Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
M
mobvista-dmp
Project
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
王金锋
mobvista-dmp
Commits
267e4a1a
Commit
267e4a1a
authored
Jun 21, 2021
by
wang-jinfeng
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix adn_sdk_v2_install_v2
parent
750ce035
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
7 deletions
+8
-7
adn_sdk_v2_install_v2.sh
azkaban/adn_sdk/adn_sdk_v2_install_v2.sh
+8
-7
No files found.
azkaban/adn_sdk/adn_sdk_v2_install_v2.sh
View file @
267e4a1a
...
...
@@ -23,8 +23,16 @@ REDUCE_NUM=$(calculate_reduce_num ${INPUT_PATH})
hadoop jar ../
${
JAR
}
mobvista.dmp.main.ParseInstallRCFile
\
-Dmapreduce
.fileoutputcommitter.algorithm.version
=
2
\
-Dmapreduce
.map.memory.mb
=
3072
\
-Dmapreduce
.map.java.opts
=
-Xmx2458m
\
-Dmapreduce
.reduce.memory.mb
=
3072
\
-Dmapreduce
.reduce.java.opts
=
-Xmx2458m
\
${
INPUT_PATH
}
${
OUTPUT_PATH
}
${
REDUCE_NUM
}
if
[[
$?
-ne
0
]]
;
then
exit
255
fi
:
'
business="adn_sdk"
...
...
@@ -41,13 +49,6 @@ spark-submit --class mobvista.dmp.datasource.dm.DmInstallListOrc \
../${JAR} \
-output ${OUTPUT_PATH} -input ${INPUT_PATH} -business ${business}
'
if
[[
$?
-ne
0
]]
;
then
exit
255
fi
mount_partition
"dm_install_list_v2"
"dt='
$LOG_TIME
', business='adn_sdk_v2'"
"
$OUTPUT_PATH
"
if
[[
$?
-ne
0
]]
;
then
exit
255
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment