Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
M
mobvista-dmp
Project
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
王金锋
mobvista-dmp
Commits
ac61d839
Commit
ac61d839
authored
Oct 15, 2021
by
fan.jiang
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix momery bug btop_tiktokrv btop_tiktokrv_gaid
parent
14b970fb
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
btop_tiktokrv.sh
azkaban/dm/pseudo_package_to_other_business/btop_tiktokrv.sh
+1
-1
btop_tiktokrv_gaid.sh
...dm/pseudo_package_to_other_business/btop_tiktokrv_gaid.sh
+1
-1
No files found.
azkaban/dm/pseudo_package_to_other_business/btop_tiktokrv.sh
View file @
ac61d839
...
...
@@ -30,7 +30,7 @@ spark-submit --class mobvista.dmp.datasource.dm.BtopTiktokrv \
--conf
spark.default.parallelism
=
3000
\
--conf
spark.sql.shuffle.partitions
=
3000
\
--conf
spark.network.timeout
=
720s
\
--master
yarn
--deploy-mode
cluster
--executor-memory
8g
--driver-memory
6
g
--executor-cores
5
--num-executors
70
\
--master
yarn
--deploy-mode
cluster
--executor-memory
8g
--driver-memory
10
g
--executor-cores
5
--num-executors
70
\
../../
${
JAR
}
-begin_day
${
begin_day
}
-begin_day02
${
begin_day02
}
-end_day
${
end_day
}
-output01
${
OUTPUT_PATH01
}
-output02
${
OUTPUT_PATH02
}
-output03
${
OUTPUT_PATH03
}
-output04
${
OUTPUT_PATH04
}
-coalesce
200
...
...
azkaban/dm/pseudo_package_to_other_business/btop_tiktokrv_gaid.sh
View file @
ac61d839
...
...
@@ -29,7 +29,7 @@ spark-submit --class mobvista.dmp.datasource.dm.BtopTiktokrvGaid \
--conf
spark.sql.shuffle.partitions
=
3000
\
--conf
spark.driver.maxResultSize
=
4g
\
--conf
spark.network.timeout
=
720s
\
--master
yarn
--deploy-mode
cluster
--executor-memory
8g
--driver-memory
6
g
--executor-cores
5
--num-executors
70
\
--master
yarn
--deploy-mode
cluster
--executor-memory
8g
--driver-memory
10
g
--executor-cores
5
--num-executors
70
\
../../
${
JAR
}
-begin_day
${
begin_day
}
-begin_day02
${
begin_day02
}
-end_day
${
end_day
}
-output01
${
OUTPUT_PATH01
}
-output02
${
OUTPUT_PATH02
}
-output03
${
OUTPUT_PATH03
}
-coalesce
200
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment