Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
M
mobvista-dmp
Project
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
王金锋
mobvista-dmp
Commits
23ca0443
Commit
23ca0443
authored
3 years ago
by
WangJinfeng
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
set default-image
parent
3d9c4d26
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
0 additions
and
2 deletions
+0
-2
joypac_result_etl.sh
azkaban/joypac/joypac_result_etl.sh
+0
-1
joypc_sdk_daily.sh
azkaban/joypac/joypc_sdk_daily.sh
+0
-1
No files found.
azkaban/joypac/joypac_result_etl.sh
View file @
23ca0443
...
...
@@ -26,7 +26,6 @@ spark-submit --class mobvista.dmp.datasource.joypac.JoypacResultEtl \
--conf
spark.network.timeout
=
720s
\
--conf
spark.default.parallelism
=
20
\
--conf
spark.hadoop.mapreduce.input.fileinputformat.input.dir.recursive
=
true
\
--conf
spark.kubernetes.container.image
=
818539432014.dkr.ecr.us-east-1.amazonaws.com/engineplus/spark:engineplus-2.0.3-free
\
--conf
spark.hadoop.fs.s3.impl
=
org.apache.hadoop.fs.s3a.S3AFileSystem
\
--conf
spark.hadoop.fs.s3a.impl
=
org.apache.hadoop.fs.s3a.S3AFileSystem
\
--master
yarn
--deploy-mode
cluster
--name
JoypacResutlEtl
\
...
...
This diff is collapsed.
Click to expand it.
azkaban/joypac/joypc_sdk_daily.sh
View file @
23ca0443
...
...
@@ -26,7 +26,6 @@ hadoop fs -rm -r "$OUTPUT_PATH/"
spark-submit
--class
mobvista.dmp.datasource.joypac.JoypcSdkDaily
\
--conf
spark.yarn.executor.memoryOverhead
=
2048
--conf
spark.network.timeout
=
720s
\
--conf
spark.hadoop.mapreduce.input.fileinputformat.input.dir.recursive
=
true
\
--conf
spark.kubernetes.container.image
=
818539432014.dkr.ecr.us-east-1.amazonaws.com/engineplus/spark:engineplus-2.0.3-free
\
--conf
spark.hadoop.fs.s3.impl
=
org.apache.hadoop.fs.s3a.S3AFileSystem
\
--conf
spark.hadoop.fs.s3a.impl
=
org.apache.hadoop.fs.s3a.S3AFileSystem
\
--master
yarn
--deploy-mode
cluster
--name
joypc_sdk_daily
\
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment