Skip to content

M
mobvista-dmp
Commit 26bfd9e2 by jinfeng.wang
Options

Update rtdmp_merge.sh,waitting write partition

parent 0a3bf7ea
Showing with 2 additions and 0 deletions
azkaban/rtdmp/rtdmp_merge.sh
...@@ -36,6 +36,8 @@ MERGE_INPUT="s3://mob-emr-test/dataplatform/DataWareHouse/data/dwh/audience_merg ...@@ -36,6 +36,8 @@ MERGE_INPUT="s3://mob-emr-test/dataplatform/DataWareHouse/data/dwh/audience_merg
check_await ${MERGE_INPUT}/_SUCCESS check_await ${MERGE_INPUT}/_SUCCESS
sleep 120
OUTPUT="s3://mob-emr-test/dataplatform/DataWareHouse/data/dwh/audience_merge/${date_path}" OUTPUT="s3://mob-emr-test/dataplatform/DataWareHouse/data/dwh/audience_merge/${date_path}"
spark-submit --class mobvista.dmp.datasource.rtdmp.RTDmpMerge \ spark-submit --class mobvista.dmp.datasource.rtdmp.RTDmpMerge \
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment