Commit c9ec291d by fan.jiang

fix reyun_daily.sh

parent 911d96f8
......@@ -24,6 +24,7 @@ hadoop fs -rm -r "${OUTPUT_PATH}"
spark-submit --class mobvista.dmp.datasource.reyun.ReyunDaily \
--conf spark.network.timeout=720s \
--conf spark.sql.mapKeyDedupPolicy=LAST_WIN \
--conf spark.driver.maxResultSize=4g \
--conf spark.default.parallelism=2000 \
--conf spark.sql.shuffle.partitions=2000 \
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment