Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
AppTag
Project
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
dataplatform
AppTag
Commits
1298bb46
Commit
1298bb46
authored
6 years ago
by
wangjf
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix
parent
fbd9a0dc
No related merge requests found
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
15 additions
and
8 deletions
+15
-8
azkaban.zip
azkaban.zip
+0
-0
app_end.job
azkaban/app_end.job
+5
-0
app_end.sh
azkaban/app_end.sh
+0
-6
app_start.job
azkaban/app_start.job
+2
-2
app_start.sh
azkaban/app_start.sh
+8
-0
app_start.sql
azkaban/app_start.sql
+0
-0
No files found.
azkaban.zip
0 → 100644
View file @
1298bb46
File added
This diff is collapsed.
Click to expand it.
azkaban/app_end.job
0 → 100644
View file @
1298bb46
type=command
retries=3
dependencies=app_start
command=sh -x app_end.sh
\ No newline at end of file
This diff is collapsed.
Click to expand it.
azkaban/app_
tag
.sh
→
azkaban/app_
end
.sh
View file @
1298bb46
#!/usr/sh
DT
=
$(
date
+%Y%m%d
-d
"-1 day
$ScheduleTime
"
)
LAST_DT
=
$(
date
+%Y%m%d
-d
"-7 day
$DT
"
)
hive
-hivevar
dt
=
${
DT
}
-hivevar
last_dt
=
${
LAST_DT
}
-f
app_tag.sql
sqoop
export
--connect
jdbc:mysql://dataplatform-app-tag.c5yzcdreb1xr.us-east-1.rds.amazonaws.com:3306/app_tag
\
--username
apptag_rw
--password
7gyLEVtkER3u8c9
--table
tag_list
--columns
"package_name,app_name,platform,category,url,install"
\
--export-dir
s3://mob-emr-test/dataplatform/DataWareHouse/dwh.db/package_list
--input-fields-terminated-by
'\001'
--update-mode
allowinsert
--update-key
package_name
...
...
This diff is collapsed.
Click to expand it.
azkaban/app_
tag
.job
→
azkaban/app_
start
.job
View file @
1298bb46
type=command
retries=3
command=sh -x app_tag.sh
\ No newline at end of file
command=sh -x app_start.sh
\ No newline at end of file
This diff is collapsed.
Click to expand it.
azkaban/app_start.sh
0 → 100644
View file @
1298bb46
#!/usr/sh
DT
=
$(
date
+%Y%m%d
-d
"-1 day
$ScheduleTime
"
)
LAST_DT
=
$(
date
+%Y%m%d
-d
"-7 day
$DT
"
)
hive
-hivevar
dt
=
${
DT
}
-hivevar
last_dt
=
${
LAST_DT
}
-f
app_start.sql
\ No newline at end of file
This diff is collapsed.
Click to expand it.
azkaban/app_
tag
.sql
→
azkaban/app_
start
.sql
View file @
1298bb46
File moved
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment