Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
AppTag
Project
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
dataplatform
AppTag
Commits
e193136c
Commit
e193136c
authored
6 years ago
by
wangjf
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix
parent
7e6fff30
master
No related merge requests found
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
7 additions
and
3 deletions
+7
-3
app_start.sh
azkaban/app_start.sh
+2
-1
app_start.sql
azkaban/app_start.sql
+5
-2
No files found.
azkaban/app_start.sh
View file @
e193136c
...
...
@@ -2,6 +2,6 @@
DT
=
$(
date
+%Y%m%d
-d
"-1 day
$ScheduleTime
"
)
LAST_DT
=
$(
date
+%Y%m%d
-d
"-
7
day
$DT
"
)
LAST_DT
=
$(
date
+%Y%m%d
-d
"-
30
day
$DT
"
)
hive
-hivevar
dt
=
${
DT
}
-hivevar
last_dt
=
${
LAST_DT
}
-f
app_start.sql
\ No newline at end of file
This diff is collapsed.
Click to expand it.
azkaban/app_start.sql
View file @
e193136c
...
...
@@ -5,10 +5,13 @@ SET mapreduce.map.memory.mb=4096;
SET
mapreduce
.
map
.
java
.
opts
=-
Xmx8192m
;
SET
mapreduce
.
reduce
.
memory
.
mb
=
4096
;
SET
mapreduce
.
reduce
.
java
.
opts
=-
Xmx8192m
;
SET
hive
.
mapred
.
mode
=
nonstrict
;
DROP
TABLE
IF
EXISTS
package_num
;
CREATE
TABLE
package_num
AS
SELECT
package_name
,
count
(
1
)
install_num
FROM
dwh
.
dm_install_list_v2
WHERE
dt
=
'${dt}'
GROUP
BY
package_name
HAVING
count
(
1
)
>
30000
ORDER
BY
install_num
DESC
LIMIT
5000
;
CREATE
TABLE
package_num
AS
SELECT
d
.
package_name
,
count
(
1
)
install_num
FROM
dwh
.
dm_install_list_v2
d
,
dwh
.
dim_package_tags
t
WHERE
d
.
dt
=
'${dt}'
AND
d
.
update_date
BETWEEN
'${LAST_DT}'
AND
'${dt}'
AND
d
.
package_name
<>
t
.
package_name
GROUP
BY
d
.
package_name
HAVING
count
(
1
)
>
30000
ORDER
BY
install_num
DESC
LIMIT
5000
;
DROP
TABLE
IF
EXISTS
package_info
;
CREATE
TABLE
package_info
AS
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment