Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
M
mobvista-dmp
Project
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
王金锋
mobvista-dmp
Commits
afb611c4
Commit
afb611c4
authored
Jul 07, 2021
by
wang-jinfeng
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix RTDmpMainPre
parent
ba33fc72
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
RTDmpMainPre.scala
...in/scala/mobvista/dmp/datasource/rtdmp/RTDmpMainPre.scala
+3
-1
No files found.
src/main/scala/mobvista/dmp/datasource/rtdmp/RTDmpMainPre.scala
View file @
afb611c4
...
...
@@ -130,7 +130,7 @@ class RTDmpMainPre extends CommonSparkJob with Serializable {
}).union(newAudience) // 与最新的人群包进行合并操作
*/
newAudience
}
else
{
}
else
if
(
dmap
.
size
==
1
)
{
val
audData
=
dmap
.
toList
.
sortWith
(
_
.
_2
>
_
.
_2
).
take
(
1
)
val
pathUri
=
new
URI
(
audData
.
get
(
0
).
_1
)
if
(
audData
.
nonEmpty
&&
FileSystem
.
get
(
new
URI
(
s
"${pathUri.getScheme}://${pathUri.getHost}"
),
sc
.
hadoopConfiguration
)
...
...
@@ -151,6 +151,8 @@ class RTDmpMainPre extends CommonSparkJob with Serializable {
}
else
{
// 如果没有,则创建 空RDD
sc
.
emptyRDD
[(
String
,
Int
)]
}
}
else
{
sc
.
emptyRDD
[(
String
,
Int
)]
}
// 所有人群包进行合并操作
mergeRDD
=
mergeRDD
.
union
(
updateRDD
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment