ATLAS-2891: updated hook notification processing with option to ignore potentially incorrect hive_column_lineage

(cherry picked from commit 20215f3dd74b16fe4a7a9c8eb21b17925256f4f9)

ATLAS-2751: Atlas is not consuming messages from ATLAS_HOOK topic after recovering from zookeeper connection timeout.

Signed-off-by: Ashutosh Mestry <amestry@hortonworks.com>

ATLAS-2421: updated Atlas notificaiton module to support V2 data structures; updated HBase hook to use V2 notifications

(cherry picked from commit 86c9b19316245c47301e5212552c35d362479fc7)

ATLAS-2265: upgrade Jackson library version from 1.9.13 to 2.9.2, to be in sync with dependent Hadoop projects

ATLAS-2251: Remove TypeSystem and related implementation, to avoid unncessary duplicate of type details in cache

Signed-off-by: Madhan Neethiraj <madhan@apache.org>

ATLAS-2075: notification enhancement to handle large messages, using compression and multi-part messages (#2)

(cherry picked from commit 28941bfe7220fc0cf09d138e79e18d5e0a82c367)

ATLAS-2075: notification enhancement to handle large messages, using compression and multi-part messages

(cherry picked from commit 99243ee8e18656acd72601468c99e7781a0b04f7)

Signed-off-by: David Radley <david_radley@uk.ibm.com>

Change-Id: I07cbe1955cd08005660f5189f30f0690809ce1b1
Signed-off-by: Madhan Neethiraj <madhan@apache.org>

ATLAS-1908: updated NotificationConsumer with a method removed earlier to avoid breaking existing usage (like in Ranger)

Change-Id: Ib8a7f338da7fd0f710fc683da87871e3d9c32035
Signed-off-by: Madhan Neethiraj <madhan@apache.org>

ATLAS-1908: updated to use existing Kafka consumer properties when equivalent new Kafka consumer properties are not present
Signed-off-by: Madhan Neethiraj <madhan@apache.org>

ATLAS-1766: updated NotificationConsumer implementation to use new Kafka Consumer API, to enable support for SASL_SSL protocol
Signed-off-by: Madhan Neethiraj <madhan@apache.org>

Signed-off-by: Madhan Neethiraj <madhan@apache.org>

ATLAS-1546: Changed to LOG.warn instead error in Hive hook should choose appropriate JAAS config if host uses kerberos ticket-cache (nixonrodrigues via kevalbhatt)

ATLAS-1546 : Fix for styleCheck error in Hive hook should choose appropriate JAAS config if host uses kerberos ticket-cache

Signed-off-by: Madhan Neethiraj <madhan@apache.org>

Signed-off-by: Madhan Neethiraj <madhan@apache.org>

Signed-off-by: Madhan Neethiraj <madhan@apache.org>

ATLAS-1129 Remove notification failed logs on retry and add sleep between retries (svimal2106 via sumasai)

ATLAS-1111 Data loss is observed when atlas is restarted while hive_table metadata ingestion into kafka topic is in-progress(shwethags via sumasai)