ATLAS-2891: updated hook notification processing with option to ignore potentially incorrect hive_column_lineage

(cherry picked from commit 20215f3dd74b16fe4a7a9c8eb21b17925256f4f9)