Python ETL Developer/Data Engineer - Remote job at ipvisibility Ottawa, ON, CA

Job Description

Specific Duties

-Reviewing, designing, developing ETL jobs to ingest data into Data Lake, load data to data marts;
-extract data to integrate with various business applications.
-Parse unstructured data, semi structured data such XML etc.
-Design and develop efficient Mapping and workflows to load data to Data Marts
-Map XML DTD schema in Python (customized table definitions)
-Write efficient queries and reports in Hive or Impala to extract data on ad hoc basis for data analysis.
-Identify the performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.
-Responsible for performance tuning of ETL mappings and queries.
-import tables and all necessary lookup tables to facilitate the ETL process required to process daily XML files in addition to processing the very large (multi-terabytes) historical XML data files

Job Tags

Remote work,

Similar Jobs

Summa

Soudeur(se) - assembleur(se) Job at Summa

SOUDEUR(SE) ASSEMBLEUR(SE)PRINCIPALES FONCTIONS Traage, assemblage et soudage de mtaux ouvrs. Lire et interprter des plans, des dessins et des symboles de soudage. COMPTENCES ET CRITRES DAPPLICATION Lecture de plans Connaissance de trigonomtrie et gomtrie...

Residences De L'Estuaire Inc.

Auxiliaire familial/auxiliaire familiale en milieux de vie (nuit) Job at Residences De L'Estuaire Inc.

...disponibilit du personnel-cadre. Description du poste Lauxiliaire familiale en milieu de vie joue un rle trs important chez nous. Il aide au maintien et au mieux-tre des personnes ges en perte d'autonomie et de personnes vivant avec une dficience intellectuelle ou...

ウェルビー・インターナショナル・ロス・アジャスターズ・リミテッド

【Hiroshima】Contact Center｜No experience｜JLPT N1 required Job at ウェルビー・インターナショナル・ロス・アジャスターズ・リミテッド

...

Wainbee Limited

Technicien(ne) de Service Job at Wainbee Limited

Rejoignez Wainbee! Wainbee appartient 100 % ses employs ! ce qui se reflte dans les valeurs que nous accordons nos employs et dans la manire dont nous les soutenons. En tant que Technicien de Service / Mcanicien chez Wainbee, vous pouvez vous attendre des avantages...

Vancouver Sign Group Canada

Project Manager - Signage and Printing - City of Vancouver Major Sporting Event Job at Vancouver Sign Group Canada

...dressing and wayfinding signage for a Major Sporting Event for the City of Vancouver! Vancouver Sign Group is a leader in the sign... ...with one very important person that we are in search for, Project Manager! As a Project Manager, and a member of our team you should:...