Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

RmxRdUFOY211ZWNubDVCSEVyVlA3dDF4bHc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Sought Peninsula Hospital

DISHWASHER ( REQ 3976) Job at Sought Peninsula Hospital

 ...Dietary Dishwasher must posses a State of Alaska Food Worker's Card within 30 days of employment.ENVIRONMENT:The South Peninsula Hospital is a combination 22 bed acute care hospital and a 28 bed nursing home located at the southern end of the Kenai Peninsula. The... 

Blair Hill Inn

Innkeeper & General Manager Job at Blair Hill Inn

 ...91, it is now a finely restored boutique hotel with exquisite dcor and exceptional service...  ...experiences.They are responsible for managing staff, maintaining budgets, implementing...  .... In essence, the hotel innkeeper & general manager is the driving force behind the hotel... 

Schlumberger

Tig Welder & Assembly Technician Job at Schlumberger

 ...oversight.+ Reviews engineering drawings and specifications to plan welding operations where procedural information is unavailable.+ Assemble and install parts on products per production instructions, procedures and drawings, and execute tasks including but not limited to... 

LTA Kids Center

Summer Camp English Teacher Job at LTA Kids Center

 ...English Lauguage, math, sience, paiting, story time, handwork, singing, etc. 2 lessons in the morning, 1 in the afternoon. Chinese teachers will support around. We have Dance class and Taekwondo classe which tought by professional teachers.4.Writing comments on daily... 

Aurelian

Implementation Specialist Job at Aurelian

Role Overview As an Implementation Specialist , youll play a critical role in ensuring our customers have a smooth, successful onboarding experience. You'll act as the bridge between our engineering team and our customers managing the setup, configuration, and launch...