Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TWVjYU10cktTbkN1S3NPN3NnSU5EWVozdlE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Insero Talent Solutions

Assistant Construction Project Manager Job at Insero Talent Solutions

 ...Insero Talent Solutions is recruiting an Assistant Construction Project Manager for a fast growing construction company in Rochester, NY. The Assistant Project Manager is responsible for supporting an assigned portfolio of electrical projects. This includes quoting... 

Sugaring NYC

Waxing Specialist/Esthetician Job at Sugaring NYC

About the Job: Pay: Base $11/hr + great tips + membership bonuses + product bonuses + other great incentives! Your books fill up quickly! Our Location: 3420 Main St Suite 400, Frisco, TX 75033. Brand new location so books will fill up quickly, located in an...

K.A. Recruiting, Inc.

Medical Laboratory Scientist or Medical Technologist Job at K.A. Recruiting, Inc.

CLINICAL LABORATORY SCIENTIST NEEDED ON OREGON COAST full time, permanent position extremely competitive pay excellent benefits gorgeous, scenic location on Pacific coast generalist position great area for those who love spending time on the water DON"T WAIT! Click... 

Compass Group

EXECUTIVE STEWARD (FULL TIME AND PART TIME) Job at Compass Group

 ...We are hiring immediately for full time and part time EXECUTIVE STEWARD positions. Location : Case Western Reserve - 1619 Mistletoe Road, Cleveland, Ohio 44106. Note: online applications accepted only . Schedule :Full time and part time schedules; Days... 

Auto Glass Perfections

Virtual Chat Assistant Job at Auto Glass Perfections

Job Description: Virtual Chat Assistant Position: Virtual Chat Assistant Job Type: Full-Time/Part-Time Location: Remote (Work from Home) Reports To: Customer Support Manager About the Role: We are looking for a Virtual Chat Assistant to join our dynamic...