Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TWVjYU10cktTbkN1S3NPN3NnSU5EWVozdlE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Courtyard Noblesville

Hotel Housekeeper Job at Courtyard Noblesville

 ...their home away from home, be it for a night or a week, and its perfect. Everything...  ...good hands while staying with us. As a Hotel Housekeeper, your contribution helps ensure guests...  ...Associate DiscountsSchedule: * Day Shifts* Weekend Availability* Flexible... 

Continuing Healthcare Forest Hills LLC

Receptionist/weekends only Job at Continuing Healthcare Forest Hills LLC

 ...pm. Work 16 hours and get paid for 20 hours. Start and end times are flexible based on community need. This position may require a weekend rotation depending on community. Full Time Benefits include but are not limited to: Health, Dental, Vision, and Voluntary insurance... 

Fujis Totes, LLC

Executive Assistant Director Job at Fujis Totes, LLC

 ...An EA assists with the following plus other items as needed Day-to-day activities which include ensuring the completion of a to do list that is created and kept daily. Complete ad hoc requests that occur daily in this multi-dimensional business. Run errands, schedule... 

BD (Becton, Dickinson and Company)

Associate Director, Regulatory Affairs - Hybrid Job at BD (Becton, Dickinson and Company)

**Job Description Summary**As Associate Director of Regulatory Affairs, you will lead regulatory activities for new product development,...  ...support recognition of associates' progress, ranging from entry level to experts in their field, and talent mobility. There are many... 

Hale Akua Garden Farm

Experienced Fish farm & organic farm worker - Must be currently living in Maui Job at Hale Akua Garden Farm

 ...Position available for an Experienced Fish farm Worker and farm worker for Organic Farm on Maui, hard-working and enthusiastic. We are looking for part-time work helping to maintain the farm, and other farm responsibilities. Farm operations include: organic gardening,...