Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TWVjYU10cktTbkN1S3NPN3NnSU5EWVozdlE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Eastlake Performance

Sports Performance Personal Trainer Job at Eastlake Performance

 ...Performance: Eastlake Performance is a thriving athletic training studio that provides clients with a winning edge in their respective sports or individual goals. Each client is taken through a comprehensive assessment and continually tracked on individual progress. Our... 

Ahoskie Health and Rehab

Licensed Practice Nurse (LPN)-Weekend Champions Job at Ahoskie Health and Rehab

 ...Position The primary purpose of your position is to provide direct nursing care to the residents, and to supervise the day-to-day nursing...  ...accredited college or university, or graduate from an approved LPN/LVN/RN program. Experience ~ Not applicable. On-the-job... 

Visa

Manager, Data Governance Platform Job at Visa

 ...Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay... 

Professional Packaging Systems

Sales Executive Job at Professional Packaging Systems

 ...difference with over 1,000 team players, please read on. National Sales ManagerJob SummaryTo sell packaging materials, packaging...  ...every industry, including e-commerce, retail and wholesale food, snack, beverage, specialty manufacturing, fresh produce, hobby... 

Luxottica

Licensed Optician - NEW STORE OPENING Job at Luxottica

Requisition ID:914485 Store # :004663 Target Optical Position: Full-Time Total Rewards: Benefits/Incentive Information At Target Optical, we love the neighborhoods we belong to and thats why we care for them. By listening and building relationships ...