Associate-Data Engineer_Gurgaon (Job Code : J45310)  

 Job Summary
Share this job on Facebook  Share this job on Twitter  Share this job on Linked In
 
Experience:
2.00 - 4.00  Years 
 
Location:
Gurgaon
 
Designation:
Associate-Data Engineer_Gurgaon
 
Degree:
BE-Comp/IT, BE-Other, BTech-Comp/IT, BTech-Other
 
Educational Level:
Graduate/Bachelors
 
Stream of Study:
 
Industrial Type:
IT-Software/Software Services
 
Functional Area:
IT Software - Application Programming / Maintenance
 
Key Skills:
Python,ETL,Pyspark,SQL
 
Job Post Date:
2022-03-25 15:54:07  
 
 

 Company Description
 
Our client provides high-quality, cost-effective research and analytical support for investment banks, private equity funds, corporates and portfolio companies around the globe. It allows clients to shift labor-intensive tasks to a flexible pool of talent, so that their in-house teams can focus on strategic initiatives and increase their capacity to take on more projects.
 

 Job Description
 
Roles and Responsibility:
• Assist with onboarding a large catalog of datasets
• Clean and normalize these datasets for downstream teams
• Develop scripts for data extraction, transformation (clean, scrub, flatten, normalize, denormalize, etc.) and
visualization
• Maintain the scripts and codes, run quality checks, and automate the pipelines

Mandatory Skills:
• Experience with designing ETL pipelines and distributed systems (Spark); Tools like – AWS, Databricks
• Development using NumPy, pandas and Pyspark; Expertise in SQL
• Experience with Cloud technologies like – Amazon S3, RedShift
• Analytical thinker with strong attention to details, good verbal and written communication skills

Secondary Skills:
• Worked on rest API to download data from different sources
• Familiarity with AWS, Airflow, MongoDB and Linux