• Data Engineer - Spark/AWS Jobs in Bangalore,India

  • Allegis Group
  • Save Job
  • 2 - 8 Years
  • Posted : above 1 month

Job Description:


- Design and build reusable components, frameworks and libraries at scale to support analytics products

- Design and implement product features in collaboration with business and Technology stakeholders

- Anticipate, identify and solve issues concerning data management to improve data quality

- Clean, prepare and optimize data at scale for ingestion and consumption

- Implement complex automated workflows and routines using workflow scheduling tools

- Build continuous integration, test-driven development and production deployment frameworks

- Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards

- Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues


- Hands on experience building cloud scalable, real time and high-performance data lake solutions leveraging AWS, EMR, S3, Hive & Spark

- Experience with relational SQL

- Experience with scripting languages such as Shell, Python

- Experience with source control tools such as GitHub and related dev process

- Experience with workflow scheduling tools like Airflow

- Strong understanding of developing complex data solutions

- Willing to learn new skills and technologies

- Has a passion for data solutions

- Strong understanding of data structures and algorithms

- Has a strong problem solving and analytical mindset

- Able to quickly pick up new programming languages, technologies, and frameworks

Profile Summary:

Employment Type : Full Time
Salary : Not Mentioned
Deadline : 07th Jan 2020

Key Skills:

Taking these free online tutorials can help you get your next job

People who search this job also searched for the following Keywords

Salary trends based on over 1 crore profiles

View Salaries

All rights reserved © 2018 Wisdom IT Services India Pvt. Ltd DMCA.com Protection Status