• Data Engineer Jobs in Pune,India

  • ThoughtWorks, Inc.

Job Description:

ThoughtWorks India is looking for talented data engineers passionate about building large scale data processing systems to help manage the ever-growing information needs of our clients

You will be responsible for -

Creating complex data processing pipelines, as part of diverse, high energy teams

Designing scalable implementations of the models developed by our Data Scientists

Hands-on programming based on TDD, usually in a pair programming environment

Deploying data pipelines in production based on Continuous Delivery practices

Advising clients on the usage of different distributed storage and computing technologies from the plethora of options available in the ecosystem

Ideally, you should have -

4-8 years of overall industry experience

Minimum of 3 years of experience building and deploying large scale data processing pipelines in a production environment

Strong domain modelling and coding experience in Java /Scala / Python

Experience building data pipelines and data centric applications using distributed storage platforms like HDFS, S3, NoSql databases (Hbase, Cassandra, etc) and distributed processing platforms like Hadoop, Spark, Hive, Oozie, Airflow, etc in a production setting

Hands on experience in MapR, Cloudera, Hortonworks and/or Cloud (AWS EMR, Azure HDInsights, Qubole etc) based Hadoop distributionsA

Are expected to be the Architect for small and large enterprise projects On larger projects, you are expected to work closely with the fellow architects to come up with the architecture and take it further

Experience working with, or an interest in Agile Methodologies, such as Extreme Programming (XP) and Scrum

Knowledge of software best practices, like Test-Driven Development (TDD) and Continuous Integration (CI)

Strong communication and client-facing skills with the ability to work in a consulting environment is essential

Desire to contribute to the wider technical community through collaboration, coaching, and mentoring of other technologists

Profile Summary:

Employment Type : Full Time
Eligibility : Any Graduate
Industry : Software Services, Internet/Dot com/ISP
Functional Area : IT Software : Software Products & Services
Role : Software Engineer
Salary : As per Industry Standards
Deadline : 17th Mar 2020

Key Skills:

Company Profile:

Company
ThoughtWorks, Incarfix

Salary trends based on over 1 crore profiles

View Salaries

All rights reserved © 2018 Wisdom IT Services India Pvt. Ltd DMCA.com Protection Status