• Lead Data Engineer - Hadoop/Hive/Spark/Kafka Jobs in Bangalore,India - 23776331

  • Catalyst Solutions
  • Save Job
  • 5 - 8 Years
  • Posted : above 1 month

Job Description:

Key Responsibilities

- Focus on scalability, performance, service robustness, and cost trade-offs

- Continuous drive to explore, improve, enhance, automate, and optimise systems and tools to best meet evolving business and market needs

- Attention to detail, coupled with ability to think abstractly

- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader

- Create prototypes and proof-of-concepts for iterative development

- Keen to learn new technologies and apply the knowledge in production systems

- Take complete ownership of projects and their development cycle

Technical Requirements

- Experience with big data tools Hadoop, Spark, Kafka, fink, Hive, Sqoop etc

- Experience with relational SQL and NoSQL databases like Mysql, Postgres, Mongodb and Cassandra

- Experience with data pipeline tools like Airflow, etc

- Experience with AWS cloud services EC2, S3, EMR, RDS, Redshift, BigQuery

- Experience with stream-processing systems Storm, Spark-Streaming, Flink etc

- Experience with object-oriented/object function scripting languages Python, Java, C++, Scala, etc

- Expertise in design / developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks

Profile Summary:

Employment Type : Full Time
Salary : Not Mentioned
Deadline : 08th Apr 2020

Key Skills:

Why not try out our free online tutorials and gain an edge?

People who search this job also searched for the following Keywords


Salary trends based on over 1 crore profiles

View Salaries

All rights reserved © 2018 Wisdom IT Services India Pvt. Ltd DMCA.com Protection Status