• LeadData Pipeline Engineer Jobs in Bangalore,India - 25738986

  • Human Forte

Job Description:

What Youll Do

You will join our Data Ops Engineering as a Lead data ops engineer working with a team of like-minded experts responsible for optimizing and support our rapidly growing data infrastructure Collecting from various feeds and using your experience in building Kafka data pipelines you will develop and maintain Python/Java software in AWS Lambda in order to transform and enrich the streaming data into Database/Data lake to aggregate, calculate, monitor and alert on cloud calling metrics We are looking for Agile development, demonstrable results, rapid improvements

Whom Youll Work With

Our team includes 2 developers and architects from the vertical You will work at the heart of building a data pipeline with Kafka engaging with architecture and data engineers as you work in an agile development environment

Who You Are


  • As a Data Ops Engineer, you love being a problem solver, translating requirements into data metrics and schemas that are easy to understand Strong interpersonal skills, enabling you to guide people through conversations to collect the information you need Naturally, you are a flexible, conscientious, independent worker, capable of learning new products and technologies with the following technical skills

  • Experience of designing system from ground up

  • Good knowledge of Data structures and algorithms

  • Working knowledge in Python and/or Java

  • Experience with building Data Pipelines from the ground up

  • Proven experience with Kafka - Producer, Consumer, and Streams API

  • Knowledge with KSteam, KSQL, Schema registry will be a plus

  • Proven with streaming and batch data processing

  • Proficient in transferring unstructured into structured data

  • Ability to build and maintain optimal data pipeline arc

Skills
JAVA, PYTHON, MYSQL, KAFKA, SPARK
,

Profile Summary:

Employment Type : Full Time
Industry : IT - Software
Salary : Not Disclosed
Deadline : 26th Jul 2020

Key Skills:

People who search this job also searched for the following Keywords

Salary trends based on over 1 crore profiles

View Salaries

All rights reserved © 2020 Wisdom IT Services India Pvt. Ltd DMCA.com Protection Status