• Data Engineer - Cloud Services/Azure Jobs in Gurgaon,India - 23295404

  • Silverpeople
  • Save Job
  • 5 - 10 Years
  • Posted : above 1 month

Job Description:

Responsibilities for Data Engineer

- Create and maintain optimal data pipeline architecture

- Assemble large, complex data sets that meet functional / non-functional business requirements

- Identify, design, and implement internal process improvements automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc

- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python, Azure Data Factory, Databricks and Azure Database Technologies

- Build analytics tools using Power BI, D3 and C# that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics

- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs

- Keep our data separated and secure across projects through multiple data centers and Azure regions

- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader

- Work with data and analytics experts to strive for greater functionality in our data systems

Qualifications for Data Engineer

- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases

- Experience building and optimizing claims data pipelines, architectures/data models and data sets

- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

- Experience with the Agile workflow, Test Driven Development, andcontinuous improvement/continuous deployment

- Strong analytic skills related to working with structured and unstructured datasets

- Build processes supporting data transformation, data structures, metadata, dependency and workload management using Azure Automation, Azure Function Apps, and Azure Data Factory

- A successful history of manipulating, processing and extracting value from large disconnected datasets

- Working knowledge of Azure Automation, Azure Data Factory, and highly scalable - big data- data stores such as Azure Blob Storage, Azure Data Lake and Azure CosmosDB

- Strong project management and organizational skills

- Experience supporting and working with cross-functional teams in a dynamic environment

- We are looking for a candidate with 5+ years of experience in a Data Engineer or Data Modeler role, who has attained a Graduate degree in Software Engineering, Computer Science, Statistics, Informatics, Information Systems or another quantitative field

They should also have experience using the following software/tools

- Experience with big data tools Spark, Databricks, Parallel Data Warehouses, Cosmos DB

- Experience with building relational SQL Data Warehouses and Claims Data Models

- Experience with data pipeline and workflow management tools Azure Data Factory, SSIS

- Experience with Azure cloud services Azure Data Warehouses, Azure Automation, Azure Function Apps

- Experience with object-oriented/object function scripting languages Python, C#, Scala, VBA, etc

- Experience with systems scripting languages Batch Scripts, Powershell

- Experience with Git/GitHub and automating builds

Profile Summary:

Employment Type : Full Time
Salary : Not Mentioned
Deadline : 01st Feb 2020

Key Skills:

These are some of our most popular tutorials

People who search this job also searched for the following Keywords


Salary trends based on over 1 crore profiles

View Salaries

All rights reserved © 2018 Wisdom IT Services India Pvt. Ltd DMCA.com Protection Status