Azure Data Engineer

EY

  • Onsite
  • Pune
  • Full Time
  • 4+ Years
  • ETL/Data
  • Azure Services
  • Pipelines using Azure Data Factory
  • Apache Spark
  • Azure Databricks
  • Azure Cosmos DB
  • Pyspark
  • Spark SQL
  • Python/Scala
Apply Now

Primary Skills

  • Experience in building ETL/data warehouse transformation processes using Azure Services
  • · Direct experience building data pipelines using Azure Data Factory and Apache Spark on Azure Databricks.
  • · Hands-on experience designing and delivering solutions using Azure Storage, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure Cosmos DB.
  • Hand- on experience in Pyspark, Spark SQL, Python/Scala

Roles and Responsibilities

  • Data Engineering Leadership: Lead a team of data and visualization engineers in designing and implementing high-performance data ingestion pipelines from multiple sources using Spark Databricks. Develop scalable and reusable frameworks for the ingestion and enrichment of datasets.
  • End-to-End Data Pipeline: Develop integrated end-to-end data pipelines to ensure the quality and consistency of data from source systems to target data repositories.
  • Recruitment and Team Building: Identify skill sets required and gaps in the team. Work with support services to staff the team, accordingly, including recruitment for large specific demands.
  • Delivery Execution Framework: Define or modify a delivery execution framework based on patterns observed in incidents within the team.
  • Stakeholder Interaction and Project Management: Manage the overall delivery of projects, prepare project plans, identify risks, and propose mitigation approaches. Interact significantly with stakeholders from clients and provide estimations for project delivery (cost and timelines) based on RFPs.

Good to Have

  • Analytics and Visualization: Design and develop tabular models for a highly performant semantic layer capable of handling high concurrency and low latency.
  • Develop Power BI dashboards with NPS scores that are scalable and easy to maintain. Azure DevOps and CI/CD: Define release plans, deployment schedules, cutover plans, and rollback plans, ensuring the team follows best practices of Azure DevOps for CI/CD.

Qualfiations:

  • 4+ years of relevant experience working end-to-end on cloud analytics platforms.

  • Excellent communication skills and decision-making ability to confidently drive projects towards success.

Posted By :

Sheetal G
Assistant Manager

Seasoned HR professional with 8+ years of experience in talent acquisition, employee relations, and HR operations. Proven ability to build high-performing teams and foster a positive work culture.

Similar Jobs

Scrum Master

EY

Data Modeller

EY