Job description

Role: Azure Data Engineer

Experience: 3-5 Years

Skill set:

Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory

Roles and Responsibilities:

Should have programming skills with the ability to write optimized and reusable high-quality code.

Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, SQL.

Optimize SQL queries for efficient data extraction and manipulation.

Demonstrate expertise in Databricks including workflow management and data exploration.

Collaborate with cross functional teams to understand the business requirements.

Implement best practices for data pipelines optimization, ETL, and query performance.

Create and maintain documentations for data pipelines and workflows.

Troubleshoot and resolve issues in data pipelines, ensurin...