Skill: Data Engineer (SQL + Pyspark)
Location: Hyderabad
Experience: 8-13 Years
JD:
Extensive experience in Pyspark, Msft Fabric or Azure data platforms, Azure Data factory, Databricks, Synapse or similar, SQL, Data lake storage.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments.
Define, Design & implement tools & methodologies for data correction, reconciliation & quality across multiple sources
Good understanding on Data Cleansing, Ingestion , Transformation and Visualization(Power BI) flow.
Hands on experience in design, build of the Azure Data and Analytics solutions Experience with data clean up and archival strategy