Summary:The main function of an AI Data Engineer is to construct and maintain data pipelines, ETL processes, and data storage systems to facilitate efficient data collection, processing, and analysis. They ensure data quality and accessibility for data-driven decision-making, collaborating closely with data scientists and analysts.
Responsibilities: Drive critical initiatives to help our data platform scale to the needs of business priorities and technology advancements. Build scalable data models and data pipelines to extract, load, and transform data, ensuring secure data storage with a focus on data quality and compliance on Azure using services such as ADF, HDI, Databricks, Synapse, and Fabric. Play a critical role in developing and building datasets and integrating with AI/ML and Co-Pilot applications. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions...