Data Engineer

Our client is looking for Data Engineers that have Python/SQL and are able to cloud code correctly.

Responsibilities

• Transforming, testing, visualizing and documenting data.
• Develop, construct, test, and maintain efficient data pipelines using Python and SQL.
• Design and implement cloud-based data solutions on platforms such as AWS, Azure, or Google Cloud.
• Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
• Ensure data quality, integrity, and security across all systems.
• Optimize data workflows for performance and scalability.
• Document data processes and maintain best practices for cloud coding.
• Curate and validate omics metadata using structured workbooks and controlled vocabularies.
• Run CLI-based workflows to upload metadata and processed data into databases.
• Write SQL, shell, and Python scr...