Job Description
Job Description
Insight Global is seeking a Data Engineer to join a large payor/provider. This person will be responsible to:
• Design, develop, and implement end-to-end data solutions using Azure Databricks.
• Convert current SQL to Python code in Databricks.
• Modify and maintain data pipelines.
• Write, test, and optimize PySpark and SQL scripts to transform and load high volumes of structured data.
• Update or maintain existing data pipelines in a production setting.
• Ensure data quality and integrity by implementing data validation and cleansing processes.
• Demonstrate strong verbal communication and critical thinking skills, working well within a team environment and not being afraid to speak up.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified cand...