Urgent requirement of AWS Data Engineer - Contract - Sydney

Requirements

Key Responsibilities:

• Design and implement scalable data pipelines using Python or PySpark, and boto3
• Integrate with Amazon Redshift for data warehousing and perform data ingestion and transformation tasks
• Work with Amazon S3 to architect and manage data lakes
• Build and manage batch processing jobs using AWS Glue, EMR, and Lambda
• Support streaming data workflows using Amazon Kinesis
• Leverage AWS Secrets Manager and KMS for secure data handling and encryption
• Write efficient SQL for data querying, transformations, and performance tuning
• Collaborate with data engineering, product, and DevOps teams to deliver end-to-end solutions
• Participate in code reviews, debugging, and testing activities to ensure high-quality software ...