Job Type: Contract

Job Category: IT

Job Description

Job Title: AWS Data Engineer

Location: Irvine, CA (Onsite)
Type: Contract

Role Summary

We are seeking an experienced AWS Data Engineer with strong expertise in cloud-based data pipelines, ETL development, and modern orchestration tools. The ideal candidate will have hands-on skills in AWS, Python, ETL frameworks, Airflow, and familiarity with OpenAI-based integrations, as well as experience with Harness and Helix for CI/CD and version control.

Key Responsibilities

• Design, build, and optimize ETL/ELT pipelines on AWS.
• Develop data processing workflows using Python and AWS-native tools.
• Build and orchestrate pipelines using Apache Airflow.
• Integrate and utilize OpenAI APIs within data workflows (preferred).
• Implement CI/CD pipelines using Harness.
• Work with version control and configuration tools such as Helix.
• Ensure data quality, reliability, and performance across data systems.
• Collaborate with data architects, analysts, and business stakeholders.
• Troubleshoot issues and optimize pipeline performance.

Required Skills

• Strong hands-on experience with AWS services: S3, Lambda, Glue, EMR, Redshift, Aurora, IAM, CloudWatch, etc.
• Proficient in Python for data engineering tasks.
• Experience designing scalable ETL/ELT pipelines.
• Solid experience with Apache Airflow.
• Exposure to/Experience with OpenAI integrations.
• Experience using Harness for deployment automation.
• Experience with Helix (Perforce) for code versioning.
• Strong understanding of data modeling and warehouse concepts.

Required Skills