Job Title: Big Data ETL Developer
Primary Skill: Big Data ETL
Location: Mississauga, ON
Job Type: Full-Time (Hybrid)
Job Description:
We are seeking a skilled Big Data ETL Developer to design, develop, and maintain large-scale data pipelines and ETL processes. The candidate will work with big data technologies to process, transform, and manage large volumes of structured and unstructured data.
Key Responsibilities:
-
Design and develop ETL pipelines for big data processing.
-
Work with big data technologies such as Hadoop, Spark, and Hive.
-
Extract, transform, and load data from multiple sources into data platforms.
-
Optimize data processing workflows and ETL jobs for performance and scalability.
-
Collaborate with data engineers, analysts, and business teams to support data requirements.
-
Ensure data quality, integrity, and governance.
-
Troubleshoot ETL failures and performance issues.
-
Document data pipelines and technical processes.
Required Skills & Qualifications:
-
Strong experience in Big Data and ETL development.
-
Proficiency in SQL, Python, or Scala.
-
Hands-on experience with Hadoop ecosystem tools (Spark, Hive, HDFS).
-
Experience with data pipeline orchestration tools.
-
Knowledge of data warehousing and big data architecture.
-
Strong analytical and problem-solving skills.
Preferred Qualifications:
-
Experience with cloud data platforms such as AWS, Azure, or GCP.
-
Familiarity with Kafka or real-time data streaming technologies.
-
Experience with CI/CD pipelines and data engineering best practices.