Job Title: Azure Databricks Developer
Primary Skill: Azure Databricks
Location: Toronto, ON
Job Type: Full-Time (Onsite / Hybrid)
Job Description:
We are seeking an experienced Azure Databricks Developer to build and maintain scalable data processing solutions on the Azure cloud platform. The ideal candidate will work with big data technologies, develop data pipelines, and support advanced analytics and data engineering initiatives.
Key Responsibilities:
Design, develop, and maintain data pipelines using Azure Databricks.
Work with Apache Spark, Python, and SQL for large-scale data processing.
Integrate data from multiple sources using Azure Data Factory and Azure Data Lake.
Optimize Spark jobs and data workflows for performance and scalability.
Collaborate with data engineers, analysts, and business teams to deliver data solutions.
Implement ETL/ELT processes and data transformation logic.
Ensure data quality, governance, and security best practices.
Troubleshoot and resolve performance or processing issues.
Required Skills & Qualifications:
Strong hands-on experience with Azure Databricks and Apache Spark.
Proficiency in Python, PySpark, and SQL.
Experience with Azure Data Factory, Data Lake, and Synapse.
Knowledge of big data architecture and ETL/ELT pipeline development.
Strong analytical and problem-solving skills.
Experience working in cloud-based data environments.
Preferred Qualifications:
Azure certification such as Azure Data Engineer Associate.
Experience with CI/CD pipelines and DevOps practices.
Familiarity with Power BI or other data visualization tools.