Job Type: Contract

Job Category: IT

Job Description

Job Title: Azure Databricks Developer (Python, PySpark, SQL)
Duration: Long-Term Contract

Job Description:
We are seeking an experienced Azure Databricks Developer with strong expertise in Python, PySpark, and SQL to join our team in Pittsburgh, PA. The ideal candidate will have hands-on experience building and optimizing data pipelines, working with large-scale datasets, and deploying solutions in Azure cloud environments. This role requires onsite presence 5 days a week in Pittsburgh, PA.

Responsibilities:

• Design, develop, and optimize data pipelines and ETL workflows using Azure Databricks, PySpark, and SQL.
• Work with stakeholders to understand business requirements and translate them into scalable data solutions.
• Implement data processing, transformation, and cleansing for large-scale structured and unstructured data.
• Collaborate with data engineers, analysts, and architects to build reliable and high-performing data platforms.
• Ensure data quality, security, and compliance across all solutions.
• Monitor, debug, and optimize performance of Databricks clusters and jobs.

Required Skills:

• Overall IT Experience: 8-10+ Years
• 5+ years of hands-on experience with Azure Databricks.
• Strong expertise in Python, PySpark, and SQL.
• Solid experience with ETL pipeline design and data processing in cloud environments.
• Good understanding of Azure Data Lake, Azure Data Factory, and related Azure services.
• Experience working with large, complex datasets and performance tuning.
• Strong problem-solving and debugging skills.

Nice to Have:

• Experience with Delta Lake, MLflow, or Spark Streaming.
• Familiarity with CI/CD pipelines and DevOps practices in Azure.
• Exposure to financial services, healthcare, or large-scale enterprise environments.

Required Skills