Role: Databricks Consultant
Location - Remote
Contract
We are seeking a skilled Databricks Consultant to design, implement, and optimize scalable data solutions using the Databricks platform. The ideal candidate will have hands-on experience with data engineering, cloud platforms (Azure/AWS/GCP), and a deep understanding of big data frameworks such as Spark.
You will collaborate closely with data scientists, analysts, and business stakeholders to enable advanced analytics, machine learning, and data-driven decision-making.
· Design and implement end-to-end data pipelines using Databricks and Apache Spark.
· Build and optimize ETL/ELT workflows for batch and streaming data.
· Integrate data from multiple sources into data lakes or data warehouses.
· Implement and maintain data governance, security, and compliance standards.
· Collaborate with cloud engineering teams to deploy Databricks on Azure, AWS, or GCP.
· Develop and maintain data models, Delta Lake tables, and data quality checks.
· Support machine learning workflows and model deployment on Databricks ML runtime.
· Troubleshoot performance issues and optimize Spark jobs for scalability and efficiency.
· Provide technical guidance and best practices to data teams and business stakeholders.