Role- Azure Data Engineer (Data-bricks)
Location: Dallas, TX- Onsite
Contract
Job Description (JD) typically involves designing, developing, and maintaining scalable data pipelines, ETL processes, and data solutions using the Databricks platform (Lake house Architecture, Spark, Delta Lake) on cloud services (AWS, Azure, GCP).
Key responsibilities include
· Data modelling, performance optimization, ensuring data quality security, collaborating with data scientist’s analysts, and implementing governance (like Unity Catalog) for big data analytics and AIML initiatives.
Common Roles Responsibilities
· Databricks
· Builds data infrastructure, optimizes Spark jobs, creates ETL/ELT pipelines, and integrates with cloud services.
Responsibilities
· Design develop data solutions on Databricks (Delta Lake, Unity Catalog).Optimize data pipelines (batch streaming) for performance.
· Collaborate with stakeholders (scientists, analysts).
· Implement data quality, security, and governance.
· Troubleshoot performance issues. Document technical specs.