The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.

This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.

The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.

Key Responsibilities

• Build and maintain scalable ETL/ELT data pipelines using Databricks.
• Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
• Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
• Work with teams across the organization to prepare data for BI dashboards and reporting tools.
• Partner with business stakeholders to understand requirements and deliver tailored data solutions.