Scope of Work

Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable data delivery.

Works on monitoring, troubleshooting, and resolving pipeline and cluster issues, and collaborates with DevOps teams using Azure DevOps, Git, CI/CD, and monitoring tools like Azure Monitor and Log Analytics to support stable and scalable data operations.

Required Skills

• Azure Data Factory (ADF)
• Azure Databricks
• Azure SQL
• Spark SQL

Understanding of

• ETL / ELT concepts
• Data ingestion patterns
• Data warehousing

Experience in

• Troubleshooting pipeline failures
• Cluster issu...