Take on the role of an Azure Databricks Engineer specializing in big data processing solutions within the Azure platform. Create and optimize data pipelines for powerful analytics.
We are actively seeking an expert in Azure Databricks with at least 10 years of experience in data engineering. This position emphasizes designing scalable data pipelines and developing robust ETL processes using Azure Data Factory. You will collaborate with fellow engineers and data scientists to integrate diverse data sources and ensure high-quality outputs.
Key Responsibilities:
• Implement data pipelines using Azure Data Factory effectively
• Optimize workflows with Azure Databricks (PySpark/Scala)
• Develop ETL processes for large datasets seamlessly
• Integrate data from APIs, lakes, and databases
• Maintain pipeline performance and quality standards
Requirements:
• Bachelor’s degree in a related field
• Over 10 years of experience in Azure data engineering
• Proficient...