Shape data engineering at your best with a lead role focused on migrating to Databricks. Capitalize on your extensive experience with AWS services and Apache Spark for impactful data solutions.
This Lead Data Engineer position requires 10+ years of experience, with a strong 2+ years as a tech lead. You'll drive the migration from Glue and Redshift to Databricks, leveraging your expertise in Apache Spark and leading teams through substantial platform transitions.
Key Responsibilities:
• Lead migration efforts from Glue/Redshift to Databricks
• Optimize Apache Spark performance through tuning techniques
• Manage production workflows using Databricks and Delta Lake
• Direct substantial data platform migrations end-to-end
• Communicate effectively with technical and executive teams
Requirements:
• 10+ years in data engineering, 2+ years in a lead role
• Deep hands-on experience with AWS Glue and Redshift
• Expert in SQL and software engineering principles