Lead Data Platform Engineer ( AI/ML , Start-up)
This job is in your area. Enjoy a short commute and work close to home.
Job Description
Data Platform Software Lead Engineer โ AI/ML Systems
Location: Hybrid (4 days onsite โ Downtown Toronto)
Type: Full-Time | Start-up
About the Role
Join our team as a Data Platform Software Lead Engineer and drive the architecture that fuels our AI and ML pipelines, focusing on large-scale, code-based text datasets. You'll design and build reliable systems for data ingestion, transformation, and deliveryโenabling teams to train, iterate, and deploy models with confidence.
What Youโll Do
Architect and implement scalable data platforms for code/text dataset ingestion, processing, and delivery.
Build web-scale crawling and metadata extraction tools from open-source code repositories.
Develop reliable, distributed pipelines with frameworks like Spark, Kafka, and Airflow/Prefect .
Enable data visualization, sampling, and analytics for re...