Role Summary

We are looking for a mid-level Python Developer - NLP, ML, Gen AI with combined experience in Data Engineering and AI/NLP engineering . The candidate will build NLP pipelines using libraries such as Flair , BERT , and LLM frameworks, and will also work on large-scale data processing using PySpark , Pandas , and related data tools. The role includes developing APIs, integrating with platform services, and supporting CI/CD deployments using GitHub and LightSpeed Enterprise.

Key Responsibilities

• Develop and optimize ETL/data processing jobs using PySpark , Pandas , PyArrow , and related libraries.
• Work with Parquet files using FastParquet or pyarrow.parquet for efficient data processing.
• Implement data parsing and serialization using json , ujson , or orjson for high-performance JSON handling.
• Build and mai...