Drive cutting-edge AI product features as a Senior Software Engineer. Integrate LLMs and ML services into user workflows while ensuring safety and measurable outcomes in a remote environment.

This role requires designing APIs, integrating LLM/NLP technologies, and developing evaluation frameworks. You’ll focus on optimizing cost and latency while collaborating closely with research and product teams for rapid iteration. Candidates must possess strong problem-solving skills and a commitment to quality.

Key Responsibilities: • Design APIs incorporating LLM/NLP and retrieval features • Build evaluation frameworks to ensure feature quality • Optimize cost and latency with prompt tuning • Instrument features for A/B testing and analysis • Collaborate with cross-functional teams for iteration

Requirements: • 5+ years software engineering experience • 2+ years applied ML/LLMs preferred • Proficient in Python and one backend stack • Experience with cloud-based ML ops...