TL;DR

Senior AI Engineer (LLM): Leading the design and implementation of scalable AI solutions that drive business value, with an accent on Retrieval-Augmented Generation (RAG) pipelines. Focus on building production-ready AI systems using Python and modern AI/ML frameworks, deploying and maintaining AI solutions in cloud environments.

Company

Roko Labs is a fast-growing strategic product and technology consultancy based in NYC.

What you will do

  • Design and implement end-to-end LLM-powered applications, focusing on Retrieval-Augmented Generation (RAG) pipelines.
  • Build production-ready AI systems using Python and modern AI/ML frameworks.
  • Develop and optimize data ingestion, embedding pipelines, and semantic search workflows.
  • Collaborate with product and engineering teams to translate business requirements into scalable technical solutions.
  • Ensure code quality, testing, monitoring, and performance optimization of AI systems in production.
  • Contribute to MLOps practices including CI/CD pipelines, model lifecycle management, and observability.

Requirements

  • Master’s degree in Computer Science, Engineering, AI, or a related field.
  • 5+ years of experience in AI/ML engineering or backend software engineering.
  • Proven hands-on experience building and deploying LLM applications, especially RAG-based systems.
  • Strong programming skills in Python.
  • Experience integrating LLM APIs (e.g., OpenAI, Anthropic, Azure OpenAI).
  • Experience with at least one major cloud platform (AWS, Azure, or GCP) in production environments.

Nice to have

  • Experience contributing to AI system architecture design and technical standards.
  • Experience participating in AI roadmap discussions and technical planning.
  • Hands-on experience with advanced MLOps frameworks and model governance.

Culture & Benefits

  • Developers work on one project at a time.
  • Opportunity to work on complex solutions with the latest technologies.
  • Remote work means it's up to you whether you work from home, beach, or the office.
  • All employees receive a contract for an indefinite period (B2B collaboration is also an option).
  • Opportunities for job role switch, education, and knowledge-sharing sessions.