TL;DR

Senior AI Engineer (LLM): Designing and implementing scalable, production-ready AI solutions with an accent on RAG pipelines and vector database architecture. Focus on building robust, high-performance LLM-powered applications and integrating complex AI systems into enterprise-grade products.

Company

Roko Labs is a strategic product and technology consultancy working with Fortune 500 companies and VC-backed startups.

What you will do

  • Design and implement end-to-end LLM-powered applications, prioritizing RAG pipelines.
  • Build and optimize data ingestion, embedding, and semantic search workflows.
  • Architect scalable vector database solutions and integrate AI platforms like OpenAI, Anthropic, or Azure OpenAI.
  • Deploy and maintain AI systems in cloud environments including AWS, Azure, or GCP.
  • Collaborate cross-functionally to translate business requirements into technical AI architectures.
  • Advance MLOps practices, including CI/CD pipelines, observability, and performance monitoring.

Requirements

  • Master’s degree in Computer Science, Engineering, AI, or a related field.
  • 5+ years of experience in AI/ML engineering or backend software engineering.
  • Proven hands-on experience building and deploying LLM applications, specifically RAG-based systems.
  • Strong programming proficiency in Python.
  • Experience with cloud platforms and scalable backend architectures in production environments.
  • Solid understanding of vector databases and semantic search architectures.

Nice to have

  • Experience designing multi-agent AI systems or fine-tuning open-source models.
  • Familiarity with Hugging Face ecosystem and advanced MLOps frameworks.
  • PhD in a relevant field.
  • Experience mentoring junior engineers.

Culture & Benefits

  • Remote work flexibility with no time-tracking systems.
  • Focus on one project at a time with opportunities for long-term engagement.
  • Support for ongoing education, including courses and conferences.
  • Contract for an indefinite period or B2B collaboration options.
  • Regular knowledge-sharing sessions and internal growth support.
  • Referral bonus program for successful candidate recommendations.