Staff AI Engineer (LLM)

Location: Warsaw/Cracow (hybrid: 1-2 days per week in the office)

Contract: B2B

Salary: 33.000 - 38.000 PLN net B2B

How this role works:

You will start by building the system as part of our team, working in a focused, greenfield setup. After a few months of introduction to the project, you will seamlessly continue working on the same product directly with the client, becoming part of the client’s team responsible for its long-term development and scaling. There is no handover phase and no context switching - you stay with the same codebase, product, and technical challenges, while gaining long-term ownership and impact.

What you’ll work on:

• Designing, implementing, and deploying end-to-end NLP and deep learning systems
• Building LLM-powered applications that interact with real users
• Developing and maintaining production Python services
• Exposing models and pipelines via REST APIs (FastAPI, Flask)
• Working on retrieval models and techniques (RAG, embeddings, ranking)
• Evaluating, monitoring, and continuously improving model and system quality
• Scaling systems to handle enormous volumes of requests

Biggest challenges in this role:

• Greenfield project built from scratch
• High-scale, user-facing systems with strict performance and reliability requirements
• Designing systems meant for long-term ownership, not short-term delivery
• Balancing model quality, latency, and cost in production LLM systems

What you’ll learn:

• How to build LLM-powered products from scratch and take them to production
• Proven approaches to running LLMs in production at scale
• How to design, evaluate, and evolve NLP systems used by real users
• Best practices for production ML and AI system architecture

What you’ll get to try and experiment with:

• End-to-end ownership of LLM-based systems
• Optimizing retrieval models, RAG pipelines, and inference workflows
• Experimenting with different LLMs, prompting strategies, and system designs
• Solving performance and reliability challenges under heavy traffic

Core requirements:

• At least 6 years of experience in ML / AI engineering
• Proven experience owning production NLP or LLM systems
• Strong understanding of Transformer architecture and deep learning foundations behind modern LLMs (attention mechanisms, self-attention, positional encoding, encoder–decoder vs decoder-only models)
• Proven experience designing, fine-tuning, and deploying end-to-end NLP and deep learning solutions in production environments
• Hands-on experience building LLM-powered production systems (e.g. GPT, Claude, Gemini), including prompt engineering, evaluation, supervised fine-tuning (SFT), instruction tuning, and parameter-efficient fine-tuning methods (e.g. LoRA, adapters), as well as user-facing integrations
• Experience training and fine-tuning Transformer-based models using frameworks such as PyTorch and Hugging Face (including dataset preparation, tokenization strategies, hyperparameter tuning, and evaluation pipelines)
• Strong understanding of scalability, performance optimization, and system design for large-scale ML/LLM systems
• Python proficiency with experience building and maintaining reliable production services and data pipelines
• Strong software engineering mindset, including code quality, testing, scalability, and production deployments
• Experience building RESTful APIs (FastAPI, Flask) to expose ML/LLM capabilities
• Curiosity and commitment to continuous learning in the NLP/LLM/AI space
• Collaborative team-player with strong communication skills
• Ability to drive technical direction and mentor other engineers

You will earn extra points for experience with:

• MLOps practices and tooling
• RAG systems, vector databases, and retrieval optimization
• multiple LLM providers or open-source models
• high-traffic, high-availability systems

We want to offer you:

• Work with an experienced team that continually shares knowledge and is not afraid of testing new solutions
• Flexible hours
• Individual work tools – Macbook Pro, Dell screen, JBL headphones? You can tailor the equipment to your needs
• Sport & wellness benefit (Kafeteria MyBenefit)
• Private medical care
• A comprehensive benefits package after transitioning to our partner, including employee benefits, training opportunities, and occasional bonuses