AI Platform Engineer (Remote, Denmark)

Job summary

This role focuses on developing the infrastructure for high-performing AI applications, emphasizing evaluation, monitoring, and continuous improvement in real-world settings. The position involves working within a distributed team to create intelligent features while ensuring quality and performance at scale.

Qualifications

• Over 6 years of experience in software engineering, data science, or machine learning, particularly in NLP, search, or recommendation systems.
• Proven track record in building and evaluating production-grade AI systems, including LLM-based applications and retrieval-augmented generation (RAG) pipelines.
• Strong proficiency in Python for experimentation and data analysis.
• Solid understanding of AI system architecture, including embeddings and retrieval mechanisms.
• Experience in designing evaluation pipelines and performance measurement systems.

Responsibilities

• Design and implement evaluation frameworks for AI system performance, including offline metrics and real-time monitoring.
• Develop observability tools and dashboards to track system quality and accuracy.
• Diagnose performance issues across AI pipelines and identify root causes.
• Experiment with various models and configurations to optimize outcomes.
• Prototype improvements to RAG pipelines, focusing on retrieval and re-ranking strategies.
• Analyze user interactions to identify enhancement opportunities.
• Collaborate with engineering teams to validate improvements and ensure reliability.
• Stay updated with emerging AI tools and best practices.

Skills

• Strong analytical mindset with the ability to interpret complex data.
• Excellent collaboration and communication skills in a distributed team.
• Comfortable in fast-paced, ambiguous environments with high autonomy.
• Full professional fluency in English.

Education

• Relevant degree in Computer Science, Data Science, or a related field is preferred but not explicitly required.

Tools

Benefits

• Familiarity with additional technologies such as Ruby on Rails is a plus.
• Competitive salary between $130,000 and $140,000 USD annually, with regular reviews.
• Equity participation and performance-based bonuses.
• Fully remote work with flexible hours.
• Generous paid time off (35 days annually) and sabbatical options.
• Comprehensive healthcare coverage for employees and families.
• Parental leave support.
• Home office setup allowance and learning development stipend.
• Biannual retreats in international locations.