Senior Python Systems Developer (Remote, AI Testing)

Job summary

This role is for a Senior Python Systems Developer specializing in functional testing for AI systems. The position involves project-based work with a focus on creating and managing tests across various programming languages and environments.

Qualifications

• Over 5 years of experience in software engineering, primarily with Python.
• Proficient in English at a B2 level or higher.
• Experience with agent evaluation platforms and MCP CLI is a plus.

Responsibilities

• Develop functional black box tests for extensive codebases in multiple source languages.
• Create and manage Docker environments to ensure reproducible builds and test executions.
• Monitor code coverage and set automated scoring criteria to align with industry standards.
• Utilize LLMs (e.g., Roo Code, Claude) to enhance development cycles and automate repetitive tasks.

Skills

• Deep expertise in pytest, including fixtures and session-scoped tests.
• Advanced Docker skills, including creating reproducible Dockerfiles and secure workspaces.
• Strong Linux and Bash scripting abilities, with experience debugging in containerized environments.
• Familiarity with modern Python tooling such as uv and pyproject.toml.
• Capability to read and understand multiple programming languages (C, C++, Rust, Go) with the help of LLMs.

Tools

• Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.

Education

• Relevant degree in Computer Science or a related field is preferred but not mandatory.