Senior Software Engineer in Test (Remote, AI Industry)

Job summary

This role involves creating and refining coding test cases for AI systems, focusing on functional testing and analyzing AI performance. It is a project-based opportunity suitable for experienced developers and test automation specialists.

Qualifications

• Degree in Computer Science, Software Engineering, or related fields
• Over 5 years of experience in software development, primarily with Python (pytest, async/await, subprocess, file operations)
• Full-Stack development experience, with skills in both React-based interfaces and robust Back-end systems
• Proven experience in writing functional and integration tests
• Familiarity with Docker containers for local evaluations
• Understanding of CI/CD processes, particularly with GitHub Actions
• English proficiency at B2 level

Responsibilities

Compensation

Contributors can earn up to $50 per hour, depending on their experience and contribution pace. Compensation may vary across different projects based on scope and complexity.

• Review and refine coding tasks based on production codebases
• Write comprehensive functional tests to validate end-to-end behavior and edge cases
• Create challenging coding tasks that require complex reasoning and information gathering
• Analyze AI failures to identify strengths and weaknesses in the model
• Iterate on tasks based on feedback from quality assurance reviewers