Software quality engineer (UK)
Remote • London, UK • FullTime
Posted 2mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
WRITER is seeking a Software Quality Engineer to ensure the reliability, performance, and trustworthiness of its AI-powered work orchestration platform. This role involves defining and implementing quality strategies for enterprise-grade LLMs and AI agents, directly impacting how global companies leverage AI. You will be at the forefront of addressing the unique challenges of AI quality assurance in a rapidly evolving field. This is a hybrid role based out of our London, San Francisco, Seattle, and New York City hubs, reporting directly to the director of engineering.
Responsibilities
- Define and implement comprehensive quality assurance strategies and test plans for AI agents and LLM-powered applications.
- Design and develop robust, scalable, and maintainable automated test frameworks using languages like Typescript or Python.
- Collaborate with product managers, machine learning engineers, and data scientists to translate complex AI features into effective test cases.
- Drive continuous improvement of testing processes and infrastructure, integrating automated checks within CI/CD pipelines.
- Identify, document, and track software defects, performing root cause analysis to provide feedback to development teams.
- Monitor production systems and AI model performance to proactively identify potential issues.
- Champion quality best practices across engineering teams.
- Design, manage, and maintain test data strategies and mock services for stable test execution.
- Analyze customer feedback and debugging logs to identify, prioritize, and track software bugs.
- Manage the full defect lifecycle, collaborating with development teams for timely resolution.
Requirements
- 5+ years of hands-on experience in software quality assurance or engineering, with a focus on testing complex distributed systems or AI/ML applications.
- 5+ years of experience working with GitHub Actions.
- Proficiency in programming languages like Python or Typescript for test automation.
- Experience with modern testing frameworks such as Playwright.
- Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and testing generative AI outputs.
- Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment is a plus.
- Exceptional analytical skills and a keen eye for detail.
- Collaborative spirit to connect cross-functional teams and drive quality goals.
- Demonstrated ability to drive initiatives independently in a fast-paced startup environment.
- Experience designing, developing, or integrating agentic AI systems, AI skills, and the Model Context Protocol (MCP).
Benefits
- Generous PTO, plus company holidays
- Comprehensive medical and dental insurance
- Paid parental leave for all parents (16 weeks)
- Fertility and family planning support
- Early-detection cancer testing through Galleri
- Competitive pension scheme and company contribution
- Annual work-life stipends for wellness and learning/development
- Company-wide off-sites and team off-sites
- Competitive compensation
- Company stock options