Senior Software Development Engineer in Test, ML
CA$114k - CA$143k • Canada, Waterloo, ON • Full-time
Posted 18d ago
Job Location
Canada, Waterloo, ON
Also open in United States, Madison, WI
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
Machine Learning Engineer
About the job
Sony Interactive Entertainment (SIE) is seeking a Senior Software Development Engineer in Test, ML to join their team and lead quality efforts for machine learning-powered products and services. You will partner closely with ML engineers, software engineers, product managers, and data partners to build scalable test automation and validation approaches for systems serving PlayStation globally. This role focuses on building confidence in model reliability, production readiness, and behavioral consistency by validating probabilistic systems through score distributions, cohort-level behavior, thresholds, and statistical signals.
Responsibilities
- Drive architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.
- Design, develop, and maintain automated test frameworks and test scripts for ML inference services and related ML platform components using Python/Java.
- Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios.
- Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release.
- Perform functional, integration, regression, and API testing with RESTful APIs, microservices, and databases.
- Conduct non-functional performance and load testing to verify inference service scalability, latency requirements, and reliability under production-like conditions.
- Collaborate with ML engineers and ops teams to ensure automated test coverage for all features and bug fixes, supporting continuous integration and deployment.
- Debug and analyze test failures and model anomalies, reporting defects.
- Drive high standards of quality for engineering decisions and customer-facing features with optimal test and automation strategy.
- Develop and implement best practices for highly scalable and maintainable test automation.
- Monitor test execution and optimize performance in test environments.
- Propose innovative solutions to organizational problems.
Requirements
- Bachelor's degree in Computer Science or related field.
- Minimum 5 years of experience as an SDET, with strong experience testing backend systems.
- Proficiency in Python/Java/Scala/Go for test automation.
- Hands-on experience with API testing tools (e.g., Postman) for distributed systems.
- Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments (e.g., GitHub Actions, ArgoCD).
- Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG).
- Experience working with databases for backend validation.
- Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).
- Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog) for validating service health.
- Strong understanding of software development lifecycle (SDLC) and agile methodologies.
- Excellent problem-solving and communication skills.
