AI Quality Assurance Intern
$0k - $0k • Toronto, Ontario • Internship
Posted 10mo ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
About the job
Cresta is seeking curious, detail-oriented students to join our AI Delivery team as AI Quality Assurance Interns. This is a hands-on role where you will evaluate the behavior, accuracy, and reliability of Cresta’s AI Agents and Agent Assist systems. This work sits at the intersection of AI behavior analysis, intent recognition evaluation, conversation quality assessment, model output auditing, and light prompt testing and refinement. You will help ensure our AI systems act as intended, follow correct business logic, and provide accurate and safe outputs to end users.
Responsibilities
- Execute structured test plans for AI Agent implementations
- Validate that intents, entities, and workflows trigger correctly
- Identify behavioral inconsistencies, misclassifications, or hallucinations
- Review and validate AI-generated suggestions, summaries, and classifications
- Provide actionable feedback to improve intent models and redaction/PII handling
- Run bias, redaction, and transcription accuracy checks
- Spot patterns or emerging issues across test sets
- Contribute ideas for improving internal QA processes and tools
Requirements
- Interest in AI/ML, NLP, or chatbots
- Interest in product quality and user experience
- Interest in linguistics, conversation analysis, or human–AI interaction
- Interest in exploring a career in AI evaluation, AI ops, or product QA
- Strong analytical thinking
- Curiosity about how intelligent systems behave
Benefits
- $30-$50 per hour
- Lunch can be expensed (up to $25) while working in the office
- 4 days PTO