Manager, AI Quality Assurance, Quality Engineering, Technology Transformation, Solutions
Actively Hiring
Full-time $24k Posted about 23 hours ago
Responsibilities
- check_circle Designing and delivering AI QA approach for Traditional AI and Generative AI systems, aligned to the AI development lifecycle and client objectives.
- check_circle Developing structured test cases to evaluate model behavior, performance and risk across a range of use cases, including edge cases and adversarial scenarios.
- check_circle Validating input and output data across AI pipelines, assessing completeness, consistency, correctness and relevance
- check_circle Supporting and governing test data preparation, validation and augmentation, including the creation of representative datasets
- check_circle Implementing AI test automation strategies, selecting appropriate frameworks and approaches to enable scalable, repeatable and efficient testing of AI systems.
- check_circle Apply appropriate tools and techniques for model observability and evaluation.
- check_circle Analyse AI model behavior and outputs to identify ethical, fairness and responsible AI risks
- check_circle Collaborating closely with data scientists, DevOps and delivery teams to embed AI testing practices early and consistently across the development lifecycle.
- check_circle Mentoring others and contributing to Deloitte’s internal tools, accelerators, and communities of practice.
Basic qualifications
- In-depth knowledge of Traditional AI and Generative AI model architectures, including training processes and lifecycle considerations.
- Knowledge of AI testing methodologies, including specialised techniques for testing AI models and relevant evaluation metrics.
- Experience in test automation for AI systems, including strategy, design and implementation.
- Ability to perform data analysis to ensure quality and adherence to relevant data compliance standards.
- Ability to identify and assess ethical, fairness and responsible AI risks within AI-enabled systems.
- Knowledge of AI model monitoring, including drift detection, performance tracking and ongoing model evaluation.
- Advanced data preparation and augmentation capabilities to support AI testing scenarios.
- Experience analysing AI model behaviour and outputs, and embedding findings into quality, risk and assurance decisions.
- ISTQB Certified Tester Foundation Level certificate (or equivalent practical experience).
- Strong experience using test management tools (e.g. JIRA) to govern quality activities at engagement level.
- Client-facing experience, including stakeholder management at senior levels.
- Proficiency in driving adherence to testing governance, including documentation controls and sign-off readiness.
- Excellent interpersonal skills, with the ability to lead, influence and mentor teams.
- Acute attention to detail, particularly in complex or AI-driven delivery contexts.
Tags & Focus Areas
Remote Ai
About Deloitte
· Do you want to learn and grow from top experts in the Finance and Performance space? · Are you excited to have real-world opportunities to develop your Finance skills? · Get hands-on experience in one the best consulting careers available
Ready to Join the Team?
Apply once with DevFound — we route your profile to Deloitte and keep you posted on matching AI roles.