We are seeking a Quality Assurance Engineer to support our Data Enablement, Governance and Quality team, with specific focus supporting our AI/ML development team as we develop, deploy, and integrate intelligent solutions into the Charity’s application suite. In this role, you will ensure that AI-aligned microservices, GenAI capabilities, AI models, APIs, and front-end features work together seamlessly, reliably, and securely. You’ll collaborate with our AI development team, our QA COE and front-end application teams to define the team’s testing strategy and standards, automate test coverage, and when needed, manually validate AI involved solutions.
The ideal candidate will have a keen interest or direct experience with integrated AI capabilities, Gen AI prompting, model output validation and quality capture. Our preferred candidate will also have experience with common test automation frameworks and a solid background in QA fundamentals and processes.
The Purpose of Your Role
- Develop and execute QA strategies for AI/ML-powered features, including LLM/SLM inputs/outputs, data / shared service pipelines, and application-level integrations.
- Design automated test frameworks for APIs, and microservice environments supporting AI solution deployment.
- Leverage the expertise of our Quality Center of Excellence (CoE) to bring an embedded quality mindset to the AI engineering team responsible for building the Charity’s AI/ML integrated and stand-alone solutions.
- Validate functional requirements, data integrity, quality metrics capture, model outputs, and user experience where AI-generated decision making is involved.
- Create and maintain test plans, test cases, and regression automation suites. Document test cases using XRAY and build API collections using Insomnia
- Perform end-to-end testing of solution outputs, edge cases, error handling. Partner with developers and DevOps on testing latency and system performance.
- Support CI/CD pipeline quality gates and implement automation within build systems (e.g., Jenkins, GitHub Actions, etc.)
- Show a sensitivity towards solution governance by helping ensure compliance with security, data privacy, and responsible AI guidelines.
- Accountable for Team outcomes and success metrics around Test Coverage, Automation Levels, and Change Failure Rate.
- Able to contribute to the Test Pyramid definition for our solutions
The Expertise and Skills We’re Looking For
- 6-9+ years of QA, software testing, or test automation / software development experience. Direct experience supporting QA within an AI solution integration teams a plus.
- Software Engineering experience or exposure; ability to read and understand Unit and Integration Test Code
- Proficiency with automation frameworks (e.g., Selenium) and scripting languages (Python/JavaScript preferred).
- Working experience with Object Oriented Programming Languages (Java, C#, Groovy, etc.)
- Familiarity with distributed systems, RESTful web services, JSON payloads, API debugging tools, and cloud platforms (AWS, Azure).
- Exposure to AI/ML solution concepts such as prompt engineering/GenAI and machine learning, modeling and thought process regarding test strategy for same.
- Experience managing CI/CD pipelines, test automation tooling and framework, feature-toggle management tooling, test environments and test data creation and maintenance, and vendor relationships.
- Strategic mindset, strong communication skills and willingness to build team behaviors from the ground up.
- Highly collaborative team player that works well within a cross functional team
- Continuous improvement mindset where mistakes and failure are viewed as opportunities to learn and improve
The Team
Fidelity Charitable is the brand name for the Fidelity® Charitable Gift Fund, an independent public charity, established in 1991 with the mission to further the American tradition of philanthropy by providing programs that make charitable giving simple and effective. Since 1991, Fidelity Charitable has helped donors support over 180,000 nonprofit organizations with more than $18 billion in grants.
The mission of Fidelity Charitable Services (FCS) is to be the premier provider of charitable solutions, offering innovative ways to make giving easy and satisfying for our customers. FCS offers the Fidelity Charitable Gift FundSM, the nation's largest donor-advised fund. Since 1991, the Gift Fund has introduced tens of thousands of donors to the benefits — and increased charitable impact — of using a donor-advised fund to meet their philanthropic goals.
Company Overview
At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want! We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experiences. For information about working at Fidelity, visit FidelityCareers.com. Fidelity Investments is an equal opportunity employer.