As one of the nation’s premier humanitarian organizations, the American Red Cross is dedicated to helping people in need throughout the United States and, in association with other Red Cross networks, throughout the world. When you join our team, you have a direct impact on a meaningful mission, and you can help save lives every day. If you share our passion for helping people, join us in this excellent career opportunity. Work where your career is a force for good.
We're seeking a Test Engineer experienced in developing manual & automated test strategies for Conversational AI (chat bots) to be a key player in the Fundraising and Marketing Technology team.
WHERE YOUR CAREER IS A FORCE FOR GOOD (Key Responsibilities):
- Develop, maintain, document, and execute test plans, test cases, and automated test scripts
- Collaborate with developers, Product Owners, and other team members to understand business requirements to develop manual and automated test strategies that will test chatbot functionality
- Execute different types of testing such as functional, integration, performance, and security across multiple devices and platforms to ensure chatbots are working as designed
- Design and create test data (text, speech, images, videos, etc) to verify how chatbots reacts to inputs and handle errors leveraging real user data when possible
- Evaluate chatbot’s understanding of natural language, intent recognition and response accuracy and provide paths for improvement
- Test for data privacy and compliance with relevant regulations
- Investigate all potential product test failures and test any code changes to fix them
- Provide regular status reporting of test progress
- Support User Acceptance Testing (UAT)
- Ensure accessibility for users with disabilities
- Contribute to best practices and continuous improvements approach to development
- Evaluate, recommend and implement automation and/or other QA tools to assist with chatbox testing
- Continue to develop Conversational AI, testing, and automation skills through ongoing professional development training, bringing new ideas and solutions to the team
Scope: Individual contributor that works under limited supervision. Apply subject matter knowledge. Capacity to understand specific needs or requirements to apply skills/knowledge.
WHAT YOU NEED TO SUCCEED (required/minimum qualifications):
- Bachelor’s Degree Computer Science or equivalent area of study, or equivalent professional experience.
- Minimum of 4 years experience with functional/integration testing and test case design
- Minimum of 2 years experience testing Conversational AI and rules-based chatbot applications
- Must demonstrate experience and understanding of AI, natural language processing (NLP), and machine learning concepts
- Experience evaluating and testing Natural Language Processing (NLP) systems or Large Language Models (LLMs)
- Experience with Azure Cognitive Services, Azure AI Services, Azure Bot Service (ABS), AWS or other cloud services
- Experience with speech recognition chatbot testing
- Experience with Jira, Confluence, Zephyr
- Experience with CI/CD pipelines like Jenkins or Azure DevOps
- Ability to work on a team with minimal supervision
- Strong understanding and hands on experience with QA processes and methodologies
- Knowledge and hands on experience using testing tools for test cases, test execution and defect management.
- Experience with Browser Testing
- Experience testing with Mobile devices
- Experience in writing test automation scripts
- Experience with Agile and Scrum methodologies
PAY INFORMATION: The annual salary range for this position is $ 100,000 - $ 115,000. We do not offer an annual bonus for this role.
BENEFITS FOR YOU:
We take care of you, while you take care of others. As a mission-based organization, we believe our team needs great support to do great work. Our comprehensive benefits help you in balancing home and work, retirement, getting healthy and more. With our resources and perks, you have amazing possibilities at the American Red Cross to advance and learn.
- Medical, Dental, & Vision Plans
- Health Spending Accounts & Flexible Spending Accounts
- PTO + Holidays
- 401K with up to 5% Match
- Paid Family Leave
- Employee Assistance Programs
- Disability and Insurance: Short + Long Term
- Service Awards and Recognition
- LI-EH1
Apply now! Joining our team will provide you with the opportunity to make a difference every day.