Job has been saved to your Account Portal!
Power Platform and AI Tester
Job Description
DUTIES AND RESPONSIBILITIES
Test Planning & Design
-Develop and maintain comprehensive test plans, test cases, and test scripts for Power Platform and Copilot Studio solutions.
-Define testing approaches covering functional, regression, integration, performance, and AI behavior validation.
Copilot & AI Testing
-Validate conversational flows, intent recognition, prompt behavior, and AI-generated responses.
-Test large language model (LLM) outputs for accuracy, grounding, safety, and hallucination risks.
-Execute responsible AI testing including bias checks, content safety, and compliance controls.
Automation & Workflow Validation
-Test Power Automate flows, triggers, approvals, and error-handling scenarios.
-Validate integrations with Dataverse, SharePoint, Teams, Dynamics 365, and external APIs.
Quality Assurance & Defect Management
-Identify, log, and manage defects using agreed defect management tools and processes.
-Work closely with developers to reproduce issues and validate fixes.
-Support UAT cycles and provide clear quality sign-off recommendations.
Governance, Security & Compliance
-Validate environment configuration, data access controls, and security role enforcement.
-Ensure solutions adhere to Power Platform governance standards and deployment policies.
-Continuous Improvement
-Contribute to QA standards, reusable test assets, and AI testing best practices.
-Continuously improve testing approaches for AI-driven and low-code solutions.
Qualification
-5+ years experience in software testing or quality assurance roles.
-Hands-on experience testing Microsoft Power Platform and/or Copilot Studio solutions.
-Experience validating AI-driven or conversational applications.
-Strong understanding of testing methodologies within Agile and DevOps environments.
Skills and Personal Attributes-Copilot Studio Testing: Conversational flow, prompt behavior, and AI response validation.
-Power Platform Knowledge: Power Apps, Power Automate, Dataverse, environments and solutions.
-AI Quality Assurance: LLM behavior testing, hallucination detection, and responsible AI checks.
-Test Design & Documentation: Strong attention to detail and structured thinking.
-Analytical Mindset: Ability to identify patterns, risks, and edge cases.
-Communication: Clearly articulates issues to technical and non-technical audiences.
-Collaboration: Works effectively with developers, architects, and business users.
-Adaptability: Comfortable testing rapidly evolving AI and low-code platforms.
What's in It for You:-Flexibility: Work hybrid (remotely and from one of our inspiring offices) and enjoy a better work-life balance!
-Inspiring Workspaces: Our offices are strategically located and designed to fuel your best work.
-Free Unlimited Barista Coffee and Booze: Enjoy refreshments from our cafe and beverage bar.
-Dynamic Open Spaces: Conducive for productivity and creativity.
-State-of-the-Art Security: Ensuring your safety and peace of mind.
-Game Rooms: Take a break and unwind with our recreational facilities.
-Competitive Compensation: Your talents deserve to be rewarded! We help you negotiate with our clients.
-Professional Growth: Access to ongoing training and development opportunities to help you reach your full potential.
-A Supportive Community: Join a diverse and inclusive team that's dedicated to your success.
-Global Impact: Be part of something bigger and make a difference on a global scale.
About The Offshoring Solutions Company
A business solutions provider offering offshoring services in areas such as accounting, IT, and customer support. It helps companies improve efficiency, reduce costs, and scale operations by providing skilled professionals and tailored support solutions.
Power Platform and AI Tester
Salary
100,000-200,000/month
Position Level
Professional
Job Level
Experienced Hire
Job Type
Full Time
Hiring Until
04/29/2026
Jobs