Senior Test Engineer (AI-Augmented & Spec-Driven Testing)

KMS provides the enterprise execution layer, where work becomes outcomes.

We are a global, AI-native technology services company focused on Enterprise Execution. We help enterprises build and modernize applications, create trusted data foundations, put AI into production, and continuously run and improve the systems that execute the work.

Founded in 2009 in the U.S., KMS has grown to serve clients worldwide, with locations across the U.S., Vietnam, Poland, and Mexico. We are trusted by technology and business leaders for the quality of our engineering, delivery, and execution. Our mission is to help enterprises move from business intent to measurable outcomes faster — with the control, reliability, governance, and confidence required to scale.

At KMS, we believe sustainable growth is built on the success of our clients and employees and on making a lasting contribution to our communities.

More about KMS Technology:

Website: kms-technology.com ↗

Linkedin: linkedin.com ↗

• Analyze requirements and specifications, define the test approach and test plan, and give test recommendations in sprint planning (feature, smoke and regression testing, both manual and automation)

• Design, build and maintain automated tests for UI and API, and run them in the CI/CD pipeline

• Use AI tools in daily testing work to speed up test design, scripting and failure analysis, and share what works with the team

• Work closely with developers, BAs, product owners and clients to build quality in from the early stages, including in spec-driven or AI-assisted development

• Support and guide junior team members, and take on test lead or technical lead duties when the project needs it

• Contribute to improving test processes, tools and practices across projects

• Perform other tasks assigned by the line manager

General requirements

• Bachelor's degree in IT, Computer Science or a related field

• 5+ years of experience in software testing, with solid hands-on experience in test automation

• Experience guiding testers or coordinating test activities in a Scrum team is a strong plus

• Familiar with Agile development methodologies

• Curious and quick to self-learn new technologies, especially AI tools and practices

• Proactive, takes ownership, and comfortable joining new teams and new domains

• Upper-Intermediate English (verbal and written), able to work directly with clients

Technical requirements

• Good foundation in requirements analysis, test planning and test design techniques (black-box, risk-based, exploratory); hands-on testing of web UI and APIs (Postman or similar)

• Hands-on experience building or maintaining automation frameworks with Playwright, Selenium or Cypress, plus API automation (REST Assured, Postman/Newman or Playwright API)

• Good coding skills in one of TypeScript/JavaScript, Java, Python or C#, using POM and other design patterns

• Experience running automated tests in CI/CD (GitHub Actions, GitLab CI, Jenkins or similar)

• AI-augmented testing: hands-on use of AI tools (e.g. Copilot, Cursor, Claude Code) in testing work, with real examples such as:

• generating test cases and test data from requirements, specs or API contracts

• writing or refactoring automation scripts with AI

• analyzing test failures and flaky tests with AI

• Able to critically review and validate AI-generated output

Nice to have

• Experience with Spec-Driven Development or structured specs (e.g. GitHub Spec Kit, Kiro, OpenAPI, BDD/Gherkin)

• Building agentic test workflows with MCP (e.g. Playwright MCP, or connecting Jira/TestRail/Git)

• Experience setting up a test process or automation framework from scratch for a new project

• Testing AI/LLM-based features (prompt-response validation, hallucination and bias checks) with evaluation tools (Promptfoo, DeepEval, Ragas)

• Using LLM APIs (OpenAI, Anthropic, Azure OpenAI) to build internal QA tools

• Performance testing (k6, JMeter) or basic security testing

• ISTQB certification