2013/2014 Sr QA Automation Engineer - AI First

Position: Senior QA Automation Engineer (AI-First)

Location: Remote

Contract Type: Full-time vendor (Direct contract with Inallmedia.com)

Time Zone Alignment: Central Time (CT) ±2 hours

About Inallmedia.com

Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams across LATAM. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.

Project Overview

You will join a forward-thinking engineering team building an innovative data center power management platform designed to optimize energy consumption and relieve grid pressure. As a Senior QA Automation Engineer (AI-First) , your primary focus will be designing, building, and enforcing a robust automated testing strategy across distributed systems, Python microservices, event pipelines, and non-deterministic agentic AI workflows.

Key Responsibilities

• Comprehensive Test Strategy: Own the automated test strategy across unit, integration, contract, end-to-end, and edge-deployment validation.
• UI & Workflows: Build and maintain end-to-end test suites in Playwright for operational UIs and human-in-the-loop approval workflows.
• Backend & Pipeline Coverage: Build API, contract, and integration testing for Python microservices and Kafka event pipelines , including replay and failure-injection scenarios.
• CI/CD Quality Enforcement: Integrate all test suites into CI as enforced quality gates with strict thresholds rather than advisory reports.
• Suite Health & Root-Cause Triage: Monitor execution time, flake rate, and critical path coverage; perform root-cause analysis to permanently fix test flakiness rather than relying on simple retries.
• AI & Agentic Evaluation: Build evaluation suites for agentic AI workflows (validating tool selection, arguments, escalation behavior, and operating envelope limits).
• Non-Deterministic Testing: Define regression testing for non-deterministic components, including golden-set evaluations, tolerance thresholds, and drift detection post-prompt/model changes.
• Edge & Boundary Verification: Automate test suites for edge deployments (offline/reconnection scenarios) and verify human-in-the-loop security boundaries under adversarial conditions.
• Process & Mentorship: Convert operational SOPs and incomplete specs into executable acceptance criteria alongside Technical Business Analysts, and coach engineers on test ownership.

Must-Have Skills

• Experience Level: 5+ years of hands-on experience owning test automation for distributed systems.
• Core Automation Stack: Deep production experience with Playwright (fixtures, parallelization, trace analysis, CI integration) and strong proficiency in both Python and TypeScript .
• Backend & Messaging: Proven experience in API, contract, and integration testing, service virtualization/mocking, and event-driven architectures like Kafka .
• CI/CD & Infrastructure: Practical experience setting up CI quality gates in GitHub Actions or Azure DevOps , with basic Kubernetes literacy for containerized testing environments.
• AI & Problem-Solving: Hands-on experience with AI-assisted testing methodologies, critical judgment of AI-generated code/tests, and strong root-cause debugging skills.
• English Proficiency: Fluent English for daily written and verbal communication.

Nice-to-Have Skills

• AI Agents & Automation: Experience with Playwright MCP, AI coding agents running non-interactively in CI, or the Claude Agent SDK .
• LLM Product Testing: Prior experience testing LLM or agent-based products in production, non-deterministic systems, or building MCP servers for test observability.
• Resilience & Security Testing: Experience with performance/load testing for high-volume telemetry, chaos/fault-injection, or security testing in CI (dependency scanning/dynamic analysis).
• Domain Knowledge: Background in energy systems, smart grid technology, industrial operations, or data center environments.

Time Zone & Collaboration

The role requires collaboration with teams aligned to Central Time (CT). Flexibility to overlap with North America business hours is expected.

Language

All interviews, documentation, and daily communication will be in English.

#LI