Java QA Automation Engineer

About the role

About Qualysoft

· 25 years of experience in software engineering, established in Vienna, Austria

· Active in Romania since 2007, with office in central Bucharest (Bd. Iancu de Hunedoara 54B)

· Delivering End to End IT Consulting Services - From Team Augmentation and Dedicated Teams to Custom Software Development

· We deliver scalable enterprise systems, intelligent automation frameworks, and digital transformation platforms

· Cross-industry experience by sustaining global players in BSFI (Banking, financial services and insurance), Telecom,Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logitics, High Tech

· Global Presence: Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia

· International team of 500+ software engineers

· Strategic partnerships: Microsoft Cloud Certified Partner, Tricentis Solutions Partner in Test Automation and Test Management, Creatio Exclusive Partner, Doxee Implementation Partner

· Powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation.

· Project beneficiaries ranging from large-scale enterprises to startups

· Stable growth and revenue increase year over year, a resilient organisation in volatile IT market conditions

· Quality-first mindset, culture of innovation, and long-term client partnerships

· Global and local reach – trusted by key industry players in Europe and the US

Responsibilities: Build API and integration test coverage for Java/Spring routers and database workflows. • Design and implement Playwright E2E tests for critical user journeys. • Create stable mocking and fixture strategies (MSW, test fixtures, seeded test data). • Set up CI quality gates for linting, unit/integration/E2E tests, coverage, and reporting. • Expand coverage to untested UI and workflow areas and prevent regressions. • Build an LLM evaluation discipline with golden datasets and measurable quality gates. • Track model output reliability, detect drift, and gate releases on quality/stability thresholds. • Improve test maintainability, remove flakiness, and optimize runtime. • LLM QA Tooling • Use LangChain4j for JVM-native LLM application support, including agents, RAG, and guardrails. • Use Langfuse Java SDK and OpenTelemetry for trace capture, prompt/version tracking, and experiment comparison. • Use the OpenAI Java SDK for structured outputs, function calling, webhook verification, and response validation. • Use Promptfoo in CI when you need language-agnostic regression and red-team checks around the Java stack. • Use Java schema validation and guardrail patterns with Jackson, Swagger annotations, and LangChain4j guardrails. • Use OpenTelemetry-based traces and Langfuse datasets as the reproducible source of truth for release gates.

Qualifications: 3+ years in QA automation for production systems. • Strong Java backend testing skills. • Strong frontend testing. • Experience building and maintaining Playwright/Cypress/Selenium E2E suites. • API testing experience (REST, schema validation, auth/error scenarios). • Experience with SQL/PostgreSQL testing and test data management. • CI/CD pipeline experience (GitHub Actions, Azure Pipelines, or Jenkins). • Practical understanding of testing non-deterministic LLM outputs.