Senior Test Automation Engineer, hibrido
Empresa
UST
Provincia
Madrid
Ciudad
Madrid
Tipo de Contrato
Tiempo Completo
Descripción
Senior Test Automation Engineer
We are still looking for the very Top Talent and we would be delighted if you were to join our team!
More in details, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work company with over 35.000 employees all over the world and presence in more than 35 countries. We are leaders on digital technology services, and we provide large-scale technologic solutions to big companies.
What we look for?
We are looking for a Senior Test Automation Engineer to own and evolve the test automation solution for our AI MLOps platform powering RAG systems, LLM assistants, agentic workflows, and ML pipelines across the project of the client from the banking sector.
High english level is required.
Availability to go to the clients offices in the centre of Madrid 3 days a week.
Key Responsibilities:
- Define automation architecture aligned with the Bank s Test Strategy/Policy
- Build reusable frameworks/patterns for UI, API, data, BDD
- Automate tests with Python (Playwright, pytest, requests, Behave/pytest-bdd)
- Create AI/ML-specific tests (LLM evals, non-determinism handling)
- Implement contract tests (e.g., Pact) and integrate into GitLab CI/CD
- Use Docker/Kubernetes for reproducible test environments
- Manage regressions/smoke suites across DEV/INT/UAT/pre-PROD
- Reduce flakiness, report results, and ensure audit-ready evidence traceability (Jira)
Mandatory requirements:
- 5 7+ years in test automation, strong Python
- Framework ownership (not only scripts) + CI/CD (GitLab preferred)
- Playwright + pytest + API testing BDD (Behave/pytest-bdd)
- Docker + basic Kubernetes strong API/microservices understanding
- Agile/SAFe experience Jira + test management integration
- English at least B2+/C1
Nice to have:
- AI/ML testing exposure (LLM/RAG/agents)
- Regulated industry experience (banking preferred)
- ISTQB Foundation SAFe certs German is a plus
¿What can we offer?
- 23 days of Annual Leave plus the 24th and 31st of December as discretionary days!
- Numerous benefits (Heath Care Plan, Internet Connectivity, Life and Accident Insurances).
- Retribución Flexible Program: (Meals, Kinder Garden, Transport, online English lessons, Heath Care Plan )
- Free access to several training platforms
- Professional stability and career plans
- UST also, compensates referrals from which you could benefit when you refer professionals.
- The option to pick between 12 or 14 payments along the year.
- Real Work Life Balance measures (flexibility, WFH or remote work policy, compacted hours during summertime )
- UST Club Platform discounts and gym Access discounts
If you would like to know more, do not hesitate to apply and we ll get in touch to fill you in details. UST is waiting for you!
In UST we are committed to equal opportunities in our selection processes and do not discriminate based on race, gender, disability, age, religion, sexual orientation or nationality. We have a special commitment to Disability Inclusion, so we are interested in hiring people with disability certificate.
#UST
Python, Playwright, pytest, requests, Behave, pytest bdd,
We are still looking for the very Top Talent and we would be delighted if you were to join our team!
More in details, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work company with over 35.000 employees all over the world and presence in more than 35 countries. We are leaders on digital technology services, and we provide large-scale technologic solutions to big companies.
What we look for?
We are looking for a Senior Test Automation Engineer to own and evolve the test automation solution for our AI MLOps platform powering RAG systems, LLM assistants, agentic workflows, and ML pipelines across the project of the client from the banking sector.
High english level is required.
Availability to go to the clients offices in the centre of Madrid 3 days a week.
Key Responsibilities:
- Define automation architecture aligned with the Bank s Test Strategy/Policy
- Build reusable frameworks/patterns for UI, API, data, BDD
- Automate tests with Python (Playwright, pytest, requests, Behave/pytest-bdd)
- Create AI/ML-specific tests (LLM evals, non-determinism handling)
- Implement contract tests (e.g., Pact) and integrate into GitLab CI/CD
- Use Docker/Kubernetes for reproducible test environments
- Manage regressions/smoke suites across DEV/INT/UAT/pre-PROD
- Reduce flakiness, report results, and ensure audit-ready evidence traceability (Jira)
Mandatory requirements:
- 5 7+ years in test automation, strong Python
- Framework ownership (not only scripts) + CI/CD (GitLab preferred)
- Playwright + pytest + API testing BDD (Behave/pytest-bdd)
- Docker + basic Kubernetes strong API/microservices understanding
- Agile/SAFe experience Jira + test management integration
- English at least B2+/C1
Nice to have:
- AI/ML testing exposure (LLM/RAG/agents)
- Regulated industry experience (banking preferred)
- ISTQB Foundation SAFe certs German is a plus
¿What can we offer?
- 23 days of Annual Leave plus the 24th and 31st of December as discretionary days!
- Numerous benefits (Heath Care Plan, Internet Connectivity, Life and Accident Insurances).
- Retribución Flexible Program: (Meals, Kinder Garden, Transport, online English lessons, Heath Care Plan )
- Free access to several training platforms
- Professional stability and career plans
- UST also, compensates referrals from which you could benefit when you refer professionals.
- The option to pick between 12 or 14 payments along the year.
- Real Work Life Balance measures (flexibility, WFH or remote work policy, compacted hours during summertime )
- UST Club Platform discounts and gym Access discounts
If you would like to know more, do not hesitate to apply and we ll get in touch to fill you in details. UST is waiting for you!
In UST we are committed to equal opportunities in our selection processes and do not discriminate based on race, gender, disability, age, religion, sexual orientation or nationality. We have a special commitment to Disability Inclusion, so we are interested in hiring people with disability certificate.
#UST
Python, Playwright, pytest, requests, Behave, pytest bdd,