Data Engineer, hibrido
Empresa
BNP Paribas
Provincia
Madrid
Ciudad
Madrid
Tipo de Contrato
Tiempo Completo
Descripción
Data Engineer
About the job
Data Engineer within South Europe Technologies (S.ET), BNP Paribas Personal Finance
South Europe Technologies (S.ET) is one of BNP Paribas Personal Finances shared services centers, dedicated to delivering outstanding IT solutions to BNP Paribas Personal Finance entities around the world.
- Applications Management (Architecture, Project Management, Development, and Quality Assurance)
- IT Risks Cybersecurity Services
- Platforms Management
- Data
- Ad-hoc, T M Development
In this context, we are looking for a Data Engineer to join our team.
Mission
As a Data Engineer, your mission is to design, implement, and optimize robust data pipelines, enabling reliable, secure, and high-performance data flows throughout the organization. You will collaborate closely with stakeholders and multidisciplinary teams to support data integration, transformation, and delivery processes, contributing to the ongoing evolution and stability of our data platforms.
Your Main Activities Will Include
- Building and maintaining data pipelines using Spark on Scala to collect and process data from diverse sources including Kafka topics, APIs, HDFS, and structured databases.
- Implementing andmaintainingorchestrators and scheduling systems to automate data pipeline execution (e.g., Airflow as a service).
- Modifying and enhancing existing codebases based on business requirements, continuously driving improvements in performance and maintainability.
- Ensuring andoptimizingthe performance and security of the data infrastructure, applying best practices in Data Engineering.
- Supporting data transformation activities and contributing to data quality assurance to ensure reliability and accuracy of information.
- Setting up CI/CD pipelines to automate deployments, unit testing, and development management.
- Contributing to production support,incidentand anomaly corrections,toimplement functional and technical evolutions ensuring stability of production processes
- Developing andmaintainingcomprehensive technical documentation to ensure effective knowledge capitalization.
- Collaborating with business and IT teams to support changes and deliver results in a dynamic environment.
IT Tools
- Good knowledge of:
- Spark on Scala
- CI/CD tools (Gitlab, Jenkins, etc.)
- HDFS and structured databases (SQL)
- Full understanding of:
- Apache Airflow
- Streaming processes (Kafka, event streams, etc.)
- S3 storage
- Shell scripting
- Some knowledge of:
- Kubernetes
- Optionally/as a plus:
- Elasticsearch and Kibana
- HVault
- Dremiofor data virtualization
- Dataiku
What We Are Looking For
- Knowledge of the banking industry and processes
- Experience in managing business and IT relationships
- Ability to understand, explain, and support change initiatives
- Results-driven mindset andcapacityto deliver
- Strong collaboration and teamwork skills
- Ability to synthesize and simplify complex technical topics
- Proficiencyin analytical thinking and resilience in handling challenges
- Desirable: Familiarity with tools such as DWH, Dataiku, Spark, Airflow, S3, Kubernetes, and CI/CD platforms
Language Skills
- English: B2 level or higher
- French: B1 level (optional)
Benefits
- Training programs, tailored career paths, and opportunities for internal mobility-nationally and internationally-supported by our global presence
- Diversityand Inclusion Committeeworkingto create an inclusive work environment, with active employee communities organizing awareness activities (PRIDE, We Generations,MixCity, etc.)
- Corporate volunteering program (1MillionHours 2 Help) supporting employees in their community engagement
- Flexible compensation plan
- Hybrid telecommuting model (50 )
- 31 vacation days
Diversity and Inclusion Commitment
BNP Paribas Group in Spain is an equal opportunity employer, proud to offer equal employment opportunities to all job seekers. We are deeply committed to ensuring that no individual is discriminated against based on age, disability, gender reassignment, marital or civil partnership status, pregnancy and maternity/paternity, race, religion or belief, sex, or sexual orientation. Equity and diversity are at the heart of our recruitment policy, as we believe they foster creativity and efficiency, ultimately improving performance and productivity.
Spark, Scala, Airflow
About the job
Data Engineer within South Europe Technologies (S.ET), BNP Paribas Personal Finance
South Europe Technologies (S.ET) is one of BNP Paribas Personal Finances shared services centers, dedicated to delivering outstanding IT solutions to BNP Paribas Personal Finance entities around the world.
- Applications Management (Architecture, Project Management, Development, and Quality Assurance)
- IT Risks Cybersecurity Services
- Platforms Management
- Data
- Ad-hoc, T M Development
In this context, we are looking for a Data Engineer to join our team.
Mission
As a Data Engineer, your mission is to design, implement, and optimize robust data pipelines, enabling reliable, secure, and high-performance data flows throughout the organization. You will collaborate closely with stakeholders and multidisciplinary teams to support data integration, transformation, and delivery processes, contributing to the ongoing evolution and stability of our data platforms.
Your Main Activities Will Include
- Building and maintaining data pipelines using Spark on Scala to collect and process data from diverse sources including Kafka topics, APIs, HDFS, and structured databases.
- Implementing andmaintainingorchestrators and scheduling systems to automate data pipeline execution (e.g., Airflow as a service).
- Modifying and enhancing existing codebases based on business requirements, continuously driving improvements in performance and maintainability.
- Ensuring andoptimizingthe performance and security of the data infrastructure, applying best practices in Data Engineering.
- Supporting data transformation activities and contributing to data quality assurance to ensure reliability and accuracy of information.
- Setting up CI/CD pipelines to automate deployments, unit testing, and development management.
- Contributing to production support,incidentand anomaly corrections,toimplement functional and technical evolutions ensuring stability of production processes
- Developing andmaintainingcomprehensive technical documentation to ensure effective knowledge capitalization.
- Collaborating with business and IT teams to support changes and deliver results in a dynamic environment.
IT Tools
- Good knowledge of:
- Spark on Scala
- CI/CD tools (Gitlab, Jenkins, etc.)
- HDFS and structured databases (SQL)
- Full understanding of:
- Apache Airflow
- Streaming processes (Kafka, event streams, etc.)
- S3 storage
- Shell scripting
- Some knowledge of:
- Kubernetes
- Optionally/as a plus:
- Elasticsearch and Kibana
- HVault
- Dremiofor data virtualization
- Dataiku
What We Are Looking For
- Knowledge of the banking industry and processes
- Experience in managing business and IT relationships
- Ability to understand, explain, and support change initiatives
- Results-driven mindset andcapacityto deliver
- Strong collaboration and teamwork skills
- Ability to synthesize and simplify complex technical topics
- Proficiencyin analytical thinking and resilience in handling challenges
- Desirable: Familiarity with tools such as DWH, Dataiku, Spark, Airflow, S3, Kubernetes, and CI/CD platforms
Language Skills
- English: B2 level or higher
- French: B1 level (optional)
Benefits
- Training programs, tailored career paths, and opportunities for internal mobility-nationally and internationally-supported by our global presence
- Diversityand Inclusion Committeeworkingto create an inclusive work environment, with active employee communities organizing awareness activities (PRIDE, We Generations,MixCity, etc.)
- Corporate volunteering program (1MillionHours 2 Help) supporting employees in their community engagement
- Flexible compensation plan
- Hybrid telecommuting model (50 )
- 31 vacation days
Diversity and Inclusion Commitment
BNP Paribas Group in Spain is an equal opportunity employer, proud to offer equal employment opportunities to all job seekers. We are deeply committed to ensuring that no individual is discriminated against based on age, disability, gender reassignment, marital or civil partnership status, pregnancy and maternity/paternity, race, religion or belief, sex, or sexual orientation. Equity and diversity are at the heart of our recruitment policy, as we believe they foster creativity and efficiency, ultimately improving performance and productivity.
Spark, Scala, Airflow