Data Engineer, Madrid
Empresa
BASF
Provincia
Madrid
Ciudad
Madrid
Tipo de Contrato
Tiempo Completo
Descripción
Data Engineer
We are currently seeking a talented Snr Data Engineer to join our highly dynamic and collaborative team at BASFs Agricultural Solutions department Digital Factory. In this role, you will be responsible to ensure the effective utilization of data for analysis, reporting, and decision-making by creating and maintaining a robust data infrastructure for BASF Agriculturals enterprise-level IT solutions.
RESPONSIBILITIES
- The role involves both technical and leadership skills to drive efficient product delivery.
- Designing, building, and maintaining data pipelines and infrastructure
- Integrate data from various sources, ensuring data quality, manage data storage, and optimize performance
- Communication and collaboration, ensure compliance, Stakeholder Alignment and Innovation
- Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems such as data warehouses or data lakes
- Integrate data from different databases, applications, and external sources, ensuring data consistency and accuracy.
- Create and maintain data models, schemas, and structures that facilitate efficient data storage and retrieval.
- Transform and clean raw data to prepare it for analysis, including handling missing values, data normalization, and aggregation
- Implement data quality checks, validation processes, and error handling to maintain high data quality standards
- Administer and optimize databases, including performance tuning, indexing, and ensuring data security.
- Automate ETL processes and routine tasks to improve efficiency and reduce manual intervention
- Continuously monitor data pipelines and infrastructure for performance issues, errors, and data anomalies. Troubleshoot and resolve issues promptly.
- Stay updated with the latest data engineering tools and technologies and evaluate their suitability for the organizations needs.
REQUIREMENTS
- Experience in bachelors degree in computer science / computer engineering / information technology or business-technology related discipline
- Min. 3-5 years of professional experience in IT and / or IT Consulting
- Experience in Tools like Databricks, Azure Data Factory, Synapse, SQL Server, Azure DevOps
- Experienced in Python, SQL, Scala, Java
- Business Consulting and Technical Consulting skills
- Familiar with Data Warehouse and Data Lake architecture concept
- Design Implementation of ETL / ELT data pipelines
BENEFITS
- Responsibility from day one in a challenging work environment and on-the-job training as part of a committed team.
- Adequate compensation according to your qualifications and experience A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holidays per year
- Another 5 days (readjustments days) and 2 days (cultural days)
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided
At BASF, the chemistry is right.
Because we are counting on innovative solutions, on sustainable actions, and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.
ETL, Python, SQL, Scala, Java
We are currently seeking a talented Snr Data Engineer to join our highly dynamic and collaborative team at BASFs Agricultural Solutions department Digital Factory. In this role, you will be responsible to ensure the effective utilization of data for analysis, reporting, and decision-making by creating and maintaining a robust data infrastructure for BASF Agriculturals enterprise-level IT solutions.
RESPONSIBILITIES
- The role involves both technical and leadership skills to drive efficient product delivery.
- Designing, building, and maintaining data pipelines and infrastructure
- Integrate data from various sources, ensuring data quality, manage data storage, and optimize performance
- Communication and collaboration, ensure compliance, Stakeholder Alignment and Innovation
- Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems such as data warehouses or data lakes
- Integrate data from different databases, applications, and external sources, ensuring data consistency and accuracy.
- Create and maintain data models, schemas, and structures that facilitate efficient data storage and retrieval.
- Transform and clean raw data to prepare it for analysis, including handling missing values, data normalization, and aggregation
- Implement data quality checks, validation processes, and error handling to maintain high data quality standards
- Administer and optimize databases, including performance tuning, indexing, and ensuring data security.
- Automate ETL processes and routine tasks to improve efficiency and reduce manual intervention
- Continuously monitor data pipelines and infrastructure for performance issues, errors, and data anomalies. Troubleshoot and resolve issues promptly.
- Stay updated with the latest data engineering tools and technologies and evaluate their suitability for the organizations needs.
REQUIREMENTS
- Experience in bachelors degree in computer science / computer engineering / information technology or business-technology related discipline
- Min. 3-5 years of professional experience in IT and / or IT Consulting
- Experience in Tools like Databricks, Azure Data Factory, Synapse, SQL Server, Azure DevOps
- Experienced in Python, SQL, Scala, Java
- Business Consulting and Technical Consulting skills
- Familiar with Data Warehouse and Data Lake architecture concept
- Design Implementation of ETL / ELT data pipelines
BENEFITS
- Responsibility from day one in a challenging work environment and on-the-job training as part of a committed team.
- Adequate compensation according to your qualifications and experience A secure work environment because your health, safety and wellbeing is always our top priority.
- Flexible work schedule and Home-office options, so that you can balance your working life and private life.
- Learning and development opportunities
- 23 holidays per year
- Another 5 days (readjustments days) and 2 days (cultural days)
- A collaborative, trustful and innovative work environment
- Being part of an international team and work in global projects
- Relocation assistance to Madrid provided
At BASF, the chemistry is right.
Because we are counting on innovative solutions, on sustainable actions, and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender, age, origin, sexual orientation, disability or belief.
ETL, Python, SQL, Scala, Java