Backend Developer - BI Spark/Scala, hibrido
Empresa
Talan
Provincia
Málaga
Ciudad
Málaga
Tipo de Contrato
Tiempo Completo
Descripción
Backend Developer - BI Spark/Scala
Company Description
Talan - Positive Innovation
Talan is an international consulting group specializing in innovation and business transformation through technology. With over 7,200 consultants in 21 countries and a turnover of 850M, we are committed to delivering impactful, future-ready solutions.
Talan at a Glance
Headquartered in Paris and operating globally, Talan combines technology, innovation, and empowerment to deliver measurable results for our clients. Over the past 22 years, weve built a strong presence in the IT and consulting landscape, and were on track to reach 1 billion in revenue this year.
Our Core Areas of Expertise
- Data Technologies: We design and implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI.
- Cloud Application Services: We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS, and IBM Maximo, helping clients transition to the cloud and improve operational efficiency.
- Management Innovation Consulting: We lead business and digital transformation initiatives through project and change management best practices (PM, PMO, Agile, Scrum, Product Ownership), and support domains such as Supply Chain, Cybersecurity, and ESG/Low-Carbon strategies.
We work with major global clients across diverse sectors, including Transport Logistics, Financial Services, Energy Utilities, Retail, and Media Telecommunications.
Job Description
We are looking for a Senior Developer with strong experience in data engineering and ETL development to join our team. The ideal candidate will have solid expertise in building and maintaining scalable data pipelines, working with big data technologies, and ensuring high-quality data processing within modern data platforms.
You will play a key role in the design, development, and optimization of data solutions, contributing to the development of robust data architectures and supporting business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain ETL pipelines for data ingestion and transformation.
- Work with Spark and Scala to build scalable data processing solutions.
- Design and implement data models to support analytics and reporting needs.
- Develop and maintain data lake solutions using technologies such as Apache Hive, S3, and AWS.
- Ensure data quality and validation across data pipelines and datasets.
- Write and optimize complex SQL queries for data processing and analysis.
- Work with relational database systems and ensure efficient data storage and retrieval.
- Contribute to BI and analytics environments, integrating with tools such as Databricks, Power BI, or Starburst.
- Implement unit testing and ensure code quality using static code analysis tools such as Sonar or Fortify.
- Support and maintain CI/CD pipelines to ensure efficient and reliable software delivery.
Required Experience
- 5+ years of experience implementing ETL processes.
- 3+ years of experience with Apache Spark.
- 3+ years of experience with Scala.
- 2+ years of experience working with BI tools (e.g., Databricks, Power BI, Starburst).
- Strong expertise in SQL.
- Experience in data model design.
- Hands-on experience with Data Lakes (Apache Hive, S3, AWS).
- Experience working with relational database systems.
- Experience in data validation and quality assurance.
- Experience with unit testing and static code analysis tools (Sonar and/or Fortify).
- Strong understanding of CI/CD and modern software delivery practices.
Qualifications
Additional Information
What do we offer you?
- Full-time contract.
- Smart Office Pack so that you can work comfortably from home.
- Training and career development.
- Benefits and perks such as private medical insurance, life insurance.
- Possibility to be part of a multicultural team and work on international projects.
- This is a hybrid position based in Málaga, Spain.
- Possibility to manage work-permits.
If you are passionate about development tech, we want to meet you!
Spark, Scala, ETL, SQL, Apache Hive, S3,
Company Description
Talan - Positive Innovation
Talan is an international consulting group specializing in innovation and business transformation through technology. With over 7,200 consultants in 21 countries and a turnover of 850M, we are committed to delivering impactful, future-ready solutions.
Talan at a Glance
Headquartered in Paris and operating globally, Talan combines technology, innovation, and empowerment to deliver measurable results for our clients. Over the past 22 years, weve built a strong presence in the IT and consulting landscape, and were on track to reach 1 billion in revenue this year.
Our Core Areas of Expertise
- Data Technologies: We design and implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI.
- Cloud Application Services: We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS, and IBM Maximo, helping clients transition to the cloud and improve operational efficiency.
- Management Innovation Consulting: We lead business and digital transformation initiatives through project and change management best practices (PM, PMO, Agile, Scrum, Product Ownership), and support domains such as Supply Chain, Cybersecurity, and ESG/Low-Carbon strategies.
We work with major global clients across diverse sectors, including Transport Logistics, Financial Services, Energy Utilities, Retail, and Media Telecommunications.
Job Description
We are looking for a Senior Developer with strong experience in data engineering and ETL development to join our team. The ideal candidate will have solid expertise in building and maintaining scalable data pipelines, working with big data technologies, and ensuring high-quality data processing within modern data platforms.
You will play a key role in the design, development, and optimization of data solutions, contributing to the development of robust data architectures and supporting business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain ETL pipelines for data ingestion and transformation.
- Work with Spark and Scala to build scalable data processing solutions.
- Design and implement data models to support analytics and reporting needs.
- Develop and maintain data lake solutions using technologies such as Apache Hive, S3, and AWS.
- Ensure data quality and validation across data pipelines and datasets.
- Write and optimize complex SQL queries for data processing and analysis.
- Work with relational database systems and ensure efficient data storage and retrieval.
- Contribute to BI and analytics environments, integrating with tools such as Databricks, Power BI, or Starburst.
- Implement unit testing and ensure code quality using static code analysis tools such as Sonar or Fortify.
- Support and maintain CI/CD pipelines to ensure efficient and reliable software delivery.
Required Experience
- 5+ years of experience implementing ETL processes.
- 3+ years of experience with Apache Spark.
- 3+ years of experience with Scala.
- 2+ years of experience working with BI tools (e.g., Databricks, Power BI, Starburst).
- Strong expertise in SQL.
- Experience in data model design.
- Hands-on experience with Data Lakes (Apache Hive, S3, AWS).
- Experience working with relational database systems.
- Experience in data validation and quality assurance.
- Experience with unit testing and static code analysis tools (Sonar and/or Fortify).
- Strong understanding of CI/CD and modern software delivery practices.
Qualifications
Additional Information
What do we offer you?
- Full-time contract.
- Smart Office Pack so that you can work comfortably from home.
- Training and career development.
- Benefits and perks such as private medical insurance, life insurance.
- Possibility to be part of a multicultural team and work on international projects.
- This is a hybrid position based in Málaga, Spain.
- Possibility to manage work-permits.
If you are passionate about development tech, we want to meet you!
Spark, Scala, ETL, SQL, Apache Hive, S3,