Big Data Engineer - Schibsted Spain at Schibsted Spain (Sant Quirze del Vallès, Spain)

We are looking for a Big Data Engineer for our Data and Insights team, whose general mission will be:

• Be a part in our project of building the Schibsted Spain's centralized data source (DataSwamp DataLake) and the company's Data Warehouse that will feed from it, consolidating data from our different sites: Infojobs, Fotocasa, Vibbo, Milanuncios, Coches.net, Fotos.net, Habitaclia...
• Implement, automate optimize data pipelines, both batch daily extractions and realtime streaming, to feed our data source in S3.
• Provide the department with tools to query our data repository in an easy fast way.
• Help Schibsted Spain taking data-driven decisions to empower improve our customer's experience.

We offer:

• Permanent contract, Full time position
• To be part of a company, with an excellent working environment and modern and creative offices.
• Our headquarters are currently on Sant Cugat, but the next year we will move to new and awesome offices on Barcelona - 22@.
• Working with the best professionals in a leading company
• Opportunities for development and growth within the company and the international group
• Flexible working hours 8-10h / 17-19h (Fridays afternoon off)
• Intensive workday during summer months and Easter
• Attractive remuneration according to your experience.
• Macbook pro or dell laptop

Categoría: Informática y telecomunicaciones - Programación

Nivel: Especialista

Número de vacantes: 1

Estudios mínimos: Ingeniería Superior

Experiencia mínima: Al menos 3 años

Conocimientos necesarios: big data, Java, Scala, AWS

Requisitos mínimos:

• If you are a curious person, positive, proactive and you are passionate about technology, and you also need to work in an environment where you share and feel our company Values: Sharing and collaborating for the common good
• Satisfaction for our users and customers
• Integrity in everything we do
• Personal drive to achieve our dreams
• Joy in working togetherAnd you also have the following skills: Amazon Web Services. Specifically, deploying EMR clusters, ingesting data from/to S3 FileSystem, querying Redshift...
• Good programming skills with Python Java.
• Knowledge of SQL querying. Expertise in multiple DBs (PostgreSQL, SQLServer...) query optimization will be a plus.
• Good scripting skills to request API REST datasets, schedule queries...
• Big Data-related tools: Spark, Kafka consumers, Sqoop... Expertise in Spark transformations will be a plus.
• Continuous Integration automation (Jenkins)
• Version control (GitHub)Join our team!

by via developer jobs - Stack Overflow