We are currently looking for a motivated and experienced Data Infrastructure Lead (m/f).
You will be the lead of a growing Data Engineering Team at mytaxi that works with an extensive variety of data systems in order to expand and develop an analytical platform that enables business users and data scientists to make data driven decisions, build innovative data products and roll out advanced analytics.
The Data Engineering Team is committed to developing a modern data infrastructure at mytaxi based on a Hadoop Data Warehouse. We are integrating and consolidating data from a broad range of micro services in our data pipelines. It is the team’s responsibility to maintain the data warehouse,
the data pipelines and make information available for analytics, reporting, research and data products. Together with your team you will develop and improve our brand new tech stack including tools like Kafka, Spark, Airflow and Presto.
Tasks will include:
- Scale and optimize mytaxi Data Warehouse Architecture with the company growth
- Create blueprints for data management systems to integrate, centralize, protect and maintain data sources
- Write efficient data pipelines using f.e. Kafka, Spark or Airflow
- Provide Rest APIs for Data Products
- Explore new technologies and look for the best technologies for the job
- You are the technological and disciplinary lead of the data engineering teams
- You work independent and are responsible for the continuous functional and personal development of the team members (e.g. through regular feedback talks) as well as the expansion of your teams
Your experiences
- In-depth understanding of the Hadoop Ecosystem
- Extensive experience in modelling a Data Warehouse
- Extensive Experience with writing data-driven production ready code (preferably Java)
- Experience in designing and implementing streaming applications (preferably Kafka)
- In-depth knowledge of database architecture
- Fully understand standard architecture methodologies, processes and best practices
- At least 6 years of experience in (disciplinary and technical) leadership of employees
- It is in your nature to identify challenges directly
- Knowledge in mentoring and training of employees
- You have strong communication and motivational skill
- Team orientated and also able to work independently
- Fluent proficiency in English is vital, German is a bonus but not required
- Experience in an international company or team away from your home country is a plus
If you are passionate about data and you want to play an essential role for our future growth, you would be a perfect fit.
by via developer jobs - Stack Overflow
No comments:
Post a Comment