As a Data Engineer, you will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
You will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Technologies we use
If you join KNEIP, you will work on the following technologies:
- Big Data tools such as Hadoop, Spark, NiFi, Kafka, Hive, Sqoop, Storm etc
- Relational SQL and NoSQL databases, including Postgres and hbase
- Cloud services such as Azure/AWS
- Object-oriented/functional languages: Python, Java, Scala etc.
Your challenge
- You will assemble large, complex data sets that meet functional / non-functional business requirements
- You will work with stakeholders including the Product, Data and Architecture teams to assist with data-related technical issues and support their data infrastructure needs
- You will keep data segregated and secure across physical and logical boundaries, and assist in the roll-out of good data governance practices
- You will create data tools for analytics and data scientist team members that assist them in building and optimizing our products into an innovative industry leader.
Who you are
You have the following characteristics, knowledge, skills to do the job at a high level of accomplishment:
- You have at least 3+ years of experience in a Data Engineer role
- You have a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
- You have experience building and optimizing ‘big data’ data pipelines, architectures and data sets within the Hadoop ecosystem
- You have advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- You have strong analytic skills related to working with unstructured datasets
- You are able to build processes supporting data transformation, data structures, metadata, dependency, data governance and workload management
- You have a successful history of manipulating, processing and extracting value from large disconnected datasets
- You have a working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
- You have the ability to self-organise and manage own workload and priorities
During the recruitment process candidates may be asked a criminal record extract for background screening purposes.
You get
As a member of the KNEIP team you will be working in a dynamic, multi-lingual and multi-cultural environment. We offer you an attractive salary package, a number of benefits and a flexible work-time schedule. We attach great importance to the personal fulfilment and professional development of our employees.
About KNEIP
With over 270 multi-lingual employees across 6 locations, KNEIP is a leading service and software provider to the global investment fund industry. We work with fund managers and administrators around the world to aggregate, format, and disseminate their fund data and reporting documents. Throughout this entire process, we control, report, and actively follow up on their quality and accuracy.
We offer data management, reporting, and dissemination solutions that enable our clients to free up their time and resources, so they can concentrate on their core business. We help our clients provide consistent and accurate fund data & documents to their distributors and meet their regulatory reporting obligations.
by via developer jobs - Stack Overflow
No comments:
Post a Comment