About the position
We are looking for a Big Data Engineer who has a passion and interest to help the business leverage its wealth of existing data and ready it for the future. You will help increase business performance by ingesting, transforming and analysing large volumes of multi structured and unstructured data.
With a demonstrated knowledge of data methodologies, architectures and transformations you will be expected to work both independently and as part of the team. This role will allow you to engage in all phases of data management from data extraction through transformation to ingestion and value provision.
You will be motivated to drive the collection and storage of every byte of data you can get access to because you foresee that the future is driven by that data and want to enable JB Hi-Fi to extract the best value from it.
Key responsibilities include but are not limited to
- Optimize queries and structures for distributed execution
- Help define company-wide relevant data sources to drive the collection of new data
- End to end solution integrity (including design, build, test and deploy)
- Help define the common data architecture asset including framework, principle, guideline and template
- Conduct research from which we will develop prototypes and proof of concepts
- Offer methods of data pre-processing, cleansing, and related Extract Transform Load (ETL) tasks.
- Improve the quality of the authoritative data store used in our analytical solutions
About our ideal candidate
- Demonstrable experience of Hadoop technologies e.g. PySpark, SparkSQL and Hive
- Highly proficient in Python (including within Jupyter notebooks),
- Ability to write and optimize complex queries using both SQL and NoSQL.
- Prior experience in MSSQL CDC and SSIS
- Experience working with, and configuring AWS services (such as S3, Redshift, EMR, and Kinesis), preferably in a production environment.
- Strong understanding of data ETL and data processing concepts
- Works well in a team environment
- Help shape the teams output to improve the overall business performance
- Ability to foster a culture of understanding and attention to detail throughout the team
- Via creative thinking, solve complex problems and discover the best solution path.
Our Benefits
- Generous staff discounts
- Access to training and development
- Collaborative work environment
- Fantastic career opportunities across the broader JB Hi-Fi and The Good Guys Group
- 6 weeks paid maternity leave
- Employee Assistance Program
by via developer jobs - Stack Overflow
No comments:
Post a Comment