Overview
At Brivo, we are on a journey to transform physical access control industry. A critical piece of this transformation is a robust data infrastructure. As a lead data engineer, you will lead a team to architect a big data platform that is real-time, stable and scalable to support data analytics, reporting, data visualization and machine learning. You will help to build the Data Engineering team, mentor and motivate team members on cutting edge big data technology and best practice. Your input and contribution will have direct impact on our future data strategy and our product roadmap. Please join us to re-shape how data is processed and analyzed in the security industry!
Responsibilities
Define big data strategy through collaborations with stakeholders, architecture team and product team to support data analytics, reporting, data visualization, and machine learning
Lead the team to build the new real time big data platform with open source technologies such as Kafka, Spark, and Presto etc.
Refactor the existing data model into an easy-to-maintain data solution across the organization
Collaborate with QC team to assure product quality
Collaborate with release team and operational team to automate build and deployment from DEV to PROD
Mentor the team to improve the process and promote the best practices
Required Qualifications
7+ years of work experience with ETL and data modeling
5+ years of experience with open source technologies (Spark, Kafka, Presto, Hive, Cassandra etc.)
4+ years of experience in architecting and building scalable data platforms processing data on a terabyte or petabyte scale
3+ years of experience with AWS - EMR, Athena, Kinesis, S3, EC2
Proficient in programming languages such as Java, Scala and Python
In-depth knowledge of NoSQL as well as SQL databases
Good understanding of modern data structures and business intelligence reporting tools and track record of applying those to build a system
Ability to be efficient and to prioritize and deliver on time
Excellent communication skills and dynamic team player
Preferred Experience
Experience in real-time analytics applications.
Experience in both batch and stream processing technologies
Experience with Java or Scala programming languages.
Machine learning experience with Spark or similar
by via developer jobs - Stack Overflow
No comments:
Post a Comment