At Brivo, we are on a journey to transform the physical access control industry. A critical piece of this transformation is a robust data infrastructure. As a data engineer, you will work with a brilliant team to architect a big data platform that is real-time, stable and scalable in order to support data analytics, reporting, data visualization and machine learning. You will help to build the data product with cutting-edge technology and best practices. Your input and contribution will have direct impact on our data strategy and overall product roadmap. Please join us to re-shape how data is processed and analyzed in the security industry!
Responsibilities
Design and develop ETL for the new big data platform with open source technologies such as Kafka, Spark, and Presto etc.
Implement and support streaming technologies such as Kafka, Spark, and Kinesis to move data efficiently
Refactor the existing data model into an easy-to-maintain data solution across the organization
Work with agile teams to perform code reviews and participate in planning and design sessions
Work with QC team to assure product quality
Work with operations team to automate build and deployment from DEV to PROD
Required Qualifications
5+ years of work experience with ETL and data modeling
4+ years of experience with open source technologies (Spark, Kafka, Presto, Hive, Cassandra etc.)
3+ years of experience in architecting and building scalable data platforms processing data on a terabyte or petabyte scale
2+ years of experience with AWS - EMR, Athena, Kinesis, S3, EC2
Expert in at least one SQL language such as T-SQL or PL/SQL.
Understanding of modern data structures and business intelligence reporting tools and track record of applying those on the job
Ability to manage numerous requests concurrently and be able to prioritize and deliver
Good communication skills and dynamic team player
Preferred Experience
Experience in real-time analytics applications.
Experience in both batch and stream processing technologies
Experience with Java or Scala programming languages.
Machine learning experience with Spark or similar
Education
Bachelor’s Degree in computer science, computer engineering, data science or related fields; Master’s and above preferred
by via developer jobs - Stack Overflow
No comments:
Post a Comment