We are seeking a passionate Senior Data Engineer to help us design and build our data infrastructure, data aggregation and ingestion platform. This platform powers our proprietary pricing algorithms, data analytics, and our internal and customer-facing applications.
Our data stack consists of Go, Python and Scala. We use ElasticSearch, Postgres, and Spark heavily. We are ownership-driven, and you will own your projects from design, implementation to operation. We are looking for someone who is passionate about creating great products to help millions of home buyers and sellers buy or sell a home without risk, stress, and uncertainty.
Responsibilities:
-
Design, architect, build and maintain big data infrastructure and tools.
-
Write reliable and efficient programs to handle a broad set of big data use cases.
-
Data qualification, verification and validation.
-
Committed to good engineering practice of testing, logging, alerting and deployment processes.
Requirements:
-
Must be U.S. based.
-
BS or MS in Computer Science, Statistics, Mathematics or equivalent.
-
Minimum of 5 years of full lifecycle software development experience in data engineering, including coding, testing, troubleshooting, and deployment.
-
Strong hands-on expertise with building resilient and reliable ETL pipelines.
-
Programming proficiency in Go, and at least one of Scala or Python.
-
Strong SQL knowledge (MySQL or Postgres), familiarity with techniques to identify slow queries and debugging.
-
Experience working in the AWS data ecosystem (S3, RDS, EMR, Lambda, Redshift, MQs, Kinesis).
-
Understanding of containerized workloads (Docker, Kubernetes, ECS).
-
Strong desire to contribute to a rapidly growing startup and being comfortable with learning new tools and technologies.
Bonus points for knowledge of:
-
RETS/RESO APIs for extracting real estate data
-
GIS datasets (shapefiles, GeoJSON, etc)Open source mapping data (OpenStreetMap (OSM), OpenAddresses)
-
Apache Spark
-
ElasticSearch
by via developer jobs - Stack Overflow
No comments:
Post a Comment