Position: Java Data Engineer
Location: Pittsburgh
You’ll be joining our data engineering team as a java data engineer and be responsible for the creation of DataLakes, DataMarts and processing of high-velocity data. You'll write performant Java code that ingests a large variety of data from field robots that is used for: logging, monitoring and remote troubleshooting. You will work daily with Roboticist's and Data Scientists.
Requirements:
- 5+ years Java Development
- 2+ years Big Data Engineering
- 2+ years working with DataMarts or DataLakes
- Experience with streaming data systems such as Kinesis or Kafka
- Production experience with query languages such as SQL.
- Strong Java multi-threading experience
- Production experience to Apache Big Data tooling such as Hadoop, M/R and Spark
- Working knowledge of ETL using a variety of tools
- Production experience with either Postgres, MariaDB or SQL Server
- Ability to give guidance on Datamart schema creation to Data Scientists
- Exposure to Structured or Semi-Structured log analysis
- Have run a production service in some cloud provider for 2+ year
Nice to haves:
- Working with non-traditional data sets such as sensor or image analysis
- Exposure to containers and working with container orchestrators such as Kubernetes
- Strong CI/CD experience so you can test your code before deployment
- Knowledge of configuration management and how to use it to increase your velocity
by via developer jobs - Stack Overflow
No comments:
Post a Comment