Lawrence Harvey are recruiting for a top Data Engineer for one of the top Artificial Intelligence organizations in Austin.
In this position as a Data Engineer will work on developing Machine Learning models and APIs for the companies AI Platform. Your will be involved in interaction with multiple teams across the business to evolve their architecture as well as optime their data acquisition, selection, and pipeline.
Requirements:
- 5+ years of experience owning and building data pipelines
- Extensive knowledge of data engineering tools, technologies and approaches for both batch and streaming environments
- Proven experience building or extending data platforms from scratch for data consumption across a wide variety of use cases (e.g data science, ML, etc)
- Experience with data transformations, API wrappers and output formats used with Machine Learning
- Ability to absorb business problems and understand how to service required data needs
- Demonstrated ability to build complex, scalable systems with high quality
- Experience with multiple data technologies and concepts such as Airflow, Kafka, Hadoop, Hive, Spark, MapReduce, SQL, NoSQL, and Columnar databases
- Experience in one or more of Java, Scala, and Python
- Experience with serverless technologies a plus (e.g. AWS Lambda)
- Hands-on, in-depth experience with AWS or other cloud infrastructure technologies
by via developer jobs - Stack Overflow
No comments:
Post a Comment