Vertical Trail LLC is a rapidly growing solutions provider with a mission to help our clients accelerate innovation by deploying advanced analytics solutions in the cloud.
We are looking for a Big Data Engineer to become an integral part of our advanced analytics program, and to help build our team in Philadelphia.
Our Big Data Engineer will use modern technologies to help our clients transform their data into meaningful insights. As a key part of our specialized delivery team, the Big Data Engineer will work onsite with our clients directly - as well as remotely - to deliver scalable data science solutions.
You might be our Big Data Engineer if youre great at
· Assisting with development and data management tasks as needed to support Big Data and analytics projects
· Working closely with developers, data scientists, consultants, and business analysts to understand clients needs
· Designing, building, and launching new data extraction, transformation, and loading processes in production using Spark and PySpark
· Assisting with the design, build, and launch of new production data models
· Supporting existing processes running in production
· Performing AWS EMR cluster maintenance (MapR experience is a plus!)
· Monitoring cluster connectivity and security
· Using AWS EKS to develop scripts for automating common administration tasks
· Troubleshooting data load, transformation scripts, and performance issues
Our Big Data Engineer needs to have
· Excellent verbal and written communication skills (we know everyone says this, but it is especially important in this customer-facing role!)
· Acumen in both leadership (e.g., managing local efforts) and collaboration (e.g., serving as part of a global delivery team)
· 5+ years of experience with Hadoop-based system development and support
· A four-year Computer Science, Engineering, Math, or Analytics degree
· 4+ years of data engineering or database support experience
· 3+ years of experience writing and using Spark
· 3+ years of experience with AWS cloud services (emphasis on EMR, EKS skills)
· 2+ years of experience as Linux admin
Please also note that candidates for this role need to be located near (i.e., able to regularly support clients onsite in) Philadelphia. You must also be able to work for Vertical Trail as a W2 employee, as we are not considering 3rd party or contract candidates for this role.
We are an energetic and innovative company offering attractive benefits including
- Comprehensive Health, Dental, and Vision insurance
- Employer-paid Life and Disability insurance
- 401(k) / Retirement Plan
- Professional Development Plan
by via developer jobs - Stack Overflow
No comments:
Post a Comment