Evalueserve is a global professional services provider offering research, analytics, and data management services. Were powered by mind+machine a unique combination of human expertise and best-in-class technologies that use smart algorithms to simplify key tasks. This approach enables us to design and manage processes that can generate and harness insights on a large scale, significantly cutting costs and timescales and helping businesses that partner with us to overtake the competition.
We work with clients across a wide range of industries and business functions, helping them to make better decisions faster; reach new levels of efficiency and effectiveness; and see a tangible impact on their top and bottom line.
Position description
Department - Corporate & Professional Services
Nature of Job - Permanent
Location - Raleigh, NC
Job Title - Big Data Architect
Big Data Engineer for IoT and Streaming Data will be responsible for creating and optimizing data pipeline architecture, as well as optimizing data flow and collection for real-time applications and analytics. Must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
Responsibilities:
· Design, develop and maintain optimal data pipeline architecture for real-time streaming data pipelines.
· Assemble large, complex data sets that meet business requirements.
· Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, designing infrastructure for scalability, etc.
· Build processes supporting data transformation, data structures, metadata, dependency and workload management.
· Work with stakeholders to assist with data-related technical issues and support their data needs.
· Responsible for ensuring compliance with applicable laws, regulations and company policies across areas of organizational responsibility.
Professional Experience/Qualifications:
· Bachelors degree in Computer Science or related quantitative disciplines.
· 5+ years of experience in a Data Engineer role
· Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
· 3+ years of experience in any streaming real-time data pipeline technology such as Kafka, AWS Kinesis or similar
· Must have experience with big data tools: Hadoop, Spark, etc.
· Must have experience with real-time streaming data ingestion into big data platforms for IoT.
· Experience in with streaming data in the manufacturing, automotive, or similar industries
· Experience with relational SQL and NoSQL databases
· Experience with languages: Python, Java, C++, Scala, etc.
by via developer jobs - Stack Overflow
No comments:
Post a Comment