Big Data Engineer at IQVIA, The Human Data Science Company (Warren, NJ)

Job Description





Big Data Developer - Software Engineer

Job Overview

We are looking for software engineer with expertise in Apache SPARK to join our software team. The candidate will implement in Scala to process data for use in a Commercial Data Warehouse based on AWS + other partner solutions. The candidate would have good design sense that will help very large data sets be consumable by a range of disciplines.

The candidate will contribute to components of our Data Warehouse platform a range of data warehouse related software such as data modeling, setting up relational and dimensional databases, transforming data using Scala, and writing advanced SQL based scripts and tools. 

Communication with different disciplines will be an important aspect. As we have teams in multiple geographies, the importance of oral communication, and being a positive team player is just greater.

Qualifications

Required

• 
  
• Apache Spark Expertise, especially in Scala
• 
  
• Expert level knowledge of SQL, data modeling and database architecture
• 
  
• Hands on experience with Java
• 
  
• Hands on experience with Basic Scripting languages including Shell Script
• 
  
• Working experience of Databricks or similar
• 
  
• Knowledge of concepts such as data warehouse, star schemas, KPIs
• 
  
• Hands on experience with Linux, HDFS, HIVE, HADOOP
• 
  

Preferred

• 
  
• Excellent written and communication skills
• 
  
• Be able to organize ideas and technical details; and present work clearly through the product lifecycle
• 
  
• Ability to work in an agile environment
• 
  
• Experienced in designing and implementing data layers and middle tiers aimed at business intelligence applications
• 
  
• Degree in Computer Science or a related subject
• 
  
• Experience with columnar data sources such as Redshift, Parquet, etc.
• 
  
• Hands on experience with AWS
• 
  

by via developer jobs - Stack Overflow