TecHHire Global is hiring for: Senior Data Engineer - GCP (4-9 yrs)

Hi Mohamed Bilal,

Here's an interesting job that we think might be relevant for you -

Job Title: Senior Data Engineer - GCP (4-9 yrs)

Click here to Apply

Job Description :

Job Description :

We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP cloud.

Responsibilities :

Must be able to write quality code and build secure, highly available systems.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc with the guidance.Create data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader.Monitoring performance and advising any necessary infrastructure changes.Defining data retention policies.Implementing the ETL process and optimal data pipeline architectureBuild analytic tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.Create design documents that describe the functionality, capacity, architecture, and process.Develop, test, and implement data solutions based on finalised design documents.Work with data and analytics experts to strive for greater functionality in our data systems.Proactively identify potential production issues and recommend and implement solutions

Requirements :

Should have at least 2 years of relevant experience as GCP Data EngineerEducational Qualifications - Bachelor's/Master'sGood understanding of optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and GCP big data' technologiesStrong in SQL and good understanding and experience in writing stored proceduresGood experience in GCPGood experience in Hadoop, Big dataProficient understanding of distributed computing principlesExperience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.Implemented complex projects dealing with the considerable data size (PB).Optimisation techniques (performance, scalability, monitoring, etc.)Experience with integration of data from multiple data sources preferably AWSExperience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.Knowledge of various ETL techniques and frameworks, such as FlumeExperience with various messaging systems, such as Kafka or RabbitMQGood understanding of Lambda Architecture, along with its advantages and drawbacksCreation of DAGs for data engineeringExpert at Python /Scala programming, especially for data engineering/ ETL purposes

To view the job description, Please refer to the below link:
https://www.hirist.com/j/senior-data-engineer-gcp-4-9-yrs-1331874.html?ref=tm

PS: Please ignore this email if you have already applied or not interested in this job.

Best regards,
Team hirist.com
info@hirist.com