Job Opportunities in Nigeria
September 26, 2024
NEX4
Abuja
CONTRACT & OTHER
Data Engineer (Python, Spark, AWS, Iceberg, Airflow, DBT, Snowflake)
Position Overview:
We are looking for a talented Big Data Engineer to join our dynamic team immediately. The ideal candidate will have a strong background in big data technologies and a passion for building scalable data frameworks. You will play a crucial role in developing a configuration-driven framework utilizing Python and Spark, driving the success of our data initiatives.
Key Responsibilities:
Pay: ₦3,000,000.00 - ₦3,500,000.00 per month
Application Question(s):
We are looking for a talented Big Data Engineer to join our dynamic team immediately. The ideal candidate will have a strong background in big data technologies and a passion for building scalable data frameworks. You will play a crucial role in developing a configuration-driven framework utilizing Python and Spark, driving the success of our data initiatives.
Key Responsibilities:
- Design and implement a configuration-driven framework using Python and Spark.
- Collaborate with cross-functional teams to understand data requirements and ensure data quality and integrity.
- Work with AWS services, including EMR, to efficiently process and analyze large datasets.
- Utilize tools such as Airflow and DBT for workflow orchestration and data transformation.
- Develop, test, and maintain scalable data pipelines and ETL processes.
- Ensure version control and collaboration through GIT.
- Optimize existing processes and identify opportunities for improvements in data processing and analytics.
- Monitor and troubleshoot data pipelines to ensure reliable data delivery.
- Proficient in Python and Spark.
- Experience with AWS services, particularly EMR.
- Familiarity with Iceberg, GIT, Airflow, DBT, Trino, Snowflake, and Linux/Unix environments.
- Strong problem-solving skills and the ability to work in a fast-paced environment.
- Bachelor’s degree in Computer Science, Data Science, or a related field.
- Proven experience as a Big Data Engineer or in a similar role.
- Strong understanding of big data technologies and methodologies.
- Excellent communication and teamwork skills.
Pay: ₦3,000,000.00 - ₦3,500,000.00 per month
Application Question(s):
- Are you available to start new position immediately?
- Are you familiar with Python, Spark, AWS Services with EMR, Iceberg, GIT, Airflow, DBT, Trino, Snowflake, DBT, Linux/Unix and Airflow. ? These are the mandatory skills.
- Are you available to work full-time (8 AM ~ 5 PM PST) remotely at your home?
Latest Job Opportunities
October 26, 2024
Lordwin Group
Architech with String 3D Modeling and Video Animation Skills
Lagos
FULL TIME
View DetailsSimilar Jobs
September 13, 2024
Triple X Environmental Health Consult
Data Collection Officer and Administrative Assistant
Abuja
FULL TIME
View DetailsSeptember 13, 2024
NoemDek
Data Sourcing Analyst – Downstream Oil & Gas Industry
Lagos
FULL TIME
View Details