Job Opportunities in Denmark
October 14, 2024
Skillspark AB
København
OTHER
Senior Developer with ETL experience
emagine is currently looking for a Senior Developer with in-depth experience of end to end ETL pipeline for a client in the financial sector.
Detailed description of work task to be carried out:
Roles/Responsibilities of the support team:
-
Take in queries from the DROC team and understand the request/requirements
-
Be the first level of support
-
If the case cannot be resolved by oneself, triage/classify the issues and identify which team to reach out to - dev team/ clients platform team
-
Track and report the progress to DROC and PO
-
Execute ETL runs on DROC validation on Hadoop infrastructure
-
Refresh UIs for DROC validation using elastic search
-
Support DROC to write spark/hive queries if needed to analyze a dataset
-
Support dev team and DROC team for config changes if specified by the relevant team.
Description of knowledge and experience
Competences needed:
-
Understand end to end ETL pipeline
-
Competent within data engineering principles:
-
Write Hive SQL (SPARK) queries (crucial)
-
SCALA knowledge (crucial)
-
Shell scripting (important
-
Quantexa (important)
-
How to work on Cloudera distribution (Oozie) (important)
-
Elasticsearch (basic knowledge)
Familiar with but not needed to expert in:
-
Intelli J
-
Zeppelin
-
Bamboo, Jenkins, Nexus, Artifactory
-
Kafka
Start: ASAP
Duration: 12 months + possibility for extension
Workload: Fulltime, time & material
Location: Taastrup, hybrid
New Jobs from This Company