N-i X is looking for a Senior Python Data Engineer in Medellin. As a Data Engineer, you will dive into the heart of data infrastructure, crafting solutions that drive business forward. You will collaborate with a dynamic team to transform raw data into actionable insights. Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes in AWS environment
Architect and implement efficient data warehousing solutions, ensuring optimal performance and reliability
Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions
Optimize and tune existing data pipelines and queries to improve performance and reduce latency
Ensure data integrity, quality, and security across all data processes and systems
Troubleshoot and resolve data-related issues in a timely manner
Stay updated with industry trends and best practices in data engineering, recommending, and implementing new technologies and methodologies as needed
Requirements:
Bachelor's degree in Computer Science, Engineering, or a related field
5+ years of experience in data engineering, with a focus on SQL, Python, and data warehousing
Solid understanding of data warehousing concepts and best practices
Strong proficiency in SQL, with experience in writing complex queries, stored procedures, and performance tuning
Proficiency in Python for data manipulation, scripting, and automation
Hands-on experience with AWS data services such as Redshift, Lambda, Glue, S3, etc.
Experience with version control systems such as Git
Strong analytical and problem-solving skills with attention to detail
Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
Will be a plus:
Master's degree or higher in Computer Science, Engineering, or a related field
Experience with big data technologies such as Spark, Hadoop, or Kafka
Experience with modern reporting software – SSRS & Power BI
Knowledge of machine learning concepts and frameworks