October 17, 2024

Chubb

México

OTHER

Data Engineer Sr

Job Description:
We are currently seeking an experienced Python and Data Bricks Developer with knowledge of SQL to join our team. As a Python and Data Bricks Developer, you will be responsible for developing and maintaining Python applications and utilizing Data Bricks for data processing and analysis. Proficiency in SQL is required for this role as you will be working extensively with databases and data manipulation.
Responsibilities:

Develop Python applications for data processing, analysis and ensuring high performance and scalability.
Utilize Data Bricks for data transformation, exploration, and analysis.
Collaborate with data engineers and data scientists to design and implement efficient and accurate data processing pipelines.
Write and optimize SQL queries for data retrieval and manipulation.
Develop, deploy, and monitor data pipelines and workflows within Data Bricks.
Troubleshoot and resolve data pipeline and application issues in a timely manner.
Document technical specifications, process flows, and solutions.

Requirements:

Bachelor’s degree in computer science, Engineering, or a related field.
Proficiency in Python and its libraries/frameworks such as Pandas, Num Py, Fast API/Flask.
Knowledge of SQL and experience working with relational databases such as My SQL, Postgre SQL, or SQL Server.
Hands-on experience with Data Bricks for data processing, analysis, and visualization.
Familiarity with cloud platforms, particularly Azure Cloud, will be an added advantage.
Knowledge of containerization technologies such as Docker and Kubernetes, specifically Azure Kubernetes Service (AKS), is a plus.
Solid understanding of software development principles, version control systems, and agile methodologies.
Strong problem-solving and analytical skills.
Excellent communication and teamwork abilities.

Additional requirements for senior level resource:

Collaborate with stakeholders and actively participate in problem-solving tasks.
Collaborate with Architects and Product Owners to finalize designs and review the work of other team members.
Engage with cross-functional technical teams to discuss and stay informed about essential Infrastructure-related tasks.