September 16, 2024

Golabs

Quesada

Senior Data Engineer with ML Experience

About the job Senior Data Engineer with ML Experience

We're seeking an experienced Senior Data Engineer to help our team, focusing on building and optimizing data pipelines for Machine Learning (ML) projects using the Databricks platform.
Key Responsibilities:

Design, develop, and maintain scalable data pipelines for ML projects on Databricks.
Implement ETL processes using Databricks' Delta Lake and Spark SQL.
Optimize data workflows for efficient ML model training and deployment.
Collaborate with data scientists to prepare and transform data for ML models.
Utilize Databricks' MLflow for ML experiment tracking and model management.
Implement data quality checks and monitoring solutions.
Leverage Databricks' Unity Catalog for data discovery and governance.
Contribute to the development of ML feature stores and automated feature engineering.
Assist in deploying ML models to production environments.
Mentor junior data engineers and promote best practices.

Qualifications:

Bachelor's degree in Computer Science, Data Science, or a related field.
5+ years of experience in data engineering, with at least 2 years focusing on ML projects.
Proficient in Mandarin (Chinese).
Strong expertise in Databricks platform and its components (Delta Lake, MLflow, Spark SQL).
Proficiency in Python and SQL; experience with Scala is a plus.
Familiarity with ML workflows and requirements for data preparation.
Knowledge of data modeling, data warehousing, and dimensional modeling concepts.
Experience with version control systems (e.g., Gitla B) and CI/CD pipelines.

Preferred Qualifications:

Databricks certifications (e.g., Databricks Certified Data Engineer Associate).
Experience with Databricks' Auto ML and Feature Store capabilities.
Knowledge of real-time data streaming technologies (e.g., Kafka, Spark Streaming).
Familiarity with containerization technologies (Docker, Kubernetes).
Experience with graph processing and analytics.

Why Join Us:

Full-time position
Payment in US dollars
100% remote anywhere in LATAM
12 PTO per year
Holiday from your country off and paid
Birthday off and paid
Career Path
Recognition Program
Paid Leaves

If you meet these requirements and are interested in applying for this position, please let us know. We look forward to the possibility of working with you.