Job Opportunities in United States
October 28, 2024
Cognizant
Stamford
FULL TIME
Azure data Migration Developer
Job Summary
We are seeking an experienced Architect with 10 to 12 years of experience to join our dynamic team. The ideal candidate will have extensive expertise in Spark in Scala Synapse Pipelines Azure CLI Azure Power Shell Structured Streaming Kafka Azure Monitor Azure Data Lake Store Azure Key Vault Azure Dev Ops Azure Event Hub Python Azure Synapse SQL Pool Azure Synapse Spark Pool SQL and Py Spark. This role is hybrid with day shifts and does not require travel.
Responsibilities
We are seeking an experienced Architect with 10 to 12 years of experience to join our dynamic team. The ideal candidate will have extensive expertise in Spark in Scala Synapse Pipelines Azure CLI Azure Power Shell Structured Streaming Kafka Azure Monitor Azure Data Lake Store Azure Key Vault Azure Dev Ops Azure Event Hub Python Azure Synapse SQL Pool Azure Synapse Spark Pool SQL and Py Spark. This role is hybrid with day shifts and does not require travel.
Responsibilities
- Lead the design and implementation of scalable data architectures using Spark in Scala and Synapse Pipelines
- Oversee the development and deployment of data solutions leveraging Azure CLI and Azure Power Shell
- Provide expertise in Structured Streaming and Kafka to ensure real-time data processing
- Implement robust monitoring solutions using Azure Monitor to maintain data pipeline health
- Manage and optimize data storage solutions with Azure Data Lake Store and Azure Key Vault
- Collaborate with Dev Ops teams to streamline CI/CD processes using Azure Dev Ops
- Integrate and manage event-driven architectures with Azure Event Hub
- Develop and maintain data processing scripts using Python and Py Spark
- Optimize SQL queries and manage data warehousing solutions with Azure Synapse SQL Pool
- Utilize Azure Synapse Spark Pool for large-scale data processing and analytics
- Ensure data security and compliance through effective use of Azure Key Vault
- Provide technical guidance and mentorship to junior team members
- Collaborate with cross-functional teams to align data architecture with business objectives
- Drive continuous improvement in data processing and storage solutions
- Conduct performance tuning and optimization of data pipelines
- Ensure high availability and disaster recovery planning for critical data systems
- Stay updated with the latest industry trends and best practices in data architecture
- Document architectural designs and technical specifications for future reference
- Possess a strong background in Spark in Scala and Synapse Pipelines
- Demonstrate proficiency in Azure CLI and Azure Power Shell
- Have hands-on experience with Structured Streaming and Kafka
- Show expertise in Azure Monitor and Azure Data Lake Store
- Be skilled in using Azure Key Vault for data security
- Have experience with Azure Dev Ops for CI/CD processes
- Be knowledgeable in Azure Event Hub for event-driven architectures
- Be proficient in Python and Py Spark for data processing
- Have experience with Azure Synapse SQL Pool and Azure Synapse Spark Pool
- Possess strong SQL skills for data querying and management
- Demonstrate excellent problem-solving and analytical skills
- Have strong communication and collaboration abilities
- Be committed to continuous learning and professional development.
- Azure Solutions Architect Expert Microsoft Certified: Azure Data Engineer Associate Databricks Certified Associate Developer for Apache Spark
Latest Job Opportunities
October 29, 2024
Actalent
Lab Technician - Entry Level No Experience Needed
Windham
FULL TIME
View Details
October 29, 2024
Onsite Women's Health
Breast Imaging Support Specialist
Westport
FULL TIME
View Details
Similar Jobs
August 16, 2024
Netflix
Administrative Assistant, Product Metadata & Ratings
Los Gatos
FULL TIME
View Details
August 2, 2024
North Idaho College
Data and Resource Coordinator
Coeur d'Alene
FULL TIME
View Details
September 10, 2024
SymphonyAI
Shelf Intelligence Data Support Consultant
Chelsea
FULL TIME
View Details
September 9, 2024
Eddy County, New Mexico
SHERIFF CRIME DATA ANALYST - STARTING PAY: $28.23-$31.15
Carlsbad
FULL TIME
View DetailsNew Jobs from This Company