Job Opportunities in India
September 10, 2024
Ikrux
Big data- GCP
Hadoop Big Data Pyspark SQL
Hands on experience is mandatory for the GCP Python Java Spark SQL and Bigdata
Key Responsibilities
o Responsible for designing Data Engineering solutions on bigdata ecosystem developing custom applications and modifying existing applications to meet distinct and changing business requirements Hands on coding debugging and documentation as well as working closely with SRE team Provide post implementation and ongoing support
o Develop and design software applications translating user needs into system architecture Assess and validate application performance and integration of component systems and provide process flow diagrams Test the engineering resilience of software and automation tools
o You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers Software Engineers who join our Loyalty Technology team will be assigned to one of several exciting teams that are developing a new nimble and modern loyalty platform which will support the key element of connecting with our customers where they are and how they choose to interact with American Express
o Be part of an enthusiastic high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand
o The position will also play a critical role partnering with other development teams testing and quality and production support to meet implementation dates and allow smooth transition throughout the development life cycle
o The successful candidate will be focused on building and executing against a strategy and roadmap focused on moving from monolithic tightly coupled batch based legacy platforms to a loosely coupled event driven microservices based architecture to meet our long term business goals
Must Have Qualifications
o master’s in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent
o Deep understanding of Hadoop and Spark Architecture and its working principle
o Deep understanding of Data warehousing concepts
o Ability to design and develop optimized Data pipelines for batch and real time data processing
o 5 years of software development experience
o 5 years’ experience on Python or Java Hands on experience on writing and understanding complex SQL Hive Py Spark data frames optimizing joins while processing huge amount of data
o 3 years of hands on experience of working with Map Reduce Hive Spark core SQL and Py Spark
o Hands on Experience on Google Cloud Platform Big Query Data Proc Cloud Composer
o 3 years of experience in UNIX shell scripting
o Should have experience in analysis design development testing and implementation of system applications
o Ability to effectively communicate with internal and external business partners
Additional Good to have requirements
o Understanding of Distributed eco system
o Experience in designing and building solutions using Kafka streams or queues
o Experience with No SQL i e HBase Cassandra Couchbase or Mongo DB
o Experience with Data Visualization tools like Tableau Si Sense Looker
o Ability to learn and apply new programming concepts
o Knowledge of Financial reporting ecosystem will be a plus
o Experience in leading teams of engineers and scrum teams
Primary Skills:
Big Data-Hadoop-Spark-Python/Scala
No of Position: 1
Experience Range: 8-12 years
Budget: 25 LPA
Hands on experience is mandatory for the GCP Python Java Spark SQL and Bigdata
Key Responsibilities
o Responsible for designing Data Engineering solutions on bigdata ecosystem developing custom applications and modifying existing applications to meet distinct and changing business requirements Hands on coding debugging and documentation as well as working closely with SRE team Provide post implementation and ongoing support
o Develop and design software applications translating user needs into system architecture Assess and validate application performance and integration of component systems and provide process flow diagrams Test the engineering resilience of software and automation tools
o You will be challenged with identifying innovative ideas and proof of concept to deliver against the existing and future needs of our customers Software Engineers who join our Loyalty Technology team will be assigned to one of several exciting teams that are developing a new nimble and modern loyalty platform which will support the key element of connecting with our customers where they are and how they choose to interact with American Express
o Be part of an enthusiastic high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand
o The position will also play a critical role partnering with other development teams testing and quality and production support to meet implementation dates and allow smooth transition throughout the development life cycle
o The successful candidate will be focused on building and executing against a strategy and roadmap focused on moving from monolithic tightly coupled batch based legacy platforms to a loosely coupled event driven microservices based architecture to meet our long term business goals
Must Have Qualifications
o master’s in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent
o Deep understanding of Hadoop and Spark Architecture and its working principle
o Deep understanding of Data warehousing concepts
o Ability to design and develop optimized Data pipelines for batch and real time data processing
o 5 years of software development experience
o 5 years’ experience on Python or Java Hands on experience on writing and understanding complex SQL Hive Py Spark data frames optimizing joins while processing huge amount of data
o 3 years of hands on experience of working with Map Reduce Hive Spark core SQL and Py Spark
o Hands on Experience on Google Cloud Platform Big Query Data Proc Cloud Composer
o 3 years of experience in UNIX shell scripting
o Should have experience in analysis design development testing and implementation of system applications
o Ability to effectively communicate with internal and external business partners
Additional Good to have requirements
o Understanding of Distributed eco system
o Experience in designing and building solutions using Kafka streams or queues
o Experience with No SQL i e HBase Cassandra Couchbase or Mongo DB
o Experience with Data Visualization tools like Tableau Si Sense Looker
o Ability to learn and apply new programming concepts
o Knowledge of Financial reporting ecosystem will be a plus
o Experience in leading teams of engineers and scrum teams
Primary Skills:
Big Data-Hadoop-Spark-Python/Scala
No of Position: 1
Experience Range: 8-12 years
Budget: 25 LPA
We regret to inform you that this job opportunity is no longer available
Latest Job Opportunities
October 19, 2024
Quincare Pharmaceuticals Private Limited
Medical Representative
Bankura
FULL TIME
View Details