HSBC Group

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

Department: - CTO DT – Data Provisioning Technologies 

In this role, you will be: 

Responsible for the end-to-end technical management and stability of Hadoop-based big data platforms, encompassing design, development, deployment, monitoring, and support. Key responsibilities include resolving production incidents, maintaining system performance, managing cluster upgrades, ensuring security compliance, and mentoring junior staff in the use of big data tools like Spark, HDFS, and Hive. 

Platform & System Management:
•    Monitor, maintain, and support Hadoop clusters to ensure stability and performance against defined metrics. 
•    Perform maintenance activities, including installing patches and upgrades, and managing configuration. 
•    Ensure systems and applications comply with technology standards. 
•    Provide technical support for Hadoop-based systems, troubleshooting issues and resolving problems.
•    Troubleshoot data pipeline issues, ensuring data integrity and performance

Incident Management & Resolution:
•    Lead the detection, analysis, and resolution of incidents, identifying root causes and implementing solutions. 
•    Provide timely and effective technical support for Hadoop-based systems.
•    Lead the resolution of complex technical issues, collaborating with cross-functional teams
•    Troubleshoot production support issues and collaborate with delivery teams to implement changes. 

Technical Leadership & Guidance:
•    Provide guidance and oversight to engineers, coaching them on Hadoop-related technologies and best practices
•    Review code, provide feedback on best practices, and ensure solutions meet functional and non-functional requirements. 
•    Manage and mentor a team of Hadoop support technicians, promoting growth and skill development

Security & Compliance:
•    Manage authentication and authorization for Hadoop clusters using tools like Kerberos. 
•    Ensure security best practices and compliance requirements are met for all solutions.

Documentation & Process:
•    Create and maintain infrastructure and technical documentation. 
•    Develop and maintain a knowledge base of Hadoop-related issues and solutions
•    Maintain accurate documentation of Hadoop systems and processes
•    Lead application governance activities like continuity testing and responding to audit inquiries.

Continuous Improvement: 
•    Stay up to date on industry best practices and emerging technologies related to service resiliency.
•    Identify opportunities to improve resilience processes and tools.
•    Promote a culture of resilience throughout CTO DT DPT.
•    Track and report on key resilience metrics.

Service Transition: 
•    Manage the transition of new and changed services into the production environment.
•    Ensure that all necessary documentation and training are provided.
•    Conduct post-implementation reviews to assess the success of service transitions.

Service Operation: 
•    Update support and operational documentation as required.
•    Oversee the day-to-day operation of IT services.
•    Manage incident, problem, and change management processes.
•    Monitor service performance and identify areas for improvement.
•    Ensure that service requests are handled efficiently.

Service Reporting and Communication: 
•    Develop and maintain service performance reports.
•    Communicate service performance and issues to stakeholders.
•    Ensure that all service-related documentation is up-to-date.
•    Manage customer satisfaction surveys and implement improvements based on the results.
•    Strong data engineering, technology engineering and architecture knowledge 
•    Coordinate delivery and dependencies between other Data Management projects and other relevant programmes/initiatives.
•    Own and develop individual project plans and other required documentation as required for project governance.
•    Manage the Ops team. 
•    Manage and lead recruitment.
•    Manage and coordinate budgeting cycle.
•    Ensure all project portfolio reporting to other forums is consistent and aligned.
 

To be successful in this role, you should meet the following requirements

• Expertise in Hadoop ecosystem tools such as HDFS, MapReduce, Spark, Hive, and HBase.

   

• Excellent analytical and problem-solving skills with a focus on data-centric issues.
• Proficiency in programming languages like Java, Scala, or Python, with hands-on experience with Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, Spark).
• Strong understanding of data modeling, ETL processes, and data warehousing concepts.
•  Familiarity with cloud platforms (AWS, Azure, GCP) and their big data services.
•  Familiarity with data governance and data quality frameworks.
• Ability to work independently and collaboratively in a team-oriented environment
• Familiarity with containerization technologies like Docker and Kubernetes.
• Proven experience in technical leadership and team management.

Candidate User Guide - India HTC - IND HSDI : IJP candidate user guide (service-now.com)

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSBC Software Development India