HSBC Group

Level GCB5

If you are a UK or CIIOM based employee, please apply using the following link which will take you to our new Recruitment System: Explore Jobs | Eightfold Career Hub

Role Description

A lead data engineer role working in the ESG IT data ingestion team, responsible for designing, building, and optimising data movement pipelines. The role involves developing robust data flows from various sources while ensuring pipelines stability and data integrity.

 role description:

• Design and build E2E data movement pipelines to meet business requirements
• Maintain and support all data movement pipelines 
• Work as SME alongside the Ingestion Business Analysts to design new pipelines based on available technology to deliver data
• Oversee all ingestion engineers to ensure high standards and best practices are being followed
• Produce team/process documentation and conduct KT sessions to the team and wider department as needed

Essential Skills

•           Proficiency in Python/Scala/Bash for data pipeline development and automation

•           Familiarity with CI/CD pipelines for deploying and managing data pipelines along with building and maintaining scalable data movement pipelines,

•           Good understanding of Hadoop and GCP environments for data storage and data processing

•           Familiarity with ETL tools and distributed data processing frameworks such as Spark

•           Good understanding of scheduling and orchestration tools such as AirFlow or Control-M

•           Good understanding of data principles, data integrity, data best practices etc and understanding of Agile ceremonies and practices

•           Proven experience in conducting knowledge transfer sessions and producing key technical documentation

Being open to different points of view is important for our business and the communities we serve. At HSBC, we’re dedicated to creating diverse and inclusive workplaces - no matter their gender, ethnicity, disability, religion, sexual orientation, or age. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best. We take pride in being a Disability Confident Leader and will offer an interview to people with disabilities, long term conditions or neurodivergent candidates who meet the minimum criteria for the role. 

If you have a need that requires accommodations or changes during the recruitment process, please get in touch with our Recruitment Helpdesk:

Email: hsbc.recruitment@hsbc.com

Telephone: +44 207 832 8500