Job description

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist

In this role you will:

  • Understanding of Spark core concepts like RDD’s, DataFrames, DataSets, SparkSQL and Spark Streaming.
  • Experience with Spark optimization techniques.
  • Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning.
  • Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer.
  • Proficiency in Python/Scala/Java for Spark development and integrate with ETL process.
  • Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database)
  • Understanding of data quality best practices and data validation techniques.
Requirements

To be successful in this role, you should meet the following requirements:

  • Understanding of data warehouse concepts, data modelling techniques.
  • Expertise in Git for code management.
  • Familiarity with CI/CD pipelines and containerization technologies.
  • Nice to have: Experience using data integration tools like DataStage/Prophecy/Informatica/Ab Initio.

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSBC Software Development India