Job description
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer
In this role, you will:
- The Associate Cybersecurity Analytics Data Engineer will form part of the CSA Platform & Data Engineering Team, joining a global team of data technology professionals to deliver critical analytics engineering requirements for the strategic cybersecurity data lake and analytics platform.
- The position is a junior technical role technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure and platform engineering, platform operations and production support.
- The Associate Cybersecurity Analytics Engineer Data Engineer> role will be required to work with Lead and Principal engineers within the Platform & Data Engineering Team to contribute to data engineering, data acquisition, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big data technologies.
- There is ample room for growth in the role, with opportunities to develop skills across multiple domains, starting from a strong foundation in a core technical area e.g., data engineering or cloud infrastructure engineering.
- For this role, cybersecurity-specific knowledge is advantageous but not essential as mentorship and learning opportunities will be provided on-the-job for the successful candidate.
- The ideal candidate will possess strong technical skills, an eagerness to learn, a keen interest in Cybersecurity, the ability to work collaboratively in a fast-paced environment, and an aptitude for picking up new tools and techniques on the job, building on existing skillsets as a foundation.
Requirements
To be successful in this role, you should meet the following requirements:
Data Engineering & Data Acquisition
- Ingestion and provisioning of raw datasets, enriched tables, and/or curated, re-usable data assets to enable Cybersecurity use cases.
- Driving improvements in the reliability and frequency of data ingestion including increasing real-time coverage.
- Support and enhancement of data ingestion infrastructure and pipelines.
- Designing and implementing data pipelines that will collect data from disparate sources across the enterprise, and from external sources, transport said data, and deliver it to our data platform.
- Extract Translate and Load (ETL) workflows, using both advanced data manipulation tools and programmatically manipulating data throughout our data flows, ensuring data is available at each stage in the data flow, and in the form needed for each system, service, and customer along said data flow.
- Identifying and onboarding data sources using existing schemas and, where required, conducting exploratory data analysis to investigate and determine new schemas.
Programming, Software & Network Principles
- Experience with SRE and Azure DevOps
- Ability to script (Bash/PowerShell, Azure CLI), code (Python, C#, Java), query (SQL, Kusto query language) coupled with experience with software versioning control systems (e.g., GitHub) and CI/CD systems.
- Programming experience in the following languages: PowerShell, Terraform, Python Windows command prompt and object orientated programming languages.
- Demonstrable experience of Linux administration and scripting (preferably Red Hat Systems)
- Understanding of hardware and software principles and storage technologies (SSD, HDD, NVMe), CPU architectures, and Memory & Operating system principles (especially network stack fundamentals)
- Understanding of network protocols and network design
Data Engineering & Data Acquisition
- Data Acquisition, Cloud-based Data Pipelines (Azure preferred)
- Data Transport and Data Cleaning
- Data Engineering pipeline automation, productionisation, and optimisation
- Designing, building, and maintaining data pipelines and ETL workflows across disparate datasets
- Cloud Cost optimisation
- Dataset and Data Asset Curation
- Data Modelling and Cataloguing
- Database Architecture and Design
- Data Warehousing and Data Integration
- Real-Time Analytics Deployment for Large-Scale Datasets
- Applying data engineering methods to the cyber security domain
Technology Stack
- Technical knowledge and breadth of Azure technology services (Identity, Networking, Compute,Storage, Web, Containers, Databases)
- Cloud & Big Data Technologies such as Azure Cloud, Azure IAM, Azure Active Directory (Azure AD), Azure Data Factory, Azure Databricks, Azure Functions, Azure, Kubernetes, Service, Azure Logic App, Azure Monitor, Azure Log Analytics, Azure Compute, Azure Storage, Azure Data Lake Store, S3, Synapse Analytics and/or PowerBI
- Experience with server, operating system, and infrastructure technologies such as Nginx/Apache, CosmosDB, Linux, Bash, PowerShell, Prometheus, Grafana, Elasticsearch)
- Experience with Infrastructure-as-Code and Automation tools such as Terraform, Chef, Ansible, CloudFormation/Azure Resource Manager (ARM)
- Streaming platforms such as Azure Event Hubs or Kafka, and stream processing services such as Spark streaming
- Experience with Security Information & Event Management (SIEM) and Security Orchestration, Automation & Response (SOAR) technologies, especially cloud based, is a significant asset
You’ll achieve more when you join HSBC.
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by – HSBC Software Development India