Job description
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
We are currently seeking an experienced professional to join our team in the role GCP Cloud Dataflow Java API engineer
Cloud Dataflow Java API engineer Engineer will be part of core platform technology team that underpins the entire Devops Technology. Person would be entrusted to provide solutions to bespoke large system problems involving the processing of significant data sets, including extensive java coding , monitoring, and troubleshooting. A key skill will be to engage with internal and external application teams to ensure the smooth running of a key future bank system.
As a key member of the technical team alongside Engineers and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process.
Requisitos
To be successful in this role, you should meet the following requirements:
- Design develop and deploy data pipelines using apache beam in google cloud using dataflow
- Write High quality testable and maintainable code
- Optimize data pipelines for performance and cost effectiveness
- Troubleshoot and debug data processing issues
- Collaborate with cross functional teams to define data requirements and implement data solutions
- Develop REST APIs
- Stay upto date with the latest advancements in data processing and streaming technologies
- Strong understanding of SQL and No SQL
- Experience with data streaming and batch processing technoligies
- Implement the tools and processes, handling performance, scale, availability, accuracy, and monitoring Product support & troubleshooting.
- Design, implement, and manage CI/CD pipelines to automate software delivery processes, ensuring rapid and reliable deployment of code changes.
- Develop and maintain the apache beam , dataflow pipelines which require low latency responses and superior performance .
- Understand multi-threading and able to code in critiDeploy and manage applications in cloud environments (Google Cloud)
- Set up and maintain monitoring and logging solutions to ensure the availability, performance testing, and reliability of systems. Utilize tools like Prometheus, Grafana, or Splunk for monitoring and analysis.
- Work closely with development, operations, and other cross-functional teams to understand their requirements and provide solutions that meet their needs. Foster a culture of collaboration and knowledge sharing.
- Providing solutions for cost optimization in GCP and resolving the security compliance violations.
- Implement containerization using Docker and container orchestration using Kubernetes or similar tools to streamline deployment and scaling of applications.
- Respond to and troubleshoot incidents, identifying root causes and implementing solutions to prevent recurrence. Participate in on-call rotations as needed.
- Create and maintain documentation for processes, procedures, and configurations to facilitate knowledge transfer and ensure operational efficiency.
- Integration with Change Management tool like Service Now.
You’ll achieve more when you join HSBC.
www.hsbc.com/careers