Kafka Engineer, Middleware & Messaging Operations
Key information
- Publication date:27 October 2024
- Workload:100%
- Contract type:Permanent position
- Place of work:Gland
Building the bank of tomorrow takes more than skills.
It means combining our differences to imagine, discuss, code, develop, test, learn… and celebrate every step together. Share our vibes? Join Swissquote to unleash your potential.
We are the Swiss Leader in Online Banking and we provide trading, investing and banking services to+500’000 clients, through our performant and secured digital platforms.
Our +1000 employees work in a flexible way, without dress code and in multicultural teams.
By having a huge impact on the industry, they are growing their skills portfolio and boosting their career in a fast-pace environment
We are all in at Swissquote. As an equal opportunity employer, we welcome candidates from all backgrounds, experiences and perspectives to join our team and contribute to our shared success.
Follow Humans of Swissquote to discover our people & culture!
Join our 240 software engineersto challenge the code and bring your expertise on cutting-edge Fintech projects such as eTrading, eForex, cryptocurrencies and more.
Our Tech stack is 100% Cobol free! See: Java, Spring, Hibernate, JavaScript, TypeScript, React, Docker, Kubernetes... and we always try to find the best tools for the right needs.
Have a look at our Tech Blog !
Are you all in? Don’t be shy, apply!
Team Mission and Stakeholders:
Are you ready to be at the heart of innovation? We’re launching an exciting new team dedicated to Middleware & Messaging Operations, and we want you to be part of it!
As a key player in this dynamic team of four, you’ll collaborate with operational teams and work closely with main stakeholders to power critical components that drive our organization forward. You’ll tackle complex challenges, streamline processes, and implement cutting-edge solutions that make a real impact.
Join a tight-knit team where your ideas matter and collaboration is key, all while working on pivotal projects that shape the future of our operations. You’ll develop strong relationships with key stakeholders, hone your skills in a vital area of technology, and advance your career in a growing field. Your contributions will support critical systems that help us achieve our goals. If you’re passionate about technology and ready to make a difference, come be part of something amazing. Let’s create the future of Middleware & Messaging together!
In this role, you will:
- Support the continuous operation, optimization, and management of Apache Kafka and other messaging systems (e.g., RabbitMQ, Redis) for a wide range of software applications.
- Work closely with development and operations teams to ensure smooth integration of Kafka into application workflows, providing support and guidance.
- Monitor and maintain the performance and health of Kafka clusters, implementing proactive solutions to maintain reliability.
- Collaborate on capacity planning, scaling Kafka infrastructure to meet current and future demand without sacrificing performance.
- Implement and maintain self-service configuration tools, allowing teams to manage Kafka configurations through systems like Git.
- Develop and maintain infrastructure-as-code (IaC) solutions to manage messaging systems, ensuring that deployments and changes are consistent and repeatable.
- Contribute to the automation of operational tasks, including Kafka deployments, monitoring, and failure recovery processes.
- Ensure Kafka systems meet security and compliance standards, managing access controls and securing data in transit.
- Document configurations, best practices, and operational procedures to promote knowledge sharing and ensure team alignment.
- Participate in on-call rotations to provide 24x7 support, responding to incidents and troubleshooting issues to minimize downtime.
Qualifications
- Educational background: Bachelor’s or Master’s degree in Computer Science or a related field
- At least2 years of experiencein managing Apache Kafka cluster
- Strong hands-on experience with Apache Kafka in production environments, including Kafka Streams, Kraft, and Kafka Connect.
- In-depth knowledge of messaging system architecture, with an emphasis on designing, deploying, and optimizing Kafka clusters.
- Experience with automation tools(e.g., Terraform, Jikkou, Ansible)and scripting (e.g., Python, Bash) to streamline Kafka operations.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes) and their integration with Kafka.
- Knowledge of monitoring tools (e.g., Prometheus, Grafana, Kafka-UI) and experience setting up proactive alerting systems.
- Experience with version control systems like Git for managing Kafka configuration.
- Understanding of security best practices for messaging systems, including access management and encryption.
Nice-to-Haves:
- Experience with other messaging platforms such as RabbitMQ or Redis.
- Experience with disaster recovery and business continuity planning for Kafka infrastructure.
- Experience with Solr and other middleware is a plus.
Who you are:
- A technical expert passionate about Kafka and messaging technologies.
- A problem solver who thrives in fast-paced, production-critical environments.
- Eager to collaborate with others, sharing your expertise to strengthen the team.
- Driven to continuously improve processes and systems through automation and innovation.
- A forward thinker, constantly seeking opportunities to automate and improve processes.
