Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.
You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.
You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities and attractive compensation.

Requirements and responsibilities

We are looking for a Data Streaming Engineer with hands-on experience in Apache Kafka based architectures and real-time integration patterns. Experience with Redpanda and Redpanda Connect is a plus, but not required. Strong Kafka fundamentals are essential. Redpanda can be taught.
This is a hands-on engineering role focused on building and operating streaming pipelines and event-driven integrations in real production environments. You will work as part of a team, contributing to design and implementation under the guidance of senior engineers and architects.

What you’ll do

Build and maintain real-time data pipelines using Kafka compatible platforms such as Redpanda, Confluent, MSK and Apache Kafka;
Implement streaming and integration pipelines using Redpanda Connect, Kafka Connect or similar frameworks;
Develop event-driven integrations between microservices, databases, SaaS systems and data platforms;
Implement transformations, filtering, enrichment and routing logic in streaming pipelines;
Configure topics, partitions, consumer groups and basic schemas;
Integrate streaming platforms with downstream systems such as data lakes, data warehouses and analytics platforms;
Support production environments including monitoring, troubleshooting and performance tuning;
Work closely with senior engineers, platform teams and application teams to deliver end-to-end solutions.

What you’ll bring
Core Requirements

Hands-on experience with Apache Kafka in production or near-production environments;
Good understanding of Kafka fundamentals including topics, partitions, consumer groups and offsets;
Experience with Kafka Connect or similar integration frameworks;
Solid understanding of event-driven architectures and asynchronous integration;
Experience building data pipelines that move data between systems;
Proficiency in at least one of Java, Python or Go.

Redpanda

Experience with Redpanda and Redpanda Connect is a plus, not a requirement;
Willingness and ability to learn new platforms quickly.

Streaming and Integration

Experience integrating with databases, APIs, SaaS platforms or file-based systems;
Basic understanding of schemas, serialization formats and data contracts;
Familiarity with CDC, event sourcing or streaming ETL is a plus.

Platform and Operations

Some experience running services in cloud or Kubernetes environments;
Basic understanding of observability including logs, metrics and monitoring;
Comfortable troubleshooting issues in distributed systems with support.

How You Think

You like building real systems, not just demos;
You are comfortable learning by doing;
You ask good questions and are not afraid to say I do not know yet;
You care about reliability and correctness;
You want to grow into a strong streaming engineer.

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.
Let’s meet and you may just be the right candidate for one of our roles.
At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

Data Streaming Engineer

AI overview