Senior Data Engineer Streaming

AI overview

Design and develop scalable streaming data pipelines using Apache Flink on AWS while collaborating to enable real-time analytics and contribute to effective data platform architecture.

The key to our success is simple; we deliver the highest quality, on time, with passion and commitment, and live every day by a set of great values. We've built a company that fosters long-term careers in an environment of continuous learning, with cutting-edge benefits, tools, and resources. In addition, certifications that endorse our company as a great place to work.

 

Responsibilities

 

  • Design and develop scalable, low-latency streaming data pipelines using Apache Flink on AWS.
  • Architect and implement solutions to join streaming and batch data, ensuring consistency, accuracy, and performance.
  • Build and manage infrastructure for efficient and secure data exchange, enabling scheduled delivery of large datasets to internal teams and external partners.
  • Leverage Apache Iceberg for reliable, scalable table formats across both batch and streaming systems.
  • Write and optimize complex SQL queries for analytical workflows and platform integration.
  • Work with AWS Redshift to support scalable, performant batch processing and business intelligence use cases.
  • Collaborate with data scientists, product teams, and platform engineers to enable real-time analytics and data-driven features.
  • Contribute to the evolution of our data platform architecture, focusing on observability, reliability, and developer self-service.
  • Partner with frontend engineers to support data visualization and exploration workflows; experience with Qlik or similar BI tools is a plus.

 

Requirements

 

  • 10+ years of experience in software engineering or data engineering roles, with a focus on real-time data processing.
  • Deep expertise in streaming technologies, especially Apache Flink.
  • Strong experience with AWS services (e.g., Kinesis, Lambda, S3, Glue, EMR, ECS, Redshift).
  • Proficient with Apache Iceberg, or similar table formats (e.g., Delta Lake, Hudi).
  • Proven experience in joining streaming and batch data, with a strong understanding of consistency models, watermarking, and state management.
  • Solid SQL skills for data exploration, transformations, and performance tuning.
  • Experience designing and managing data exchange pipelines—delivering large-scale, scheduled datasets safely to various consumers.
  • Strong understanding of distributed systems, networking, and data architecture.
  • Solid programming skills in Java, Scala, or Python.
  • Experience working with BI tools or frontend data layers—Qlik experience is a strong plus.
  • Excellent communication and collaboration skills; able to work cross-functionally in a fast-paced environment.

 

 

 

 

 

#LI-REMOTE

 

 


About us

AssureSoft is a multinational software development and information technology company providing strategic consulting, technology services, and outsourcing business processes. We work to innovate and create quality software with motivated, passionate, and qualified teams that develop in an environment of professional, stable growth and continuous learning.

Inclusive Opportunities for Every Talent. At AssureSoft, we believe that true innovation is born from diversity—of ideas, experiences, and perspectives. That’s why our hiring practices are inclusive and reflect a firm commitment to equity and equal opportunity.
Here, every person—regardless of origin, gender, orientation, or beliefs—finds a space to grow, contribute, and be valued not only for their talent, but also for who they are.

What sets us apart

  • Great Place To Work certification.
  • A company with more than 15 years of experience.
  • Work with world-class clients and long-term projects.
  • English scholarships for an external institute.
  • English classes with company teachers.
  • State-of-the-art tools and resources.
  • Certifications for your professional growth.
  • Recreation and leisure activities.
  • Compliance with the regulations and labor rights of your region.

Retention of your personal information: AssureSoft will retain your personal information for as long as necessary to fulfill the purposes for which it was collected or as necessary to comply with our legal obligations, resolve disputes, and maintain appropriate business records. Once the purpose has been fulfilled, your personal information will be retained and blocked due to the possibility of legal and governmental requirements, and until the status of limitations has run out.

Important Notice Regarding Personal Information:  If you do not want your personal and professional information to be retained in our database, please send your request for data removal to [email protected].

Perks & Benefits Extracted with AI

  • Education Stipend: English classes with company teachers.
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Senior Data Engineer Q&A's
Report this job
Apply for this job