Data Platform DevOps - Lotus's

AI overview

Design and maintain scalable data pipelines, ensuring data quality and governance while managing CI/CD processes and collaborating with stakeholders on data solutions.

Job Summary:

We are seeking an experienced Data Platform DevOps to implementation, and maintenance of our data infrastructure and pipelines. The ideal candidate will have a strong background in data engineering and DevOps principles, with a passion for automation, quality, and

governance. You will act as a bridge between technical and business teams, ensuring our data

platform is not only efficient and scalable but also reliable and compliant. This role is crucial for

enabling data-driven decisions and accelerating the development life-cycle for all data

initiatives.

Key Responsibilities:

  • Design & Implement Data Platforms: Design, develop, and maintain robust, scalable data
  • pipelines and ETL processes, with a focus on automation and operational excellence.
  • Ensure Data Quality and Governance: Implement automated data validation, quality
  • checks, and monitoring systems to ensure data accuracy, consistency, and reliability.
  • Manage CI/CD for Data: Own and optimize the CI/CD pipelines for data engineering
  • workflows, including automated testing and deployment of data transformations and
  • schema changes.
  • Architect & Implement IaC: Use Infrastructure as Code (IaC) with Terraform to manage data
  • infrastructure across various cloud platforms (Azure, AWS, GCP).
  • Performance & Optimization: Proactively monitor and optimize query performance, data
  • storage, and resource utilization to manage costs and enhance efficiency.
  • Collaborate with Stakeholders: Manage communication with technical and business teams
  • to understand requirements, assess technical and business impact, and deliver effective
  • data solutions.
  • Strategic Design: Possess the ability to see the big picture in architectural design, conduct
  • thorough risk assessments, and plan for future scalability and growth.

Requirements

Requirements:

  • Experience: 1-3 years of experience in data engineering, data warehousing, and ETL
  • processes, with a significant portion of that time focused on DataOps or a similar
  • operational role.
  • Platform Expertise: Strong experience with data platforms such
  • as Databricks and exposure to multiple cloud environments (Azure, AWS, or GCP).
  • Data Processing: Extensive experience with Apache Spark for large-scale data processing.
  • Orchestration: Experience working with data orchestration tools like Azure Data Factory
  • (ADF), Apache Airflow, or similar.
  • CI/CD & Version Control: knowledge of version control (Git) and experience with CI/CD
  • pipelines (GitLab CI/CD, GitHub Actions).
  • IaC: hands-on experience with Terraform.
  • Programming: Programming skills in Python and advanced proficiency in SQL.
  • Soft Skills: Strong stakeholder management, communication, and collaboration skills. The
  • ability to articulate complex technical concepts to non-technical audiences is a must.
  • Problem-Solving: Strong problem-solving skills with an ability to analyze technical
  • challenges and their business impact.

Preferred Qualifications:

  • Data Modeling: Experience with data modeling tools and methodologies, specifically
  • with dbt (data build tool).
  • AI & ML: Experience with AI-related technologies like Retrieval-Augmented Generation
  • (RAG) and frameworks such as LangChain.
  • Data Observability: Hands-on experience with data quality and observability tools such
  • as Great Expectations, Monte Carlo, or Soda Core.
  • Data Governance: Familiarity with data governance principles, compliance
  • requirements, and data catalogs (e.g., Unity Catalog).
  • Streaming Technologies: Experience with stream processing technologies like Kafka or
  • Flink.
  • Containerization: Familiarity with containerization and orchestration tools (e.g., Docker,
  • Kubernetes).
  • Open Source: Contributions to open-source projects or relevant certifications.

Benefits

Benefits

Health Insurance – At Lotus's, we care about your health! Group insurance from a top insurance company is included in your benefits—OPD, IPD, Emergency OPD

Provident Fund – Lotus's cares about your long-term plan! We offer 3% provident fund.

Year-end bonus – We include variable and performance bonus for our employees.

Attractive Vacations days – Enjoy our attractive annual leave. Let’s say the minimum is 16 days!

No overtime – We work 5 days a week with. We set our own goals and deadlines.

Free car parking space – No more stress or extra cost if you drive to work. We offer free parking space for our employees.

Best Culture

  • Clear focus.
  • Diverse Workplace (Our members are from around the world!)
  • Non-hierarchical and agile environment
  • Growth opportunity and career path


Perks & Benefits Extracted with AI

  • Health Insurance: Group insurance from a top insurance company is included in your benefits—OPD, IPD, Emergency OPD
  • Free car parking space: Free car parking space – No more stress or extra cost if you drive to work.
  • Paid Time Off: Enjoy our attractive annual leave. Let’s say the minimum is 16 days!

MakroPRO is an exciting new digital venture by the iconic Makro. Our proud purpose is to build a technology platform that will help make business possible for restaurant owners, hotels, and independent retailers, and open the door for sellers by bringing together the best talent to transform the B2B marketplace ecosystem in Southeast Asia Curious. Growth-mindset. User-obsessed. We search for talented people who each bring unique skills and behaviours that will help us build Southeast Asia’s next unicorn. Whether you’re in tech, marketing, finance or client/seller-facing roles, our people bring relentless passion, fast learning and a culture of innovation to every dimension of their work. Every member of our team is open to new perspectives, willing to navigate uncertainty and brings humility and radical candour to the table at all times We are bold, energetic, and thoughtful – grounded in our purpose and family culture, while driven by our passion for digital innovation. Our company is 70% technology, 20% retail, 10% logistics, and 100% heart. Every day, we use leading-edge technologies to understand and help food retailers, hotels, restaurants, caterers, and other businesses big and small navigate supply chain complexities and achieve their goals But the best technology needs to be driven by passionate talent. Aspiring professionals who share our belief in collaboration, diversity, and excellence – those willing to think big, redefine what’s possible, and put customers at the center of their work In return, our commitment to you is to offer a workplace like no other, where ideas can thrive and individuals can be themselves, where colleagues support each other and talent is fairly rewarded, where growth and learning opportunities are the norm not the exception, and where your career can reach new heights

View all jobs
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

DevOps Q&A's
Report this job
Apply for this job