Join our team where you can participate delivering data driven solutions based on Medallion data design pattern.
Introducing Medallion Architecture, with its Raw, Silver, and Gold layers, we expect to extend existing toolset for data management, increase flexibility and governance as well as reduce complexity of organizing and processing data across organization.
Our solution will be delivered as a self-service framework to various teams owning data sources.
We are working in fully AWS cloud environment, using latest services to build our framework and platform solutions from Proof of Concept to Production usage stage.
By joining our team, you will be playing a vital role in changing mindset for data management approach!
Your responsibilities:
Lead the design and evolution of our Medallion Architecture–based framework, ensuring scalability, governance, and best practices
Partner with other development teams and stakeholders to drive architecture decisions and ensure technical excellence across the organization
Contribute to the development and maintenance of CI/CD processes for deployment and testing
Support troubleshooting and resolution of technical issues in production environments
Mentor and coach mid-level engineers, conducting design and code reviews
Proactively identify opportunities to optimize data platforms and influence long-term data strategy
Expertise in Java with Spring and/or Python, with a track record of delivering large-scale solutions
Strong hands-on experience with AWS cloud services and Big Data solutions, including DMS, Lambda functions, EventBridge, S3 tables, AWS Glue, Amazon ECS, Lake Formation, and Amazon MSK.
Proven ability to design and optimize data architectures, including governance and scalability aspects
Proficiency with infrastructure as code (Terraform), CI/CD pipelines, and automation at scale
In-depth experience with data tools and standards: Spark, Iceberg, Kafka Streams (and alternatives)
Strong understanding of relational (MySQL, Postgres, MS SQL) and NoSQL (DynamoDB, MongoDB) databases
Ability to mentor and guide mid-level engineers, perform code reviews, and lead design discussions
Experience influencing architecture decisions and aligning technical solutions with business goals
We’re a community here that cares as much about your life outside work as how you feel when you’re with us. Because your job shouldn’t take over your life, it should enrich it. Here are some of the benefits we offer:
Our commitment
Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to our success as a global company, so we want to recruit, develop, and keep the best talent. We encourage applications from everyone, regardless of background, gender identity, sexual orientation, disability status, ethnicity, belief, age, family or parental status, and any other characteristic.
Careers at StepStone Group. Find Great Talent with Career Pages. | powered by SmartRecruiters | Find Great Talent with a Career Page.
Please mention you found this job on AI Jobs. It helps us get more startups to hire on our site. Thanks and good luck!
Be the first to apply. Receive an email whenever similar jobs are posted.
Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.
Senior Data Engineer Q&A's