Staff Data Systems Engineer

We shaped the earliest forms of ad tech, and we’re looking for the technical expertise to help shape its future. Our customers have unique problems that can only be solved at internet scale, and that’s where the technical skills of our team make a real difference. 

Our exchange handles over 500 billion requests every day (for comparison Google serves an estimated 9 billion searches a day), all running in our own global data centers. Every member of our technology team has an enormous amount of autonomy in building and managing our systems to support and enable our growing level of scale. Through the transparency of our technology, dedication to innovation and integrity, and long-standing customer relationships, we lead through change. 

What’s it like to work at Index? 

We have more than 550 Indexers around the globe dedicated to building a safe and transparent marketplace that provides a trusted experience for consumers. 

Index is an exciting and fast-paced place to work. We’re built on our values of change, support, learning and teaching, trust, and intention. We pride ourselves on our independence and openness, not only in our technology, but in our teams, too. Our diverse and inclusive culture celebrates how we can leverage our unique differences to help drive Index forward. 

Our culture of success is truly supportive and collaborative. In working together across our teams, we’re continually investing in the people and technology to solve the industry’s most complex problems. As we extend the promise of ad tech to every channel, we’re looking for talented engineers to help advance Index, and the industry, forward. 

Are you ready to join the programmatic evolution? 

Index Exchange funds the open web. Content and journalism across the internet are funded through advertising, and we are the engine that helps to make that happen transparently, safely and efficiently. Handling hundreds of billions of auctions per day within milliseconds requires an intense understanding of the exchange and the ecosystem that we live in. 

Our business is growing significantly every year and is poised to grow even faster. Our people and our platforms are the foundation and enabler of that growth. We are significantly expanding our technology teams, and are looking for technologists with a passion for high performance software development, and a drive to deliver software products and platforms that enable and empower industries at a global scale. 

About The Role: 

We’re looking for a Staff Engineer, Data Systems to join our team and help build and maintain the next generation of big and small data solutions at Index Exchange. Data is a big deal at Index Exchange (Index). Index’s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day. Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs.  

Working with exciting technologies, your team will experiment with new tools and engineer innovative approaches to solve interesting challenges under your technical leadership. Things shift very quickly in our industry, and we rely on our Technology Operations and Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction. We are looking for Engineers who have experience in an Agile environment, who can execute and innovate between all layers of the data stacks, from application event driven systems and RDBs to big data query engines and storage patterns and their automation pipelines. 

Index’s scale spans the globe, our transactions happen 24x7 in our global data centers, and every second that passes millions of requests are evaluated across our exchange. In order to achieve our mission, global efficiency and reliability are absolutely key, as every millisecond quite literally counts in our business. 

What We’re Looking For: 

• Experience and Execution: An established engineer with exposure execution of projects at a lead/staff level or a functional area. A developer first and for most, that understands how to operate, scale and join various data systems. 

• Problem Solvers: You don’t stop until the problem gets solved and you find more than one way to solve it. You love working with other people, presenting your viewpoint but ultimately working towards the best solution, regardless of where it comes from. 

• Knowledge Hungry: Learning new frameworks and languages is exciting to you – you’re not satisfied with the status quo. We use a variety of languages and tools to solve problems and we're interested in what you're looking to learn. 

• Passionate and Self Motivated: You have a passion for Small and Big Data and an interest in the latest trends and developments constantly researching new tools and data technologies 

Here’s What You’ll be Doing: 

• Evaluate new technologies, design, implement, and maintain big and small data systems and their associated pipelines (governance, audit, installations, operations, best practices, code libraries)
• Maintain, operate, expand and govern existing big and small data systems (from small caches and RDBs in Kubernetes to large Trino/Spark/Hadoop/OLAP clusters)
• Automate and manual hardships, deployments, create CI/CD pipelines for everything, best practices, and internal methodologies for making everyone's life “just that much easier.”
• Lead and mentor team members
• Identify and assess potential solutions for technical and business suitability
• Have a deep understanding about Index and its products. Drive initiatives that produce positive outcomes across divisions 

Here's What You Need: 

• Bachelor/ Master’s Degree in Computer Science or Engineering related fields
• 8+ years of experience as a Senior Software Engineer in enterprise grade, large scale distributed software product development
• 5+ years of work experience designing and building high performance data pipelines and applications using Hadoop, Spark, Hive, Presto, Kafka and Flink streaming, Druid, or other similar technologies
• General Working and Operational knowledge in traditional RDBS (mysql, postgres, etc)
• Proficiency in some of the following languages: Kotlin, Scala, Java, Python, Golang, Rust, Bash
• Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks
• Strong technical leadership, mentorship, collaboration, and communication skills
• Exposure to working with a globally distributed, culturally diverse team
• Knowledge of data modeling, index patterns, query optimization.
• Some Experience NoSQL systems, usage, operations, installations (cassandra, redis, scylladb, keyDB, etc)
• Experience with automated testing systems
• Experience working in Agile methodologies with continuous integration and delivery as CI/CD
• Experience working with containerization, and virtualization tools such as Kubernetes, Docker
• Some experience with scheduling tools such as airflow, oozie 

Why You’ll Love Working Here:

• Company paid comprehensive health and life insurance plans
• Paid Time off and flexible work schedules
• Company contribution to Provident Fund
• Participation in our company Stock options plan
• Company paid Parental Leave
• Monthly internet stipend
• Quarterly Wellness allowance
• Community engagement opportunities and donation-matching program
• Volunteer paid day off
• Annual virtual company retreats and regular community-led team events
• A workplace that supports a diverse, equitable, and inclusive environment – learn more here

Notification

Index Exchange is aware that there have been recent scams directed toward candidates regarding job interviews and offers.

Please be vigilant and do not accept interview requests, job offers, or other hiring-related documents from anyone other than our dedicated recruitment team, from the domain of @indexexchange.com. Our interview process consists of several steps, including phone screens and video interviews. We do not conduct interviews via an email questionnaire or request money at any point in the process.

We remain dedicated to resolving this matter and we appreciate your support.

Equal employment opportunity

At Index Exchange, we believe that successful products are built by teams just as diverse as the audience who uses them. As such, we are committed to equal employment opportunities. We celebrate diversity of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or veteran status. Additionally, we realize that diversity is deeper than any status or classification—diversity is the human experience. For those who show grit, passion, and humility—Index will welcome you.

Accessibility for applicants with disabilities

Index Exchange welcomes and encourages individuals with disabilities to apply to work with us. 

If you require an accommodation, please share the details of your request and any information how we can assist you with the hiring recruiter when they contact you. Index Exchange will make reasonable efforts to ensure accommodation requests are met throughout the recruitment process.

Index Everywhere, Index Anywhere

Our corporate headquarters are in Toronto, with major offices in New York, Montreal, Kitchener, London, San Francisco, and many other global cities. As a major global advertising exchange, we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be.  

#LI-REMOTE

#LI-AS4