Data Infrastructure Manager

What you will be doing:

Join our cutting-edge Tech Team as a Data Infrastructure Manager! We are seeking a dynamic and seasoned professional to lead the design and implementation of high-performance systems essential for detecting financial risks. In this role, you'll collaborate across various functions, managing a team of Data Infrastructure Engineers dedicated to providing and supporting data services organisation-wide. Your expertise will be key in handling classic SQL and NoSQL databases, distributed SQL, Kafka, and Spark-based systems.

What you will be doing:

As a Data Infrastructure Manager, you will

• Take ownership of your team, being responsible for current team members’ growth and development, plus hiring and onboarding new team members
• Create a positive environment where your team members thrive to deliver the best outcomes and innovations
• Be a role model for your team, mentoring and coaching them, whilst having a learning mindset yourself, being open to new ideas and technologies
• Within the context of our broader technology vision, set the direction for your team and take accountability for tech decisions 
• Use your specific experience working with data systems to input into technical decision-making
• Work with other stakeholders across engineering to ensure the systems and services your team provides meet the needs of your internal customers
• Collaborate, both within your team and across the tribe to ensure your team’s implementation meets industry standards 

Our tech stack:

ComplyAdvantage is fully cloud-based, with a modern Kubernetes-focused tech stack. All compute workloads run in Kubernetes, with clusters in multiple regions to support the needs of our global client base. Our production services are currently based in AWS and GCP.

We make heavy use of Terraform and Helm to define our infrastructure and services, and lean heavily on GitOps paradigms - production and non-production environments are defined in git and changes to these environments (both cloud infrastructure and Kubernetes applications) are managed via git.

Kafka is used widely across teams, and is seen as a core technology in our tech stack. We are focusing on developments to our Kafka and Yugabyte tooling, as well as the other data systems we rely on, such as PostgreSQL, Elasticsearch and Databricks/Spark. To tie in with our multi-cloud plans, we’ll also be developing inter-cloud failover options to be leveraged by our development teams.

Across the wider Technology team, teams build and release containerised applications to support the wide array of activities that our teams are engaged in - from developing low latency client-facing APIs, to machine learning models and data processing pipelines.

About you:

As an Data Infrastructure Manager, you will

• Have experience of managing and growing high performing engineering teams
• An understanding of cost and performance considerations when designing data systems architectures
• Have solid knowledge and experience of designing, building and managing data stores and/or pipelines, preferably using Kafka and/or Spark
• Have understanding and experience of the complexities of scaling data systems while maintaining performance and availability
• Have experience working with or building data-intensive applications and with relational databases (eg PostgreSQL, MySQL)
• Have experience designing and developing microservices-based architectures
• Have experience of working with cloud native architectures (AWS and GCP are preferred)
• Have good communication and writing skills including experience writing technical documentation
• Experience with data modelling, sharding and indexing strategies running databases at scale

Nice to haves:

• Experience of working in a start-up/ scale-up environment
• Experience with Kubernetes and Terraform
• Experience of distributed SQL and/or noSQL databases, such as Yugabyte, Cockroach, Spanner, HBase or CouchDB

Benefits:

• Equity as we want you to have a part of what we are building 
• We embrace a hybrid approach that requires employees to be in the office for two days a week. We strongly believe that this approach fosters collaboration and enables the building of meaningful relationships
• You will also get a budget to kit out your home office
• Opportunity to work on innovative projects with smart-minded people keen to share their knowledge and continuously improve 
• Annual learning budget to drive your performance and career development
• Enhanced parental leave and childcare benefits 
• Medical insurance through Bupa with pre-existing conditions covered 
• Pension contribution through The Peoples Pension