Senior Databricks Engineer - Join our growing community

Hyderabad , India
contractor

AI overview

Join a data engineering team to build and optimize scalable data pipelines on Databricks, collaborating with data scientists and business stakeholders for impactful analytics.

About us:

Where elite tech talent meets world-class opportunities!

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today’s most complex challenges.

We are building a community of top-tier experts and we’re opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.

Structured Onboarding Process

We ensure every member is aligned and empowered:

  1. Screening – We review your application and experience in Data & AI, ML engineering, and solution delivery
  2. Technical Assessment – 2-step technical assessment process that includes an interactive problem-solving test, and a verbal interview about your skills and experience
  3. Matching you to Opportunity – We explore how your skills align with ongoing projects and innovation tracks

Who We're Looking For

We are looking for a skilled and experienced Data Engineer with deep expertise in the Databricks ecosystem to join our data engineering team. You will be responsible for building, optimizing, and maintaining scalable data pipelines on Databricks, leveraging Delta Lake, PySpark, and cloud-native services (AWS, Azure, or GCP). You will collaborate with data scientists, analysts, and business stakeholders to ensure clean, high-quality, and governed data is available for analytics and machine learning use cases.

Requirements

  • 6+ years of experience as a Data Engineer, with at least 4 years hands-on with Databricks in production environments
  • Proficient in PySpark and SQL for large-scale data processing
  • Deep understanding of Delta Lake features: ACID transactions, schema enforcement, time travel, and vacuuming
  • Experience working with cloud platforms: AWS (Glue, S3), Azure (Data Lake, ADF), or GCP (BigQuery, GCS)
  • Hands-on experience with Databricks Auto Loader, Structured Streaming, and job scheduling
  • Familiarity with Unity Catalog for multi-workspace governance and fine-grained data access
  • Experience integrating with orchestration tools (Airflow, ADF) and using infrastructure-as-code for deployment
  • Comfortable with version control and automation using Git, Databricks Repos, dbx, or Terraform
  • Experience with performance tuning, Z-Ordering, caching strategies, and partitioning best practices

Benefits

At Xenon7, we're not just building AI systems—we're building a community of talent with the mindset to lead, collaborate, and innovate together.

  • Ecosystem of Opportunity: You'll be part of a growing network where client engagements, thought leadership, research collaborations, and mentorship paths are interconnected. Whether you're building solutions or nurturing the next generation of talent, this is a place to scale your influence.
  • Collaborative Environment: Our culture thrives on openness, continuous learning, and engineering excellence. You'll work alongside seasoned practitioners who value smart execution and shared growth.
  • Flexible & Impact-Driven Work: Whether you're contributing from a client project, innovation sprint, or open-source initiative, we focus on outcomes—not hours. Autonomy, ownership, and curiosity are encouraged here.
  • Talent-Led Innovation: We believe communities are strongest when built around real practitioners. Our Innovation Community isn’t just a knowledge-sharing forum—it’s a launchpad for members to lead new projects, co-develop tools, and shape the direction of AI itself.

Perks & Benefits Extracted with AI

  • Flexible & Impact-Driven Work: Whether you're contributing from a client project, innovation sprint, or open-source initiative, we focus on outcomes—not hours. Autonomy, ownership, and curiosity are encouraged here.
  • Talent-Led Innovation: Our Innovation Community isn’t just a knowledge-sharing forum—it’s a launchpad for members to lead new projects, co-develop tools, and shape the direction of AI itself.

In a world where business landscapes are in constant motion, Xenon7 embraces change, adaptability and innovation as friends. We are a cooperative practice of AI scientists and business leaders partnering with businesses to harness the power of Artificial Intelligence.At Xenon7, our purpose is clear: to empower businesses to navigate AI complexity with confidence. Our mission is to revolutionize the way organizations approach AI challenges, leveraging intelligent solutions to unlock new possibilities. Our values of integrity, collaboration, and relentless pursuit of excellence guide every decision we make on our behalf and yours.Our teams blend expertise from diverse disciplines to tackle complex challenges with creativity and agility and Continuous Improvement.Collaboration is at the heart of how we operate. By embracing cutting-edge technologies and innovative methodologies, we deliver solutions that exceed expectations and drive tangible results for our clients.

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Engineer Q&A's
Report this job
Apply for this job