Data Engineer

AI overview

Design and implement high-scale systems and data pipelines using technologies like PySpark, Hadoop, and Databricks to support various data-driven solutions.

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online. 

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. 

In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious, practical and good people.

 

We are seeking a skilled Data/ Backend Engineer to design and implement complex, high-scale systems that retrieve, process, and analyze data from the digital world. This role involves developing and maintaining backend infrastructure, creating robust data pipelines, and ensuring the seamless operation of data-driven products and services.

 

Key Responsibilities:

- Design and build high-scale systems and services to support data infrastructure and production systems.

- Develop and maintain data processing pipelines using technologies such as PySpark, Hadoop, and Databricks.

- Implement dockerized high-performance microservices and manage their deployment.

- Monitor and debug backend systems and data pipelines to identify and resolve bottlenecks and failures.

- Work collaboratively with data scientists, analysts, and other engineers to develop and maintain data-driven solutions.

- Ensure data is ingested correctly from various sources and is processed efficiently.

 

Qualifications:

- BSc degree in Computer Science or equivalent practical experience.

- At least 4+ years of server-side software development experience in languages such as Python, Java, Scala, or Go.

- Experience with Big Data technologies like Hadoop, Spark, Databricks, and Airflow.

- Familiarity with cloud environments such as AWS or GCP and containerization technologies like Docker and Kubernetes.

- Strong problem-solving skills and ability to learn new technologies quickly.

- Excellent communication skills and ability to work in a team-oriented environment.

 

Nice to Have:

- Experience with web scraping technologies.

- Familiarity with Microservices architecture and API development.

- Knowledge of databases like Redis, PostgreSQL, and Firebolt.

 

Why Similarweb?

- Opportunity to work in a dynamic and innovative environment.

- Collaboration with talented and independent engineers.

- Hybrid working model with flexibility to work from home and in the office.

We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available here.

Perks & Benefits Extracted with AI

  • Flexible Work Hours: Hybrid working model with flexibility to work from home and in the office.

Grow your market share with SimilarWeb's digital market intelligence platform. Compare website traffic statistics & analytics.

View all jobs
Get hired quicker

Be the first to apply. Receive an email whenever similar jobs are posted.

Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Data Engineer Q&A's
Report this job
Apply for this job