As a Backend Spark Developer, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.
We need somebody like you to help us in different fronts:
- You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
- You will use Scrum methodology, and be part of a high performance team
- You will document your solutions in JIRA, Confluence, ALM…
- You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery
Required qualifications:
- At least 2 years of experience working with Spark with Scala, software design patterns, and TDD
- Experience working with big data – Spark, Hadoop, Hive is a must – Azure Databricks be a plus
- Agile approach for software development
- Experience and expertise across data integration and data management with high data volumes
- Experience working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
- Experience with different database structures, including (Postgres, SQL, Hive)
- English (at least B2+)
Preferred qualifications:
- Jenkins orchestration
- Bash script
- Control-M
- Software development life cycle (HP ALM...)
- Basics of cybersecurity & Quality (Sonar, Fortify…)
- Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)
- SOA Architecture
What do we offer you?
- B2B contract
- Training and career development
- Benefits and perks such as private medical insurance, lunch pass cards
- Possibility to be part of a multicultural team and work on international projects
- Hybrid position based in Warsaw, Poland
- Possibility to manage work permits
