(part-time) Senior QA with GenAI experience (freelance)

Netguru is a trusted partner in digital commerce. The company helps leading brands modernize B2B solutions, marketplaces, and retail ecosystems. Since 2008, it has empowered businesses with cutting-edge technology, AI-powered personalization, and world-class engineering and design teams. A certified B Corporation®, Netguru is trusted by major brands including IKEA, VW, OLX, Delivery Hero, Żabka, Wolt, Careem, and Vinted.

How freelancing works at Netguru?

As a Netguru freelancer, you can choose what works well for you. You decide when, where, and how you work on projects and tasks. 

We match you with work that fits your skills. Plus, you have access to various opportunities across different industries and companies. That means you will not only gain more experience, but also develop various skills.

But there's more. Netguru freelancers can benefit from full-time collaboration and really be a part of the team.

So, are you ready to make an impact? Join Netguru, and let's build beautiful software together.

Location: Remote (Poland preferred)
Start date: ASAP

Engagement: Part-time

Language requirement: Polish – mandatory
Salary rate: up to 125PLN/h (B2B contract)

Length of the project: 3 months (further extension to be confirmed)


Project Description

We are looking for a QA Engineer to join the client’s team working on Python-based web applications integrated with AI/ML components. This role combines traditional software testing with quality assurance for predictive models and data pipelines.

The ideal candidate has solid experience in testing web applications and is either familiar with or motivated to learn how to evaluate the quality and fairness of AI/ML systems.

Responsibilities

• Design and execute test scenarios for Python-based web applications.

• Assess AI model performance using metrics such as precision, recall, F1-score, bias, fairness, and explainability.

• Conduct robustness testing and validate data quality used for training models.

• Work with tools supporting AI/ML model testing (e.g. MLflow, TensorBoard, Great Expectations, Evidently AI).

• Cooperate with data scientists and engineers to define QA standards for data-driven systems.

• Apply testing methodologies suited for predictive, model-based architectures.

Requirements

Must-haves:

• General knowledge of artificial intelligence and machine learning (understanding of ML/AI models, NLP, recommendation systems).
• Ability to collect, analyze, and interpret business data and translate it into requirements for technical teams.
• Knowledge of programming languages for data analysis (Python, R) is welcome.
• Understanding of the AI project lifecycle and the role of data in the process.
• Experience with testing Python-based web applications.
• Ability to design tests in the context of AI model quality: precision, recall, F1-score, bias, fairness, explainability.
• Experience in resilience testing and validation of the quality of data used in model training.
• Knowledge of tools supporting AI model testing (e.g., MLflow, TensorBoard, Great Expectations, Evidently AI).
• Understanding of the difference between classic software testing and testing systems based on data and predictive models.

Nice-to-haves:

• Experience in implementing AI in enterprises and integrating it with existing business systems.
• Knowledge of AI ethics, privacy, and regulatory compliance.
• Knowledge of vector databases and search-assisted content generation (RAG) techniques.
• Experience working with low-code/no-code platforms for creating AI solutions.

Benefits

In return, we offer:

• 100% remote, flexible work.
• work with an experienced team of developers and continuous development of your hard and soft skills.
• dev-friendly processes such as Continuous Integration, Continuous Delivery, Code Review and bug bashes.
• long-term collaboration on challenging products (FinTech, B2B software, E-commerce and more).
  

Looking for a full-time job? Check out our Career Page and find out more about our open recruitment processes.

If you need any disability-related adaptation at any step of the recruitment process – simply let the recruiter know! We'd be happy to help.