Schedule

How do you measure the real impact of GenAI in testing at the scale of 1,000+ QA engineers and separate actual value from the “wow” effect? We’ll share the metric framework and results from real implementations: LLMs for generating test documentation, accelerating E2E automation, and AI agents running regression tests.

How to transform chaotic "vibecoding" into a controlled engineering process using Spec-Driven Development, custom skills, and proper testing tools. Through a live project build (Web, Mobile, Backend), I will demonstrate how to get AI agents to deliver high-quality results on the first try, avoiding the trap of endless chat corrections.

LLM-as-a-Judge in AI agent testing automation — let's discuss why this practice is vital, which models to choose, why LLM-as-a-Judge will deceive you with its simplicity, and how to start writing regression automation for your AI agents.

Let's build a simple RAG bot based on Heisenbug conference program.

We will discuss how to implement AI in a company if you do not have large resources and free ML teams. I'll show you the free Roo Code AI assistant, as well as an unusual approach to writing feature evaluation agents, commit analysis, and requirements testing.

The practice of building an agent-based system for mobile regression: interaction with the device, model selection, and a set of engineering techniques that reduce non-determinism and help validate the result without self-deception.

A talk on how we test copilots and agents.

This talk focuses on the practice of testing applications based on large language models (LLM) using the DeepEval tool. It will cover the automation of quality assessment using the LLM-as-a-Judge approach, specialized metrics, and the integration of testing into the development process to ensure the reliability and predictability of system operation.

An AI is losing context during codebase growth. I will demonstrate a few ways to manage it and make your work more comfortable.

Our friends from the Moscow QA community have prepared a short track for you — a series of short talks from community practitioners.

How do you measure the real impact of GenAI in testing at the scale of 1,000+ QA engineers and separate actual value from the “wow” effect? We’ll share the metric framework and results from real implementations: LLMs for generating test documentation, accelerating E2E automation, and AI agents running regression tests.

Using practical examples, we will show which solutions really help speed up runs and why generative AI tips should be tested with engineering experience.

Let's systematize the approach to testing in game development. I'll show you how and which test design methods are used in game development and share patterns of approaches to key game mechanics. Let's systematize the approach to testing in game development. I'll show you how test design techniques are used in gamedev and share patterns of approaches to key game mechanics.

The market is changing, companies are reviewing their teams, and the requirements for specialists are becoming different. At the QA cozy talk, we will honestly discuss why employees are actually being fired, what signals may appear in advance, and which specialists will be in demand in the coming years. This is an open conversation where you can not only listen, but also ask questions, argue and share your experiences.

What do hiring managers at big tech companies really think about controversial situations in technical interviews? Where is the line of “acceptable help,” and what should you do if it feels like something is going wrong?

In this interactive format, experts will break down real cases without pre-prepared answers, and the audience will decide whose position is more convincing.

We analyze real cases from practice without prepared answers: on stage, experts will take turns offering their solutions, explaining their train of thought and arguing approaches. But it's up to you to decide which approach is most appropriate in each case!

Testing the Smile Payment service.

Security check and search for biometric system vulnerabilities.

Errors occur at all stages of software development. The sooner we find out, the cheaper it is to fix them. At WS, testers will learn how to identify errors in requirements before the development stage. This will reduce the number of potential errors, the time and effort of the team to fix them.

This is not a conversation about "tests will replace documentation" or that all processes need to be urgently rewritten under AI. Rather, it’s an attempt to figure things out together.

Let's reflect and discuss new tools together!

We will discuss how to implement AI in a company if you do not have large resources and free ML teams. I'll show you the free Roo Code AI assistant, as well as an unusual approach to writing feature evaluation agents, commit analysis, and requirements testing.

Let's recall the times when the grass was greener and JUnit was a very simple library.

The classic "how to reproduce this?" dilemma has been resolved! This talk introduces my browser extension that handles action recording, captures errors, and helps to produce bug reports automatically — no more manual note-taking or relying on memory.

This talk focuses on the practice of testing applications based on large language models (LLM) using the DeepEval tool. It will cover the automation of quality assessment using the LLM-as-a-Judge approach, specialized metrics, and the integration of testing into the development process to ensure the reliability and predictability of system operation.

An AI is losing context during codebase growth. I will demonstrate a few ways to manage it and make your work more comfortable.

We will tell you how T-Bank developed a tool for chaos testing and integrated it into the daily work of teams and SDLC processes.

Using practical examples, we will show which solutions really help speed up runs and why generative AI tips should be tested with engineering experience.

How Ozon Bank launched its ATM network, the testing challenges that emerged, and how the team approached UI regression automation for ATMs.

I will tell you about the current state of mutation testing tools for programming languages. What new scientific papers have been published? Which tools are relevant where? My task is to provide an overview of the topic without going into details of specific tools or languages.

The practice of building an agent-based system for mobile regression: interaction with the device, model selection, and a set of engineering techniques that reduce non-determinism and help validate the result without self-deception.

Let's talk about how to implement the contractual approach gradually and without unnecessary complication.

An AI is losing context during codebase growth. I will demonstrate a few ways to manage it and make your work more comfortable.

We will tell you how T-Bank developed a tool for chaos testing and integrated it into the daily work of teams and SDLC processes.

You will learn how to organize a compact, convenient and scalable laboratory for test benches using telecommunication racks as a platform.

Testing the Smile Payment service.

Security check and search for biometric system vulnerabilities.

I will tell you how to build a simple and convenient tool for measuring the energy consumption of various electrical appliances and integrate it into your infrastructure.

Using practical examples, we will show which solutions really help speed up runs and why generative AI tips should be tested with engineering experience.

The practice of building an agent-based system for mobile regression: interaction with the device, model selection, and a set of engineering techniques that reduce non-determinism and help validate the result without self-deception.

I will tell you how to build a simple and convenient tool for measuring the energy consumption of various electrical appliances and integrate it into your infrastructure.

Let's build a simple RAG bot based on Heisenbug conference program.

Errors occur at all stages of software development. The sooner we find out, the cheaper it is to fix them. At WS, testers will learn how to identify errors in requirements before the development stage. This will reduce the number of potential errors, the time and effort of the team to fix them.

Poorly secured test repositories are not just a future threat that will materialize sooner or later. This is a current, actively exploited security breach. And as the protection of the production code strengthens, this gap will only widen, making attacks on tests more attractive to intruders. The question is not whether there will be an attack, but when it will affect your company.

Let's talk about testing the security of IoT devices and embedded firmware, based on the OWASP Firmware Security Testing Methodology, and create a checklist with device security checks.

We will tell you what problems appeared, how we learned to reproduce the defect, how we stepped on a rake, and how it all ended (or did not end).

Let's systematize the approach to testing in game development. I'll show you how and which test design methods are used in game development and share patterns of approaches to key game mechanics. Let's systematize the approach to testing in game development. I'll show you how test design techniques are used in gamedev and share patterns of approaches to key game mechanics.

Networking session in Discussion Zone 2.

We'll talk about the schedule, sessions and share information.

We build systems that none of us can keep in our heads entirely. We cover complexity with abstractions, abstractions with frameworks, frameworks with automation. And with each new layer, we believe more and more strongly that this time there is no need to check. That the tool is finally smart enough. That's how it works. And then someone checks it anyway, and it starts.

An entertaining format for those who love heated discussions and are ready to defend their point of view.

Lightning talks are a great format to dynamically discuss a topic and find like-minded people. You will enjoy 10-minute talks on professional or near-professional topics and lively discussions.

Let's look at how the elements of quantum computers are tested, the state of qubits is measured, and the performance of quantum processors is evaluated.

Summing up the results of the conference, remembering the highlights and talking about plans.