Development Of New Software Components For A/B Experiments in Yandex

In today's world, A/B testing has become one of the best tools for making data-based decisions, which has a significant impact on improving user experience and service delivery. Therefore, before implementing new functionality, it is necessary to assess the possible impact of experimental changes. Yandex has several internal services that are responsible for the A/B experiment cycle, one of them is the experiment admin panel, where the experiment is created, its results are viewed, and so on. Most of the functionality was written a long time ago and is not very suitable for development these days. Business logic is difficult to expand and scale, and there are a lot of bugs in the code. In this work, new software components are implemented: a calculation page where you can view all metrics and make a decision on the experiment, as well as pages of testids, observations and experiments, all integral parts of the admin panel's cycle. The new solution has good stability and reliability, introduces flexibility and convenience in terms of user experience, and also opens up new opportunities for rapid development of the service. A large number of Yandex developers, analysts and managers are already using the new functionality.