Neural network generative models have achieved impressive results in recent years, but researchers are still working on increasing their efficiency. Researchers from the HSE Faculty of Computer Science and AIRI have managed to optimize the finetuning of the StyleGAN2 neural network, which creates realistic images, to new domains, reducing the number of trained parameters by four orders of magnitude. At the same time, the quality of the obtained images remained high. The results of this work were presented at the NeurIPS 2022 conference.