The Main Components for Using Assessors and Tools for Stimulating Assessors and Monitoring Their States

This paper explores the use of crowdsourcing in creation of high-quality datasets, highlighting the complex challenges. The main focus lies on areas of launching the markup process, monitoring assessors' status, and automating bonus payments to improve productivity and engagement. A detailed plan is provided for launching markup, along with examples of markup and crowdsourcing platforms. Challenges such as the diverse backgrounds of performers and task management are addressed through the introduction of learning funnels. A state machine is also discussed that automates the monitoring of assessor statuses and supports learning funnels, enabling better management and visualization of progress. Finally, a unified system is proposed for automating bonus payment, designed to increase productivity and simplify management of bonus programs. This system not only simplifies the creation and processing of bonus programs, but also reduces manual labor significantly improving operational efficiency.