From 1b6d2e0490cde8decff7c070f074395f9a0c9218 Mon Sep 17 00:00:00 2001 From: Albionthegreat <74660626+Albionthegreat@users.noreply.github.com> Date: Thu, 23 May 2024 03:10:05 +0200 Subject: [PATCH 1/4] Update `Tournaments/Official_Support` with Expectations for Programs --- wiki/Tournaments/Official_support/en.md | 33 +++++++++++++++++++------ 1 file changed, 26 insertions(+), 7 deletions(-) diff --git a/wiki/Tournaments/Official_support/en.md b/wiki/Tournaments/Official_support/en.md index d411f6731397..440a33b0d541 100644 --- a/wiki/Tournaments/Official_support/en.md +++ b/wiki/Tournaments/Official_support/en.md @@ -91,16 +91,35 @@ Once the tournament has concluded, the tournament organisers will need to submit - An appropriately designed badge ([see below](#profile-badges)). - A link to the publicly viewable catalogue of your tournament's match history. -#### Referee bots/automation +### Registrant Filtering, Seeding and Automated Refereeing -The use of bots/automation to aid in the running of officially supported tournament matches is permitted *with some caveats to reflect their cutting-edge nature*, so long as any applicable software/workflows meet the requirements listed below: +#### Expectations for Programs -- The bot/automation must be made publicly and functionally available as an open-source repository. -- The bot/automation should abide by the expectations laid out for [bot accounts](/wiki/Bot_account) for general in-game use. Referee-related tools and software can be run directly from a user's own account. -- If a bot/automation is used for refereeing, a human referee must always be available to respond to calls for support from participants within a reasonable timeframe (2–5 minutes), and be able to be summoned remotely via the use of a chat command inside the lobby itself (we recommend `!panic` as a global alias for this). -- Where a bot/automation workflow is present, any ongoing lobbies should be able to be manually taken over by a human referee with minimal interference whilst also retaining any previous logs of play and chat. +Third-party programs designed to automate the job of a referee or filter registrants from the tournament automatically must be open, transparent, and documented. Any third-party tool used for these purposes must: -Approval for the use of referee bots/automation **must** be granted by the osu! support team. In addition, this approval is required for **every individual instance where a referee bot/automation is used**. We expect to relax some of these requirements in the future as the technology surrounding these bots develops and experience with using them grows. +- Be made publicly and functionally available as an open-source repository. +- Be completely documented in an easily readable & digestable format. + +Currently, approval for the use of any such tool must be **explicitly granted** by the osu! support team. Additionally, this approval must be granted for **every tournament where registrant filtering, seeding, or automated refereeing are used.** We expect to relax some of these requirements in the future as the technology surrounding these bots develops and experience with using them grows. + +#### Registrant Filtering and Seeding + +Registrant filtering, not to be confused with [screening](#tournament-screening), is the process of using any program, algorithm, mathematical formula, or other means to remove otherwise good-standing players from a tournament. The standard use of such tools is to reduce the variance in skill within a tournament. One such tool that may come to mind is [BWS](/wiki/Tournaments/Badge-weighted_seeding). + +In addition to the expectations for programs above, tools used to filter registrants or seed players must also: + +- Have an up-to-date, publicly-available, downloadable dataset including documentation explaining how to reproduce the results using this dataset. + - A third party should be able to get the same results without needing additional information. + +#### Automated Refereeing + +The use of automated refereeing tools are permitted *with some caveats to reflect their cutting-edge nature*. Automated refereeing tools, including bots, may receive approval for use in badged tournaments so long as certain requirements are met. + +In addition to the expectations for programs above, they must also adhere to the following expectations: + +- Potential bots must abide by the expectations laid out for [bot accounts](wiki/Bot_account) for general in-game use. Referee-related tools and software could alternatively be run directly from a user's own account. +- A human referee must always be available to respond to calls for support from participants within a reasonable timeframe (2–5 minutes), and be able to be summoned remotely via the use of a `!panic` command inside the lobby itself. +- Any ongoing lobbies should be able to be manually taken over by a human referee with minimal interference whilst also retaining any previous logs of play and chat. ### Staff From d059a86024633afbfab2f6ed21ff00aa45d907fb Mon Sep 17 00:00:00 2001 From: Albionthegreat <74660626+Albionthegreat@users.noreply.github.com> Date: Fri, 24 May 2024 01:51:03 +0200 Subject: [PATCH 2/4] Update wording and clarify further. --- wiki/Tournaments/Official_support/en.md | 20 +++++++++++--------- 1 file changed, 11 insertions(+), 9 deletions(-) diff --git a/wiki/Tournaments/Official_support/en.md b/wiki/Tournaments/Official_support/en.md index 440a33b0d541..b251eb0a04d2 100644 --- a/wiki/Tournaments/Official_support/en.md +++ b/wiki/Tournaments/Official_support/en.md @@ -77,7 +77,7 @@ In addition, all promotional material or any services associated with a tourname **The tournament must also abide by the following practices throughout:** - All registrants must be screened by the account support team before play commences.[^play-commence] See [tournament screening](#tournament-screening) for more details. -- If a user satisfies the sign-up criteria (if any), the tournament must not prevent those who pass the screening from participating without both ample evidence presented publicly against them and the approval of the account support team. +- If a user satisfies the sign-up criteria (if any) and is not [filtered](#registrant-filtering-seeding-and-automated-refereeing) out through other means, the tournament must not prevent those who pass the screening from participating without both ample evidence presented publicly against them and the approval of the account support team. - This includes preventing users who are perceived to be "sandbagging" from play. Should an organiser have valid concerns about the presence of such players affecting the competitive integrity of their tournament, they may raise the issue to the [Tournament Committee](/wiki/People/Tournament_Committee) for a case-by-case review using the [tournament reports form](https://pif.ephemeral.ink/tournament-reports). - A dedicated referee must be present during every match, or be available to be summoned with minimal delay (2–5 minutes) if appropriate permission for automated software has been granted and is being used for assistance. Players cannot "self-ref". - The use of bots is allowed on qualifier stage matches, provided that it is supervised by a staff member. @@ -95,30 +95,32 @@ Once the tournament has concluded, the tournament organisers will need to submit #### Expectations for Programs -Third-party programs designed to automate the job of a referee or filter registrants from the tournament automatically must be open, transparent, and documented. Any third-party tool used for these purposes must: +Third-party programs designed to filter registrants, seed players, or automate the job of a referee from the tournament automatically must be open, transparent, and documented. Any third-party tool used for these purposes must: - Be made publicly and functionally available as an open-source repository. - Be completely documented in an easily readable & digestable format. -Currently, approval for the use of any such tool must be **explicitly granted** by the osu! support team. Additionally, this approval must be granted for **every tournament where registrant filtering, seeding, or automated refereeing are used.** We expect to relax some of these requirements in the future as the technology surrounding these bots develops and experience with using them grows. +Currently, approval for the use of any such tool must be **explicitly granted** by the osu! support team. Additionally, this approval must be granted for **every tournament where registrant filtering, seeding, or automated refereeing is used.** We expect to relax some of these requirements in the future as the technology surrounding these programs develops and experience with using them grows. #### Registrant Filtering and Seeding -Registrant filtering, not to be confused with [screening](#tournament-screening), is the process of using any program, algorithm, mathematical formula, or other means to remove otherwise good-standing players from a tournament. The standard use of such tools is to reduce the variance in skill within a tournament. One such tool that may come to mind is [BWS](/wiki/Tournaments/Badge-weighted_seeding). +Registrant filtering, not to be confused with [screening](#tournament-screening), is the process of using any program, algorithm, mathematical formula, or other objective means to remove otherwise good-standing players from a tournament. The standard use of such tools or systems is to reduce the variance in skill within a tournament. One such system that may come to mind is [BWS](/wiki/Tournaments/Badge-weighted_seeding). -In addition to the expectations for programs above, tools used to filter registrants or seed players must also: +In addition to the expectations for programs above, tools or systems used to filter registrants or seed players must also abide by the following practices: -- Have an up-to-date, publicly-available, downloadable dataset including documentation explaining how to reproduce the results using this dataset. - - A third party should be able to get the same results without needing additional information. +- If a dataset is used, it must be up to date, publicly available and downloadable. Documentation must be provided explaining how to reproduce the results using this dataset. +- When doing qualifiers, the formula or method used to determine seeding must be included in the tournament's ruleset. + +A third party should be able to get the same results without needing additional information. Manually filtering players or adjusting their seeds is strictly prohibited. #### Automated Refereeing The use of automated refereeing tools are permitted *with some caveats to reflect their cutting-edge nature*. Automated refereeing tools, including bots, may receive approval for use in badged tournaments so long as certain requirements are met. -In addition to the expectations for programs above, they must also adhere to the following expectations: +In addition to the expectations for programs above, automated refereeing tools must also adhere to the following expectations: - Potential bots must abide by the expectations laid out for [bot accounts](wiki/Bot_account) for general in-game use. Referee-related tools and software could alternatively be run directly from a user's own account. -- A human referee must always be available to respond to calls for support from participants within a reasonable timeframe (2–5 minutes), and be able to be summoned remotely via the use of a `!panic` command inside the lobby itself. +- A human referee must always be available to respond to calls for support from participants within a reasonable timeframe (2–5 minutes), and be able to be summoned remotely via the use of a `!panic` command inside the lobby itself. When this command is used, all automation should stop until resumed by the human referee. - Any ongoing lobbies should be able to be manually taken over by a human referee with minimal interference whilst also retaining any previous logs of play and chat. ### Staff From 4b15e4556243c83ab9713d6cbcc3a37c41ffd154 Mon Sep 17 00:00:00 2001 From: Albionthegreat <74660626+Albionthegreat@users.noreply.github.com> Date: Fri, 24 May 2024 01:55:42 +0200 Subject: [PATCH 3/4] smol addition --- wiki/Tournaments/Official_support/en.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/wiki/Tournaments/Official_support/en.md b/wiki/Tournaments/Official_support/en.md index b251eb0a04d2..6643200da84b 100644 --- a/wiki/Tournaments/Official_support/en.md +++ b/wiki/Tournaments/Official_support/en.md @@ -108,7 +108,7 @@ Registrant filtering, not to be confused with [screening](#tournament-screening) In addition to the expectations for programs above, tools or systems used to filter registrants or seed players must also abide by the following practices: -- If a dataset is used, it must be up to date, publicly available and downloadable. Documentation must be provided explaining how to reproduce the results using this dataset. +- If a dataset is used, it must be up to date, publicly available and downloadable. Documentation must be provided explaining how to recreate the dataset and reproduce the results using it. - When doing qualifiers, the formula or method used to determine seeding must be included in the tournament's ruleset. A third party should be able to get the same results without needing additional information. Manually filtering players or adjusting their seeds is strictly prohibited. From 37dd403df2c91ef09a067c6cec7be12cd9b5f15a Mon Sep 17 00:00:00 2001 From: Albionthegreat <74660626+Albionthegreat@users.noreply.github.com> Date: Sat, 25 May 2024 23:08:56 +0200 Subject: [PATCH 4/4] shmol ficc --- wiki/Tournaments/Official_support/en.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/wiki/Tournaments/Official_support/en.md b/wiki/Tournaments/Official_support/en.md index 6643200da84b..d3417ff01fc0 100644 --- a/wiki/Tournaments/Official_support/en.md +++ b/wiki/Tournaments/Official_support/en.md @@ -95,12 +95,12 @@ Once the tournament has concluded, the tournament organisers will need to submit #### Expectations for Programs -Third-party programs designed to filter registrants, seed players, or automate the job of a referee from the tournament automatically must be open, transparent, and documented. Any third-party tool used for these purposes must: +Third-party programs designed to filter registrants, seed players, or automate the job of a referee must be open, transparent, and documented. Any third-party tool used for these purposes must: - Be made publicly and functionally available as an open-source repository. - Be completely documented in an easily readable & digestable format. -Currently, approval for the use of any such tool must be **explicitly granted** by the osu! support team. Additionally, this approval must be granted for **every tournament where registrant filtering, seeding, or automated refereeing is used.** We expect to relax some of these requirements in the future as the technology surrounding these programs develops and experience with using them grows. +Currently, approval for the use of any such tool must be **explicitly granted** by the osu! support team. Additionally, this approval must be granted for **every tournament where programs for registrant filtering, seeding, or automated refereeing are used.** We expect to relax some of these requirements in the future as the technology surrounding these programs develops and experience with using them grows. #### Registrant Filtering and Seeding @@ -108,7 +108,7 @@ Registrant filtering, not to be confused with [screening](#tournament-screening) In addition to the expectations for programs above, tools or systems used to filter registrants or seed players must also abide by the following practices: -- If a dataset is used, it must be up to date, publicly available and downloadable. Documentation must be provided explaining how to recreate the dataset and reproduce the results using it. +- If a dataset is used, it must be up to date, publicly available and downloadable. Documentation must be provided explaining how to recreate the dataset and reproduce the results using it — including code where applicable. - When doing qualifiers, the formula or method used to determine seeding must be included in the tournament's ruleset. A third party should be able to get the same results without needing additional information. Manually filtering players or adjusting their seeds is strictly prohibited.