MediaWiki

Anti-Harassment Tools/SecurePoll Improvements/Test Results

< Anti-Harassment Tools | SecurePoll Improvements

Test Election Results

edit

Randomly generated elections

edit
Election Comments Latest version tested
20_6_5100_1090197746 SecurePoll and OpenSTV agree on elected candidates commit f06e679
20_4_5120_824772467 Discrepancies due to how many candidates we eliminate at once commit 5986646
20_6_5000_536228607 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5001_819859726 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_2_5200_1308507669 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_4_5120_1609394555 Results (almost) agree between SecurePoll and OpenSTV commit dcbad8c
20_6_5000_1301235635 Infinite recursion commit dcbad8c
20_6_5001_1851698519 Results (almost) agree between SecurePoll and OpenSTV commit dcbad8c
20_6_5000_2048723651 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_1048374110 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_751478367 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_39399868 SecurePoll and OpenSTV agree on elected candidates (might be a good candidate for performance testing) commit 58bf4c8
20_6_5000_698142105 SecurePoll and OpenSTV agree on elected candidates commit b7a4ccb
20_6_5000_899201474 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_1329880128 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
7_6_566_1185838663 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
5_3_2065 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
5_3_2679 Results (almost) agree between SecurePoll and OpenSTV commit dcbad8c
7_5_1000 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit dcbad8c
20_9_5200_704404317 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_4_5000_8910242957 Discrepancies between SecurePoll and OpenSTV, probably due to how we eliminate candidates commit dcbad8c
20_6_5100_319413701 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 624ef32
20_6_5000_2048397232 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 624ef32
5_3_100 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit dcbad8c
20_4_5000_1685033555 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 624ef32
20_6_5100_106188776 SecurePoll and OpenSTV agree on elected candidates commit 624ef32
20_6_5100_1116366364 SecurePoll and OpenSTV agree on elected candidates commit 624ef32
20_9_5200_2038025507 Potential example election to show our method for dealing with ties commit 58bf4c8
20_9_5000_1730013084 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties. Use-case for precision testing. commit 624ef32
20_9_5000_439818328 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties. Use-case for precision testing. commit 624ef32
20_9_5000_1236153056 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit c285563
20_9_5000_1355531191 SecurePoll and OpenSTV agree on elected candidates commit c285563
12_9_4828_204236991 SecurePoll and OpenSTV agree on elected candidates commit f06e679
20_9_5200_814099392 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit f06e679
20_9_5200_462089016 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit f06e679
12_9_4928_1803187550 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
20_9_5000_2083479695 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 3007c40
20_9_5000_1420679070 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 3007c40
20_9_5000_1886935514 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 3007c40
20_7_5000_292763510 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
20_7_5000_425367464 Infinite recursion commit 624ef32
20_9_496_604810680 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
20_9_496_604810680_reorder_reverse SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
12_9_5000_1830523430 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties and precision. Use-case for precision. commit 624ef32
20_9_488_1934769146 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
12_9_5000_179685718 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties and precision. Use-case for precision. commit 624ef32
20_9_5000_468090402 SecurePoll and OpenSTV agree on elected candidates commit 624ef32
4_2_104_388762016 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
4_2_104_643122133 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
4_2_104_839775172 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
4_2_2_394987273 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 58bf4c8

Real elections

edit
Election Comments Latest version tested
stackoverflow-com-2011-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2011-election-results_2 SecurePoll and OpenSTV agree on elected candidates commit 3007c40
stackoverflow-com-2012-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2013-election-results Some discrepancies between our results and what SO report commit f06e679
stackoverflow-com-2014-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2015-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2015-election-results_2 SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2016-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2017-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
stackoverflow-com-2018-election-results Discrepancies between SecurePoll and OpaVote due to candidates being removed commit f06e679
stackoverflow-com-2019-election-results SecurePoll and OpaVote agree on elected candidates commit 3007c40
stackoverflow-com-2020-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
datascience-stackexchange-com-2019-election-results SecurePoll and OpaVote agree on elected candidates commit 3007c40
math-stackexchange-com-2010-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
math-stackexchange-com-2011-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2012-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2013-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2014-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2017-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
math-stackexchange-com-2018-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
math-stackexchange-com-2020-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
irish_2002_general_election_dublin_west SecurePoll, OpenSTV and real-life results agree on elected candidates commit 3007c40

High-volume testing

edit
Election Description Comments Latest version tested
100_uniform_elections 100 elections where each candidate is equally popular Discrepencies between SecurePoll and OpenSTV in 12 out of 100 of the elections commit 624ef32
100_binomial_elections 100 elections where candidate popularity was based on binomial distribution No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_normal_elections 100 elections where candidate popularity was based on normal distribution No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_so2011_2_elections 100 elections where candidate popularity was the same as SO 2011 (2nd) elections No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_so2020_elections 100 elections where candidate popularity was the same as SO 2020 elections No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_m_so2010_elections 100 elections where candidate popularity was the same as the Math SO 2010 elections No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8

Analyses

edit
Name Description Comments
Precision Analysis of the precision of SecurePoll calculations So far, no evidence of large precision errors

Creating a new test result? Please use the Template.

All subpages

edit
Retrieved from "https://www.mediawiki.org/w/index.php?title=Anti-Harassment_Tools/SecurePoll_Improvements/Test_Results&oldid=5008684"