Anti-Harassment Tools/SecurePoll Improvements/Test Results

Test Election Results[edit]

Randomly generated elections[edit]

Election	Comments	Latest version tested
20_6_5100_1090197746	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
20_4_5120_824772467	Discrepancies due to how many candidates we eliminate at once	commit 5986646
20_6_5000_536228607	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_6_5001_819859726	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_2_5200_1308507669	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_4_5120_1609394555	Results (almost) agree between SecurePoll and OpenSTV	commit dcbad8c
20_6_5000_1301235635	Infinite recursion	commit dcbad8c
20_6_5001_1851698519	Results (almost) agree between SecurePoll and OpenSTV	commit dcbad8c
20_6_5000_2048723651	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_6_5000_1048374110	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_6_5000_751478367	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_6_5000_39399868	SecurePoll and OpenSTV agree on elected candidates (might be a good candidate for performance testing)	commit 58bf4c8
20_6_5000_698142105	SecurePoll and OpenSTV agree on elected candidates	commit b7a4ccb
20_6_5000_899201474	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_6_5000_1329880128	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
7_6_566_1185838663	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
5_3_2065	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
5_3_2679	Results (almost) agree between SecurePoll and OpenSTV	commit dcbad8c
7_5_1000	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit dcbad8c
20_9_5200_704404317	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
20_4_5000_8910242957	Discrepancies between SecurePoll and OpenSTV, probably due to how we eliminate candidates	commit dcbad8c
20_6_5100_319413701	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 624ef32
20_6_5000_2048397232	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 624ef32
5_3_100	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit dcbad8c
20_4_5000_1685033555	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 624ef32
20_6_5100_106188776	SecurePoll and OpenSTV agree on elected candidates	commit 624ef32
20_6_5100_1116366364	SecurePoll and OpenSTV agree on elected candidates	commit 624ef32
20_9_5200_2038025507	Potential example election to show our method for dealing with ties	commit 58bf4c8
20_9_5000_1730013084	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties. Use-case for precision testing.	commit 624ef32
20_9_5000_439818328	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties. Use-case for precision testing.	commit 624ef32
20_9_5000_1236153056	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit c285563
20_9_5000_1355531191	SecurePoll and OpenSTV agree on elected candidates	commit c285563
12_9_4828_204236991	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
20_9_5200_814099392	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit f06e679
20_9_5200_462089016	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit f06e679
12_9_4928_1803187550	SecurePoll and OpenSTV agree on elected candidates. Use-case for precision.	commit 624ef32
20_9_5000_2083479695	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 3007c40
20_9_5000_1420679070	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 3007c40
20_9_5000_1886935514	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 3007c40
20_7_5000_292763510	SecurePoll and OpenSTV agree on elected candidates. Use-case for precision.	commit 624ef32
20_7_5000_425367464	Infinite recursion	commit 624ef32
20_9_496_604810680	SecurePoll and OpenSTV agree on elected candidates. Use-case for precision.	commit 624ef32
20_9_496_604810680_reorder_reverse	SecurePoll and OpenSTV agree on elected candidates. Use-case for precision.	commit 624ef32
12_9_5000_1830523430	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties and precision. Use-case for precision.	commit 624ef32
20_9_488_1934769146	SecurePoll and OpenSTV agree on elected candidates. Use-case for precision.	commit 624ef32
12_9_5000_179685718	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties and precision. Use-case for precision.	commit 624ef32
20_9_5000_468090402	SecurePoll and OpenSTV agree on elected candidates	commit 624ef32
4_2_104_388762016	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
4_2_104_643122133	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
4_2_104_839775172	SecurePoll and OpenSTV agree on elected candidates	commit 58bf4c8
4_2_2_394987273	Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties	commit 58bf4c8

Real elections[edit]

Election	Comments	Latest version tested
stackoverflow-com-2011-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
stackoverflow-com-2011-election-results_2	SecurePoll and OpenSTV agree on elected candidates	commit 3007c40
stackoverflow-com-2012-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
stackoverflow-com-2013-election-results	Some discrepancies between our results and what SO report	commit f06e679
stackoverflow-com-2014-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
stackoverflow-com-2015-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
stackoverflow-com-2015-election-results_2	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
stackoverflow-com-2016-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
stackoverflow-com-2017-election-results	SecurePoll and OpaVote agree on elected candidates	commit f06e679
stackoverflow-com-2018-election-results	Discrepancies between SecurePoll and OpaVote due to candidates being removed	commit f06e679
stackoverflow-com-2019-election-results	SecurePoll and OpaVote agree on elected candidates	commit 3007c40
stackoverflow-com-2020-election-results	SecurePoll and OpaVote agree on elected candidates	commit f06e679
datascience-stackexchange-com-2019-election-results	SecurePoll and OpaVote agree on elected candidates	commit 3007c40
math-stackexchange-com-2010-election-results	SecurePoll and OpaVote agree on elected candidates	commit f06e679
math-stackexchange-com-2011-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
math-stackexchange-com-2012-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
math-stackexchange-com-2013-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
math-stackexchange-com-2014-election-results	SecurePoll and OpenSTV agree on elected candidates	commit f06e679
math-stackexchange-com-2017-election-results	SecurePoll and OpaVote agree on elected candidates	commit f06e679
math-stackexchange-com-2018-election-results	SecurePoll and OpaVote agree on elected candidates	commit f06e679
math-stackexchange-com-2020-election-results	SecurePoll and OpaVote agree on elected candidates	commit f06e679
irish_2002_general_election_dublin_west	SecurePoll, OpenSTV and real-life results agree on elected candidates	commit 3007c40

High-volume testing[edit]

Election	Description	Comments	Latest version tested
100_uniform_elections	100 elections where each candidate is equally popular	Discrepencies between SecurePoll and OpenSTV in 12 out of 100 of the elections	commit 624ef32
100_binomial_elections	100 elections where candidate popularity was based on binomial distribution	No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections	commit 58bf4c8
100_normal_elections	100 elections where candidate popularity was based on normal distribution	No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections	commit 58bf4c8
100_so2011_2_elections	100 elections where candidate popularity was the same as SO 2011 (2nd) elections	No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections	commit 58bf4c8
100_so2020_elections	100 elections where candidate popularity was the same as SO 2020 elections	No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections	commit 58bf4c8
100_m_so2010_elections	100 elections where candidate popularity was the same as the Math SO 2010 elections	No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections	commit 58bf4c8

Analyses[edit]

Name	Description	Comments
Precision	Analysis of the precision of SecurePoll calculations	So far, no evidence of large precision errors

Creating a new test result? Please use the Template.

All subpages[edit]