Benchmarks on Sergey/kcfa/solovay-strassen.scm of differents structure for the worklist (Scala-Par-AM 01.00.02)

TypeSet lattice – Classical address – Default step – Sequential SeqAAMLS and parallel ParAAM-*-*-* – 13 repetitions (time in seconds, computed on SuperWOPR – Dell Precision T3500 – Intel Xeon CPU W3530 @ 2.8GHz4 cores × 2 by Hyper-Threading – Java GraalVM 19.1.1)
  Machine p # states # error states # error values # final states # final values Final values # ? Time 1 ? Time 2 ? Time 3 ? Time 4 ? Time 5 ? Time 6 ? Time 7 ? Time 8 ? Time 9 ? Time 10 ? Time 11 ? Time 12 ? Time 13 # finished Average time Standard error Correct? Error 1 Error 2 Error 3 Error 4 Error 5 Error 6 Error 7 Error 8 Error 9 Error 10 Error 11 Error 12 Error 13
1 SeqAAMLS 1 698817 18162 1 4878 1 #f 13 16.934 16.885 15.907 15.2   15.324 15.223 15.28  15.284 15.307 15.265 15.267 15.232 15.28  13 15.568 0.465
2 ParAAM-L-SA-state 2 698817 18162 1 4878 1 #f 13 15.764 14.182 14.716 14.328 14.52  14.306 14.568 14.833 14.674 14.77  14.447 14.352 14.782 13 14.634 0.267
3 ParAAM-L-SA-state 3 698817 18162 1 4878 1 #f 13 14.783 14.888 14.408 14.652 14.565 14.918 14.846 14.641 14.943 14.761 14.466 14.676 14.433 13 14.691 0.153
4 ParAAM-L-SA-state 4 698817 18162 1 4878 1 #f 13 16.11  16.357 16.506 15.965 16.351 16.382 16.04  15.992 15.972 16.36  16.037 16.091 15.984 13 16.165 0.174
5 ParAAM-L-SA-state 5 698817 18162 1 4878 1 #f 13 16.912 16.53  16.479 16.63  16.666 16.743 16.537 16.452 16.508 16.594 16.615 16.349 16.49  13 16.577 0.107
6 ParAAM-L-SA-state 6 698817 18162 1 4878 1 #f 13 16.986 16.823 16.856 16.909 17.061 16.603 16.634 16.788 16.854 16.752 16.423 16.521 16.783 13 16.769 0.14 
7 ParAAM-L-SA-state 7 698817 18162 1 4878 1 #f 13 17.014 16.638 17.136 17.226 16.59  17.068 16.84  16.995 16.803 17     17.06  16.996 16.602 13 16.921 0.174
8 ParAAM-L-SA-state 8 698817 18162 1 4878 1 #f 13 17.218 16.862 17.157 16.717 16.77  16.939 16.834 16.671 16.661 16.74  16.851 16.855 17.06  13 16.872 0.136
9 ParAAM-L-SA-set 2 698817 18162 1 4878 1 #f 13 14.04  14.036 14.174 13.968 14.09  14.316 14.12  14.211 13.964 14.033 14.139 14.383 13.88  13 14.104 0.111
10 ParAAM-L-SA-set 3 698817 18162 1 4878 1 #f 13 15.183 14.436 14.532 14.575 14.579 15.058 14.455 14.582 14.561 14.673 14.374 14.774 14.876 13 14.666 0.19 
11 ParAAM-L-SA-set 4 698817 18162 1 4878 1 #f 13 16.522 16.401 16.344 16.213 15.993 16.177 16.184 16.295 16.148 16.303 16.066 16.286 16.336 13 16.251 0.112
12 ParAAM-L-SA-set 5 698817 18162 1 4878 1 #f 13 16.573 16.891 16.847 16.803 16.635 17.012 16.613 16.406 16.521 16.593 16.318 16.524 16.812 13 16.658 0.166
13 ParAAM-L-SA-set 6 698817 18162 1 4878 1 #f 13 16.819 16.887 16.861 16.774 17.073 17.062 16.844 16.952 16.998 17.031 16.976 17.098 16.67  13 16.926 0.108
14 ParAAM-L-SA-set 7 698817 18162 1 4878 1 #f 13 16.668 16.709 16.977 16.722 16.73  16.893 16.955 16.903 16.694 16.884 16.959 16.682 17.136 13 16.839 0.128
15 ParAAM-L-SA-set 8 698817 18162 1 4878 1 #f 13 17.218 16.708 16.947 16.557 16.761 16.981 16.805 16.933 16.742 17.208 16.864 16.936 16.68  13 16.872 0.152
16 ParAAM-L-SA-part 2 698817 18162 1 4878 1 #f 13 16.25  16.187 16.262 16.059 16.177 16.088 16.143 16.374 17.767 16.925 16.614 16.19  16.111 13 16.396 0.326
17 ParAAM-L-SA-part 3 698817 18162 1 4878 1 #f 13 11.808 11.588 11.484 11.594 11.552 11.466 11.334 11.624 11.446 11.512 11.521 11.415 11.565 13 11.532 0.083
18 ParAAM-L-SA-part 4 698817 18162 1 4878 1 #f 13 10.317 10.16  10.248 10.198 10.294 10.176 10.167 10.09  10.148 10.129 10.041 10.177 10.272 13 10.186 0.061
19 ParAAM-L-SA-part 5 698817 18162 1 4878 1 #f 13 9.766 9.524 9.541 9.657 9.694 9.639 9.639 9.833 9.705 9.567 9.634 9.737 9.707 13 9.665 0.07 
20 ParAAM-L-SA-part 6 698817 18162 1 4878 1 #f 13 9.354 9.243 9.488 9.39  9.252 9.344 9.36  9.353 9.499 9.495 9.447 9.276 9.237 13 9.365 0.076
21 ParAAM-L-SA-part 7 698817 18162 1 4878 1 #f 13 9.097 9.143 9.081 9.231 9.125 9.12  9.161 9.039 9.024 9.185 9.159 8.995 9.162 13 9.117 0.054
22 ParAAM-L-SA-part 8 698817 18162 1 4878 1 #f 13 9.066 8.964 9.116 9.037 8.932 9.066 9.052 8.939 9.063 8.935 8.947 8.935 8.977 13 9.002 0.059
23 ParAAM-C-S-state 2 698817 18162 1 4878 1 #f 13 84.878 81.171 76.467 71.124 68.718 75.58  71.18  69.543 69.59  96.754 71.015 69.327 78.702 13 75.696 6.076
24 ParAAM-C-S-state 3 698817 18162 1 4878 1 #f 13 99.942 101.391 107.849 105.112 103.184 100.116 101.401 105.15  100.347 99.295 101.298 103.705 99.904 13 102.207 2.148
25 ParAAM-C-S-state 4 698817 18162 1 4878 1 #f 13 97.838 95.26  95.28  97.362 95.045 95.663 94.413 99.97  93.209 97.211 99.102 97.452 94.491 13 96.331 1.685
26 ParAAM-C-S-state 5 698817 18162 1 4878 1 #f 13 93.623 94.086 95.94  95.105 94.084 97.892 92.344 92.825 95.339 92.148 95.542 91.385 96.625 13 94.38  1.564
27 ParAAM-C-S-state 6 698817 18162 1 4878 1 #f 13 93.422 92.418 92.031 94.722 95.416 93.716 93.28  94.939 92.803 94.246 85.098 90.917 94.596 13 92.893 1.723
28 ParAAM-C-S-state 7 698817 18162 1 4878 1 #f 13 91.089 89.968 85.39  91.313 92.03  93.103 92.537 93.549 93.676 92.496 91.524 92.281 90.055 13 91.462 1.461
29 ParAAM-C-S-state 8 698817 18162 1 4878 1 #f 13 93.809 90.746 92.002 93.273 92.062 92.763 93.464 91.164 90.793 93.024 90.212 93.606 91.971 13 92.222 1.016
30 ParAAM-C-S-set 2 698817 18162 1 4878 1 #f 13 21.897 22.081 21.937 21.845 21.976 21.9   21.92  22.005 21.816 21.91  21.927 21.788 22.113 13 21.932 0.07 
31 ParAAM-C-S-set 3 698817 18162 1 4878 1 #f 13 17.911 16.505 16.723 17.158 17.332 17.604 16.95  16.132 17.086 16.595 17.207 16.712 16.536 13 16.958 0.393
32 ParAAM-C-S-set 4 698817 18162 1 4878 1 #f 13 19.974 19.607 19.536 19.166 19.195 19.61  19.234 19.328 18.793 19.392 19.436 19.341 19.694 13 19.408 0.217
33 ParAAM-C-S-set 5 698817 18162 1 4878 1 #f 13 21.947 21.696 21.829 21.81  22.726 22.38  22.161 22.118 22.388 22.4   22.062 22.297 22.331 13 22.165 0.236
34 ParAAM-C-S-set 6 698817 18162 1 4878 1 #f 13 23.951 23.948 23.637 23.917 23.446 23.94  23.583 23.587 22.993 24.713 23.781 23.54  24.61  13 23.819 0.333
35 ParAAM-C-S-set 7 698817 18162 1 4878 1 #f 13 25.059 25.095 24.521 24.85  24.067 24.551 24.97  24.8   24.413 24.591 24.033 23.538 22.396 13 24.376 0.534
36 ParAAM-C-S-set 8 698817 18162 1 4878 1 #f 13 22.847 26.13  25.292 24.927 24.568 24.727 24.632 24.927 24.551 25.53  24.432 24.905 24.894 13 24.797 0.465
37 ParAAM-C-S-part 2 698817 18162 1 4878 1 #f 13 16.533 16.717 16.521 16.573 16.355 16.275 16.373 16.32  16.909 16.385 16.494 16.54  16.675 13 16.513 0.135
38 ParAAM-C-S-part 3 698817 18162 1 4878 1 #f 13 9.215 9.001 8.591 9.11  7.833 8.41  8.42  8.64  8.934 7.569 8.566 9.012 7.785 13 8.545 0.417
39 ParAAM-C-S-part 4 698817 18162 1 4878 1 #f 13 5.168 5.322 5.504 5.792 5.291 4.971 5.144 5.611 5.228 5.199 5.079 5.893 5.274 13 5.344 0.219
40 ParAAM-C-S-part 5 698817 18162 1 4878 1 #f 13 4.398 4.299 4.09  4.076 4.127 4.132 4.248 4.363 4.281 4.421 4.399 4.355 4.183 13 4.259 0.108
41 ParAAM-C-S-part 6 698817 18162 1 4878 1 #f 13 3.989 3.801 3.593 3.383 3.653 4.053 3.784 3.87  3.97  3.918 3.984 4.038 3.719 13 3.827 0.159
42 ParAAM-C-S-part 7 698817 18162 1 4878 1 #f 13 3.267 3.695 3.287 3.639 3.508 3.506 3.395 3.483 3.387 3.612 3.572 3.429 3.208 13 3.461 0.122
43 ParAAM-C-S-part 8 698817 18162 1 4878 1 #f 13 3.191 3.16  3.373 3.32  3.296 3.195 3.163 3.241 3.2   3.163 3.084 3.206 3.382 13 3.229 0.072
44 ParAAM-C-state 1 698817 18162 1 4878 1 #f 13 9.33  9.195 9.2   9.196 9.367 9.506 9.28  9.26  9.437 9.314 9.321 9.31  9.271 13 9.307 0.067
45 ParAAM-C-state 2 698817 18162 1 4878 1 #f 13 5.333 5.332 5.245 5.301 5.258 5.298 5.276 5.249 5.288 5.221 5.209 5.285 5.26  13 5.273 0.031
46 ParAAM-C-state 3 698817 18162 1 4878 1 #f 13 4.03  3.92  3.866 3.963 4.011 3.995 3.906 3.935 3.972 3.978 3.978 4.048 3.971 13 3.967 0.038
47 ParAAM-C-state 4 698817 18162 1 4878 1 #f 13 3.662 3.61  3.588 3.626 3.627 3.564 3.624 3.632 3.647 3.601 3.597 3.613 3.626 13 3.617 0.019
48 ParAAM-C-state 5 698817 18162 1 4878 1 #f 13 3.877 3.759 3.807 3.8   3.816 3.769 3.799 3.728 3.732 3.748 3.71  3.651 3.642 13 3.757 0.051
49 ParAAM-C-state 6 698817 18162 1 4878 1 #f 13 3.959 3.985 3.956 4.061 3.961 3.983 3.962 4.025 3.932 4.044 3.833 3.99  4.013 13 3.977 0.04 
50 ParAAM-C-state 7 698817 18162 1 4878 1 #f 13 4.103 3.988 4.002 4.099 4.004 3.856 4.042 4.021 3.991 3.995 4.039 4.047 3.904 13 4.007 0.047
51 ParAAM-C-state 8 698817 18162 1 4878 1 #f 13 3.925 3.999 4.05  4.028 3.875 4.001 3.857 3.943 3.881 3.871 3.925 3.884 3.85  13 3.93  0.057
52 ParAAM-C-set 1 698817 18162 1 4878 1 #f 13 9.662 9.633 9.71  9.594 9.578 9.569 9.696 9.568 9.658 9.573 9.68  9.575 9.903 13 9.646 0.067
53 ParAAM-C-set 2 698817 18162 1 4878 1 #f 13 5.32  5.261 5.287 5.277 5.205 5.266 5.259 5.3   5.249 5.233 5.257 5.283 5.236 13 5.264 0.023
54 ParAAM-C-set 3 698817 18162 1 4878 1 #f 13 3.684 3.642 3.754 3.664 3.74  3.569 3.627 3.546 3.608 3.642 3.578 3.582 3.604 13 3.634 0.05 
55 ParAAM-C-set 4 698817 18162 1 4878 1 #f 13 3.491 3.139 3.086 3.07  3.15  3.142 3.102 3.145 3.07  3.152 3.151 3.137 3.041 13 3.144 0.057
56 ParAAM-C-set 5 698817 18162 1 4878 1 #f 13 3.012 2.86  2.896 2.921 2.93  2.908 2.856 2.95  2.88  2.847 2.841 2.89  2.878 13 2.898 0.036
57 ParAAM-C-set 6 698817 18162 1 4878 1 #f 13 2.639 2.681 2.681 2.69  2.671 2.67  2.647 2.672 2.683 2.622 2.616 2.67  2.641 13 2.66  0.021
58 ParAAM-C-set 7 698817 18162 1 4878 1 #f 13 2.58  2.497 2.494 2.485 2.53  2.533 2.5   2.513 2.506 2.511 2.516 2.518 2.502 13 2.514 0.016
59 ParAAM-C-set 8 698817 18162 1 4878 1 #f 13 2.618 2.556 2.531 2.585 2.563 2.574 2.605 2.571 2.523 2.606 2.562 2.576 2.583 13 2.573 0.021
60 ParAAM-C-part 1 698817 18162 1 4878 1 #f 13 15.156 15.033 15.172 15.194 14.805 14.751 14.98  14.772 14.809 15.149 14.901 15.027 14.984 13 14.979 0.132
61 ParAAM-C-part 2 698817 18162 1 4878 1 #f 13 8.337 8.438 8.311 8.356 8.388 8.361 8.386 8.388 8.476 8.394 8.354 8.45  8.411 13 8.388 0.035
62 ParAAM-C-part 3 698817 18162 1 4878 1 #f 13 5.083 5.181 5.151 5.321 5.478 5.173 5.121 5.36  5.124 5.139 5.488 5.425 5.418 13 5.266 0.137
63 ParAAM-C-part 4 698817 18162 1 4878 1 #f 13 4.141 4.15  4.046 4.119 4.035 4.037 3.972 3.994 4.125 3.811 4.038 4.021 4.042 13 4.041 0.058
64 ParAAM-C-part 5 698817 18162 1 4878 1 #f 13 3.916 4.016 3.673 3.652 3.604 3.66  3.631 3.631 3.537 3.596 3.571 3.555 3.585 13 3.664 0.094
65 ParAAM-C-part 6 698817 18162 1 4878 1 #f 13 3.296 3.386 3.286 3.271 3.36  3.336 3.331 3.421 3.316 3.344 3.415 3.474 3.321 13 3.35  0.047
66 ParAAM-C-part 7 698817 18162 1 4878 1 #f 13 3.088 3.102 3.095 2.97  3.134 2.997 3.099 3.11  3.041 3.033 3.234 3.029 3.169 13 3.085 0.054
67 ParAAM-C-part 8 698817 18162 1 4878 1 #f 13 2.787 2.743 2.853 2.909 2.882 3.063 2.972 2.85  3.009 2.949 2.913 2.955 2.873 13 2.904 0.068