BENCHMARK INFORMATION benchmark definition: ../benchexec/conditional-commutativity.nowrapper.xml name: conditional-commutativity.nowrapper run sets: NONE.Weaver-Boogie, CE-Sufficient.Weaver-Boogie, CE-NecessaryAndSufficient.Weaver-Boogie date: Mon, 2024-12-16 20:02:36 CET tool: ULTIMATE GemCutter 0.3.0-1c4755c5 tool executable: ./Ultimate.py options: --force-no-wrapper -s '${benchmark_path}/../../../trunk/examples/settings/default/gemcutter/svcomp-Reach-32bit-GemCutter_Default.epf' parallel runs: 7 resource limits: - memory: 16000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 16000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-6.8.8-4-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ NONE.Weaver-Boogie Run set 1 of 6 with options '--force-no-wrapper -s ${benchmark_path}/../../../trunk/examples/settings/default/gemcutter/svcomp-Reach-32bit-GemCutter_Default.epf --traceabstraction.commutativity.condition.synthesis NONE' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------- array-eq-symm.wvr.yml true 14.33 8.38 None array-eq-trans.wvr.yml ERROR: EXCEPTION 519.97 486.95 None clever.wvr.yml TIMEOUT 901.09 803.88 None fibonacci.wvr.yml true 15.27 8.53 None loop-tiling-eq.wvr.yml TIMEOUT 901.68 888.20 None mult-comm.wvr.yml TIMEOUT 900.91 852.72 None mult-dist.wvr.yml TIMEOUT 901.43 836.11 None mult-flipped-dist.wvr.yml true 10.30 6.35 None security.wvr.yml true 9.15 4.95 None spaghetti.wvr.yml true 9.91 5.28 None unroll-2.wvr.yml ERROR: EXCEPTION 382.00 363.51 None unroll-3.wvr.yml ERROR: EXCEPTION 405.58 376.79 None unroll-4.wvr.yml ERROR: EXCEPTION 390.38 371.94 None unroll-5.wvr.yml ERROR: EXCEPTION 809.73 769.20 None unroll-cond-2.wvr.yml ERROR: EXCEPTION 624.21 599.27 None unroll-cond-3.wvr.yml ERROR: EXCEPTION 403.21 385.72 None unroll-cond-4.wvr.yml ERROR: EXCEPTION 390.87 362.78 None unroll-cond-5.wvr.yml TIMEOUT 901.35 882.38 None bench/exp1x3.wvr.yml true 7.68 4.48 None bench/exp2x3.wvr.yml true 10.10 5.93 None bench/exp2x4.wvr.yml true 10.00 5.81 None bench/exp2x6.wvr.yml true 11.67 7.15 None bench/exp2x9.wvr.yml true 10.12 5.88 None bench/exp3x3-opt.wvr.yml true 13.46 7.49 None bench/exp3x3.wvr.yml true 41.47 30.07 None chl/array-int-subst.wvr.yml true 73.16 56.93 None chl/array-int-symm.wvr.yml true 25.98 16.82 None chl/array-int-trans.wvr.yml true 135.02 117.67 None chl/chromosome-opt-symm.wvr.yml true 23.22 14.04 None chl/chromosome-subst.wvr.yml true 37.63 25.69 None chl/chromosome-symm.wvr.yml true 20.98 12.66 None chl/chromosome-trans.wvr.yml true 46.57 31.92 None chl/collitem-subst.wvr.yml true 9.44 5.09 None chl/collitem-symm.wvr.yml true 8.55 4.66 None chl/collitem-trans.wvr.yml true 9.15 5.02 None chl/container-subst.wvr.yml true 9.54 5.13 None chl/container-symm.wvr.yml true 8.80 4.93 None chl/container-trans.wvr.yml true 9.01 4.93 None chl/exp-term-subst.wvr.yml true 8.71 4.83 None chl/exp-term-symm.wvr.yml true 7.88 4.34 None chl/file-item-subst.wvr.yml true 9.85 5.47 None chl/file-item-symm.wvr.yml true 7.60 4.21 None chl/file-item-trans.wvr.yml true 8.00 4.37 None chl/match-subst.wvr.yml true 10.32 5.57 None chl/match-symm.wvr.yml true 10.25 5.43 None chl/match-trans.wvr.yml true 10.30 5.67 None chl/name-comparator-subst.wvr.yml true 30.14 18.71 None chl/name-comparator-symm.wvr.yml true 19.64 11.70 None chl/name-comparator-trans.wvr.yml true 56.04 40.00 None chl/node-subst.wvr.yml true 9.67 5.42 None chl/node-symm.wvr.yml true 8.43 4.61 None chl/node-trans.wvr.yml true 9.04 5.10 None chl/nzb-file-subst.wvr.yml true 64.37 46.23 None chl/nzb-file-symm.wvr.yml true 28.68 18.52 None chl/nzb-file-trans.wvr.yml true 59.95 43.29 None chl/poker-hand-subst.wvr.yml true 201.51 171.18 None chl/poker-hand-symm.wvr.yml true 40.41 26.00 None chl/poker-hand-trans.wvr.yml true 76.68 55.19 None chl/simpl-str-subst.wvr.yml true 7.59 4.20 None chl/simpl-str-symm.wvr.yml true 10.31 5.53 None chl/simpl-str-trans.wvr.yml true 7.68 4.45 None chl/sre-subst.wvr.yml true 11.03 5.86 None chl/sre-symm.wvr.yml true 7.13 3.96 None chl/sre-trans.wvr.yml true 7.98 4.47 None chl/time-subst.wvr.yml true 10.79 5.76 None chl/time-symm.wvr.yml true 6.90 3.83 None chl/time-trans.wvr.yml true 10.30 5.54 None chl/word-subst.wvr.yml true 48.50 33.29 None chl/word-symm.wvr.yml true 20.46 11.90 None chl/word-trans.wvr.yml true 77.91 51.14 None parallel/bakery-2.wvr.yml true 9.74 5.25 None parallel/bakery-3.wvr.yml true 12.04 6.39 None parallel/bakery-4.wvr.yml true 18.01 9.75 None parallel/barrier-loop.wvr.yml true 10.38 5.52 None parallel/barrier.wvr.yml true 10.85 5.81 None parallel/bluetooth.wvr.yml true 7.60 4.34 None parallel/lamport.wvr.yml true 7.19 4.13 None parallel/min-max-1.wvr.yml true 11.22 5.95 None parallel/min-max-2.wvr.yml ERROR: EXCEPTION 481.54 452.94 None parallel/misc-1.wvr.yml true 20.86 12.16 None parallel/misc-2-unrolled-atomic.wvr.yml true 10.71 5.87 None parallel/misc-2-unrolled.wvr.yml true 6.24 3.52 None parallel/misc-2.wvr.yml true 10.94 6.62 None parallel/misc-3-extended.wvr.yml true 37.80 23.46 None parallel/misc-3.wvr.yml true 9.91 6.32 None parallel/misc-4.wvr.yml true 10.36 5.95 None parallel/misc-5.wvr.yml OUT OF MEMORY 496.64 445.69 None parallel/parallel-sum-1-dsl.wvr.yml TIMEOUT 901.56 863.50 None parallel/parallel-sum-1.wvr.yml TIMEOUT 901.96 827.51 None parallel/parallel-sum-2.wvr.yml TIMEOUT 900.92 810.13 None parallel/parallel-sum-equiv.wvr.yml TIMEOUT 901.67 854.93 None parallel/simple-equiv.wvr.yml true 6.66 3.74 None parallel/ticket-2.wvr.yml true 7.07 3.93 None parallel/ticket-3.wvr.yml true 8.23 4.50 None parallel/ticket-4.wvr.yml true 8.95 4.86 None parallel/ticket-5.wvr.yml true 10.77 5.79 None parallel/ticket-6.wvr.yml true 11.70 6.31 None parallel/ticket-7.wvr.yml true 14.97 8.11 None parallel/ticket-8.wvr.yml true 20.47 10.79 None popl20/channel-sum.wvr.yml TIMEOUT 901.78 857.77 None popl20/commit-1.wvr.yml true 16.03 8.88 None popl20/commit-2.wvr.yml true 26.01 14.82 None popl20/counter-determinism.wvr.yml TIMEOUT 901.56 832.96 None popl20/counter-fun.wvr.yml ERROR: EXCEPTION 395.21 366.04 None popl20/difference-det.wvr.yml TIMEOUT 901.36 793.45 None popl20/figure1-alt.wvr.yml true 47.85 31.94 None popl20/figure1.wvr.yml TIMEOUT 901.09 815.30 None popl20/figure3.wvr.yml TIMEOUT 901.42 792.25 None popl20/horseshoe.wvr.yml TIMEOUT 901.11 873.81 None popl20/min-max-dec.wvr.yml OUT OF MEMORY 268.29 227.78 None popl20/min-max-inc-dec.wvr.yml ERROR: EXCEPTION 238.26 216.57 None popl20/min-max-inc.wvr.yml TIMEOUT 901.67 870.27 None popl20/mult-4.wvr.yml TIMEOUT 901.27 837.46 None popl20/mult-equiv.wvr.yml TIMEOUT 900.73 819.20 None popl20/nonblocking-cntr-alt.wvr.yml true 30.78 18.17 None popl20/nonblocking-cntr.wvr.yml TIMEOUT 900.70 807.15 None popl20/prod-cons-eq.wvr.yml ERROR: EXCEPTION 136.53 121.12 None popl20/prod-cons.wvr.yml TIMEOUT 901.70 857.78 None popl20/prod-cons3.wvr.yml ERROR: EXCEPTION 573.95 538.69 None popl20/queue-add-2.wvr.yml TIMEOUT 900.89 796.00 None popl20/queue-add-3.wvr.yml TIMEOUT 901.55 843.91 None popl20/send-receive-alt.wvr.yml ERROR: EXCEPTION 844.80 805.51 None popl20/send-receive.wvr.yml TIMEOUT 901.64 833.91 None popl20/simple-array-sum.wvr.yml OUT OF MEMORY 734.54 545.38 None popl20/simple-queue.wvr.yml true 14.57 8.71 None popl20/threaded-sum-3.wvr.yml TIMEOUT 900.78 798.82 None popl20/three-array-max.wvr.yml TIMEOUT 905.46 891.20 None popl20/three-array-min.wvr.yml TIMEOUT 905.52 882.20 None popl20/three-array-sum.wvr.yml OUT OF MEMORY 418.41 338.34 None popl20/two-queue.wvr.yml true 25.39 15.90 None popl20-bad/bad-commit-1.wvr.yml true 18.27 9.76 None popl20-bad/bad-commit-2.wvr.yml true 31.21 19.21 None popl20-bad/bad-dot-product.wvr.yml TIMEOUT 901.64 853.80 None popl20-bad/buffer-mult-alt.wvr.yml ERROR: EXCEPTION 883.63 847.50 None popl20-bad/counter-queue.wvr.yml true 15.37 9.00 None popl20-bad/dot-product-alt.wvr.yml ERROR: EXCEPTION 142.19 128.61 None popl20-bad/ring-nondet.wvr.yml ERROR: EXCEPTION 373.07 338.98 None popl20-bad/ring.wvr.yml true 55.87 42.32 None popl20-bad/threaded-sum-2.wvr.yml true 20.91 13.82 None popl20-bad/three-array-sum-alt.wvr.yml true 12.78 8.00 None popl20-more/array-sum-alt.wvr.yml TIMEOUT 901.12 864.50 None popl20-more/array-sum.wvr.yml TIMEOUT 900.86 796.52 None popl20-more/buffer-mult.wvr.yml ERROR: EXCEPTION 318.72 282.56 None popl20-more/buffer-series-array.wvr.yml TIMEOUT 901.70 832.59 None popl20-more/buffer-series.wvr.yml TIMEOUT 901.70 853.98 None popl20-more/dec-subseq-array.wvr.yml true 17.25 9.96 None popl20-more/dec-subseq.wvr.yml true 17.00 9.91 None popl20-more/dot-product-array.wvr.yml ERROR: EXCEPTION 145.72 129.16 None popl20-more/dot-product.wvr.yml ERROR: EXCEPTION 143.69 127.09 None popl20-more/inc-subseq-array.wvr.yml true 18.86 10.68 None popl20-more/inc-subseq.wvr.yml true 18.02 10.46 None popl20-more/max-array-hom.wvr.yml ERROR: EXCEPTION 205.63 186.94 None popl20-more/max-array.wvr.yml TIMEOUT 901.51 873.44 None popl20-more/max-fun-alt.wvr.yml TIMEOUT 901.42 874.41 None popl20-more/max-fun.wvr.yml ERROR: EXCEPTION 224.38 195.54 None popl20-more/min-array-hom.wvr.yml ERROR: EXCEPTION 358.04 336.10 None popl20-more/min-array.wvr.yml TIMEOUT 900.78 879.06 None popl20-more/min-fun-alt.wvr.yml TIMEOUT 900.82 870.15 None popl20-more/min-fun.wvr.yml ERROR: EXCEPTION 380.50 349.20 None popl20-more/min-le-max.wvr.yml true 9.20 5.16 None popl20-more/mts-array.wvr.yml TIMEOUT 901.21 878.69 None popl20-more/mts.wvr.yml TIMEOUT 900.75 877.12 None popl20-more/multiply-verify.wvr.yml true 13.43 7.28 None popl20-more/nonblocking-counter-alt2.wvr.yml TIMEOUT 901.45 826.68 None popl20-more/parray-copy.wvr.yml TIMEOUT 900.89 882.61 None popl20-more/queue-add-2-nl.wvr.yml TIMEOUT 900.42 823.60 None popl20-more/queue-add-3-nl.wvr.yml TIMEOUT 901.35 860.76 None popl20-more/sorted.wvr.yml ERROR: EXCEPTION 600.90 568.25 None popl20-more/sum-array-hom.wvr.yml ERROR: EXCEPTION 510.44 486.71 None popl20-more/sum-array.wvr.yml ERROR: EXCEPTION 667.29 641.48 None popl20-more/sum-fun-alt.wvr.yml ERROR: EXCEPTION 794.94 755.26 None popl20-more/sum-fun.wvr.yml ERROR: EXCEPTION 531.99 507.54 None popl20-more/vector-add.wvr.yml TIMEOUT 901.42 853.98 None popl20-proofs/counter-add-4-semi-Q67.wvr.yml TIMEOUT 900.77 822.40 None test/context1.wvr.yml TIMEOUT 901.27 834.23 None test/easy1.wvr.yml true 8.17 4.84 None test/easy10.wvr.yml true 7.65 4.39 None test/easy11.wvr.yml true 10.96 6.47 None test/easy6.wvr.yml true 7.65 4.32 None test/easy7.wvr.yml true 6.92 3.96 None test/easy8.wvr.yml true 6.98 3.93 None test/hard1.wvr.yml TIMEOUT 901.24 858.62 None test/semi1.wvr.yml true 6.39 3.53 None ------------------------------------------------------------------------------------------------------------- Run set 1 done 57593.68 7954.19 - CE-Sufficient.Weaver-Boogie Run set 2 of 6 with options '--force-no-wrapper -s ${benchmark_path}/../../../trunk/examples/settings/default/gemcutter/svcomp-Reach-32bit-GemCutter_Default.epf --traceabstraction.commutativity.condition.synthesis SUFFICIENT' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------- array-eq-symm.wvr.yml true 14.29 8.34 None array-eq-trans.wvr.yml ERROR: EXCEPTION 520.97 485.98 None clever.wvr.yml TIMEOUT 901.01 803.32 None fibonacci.wvr.yml true 14.80 8.22 None loop-tiling-eq.wvr.yml TIMEOUT 901.66 891.22 None mult-comm.wvr.yml TIMEOUT 900.98 852.24 None mult-dist.wvr.yml TIMEOUT 901.61 834.16 None mult-flipped-dist.wvr.yml true 13.82 8.11 None security.wvr.yml true 6.60 3.63 None spaghetti.wvr.yml true 7.15 4.02 None unroll-2.wvr.yml ERROR: EXCEPTION 384.04 365.47 None unroll-3.wvr.yml ERROR: EXCEPTION 397.63 368.87 None unroll-4.wvr.yml ERROR: EXCEPTION 369.74 350.95 None unroll-5.wvr.yml ERROR: EXCEPTION 853.55 814.33 None unroll-cond-2.wvr.yml ERROR: EXCEPTION 382.45 363.90 None unroll-cond-3.wvr.yml ERROR: EXCEPTION 416.60 398.41 None unroll-cond-4.wvr.yml ERROR: EXCEPTION 383.20 356.43 None unroll-cond-5.wvr.yml TIMEOUT 901.44 881.96 None bench/exp1x3.wvr.yml true 7.40 4.38 None bench/exp2x3.wvr.yml true 10.23 5.86 None bench/exp2x4.wvr.yml true 9.77 5.68 None bench/exp2x6.wvr.yml true 11.66 7.12 None bench/exp2x9.wvr.yml true 9.93 5.80 None bench/exp3x3-opt.wvr.yml true 13.19 7.32 None bench/exp3x3.wvr.yml true 38.60 27.83 None chl/array-int-subst.wvr.yml true 72.01 55.51 None chl/array-int-symm.wvr.yml true 25.19 16.30 None chl/array-int-trans.wvr.yml true 127.61 107.82 None chl/chromosome-opt-symm.wvr.yml true 22.95 14.19 None chl/chromosome-subst.wvr.yml true 39.50 27.32 None chl/chromosome-symm.wvr.yml true 20.19 12.62 None chl/chromosome-trans.wvr.yml true 44.79 31.05 None chl/collitem-subst.wvr.yml true 9.99 5.43 None chl/collitem-symm.wvr.yml true 8.77 4.88 None chl/collitem-trans.wvr.yml true 9.17 5.16 None chl/container-subst.wvr.yml true 9.51 5.21 None chl/container-symm.wvr.yml true 8.94 4.96 None chl/container-trans.wvr.yml true 9.33 5.03 None chl/exp-term-subst.wvr.yml true 8.70 4.84 None chl/exp-term-symm.wvr.yml true 7.95 4.38 None chl/file-item-subst.wvr.yml true 9.61 5.23 None chl/file-item-symm.wvr.yml true 7.99 4.41 None chl/file-item-trans.wvr.yml true 8.40 4.68 None chl/match-subst.wvr.yml true 10.78 5.77 None chl/match-symm.wvr.yml true 11.03 5.94 None chl/match-trans.wvr.yml true 11.12 5.84 None chl/name-comparator-subst.wvr.yml true 30.83 19.74 None chl/name-comparator-symm.wvr.yml true 19.39 11.28 None chl/name-comparator-trans.wvr.yml true 56.26 40.35 None chl/node-subst.wvr.yml true 9.53 5.14 None chl/node-symm.wvr.yml true 8.89 4.88 None chl/node-trans.wvr.yml true 8.97 5.09 None chl/nzb-file-subst.wvr.yml true 65.04 47.23 None chl/nzb-file-symm.wvr.yml true 29.91 18.66 None chl/nzb-file-trans.wvr.yml true 60.82 44.35 None chl/poker-hand-subst.wvr.yml true 205.14 173.13 None chl/poker-hand-symm.wvr.yml true 40.81 26.76 None chl/poker-hand-trans.wvr.yml true 77.81 59.81 None chl/simpl-str-subst.wvr.yml true 8.43 4.65 None chl/simpl-str-symm.wvr.yml true 7.51 4.16 None chl/simpl-str-trans.wvr.yml true 7.78 4.24 None chl/sre-subst.wvr.yml true 8.21 4.50 None chl/sre-symm.wvr.yml true 7.75 4.27 None chl/sre-trans.wvr.yml true 7.70 4.17 None chl/time-subst.wvr.yml true 7.82 4.27 None chl/time-symm.wvr.yml true 7.27 4.00 None chl/time-trans.wvr.yml true 7.38 4.10 None chl/word-subst.wvr.yml true 51.27 35.42 None chl/word-symm.wvr.yml true 19.26 11.11 None chl/word-trans.wvr.yml true 59.00 43.09 None parallel/bakery-2.wvr.yml true 6.90 3.83 None parallel/bakery-3.wvr.yml true 8.04 4.40 None parallel/bakery-4.wvr.yml true 16.30 8.73 None parallel/barrier-loop.wvr.yml true 9.98 5.37 None parallel/barrier.wvr.yml true 8.03 4.38 None parallel/bluetooth.wvr.yml true 9.71 5.21 None parallel/lamport.wvr.yml true 7.38 4.08 None parallel/min-max-1.wvr.yml true 8.15 4.45 None parallel/min-max-2.wvr.yml ERROR: EXCEPTION 278.94 246.35 None parallel/misc-1.wvr.yml true 20.77 11.83 None parallel/misc-2-unrolled-atomic.wvr.yml true 7.63 4.39 None parallel/misc-2-unrolled.wvr.yml true 6.45 3.54 None parallel/misc-2.wvr.yml true 11.38 6.67 None parallel/misc-3-extended.wvr.yml true 29.04 18.88 None parallel/misc-3.wvr.yml true 9.80 6.15 None parallel/misc-4.wvr.yml true 10.87 6.31 None parallel/misc-5.wvr.yml OUT OF MEMORY 800.30 726.72 None parallel/parallel-sum-1-dsl.wvr.yml TIMEOUT 901.54 869.15 None parallel/parallel-sum-1.wvr.yml TIMEOUT 901.47 824.76 None parallel/parallel-sum-2.wvr.yml TIMEOUT 901.90 839.75 None parallel/parallel-sum-equiv.wvr.yml TIMEOUT 902.61 856.02 None parallel/simple-equiv.wvr.yml true 9.10 4.90 None parallel/ticket-2.wvr.yml true 9.93 5.22 None parallel/ticket-3.wvr.yml true 10.86 5.74 None parallel/ticket-4.wvr.yml true 11.88 6.31 None parallel/ticket-5.wvr.yml true 14.19 7.38 None parallel/ticket-6.wvr.yml true 16.11 8.40 None parallel/ticket-7.wvr.yml true 19.79 10.28 None parallel/ticket-8.wvr.yml true 28.24 14.52 None popl20/channel-sum.wvr.yml TIMEOUT 901.32 816.94 None popl20/commit-1.wvr.yml true 16.43 8.97 None popl20/commit-2.wvr.yml true 25.01 14.26 None popl20/counter-determinism.wvr.yml true 714.15 643.42 None popl20/counter-fun.wvr.yml ERROR: EXCEPTION 457.95 428.06 None popl20/difference-det.wvr.yml true 71.97 47.31 None popl20/figure1-alt.wvr.yml true 25.96 16.76 None popl20/figure1.wvr.yml true 9.79 5.72 None popl20/figure3.wvr.yml TIMEOUT 901.25 872.12 None popl20/horseshoe.wvr.yml TIMEOUT 901.14 872.48 None popl20/min-max-dec.wvr.yml OUT OF MEMORY 257.02 220.62 None popl20/min-max-inc-dec.wvr.yml ERROR: EXCEPTION 258.92 227.37 None popl20/min-max-inc.wvr.yml true 28.20 15.81 None popl20/mult-4.wvr.yml TIMEOUT 900.89 800.51 None popl20/mult-equiv.wvr.yml TIMEOUT 901.29 794.58 None popl20/nonblocking-cntr-alt.wvr.yml true 24.01 15.18 None popl20/nonblocking-cntr.wvr.yml true 37.21 25.36 None popl20/prod-cons-eq.wvr.yml TIMEOUT 901.23 874.59 None popl20/prod-cons.wvr.yml TIMEOUT 901.08 859.55 None popl20/prod-cons3.wvr.yml ERROR: EXCEPTION 573.77 537.65 None popl20/queue-add-2.wvr.yml true 29.98 19.57 None popl20/queue-add-3.wvr.yml true 140.33 120.68 None popl20/send-receive-alt.wvr.yml ERROR: EXCEPTION 837.15 783.23 None popl20/send-receive.wvr.yml TIMEOUT 901.99 836.32 None popl20/simple-array-sum.wvr.yml OUT OF MEMORY 663.56 529.21 None popl20/simple-queue.wvr.yml true 15.24 9.17 None popl20/threaded-sum-3.wvr.yml TIMEOUT 900.79 802.96 None popl20/three-array-max.wvr.yml TIMEOUT 905.51 883.80 None popl20/three-array-min.wvr.yml TIMEOUT 905.49 890.12 None popl20/three-array-sum.wvr.yml OUT OF MEMORY 624.05 451.51 None popl20/two-queue.wvr.yml true 23.91 15.22 None popl20-bad/bad-commit-1.wvr.yml true 19.63 10.96 None popl20-bad/bad-commit-2.wvr.yml true 32.06 20.02 None popl20-bad/bad-dot-product.wvr.yml TIMEOUT 901.41 864.79 None popl20-bad/buffer-mult-alt.wvr.yml ERROR: EXCEPTION 879.75 843.27 None popl20-bad/counter-queue.wvr.yml true 14.62 8.45 None popl20-bad/dot-product-alt.wvr.yml ERROR: EXCEPTION 141.04 126.29 None popl20-bad/ring-nondet.wvr.yml ERROR: EXCEPTION 373.98 339.07 None popl20-bad/ring.wvr.yml true 55.94 40.97 None popl20-bad/threaded-sum-2.wvr.yml true 21.15 13.55 None popl20-bad/three-array-sum-alt.wvr.yml true 16.51 9.58 None popl20-more/array-sum-alt.wvr.yml TIMEOUT 901.14 795.96 None popl20-more/array-sum.wvr.yml TIMEOUT 900.56 826.20 None popl20-more/buffer-mult.wvr.yml ERROR: EXCEPTION 381.00 325.36 None popl20-more/buffer-series-array.wvr.yml TIMEOUT 901.57 853.03 None popl20-more/buffer-series.wvr.yml TIMEOUT 901.68 853.67 None popl20-more/dec-subseq-array.wvr.yml true 23.89 13.19 None popl20-more/dec-subseq.wvr.yml true 23.55 12.99 None popl20-more/dot-product-array.wvr.yml ERROR: EXCEPTION 294.30 264.47 None popl20-more/dot-product.wvr.yml ERROR: EXCEPTION 272.97 254.57 None popl20-more/inc-subseq-array.wvr.yml true 17.86 10.33 None popl20-more/inc-subseq.wvr.yml true 17.82 10.26 None popl20-more/max-array-hom.wvr.yml ERROR: EXCEPTION 200.50 180.80 None popl20-more/max-array.wvr.yml TIMEOUT 901.77 862.48 None popl20-more/max-fun-alt.wvr.yml TIMEOUT 901.75 865.35 None popl20-more/max-fun.wvr.yml ERROR: EXCEPTION 204.97 184.85 None popl20-more/min-array-hom.wvr.yml ERROR: EXCEPTION 364.55 341.75 None popl20-more/min-array.wvr.yml TIMEOUT 900.84 879.74 None popl20-more/min-fun-alt.wvr.yml TIMEOUT 900.75 878.25 None popl20-more/min-fun.wvr.yml ERROR: EXCEPTION 353.69 331.40 None popl20-more/min-le-max.wvr.yml true 8.99 5.03 None popl20-more/mts-array.wvr.yml TIMEOUT 901.20 877.99 None popl20-more/mts.wvr.yml TIMEOUT 901.26 877.75 None popl20-more/multiply-verify.wvr.yml true 10.32 5.77 None popl20-more/nonblocking-counter-alt2.wvr.yml TIMEOUT 901.23 846.97 None popl20-more/parray-copy.wvr.yml TIMEOUT 901.93 873.71 None popl20-more/queue-add-2-nl.wvr.yml true 53.88 34.78 None popl20-more/queue-add-3-nl.wvr.yml true 215.04 176.19 None popl20-more/sorted.wvr.yml ERROR: EXCEPTION 597.73 578.81 None popl20-more/sum-array-hom.wvr.yml ERROR: EXCEPTION 547.37 523.75 None popl20-more/sum-array.wvr.yml ERROR: EXCEPTION 690.44 650.36 None popl20-more/sum-fun-alt.wvr.yml ERROR: EXCEPTION 599.55 574.38 None popl20-more/sum-fun.wvr.yml ERROR: EXCEPTION 569.02 544.30 None popl20-more/vector-add.wvr.yml TIMEOUT 901.29 869.49 None popl20-proofs/counter-add-4-semi-Q67.wvr.yml true 29.34 17.99 None test/context1.wvr.yml true 8.84 5.53 None test/easy1.wvr.yml true 7.48 4.67 None test/easy10.wvr.yml true 7.77 4.50 None test/easy11.wvr.yml true 10.82 6.41 None test/easy6.wvr.yml true 6.84 4.03 None test/easy7.wvr.yml true 6.54 3.73 None test/easy8.wvr.yml true 6.27 3.58 None test/hard1.wvr.yml TIMEOUT 906.56 863.45 None test/semi1.wvr.yml true 8.53 4.71 None ------------------------------------------------------------------------------------------------------------- Run set 2 done 50025.02 7133.17 - CE-SufficientWithContext.Weaver-Boogie Run set 3 of 6: skipped CE-NecessaryAndSufficient.Weaver-Boogie Run set 4 of 6 with options '--force-no-wrapper -s ${benchmark_path}/../../../trunk/examples/settings/default/gemcutter/svcomp-Reach-32bit-GemCutter_Default.epf --traceabstraction.commutativity.condition.synthesis NECESSARY_AND_SUFFICIENT' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------- array-eq-symm.wvr.yml true 14.46 8.46 None array-eq-trans.wvr.yml ERROR: EXCEPTION 519.31 485.73 None clever.wvr.yml TIMEOUT 900.88 800.77 None fibonacci.wvr.yml true 15.44 8.53 None loop-tiling-eq.wvr.yml TIMEOUT 900.78 884.63 None mult-comm.wvr.yml TIMEOUT 900.93 852.36 None mult-dist.wvr.yml TIMEOUT 901.57 836.41 None mult-flipped-dist.wvr.yml true 10.10 6.29 None security.wvr.yml true 9.55 5.12 None spaghetti.wvr.yml true 10.14 5.43 None unroll-2.wvr.yml ERROR: EXCEPTION 386.74 368.65 None unroll-3.wvr.yml ERROR: EXCEPTION 398.75 369.78 None unroll-4.wvr.yml ERROR: EXCEPTION 394.08 375.68 None unroll-5.wvr.yml ERROR: EXCEPTION 796.59 755.54 None unroll-cond-2.wvr.yml ERROR: EXCEPTION 609.06 583.89 None unroll-cond-3.wvr.yml ERROR: EXCEPTION 405.61 388.44 None unroll-cond-4.wvr.yml ERROR: EXCEPTION 402.91 374.99 None unroll-cond-5.wvr.yml TIMEOUT 901.28 882.52 None bench/exp1x3.wvr.yml true 8.04 4.69 None bench/exp2x3.wvr.yml true 11.15 6.32 None bench/exp2x4.wvr.yml true 9.92 5.75 None bench/exp2x6.wvr.yml true 11.34 7.02 None bench/exp2x9.wvr.yml true 9.69 5.66 None bench/exp3x3-opt.wvr.yml true 13.07 7.34 None bench/exp3x3.wvr.yml true 41.74 29.81 None chl/array-int-subst.wvr.yml true 71.36 55.53 None chl/array-int-symm.wvr.yml true 25.26 16.61 None chl/array-int-trans.wvr.yml true 135.72 117.82 None chl/chromosome-opt-symm.wvr.yml true 23.29 13.77 None chl/chromosome-subst.wvr.yml true 36.69 25.02 None chl/chromosome-symm.wvr.yml true 20.37 12.77 None chl/chromosome-trans.wvr.yml true 45.90 32.07 None chl/collitem-subst.wvr.yml true 9.70 5.27 None chl/collitem-symm.wvr.yml true 8.40 4.60 None chl/collitem-trans.wvr.yml true 9.23 4.97 None chl/container-subst.wvr.yml true 9.63 5.24 None chl/container-symm.wvr.yml true 8.67 4.90 None chl/container-trans.wvr.yml true 9.52 5.23 None chl/exp-term-subst.wvr.yml true 9.10 5.13 None chl/exp-term-symm.wvr.yml true 7.98 4.40 None chl/file-item-subst.wvr.yml true 9.92 5.47 None chl/file-item-symm.wvr.yml true 8.48 4.67 None chl/file-item-trans.wvr.yml true 8.50 4.76 None chl/match-subst.wvr.yml true 10.43 5.57 None chl/match-symm.wvr.yml true 10.35 5.46 None chl/match-trans.wvr.yml true 10.62 5.72 None chl/name-comparator-subst.wvr.yml true 31.29 19.21 None chl/name-comparator-symm.wvr.yml true 18.97 11.10 None chl/name-comparator-trans.wvr.yml true 60.77 44.42 None chl/node-subst.wvr.yml true 9.38 5.10 None chl/node-symm.wvr.yml true 9.16 4.95 None chl/node-trans.wvr.yml true 8.94 4.84 None chl/nzb-file-subst.wvr.yml true 67.37 48.57 None chl/nzb-file-symm.wvr.yml true 29.44 18.35 None chl/nzb-file-trans.wvr.yml true 60.13 41.99 None chl/poker-hand-subst.wvr.yml true 216.08 193.90 None chl/poker-hand-symm.wvr.yml true 58.36 35.52 None chl/poker-hand-trans.wvr.yml true 78.41 57.02 None chl/simpl-str-subst.wvr.yml true 8.37 4.56 None chl/simpl-str-symm.wvr.yml true 7.77 4.29 None chl/simpl-str-trans.wvr.yml true 7.55 4.21 None chl/sre-subst.wvr.yml true 8.38 4.56 None chl/sre-symm.wvr.yml true 7.65 4.20 None chl/sre-trans.wvr.yml true 7.57 4.13 None chl/time-subst.wvr.yml true 8.06 4.42 None chl/time-symm.wvr.yml true 7.28 4.03 None chl/time-trans.wvr.yml true 7.45 4.11 None chl/word-subst.wvr.yml true 50.73 35.74 None chl/word-symm.wvr.yml true 20.47 11.69 None chl/word-trans.wvr.yml true 76.99 50.99 None parallel/bakery-2.wvr.yml true 10.02 5.40 None parallel/bakery-3.wvr.yml true 11.96 6.36 None parallel/bakery-4.wvr.yml true 17.50 9.38 None parallel/barrier-loop.wvr.yml true 10.40 5.61 None parallel/barrier.wvr.yml true 7.87 4.36 None parallel/bluetooth.wvr.yml true 10.41 5.49 None parallel/lamport.wvr.yml true 6.97 3.90 None parallel/min-max-1.wvr.yml true 8.67 4.76 None parallel/min-max-2.wvr.yml ERROR: EXCEPTION 528.47 488.69 None parallel/misc-1.wvr.yml true 20.02 11.23 None parallel/misc-2-unrolled-atomic.wvr.yml true 7.87 4.56 None parallel/misc-2-unrolled.wvr.yml true 7.00 3.93 None parallel/misc-2.wvr.yml true 11.70 6.97 None parallel/misc-3-extended.wvr.yml true 29.21 19.06 None parallel/misc-3.wvr.yml true 9.62 6.07 None parallel/misc-4.wvr.yml true 10.70 6.06 None parallel/misc-5.wvr.yml OUT OF MEMORY 809.72 738.64 None parallel/parallel-sum-1-dsl.wvr.yml TIMEOUT 901.00 867.81 None parallel/parallel-sum-1.wvr.yml TIMEOUT 901.96 828.75 None parallel/parallel-sum-2.wvr.yml TIMEOUT 901.81 842.04 None parallel/parallel-sum-equiv.wvr.yml TIMEOUT 901.86 864.55 None parallel/simple-equiv.wvr.yml true 9.74 5.39 None parallel/ticket-2.wvr.yml true 10.01 5.27 None parallel/ticket-3.wvr.yml true 10.80 5.71 None parallel/ticket-4.wvr.yml true 11.73 6.23 None parallel/ticket-5.wvr.yml true 14.20 7.44 None parallel/ticket-6.wvr.yml true 11.82 6.31 None parallel/ticket-7.wvr.yml true 20.95 10.85 None parallel/ticket-8.wvr.yml true 20.69 10.73 None popl20/channel-sum.wvr.yml TIMEOUT 901.35 816.04 None popl20/commit-1.wvr.yml true 15.85 8.79 None popl20/commit-2.wvr.yml true 24.54 14.17 None popl20/counter-determinism.wvr.yml true 747.11 670.47 None popl20/counter-fun.wvr.yml true 156.81 135.24 None popl20/difference-det.wvr.yml true 74.53 48.10 None popl20/figure1-alt.wvr.yml true 25.27 16.41 None popl20/figure1.wvr.yml true 9.84 5.66 None popl20/figure3.wvr.yml TIMEOUT 900.92 815.13 None popl20/horseshoe.wvr.yml TIMEOUT 901.17 871.84 None popl20/min-max-dec.wvr.yml OUT OF MEMORY 268.46 231.51 None popl20/min-max-inc-dec.wvr.yml ERROR: EXCEPTION 258.71 226.76 None popl20/min-max-inc.wvr.yml true 27.45 15.98 None popl20/mult-4.wvr.yml TIMEOUT 901.20 852.07 None popl20/mult-equiv.wvr.yml TIMEOUT 900.67 821.56 None popl20/nonblocking-cntr-alt.wvr.yml true 31.08 18.38 None popl20/nonblocking-cntr.wvr.yml true 46.62 30.74 None popl20/prod-cons-eq.wvr.yml ERROR: EXCEPTION 213.35 197.36 None popl20/prod-cons.wvr.yml true 515.31 485.98 None popl20/prod-cons3.wvr.yml TIMEOUT 901.97 839.18 None popl20/queue-add-2.wvr.yml true 25.47 14.79 None popl20/queue-add-3.wvr.yml true 169.23 134.10 None popl20/send-receive-alt.wvr.yml TIMEOUT 901.35 820.67 None popl20/send-receive.wvr.yml TIMEOUT 902.13 832.04 None popl20/simple-array-sum.wvr.yml OUT OF MEMORY 748.50 565.16 None popl20/simple-queue.wvr.yml true 9.12 5.79 None popl20/threaded-sum-3.wvr.yml TIMEOUT 901.34 832.07 None popl20/three-array-max.wvr.yml TIMEOUT 905.48 889.90 None popl20/three-array-min.wvr.yml TIMEOUT 905.49 890.71 None popl20/three-array-sum.wvr.yml OUT OF MEMORY 537.30 405.91 None popl20/two-queue.wvr.yml true 23.87 14.86 None popl20-bad/bad-commit-1.wvr.yml true 18.00 9.90 None popl20-bad/bad-commit-2.wvr.yml true 30.66 18.37 None popl20-bad/bad-dot-product.wvr.yml TIMEOUT 901.70 853.41 None popl20-bad/buffer-mult-alt.wvr.yml TIMEOUT 901.89 850.40 None popl20-bad/counter-queue.wvr.yml true 14.98 8.49 None popl20-bad/dot-product-alt.wvr.yml ERROR: EXCEPTION 141.74 127.84 None popl20-bad/ring-nondet.wvr.yml ERROR: EXCEPTION 444.68 391.44 None popl20-bad/ring.wvr.yml true 57.69 41.99 None popl20-bad/threaded-sum-2.wvr.yml true 21.89 13.94 None popl20-bad/three-array-sum-alt.wvr.yml true 12.83 7.84 None popl20-more/array-sum-alt.wvr.yml TIMEOUT 901.59 821.08 None popl20-more/array-sum.wvr.yml TIMEOUT 900.63 824.76 None popl20-more/buffer-mult.wvr.yml ERROR: EXCEPTION 346.78 312.87 None popl20-more/buffer-series-array.wvr.yml TIMEOUT 901.17 852.38 None popl20-more/buffer-series.wvr.yml TIMEOUT 901.88 830.57 None popl20-more/dec-subseq-array.wvr.yml true 18.61 11.07 None popl20-more/dec-subseq.wvr.yml true 18.37 10.97 None popl20-more/dot-product-array.wvr.yml ERROR: EXCEPTION 276.15 257.98 None popl20-more/dot-product.wvr.yml ERROR: EXCEPTION 148.15 131.03 None popl20-more/inc-subseq-array.wvr.yml true 25.18 13.68 None popl20-more/inc-subseq.wvr.yml true 24.79 13.59 None popl20-more/max-array-hom.wvr.yml ERROR: EXCEPTION 225.88 197.55 None popl20-more/max-array.wvr.yml TIMEOUT 901.45 875.37 None popl20-more/max-fun-alt.wvr.yml TIMEOUT 901.62 877.35 None popl20-more/max-fun.wvr.yml ERROR: EXCEPTION 222.86 194.38 None popl20-more/min-array-hom.wvr.yml ERROR: EXCEPTION 369.03 345.59 None popl20-more/min-array.wvr.yml TIMEOUT 900.76 878.18 None popl20-more/min-fun-alt.wvr.yml TIMEOUT 900.80 869.63 None popl20-more/min-fun.wvr.yml ERROR: EXCEPTION 358.67 336.86 None popl20-more/min-le-max.wvr.yml true 12.39 6.73 None popl20-more/mts-array.wvr.yml TIMEOUT 901.54 869.09 None popl20-more/mts.wvr.yml TIMEOUT 901.32 877.15 None popl20-more/multiply-verify.wvr.yml true 10.27 5.74 None popl20-more/nonblocking-counter-alt2.wvr.yml TIMEOUT 901.42 845.70 None popl20-more/parray-copy.wvr.yml TIMEOUT 901.02 883.07 None popl20-more/queue-add-2-nl.wvr.yml true 29.51 20.22 None popl20-more/queue-add-3-nl.wvr.yml true 184.55 166.48 None popl20-more/sorted.wvr.yml ERROR: EXCEPTION 571.75 548.47 None popl20-more/sum-array-hom.wvr.yml ERROR: EXCEPTION 551.07 531.65 None popl20-more/sum-array.wvr.yml ERROR: EXCEPTION 668.85 631.00 None popl20-more/sum-fun-alt.wvr.yml ERROR: EXCEPTION 703.17 665.94 None popl20-more/sum-fun.wvr.yml ERROR: EXCEPTION 537.56 513.68 None popl20-more/vector-add.wvr.yml TIMEOUT 901.33 869.11 None popl20-proofs/counter-add-4-semi-Q67.wvr.yml true 29.74 18.24 None test/context1.wvr.yml true 9.08 5.48 None test/easy1.wvr.yml true 7.90 4.56 None test/easy10.wvr.yml true 7.27 4.05 None test/easy11.wvr.yml true 10.38 6.03 None test/easy6.wvr.yml true 7.13 4.14 None test/easy7.wvr.yml true 6.81 3.80 None test/easy8.wvr.yml true 6.60 4.00 None test/hard1.wvr.yml TIMEOUT 900.91 817.64 None test/semi1.wvr.yml true 6.87 3.96 None ------------------------------------------------------------------------------------------------------------- Run set 4 done 49587.05 6974.59 - CE-NecessaryAndSufficient-Badger.Weaver-Boogie Run set 5 of 6: skipped CE-NecessaryAndSufficient-Camel.Weaver-Boogie Run set 6 of 6: skipped Statistics: 549 Files correct: 336 correct true: 336 correct false: 0 incorrect: 3 incorrect true: 3 incorrect false: 0 unknown: 210 Score: 576 (max: 1095)