BENCHMARK INFORMATION benchmark definition: ../benchexec/concurrency.xml name: concurrency run sets: Automizer FA.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.None.POPL2022 Benchmarks, Automizer PN.POPL2022 Benchmarks, Automizer FA.Delay.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.OrderLockstep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.Symm.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderLockstep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom42.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom521.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom7777.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepUncond.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.Persistent.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleepPersistent.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleepPersistentFixedOrder.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderLockstep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom42.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom521.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom7777.POPL2022 Benchmarks date: Wed, 2021-06-30 11:47:22 CEST tool: ULTIMATE Automizer 0.2.1-8b99979f tool executable: ./Ultimate.py options: --force-no-wrapper parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: benchexec os: Linux-5.4.65-1-pve-x86_64-with-debian-10.10 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer FA.POPL2022 Benchmarks Run set 1 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.31 3.12 None add-sub02.yml true 5.64 3.91 None add-sub03.yml true 19.79 17.61 None add-sub04.yml OUT OF MEMORY 218.61 231.86 None add-sub05.yml OUT OF MEMORY 540.86 406.07 None add-sub06.yml OUT OF MEMORY 652.53 452.20 None add-sub07.yml OUT OF MEMORY 87.68 67.94 None add-sub08.yml TIMEOUT 904.72 658.89 None add-sub09.yml TIMEOUT 902.85 706.74 None add-sub10.yml TIMEOUT 905.10 722.18 None add-sub11.yml TIMEOUT 901.56 667.70 None add-sub12.yml TIMEOUT 903.36 761.50 None add-sub13.yml TIMEOUT 901.18 745.41 None add-sub14.yml TIMEOUT 900.37 805.30 None add-sub15.yml TIMEOUT 903.53 646.72 None add-sub16.yml TIMEOUT 903.99 660.66 None add-sub17.yml TIMEOUT 904.43 707.21 None add-sub18.yml TIMEOUT 908.67 678.73 None add-sub19.yml TIMEOUT 907.99 643.85 None add-sub20.yml TIMEOUT 904.91 734.62 None add-sub21.yml TIMEOUT 907.39 661.82 None add-sub22.yml TIMEOUT 901.44 652.88 None add-sub23.yml TIMEOUT 904.84 654.57 None add-sub24.yml TIMEOUT 900.71 691.92 None add-sub25.yml TIMEOUT 907.81 620.08 None bluetooth-correct02.yml unknown 3.08 1.72 None bluetooth-correct03.yml unknown 2.94 1.68 None bluetooth-correct04.yml unknown 3.01 1.66 None bluetooth-correct05.yml unknown 2.87 1.62 None bluetooth-correct06.yml unknown 2.82 1.65 None bluetooth-correct07.yml unknown 2.96 1.71 None bluetooth-correct08.yml unknown 3.17 1.84 None bluetooth-correct09.yml unknown 3.04 1.86 None bluetooth-correct10.yml unknown 3.04 1.79 None bluetooth-customized02.yml unknown 3.07 1.73 None bluetooth-customized03.yml unknown 2.85 1.59 None bluetooth-customized04.yml unknown 3.04 1.68 None bluetooth-customized05.yml unknown 2.98 1.89 None bluetooth-customized06.yml unknown 3.04 1.72 None bluetooth-customized07.yml unknown 2.93 1.67 None bluetooth-customized08.yml unknown 3.20 1.79 None bluetooth-customized09.yml unknown 3.11 1.74 None bluetooth-customized10.yml unknown 2.90 1.62 None bluetooth-incorrect02.yml unknown 3.26 2.11 None bluetooth-incorrect03.yml unknown 2.99 1.69 None bluetooth-incorrect04.yml unknown 2.84 1.60 None bluetooth-incorrect05.yml unknown 3.02 2.00 None bluetooth-incorrect06.yml unknown 3.00 1.69 None bluetooth-incorrect07.yml unknown 3.04 1.71 None bluetooth-incorrect08.yml unknown 3.01 1.67 None bluetooth-incorrect09.yml unknown 3.17 1.82 None bluetooth-incorrect10.yml unknown 2.96 1.65 None bluetooth-serverassert01.yml unknown 2.73 1.55 None bluetooth-serverassert02.yml unknown 2.95 1.64 None bluetooth-serverassert03.yml unknown 3.19 1.79 None bluetooth-serverassert04.yml unknown 3.08 1.76 None bluetooth-serverassert05.yml unknown 2.86 1.64 None bluetooth-serverassert06.yml unknown 3.19 1.96 None bluetooth-serverassert07.yml unknown 2.88 1.72 None bluetooth-serverassert08.yml unknown 3.07 1.76 None bluetooth-serverassert09.yml unknown 3.11 2.03 None bluetooth-serverassert10.yml unknown 3.07 1.80 None incr-decr01.yml true 4.04 2.61 None incr-decr02.yml true 4.87 3.27 None incr-decr03.yml true 5.37 3.45 None incr-decr04.yml true 6.37 4.34 None incr-decr05.yml true 8.20 5.73 None incr-decr06.yml true 10.69 7.24 None incr-decr07.yml true 19.35 11.80 None incr-decr08.yml true 43.00 27.20 None incr-decr09.yml true 152.57 108.64 None incr-decr10.yml OUT OF MEMORY 211.39 187.37 None incr-decr11.yml TIMEOUT 922.24 782.06 None incr-decr12.yml TIMEOUT 902.16 686.61 None incr-decr13.yml TIMEOUT 903.41 778.17 None incr-decr14.yml TIMEOUT 904.90 658.85 None incr-decr15.yml TIMEOUT 900.65 778.19 None incr-decr16.yml TIMEOUT 901.59 644.34 None incr-decr17.yml TIMEOUT 908.78 646.43 None incr-decr18.yml TIMEOUT 901.25 630.66 None incr-decr19.yml TIMEOUT 902.93 681.40 None incr-decr20.yml TIMEOUT 902.94 642.43 None incr-decr21.yml TIMEOUT 900.55 671.48 None incr-decr22.yml TIMEOUT 900.81 636.88 None incr-decr23.yml TIMEOUT 908.19 681.20 None incr-decr24.yml TIMEOUT 902.25 614.51 None incr-decr25.yml TIMEOUT 903.39 614.38 None --------------------------------------------------------------------------------------------- Run set 1 done 31894.25 2048.66 - Automizer PARTIAL_ORDER_FA.None.POPL2022 Benchmarks Run set 2 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-None-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.27 3.49 None add-sub02.yml true 5.75 3.86 None add-sub03.yml true 7.60 5.41 None add-sub04.yml true 35.72 24.00 None add-sub05.yml OUT OF MEMORY 570.81 413.35 None add-sub06.yml TIMEOUT 902.71 567.06 None add-sub07.yml TIMEOUT 922.18 557.27 None add-sub08.yml TIMEOUT 922.31 593.08 None add-sub09.yml TIMEOUT 902.02 646.21 None add-sub10.yml TIMEOUT 900.24 666.77 None add-sub11.yml TIMEOUT 904.97 687.58 None add-sub12.yml TIMEOUT 907.37 763.01 None add-sub13.yml TIMEOUT 902.46 749.67 None add-sub14.yml TIMEOUT 900.71 747.71 None add-sub15.yml TIMEOUT 901.92 668.21 None add-sub16.yml TIMEOUT 903.99 609.64 None add-sub17.yml TIMEOUT 901.43 704.96 None add-sub18.yml TIMEOUT 909.10 698.46 None add-sub19.yml TIMEOUT 904.76 641.59 None add-sub20.yml TIMEOUT 907.46 648.09 None add-sub21.yml TIMEOUT 907.47 654.93 None add-sub22.yml TIMEOUT 900.81 661.13 None add-sub23.yml TIMEOUT 901.32 611.70 None add-sub24.yml TIMEOUT 902.30 622.47 None add-sub25.yml TIMEOUT 906.77 613.36 None bluetooth-correct02.yml unknown 3.95 2.25 None bluetooth-correct03.yml unknown 3.92 2.17 None bluetooth-correct04.yml unknown 3.98 2.16 None bluetooth-correct05.yml unknown 3.95 2.15 None bluetooth-correct06.yml unknown 3.66 2.06 None bluetooth-correct07.yml unknown 3.94 2.30 None bluetooth-correct08.yml unknown 3.62 2.00 None bluetooth-correct09.yml unknown 2.81 1.70 None bluetooth-correct10.yml unknown 3.93 2.15 None bluetooth-customized02.yml unknown 3.23 1.83 None bluetooth-customized03.yml unknown 3.77 2.10 None bluetooth-customized04.yml unknown 2.99 1.68 None bluetooth-customized05.yml unknown 2.99 1.72 None bluetooth-customized06.yml unknown 3.96 2.17 None bluetooth-customized07.yml unknown 2.75 1.58 None bluetooth-customized08.yml unknown 3.92 2.14 None bluetooth-customized09.yml unknown 2.90 1.68 None bluetooth-customized10.yml unknown 3.79 2.09 None bluetooth-incorrect02.yml unknown 3.35 1.97 None bluetooth-incorrect03.yml unknown 3.95 2.19 None bluetooth-incorrect04.yml unknown 3.18 1.82 None bluetooth-incorrect05.yml unknown 3.75 2.09 None bluetooth-incorrect06.yml unknown 2.92 1.75 None bluetooth-incorrect07.yml unknown 3.21 1.89 None bluetooth-incorrect08.yml unknown 3.74 2.09 None bluetooth-incorrect09.yml unknown 2.91 1.74 None bluetooth-incorrect10.yml unknown 3.99 2.20 None bluetooth-serverassert01.yml unknown 3.10 1.81 None bluetooth-serverassert02.yml unknown 3.92 2.13 None bluetooth-serverassert03.yml unknown 2.92 1.78 None bluetooth-serverassert04.yml unknown 2.88 1.70 None bluetooth-serverassert05.yml unknown 3.59 2.01 None bluetooth-serverassert06.yml unknown 3.03 2.03 None bluetooth-serverassert07.yml unknown 3.17 1.80 None bluetooth-serverassert08.yml unknown 3.94 2.17 None bluetooth-serverassert09.yml unknown 3.19 1.80 None bluetooth-serverassert10.yml unknown 3.18 1.80 None incr-decr01.yml true 3.96 2.55 None incr-decr02.yml true 6.05 3.78 None incr-decr03.yml true 5.62 3.87 None incr-decr04.yml true 6.33 4.39 None incr-decr05.yml true 10.36 6.61 None incr-decr06.yml true 10.45 6.89 None incr-decr07.yml true 19.42 11.84 None incr-decr08.yml true 25.08 16.41 None incr-decr09.yml true 73.85 48.44 None incr-decr10.yml OUT OF MEMORY 190.77 156.31 None incr-decr11.yml TIMEOUT 906.00 716.36 None incr-decr12.yml TIMEOUT 905.69 679.15 None incr-decr13.yml TIMEOUT 901.85 777.58 None incr-decr14.yml TIMEOUT 908.03 777.54 None incr-decr15.yml TIMEOUT 901.30 791.05 None incr-decr16.yml TIMEOUT 906.24 719.23 None incr-decr17.yml TIMEOUT 905.80 648.25 None incr-decr18.yml TIMEOUT 907.26 645.32 None incr-decr19.yml TIMEOUT 902.01 629.60 None incr-decr20.yml TIMEOUT 905.46 638.72 None incr-decr21.yml TIMEOUT 905.22 615.86 None incr-decr22.yml TIMEOUT 909.84 631.04 None incr-decr23.yml TIMEOUT 901.91 627.33 None incr-decr24.yml TIMEOUT 908.15 615.74 None incr-decr25.yml TIMEOUT 902.68 601.51 None --------------------------------------------------------------------------------------------- Run set 2 done 32301.28 2022.57 - Automizer PN.POPL2022 Benchmarks Run set 3 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-PN-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.57 3.46 None add-sub02.yml true 5.77 3.74 None add-sub03.yml true 64.90 55.12 None add-sub04.yml OUT OF MEMORY 698.07 593.64 None add-sub05.yml TIMEOUT 903.01 747.09 None add-sub06.yml TIMEOUT 901.24 740.54 None add-sub07.yml TIMEOUT 901.97 767.61 None add-sub08.yml TIMEOUT 900.49 720.29 None add-sub09.yml OUT OF MEMORY 509.58 402.46 None add-sub10.yml OUT OF MEMORY 132.39 95.54 None add-sub11.yml TIMEOUT 903.73 656.42 None add-sub12.yml OUT OF MEMORY 413.91 302.42 None add-sub13.yml OUT OF MEMORY 369.90 272.65 None add-sub14.yml OUT OF MEMORY 320.44 207.00 None add-sub15.yml OUT OF MEMORY 164.56 96.79 None add-sub16.yml OUT OF MEMORY 126.20 76.68 None add-sub17.yml OUT OF MEMORY 115.37 75.38 None add-sub18.yml OUT OF MEMORY 117.66 72.80 None add-sub19.yml OUT OF MEMORY 108.39 65.79 None add-sub20.yml OUT OF MEMORY 151.47 85.34 None add-sub21.yml OUT OF MEMORY 132.04 85.01 None add-sub22.yml OUT OF MEMORY 127.92 83.76 None add-sub23.yml OUT OF MEMORY 126.41 78.20 None add-sub24.yml OUT OF MEMORY 159.14 95.15 None add-sub25.yml OUT OF MEMORY 119.41 80.10 None bluetooth-correct02.yml unknown 3.03 1.93 None bluetooth-correct03.yml unknown 3.07 1.83 None bluetooth-correct04.yml unknown 2.95 1.78 None bluetooth-correct05.yml unknown 3.20 2.02 None bluetooth-correct06.yml unknown 3.20 1.83 None bluetooth-correct07.yml unknown 2.97 1.71 None bluetooth-correct08.yml unknown 3.03 1.76 None bluetooth-correct09.yml unknown 2.86 1.65 None bluetooth-correct10.yml unknown 3.02 1.76 None bluetooth-customized02.yml unknown 2.81 1.68 None bluetooth-customized03.yml unknown 2.94 1.70 None bluetooth-customized04.yml unknown 3.08 1.76 None bluetooth-customized05.yml unknown 3.13 1.85 None bluetooth-customized06.yml unknown 3.09 1.74 None bluetooth-customized07.yml unknown 3.15 1.83 None bluetooth-customized08.yml unknown 3.27 1.96 None bluetooth-customized09.yml unknown 3.03 1.71 None bluetooth-customized10.yml unknown 3.16 2.02 None bluetooth-incorrect02.yml unknown 3.14 1.94 None bluetooth-incorrect03.yml unknown 2.97 1.80 None bluetooth-incorrect04.yml unknown 2.96 1.76 None bluetooth-incorrect05.yml unknown 3.18 1.85 None bluetooth-incorrect06.yml unknown 3.25 1.78 None bluetooth-incorrect07.yml unknown 3.09 1.74 None bluetooth-incorrect08.yml unknown 3.22 1.89 None bluetooth-incorrect09.yml unknown 3.04 1.76 None bluetooth-incorrect10.yml unknown 2.89 1.73 None bluetooth-serverassert01.yml unknown 3.21 1.83 None bluetooth-serverassert02.yml unknown 2.97 1.68 None bluetooth-serverassert03.yml unknown 3.24 1.82 None bluetooth-serverassert04.yml unknown 3.26 1.80 None bluetooth-serverassert05.yml unknown 3.11 1.87 None bluetooth-serverassert06.yml unknown 2.91 1.78 None bluetooth-serverassert07.yml unknown 3.13 1.76 None bluetooth-serverassert08.yml unknown 2.97 1.73 None bluetooth-serverassert09.yml unknown 2.83 1.76 None bluetooth-serverassert10.yml unknown 3.00 1.70 None incr-decr01.yml true 4.32 2.54 None incr-decr02.yml true 4.56 3.03 None incr-decr03.yml true 5.54 3.61 None incr-decr04.yml true 6.62 4.48 None incr-decr05.yml true 8.72 5.55 None incr-decr06.yml true 12.06 7.25 None incr-decr07.yml true 18.04 10.33 None incr-decr08.yml true 30.57 21.36 None incr-decr09.yml true 59.89 44.76 None incr-decr10.yml OUT OF MEMORY 105.91 91.02 None incr-decr11.yml OUT OF MEMORY 317.31 279.95 None incr-decr12.yml TIMEOUT 912.43 672.47 None incr-decr13.yml OUT OF MEMORY 526.01 390.75 None incr-decr14.yml OUT OF MEMORY 120.30 79.17 None incr-decr15.yml OUT OF MEMORY 145.65 97.12 None incr-decr16.yml OUT OF MEMORY 123.70 78.47 None incr-decr17.yml OUT OF MEMORY 138.08 85.82 None incr-decr18.yml OUT OF MEMORY 111.62 66.82 None incr-decr19.yml OUT OF MEMORY 145.11 89.60 None incr-decr20.yml OUT OF MEMORY 137.02 89.72 None incr-decr21.yml OUT OF MEMORY 101.69 61.51 None incr-decr22.yml OUT OF MEMORY 111.88 68.34 None incr-decr23.yml OUT OF MEMORY 131.59 89.96 None incr-decr24.yml OUT OF MEMORY 111.43 71.03 None incr-decr25.yml OUT OF MEMORY 101.15 60.10 None --------------------------------------------------------------------------------------------- Run set 3 done 12066.94 959.31 - Automizer FA.Delay.POPL2022 Benchmarks Run set 4 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe-Delay.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.71 3.21 None add-sub02.yml true 6.09 3.95 None add-sub03.yml true 19.49 17.59 None add-sub04.yml TIMEOUT 854.40 951.42 None add-sub05.yml TIMEOUT 885.42 951.45 None add-sub06.yml TIMEOUT 901.14 946.85 None add-sub07.yml OUT OF MEMORY 807.60 825.41 None add-sub08.yml TIMEOUT 900.59 876.85 None add-sub09.yml TIMEOUT 901.14 841.90 None add-sub10.yml TIMEOUT 905.24 684.43 None add-sub11.yml TIMEOUT 903.89 660.84 None add-sub12.yml TIMEOUT 901.71 729.20 None add-sub13.yml TIMEOUT 900.69 726.19 None add-sub14.yml TIMEOUT 907.83 737.72 None add-sub15.yml TIMEOUT 901.83 702.88 None add-sub16.yml TIMEOUT 903.17 601.36 None add-sub17.yml TIMEOUT 901.50 575.24 None add-sub18.yml TIMEOUT 908.46 611.08 None add-sub19.yml TIMEOUT 901.41 560.14 None add-sub20.yml TIMEOUT 902.70 620.38 None add-sub21.yml TIMEOUT 901.85 603.07 None add-sub22.yml TIMEOUT 910.17 589.84 None add-sub23.yml TIMEOUT 904.16 611.98 None add-sub24.yml TIMEOUT 905.28 630.76 None add-sub25.yml TIMEOUT 900.73 638.64 None bluetooth-correct02.yml unknown 2.94 1.69 None bluetooth-correct03.yml unknown 2.78 1.68 None bluetooth-correct04.yml unknown 3.15 1.80 None bluetooth-correct05.yml unknown 3.24 1.87 None bluetooth-correct06.yml unknown 3.02 1.78 None bluetooth-correct07.yml unknown 3.13 1.77 None bluetooth-correct08.yml unknown 3.04 1.71 None bluetooth-correct09.yml unknown 2.93 1.71 None bluetooth-correct10.yml unknown 2.75 1.55 None bluetooth-customized02.yml unknown 3.17 1.86 None bluetooth-customized03.yml unknown 2.73 1.58 None bluetooth-customized04.yml unknown 3.00 1.73 None bluetooth-customized05.yml unknown 2.79 1.62 None bluetooth-customized06.yml unknown 3.48 2.09 None bluetooth-customized07.yml unknown 2.98 1.79 None bluetooth-customized08.yml unknown 3.14 2.01 None bluetooth-customized09.yml unknown 2.78 1.62 None bluetooth-customized10.yml unknown 3.24 1.99 None bluetooth-incorrect02.yml unknown 2.83 1.82 None bluetooth-incorrect03.yml unknown 3.22 2.03 None bluetooth-incorrect04.yml unknown 2.96 1.81 None bluetooth-incorrect05.yml unknown 2.80 1.61 None bluetooth-incorrect06.yml unknown 2.91 1.66 None bluetooth-incorrect07.yml unknown 2.70 1.58 None bluetooth-incorrect08.yml unknown 3.18 1.75 None bluetooth-incorrect09.yml unknown 2.90 1.66 None bluetooth-incorrect10.yml unknown 2.96 1.67 None bluetooth-serverassert01.yml unknown 2.78 1.63 None bluetooth-serverassert02.yml unknown 2.85 1.73 None bluetooth-serverassert03.yml unknown 2.90 1.64 None bluetooth-serverassert04.yml unknown 2.82 1.67 None bluetooth-serverassert05.yml unknown 2.83 1.63 None bluetooth-serverassert06.yml unknown 3.14 1.76 None bluetooth-serverassert07.yml unknown 2.78 1.65 None bluetooth-serverassert08.yml unknown 2.93 1.72 None bluetooth-serverassert09.yml unknown 2.91 1.68 None bluetooth-serverassert10.yml unknown 2.92 1.70 None incr-decr01.yml true 4.37 2.71 None incr-decr02.yml true 5.03 3.24 None incr-decr03.yml true 5.75 3.79 None incr-decr04.yml true 6.82 4.53 None incr-decr05.yml true 7.79 5.17 None incr-decr06.yml true 11.27 7.26 None incr-decr07.yml true 11.05 7.19 None incr-decr08.yml true 14.34 9.14 None incr-decr09.yml true 27.79 16.54 None incr-decr10.yml true 40.40 27.53 None incr-decr11.yml true 153.36 128.57 None incr-decr12.yml TIMEOUT 905.23 646.86 None incr-decr13.yml TIMEOUT 908.20 607.63 None incr-decr14.yml TIMEOUT 903.27 617.66 None incr-decr15.yml TIMEOUT 905.21 629.66 None incr-decr16.yml TIMEOUT 901.48 594.77 None incr-decr17.yml TIMEOUT 901.61 621.62 None incr-decr18.yml TIMEOUT 906.44 590.12 None incr-decr19.yml TIMEOUT 902.37 569.62 None incr-decr20.yml TIMEOUT 904.39 552.84 None incr-decr21.yml TIMEOUT 911.40 590.54 None incr-decr22.yml TIMEOUT 901.82 621.09 None incr-decr23.yml TIMEOUT 906.82 586.22 None incr-decr24.yml TIMEOUT 905.97 608.08 None incr-decr25.yml TIMEOUT 905.70 610.10 None --------------------------------------------------------------------------------------------- Run set 4 done 32497.28 1987.42 - Automizer PARTIAL_ORDER_FA.DelaySleep.POPL2022 Benchmarks Run set 5 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.53 3.72 None add-sub02.yml true 4.74 3.03 None add-sub03.yml true 5.04 3.34 None add-sub04.yml true 7.18 4.37 None add-sub05.yml true 9.28 5.36 None add-sub06.yml true 14.80 8.56 None add-sub07.yml true 20.59 11.88 None add-sub08.yml true 66.50 46.33 None add-sub09.yml OUT OF MEMORY 284.43 228.58 None add-sub10.yml TIMEOUT 904.54 710.54 None add-sub11.yml TIMEOUT 903.83 709.63 None add-sub12.yml TIMEOUT 900.79 765.03 None add-sub13.yml TIMEOUT 902.18 753.61 None add-sub14.yml TIMEOUT 901.79 719.39 None add-sub15.yml TIMEOUT 901.45 760.61 None add-sub16.yml TIMEOUT 902.43 622.19 None add-sub17.yml TIMEOUT 904.66 675.38 None add-sub18.yml TIMEOUT 902.62 635.29 None add-sub19.yml TIMEOUT 906.70 652.71 None add-sub20.yml TIMEOUT 904.39 645.14 None add-sub21.yml TIMEOUT 907.82 675.01 None add-sub22.yml TIMEOUT 902.99 611.68 None add-sub23.yml TIMEOUT 906.06 590.78 None add-sub24.yml TIMEOUT 901.66 623.20 None add-sub25.yml TIMEOUT 907.02 635.57 None bluetooth-correct02.yml unknown 4.21 2.31 None bluetooth-correct03.yml unknown 4.00 2.29 None bluetooth-correct04.yml unknown 3.90 2.18 None bluetooth-correct05.yml unknown 4.03 2.21 None bluetooth-correct06.yml unknown 3.91 2.36 None bluetooth-correct07.yml unknown 3.81 2.10 None bluetooth-correct08.yml unknown 3.73 2.10 None bluetooth-correct09.yml unknown 3.89 2.16 None bluetooth-correct10.yml unknown 4.16 2.47 None bluetooth-customized02.yml unknown 3.89 2.22 None bluetooth-customized03.yml unknown 3.93 2.16 None bluetooth-customized04.yml unknown 4.22 2.33 None bluetooth-customized05.yml unknown 4.12 2.26 None bluetooth-customized06.yml unknown 3.92 2.14 None bluetooth-customized07.yml unknown 4.24 2.33 None bluetooth-customized08.yml unknown 4.01 2.28 None bluetooth-customized09.yml unknown 3.94 2.15 None bluetooth-customized10.yml unknown 3.99 2.20 None bluetooth-incorrect02.yml unknown 3.82 2.08 None bluetooth-incorrect03.yml unknown 3.97 2.31 None bluetooth-incorrect04.yml unknown 3.92 2.19 None bluetooth-incorrect05.yml unknown 3.76 2.09 None bluetooth-incorrect06.yml unknown 4.03 2.18 None bluetooth-incorrect07.yml unknown 3.99 2.19 None bluetooth-incorrect08.yml unknown 4.13 2.26 None bluetooth-incorrect09.yml unknown 3.57 2.15 None bluetooth-incorrect10.yml unknown 3.70 2.10 None bluetooth-serverassert01.yml unknown 3.91 2.16 None bluetooth-serverassert02.yml unknown 3.83 2.15 None bluetooth-serverassert03.yml unknown 4.01 2.17 None bluetooth-serverassert04.yml unknown 3.92 2.12 None bluetooth-serverassert05.yml unknown 4.03 2.32 None bluetooth-serverassert06.yml unknown 3.80 2.13 None bluetooth-serverassert07.yml unknown 4.01 2.22 None bluetooth-serverassert08.yml unknown 3.64 2.03 None bluetooth-serverassert09.yml unknown 3.70 2.06 None bluetooth-serverassert10.yml unknown 3.83 2.12 None incr-decr01.yml true 5.54 3.31 None incr-decr02.yml true 5.59 3.40 None incr-decr03.yml true 5.93 3.47 None incr-decr04.yml true 6.11 3.71 None incr-decr05.yml true 5.02 3.32 None incr-decr06.yml true 6.99 4.05 None incr-decr07.yml true 7.92 4.59 None incr-decr08.yml true 10.49 5.87 None incr-decr09.yml true 16.77 9.32 None incr-decr10.yml true 31.18 21.07 None incr-decr11.yml true 151.07 129.76 None incr-decr12.yml TIMEOUT 900.86 699.80 None incr-decr13.yml TIMEOUT 904.69 671.33 None incr-decr14.yml TIMEOUT 904.78 671.75 None incr-decr15.yml TIMEOUT 908.29 648.63 None incr-decr16.yml TIMEOUT 904.94 601.74 None incr-decr17.yml TIMEOUT 903.00 616.50 None incr-decr18.yml TIMEOUT 906.20 703.54 None incr-decr19.yml TIMEOUT 906.99 641.70 None incr-decr20.yml TIMEOUT 901.68 622.50 None incr-decr21.yml TIMEOUT 910.09 670.47 None incr-decr22.yml TIMEOUT 904.81 645.34 None incr-decr23.yml TIMEOUT 905.37 608.77 None incr-decr24.yml TIMEOUT 902.53 617.81 None incr-decr25.yml TIMEOUT 904.48 599.25 None --------------------------------------------------------------------------------------------- Run set 5 done 27944.30 1875.28 - Automizer PARTIAL_ORDER_FA.DelaySleep.OrderLockstep.POPL2022 Benchmarks Run set 6 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.57 3.43 None add-sub02.yml true 4.90 3.50 None add-sub03.yml true 9.07 7.36 None add-sub04.yml true 17.07 10.99 None add-sub05.yml OUT OF MEMORY 744.99 515.39 None add-sub06.yml TIMEOUT 903.19 610.27 None add-sub07.yml TIMEOUT 901.58 771.38 None add-sub08.yml TIMEOUT 906.99 649.61 None add-sub09.yml TIMEOUT 901.07 766.78 None add-sub10.yml TIMEOUT 905.45 728.62 None add-sub11.yml TIMEOUT 901.29 780.74 None add-sub12.yml TIMEOUT 904.61 856.92 None add-sub13.yml TIMEOUT 903.68 733.56 None add-sub14.yml TIMEOUT 901.17 751.47 None add-sub15.yml TIMEOUT 904.72 687.72 None add-sub16.yml TIMEOUT 902.98 743.48 None add-sub17.yml TIMEOUT 901.27 797.88 None add-sub18.yml TIMEOUT 901.10 747.34 None add-sub19.yml TIMEOUT 901.09 776.49 None add-sub20.yml TIMEOUT 907.00 792.34 None add-sub21.yml TIMEOUT 901.13 787.03 None add-sub22.yml TIMEOUT 900.61 736.61 None add-sub23.yml TIMEOUT 901.31 785.52 None add-sub24.yml TIMEOUT 907.22 759.60 None add-sub25.yml TIMEOUT 903.40 644.02 None bluetooth-correct02.yml unknown 3.03 2.26 None bluetooth-correct03.yml unknown 3.11 2.17 None bluetooth-correct04.yml unknown 3.10 1.89 None bluetooth-correct05.yml unknown 3.13 2.28 None bluetooth-correct06.yml unknown 3.51 2.14 None bluetooth-correct07.yml unknown 3.85 2.11 None bluetooth-correct08.yml unknown 2.74 1.79 None bluetooth-correct09.yml unknown 3.01 2.07 None bluetooth-correct10.yml unknown 3.77 2.05 None bluetooth-customized02.yml unknown 2.73 1.88 None bluetooth-customized03.yml unknown 3.55 1.94 None bluetooth-customized04.yml unknown 3.05 1.70 None bluetooth-customized05.yml unknown 3.13 2.01 None bluetooth-customized06.yml unknown 3.80 2.04 None bluetooth-customized07.yml unknown 2.87 1.65 None bluetooth-customized08.yml unknown 2.72 1.77 None bluetooth-customized09.yml unknown 3.78 2.08 None bluetooth-customized10.yml unknown 2.87 1.61 None bluetooth-incorrect02.yml unknown 3.10 2.26 None bluetooth-incorrect03.yml unknown 2.92 1.66 None bluetooth-incorrect04.yml unknown 3.82 2.10 None bluetooth-incorrect05.yml unknown 2.85 1.63 None bluetooth-incorrect06.yml unknown 3.17 1.80 None bluetooth-incorrect07.yml unknown 3.14 2.20 None bluetooth-incorrect08.yml unknown 3.82 2.10 None bluetooth-incorrect09.yml unknown 2.91 1.62 None bluetooth-incorrect10.yml unknown 3.03 1.71 None bluetooth-serverassert01.yml unknown 2.69 1.55 None bluetooth-serverassert02.yml unknown 3.20 2.39 None bluetooth-serverassert03.yml unknown 3.80 2.14 None bluetooth-serverassert04.yml unknown 3.10 1.81 None bluetooth-serverassert05.yml unknown 3.14 1.79 None bluetooth-serverassert06.yml unknown 3.03 2.26 None bluetooth-serverassert07.yml unknown 3.90 2.17 None bluetooth-serverassert08.yml unknown 3.09 1.82 None bluetooth-serverassert09.yml unknown 2.92 1.65 None bluetooth-serverassert10.yml unknown 2.78 1.60 None incr-decr01.yml true 4.23 2.96 None incr-decr02.yml true 4.53 2.92 None incr-decr03.yml true 6.53 4.35 None incr-decr04.yml true 5.19 3.62 None incr-decr05.yml true 5.89 4.04 None incr-decr06.yml true 6.46 4.61 None incr-decr07.yml true 7.22 4.66 None incr-decr08.yml true 9.51 5.72 None incr-decr09.yml true 18.71 11.10 None incr-decr10.yml true 33.15 24.44 None incr-decr11.yml true 145.05 135.98 None incr-decr12.yml TIMEOUT 905.55 650.71 None incr-decr13.yml TIMEOUT 906.74 675.75 None incr-decr14.yml TIMEOUT 909.39 667.22 None incr-decr15.yml TIMEOUT 902.87 600.80 None incr-decr16.yml TIMEOUT 908.79 596.34 None incr-decr17.yml OUT OF MEMORY 288.17 262.69 None incr-decr18.yml OUT OF MEMORY 341.62 311.43 None incr-decr19.yml OUT OF MEMORY 873.47 624.41 None incr-decr20.yml OUT OF MEMORY 447.90 425.10 None incr-decr21.yml TIMEOUT 911.03 726.29 None incr-decr22.yml TIMEOUT 903.61 650.69 None incr-decr23.yml TIMEOUT 909.10 668.68 None incr-decr24.yml TIMEOUT 905.94 663.49 None incr-decr25.yml TIMEOUT 900.68 701.12 None --------------------------------------------------------------------------------------------- Run set 6 done 29748.63 2110.50 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.POPL2022 Benchmarks Run set 7 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.51 3.35 None add-sub02.yml true 4.58 2.97 None add-sub03.yml true 5.17 3.27 None add-sub04.yml true 7.22 4.23 None add-sub05.yml true 10.06 5.69 None add-sub06.yml true 13.96 7.61 None add-sub07.yml true 22.02 13.24 None add-sub08.yml true 77.82 52.81 None add-sub09.yml OUT OF MEMORY 241.74 166.65 None add-sub10.yml TIMEOUT 902.82 705.91 None add-sub11.yml TIMEOUT 906.16 701.69 None add-sub12.yml TIMEOUT 905.04 714.28 None add-sub13.yml TIMEOUT 907.90 707.30 None add-sub14.yml TIMEOUT 900.92 740.66 None add-sub15.yml TIMEOUT 905.54 639.66 None add-sub16.yml TIMEOUT 906.14 660.75 None add-sub17.yml TIMEOUT 909.06 616.55 None add-sub18.yml TIMEOUT 904.03 636.58 None add-sub19.yml TIMEOUT 904.63 575.23 None add-sub20.yml TIMEOUT 908.31 684.42 None add-sub21.yml TIMEOUT 902.37 605.14 None add-sub22.yml TIMEOUT 908.64 611.64 None add-sub23.yml TIMEOUT 901.22 601.98 None add-sub24.yml TIMEOUT 902.03 576.80 None add-sub25.yml TIMEOUT 901.24 600.39 None bluetooth-correct02.yml unknown 4.18 2.30 None bluetooth-correct03.yml unknown 3.87 2.22 None bluetooth-correct04.yml unknown 3.84 2.22 None bluetooth-correct05.yml unknown 3.84 2.14 None bluetooth-correct06.yml unknown 3.83 2.27 None bluetooth-correct07.yml unknown 3.95 2.21 None bluetooth-correct08.yml unknown 4.02 2.21 None bluetooth-correct09.yml unknown 3.98 2.15 None bluetooth-correct10.yml unknown 3.77 2.11 None bluetooth-customized02.yml unknown 3.80 2.17 None bluetooth-customized03.yml unknown 4.05 2.22 None bluetooth-customized04.yml unknown 3.17 1.80 None bluetooth-customized05.yml unknown 4.20 2.32 None bluetooth-customized06.yml unknown 3.70 2.18 None bluetooth-customized07.yml unknown 3.13 1.86 None bluetooth-customized08.yml unknown 3.89 2.17 None bluetooth-customized09.yml unknown 3.61 2.03 None bluetooth-customized10.yml unknown 3.14 1.80 None bluetooth-incorrect02.yml unknown 3.87 2.21 None bluetooth-incorrect03.yml unknown 2.93 1.75 None bluetooth-incorrect04.yml unknown 3.85 2.10 None bluetooth-incorrect05.yml unknown 3.85 2.18 None bluetooth-incorrect06.yml unknown 3.07 1.73 None bluetooth-incorrect07.yml unknown 3.84 2.13 None bluetooth-incorrect08.yml unknown 2.90 1.78 None bluetooth-incorrect09.yml unknown 3.84 2.17 None bluetooth-incorrect10.yml unknown 3.92 2.17 None bluetooth-serverassert01.yml unknown 3.04 2.07 None bluetooth-serverassert02.yml unknown 3.80 2.26 None bluetooth-serverassert03.yml unknown 3.73 2.22 None bluetooth-serverassert04.yml unknown 3.06 1.91 None bluetooth-serverassert05.yml unknown 4.01 2.27 None bluetooth-serverassert06.yml unknown 3.92 2.17 None bluetooth-serverassert07.yml unknown 3.08 1.88 None bluetooth-serverassert08.yml unknown 3.76 2.06 None bluetooth-serverassert09.yml unknown 3.80 2.11 None bluetooth-serverassert10.yml unknown 3.15 1.75 None incr-decr01.yml true 5.40 3.29 None incr-decr02.yml true 4.53 2.95 None incr-decr03.yml true 6.10 3.44 None incr-decr04.yml true 4.64 2.96 None incr-decr05.yml true 6.92 4.07 None incr-decr06.yml true 6.86 4.04 None incr-decr07.yml true 6.02 3.63 None incr-decr08.yml true 10.93 6.05 None incr-decr09.yml true 13.83 7.88 None incr-decr10.yml true 37.65 24.63 None incr-decr11.yml true 189.25 157.02 None incr-decr12.yml TIMEOUT 907.41 636.83 None incr-decr13.yml TIMEOUT 901.91 665.36 None incr-decr14.yml TIMEOUT 904.31 612.22 None incr-decr15.yml TIMEOUT 904.41 635.25 None incr-decr16.yml TIMEOUT 908.93 575.29 None incr-decr17.yml TIMEOUT 908.76 597.52 None incr-decr18.yml TIMEOUT 905.02 560.75 None incr-decr19.yml TIMEOUT 909.18 624.61 None incr-decr20.yml TIMEOUT 911.56 675.45 None incr-decr21.yml TIMEOUT 903.48 658.70 None incr-decr22.yml TIMEOUT 901.10 592.04 None incr-decr23.yml TIMEOUT 902.17 578.40 None incr-decr24.yml TIMEOUT 901.38 535.07 None incr-decr25.yml TIMEOUT 910.04 557.09 None --------------------------------------------------------------------------------------------- Run set 7 done 27969.73 1777.75 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.Symm.POPL2022 Benchmarks Run set 8 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Symm.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.61 3.72 None add-sub02.yml true 4.73 3.30 None add-sub03.yml true 5.29 3.57 None add-sub04.yml true 7.90 4.54 None add-sub05.yml true 9.69 5.54 None add-sub06.yml true 15.10 10.48 None add-sub07.yml true 20.74 12.42 None add-sub08.yml true 78.23 53.50 None add-sub09.yml OUT OF MEMORY 185.09 137.37 None add-sub10.yml TIMEOUT 904.86 669.89 None add-sub11.yml TIMEOUT 904.56 626.07 None add-sub12.yml TIMEOUT 908.12 702.78 None add-sub13.yml TIMEOUT 908.51 661.60 None add-sub14.yml TIMEOUT 901.41 742.17 None add-sub15.yml TIMEOUT 903.84 635.49 None add-sub16.yml TIMEOUT 906.52 644.70 None add-sub17.yml TIMEOUT 906.51 618.28 None add-sub18.yml TIMEOUT 905.38 626.23 None add-sub19.yml TIMEOUT 909.65 586.60 None add-sub20.yml TIMEOUT 902.55 651.18 None add-sub21.yml TIMEOUT 905.80 601.83 None add-sub22.yml TIMEOUT 901.15 593.27 None add-sub23.yml TIMEOUT 906.17 580.82 None add-sub24.yml TIMEOUT 905.83 579.09 None add-sub25.yml TIMEOUT 902.27 602.57 None bluetooth-correct02.yml unknown 3.90 2.26 None bluetooth-correct03.yml unknown 3.68 2.19 None bluetooth-correct04.yml unknown 3.10 1.73 None bluetooth-correct05.yml unknown 3.86 2.13 None bluetooth-correct06.yml unknown 3.13 1.79 None bluetooth-correct07.yml unknown 3.90 2.12 None bluetooth-correct08.yml unknown 3.02 1.78 None bluetooth-correct09.yml unknown 3.92 2.13 None bluetooth-correct10.yml unknown 3.93 2.18 None bluetooth-customized02.yml unknown 3.07 1.74 None bluetooth-customized03.yml unknown 3.92 2.19 None bluetooth-customized04.yml unknown 2.90 1.68 None bluetooth-customized05.yml unknown 3.88 2.13 None bluetooth-customized06.yml unknown 2.93 1.69 None bluetooth-customized07.yml unknown 3.83 2.10 None bluetooth-customized08.yml unknown 3.93 2.17 None bluetooth-customized09.yml unknown 3.00 1.71 None bluetooth-customized10.yml unknown 3.85 2.34 None bluetooth-incorrect02.yml unknown 3.63 2.04 None bluetooth-incorrect03.yml unknown 2.94 1.66 None bluetooth-incorrect04.yml unknown 3.00 1.98 None bluetooth-incorrect05.yml unknown 4.00 2.23 None bluetooth-incorrect06.yml unknown 2.79 1.69 None bluetooth-incorrect07.yml unknown 3.85 2.12 None bluetooth-incorrect08.yml unknown 3.09 1.81 None bluetooth-incorrect09.yml unknown 2.88 1.68 None bluetooth-incorrect10.yml unknown 3.60 2.00 None bluetooth-serverassert01.yml unknown 4.02 2.20 None bluetooth-serverassert02.yml unknown 3.17 1.83 None bluetooth-serverassert03.yml unknown 3.05 1.79 None bluetooth-serverassert04.yml unknown 4.02 2.17 None bluetooth-serverassert05.yml unknown 3.60 2.20 None bluetooth-serverassert06.yml unknown 3.14 1.78 None bluetooth-serverassert07.yml unknown 2.74 1.59 None bluetooth-serverassert08.yml unknown 4.05 2.24 None bluetooth-serverassert09.yml unknown 3.07 1.76 None bluetooth-serverassert10.yml unknown 3.84 2.14 None incr-decr01.yml true 4.27 2.74 None incr-decr02.yml true 5.44 3.31 None incr-decr03.yml true 4.49 2.89 None incr-decr04.yml true 6.38 3.81 None incr-decr05.yml true 5.00 3.12 None incr-decr06.yml true 6.46 3.89 None incr-decr07.yml true 6.25 3.73 None incr-decr08.yml true 11.07 6.20 None incr-decr09.yml true 13.99 7.87 None incr-decr10.yml true 32.09 21.47 None incr-decr11.yml true 198.48 155.89 None incr-decr12.yml TIMEOUT 901.00 601.59 None incr-decr13.yml TIMEOUT 906.75 644.40 None incr-decr14.yml TIMEOUT 901.42 631.83 None incr-decr15.yml TIMEOUT 907.83 617.41 None incr-decr16.yml TIMEOUT 905.37 590.14 None incr-decr17.yml TIMEOUT 904.90 626.38 None incr-decr18.yml TIMEOUT 910.28 556.71 None incr-decr19.yml TIMEOUT 903.59 588.93 None incr-decr20.yml TIMEOUT 907.85 639.24 None incr-decr21.yml TIMEOUT 911.25 581.35 None incr-decr22.yml TIMEOUT 900.50 669.47 None incr-decr23.yml TIMEOUT 907.21 603.32 None incr-decr24.yml TIMEOUT 901.13 537.30 None incr-decr25.yml TIMEOUT 906.06 556.26 None --------------------------------------------------------------------------------------------- Run set 8 done 27911.35 1774.84 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderLockstep.POPL2022 Benchmarks Run set 9 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.72 3.32 None add-sub02.yml true 4.69 3.24 None add-sub03.yml true 5.30 3.53 None add-sub04.yml true 7.68 4.94 None add-sub05.yml true 10.87 6.30 None add-sub06.yml true 22.59 13.19 None add-sub07.yml OUT OF MEMORY 163.02 130.30 None add-sub08.yml OUT OF MEMORY 137.15 99.20 None add-sub09.yml OUT OF MEMORY 265.62 171.14 None add-sub10.yml OUT OF MEMORY 484.95 288.51 None add-sub11.yml OUT OF MEMORY 520.56 309.34 None add-sub12.yml OUT OF MEMORY 172.94 145.35 None add-sub13.yml OUT OF MEMORY 168.92 140.00 None add-sub14.yml OUT OF MEMORY 153.64 140.01 None add-sub15.yml OUT OF MEMORY 465.86 290.40 None add-sub16.yml OUT OF MEMORY 208.61 147.12 None add-sub17.yml OUT OF MEMORY 567.74 341.22 None add-sub18.yml OUT OF MEMORY 166.68 119.77 None add-sub19.yml OUT OF MEMORY 165.65 123.72 None add-sub20.yml OUT OF MEMORY 130.15 106.32 None add-sub21.yml OUT OF MEMORY 387.64 239.08 None add-sub22.yml OUT OF MEMORY 170.13 122.81 None add-sub23.yml OUT OF MEMORY 443.55 271.44 None add-sub24.yml OUT OF MEMORY 353.19 224.85 None add-sub25.yml OUT OF MEMORY 280.02 188.86 None bluetooth-correct02.yml unknown 3.23 1.97 None bluetooth-correct03.yml unknown 2.97 2.01 None bluetooth-correct04.yml unknown 3.12 1.88 None bluetooth-correct05.yml unknown 3.31 1.95 None bluetooth-correct06.yml unknown 2.88 1.86 None bluetooth-correct07.yml unknown 3.12 1.96 None bluetooth-correct08.yml unknown 3.14 2.37 None bluetooth-correct09.yml unknown 3.10 2.22 None bluetooth-correct10.yml unknown 3.08 1.84 None bluetooth-customized02.yml unknown 3.34 2.25 None bluetooth-customized03.yml unknown 3.07 2.07 None bluetooth-customized04.yml unknown 3.40 2.06 None bluetooth-customized05.yml unknown 3.20 2.15 None bluetooth-customized06.yml unknown 3.96 2.13 None bluetooth-customized07.yml unknown 3.11 1.86 None bluetooth-customized08.yml unknown 3.14 1.98 None bluetooth-customized09.yml unknown 3.22 1.96 None bluetooth-customized10.yml unknown 3.14 1.98 None bluetooth-incorrect02.yml unknown 3.68 2.03 None bluetooth-incorrect03.yml unknown 3.09 1.90 None bluetooth-incorrect04.yml unknown 2.93 1.78 None bluetooth-incorrect05.yml unknown 3.08 2.13 None bluetooth-incorrect06.yml unknown 3.93 2.13 None bluetooth-incorrect07.yml unknown 3.21 2.07 None bluetooth-incorrect08.yml unknown 3.17 2.25 None bluetooth-incorrect09.yml unknown 3.36 2.26 None bluetooth-incorrect10.yml unknown 3.94 2.16 None bluetooth-serverassert01.yml unknown 2.99 1.84 None bluetooth-serverassert02.yml unknown 2.95 1.89 None bluetooth-serverassert03.yml unknown 3.18 2.10 None bluetooth-serverassert04.yml unknown 3.83 2.11 None bluetooth-serverassert05.yml unknown 3.11 1.99 None bluetooth-serverassert06.yml unknown 3.07 1.88 None bluetooth-serverassert07.yml unknown 3.09 1.98 None bluetooth-serverassert08.yml unknown 4.04 2.19 None bluetooth-serverassert09.yml unknown 3.26 2.26 None bluetooth-serverassert10.yml unknown 3.02 1.88 None incr-decr01.yml true 4.60 3.11 None incr-decr02.yml true 6.67 4.27 None incr-decr03.yml true 5.40 4.17 None incr-decr04.yml true 6.06 4.18 None incr-decr05.yml true 6.40 4.23 None incr-decr06.yml true 9.10 5.81 None incr-decr07.yml true 19.88 11.90 None incr-decr08.yml true 43.08 33.80 None incr-decr09.yml OUT OF MEMORY 95.51 86.58 None incr-decr10.yml OUT OF MEMORY 100.68 85.81 None incr-decr11.yml OUT OF MEMORY 195.89 150.95 None incr-decr12.yml OUT OF MEMORY 121.58 102.09 None incr-decr13.yml OUT OF MEMORY 109.53 97.85 None incr-decr14.yml OUT OF MEMORY 130.38 117.47 None incr-decr15.yml OUT OF MEMORY 115.04 102.30 None incr-decr16.yml OUT OF MEMORY 140.28 123.20 None incr-decr17.yml OUT OF MEMORY 112.47 97.79 None incr-decr18.yml OUT OF MEMORY 239.36 163.72 None incr-decr19.yml OUT OF MEMORY 211.58 147.94 None incr-decr20.yml OUT OF MEMORY 101.90 99.18 None incr-decr21.yml OUT OF MEMORY 247.14 169.05 None incr-decr22.yml OUT OF MEMORY 274.24 179.06 None incr-decr23.yml OUT OF MEMORY 85.66 80.29 None incr-decr24.yml OUT OF MEMORY 104.91 88.24 None incr-decr25.yml OUT OF MEMORY 232.39 158.53 None --------------------------------------------------------------------------------------------- Run set 9 done 8277.97 503.81 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom42.POPL2022 Benchmarks Run set 10 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.54 3.37 None add-sub02.yml true 4.78 2.95 None add-sub03.yml true 7.85 5.15 None add-sub04.yml true 19.44 13.11 None add-sub05.yml true 44.84 32.04 None add-sub06.yml OUT OF MEMORY 693.80 438.20 None add-sub07.yml OUT OF MEMORY 119.90 97.49 None add-sub08.yml OUT OF MEMORY 170.84 129.98 None add-sub09.yml OUT OF MEMORY 512.19 356.45 None add-sub10.yml OUT OF MEMORY 109.15 86.90 None add-sub11.yml OUT OF MEMORY 621.09 392.16 None add-sub12.yml OUT OF MEMORY 132.03 114.71 None add-sub13.yml OUT OF MEMORY 86.81 76.80 None add-sub14.yml OUT OF MEMORY 104.31 91.90 None add-sub15.yml OUT OF MEMORY 125.07 101.88 None add-sub16.yml OUT OF MEMORY 681.89 414.15 None add-sub17.yml OUT OF MEMORY 485.42 299.77 None add-sub18.yml OUT OF MEMORY 156.51 128.92 None add-sub19.yml OUT OF MEMORY 167.20 138.11 None add-sub20.yml OUT OF MEMORY 176.88 156.61 None add-sub21.yml OUT OF MEMORY 398.97 253.80 None add-sub22.yml OUT OF MEMORY 148.44 141.39 None add-sub23.yml OUT OF MEMORY 433.38 268.91 None add-sub24.yml OUT OF MEMORY 132.55 111.56 None add-sub25.yml OUT OF MEMORY 135.96 123.58 None bluetooth-correct02.yml unknown 3.88 2.18 None bluetooth-correct03.yml unknown 4.12 2.24 None bluetooth-correct04.yml unknown 3.43 1.95 None bluetooth-correct05.yml unknown 3.98 2.27 None bluetooth-correct06.yml unknown 3.82 2.15 None bluetooth-correct07.yml unknown 3.91 2.43 None bluetooth-correct08.yml unknown 3.90 2.13 None bluetooth-correct09.yml unknown 3.92 2.18 None bluetooth-correct10.yml unknown 4.13 2.28 None bluetooth-customized02.yml unknown 4.14 2.30 None bluetooth-customized03.yml unknown 3.68 2.06 None bluetooth-customized04.yml unknown 3.86 2.12 None bluetooth-customized05.yml unknown 3.83 2.10 None bluetooth-customized06.yml unknown 3.98 2.26 None bluetooth-customized07.yml unknown 3.69 2.07 None bluetooth-customized08.yml unknown 4.00 2.21 None bluetooth-customized09.yml unknown 4.04 2.23 None bluetooth-customized10.yml unknown 4.02 2.23 None bluetooth-incorrect02.yml unknown 4.01 2.19 None bluetooth-incorrect03.yml unknown 3.84 2.13 None bluetooth-incorrect04.yml unknown 3.89 2.21 None bluetooth-incorrect05.yml unknown 3.68 2.06 None bluetooth-incorrect06.yml unknown 3.99 2.18 None bluetooth-incorrect07.yml unknown 4.16 2.25 None bluetooth-incorrect08.yml unknown 3.92 2.18 None bluetooth-incorrect09.yml unknown 3.83 2.11 None bluetooth-incorrect10.yml unknown 3.73 2.09 None bluetooth-serverassert01.yml unknown 3.90 2.19 None bluetooth-serverassert02.yml unknown 3.96 2.22 None bluetooth-serverassert03.yml unknown 3.94 2.17 None bluetooth-serverassert04.yml unknown 3.75 2.14 None bluetooth-serverassert05.yml unknown 3.89 2.17 None bluetooth-serverassert06.yml unknown 4.07 2.24 None bluetooth-serverassert07.yml unknown 4.01 2.24 None bluetooth-serverassert08.yml unknown 4.02 2.22 None bluetooth-serverassert09.yml unknown 3.93 2.20 None bluetooth-serverassert10.yml unknown 3.97 2.37 None incr-decr01.yml true 5.44 3.30 None incr-decr02.yml true 5.62 3.35 None incr-decr03.yml true 5.60 3.44 None incr-decr04.yml true 6.97 4.03 None incr-decr05.yml true 7.01 4.23 None incr-decr06.yml true 10.14 6.35 None incr-decr07.yml true 14.91 8.84 None incr-decr08.yml true 14.17 7.98 None incr-decr09.yml true 58.61 40.80 None incr-decr10.yml true 75.68 55.67 None incr-decr11.yml OUT OF MEMORY 116.27 95.55 None incr-decr12.yml OUT OF MEMORY 379.40 246.91 None incr-decr13.yml OUT OF MEMORY 637.03 392.96 None incr-decr14.yml TIMEOUT 901.36 638.23 None incr-decr15.yml OUT OF MEMORY 473.23 316.91 None incr-decr16.yml OUT OF MEMORY 146.28 127.72 None incr-decr17.yml OUT OF MEMORY 200.38 143.55 None incr-decr18.yml OUT OF MEMORY 156.06 122.69 None incr-decr19.yml OUT OF MEMORY 685.27 414.83 None incr-decr20.yml OUT OF MEMORY 866.78 522.25 None incr-decr21.yml OUT OF MEMORY 234.57 163.50 None incr-decr22.yml OUT OF MEMORY 156.54 153.46 None incr-decr23.yml OUT OF MEMORY 289.30 194.51 None incr-decr24.yml OUT OF MEMORY 190.66 148.36 None incr-decr25.yml OUT OF MEMORY 339.38 209.80 None --------------------------------------------------------------------------------------------- Run set 10 done 11739.90 872.78 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom521.POPL2022 Benchmarks Run set 11 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random521.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.65 3.80 None add-sub02.yml true 4.69 3.93 None add-sub03.yml true 6.53 4.73 None add-sub04.yml true 17.31 11.61 None add-sub05.yml true 88.70 71.59 None add-sub06.yml OUT OF MEMORY 404.87 287.22 None add-sub07.yml OUT OF MEMORY 516.94 353.68 None add-sub08.yml OUT OF MEMORY 489.05 312.72 None add-sub09.yml OUT OF MEMORY 105.87 92.50 None add-sub10.yml OUT OF MEMORY 292.94 192.96 None add-sub11.yml OUT OF MEMORY 134.91 107.90 None add-sub12.yml OUT OF MEMORY 93.71 87.43 None add-sub13.yml OUT OF MEMORY 99.12 82.65 None add-sub14.yml OUT OF MEMORY 203.91 174.50 None add-sub15.yml OUT OF MEMORY 444.28 334.41 None add-sub16.yml OUT OF MEMORY 843.64 513.52 None add-sub17.yml OUT OF MEMORY 353.22 226.02 None add-sub18.yml OUT OF MEMORY 146.07 121.83 None add-sub19.yml TIMEOUT 907.71 535.78 None add-sub20.yml OUT OF MEMORY 99.23 82.58 None add-sub21.yml OUT OF MEMORY 116.66 105.37 None add-sub22.yml OUT OF MEMORY 451.10 297.02 None add-sub23.yml OUT OF MEMORY 547.12 327.56 None add-sub24.yml OUT OF MEMORY 665.05 394.05 None add-sub25.yml OUT OF MEMORY 172.18 137.65 None bluetooth-correct02.yml unknown 3.00 2.19 None bluetooth-correct03.yml unknown 3.24 2.16 None bluetooth-correct04.yml unknown 2.83 2.06 None bluetooth-correct05.yml unknown 2.86 1.99 None bluetooth-correct06.yml unknown 2.98 2.21 None bluetooth-correct07.yml unknown 3.04 1.90 None bluetooth-correct08.yml unknown 3.23 2.11 None bluetooth-correct09.yml unknown 2.97 2.63 None bluetooth-correct10.yml unknown 2.91 1.64 None bluetooth-customized02.yml unknown 3.23 2.18 None bluetooth-customized03.yml unknown 3.22 2.31 None bluetooth-customized04.yml unknown 3.19 1.88 None bluetooth-customized05.yml unknown 3.24 2.19 None bluetooth-customized06.yml unknown 3.35 2.38 None bluetooth-customized07.yml unknown 3.09 1.77 None bluetooth-customized08.yml unknown 3.56 2.29 None bluetooth-customized09.yml unknown 3.01 2.52 None bluetooth-customized10.yml unknown 3.21 1.86 None bluetooth-incorrect02.yml unknown 3.36 2.22 None bluetooth-incorrect03.yml unknown 3.11 1.75 None bluetooth-incorrect04.yml unknown 3.09 2.06 None bluetooth-incorrect05.yml unknown 3.21 2.12 None bluetooth-incorrect06.yml unknown 2.98 1.70 None bluetooth-incorrect07.yml unknown 2.68 1.64 None bluetooth-incorrect08.yml unknown 2.97 1.68 None bluetooth-incorrect09.yml unknown 3.06 1.97 None bluetooth-incorrect10.yml unknown 3.08 2.04 None bluetooth-serverassert01.yml unknown 2.94 1.64 None bluetooth-serverassert02.yml unknown 3.09 1.98 None bluetooth-serverassert03.yml unknown 2.96 2.05 None bluetooth-serverassert04.yml unknown 3.02 1.70 None bluetooth-serverassert05.yml unknown 3.33 2.04 None bluetooth-serverassert06.yml unknown 3.07 2.23 None bluetooth-serverassert07.yml unknown 2.97 1.69 None bluetooth-serverassert08.yml unknown 3.38 2.50 None bluetooth-serverassert09.yml unknown 3.29 2.01 None bluetooth-serverassert10.yml unknown 3.01 1.71 None incr-decr01.yml true 3.94 3.03 None incr-decr02.yml true 4.29 2.71 None incr-decr03.yml true 5.26 3.25 None incr-decr04.yml true 5.88 4.01 None incr-decr05.yml true 6.75 5.15 None incr-decr06.yml true 8.15 6.79 None incr-decr07.yml true 11.98 7.10 None incr-decr08.yml true 16.89 12.02 None incr-decr09.yml true 18.13 13.71 None incr-decr10.yml OUT OF MEMORY 107.10 93.36 None incr-decr11.yml OUT OF MEMORY 358.38 221.77 None incr-decr12.yml OUT OF MEMORY 214.63 186.02 None incr-decr13.yml OUT OF MEMORY 145.35 134.77 None incr-decr14.yml OUT OF MEMORY 146.83 117.34 None incr-decr15.yml OUT OF MEMORY 696.91 439.42 None incr-decr16.yml OUT OF MEMORY 852.87 511.95 None incr-decr17.yml OUT OF MEMORY 523.90 317.25 None incr-decr18.yml OUT OF MEMORY 150.54 122.78 None incr-decr19.yml TIMEOUT 912.77 533.68 None incr-decr20.yml OUT OF MEMORY 301.22 250.73 None incr-decr21.yml OUT OF MEMORY 485.94 291.62 None incr-decr22.yml TIMEOUT 915.84 543.50 None incr-decr23.yml OUT OF MEMORY 108.50 105.78 None incr-decr24.yml OUT OF MEMORY 388.36 245.65 None incr-decr25.yml OUT OF MEMORY 585.16 351.29 None --------------------------------------------------------------------------------------------- Run set 11 done 14206.29 948.75 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom7777.POPL2022 Benchmarks Run set 12 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random7777.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.52 3.86 None add-sub02.yml true 4.81 3.99 None add-sub03.yml true 5.16 3.27 None add-sub04.yml true 11.30 7.14 None add-sub05.yml true 127.02 102.67 None add-sub06.yml true 140.43 109.57 None add-sub07.yml OUT OF MEMORY 307.42 219.04 None add-sub08.yml OUT OF MEMORY 129.25 106.71 None add-sub09.yml OUT OF MEMORY 114.47 90.96 None add-sub10.yml OUT OF MEMORY 110.15 90.95 None add-sub11.yml OUT OF MEMORY 202.38 147.16 None add-sub12.yml OUT OF MEMORY 191.64 157.45 None add-sub13.yml OUT OF MEMORY 484.09 321.15 None add-sub14.yml OUT OF MEMORY 99.49 90.86 None add-sub15.yml OUT OF MEMORY 892.70 543.40 None add-sub16.yml OUT OF MEMORY 406.02 260.91 None add-sub17.yml OUT OF MEMORY 676.88 409.99 None add-sub18.yml TIMEOUT 903.21 535.62 None add-sub19.yml OUT OF MEMORY 141.63 127.96 None add-sub20.yml OUT OF MEMORY 122.11 107.94 None add-sub21.yml OUT OF MEMORY 264.32 184.05 None add-sub22.yml OUT OF MEMORY 125.28 106.13 None add-sub23.yml OUT OF MEMORY 147.69 127.34 None add-sub24.yml OUT OF MEMORY 187.34 155.18 None add-sub25.yml OUT OF MEMORY 555.78 338.00 None bluetooth-correct02.yml unknown 3.10 1.89 None bluetooth-correct03.yml unknown 3.42 2.17 None bluetooth-correct04.yml unknown 3.26 2.21 None bluetooth-correct05.yml unknown 3.27 2.28 None bluetooth-correct06.yml unknown 3.25 2.23 None bluetooth-correct07.yml unknown 3.12 1.91 None bluetooth-correct08.yml unknown 3.15 2.14 None bluetooth-correct09.yml unknown 2.65 1.58 None bluetooth-correct10.yml unknown 3.27 2.38 None bluetooth-customized02.yml unknown 3.16 1.84 None bluetooth-customized03.yml unknown 3.18 2.02 None bluetooth-customized04.yml unknown 2.85 1.83 None bluetooth-customized05.yml unknown 2.79 1.94 None bluetooth-customized06.yml unknown 2.85 1.88 None bluetooth-customized07.yml unknown 3.10 2.21 None bluetooth-customized08.yml unknown 3.00 1.84 None bluetooth-customized09.yml unknown 3.22 2.16 None bluetooth-customized10.yml unknown 2.71 1.75 None bluetooth-incorrect02.yml unknown 3.10 1.95 None bluetooth-incorrect03.yml unknown 2.96 1.66 None bluetooth-incorrect04.yml unknown 3.18 2.08 None bluetooth-incorrect05.yml unknown 2.90 1.63 None bluetooth-incorrect06.yml unknown 2.91 2.03 None bluetooth-incorrect07.yml unknown 2.98 1.66 None bluetooth-incorrect08.yml unknown 2.80 1.60 None bluetooth-incorrect09.yml unknown 3.02 2.27 None bluetooth-incorrect10.yml unknown 2.91 1.73 None bluetooth-serverassert01.yml unknown 2.95 1.85 None bluetooth-serverassert02.yml unknown 2.99 1.69 None bluetooth-serverassert03.yml unknown 3.96 2.23 None bluetooth-serverassert04.yml unknown 3.22 2.20 None bluetooth-serverassert05.yml unknown 3.05 1.71 None bluetooth-serverassert06.yml unknown 3.94 2.20 None bluetooth-serverassert07.yml unknown 2.86 1.84 None bluetooth-serverassert08.yml unknown 2.89 1.66 None bluetooth-serverassert09.yml unknown 3.12 2.55 None bluetooth-serverassert10.yml unknown 3.83 2.08 None incr-decr01.yml true 3.94 2.53 None incr-decr02.yml true 6.25 4.00 None incr-decr03.yml true 4.02 2.92 None incr-decr04.yml true 5.52 3.79 None incr-decr05.yml true 5.45 3.58 None incr-decr06.yml true 5.94 4.21 None incr-decr07.yml true 11.14 7.54 None incr-decr08.yml true 13.59 7.91 None incr-decr09.yml true 68.01 53.28 None incr-decr10.yml OUT OF MEMORY 178.04 123.90 None incr-decr11.yml OUT OF MEMORY 127.31 118.30 None incr-decr12.yml OUT OF MEMORY 120.19 109.27 None incr-decr13.yml OUT OF MEMORY 107.37 97.98 None incr-decr14.yml OUT OF MEMORY 97.57 81.88 None incr-decr15.yml OUT OF MEMORY 522.46 323.25 None incr-decr16.yml OUT OF MEMORY 830.89 517.30 None incr-decr17.yml TIMEOUT 901.28 533.52 None incr-decr18.yml OUT OF MEMORY 614.43 373.98 None incr-decr19.yml OUT OF MEMORY 340.85 225.47 None incr-decr20.yml OUT OF MEMORY 144.47 127.83 None incr-decr21.yml OUT OF MEMORY 588.80 353.35 None incr-decr22.yml OUT OF MEMORY 167.37 153.63 None incr-decr23.yml OUT OF MEMORY 148.73 132.99 None incr-decr24.yml OUT OF MEMORY 279.17 179.29 None incr-decr25.yml OUT OF MEMORY 288.58 188.86 None --------------------------------------------------------------------------------------------- Run set 12 done 12009.15 808.94 - Automizer PARTIAL_ORDER_FA.NewStatesSleepUncond.POPL2022 Benchmarks Run set 13 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepUncond-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.56 3.46 None add-sub02.yml true 4.83 3.07 None add-sub03.yml true 5.27 3.45 None add-sub04.yml true 7.36 4.82 None add-sub05.yml true 9.61 5.35 None add-sub06.yml true 14.53 7.94 None add-sub07.yml true 21.78 12.82 None add-sub08.yml true 74.82 51.01 None add-sub09.yml OUT OF MEMORY 158.11 127.03 None add-sub10.yml TIMEOUT 900.57 682.33 None add-sub11.yml TIMEOUT 901.87 660.12 None add-sub12.yml TIMEOUT 901.83 756.83 None add-sub13.yml TIMEOUT 904.20 687.33 None add-sub14.yml TIMEOUT 906.66 745.15 None add-sub15.yml TIMEOUT 903.25 626.74 None add-sub16.yml TIMEOUT 905.41 651.77 None add-sub17.yml TIMEOUT 903.61 581.56 None add-sub18.yml TIMEOUT 906.43 636.01 None add-sub19.yml TIMEOUT 906.60 570.41 None add-sub20.yml TIMEOUT 907.80 682.37 None add-sub21.yml TIMEOUT 905.28 619.75 None add-sub22.yml TIMEOUT 908.57 614.84 None add-sub23.yml TIMEOUT 903.25 585.43 None add-sub24.yml TIMEOUT 903.80 590.46 None add-sub25.yml TIMEOUT 906.54 605.33 None bluetooth-correct02.yml unknown 3.09 1.80 None bluetooth-correct03.yml unknown 2.92 1.67 None bluetooth-correct04.yml unknown 3.30 1.96 None bluetooth-correct05.yml unknown 2.95 1.67 None bluetooth-correct06.yml unknown 3.16 1.81 None bluetooth-correct07.yml unknown 3.28 1.87 None bluetooth-correct08.yml unknown 3.32 1.90 None bluetooth-correct09.yml unknown 3.01 1.72 None bluetooth-correct10.yml unknown 3.16 1.83 None bluetooth-customized02.yml unknown 3.16 1.86 None bluetooth-customized03.yml unknown 3.19 1.80 None bluetooth-customized04.yml unknown 3.86 2.10 None bluetooth-customized05.yml unknown 3.04 1.77 None bluetooth-customized06.yml unknown 2.98 1.77 None bluetooth-customized07.yml unknown 3.76 2.08 None bluetooth-customized08.yml unknown 2.89 1.66 None bluetooth-customized09.yml unknown 3.16 1.85 None bluetooth-customized10.yml unknown 3.84 2.12 None bluetooth-incorrect02.yml unknown 3.11 1.76 None bluetooth-incorrect03.yml unknown 3.21 1.90 None bluetooth-incorrect04.yml unknown 3.16 1.83 None bluetooth-incorrect05.yml unknown 3.97 2.19 None bluetooth-incorrect06.yml unknown 2.92 1.85 None bluetooth-incorrect07.yml unknown 3.08 1.77 None bluetooth-incorrect08.yml unknown 3.82 2.16 None bluetooth-incorrect09.yml unknown 3.27 1.96 None bluetooth-incorrect10.yml unknown 2.87 1.64 None bluetooth-serverassert01.yml unknown 3.89 2.18 None bluetooth-serverassert02.yml unknown 3.17 1.81 None bluetooth-serverassert03.yml unknown 3.01 1.72 None bluetooth-serverassert04.yml unknown 3.99 2.20 None bluetooth-serverassert05.yml unknown 3.19 1.81 None bluetooth-serverassert06.yml unknown 3.87 2.13 None bluetooth-serverassert07.yml unknown 2.95 1.65 None bluetooth-serverassert08.yml unknown 3.02 1.80 None bluetooth-serverassert09.yml unknown 3.05 1.74 None bluetooth-serverassert10.yml unknown 3.90 2.16 None incr-decr01.yml true 5.12 3.14 None incr-decr02.yml true 4.18 2.82 None incr-decr03.yml true 4.44 2.96 None incr-decr04.yml true 6.15 3.60 None incr-decr05.yml true 5.09 3.26 None incr-decr06.yml true 6.83 4.05 None incr-decr07.yml true 5.90 3.67 None incr-decr08.yml true 7.67 4.48 None incr-decr09.yml true 18.17 10.33 None incr-decr10.yml true 33.35 22.73 None incr-decr11.yml true 190.30 146.36 None incr-decr12.yml TIMEOUT 900.90 653.32 None incr-decr13.yml TIMEOUT 906.18 635.71 None incr-decr14.yml TIMEOUT 904.13 605.68 None incr-decr15.yml TIMEOUT 901.27 622.02 None incr-decr16.yml TIMEOUT 907.82 564.97 None incr-decr17.yml TIMEOUT 906.78 598.33 None incr-decr18.yml TIMEOUT 910.44 607.59 None incr-decr19.yml TIMEOUT 904.67 613.70 None incr-decr20.yml TIMEOUT 907.25 563.36 None incr-decr21.yml TIMEOUT 905.38 639.21 None incr-decr22.yml TIMEOUT 910.56 646.33 None incr-decr23.yml TIMEOUT 901.17 584.30 None incr-decr24.yml TIMEOUT 909.66 546.41 None incr-decr25.yml TIMEOUT 908.80 560.51 None --------------------------------------------------------------------------------------------- Run set 13 done 27870.08 1751.93 - Automizer PARTIAL_ORDER_FA.Persistent.POPL2022 Benchmarks Run set 14 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-Persistent-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.00 3.21 None add-sub02.yml true 5.16 4.23 None add-sub03.yml true 5.33 3.88 None add-sub04.yml true 10.03 7.00 None add-sub05.yml true 19.50 14.09 None add-sub06.yml true 33.02 24.87 None add-sub07.yml true 55.86 51.27 None add-sub08.yml true 156.63 142.78 None add-sub09.yml true 475.85 354.17 None add-sub10.yml OUT OF MEMORY 728.83 479.81 None add-sub11.yml OUT OF MEMORY 817.29 538.14 None add-sub12.yml OUT OF MEMORY 806.69 594.49 None add-sub13.yml TIMEOUT 920.39 653.29 None add-sub14.yml TIMEOUT 916.13 657.99 None add-sub15.yml TIMEOUT 908.99 611.85 None add-sub16.yml TIMEOUT 911.94 626.34 None add-sub17.yml TIMEOUT 916.38 642.79 None add-sub18.yml TIMEOUT 907.58 641.35 None add-sub19.yml TIMEOUT 911.41 668.42 None add-sub20.yml TIMEOUT 914.72 679.69 None add-sub21.yml TIMEOUT 908.96 672.73 None add-sub22.yml TIMEOUT 910.08 692.71 None add-sub23.yml TIMEOUT 903.38 708.17 None add-sub24.yml TIMEOUT 911.32 724.32 None add-sub25.yml TIMEOUT 908.96 725.29 None bluetooth-correct02.yml unknown 2.94 1.79 None bluetooth-correct03.yml unknown 2.80 1.85 None bluetooth-correct04.yml unknown 3.27 2.14 None bluetooth-correct05.yml unknown 3.29 2.17 None bluetooth-correct06.yml unknown 3.21 2.13 None bluetooth-correct07.yml unknown 3.03 1.81 None bluetooth-correct08.yml unknown 2.93 2.01 None bluetooth-correct09.yml unknown 2.94 2.21 None bluetooth-correct10.yml unknown 2.79 2.44 None bluetooth-customized02.yml unknown 3.68 2.03 None bluetooth-customized03.yml unknown 3.24 1.94 None bluetooth-customized04.yml unknown 3.70 2.09 None bluetooth-customized05.yml unknown 3.21 2.04 None bluetooth-customized06.yml unknown 3.96 2.17 None bluetooth-customized07.yml unknown 3.15 2.48 None bluetooth-customized08.yml unknown 3.83 2.11 None bluetooth-customized09.yml unknown 3.05 2.08 None bluetooth-customized10.yml unknown 3.95 2.19 None bluetooth-incorrect02.yml unknown 3.36 2.01 None bluetooth-incorrect03.yml unknown 3.97 2.22 None bluetooth-incorrect04.yml unknown 3.20 2.20 None bluetooth-incorrect05.yml unknown 3.73 2.08 None bluetooth-incorrect06.yml unknown 3.07 1.77 None bluetooth-incorrect07.yml unknown 2.85 1.62 None bluetooth-incorrect08.yml unknown 2.88 1.78 None bluetooth-incorrect09.yml unknown 3.68 2.02 None bluetooth-incorrect10.yml unknown 2.91 1.77 None bluetooth-serverassert01.yml unknown 3.17 2.13 None bluetooth-serverassert02.yml unknown 3.74 2.11 None bluetooth-serverassert03.yml unknown 2.87 1.81 None bluetooth-serverassert04.yml unknown 3.19 2.10 None bluetooth-serverassert05.yml unknown 3.78 2.11 None bluetooth-serverassert06.yml unknown 2.74 1.60 None bluetooth-serverassert07.yml unknown 2.77 1.64 None bluetooth-serverassert08.yml unknown 2.97 1.73 None bluetooth-serverassert09.yml unknown 3.97 2.16 None bluetooth-serverassert10.yml unknown 2.94 1.69 None incr-decr01.yml true 4.05 2.67 None incr-decr02.yml true 5.94 3.77 None incr-decr03.yml true 4.68 3.15 None incr-decr04.yml true 5.43 3.72 None incr-decr05.yml true 7.17 4.39 None incr-decr06.yml true 6.37 4.03 None incr-decr07.yml true 6.87 4.56 None incr-decr08.yml true 7.59 4.71 None incr-decr09.yml true 10.88 6.34 None incr-decr10.yml true 10.11 5.99 None incr-decr11.yml true 18.44 10.38 None incr-decr12.yml true 21.35 16.81 None incr-decr13.yml true 48.09 39.33 None incr-decr14.yml true 169.89 157.69 None incr-decr15.yml TIMEOUT 911.82 707.10 None incr-decr16.yml TIMEOUT 922.06 698.39 None incr-decr17.yml TIMEOUT 914.66 738.76 None incr-decr18.yml TIMEOUT 908.19 690.99 None incr-decr19.yml TIMEOUT 909.49 745.58 None incr-decr20.yml TIMEOUT 922.23 626.63 None incr-decr21.yml TIMEOUT 914.45 618.15 None incr-decr22.yml TIMEOUT 917.49 652.29 None incr-decr23.yml TIMEOUT 920.93 617.11 None incr-decr24.yml TIMEOUT 922.27 596.38 None incr-decr25.yml TIMEOUT 922.09 620.47 None --------------------------------------------------------------------------------------------- Run set 14 done 23797.64 1457.96 - Automizer PARTIAL_ORDER_FA.DelaySleepPersistent.POPL2022 Benchmarks Run set 15 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleepPersistent-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.62 3.22 None add-sub02.yml true 5.05 3.69 None add-sub03.yml true 5.94 4.19 None add-sub04.yml true 11.63 8.09 None add-sub05.yml true 21.12 14.27 None add-sub06.yml true 47.12 35.49 None add-sub07.yml true 83.88 75.38 None add-sub08.yml true 641.74 433.92 None add-sub09.yml TIMEOUT 914.38 582.04 None add-sub10.yml TIMEOUT 908.37 571.72 None add-sub11.yml TIMEOUT 918.17 584.97 None add-sub12.yml OUT OF MEMORY 584.06 543.71 None add-sub13.yml TIMEOUT 900.58 644.31 None add-sub14.yml TIMEOUT 912.85 663.85 None add-sub15.yml TIMEOUT 900.54 596.10 None add-sub16.yml TIMEOUT 901.58 653.27 None add-sub17.yml TIMEOUT 914.26 651.18 None add-sub18.yml TIMEOUT 900.89 655.39 None add-sub19.yml TIMEOUT 900.87 642.87 None add-sub20.yml TIMEOUT 900.88 662.81 None add-sub21.yml TIMEOUT 901.28 697.59 None add-sub22.yml TIMEOUT 901.49 696.32 None add-sub23.yml TIMEOUT 901.30 832.51 None add-sub24.yml TIMEOUT 900.96 727.27 None add-sub25.yml TIMEOUT 901.11 726.93 None bluetooth-correct02.yml unknown 2.97 1.68 None bluetooth-correct03.yml unknown 3.04 1.77 None bluetooth-correct04.yml unknown 3.09 1.78 None bluetooth-correct05.yml unknown 3.09 1.80 None bluetooth-correct06.yml unknown 2.91 1.69 None bluetooth-correct07.yml unknown 2.98 1.74 None bluetooth-correct08.yml unknown 3.19 1.81 None bluetooth-correct09.yml unknown 3.00 1.71 None bluetooth-correct10.yml unknown 3.97 2.15 None bluetooth-customized02.yml unknown 3.09 1.81 None bluetooth-customized03.yml unknown 3.61 2.04 None bluetooth-customized04.yml unknown 3.20 1.82 None bluetooth-customized05.yml unknown 3.72 2.13 None bluetooth-customized06.yml unknown 2.92 1.80 None bluetooth-customized07.yml unknown 3.79 2.16 None bluetooth-customized08.yml unknown 2.92 1.68 None bluetooth-customized09.yml unknown 2.97 1.70 None bluetooth-customized10.yml unknown 3.65 2.03 None bluetooth-incorrect02.yml unknown 3.09 1.78 None bluetooth-incorrect03.yml unknown 3.67 2.06 None bluetooth-incorrect04.yml unknown 2.87 1.71 None bluetooth-incorrect05.yml unknown 3.89 2.11 None bluetooth-incorrect06.yml unknown 3.15 1.81 None bluetooth-incorrect07.yml unknown 3.82 2.09 None bluetooth-incorrect08.yml unknown 3.10 1.75 None bluetooth-incorrect09.yml unknown 3.88 2.12 None bluetooth-incorrect10.yml unknown 3.02 1.74 None bluetooth-serverassert01.yml unknown 3.81 2.13 None bluetooth-serverassert02.yml unknown 3.00 1.72 None bluetooth-serverassert03.yml unknown 2.83 1.62 None bluetooth-serverassert04.yml unknown 3.65 2.02 None bluetooth-serverassert05.yml unknown 3.18 1.81 None bluetooth-serverassert06.yml unknown 3.80 2.13 None bluetooth-serverassert07.yml unknown 2.88 1.70 None bluetooth-serverassert08.yml unknown 3.85 2.16 None bluetooth-serverassert09.yml unknown 2.97 1.68 None bluetooth-serverassert10.yml unknown 3.80 2.16 None incr-decr01.yml true 4.34 2.77 None incr-decr02.yml true 5.87 3.76 None incr-decr03.yml true 4.97 3.12 None incr-decr04.yml true 6.73 4.08 None incr-decr05.yml true 5.80 3.74 None incr-decr06.yml true 7.35 4.54 None incr-decr07.yml true 6.96 4.40 None incr-decr08.yml true 7.19 4.85 None incr-decr09.yml true 11.53 6.55 None incr-decr10.yml true 10.86 6.43 None incr-decr11.yml true 14.63 8.92 None incr-decr12.yml true 26.55 17.04 None incr-decr13.yml true 56.69 44.10 None incr-decr14.yml true 177.88 162.00 None incr-decr15.yml TIMEOUT 902.11 654.87 None incr-decr16.yml TIMEOUT 907.01 670.10 None incr-decr17.yml TIMEOUT 900.99 703.67 None incr-decr18.yml TIMEOUT 901.17 749.83 None incr-decr19.yml TIMEOUT 907.57 675.36 None incr-decr20.yml TIMEOUT 903.11 606.60 None incr-decr21.yml TIMEOUT 901.14 627.38 None incr-decr22.yml TIMEOUT 903.06 644.21 None incr-decr23.yml TIMEOUT 907.71 568.74 None incr-decr24.yml TIMEOUT 909.05 541.97 None incr-decr25.yml TIMEOUT 909.61 572.07 None --------------------------------------------------------------------------------------------- Run set 15 done 22964.03 1703.87 - Automizer PARTIAL_ORDER_FA.DelaySleepPersistentFixedOrder.POPL2022 Benchmarks Run set 16 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleepPersistentFixedOrder-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.25 3.30 None add-sub02.yml true 4.25 2.83 None add-sub03.yml true 5.09 3.17 None add-sub04.yml true 6.81 4.13 None add-sub05.yml true 7.86 4.79 None add-sub06.yml true 8.88 6.67 None add-sub07.yml true 7.59 4.46 None add-sub08.yml true 10.96 6.29 None add-sub09.yml true 9.30 5.27 None add-sub10.yml true 10.25 6.03 None add-sub11.yml true 11.11 6.38 None add-sub12.yml true 12.54 7.83 None add-sub13.yml true 14.38 8.75 None add-sub14.yml true 15.27 9.83 None add-sub15.yml true 16.74 9.45 None add-sub16.yml true 18.65 10.59 None add-sub17.yml true 25.78 14.58 None add-sub18.yml true 29.72 16.45 None add-sub19.yml true 24.65 14.60 None add-sub20.yml true 36.35 20.91 None add-sub21.yml true 30.93 18.79 None add-sub22.yml true 35.33 22.47 None add-sub23.yml true 53.61 33.36 None add-sub24.yml true 53.12 37.53 None add-sub25.yml true 83.25 59.19 None bluetooth-correct02.yml unknown 3.03 2.04 None bluetooth-correct03.yml unknown 3.15 1.94 None bluetooth-correct04.yml unknown 3.01 2.04 None bluetooth-correct05.yml unknown 3.08 2.20 None bluetooth-correct06.yml unknown 3.02 1.93 None bluetooth-correct07.yml unknown 3.17 2.34 None bluetooth-correct08.yml unknown 3.03 1.68 None bluetooth-correct09.yml unknown 3.10 1.94 None bluetooth-correct10.yml unknown 3.10 1.79 None bluetooth-customized02.yml unknown 3.14 1.74 None bluetooth-customized03.yml unknown 2.99 1.69 None bluetooth-customized04.yml unknown 3.15 2.24 None bluetooth-customized05.yml unknown 3.09 2.10 None bluetooth-customized06.yml unknown 2.95 1.72 None bluetooth-customized07.yml unknown 2.86 1.60 None bluetooth-customized08.yml unknown 2.98 1.70 None bluetooth-customized09.yml unknown 3.06 1.82 None bluetooth-customized10.yml unknown 3.18 1.93 None bluetooth-incorrect02.yml unknown 3.16 1.95 None bluetooth-incorrect03.yml unknown 2.86 1.64 None bluetooth-incorrect04.yml unknown 3.72 2.07 None bluetooth-incorrect05.yml unknown 3.05 1.78 None bluetooth-incorrect06.yml unknown 2.99 1.95 None bluetooth-incorrect07.yml unknown 3.15 1.82 None bluetooth-incorrect08.yml unknown 3.18 2.31 None bluetooth-incorrect09.yml unknown 2.67 1.55 None bluetooth-incorrect10.yml unknown 2.99 1.67 None bluetooth-serverassert01.yml unknown 3.14 1.74 None bluetooth-serverassert02.yml unknown 3.66 2.00 None bluetooth-serverassert03.yml unknown 3.95 2.13 None bluetooth-serverassert04.yml unknown 3.02 1.72 None bluetooth-serverassert05.yml unknown 3.32 2.19 None bluetooth-serverassert06.yml unknown 3.09 1.91 None bluetooth-serverassert07.yml unknown 2.93 1.66 None bluetooth-serverassert08.yml unknown 3.21 2.43 None bluetooth-serverassert09.yml unknown 3.09 1.78 None bluetooth-serverassert10.yml unknown 3.84 2.11 None incr-decr01.yml true 4.44 2.83 None incr-decr02.yml true 5.24 3.25 None incr-decr03.yml true 4.61 3.00 None incr-decr04.yml true 4.70 3.22 None incr-decr05.yml true 5.07 3.43 None incr-decr06.yml true 4.95 3.14 None incr-decr07.yml true 5.37 3.95 None incr-decr08.yml true 5.20 3.23 None incr-decr09.yml true 7.44 4.32 None incr-decr10.yml true 7.70 4.49 None incr-decr11.yml true 6.30 3.83 None incr-decr12.yml true 5.99 3.81 None incr-decr13.yml true 8.06 4.69 None incr-decr14.yml true 6.40 4.17 None incr-decr15.yml true 6.79 4.13 None incr-decr16.yml true 7.29 4.56 None incr-decr17.yml true 7.35 4.38 None incr-decr18.yml true 7.96 5.62 None incr-decr19.yml true 8.23 4.86 None incr-decr20.yml true 11.47 6.63 None incr-decr21.yml true 10.48 6.35 None incr-decr22.yml true 11.60 7.50 None incr-decr23.yml true 18.68 12.84 None incr-decr24.yml true 21.14 17.31 None incr-decr25.yml true 36.32 29.66 None --------------------------------------------------------------------------------------------- Run set 16 done 882.84 66.33 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.POPL2022 Benchmarks Run set 17 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.61 3.47 None add-sub02.yml true 4.63 3.00 None add-sub03.yml true 5.25 3.35 None add-sub04.yml true 6.80 4.09 None add-sub05.yml true 8.67 4.95 None add-sub06.yml true 9.48 5.37 None add-sub07.yml true 8.41 4.76 None add-sub08.yml true 10.77 6.20 None add-sub09.yml true 9.35 5.33 None add-sub10.yml true 11.65 7.16 None add-sub11.yml true 12.52 7.00 None add-sub12.yml true 14.48 8.22 None add-sub13.yml true 15.27 8.83 None add-sub14.yml true 16.21 12.53 None add-sub15.yml true 19.93 11.47 None add-sub16.yml true 23.73 13.53 None add-sub17.yml true 37.26 20.86 None add-sub18.yml true 43.84 26.02 None add-sub19.yml true 43.53 31.04 None add-sub20.yml true 73.01 52.55 None add-sub21.yml true 93.29 77.61 None add-sub22.yml true 184.40 162.51 None add-sub23.yml true 330.72 305.48 None add-sub24.yml true 583.69 562.80 None add-sub25.yml TIMEOUT 900.67 882.64 None bluetooth-correct02.yml unknown 3.33 2.23 None bluetooth-correct03.yml unknown 2.86 1.87 None bluetooth-correct04.yml unknown 3.55 2.41 None bluetooth-correct05.yml unknown 3.12 2.35 None bluetooth-correct06.yml unknown 2.81 1.85 None bluetooth-correct07.yml unknown 3.19 2.27 None bluetooth-correct08.yml unknown 3.27 2.10 None bluetooth-correct09.yml unknown 3.29 1.86 None bluetooth-correct10.yml unknown 3.08 1.95 None bluetooth-customized02.yml unknown 3.49 2.55 None bluetooth-customized03.yml unknown 3.01 1.88 None bluetooth-customized04.yml unknown 3.12 1.80 None bluetooth-customized05.yml unknown 2.94 1.81 None bluetooth-customized06.yml unknown 3.16 2.04 None bluetooth-customized07.yml unknown 3.27 2.12 None bluetooth-customized08.yml unknown 3.25 2.03 None bluetooth-customized09.yml unknown 2.99 1.71 None bluetooth-customized10.yml unknown 3.04 1.97 None bluetooth-incorrect02.yml unknown 3.10 1.94 None bluetooth-incorrect03.yml unknown 3.04 1.87 None bluetooth-incorrect04.yml unknown 3.21 1.85 None bluetooth-incorrect05.yml unknown 3.30 2.11 None bluetooth-incorrect06.yml unknown 3.03 1.89 None bluetooth-incorrect07.yml unknown 2.89 1.67 None bluetooth-incorrect08.yml unknown 2.99 1.87 None bluetooth-incorrect09.yml unknown 3.18 1.80 None bluetooth-incorrect10.yml unknown 2.97 1.96 None bluetooth-serverassert01.yml unknown 3.27 2.19 None bluetooth-serverassert02.yml unknown 3.13 1.79 None bluetooth-serverassert03.yml unknown 3.00 2.02 None bluetooth-serverassert04.yml unknown 3.82 2.09 None bluetooth-serverassert05.yml unknown 3.16 1.81 None bluetooth-serverassert06.yml unknown 2.89 1.86 None bluetooth-serverassert07.yml unknown 2.97 1.73 None bluetooth-serverassert08.yml unknown 3.41 2.02 None bluetooth-serverassert09.yml unknown 3.10 1.80 None bluetooth-serverassert10.yml unknown 3.23 1.98 None incr-decr01.yml true 5.65 3.39 None incr-decr02.yml true 4.56 2.98 None incr-decr03.yml true 4.44 3.44 None incr-decr04.yml true 5.17 4.37 None incr-decr05.yml true 5.24 3.31 None incr-decr06.yml true 4.71 3.21 None incr-decr07.yml true 5.47 3.40 None incr-decr08.yml true 7.75 4.51 None incr-decr09.yml true 6.98 4.16 None incr-decr10.yml true 6.17 4.34 None incr-decr11.yml true 6.23 3.86 None incr-decr12.yml true 6.24 3.97 None incr-decr13.yml true 6.84 5.36 None incr-decr14.yml true 6.95 4.08 None incr-decr15.yml true 9.29 5.27 None incr-decr16.yml true 10.16 5.76 None incr-decr17.yml true 8.15 5.05 None incr-decr18.yml true 9.02 5.30 None incr-decr19.yml true 10.44 6.09 None incr-decr20.yml true 12.00 7.90 None incr-decr21.yml true 16.09 12.07 None incr-decr22.yml true 19.85 14.57 None incr-decr23.yml true 33.81 26.44 None incr-decr24.yml true 49.09 43.79 None incr-decr25.yml true 93.78 85.21 None --------------------------------------------------------------------------------------------- Run set 17 done 2940.06 890.82 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderLockstep.POPL2022 Benchmarks Run set 18 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.87 3.52 None add-sub02.yml true 5.07 3.45 None add-sub03.yml true 5.30 3.62 None add-sub04.yml true 7.76 4.93 None add-sub05.yml true 9.43 5.57 None add-sub06.yml true 18.43 10.34 None add-sub07.yml true 43.89 28.87 None add-sub08.yml true 195.22 141.63 None add-sub09.yml OUT OF MEMORY 540.22 372.48 None add-sub10.yml TIMEOUT 902.76 620.63 None add-sub11.yml TIMEOUT 904.10 579.12 None add-sub12.yml TIMEOUT 901.99 865.56 None add-sub13.yml TIMEOUT 901.22 869.20 None add-sub14.yml TIMEOUT 901.16 859.19 None add-sub15.yml TIMEOUT 901.10 732.95 None add-sub16.yml TIMEOUT 901.37 702.33 None add-sub17.yml TIMEOUT 900.87 741.65 None add-sub18.yml TIMEOUT 902.22 704.25 None add-sub19.yml TIMEOUT 901.23 708.47 None add-sub20.yml TIMEOUT 901.56 712.93 None add-sub21.yml TIMEOUT 901.68 747.21 None add-sub22.yml TIMEOUT 902.32 735.13 None add-sub23.yml TIMEOUT 900.70 783.18 None add-sub24.yml TIMEOUT 901.27 805.41 None add-sub25.yml TIMEOUT 902.29 829.25 None bluetooth-correct02.yml unknown 3.89 2.17 None bluetooth-correct03.yml unknown 3.77 2.12 None bluetooth-correct04.yml unknown 4.00 2.14 None bluetooth-correct05.yml unknown 3.93 2.15 None bluetooth-correct06.yml unknown 3.72 2.09 None bluetooth-correct07.yml unknown 3.97 2.12 None bluetooth-correct08.yml unknown 3.61 2.00 None bluetooth-correct09.yml unknown 3.79 2.13 None bluetooth-correct10.yml unknown 3.62 2.01 None bluetooth-customized02.yml unknown 3.86 2.14 None bluetooth-customized03.yml unknown 4.02 2.17 None bluetooth-customized04.yml unknown 3.85 2.13 None bluetooth-customized05.yml unknown 3.90 2.11 None bluetooth-customized06.yml unknown 3.57 1.97 None bluetooth-customized07.yml unknown 3.77 2.06 None bluetooth-customized08.yml unknown 3.68 2.01 None bluetooth-customized09.yml unknown 3.50 1.96 None bluetooth-customized10.yml unknown 3.75 2.07 None bluetooth-incorrect02.yml unknown 3.88 2.14 None bluetooth-incorrect03.yml unknown 3.89 2.16 None bluetooth-incorrect04.yml unknown 3.86 2.13 None bluetooth-incorrect05.yml unknown 3.78 2.10 None bluetooth-incorrect06.yml unknown 3.88 2.13 None bluetooth-incorrect07.yml unknown 4.11 2.35 None bluetooth-incorrect08.yml unknown 3.90 2.13 None bluetooth-incorrect09.yml unknown 3.73 2.10 None bluetooth-incorrect10.yml unknown 3.54 1.99 None bluetooth-serverassert01.yml unknown 3.99 2.18 None bluetooth-serverassert02.yml unknown 3.79 2.19 None bluetooth-serverassert03.yml unknown 3.79 2.09 None bluetooth-serverassert04.yml unknown 3.83 2.07 None bluetooth-serverassert05.yml unknown 3.91 2.16 None bluetooth-serverassert06.yml unknown 4.00 2.18 None bluetooth-serverassert07.yml unknown 3.84 2.12 None bluetooth-serverassert08.yml unknown 3.75 2.14 None bluetooth-serverassert09.yml unknown 4.02 2.21 None bluetooth-serverassert10.yml unknown 3.90 2.19 None incr-decr01.yml true 5.40 3.30 None incr-decr02.yml true 6.41 4.23 None incr-decr03.yml true 6.83 4.06 None incr-decr04.yml true 7.10 4.36 None incr-decr05.yml true 6.31 4.02 None incr-decr06.yml true 9.94 5.81 None incr-decr07.yml true 14.01 8.00 None incr-decr08.yml true 29.58 19.18 None incr-decr09.yml true 67.39 51.44 None incr-decr10.yml true 251.59 219.00 None incr-decr11.yml OUT OF MEMORY 882.04 570.39 None incr-decr12.yml TIMEOUT 908.80 628.55 None incr-decr13.yml TIMEOUT 901.07 698.41 None incr-decr14.yml TIMEOUT 900.71 730.09 None incr-decr15.yml TIMEOUT 903.80 650.63 None incr-decr16.yml TIMEOUT 902.46 645.12 None incr-decr17.yml TIMEOUT 911.53 717.60 None incr-decr18.yml TIMEOUT 901.64 683.47 None incr-decr19.yml TIMEOUT 906.61 658.37 None incr-decr20.yml TIMEOUT 904.11 640.59 None incr-decr21.yml TIMEOUT 909.21 640.44 None incr-decr22.yml TIMEOUT 906.04 641.33 None incr-decr23.yml TIMEOUT 909.68 678.96 None incr-decr24.yml TIMEOUT 903.88 735.93 None incr-decr25.yml TIMEOUT 901.10 861.15 None --------------------------------------------------------------------------------------------- Run set 18 done 24082.64 2247.67 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom42.POPL2022 Benchmarks Run set 19 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.46 3.30 None add-sub02.yml true 4.64 3.11 None add-sub03.yml true 8.26 5.47 None add-sub04.yml true 22.91 14.85 None add-sub05.yml true 56.91 44.26 None add-sub06.yml OUT OF MEMORY 381.71 343.97 None add-sub07.yml OUT OF MEMORY 424.29 374.52 None add-sub08.yml OUT OF MEMORY 604.62 533.98 None add-sub09.yml OUT OF MEMORY 686.44 584.65 None add-sub10.yml TIMEOUT 901.40 840.81 None add-sub11.yml TIMEOUT 901.52 739.45 None add-sub12.yml OUT OF MEMORY 704.43 681.74 None add-sub13.yml OUT OF MEMORY 243.08 218.66 None add-sub14.yml OUT OF MEMORY 502.73 484.97 None add-sub15.yml TIMEOUT 901.16 846.06 None add-sub16.yml TIMEOUT 900.74 799.65 None add-sub17.yml TIMEOUT 900.96 867.12 None add-sub18.yml TIMEOUT 900.95 809.81 None add-sub19.yml TIMEOUT 905.76 784.22 None add-sub20.yml TIMEOUT 900.97 876.79 None add-sub21.yml TIMEOUT 902.94 847.16 None add-sub22.yml TIMEOUT 901.06 861.57 None add-sub23.yml TIMEOUT 900.86 890.99 None add-sub24.yml TIMEOUT 902.23 860.42 None add-sub25.yml TIMEOUT 904.86 782.17 None bluetooth-correct02.yml unknown 2.93 2.20 None bluetooth-correct03.yml unknown 3.21 2.42 None bluetooth-correct04.yml unknown 3.29 2.27 None bluetooth-correct05.yml unknown 3.30 2.46 None bluetooth-correct06.yml unknown 3.24 2.40 None bluetooth-correct07.yml unknown 3.10 2.50 None bluetooth-correct08.yml unknown 3.05 1.97 None bluetooth-correct09.yml unknown 3.29 2.14 None bluetooth-correct10.yml unknown 3.31 2.45 None bluetooth-customized02.yml unknown 3.21 2.09 None bluetooth-customized03.yml unknown 3.25 2.17 None bluetooth-customized04.yml unknown 2.95 2.11 None bluetooth-customized05.yml unknown 2.97 3.02 None bluetooth-customized06.yml unknown 3.49 2.35 None bluetooth-customized07.yml unknown 3.09 2.48 None bluetooth-customized08.yml unknown 3.09 2.21 None bluetooth-customized09.yml unknown 2.95 2.33 None bluetooth-customized10.yml unknown 2.97 1.82 None bluetooth-incorrect02.yml unknown 3.10 2.09 None bluetooth-incorrect03.yml unknown 2.99 1.91 None bluetooth-incorrect04.yml unknown 3.12 2.31 None bluetooth-incorrect05.yml unknown 3.17 2.26 None bluetooth-incorrect06.yml unknown 3.26 2.43 None bluetooth-incorrect07.yml unknown 3.21 2.02 None bluetooth-incorrect08.yml unknown 3.15 1.84 None bluetooth-incorrect09.yml unknown 3.75 2.30 None bluetooth-incorrect10.yml unknown 3.21 1.86 None bluetooth-serverassert01.yml unknown 3.44 2.36 None bluetooth-serverassert02.yml unknown 3.19 1.88 None bluetooth-serverassert03.yml unknown 3.41 2.31 None bluetooth-serverassert04.yml unknown 3.47 1.92 None bluetooth-serverassert05.yml unknown 3.15 1.85 None bluetooth-serverassert06.yml unknown 3.35 2.06 None bluetooth-serverassert07.yml unknown 3.31 1.92 None bluetooth-serverassert08.yml unknown 3.42 2.24 None bluetooth-serverassert09.yml unknown 3.23 1.86 None bluetooth-serverassert10.yml unknown 3.02 1.87 None incr-decr01.yml true 4.76 3.06 None incr-decr02.yml true 5.11 3.44 None incr-decr03.yml true 5.25 3.35 None incr-decr04.yml true 5.87 4.22 None incr-decr05.yml true 7.36 4.38 None incr-decr06.yml true 11.94 7.75 None incr-decr07.yml true 30.78 20.65 None incr-decr08.yml true 24.35 16.72 None incr-decr09.yml true 359.67 327.87 None incr-decr10.yml OUT OF MEMORY 230.47 216.21 None incr-decr11.yml TIMEOUT 900.78 824.92 None incr-decr12.yml OUT OF MEMORY 469.54 410.47 None incr-decr13.yml TIMEOUT 900.44 739.09 None incr-decr14.yml TIMEOUT 904.92 679.79 None incr-decr15.yml TIMEOUT 901.30 787.91 None incr-decr16.yml TIMEOUT 900.91 863.07 None incr-decr17.yml TIMEOUT 900.88 879.68 None incr-decr18.yml TIMEOUT 900.96 864.28 None incr-decr19.yml TIMEOUT 900.64 728.48 None incr-decr20.yml TIMEOUT 904.00 704.95 None incr-decr21.yml TIMEOUT 900.86 866.66 None incr-decr22.yml TIMEOUT 901.20 829.71 None incr-decr23.yml TIMEOUT 900.81 870.53 None incr-decr24.yml TIMEOUT 900.66 890.62 None incr-decr25.yml TIMEOUT 900.84 867.41 None --------------------------------------------------------------------------------------------- Run set 19 done 29218.62 2267.86 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom521.POPL2022 Benchmarks Run set 20 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random521.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.62 3.44 None add-sub02.yml true 5.65 3.50 None add-sub03.yml true 6.82 4.62 None add-sub04.yml true 20.46 13.40 None add-sub05.yml true 120.70 99.34 None add-sub06.yml OUT OF MEMORY 294.76 256.95 None add-sub07.yml OUT OF MEMORY 819.19 643.90 None add-sub08.yml OUT OF MEMORY 330.18 282.54 None add-sub09.yml TIMEOUT 900.77 826.39 None add-sub10.yml OUT OF MEMORY 352.82 307.63 None add-sub11.yml OUT OF MEMORY 561.17 507.41 None add-sub12.yml OUT OF MEMORY 119.39 112.94 None add-sub13.yml OUT OF MEMORY 199.41 179.57 None add-sub14.yml OUT OF MEMORY 485.15 476.89 None add-sub15.yml OUT OF MEMORY 823.26 734.41 None add-sub16.yml TIMEOUT 902.72 754.71 None add-sub17.yml TIMEOUT 901.19 832.16 None add-sub18.yml TIMEOUT 900.65 823.03 None add-sub19.yml TIMEOUT 901.97 759.51 None add-sub20.yml TIMEOUT 900.73 886.12 None add-sub21.yml TIMEOUT 901.08 876.72 None add-sub22.yml TIMEOUT 904.69 776.64 None add-sub23.yml TIMEOUT 901.25 846.66 None add-sub24.yml TIMEOUT 901.07 827.66 None add-sub25.yml TIMEOUT 900.71 890.99 None bluetooth-correct02.yml unknown 2.82 1.67 None bluetooth-correct03.yml unknown 3.11 1.85 None bluetooth-correct04.yml unknown 3.01 1.74 None bluetooth-correct05.yml unknown 3.06 1.79 None bluetooth-correct06.yml unknown 3.12 1.96 None bluetooth-correct07.yml unknown 3.47 2.10 None bluetooth-correct08.yml unknown 3.35 2.03 None bluetooth-correct09.yml unknown 3.39 2.06 None bluetooth-correct10.yml unknown 3.34 2.01 None bluetooth-customized02.yml unknown 2.99 1.81 None bluetooth-customized03.yml unknown 3.09 1.75 None bluetooth-customized04.yml unknown 3.10 1.84 None bluetooth-customized05.yml unknown 3.23 1.88 None bluetooth-customized06.yml unknown 3.12 1.81 None bluetooth-customized07.yml unknown 3.02 1.71 None bluetooth-customized08.yml unknown 2.95 1.77 None bluetooth-customized09.yml unknown 2.94 1.77 None bluetooth-customized10.yml unknown 2.86 1.71 None bluetooth-incorrect02.yml unknown 3.08 1.84 None bluetooth-incorrect03.yml unknown 3.02 1.81 None bluetooth-incorrect04.yml unknown 3.16 1.86 None bluetooth-incorrect05.yml unknown 2.87 1.76 None bluetooth-incorrect06.yml unknown 3.05 1.74 None bluetooth-incorrect07.yml unknown 3.26 1.99 None bluetooth-incorrect08.yml unknown 3.07 1.79 None bluetooth-incorrect09.yml unknown 3.10 1.83 None bluetooth-incorrect10.yml unknown 3.23 1.88 None bluetooth-serverassert01.yml unknown 3.26 1.86 None bluetooth-serverassert02.yml unknown 3.48 2.06 None bluetooth-serverassert03.yml unknown 3.38 2.20 None bluetooth-serverassert04.yml unknown 3.26 1.87 None bluetooth-serverassert05.yml unknown 3.38 2.16 None bluetooth-serverassert06.yml unknown 3.39 2.00 None bluetooth-serverassert07.yml unknown 3.31 1.98 None bluetooth-serverassert08.yml unknown 3.14 1.82 None bluetooth-serverassert09.yml unknown 3.21 1.85 None bluetooth-serverassert10.yml unknown 3.05 1.81 None incr-decr01.yml true 4.69 3.00 None incr-decr02.yml true 5.04 3.19 None incr-decr03.yml true 5.32 3.34 None incr-decr04.yml true 6.66 4.33 None incr-decr05.yml true 8.98 5.77 None incr-decr06.yml true 14.33 8.86 None incr-decr07.yml true 29.32 20.80 None incr-decr08.yml true 51.24 41.15 None incr-decr09.yml true 57.33 45.39 None incr-decr10.yml TIMEOUT 900.52 832.04 None incr-decr11.yml TIMEOUT 901.37 831.73 None incr-decr12.yml TIMEOUT 903.82 691.06 None incr-decr13.yml TIMEOUT 901.03 854.48 None incr-decr14.yml TIMEOUT 900.55 798.25 None incr-decr15.yml TIMEOUT 905.72 714.16 None incr-decr16.yml TIMEOUT 901.31 776.02 None incr-decr17.yml TIMEOUT 902.30 792.17 None incr-decr18.yml TIMEOUT 900.61 888.05 None incr-decr19.yml TIMEOUT 904.72 754.86 None incr-decr20.yml TIMEOUT 900.86 873.36 None incr-decr21.yml TIMEOUT 901.05 850.01 None incr-decr22.yml TIMEOUT 904.19 698.98 None incr-decr23.yml TIMEOUT 900.68 891.18 None incr-decr24.yml TIMEOUT 900.93 861.85 None incr-decr25.yml TIMEOUT 901.05 841.84 None --------------------------------------------------------------------------------------------- Run set 20 done 28714.80 2352.18 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom7777.POPL2022 Benchmarks Run set 21 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random7777.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- add-sub01.yml true 5.74 3.57 None add-sub02.yml true 4.97 3.33 None add-sub03.yml true 5.49 4.04 None add-sub04.yml true 13.15 8.18 None add-sub05.yml true 205.67 173.37 None add-sub06.yml OUT OF MEMORY 259.93 223.72 None add-sub07.yml OUT OF MEMORY 406.47 362.02 None add-sub08.yml OUT OF MEMORY 270.90 232.33 None add-sub09.yml OUT OF MEMORY 770.40 695.06 None add-sub10.yml TIMEOUT 900.78 825.27 None add-sub11.yml TIMEOUT 901.36 830.46 None add-sub12.yml OUT OF MEMORY 285.84 259.56 None add-sub13.yml TIMEOUT 901.03 865.85 None add-sub14.yml OUT OF MEMORY 105.38 92.47 None add-sub15.yml TIMEOUT 901.47 771.47 None add-sub16.yml TIMEOUT 900.43 829.21 None add-sub17.yml TIMEOUT 903.24 807.13 None add-sub18.yml TIMEOUT 904.25 793.43 None add-sub19.yml TIMEOUT 900.85 882.80 None add-sub20.yml TIMEOUT 904.89 852.91 None add-sub21.yml TIMEOUT 901.32 807.49 None add-sub22.yml TIMEOUT 900.34 834.99 None add-sub23.yml TIMEOUT 900.72 887.18 None add-sub24.yml TIMEOUT 901.01 863.58 None add-sub25.yml TIMEOUT 901.03 861.58 None bluetooth-correct02.yml unknown 3.18 1.87 None bluetooth-correct03.yml unknown 3.26 2.06 None bluetooth-correct04.yml unknown 3.24 1.84 None bluetooth-correct05.yml unknown 3.18 1.79 None bluetooth-correct06.yml unknown 3.02 1.71 None bluetooth-correct07.yml unknown 2.98 1.78 None bluetooth-correct08.yml unknown 3.10 1.78 None bluetooth-correct09.yml unknown 2.97 1.78 None bluetooth-correct10.yml unknown 3.10 1.79 None bluetooth-customized02.yml unknown 2.96 1.73 None bluetooth-customized03.yml unknown 3.10 1.86 None bluetooth-customized04.yml unknown 2.97 1.72 None bluetooth-customized05.yml unknown 3.15 1.81 None bluetooth-customized06.yml unknown 3.01 1.81 None bluetooth-customized07.yml unknown 3.88 2.20 None bluetooth-customized08.yml unknown 2.93 1.74 None bluetooth-customized09.yml unknown 3.96 2.18 None bluetooth-customized10.yml unknown 3.02 2.17 None bluetooth-incorrect02.yml unknown 4.12 2.24 None bluetooth-incorrect03.yml unknown 3.04 1.69 None bluetooth-incorrect04.yml unknown 3.87 2.16 None bluetooth-incorrect05.yml unknown 3.01 1.74 None bluetooth-incorrect06.yml unknown 2.95 1.72 None bluetooth-incorrect07.yml unknown 2.96 1.70 None bluetooth-incorrect08.yml unknown 3.81 2.12 None bluetooth-incorrect09.yml unknown 2.98 1.73 None bluetooth-incorrect10.yml unknown 2.95 1.66 None bluetooth-serverassert01.yml unknown 3.72 2.08 None bluetooth-serverassert02.yml unknown 3.11 1.74 None bluetooth-serverassert03.yml unknown 3.09 1.71 None bluetooth-serverassert04.yml unknown 3.92 2.19 None bluetooth-serverassert05.yml unknown 3.07 1.75 None bluetooth-serverassert06.yml unknown 2.97 1.71 None bluetooth-serverassert07.yml unknown 3.85 2.35 None bluetooth-serverassert08.yml unknown 2.86 1.83 None bluetooth-serverassert09.yml unknown 3.02 1.86 None bluetooth-serverassert10.yml unknown 3.07 1.92 None incr-decr01.yml true 4.32 3.01 None incr-decr02.yml true 6.17 3.90 None incr-decr03.yml true 4.53 3.14 None incr-decr04.yml true 6.12 4.73 None incr-decr05.yml true 7.94 4.92 None incr-decr06.yml true 9.58 5.45 None incr-decr07.yml true 23.89 17.93 None incr-decr08.yml true 24.87 18.36 None incr-decr09.yml true 718.82 647.41 None incr-decr10.yml TIMEOUT 901.01 816.55 None incr-decr11.yml TIMEOUT 900.53 807.69 None incr-decr12.yml TIMEOUT 901.15 759.47 None incr-decr13.yml TIMEOUT 901.13 849.57 None incr-decr14.yml TIMEOUT 900.81 856.10 None incr-decr15.yml TIMEOUT 903.90 828.14 None incr-decr16.yml TIMEOUT 901.84 852.26 None incr-decr17.yml TIMEOUT 903.27 756.61 None incr-decr18.yml TIMEOUT 901.28 831.60 None incr-decr19.yml TIMEOUT 901.04 850.05 None incr-decr20.yml TIMEOUT 900.69 887.62 None incr-decr21.yml TIMEOUT 900.97 846.30 None incr-decr22.yml TIMEOUT 901.91 730.54 None incr-decr23.yml TIMEOUT 900.77 873.42 None incr-decr24.yml TIMEOUT 900.84 866.00 None incr-decr25.yml TIMEOUT 900.78 876.66 None --------------------------------------------------------------------------------------------- Run set 21 done 30266.57 2518.26 - Statistics: 1827 Files correct: 404 correct true: 404 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 1423 Score: 808 (max: 3465)