BENCHMARK INFORMATION benchmark definition: ../benchexec/concurrency.xml name: concurrency run sets: Automizer FA.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.None.POPL2022 Benchmarks, Automizer PN.POPL2022 Benchmarks, Automizer FA.Delay.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.OrderLockstep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.Symm.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderLockstep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom42.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom521.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom7777.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepUncond.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.Persistent.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleepPersistent.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleepPersistentFixedOrder.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderLockstep.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom42.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom521.POPL2022 Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom7777.POPL2022 Benchmarks date: Thu, 2021-07-01 09:24:56 CEST tool: ULTIMATE Automizer 0.2.1-1c3aa573 tool executable: ./Ultimate.py options: --force-no-wrapper parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: benchexec os: Linux-5.4.65-1-pve-x86_64-with-debian-10.10 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer FA.POPL2022 Benchmarks Run set 1 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.59 3.74 None bluetooth-correct03.yml true 6.00 3.79 None bluetooth-correct04.yml true 6.91 4.22 None bluetooth-correct05.yml true 15.72 8.40 None bluetooth-correct06.yml true 29.64 17.17 None bluetooth-correct07.yml true 100.90 70.87 None bluetooth-correct08.yml OUT OF MEMORY 759.48 670.12 None bluetooth-correct09.yml TIMEOUT 900.65 882.22 None bluetooth-correct10.yml TIMEOUT 900.99 821.59 None bluetooth-customized02.yml true 4.97 3.08 None bluetooth-customized03.yml true 6.07 3.89 None bluetooth-customized04.yml true 7.99 5.24 None bluetooth-customized05.yml true 13.96 7.81 None bluetooth-customized06.yml true 29.28 20.68 None bluetooth-customized07.yml true 118.64 80.58 None bluetooth-customized08.yml OUT OF MEMORY 677.28 614.94 None bluetooth-customized09.yml TIMEOUT 900.45 874.09 None bluetooth-customized10.yml TIMEOUT 901.06 790.59 None bluetooth-incorrect02.yml false(unreach-call) 4.42 2.77 None bluetooth-incorrect03.yml false(unreach-call) 5.41 3.72 None bluetooth-incorrect04.yml false(unreach-call) 7.79 4.47 None bluetooth-incorrect05.yml false(unreach-call) 16.45 11.07 None bluetooth-incorrect06.yml false(unreach-call) 127.72 104.49 None bluetooth-incorrect07.yml TIMEOUT 900.62 891.08 None bluetooth-incorrect08.yml TIMEOUT 900.64 833.15 None bluetooth-incorrect09.yml TIMEOUT 903.13 876.74 None bluetooth-incorrect10.yml TIMEOUT 905.88 819.28 None bluetooth-serverassert01.yml true 4.62 3.42 None bluetooth-serverassert02.yml true 5.53 4.02 None bluetooth-serverassert03.yml true 6.73 4.35 None bluetooth-serverassert04.yml true 10.80 6.87 None bluetooth-serverassert05.yml true 20.00 12.27 None bluetooth-serverassert06.yml true 48.33 32.27 None bluetooth-serverassert07.yml true 231.80 150.97 None bluetooth-serverassert08.yml OUT OF MEMORY 276.10 202.67 None bluetooth-serverassert09.yml TIMEOUT 900.66 814.31 None bluetooth-serverassert10.yml TIMEOUT 900.83 749.23 None --------------------------------------------------------------------------------------------- Run set 1 done 11563.58 901.00 - Automizer PARTIAL_ORDER_FA.None.POPL2022 Benchmarks Run set 2 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-None-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.32 4.64 None bluetooth-correct03.yml true 7.31 5.12 None bluetooth-correct04.yml true 9.40 6.57 None bluetooth-correct05.yml true 18.56 11.37 None bluetooth-correct06.yml true 34.07 21.27 None bluetooth-correct07.yml true 101.34 79.03 None bluetooth-correct08.yml OUT OF MEMORY 727.32 670.10 None bluetooth-correct09.yml TIMEOUT 900.74 883.28 None bluetooth-correct10.yml TIMEOUT 902.54 816.21 None bluetooth-customized02.yml true 5.01 3.53 None bluetooth-customized03.yml true 6.86 4.57 None bluetooth-customized04.yml true 9.91 6.95 None bluetooth-customized05.yml true 16.58 11.16 None bluetooth-customized06.yml true 45.33 38.66 None bluetooth-customized07.yml OUT OF MEMORY 125.81 103.10 None bluetooth-customized08.yml OUT OF MEMORY 680.06 634.48 None bluetooth-customized09.yml TIMEOUT 902.07 853.21 None bluetooth-customized10.yml TIMEOUT 901.60 761.66 None bluetooth-incorrect02.yml false(unreach-call) 5.01 3.36 None bluetooth-incorrect03.yml false(unreach-call) 6.94 4.75 None bluetooth-incorrect04.yml false(unreach-call) 7.57 4.91 None bluetooth-incorrect05.yml false(unreach-call) 12.72 9.54 None bluetooth-incorrect06.yml false(unreach-call) 92.34 82.99 None bluetooth-incorrect07.yml TIMEOUT 900.70 890.72 None bluetooth-incorrect08.yml TIMEOUT 900.65 790.08 None bluetooth-incorrect09.yml TIMEOUT 901.29 825.48 None bluetooth-incorrect10.yml TIMEOUT 900.63 732.49 None bluetooth-serverassert01.yml true 4.29 3.45 None bluetooth-serverassert02.yml true 6.22 4.92 None bluetooth-serverassert03.yml true 7.84 5.87 None bluetooth-serverassert04.yml true 10.93 8.06 None bluetooth-serverassert05.yml true 17.89 13.06 None bluetooth-serverassert06.yml true 38.09 31.55 None bluetooth-serverassert07.yml true 158.00 116.41 None bluetooth-serverassert08.yml OUT OF MEMORY 247.47 201.44 None bluetooth-serverassert09.yml TIMEOUT 901.05 717.29 None bluetooth-serverassert10.yml TIMEOUT 903.97 843.64 None --------------------------------------------------------------------------------------------- Run set 2 done 11417.19 951.45 - Automizer PN.POPL2022 Benchmarks Run set 3 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-PN-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.76 3.70 None bluetooth-correct03.yml true 5.45 3.24 None bluetooth-correct04.yml true 6.41 3.63 None bluetooth-correct05.yml true 13.32 7.02 None bluetooth-correct06.yml true 27.90 14.98 None bluetooth-correct07.yml true 60.15 39.66 None bluetooth-correct08.yml OUT OF MEMORY 88.49 78.11 None bluetooth-correct09.yml OUT OF MEMORY 419.77 304.72 None bluetooth-correct10.yml OUT OF MEMORY 119.98 92.98 None bluetooth-customized02.yml true 4.89 3.04 None bluetooth-customized03.yml true 5.26 3.13 None bluetooth-customized04.yml true 8.26 5.14 None bluetooth-customized05.yml true 23.19 13.51 None bluetooth-customized06.yml OUT OF MEMORY (true) 108.14 97.87 None bluetooth-customized07.yml OUT OF MEMORY 276.36 207.24 None bluetooth-customized08.yml OUT OF MEMORY 245.11 176.48 None bluetooth-customized09.yml OUT OF MEMORY 237.98 171.30 None bluetooth-customized10.yml OUT OF MEMORY 219.70 165.74 None bluetooth-incorrect02.yml false(unreach-call) 6.23 3.55 None bluetooth-incorrect03.yml false(unreach-call) 4.60 3.91 None bluetooth-incorrect04.yml false(unreach-call) 6.24 3.51 None bluetooth-incorrect05.yml false(unreach-call) 9.76 5.15 None bluetooth-incorrect06.yml false(unreach-call) 6.90 4.48 None bluetooth-incorrect07.yml false(unreach-call) 6.75 3.83 None bluetooth-incorrect08.yml false(unreach-call) 88.71 62.61 None bluetooth-incorrect09.yml OUT OF MEMORY 238.23 145.40 None bluetooth-incorrect10.yml OUT OF MEMORY 199.45 129.72 None bluetooth-serverassert01.yml true 6.19 3.51 None bluetooth-serverassert02.yml true 8.40 4.75 None bluetooth-serverassert03.yml true 10.85 6.04 None bluetooth-serverassert04.yml true 15.68 8.72 None bluetooth-serverassert05.yml true 29.88 16.25 None bluetooth-serverassert06.yml true 63.96 42.96 None bluetooth-serverassert07.yml true 185.27 144.53 None bluetooth-serverassert08.yml OUT OF MEMORY 509.89 414.47 None bluetooth-serverassert09.yml OUT OF MEMORY 209.44 163.84 None bluetooth-serverassert10.yml OUT OF MEMORY 610.79 416.02 None --------------------------------------------------------------------------------------------- Run set 3 done 4087.46 492.36 - Automizer FA.Delay.POPL2022 Benchmarks Run set 4 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe-Delay.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.29 3.75 None bluetooth-correct03.yml true 6.00 3.48 None bluetooth-correct04.yml true 7.54 4.18 None bluetooth-correct05.yml true 16.08 8.49 None bluetooth-correct06.yml true 33.87 18.13 None bluetooth-correct07.yml true 98.33 60.72 None bluetooth-correct08.yml OUT OF MEMORY 348.29 286.37 None bluetooth-correct09.yml TIMEOUT 900.90 758.06 None bluetooth-correct10.yml TIMEOUT 907.81 826.74 None bluetooth-customized02.yml true 5.07 3.14 None bluetooth-customized03.yml true 5.98 3.59 None bluetooth-customized04.yml true 7.47 4.56 None bluetooth-customized05.yml true 14.32 7.99 None bluetooth-customized06.yml true 30.52 19.88 None bluetooth-customized07.yml true 101.63 64.84 None bluetooth-customized08.yml OUT OF MEMORY 316.81 262.45 None bluetooth-customized09.yml TIMEOUT 907.04 780.94 None bluetooth-customized10.yml TIMEOUT 901.29 820.57 None bluetooth-incorrect02.yml false(unreach-call) 5.04 3.02 None bluetooth-incorrect03.yml false(unreach-call) 5.07 3.25 None bluetooth-incorrect04.yml false(unreach-call) 8.47 4.57 None bluetooth-incorrect05.yml false(unreach-call) 17.46 10.11 None bluetooth-incorrect06.yml false(unreach-call) 77.07 57.71 None bluetooth-incorrect07.yml TIMEOUT 907.57 727.06 None bluetooth-incorrect08.yml TIMEOUT 901.11 779.03 None bluetooth-incorrect09.yml TIMEOUT 901.06 702.51 None bluetooth-incorrect10.yml TIMEOUT 904.85 740.69 None bluetooth-serverassert01.yml true 4.73 3.13 None bluetooth-serverassert02.yml true 5.54 3.65 None bluetooth-serverassert03.yml true 7.52 4.79 None bluetooth-serverassert04.yml true 11.38 7.71 None bluetooth-serverassert05.yml true 20.29 12.31 None bluetooth-serverassert06.yml true 48.39 31.47 None bluetooth-serverassert07.yml true 214.36 137.90 None bluetooth-serverassert08.yml OUT OF MEMORY 196.93 158.88 None bluetooth-serverassert09.yml TIMEOUT 906.15 641.24 None bluetooth-serverassert10.yml TIMEOUT 904.50 764.37 None --------------------------------------------------------------------------------------------- Run set 4 done 10661.49 849.06 - Automizer PARTIAL_ORDER_FA.DelaySleep.POPL2022 Benchmarks Run set 5 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.53 4.00 None bluetooth-correct03.yml true 5.09 3.36 None bluetooth-correct04.yml true 6.06 3.86 None bluetooth-correct05.yml true 8.49 5.00 None bluetooth-correct06.yml true 11.89 6.97 None bluetooth-correct07.yml true 19.93 11.20 None bluetooth-correct08.yml true 48.68 37.95 None bluetooth-correct09.yml true 215.46 180.78 None bluetooth-correct10.yml TIMEOUT 906.31 668.62 None bluetooth-customized02.yml true 4.86 3.22 None bluetooth-customized03.yml true 5.67 3.67 None bluetooth-customized04.yml true 6.14 4.73 None bluetooth-customized05.yml true 8.69 5.38 None bluetooth-customized06.yml true 12.17 7.48 None bluetooth-customized07.yml true 22.18 14.77 None bluetooth-customized08.yml true 109.09 94.27 None bluetooth-customized09.yml true 627.91 541.15 None bluetooth-customized10.yml TIMEOUT 906.58 681.26 None bluetooth-incorrect02.yml false(unreach-call) 6.68 4.35 None bluetooth-incorrect03.yml false(unreach-call) 5.98 4.46 None bluetooth-incorrect04.yml false(unreach-call) 8.45 5.21 None bluetooth-incorrect05.yml false(unreach-call) 8.47 5.49 None bluetooth-incorrect06.yml false(unreach-call) 19.06 10.52 None bluetooth-incorrect07.yml false(unreach-call) 39.57 32.13 None bluetooth-incorrect08.yml false(unreach-call) 484.70 344.08 None bluetooth-incorrect09.yml TIMEOUT 901.73 841.10 None bluetooth-incorrect10.yml TIMEOUT 901.62 749.72 None bluetooth-serverassert01.yml true 5.31 5.93 None bluetooth-serverassert02.yml true 8.33 5.15 None bluetooth-serverassert03.yml true 9.24 5.78 None bluetooth-serverassert04.yml true 7.77 5.90 None bluetooth-serverassert05.yml true 12.25 7.22 None bluetooth-serverassert06.yml true 11.78 6.89 None bluetooth-serverassert07.yml true 28.19 15.76 None bluetooth-serverassert08.yml true 40.82 28.89 None bluetooth-serverassert09.yml true 161.57 127.66 None bluetooth-serverassert10.yml OUT OF MEMORY 874.82 573.13 None --------------------------------------------------------------------------------------------- Run set 5 done 6466.99 851.15 - Automizer PARTIAL_ORDER_FA.DelaySleep.OrderLockstep.POPL2022 Benchmarks Run set 6 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.22 4.88 None bluetooth-correct03.yml true 7.22 4.75 None bluetooth-correct04.yml true 11.36 7.03 None bluetooth-correct05.yml true 21.98 12.90 None bluetooth-correct06.yml true 41.88 26.62 None bluetooth-correct07.yml true 114.48 83.09 None bluetooth-correct08.yml OUT OF MEMORY 641.52 428.68 None bluetooth-correct09.yml OUT OF MEMORY 294.18 244.35 None bluetooth-correct10.yml OUT OF MEMORY 831.15 648.89 None bluetooth-customized02.yml true 5.43 3.94 None bluetooth-customized03.yml true 6.33 4.30 None bluetooth-customized04.yml true 9.00 6.97 None bluetooth-customized05.yml true 17.80 12.28 None bluetooth-customized06.yml true 48.05 37.04 None bluetooth-customized07.yml OUT OF MEMORY 154.01 127.47 None bluetooth-customized08.yml OUT OF MEMORY 169.55 131.29 None bluetooth-customized09.yml OUT OF MEMORY 381.10 295.67 None bluetooth-customized10.yml OUT OF MEMORY 787.69 659.08 None bluetooth-incorrect02.yml false(unreach-call) 4.81 3.41 None bluetooth-incorrect03.yml false(unreach-call) 5.40 4.10 None bluetooth-incorrect04.yml false(unreach-call) 5.23 3.44 None bluetooth-incorrect05.yml false(unreach-call) 6.57 4.40 None bluetooth-incorrect06.yml false(unreach-call) 10.98 6.50 None bluetooth-incorrect07.yml false(unreach-call) 31.82 24.89 None bluetooth-incorrect08.yml false(unreach-call) 276.03 260.93 None bluetooth-incorrect09.yml TIMEOUT 903.73 807.92 None bluetooth-incorrect10.yml TIMEOUT 901.23 765.27 None bluetooth-serverassert01.yml true 6.58 4.33 None bluetooth-serverassert02.yml true 8.73 5.86 None bluetooth-serverassert03.yml true 9.44 6.87 None bluetooth-serverassert04.yml true 17.78 10.82 None bluetooth-serverassert05.yml true 31.41 19.32 None bluetooth-serverassert06.yml true 53.00 42.74 None bluetooth-serverassert07.yml OUT OF MEMORY 177.45 139.22 None bluetooth-serverassert08.yml OUT OF MEMORY 141.30 104.89 None bluetooth-serverassert09.yml OUT OF MEMORY 157.92 125.58 None bluetooth-serverassert10.yml OUT OF MEMORY 159.95 146.75 None --------------------------------------------------------------------------------------------- Run set 6 done 6423.21 824.59 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.POPL2022 Benchmarks Run set 7 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.70 4.23 None bluetooth-correct03.yml true 5.30 3.77 None bluetooth-correct04.yml true 5.90 4.05 None bluetooth-correct05.yml true 8.53 5.20 None bluetooth-correct06.yml true 12.44 7.09 None bluetooth-correct07.yml true 23.86 13.63 None bluetooth-correct08.yml true 55.39 44.89 None bluetooth-correct09.yml true 291.99 222.40 None bluetooth-correct10.yml TIMEOUT 900.92 749.54 None bluetooth-customized02.yml true 5.10 3.63 None bluetooth-customized03.yml true 6.03 4.13 None bluetooth-customized04.yml true 7.02 5.12 None bluetooth-customized05.yml true 8.95 5.82 None bluetooth-customized06.yml true 14.20 8.87 None bluetooth-customized07.yml true 27.81 19.71 None bluetooth-customized08.yml true 167.37 135.39 None bluetooth-customized09.yml TIMEOUT 901.07 636.06 None bluetooth-customized10.yml TIMEOUT 908.47 656.31 None bluetooth-incorrect02.yml false(unreach-call) 6.64 4.14 None bluetooth-incorrect03.yml false(unreach-call) 5.59 4.03 None bluetooth-incorrect04.yml false(unreach-call) 8.75 5.21 None bluetooth-incorrect05.yml false(unreach-call) 11.05 6.45 None bluetooth-incorrect06.yml false(unreach-call) 35.71 22.71 None bluetooth-incorrect07.yml false(unreach-call) 172.42 145.74 None bluetooth-incorrect08.yml TIMEOUT 901.14 855.07 None bluetooth-incorrect09.yml TIMEOUT 903.64 740.63 None bluetooth-incorrect10.yml TIMEOUT 901.22 694.26 None bluetooth-serverassert01.yml true 5.26 3.73 None bluetooth-serverassert02.yml true 8.10 5.04 None bluetooth-serverassert03.yml true 7.03 4.69 None bluetooth-serverassert04.yml true 10.84 6.69 None bluetooth-serverassert05.yml true 10.15 6.83 None bluetooth-serverassert06.yml true 13.61 8.00 None bluetooth-serverassert07.yml true 29.62 17.32 None bluetooth-serverassert08.yml true 48.47 36.53 None bluetooth-serverassert09.yml true 259.53 186.85 None bluetooth-serverassert10.yml OUT OF MEMORY 264.53 181.46 None --------------------------------------------------------------------------------------------- Run set 7 done 6958.41 865.02 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.Symm.POPL2022 Benchmarks Run set 8 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Symm.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.82 4.46 None bluetooth-correct03.yml true 6.19 4.15 None bluetooth-correct04.yml true 6.52 4.57 None bluetooth-correct05.yml true 9.72 5.94 None bluetooth-correct06.yml true 15.82 8.84 None bluetooth-correct07.yml true 26.09 16.14 None bluetooth-correct08.yml true 79.03 65.86 None bluetooth-correct09.yml true 476.16 362.96 None bluetooth-correct10.yml TIMEOUT 906.43 697.51 None bluetooth-customized02.yml true 5.20 3.62 None bluetooth-customized03.yml true 6.29 4.09 None bluetooth-customized04.yml true 8.77 5.82 None bluetooth-customized05.yml true 9.84 7.37 None bluetooth-customized06.yml true 15.45 9.68 None bluetooth-customized07.yml true 32.58 22.91 None bluetooth-customized08.yml true 190.51 152.55 None bluetooth-customized09.yml TIMEOUT 905.23 655.36 None bluetooth-customized10.yml TIMEOUT 907.43 677.09 None bluetooth-incorrect02.yml false(unreach-call) 5.00 3.40 None bluetooth-incorrect03.yml false(unreach-call) 6.20 4.53 None bluetooth-incorrect04.yml false(unreach-call) 9.28 5.63 None bluetooth-incorrect05.yml false(unreach-call) 11.79 7.29 None bluetooth-incorrect06.yml false(unreach-call) 30.77 22.33 None bluetooth-incorrect07.yml false(unreach-call) 260.82 204.43 None bluetooth-incorrect08.yml TIMEOUT 903.61 748.81 None bluetooth-incorrect09.yml TIMEOUT 900.70 715.29 None bluetooth-incorrect10.yml TIMEOUT 907.39 692.76 None bluetooth-serverassert01.yml true 5.33 3.75 None bluetooth-serverassert02.yml true 8.16 5.05 None bluetooth-serverassert03.yml true 7.53 5.45 None bluetooth-serverassert04.yml true 10.81 6.47 None bluetooth-serverassert05.yml true 10.38 6.61 None bluetooth-serverassert06.yml true 14.93 8.63 None bluetooth-serverassert07.yml true 33.51 21.10 None bluetooth-serverassert08.yml true 63.09 47.69 None bluetooth-serverassert09.yml OUT OF MEMORY 328.61 253.50 None bluetooth-serverassert10.yml OUT OF MEMORY 321.37 223.41 None --------------------------------------------------------------------------------------------- Run set 8 done 7451.57 759.21 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderLockstep.POPL2022 Benchmarks Run set 9 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.29 4.72 None bluetooth-correct03.yml true 7.38 4.83 None bluetooth-correct04.yml true 11.79 7.36 None bluetooth-correct05.yml true 29.26 17.88 None bluetooth-correct06.yml true 60.88 41.92 None bluetooth-correct07.yml OUT OF MEMORY 171.66 134.93 None bluetooth-correct08.yml OUT OF MEMORY 354.49 285.24 None bluetooth-correct09.yml OUT OF MEMORY 888.56 711.07 None bluetooth-correct10.yml OUT OF MEMORY 657.41 531.67 None bluetooth-customized02.yml true 5.61 3.93 None bluetooth-customized03.yml true 7.22 4.81 None bluetooth-customized04.yml true 10.66 7.50 None bluetooth-customized05.yml true 22.48 16.41 None bluetooth-customized06.yml true 53.89 42.31 None bluetooth-customized07.yml OUT OF MEMORY 144.60 115.38 None bluetooth-customized08.yml OUT OF MEMORY 175.27 140.32 None bluetooth-customized09.yml TIMEOUT 900.66 605.81 None bluetooth-customized10.yml OUT OF MEMORY 768.79 475.15 None bluetooth-incorrect02.yml false(unreach-call) 4.99 3.44 None bluetooth-incorrect03.yml false(unreach-call) 4.74 3.49 None bluetooth-incorrect04.yml false(unreach-call) 5.95 3.84 None bluetooth-incorrect05.yml false(unreach-call) 7.35 4.80 None bluetooth-incorrect06.yml false(unreach-call) 15.89 11.23 None bluetooth-incorrect07.yml false(unreach-call) 88.45 79.06 None bluetooth-incorrect08.yml TIMEOUT 901.47 811.88 None bluetooth-incorrect09.yml TIMEOUT 904.64 657.61 None bluetooth-incorrect10.yml TIMEOUT 902.18 719.90 None bluetooth-serverassert01.yml true 6.81 4.43 None bluetooth-serverassert02.yml true 6.61 5.51 None bluetooth-serverassert03.yml true 11.61 7.31 None bluetooth-serverassert04.yml true 12.97 8.52 None bluetooth-serverassert05.yml true 31.61 19.21 None bluetooth-serverassert06.yml true 75.99 64.47 None bluetooth-serverassert07.yml OUT OF MEMORY 138.34 112.45 None bluetooth-serverassert08.yml OUT OF MEMORY 139.78 117.34 None bluetooth-serverassert09.yml OUT OF MEMORY 145.13 118.11 None bluetooth-serverassert10.yml OUT OF MEMORY 155.37 135.15 None --------------------------------------------------------------------------------------------- Run set 9 done 7817.49 829.32 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom42.POPL2022 Benchmarks Run set 10 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.53 6.05 None bluetooth-correct03.yml true 6.91 6.75 None bluetooth-correct04.yml true 6.50 6.22 None bluetooth-correct05.yml true 16.67 11.41 None bluetooth-correct06.yml true 18.82 12.60 None bluetooth-correct07.yml true 123.39 91.48 None bluetooth-correct08.yml true 433.22 335.50 None bluetooth-correct09.yml OUT OF MEMORY 838.77 659.85 None bluetooth-correct10.yml OUT OF MEMORY 350.72 280.94 None bluetooth-customized02.yml true 5.51 5.69 None bluetooth-customized03.yml true 6.67 6.79 None bluetooth-customized04.yml true 8.63 8.12 None bluetooth-customized05.yml true 12.74 9.48 None bluetooth-customized06.yml true 26.29 19.84 None bluetooth-customized07.yml true 44.23 32.49 None bluetooth-customized08.yml OUT OF MEMORY 266.41 208.15 None bluetooth-customized09.yml OUT OF MEMORY 781.88 576.60 None bluetooth-customized10.yml OUT OF MEMORY 639.82 494.29 None bluetooth-incorrect02.yml false(unreach-call) 4.86 3.29 None bluetooth-incorrect03.yml false(unreach-call) 4.29 3.28 None bluetooth-incorrect04.yml false(unreach-call) 6.04 4.16 None bluetooth-incorrect05.yml false(unreach-call) 8.91 5.25 None bluetooth-incorrect06.yml false(unreach-call) 21.28 14.12 None bluetooth-incorrect07.yml false(unreach-call) 155.63 139.90 None bluetooth-incorrect08.yml TIMEOUT 900.70 704.61 None bluetooth-incorrect09.yml TIMEOUT 905.94 750.76 None bluetooth-incorrect10.yml OUT OF MEMORY 795.96 607.75 None bluetooth-serverassert01.yml true 5.64 4.82 None bluetooth-serverassert02.yml true 5.74 4.71 None bluetooth-serverassert03.yml true 8.97 5.66 None bluetooth-serverassert04.yml true 8.27 5.99 None bluetooth-serverassert05.yml true 18.65 10.78 None bluetooth-serverassert06.yml true 29.72 22.21 None bluetooth-serverassert07.yml true 69.15 50.54 None bluetooth-serverassert08.yml OUT OF MEMORY 144.17 110.47 None bluetooth-serverassert09.yml OUT OF MEMORY 211.45 160.69 None bluetooth-serverassert10.yml OUT OF MEMORY 311.49 217.16 None --------------------------------------------------------------------------------------------- Run set 10 done 7204.06 765.21 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom521.POPL2022 Benchmarks Run set 11 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random521.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.57 4.81 None bluetooth-correct03.yml true 7.53 5.10 None bluetooth-correct04.yml true 10.18 6.34 None bluetooth-correct05.yml true 13.56 8.02 None bluetooth-correct06.yml true 45.57 30.98 None bluetooth-correct07.yml true 65.88 46.63 None bluetooth-correct08.yml true 234.85 187.65 None bluetooth-correct09.yml OUT OF MEMORY 778.38 616.70 None bluetooth-correct10.yml OUT OF MEMORY 579.96 441.83 None bluetooth-customized02.yml true 5.63 3.89 None bluetooth-customized03.yml true 5.42 3.60 None bluetooth-customized04.yml true 8.92 6.32 None bluetooth-customized05.yml true 17.86 12.13 None bluetooth-customized06.yml true 34.21 25.99 None bluetooth-customized07.yml true 82.35 63.73 None bluetooth-customized08.yml OUT OF MEMORY 737.27 541.12 None bluetooth-customized09.yml OUT OF MEMORY 729.29 545.29 None bluetooth-customized10.yml OUT OF MEMORY 688.00 498.92 None bluetooth-incorrect02.yml false(unreach-call) 5.18 3.40 None bluetooth-incorrect03.yml false(unreach-call) 8.17 5.82 None bluetooth-incorrect04.yml false(unreach-call) 8.22 5.25 None bluetooth-incorrect05.yml false(unreach-call) 8.57 5.15 None bluetooth-incorrect06.yml false(unreach-call) 19.34 14.13 None bluetooth-incorrect07.yml false(unreach-call) 157.38 138.22 None bluetooth-incorrect08.yml TIMEOUT 901.58 613.86 None bluetooth-incorrect09.yml OUT OF MEMORY 765.37 617.19 None bluetooth-incorrect10.yml OUT OF MEMORY 321.49 288.55 None bluetooth-serverassert01.yml true 5.38 3.81 None bluetooth-serverassert02.yml true 5.87 4.10 None bluetooth-serverassert03.yml true 11.41 7.45 None bluetooth-serverassert04.yml true 9.27 6.41 None bluetooth-serverassert05.yml true 16.14 9.59 None bluetooth-serverassert06.yml true 36.05 25.22 None bluetooth-serverassert07.yml true 71.63 48.79 None bluetooth-serverassert08.yml OUT OF MEMORY 160.22 122.59 None bluetooth-serverassert09.yml OUT OF MEMORY 139.79 113.90 None bluetooth-serverassert10.yml OUT OF MEMORY 123.69 103.53 None --------------------------------------------------------------------------------------------- Run set 11 done 6818.26 632.94 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom7777.POPL2022 Benchmarks Run set 12 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random7777.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.95 4.81 None bluetooth-correct03.yml true 6.08 5.07 None bluetooth-correct04.yml true 8.88 6.03 None bluetooth-correct05.yml true 16.49 9.74 None bluetooth-correct06.yml true 25.39 15.23 None bluetooth-correct07.yml true 109.77 79.27 None bluetooth-correct08.yml true 275.39 230.49 None bluetooth-correct09.yml OUT OF MEMORY 649.26 522.07 None bluetooth-correct10.yml OUT OF MEMORY 324.57 260.29 None bluetooth-customized02.yml true 5.29 3.67 None bluetooth-customized03.yml true 6.32 4.14 None bluetooth-customized04.yml true 8.71 5.84 None bluetooth-customized05.yml true 8.57 5.32 None bluetooth-customized06.yml true 33.82 26.00 None bluetooth-customized07.yml true 140.21 111.45 None bluetooth-customized08.yml true 304.74 241.03 None bluetooth-customized09.yml TIMEOUT 908.22 570.04 None bluetooth-customized10.yml OUT OF MEMORY 886.66 573.22 None bluetooth-incorrect02.yml false(unreach-call) 5.33 3.81 None bluetooth-incorrect03.yml false(unreach-call) 5.71 4.01 None bluetooth-incorrect04.yml false(unreach-call) 5.81 3.73 None bluetooth-incorrect05.yml false(unreach-call) 8.04 5.06 None bluetooth-incorrect06.yml false(unreach-call) 28.85 19.37 None bluetooth-incorrect07.yml false(unreach-call) 153.78 128.58 None bluetooth-incorrect08.yml TIMEOUT 901.45 826.32 None bluetooth-incorrect09.yml OUT OF MEMORY 802.63 675.14 None bluetooth-incorrect10.yml OUT OF MEMORY 844.49 650.45 None bluetooth-serverassert01.yml true 5.33 4.10 None bluetooth-serverassert02.yml true 7.61 5.04 None bluetooth-serverassert03.yml true 7.55 5.51 None bluetooth-serverassert04.yml true 10.63 6.79 None bluetooth-serverassert05.yml true 10.96 7.21 None bluetooth-serverassert06.yml true 23.41 13.51 None bluetooth-serverassert07.yml true 34.21 25.71 None bluetooth-serverassert08.yml OUT OF MEMORY 118.25 92.05 None bluetooth-serverassert09.yml OUT OF MEMORY 140.92 123.82 None bluetooth-serverassert10.yml OUT OF MEMORY 118.44 83.34 None --------------------------------------------------------------------------------------------- Run set 12 done 6951.24 837.29 - Automizer PARTIAL_ORDER_FA.NewStatesSleepUncond.POPL2022 Benchmarks Run set 13 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepUncond-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.48 4.13 None bluetooth-correct03.yml true 6.43 4.31 None bluetooth-correct04.yml true 8.10 5.15 None bluetooth-correct05.yml true 19.13 11.46 None bluetooth-correct06.yml true 48.28 31.03 None bluetooth-correct07.yml OUT OF MEMORY 292.70 257.36 None bluetooth-correct08.yml OUT OF MEMORY 573.50 435.33 None bluetooth-correct09.yml OUT OF MEMORY 430.28 380.06 None bluetooth-correct10.yml OUT OF MEMORY 865.58 723.76 None bluetooth-customized02.yml true 5.23 3.64 None bluetooth-customized03.yml true 6.40 4.60 None bluetooth-customized04.yml true 8.95 6.54 None bluetooth-customized05.yml true 15.06 9.94 None bluetooth-customized06.yml true 31.84 25.15 None bluetooth-customized07.yml true 134.59 104.49 None bluetooth-customized08.yml TIMEOUT 909.82 669.00 None bluetooth-customized09.yml TIMEOUT 901.07 719.55 None bluetooth-customized10.yml TIMEOUT 901.19 807.99 None bluetooth-incorrect02.yml false(unreach-call) 5.01 3.36 None bluetooth-incorrect03.yml false(unreach-call) 6.41 4.78 None bluetooth-incorrect04.yml false(unreach-call) 8.92 5.79 None bluetooth-incorrect05.yml false(unreach-call) 21.94 14.27 None bluetooth-incorrect06.yml false(unreach-call) 114.29 91.28 None bluetooth-incorrect07.yml TIMEOUT 913.09 828.97 None bluetooth-incorrect08.yml TIMEOUT 901.04 821.52 None bluetooth-incorrect09.yml TIMEOUT 904.59 756.79 None bluetooth-incorrect10.yml TIMEOUT 900.74 797.45 None bluetooth-serverassert01.yml true 6.86 4.51 None bluetooth-serverassert02.yml true 9.03 5.75 None bluetooth-serverassert03.yml true 13.30 8.22 None bluetooth-serverassert04.yml true 21.56 12.93 None bluetooth-serverassert05.yml true 52.06 33.74 None bluetooth-serverassert06.yml true 323.56 271.41 None bluetooth-serverassert07.yml OUT OF MEMORY 332.31 292.21 None bluetooth-serverassert08.yml OUT OF MEMORY 332.60 291.96 None bluetooth-serverassert09.yml OUT OF MEMORY 544.37 399.42 None bluetooth-serverassert10.yml OUT OF MEMORY 383.45 308.70 None --------------------------------------------------------------------------------------------- Run set 13 done 10889.07 840.92 - Automizer PARTIAL_ORDER_FA.Persistent.POPL2022 Benchmarks Run set 14 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-Persistent-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.53 4.97 None bluetooth-correct03.yml true 7.19 5.18 None bluetooth-correct04.yml true 10.19 6.63 None bluetooth-correct05.yml true 20.13 12.09 None bluetooth-correct06.yml true 38.22 24.32 None bluetooth-correct07.yml true 101.01 73.65 None bluetooth-correct08.yml OUT OF MEMORY 348.77 277.45 None bluetooth-correct09.yml OUT OF MEMORY 144.73 110.22 None bluetooth-correct10.yml OUT OF MEMORY 296.23 252.11 None bluetooth-customized02.yml true 5.17 3.77 None bluetooth-customized03.yml true 6.65 4.63 None bluetooth-customized04.yml true 9.36 6.78 None bluetooth-customized05.yml true 16.38 11.14 None bluetooth-customized06.yml true 48.25 37.88 None bluetooth-customized07.yml OUT OF MEMORY 165.32 145.32 None bluetooth-customized08.yml OUT OF MEMORY 248.55 201.73 None bluetooth-customized09.yml OUT OF MEMORY 114.20 88.24 None bluetooth-customized10.yml OUT OF MEMORY 190.96 154.81 None bluetooth-incorrect02.yml false(unreach-call) 5.22 3.45 None bluetooth-incorrect03.yml false(unreach-call) 6.64 5.71 None bluetooth-incorrect04.yml false(unreach-call) 6.64 4.42 None bluetooth-incorrect05.yml false(unreach-call) 7.51 5.09 None bluetooth-incorrect06.yml false(unreach-call) 9.23 5.66 None bluetooth-incorrect07.yml false(unreach-call) 8.00 5.58 None bluetooth-incorrect08.yml false(unreach-call) 8.15 5.20 None bluetooth-incorrect09.yml false(unreach-call) 9.13 5.93 None bluetooth-incorrect10.yml false(unreach-call) 14.31 8.16 None bluetooth-serverassert01.yml true 5.15 3.99 None bluetooth-serverassert02.yml true 6.84 4.60 None bluetooth-serverassert03.yml true 8.86 5.98 None bluetooth-serverassert04.yml true 12.94 9.22 None bluetooth-serverassert05.yml true 28.38 17.30 None bluetooth-serverassert06.yml true 45.77 33.40 None bluetooth-serverassert07.yml OUT OF MEMORY 151.48 112.71 None bluetooth-serverassert08.yml OUT OF MEMORY 130.69 105.04 None bluetooth-serverassert09.yml OUT OF MEMORY 233.23 194.00 None bluetooth-serverassert10.yml OUT OF MEMORY 88.11 70.98 None --------------------------------------------------------------------------------------------- Run set 14 done 2533.79 277.65 - Automizer PARTIAL_ORDER_FA.DelaySleepPersistent.POPL2022 Benchmarks Run set 15 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleepPersistent-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.73 4.31 None bluetooth-correct03.yml true 5.91 3.85 None bluetooth-correct04.yml true 5.93 3.78 None bluetooth-correct05.yml true 9.24 5.29 None bluetooth-correct06.yml true 13.63 7.62 None bluetooth-correct07.yml true 21.86 12.17 None bluetooth-correct08.yml true 40.64 30.30 None bluetooth-correct09.yml true 151.00 127.02 None bluetooth-correct10.yml true 822.44 575.80 None bluetooth-customized02.yml true 5.00 3.88 None bluetooth-customized03.yml true 5.86 3.75 None bluetooth-customized04.yml true 6.79 4.82 None bluetooth-customized05.yml true 8.00 5.05 None bluetooth-customized06.yml true 10.14 6.44 None bluetooth-customized07.yml true 17.45 10.52 None bluetooth-customized08.yml true 42.26 31.35 None bluetooth-customized09.yml true 155.50 136.19 None bluetooth-customized10.yml true 652.36 577.66 None bluetooth-incorrect02.yml false(unreach-call) 7.28 4.68 None bluetooth-incorrect03.yml false(unreach-call) 6.56 4.75 None bluetooth-incorrect04.yml false(unreach-call) 6.77 4.66 None bluetooth-incorrect05.yml false(unreach-call) 10.33 6.18 None bluetooth-incorrect06.yml false(unreach-call) 12.84 8.39 None bluetooth-incorrect07.yml false(unreach-call) 39.58 26.28 None bluetooth-incorrect08.yml false(unreach-call) 184.51 156.90 None bluetooth-incorrect09.yml TIMEOUT 906.60 719.88 None bluetooth-incorrect10.yml TIMEOUT 900.97 677.30 None bluetooth-serverassert01.yml true 6.49 4.08 None bluetooth-serverassert02.yml true 8.56 5.39 None bluetooth-serverassert03.yml true 7.24 4.83 None bluetooth-serverassert04.yml true 7.86 5.87 None bluetooth-serverassert05.yml true 13.42 7.74 None bluetooth-serverassert06.yml true 20.28 11.32 None bluetooth-serverassert07.yml true 27.57 16.91 None bluetooth-serverassert08.yml true 54.70 41.64 None bluetooth-serverassert09.yml true 214.68 171.05 None bluetooth-serverassert10.yml OUT OF MEMORY 220.91 180.22 None --------------------------------------------------------------------------------------------- Run set 15 done 4636.92 730.14 - Automizer PARTIAL_ORDER_FA.DelaySleepPersistentFixedOrder.POPL2022 Benchmarks Run set 16 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleepPersistentFixedOrder-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.93 4.34 None bluetooth-correct03.yml true 6.33 4.14 None bluetooth-correct04.yml true 6.78 4.39 None bluetooth-correct05.yml true 11.21 6.74 None bluetooth-correct06.yml true 19.26 10.61 None bluetooth-correct07.yml true 31.76 20.59 None bluetooth-correct08.yml true 73.61 61.36 None bluetooth-correct09.yml true 286.55 250.03 None bluetooth-correct10.yml TIMEOUT 903.84 677.12 None bluetooth-customized02.yml true 5.27 3.43 None bluetooth-customized03.yml true 6.58 4.15 None bluetooth-customized04.yml true 8.39 5.74 None bluetooth-customized05.yml true 10.70 6.75 None bluetooth-customized06.yml true 16.97 10.11 None bluetooth-customized07.yml true 31.80 22.60 None bluetooth-customized08.yml true 100.84 87.32 None bluetooth-customized09.yml true 393.52 353.11 None bluetooth-customized10.yml TIMEOUT 904.56 754.25 None bluetooth-incorrect02.yml false(unreach-call) 5.71 4.09 None bluetooth-incorrect03.yml false(unreach-call) 6.34 4.63 None bluetooth-incorrect04.yml false(unreach-call) 9.52 5.68 None bluetooth-incorrect05.yml false(unreach-call) 10.06 6.81 None bluetooth-incorrect06.yml false(unreach-call) 20.27 12.57 None bluetooth-incorrect07.yml false(unreach-call) 59.18 49.64 None bluetooth-incorrect08.yml false(unreach-call) 328.93 285.33 None bluetooth-incorrect09.yml OUT OF MEMORY 166.11 149.54 None bluetooth-incorrect10.yml TIMEOUT 904.83 735.40 None bluetooth-serverassert01.yml true 5.57 4.11 None bluetooth-serverassert02.yml true 6.19 4.26 None bluetooth-serverassert03.yml true 10.70 6.37 None bluetooth-serverassert04.yml true 9.71 6.01 None bluetooth-serverassert05.yml true 13.07 8.08 None bluetooth-serverassert06.yml true 20.74 12.59 None bluetooth-serverassert07.yml true 52.69 36.62 None bluetooth-serverassert08.yml true 109.21 88.91 None bluetooth-serverassert09.yml OUT OF MEMORY 218.46 190.92 None bluetooth-serverassert10.yml TIMEOUT 905.81 691.26 None --------------------------------------------------------------------------------------------- Run set 16 done 5687.11 758.99 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.POPL2022 Benchmarks Run set 17 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 6.75 4.19 None bluetooth-correct03.yml true 5.54 3.59 None bluetooth-correct04.yml true 6.51 4.10 None bluetooth-correct05.yml true 11.62 6.65 None bluetooth-correct06.yml true 18.02 10.04 None bluetooth-correct07.yml true 31.44 19.76 None bluetooth-correct08.yml true 69.12 57.39 None bluetooth-correct09.yml true 277.72 241.57 None bluetooth-correct10.yml TIMEOUT 908.68 657.06 None bluetooth-customized02.yml true 5.27 3.46 None bluetooth-customized03.yml true 6.29 4.23 None bluetooth-customized04.yml true 8.08 5.09 None bluetooth-customized05.yml true 10.71 6.53 None bluetooth-customized06.yml true 18.63 11.10 None bluetooth-customized07.yml true 37.31 26.69 None bluetooth-customized08.yml true 122.01 104.29 None bluetooth-customized09.yml true 546.44 438.45 None bluetooth-customized10.yml TIMEOUT 903.62 700.10 None bluetooth-incorrect02.yml false(unreach-call) 5.37 3.55 None bluetooth-incorrect03.yml false(unreach-call) 5.94 4.33 None bluetooth-incorrect04.yml false(unreach-call) 6.97 4.81 None bluetooth-incorrect05.yml false(unreach-call) 12.28 6.94 None bluetooth-incorrect06.yml false(unreach-call) 18.03 11.06 None bluetooth-incorrect07.yml false(unreach-call) 57.42 47.69 None bluetooth-incorrect08.yml false(unreach-call) 326.21 285.37 None bluetooth-incorrect09.yml OUT OF MEMORY 468.31 440.13 None bluetooth-incorrect10.yml TIMEOUT 910.44 731.93 None bluetooth-serverassert01.yml true 6.75 4.18 None bluetooth-serverassert02.yml true 8.22 5.11 None bluetooth-serverassert03.yml true 7.13 4.68 None bluetooth-serverassert04.yml true 12.68 7.54 None bluetooth-serverassert05.yml true 16.03 9.00 None bluetooth-serverassert06.yml true 18.83 11.42 None bluetooth-serverassert07.yml true 46.60 30.23 None bluetooth-serverassert08.yml true 85.44 65.98 None bluetooth-serverassert09.yml OUT OF MEMORY 294.52 244.44 None bluetooth-serverassert10.yml OUT OF MEMORY 518.79 410.90 None --------------------------------------------------------------------------------------------- Run set 17 done 5817.87 744.05 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderLockstep.POPL2022 Benchmarks Run set 18 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 8.19 5.41 None bluetooth-correct03.yml true 9.27 6.01 None bluetooth-correct04.yml true 19.09 12.13 None bluetooth-correct05.yml true 64.16 47.43 None bluetooth-correct06.yml true 227.94 188.54 None bluetooth-correct07.yml OUT OF MEMORY 722.42 644.11 None bluetooth-correct08.yml TIMEOUT 900.80 831.65 None bluetooth-correct09.yml TIMEOUT 900.56 833.41 None bluetooth-correct10.yml TIMEOUT 901.16 853.20 None bluetooth-customized02.yml true 6.26 4.24 None bluetooth-customized03.yml true 9.13 5.79 None bluetooth-customized04.yml true 19.48 12.54 None bluetooth-customized05.yml true 57.02 47.42 None bluetooth-customized06.yml OUT OF MEMORY 109.63 99.60 None bluetooth-customized07.yml TIMEOUT 901.26 788.66 None bluetooth-customized08.yml OUT OF MEMORY 729.12 645.21 None bluetooth-customized09.yml TIMEOUT 901.33 697.11 None bluetooth-customized10.yml TIMEOUT 902.10 714.79 None bluetooth-incorrect02.yml false(unreach-call) 5.30 3.64 None bluetooth-incorrect03.yml false(unreach-call) 5.57 4.17 None bluetooth-incorrect04.yml false(unreach-call) 6.98 4.54 None bluetooth-incorrect05.yml false(unreach-call) 13.81 8.86 None bluetooth-incorrect06.yml false(unreach-call) 39.29 33.10 None bluetooth-incorrect07.yml false(unreach-call) 322.63 306.98 None bluetooth-incorrect08.yml TIMEOUT 902.17 743.35 None bluetooth-incorrect09.yml TIMEOUT 901.18 866.46 None bluetooth-incorrect10.yml TIMEOUT 900.99 751.80 None bluetooth-serverassert01.yml true 5.39 4.47 None bluetooth-serverassert02.yml true 6.74 5.47 None bluetooth-serverassert03.yml true 9.01 6.45 None bluetooth-serverassert04.yml true 18.79 13.25 None bluetooth-serverassert05.yml true 49.52 40.84 None bluetooth-serverassert06.yml OUT OF MEMORY 114.73 109.03 None bluetooth-serverassert07.yml OUT OF MEMORY 389.33 342.54 None bluetooth-serverassert08.yml OUT OF MEMORY 111.51 101.95 None bluetooth-serverassert09.yml OUT OF MEMORY 145.89 136.14 None bluetooth-serverassert10.yml OUT OF MEMORY 126.69 117.73 None --------------------------------------------------------------------------------------------- Run set 18 done 11446.79 914.93 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom42.POPL2022 Benchmarks Run set 19 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.62 4.79 None bluetooth-correct03.yml true 7.59 4.86 None bluetooth-correct04.yml true 7.86 4.88 None bluetooth-correct05.yml true 32.19 19.23 None bluetooth-correct06.yml true 55.85 37.96 None bluetooth-correct07.yml OUT OF MEMORY 496.42 441.39 None bluetooth-correct08.yml TIMEOUT 901.16 854.50 None bluetooth-correct09.yml TIMEOUT 901.21 854.12 None bluetooth-correct10.yml TIMEOUT 900.86 876.26 None bluetooth-customized02.yml true 5.53 3.57 None bluetooth-customized03.yml true 8.39 5.49 None bluetooth-customized04.yml true 16.23 10.13 None bluetooth-customized05.yml true 30.77 19.51 None bluetooth-customized06.yml true 81.25 67.55 None bluetooth-customized07.yml true 204.22 179.66 None bluetooth-customized08.yml TIMEOUT 905.08 829.81 None bluetooth-customized09.yml TIMEOUT 901.33 852.57 None bluetooth-customized10.yml TIMEOUT 900.98 862.62 None bluetooth-incorrect02.yml false(unreach-call) 5.63 3.60 None bluetooth-incorrect03.yml false(unreach-call) 5.90 3.85 None bluetooth-incorrect04.yml false(unreach-call) 8.35 5.42 None bluetooth-incorrect05.yml false(unreach-call) 20.10 13.45 None bluetooth-incorrect06.yml false(unreach-call) 77.37 70.46 None bluetooth-incorrect07.yml TIMEOUT 901.17 809.37 None bluetooth-incorrect08.yml TIMEOUT 901.00 864.72 None bluetooth-incorrect09.yml TIMEOUT 901.17 851.07 None bluetooth-incorrect10.yml TIMEOUT 901.19 845.19 None bluetooth-serverassert01.yml true 5.75 4.52 None bluetooth-serverassert02.yml true 6.39 5.19 None bluetooth-serverassert03.yml true 8.13 5.50 None bluetooth-serverassert04.yml true 10.06 6.72 None bluetooth-serverassert05.yml true 22.81 17.04 None bluetooth-serverassert06.yml true 79.80 68.57 None bluetooth-serverassert07.yml true 347.18 319.60 None bluetooth-serverassert08.yml OUT OF MEMORY 409.98 379.22 None bluetooth-serverassert09.yml OUT OF MEMORY 308.12 267.84 None bluetooth-serverassert10.yml OUT OF MEMORY 123.93 107.22 None --------------------------------------------------------------------------------------------- Run set 19 done 11400.90 884.78 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom521.POPL2022 Benchmarks Run set 20 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random521.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 8.01 5.06 None bluetooth-correct03.yml true 9.07 6.19 None bluetooth-correct04.yml true 17.83 11.16 None bluetooth-correct05.yml true 27.65 15.60 None bluetooth-correct06.yml true 164.39 138.03 None bluetooth-correct07.yml true 312.85 274.07 None bluetooth-correct08.yml TIMEOUT 901.19 855.90 None bluetooth-correct09.yml TIMEOUT 901.15 855.20 None bluetooth-correct10.yml TIMEOUT 900.94 871.78 None bluetooth-customized02.yml true 5.94 4.50 None bluetooth-customized03.yml true 6.50 4.37 None bluetooth-customized04.yml true 14.70 9.52 None bluetooth-customized05.yml true 42.77 32.24 None bluetooth-customized06.yml true 131.51 119.09 None bluetooth-customized07.yml true 459.25 410.08 None bluetooth-customized08.yml TIMEOUT 900.76 841.80 None bluetooth-customized09.yml TIMEOUT 900.54 833.68 None bluetooth-customized10.yml TIMEOUT 900.30 733.02 None bluetooth-incorrect02.yml false(unreach-call) 5.88 4.41 None bluetooth-incorrect03.yml false(unreach-call) 8.71 5.59 None bluetooth-incorrect04.yml false(unreach-call) 10.43 6.30 None bluetooth-incorrect05.yml false(unreach-call) 22.25 14.21 None bluetooth-incorrect06.yml false(unreach-call) 85.93 77.71 None bluetooth-incorrect07.yml TIMEOUT 901.30 873.40 None bluetooth-incorrect08.yml TIMEOUT 900.35 828.64 None bluetooth-incorrect09.yml TIMEOUT 900.71 880.83 None bluetooth-incorrect10.yml TIMEOUT 901.00 859.05 None bluetooth-serverassert01.yml true 5.59 4.44 None bluetooth-serverassert02.yml true 5.68 4.43 None bluetooth-serverassert03.yml true 10.06 7.25 None bluetooth-serverassert04.yml true 12.59 9.03 None bluetooth-serverassert05.yml true 26.09 15.71 None bluetooth-serverassert06.yml true 88.35 77.19 None bluetooth-serverassert07.yml true 263.20 226.33 None bluetooth-serverassert08.yml OUT OF MEMORY 483.28 449.96 None bluetooth-serverassert09.yml OUT OF MEMORY 303.83 260.22 None bluetooth-serverassert10.yml OUT OF MEMORY 338.86 292.04 None --------------------------------------------------------------------------------------------- Run set 20 done 11871.25 955.14 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom7777.POPL2022 Benchmarks Run set 21 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random7777.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------- bluetooth-correct02.yml true 7.36 4.58 None bluetooth-correct03.yml true 7.22 4.50 None bluetooth-correct04.yml true 13.21 8.03 None bluetooth-correct05.yml true 29.93 18.17 None bluetooth-correct06.yml true 71.13 54.82 None bluetooth-correct07.yml OUT OF MEMORY 398.15 342.03 None bluetooth-correct08.yml TIMEOUT 903.71 851.47 None bluetooth-correct09.yml TIMEOUT 901.34 853.24 None bluetooth-correct10.yml TIMEOUT 900.80 879.30 None bluetooth-customized02.yml true 6.07 4.14 None bluetooth-customized03.yml true 7.13 4.48 None bluetooth-customized04.yml true 11.24 7.40 None bluetooth-customized05.yml true 15.60 9.47 None bluetooth-customized06.yml OUT OF MEMORY 97.00 91.76 None bluetooth-customized07.yml true 728.14 657.22 None bluetooth-customized08.yml TIMEOUT 901.31 848.41 None bluetooth-customized09.yml TIMEOUT 905.34 837.38 None bluetooth-customized10.yml TIMEOUT 901.09 852.85 None bluetooth-incorrect02.yml false(unreach-call) 5.40 3.70 None bluetooth-incorrect03.yml false(unreach-call) 6.19 4.04 None bluetooth-incorrect04.yml false(unreach-call) 8.45 5.31 None bluetooth-incorrect05.yml false(unreach-call) 17.64 11.83 None bluetooth-incorrect06.yml false(unreach-call) 115.76 100.93 None bluetooth-incorrect07.yml false(unreach-call) 829.37 784.57 None bluetooth-incorrect08.yml TIMEOUT 901.36 833.09 None bluetooth-incorrect09.yml TIMEOUT 901.02 877.29 None bluetooth-incorrect10.yml TIMEOUT 900.33 834.59 None bluetooth-serverassert01.yml true 5.50 4.52 None bluetooth-serverassert02.yml true 6.49 4.57 None bluetooth-serverassert03.yml true 8.25 6.21 None bluetooth-serverassert04.yml true 10.67 7.36 None bluetooth-serverassert05.yml true 19.71 12.52 None bluetooth-serverassert06.yml true 40.63 31.73 None bluetooth-serverassert07.yml true 147.96 129.52 None bluetooth-serverassert08.yml OUT OF MEMORY 103.17 97.19 None bluetooth-serverassert09.yml OUT OF MEMORY 104.33 97.03 None bluetooth-serverassert10.yml OUT OF MEMORY 387.04 336.40 None --------------------------------------------------------------------------------------------- Run set 21 done 11316.92 901.80 - Statistics: 777 Files correct: 545 correct true: 416 correct false: 129 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 232 Score: 961 (max: 1365)