BENCHMARK INFORMATION benchmark definition: ../benchexec/concurrency.xml name: concurrency run sets: Automizer FA.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.None.Bluetooth Benchmarks, Automizer PN.Bluetooth Benchmarks, Automizer FA.Delay.Bluetooth Benchmarks, Automizer FA.NewStates.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.OrderLockstep.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.OrderRandom42.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.OrderRandom521.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleep.OrderRandom7777.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.Symm.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderLockstep.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom42.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepUncond.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.Persistent.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleepPersistent.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.DelaySleepPersistentFixedOrder.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderLockstep.Bluetooth Benchmarks, Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom42.Bluetooth Benchmarks date: Thu, 2021-06-24 17:53:13 CEST tool: ULTIMATE Automizer 0.2.1-d310483f tool executable: ./Ultimate.py options: --force-no-wrapper parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: benchexec os: Linux-5.4.65-1-pve-x86_64-with-debian-10.10 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer FA.Bluetooth Benchmarks Run set 1 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.05 3.62 None bluetooth01.yml true 4.78 3.36 None bluetooth02-incorrect.yml false(unreach-call) 4.99 3.56 None bluetooth02.yml true 7.13 4.29 None bluetooth03-incorrect.yml false(unreach-call) 8.32 4.76 None bluetooth03.yml true 10.63 5.95 None bluetooth04-incorrect.yml false(unreach-call) 14.18 8.90 None bluetooth04.yml true 27.37 15.31 None bluetooth05-incorrect.yml false(unreach-call) 120.72 106.80 None bluetooth05.yml true 107.07 82.78 None bluetooth06-incorrect.yml TIMEOUT 904.25 695.66 None bluetooth06.yml TIMEOUT 901.25 854.30 None bluetooth07-incorrect.yml TIMEOUT 901.49 843.44 None bluetooth07.yml TIMEOUT 902.89 836.18 None bluetooth08-incorrect.yml TIMEOUT 901.10 741.09 None bluetooth08.yml TIMEOUT 900.83 772.29 None bluetooth09-incorrect.yml TIMEOUT 906.58 769.23 None bluetooth09.yml TIMEOUT 901.04 730.39 None bluetooth10-incorrect.yml TIMEOUT 901.40 711.53 None bluetooth10.yml TIMEOUT 904.08 733.57 None ------------------------------------------------------------------------------------------ Run set 1 done 9336.04 854.56 - Automizer PARTIAL_ORDER_FA.None.Bluetooth Benchmarks Run set 2 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-None-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.04 3.93 None bluetooth01.yml true 4.87 3.44 None bluetooth02-incorrect.yml false(unreach-call) 5.89 4.66 None bluetooth02.yml true 8.63 6.14 None bluetooth03-incorrect.yml false(unreach-call) 9.67 6.22 None bluetooth03.yml true 14.65 9.91 None bluetooth04-incorrect.yml false(unreach-call) 10.96 7.45 None bluetooth04.yml true 32.90 21.27 None bluetooth05-incorrect.yml false(unreach-call) 103.31 96.75 None bluetooth05.yml true 107.73 87.48 None bluetooth06-incorrect.yml TIMEOUT 902.70 710.09 None bluetooth06.yml TIMEOUT 901.23 871.95 None bluetooth07-incorrect.yml TIMEOUT 903.96 850.20 None bluetooth07.yml TIMEOUT 901.64 823.23 None bluetooth08-incorrect.yml TIMEOUT 903.03 679.19 None bluetooth08.yml TIMEOUT 904.90 768.48 None bluetooth09-incorrect.yml TIMEOUT 903.27 710.28 None bluetooth09.yml TIMEOUT 906.29 746.50 None bluetooth10-incorrect.yml TIMEOUT 907.65 672.98 None bluetooth10.yml TIMEOUT 901.85 660.54 None ------------------------------------------------------------------------------------------ Run set 2 done 9339.49 872.23 - Automizer PN.Bluetooth Benchmarks Run set 3 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-PN-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.06 3.69 None bluetooth01.yml true 4.99 2.99 None bluetooth02-incorrect.yml false(unreach-call) 5.23 3.86 None bluetooth02.yml true 7.46 4.45 None bluetooth03-incorrect.yml false(unreach-call) 7.59 4.35 None bluetooth03.yml true 11.15 5.97 None bluetooth04-incorrect.yml false(unreach-call) 5.23 3.10 None bluetooth04.yml true 23.75 12.41 None bluetooth05-incorrect.yml false(unreach-call) 14.52 8.33 None bluetooth05.yml true 66.57 49.09 None bluetooth06-incorrect.yml false(unreach-call) 12.24 6.71 None bluetooth06.yml OUT OF MEMORY 166.50 141.04 None bluetooth07-incorrect.yml OUT OF MEMORY 323.85 228.46 None bluetooth07.yml OUT OF MEMORY 309.50 243.43 None bluetooth08-incorrect.yml OUT OF MEMORY 253.51 163.83 None bluetooth08.yml OUT OF MEMORY 262.02 163.70 None bluetooth09-incorrect.yml OUT OF MEMORY 254.18 163.15 None bluetooth09.yml OUT OF MEMORY 154.52 116.99 None bluetooth10-incorrect.yml OUT OF MEMORY 234.73 141.72 None bluetooth10.yml OUT OF MEMORY 234.13 141.66 None ------------------------------------------------------------------------------------------ Run set 3 done 2356.48 243.71 - Automizer FA.Delay.Bluetooth Benchmarks Run set 4 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe-Delay.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.33 3.58 None bluetooth01.yml true 5.05 3.01 None bluetooth02-incorrect.yml false(unreach-call) 5.09 3.00 None bluetooth02.yml true 7.74 4.78 None bluetooth03-incorrect.yml false(unreach-call) 8.35 4.85 None bluetooth03.yml true 11.93 6.46 None bluetooth04-incorrect.yml false(unreach-call) 14.93 8.16 None bluetooth04.yml true 30.42 16.42 None bluetooth05-incorrect.yml false(unreach-call) 76.66 62.10 None bluetooth05.yml true 97.27 70.98 None bluetooth06-incorrect.yml TIMEOUT 902.83 630.12 None bluetooth06.yml OUT OF MEMORY 690.34 645.03 None bluetooth07-incorrect.yml TIMEOUT 903.16 767.05 None bluetooth07.yml TIMEOUT 901.23 743.96 None bluetooth08-incorrect.yml TIMEOUT 906.42 728.99 None bluetooth08.yml TIMEOUT 901.57 655.72 None bluetooth09-incorrect.yml TIMEOUT 905.81 742.02 None bluetooth09.yml TIMEOUT 900.53 698.16 None bluetooth10-incorrect.yml TIMEOUT 900.42 724.73 None bluetooth10.yml TIMEOUT 905.62 706.70 None ------------------------------------------------------------------------------------------ Run set 4 done 9080.85 767.47 - Automizer FA.NewStates.Bluetooth Benchmarks Run set 5 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe-NewStates.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.45 3.73 None bluetooth01.yml true 4.92 2.97 None bluetooth02-incorrect.yml false(unreach-call) 5.18 3.09 None bluetooth02.yml true 7.95 4.61 None bluetooth03-incorrect.yml false(unreach-call) 9.49 5.36 None bluetooth03.yml true 13.22 7.07 None bluetooth04-incorrect.yml false(unreach-call) 21.04 12.19 None bluetooth04.yml true 41.55 24.89 None bluetooth05-incorrect.yml false(unreach-call) 116.95 89.46 None bluetooth05.yml true 248.09 181.08 None bluetooth06-incorrect.yml TIMEOUT 900.54 535.56 None bluetooth06.yml OUT OF MEMORY 418.50 307.78 None bluetooth07-incorrect.yml TIMEOUT 914.16 589.08 None bluetooth07.yml OUT OF MEMORY 542.39 358.89 None bluetooth08-incorrect.yml TIMEOUT 900.76 561.44 None bluetooth08.yml OUT OF MEMORY 527.71 329.93 None bluetooth09-incorrect.yml TIMEOUT 901.46 552.49 None bluetooth09.yml OUT OF MEMORY 612.93 364.34 None bluetooth10-incorrect.yml TIMEOUT 908.54 560.75 None bluetooth10.yml TIMEOUT 913.56 536.07 None ------------------------------------------------------------------------------------------ Run set 5 done 8014.66 589.33 - Automizer PARTIAL_ORDER_FA.DelaySleep.Bluetooth Benchmarks Run set 6 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.83 3.76 None bluetooth01.yml true 4.72 3.28 None bluetooth02-incorrect.yml false(unreach-call) 5.11 3.68 None bluetooth02.yml true 7.72 5.39 None bluetooth03-incorrect.yml false(unreach-call) 8.19 5.11 None bluetooth03.yml true 10.37 6.59 None bluetooth04-incorrect.yml false(unreach-call) 8.44 5.27 None bluetooth04.yml true 13.66 8.34 None bluetooth05-incorrect.yml false(unreach-call) 13.01 7.48 None bluetooth05.yml true 17.64 10.62 None bluetooth06-incorrect.yml false(unreach-call) 117.94 103.93 None bluetooth06.yml true 63.40 51.70 None bluetooth07-incorrect.yml TIMEOUT 903.79 731.47 None bluetooth07.yml OUT OF MEMORY 329.73 296.80 None bluetooth08-incorrect.yml TIMEOUT 902.53 686.66 None bluetooth08.yml TIMEOUT 911.67 683.50 None bluetooth09-incorrect.yml TIMEOUT 907.90 694.89 None bluetooth09.yml TIMEOUT 903.34 639.41 None bluetooth10-incorrect.yml TIMEOUT 903.72 645.42 None bluetooth10.yml TIMEOUT 910.30 687.92 None ------------------------------------------------------------------------------------------ Run set 6 done 6946.32 731.81 - Automizer PARTIAL_ORDER_FA.DelaySleep.OrderLockstep.Bluetooth Benchmarks Run set 7 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.85 3.75 None bluetooth01.yml true 5.16 3.44 None bluetooth02-incorrect.yml false(unreach-call) 5.04 3.59 None bluetooth02.yml true 7.85 5.48 None bluetooth03-incorrect.yml false(unreach-call) 7.15 4.72 None bluetooth03.yml true 14.81 9.67 None bluetooth04-incorrect.yml false(unreach-call) 7.39 4.92 None bluetooth04.yml true 33.34 20.80 None bluetooth05-incorrect.yml false(unreach-call) 10.29 6.16 None bluetooth05.yml true 79.67 61.11 None bluetooth06-incorrect.yml false(unreach-call) 15.79 9.67 None bluetooth06.yml OUT OF MEMORY 273.62 208.19 None bluetooth07-incorrect.yml false(unreach-call) 31.70 22.25 None bluetooth07.yml OUT OF MEMORY 176.89 162.68 None bluetooth08-incorrect.yml false(unreach-call) 744.56 607.77 None bluetooth08.yml OUT OF MEMORY 198.82 153.33 None bluetooth09-incorrect.yml TIMEOUT 901.15 705.22 None bluetooth09.yml OUT OF MEMORY 177.48 136.74 None bluetooth10-incorrect.yml TIMEOUT 905.99 633.86 None bluetooth10.yml OUT OF MEMORY 218.18 166.65 None ------------------------------------------------------------------------------------------ Run set 7 done 3808.22 709.92 - Automizer PARTIAL_ORDER_FA.DelaySleep.OrderRandom42.Bluetooth Benchmarks Run set 8 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.93 4.02 None bluetooth01.yml true 4.72 3.20 None bluetooth02-incorrect.yml false(unreach-call) 5.49 3.73 None bluetooth02.yml true 7.75 5.13 None bluetooth03-incorrect.yml false(unreach-call) 7.22 4.77 None bluetooth03.yml true 11.37 7.27 None bluetooth04-incorrect.yml false(unreach-call) 5.96 3.82 None bluetooth04.yml true 20.39 12.57 None bluetooth05-incorrect.yml false(unreach-call) 8.57 5.22 None bluetooth05.yml true 43.62 32.90 None bluetooth06-incorrect.yml false(unreach-call) 6.46 4.03 None bluetooth06.yml true 195.33 158.31 None bluetooth07-incorrect.yml false(unreach-call) 15.46 9.41 None bluetooth07.yml OUT OF MEMORY 311.50 273.41 None bluetooth08-incorrect.yml false(unreach-call) 9.35 5.47 None bluetooth08.yml TIMEOUT 906.04 527.31 None bluetooth09-incorrect.yml false(unreach-call) 19.56 10.70 None bluetooth09.yml OUT OF MEMORY 732.66 571.45 None bluetooth10-incorrect.yml false(unreach-call) 9.38 5.36 None bluetooth10.yml TIMEOUT 904.68 576.01 None ------------------------------------------------------------------------------------------ Run set 8 done 3228.49 581.75 - Automizer PARTIAL_ORDER_FA.DelaySleep.OrderRandom521.Bluetooth Benchmarks Run set 9 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe-Random521.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.95 4.06 None bluetooth01.yml true 4.81 3.35 None bluetooth02-incorrect.yml false(unreach-call) 5.78 3.45 None bluetooth02.yml true 8.31 5.54 None bluetooth03-incorrect.yml false(unreach-call) 6.47 4.19 None bluetooth03.yml true 13.30 9.34 None bluetooth04-incorrect.yml false(unreach-call) 7.17 5.01 None bluetooth04.yml true 24.76 18.64 None bluetooth05-incorrect.yml false(unreach-call) 9.87 6.13 None bluetooth05.yml true 35.78 25.54 None bluetooth06-incorrect.yml false(unreach-call) 8.83 5.77 None bluetooth06.yml OUT OF MEMORY 194.53 172.95 None bluetooth07-incorrect.yml false(unreach-call) 13.69 8.95 None bluetooth07.yml OUT OF MEMORY 266.70 244.80 None bluetooth08-incorrect.yml false(unreach-call) 8.42 5.04 None bluetooth08.yml OUT OF MEMORY 613.44 384.00 None bluetooth09-incorrect.yml false(unreach-call) 34.70 19.83 None bluetooth09.yml OUT OF MEMORY 159.04 122.33 None bluetooth10-incorrect.yml false(unreach-call) 58.60 41.68 None bluetooth10.yml TIMEOUT 901.80 586.34 None ------------------------------------------------------------------------------------------ Run set 9 done 2370.16 593.18 - Automizer PARTIAL_ORDER_FA.DelaySleep.OrderRandom7777.Bluetooth Benchmarks Run set 10 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleep-NoLbe-Random7777.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.45 3.83 None bluetooth01.yml true 4.59 3.16 None bluetooth02-incorrect.yml false(unreach-call) 5.31 3.51 None bluetooth02.yml true 8.63 5.80 None bluetooth03-incorrect.yml false(unreach-call) 6.74 4.20 None bluetooth03.yml true 13.09 8.40 None bluetooth04-incorrect.yml false(unreach-call) 6.85 4.75 None bluetooth04.yml true 20.29 12.99 None bluetooth05-incorrect.yml false(unreach-call) 7.84 7.84 None bluetooth05.yml TIMEOUT 915.06 564.68 None bluetooth06-incorrect.yml false(unreach-call) 7.73 5.17 None bluetooth06.yml OUT OF MEMORY 165.97 138.08 None bluetooth07-incorrect.yml false(unreach-call) 15.21 9.18 None bluetooth07.yml false(unreach-call) 25.56 19.22 None bluetooth08-incorrect.yml false(unreach-call) 6.80 4.18 None bluetooth08.yml TIMEOUT 917.65 688.25 None bluetooth09-incorrect.yml false(unreach-call) 27.49 16.40 None bluetooth09.yml TIMEOUT 903.86 583.89 None bluetooth10-incorrect.yml false(unreach-call) 7.76 4.54 None bluetooth10.yml TIMEOUT 904.09 568.00 None ------------------------------------------------------------------------------------------ Run set 10 done 3968.76 692.32 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.Bluetooth Benchmarks Run set 11 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.40 4.04 None bluetooth01.yml true 4.72 3.19 None bluetooth02-incorrect.yml false(unreach-call) 5.10 3.72 None bluetooth02.yml true 8.30 5.58 None bluetooth03-incorrect.yml false(unreach-call) 7.42 4.53 None bluetooth03.yml true 10.37 6.69 None bluetooth04-incorrect.yml false(unreach-call) 6.62 4.00 None bluetooth04.yml true 13.45 8.82 None bluetooth05-incorrect.yml false(unreach-call) 8.44 5.04 None bluetooth05.yml true 18.03 11.45 None bluetooth06-incorrect.yml false(unreach-call) 6.00 3.94 None bluetooth06.yml true 58.98 48.45 None bluetooth07-incorrect.yml false(unreach-call) 6.41 4.34 None bluetooth07.yml OUT OF MEMORY 314.78 254.79 None bluetooth08-incorrect.yml false(unreach-call) 7.70 4.55 None bluetooth08.yml TIMEOUT 906.42 616.24 None bluetooth09-incorrect.yml false(unreach-call) 12.44 6.68 None bluetooth09.yml TIMEOUT 906.17 648.86 None bluetooth10-incorrect.yml false(unreach-call) 12.53 7.11 None bluetooth10.yml TIMEOUT 906.86 693.14 None ------------------------------------------------------------------------------------------ Run set 11 done 3226.25 697.99 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.Symm.Bluetooth Benchmarks Run set 12 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Symm.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.82 3.75 None bluetooth01.yml true 4.92 3.63 None bluetooth02-incorrect.yml false(unreach-call) 5.18 3.72 None bluetooth02.yml true 8.09 5.85 None bluetooth03-incorrect.yml false(unreach-call) 7.38 4.56 None bluetooth03.yml true 10.99 6.95 None bluetooth04-incorrect.yml false(unreach-call) 6.39 4.29 None bluetooth04.yml true 14.52 9.06 None bluetooth05-incorrect.yml false(unreach-call) 10.34 6.34 None bluetooth05.yml true 21.16 12.88 None bluetooth06-incorrect.yml false(unreach-call) 6.59 4.00 None bluetooth06.yml true 78.50 64.42 None bluetooth07-incorrect.yml false(unreach-call) 6.80 4.43 None bluetooth07.yml OUT OF MEMORY 386.47 333.63 None bluetooth08-incorrect.yml false(unreach-call) 7.32 4.45 None bluetooth08.yml TIMEOUT 902.61 616.76 None bluetooth09-incorrect.yml false(unreach-call) 11.96 8.11 None bluetooth09.yml TIMEOUT 909.04 638.22 None bluetooth10-incorrect.yml false(unreach-call) 13.02 7.64 None bluetooth10.yml TIMEOUT 901.07 682.87 None ------------------------------------------------------------------------------------------ Run set 12 done 3316.28 688.38 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderLockstep.Bluetooth Benchmarks Run set 13 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.49 4.16 None bluetooth01.yml true 4.79 3.21 None bluetooth02-incorrect.yml false(unreach-call) 5.56 3.89 None bluetooth02.yml true 8.29 5.89 None bluetooth03-incorrect.yml false(unreach-call) 7.57 4.57 None bluetooth03.yml true 16.18 10.15 None bluetooth04-incorrect.yml false(unreach-call) 8.21 4.73 None bluetooth04.yml true 38.87 24.77 None bluetooth05-incorrect.yml false(unreach-call) 13.98 8.14 None bluetooth05.yml true 116.77 90.01 None bluetooth06-incorrect.yml false(unreach-call) 23.42 14.17 None bluetooth06.yml OUT OF MEMORY 201.59 168.15 None bluetooth07-incorrect.yml false(unreach-call) 42.23 31.81 None bluetooth07.yml OUT OF MEMORY 158.50 137.31 None bluetooth08-incorrect.yml TIMEOUT 901.99 670.82 None bluetooth08.yml OUT OF MEMORY 140.30 128.23 None bluetooth09-incorrect.yml TIMEOUT 900.81 637.51 None bluetooth09.yml OUT OF MEMORY 160.81 127.49 None bluetooth10-incorrect.yml TIMEOUT 904.13 606.59 None bluetooth10.yml OUT OF MEMORY 179.48 156.99 None ------------------------------------------------------------------------------------------ Run set 13 done 3831.31 675.21 - Automizer PARTIAL_ORDER_FA.NewStatesSleep.OrderRandom42.Bluetooth Benchmarks Run set 14 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleep-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.19 4.04 None bluetooth01.yml true 5.08 4.28 None bluetooth02-incorrect.yml false(unreach-call) 4.75 3.73 None bluetooth02.yml true 8.57 6.05 None bluetooth03-incorrect.yml false(unreach-call) 7.23 5.95 None bluetooth03.yml true 14.82 10.37 None bluetooth04-incorrect.yml false(unreach-call) 6.46 4.16 None bluetooth04.yml true 26.19 16.08 None bluetooth05-incorrect.yml false(unreach-call) 12.28 7.92 None bluetooth05.yml true 85.43 65.97 None bluetooth06-incorrect.yml false(unreach-call) 8.54 5.07 None bluetooth06.yml OUT OF MEMORY 201.51 179.47 None bluetooth07-incorrect.yml false(unreach-call) 20.23 13.29 None bluetooth07.yml OUT OF MEMORY 119.48 112.91 None bluetooth08-incorrect.yml false(unreach-call) 9.53 5.66 None bluetooth08.yml OUT OF MEMORY 216.08 159.83 None bluetooth09-incorrect.yml false(unreach-call) 24.06 15.53 None bluetooth09.yml TIMEOUT 907.35 533.55 None bluetooth10-incorrect.yml false(unreach-call) 12.41 7.09 None bluetooth10.yml OUT OF MEMORY 611.78 378.11 None ------------------------------------------------------------------------------------------ Run set 14 done 2301.61 538.15 - Automizer PARTIAL_ORDER_FA.NewStatesSleepUncond.Bluetooth Benchmarks Run set 15 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepUncond-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 5.87 3.79 None bluetooth01.yml true 4.76 3.27 None bluetooth02-incorrect.yml false(unreach-call) 5.15 4.55 None bluetooth02.yml true 7.71 4.87 None bluetooth03-incorrect.yml false(unreach-call) 7.02 4.40 None bluetooth03.yml true 13.43 8.20 None bluetooth04-incorrect.yml false(unreach-call) 6.05 3.87 None bluetooth04.yml true 30.46 18.56 None bluetooth05-incorrect.yml false(unreach-call) 8.43 5.08 None bluetooth05.yml true 86.49 67.54 None bluetooth06-incorrect.yml false(unreach-call) 5.82 3.60 None bluetooth06.yml OUT OF MEMORY 189.74 168.56 None bluetooth07-incorrect.yml false(unreach-call) 6.66 4.17 None bluetooth07.yml OUT OF MEMORY 127.45 117.32 None bluetooth08-incorrect.yml false(unreach-call) 7.14 4.25 None bluetooth08.yml OUT OF MEMORY 289.85 231.31 None bluetooth09-incorrect.yml false(unreach-call) 11.85 6.61 None bluetooth09.yml OUT OF MEMORY 301.28 220.91 None bluetooth10-incorrect.yml false(unreach-call) 15.97 9.22 None bluetooth10.yml OUT OF MEMORY 167.99 128.27 None ------------------------------------------------------------------------------------------ Run set 15 done 1291.35 235.34 - Automizer PARTIAL_ORDER_FA.Persistent.Bluetooth Benchmarks Run set 16 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-Persistent-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.20 3.93 None bluetooth01.yml true 4.68 3.36 None bluetooth02-incorrect.yml false(unreach-call) 5.06 3.44 None bluetooth02.yml true 8.72 6.05 None bluetooth03-incorrect.yml false(unreach-call) 9.53 6.00 None bluetooth03.yml true 15.48 10.13 None bluetooth04-incorrect.yml false(unreach-call) 7.75 4.95 None bluetooth04.yml true 34.02 20.47 None bluetooth05-incorrect.yml false(unreach-call) 7.30 7.15 None bluetooth05.yml true 68.86 50.56 None bluetooth06-incorrect.yml false(unreach-call) 8.93 5.63 None bluetooth06.yml OUT OF MEMORY 129.76 117.64 None bluetooth07-incorrect.yml false(unreach-call) 9.75 6.00 None bluetooth07.yml OUT OF MEMORY 218.74 199.83 None bluetooth08-incorrect.yml false(unreach-call) 10.45 6.13 None bluetooth08.yml OUT OF MEMORY 379.20 303.78 None bluetooth09-incorrect.yml false(unreach-call) 14.19 7.92 None bluetooth09.yml OUT OF MEMORY 198.85 168.69 None bluetooth10-incorrect.yml false(unreach-call) 11.97 6.85 None bluetooth10.yml OUT OF MEMORY 125.09 101.03 None ------------------------------------------------------------------------------------------ Run set 16 done 1259.14 307.64 - Automizer PARTIAL_ORDER_FA.DelaySleepPersistent.Bluetooth Benchmarks Run set 17 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleepPersistent-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.39 3.96 None bluetooth01.yml true 4.97 3.55 None bluetooth02-incorrect.yml false(unreach-call) 5.32 3.61 None bluetooth02.yml true 7.47 4.78 None bluetooth03-incorrect.yml false(unreach-call) 7.90 4.96 None bluetooth03.yml true 9.56 6.04 None bluetooth04-incorrect.yml false(unreach-call) 7.32 4.57 None bluetooth04.yml true 14.08 8.39 None bluetooth05-incorrect.yml false(unreach-call) 10.94 6.40 None bluetooth05.yml true 18.63 11.04 None bluetooth06-incorrect.yml false(unreach-call) 42.15 29.75 None bluetooth06.yml true 58.66 44.65 None bluetooth07-incorrect.yml false(unreach-call) 252.85 229.66 None bluetooth07.yml OUT OF MEMORY 210.78 199.03 None bluetooth08-incorrect.yml TIMEOUT 900.67 703.77 None bluetooth08.yml TIMEOUT 901.73 763.41 None bluetooth09-incorrect.yml TIMEOUT 900.83 700.63 None bluetooth09.yml TIMEOUT 906.08 611.86 None bluetooth10-incorrect.yml TIMEOUT 902.15 695.39 None bluetooth10.yml TIMEOUT 903.63 642.84 None ------------------------------------------------------------------------------------------ Run set 17 done 6067.86 767.93 - Automizer PARTIAL_ORDER_FA.DelaySleepPersistentFixedOrder.Bluetooth Benchmarks Run set 18 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-DelaySleepPersistentFixedOrder-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.43 4.12 None bluetooth01.yml true 5.41 3.74 None bluetooth02-incorrect.yml false(unreach-call) 5.30 3.54 None bluetooth02.yml true 8.72 5.82 None bluetooth03-incorrect.yml false(unreach-call) 9.33 5.88 None bluetooth03.yml true 11.93 7.32 None bluetooth04-incorrect.yml false(unreach-call) 9.91 6.25 None bluetooth04.yml true 18.75 11.19 None bluetooth05-incorrect.yml false(unreach-call) 14.52 8.40 None bluetooth05.yml true 30.42 21.01 None bluetooth06-incorrect.yml false(unreach-call) 132.17 113.50 None bluetooth06.yml true 122.31 105.53 None bluetooth07-incorrect.yml false(unreach-call) 416.23 383.49 None bluetooth07.yml OUT OF MEMORY 166.03 158.08 None bluetooth08-incorrect.yml TIMEOUT 907.04 691.58 None bluetooth08.yml TIMEOUT 906.25 730.70 None bluetooth09-incorrect.yml TIMEOUT 900.96 695.76 None bluetooth09.yml TIMEOUT 905.44 753.72 None bluetooth10-incorrect.yml TIMEOUT 908.51 716.29 None bluetooth10.yml TIMEOUT 906.87 716.64 None ------------------------------------------------------------------------------------------ Run set 18 done 6391.49 760.03 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.Bluetooth Benchmarks Run set 19 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.41 4.47 None bluetooth01.yml true 4.83 3.52 None bluetooth02-incorrect.yml false(unreach-call) 5.33 3.77 None bluetooth02.yml true 8.31 5.31 None bluetooth03-incorrect.yml false(unreach-call) 7.39 4.54 None bluetooth03.yml true 11.34 7.00 None bluetooth04-incorrect.yml false(unreach-call) 6.54 4.11 None bluetooth04.yml true 17.91 10.86 None bluetooth05-incorrect.yml false(unreach-call) 6.51 4.33 None bluetooth05.yml true 30.53 20.16 None bluetooth06-incorrect.yml false(unreach-call) 8.25 5.03 None bluetooth06.yml true 99.75 86.71 None bluetooth07-incorrect.yml false(unreach-call) 8.50 5.14 None bluetooth07.yml OUT OF MEMORY 203.32 190.43 None bluetooth08-incorrect.yml false(unreach-call) 13.34 7.46 None bluetooth08.yml TIMEOUT 909.01 644.55 None bluetooth09-incorrect.yml false(unreach-call) 14.11 8.13 None bluetooth09.yml TIMEOUT 903.45 653.97 None bluetooth10-incorrect.yml false(unreach-call) 19.28 10.64 None bluetooth10.yml TIMEOUT 907.43 678.10 None ------------------------------------------------------------------------------------------ Run set 19 done 3190.50 683.02 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderLockstep.Bluetooth Benchmarks Run set 20 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Lockstep.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.13 3.88 None bluetooth01.yml true 4.96 3.36 None bluetooth02-incorrect.yml false(unreach-call) 5.18 3.84 None bluetooth02.yml true 8.86 5.64 None bluetooth03-incorrect.yml false(unreach-call) 8.05 4.83 None bluetooth03.yml true 20.98 12.92 None bluetooth04-incorrect.yml false(unreach-call) 9.19 6.05 None bluetooth04.yml true 66.33 47.24 None bluetooth05-incorrect.yml false(unreach-call) 22.09 16.47 None bluetooth05.yml true 395.34 341.89 None bluetooth06-incorrect.yml false(unreach-call) 21.60 11.87 None bluetooth06.yml OUT OF MEMORY 151.97 141.59 None bluetooth07-incorrect.yml false(unreach-call) 31.50 20.72 None bluetooth07.yml OUT OF MEMORY 83.80 75.67 None bluetooth08-incorrect.yml false(unreach-call) 299.10 261.91 None bluetooth08.yml OUT OF MEMORY 739.68 649.47 None bluetooth09-incorrect.yml TIMEOUT 908.33 732.25 None bluetooth09.yml OUT OF MEMORY 257.27 223.77 None bluetooth10-incorrect.yml TIMEOUT 906.14 723.67 None bluetooth10.yml OUT OF MEMORY 704.33 621.72 None ------------------------------------------------------------------------------------------ Run set 20 done 4644.31 736.57 - Automizer PARTIAL_ORDER_FA.NewStatesSleepPersistentFixedOrder.OrderRandom42.Bluetooth Benchmarks Run set 21 of 21 with options '--force-no-wrapper -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-POR-NewStatesSleepPersistentFixedOrder-NoLbe-Random42.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------ bluetooth01-incorrect.yml false(unreach-call) 6.29 4.12 None bluetooth01.yml true 5.25 3.78 None bluetooth02-incorrect.yml false(unreach-call) 5.60 4.22 None bluetooth02.yml true 9.38 6.62 None bluetooth03-incorrect.yml false(unreach-call) 8.35 4.93 None bluetooth03.yml true 20.02 12.52 None bluetooth04-incorrect.yml false(unreach-call) 10.39 6.21 None bluetooth04.yml true 43.56 28.30 None bluetooth05-incorrect.yml false(unreach-call) 36.65 30.40 None bluetooth05.yml true 283.07 247.11 None bluetooth06-incorrect.yml false(unreach-call) 13.36 7.48 None bluetooth06.yml OUT OF MEMORY 201.55 183.06 None bluetooth07-incorrect.yml false(unreach-call) 47.34 34.98 None bluetooth07.yml OUT OF MEMORY 455.47 428.85 None bluetooth08-incorrect.yml false(unreach-call) 22.77 13.79 None bluetooth08.yml OUT OF MEMORY 557.04 480.96 None bluetooth09-incorrect.yml false(unreach-call) 70.98 58.86 None bluetooth09.yml TIMEOUT 904.74 782.00 None bluetooth10-incorrect.yml false(unreach-call) 28.73 17.24 None bluetooth10.yml OUT OF MEMORY 355.46 299.14 None ------------------------------------------------------------------------------------------ Run set 21 done 3080.57 788.04 - Statistics: 420 Files correct: 280 correct true: 111 correct false: 169 incorrect: 1 incorrect true: 0 incorrect false: 1 unknown: 139 Score: 375 (max: 630)