BENCHMARK INFORMATION benchmark definition: ../benchexec/sleep-threadmodular.xml name: sleep-threadmodular run sets: SleepExplicit.NondetSleep.Eldarica.threadmodular-examples, SleepExplicit.NondetSleep.Z3.threadmodular-examples, SleepExplicit.NondetSleep.Golem.threadmodular-examples, SleepExplicit.NondetSleep.NecSufComm.Eldarica.threadmodular-examples, SleepExplicit.NecSufComm.Eldarica.threadmodular-examples, SleepExplicit.NecSufComm.Z3.threadmodular-examples, SleepExplicit.NecSufComm.Golem.threadmodular-examples date: Mon, 2024-12-30 11:41:50 CET tool: ULTIMATE Automizer 0.3.0-07d31464 tool executable: ./Ultimate.py options: --force-no-wrapper -s '${taskdef_path}/../ThreadModularVerifier.Settings.epf' parallel runs: 6 resource limits: - memory: 22000.0 MB - time: 7200 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 22000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-6.8.12-5-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ SleepExplicit.Eldarica.threadmodular-examples Run set 1 of 22: skipped SleepExplicit.Z3.threadmodular-examples Run set 2 of 22: skipped SleepExplicit.Golem.threadmodular-examples Run set 3 of 22: skipped SleepExplicit.NondetSleep.Eldarica.threadmodular-examples Run set 4 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend ELDARICA --icfgtochc.use.nondeterministic.sleep.update.encoding true' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 81.85 53.10 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 154.29 132.24 None bluetooth-better/bluetooth-better.ELDARICA.yml TIMEOUT 7203.56 3661.33 None equalsum-ghost/equalsum-ghost.ELDARICA.yml TIMEOUT 7202.40 4972.02 None inc-bdec/inc-bdec.GOLEM.yml unknown 60.44 34.28 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml unknown 128.55 102.65 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml unknown 6104.51 4138.35 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 54.75 30.64 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 38.14 20.03 None line-queue/line-queue.ELDARICA.yml ERROR: EXCEPTION 5926.60 3326.12 None lock/lock.Z3.yml unknown 17.93 9.59 None mutex-3/mutex-3.GOLEM.yml unknown 45.29 24.16 None mutex-4/mutex-4.GOLEM.yml unknown 36.59 21.16 None mutex-5/mutex-5.GOLEM.yml unknown 63.89 38.28 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 30.82 17.19 None notify-listeners/notify-listeners.ELDARICA.yml unknown 258.16 217.31 None numbered-array/numbered-array.Z3.yml unknown 61.31 33.71 None thread-pooling/thread-pooling.ELDARICA.yml TIMEOUT 7203.35 3773.68 None ticket/ticket.ELDARICA.yml TIMEOUT (ERROR: EXCEPTION) 7200.11 3938.53 None --------------------------------------------------------------------------------------------------------------------------------- Run set 4 done 41872.77 4972.46 - SleepExplicit.NondetSleep.Z3.threadmodular-examples Run set 5 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend Z3 --icfgtochc.use.nondeterministic.sleep.update.encoding true' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 256.14 253.38 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 576.60 575.56 None bluetooth-better/bluetooth-better.ELDARICA.yml unknown 1306.49 1301.79 None equalsum-ghost/equalsum-ghost.ELDARICA.yml TIMEOUT 7201.98 7190.36 None inc-bdec/inc-bdec.GOLEM.yml unknown 96.43 93.70 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml TIMEOUT 7201.95 7193.13 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml TIMEOUT 7201.96 7186.16 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 65.61 63.30 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 8.76 6.79 None line-queue/line-queue.ELDARICA.yml unknown 101.12 92.75 None lock/lock.Z3.yml unknown 7.01 4.04 None mutex-3/mutex-3.GOLEM.yml unknown 7.46 5.23 None mutex-4/mutex-4.GOLEM.yml unknown 7.61 5.30 None mutex-5/mutex-5.GOLEM.yml unknown 7.02 4.88 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 7.32 5.31 None notify-listeners/notify-listeners.ELDARICA.yml unknown 247.18 242.88 None numbered-array/numbered-array.Z3.yml unknown 4.40 3.09 None thread-pooling/thread-pooling.ELDARICA.yml TIMEOUT 7201.74 7201.40 None ticket/ticket.ELDARICA.yml unknown 730.83 727.13 None --------------------------------------------------------------------------------------------------------------------------------- Run set 5 done 32237.90 7780.86 - SleepExplicit.NondetSleep.Golem.threadmodular-examples Run set 6 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend GOLEM --icfgtochc.use.nondeterministic.sleep.update.encoding true' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 89.34 86.58 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 220.90 219.35 None bluetooth-better/bluetooth-better.ELDARICA.yml TIMEOUT 7201.54 7193.68 None equalsum-ghost/equalsum-ghost.ELDARICA.yml ERROR: EXCEPTION 6.35 3.64 None inc-bdec/inc-bdec.GOLEM.yml unknown 23.80 21.38 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml TIMEOUT 7201.51 7191.36 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml TIMEOUT 7201.50 7190.11 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 21.78 19.46 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 9.40 6.99 None line-queue/line-queue.ELDARICA.yml ERROR: EXCEPTION 98.43 91.45 None lock/lock.Z3.yml unknown 7.24 4.19 None mutex-3/mutex-3.GOLEM.yml unknown 6.74 4.46 None mutex-4/mutex-4.GOLEM.yml unknown 6.72 4.43 None mutex-5/mutex-5.GOLEM.yml unknown 6.43 4.32 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 5.48 3.37 None notify-listeners/notify-listeners.ELDARICA.yml ERROR: EXCEPTION 8.19 4.43 None numbered-array/numbered-array.Z3.yml ERROR: EXCEPTION 5.46 3.09 None thread-pooling/thread-pooling.ELDARICA.yml ERROR: EXCEPTION 14.13 7.41 None ticket/ticket.ELDARICA.yml TIMEOUT 7201.71 7185.87 None --------------------------------------------------------------------------------------------------------------------------------- Run set 6 done 29336.97 7310.38 - SleepExplicit.NondetSleep.NecSufComm.Eldarica.threadmodular-examples Run set 7 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend ELDARICA --icfgtochc.use.nondeterministic.sleep.update.encoding true --icfgtochc.conditional.independence NECESSARY_AND_SUFFICIENT' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 145.54 110.46 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 150.14 127.46 None bluetooth-better/bluetooth-better.ELDARICA.yml ERROR: EXCEPTION 846.07 464.59 None equalsum-ghost/equalsum-ghost.ELDARICA.yml TIMEOUT 7204.32 5547.95 None inc-bdec/inc-bdec.GOLEM.yml unknown 62.53 34.76 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml unknown 129.46 103.07 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml unknown 6283.17 4251.07 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 43.33 26.92 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 39.37 20.63 None line-queue/line-queue.ELDARICA.yml ERROR: EXCEPTION 240.39 198.51 None lock/lock.Z3.yml unknown 13.97 8.18 None mutex-3/mutex-3.GOLEM.yml unknown 42.45 22.26 None mutex-4/mutex-4.GOLEM.yml unknown 32.24 18.54 None mutex-5/mutex-5.GOLEM.yml unknown 44.88 23.65 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 30.66 17.22 None notify-listeners/notify-listeners.ELDARICA.yml unknown 628.36 572.07 None numbered-array/numbered-array.Z3.yml unknown 70.37 39.71 None thread-pooling/thread-pooling.ELDARICA.yml ERROR: EXCEPTION 5629.20 3005.85 None ticket/ticket.ELDARICA.yml ERROR: EXCEPTION 4873.81 2745.03 None --------------------------------------------------------------------------------------------------------------------------------- Run set 7 done 26510.51 5548.20 - SleepExplicit.NecSufComm.Eldarica.threadmodular-examples Run set 8 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend ELDARICA --icfgtochc.conditional.independence NECESSARY_AND_SUFFICIENT' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 247.04 205.44 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 409.22 375.32 None bluetooth-better/bluetooth-better.ELDARICA.yml TIMEOUT 7203.27 3678.99 None equalsum-ghost/equalsum-ghost.ELDARICA.yml ERROR: EXCEPTION 1257.91 718.70 None inc-bdec/inc-bdec.GOLEM.yml unknown 216.15 160.99 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml unknown 579.76 526.97 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml TIMEOUT 7202.34 5038.67 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 99.29 67.12 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 82.63 48.59 None line-queue/line-queue.ELDARICA.yml ERROR: EXCEPTION 5644.92 3213.60 None lock/lock.Z3.yml unknown 30.14 16.76 None mutex-3/mutex-3.GOLEM.yml unknown 51.36 30.98 None mutex-4/mutex-4.GOLEM.yml unknown 52.60 32.77 None mutex-5/mutex-5.GOLEM.yml unknown 52.33 31.97 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 56.20 34.22 None notify-listeners/notify-listeners.ELDARICA.yml unknown 619.92 558.72 None numbered-array/numbered-array.Z3.yml unknown 99.86 70.42 None thread-pooling/thread-pooling.ELDARICA.yml TIMEOUT 7202.31 4561.17 None ticket/ticket.ELDARICA.yml TIMEOUT 7203.16 4863.33 None --------------------------------------------------------------------------------------------------------------------------------- Run set 8 done 38310.66 5582.63 - SleepExplicit.NecSufComm.Z3.threadmodular-examples Run set 9 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend Z3 --icfgtochc.conditional.independence NECESSARY_AND_SUFFICIENT' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 256.55 253.49 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 1393.20 1391.44 None bluetooth-better/bluetooth-better.ELDARICA.yml unknown 1655.67 1651.04 None equalsum-ghost/equalsum-ghost.ELDARICA.yml TIMEOUT 7202.01 7189.85 None inc-bdec/inc-bdec.GOLEM.yml unknown 96.38 93.65 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml TIMEOUT 7201.99 7193.56 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml TIMEOUT 7201.95 7186.26 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 65.46 63.23 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 7.33 5.13 None line-queue/line-queue.ELDARICA.yml TIMEOUT 7201.92 7184.22 None lock/lock.Z3.yml unknown 4.90 3.25 None mutex-3/mutex-3.GOLEM.yml unknown 6.37 5.03 None mutex-4/mutex-4.GOLEM.yml unknown 6.23 4.71 None mutex-5/mutex-5.GOLEM.yml unknown 6.85 5.44 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 5.65 4.26 None notify-listeners/notify-listeners.ELDARICA.yml unknown 703.00 700.75 None numbered-array/numbered-array.Z3.yml unknown 4.16 2.69 None thread-pooling/thread-pooling.ELDARICA.yml TIMEOUT 7201.92 7192.09 None ticket/ticket.ELDARICA.yml unknown 2226.03 2223.89 None --------------------------------------------------------------------------------------------------------------------------------- Run set 9 done 42447.88 8846.60 - SleepExplicit.NecSufComm.Golem.threadmodular-examples Run set 10 of 22 with options '--force-no-wrapper -s ${taskdef_path}/../ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/concurrent/bpl/parameterized/ThreadModularVerifier.xml --chcsolver.chc.solver.backend GOLEM --icfgtochc.conditional.independence NECESSARY_AND_SUFFICIENT' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------- add-sub-k/add-sub-k.GOLEM.yml unknown 66.88 64.37 None add-sub-positive-k/add-sub-positive-k.ELDARICA.yml unknown 137.61 135.94 None bluetooth-better/bluetooth-better.ELDARICA.yml unknown 3581.15 3575.60 None equalsum-ghost/equalsum-ghost.ELDARICA.yml ERROR: EXCEPTION 7.29 4.07 None inc-bdec/inc-bdec.GOLEM.yml unknown 34.87 32.33 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.ELDARICA.yml TIMEOUT 7201.51 7192.23 None inc-dec-eq0-locked/inc-dec-eq0-locked.ELDARICA.yml TIMEOUT 7201.51 7191.56 None inc-dec-eq0/inc-dec-eq0.GOLEM.yml unknown 22.78 20.47 None inc-dec-geq0/inc-dec-geq0.GOLEM.yml unknown 6.36 4.04 None line-queue/line-queue.ELDARICA.yml ERROR: EXCEPTION 8.67 4.72 None lock/lock.Z3.yml unknown 6.68 3.95 None mutex-3/mutex-3.GOLEM.yml unknown 6.27 4.03 None mutex-4/mutex-4.GOLEM.yml unknown 7.21 4.84 None mutex-5/mutex-5.GOLEM.yml unknown 7.65 5.41 None mutex-unbounded/mutex-unbounded.GOLEM.yml unknown 5.72 3.52 None notify-listeners/notify-listeners.ELDARICA.yml ERROR: EXCEPTION 7.65 4.13 None numbered-array/numbered-array.Z3.yml ERROR: EXCEPTION 5.41 3.08 None thread-pooling/thread-pooling.ELDARICA.yml ERROR: EXCEPTION 11.49 6.07 None ticket/ticket.ELDARICA.yml TIMEOUT 7201.65 7187.07 None --------------------------------------------------------------------------------------------------------------------------------- Run set 10 done 25528.69 7266.24 - SleepSymbolic.Eldarica.threadmodular-examples Run set 11 of 22: skipped SleepSymbolic.Z3.threadmodular-examples Run set 12 of 22: skipped SleepSymbolic.Golem.threadmodular-examples Run set 13 of 22: skipped SleepSymbolic-Symmetry.Eldarica.threadmodular-examples Run set 14 of 22: skipped SleepSymbolic-Symmetry.Z3.threadmodular-examples Run set 15 of 22: skipped SleepSymbolic-Symmetry.Golem.threadmodular-examples Run set 16 of 22: skipped NoSleep.Eldarica.threadmodular-examples Run set 17 of 22: skipped NoSleep.Z3.threadmodular-examples Run set 18 of 22: skipped NoSleep.Golem.threadmodular-examples Run set 19 of 22: skipped NoSleep-Symmetry.Eldarica.threadmodular-examples Run set 20 of 22: skipped NoSleep-Symmetry.Z3.threadmodular-examples Run set 21 of 22: skipped NoSleep-Symmetry.Golem.threadmodular-examples Run set 22 of 22: skipped Statistics: 133 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 133 Score: 0 (max: 266)