BENCHMARK INFORMATION benchmark definition: ../benchexec/sleep-threadmodular.xml name: sleep-threadmodular run sets: SleepSymbolic-Symmetry.Eldarica.threadmodular-examples, SleepSymbolic-Symmetry.Z3.threadmodular-examples, SleepSymbolic-Symmetry.Golem.threadmodular-examples, NoSleep-Symmetry.Eldarica.threadmodular-examples, NoSleep-Symmetry.Z3.threadmodular-examples, NoSleep-Symmetry.Golem.threadmodular-examples date: Tue, 2023-09-12 10:49:52 CEST tool: ULTIMATE Automizer 0.2.3-dd9be670 tool executable: ./Ultimate.py options: --force-no-wrapper -s '${taskdef_path}/ThreadModularVerifier.Settings.epf' parallel runs: 7 resource limits: - memory: 15000.0 MB - time: 1800 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 15000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.60-1-pve-x86_64-with-glibc2.31 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 4549.121 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ SleepExplicit.Eldarica.threadmodular-examples Run set 1 of 15: skipped SleepExplicit.Z3.threadmodular-examples Run set 2 of 15: skipped SleepExplicit.Golem.threadmodular-examples Run set 3 of 15: skipped SleepSymbolic.Eldarica.threadmodular-examples Run set 4 of 15: skipped SleepSymbolic.Z3.threadmodular-examples Run set 5 of 15: skipped SleepSymbolic.Golem.threadmodular-examples Run set 6 of 15: skipped SleepSymbolic-Symmetry.Eldarica.threadmodular-examples Run set 7 of 15 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 93.39 50.86 None add-sub-positive-k/add-sub-positive-k.yml unknown 32.24 18.99 None bluetooth-better/bluetooth-better.yml TIMEOUT 1804.36 1177.48 None bluetooth/bluetooth.yml unknown 405.64 294.18 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.66 4.80 None equalsum-ghost/equalsum-ghost.yml unknown 226.98 145.66 None inc-bdec/inc-bdec.yml unknown 47.85 25.53 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 53.26 27.49 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 61.71 36.27 None inc-dec-eq0/inc-dec-eq0.yml unknown 54.48 29.99 None inc-dec-geq0/inc-dec-geq0.yml unknown 73.87 38.33 None line-queue/line-queue.yml TIMEOUT 1802.11 1573.25 None lock/lock.yml unknown 33.60 18.79 None mutex-3/mutex-3.yml unknown 24.86 13.26 None mutex-4/mutex-4.yml unknown 11.92 6.73 None mutex-5/mutex-5.yml unknown 32.81 17.23 None mutex-unbounded/mutex-unbounded.yml unknown 11.69 7.31 None notify-listeners/notify-listeners.yml TIMEOUT 1801.65 1725.53 None numbered-array/numbered-array.yml unknown 16.07 9.05 None thread-pooling/thread-pooling.yml TIMEOUT 1803.48 1282.49 None ticket/ticket.yml unknown 13.43 7.82 None ------------------------------------------------------------------------------------------------------------------------ Run set 7 done 8414.43 1803.10 - SleepSymbolic-Symmetry.Z3.threadmodular-examples Run set 8 of 15 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 7.72 4.98 None add-sub-positive-k/add-sub-positive-k.yml unknown 7.91 6.39 None bluetooth-better/bluetooth-better.yml unknown 13.46 9.39 None bluetooth/bluetooth.yml unknown 13.23 8.76 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.07 4.56 None equalsum-ghost/equalsum-ghost.yml unknown 17.90 14.28 None inc-bdec/inc-bdec.yml unknown 6.01 4.22 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 12.67 10.46 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 56.40 52.91 None inc-dec-eq0/inc-dec-eq0.yml unknown 7.84 5.30 None inc-dec-geq0/inc-dec-geq0.yml unknown 5.61 3.84 None line-queue/line-queue.yml TIMEOUT 1801.77 1793.31 None lock/lock.yml unknown 8.04 4.66 None mutex-3/mutex-3.yml unknown 5.91 3.94 None mutex-4/mutex-4.yml unknown 6.99 4.19 None mutex-5/mutex-5.yml unknown 7.14 4.26 None mutex-unbounded/mutex-unbounded.yml unknown 7.45 4.42 None notify-listeners/notify-listeners.yml TIMEOUT 1801.67 1799.17 None numbered-array/numbered-array.yml unknown 7.63 4.48 None thread-pooling/thread-pooling.yml unknown 7.35 4.52 None ticket/ticket.yml unknown 7.87 4.67 None ------------------------------------------------------------------------------------------------------------------------ Run set 8 done 3819.04 1814.81 - SleepSymbolic-Symmetry.Golem.threadmodular-examples Run set 9 of 15 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 8.28 5.19 None add-sub-positive-k/add-sub-positive-k.yml unknown 6.61 4.83 None bluetooth-better/bluetooth-better.yml unknown 41.60 36.97 None bluetooth/bluetooth.yml unknown 10.71 6.45 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.60 4.29 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 8.19 4.57 None inc-bdec/inc-bdec.yml unknown 5.72 3.47 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 49.85 47.08 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 59.04 55.36 None inc-dec-eq0/inc-dec-eq0.yml unknown 5.89 3.91 None inc-dec-geq0/inc-dec-geq0.yml unknown 7.40 4.32 None line-queue/line-queue.yml ERROR: EXCEPTION 107.45 101.58 None lock/lock.yml unknown 7.89 4.59 None mutex-3/mutex-3.yml unknown 5.40 3.57 None mutex-4/mutex-4.yml unknown 6.42 3.70 None mutex-5/mutex-5.yml unknown 7.05 3.97 None mutex-unbounded/mutex-unbounded.yml unknown 5.43 3.57 None notify-listeners/notify-listeners.yml ERROR: EXCEPTION 7.92 4.41 None numbered-array/numbered-array.yml ERROR: EXCEPTION 7.13 3.97 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 6.66 4.05 None ticket/ticket.yml unknown 7.99 4.82 None ------------------------------------------------------------------------------------------------------------------------ Run set 9 done 380.62 107.80 - NoSleep.Eldarica.threadmodular-examples Run set 10 of 15: skipped NoSleep.Z3.threadmodular-examples Run set 11 of 15: skipped NoSleep.Golem.threadmodular-examples Run set 12 of 15: skipped NoSleep-Symmetry.Eldarica.threadmodular-examples Run set 13 of 15 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 35.97 19.43 None add-sub-positive-k/add-sub-positive-k.yml unknown 16.89 10.31 None bluetooth-better/bluetooth-better.yml unknown 23.05 12.22 None bluetooth/bluetooth.yml unknown 15.94 8.66 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 6.55 3.81 None equalsum-ghost/equalsum-ghost.yml unknown 34.45 17.91 None inc-bdec/inc-bdec.yml unknown 9.61 5.61 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 11.93 6.60 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 95.99 70.37 None inc-dec-eq0/inc-dec-eq0.yml unknown 16.19 8.95 None inc-dec-geq0/inc-dec-geq0.yml unknown 18.89 10.47 None line-queue/line-queue.yml unknown 16.67 9.00 None lock/lock.yml unknown 16.31 9.01 None mutex-3/mutex-3.yml unknown 10.47 5.85 None mutex-4/mutex-4.yml unknown 10.91 6.08 None mutex-5/mutex-5.yml unknown 9.79 5.55 None mutex-unbounded/mutex-unbounded.yml unknown 10.24 5.83 None notify-listeners/notify-listeners.yml TIMEOUT 1801.63 1742.26 None numbered-array/numbered-array.yml unknown 11.74 6.47 None thread-pooling/thread-pooling.yml unknown 14.31 7.83 None ticket/ticket.yml unknown 10.73 6.10 None ------------------------------------------------------------------------------------------------------------------------ Run set 13 done 2198.68 1763.98 - NoSleep-Symmetry.Z3.threadmodular-examples Run set 14 of 15 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 7.66 5.13 None add-sub-positive-k/add-sub-positive-k.yml unknown 5.72 3.96 None bluetooth-better/bluetooth-better.yml unknown 7.20 4.44 None bluetooth/bluetooth.yml unknown 9.55 6.68 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 6.94 3.89 None equalsum-ghost/equalsum-ghost.yml unknown 7.40 4.48 None inc-bdec/inc-bdec.yml unknown 5.19 3.33 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 5.48 3.67 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 6.50 4.59 None inc-dec-eq0/inc-dec-eq0.yml unknown 7.18 4.32 None inc-dec-geq0/inc-dec-geq0.yml unknown 6.65 4.03 None line-queue/line-queue.yml unknown 7.22 4.30 None lock/lock.yml unknown 6.97 4.23 None mutex-3/mutex-3.yml unknown 7.01 4.20 None mutex-4/mutex-4.yml unknown 4.97 3.24 None mutex-5/mutex-5.yml unknown 5.36 3.53 None mutex-unbounded/mutex-unbounded.yml unknown 6.79 4.07 None notify-listeners/notify-listeners.yml TIMEOUT 1801.66 1796.03 None numbered-array/numbered-array.yml unknown 7.17 4.29 None thread-pooling/thread-pooling.yml unknown 7.13 4.27 None ticket/ticket.yml unknown 4.97 3.27 None ------------------------------------------------------------------------------------------------------------------------ Run set 14 done 1935.10 1805.79 - NoSleep-Symmetry.Golem.threadmodular-examples Run set 15 of 15 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 7.76 4.80 None add-sub-positive-k/add-sub-positive-k.yml unknown 6.88 4.85 None bluetooth-better/bluetooth-better.yml unknown 8.21 5.15 None bluetooth/bluetooth.yml unknown 28.17 25.16 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.04 4.01 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 7.02 3.98 None inc-bdec/inc-bdec.yml unknown 5.33 3.11 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 6.03 4.10 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 53.61 50.46 None inc-dec-eq0/inc-dec-eq0.yml unknown 7.22 4.29 None inc-dec-geq0/inc-dec-geq0.yml unknown 6.85 3.85 None line-queue/line-queue.yml ERROR: EXCEPTION 5.06 3.16 None lock/lock.yml unknown 7.09 4.13 None mutex-3/mutex-3.yml unknown 5.14 3.09 None mutex-4/mutex-4.yml unknown 5.38 3.63 None mutex-5/mutex-5.yml unknown 6.63 3.81 None mutex-unbounded/mutex-unbounded.yml unknown 6.62 3.83 None notify-listeners/notify-listeners.yml ERROR: EXCEPTION 6.89 3.88 None numbered-array/numbered-array.yml ERROR: EXCEPTION 5.35 3.08 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 5.26 3.51 None ticket/ticket.yml unknown 6.47 3.74 None ------------------------------------------------------------------------------------------------------------------------ Run set 15 done 204.41 55.56 - Statistics: 126 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 126 Score: 0 (max: 252)