BENCHMARK INFORMATION benchmark definition: ../benchexec/sleep-threadmodular.xml name: sleep-threadmodular run sets: Eldarica.threadmodular-examples, Z3.threadmodular-examples, Golem.threadmodular-examples, TreeAutomizer.threadmodular-examples, UniHorn.threadmodular-examples date: Wed, 2023-05-31 11:49:37 CEST tool: ULTIMATE Automizer 0.2.3-fe2097d1 tool executable: ./Ultimate.py options: --force-no-wrapper -s '${taskdef_path}/ThreadModularVerifier.Settings.epf' parallel runs: 7 resource limits: - memory: 15000.0 MB - time: 1800 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 15000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.60-1-pve-x86_64-with-glibc2.31 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 4549.121 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Eldarica.threadmodular-examples Run set 1 of 5 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml TIMEOUT 1802.18 1747.41 None add-sub-positive-k/add-sub-positive-k.yml TIMEOUT 1800.61 1767.76 None bluetooth/bluetooth.yml TIMEOUT 1801.86 1509.47 None equalsum-fork/equalsum-fork.yml OUT OF MEMORY 410.86 345.61 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1822.15 1387.36 None inc-bdec/inc-bdec.yml TIMEOUT 1801.10 1740.15 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 564.22 536.76 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.53 1691.55 None inc-dec-eq0/inc-dec-eq0.yml TIMEOUT 1804.38 1769.11 None inc-dec-geq0/inc-dec-geq0.yml unknown 41.33 22.93 None lock/lock.yml unknown 18.75 9.94 None numbered-array/numbered-array.yml ERROR: EXCEPTION 24.49 12.78 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 1060.66 979.52 None ticket/ticket.yml TIMEOUT 1800.86 1739.36 None ------------------------------------------------------------------------------------------------------------------------ Run set 1 done 16555.20 3250.36 - Z3.threadmodular-examples Run set 2 of 5 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 17.31 15.03 None add-sub-positive-k/add-sub-positive-k.yml unknown 16.23 14.53 None bluetooth/bluetooth.yml unknown 19.54 16.08 None equalsum-fork/equalsum-fork.yml unknown 7.08 4.51 None equalsum-ghost/equalsum-ghost.yml unknown 6.41 3.70 None inc-bdec/inc-bdec.yml unknown 18.05 15.13 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 16.88 14.76 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 17.89 15.29 None inc-dec-eq0/inc-dec-eq0.yml unknown 15.88 14.44 None inc-dec-geq0/inc-dec-geq0.yml unknown 16.11 14.45 None lock/lock.yml unknown 16.33 14.66 None numbered-array/numbered-array.yml unknown 5.38 3.17 None thread-pooling/thread-pooling.yml unknown 8.01 4.50 None ticket/ticket.yml unknown 17.60 15.19 None ------------------------------------------------------------------------------------------------------------------------ Run set 2 done 198.95 31.73 - Golem.threadmodular-examples Run set 3 of 5 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 5.35 3.03 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 4.08 2.47 None bluetooth/bluetooth.yml ERROR: EXCEPTION 7.32 4.12 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 5.52 3.33 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 5.99 3.58 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.67 3.26 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 4.51 2.69 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 4.76 2.69 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 4.02 2.43 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 5.35 3.05 None lock/lock.yml ERROR: EXCEPTION 5.54 3.24 None numbered-array/numbered-array.yml ERROR: EXCEPTION 4.06 2.54 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 7.74 4.33 None ticket/ticket.yml ERROR: EXCEPTION 5.50 3.14 None ------------------------------------------------------------------------------------------------------------------------ Run set 3 done 75.65 8.42 - TreeAutomizer.threadmodular-examples Run set 4 of 5 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend TREEAUTOMIZER --chcsolver.produce.chc.model.if.query.is.sat false --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 5.05 2.90 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 4.16 2.53 None bluetooth/bluetooth.yml ERROR: EXCEPTION 7.02 3.97 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 5.68 3.34 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 6.11 3.53 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.64 3.21 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 4.71 2.77 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 4.65 2.80 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 4.19 2.56 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 5.28 3.02 None lock/lock.yml ERROR: EXCEPTION 5.81 3.32 None numbered-array/numbered-array.yml ERROR: EXCEPTION 4.50 2.68 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 7.56 4.31 None ticket/ticket.yml ERROR: EXCEPTION 5.62 3.22 None ------------------------------------------------------------------------------------------------------------------------ Run set 4 done 76.20 8.25 - UniHorn.threadmodular-examples Run set 5 of 5 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularUniHorn.xml' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 5.23 3.03 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 3.80 2.38 None bluetooth/bluetooth.yml ERROR: EXCEPTION 7.19 4.08 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 5.54 3.38 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 6.26 3.56 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.54 3.17 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 4.55 2.70 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 4.63 2.75 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 4.12 2.51 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 4.84 2.88 None lock/lock.yml ERROR: EXCEPTION 5.78 3.32 None numbered-array/numbered-array.yml ERROR: EXCEPTION 4.25 2.61 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 7.67 4.20 None ticket/ticket.yml ERROR: EXCEPTION 5.65 3.23 None ------------------------------------------------------------------------------------------------------------------------ Run set 5 done 75.29 8.30 - Statistics: 70 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 70 Score: 0 (max: 140)