BENCHMARK INFORMATION benchmark definition: ../benchexec/sleep-threadmodular.xml name: sleep-threadmodular run sets: SleepExplicit.Eldarica.threadmodular-examples, SleepExplicit.Z3.threadmodular-examples, SleepExplicit.Golem.threadmodular-examples, SleepExplicit.TreeAutomizer.threadmodular-examples, SleepSymbolic.Eldarica.threadmodular-examples, SleepSymbolic.Z3.threadmodular-examples, SleepSymbolic.Golem.threadmodular-examples, SleepSymbolic.TreeAutomizer.threadmodular-examples, SleepSymbolic-Symmetry.Eldarica.threadmodular-examples, SleepSymbolic-Symmetry.Z3.threadmodular-examples, SleepSymbolic-Symmetry.Golem.threadmodular-examples, SleepSymbolic-Symmetry.TreeAutomizer.threadmodular-examples, NoSleep.Eldarica.threadmodular-examples, NoSleep.Z3.threadmodular-examples, NoSleep.Golem.threadmodular-examples, NoSleep.TreeAutomizer.threadmodular-examples, UniHorn.threadmodular-examples date: Mon, 2023-09-11 15:49:24 CEST tool: ULTIMATE Automizer 0.2.3-dcd3a62b tool executable: ./Ultimate.py options: --force-no-wrapper -s '${taskdef_path}/ThreadModularVerifier.Settings.epf' parallel runs: 7 resource limits: - memory: 15000.0 MB - time: 1800 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 15000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.60-1-pve-x86_64-with-glibc2.31 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 4549.121 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ SleepExplicit.Eldarica.threadmodular-examples Run set 1 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 481.61 432.39 None add-sub-positive-k/add-sub-positive-k.yml unknown 456.94 417.63 None bluetooth-better/bluetooth-better.yml unknown 99.41 60.54 None bluetooth/bluetooth.yml TIMEOUT 1803.46 1051.77 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.49 4.72 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1801.97 1668.26 None inc-bdec/inc-bdec.yml unknown 219.32 179.65 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 759.15 684.35 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1804.37 1714.06 None inc-dec-eq0/inc-dec-eq0.yml unknown 96.17 70.33 None inc-dec-geq0/inc-dec-geq0.yml unknown 68.34 43.21 None line-queue/line-queue.yml TIMEOUT 1803.68 1018.93 None lock/lock.yml unknown 32.03 18.07 None mutex-3/mutex-3.yml unknown 75.69 43.99 None mutex-4/mutex-4.yml unknown 62.78 40.85 None mutex-5/mutex-5.yml unknown 91.65 56.83 None mutex-unbounded/mutex-unbounded.yml unknown 66.61 40.57 None notify-listeners/notify-listeners.yml TIMEOUT 1801.69 1708.37 None numbered-array/numbered-array.yml unknown 106.08 65.56 None thread-pooling/thread-pooling.yml TIMEOUT 1801.98 1619.15 None ticket/ticket.yml TIMEOUT 1802.04 1702.25 None ------------------------------------------------------------------------------------------------------------------------ Run set 1 done 15243.82 2392.34 - SleepExplicit.Z3.threadmodular-examples Run set 2 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 376.54 372.55 None add-sub-positive-k/add-sub-positive-k.yml TIMEOUT 1801.79 1799.85 None bluetooth-better/bluetooth-better.yml unknown 10.91 6.90 None bluetooth/bluetooth.yml TIMEOUT 1801.74 1794.96 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.59 4.81 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1801.73 1795.39 None inc-bdec/inc-bdec.yml unknown 74.51 72.16 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1801.73 1795.26 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.72 1796.37 None inc-dec-eq0/inc-dec-eq0.yml unknown 35.01 32.83 None inc-dec-geq0/inc-dec-geq0.yml unknown 7.44 5.39 None line-queue/line-queue.yml TIMEOUT 1801.75 1795.61 None lock/lock.yml unknown 7.57 4.46 None mutex-3/mutex-3.yml unknown 8.91 6.17 None mutex-4/mutex-4.yml unknown 9.40 6.42 None mutex-5/mutex-5.yml unknown 9.37 6.57 None mutex-unbounded/mutex-unbounded.yml unknown 9.49 6.60 None notify-listeners/notify-listeners.yml unknown 324.38 320.39 None numbered-array/numbered-array.yml unknown 7.25 4.29 None thread-pooling/thread-pooling.yml TIMEOUT 1801.74 1794.52 None ticket/ticket.yml TIMEOUT 1801.86 1795.87 None ------------------------------------------------------------------------------------------------------------------------ Run set 2 done 15303.83 3591.61 - SleepExplicit.Golem.threadmodular-examples Run set 3 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 79.08 75.23 None add-sub-positive-k/add-sub-positive-k.yml unknown 143.71 141.32 None bluetooth-better/bluetooth-better.yml unknown 13.14 9.12 None bluetooth/bluetooth.yml TIMEOUT 1801.49 1795.06 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.19 4.57 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 7.83 4.41 None inc-bdec/inc-bdec.yml unknown 37.39 34.76 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1801.45 1795.20 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.47 1795.62 None inc-dec-eq0/inc-dec-eq0.yml unknown 26.42 23.17 None inc-dec-geq0/inc-dec-geq0.yml unknown 8.17 5.01 None line-queue/line-queue.yml ERROR: EXCEPTION 104.68 100.69 None lock/lock.yml unknown 8.24 4.82 None mutex-3/mutex-3.yml unknown 7.25 4.43 None mutex-4/mutex-4.yml unknown 7.41 4.45 None mutex-5/mutex-5.yml unknown 7.33 4.66 None mutex-unbounded/mutex-unbounded.yml unknown 7.54 4.67 None notify-listeners/notify-listeners.yml ERROR: EXCEPTION 7.73 4.35 None numbered-array/numbered-array.yml ERROR: EXCEPTION 7.16 4.04 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 8.74 4.91 None ticket/ticket.yml TIMEOUT 1801.49 1796.06 None ------------------------------------------------------------------------------------------------------------------------ Run set 3 done 7696.28 1872.03 - SleepExplicit.TreeAutomizer.threadmodular-examples Run set 4 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --chcsolver.chc.solver.backend TREEAUTOMIZER --chcsolver.produce.chc.model.if.query.is.sat false --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat true --rcfgbuilder.smt.solver Internal_SMTInterpol' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml TIMEOUT 1800.83 1771.01 None add-sub-positive-k/add-sub-positive-k.yml TIMEOUT 1801.00 1777.98 None bluetooth-better/bluetooth-better.yml TIMEOUT 1800.64 1764.46 None bluetooth/bluetooth.yml TIMEOUT 1801.21 1746.70 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.91 4.96 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1800.96 1760.30 None inc-bdec/inc-bdec.yml TIMEOUT 1800.81 1780.12 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1800.96 1757.38 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1800.94 1759.89 None inc-dec-eq0/inc-dec-eq0.yml TIMEOUT 1800.71 1772.80 None inc-dec-geq0/inc-dec-geq0.yml TIMEOUT 1800.73 1775.17 None line-queue/line-queue.yml TIMEOUT 1801.22 1723.60 None lock/lock.yml unknown 344.28 314.09 None mutex-3/mutex-3.yml TIMEOUT 1800.81 1782.16 None mutex-4/mutex-4.yml TIMEOUT 1800.71 1779.89 None mutex-5/mutex-5.yml TIMEOUT 1800.91 1773.19 None mutex-unbounded/mutex-unbounded.yml TIMEOUT 1800.78 1774.05 None notify-listeners/notify-listeners.yml TIMEOUT 1800.68 1762.90 None numbered-array/numbered-array.yml TIMEOUT 1800.73 1772.76 None thread-pooling/thread-pooling.yml TIMEOUT 1800.67 1770.55 None ticket/ticket.yml TIMEOUT 1800.74 1781.90 None ------------------------------------------------------------------------------------------------------------------------ Run set 4 done 34569.62 5343.38 - SleepSymbolic.Eldarica.threadmodular-examples Run set 5 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 1186.76 1117.64 None add-sub-positive-k/add-sub-positive-k.yml TIMEOUT 1801.70 1725.47 None bluetooth-better/bluetooth-better.yml TIMEOUT 1804.23 1391.35 None bluetooth/bluetooth.yml TIMEOUT 1802.08 1681.70 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.60 4.81 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1804.40 1547.16 None inc-bdec/inc-bdec.yml TIMEOUT 1802.91 1048.75 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1801.90 1689.10 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.59 1744.30 None inc-dec-eq0/inc-dec-eq0.yml unknown 729.19 661.15 None inc-dec-geq0/inc-dec-geq0.yml unknown 147.46 101.92 None line-queue/line-queue.yml TIMEOUT 1802.04 1645.92 None lock/lock.yml unknown 43.53 22.71 None mutex-3/mutex-3.yml unknown 116.45 79.57 None mutex-4/mutex-4.yml unknown 156.54 115.51 None mutex-5/mutex-5.yml unknown 171.76 132.57 None mutex-unbounded/mutex-unbounded.yml unknown 183.08 141.34 None notify-listeners/notify-listeners.yml TIMEOUT 1801.63 1722.91 None numbered-array/numbered-array.yml unknown 127.67 79.32 None thread-pooling/thread-pooling.yml TIMEOUT 1804.33 1252.07 None ticket/ticket.yml TIMEOUT 1801.78 1712.04 None ------------------------------------------------------------------------------------------------------------------------ Run set 5 done 22699.99 3527.91 - SleepSymbolic.Z3.threadmodular-examples Run set 6 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 275.62 272.04 None add-sub-positive-k/add-sub-positive-k.yml unknown 1248.49 1246.46 None bluetooth-better/bluetooth-better.yml unknown 11.31 7.36 None bluetooth/bluetooth.yml TIMEOUT 1801.73 1794.79 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.23 4.06 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1801.76 1795.24 None inc-bdec/inc-bdec.yml unknown 53.00 50.97 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1801.77 1795.98 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.73 1795.58 None inc-dec-eq0/inc-dec-eq0.yml unknown 46.94 44.73 None inc-dec-geq0/inc-dec-geq0.yml unknown 6.26 4.21 None line-queue/line-queue.yml TIMEOUT 1801.70 1797.09 None lock/lock.yml unknown 7.40 4.41 None mutex-3/mutex-3.yml unknown 9.09 6.34 None mutex-4/mutex-4.yml unknown 8.59 5.73 None mutex-5/mutex-5.yml unknown 8.61 5.62 None mutex-unbounded/mutex-unbounded.yml unknown 8.29 5.37 None notify-listeners/notify-listeners.yml TIMEOUT 1801.74 1795.46 None numbered-array/numbered-array.yml unknown 5.48 3.69 None thread-pooling/thread-pooling.yml TIMEOUT 1801.72 1798.20 None ticket/ticket.yml TIMEOUT 1801.74 1796.00 None ------------------------------------------------------------------------------------------------------------------------ Run set 6 done 16110.61 3591.99 - SleepSymbolic.Golem.threadmodular-examples Run set 7 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 420.34 415.86 None add-sub-positive-k/add-sub-positive-k.yml unknown 1457.64 1454.21 None bluetooth-better/bluetooth-better.yml unknown 20.16 16.18 None bluetooth/bluetooth.yml TIMEOUT 1801.43 1794.89 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.82 4.87 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 7.86 4.38 None inc-bdec/inc-bdec.yml unknown 126.39 123.56 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1801.45 1795.18 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.44 1795.79 None inc-dec-eq0/inc-dec-eq0.yml unknown 387.51 382.74 None inc-dec-geq0/inc-dec-geq0.yml unknown 6.72 4.97 None line-queue/line-queue.yml ERROR: EXCEPTION 104.47 100.34 None lock/lock.yml unknown 5.88 3.57 None mutex-3/mutex-3.yml unknown 6.59 4.46 None mutex-4/mutex-4.yml unknown 6.43 4.40 None mutex-5/mutex-5.yml unknown 6.61 4.44 None mutex-unbounded/mutex-unbounded.yml unknown 20.60 18.24 None notify-listeners/notify-listeners.yml ERROR: EXCEPTION 5.82 3.41 None numbered-array/numbered-array.yml ERROR: EXCEPTION 5.44 3.21 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 6.99 4.00 None ticket/ticket.yml TIMEOUT 1801.40 1797.75 None ------------------------------------------------------------------------------------------------------------------------ Run set 7 done 9810.39 2077.30 - SleepSymbolic.TreeAutomizer.threadmodular-examples Run set 8 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --chcsolver.chc.solver.backend TREEAUTOMIZER --chcsolver.produce.chc.model.if.query.is.sat false --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat true --rcfgbuilder.smt.solver Internal_SMTInterpol' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml TIMEOUT 1800.56 1774.07 None add-sub-positive-k/add-sub-positive-k.yml TIMEOUT 1800.59 1782.42 None bluetooth-better/bluetooth-better.yml TIMEOUT 1800.64 1763.24 None bluetooth/bluetooth.yml TIMEOUT 1800.79 1772.02 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.48 4.06 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1800.71 1771.04 None inc-bdec/inc-bdec.yml TIMEOUT 1800.90 1778.24 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1800.58 1771.96 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1800.71 1772.57 None inc-dec-eq0/inc-dec-eq0.yml TIMEOUT 1800.59 1776.03 None inc-dec-geq0/inc-dec-geq0.yml TIMEOUT 1800.54 1776.10 None line-queue/line-queue.yml TIMEOUT 1801.25 1722.40 None lock/lock.yml unknown 176.34 152.53 None mutex-3/mutex-3.yml TIMEOUT 1800.51 1782.69 None mutex-4/mutex-4.yml TIMEOUT 1800.49 1782.74 None mutex-5/mutex-5.yml TIMEOUT 1800.51 1775.56 None mutex-unbounded/mutex-unbounded.yml TIMEOUT 1800.53 1777.99 None notify-listeners/notify-listeners.yml TIMEOUT 1800.61 1759.51 None numbered-array/numbered-array.yml TIMEOUT 1800.49 1775.98 None thread-pooling/thread-pooling.yml TIMEOUT 1800.61 1770.09 None ticket/ticket.yml TIMEOUT 1800.58 1784.36 None ------------------------------------------------------------------------------------------------------------------------ Run set 8 done 34396.42 5346.58 - SleepSymbolic-Symmetry.Eldarica.threadmodular-examples Run set 9 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 6.86 3.92 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 5.47 3.46 None bluetooth-better/bluetooth-better.yml TIMEOUT 1801.78 1704.17 None bluetooth/bluetooth.yml ERROR: EXCEPTION 9.27 5.17 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.65 4.34 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 7.46 4.25 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.23 3.09 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 5.56 3.24 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 5.47 3.62 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 6.62 3.78 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 6.68 3.81 None line-queue/line-queue.yml ERROR: EXCEPTION 107.19 101.85 None lock/lock.yml unknown 42.40 22.20 None mutex-3/mutex-3.yml ERROR: EXCEPTION 5.33 3.14 None mutex-4/mutex-4.yml ERROR: EXCEPTION 5.69 3.75 None mutex-5/mutex-5.yml ERROR: EXCEPTION 6.63 3.78 None mutex-unbounded/mutex-unbounded.yml ERROR: EXCEPTION 6.90 3.88 None notify-listeners/notify-listeners.yml TIMEOUT 1801.65 1720.51 None numbered-array/numbered-array.yml ERROR: EXCEPTION 5.75 3.52 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 8.68 4.87 None ticket/ticket.yml ERROR: EXCEPTION 6.37 3.67 None ------------------------------------------------------------------------------------------------------------------------ Run set 9 done 3865.15 1731.74 - SleepSymbolic-Symmetry.Z3.threadmodular-examples Run set 10 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 7.13 6.36 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 6.28 4.21 None bluetooth-better/bluetooth-better.yml unknown 12.70 8.40 None bluetooth/bluetooth.yml ERROR: EXCEPTION 9.33 5.22 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.06 4.58 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 8.09 4.56 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.48 3.26 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 6.04 3.54 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 5.68 3.69 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 7.52 4.18 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 7.08 4.07 None line-queue/line-queue.yml ERROR: EXCEPTION 107.90 102.15 None lock/lock.yml unknown 8.71 6.38 None mutex-3/mutex-3.yml ERROR: EXCEPTION 5.38 3.25 None mutex-4/mutex-4.yml ERROR: EXCEPTION 5.68 4.00 None mutex-5/mutex-5.yml ERROR: EXCEPTION 6.92 4.12 None mutex-unbounded/mutex-unbounded.yml ERROR: EXCEPTION 7.25 4.13 None notify-listeners/notify-listeners.yml TIMEOUT 1801.73 1795.38 None numbered-array/numbered-array.yml ERROR: EXCEPTION 5.69 3.40 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 7.19 4.71 None ticket/ticket.yml ERROR: EXCEPTION 7.61 4.30 None ------------------------------------------------------------------------------------------------------------------------ Run set 10 done 2047.89 1805.21 - SleepSymbolic-Symmetry.Golem.threadmodular-examples Run set 11 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 6.85 3.90 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 5.67 3.64 None bluetooth-better/bluetooth-better.yml unknown 21.40 17.13 None bluetooth/bluetooth.yml ERROR: EXCEPTION 9.76 5.26 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.69 4.90 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 7.53 4.28 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.48 3.28 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 5.79 3.44 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 5.81 3.58 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 7.02 3.93 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 6.80 3.90 None line-queue/line-queue.yml ERROR: EXCEPTION 107.62 101.91 None lock/lock.yml unknown 8.08 4.72 None mutex-3/mutex-3.yml ERROR: EXCEPTION 5.26 3.15 None mutex-4/mutex-4.yml ERROR: EXCEPTION 5.32 3.85 None mutex-5/mutex-5.yml ERROR: EXCEPTION 6.57 3.79 None mutex-unbounded/mutex-unbounded.yml ERROR: EXCEPTION 7.06 4.03 None notify-listeners/notify-listeners.yml ERROR: EXCEPTION 8.05 4.55 None numbered-array/numbered-array.yml ERROR: EXCEPTION 5.51 3.25 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 7.10 4.29 None ticket/ticket.yml ERROR: EXCEPTION 7.00 3.97 None ------------------------------------------------------------------------------------------------------------------------ Run set 11 done 258.76 107.76 - SleepSymbolic-Symmetry.TreeAutomizer.threadmodular-examples Run set 12 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.break.symmetry.of.preference.order false --icfgtochc.use.symmetry.clauses true --chcsolver.chc.solver.backend TREEAUTOMIZER --chcsolver.produce.chc.model.if.query.is.sat false --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat true --rcfgbuilder.smt.solver Internal_SMTInterpol' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml ERROR: EXCEPTION 6.80 3.72 None add-sub-positive-k/add-sub-positive-k.yml ERROR: EXCEPTION 5.48 3.45 None bluetooth-better/bluetooth-better.yml TIMEOUT 1800.58 1764.49 None bluetooth/bluetooth.yml ERROR: EXCEPTION 10.35 5.61 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 8.46 4.56 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 8.20 4.41 None inc-bdec/inc-bdec.yml ERROR: EXCEPTION 5.48 2.99 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml ERROR: EXCEPTION 5.82 3.20 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml ERROR: EXCEPTION 6.09 3.59 None inc-dec-eq0/inc-dec-eq0.yml ERROR: EXCEPTION 6.91 3.68 None inc-dec-geq0/inc-dec-geq0.yml ERROR: EXCEPTION 6.90 3.68 None line-queue/line-queue.yml TIMEOUT 1801.16 1721.94 None lock/lock.yml unknown 188.21 162.05 None mutex-3/mutex-3.yml ERROR: EXCEPTION 5.13 2.88 None mutex-4/mutex-4.yml ERROR: EXCEPTION 5.32 3.15 None mutex-5/mutex-5.yml ERROR: EXCEPTION 6.68 3.66 None mutex-unbounded/mutex-unbounded.yml ERROR: EXCEPTION 6.93 3.74 None notify-listeners/notify-listeners.yml TIMEOUT 1800.52 1770.18 None numbered-array/numbered-array.yml ERROR: EXCEPTION 5.54 3.31 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 9.20 4.86 None ticket/ticket.yml ERROR: EXCEPTION 6.99 3.70 None ------------------------------------------------------------------------------------------------------------------------ Run set 12 done 5707.19 1781.02 - NoSleep.Eldarica.threadmodular-examples Run set 13 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --chcsolver.chc.solver.backend ELDARICA --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat true --chcsolver.produce.unsat.core.if.query.is.unsat true' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 56.29 30.95 None add-sub-positive-k/add-sub-positive-k.yml unknown 70.00 45.45 None bluetooth-better/bluetooth-better.yml unknown 58.77 32.19 None bluetooth/bluetooth.yml TIMEOUT 1804.44 1071.56 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 6.90 3.97 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1801.97 1674.36 None inc-bdec/inc-bdec.yml unknown 36.12 20.46 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 60.18 34.33 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml unknown 111.30 82.65 None inc-dec-eq0/inc-dec-eq0.yml unknown 36.53 19.41 None inc-dec-geq0/inc-dec-geq0.yml unknown 31.43 16.47 None line-queue/line-queue.yml TIMEOUT 1801.87 1679.58 None lock/lock.yml unknown 13.86 8.40 None mutex-3/mutex-3.yml unknown 17.79 9.67 None mutex-4/mutex-4.yml unknown 17.59 9.60 None mutex-5/mutex-5.yml unknown 17.09 9.94 None mutex-unbounded/mutex-unbounded.yml unknown 21.37 11.44 None notify-listeners/notify-listeners.yml TIMEOUT 1801.78 1716.81 None numbered-array/numbered-array.yml unknown 19.45 10.93 None thread-pooling/thread-pooling.yml TIMEOUT 1804.20 1212.47 None ticket/ticket.yml TIMEOUT 1801.36 1379.68 None ------------------------------------------------------------------------------------------------------------------------ Run set 13 done 11390.70 1778.10 - NoSleep.Z3.threadmodular-examples Run set 14 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --chcsolver.chc.solver.backend Z3 --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 24.07 21.26 None add-sub-positive-k/add-sub-positive-k.yml unknown 61.12 59.06 None bluetooth-better/bluetooth-better.yml unknown 7.78 5.00 None bluetooth/bluetooth.yml unknown 853.04 848.45 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.04 3.91 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1801.69 1795.37 None inc-bdec/inc-bdec.yml unknown 7.24 5.11 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 1049.82 1045.30 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.75 1796.15 None inc-dec-eq0/inc-dec-eq0.yml unknown 10.93 9.07 None inc-dec-geq0/inc-dec-geq0.yml unknown 5.70 3.75 None line-queue/line-queue.yml TIMEOUT 1801.68 1798.30 None lock/lock.yml unknown 6.67 3.93 None mutex-3/mutex-3.yml unknown 7.21 4.41 None mutex-4/mutex-4.yml unknown 7.40 4.39 None mutex-5/mutex-5.yml unknown 6.74 4.18 None mutex-unbounded/mutex-unbounded.yml unknown 6.80 4.19 None notify-listeners/notify-listeners.yml TIMEOUT 1801.65 1795.90 None numbered-array/numbered-array.yml unknown 5.82 3.87 None thread-pooling/thread-pooling.yml TIMEOUT 1801.63 1799.16 None ticket/ticket.yml unknown 131.81 128.39 None ------------------------------------------------------------------------------------------------------------------------ Run set 14 done 11208.02 1863.29 - NoSleep.Golem.threadmodular-examples Run set 15 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --chcsolver.chc.solver.backend GOLEM --chcsolver.produce.chc.model.if.query.is.sat true --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml unknown 22.43 19.53 None add-sub-positive-k/add-sub-positive-k.yml unknown 95.40 93.30 None bluetooth-better/bluetooth-better.yml unknown 8.41 5.35 None bluetooth/bluetooth.yml TIMEOUT 1801.43 1795.88 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.07 3.95 None equalsum-ghost/equalsum-ghost.yml ERROR: EXCEPTION 7.16 4.08 None inc-bdec/inc-bdec.yml unknown 7.70 5.55 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml unknown 829.64 824.37 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1801.44 1795.87 None inc-dec-eq0/inc-dec-eq0.yml unknown 11.19 8.08 None inc-dec-geq0/inc-dec-geq0.yml unknown 5.78 3.67 None line-queue/line-queue.yml ERROR: EXCEPTION 5.58 3.30 None lock/lock.yml unknown 5.38 3.31 None mutex-3/mutex-3.yml unknown 6.54 3.85 None mutex-4/mutex-4.yml unknown 5.56 3.37 None mutex-5/mutex-5.yml unknown 6.97 4.04 None mutex-unbounded/mutex-unbounded.yml unknown 7.04 4.07 None notify-listeners/notify-listeners.yml ERROR: EXCEPTION 5.36 3.17 None numbered-array/numbered-array.yml ERROR: EXCEPTION 6.93 4.00 None thread-pooling/thread-pooling.yml ERROR: EXCEPTION 5.70 3.23 None ticket/ticket.yml TIMEOUT 1801.47 1796.02 None ------------------------------------------------------------------------------------------------------------------------ Run set 15 done 6454.67 1820.53 - NoSleep.TreeAutomizer.threadmodular-examples Run set 16 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularVerifier.xml --icfgtochc.enable.sleep.set.reduction false --chcsolver.chc.solver.backend TREEAUTOMIZER --chcsolver.produce.chc.model.if.query.is.sat false --chcsolver.produce.derivation.if.query.is.unsat false --chcsolver.produce.unsat.core.if.query.is.unsat true --rcfgbuilder.smt.solver Internal_SMTInterpol' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml TIMEOUT 1800.51 1777.84 None add-sub-positive-k/add-sub-positive-k.yml TIMEOUT 1800.55 1784.29 None bluetooth-better/bluetooth-better.yml TIMEOUT 1800.83 1765.01 None bluetooth/bluetooth.yml TIMEOUT 1800.78 1773.95 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.01 3.76 None equalsum-ghost/equalsum-ghost.yml TIMEOUT 1800.66 1774.35 None inc-bdec/inc-bdec.yml TIMEOUT 1800.87 1780.26 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml TIMEOUT 1800.71 1773.12 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml TIMEOUT 1800.65 1769.72 None inc-dec-eq0/inc-dec-eq0.yml TIMEOUT 1800.47 1780.86 None inc-dec-geq0/inc-dec-geq0.yml TIMEOUT 1800.86 1774.14 None line-queue/line-queue.yml TIMEOUT 1800.51 1774.59 None lock/lock.yml unknown 117.69 98.45 None mutex-3/mutex-3.yml TIMEOUT 1800.86 1781.55 None mutex-4/mutex-4.yml TIMEOUT 1800.47 1787.09 None mutex-5/mutex-5.yml TIMEOUT (ERROR: EXCEPTION) 1805.07 1778.53 None mutex-unbounded/mutex-unbounded.yml TIMEOUT 1800.52 1779.86 None notify-listeners/notify-listeners.yml TIMEOUT 1800.61 1766.64 None numbered-array/numbered-array.yml TIMEOUT 1800.48 1781.48 None thread-pooling/thread-pooling.yml TIMEOUT 1800.68 1773.21 None ticket/ticket.yml TIMEOUT 1800.68 1785.09 None ------------------------------------------------------------------------------------------------------------------------ Run set 16 done 34341.86 5348.05 - UniHorn.threadmodular-examples Run set 17 of 17 with options '--force-no-wrapper -s ${taskdef_path}/ThreadModularVerifier.Settings.epf -tc ../../../trunk/examples/threadmodular/regression/ThreadModularUniHorn.xml' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------ add-sub-k/add-sub-k.yml OUT OF MEMORY 351.26 217.84 None add-sub-positive-k/add-sub-positive-k.yml OUT OF MEMORY 327.26 237.45 None bluetooth-better/bluetooth-better.yml OUT OF MEMORY 425.87 245.86 None bluetooth/bluetooth.yml OUT OF MEMORY 402.24 247.80 None equalsum-fork/equalsum-fork.yml ERROR: EXCEPTION 7.44 4.17 None equalsum-ghost/equalsum-ghost.yml OUT OF MEMORY 620.17 396.62 None inc-bdec/inc-bdec.yml OUT OF MEMORY 257.47 167.62 None inc-dec-eq0-locked-assert/inc-dec-eq0-locked-assert.yml OUT OF MEMORY 231.11 148.18 None inc-dec-eq0-locked/inc-dec-eq0-locked.yml OUT OF MEMORY 407.27 258.24 None inc-dec-eq0/inc-dec-eq0.yml OUT OF MEMORY 190.05 123.69 None inc-dec-geq0/inc-dec-geq0.yml OUT OF MEMORY 358.69 220.67 None line-queue/line-queue.yml ERROR: EXCEPTION 104.67 100.90 None lock/lock.yml true 53.24 31.34 None mutex-3/mutex-3.yml OUT OF MEMORY 323.56 212.21 None mutex-4/mutex-4.yml OUT OF MEMORY 438.80 272.77 None mutex-5/mutex-5.yml OUT OF MEMORY 246.62 171.63 None mutex-unbounded/mutex-unbounded.yml OUT OF MEMORY 401.35 294.06 None notify-listeners/notify-listeners.yml OUT OF MEMORY 656.04 387.53 None numbered-array/numbered-array.yml OUT OF MEMORY 347.62 217.51 None thread-pooling/thread-pooling.yml OUT OF MEMORY 251.45 155.52 None ticket/ticket.yml OUT OF MEMORY 173.11 101.84 None ------------------------------------------------------------------------------------------------------------------------ Run set 17 done 6575.79 785.20 - Statistics: 357 Files correct: 1 correct true: 1 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 356 Score: 2 (max: 714)