BENCHMARK INFORMATION benchmark definition: ../benchexec/termination-concurrency-bpl.xml name: termination-concurrency-bpl run sets: Buchi Automaton (semantic LBE).Ultimate Repo, Buchi PN (semantic LBE).Ultimate Repo date: Thu, 2022-09-29 14:59:47 CEST tool: ULTIMATE Automizer 0.2.2-638c691e tool executable: ./Ultimate.py options: --force-no-wrapper -tc ../../../trunk/examples/toolchains/BuchiAutomizerBplInline.xml parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 300 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.11.22-4-pve-x86_64-with-glibc2.31 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 4549.121 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Buchi Automaton (semantic LBE).Ultimate Repo Run set 1 of 2 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/BuchiAutomizerBplInline.xml -s ../../../trunk/examples/settings/buchiAutomizer/concurrent-automaton-semanticLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host -------------------------------------------------------------------------------------------------------------- LBE_bigexample_safe.bpl true 7.00 4.48 None LBE_bigexample_safe_BA.bpl true 16.57 9.40 None MirabelleConcurrentIncrement.bpl true 8.94 5.59 None NonAtomicIncrement_2Threads_Loop.bpl true 9.24 5.78 None TwoActiveWorkersSirius.bpl ERROR: EXCEPTION 8.37 4.71 None bigNumberOfThreads.bpl true 9.18 5.29 None concurrent_increment.bpl true 9.48 5.79 None concurrent_increment_nonterminating.bpl false(termination) 7.79 5.75 None concurrent_mult.bpl true 9.19 5.63 None equal-array-sums-locked.bpl true 7.73 4.97 None equal-array-sums.bpl true 7.30 5.63 None loop-lockstep-example.bpl true 7.63 5.07 None single_assertion_test.bpl true 6.28 3.76 None sum_invariant.bpl true 5.80 3.41 None POPL2023/acq-work-3threads.bpl unknown 15.10 9.60 None POPL2023/acq-work-4threads.bpl unknown 15.59 9.83 None POPL2023/acq-work-5threads.bpl unknown 17.02 11.93 None POPL2023/acq-work-6threads.bpl unknown 25.63 14.55 None POPL2023/acq-work-constants.bpl unknown 13.77 8.85 None POPL2023/acq-work.bpl unknown 13.83 11.25 None POPL2023/array-sum-with-log-3threads.bpl true 14.02 8.03 None POPL2023/array-sum-with-log-4threads.bpl true 19.09 10.63 None POPL2023/array-sum-with-log-5threads.bpl true 37.82 21.51 None POPL2023/array-sum-with-log-6threads.bpl true 255.84 157.92 None POPL2023/array-sum-with-log.bpl true 8.95 5.89 None POPL2023/count0-countEven-sample-abs.bpl ERROR: EXCEPTION 10.25 5.86 None POPL2023/incr-decr-zero.bpl true 8.93 5.54 None POPL2023/map-aggr-update1-2modifiers.bpl true 15.15 8.76 None POPL2023/map-aggr-update1-3modifiers.bpl true 21.59 11.93 None POPL2023/map-aggr-update1-4modifiers.bpl true 41.22 23.06 None POPL2023/map-aggr-update1-otherloopbounds.bpl unknown 12.14 10.04 None POPL2023/map-aggr-update1.bpl true 10.07 5.98 None POPL2023/map-aggr-update2-otherloopbounds.bpl unknown 14.82 8.86 None POPL2023/map-aggr-update2.bpl true 9.74 6.16 None POPL2023/map-aggr-update3.bpl false(termination) 9.35 5.52 None POPL2023/map-comp.bpl true 10.68 6.16 None POPL2023/map-incr-decr.bpl true 7.60 6.73 None POPL2023/map-incr-split.bpl true 7.68 6.01 None POPL2023/max-tailsum2.bpl true 11.85 6.68 None POPL2023/max-tailsum3.bpl true 14.19 7.90 None POPL2023/max-tailsum4.bpl true 14.13 8.36 None POPL2023/max-tailsum5.bpl true 19.57 11.57 None POPL2023/min-max-sample-2.bpl false(termination) 6.18 3.71 None POPL2023/min-max-sample-abs-2.bpl false(termination) 9.45 6.62 None POPL2023/min-max-sample-abs-nonatomic.bpl false(termination) 11.97 6.73 None POPL2023/min-max-sample-abs.bpl true 14.39 8.12 None POPL2023/min-max-sample-with_locks.bpl false(termination) 8.40 6.25 None POPL2023/min-max-sample.bpl false(termination) 6.11 4.51 None POPL2023/min-max-split-sample.bpl false(termination) 20.41 10.95 None POPL2023/min2-max2-sample.bpl false(termination) 14.78 8.49 None POPL2023/motivating-slowitp.bpl true 12.62 7.20 None POPL2023/motivating.bpl false(termination) 9.09 5.14 None POPL2023/optimistic-concurrency1.bpl true 13.59 7.65 None POPL2023/optimistic-concurrency2.bpl true 10.99 6.58 None POPL2023/readers_writer.bpl unknown 14.26 11.06 None POPL2023/sum-print.bpl false(termination) 7.14 4.66 None POPL2023/sum-print2.bpl true 9.03 5.84 None POPL2023/sum-rwlock.bpl false(termination) 8.95 5.16 None POPL2023/sum2_diff_incr_decr.bpl true 10.50 6.23 None POPL2023/sum_diff_incr_decr.bpl true 8.17 5.13 None POPL2023/sumsumbank.bpl false(termination) 7.75 4.40 None POPL2023/sumsuminc.bpl false(termination) 9.91 5.98 None POPL2023/sumsumsampleabs.bpl false(termination) 5.76 3.53 None POPL2023/sumsumsampleabs2.bpl true 9.86 6.28 None POPL2023/work-steal1.bpl true 10.36 5.97 None POPL2023/work-steal2.bpl true 10.58 6.10 None -------------------------------------------------------------------------------------------------------------- Run set 1 done 1047.60 164.20 - Buchi PN (semantic LBE).Ultimate Repo Run set 2 of 2 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/BuchiAutomizerBplInline.xml -s ../../../trunk/examples/settings/buchiAutomizer/concurrent-buchi-pn-semanticLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host -------------------------------------------------------------------------------------------------------------- LBE_bigexample_safe.bpl true 6.17 3.75 None LBE_bigexample_safe_BA.bpl true 8.06 4.43 None MirabelleConcurrentIncrement.bpl true 9.04 5.61 None NonAtomicIncrement_2Threads_Loop.bpl true 10.71 6.00 None TwoActiveWorkersSirius.bpl ERROR: EXCEPTION 8.16 4.58 None bigNumberOfThreads.bpl true 9.61 5.25 None concurrent_increment.bpl true 9.85 6.05 None concurrent_increment_nonterminating.bpl false(termination) 8.51 5.50 None concurrent_mult.bpl true 10.02 5.99 None equal-array-sums-locked.bpl true 8.93 5.10 None equal-array-sums.bpl true 7.88 5.60 None loop-lockstep-example.bpl true 8.03 4.90 None single_assertion_test.bpl true 6.16 3.69 None sum_invariant.bpl true 6.02 3.55 None POPL2023/acq-work-3threads.bpl unknown 14.86 10.99 None POPL2023/acq-work-4threads.bpl unknown 16.46 10.27 None POPL2023/acq-work-5threads.bpl unknown 15.96 10.25 None POPL2023/acq-work-6threads.bpl unknown 21.50 12.30 None POPL2023/acq-work-constants.bpl unknown 17.55 10.39 None POPL2023/acq-work.bpl unknown 14.13 9.58 None POPL2023/array-sum-with-log-3threads.bpl TIMEOUT 306.20 227.47 None POPL2023/array-sum-with-log-4threads.bpl TIMEOUT 318.62 173.23 None POPL2023/array-sum-with-log-5threads.bpl TIMEOUT 321.56 174.70 None POPL2023/array-sum-with-log-6threads.bpl TIMEOUT 322.19 181.40 None POPL2023/array-sum-with-log.bpl TIMEOUT 311.55 278.80 None POPL2023/count0-countEven-sample-abs.bpl ERROR: EXCEPTION 10.72 5.97 None POPL2023/incr-decr-zero.bpl true 10.08 6.08 None POPL2023/map-aggr-update1-2modifiers.bpl TIMEOUT 309.51 187.99 None POPL2023/map-aggr-update1-3modifiers.bpl TIMEOUT 311.47 227.78 None POPL2023/map-aggr-update1-4modifiers.bpl TIMEOUT 322.27 216.90 None POPL2023/map-aggr-update1-otherloopbounds.bpl unknown 12.33 7.65 None POPL2023/map-aggr-update1.bpl true 229.91 221.41 None POPL2023/map-aggr-update2-otherloopbounds.bpl unknown 12.03 8.09 None POPL2023/map-aggr-update2.bpl true 174.10 167.18 None POPL2023/map-aggr-update3.bpl false(termination) 12.35 6.69 None POPL2023/map-comp.bpl true 251.42 241.21 None POPL2023/map-incr-decr.bpl true 10.25 6.10 None POPL2023/map-incr-split.bpl true 8.02 5.07 None POPL2023/max-tailsum2.bpl true 9.52 5.66 None POPL2023/max-tailsum3.bpl TIMEOUT 306.01 297.24 None POPL2023/max-tailsum4.bpl TIMEOUT 313.83 254.33 None POPL2023/max-tailsum5.bpl TIMEOUT 314.69 231.54 None POPL2023/min-max-sample-2.bpl false(termination) 7.36 4.12 None POPL2023/min-max-sample-abs-2.bpl false(termination) 11.89 6.92 None POPL2023/min-max-sample-abs-nonatomic.bpl false(termination) 10.06 6.11 None POPL2023/min-max-sample-abs.bpl TIMEOUT 301.73 290.18 None POPL2023/min-max-sample-with_locks.bpl OUT OF MEMORY 256.60 206.56 None POPL2023/min-max-sample.bpl false(termination) 10.16 5.99 None POPL2023/min-max-split-sample.bpl TIMEOUT 322.30 232.87 None POPL2023/min2-max2-sample.bpl false(termination) 285.80 264.39 None POPL2023/motivating-slowitp.bpl true 132.16 121.87 None POPL2023/motivating.bpl false(termination) 8.14 4.59 None POPL2023/optimistic-concurrency1.bpl true 20.02 13.15 None POPL2023/optimistic-concurrency2.bpl true 22.30 14.01 None POPL2023/readers_writer.bpl unknown 13.57 8.56 None POPL2023/sum-print.bpl false(termination) 8.95 5.07 None POPL2023/sum-print2.bpl true 9.97 5.64 None POPL2023/sum-rwlock.bpl false(termination) 9.07 5.13 None POPL2023/sum2_diff_incr_decr.bpl true 8.56 4.94 None POPL2023/sum_diff_incr_decr.bpl true 10.48 6.03 None POPL2023/sumsumbank.bpl false(termination) 6.68 4.16 None POPL2023/sumsuminc.bpl false(termination) 10.93 6.07 None POPL2023/sumsumsampleabs.bpl false(termination) 5.30 3.24 None POPL2023/sumsumsampleabs2.bpl TIMEOUT 306.23 294.05 None POPL2023/work-steal1.bpl true 8.74 5.25 None POPL2023/work-steal2.bpl true 8.94 5.47 None -------------------------------------------------------------------------------------------------------------- Run set 2 done 6213.41 549.42 - Statistics: 132 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 37