BENCHMARK INFORMATION benchmark definition: ../benchexec/automizer.xml name: automizer run sets: Automizer.SmallPrerun-Termination date: Thu, 2023-11-23 16:15:17 CET tool: ULTIMATE Automizer 0.2.3-c4f91361 tool executable: ./Ultimate.py options: --full-output parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 300 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.108-1-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer.SmallPrerun-Termination Run set 1 of 3 with options '--full-output' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ldv-regression/alt_test.yml true 11.61 14.93 None ldv-regression/callfpointer.yml true 8.15 9.63 None ldv-regression/ex3_forlist.yml true 52.54 52.36 None ldv-regression/fo_test.yml true 9.68 11.29 None ldv-regression/just_assert.yml true 8.61 9.03 None psyco/psyco_io_1.yml false(termination) 12.86 15.15 None psyco/psyco_net_1.yml false(termination) 46.45 49.43 None product-lines/elevator_spec13_product30.cil.yml OUT OF MEMORY 116.88 110.62 None product-lines/elevator_spec13_product31.cil.yml OUT OF MEMORY 97.39 97.87 None product-lines/elevator_spec13_product32.cil.yml OUT OF MEMORY 107.74 100.81 None product-lines/elevator_spec13_productSimulator.cil.yml OUT OF MEMORY 140.61 97.96 None product-lines/elevator_spec14_product03.cil.yml OUT OF MEMORY 110.81 72.94 None memsafety-ext/tree_cnstr.yml false(termination) 16.33 10.85 None memsafety-ext/tree_dsw.yml false(termination) 16.12 10.74 None memsafety-ext/tree_parent_ptr.yml false(termination) 38.13 42.80 None memsafety-ext/tree_stack.yml false(termination) 15.66 18.22 None loop-lit/bhmr2007.yml true 10.44 6.56 None loop-lit/cggmp2005b.yml true 13.48 8.97 None loop-lit/cggmp2005_variant.yml true 9.76 11.33 None loop-lit/cggmp2005.yml true 12.77 14.14 None loop-lit/css2003.yml true 14.05 16.01 None recursive/Addition02.yml true 14.44 10.82 None recursive/Addition03-1.yml true 16.29 11.92 None recursive/BallRajamani-SPIN2000-Fig1.yml true 19.62 20.44 None ldv-memsafety/ArraysOfVariableLength6.yml TIMEOUT 301.00 296.38 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-cousot9.yml true 11.47 12.33 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-easy1.yml true 12.89 14.23 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-easy2-2.yml true 9.81 6.23 None array-examples/sanfoundry_24-1.yml TIMEOUT 300.79 262.63 None floats-cbmc-regression/float1.yml true 8.83 5.17 None floats-cbmc-regression/float20.yml true 7.88 8.12 None floats-cbmc-regression/float22.yml true 9.79 5.74 None recursified_loop-simple/recursified_nested_2.yml true 55.37 55.73 None recursified_loop-simple/recursified_nested_3.yml true 114.09 94.08 None recursified_loop-simple/recursified_nested_4.yml TIMEOUT 301.09 259.66 None recursified_loop-simple/recursified_nested_5.yml TIMEOUT 300.65 266.30 None recursified_loop-simple/recursified_nested_6.yml TIMEOUT 300.68 245.36 None recursified_loop-crafted/recursified_simple_array_index_value_4.yml ERROR 40.52 32.13 None recursified_loop-crafted/recursified_simple_vardep_1.yml ERROR 48.24 34.56 None recursified_loop-crafted/recursified_simple_vardep_2.yml ERROR 54.94 42.10 None recursive-simple/fibo_10-2.yml true 25.52 15.78 None loop-new/gauss_sum.yml true 9.51 5.71 None loop-new/half.yml true 10.33 6.12 None uthash-2.0.2/uthash_BER_nondet_test3-2.yml TIMEOUT 301.07 285.56 None uthash-2.0.2/uthash_BER_nondet_test4-1.yml TIMEOUT 300.62 279.87 None uthash-2.0.2/uthash_BER_nondet_test4-2.yml TIMEOUT 300.22 275.80 None uthash-2.0.2/uthash_BER_nondet_test4-3.yml TIMEOUT 300.16 280.83 None uthash-2.0.2/uthash_BER_test10-1.yml TIMEOUT 300.36 279.44 None signedintegeroverflow-regression/Multiplication-1.yml true 11.89 11.99 None signedintegeroverflow-regression/NoNegativeIntegerConstant.yml true 11.07 6.30 None loop-crafted/simple_array_index_value_4.yml ERROR 38.65 38.68 None loop-crafted/simple_vardep_1.yml ERROR 25.74 16.95 None loop-crafted/simple_vardep_2.yml ERROR 35.29 21.52 None termination-recursive-malloc/mergeSort.yml TIMEOUT 300.45 258.85 None termination-recursive-malloc/mutual_simple2.yml true 18.39 10.24 None termination-recursive-malloc/mutual_simple.yml true 12.48 7.81 None termination-recursive-malloc/rec_malloc_ex11B.yml true 207.21 186.49 None termination-dietlibc/skip_to.yml ERROR 55.81 38.90 None termination-dietlibc/stpcpy.yml true 17.91 17.54 None recursified_loop-invariants/recursified_even.yml ERROR 45.98 46.37 None recursified_loop-invariants/recursified_linear-inequality-inv-a.yml ERROR 64.63 42.38 None recursified_loop-invariants/recursified_linear-inequality-inv-b.yml ERROR 72.78 73.00 None recursified_loop-invariants/recursified_mod4.yml ERROR 37.79 24.75 None recursified_loop-invariants/recursified_odd.yml ERROR 37.01 24.13 None termination-15/array12_alloca.yml true 36.77 22.21 None termination-15/array13_alloca.yml true 45.83 47.29 None termination-numeric/EvenOdd01-2.yml true 10.92 6.61 None termination-numeric/Fibonacci01-2.yml true 27.77 18.67 None termination-restricted-15/a.08.yml true 9.71 6.00 None termination-restricted-15/a.09_assume.yml true 13.14 7.72 None termination-restricted-15/a.10.yml true 12.59 8.06 None termination-restricted-15/AlternKonv.yml false(termination) 10.56 6.73 None termination-restricted-15/b.01.yml true 11.97 7.02 None float-benchs/cast_float_ptr.yml true 9.01 5.55 None float-benchs/cast_union_loose.yml true 8.31 5.19 None float-benchs/cast_union_tight.yml true 9.13 5.44 None float-benchs/cos_polynomial.yml true 10.67 6.21 None termination-crafted/aaron2-1.yml true 10.49 6.42 None termination-crafted/aaron3-1.yml true 14.50 9.24 None ldv-linux-3.0/module_get_put-drivers-bluetooth-btmrvl.ko.cil.out.yml false(termination) 193.36 178.10 None termination-memory-alloca/a.08-alloca.yml true 13.78 8.06 None termination-memory-alloca/a.09_assume-alloca.yml true 19.28 10.72 None termination-memory-alloca/a.10-alloca.yml true 18.55 12.09 None termination-memory-alloca/array01-alloca-1.yml true 28.17 16.20 None floats-cdfpl/newton_1_6.yml true 9.15 5.56 None floats-cdfpl/newton_1_7.yml true 8.62 5.23 None floats-cdfpl/newton_1_8.yml true 8.42 5.22 None floats-cdfpl/newton_2_1.yml true 10.85 6.20 None floats-cdfpl/newton_2_2.yml true 8.43 5.23 None loop-acceleration/array_2-2.yml TIMEOUT 301.01 290.29 None loop-acceleration/array_3-1.yml TIMEOUT 301.01 287.57 None loop-acceleration/array_3-2.yml TIMEOUT 300.91 299.52 None loop-acceleration/array_4.yml TIMEOUT 301.00 288.30 None termination-bwb/and-03.yml true 15.11 8.86 None termination-bwb/and-04-false.yml false(termination) 12.23 6.99 None termination-bwb/and-04.yml true 11.02 7.15 None termination-bwb/and-05-false.yml ERROR 32.83 21.28 None termination-bwb/and-05.yml true 18.32 13.11 None bitvector/gcd_4.yml true 19.73 11.51 None seq-mthreaded/pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml OUT OF MEMORY 139.34 99.21 None seq-mthreaded/pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml true 14.71 8.76 None seq-mthreaded/pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml OUT OF MEMORY 133.20 93.26 None seq-mthreaded/pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml OUT OF MEMORY 128.08 90.29 None seq-mthreaded/pals_floodmax.3.ufo.BOUNDED-6.pals.yml true 16.48 9.69 None loops/count_up_down-1.yml ERROR 26.24 18.98 None loops/count_up_down-2.yml ERROR 26.54 19.26 None loops/eureka_05.yml true 97.88 83.93 None locks/test_locks_14-2.yml false(termination) 17.22 10.13 None locks/test_locks_15-1.yml false(termination) 22.97 12.82 None locks/test_locks_15-2.yml false(termination) 42.98 27.00 None locks/test_locks_5.yml false(termination) 9.85 6.20 None locks/test_locks_6.yml false(termination) 10.24 6.29 None eca-rers2012/Problem01_label05.yml false(termination) 39.45 23.19 None eca-rers2012/Problem01_label06.yml false(termination) 41.60 25.13 None eca-rers2012/Problem01_label07.yml false(termination) 39.91 25.00 None eca-rers2012/Problem01_label08.yml false(termination) 37.90 24.19 None eca-rers2012/Problem01_label09.yml false(termination) 39.08 23.27 None ldv-linux-3.4-simple/32_1_cilled_ok_nondet_linux-3.4-32_1-drivers--atm--adummy.ko-ldv_main0_sequence_infinite_withcheck_stateful.cil.out.yml true 17.49 9.48 None list-ext-properties/simple-ext.yml true 24.30 15.75 None systemc/mem_slave_tlm.2.cil.yml false(termination) 23.87 15.89 None systemc/mem_slave_tlm.3.cil.yml false(termination) 24.08 16.08 None systemc/mem_slave_tlm.4.cil.yml false(termination) 23.94 14.70 None systemc/mem_slave_tlm.5.cil.yml false(termination) 24.71 16.21 None systemc/pc_sfifo_1.cil-1.yml false(termination) 29.87 19.69 None bitvector-regression/recHanoi03-1.yml true 10.58 6.27 None bitvector-regression/signextension-1.yml true 8.57 5.26 None bitvector-regression/signextension2-1.yml true 7.85 4.73 None bitvector-regression/signextension2-2.yml true 8.14 4.89 None bitvector-regression/signextension-2.yml true 8.21 5.19 None array-memsafety/bubblesort-alloca-2.yml true 24.44 15.05 None array-memsafety/count_down-alloca-1.yml true 28.85 17.77 None array-memsafety/cstrcat-alloca-2.yml true 21.07 12.92 None termination-nla/cohencu2-both-t.yml ERROR 19.84 14.17 None termination-nla/cohencu3-both-nt.yml ERROR 18.49 13.62 None termination-nla/cohencu3-both-t.yml ERROR 24.94 15.58 None termination-nla/cohencu4-both-nt.yml ERROR 18.32 13.68 None termination-nla/cohencu4-both-t.yml ERROR 24.04 15.54 None loop-simple/nested_2.yml true 12.31 7.74 None loop-simple/nested_3.yml true 18.35 11.29 None loop-simple/nested_4.yml true 48.41 35.73 None loop-simple/nested_5.yml TIMEOUT 301.03 263.37 None loop-simple/nested_6.yml OUT OF MEMORY 106.20 78.79 None loop-invariants/even.yml ERROR 23.39 15.79 None loop-invariants/linear-inequality-inv-a.yml ERROR 28.38 19.56 None loop-invariants/linear-inequality-inv-b.yml ERROR 26.97 19.18 None loop-invariants/mod4.yml ERROR 29.25 18.85 None loop-invariants/odd.yml ERROR 24.43 16.12 None list-ext2-properties/list_and_tree_cnstr-2.yml false(termination) 69.15 47.43 None termination-memory-linkedlists/cll_traverse-alloca.yml false(termination) 14.02 7.96 None termination-memory-linkedlists/ll_append-alloca-1.yml ERROR (7) 103.33 86.11 None termination-memory-linkedlists/ll_append-alloca-2.yml false(termination) 18.49 11.11 None termination-memory-linkedlists/ll_append_rec-alloca-1.yml ERROR 185.06 161.94 None termination-memory-linkedlists/ll_append_rec-alloca-2.yml false(termination) 47.11 28.94 None bitvector-loops/verisec_sendmail_tTflag_arr_one_loop.yml true 26.42 18.88 None ldv-memsafety-bitfields/test-bitfields-2-2.yml ERROR 39.25 31.03 None ldv-memsafety-bitfields/test-bitfields-3.1-1.yml ERROR 32.67 24.23 None ldv-memsafety-bitfields/test-bitfields-3-1.yml ERROR 44.71 34.95 None loop-invgen/apache-get-tag.yml true 10.82 6.57 None loop-invgen/down.yml true 10.67 6.74 None loop-invgen/fragtest_simple.yml true 15.25 9.26 None ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 1 done 9725.08 738.09 - Automizer-Slice.SmallPrerun-Termination Run set 2 of 3: skipped Automizer-NoSlice.SmallPrerun-Termination Run set 3 of 3: skipped Statistics: 160 Files correct: 105 correct true: 77 correct false: 28 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 55 Score: 182 (max: 278)