BENCHMARK INFORMATION benchmark definition: ../benchexec/automizer.xml name: automizer run sets: Automizer.Memslicer-Tests-Small date: Wed, 2023-11-22 20:53:06 CET tool: ULTIMATE Automizer 0.2.3-6ae2ee47 tool executable: ./Ultimate.py options: --full-output parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 300 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.108-1-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer-Slice.Memslicer-Tests-Small Run set 1 of 2: skipped Automizer.Memslicer-Tests-Small Run set 2 of 2 with options '--full-output --preprocessor.use.memory.slicer false' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ldv-regression/1_3.yml false(unreach-call) 12.21 7.29 None ldv-regression/alias_of_return_2.c_1.yml true 9.57 6.61 None psyco/psyco_abp_1-1.yml false(unreach-call) 36.50 21.81 None unsignedintegeroverflow-sas23/bilinear_interpolation.yml TIMEOUT 300.91 297.26 None unsignedintegeroverflow-sas23/cancel_var_through_overflow.yml true 9.17 5.57 None product-lines/elevator_spec13_product21.cil.yml OUT OF MEMORY 141.79 98.72 None product-lines/elevator_spec13_product22.cil.yml OUT OF MEMORY 216.69 177.42 None nla-digbench/bresenham-ll.yml true 28.71 18.10 None ldv-linux-3.7.3/linux-3.10-rc1-43_1a-bitvector-drivers--atm--he.ko-ldv_main0.cil.out.yml true 137.13 105.86 None ldv-linux-3.7.3/main0_drivers--media--dvb-frontends--stv090x-ko---32_7a--linux-3.7.3.yml TIMEOUT 301.20 237.61 None ldv-linux-4.0-rc1-mav-todo/linux-4.0-rc1---drivers--iio--accel--kxcjk-1013.ko.cil.yml TIMEOUT 300.73 259.39 None ldv-linux-4.0-rc1-mav-todo/linux-4.0-rc1---drivers--media--dvb-core--dvb-core.ko.cil.yml TIMEOUT 300.88 251.82 None floats-esbmc-regression/ceil_nondet.yml unknown 21.40 14.01 None floats-esbmc-regression/ceil.yml false(unreach-call) 17.45 10.64 None forester-heap/dll-01-1.yml false(unreach-call) 15.15 8.43 None forester-heap/dll-01-2.yml TIMEOUT 300.16 280.95 None array-multidimensional/add-2-n-u.yml TIMEOUT 301.03 292.99 None array-multidimensional/add-3-n-u.yml TIMEOUT 301.09 294.94 None ldv-commit-tester/m0_drivers-block-virtio_blk-ko--101_1a--39a1d13-1.yml unknown 28.43 16.93 None ldv-commit-tester/m0_drivers-hwmon-ibmpex-ko--130_7a--d631323.yml true 79.80 53.98 None loop-lit/afnp2014.yml true 13.70 8.07 None loop-lit/as2013-hybrid.yml true 10.79 6.39 None recursive/Ackermann01-2.yml true 28.67 16.14 None recursive/Ackermann02.yml false(unreach-call) 10.70 6.58 None heap-manipulation/bubble_sort_linux-1.yml TIMEOUT 300.55 268.49 None heap-manipulation/bubble_sort_linux-2.yml TIMEOUT 300.54 265.86 None array-examples/data_structures_set_multi_proc_ground-1.yml TIMEOUT 300.99 289.50 None array-examples/data_structures_set_multi_proc_ground-2.yml TIMEOUT 300.95 292.53 None floats-cbmc-regression/float11.yml true 20.88 12.02 None floats-cbmc-regression/float12.yml true 27.27 19.78 None ldv-linux-3.16-rc1-todo/205_9a_array_safes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--arcnet--arc-rawmode.ko-entry_point.cil.out.yml TIMEOUT 300.42 238.23 None recursified_loop-simple/recursified_deep-nested.yml TIMEOUT 300.23 256.71 None recursified_loop-simple/recursified_nested_1b.yml false(unreach-call) 21.42 13.00 None ldv-challenges/linux-3.10-rc1-43_1a-bitvector-drivers--net--ethernet--broadcom--b44.ko--ldv_main0.cil.out.yml TIMEOUT 301.18 284.95 None ldv-challenges/linux-3.14_complex_emg_linux-alloc-spinlock_drivers-media-dvb-core-dvb-core.cil.yml TIMEOUT 300.76 259.42 None recursified_loop-crafted/recursified_simple_array_index_value_1-1.yml TIMEOUT 301.10 283.11 None recursified_loop-crafted/recursified_simple_array_index_value_1-2.yml false(unreach-call) 9.78 6.36 None ldv-validator-v0.6/linux-stable-1575714-1-150_1a-drivers--net--wireless--b43--b43.ko-entry_point.cil.out.yml TIMEOUT 300.41 256.81 None ldv-sets/test_add-1.yml false(unreach-call) 13.02 8.18 None ldv-sets/test_add-2.yml TIMEOUT 300.89 268.38 None array-lopstr16/base_case.yml TIMEOUT 300.94 295.54 None array-lopstr16/break-1.yml TIMEOUT 301.15 288.39 None recursive-with-pointer/simple-recursive.yml true 23.12 13.13 None seq-pthread/cs_dekker.yml TIMEOUT 300.76 261.49 None seq-pthread/cs_fib-1.yml TIMEOUT 301.07 280.58 None float-newlib/double_req_bl_0210.yml true 257.08 235.30 None float-newlib/double_req_bl_0220a.yml true 217.45 193.71 None verifythis/duplets.yml TIMEOUT 300.49 265.97 None verifythis/elimination_max_rec_onepoint.yml true 18.21 12.31 None hardness-nfm22/hardness_codestructure_dependencies_file-0.yml TIMEOUT 301.00 287.99 None hardness-nfm22/hardness_codestructure_dependencies_file-10.yml TIMEOUT 300.24 277.28 None ddv-machzwd/ddv_machzwd_all.yml unknown 90.15 73.24 None ddv-machzwd/ddv_machzwd_inb_p.yml true 13.64 8.09 None recursive-simple/afterrec-1.yml false(unreach-call) 8.48 5.49 None recursive-simple/afterrec_2calls-1.yml false(unreach-call) 9.42 5.89 None memory-model/2SB.yml TIMEOUT 300.55 260.13 None memory-model/4SB.yml TIMEOUT 300.20 261.84 None pthread-complex/bounded_buffer.yml OUT OF MEMORY 62.11 37.60 None ldv-validator-v0.8-todo/linux-stable-073676f-1-114_1a-drivers--net--b44.ko-entry_point_ldv-val-v0.8.cil.out.yml TIMEOUT 301.22 285.08 None ldv-validator-v0.8-todo/linux-stable-468e4e3-1-204_8a-drivers--net--jme.ko-entry_point_ldv-val-v0.8.cil.out.yml TIMEOUT 300.82 219.43 None loop-new/count_by_1_variant.yml true 10.27 6.50 None loop-new/count_by_1.yml true 9.60 6.26 None uthash-2.0.2/uthash_BER_nondet_test1-1.yml TIMEOUT 300.29 277.75 None uthash-2.0.2/uthash_BER_nondet_test1-2.yml TIMEOUT 301.51 269.51 None goblint-coreutils/instrumented_cksum_comb.yml ERROR (7) 74.69 59.53 None goblint-coreutils/instrumented_cp_comb.yml ERROR (7) 104.51 75.51 None array-cav19/array_doub_access_init_const.yml TIMEOUT 300.95 292.72 None array-cav19/array_init_both_ends_multiple_sum.yml TIMEOUT 300.97 294.87 None ldv-linux-3.12-rc1/linux-3.12-rc1.tar.xz-08_1a-drivers--staging--comedi--comedi.ko-entry_point.cil.out.yml TIMEOUT 300.64 248.95 None ldv-linux-3.12-rc1/linux-3.12-rc1.tar.xz-08_1a-drivers--staging--comedi--comedi.ko-entry_point_simplified.cil.out.yml true 31.64 16.71 None ldv-linux-3.12-rc1-todo/linux-3.12-rc1.tar.xz-144_2a-drivers--net--usb--ipheth.ko-entry_point.cil.out.yml TIMEOUT 301.22 257.88 None longjmp/68-longjmp_04-counting-local_true.yml unknown 22.37 13.26 None longjmp/68-longjmp_04-counting-local_unknown_1_neg.yml false(unreach-call) 10.94 6.19 None list-properties/alternating_list-1.yml TIMEOUT 300.68 268.02 None list-properties/alternating_list-2.yml false(unreach-call) 13.42 7.47 None neural-networks/cartpole_0_safe.c-amalgamation.yml TIMEOUT 300.33 263.94 None neural-networks/cartpole_10_safe.c-amalgamation.yml TIMEOUT 300.16 274.25 None array-industry-pattern/array_assert_loop_dep.yml TIMEOUT 300.98 289.69 None array-industry-pattern/array_monotonic.yml TIMEOUT 300.98 290.00 None ldv-races/race-1_1-join.yml true 11.96 7.33 None fuzzle-programs/01_fuzzle_30x30.yml false(unreach-call) 25.51 14.70 None fuzzle-programs/02_fuzzle_40x40.yml false(unreach-call) 39.40 24.02 None array-tiling/mbpr2.yml TIMEOUT 300.53 269.39 None array-tiling/mbpr3.yml TIMEOUT 300.76 273.26 None ldv-linux-4.0-rc1-mav/linux-4.0-rc1---drivers--atm--fore_200e.ko.cil.yml TIMEOUT 300.73 242.63 None ldv-linux-4.0-rc1-mav/linux-4.0-rc1---drivers--block--mtip32xx--mtip32xx.ko.cil.yml TIMEOUT 300.76 259.81 None loop-crafted/simple_array_index_value_1-1.yml TIMEOUT 301.01 286.99 None loop-crafted/simple_array_index_value_1-2.yml false(unreach-call) 9.10 5.67 None recursified_loop-invariants/recursified_bin-suffix-5.yml true 22.27 13.80 None recursified_loop-invariants/recursified_const.yml true 10.73 6.43 None ldv-linux-3.0-todo/usb_urb-drivers-net-usb-catc.ko.cil.out.yml TIMEOUT 300.35 263.62 None xcsp/aim-100-1-6-sat-1.yml TIMEOUT 300.75 233.72 None xcsp/aim-100-1-6-sat-2.yml TIMEOUT 300.81 239.32 None nla-digbench-scaling/bresenham-ll_unwindbound100.yml false(unreach-call) 53.33 41.07 None nla-digbench-scaling/bresenham-ll_unwindbound10.yml false(unreach-call) 33.31 20.29 None ldv-linux-3.16-rc1/205_9a_array_safes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--usb--cdc_eem.ko-entry_point.cil.out.yml true 52.74 30.90 None ldv-linux-3.16-rc1/205_9a_array_safes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--wireless--libertas_tf--libertas_tf.ko-entry_point.cil.out.yml TIMEOUT 300.73 230.05 None loops-crafted-1/discover_list.yml TIMEOUT 300.99 286.88 None loops-crafted-1/iftelse.yml TIMEOUT 300.08 278.54 None loop-zilu/benchmark02_linear_abstracted.yml true 11.74 6.66 None array-crafted/bAnd1.yml TIMEOUT 301.04 283.85 None array-crafted/bAnd2.yml TIMEOUT 300.10 277.14 None ntdrivers/cdaudio.i.cil-1.yml TIMEOUT 300.56 250.50 None float-benchs/addsub_double_exact.yml true 17.32 10.43 None float-benchs/addsub_float_exact.yml true 17.10 10.68 None pthread-ext/01b_inc-pthread.yml OUT OF MEMORY 73.45 46.71 None pthread-ext/01b_inc.yml OUT OF MEMORY 66.18 43.98 None ldv-linux-3.0/module_get_put-drivers-block-drbd-drbd.ko.cil.out-1.yml true 51.88 33.33 None ldv-linux-3.14/linux-3.14_complex_emg_linux-alloc-spinlock_drivers-media-common-saa7146-saa7146_vv.cil.yml TIMEOUT 300.96 249.64 None ldv-linux-3.14/linux-3.14_complex_emg_linux-alloc-spinlock_drivers-media-pci-cx25821-cx25821.cil.yml TIMEOUT 301.11 250.46 None list-simple/dll2c_append_equal.yml TIMEOUT 301.11 286.93 None list-simple/dll2c_append_unequal.yml ERROR (7) 63.25 41.46 None loop-floats-scientific-comp/loop1-1.yml TIMEOUT 300.95 293.48 None loop-floats-scientific-comp/loop1-2.yml false(unreach-call) 22.90 16.30 None floats-cdfpl/newton_1_1.yml TIMEOUT 300.93 294.49 None floats-cdfpl/newton_1_2.yml TIMEOUT 300.93 294.20 None loop-acceleration/array_1-1.yml TIMEOUT 300.98 291.07 None loop-acceleration/array_1-2.yml true 13.83 9.69 None hardware-verification-bv/btor2c-lazyMod.adding.1.prop1-back-serstep.yml OUT OF MEMORY 166.29 119.58 None hardware-verification-bv/btor2c-lazyMod.adding.1.prop1-func-interl.yml ERROR (7) 89.27 67.44 None seq-mthreaded-reduced/pals_floodmax.3.1.ufo.BOUNDED-6.pals.c.v+cfa-reducer.yml OUT OF MEMORY 71.43 41.56 None seq-mthreaded-reduced/pals_floodmax.3.1.ufo.BOUNDED-6.pals.c.v+lhb-reducer.yml false(unreach-call) 20.51 11.64 None bitvector/byte_add_1-1.yml TIMEOUT 300.42 267.54 None busybox-1.22.0/basename-2.yml true 16.59 10.02 None ldv-linux-4.2-rc1/linux-4.2-rc1.tar.xz-08_1a-drivers--ata--libata.ko-entry_point.cil.out.yml TIMEOUT 302.20 244.48 None ldv-linux-4.2-rc1/linux-4.2-rc1.tar.xz-08_1a-drivers--atm--atmtcp.ko-entry_point.cil.out.yml TIMEOUT 300.60 275.49 None pthread-atomic/dekker.yml true 12.37 7.25 None combinations/gcd_1+newton_1_1.yml TIMEOUT 300.94 293.20 None combinations/gcd_1+newton_1_2.yml TIMEOUT 300.97 291.05 None loop-industry-pattern/aiob_1.yml true 18.52 10.76 None loop-industry-pattern/aiob_2.yml true 17.84 10.43 None seq-mthreaded/pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml OUT OF MEMORY 62.72 40.63 None seq-mthreaded/pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml OUT OF MEMORY 85.98 52.94 None ldv-linux-4.2-rc1-todo/linux-4.2-rc1.tar.xz-08_1a-drivers--md--dm-cache.ko-entry_point.cil.out.yml TIMEOUT 301.12 248.28 None ldv-linux-4.2-rc1-todo/linux-4.2-rc1.tar.xz-08_1a-drivers--staging--comedi--comedi.ko-entry_point.cil.out.yml TIMEOUT 300.84 256.73 None loops/array-1.yml true 15.24 8.69 None loops/array-2.yml false(unreach-call) 9.73 5.92 None weaver/array-eq-symm.wvr.yml OUT OF MEMORY 179.40 139.13 None weaver/array-eq-trans.wvr.yml TIMEOUT 301.11 239.02 None ldv-validator-v0.6-todo/linux-stable-073676f-1-114_1a-drivers--net--b44.ko-entry_point.cil.out.yml TIMEOUT 301.22 285.17 None locks/test_locks_10.yml true 19.57 10.94 None locks/test_locks_11.yml true 27.68 15.97 None eca-rers2012/Problem01_label00.yml true 18.86 11.55 None eca-rers2012/Problem01_label01.yml true 18.67 10.99 None heap-data/calendar.yml TIMEOUT 301.23 261.77 None heap-data/cart.yml TIMEOUT 300.42 283.82 None ldv-linux-3.4-simple/32_1_cilled_ok_nondet_linux-3.4-32_1-drivers--acpi--apei--einj.ko-ldv_main0_sequence_infinite_withcheck_stateful.cil.out.yml true 15.83 9.25 None ldv-linux-3.4-simple/32_1_cilled_ok_nondet_linux-3.4-32_1-drivers--acpi--bgrt.ko-ldv_main0_sequence_infinite_withcheck_stateful.cil.out.yml true 13.34 8.12 None ldv-validator-v0.8/linux-stable-063f96c-1-144_2a-drivers--mmc--host--vub300.ko.unsigned-entry_point_ldv-val-v0.8.cil.out.yml OUT OF MEMORY 193.02 145.21 None systemc/bist_cell.cil.yml true 105.37 79.40 None systemc/kundu1.cil.yml false(unreach-call) 47.31 26.19 None aws-c-common/aws_add_size_checked_harness_negated.yml unknown 90.44 79.19 None aws-c-common/aws_add_size_checked_harness.yml unknown 145.21 122.98 None reducercommutativity/avg05-1.yml true 71.99 46.71 None bitvector-regression/implicitfloatconversion.yml false(unreach-call) 15.19 9.42 None bitvector-regression/implicitunsignedconversion-1.yml false(unreach-call) 7.98 4.86 None ldv-commit-tester-todo/m0_drivers-net-b44-ko--114_1a--073676f-1.yml TIMEOUT 301.15 286.39 None array-fpi/brs1f.yml false(unreach-call) 9.70 6.07 None array-fpi/brs1.yml TIMEOUT 301.59 276.44 None ldv-consumption/32_7a_cilled_linux-3.8-rc1-32_7a-drivers--ata--libata.ko-ldv_main4_sequence_infinite_withcheck_stateful.cil.out.yml TIMEOUT 300.43 265.10 None ldv-consumption/32_7a_cilled_linux-3.8-rc1-32_7a-drivers--block--cciss.ko-ldv_main0_sequence_infinite_withcheck_stateful.cil.out.yml TIMEOUT 300.34 271.70 None array-programs/copysome1-1.yml TIMEOUT 300.96 291.90 None array-programs/copysome1-2.yml TIMEOUT 300.95 292.67 None pthread-wmm/mix000.oepc.yml false(unreach-call) 17.17 9.48 None pthread-wmm/mix000.opt.yml false(unreach-call) 16.66 9.55 None eca-programs/Problem101_label00.yml OUT OF MEMORY 130.69 93.51 None eca-programs/Problem101_label01.yml OUT OF MEMORY 117.88 82.41 None ldv-challenges-todo/linux-3.14_complex_emg_linux-drivers-clk1_drivers-net-ethernet-ethoc.cil.yml TIMEOUT 300.65 258.88 None array-patterns/array10_pattern.yml TIMEOUT 300.13 258.38 None array-patterns/array11_pattern.yml TIMEOUT 300.07 285.73 None eca-rers2018/Problem10.yml OUT OF MEMORY 77.59 49.31 None eca-rers2018/Problem11.yml OUT OF MEMORY 183.67 153.45 None hardware-verification-array/btor2c-lazyMod.safe_arbitrated_fifos_n2d8w8.yml TIMEOUT 301.09 242.04 None hardware-verification-array/btor2c-lazyMod.safe_linked_list_fifo_n2d4.yml TIMEOUT 300.55 257.71 None ldv-linux-3.14-todo/linux-3.14_complex_emg_linux-alloc-spinlock_drivers-net-usb-kaweth.cil.yml TIMEOUT 300.88 252.79 None pthread/bigshot_s2.yml true 50.00 42.65 None loop-simple/deep-nested.yml TIMEOUT 300.31 273.78 None loop-simple/nested_1b.yml false(unreach-call) 10.10 6.42 None list-ext3-properties/dll_circular_traversal-2.yml TIMEOUT 300.49 275.91 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-1.yml OUT OF MEMORY 140.16 95.19 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-2.yml OUT OF MEMORY 124.68 88.04 None loop-invariants/bin-suffix-5.yml true 24.40 14.24 None loop-invariants/const.yml true 11.51 6.57 None list-ext2-properties/list_and_tree_cnstr-1.yml TIMEOUT 301.13 248.56 None list-ext2-properties/list_and_tree_cnstr-2.yml TIMEOUT 300.99 263.18 None pthread-C-DAC/pthread-demo-datarace-1.yml OUT OF MEMORY 161.77 136.86 None recursified_nla-digbench/recursified_bresenham-ll.yml TIMEOUT 300.74 273.53 None bitvector-loops/diamond_2-1.yml false(unreach-call) 12.04 6.93 None bitvector-loops/overflow_1-2.yml TIMEOUT 300.97 289.11 None ldv-multiproperty/linux-4.0-rc1---drivers--atm--fore_200e.ko.cil.yml TIMEOUT 300.22 231.32 None ldv-multiproperty/linux-4.0-rc1---drivers--block--mtip32xx--mtip32xx.ko.cil.yml TIMEOUT 300.74 265.86 None loop-invgen/apache-escape-absolute.i.v+cfa-reducer.yml true 16.05 9.43 None loop-invgen/apache-escape-absolute.yml true 15.21 8.44 None ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 2 done 32834.86 2178.15 - Statistics: 193 Files correct: 72 correct true: 45 correct false: 27 incorrect: 1 incorrect true: 0 incorrect false: 1 unknown: 120 Score: 101 (max: 310)