BENCHMARK INFORMATION benchmark definition: ../benchexec/automizer.xml name: automizer run sets: Automizer.SmallPrerun-NoOverflow date: Thu, 2023-11-23 16:00:13 CET tool: ULTIMATE Automizer 0.2.3-c4f91361 tool executable: ./Ultimate.py options: --full-output parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 300 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.108-1-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer.SmallPrerun-NoOverflow Run set 1 of 3 with options '--full-output' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------------------------------------------------- psyco/psyco_math_1.yml false(no-overflow) 13.63 7.95 None memsafety-bftpd/bftpd_1a.yml true 11.89 7.73 None memsafety-bftpd/bftpd_1b.yml true 11.45 7.16 None memsafety-bftpd/bftpd_2a.yml true 11.89 7.43 None memsafety-bftpd/bftpd_2b.yml true 11.29 7.07 None memsafety-bftpd/bftpd_3.yml true 14.19 8.41 None unsignedintegeroverflow-sas23/bilinear_interpolation.yml true 9.84 6.51 None unsignedintegeroverflow-sas23/cancel_var_through_overflow.yml true 12.11 6.85 None unsignedintegeroverflow-sas23/distance_through_overflow.yml true 10.00 6.64 None unsignedintegeroverflow-sas23/linear_interpolation_2.yml true 11.12 7.03 None unsignedintegeroverflow-sas23/linear_interpolation.yml true 10.48 7.04 None nla-digbench/cohendiv.yml false(no-overflow) 14.29 10.35 None nla-digbench/dijkstra-u.yml true 8.76 5.79 None nla-digbench/dijkstra.yml TIMEOUT 301.06 286.97 None nla-digbench/divbin2.yml true 8.93 5.80 None nla-digbench/divbin.yml true 8.63 6.41 None array-multidimensional/diff-2-n-u.yml true 14.49 10.55 None array-multidimensional/diff-3-n-u.yml true 23.25 14.87 None array-multidimensional/init-2-n-u.yml true 12.87 9.28 None array-multidimensional/init-3-u.yml true 16.36 12.98 None ldv-commit-tester/m0_drivers-media-rc-imon--32_7a--a9e7fb5.yml TIMEOUT 300.71 256.59 None loop-lit/cggmp2005b.yml true 12.78 7.84 None loop-lit/cggmp2005.yml true 13.47 10.56 None recursive/Addition02WithOverflowBug.yml false(no-overflow) 12.27 6.99 None recursive/Addition02.yml TIMEOUT 300.50 276.29 None recursive/Addition03-1.yml TIMEOUT 300.81 246.41 None recursive/Addition03-2.yml false(no-overflow) 9.86 5.84 None recursive/BallRajamani-SPIN2000-Fig1.yml true 8.44 5.61 None ldv-memsafety/ArraysOfVariableLength6.yml true 42.76 31.87 None ldv-memsafety/ArraysOfVariableLength.yml true 26.02 15.73 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-cousot9.yml true 10.14 6.22 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-easy1.yml true 9.44 5.68 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-easy2-1.yml TIMEOUT 300.64 261.34 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-easy2-2.yml TIMEOUT 300.27 277.85 None termination-crafted-lit/AliasDarteFeautrierGonnord-SAS2010-exmini.yml false(no-overflow) 9.51 6.55 None array-examples/sanfoundry_24-1.yml true 18.49 13.30 None recursified_loop-simple/recursified_nested_2.yml true 16.08 11.20 None recursified_loop-simple/recursified_nested_3.yml true 38.44 24.56 None recursified_loop-simple/recursified_nested_4.yml true 103.03 72.53 None recursified_loop-simple/recursified_nested_5.yml true 163.59 142.96 None ldv-validator-v0.6/linux-stable-4ed3cba-1-100_1a-drivers--usb--serial--qcserial.ko-entry_point.cil.out.yml TIMEOUT 300.45 269.90 None ldv-sets/test_mutex_unbounded-1.yml true 20.65 11.76 None ldv-sets/test_mutex_unbounded-2.yml true 17.08 10.85 None array-lopstr16/partial_lesser_bound-1.yml true 81.94 66.58 None array-lopstr16/partial_lesser_bound.yml true 84.26 67.69 None array-lopstr16/single_elem_safe.yml true 21.74 12.43 None recursive-with-pointer/simple-recursive.yml true 12.01 7.67 None seq-pthread/cs_lamport.yml true 18.36 11.76 None seq-pthread/cs_lazy.yml false(no-overflow) 107.94 80.83 None seq-pthread/cs_peterson.yml true 20.84 11.96 None ddv-machzwd/ddv_machzwd_inw.yml TIMEOUT 300.29 265.61 None recursive-simple/fibo_10-2.yml true 128.76 88.70 None pthread-lit/qw2004-2b.yml true 15.81 8.84 None memsafety-ext3/getNumbers1-2.yml true 12.06 8.41 None memsafety-ext3/getNumbers3.yml true 12.17 7.17 None memsafety-ext3/getNumbers4-1.yml true 16.74 12.64 None pthread-complex/elimination_backoff_stack.yml OUT OF MEMORY 52.19 32.06 None pthread-complex/safestack_relacy.yml OUT OF MEMORY 70.15 42.61 None pthread-complex/workstealqueue_mutex-2.yml OUT OF MEMORY 66.73 45.84 None goblint-regression/04-mutex_02-simple_nr.yml true 11.66 6.88 None uthash-2.0.2/uthash_BER_nondet_test3-2.yml TIMEOUT 301.28 282.47 None uthash-2.0.2/uthash_BER_nondet_test4-1.yml TIMEOUT 301.33 282.77 None uthash-2.0.2/uthash_BER_nondet_test4-3.yml OUT OF MEMORY 124.99 92.21 None uthash-2.0.2/uthash_BER_test10-1.yml TIMEOUT 300.59 268.29 None goblint-coreutils/instrumented_du_comb.yml ERROR (7) 80.97 63.14 None goblint-coreutils/instrumented_interval_cksum_comb.yml ERROR (7) 75.00 59.31 None goblint-coreutils/instrumented_interval_cp_comb.yml ERROR (7) 98.10 82.15 None goblint-coreutils/instrumented_interval_cut_comb.yml ERROR (7) 79.67 61.14 None goblint-coreutils/instrumented_interval_dd_comb.yml ERROR (7) 95.26 69.77 None signedintegeroverflow-regression/Multiplication-1.yml true 11.15 6.35 None signedintegeroverflow-regression/Multiplication-2.yml false(no-overflow) 12.19 6.83 None signedintegeroverflow-regression/NoConversion.yml false(no-overflow) 8.89 5.57 None signedintegeroverflow-regression/NoNegativeIntegerConstant.yml true 11.44 6.47 None signedintegeroverflow-regression/PostfixDecrement.yml false(no-overflow) 9.43 5.72 None openssl-simplified/s3_clnt_3.cil-2.yml false(no-overflow) 11.18 6.73 None openssl-simplified/s3_clnt_3.cil-3.yml false(no-overflow) 13.71 7.65 None openssl-simplified/s3_clnt_4.cil-1.yml false(no-overflow) 10.68 6.83 None openssl-simplified/s3_clnt_4.cil-2.yml false(no-overflow) 10.94 7.02 None openssl-simplified/s3_srvr_10.cil.yml false(no-overflow) 13.63 7.61 None array-industry-pattern/array_of_struct_ptr_cond_init.yml true 17.46 10.87 None array-industry-pattern/array_of_struct_ptr_flag_init.yml true 57.90 39.34 None array-industry-pattern/array_of_struct_ptr_monotonic.yml true 10.49 6.39 None array-industry-pattern/array_of_struct_single_elem_init.yml true 19.50 11.77 None ldv-races/race-2_1-container_of.yml false(no-overflow) 12.36 7.35 None ldv-races/race-2_2-container_of.yml false(no-overflow) 13.85 7.83 None ldv-races/race-2_3-container_of.yml false(no-overflow) 12.06 7.06 None array-tiling/mlceu.yml true 14.95 10.22 None array-tiling/nr2.yml true 21.48 14.55 None array-tiling/nr3.yml true 23.01 15.36 None array-tiling/nr4.yml true 23.45 15.20 None array-tiling/nr5.yml true 31.96 18.75 None termination-recursive-malloc/mutual_simple2.yml true 11.02 6.55 None termination-recursive-malloc/mutual_simple.yml true 10.99 6.36 None termination-recursive-malloc/rec_malloc_ex10.yml false(no-overflow) 9.46 5.89 None termination-dietlibc/skip_to.yml true 9.80 5.89 None termination-dietlibc/stpcpy.yml true 10.11 5.92 None recursified_loop-invariants/recursified_even.yml true 8.62 5.86 None recursified_loop-invariants/recursified_linear-inequality-inv-a.yml true 8.78 5.59 None recursified_loop-invariants/recursified_linear-inequality-inv-b.yml true 9.75 6.38 None recursified_loop-invariants/recursified_mod4.yml true 8.88 5.63 None recursified_loop-invariants/recursified_odd.yml true 8.95 5.79 None termination-15/array08_alloca.yml false(no-overflow) 26.64 16.70 None termination-15/array09_alloca.yml false(no-overflow) 13.76 9.28 None termination-15/array10_alloca.yml false(no-overflow) 12.01 7.47 None termination-15/array12_alloca.yml true 18.19 13.01 None termination-15/array13_alloca.yml true 23.63 14.23 None nla-digbench-scaling/bresenham-ll_unwindbound50.yml TIMEOUT 300.15 283.64 None nla-digbench-scaling/bresenham-ll_unwindbound5.yml TIMEOUT 301.00 283.94 None nla-digbench-scaling/bresenham-ll_valuebound100.yml TIMEOUT 300.85 258.69 None nla-digbench-scaling/bresenham-ll_valuebound10.yml TIMEOUT 300.25 279.29 None nla-digbench-scaling/bresenham-ll_valuebound1.yml true 110.82 89.18 None loop-zilu/benchmark05_conjunctive.yml true 11.22 7.17 None loop-zilu/benchmark06_conjunctive.yml false(no-overflow) 8.41 5.09 None loop-zilu/benchmark07_linear.yml false(no-overflow) 9.57 5.73 None loop-zilu/benchmark08_conjunctive.yml TIMEOUT 300.55 274.53 None loop-zilu/benchmark09_conjunctive.yml true 9.36 6.05 None memsafety-ext2/length_test03-2.yml true 20.59 12.42 None memsafety-ext2/optional_data_creation_test04-1.yml true 11.31 6.77 None memsafety-ext2/optional_data_creation_test04-2.yml true 14.10 8.04 None memsafety-ext2/split_list_test05-2.yml true 39.30 24.44 None termination-numeric/Et2_true.yml false(no-overflow) 9.06 5.45 None termination-numeric/Et3_true.yml false(no-overflow) 9.10 5.57 None termination-numeric/Et4_true.yml false(no-overflow) 11.20 6.50 None termination-numeric/EvenOdd01-2.yml TIMEOUT 300.31 259.30 None termination-numeric/Fibonacci01-2.yml TIMEOUT 301.03 256.14 None array-crafted/bor1.yml true 31.24 20.31 None array-crafted/bor2.yml true 37.87 23.73 None array-crafted/bor3.yml true 31.32 20.53 None array-crafted/bor4.yml true 32.01 20.71 None array-crafted/bor5.yml true 23.99 15.13 None termination-restricted-15/a.08.yml true 9.31 5.70 None termination-restricted-15/a.09_assume.yml true 10.27 6.25 None termination-restricted-15/a.10.yml true 9.59 5.84 None termination-restricted-15/AlternKonv.yml true 12.53 7.05 None termination-restricted-15/b.01.yml true 9.08 5.60 None ntdrivers-simplified/floppy_simpl4.cil-1.yml false(no-overflow) 13.14 7.57 None ntdrivers-simplified/floppy_simpl4.cil-2.yml false(no-overflow) 17.25 9.35 None ntdrivers-simplified/kbfiltr_simpl1.cil.yml false(no-overflow) 9.83 6.14 None ntdrivers-simplified/kbfiltr_simpl2.cil-1.yml false(no-overflow) 10.17 6.06 None ntdrivers-simplified/kbfiltr_simpl2.cil-2.yml false(no-overflow) 10.15 6.09 None pthread-ext/03_incdec.yml true 11.96 6.77 None pthread-ext/04_incdec_cas.yml true 9.54 5.68 None termination-crafted/aaron2-1.yml true 11.49 7.30 None termination-crafted/aaron2-2.yml false(no-overflow) 10.72 6.25 None termination-crafted/aaron3-1.yml true 20.75 12.76 None termination-crafted/aaron3-2.yml false(no-overflow) 8.26 5.00 None termination-crafted/Ackermann-1.yml false(no-overflow) 9.20 5.79 None list-simple/dll2c_remove_all_reverse.yml true 18.46 10.63 None list-simple/dll2c_remove_all.yml true 14.36 9.07 None list-simple/dll2c_update_all_reverse.yml true 21.41 12.99 None list-simple/dll2c_update_all.yml true 23.63 14.62 None termination-memory-alloca/a.08-alloca.yml true 11.28 6.69 None termination-memory-alloca/a.09_assume-alloca.yml true 16.69 9.28 None termination-memory-alloca/a.10-alloca.yml true 12.94 7.43 None loop-acceleration/array_2-2.yml true 15.84 9.95 None loop-acceleration/array_3-1.yml true 18.93 11.01 None loop-acceleration/array_3-2.yml true 14.72 9.23 None bitvector/byte_add-2.yml false(no-overflow) 37.62 20.87 None bitvector/gcd_1.yml true 12.77 7.85 None bitvector/gcd_2.yml true 9.70 5.89 None bitvector/gcd_3.yml true 9.65 6.19 None bitvector/gcd_4.yml true 20.60 12.29 None busybox-1.22.0/chroot-incomplete-2.yml OUT OF MEMORY 148.80 89.13 None busybox-1.22.0/cut-1.yml TIMEOUT 300.46 257.60 None busybox-1.22.0/cut-3.yml TIMEOUT 300.52 257.83 None pthread-atomic/peterson.yml true 11.93 6.77 None loops/eureka_01-1.yml false(no-overflow) 10.59 6.67 None loops/eureka_05.yml true 23.93 16.40 None weaver/bench-exp2x6.wvr.yml true 11.53 6.60 None weaver/bench-exp2x9.wvr.yml true 11.79 6.68 None weaver/bench-exp3x3-opt.wvr.yml true 9.31 5.47 None weaver/bench-exp3x3.wvr.yml true 11.86 6.62 None weaver/chl-array-int-subst.wvr.yml OUT OF MEMORY 69.16 43.61 None heap-data/running_example.yml true 11.83 6.81 None list-ext-properties/simple-ext.yml true 21.30 12.31 None pthread-wmm/mix002.opt.yml true 14.00 8.36 None pthread-wmm/mix003.oepc.yml true 13.91 7.81 None pthread-wmm/mix003_power.opt_pso.opt_rmo.opt_tso.opt.yml true 14.09 8.15 None pthread-wmm/mix004.oepc.yml true 23.62 12.99 None pthread-wmm/mix004.opt.yml true 26.75 14.17 None openssl/s3_clnt.blast.03.i.cil-2.yml false(no-overflow) 12.16 7.28 None openssl/s3_clnt.blast.04.i.cil-1.yml false(no-overflow) 11.70 6.90 None openssl/s3_clnt.blast.04.i.cil-2.yml false(no-overflow) 14.85 8.34 None openssl/s3_srvr.blast.01.i.cil-1.yml false(no-overflow) 11.80 7.00 None openssl/s3_srvr.blast.01.i.cil-2.yml false(no-overflow) 11.42 6.63 None array-memsafety/bubblesort-alloca-2.yml true 27.05 17.64 None array-memsafety/cstrcat-alloca-2.yml true 21.91 12.72 None pthread-deagle/arithmetic_prog_bad.yml true 27.33 15.28 None pthread-deagle/arithmetic_prog_ok.yml true 21.59 12.42 None pthread-deagle/circular_buffer_bad.yml true 19.44 11.07 None pthread-deagle/circular_buffer_ok.yml true 15.19 8.99 None pthread/fib_safe-11.yml OUT OF MEMORY 76.57 53.76 None pthread/fib_safe-12.yml OUT OF MEMORY 98.90 62.66 None loop-simple/nested_2.yml true 13.94 8.29 None loop-simple/nested_3.yml true 11.76 7.88 None loop-simple/nested_4.yml true 19.39 12.08 None loop-simple/nested_5.yml true 118.01 96.10 None list-ext3-properties/dll_nullified-2.yml true 10.83 6.28 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-2.yml OUT OF MEMORY 159.04 108.20 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--nsc-ircc.ko.cil.yml OUT OF MEMORY 84.34 51.50 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--w83977af_ir.ko.cil.yml OUT OF MEMORY 64.87 38.88 None ldv-linux-3.14-races/linux-3.14--drivers--spi--spi-tegra20-slink.ko.cil.yml OUT OF MEMORY 119.60 75.70 None ldv-linux-3.14-races/linux-3.14--drivers--usb--misc--adutux.ko.cil.yml OUT OF MEMORY 71.53 40.88 None loop-invariants/even.yml true 8.71 5.13 None loop-invariants/linear-inequality-inv-a.yml true 8.74 5.43 None loop-invariants/linear-inequality-inv-b.yml true 9.09 5.51 None loop-invariants/mod4.yml true 8.44 5.10 None loop-invariants/odd.yml true 8.99 5.52 None termination-memory-linkedlists/cll_traverse-alloca.yml true 12.22 7.30 None array-memsafety-realloc/array-realloc-2.yml true 12.30 7.63 None array-memsafety-realloc/array-realloc-3.yml true 12.31 8.08 None pthread-C-DAC/pthread-demo-datarace-1.yml OUT OF MEMORY 98.04 71.12 None pthread-C-DAC/pthread-demo-datarace-3.yml OUT OF MEMORY 147.06 116.75 None pthread-C-DAC/pthread-finding-k-matches.yml unknown 15.16 8.70 None pthread-C-DAC/pthread-numerical-integration.yml unknown 15.68 9.37 None pthread-driver-races/char_generic_nvram_read_nvram_write_nvram.yml true 16.89 9.58 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_configure.yml TIMEOUT 301.08 280.87 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_current.yml TIMEOUT 301.08 280.68 None recursified_nla-digbench/recursified_cohendiv.yml false(no-overflow) 51.56 43.52 None recursified_nla-digbench/recursified_dijkstra-u.yml true 9.38 5.59 None recursified_nla-digbench/recursified_dijkstra.yml false(no-overflow) 174.46 148.15 None recursified_nla-digbench/recursified_divbin2.yml true 8.62 5.21 None recursified_nla-digbench/recursified_divbin.yml true 9.14 5.35 None loop-invgen/apache-get-tag.i.v+lhb-reducer.yml TIMEOUT 300.32 253.72 None --------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 1 done 12512.89 894.80 - Automizer-Slice.SmallPrerun-NoOverflow Run set 2 of 3: skipped Automizer-NoSlice.SmallPrerun-NoOverflow Run set 3 of 3: skipped Statistics: 224 Files correct: 176 correct true: 136 correct false: 40 incorrect: 3 incorrect true: 0 incorrect false: 3 unknown: 45 Score: 264 (max: 404)