BENCHMARK INFORMATION benchmark definition: ../benchexec/automizer.xml name: automizer run sets: Automizer.Memslicer-Tests, Automizer-Slice.Memslicer-Tests date: Wed, 2023-11-22 16:29:14 CET tool: ULTIMATE Automizer 0.2.3-6ae2ee47 tool executable: ./Ultimate.py options: --full-output parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 300 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.108-1-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ Automizer.Memslicer-Tests Run set 1 of 2 with options '--full-output' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ldv-regression/alias_of_return_2.c_1.yml true 13.22 7.60 None ldv-regression/alias_of_return_2.yml true 11.14 7.18 None ldv-regression/alias_of_return.c_1.yml true 10.49 6.36 None ldv-regression/alias_of_return.yml true 10.83 6.67 None memsafety-bftpd/bftpd_1a.yml TIMEOUT 300.21 265.39 None memsafety-bftpd/bftpd_2a.yml TIMEOUT 300.46 253.04 None memsafety-bftpd/bftpd_3.yml TIMEOUT 300.14 271.18 None openbsd-6.2/if_etherip-fixed-invalid-deref1.yml ERROR (7) 21.28 11.93 None openbsd-6.2/if_etherip-fixed-invalid-deref2.yml ERROR (7) 17.43 11.02 None openbsd-6.2/if_etherip-fixed.yml ERROR (7) 17.44 10.50 None openbsd-6.2/if_etherip-invalid-deref.yml ERROR (7) 17.55 10.32 None openbsd-6.2/if_etherip-unreach-call.yml ERROR (7) 16.93 10.03 None memsafety-ext/dll_extends_pointer.yml TIMEOUT 300.56 276.44 None memsafety-ext/skiplist_2lvl.yml TIMEOUT 300.51 271.38 None memsafety-ext/skiplist_3lvl.yml TIMEOUT 300.65 267.74 None memsafety-ext/tree_cnstr.yml TIMEOUT 300.37 275.29 None memsafety-ext/tree_dsw.yml TIMEOUT 300.20 276.12 None forester-heap/dll-01-2.yml TIMEOUT 300.26 258.09 None forester-heap/dll-circular-2.yml TIMEOUT 300.94 264.13 None forester-heap/dll-optional-1.yml TIMEOUT 300.17 275.25 None ldv-memsafety/ArraysOfVariableLength2_-read.yml false(valid-deref) 9.93 6.48 None ldv-memsafety/ArraysOfVariableLength2_-write.yml false(valid-deref) 10.79 6.59 None ldv-memsafety/ArraysOfVariableLength2.yml TIMEOUT 300.30 264.32 None ldv-memsafety/ArraysOfVariableLength4.yml true 52.98 33.68 None ldv-memsafety/ArraysOfVariableLength5.yml true 29.27 21.56 None heap-manipulation/bubble_sort_linux-1.yml TIMEOUT 301.02 285.11 None heap-manipulation/dancing.yml TIMEOUT 300.48 272.54 None heap-manipulation/dll_of_dll-1.yml TIMEOUT 300.76 252.90 None array-examples/data_structures_set_multi_proc_trivial_ground.yml true 65.11 44.00 None array-examples/relax-1.yml false(valid-deref) 13.35 7.35 None array-examples/relax-2-2.yml unknown 54.03 36.39 None ldv-linux-3.16-rc1-todo/205_9a_array_safes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--caif--caif_hsi.ko-entry_point.cil.out.yml ERROR (7) 21.76 12.15 None ldv-validator-v0.6/linux-stable-064368f-1-111_1a-drivers--media--radio--si4713-i2c.ko-entry_point.cil.out.yml unknown 159.93 122.18 None recursive-with-pointer/simple-recursive.yml true 96.24 70.52 None recursive-with-pointer/system-with-recursion.yml false(valid-deref) 60.41 34.31 None verifythis/duplets.yml TIMEOUT 300.23 274.03 None verifythis/elimination_max_rec_onepoint.yml true 64.83 41.18 None verifythis/elimination_max_rec.yml true 35.52 23.58 None verifythis/elimination_max.yml true 25.75 17.88 None verifythis/lcp.yml true 39.94 25.62 None memsafety/20020406-1.yml TIMEOUT 300.24 276.57 None memsafety/20051113-1.yml TIMEOUT 301.05 282.91 None memsafety/960521-1-1.yml TIMEOUT 301.03 284.29 None memsafety/960521-1-2.yml TIMEOUT 301.01 288.04 None memsafety/960521-1-3.yml TIMEOUT 301.04 284.68 None ddv-machzwd/ddv_machzwd_all.yml unknown 229.36 208.55 None ddv-machzwd/ddv_machzwd_inb_p.yml TIMEOUT 300.85 276.82 None ddv-machzwd/ddv_machzwd_inb.yml TIMEOUT 300.96 268.95 None ddv-machzwd/ddv_machzwd_inl_p.yml TIMEOUT 301.22 280.58 None ddv-machzwd/ddv_machzwd_inl.yml TIMEOUT 300.21 278.21 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_01_bad.yml true 148.51 138.51 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_01_good.yml TIMEOUT 301.02 286.90 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_02_bad.yml true 207.70 198.39 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_02_good.yml TIMEOUT 301.23 284.37 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_03_bad.yml true 166.66 156.74 None memsafety-ext3/derefAfterFree1.yml false(valid-deref) 9.09 5.78 None memsafety-ext3/derefAfterFree2.yml false(valid-deref) 11.53 7.36 None memsafety-ext3/derefInLoop1.yml false(valid-deref) 9.88 6.23 None memsafety-ext3/freeAlloca.yml false(valid-free) 12.31 7.91 None memsafety-ext3/getNumbers1-1.yml false(valid-deref) 12.19 7.74 None pthread-complex/bounded_buffer.yml OUT OF MEMORY 61.10 41.86 None pthread-complex/elimination_backoff_stack.yml OUT OF MEMORY 61.40 37.41 None pthread-complex/safestack_relacy.yml OUT OF MEMORY 63.00 43.07 None uthash-2.0.2/uthash_BER_nondet_test1-1.yml TIMEOUT 300.56 280.76 None uthash-2.0.2/uthash_BER_nondet_test1-2.yml TIMEOUT 300.29 266.80 None uthash-2.0.2/uthash_BER_nondet_test2-1.yml TIMEOUT 301.05 281.87 None uthash-2.0.2/uthash_BER_nondet_test2-2.yml TIMEOUT 300.11 277.80 None uthash-2.0.2/uthash_BER_nondet_test3-1.yml TIMEOUT 301.06 280.88 None goblint-coreutils/instrumented_cksum_comb.yml ERROR (7) 70.58 55.80 None goblint-coreutils/instrumented_cp_comb.yml ERROR (7) 91.31 74.37 None goblint-coreutils/instrumented_cut_comb.yml ERROR (7) 74.57 59.66 None goblint-coreutils/instrumented_dd_comb.yml ERROR (7) 80.71 63.92 None goblint-coreutils/instrumented_df_comb.yml ERROR (7) 81.13 65.31 None list-properties/alternating_list-1.yml TIMEOUT 300.40 279.99 None list-properties/list-1.yml unknown 24.89 15.92 None ldv-races/race-1_1-join.yml true 14.35 8.25 None ldv-races/race-1_2-join.yml unknown 24.36 15.70 None ldv-races/race-1_3-join.yml unknown 25.46 16.52 None termination-recursive-malloc/chunk1-2.yml unknown 16.10 10.34 None termination-recursive-malloc/insertionSort_recursive.yml true 38.69 22.97 None termination-dietlibc/basename-3.yml true 117.61 104.63 None ldv-linux-3.16-rc1/205_9a_array_unsafes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--ieee802154--mrf24j40.ko-entry_point.cil.out.yml ERROR (7) 18.80 10.61 None memsafety-ext2/complex_data_creation_test01-1.yml TIMEOUT 300.18 281.98 None memsafety-ext2/complex_data_creation_test02-2.yml TIMEOUT 301.05 284.04 None memsafety-ext2/length_test03-1.yml TIMEOUT 300.29 275.81 None ntdrivers/floppy2.i.cil.yml ERROR (7) 20.96 12.54 None pthread-ext/01b_inc-pthread.yml OUT OF MEMORY 64.71 41.13 None pthread-ext/01b_inc.yml OUT OF MEMORY 77.54 47.86 None pthread-ext/02_inc_cas.yml OUT OF MEMORY 60.01 39.66 None pthread-ext/03_incdec-pthread.yml OUT OF MEMORY 62.55 39.72 None termination-crafted/2Nested-1.yml true 9.01 5.62 None termination-crafted/4BitCounterPointer.yml true 50.01 32.48 None termination-crafted/4NestedWith3Variables-1.yml true 9.35 5.95 None ldv-linux-3.0/module_get_put-drivers-block-loop.ko.cil.out.yml TIMEOUT 300.26 271.53 None ldv-linux-3.14/linux-3.14_complex_emg_linux-alloc-spinlock_drivers-media-pci-saa7164-saa7164.cil.yml ERROR (7) 25.25 14.72 None list-simple/dll2c_append_equal.yml TIMEOUT 300.84 245.02 None list-simple/dll2c_append_unequal.yml TIMEOUT 300.42 278.72 None list-simple/dll2c_insert_equal.yml TIMEOUT 301.01 251.96 None list-simple/dll2c_insert_unequal.yml TIMEOUT 300.34 279.50 None list-simple/dll2c_prepend_equal.yml TIMEOUT 301.03 244.88 None termination-memory-alloca/a.01-alloca.yml true 11.50 6.61 None termination-memory-alloca/a.04-alloca.yml true 11.50 6.70 None termination-memory-alloca/a.05-alloca.yml true 10.71 6.54 None termination-memory-alloca/a.06-alloca.yml true 13.81 7.72 None termination-memory-alloca/a.07-alloca.yml true 12.49 7.29 None loop-acceleration/array_1-2.yml true 18.24 12.45 None busybox-1.22.0/basename-1.yml TIMEOUT 300.30 278.30 None busybox-1.22.0/basename-2.yml TIMEOUT 301.08 281.57 None busybox-1.22.0/chgrp-incomplete-1.yml TIMEOUT 300.33 276.96 None ldv-linux-4.2-rc1/linux-4.2-rc1.tar.xz-08_1a-drivers--block--loop.ko-entry_point.cil.out.yml TIMEOUT 300.51 268.28 None pthread-atomic/dekker.yml true 14.29 8.22 None pthread-atomic/lamport.yml true 21.45 12.05 None loop-industry-pattern/aiob_4.c.v+cfa-reducer.yml true 26.86 15.39 None loop-industry-pattern/aiob_4.c.v+lhb-reducer.yml true 78.71 52.17 None loops/array-1.yml true 13.53 8.00 None loops/bubble_sort-1.yml unknown 15.21 9.42 None weaver/array-eq-symm.wvr.yml TIMEOUT 300.62 279.75 None weaver/array-eq-trans.wvr.yml OUT OF MEMORY 178.87 150.56 None weaver/bench-exp1x3.wvr.yml TIMEOUT 300.09 281.79 None weaver/bench-exp2x3.wvr.yml TIMEOUT 300.08 281.63 None weaver/bench-exp2x4.wvr.yml TIMEOUT 300.19 272.96 None locks/test_locks_10.yml true 18.16 10.29 None locks/test_locks_11.yml true 26.13 14.00 None locks/test_locks_12.yml true 28.50 16.77 None locks/test_locks_13.yml true 53.88 31.53 None locks/test_locks_14-1.yml OUT OF MEMORY 63.12 41.11 None ldv-validator-v0.8/linux-stable-063f96c-1-144_1a-drivers--mmc--host--vub300.ko.unsigned-entry_point_ldv-val-v0.8.cil.out.yml ERROR (7) 18.92 10.90 None list-ext-properties/960521-1_1-1.yml false(valid-deref) 14.75 8.91 None list-ext-properties/960521-1_1-2.yml true 48.94 33.44 None list-ext-properties/960521-1_1-3.yml false(valid-free) 21.09 13.20 None list-ext-properties/list-ext_1.yml TIMEOUT 300.79 258.17 None list-ext-properties/list-ext_2.yml unknown 34.28 20.24 None memory-alloca/c.03-alloca-2.yml true 12.98 7.83 None pthread-memsafety/fillarray1.yml false(valid-deref) 23.64 14.91 None pthread-memsafety/fillarray.yml false(valid-deref) 22.14 14.54 None pthread-memsafety/list1.yml TIMEOUT 300.37 275.98 None pthread-wmm/mix000.oepc.yml unknown 38.49 23.30 None pthread-wmm/mix000.opt.yml unknown 45.07 25.86 None pthread-wmm/mix001.oepc.yml unknown 58.16 35.28 None pthread-wmm/mix001.opt.yml unknown 47.45 28.27 None pthread-wmm/mix002.oepc.yml unknown 61.18 38.29 None array-memsafety/add_last_unsafe.yml false(valid-deref) 13.48 7.64 None array-memsafety/array01-alloca-2.yml TIMEOUT 300.14 279.80 None array-memsafety/array02-alloca-2.yml TIMEOUT 301.00 286.63 None pthread/bigshot_s2.yml TIMEOUT 300.44 259.60 None pthread/bigshot_s.yml TIMEOUT 300.19 269.19 None pthread/fib_safe-10.yml OUT OF MEMORY 150.44 123.35 None list-ext3-properties/dll_circular_traversal-1.yml TIMEOUT 300.33 271.88 None list-ext3-properties/dll_circular_traversal-2.yml TIMEOUT 300.54 267.19 None list-ext3-properties/dll_nondet_free_order-1.yml TIMEOUT 301.07 279.14 None list-ext3-properties/dll_nondet_free_order-2.yml unknown 125.32 101.16 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-1.yml ERROR (7) 22.95 13.27 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-2.yml ERROR (7) 23.39 13.41 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--nsc-ircc.ko.cil.yml OUT OF MEMORY 93.96 60.73 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--w83977af_ir.ko.cil.yml OUT OF MEMORY 91.94 57.36 None ldv-linux-3.14-races/linux-3.14--drivers--spi--spi-tegra20-slink.ko.cil.yml ERROR (7) 19.67 11.40 None array-memsafety-realloc/array-realloc-1.yml false(valid-free) 28.25 18.15 None array-memsafety-realloc/array-realloc-2.yml TIMEOUT 301.02 284.89 None array-memsafety-realloc/array-realloc-3.yml unknown 22.25 13.57 None pthread-C-DAC/pthread-demo-datarace-1.yml OUT OF MEMORY 210.76 173.89 None pthread-C-DAC/pthread-demo-datarace-3.yml unknown 50.25 31.95 None pthread-C-DAC/pthread-finding-k-matches.yml unknown 19.40 10.55 None pthread-C-DAC/pthread-numerical-integration.yml unknown 15.38 9.19 None pthread-driver-races/char_generic_nvram_nvram_unlocked_ioctl_write_nvram.yml ERROR (7) 28.44 15.56 None pthread-driver-races/char_generic_nvram_read_nvram_nvram_unlocked_ioctl.yml ERROR (7) 21.49 12.37 None ldv-memsafety-bitfields/test-bitfields-1-1.yml ERROR (7) 13.62 8.24 None ldv-memsafety-bitfields/test-bitfields-1-2.yml ERROR (7) 13.38 8.57 None ldv-memsafety-bitfields/test-bitfields-2.1-1.yml ERROR (7) 13.31 8.25 None ldv-memsafety-bitfields/test-bitfields-2.1-2.yml ERROR (7) 16.77 9.25 None ldv-memsafety-bitfields/test-bitfields-2-1.yml ERROR (7) 13.33 7.96 None coreutils-v8.31/comm_3args_klee-sa_ko_243_infer_nd.yml TIMEOUT 300.72 238.28 None coreutils-v8.31/comm_3args_klee-sa_ko_243_infer_uaf.yml TIMEOUT 300.20 250.51 None coreutils-v8.31/comm_3args_ok.yml TIMEOUT 301.47 204.24 None coreutils-v8.31/csplit_3args_klee-sa_ko_1318-1332_csa_nd.yml TIMEOUT 300.20 258.85 None coreutils-v8.31/csplit_3args_klee-sa_ko_1318-1332_csa_uaf.yml TIMEOUT 301.04 225.56 None --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 1 done 24539.98 1651.22 - Automizer-Slice.Memslicer-Tests Run set 2 of 2 with options '--full-output --preprocessor.use.memory.slicer true' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ldv-regression/alias_of_return_2.c_1.yml true 12.50 7.19 None ldv-regression/alias_of_return_2.yml true 10.61 6.96 None ldv-regression/alias_of_return.c_1.yml true 10.18 6.20 None ldv-regression/alias_of_return.yml true 10.64 6.85 None memsafety-bftpd/bftpd_1a.yml TIMEOUT 300.28 263.95 None memsafety-bftpd/bftpd_2a.yml TIMEOUT 300.38 258.45 None memsafety-bftpd/bftpd_3.yml TIMEOUT 300.14 272.16 None openbsd-6.2/if_etherip-fixed-invalid-deref1.yml ERROR (7) 20.59 11.32 None openbsd-6.2/if_etherip-fixed-invalid-deref2.yml ERROR (7) 17.07 10.39 None openbsd-6.2/if_etherip-fixed.yml ERROR (7) 17.90 10.86 None openbsd-6.2/if_etherip-invalid-deref.yml ERROR (7) 17.80 10.55 None openbsd-6.2/if_etherip-unreach-call.yml ERROR (7) 17.15 10.23 None memsafety-ext/dll_extends_pointer.yml TIMEOUT 301.07 281.26 None memsafety-ext/skiplist_2lvl.yml TIMEOUT 300.29 268.75 None memsafety-ext/skiplist_3lvl.yml TIMEOUT 300.66 258.60 None memsafety-ext/tree_cnstr.yml TIMEOUT 301.08 267.06 None memsafety-ext/tree_dsw.yml TIMEOUT 300.15 278.17 None forester-heap/dll-01-2.yml TIMEOUT 300.44 275.08 None forester-heap/dll-circular-2.yml TIMEOUT 300.39 273.25 None forester-heap/dll-optional-1.yml TIMEOUT 300.41 274.31 None ldv-memsafety/ArraysOfVariableLength2_-read.yml false(valid-deref) 10.42 6.25 None ldv-memsafety/ArraysOfVariableLength2_-write.yml false(valid-deref) 10.55 6.70 None ldv-memsafety/ArraysOfVariableLength2.yml TIMEOUT 300.30 265.00 None ldv-memsafety/ArraysOfVariableLength4.yml true 51.82 33.93 None ldv-memsafety/ArraysOfVariableLength5.yml true 30.20 20.91 None heap-manipulation/bubble_sort_linux-1.yml ERROR (7) 280.76 264.11 None heap-manipulation/dancing.yml TIMEOUT 300.39 269.92 None heap-manipulation/dll_of_dll-1.yml TIMEOUT 300.31 268.40 None array-examples/data_structures_set_multi_proc_trivial_ground.yml true 63.74 45.35 None array-examples/relax-1.yml false(valid-deref) 10.58 6.10 None array-examples/relax-2-2.yml unknown 52.34 36.40 None ldv-linux-3.16-rc1-todo/205_9a_array_safes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--caif--caif_hsi.ko-entry_point.cil.out.yml ERROR (7) 21.43 12.17 None ldv-validator-v0.6/linux-stable-064368f-1-111_1a-drivers--media--radio--si4713-i2c.ko-entry_point.cil.out.yml unknown 199.72 172.73 None recursive-with-pointer/simple-recursive.yml true 78.45 49.06 None recursive-with-pointer/system-with-recursion.yml false(valid-deref) 71.07 38.97 None verifythis/duplets.yml true 155.29 128.06 None verifythis/elimination_max_rec_onepoint.yml true 56.76 41.26 None verifythis/elimination_max_rec.yml true 36.16 23.41 None verifythis/elimination_max.yml true 26.56 17.87 None verifythis/lcp.yml true 36.34 24.07 None memsafety/20020406-1.yml unknown 264.33 243.85 None memsafety/20051113-1.yml TIMEOUT 301.03 284.10 None memsafety/960521-1-1.yml TIMEOUT 301.00 287.72 None memsafety/960521-1-2.yml TIMEOUT 301.01 286.13 None memsafety/960521-1-3.yml TIMEOUT 301.02 286.21 None ddv-machzwd/ddv_machzwd_all.yml unknown 226.14 207.24 None ddv-machzwd/ddv_machzwd_inb_p.yml TIMEOUT 300.42 275.81 None ddv-machzwd/ddv_machzwd_inb.yml TIMEOUT 300.74 260.93 None ddv-machzwd/ddv_machzwd_inl_p.yml TIMEOUT 300.25 277.81 None ddv-machzwd/ddv_machzwd_inl.yml TIMEOUT 300.71 259.90 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_01_bad.yml true 122.33 113.62 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_01_good.yml TIMEOUT 300.95 291.35 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_02_bad.yml true 119.94 110.75 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_02_good.yml TIMEOUT 300.95 291.74 None Juliet_Test/CWE121_Stack_Based_Buffer_Overflow---s01---CWE121_Stack_Based_Buffer_Overflow__char_type_overrun_memcpy_03_bad.yml true 108.11 99.00 None memsafety-ext3/derefAfterFree1.yml false(valid-deref) 11.70 6.64 None memsafety-ext3/derefAfterFree2.yml false(valid-deref) 12.41 7.83 None memsafety-ext3/derefInLoop1.yml false(valid-deref) 11.94 6.89 None memsafety-ext3/freeAlloca.yml false(valid-free) 12.39 8.05 None memsafety-ext3/getNumbers1-1.yml false(valid-deref) 14.49 8.44 None pthread-complex/bounded_buffer.yml OUT OF MEMORY 62.10 41.70 None pthread-complex/elimination_backoff_stack.yml OUT OF MEMORY 55.23 33.72 None pthread-complex/safestack_relacy.yml OUT OF MEMORY 77.96 49.20 None uthash-2.0.2/uthash_BER_nondet_test1-1.yml TIMEOUT 300.22 270.56 None uthash-2.0.2/uthash_BER_nondet_test1-2.yml TIMEOUT 301.07 279.99 None uthash-2.0.2/uthash_BER_nondet_test2-1.yml TIMEOUT 300.22 270.73 None uthash-2.0.2/uthash_BER_nondet_test2-2.yml TIMEOUT 300.10 277.41 None uthash-2.0.2/uthash_BER_nondet_test3-1.yml TIMEOUT 300.11 276.87 None goblint-coreutils/instrumented_cksum_comb.yml ERROR (7) 75.32 59.04 None goblint-coreutils/instrumented_cp_comb.yml ERROR (7) 95.39 78.37 None goblint-coreutils/instrumented_cut_comb.yml ERROR (7) 75.62 59.46 None goblint-coreutils/instrumented_dd_comb.yml ERROR (7) 77.20 59.83 None goblint-coreutils/instrumented_df_comb.yml ERROR (7) 85.91 69.22 None list-properties/alternating_list-1.yml TIMEOUT 301.08 264.51 None list-properties/list-1.yml unknown 25.45 16.70 None ldv-races/race-1_1-join.yml true 14.16 8.26 None ldv-races/race-1_2-join.yml unknown 25.87 16.20 None ldv-races/race-1_3-join.yml unknown 27.41 17.20 None termination-recursive-malloc/chunk1-2.yml unknown 15.77 9.59 None termination-recursive-malloc/insertionSort_recursive.yml true 30.34 19.18 None termination-dietlibc/basename-3.yml TIMEOUT 301.20 283.98 None ldv-linux-3.16-rc1/205_9a_array_unsafes_linux-3.16-rc1.tar.xz-205_9a-drivers--net--ieee802154--mrf24j40.ko-entry_point.cil.out.yml ERROR (7) 19.23 10.84 None memsafety-ext2/complex_data_creation_test01-1.yml TIMEOUT 301.03 287.80 None memsafety-ext2/complex_data_creation_test02-2.yml TIMEOUT 301.04 282.83 None memsafety-ext2/length_test03-1.yml TIMEOUT 300.99 261.19 None ntdrivers/floppy2.i.cil.yml ERROR (7) 18.98 10.94 None pthread-ext/01b_inc-pthread.yml OUT OF MEMORY 60.54 38.74 None pthread-ext/01b_inc.yml OUT OF MEMORY 60.25 38.97 None pthread-ext/02_inc_cas.yml OUT OF MEMORY 51.32 33.69 None pthread-ext/03_incdec-pthread.yml OUT OF MEMORY 61.05 38.55 None termination-crafted/2Nested-1.yml true 8.53 5.16 None termination-crafted/4BitCounterPointer.yml true 15.72 8.96 None termination-crafted/4NestedWith3Variables-1.yml true 8.84 5.33 None ldv-linux-3.0/module_get_put-drivers-block-loop.ko.cil.out.yml TIMEOUT 300.35 270.90 None ldv-linux-3.14/linux-3.14_complex_emg_linux-alloc-spinlock_drivers-media-pci-saa7164-saa7164.cil.yml ERROR (7) 24.12 13.83 None list-simple/dll2c_append_equal.yml TIMEOUT 300.44 266.87 None list-simple/dll2c_append_unequal.yml TIMEOUT 300.34 267.13 None list-simple/dll2c_insert_equal.yml TIMEOUT 300.77 260.82 None list-simple/dll2c_insert_unequal.yml TIMEOUT 301.04 247.73 None list-simple/dll2c_prepend_equal.yml TIMEOUT 300.52 252.20 None termination-memory-alloca/a.01-alloca.yml true 11.80 6.95 None termination-memory-alloca/a.04-alloca.yml true 11.30 6.41 None termination-memory-alloca/a.05-alloca.yml true 11.50 6.62 None termination-memory-alloca/a.06-alloca.yml true 17.41 9.62 None termination-memory-alloca/a.07-alloca.yml true 12.27 6.98 None loop-acceleration/array_1-2.yml true 18.83 12.57 None busybox-1.22.0/basename-1.yml unknown 146.32 128.22 None busybox-1.22.0/basename-2.yml TIMEOUT 300.38 266.00 None busybox-1.22.0/chgrp-incomplete-1.yml TIMEOUT 300.31 275.18 None ldv-linux-4.2-rc1/linux-4.2-rc1.tar.xz-08_1a-drivers--block--loop.ko-entry_point.cil.out.yml TIMEOUT 300.64 270.04 None pthread-atomic/dekker.yml true 13.91 8.03 None pthread-atomic/lamport.yml true 21.89 12.47 None loop-industry-pattern/aiob_4.c.v+cfa-reducer.yml true 28.06 16.09 None loop-industry-pattern/aiob_4.c.v+lhb-reducer.yml true 81.56 53.53 None loops/array-1.yml true 13.98 8.51 None loops/bubble_sort-1.yml unknown 14.06 8.39 None weaver/array-eq-symm.wvr.yml TIMEOUT 300.57 281.21 None weaver/array-eq-trans.wvr.yml OUT OF MEMORY 197.30 167.80 None weaver/bench-exp1x3.wvr.yml TIMEOUT 301.03 284.95 None weaver/bench-exp2x3.wvr.yml TIMEOUT 300.19 280.09 None weaver/bench-exp2x4.wvr.yml TIMEOUT 300.60 279.91 None locks/test_locks_10.yml true 16.34 9.42 None locks/test_locks_11.yml true 21.47 12.22 None locks/test_locks_12.yml true 27.79 15.95 None locks/test_locks_13.yml true 42.40 26.74 None locks/test_locks_14-1.yml OUT OF MEMORY 56.81 35.73 None ldv-validator-v0.8/linux-stable-063f96c-1-144_1a-drivers--mmc--host--vub300.ko.unsigned-entry_point_ldv-val-v0.8.cil.out.yml ERROR (7) 17.95 10.39 None list-ext-properties/960521-1_1-1.yml false(valid-deref) 14.74 8.73 None list-ext-properties/960521-1_1-2.yml true 48.20 32.82 None list-ext-properties/960521-1_1-3.yml false(valid-free) 20.81 12.68 None list-ext-properties/list-ext_1.yml TIMEOUT 300.49 269.30 None list-ext-properties/list-ext_2.yml unknown 27.81 17.61 None memory-alloca/c.03-alloca-2.yml true 12.15 7.11 None pthread-memsafety/fillarray1.yml false(valid-deref) 21.14 13.19 None pthread-memsafety/fillarray.yml false(valid-deref) 21.43 14.02 None pthread-memsafety/list1.yml unknown 83.55 67.62 None pthread-wmm/mix000.oepc.yml unknown 32.94 20.20 None pthread-wmm/mix000.opt.yml unknown 34.62 21.14 None pthread-wmm/mix001.oepc.yml unknown 71.05 40.20 None pthread-wmm/mix001.opt.yml unknown 47.43 28.43 None pthread-wmm/mix002.oepc.yml OUT OF MEMORY 75.29 52.59 None array-memsafety/add_last_unsafe.yml false(valid-deref) 13.58 7.64 None array-memsafety/array01-alloca-2.yml TIMEOUT 300.15 279.57 None array-memsafety/array02-alloca-2.yml TIMEOUT 300.06 286.46 None pthread/bigshot_s2.yml unknown 182.02 152.69 None pthread/bigshot_s.yml TIMEOUT 300.97 267.93 None pthread/fib_safe-10.yml OUT OF MEMORY 184.25 147.11 None list-ext3-properties/dll_circular_traversal-1.yml TIMEOUT 300.74 258.85 None list-ext3-properties/dll_circular_traversal-2.yml TIMEOUT 300.28 273.94 None list-ext3-properties/dll_nondet_free_order-1.yml TIMEOUT 300.11 276.79 None list-ext3-properties/dll_nondet_free_order-2.yml unknown 107.15 84.71 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-1.yml ERROR (7) 21.52 12.27 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-2.yml ERROR (7) 22.05 12.74 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--nsc-ircc.ko.cil.yml OUT OF MEMORY 103.19 66.73 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--w83977af_ir.ko.cil.yml OUT OF MEMORY 90.77 55.89 None ldv-linux-3.14-races/linux-3.14--drivers--spi--spi-tegra20-slink.ko.cil.yml ERROR (7) 21.93 12.74 None array-memsafety-realloc/array-realloc-1.yml false(valid-free) 24.54 17.18 None array-memsafety-realloc/array-realloc-2.yml TIMEOUT 301.02 285.86 None array-memsafety-realloc/array-realloc-3.yml unknown 18.06 11.89 None pthread-C-DAC/pthread-demo-datarace-1.yml OUT OF MEMORY 247.69 216.90 None pthread-C-DAC/pthread-demo-datarace-3.yml unknown 52.62 32.91 None pthread-C-DAC/pthread-finding-k-matches.yml unknown 16.49 9.82 None pthread-C-DAC/pthread-numerical-integration.yml unknown 16.49 9.79 None pthread-driver-races/char_generic_nvram_nvram_unlocked_ioctl_write_nvram.yml ERROR (7) 23.26 14.12 None pthread-driver-races/char_generic_nvram_read_nvram_nvram_unlocked_ioctl.yml ERROR (7) 21.59 13.57 None ldv-memsafety-bitfields/test-bitfields-1-1.yml ERROR (7) 14.54 8.93 None ldv-memsafety-bitfields/test-bitfields-1-2.yml ERROR (7) 15.15 9.11 None ldv-memsafety-bitfields/test-bitfields-2.1-1.yml ERROR (7) 14.36 8.62 None ldv-memsafety-bitfields/test-bitfields-2.1-2.yml ERROR (7) 14.33 8.67 None ldv-memsafety-bitfields/test-bitfields-2-1.yml ERROR (7) 13.92 8.51 None coreutils-v8.31/comm_3args_klee-sa_ko_243_infer_nd.yml TIMEOUT 300.75 255.73 None coreutils-v8.31/comm_3args_klee-sa_ko_243_infer_uaf.yml TIMEOUT 300.41 230.49 None coreutils-v8.31/comm_3args_ok.yml TIMEOUT 301.20 263.52 None coreutils-v8.31/csplit_3args_klee-sa_ko_1318-1332_csa_nd.yml TIMEOUT 301.11 273.59 None coreutils-v8.31/csplit_3args_klee-sa_ko_1318-1332_csa_uaf.yml TIMEOUT 300.51 268.46 None --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 2 done 23875.75 1601.46 - Statistics: 350 Files correct: 100 correct true: 70 correct false: 30 incorrect: 6 incorrect true: 6 incorrect false: 0 unknown: 244 Score: -22 (max: 582)