BENCHMARK INFORMATION benchmark definition: ../benchexec/equality-cav18-rreach-heapsep-32.xml name: equality-cav18-rreach-heapsep-32 run sets: Automizer.32bitMem, AutomizerHeapSep.32bitMem, HeapSep.32bitMem date: Wed, 2018-01-31 08:14:09 CET tool: ULTIMATE Automizer 0.1.23-5f7ec6ee tool executable: ./Ultimate.py options: --generate-csv --csv-dir ../../../releaseScripts/default/UAutomizer-linux/csv resource limits: - memory: 6000.0 MB - time: 180 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 6000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: alex_server os: Linux-4.14.13-1-ARCH-x86_64-with-arch cpu: Intel Xeon CPU E3-1225 v3 @ 3.20GHz - cores: 4 - max frequency: 3600.0 MHz - turbo boost enabled: True ram: 8272.576512 MB ------------------------------------------------------------ Automizer.32bitMem Run set 1 of 3 with options '--generate-csv --csv-dir ../../../releaseScripts/default/UAutomizer-linux/csv -tc ../../../trunk/examples/toolchains/AutomizerC.xml -s ../../../trunk/examples/settings/ai/eq-bench/svcomp-Reach-32bit-Automizer_Camel+AI_EQ_SS.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------------------------------------- array-examples/data_structures_set_multi_proc_false-unreach-call_ground.i TIMEOUT (ERROR (143)) 185.68 160.18 None array-examples/data_structures_set_multi_proc_trivial_true-unreach-call_ground_true-termination.i TRUE 5.53 3.12 None array-examples/data_structures_set_multi_proc_true-unreach-call_ground.i ERROR: EXCEPTION 99.61 80.75 None array-examples/relax_true-unreach-call.i TIMEOUT (ERROR (143)) 181.06 164.59 None array-examples/sanfoundry_43_true-unreach-call_ground.i TRUE 3.38 1.90 None array-examples/standard_strcmp_true-unreach-call_ground.i TIMEOUT (ERROR (143)) 180.61 153.83 None array-industry-pattern/array_of_struct_ptr_flag_init_true-unreach-call.i TRUE 10.90 6.53 None array-industry-pattern/check_removal_from_set_after_insertion_false-unreach-call.i TIMEOUT (ERROR (143)) 180.75 147.67 None reducercommutativity/avg05_true-unreach-call_true-termination.i ERROR: EXCEPTION 39.75 26.53 None reducercommutativity/avg10_true-unreach-call_true-termination.i TIMEOUT (ERROR: EXCEPTION) 181.67 161.23 None reducercommutativity/avg20_true-unreach-call.i TIMEOUT (ERROR: EXCEPTION) 181.00 146.88 None reducercommutativity/avg40_true-unreach-call.i TIMEOUT (ERROR (143)) 185.48 160.58 None reducercommutativity/avg60_true-unreach-call.i TIMEOUT (ERROR (143)) 184.02 159.13 None reducercommutativity/avg_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 181.45 178.70 None reducercommutativity/max05_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 182.11 167.66 None reducercommutativity/max10_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 180.81 160.22 None reducercommutativity/max20_true-unreach-call.i TIMEOUT (ERROR (143)) 181.39 150.20 None reducercommutativity/max40_true-unreach-call.i TIMEOUT (ERROR (143)) 180.98 154.62 None reducercommutativity/max60_true-unreach-call.i TIMEOUT (ERROR (143)) 180.54 154.65 None reducercommutativity/max_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 183.41 169.32 None reducercommutativity/rangesum05_false-unreach-call_true-termination.i FALSE 12.28 7.08 None reducercommutativity/rangesum10_false-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 186.07 176.63 None reducercommutativity/rangesum20_false-unreach-call.i TIMEOUT (ERROR (143)) 186.17 170.71 None reducercommutativity/rangesum40_false-unreach-call.i TIMEOUT (ERROR (143)) 186.17 172.74 None reducercommutativity/rangesum60_false-unreach-call.i TIMEOUT (ERROR (143)) 186.02 179.12 None reducercommutativity/rangesum_false-unreach-call_true-termination.i FALSE 14.97 9.37 None reducercommutativity/sep05_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 182.11 164.49 None reducercommutativity/sep10_true-unreach-call.i TIMEOUT (ERROR (143)) 180.35 150.15 None reducercommutativity/sep20_true-unreach-call.i TIMEOUT (ERROR (143)) 185.85 156.58 None reducercommutativity/sep40_true-unreach-call.i TIMEOUT (ERROR (143)) 182.03 156.82 None reducercommutativity/sep60_true-unreach-call.i TIMEOUT (ERROR (143)) 180.49 157.33 None reducercommutativity/sep_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 181.78 162.38 None reducercommutativity/sum05_true-unreach-call_true-termination.i TIMEOUT (ERROR (143)) 181.52 167.20 None reducercommutativity/sum10_true-unreach-call_true-termination.i TIMEOUT (ERROR: EXCEPTION) 181.03 161.68 None reducercommutativity/sum20_true-unreach-call.i TIMEOUT (ERROR: EXCEPTION) 180.84 148.12 None reducercommutativity/sum40_true-unreach-call.i TIMEOUT (ERROR (143)) 181.81 156.26 None reducercommutativity/sum60_true-unreach-call.i TIMEOUT (ERROR (143)) 180.61 152.62 None reducercommutativity/sum_true-unreach-call_true-termination.i TIMEOUT (ERROR: EXCEPTION) 180.83 174.79 None --------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 1 done 3454.39 5152.39 - AutomizerHeapSep.32bitMem Run set 2 of 3 with options '--generate-csv --csv-dir ../../../releaseScripts/default/UAutomizer-linux/csv -tc ../../../trunk/examples/toolchains/AutomizerCTransformed.xml -s ../../../trunk/examples/settings/ai/eq-bench/svcomp-Reach-32bit-Automizer_Camel+AI_EQ_SS.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------------------------------------- array-examples/data_structures_set_multi_proc_false-unreach-call_ground.i TIMEOUT (ERROR (143)) 181.03 139.84 None array-examples/data_structures_set_multi_proc_trivial_true-unreach-call_ground_true-termination.i FALSE 24.02 12.58 None array-examples/data_structures_set_multi_proc_true-unreach-call_ground.i TIMEOUT (ERROR (143)) 180.82 143.54 None array-examples/relax_true-unreach-call.i FALSE 69.41 55.20 None array-examples/sanfoundry_43_true-unreach-call_ground.i TRUE 8.75 4.59 None array-examples/standard_strcmp_true-unreach-call_ground.i FALSE 11.05 5.76 None array-industry-pattern/array_of_struct_ptr_flag_init_true-unreach-call.i TIMEOUT (ERROR (143)) 180.92 147.37 None array-industry-pattern/check_removal_from_set_after_insertion_false-unreach-call.i FALSE 32.63 19.66 None reducercommutativity/avg05_true-unreach-call_true-termination.i FALSE 107.98 93.59 None reducercommutativity/avg10_true-unreach-call_true-termination.i FALSE 116.97 98.99 None reducercommutativity/avg20_true-unreach-call.i TIMEOUT (ERROR (143)) 182.96 158.43 None reducercommutativity/avg40_true-unreach-call.i TIMEOUT (ERROR (143)) 180.10 155.17 None reducercommutativity/avg60_true-unreach-call.i TIMEOUT (ERROR (143)) 185.95 159.90 None reducercommutativity/avg_true-unreach-call_true-termination.i FALSE 29.43 20.31 None reducercommutativity/max05_true-unreach-call_true-termination.i FALSE 111.70 95.95 None reducercommutativity/max10_true-unreach-call_true-termination.i FALSE 118.99 102.43 None reducercommutativity/max20_true-unreach-call.i TIMEOUT (ERROR (143)) 185.86 157.00 None reducercommutativity/max40_true-unreach-call.i TIMEOUT (ERROR (143)) 185.94 160.98 None reducercommutativity/max60_true-unreach-call.i TIMEOUT (ERROR (143)) 181.91 156.29 None reducercommutativity/max_true-unreach-call_true-termination.i FALSE 34.41 23.15 None reducercommutativity/rangesum05_false-unreach-call_true-termination.i FALSE 21.23 11.45 None reducercommutativity/rangesum10_false-unreach-call_true-termination.i FALSE 26.97 15.47 None reducercommutativity/rangesum20_false-unreach-call.i FALSE 52.34 36.64 None reducercommutativity/rangesum40_false-unreach-call.i TIMEOUT (ERROR (143)) 180.48 153.72 None reducercommutativity/rangesum60_false-unreach-call.i TIMEOUT (ERROR (143)) 180.54 154.39 None reducercommutativity/rangesum_false-unreach-call_true-termination.i FALSE 19.49 10.08 None reducercommutativity/sep05_true-unreach-call_true-termination.i FALSE 65.00 50.82 None reducercommutativity/sep10_true-unreach-call.i FALSE 72.07 55.84 None reducercommutativity/sep20_true-unreach-call.i FALSE 148.07 118.01 None reducercommutativity/sep40_true-unreach-call.i TIMEOUT (ERROR (143)) 185.63 156.47 None reducercommutativity/sep60_true-unreach-call.i TIMEOUT (ERROR (143)) 185.53 158.94 None reducercommutativity/sep_true-unreach-call_true-termination.i FALSE 28.29 18.95 None reducercommutativity/sum05_true-unreach-call_true-termination.i FALSE 105.84 93.36 None reducercommutativity/sum10_true-unreach-call_true-termination.i FALSE 114.80 99.83 None reducercommutativity/sum20_true-unreach-call.i TIMEOUT (ERROR (143)) 181.27 155.44 None reducercommutativity/sum40_true-unreach-call.i TIMEOUT (ERROR (143)) 181.47 156.06 None reducercommutativity/sum60_true-unreach-call.i TIMEOUT (ERROR (143)) 185.84 159.96 None reducercommutativity/sum_true-unreach-call_true-termination.i FALSE 29.74 20.35 None --------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 2 done 3609.79 3548.88 - HeapSep.32bitMem Run set 3 of 3 with options '--generate-csv --csv-dir ../../../releaseScripts/default/UAutomizer-linux/csv -tc ../../../trunk/examples/toolchains/IcfgTransformerC.xml -s ../../../trunk/examples/settings/ai/eq-bench/svcomp-Reach-32bit-Automizer_Camel+AI_EQ_SS.epf' and propertyfile 'None' inputfile status cpu time wall time host --------------------------------------------------------------------------------------------------------------------------------------------------------------- array-examples/data_structures_set_multi_proc_false-unreach-call_ground.i unknown 20.96 11.52 None array-examples/data_structures_set_multi_proc_trivial_true-unreach-call_ground_true-termination.i unknown 20.92 11.45 None array-examples/data_structures_set_multi_proc_true-unreach-call_ground.i unknown 20.53 11.37 None array-examples/relax_true-unreach-call.i unknown 72.27 57.40 None array-examples/sanfoundry_43_true-unreach-call_ground.i unknown 8.76 4.65 None array-examples/standard_strcmp_true-unreach-call_ground.i unknown 11.21 5.84 None array-industry-pattern/array_of_struct_ptr_flag_init_true-unreach-call.i unknown 24.30 13.99 None array-industry-pattern/check_removal_from_set_after_insertion_false-unreach-call.i unknown 27.09 17.17 None reducercommutativity/avg05_true-unreach-call_true-termination.i unknown 104.40 91.60 None reducercommutativity/avg10_true-unreach-call_true-termination.i unknown 103.33 91.76 None reducercommutativity/avg20_true-unreach-call.i unknown 102.63 91.27 None reducercommutativity/avg40_true-unreach-call.i unknown 101.13 89.35 None reducercommutativity/avg60_true-unreach-call.i unknown 103.41 89.65 None reducercommutativity/avg_true-unreach-call_true-termination.i unknown 29.35 20.00 None reducercommutativity/max05_true-unreach-call_true-termination.i unknown 106.27 93.54 None reducercommutativity/max10_true-unreach-call_true-termination.i unknown 107.49 94.96 None reducercommutativity/max20_true-unreach-call.i unknown 106.18 93.12 None reducercommutativity/max40_true-unreach-call.i unknown 109.29 96.14 None reducercommutativity/max60_true-unreach-call.i unknown 108.72 93.21 None reducercommutativity/max_true-unreach-call_true-termination.i unknown 31.87 22.18 None reducercommutativity/rangesum05_false-unreach-call_true-termination.i unknown 18.08 9.30 None reducercommutativity/rangesum10_false-unreach-call_true-termination.i unknown 16.39 8.77 None reducercommutativity/rangesum20_false-unreach-call.i unknown 16.79 9.02 None reducercommutativity/rangesum40_false-unreach-call.i unknown 16.53 8.89 None reducercommutativity/rangesum60_false-unreach-call.i unknown 17.00 8.79 None reducercommutativity/rangesum_false-unreach-call_true-termination.i unknown 18.18 9.38 None reducercommutativity/sep05_true-unreach-call_true-termination.i unknown 61.72 46.44 None reducercommutativity/sep10_true-unreach-call.i unknown 59.75 46.52 None reducercommutativity/sep20_true-unreach-call.i unknown 56.79 45.96 None reducercommutativity/sep40_true-unreach-call.i unknown 58.40 46.30 None reducercommutativity/sep60_true-unreach-call.i unknown 57.03 45.89 None reducercommutativity/sep_true-unreach-call_true-termination.i unknown 27.94 18.31 None reducercommutativity/sum05_true-unreach-call_true-termination.i unknown 102.70 91.43 None reducercommutativity/sum10_true-unreach-call_true-termination.i unknown 102.98 90.72 None reducercommutativity/sum20_true-unreach-call.i unknown 102.15 90.95 None reducercommutativity/sum40_true-unreach-call.i unknown 101.94 89.95 None reducercommutativity/sum60_true-unreach-call.i unknown 103.79 91.45 None reducercommutativity/sum_true-unreach-call_true-termination.i unknown 29.18 20.05 None --------------------------------------------------------------------------------------------------------------------------------------------------------------- Run set 3 done 2287.48 1883.32 - Statistics: 114 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 114