BENCHMARK INFORMATION benchmark definition: ../benchexec/student-arraydomain-essential.xml name: student-arraydomain-essential run sets: Taipan EXP+CONG.Array-Boogie, Taipan Array-OCT.Array-Boogie, AbsInt EXP+CONG.Array-Boogie, AbsInt OCT+CONG.Array-Boogie, AbsInt OCT.Array-Boogie, AbsInt Array-EXP+CONG.Array-Boogie, AbsInt Array-OCT+CONG.Array-Boogie, AbsInt Array-OCT.Array-Boogie date: Mon, 2018-12-17 14:12:11 CET tool: ULTIMATE Automizer 0.1.24-c30ebe19 tool executable: ./Ultimate.py options: -ea parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: struebli os: Linux-4.16.18-gentoo-x86_64-AMD_EPYC_7351P_16-Core_Processor-with-gentoo-2.4.1 cpu: AMD EPYC 7351P 16-Core Processor - cores: 32 - max frequency: 2400.0 MHz ram: 135158.484992 MB ------------------------------------------------------------ Taipan EXP+CONG.Array-Boogie Run set 1 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AutomizerBplInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_compound_exp_cong.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl TIMEOUT 900.89 779.26 None real-life/GuiTestExample.bpl FALSE 29.32 17.98 None real-life/GuiTestExampleUnsafe.bpl FALSE 31.95 20.33 None 20170304-DifficultPathPrograms/array1.i_3.bpl TIMEOUT 900.06 750.10 None 20170304-DifficultPathPrograms/array2.i_3.bpl TIMEOUT 901.14 754.30 None 20170304-DifficultPathPrograms/array3.i_4.bpl TIMEOUT 901.14 761.34 None 20170304-DifficultPathPrograms/array4.i_4.bpl ERROR: EXCEPTION 282.74 224.93 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 10.64 6.02 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TRUE 15.08 8.20 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl ERROR: EXCEPTION 10.72 5.90 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl ERROR: EXCEPTION 9.79 5.73 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 12.15 6.81 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl TIMEOUT 901.11 772.78 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl TRUE 15.82 8.85 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl TRUE 18.52 10.24 None 20170304-DifficultPathPrograms/matrix.i_4.bpl TRUE 16.03 9.02 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl TRUE 11.16 6.21 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 16.52 9.49 None 20170304-DifficultPathPrograms/string.i_3.bpl UNKNOWN: OverapproxCex 14.42 8.31 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl TRUE 13.71 7.77 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 14.32 8.02 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl FALSE 12.95 7.31 None 20170304-DifficultPathPrograms/vogal.i_5.bpl ERROR: EXCEPTION 10.71 6.28 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl ERROR: EXCEPTION 136.10 125.49 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.95 777.22 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TRUE 10.41 5.82 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 9.70 5.51 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TRUE 14.24 8.40 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl OUT OF MEMORY 135.44 142.78 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 11.10 6.17 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 9.08 5.21 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 8.15 4.63 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 8.44 4.69 None toy/tooDifficultLoopInvariant/Sandman01.bpl OUT OF MEMORY 147.53 135.78 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 13.37 7.79 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl TRUE 14.45 9.43 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.78 2.56 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 1 done 3548.90 795.16 - Taipan Array-OCT.Array-Boogie Run set 2 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AutomizerBplInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_array_oct.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl TIMEOUT 900.87 782.22 None real-life/GuiTestExample.bpl FALSE 28.60 17.71 None real-life/GuiTestExampleUnsafe.bpl FALSE 29.79 18.21 None 20170304-DifficultPathPrograms/array1.i_3.bpl TIMEOUT 901.16 756.33 None 20170304-DifficultPathPrograms/array2.i_3.bpl TIMEOUT 901.19 754.33 None 20170304-DifficultPathPrograms/array3.i_4.bpl TIMEOUT 900.93 765.85 None 20170304-DifficultPathPrograms/array4.i_4.bpl ERROR: EXCEPTION 435.08 363.87 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 64.34 45.17 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TIMEOUT 900.69 868.12 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TIMEOUT 900.67 868.93 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl ERROR: EXCEPTION 117.42 95.02 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 49.33 37.69 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl ERROR: EXCEPTION 393.38 349.93 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl OUT OF MEMORY 207.00 146.35 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl OUT OF MEMORY 209.93 154.27 None 20170304-DifficultPathPrograms/matrix.i_4.bpl TIMEOUT 901.10 819.51 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl OUT OF MEMORY 166.71 129.05 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 76.34 56.09 None 20170304-DifficultPathPrograms/string.i_3.bpl ERROR: EXCEPTION 100.78 81.92 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl ERROR: EXCEPTION 36.55 23.30 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl OUT OF MEMORY 176.42 134.12 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl OUT OF MEMORY 217.05 148.37 None 20170304-DifficultPathPrograms/vogal.i_5.bpl OUT OF MEMORY 217.31 158.59 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl ERROR: EXCEPTION 102.47 83.50 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 901.03 770.17 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl ERROR: EXCEPTION 18.37 10.47 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl ERROR: EXCEPTION 11.48 6.41 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TRUE 38.16 23.99 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl ERROR: EXCEPTION 11.96 6.62 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 9.93 5.47 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 9.41 5.36 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 8.45 4.72 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 7.99 4.53 None toy/tooDifficultLoopInvariant/Sandman01.bpl OUT OF MEMORY 137.00 122.33 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 42.31 25.91 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl TRUE 16.52 10.54 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.43 2.41 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 2 done 6516.07 948.59 - AbsInt EXP+CONG.Array-Boogie Run set 3 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_compound_exp_cong.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl unknown 6.16 3.50 None real-life/GuiTestExample.bpl ERROR: EXCEPTION 11.02 6.09 None real-life/GuiTestExampleUnsafe.bpl ERROR: EXCEPTION 10.31 6.17 None 20170304-DifficultPathPrograms/array1.i_3.bpl unknown 6.26 3.73 None 20170304-DifficultPathPrograms/array2.i_3.bpl unknown 6.11 3.48 None 20170304-DifficultPathPrograms/array3.i_4.bpl unknown 6.79 3.78 None 20170304-DifficultPathPrograms/array4.i_4.bpl unknown 6.40 3.83 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 6.31 3.94 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl unknown 7.14 4.15 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TRUE 6.35 3.58 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl unknown 7.31 4.20 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 6.35 3.56 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl unknown 6.55 3.88 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl unknown 7.26 3.99 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl unknown 7.16 4.19 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 6.58 3.69 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl unknown 7.11 3.95 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl unknown 6.27 4.14 None 20170304-DifficultPathPrograms/string.i_3.bpl unknown 6.72 3.78 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl unknown 6.78 3.81 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl unknown 7.26 4.02 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl unknown 7.01 3.92 None 20170304-DifficultPathPrograms/vogal.i_5.bpl unknown 7.25 4.48 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl unknown 6.16 3.50 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 7.75 4.35 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl unknown 6.25 3.52 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl unknown 6.29 3.53 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 6.11 3.44 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl unknown 6.02 3.37 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 6.19 3.49 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 5.88 3.28 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 5.99 3.57 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 5.68 3.21 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 5.70 3.25 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 6.33 3.55 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl unknown 6.61 3.67 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.39 2.37 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 3 done 247.97 12.12 - AbsInt OCT+CONG.Array-Boogie Run set 4 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_compound_oct_cong.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl unknown 6.69 3.76 None real-life/GuiTestExample.bpl ERROR: EXCEPTION 10.91 6.28 None real-life/GuiTestExampleUnsafe.bpl ERROR: EXCEPTION 9.76 5.51 None 20170304-DifficultPathPrograms/array1.i_3.bpl unknown 6.74 3.95 None 20170304-DifficultPathPrograms/array2.i_3.bpl unknown 6.88 3.84 None 20170304-DifficultPathPrograms/array3.i_4.bpl unknown 7.30 4.28 None 20170304-DifficultPathPrograms/array4.i_4.bpl unknown 7.97 4.57 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 6.52 3.62 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl unknown 8.07 4.36 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TRUE 6.87 3.78 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl unknown 9.07 4.95 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 7.52 4.30 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl unknown 12.45 6.68 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl unknown 31.08 20.82 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl unknown 34.48 23.49 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 7.37 4.02 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl unknown 10.45 5.61 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl unknown 8.02 4.43 None 20170304-DifficultPathPrograms/string.i_3.bpl unknown 7.87 4.27 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl unknown 9.69 5.27 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 8.42 4.55 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl unknown 12.24 6.63 None 20170304-DifficultPathPrograms/vogal.i_5.bpl unknown 43.50 23.61 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl unknown 6.90 3.87 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 10.82 5.84 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl unknown 6.94 3.90 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 6.85 3.87 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 6.53 3.70 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl unknown 6.06 3.42 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 6.25 3.54 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 6.08 3.45 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 5.91 3.33 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 5.64 3.19 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 6.12 3.44 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 6.88 3.80 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl unknown 6.17 3.48 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.23 2.28 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 4 done 371.35 28.64 - AbsInt OCT.Array-Boogie Run set 5 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_oct.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl unknown 6.95 3.86 None real-life/GuiTestExample.bpl ERROR: EXCEPTION 10.15 5.80 None real-life/GuiTestExampleUnsafe.bpl ERROR: EXCEPTION 10.53 6.11 None 20170304-DifficultPathPrograms/array1.i_3.bpl unknown 6.56 3.67 None 20170304-DifficultPathPrograms/array2.i_3.bpl unknown 6.54 3.83 None 20170304-DifficultPathPrograms/array3.i_4.bpl unknown 7.36 4.05 None 20170304-DifficultPathPrograms/array4.i_4.bpl unknown 7.53 4.34 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 7.97 4.34 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl unknown 7.34 4.29 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TRUE 6.63 3.67 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl unknown 8.93 5.18 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 7.20 4.03 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl unknown 11.32 6.11 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl unknown 28.64 20.15 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl unknown 31.53 22.28 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 9.91 5.39 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl unknown 9.34 5.04 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl unknown 7.74 4.29 None 20170304-DifficultPathPrograms/string.i_3.bpl unknown 7.31 4.05 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl unknown 9.33 5.07 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 8.64 4.78 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl unknown 9.09 5.17 None 20170304-DifficultPathPrograms/vogal.i_5.bpl unknown 39.98 22.07 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl unknown 6.79 3.76 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 9.55 5.26 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl unknown 6.57 3.68 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 7.32 4.09 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 6.71 3.76 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl unknown 5.93 3.35 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 6.32 3.53 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 6.12 3.45 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 5.89 3.53 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 6.01 3.38 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 6.25 3.47 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 6.85 3.83 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl unknown 6.61 3.65 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.65 2.50 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 5 done 358.23 26.94 - AbsInt Array-EXP+CONG.Array-Boogie Run set 6 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_array_compound_exp_cong.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl unknown 8.93 5.17 None real-life/GuiTestExample.bpl ERROR: EXCEPTION 10.06 5.68 None real-life/GuiTestExampleUnsafe.bpl ERROR: EXCEPTION 10.52 6.13 None 20170304-DifficultPathPrograms/array1.i_3.bpl unknown 9.86 5.60 None 20170304-DifficultPathPrograms/array2.i_3.bpl unknown 7.23 4.13 None 20170304-DifficultPathPrograms/array3.i_4.bpl unknown 8.81 5.11 None 20170304-DifficultPathPrograms/array4.i_4.bpl unknown 13.91 8.32 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 6.91 3.92 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl unknown 863.28 794.03 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TRUE 108.50 94.14 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl ERROR: EXCEPTION 20.57 12.56 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 8.36 4.70 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl unknown 13.06 7.26 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl unknown 54.40 38.93 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl unknown 50.53 36.14 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 8.28 4.60 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl unknown 48.26 32.11 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl unknown 10.27 5.77 None 20170304-DifficultPathPrograms/string.i_3.bpl ERROR: EXCEPTION 10.31 5.73 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl unknown 13.51 7.74 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl unknown 44.53 30.00 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl unknown 67.74 48.63 None 20170304-DifficultPathPrograms/vogal.i_5.bpl unknown 101.47 82.01 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl unknown 15.68 9.89 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 8.49 4.74 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl unknown 7.73 4.38 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl unknown 6.45 3.71 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 7.32 4.13 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl unknown 6.64 3.77 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 6.30 3.54 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 6.04 3.40 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 5.94 3.36 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 6.02 3.37 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 6.40 3.65 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 10.55 6.01 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl unknown 6.89 4.04 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.76 2.55 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 6 done 1603.60 794.45 - AbsInt Array-OCT+CONG.Array-Boogie Run set 7 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_array_compound_oct_cong.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl unknown 45.24 28.18 None real-life/GuiTestExample.bpl ERROR: EXCEPTION 9.79 5.53 None real-life/GuiTestExampleUnsafe.bpl ERROR: EXCEPTION 10.96 6.36 None 20170304-DifficultPathPrograms/array1.i_3.bpl TIMEOUT 900.40 890.35 None 20170304-DifficultPathPrograms/array2.i_3.bpl unknown 22.94 14.56 None 20170304-DifficultPathPrograms/array3.i_4.bpl ERROR: EXCEPTION 22.55 12.58 None 20170304-DifficultPathPrograms/array4.i_4.bpl ERROR: EXCEPTION 29.78 17.96 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 17.63 9.93 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TIMEOUT 900.82 867.73 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TIMEOUT 900.92 867.47 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TIMEOUT 900.41 889.52 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 42.56 27.98 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl TIMEOUT 900.41 890.79 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl TIMEOUT 900.41 890.73 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl TIMEOUT 900.38 892.39 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 36.36 22.44 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl TIMEOUT 900.39 891.78 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TIMEOUT 900.39 890.69 None 20170304-DifficultPathPrograms/string.i_3.bpl ERROR: EXCEPTION 88.01 66.34 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl ERROR: EXCEPTION 25.52 14.32 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TIMEOUT 900.38 891.06 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl TIMEOUT 900.36 893.18 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TIMEOUT 900.43 879.71 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl TIMEOUT 900.37 891.97 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 12.06 6.44 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TIMEOUT 900.39 889.04 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 8.32 4.64 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 32.52 19.10 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl TIMEOUT 900.40 889.38 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 6.73 3.73 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 5.92 3.34 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 6.20 3.44 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 5.80 3.31 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 9.45 5.20 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 52.54 32.13 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl ERROR: EXCEPTION 9.82 5.44 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.77 2.56 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 7 done 13355.31 1763.23 - AbsInt Array-OCT.Array-Boogie Run set 8 of 8 with options '-ea -tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_array_oct.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl unknown 27.46 16.50 None real-life/GuiTestExample.bpl ERROR: EXCEPTION 11.49 6.41 None real-life/GuiTestExampleUnsafe.bpl ERROR: EXCEPTION 10.79 6.05 None 20170304-DifficultPathPrograms/array1.i_3.bpl unknown 29.67 18.67 None 20170304-DifficultPathPrograms/array2.i_3.bpl unknown 24.95 15.92 None 20170304-DifficultPathPrograms/array3.i_4.bpl unknown 70.87 55.50 None 20170304-DifficultPathPrograms/array4.i_4.bpl unknown 81.96 64.22 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 64.16 40.80 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TIMEOUT 900.85 869.62 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TIMEOUT 900.76 869.73 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TIMEOUT 900.83 846.96 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 34.28 24.00 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl ERROR: EXCEPTION 221.39 189.35 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl OUT OF MEMORY 202.76 150.41 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl OUT OF MEMORY 186.83 139.26 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 190.86 155.91 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl OUT OF MEMORY 184.66 134.49 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl unknown 46.92 32.14 None 20170304-DifficultPathPrograms/string.i_3.bpl ERROR: EXCEPTION 158.31 127.51 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl ERROR: EXCEPTION 31.94 20.11 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl OUT OF MEMORY 203.19 150.53 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl OUT OF MEMORY 206.49 157.26 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TIMEOUT 900.70 800.54 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl TRUE 119.30 99.32 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 10.38 5.75 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TRUE 12.11 6.73 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 8.09 4.53 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 28.20 17.07 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl ERROR: EXCEPTION 9.76 5.37 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 6.56 3.66 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 6.38 3.51 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl ERROR: EXCEPTION 5.97 3.33 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl ERROR: EXCEPTION 5.82 3.28 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 8.94 4.94 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 38.78 25.00 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl ERROR: EXCEPTION 9.94 5.48 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: TYPE ERROR 4.67 2.51 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 8 done 4466.36 870.62 - Statistics: 296 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 296