BENCHMARK INFORMATION benchmark definition: ../benchexec/student-arraydomain-eval.xml name: student-arraydomain-eval run sets: Automizer.Array-Boogie, Taipan OCT.Array-Boogie, Taipan Array-OCT.Array-Boogie, AbsInt Array-OCT.Array-Boogie date: Mon, 2019-03-04 16:23:44 CET tool: ULTIMATE Automizer 0.1.24-1ae3202c tool executable: ./Ultimate.py options: parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: struebli os: Linux-4.20.1-gentoo-x86_64-AMD_EPYC_7351P_16-Core_Processor-with-gentoo-2.6 cpu: AMD EPYC 7351P 16-Core Processor - cores: 32 - max frequency: 2400.0 MHz - turbo boost enabled: True ram: 135155.56863999998 MB ------------------------------------------------------------ Automizer.Array-Boogie Run set 1 of 4 with options '-tc ../../../trunk/examples/toolchains/AutomizerBplInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_camel.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/GuiTestExample.bpl FALSE 11.31 6.32 None real-life/GuiTestExampleUnsafe.bpl FALSE 14.53 7.86 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 8.09 4.65 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TRUE 12.91 7.44 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 7.26 4.04 None 20170304-DifficultPathPrograms/matrix.i_4.bpl TRUE 9.80 5.49 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 9.84 5.63 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl TRUE 9.21 5.14 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 9.05 5.11 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl FALSE 8.38 4.99 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TRUE 10.19 5.89 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl ERROR: EXCEPTION 104.46 96.29 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.73 785.35 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TRUE 7.25 4.08 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 7.60 4.31 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TRUE 8.83 4.87 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl TIMEOUT 901.02 768.62 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl TIMEOUT 901.08 770.53 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl TRUE 587.75 492.62 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl TRUE 527.45 440.16 None toy/tooDifficultLoopInvariant/Sandman01.bpl TIMEOUT 900.95 765.58 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 11.17 6.23 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl TRUE 9.80 5.58 None heapseparator/speedup-poc-dd-1-limited.bpl TRUE 6.61 3.78 None heapseparator/speedup-poc-dd-1-unlimited.bpl TRUE 7.32 3.96 None heapseparator/speedup-poc-dd-10-limited.bpl ERROR: EXCEPTION 38.67 33.30 None heapseparator/speedup-poc-dd-10-unlimited.bpl ERROR: EXCEPTION 35.92 29.93 None heapseparator/speedup-poc-dd-2-limited.bpl TRUE 13.49 7.94 None heapseparator/speedup-poc-dd-2-unlimited.bpl TRUE 12.50 7.38 None heapseparator/speedup-poc-dd-3-limited.bpl TRUE 32.13 19.79 None heapseparator/speedup-poc-dd-3-unlimited.bpl TRUE 27.45 16.99 None heapseparator/speedup-poc-dd-4-limited.bpl TRUE 106.32 76.09 None heapseparator/speedup-poc-dd-4-unlimited.bpl TRUE 121.43 88.95 None heapseparator/speedup-poc-dd-5-limited.bpl TRUE 434.43 378.28 None heapseparator/speedup-poc-dd-5-unlimited.bpl TIMEOUT 900.86 839.31 None heapseparator/speedup-poc-dd-6-limited.bpl ERROR: EXCEPTION 91.20 82.01 None heapseparator/speedup-poc-dd-6-unlimited.bpl TIMEOUT 900.66 832.46 None heapseparator/speedup-poc-dd-7-limited.bpl ERROR: EXCEPTION 215.55 205.67 None heapseparator/speedup-poc-dd-7-unlimited.bpl ERROR: EXCEPTION 175.12 140.68 None heapseparator/speedup-poc-dd-8-limited.bpl ERROR: EXCEPTION 38.42 33.42 None heapseparator/speedup-poc-dd-8-unlimited.bpl ERROR: EXCEPTION 91.72 80.86 None heapseparator/speedup-poc-dd-9-limited.bpl ERROR: EXCEPTION 36.96 32.03 None heapseparator/speedup-poc-dd-9-unlimited.bpl ERROR: EXCEPTION 57.15 49.10 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 1 done 5968.65 872.10 - Taipan OCT.Array-Boogie Run set 2 of 4 with options '-tc ../../../trunk/examples/toolchains/AutomizerBplInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_oct.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/GuiTestExample.bpl FALSE 12.06 6.64 None real-life/GuiTestExampleUnsafe.bpl FALSE 11.24 6.33 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 8.91 4.99 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TRUE 17.55 10.00 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 8.51 4.95 None 20170304-DifficultPathPrograms/matrix.i_4.bpl TRUE 11.80 6.61 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 11.26 6.44 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl TRUE 10.61 5.87 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 11.61 6.39 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl FALSE 9.57 5.37 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TRUE 16.85 9.12 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl ERROR: EXCEPTION 124.82 116.14 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.66 782.98 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TRUE 8.04 4.46 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 7.03 4.01 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TRUE 10.54 6.08 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl TIMEOUT 900.68 840.25 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl TIMEOUT 901.01 773.93 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl TRUE 829.62 700.27 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl TRUE 828.89 699.40 None toy/tooDifficultLoopInvariant/Sandman01.bpl TIMEOUT 900.24 824.30 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 10.44 5.97 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl TRUE 10.46 5.85 None heapseparator/speedup-poc-dd-1-limited.bpl TRUE 6.76 3.88 None heapseparator/speedup-poc-dd-1-unlimited.bpl TRUE 6.91 3.90 None heapseparator/speedup-poc-dd-10-limited.bpl ERROR: EXCEPTION 36.49 31.08 None heapseparator/speedup-poc-dd-10-unlimited.bpl ERROR: EXCEPTION 35.67 29.94 None heapseparator/speedup-poc-dd-2-limited.bpl TRUE 12.32 7.27 None heapseparator/speedup-poc-dd-2-unlimited.bpl TRUE 12.63 7.43 None heapseparator/speedup-poc-dd-3-limited.bpl TRUE 26.93 16.61 None heapseparator/speedup-poc-dd-3-unlimited.bpl TRUE 25.84 16.07 None heapseparator/speedup-poc-dd-4-limited.bpl TRUE 110.93 81.65 None heapseparator/speedup-poc-dd-4-unlimited.bpl TRUE 125.77 93.89 None heapseparator/speedup-poc-dd-5-limited.bpl TRUE 693.72 629.14 None heapseparator/speedup-poc-dd-5-unlimited.bpl TIMEOUT 900.14 845.12 None heapseparator/speedup-poc-dd-6-limited.bpl ERROR: EXCEPTION 93.15 83.62 None heapseparator/speedup-poc-dd-6-unlimited.bpl ERROR: EXCEPTION 384.21 334.72 None heapseparator/speedup-poc-dd-7-limited.bpl ERROR: EXCEPTION 265.81 256.10 None heapseparator/speedup-poc-dd-7-unlimited.bpl ERROR: EXCEPTION 164.39 131.41 None heapseparator/speedup-poc-dd-8-limited.bpl ERROR: EXCEPTION 38.90 33.81 None heapseparator/speedup-poc-dd-8-unlimited.bpl ERROR: EXCEPTION 184.30 146.88 None heapseparator/speedup-poc-dd-9-limited.bpl ERROR: EXCEPTION 37.50 32.16 None heapseparator/speedup-poc-dd-9-unlimited.bpl ERROR: EXCEPTION 57.10 49.08 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 2 done 6433.99 875.01 - Taipan Array-OCT.Array-Boogie Run set 3 of 4 with options '-tc ../../../trunk/examples/toolchains/AutomizerBplInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_array_oct.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/GuiTestExample.bpl FALSE 11.56 6.52 None real-life/GuiTestExampleUnsafe.bpl FALSE 11.70 6.82 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 12.57 6.82 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TRUE 24.65 12.85 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 10.61 5.80 None 20170304-DifficultPathPrograms/matrix.i_4.bpl TRUE 39.12 21.90 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 15.51 8.73 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl TRUE 19.65 10.41 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 47.92 34.84 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl FALSE 143.66 127.20 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TIMEOUT 900.58 866.22 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl TRUE 11.91 6.54 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.87 782.28 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TRUE 8.29 4.58 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 8.02 4.52 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TRUE 13.13 7.35 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl TRUE 11.80 6.37 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl TIMEOUT 901.02 763.99 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl TRUE 872.90 732.70 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl TRUE 832.47 700.13 None toy/tooDifficultLoopInvariant/Sandman01.bpl TIMEOUT 900.83 821.97 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 13.88 7.66 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl TRUE 10.79 6.04 None heapseparator/speedup-poc-dd-1-limited.bpl TRUE 15.13 8.02 None heapseparator/speedup-poc-dd-1-unlimited.bpl TRUE 15.12 8.01 None heapseparator/speedup-poc-dd-10-limited.bpl TIMEOUT 900.54 868.86 None heapseparator/speedup-poc-dd-10-unlimited.bpl ERROR: EXCEPTION 39.67 32.26 None heapseparator/speedup-poc-dd-2-limited.bpl TRUE 31.94 18.70 None heapseparator/speedup-poc-dd-2-unlimited.bpl TRUE 25.16 13.88 None heapseparator/speedup-poc-dd-3-limited.bpl TRUE 113.60 84.78 None heapseparator/speedup-poc-dd-3-unlimited.bpl TRUE 38.31 22.40 None heapseparator/speedup-poc-dd-4-limited.bpl ERROR: EXCEPTION 217.64 179.21 None heapseparator/speedup-poc-dd-4-unlimited.bpl TRUE 152.66 113.27 None heapseparator/speedup-poc-dd-5-limited.bpl ERROR: EXCEPTION 55.02 36.05 None heapseparator/speedup-poc-dd-5-unlimited.bpl TIMEOUT 900.93 836.46 None heapseparator/speedup-poc-dd-6-limited.bpl ERROR: EXCEPTION 108.26 85.91 None heapseparator/speedup-poc-dd-6-unlimited.bpl TIMEOUT 900.84 823.67 None heapseparator/speedup-poc-dd-7-limited.bpl ERROR: EXCEPTION 338.41 311.57 None heapseparator/speedup-poc-dd-7-unlimited.bpl ERROR: EXCEPTION 105.56 83.71 None heapseparator/speedup-poc-dd-8-limited.bpl TIMEOUT 900.70 860.83 None heapseparator/speedup-poc-dd-8-unlimited.bpl ERROR: EXCEPTION 204.00 159.17 None heapseparator/speedup-poc-dd-9-limited.bpl TIMEOUT 900.54 869.59 None heapseparator/speedup-poc-dd-9-unlimited.bpl ERROR: EXCEPTION 68.22 56.02 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 3 done 9874.35 1081.73 - AbsInt Array-OCT.Array-Boogie Run set 4 of 4 with options '-tc ../../../trunk/examples/toolchains/AbstractInterpretationInline.xml -s ../../../trunk/examples/settings/ai/array-bench/reach_32bit_array_oct.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/GuiTestExample.bpl unknown 10.74 5.89 None real-life/GuiTestExampleUnsafe.bpl unknown 10.53 5.72 None 20170304-DifficultPathPrograms/array.i_3.bpl unknown 9.41 5.11 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TRUE 16.53 8.88 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl unknown 7.88 4.48 None 20170304-DifficultPathPrograms/matrix.i_4.bpl unknown 37.39 21.91 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl unknown 8.94 4.75 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl unknown 15.53 8.13 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl unknown 35.83 22.27 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl unknown 150.65 131.96 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TIMEOUT 900.61 862.45 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl TRUE 11.45 6.08 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl unknown 5.93 3.35 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TRUE 6.32 3.59 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 5.40 3.08 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl unknown 7.41 3.97 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl TRUE 10.19 5.47 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl unknown 70.74 52.54 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl unknown 34.21 21.05 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl unknown 26.40 14.46 None toy/tooDifficultLoopInvariant/Sandman01.bpl unknown 6.01 3.37 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl unknown 11.63 6.08 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl unknown 6.31 3.50 None heapseparator/speedup-poc-dd-1-limited.bpl TRUE 16.97 8.81 None heapseparator/speedup-poc-dd-1-unlimited.bpl TRUE 19.30 10.02 None heapseparator/speedup-poc-dd-10-limited.bpl TIMEOUT 900.60 871.78 None heapseparator/speedup-poc-dd-10-unlimited.bpl unknown 12.03 6.36 None heapseparator/speedup-poc-dd-2-limited.bpl TRUE 32.75 19.68 None heapseparator/speedup-poc-dd-2-unlimited.bpl unknown 8.17 4.34 None heapseparator/speedup-poc-dd-3-limited.bpl TRUE 37.66 25.94 None heapseparator/speedup-poc-dd-3-unlimited.bpl unknown 8.46 4.57 None heapseparator/speedup-poc-dd-4-limited.bpl TRUE 117.77 98.25 None heapseparator/speedup-poc-dd-4-unlimited.bpl unknown 11.15 5.91 None heapseparator/speedup-poc-dd-5-limited.bpl TRUE 203.96 184.54 None heapseparator/speedup-poc-dd-5-unlimited.bpl unknown 9.37 5.05 None heapseparator/speedup-poc-dd-6-limited.bpl TRUE 352.77 330.66 None heapseparator/speedup-poc-dd-6-unlimited.bpl unknown 9.96 5.35 None heapseparator/speedup-poc-dd-7-limited.bpl TRUE 238.23 217.72 None heapseparator/speedup-poc-dd-7-unlimited.bpl unknown 10.52 5.66 None heapseparator/speedup-poc-dd-8-limited.bpl TIMEOUT 900.55 871.02 None heapseparator/speedup-poc-dd-8-unlimited.bpl unknown 13.18 7.01 None heapseparator/speedup-poc-dd-9-limited.bpl TIMEOUT 900.55 872.10 None heapseparator/speedup-poc-dd-9-unlimited.bpl unknown 14.01 7.40 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 4 done 5223.28 900.46 - Statistics: 172 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 172