BENCHMARK INFORMATION benchmark definition: ../benchexec/student-mapelim-moniaux.xml name: student-mapelim-moniaux run sets: Automizer.Array-Boogie, Automizer+MapElim.Array-Boogie, Automizer+MapElim+LBE.Array-Boogie date: Wed, 2019-05-15 10:15:06 CEST tool: ULTIMATE Automizer 0.1.24-1c58c86c tool executable: ./Ultimate.py options: -ea parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: struebli os: Linux-4.20.1-gentoo-x86_64-AMD_EPYC_7351P_16-Core_Processor-with-gentoo-2.6 cpu: AMD EPYC 7351P 16-Core Processor - cores: 32 - max frequency: 2400.0 MHz - turbo boost enabled: True ram: 135155.56863999998 MB ------------------------------------------------------------ Automizer.Array-Boogie Run set 1 of 3 with options '-ea -tc ../../../trunk/examples/toolchains/AutomizerBplInline.xml --rcfgbuilder.size.of.a.code.block SingleStatement' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl TIMEOUT 900.94 783.79 None real-life/GuiTestExample.bpl FALSE 47.35 32.06 None real-life/GuiTestExampleUnsafe.bpl FALSE 46.16 31.53 None 20170304-DifficultPathPrograms/array1.i_3.bpl TIMEOUT 901.13 763.68 None 20170304-DifficultPathPrograms/array2.i_3.bpl TIMEOUT 901.19 764.55 None 20170304-DifficultPathPrograms/array3.i_4.bpl TIMEOUT 901.11 765.51 None 20170304-DifficultPathPrograms/array4.i_4.bpl TIMEOUT 901.16 764.88 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 11.76 6.85 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TRUE 13.41 8.23 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl TRUE 12.44 7.36 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl TRUE 43.62 30.30 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 14.76 9.10 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl TIMEOUT 900.92 775.16 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl TRUE 34.70 27.28 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl TRUE 15.36 9.24 None 20170304-DifficultPathPrograms/matrix.i_4.bpl TRUE 15.16 9.05 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl TRUE 17.82 11.48 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 15.45 10.09 None 20170304-DifficultPathPrograms/string.i_3.bpl UNKNOWN: OverapproxCex 19.23 12.21 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl TRUE 13.50 7.82 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl TRUE 14.36 8.88 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl FALSE 15.00 9.28 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TIMEOUT 901.05 766.78 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl ERROR: EXCEPTION 620.38 594.96 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.93 772.74 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TIMEOUT 900.07 759.05 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 385.35 315.43 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TIMEOUT 901.13 765.06 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl TIMEOUT 900.46 823.38 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl TIMEOUT 900.83 781.88 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl TIMEOUT 900.81 782.22 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl TRUE 859.42 733.90 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl TRUE 774.42 658.86 None toy/tooDifficultLoopInvariant/Sandman01.bpl TIMEOUT 900.62 787.77 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl ERROR: EXCEPTION 21.91 13.98 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl TRUE 15.80 10.62 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: EXCEPTION 32.60 27.72 None heapseparator/speedup-poc-dd-1-limited.bpl TIMEOUT 900.90 777.52 None heapseparator/speedup-poc-dd-1-unlimited.bpl TIMEOUT 900.86 777.85 None heapseparator/speedup-poc-dd-10-limited.bpl ERROR: EXCEPTION 52.15 46.79 None heapseparator/speedup-poc-dd-10-unlimited.bpl ERROR: EXCEPTION 45.50 38.03 None heapseparator/speedup-poc-dd-2-limited.bpl TIMEOUT 900.62 874.11 None heapseparator/speedup-poc-dd-2-unlimited.bpl TIMEOUT 900.73 872.93 None heapseparator/speedup-poc-dd-3-limited.bpl ERROR: EXCEPTION 724.64 683.89 None heapseparator/speedup-poc-dd-3-unlimited.bpl ERROR: EXCEPTION 414.80 396.79 None heapseparator/speedup-poc-dd-4-limited.bpl ERROR: EXCEPTION 140.53 122.61 None heapseparator/speedup-poc-dd-4-unlimited.bpl ERROR: EXCEPTION 198.89 183.64 None heapseparator/speedup-poc-dd-5-limited.bpl ERROR: EXCEPTION 37.07 32.05 None heapseparator/speedup-poc-dd-5-unlimited.bpl ERROR: EXCEPTION 93.20 79.99 None heapseparator/speedup-poc-dd-6-limited.bpl ERROR: EXCEPTION 37.81 32.67 None heapseparator/speedup-poc-dd-6-unlimited.bpl ERROR: EXCEPTION 183.55 165.38 None heapseparator/speedup-poc-dd-7-limited.bpl ERROR: EXCEPTION 36.35 31.30 None heapseparator/speedup-poc-dd-7-unlimited.bpl ERROR: EXCEPTION 47.98 39.78 None heapseparator/speedup-poc-dd-8-limited.bpl ERROR: EXCEPTION 33.75 28.36 None heapseparator/speedup-poc-dd-8-unlimited.bpl ERROR: EXCEPTION 50.83 40.30 None heapseparator/speedup-poc-dd-9-limited.bpl ERROR: EXCEPTION 55.18 49.91 None heapseparator/speedup-poc-dd-9-unlimited.bpl ERROR: EXCEPTION 81.82 68.08 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 1 done 11769.00 1670.86 - Automizer+MapElim.Array-Boogie Run set 2 of 3 with options '-ea -tc ../../../trunk/examples/toolchains/AutomizerBplInlineTransformed.xml --icfgtransformation.transformationtype MAP_ELIMINATION_MONNIAUX --rcfgbuilder.size.of.a.code.block SingleStatement' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl TRUE 7.06 4.38 None real-life/GuiTestExample.bpl FALSE 50.54 33.69 None real-life/GuiTestExampleUnsafe.bpl FALSE 49.85 33.05 None 20170304-DifficultPathPrograms/array1.i_3.bpl TRUE 9.15 5.34 None 20170304-DifficultPathPrograms/array2.i_3.bpl TRUE 9.00 5.06 None 20170304-DifficultPathPrograms/array3.i_4.bpl TIMEOUT 901.20 758.84 None 20170304-DifficultPathPrograms/array4.i_4.bpl TRUE 9.57 5.45 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 10.97 6.75 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TRUE 11.19 6.40 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl ERROR: EXCEPTION 7.72 4.43 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl ERROR: EXCEPTION 6.37 3.76 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl TRUE 10.26 5.82 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl ERROR: EXCEPTION 6.39 3.78 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl ERROR: EXCEPTION 6.39 3.63 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl ERROR: EXCEPTION 6.31 3.56 None 20170304-DifficultPathPrograms/matrix.i_4.bpl ERROR: EXCEPTION 5.86 3.38 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl ERROR: EXCEPTION 6.00 3.39 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 15.76 9.88 None 20170304-DifficultPathPrograms/string.i_3.bpl TRUE 10.31 5.93 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl ERROR: EXCEPTION 6.24 3.54 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl ERROR: EXCEPTION 6.15 3.48 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl ERROR: EXCEPTION 6.09 3.46 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TRUE 8.21 4.69 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl TRUE 8.73 4.90 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.98 770.62 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TIMEOUT 900.23 752.53 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 367.24 296.55 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TRUE 11.72 6.79 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl ERROR: EXCEPTION 5.37 3.04 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 5.76 3.27 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 6.06 3.41 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl TRUE 6.36 3.64 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl TRUE 6.37 3.62 None toy/tooDifficultLoopInvariant/Sandman01.bpl ERROR: EXCEPTION 5.61 3.13 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 7.34 4.20 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl ERROR: EXCEPTION 5.67 3.21 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: EXCEPTION 5.75 3.25 None heapseparator/speedup-poc-dd-1-limited.bpl ERROR: EXCEPTION 5.39 3.02 None heapseparator/speedup-poc-dd-1-unlimited.bpl ERROR: EXCEPTION 5.48 3.27 None heapseparator/speedup-poc-dd-10-limited.bpl ERROR: EXCEPTION 7.20 4.05 None heapseparator/speedup-poc-dd-10-unlimited.bpl ERROR: EXCEPTION 6.81 3.83 None heapseparator/speedup-poc-dd-2-limited.bpl ERROR: EXCEPTION 5.76 3.27 None heapseparator/speedup-poc-dd-2-unlimited.bpl ERROR: EXCEPTION 5.42 3.12 None heapseparator/speedup-poc-dd-3-limited.bpl ERROR: EXCEPTION 5.75 3.25 None heapseparator/speedup-poc-dd-3-unlimited.bpl ERROR: EXCEPTION 5.99 3.39 None heapseparator/speedup-poc-dd-4-limited.bpl ERROR: EXCEPTION 5.89 3.33 None heapseparator/speedup-poc-dd-4-unlimited.bpl ERROR: EXCEPTION 5.85 3.31 None heapseparator/speedup-poc-dd-5-limited.bpl ERROR: EXCEPTION 6.36 3.60 None heapseparator/speedup-poc-dd-5-unlimited.bpl ERROR: EXCEPTION 6.26 3.50 None heapseparator/speedup-poc-dd-6-limited.bpl ERROR: EXCEPTION 6.13 3.50 None heapseparator/speedup-poc-dd-6-unlimited.bpl ERROR: EXCEPTION 6.30 3.58 None heapseparator/speedup-poc-dd-7-limited.bpl ERROR: EXCEPTION 6.95 3.90 None heapseparator/speedup-poc-dd-7-unlimited.bpl ERROR: EXCEPTION 6.13 3.46 None heapseparator/speedup-poc-dd-8-limited.bpl ERROR: EXCEPTION 6.86 3.86 None heapseparator/speedup-poc-dd-8-unlimited.bpl ERROR: EXCEPTION 6.45 3.59 None heapseparator/speedup-poc-dd-9-limited.bpl ERROR: EXCEPTION 6.94 3.89 None heapseparator/speedup-poc-dd-9-unlimited.bpl ERROR: EXCEPTION 6.85 3.82 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 2 done 2144.62 778.66 - Automizer+MapElim+LBE.Array-Boogie Run set 3 of 3 with options '-ea -tc ../../../trunk/examples/toolchains/AutomizerBplInlineTransformed.xml --icfgtransformation.transformationtype MAP_ELIMINATION_MONNIAUX' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------ real-life/divisibilityWithArray.bpl TRUE 6.60 3.80 None real-life/GuiTestExample.bpl FALSE 15.54 9.18 None real-life/GuiTestExampleUnsafe.bpl FALSE 20.18 12.46 None 20170304-DifficultPathPrograms/array1.i_3.bpl TRUE 7.72 4.30 None 20170304-DifficultPathPrograms/array2.i_3.bpl TRUE 8.10 4.61 None 20170304-DifficultPathPrograms/array3.i_4.bpl TIMEOUT 900.76 772.82 None 20170304-DifficultPathPrograms/array4.i_4.bpl TRUE 9.15 5.16 None 20170304-DifficultPathPrograms/array.i_3.bpl TRUE 7.87 4.61 None 20170304-DifficultPathPrograms/eureka_01.i_3.bpl TRUE 9.26 5.45 None 20170304-DifficultPathPrograms/eureka_01.i_6.bpl ERROR: EXCEPTION 6.67 3.85 None 20170304-DifficultPathPrograms/eureka_05.i_5.bpl ERROR: EXCEPTION 5.62 3.18 None 20170304-DifficultPathPrograms/insertion_sort.i_3.bpl UNKNOWN: OverapproxCex 7.64 4.16 None 20170304-DifficultPathPrograms/invert_string.i_4.bpl ERROR: EXCEPTION 5.80 3.28 None 20170304-DifficultPathPrograms/linear_sea.ch.i_4.bpl ERROR: EXCEPTION 5.65 3.41 None 20170304-DifficultPathPrograms/linear_search.i_5.bpl ERROR: EXCEPTION 5.54 3.15 None 20170304-DifficultPathPrograms/matrix.i_4.bpl ERROR: EXCEPTION 5.84 3.29 None 20170304-DifficultPathPrograms/mcmillan2006.c.i_3.bpl ERROR: EXCEPTION 5.62 3.17 None 20170304-DifficultPathPrograms/n.c11.i_3.bpl TRUE 10.48 5.84 None 20170304-DifficultPathPrograms/string.i_3.bpl TRUE 9.02 5.10 None 20170304-DifficultPathPrograms/sum_array.i_3.bpl ERROR: EXCEPTION 6.13 3.44 None 20170304-DifficultPathPrograms/veris.c_NetBSD-libc__loop.i_2.bpl ERROR: EXCEPTION 5.50 3.13 None 20170304-DifficultPathPrograms/verisec_NetBSD-libc__loop.i_2.bpl ERROR: EXCEPTION 5.75 3.24 None 20170304-DifficultPathPrograms/vogal.i_5.bpl TRUE 8.26 4.66 None toy/tooDifficultLoopInvariant/ArrayInit01.bpl TRUE 7.33 4.17 None toy/tooDifficultLoopInvariant/ArrayInit02.bpl TIMEOUT 900.99 777.03 None toy/tooDifficultLoopInvariant/codeblockAssertOrder01.bpl TIMEOUT 900.11 755.41 None toy/tooDifficultLoopInvariant/CountTillBound-Jupiter.bpl TRUE 318.37 254.10 None toy/tooDifficultLoopInvariant/LargeConstant-ForwardSuccess.bpl TIMEOUT 901.22 757.30 None toy/tooDifficultLoopInvariant/Luxembourg-WithArrays.bpl ERROR: EXCEPTION 5.69 3.11 None toy/tooDifficultLoopInvariant/PointerIncrement.bpl ERROR: EXCEPTION 5.73 3.26 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified01.bpl ERROR: EXCEPTION 6.02 3.38 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified02.bpl TRUE 6.74 3.71 None toy/tooDifficultLoopInvariant/PointerIncrement-simplified03.bpl TRUE 7.08 3.96 None toy/tooDifficultLoopInvariant/Sandman01.bpl ERROR: EXCEPTION 5.36 3.04 None toy/tooDifficultLoopInvariant/ValueTerminatedArrayIteration01.bpl TRUE 6.94 4.04 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/GeometricalIntegerCakeWithArray.bpl ERROR: EXCEPTION 5.64 3.14 None toy/tooDifficultLoopInvariant/HierarchicalTraceAbstraction/SkatingStrawberry.bpl ERROR: EXCEPTION 5.14 2.91 None heapseparator/speedup-poc-dd-1-limited.bpl ERROR: EXCEPTION 5.55 3.14 None heapseparator/speedup-poc-dd-1-unlimited.bpl ERROR: EXCEPTION 5.28 2.99 None heapseparator/speedup-poc-dd-10-limited.bpl ERROR: EXCEPTION 7.07 3.92 None heapseparator/speedup-poc-dd-10-unlimited.bpl ERROR: EXCEPTION 6.99 3.94 None heapseparator/speedup-poc-dd-2-limited.bpl ERROR: EXCEPTION 5.63 3.19 None heapseparator/speedup-poc-dd-2-unlimited.bpl ERROR: EXCEPTION 5.80 3.26 None heapseparator/speedup-poc-dd-3-limited.bpl ERROR: EXCEPTION 6.12 3.43 None heapseparator/speedup-poc-dd-3-unlimited.bpl ERROR: EXCEPTION 5.61 3.17 None heapseparator/speedup-poc-dd-4-limited.bpl ERROR: EXCEPTION 5.84 3.31 None heapseparator/speedup-poc-dd-4-unlimited.bpl ERROR: EXCEPTION 6.03 3.35 None heapseparator/speedup-poc-dd-5-limited.bpl ERROR: EXCEPTION 6.14 3.42 None heapseparator/speedup-poc-dd-5-unlimited.bpl ERROR: EXCEPTION 5.73 3.27 None heapseparator/speedup-poc-dd-6-limited.bpl ERROR: EXCEPTION 6.20 3.48 None heapseparator/speedup-poc-dd-6-unlimited.bpl ERROR: EXCEPTION 6.26 3.47 None heapseparator/speedup-poc-dd-7-limited.bpl ERROR: EXCEPTION 5.88 3.36 None heapseparator/speedup-poc-dd-7-unlimited.bpl ERROR: EXCEPTION 5.88 3.33 None heapseparator/speedup-poc-dd-8-limited.bpl ERROR: EXCEPTION 6.08 3.47 None heapseparator/speedup-poc-dd-8-unlimited.bpl ERROR: EXCEPTION 6.52 3.62 None heapseparator/speedup-poc-dd-9-limited.bpl ERROR: EXCEPTION 6.97 3.96 None heapseparator/speedup-poc-dd-9-unlimited.bpl ERROR: EXCEPTION 6.39 3.61 None ------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 3 done 2460.91 783.73 - Statistics: 171 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 171