BENCHMARK INFORMATION benchmark definition: ../benchexec/student-concurrency.xml name: student-concurrency run sets: Automizer SVCOMP 2020.Ultimate Repo, Automizer FA-SemanticLbe.Ultimate Repo, Automizer FA-VariableLbe.Ultimate Repo, Automizer FA-NoLbe.Ultimate Repo, Automizer FA-SemanticLbe-MCR.Ultimate Repo, Automizer FA-VariableLbe-MCR.Ultimate Repo, Automizer FA-NoLbe-MCR.Ultimate Repo date: Sun, 2019-12-22 15:44:27 CET tool: ULTIMATE Automizer 0.1.25-58757687 tool executable: ./Ultimate.py options: --force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml parallel runs: 8 resource limits: - memory: 8000.0 MB - time: 300 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: struebli os: Linux-5.3.6-gentoo-r1-x86_64-AMD_EPYC_7351P_16-Core_Processor-with-gentoo-2.6 cpu: AMD EPYC 7351P 16-Core Processor - cores: 32 - max frequency: 2400.0 MHz - turbo boost enabled: True ram: 135153.39776 MB ------------------------------------------------------------ Automizer SVCOMP 2020.Ultimate Repo Run set 1 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/default/automizer/svcomp-Reach-32bit-Automizer_Default.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 8.33 5.06 None NonAtomicIncrement_2Threads.c true 15.79 11.25 None SimpleFunctionPointer.c true 7.56 4.57 None SvcompVerifierAtomic.c true 8.89 5.26 None ThreadIdTest.c ERROR: TYPE ERROR 6.00 3.53 None ex1.c true 8.44 5.27 None forkFork.c true 11.38 6.75 None forkForkSimple.c true 9.16 5.49 None forkJoinInLoop.c false(unreach-call) 11.03 6.65 None forkJoinNotMod.c false(unreach-call) 15.81 10.16 None forkMultipleParameter.c unknown 5.82 3.38 None forkMultipleTimes.c true 8.90 5.36 None globalVariableMultipleThreads.c false(unreach-call) 23.98 13.81 None joinMultipleReturnValues.c unknown 5.45 3.24 None mainThreadTerminates.c false(unreach-call) 206.85 177.63 None multipleForkSameIdDifferentReturnType.c true 14.96 9.90 None pthreadExitNull-safe.c true 8.74 5.09 None pthreadExitSafe.c true 10.84 6.50 None pthreadExitUnsafe.c false(unreach-call) 8.56 5.15 None pthreadJoinCorrectThreadId.c true 8.52 5.06 None pthreadMutex01-safe.c true 7.72 4.61 None pthreadMutex02-unsafe.c false(unreach-call) 6.94 4.18 None pthreadReturn.c true 10.58 6.44 None simpleReturn.c true 10.80 6.33 None ----------------------------------------------------------------------------------------------------- Run set 1 done 439.01 184.76 - Automizer FA-SemanticLbe.Ultimate Repo Run set 2 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-SemanticLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 8.57 5.20 None NonAtomicIncrement_2Threads.c true 15.84 10.76 None SimpleFunctionPointer.c true 7.59 4.64 None SvcompVerifierAtomic.c true 9.10 5.43 None ThreadIdTest.c ERROR: TYPE ERROR 5.80 3.46 None ex1.c true 8.71 5.15 None forkFork.c true 11.59 6.93 None forkForkSimple.c true 8.15 4.93 None forkJoinInLoop.c false(unreach-call) 11.25 6.70 None forkJoinNotMod.c false(unreach-call) 16.17 10.62 None forkMultipleParameter.c unknown 5.95 3.45 None forkMultipleTimes.c true 9.37 5.39 None globalVariableMultipleThreads.c false(unreach-call) 23.69 13.53 None joinMultipleReturnValues.c unknown 5.86 3.30 None mainThreadTerminates.c false(unreach-call) 209.88 179.23 None multipleForkSameIdDifferentReturnType.c true 14.96 9.89 None pthreadExitNull-safe.c true 8.88 5.09 None pthreadExitSafe.c true 11.02 6.40 None pthreadExitUnsafe.c false(unreach-call) 8.58 4.98 None pthreadJoinCorrectThreadId.c true 8.75 5.22 None pthreadMutex01-safe.c true 7.47 4.56 None pthreadMutex02-unsafe.c false(unreach-call) 7.41 4.36 None pthreadReturn.c true 10.67 6.29 None simpleReturn.c true 10.98 6.45 None ----------------------------------------------------------------------------------------------------- Run set 2 done 444.33 186.55 - Automizer FA-VariableLbe.Ultimate Repo Run set 3 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-VariableLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 8.08 4.87 None NonAtomicIncrement_2Threads.c true 16.55 10.83 None SimpleFunctionPointer.c true 7.61 4.66 None SvcompVerifierAtomic.c true 8.43 5.07 None ThreadIdTest.c ERROR: TYPE ERROR 6.23 3.56 None ex1.c true 8.23 5.08 None forkFork.c true 10.99 6.43 None forkForkSimple.c true 8.27 4.98 None forkJoinInLoop.c false(unreach-call) 11.28 6.71 None forkJoinNotMod.c false(unreach-call) 15.95 10.20 None forkMultipleParameter.c unknown 5.98 3.41 None forkMultipleTimes.c true 9.42 5.48 None globalVariableMultipleThreads.c false(unreach-call) 23.23 13.36 None joinMultipleReturnValues.c unknown 5.52 3.53 None mainThreadTerminates.c false(unreach-call) 209.64 178.95 None multipleForkSameIdDifferentReturnType.c true 15.12 9.93 None pthreadExitNull-safe.c true 8.68 5.09 None pthreadExitSafe.c true 10.99 6.35 None pthreadExitUnsafe.c false(unreach-call) 8.48 5.07 None pthreadJoinCorrectThreadId.c true 8.64 5.17 None pthreadMutex01-safe.c true 7.57 4.47 None pthreadMutex02-unsafe.c false(unreach-call) 6.95 4.16 None pthreadReturn.c true 10.79 6.54 None simpleReturn.c true 10.94 6.44 None ----------------------------------------------------------------------------------------------------- Run set 3 done 441.69 185.76 - Automizer FA-NoLbe.Ultimate Repo Run set 4 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 6.77 4.18 None NonAtomicIncrement_2Threads.c true 46.14 30.20 None SimpleFunctionPointer.c true 7.10 4.27 None SvcompVerifierAtomic.c true 7.34 4.41 None ThreadIdTest.c ERROR: TYPE ERROR 5.99 3.54 None ex1.c true 6.79 4.36 None forkFork.c true 7.53 4.55 None forkForkSimple.c true 6.83 4.23 None forkJoinInLoop.c false(unreach-call) 10.54 6.35 None forkJoinNotMod.c false(unreach-call) 10.81 6.16 None forkMultipleParameter.c unknown 5.74 3.45 None forkMultipleTimes.c true 7.38 4.45 None globalVariableMultipleThreads.c false(unreach-call) 90.82 66.91 None joinMultipleReturnValues.c unknown 5.64 3.33 None mainThreadTerminates.c TIMEOUT (ERROR (143)) 300.39 248.44 None multipleForkSameIdDifferentReturnType.c true 8.12 4.82 None pthreadExitNull-safe.c true 6.94 4.24 None pthreadExitSafe.c true 22.39 14.22 None pthreadExitUnsafe.c false(unreach-call) 7.54 4.48 None pthreadJoinCorrectThreadId.c true 7.16 4.33 None pthreadMutex01-safe.c true 7.50 4.55 None pthreadMutex02-unsafe.c false(unreach-call) 7.02 4.32 None pthreadReturn.c true 7.38 4.46 None simpleReturn.c true 19.81 12.57 None ----------------------------------------------------------------------------------------------------- Run set 4 done 616.69 253.35 - Automizer FA-SemanticLbe-MCR.Ultimate Repo Run set 5 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-SemanticLbe-MCR.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 8.24 5.03 None NonAtomicIncrement_2Threads.c true 17.84 12.29 None SimpleFunctionPointer.c true 7.50 4.62 None SvcompVerifierAtomic.c true 8.64 5.21 None ThreadIdTest.c ERROR: TYPE ERROR 5.91 3.69 None ex1.c true 8.47 5.01 None forkFork.c true 11.73 6.88 None forkForkSimple.c true 8.29 5.00 None forkJoinInLoop.c false(unreach-call) 10.88 6.62 None forkJoinNotMod.c false(unreach-call) 15.85 10.11 None forkMultipleParameter.c unknown 5.70 3.41 None forkMultipleTimes.c true 8.93 5.36 None globalVariableMultipleThreads.c false(unreach-call) 24.46 14.10 None joinMultipleReturnValues.c unknown 5.61 3.29 None mainThreadTerminates.c false(unreach-call) 216.22 181.58 None multipleForkSameIdDifferentReturnType.c true 15.21 9.95 None pthreadExitNull-safe.c true 8.91 5.35 None pthreadExitSafe.c true 10.99 6.31 None pthreadExitUnsafe.c false(unreach-call) 8.71 5.06 None pthreadJoinCorrectThreadId.c true 8.89 5.16 None pthreadMutex01-safe.c true 7.31 4.40 None pthreadMutex02-unsafe.c false(unreach-call) 7.11 4.26 None pthreadReturn.c true 10.45 6.38 None simpleReturn.c true 10.78 6.35 None ----------------------------------------------------------------------------------------------------- Run set 5 done 450.70 188.95 - Automizer FA-VariableLbe-MCR.Ultimate Repo Run set 6 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-VariableLbe-MCR.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 8.27 5.05 None NonAtomicIncrement_2Threads.c true 16.30 10.21 None SimpleFunctionPointer.c true 7.61 5.11 None SvcompVerifierAtomic.c true 9.15 5.25 None ThreadIdTest.c ERROR: TYPE ERROR 5.96 3.55 None ex1.c true 8.53 5.34 None forkFork.c true 10.67 6.33 None forkForkSimple.c true 8.21 4.93 None forkJoinInLoop.c false(unreach-call) 10.94 6.58 None forkJoinNotMod.c false(unreach-call) 15.62 10.04 None forkMultipleParameter.c unknown 6.11 3.59 None forkMultipleTimes.c true 9.26 5.43 None globalVariableMultipleThreads.c false(unreach-call) 22.57 13.08 None joinMultipleReturnValues.c unknown 5.66 3.31 None mainThreadTerminates.c false(unreach-call) 210.90 179.98 None multipleForkSameIdDifferentReturnType.c true 14.91 9.87 None pthreadExitNull-safe.c true 8.50 4.97 None pthreadExitSafe.c true 11.05 6.48 None pthreadExitUnsafe.c false(unreach-call) 8.54 5.12 None pthreadJoinCorrectThreadId.c true 8.56 5.13 None pthreadMutex01-safe.c true 7.32 4.48 None pthreadMutex02-unsafe.c false(unreach-call) 7.35 4.43 None pthreadReturn.c true 10.66 6.25 None simpleReturn.c true 11.63 6.74 None ----------------------------------------------------------------------------------------------------- Run set 6 done 442.41 186.81 - Automizer FA-NoLbe-MCR.Ultimate Repo Run set 7 of 7 with options '--force-no-wrapper -tc ../../../trunk/examples/toolchains/AutomizerCInline.xml -s ../../../trunk/examples/settings/automizer/concurrent/svcomp-Reach-32bit-Automizer_Default-noMmResRef-FA-NoLbe-MCR.epf' and propertyfile 'None' inputfile status cpu time wall time host ----------------------------------------------------------------------------------------------------- ForkedModifiesGlobal.c true 7.46 4.38 None NonAtomicIncrement_2Threads.c TIMEOUT (ERROR (143)) 300.42 253.62 None SimpleFunctionPointer.c true 6.66 4.33 None SvcompVerifierAtomic.c true 7.78 4.61 None ThreadIdTest.c ERROR: TYPE ERROR 6.04 3.76 None ex1.c true 7.13 4.27 None forkFork.c true 7.39 4.52 None forkForkSimple.c true 6.93 4.31 None forkJoinInLoop.c false(unreach-call) 11.09 6.41 None forkJoinNotMod.c false(unreach-call) 10.90 6.30 None forkMultipleParameter.c unknown 5.81 3.35 None forkMultipleTimes.c true 7.02 4.36 None globalVariableMultipleThreads.c false(unreach-call) 88.42 69.71 None joinMultipleReturnValues.c unknown 5.62 3.42 None mainThreadTerminates.c TIMEOUT (ERROR (143)) 300.39 247.25 None multipleForkSameIdDifferentReturnType.c true 8.55 5.06 None pthreadExitNull-safe.c true 7.14 4.27 None pthreadExitSafe.c true 13.17 7.98 None pthreadExitUnsafe.c false(unreach-call) 7.40 4.45 None pthreadJoinCorrectThreadId.c true 7.16 4.30 None pthreadMutex01-safe.c true 7.88 4.74 None pthreadMutex02-unsafe.c false(unreach-call) 6.86 4.29 None pthreadReturn.c true 6.66 4.14 None simpleReturn.c true 12.41 7.56 None ----------------------------------------------------------------------------------------------------- Run set 7 done 692.25 253.79 - Statistics: 168 Files correct: 0 correct true: 0 correct false: 0 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 24