Overview of 1618 results from 1384 .log files (77 Timeout by benchexec, 400 OOM by benchexec) Categories 458 Ultimate.py: error: argument --validate: File 397 OOM by benchexec 197 StackOverflowError: null 175 CounterExampleResult 148 Killed by 15 124 AllSpecificationsHoldResult: All specifications hold 56 Undeclared variable in ACSL expression 24 UnsupportedSyntaxResult 24 The following witness entry could not be matched 15 stderr output: (error "out of memory") Actual results (n>=10) 458 Ultimate.py: erro... Ultimate.py: error: argument --validate: File ./goblint.2024-05-07_14-17-48.files/protection/parallel-ticket-2.wvr.yml/witness.yml does not exist: 397 OOM by benchexec ...: 197 StackOverflowErro... - ExceptionOrErrorResult: StackOverflowError: null: 175 CounterExampleResult - CounterExampleResult [Line: 19]: a call to reach_error is reachable: 148 Killed by 15 Killed by 15: 124 AllSpecifications... - AllSpecificationsHoldResult: All specifications hold: 56 Undeclared variab... [2024-05-12 10:48:23,941 ERROR L334 MainTranslator]: Incorrect Syntax: Undeclared variable in ACSL expression: pc8736x_gpio_init: 24 The following wit... java.lang.UnsupportedOperationException: The following witness entry could not be matched: LocationInvariant (/mnt/goblint-svcomp/benchexec/sv-benchmarks/c/pthread/twostage_3.i, L1304-9): ! multithreaded || (alloc_m563103013_locked || ((((2147483647LL + (long long )iRThreads) + (long long )iTThreads >= 0LL && (2147583648LL - (long long )iRThreads) + (long long )iTThreads >= 0LL) && (2147583648LL + (long long )iRThreads) - (long long )iTThreads >= 0LL) && (200000LL - (long long )iRThreads) - (long long )iTThreads >= 0LL)): 16 UnsupportedSyntax... The following functions are not defined or handled internally: sleep: 15 stderr output: (e... [2024-05-12 12:58:07,741 WARN L249 Executor]: External (MP /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/z3 SMTLIB2_COMPLIANT=true -memory:2024 -smt2 -in -t:4000 (1) with exit command (exit)) stderr output: (error "out of memory"): Actual results (n<10) 8 UnsupportedSyntax... Unsupported function: pthread_attr_init: Detailed actual results (n>=10) 458 Ultimate.py: erro... Ultimate.py: error: argument --validate: File ./goblint.2024-05-07_14-17-48.files/protection/parallel-ticket-2.wvr.yml/witness.yml does not exist: 0.04s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-protection.parallel-ticket-2.wvr.yml.log Call: None 397 OOM by benchexec ...: 28.81s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-protection.mix040_tso.oepc.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-wmm/mix040_tso.oepc.i ./goblint.2024-05-07_14-17-48.files/protection/mix040_tso.oepc.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 197 StackOverflowErro... - ExceptionOrErrorResult: StackOverflowError: null: 9.24s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-mutexmeet.safe001_rmo.oepc.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-wmm/safe001_rmo.oepc.i ./goblint.2024-05-07_14-17-48.files/mutex-meet/safe001_rmo.oepc.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 175 CounterExampleResult - CounterExampleResult [Line: 19]: a call to reach_error is reachable: 6.32s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-protection.13-privatized_18-first-reads_unknown_2_neg.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/goblint-regression/13-privatized_18-first-reads_unknown_2_neg.i ./goblint.2024-05-07_14-17-48.files/protection/13-privatized_18-first-reads_unknown_2_neg.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 148 Killed by 15 Killed by 15: 806.06s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-mutexmeet.safe004_power.opt_pso.opt_rmo.opt.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-wmm/safe004_power.opt_pso.opt_rmo.opt.i ./goblint.2024-05-07_14-17-48.files/mutex-meet/safe004_power.opt_pso.opt_rmo.opt.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 124 AllSpecifications... - AllSpecificationsHoldResult: All specifications hold: 6.16s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-protection.13-privatized_47-refine-protected2_true.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/goblint-regression/13-privatized_47-refine-protected2_true.i ./goblint.2024-05-07_14-17-48.files/protection/13-privatized_47-refine-protected2_true.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 56 Undeclared variab... [2024-05-12 10:48:23,941 ERROR L334 MainTranslator]: Incorrect Syntax: Undeclared variable in ACSL expression: pc8736x_gpio_init: 18.40s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-mutexmeet.char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_configure.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_configure.i ./goblint.2024-05-07_14-17-48.files/mutex-meet/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_configure.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Bitvector.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 24 The following wit... java.lang.UnsupportedOperationException: The following witness entry could not be matched: LocationInvariant (/mnt/goblint-svcomp/benchexec/sv-benchmarks/c/pthread/twostage_3.i, L1304-9): ! multithreaded || (alloc_m563103013_locked || ((((2147483647LL + (long long )iRThreads) + (long long )iTThreads >= 0LL && (2147583648LL - (long long )iRThreads) + (long long )iTThreads >= 0LL) && (2147583648LL + (long long )iRThreads) - (long long )iTThreads >= 0LL) && (200000LL - (long long )iRThreads) - (long long )iTThreads >= 0LL)): 10.14s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-mutexmeet.twostage_3.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread/twostage_3.i ./goblint.2024-05-07_14-17-48.files/mutex-meet/twostage_3.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 16 UnsupportedSyntax... The following functions are not defined or handled internally: sleep: 9.39s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-mutexmeet.13-privatized_04-priv_multi_true.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/goblint-regression/13-privatized_04-priv_multi_true.i ./goblint.2024-05-07_14-17-48.files/mutex-meet/13-privatized_04-priv_multi_true.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false 15 stderr output: (e... [2024-05-12 12:58:07,741 WARN L249 Executor]: External (MP /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/z3 SMTLIB2_COMPLIANT=true -memory:2024 -smt2 -in -t:4000 (1) with exit command (exit)) stderr output: (error "out of memory"): 841.81s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-protection.popl20-more-inc-subseq.wvr.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/weaver/popl20-more-inc-subseq.wvr.c ./goblint.2024-05-07_14-17-48.files/protection/popl20-more-inc-subseq.wvr.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false Detailed actual results (n<10) 8 UnsupportedSyntax... Unsupported function: pthread_attr_init: 9.37s results/concurrency-witness-validation.2024-05-12_10-32-13.logfiles/validate-goblint-witnesses-protection.pthread-numerical-integration.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-C-DAC/pthread-numerical-integration.i ./goblint.2024-05-07_14-17-48.files/protection/pthread-numerical-integration.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false