Overview of 1684 results from 1384 .log files (153 Timeout by benchexec, 206 OOM by benchexec) Categories 463 Ultimate.py: error: argument --validate: File 361 AllSpecificationsHoldResult: All specifications hold 302 Killed by 15 206 OOM by benchexec 202 StackOverflowError: null 58 CounterExampleResult 56 Undeclared variable in ACSL expression 24 The following witness entry could not be matched 8 UnsupportedSyntaxResult 4 stderr output: (error "out of memory") Actual results (n>=10) 463 Ultimate.py: erro... Ultimate.py: error: argument --validate: File ./goblint.2024-05-21_14-57-05.files/mutex-meet/unroll-4.wvr.yml/witness.yml does not exist: 361 AllSpecifications... - AllSpecificationsHoldResult: All specifications hold: 302 Killed by 15 Killed by 15: 206 OOM by benchexec ...: 202 StackOverflowErro... - ExceptionOrErrorResult: StackOverflowError: null: 58 CounterExampleResult - CounterExampleResult [Line: 838]: invariant of correctness witness can be violated: 56 Undeclared variab... [2024-06-03 18:59:21,973 ERROR L334 MainTranslator]: Incorrect Syntax: Undeclared variable in ACSL expression: pc8736x_gpio_cleanup: 24 The following wit... java.lang.UnsupportedOperationException: The following witness entry could not be matched: LocationInvariant (/mnt/goblint-svcomp/benchexec/sv-benchmarks/c/pthread-driver-races/char_generic_nvram_read_nvram_write_nvram.i, L6884-2): ! multithreaded || _whoop_init == & nvram_init: Actual results (n<10) 8 UnsupportedSyntax... Unsupported function: pthread_attr_init: 4 stderr output: (e... [2024-06-03 21:06:19,475 WARN L249 Executor]: External (MP /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/z3 SMTLIB2_COMPLIANT=true -memory:2024 -smt2 -in -t:4000 (1) with exit command (exit)) stderr output: (error "out of memory"): Detailed actual results (n>=10) 463 Ultimate.py: erro... Ultimate.py: error: argument --validate: File ./goblint.2024-05-21_14-57-05.files/mutex-meet/unroll-4.wvr.yml/witness.yml does not exist: 0.04s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-mutexmeet.unroll-4.wvr.yml.log Call: None 361 AllSpecifications... - AllSpecificationsHoldResult: All specifications hold: 5.73s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-mutexmeet.13-privatized_57-singlethreaded-unlock_true.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/goblint-regression/13-privatized_57-singlethreaded-unlock_true.i ./goblint.2024-05-21_14-57-05.files/mutex-meet/13-privatized_57-singlethreaded-unlock_true.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 302 Killed by 15 Killed by 15: 795.85s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-protection.rfi003_tso.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-wmm/rfi003_tso.i ./goblint.2024-05-21_14-57-05.files/protection/rfi003_tso.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 206 OOM by benchexec ...: 30.80s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-mutexmeet.chl-poker-hand-trans.wvr.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/weaver/chl-poker-hand-trans.wvr.c ./goblint.2024-05-21_14-57-05.files/mutex-meet/chl-poker-hand-trans.wvr.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 202 StackOverflowErro... - ExceptionOrErrorResult: StackOverflowError: null: 9.31s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-mutexmeet.safe028_power.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-wmm/safe028_power.i ./goblint.2024-05-21_14-57-05.files/mutex-meet/safe028_power.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 58 CounterExampleResult - CounterExampleResult [Line: 838]: invariant of correctness witness can be violated: 10.58s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-protection.safe009_power.oepc.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-wmm/safe009_power.oepc.i ./goblint.2024-05-21_14-57-05.files/protection/safe009_power.oepc.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 56 Undeclared variab... [2024-06-03 18:59:21,973 ERROR L334 MainTranslator]: Incorrect Syntax: Undeclared variable in ACSL expression: pc8736x_gpio_cleanup: 15.30s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-protection.char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_get.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_get.i ./goblint.2024-05-21_14-57-05.files/protection/char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_get.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Bitvector.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 24 The following wit... java.lang.UnsupportedOperationException: The following witness entry could not be matched: LocationInvariant (/mnt/goblint-svcomp/benchexec/sv-benchmarks/c/pthread-driver-races/char_generic_nvram_read_nvram_write_nvram.i, L6884-2): ! multithreaded || _whoop_init == & nvram_init: 8.83s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-mutexmeet.char_generic_nvram_read_nvram_write_nvram.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-driver-races/char_generic_nvram_read_nvram_write_nvram.i ./goblint.2024-05-21_14-57-05.files/mutex-meet/char_generic_nvram_read_nvram_write_nvram.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false Detailed actual results (n<10) 8 UnsupportedSyntax... Unsupported function: pthread_attr_init: 8.65s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-protection.pthread-finding-k-matches.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/pthread-C-DAC/pthread-finding-k-matches.i ./goblint.2024-05-21_14-57-05.files/protection/pthread-finding-k-matches.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false 4 stderr output: (e... [2024-06-03 21:06:19,475 WARN L249 Executor]: External (MP /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/z3 SMTLIB2_COMPLIANT=true -memory:2024 -smt2 -in -t:4000 (1) with exit command (exit)) stderr output: (error "out of memory"): 849.57s results/concurrency-witness-validation.2024-06-03_18-35-45.logfiles/validate-goblint-witnesses-mutexmeet.chl-collitem-trans.wvr.yml.log Call: Calling Ultimate with: /root/.sdkman/candidates/java/current/bin/java -Dosgi.configuration.area=/storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data/config -Xmx15G -Xms4m -jar /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/plugins/org.eclipse.equinox.launcher_1.5.800.v20200727-1323.jar -data @noDefault -ultimatedata /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/data -tc /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/AutomizerReachWitnessValidation.xml -i ../../../trunk/examples/svcomp/weaver/chl-collitem-trans.wvr.c ./goblint.2024-05-21_14-57-05.files/mutex-meet/chl-collitem-trans.wvr.yml/witness.yml -s /storage/repos/ultimate/releaseScripts/default/UAutomizer-linux/config/svcomp-Reach-32bit-Automizer_Default.epf --cacsl2boogietranslator.entry.function main --traceabstraction.compute.hoare.annotation.of.negated.interpolant.automaton,.abstraction.and.cfg false --witnessparser.only.consider.loop.invariants false --cacsl2boogietranslator.check.unreachability.of.reach_error.function false