BENCHMARK INFORMATION benchmark definition: ../benchexec/concurrency.xml name: concurrency run sets: GemCutter.SleepMap.ConcreteSmt_VarAbsGlobalSmt.SVCOMP-Concurrency-SafeDeref date: Wed, 2023-01-11 14:14:10 CET tool: ULTIMATE Automizer 0.2.3-95ec5590 tool executable: ./Ultimate.py options: --force-no-wrapper --traceabstraction.cegar.restart.behaviour ONE_CEGAR_PER_ERROR_LOCATION parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.60-1-pve-x86_64-with-glibc2.31 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 4549.121 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ GemCutter.NewStatesSleep.SVCOMP-Concurrency-SafeDeref Run set 1 of 26: skipped GemCutter.NewStatesSleepPersistentFixedOrder.SVCOMP-Concurrency-SafeDeref Run set 2 of 26: skipped GemCutter.NewStatesSleepPersistentFixedOrder.Badger.SVCOMP-Concurrency-SafeDeref Run set 3 of 26: skipped GemCutter.NewStatesSleepPersistentFixedOrder.PerError.SVCOMP-Concurrency-SafeDeref Run set 4 of 26: skipped GemCutter.NewStatesSleep.VarAbsGlobalSyntactic.SVCOMP-Concurrency-SafeDeref Run set 5 of 26: skipped GemCutter.NewStatesSleep.VarAbsGlobalSmt.SVCOMP-Concurrency-SafeDeref Run set 6 of 26: skipped GemCutter.SleepMap.ConcreteSmt_VarAbsGlobalSyntactic.SVCOMP-Concurrency-SafeDeref Run set 7 of 26: skipped GemCutter.SleepMap.ConcreteSmt_VarAbsGlobalSmt.SVCOMP-Concurrency-SafeDeref Run set 8 of 26 with options '--force-no-wrapper --traceabstraction.cegar.restart.behaviour ONE_CEGAR_PER_ERROR_LOCATION -s ../../../trunk/examples/settings/gemcutter/SleepMap-ConcreteSmt-VarAbsGlobalSmt.epf' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ pthread/bigshot_s.yml true 57.71 45.12 None pthread/bigshot_s2.yml true 49.21 38.55 None pthread/fib_safe-10.yml true 10.59 8.32 None pthread/fib_safe-11.yml true 13.54 8.74 None pthread/fib_safe-12.yml true 11.15 7.67 None pthread/fib_safe-5.yml true 10.96 8.10 None pthread/fib_safe-6.yml true 13.81 8.83 None pthread/fib_safe-7.yml true 14.74 9.31 None pthread/fib_unsafe-10.yml true 14.22 9.30 None pthread/fib_unsafe-11.yml true 11.23 9.07 None pthread/fib_unsafe-12.yml true 10.68 8.33 None pthread/fib_unsafe-5.yml true 10.39 7.90 None pthread/fib_unsafe-6.yml true 11.50 7.52 None pthread/fib_unsafe-7.yml true 10.41 7.21 None pthread/lazy01.yml true 18.86 13.45 None pthread/queue.yml TIMEOUT (ERROR: EXCEPTION) 911.58 787.40 None pthread/queue_longer.yml TIMEOUT 902.93 813.37 None pthread/queue_longest.yml TIMEOUT 902.51 843.89 None pthread/queue_ok.yml TIMEOUT (ERROR: EXCEPTION) 901.22 805.45 None pthread/queue_ok_longer.yml TIMEOUT (ERROR: EXCEPTION) 901.16 807.66 None pthread/queue_ok_longest.yml TIMEOUT 901.58 824.22 None pthread/reorder_2-2.yml false(valid-deref) 24.67 16.23 None pthread/reorder_2.yml OUT OF MEMORY 139.50 84.28 None pthread/reorder_5-2.yml false(valid-deref) 21.11 15.61 None pthread/reorder_5.yml OUT OF MEMORY 154.57 98.68 None pthread/singleton.yml OUT OF MEMORY 137.37 92.60 None pthread/singleton_with-uninit-problems.yml OUT OF MEMORY 123.01 89.93 None pthread/stack-1.yml OUT OF MEMORY 226.13 182.38 None pthread/stack-2.yml true 280.87 203.17 None pthread/stack_longer-1.yml true 122.89 92.83 None pthread/stack_longer-2.yml true 255.69 194.16 None pthread/stack_longest-1.yml true 160.88 108.92 None pthread/stack_longest-2.yml OUT OF MEMORY 320.21 232.02 None pthread/stateful01-1.yml true 17.53 11.40 None pthread/stateful01-2.yml true 12.45 9.06 None pthread/sync01.yml true 18.33 11.86 None pthread/triangular-1.yml true 10.42 7.26 None pthread/triangular-2.yml true 10.28 7.21 None pthread/triangular-longer-1.yml true 10.17 7.56 None pthread/triangular-longer-2.yml true 13.79 8.77 None pthread/triangular-longest-1.yml true 10.08 7.05 None pthread/triangular-longest-2.yml true 10.61 7.97 None pthread/twostage_3-2.yml unknown 10.00 5.45 None pthread/twostage_3.yml unknown 7.01 4.00 None pthread-atomic/dekker.yml true 19.80 12.72 None pthread-atomic/lamport.yml true 17.83 11.80 None pthread-atomic/peterson.yml true 13.57 10.14 None pthread-atomic/read_write_lock-1.yml OUT OF MEMORY 123.22 92.23 None pthread-atomic/read_write_lock-2.yml OUT OF MEMORY 93.39 63.64 None pthread-atomic/szymanski.yml true 21.42 13.44 None pthread-atomic/time_var_mutex.yml true 18.24 11.84 None pthread-ext/01b_inc.yml OUT OF MEMORY 372.75 239.24 None pthread-ext/02_inc_cas.yml ERROR: EXCEPTION 11.05 6.20 None pthread-ext/03_incdec.yml OUT OF MEMORY 445.59 267.20 None pthread-ext/04_incdec_cas.yml OUT OF MEMORY 443.42 286.86 None pthread-ext/08_rand_cas.yml OUT OF MEMORY 355.13 256.97 None pthread-ext/09_fmaxsym.yml OUT OF MEMORY 548.95 304.39 None pthread-ext/11_fmaxsymopt.yml OUT OF MEMORY 428.02 239.54 None pthread-ext/14_spin2003.yml OUT OF MEMORY 217.35 153.55 None pthread-ext/18_read_write_lock.yml true 13.09 7.87 None pthread-ext/25_stack.yml OUT OF MEMORY 379.65 218.53 None pthread-ext/25_stack_longer-1.yml OUT OF MEMORY 251.34 157.58 None pthread-ext/25_stack_longer-2.yml OUT OF MEMORY 234.41 142.67 None pthread-ext/25_stack_longest-1.yml OUT OF MEMORY 333.58 203.85 None pthread-ext/25_stack_longest-2.yml OUT OF MEMORY 149.33 98.77 None pthread-ext/26_stack_cas.yml OUT OF MEMORY 164.82 127.71 None pthread-ext/26_stack_cas_longer-1.yml OUT OF MEMORY 163.19 116.45 None pthread-ext/26_stack_cas_longer-2.yml OUT OF MEMORY 173.80 125.27 None pthread-ext/26_stack_cas_longest-1.yml OUT OF MEMORY 206.17 152.38 None pthread-ext/26_stack_cas_longest-2.yml OUT OF MEMORY 168.61 131.32 None pthread-ext/28_buggy_simple_loop1_vf.yml OUT OF MEMORY 474.42 261.93 None pthread-ext/29_conditionals_vs.yml OUT OF MEMORY 177.87 108.85 None pthread-ext/31_simple_loop5_vs.yml OUT OF MEMORY 108.00 78.84 None pthread-ext/35_double_lock_p3_vs.yml OUT OF MEMORY 279.35 158.12 None pthread-ext/36_stack_cas_p0_vs_concur.yml TIMEOUT 902.70 843.85 None pthread-ext/37_stack_lock_p0_vs_concur.yml OUT OF MEMORY 98.93 66.56 None pthread-ext/39_rand_lock_p0_vs.yml OUT OF MEMORY 322.58 195.63 None pthread-ext/40_barrier_vf.yml OUT OF MEMORY 241.49 165.49 None pthread-ext/43_NetBSD_sysmon_power_sliced.yml ERROR: TYPE ERROR 7.49 4.76 None pthread-ext/45_monabsex1_vs.yml OUT OF MEMORY 219.78 133.87 None pthread-ext/46_monabsex2_vs.yml OUT OF MEMORY 361.04 247.43 None pthread-ext/48_ticket_lock_low_contention_vs.yml OUT OF MEMORY 203.25 163.26 None pthread-wmm/mix000.oepc.yml true 16.74 10.26 None pthread-wmm/mix000.opt.yml true 16.72 10.43 None pthread-wmm/mix001.oepc.yml true 19.03 12.04 None pthread-wmm/mix001.opt.yml true 13.44 9.38 None pthread-wmm/mix002.oepc.yml true 17.38 11.39 None pthread-wmm/mix002.opt.yml true 13.90 9.62 None pthread-wmm/mix003.oepc.yml true 12.99 9.82 None pthread-wmm/mix003_power.opt_pso.opt_rmo.opt_tso.opt.yml true 13.46 9.90 None pthread-wmm/mix004.oepc.yml true 21.69 14.10 None pthread-wmm/mix004.opt.yml true 15.75 11.81 None pthread-wmm/mix005.opt.yml true 14.94 10.72 None pthread-wmm/mix005_power.oepc_pso.oepc_rmo.oepc.yml true 17.13 12.12 None pthread-wmm/mix005_tso.oepc.yml true 16.98 11.62 None pthread-wmm/mix006.opt.yml true 14.20 10.79 None pthread-wmm/mix006_power.oepc_pso.oepc_rmo.oepc.yml true 17.33 11.38 None pthread-wmm/mix006_tso.oepc.yml true 19.61 12.27 None pthread-wmm/mix007.oepc.yml true 16.00 11.32 None pthread-wmm/mix007.opt.yml true 15.23 11.30 None pthread-wmm/mix008.opt.yml true 15.27 11.06 None pthread-wmm/mix008_power.oepc_pso.oepc_rmo.oepc.yml true 16.94 12.21 None pthread-wmm/mix008_tso.oepc.yml true 18.48 12.30 None pthread-wmm/mix009.oepc.yml true 10.85 8.09 None pthread-wmm/mix009.opt.yml true 16.03 9.80 None pthread-wmm/mix010.oepc.yml true 17.32 11.20 None pthread-wmm/mix010.opt.yml true 13.40 10.03 None pthread-wmm/mix011.opt.yml true 13.85 9.48 None pthread-wmm/mix011_power.oepc_pso.oepc_rmo.oepc.yml true 12.67 9.59 None pthread-wmm/mix011_tso.oepc.yml true 13.50 9.73 None pthread-wmm/mix012_power.oepc_power.opt_pso.oepc_rmo.oepc_rmo.opt_tso.oepc.yml true 12.06 8.13 None pthread-wmm/mix012_pso.opt_tso.opt.yml true 12.27 8.03 None pthread-wmm/mix013.oepc.yml true 21.94 14.10 None pthread-wmm/mix013.opt.yml true 15.59 11.35 None pthread-wmm/mix014.opt.yml true 14.99 10.78 None pthread-wmm/mix014_power.oepc_pso.oepc_rmo.oepc.yml true 16.63 11.62 None pthread-wmm/mix014_tso.oepc.yml true 21.09 15.04 None pthread-wmm/mix015.oepc.yml true 12.55 9.67 None pthread-wmm/mix015.opt.yml true 17.74 11.28 None pthread-wmm/mix016.oepc.yml true 13.28 9.19 None pthread-wmm/mix016_power.opt_rmo.opt.yml true 15.21 10.69 None pthread-wmm/mix016_pso.opt_tso.opt.yml true 13.69 10.20 None pthread-wmm/mix017.oepc.yml true 15.53 11.57 None pthread-wmm/mix017_power.opt_rmo.opt.yml true 16.70 12.05 None pthread-wmm/mix017_pso.opt_tso.opt.yml true 15.69 11.08 None pthread-wmm/mix018.opt.yml true 15.21 10.75 None pthread-wmm/mix018_power.oepc_pso.oepc_rmo.oepc.yml true 22.32 14.33 None pthread-wmm/mix018_tso.oepc.yml true 21.35 13.77 None pthread-wmm/mix019.opt.yml true 14.14 9.66 None pthread-wmm/mix019_power.oepc_pso.oepc_rmo.oepc.yml true 13.89 10.20 None pthread-wmm/mix019_tso.oepc.yml true 14.04 10.31 None pthread-wmm/mix020.oepc.yml true 16.99 12.30 None pthread-wmm/mix020.opt.yml true 15.03 11.47 None pthread-wmm/mix021.opt.yml true 16.53 11.60 None pthread-wmm/mix021_power.oepc_pso.oepc_rmo.oepc.yml true 16.43 11.86 None pthread-wmm/mix021_tso.oepc.yml true 15.23 10.95 None pthread-wmm/mix022_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 11.94 7.94 None pthread-wmm/mix022_tso.yml true 11.35 8.25 None pthread-wmm/mix023_power.oepc_pso.oepc_rmo.oepc.yml true 17.84 12.55 None pthread-wmm/mix023_power.opt_pso.opt_rmo.opt.yml true 22.61 14.36 None pthread-wmm/mix023_tso.yml true 25.26 15.73 None pthread-wmm/mix024_power.oepc_pso.oepc_rmo.oepc_tso.oepc_tso.opt.yml true 13.49 10.04 None pthread-wmm/mix024_power.opt_pso.opt_rmo.opt.yml true 14.88 9.97 None pthread-wmm/mix025_power.oepc_power.opt_pso.oepc_rmo.oepc_tso.oepc_tso.opt.yml true 13.87 9.69 None pthread-wmm/mix025_pso.opt_rmo.opt.yml true 14.99 11.03 None pthread-wmm/mix026.oepc.yml true 17.32 12.46 None pthread-wmm/mix026_power.opt_tso.opt.yml true 21.10 14.37 None pthread-wmm/mix026_pso.opt_rmo.opt.yml true 16.10 11.47 None pthread-wmm/mix027_power.oepc_pso.oepc_rmo.oepc.yml true 16.63 11.78 None pthread-wmm/mix027_power.opt_pso.opt_rmo.opt.yml true 18.84 13.09 None pthread-wmm/mix027_tso.yml true 16.96 12.61 None pthread-wmm/mix028_power.oepc_pso.oepc_rmo.oepc.yml true 13.24 9.35 None pthread-wmm/mix028_power.opt_pso.opt_rmo.opt.yml true 17.58 11.30 None pthread-wmm/mix028_tso.yml true 13.23 9.25 None pthread-wmm/mix029_power.oepc_pso.oepc_rmo.oepc_tso.oepc_tso.opt.yml true 22.14 14.28 None pthread-wmm/mix029_power.opt_pso.opt_rmo.opt.yml true 15.98 11.81 None pthread-wmm/mix030_power.oepc_pso.oepc_rmo.oepc.yml true 16.55 11.59 None pthread-wmm/mix030_power.opt_pso.opt_rmo.opt.yml true 16.73 11.70 None pthread-wmm/mix030_tso.yml true 15.44 11.84 None pthread-wmm/mix031.oepc.yml true 12.76 8.57 None pthread-wmm/mix031.opt.yml true 13.01 8.61 None pthread-wmm/mix032.oepc.yml true 14.09 9.89 None pthread-wmm/mix032.opt.yml true 13.57 11.20 None pthread-wmm/mix033.opt.yml true 15.92 11.34 None pthread-wmm/mix033_power.oepc_pso.oepc_rmo.oepc.yml true 17.31 11.23 None pthread-wmm/mix033_tso.oepc.yml true 14.57 11.67 None pthread-wmm/mix034_power.oepc_power.opt_pso.oepc_rmo.oepc_rmo.opt_tso.oepc.yml true 12.08 8.67 None pthread-wmm/mix034_pso.opt_tso.opt.yml true 13.61 9.04 None pthread-wmm/mix035.oepc.yml true 17.55 11.42 None pthread-wmm/mix035_power.opt_rmo.opt.yml true 14.82 10.13 None pthread-wmm/mix035_pso.opt_tso.opt.yml true 13.94 10.38 None pthread-wmm/mix036.oepc.yml true 16.75 11.99 None pthread-wmm/mix036_power.opt_rmo.opt.yml true 17.46 12.66 None pthread-wmm/mix036_pso.opt_tso.opt.yml true 15.88 11.30 None pthread-wmm/mix037.opt.yml true 15.74 12.20 None pthread-wmm/mix037_power.oepc_pso.oepc_rmo.oepc.yml true 20.81 14.52 None pthread-wmm/mix037_tso.oepc.yml true 22.15 14.20 None pthread-wmm/mix038.opt.yml true 13.88 10.34 None pthread-wmm/mix038_power.oepc_pso.oepc_rmo.oepc.yml true 14.91 10.38 None pthread-wmm/mix038_tso.oepc.yml true 13.90 11.15 None pthread-wmm/mix039.oepc.yml true 17.09 11.65 None pthread-wmm/mix039.opt.yml true 15.46 11.96 None pthread-wmm/mix040.opt.yml true 20.71 13.80 None pthread-wmm/mix040_power.oepc_pso.oepc_rmo.oepc.yml true 16.62 11.59 None pthread-wmm/mix040_tso.oepc.yml true 15.68 11.47 None pthread-wmm/mix041_power.oepc_pso.oepc_rmo.oepc.yml true 12.01 8.07 None pthread-wmm/mix041_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 11.43 8.48 None pthread-wmm/mix042.oepc.yml true 12.88 9.89 None pthread-wmm/mix042.opt.yml true 12.76 9.08 None pthread-wmm/mix043.oepc.yml true 16.12 11.80 None pthread-wmm/mix043.opt.yml true 19.29 12.79 None pthread-wmm/mix044.opt.yml true 15.99 12.16 None pthread-wmm/mix044_power.oepc_pso.oepc_rmo.oepc.yml true 16.62 11.71 None pthread-wmm/mix044_tso.oepc.yml true 16.78 11.58 None pthread-wmm/mix045_power.oepc_pso.oepc_rmo.oepc.yml true 12.80 9.34 None pthread-wmm/mix045_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 12.94 9.22 None pthread-wmm/mix046.oepc.yml true 22.28 14.27 None pthread-wmm/mix046.opt.yml true 14.82 11.12 None pthread-wmm/mix047_power.oepc_pso.oepc_rmo.oepc.yml true 15.25 11.88 None pthread-wmm/mix047_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 14.85 11.14 None pthread-wmm/mix048_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt-podwr000_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt.yml true 11.42 7.74 None pthread-wmm/mix049_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt-podwr001_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt.yml true 12.71 10.03 None pthread-wmm/mix050.yml true 16.10 12.49 None pthread-wmm/mix051_power.oepc_power.opt_pso.oepc_rmo.oepc.yml true 17.07 12.10 None pthread-wmm/mix051_pso.opt_rmo.opt_tso.opt.yml true 19.91 12.91 None pthread-wmm/mix051_tso.oepc.yml true 16.46 11.71 None pthread-wmm/mix052_power.oepc_power.opt_pso.oepc_rmo.oepc.yml true 13.05 9.09 None pthread-wmm/mix052_pso.opt_rmo.opt_tso.opt.yml true 13.74 9.48 None pthread-wmm/mix052_tso.oepc.yml true 13.20 9.37 None pthread-wmm/mix053.opt.yml true 15.51 11.60 None pthread-wmm/mix053_power.oepc_pso.oepc_rmo.oepc.yml true 16.41 11.90 None pthread-wmm/mix053_tso.oepc.yml true 15.49 11.79 None pthread-wmm/mix054_power.oepc_power.opt_pso.oepc_rmo.oepc.yml true 15.43 9.83 None pthread-wmm/mix054_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 11.33 8.19 None pthread-wmm/mix055.opt.yml true 14.48 10.82 None pthread-wmm/mix055_power.oepc_pso.oepc_rmo.oepc.yml true 15.90 11.20 None pthread-wmm/mix055_tso.oepc.yml true 16.64 12.69 None pthread-wmm/mix056_power.oepc_pso.oepc_rmo.oepc.yml true 13.21 10.38 None pthread-wmm/mix056_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 12.30 8.91 None pthread-wmm/mix057_power.oepc_pso.oepc_rmo.oepc.yml true 16.17 11.21 None pthread-wmm/mix057_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 18.76 12.42 None pthread-wmm/rfi000_power.oepc_pso.oepc_rmo.oepc.yml true 11.44 8.34 None pthread-wmm/rfi000_power.opt_pso.opt_rmo.opt.yml true 15.22 9.61 None pthread-wmm/rfi000_tso.yml true 15.15 9.59 None pthread-wmm/rfi001_power.oepc_pso.oepc_rmo.oepc.yml true 11.45 8.69 None pthread-wmm/rfi001_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 11.29 8.33 None pthread-wmm/rfi002_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 13.21 9.00 None pthread-wmm/rfi002_tso.yml true 13.41 8.58 None pthread-wmm/rfi003_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 11.79 8.07 None pthread-wmm/rfi003_tso.yml true 12.24 8.04 None pthread-wmm/rfi004.yml true 11.92 8.49 None pthread-wmm/rfi005.yml true 12.36 8.16 None pthread-wmm/rfi006_power.oepc.yml OUT OF MEMORY 300.20 250.36 None pthread-wmm/rfi006_power.opt.yml OUT OF MEMORY 384.36 320.98 None pthread-wmm/rfi006_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 14.43 10.39 None pthread-wmm/rfi006_rmo.yml true 191.24 139.59 None pthread-wmm/rfi007_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 14.76 9.32 None pthread-wmm/rfi007_tso.yml true 11.42 8.41 None pthread-wmm/rfi008.oepc.yml true 16.23 10.05 None pthread-wmm/rfi008.opt.yml true 12.57 9.03 None pthread-wmm/rfi009_power.oepc.yml true 582.63 524.28 None pthread-wmm/rfi009_power.opt_pso.oepc_pso.opt_rmo.opt_tso.oepc_tso.opt.yml true 15.75 10.82 None pthread-wmm/rfi009_rmo.oepc.yml true 218.21 177.49 None pthread-wmm/rfi010.yml true 12.54 8.76 None pthread-wmm/safe000_power.oepc.yml OUT OF MEMORY 587.46 524.51 None pthread-wmm/safe000_power.opt.yml true 818.25 752.57 None pthread-wmm/safe000_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 15.18 10.09 None pthread-wmm/safe000_rmo.yml OUT OF MEMORY 384.38 318.36 None pthread-wmm/safe001_power.oepc.yml TIMEOUT 900.81 817.13 None pthread-wmm/safe001_power.opt_pso.oepc_pso.opt_rmo.opt.yml true 13.04 9.37 None pthread-wmm/safe001_rmo.oepc.yml OUT OF MEMORY 335.79 267.45 None pthread-wmm/safe001_tso.yml true 12.33 8.86 None pthread-wmm/safe002_power.oepc.yml OUT OF MEMORY 552.97 484.79 None pthread-wmm/safe002_power.opt_pso.oepc_pso.opt_rmo.opt.yml true 14.25 10.05 None pthread-wmm/safe002_rmo.oepc.yml OUT OF MEMORY 455.28 362.84 None pthread-wmm/safe002_tso.yml true 11.95 9.13 None pthread-wmm/safe003_power.oepc_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 13.21 9.37 None pthread-wmm/safe003_power.opt.yml true 813.20 747.02 None pthread-wmm/safe003_tso.yml true 14.91 9.99 None pthread-wmm/safe004_power.oepc_pso.oepc_rmo.oepc.yml true 17.26 11.03 None pthread-wmm/safe004_power.opt_pso.opt_rmo.opt.yml true 16.78 10.87 None pthread-wmm/safe004_tso.yml true 14.40 9.70 None pthread-wmm/safe005_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 18.84 11.87 None pthread-wmm/safe005_tso.yml true 11.60 8.50 None pthread-wmm/safe006_power.oepc-thin000_power.oepc.yml true 682.33 637.32 None pthread-wmm/safe006_power.opt-thin000_power.opt.yml OUT OF MEMORY 355.60 297.33 None pthread-wmm/safe006_pso.oepc_pso.opt_tso.oepc_tso.opt-thin000_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 10.09 7.67 None pthread-wmm/safe006_rmo.oepc_rmo.opt-thin000_rmo.oepc_rmo.opt.yml true 80.08 57.44 None pthread-wmm/safe007_power.oepc-thin001_power.oepc.yml OUT OF MEMORY 644.19 580.81 None pthread-wmm/safe007_power.opt-thin001_power.opt.yml true 736.71 677.75 None pthread-wmm/safe007_pso.oepc_pso.opt_tso.oepc_tso.opt-thin001_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 12.29 9.26 None pthread-wmm/safe007_rmo.oepc_rmo.opt-thin001_rmo.oepc_rmo.opt.yml true 108.45 83.52 None pthread-wmm/safe008_power.oepc_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 13.64 9.72 None pthread-wmm/safe008_power.opt.yml true 886.10 810.30 None pthread-wmm/safe008_tso.yml true 11.63 8.39 None pthread-wmm/safe009_power.oepc.yml TIMEOUT (true) 901.11 817.72 None pthread-wmm/safe009_power.opt.yml TIMEOUT 905.92 830.12 None pthread-wmm/safe009_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 15.83 10.41 None pthread-wmm/safe009_rmo.oepc.yml OUT OF MEMORY 347.65 261.38 None pthread-wmm/safe009_rmo.opt.yml true 285.59 221.69 None pthread-wmm/safe010_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 11.23 7.98 None pthread-wmm/safe010_tso.yml true 10.29 7.23 None pthread-wmm/safe011_power.oepc_pso.oepc_rmo.oepc_rmo.opt.yml true 16.55 10.80 None pthread-wmm/safe011_power.opt_pso.opt.yml true 12.98 9.13 None pthread-wmm/safe011_tso.yml true 11.60 8.38 None pthread-wmm/safe012_power.oepc.yml true 813.86 733.92 None pthread-wmm/safe012_power.opt.yml true 584.35 533.25 None pthread-wmm/safe012_pso.oepc_pso.opt_rmo.opt.yml true 14.16 9.65 None pthread-wmm/safe012_rmo.oepc.yml true 114.77 85.42 None pthread-wmm/safe012_tso.yml true 11.36 8.31 None pthread-wmm/safe013_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 13.56 9.37 None pthread-wmm/safe013_tso.yml true 11.69 8.46 None pthread-wmm/safe014_power.oepc.yml true 619.34 570.13 None pthread-wmm/safe014_power.opt.yml OUT OF MEMORY 499.33 428.68 None pthread-wmm/safe014_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 11.86 9.10 None pthread-wmm/safe014_rmo.oepc.yml true 115.38 74.33 None pthread-wmm/safe014_rmo.opt.yml OUT OF MEMORY 298.84 247.01 None pthread-wmm/safe015_power.oepc.yml OUT OF MEMORY 628.50 565.81 None pthread-wmm/safe015_power.opt.yml TIMEOUT 901.36 801.72 None pthread-wmm/safe015_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 11.94 8.98 None pthread-wmm/safe015_rmo.yml OUT OF MEMORY 536.50 427.80 None pthread-wmm/safe016_power.oepc.yml OUT OF MEMORY 526.74 450.74 None pthread-wmm/safe016_power.opt.yml OUT OF MEMORY 296.26 257.32 None pthread-wmm/safe016_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 13.67 10.29 None pthread-wmm/safe016_rmo.oepc.yml OUT OF MEMORY 165.59 122.70 None pthread-wmm/safe016_rmo.opt.yml OUT OF MEMORY 235.32 162.76 None pthread-wmm/safe017_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 13.68 9.82 None pthread-wmm/safe017_tso.yml true 11.87 8.42 None pthread-wmm/safe018_power.oepc.yml true 669.95 621.72 None pthread-wmm/safe018_power.opt.yml TIMEOUT 901.06 817.29 None pthread-wmm/safe018_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 12.16 9.19 None pthread-wmm/safe018_rmo.oepc.yml true 78.40 56.23 None pthread-wmm/safe018_rmo.opt.yml true 193.17 163.50 None pthread-wmm/safe019_power.oepc.yml OUT OF MEMORY 345.75 280.78 None pthread-wmm/safe019_power.opt.yml OUT OF MEMORY 328.61 264.56 None pthread-wmm/safe019_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 15.17 11.05 None pthread-wmm/safe019_rmo.oepc.yml OUT OF MEMORY 117.56 83.82 None pthread-wmm/safe019_rmo.opt.yml OUT OF MEMORY 175.27 123.48 None pthread-wmm/safe020_power.yml OUT OF MEMORY 617.48 543.94 None pthread-wmm/safe020_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 11.97 8.76 None pthread-wmm/safe020_rmo.yml true 185.46 155.96 None pthread-wmm/safe021_power.oepc_pso.oepc_rmo.oepc_rmo.opt.yml true 12.77 9.00 None pthread-wmm/safe021_power.opt_pso.opt.yml true 13.57 9.40 None pthread-wmm/safe021_tso.yml true 14.76 9.88 None pthread-wmm/safe022_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 11.34 7.73 None pthread-wmm/safe022_tso.yml true 12.87 8.29 None pthread-wmm/safe023_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 14.69 10.56 None pthread-wmm/safe023_tso.yml true 15.64 10.21 None pthread-wmm/safe024_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 15.04 10.39 None pthread-wmm/safe024_tso.yml true 14.93 9.94 None pthread-wmm/safe025_power.yml OUT OF MEMORY 608.26 543.06 None pthread-wmm/safe025_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 14.68 10.14 None pthread-wmm/safe025_rmo.yml true 417.20 352.40 None pthread-wmm/safe026_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 16.48 10.70 None pthread-wmm/safe026_tso.yml true 15.56 10.32 None pthread-wmm/safe027_power.oepc.yml TIMEOUT 901.31 848.58 None pthread-wmm/safe027_power.opt.yml OUT OF MEMORY 558.89 405.14 None pthread-wmm/safe027_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 18.66 12.38 None pthread-wmm/safe027_rmo.yml OUT OF MEMORY 145.47 93.18 None pthread-wmm/safe028_power.yml TIMEOUT 900.99 818.27 None pthread-wmm/safe028_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 11.39 8.49 None pthread-wmm/safe028_rmo.yml true 247.46 209.31 None pthread-wmm/safe029_power.oepc_pso.oepc_rmo.oepc.yml true 11.28 7.95 None pthread-wmm/safe029_power.opt_pso.opt_rmo.opt.yml true 11.39 8.03 None pthread-wmm/safe029_tso.yml true 10.34 7.52 None pthread-wmm/safe030_power.oepc_pso.oepc_rmo.oepc.yml true 17.37 11.23 None pthread-wmm/safe030_power.opt_pso.opt_rmo.opt.yml true 12.88 9.63 None pthread-wmm/safe030_tso.yml true 14.83 10.07 None pthread-wmm/safe031_power.oepc_pso.oepc_rmo.oepc.yml true 18.92 12.01 None pthread-wmm/safe031_power.opt_pso.opt_rmo.opt.yml true 12.34 8.92 None pthread-wmm/safe031_tso.yml true 12.55 9.19 None pthread-wmm/safe032_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 21.12 13.01 None pthread-wmm/safe032_tso.yml true 15.50 10.20 None pthread-wmm/safe033_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 12.62 8.54 None pthread-wmm/safe033_tso.yml true 10.41 7.76 None pthread-wmm/safe034_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml true 18.25 11.60 None pthread-wmm/safe034_tso.yml true 11.72 8.84 None pthread-wmm/safe035_power.yml true 20.25 12.59 None pthread-wmm/safe035_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt.yml true 11.72 8.84 None pthread-wmm/safe036.yml true 10.33 7.32 None pthread-wmm/safe037.yml true 15.20 10.15 None pthread-wmm/thin002_power.oepc.yml OUT OF MEMORY 301.19 263.58 None pthread-wmm/thin002_power.opt.yml OUT OF MEMORY 296.56 237.06 None pthread-wmm/thin002_pso.oepc_pso.opt_tso.oepc_tso.opt.yml true 13.24 10.13 None pthread-wmm/thin002_rmo.yml OUT OF MEMORY 141.32 88.26 None pthread-lit/qw2004-2b.yml true 9.37 6.60 None pthread-lit/sssc12-2.yml OUT OF MEMORY 461.69 289.59 None pthread-lit/sssc12.yml OUT OF MEMORY 584.47 344.22 None pthread-lit/sssc12_variant-2.yml OUT OF MEMORY 116.56 81.55 None pthread-lit/sssc12_variant.yml OUT OF MEMORY 541.03 301.95 None ldv-races/race-1_1-join.yml true 14.32 9.36 None ldv-races/race-1_2-join.yml true 14.33 9.69 None ldv-races/race-1_3-join.yml true 14.57 9.50 None ldv-races/race-2_1-container_of.yml unknown 7.46 4.72 None ldv-races/race-2_2-container_of.yml unknown 7.70 4.60 None ldv-races/race-2_3-container_of.yml unknown 7.70 4.70 None ldv-races/race-2_4-container_of.yml unknown 7.71 4.38 None ldv-races/race-2_5-container_of.yml unknown 7.36 4.38 None ldv-races/race-3_1-container_of-global.yml unknown 8.20 4.60 None ldv-races/race-3_2-container_of-global.yml unknown 7.75 4.62 None ldv-races/race-4_1-thread_local_vars.yml true 122.09 88.84 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-1.yml ERROR: EXCEPTION 9.94 5.69 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-2.yml ERROR: EXCEPTION 9.79 5.77 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--nsc-ircc.ko.cil.yml unknown 11.01 6.32 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--w83977af_ir.ko.cil.yml unknown 9.67 5.76 None ldv-linux-3.14-races/linux-3.14--drivers--spi--spi-tegra20-slink.ko.cil.yml unknown 12.79 6.83 None ldv-linux-3.14-races/linux-3.14--drivers--usb--misc--adutux.ko.cil.yml unknown 10.06 5.85 None pthread-complex/bounded_buffer.yml unknown 10.32 5.56 None pthread-complex/elimination_backoff_stack.yml OUT OF MEMORY 189.40 135.04 None pthread-complex/safestack_relacy.yml OUT OF MEMORY 296.83 234.12 None pthread-complex/workstealqueue_mutex-2.yml TIMEOUT 901.29 861.63 None pthread-driver-races/char_generic_nvram_nvram_unlocked_ioctl_write_nvram.yml unknown 18.19 10.58 None pthread-driver-races/char_generic_nvram_read_nvram_nvram_unlocked_ioctl.yml unknown 18.29 10.70 None pthread-driver-races/char_generic_nvram_read_nvram_write_nvram.yml unknown 14.64 9.30 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_configure.yml unknown 13.08 8.71 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_current.yml unknown 18.06 10.69 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_get.yml unknown 13.25 8.02 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_set.yml unknown 18.33 10.28 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_configure_pc8736x_gpio_current.yml unknown 12.03 7.50 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_configure_pc8736x_gpio_get.yml unknown 18.31 10.95 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_configure_pc8736x_gpio_set.yml unknown 13.11 7.90 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_get.yml unknown 15.13 10.71 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_set.yml unknown 14.02 8.49 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_get_pc8736x_gpio_set.yml unknown 20.32 10.99 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_change.yml unknown 13.02 7.81 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_configure.yml unknown 13.52 8.14 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_current.yml unknown 14.73 9.05 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_get.yml unknown 16.96 10.07 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_set.yml unknown 17.02 10.16 None pthread-C-DAC/pthread-demo-datarace-1.yml true 11.80 7.74 None pthread-C-DAC/pthread-demo-datarace-3.yml true 11.09 8.38 None pthread-C-DAC/pthread-finding-k-matches.yml unknown 7.63 4.42 None pthread-C-DAC/pthread-numerical-integration.yml unknown 7.80 4.83 None pthread-divine/ring_2w1r-1.yml OUT OF MEMORY 93.79 59.00 None pthread-divine/tls_basic.yml unknown 9.47 5.47 None pthread-divine/tls_destructor_worker.yml unknown 7.38 4.35 None goblint-regression/04-mutex_02-simple_nr.yml true 10.91 7.59 None goblint-regression/04-mutex_04-munge_nr.yml true 10.15 7.48 None goblint-regression/04-mutex_05-lockfuns.yml true 9.59 7.34 None goblint-regression/04-mutex_07-ps_nr.yml true 12.73 7.66 None goblint-regression/04-mutex_10-ptrmunge_nr.yml true 15.08 11.76 None goblint-regression/04-mutex_12-ptr_nr.yml true 14.68 12.00 None goblint-regression/04-mutex_15-funarg_nr.yml true 10.50 7.84 None goblint-regression/04-mutex_17-ps_add1_nr.yml true 12.66 7.68 None goblint-regression/04-mutex_18-glob_guards.yml true 10.12 7.36 None goblint-regression/04-mutex_22-deref_read.yml true 12.53 8.76 None goblint-regression/04-mutex_28-base_nr.yml true 13.15 7.90 None goblint-regression/04-mutex_36-trylock_nr.yml true 26.77 17.62 None goblint-regression/04-mutex_41-pt_rwlock.yml true 10.38 7.66 None goblint-regression/04-mutex_42-trylock_2mutex.yml true 13.58 8.56 None goblint-regression/04-mutex_43-thread_create_nr.yml true 9.61 6.17 None goblint-regression/04-mutex_46-escape_nr.yml unknown 7.35 5.54 None goblint-regression/04-mutex_51-mutex_ptr.yml true 15.11 11.43 None goblint-regression/04-mutex_54-pt_rwlock_ww.yml true 13.83 8.64 None goblint-regression/05-lval_ls_02-idx_nr.yml true 10.58 7.22 None goblint-regression/05-lval_ls_04-fld_nr.yml true 9.22 6.58 None goblint-regression/05-lval_ls_12-fldsense_nr.yml true 15.45 12.89 None goblint-regression/06-symbeq_02-funloop_norace.yml true 46.98 34.42 None goblint-regression/06-symbeq_05-funloop_hard2.yml true 73.00 47.24 None goblint-regression/06-symbeq_06-tricky_address1.yml true 25.75 19.71 None goblint-regression/06-symbeq_07-tricky_address2.yml true 23.91 20.93 None goblint-regression/06-symbeq_08-tricky_address3.yml true 25.18 19.39 None goblint-regression/06-symbeq_11-equ_nr.yml true 14.45 10.75 None goblint-regression/06-symbeq_13-equ_proc_nr.yml true 15.84 10.62 None goblint-regression/06-symbeq_15-list_entry_nr.yml unknown 7.84 4.75 None goblint-regression/06-symbeq_23-idxsense_nr.yml true 26.69 21.76 None goblint-regression/09-regions_02-list_nr.yml true 32.51 24.63 None goblint-regression/09-regions_04-list2_nr.yml true 84.60 69.59 None goblint-regression/09-regions_06-ptra_nr.yml unknown 8.21 4.99 None goblint-regression/09-regions_09-arraylist-deref.yml false(valid-deref) 112.36 82.84 None goblint-regression/09-regions_09-arraylist.yml TIMEOUT 901.79 883.13 None goblint-regression/09-regions_11-arraylist_nr-deref.yml false(valid-deref) 295.24 264.82 None goblint-regression/09-regions_11-arraylist_nr.yml TIMEOUT 901.77 884.46 None goblint-regression/09-regions_12-arraycollapse_rc-deref.yml TIMEOUT 900.70 782.50 None goblint-regression/09-regions_12-arraycollapse_rc.yml TIMEOUT 902.64 838.86 None goblint-regression/09-regions_13-arraycollapse_nr-deref.yml TIMEOUT 901.87 743.21 None goblint-regression/09-regions_13-arraycollapse_nr.yml TIMEOUT 901.64 843.89 None goblint-regression/09-regions_17-arrayloop_nr.yml TIMEOUT 902.09 868.19 None goblint-regression/09-regions_19-nested_nr-deref.yml false(valid-deref) 304.12 279.62 None goblint-regression/09-regions_19-nested_nr.yml TIMEOUT 901.90 875.95 None goblint-regression/09-regions_21-arrayloop2_nr.yml unknown 7.19 4.12 None goblint-regression/09-regions_22-nocollapse.yml unknown 7.34 4.21 None goblint-regression/09-regions_24-evilcollapse_nr.yml unknown 7.39 4.29 None goblint-regression/10-synch_01-thread_unique.yml true 9.79 6.85 None goblint-regression/10-synch_03-two_unique.yml true 10.28 7.08 None goblint-regression/13-privatized_01-priv_nr_true.yml true 11.08 7.35 None goblint-regression/13-privatized_03-priv_inv.yml true 10.59 7.17 None goblint-regression/13-privatized_04-priv_multi_true.yml true 14.17 10.03 None goblint-regression/13-privatized_18-first-reads_true.yml true 11.00 7.24 None goblint-regression/13-privatized_18-first-reads_unknown_1_neg.yml true 9.85 6.76 None goblint-regression/13-privatized_18-first-reads_unknown_1_pos.yml true 9.84 6.77 None goblint-regression/13-privatized_18-first-reads_unknown_2_neg.yml true 9.98 6.77 None goblint-regression/13-privatized_18-first-reads_unknown_2_pos.yml true 9.81 6.66 None goblint-regression/13-privatized_19-publish-precision_true.yml true 10.27 6.93 None goblint-regression/13-privatized_19-publish-precision_unknown_1_neg.yml true 10.24 7.28 None goblint-regression/13-privatized_19-publish-precision_unknown_1_pos.yml true 10.43 6.94 None goblint-regression/13-privatized_19-publish-precision_unknown_2_neg.yml true 10.42 7.13 None goblint-regression/13-privatized_19-publish-precision_unknown_2_pos.yml true 10.57 7.08 None goblint-regression/13-privatized_20-publish-regression_true.yml true 11.02 7.37 None goblint-regression/13-privatized_24-multiple-protecting_true.yml true 12.38 7.94 None goblint-regression/13-privatized_25-struct_nr_true.yml true 10.89 7.32 None goblint-regression/13-privatized_27-multiple-protecting2_true.yml true 19.46 12.64 None goblint-regression/13-privatized_29-multiple-protecting2-vesal_true.yml true 10.65 7.22 None goblint-regression/13-privatized_30-traces-oplus-vs-meet_true.yml true 10.65 7.12 None goblint-regression/13-privatized_31-traces-mine-vs-mutex_true.yml true 9.93 7.22 None goblint-regression/13-privatized_32-traces-mine-vs-oplus-vs-meet_true.yml true 10.74 7.19 None goblint-regression/13-privatized_33-traces-v-matters_true.yml true 10.13 6.68 None goblint-regression/13-privatized_34-traces-minepp-L-needs-to-be-um_true.yml true 9.62 6.19 None goblint-regression/13-privatized_35-traces-ex-2_true.yml true 9.61 6.64 None goblint-regression/13-privatized_36-traces-ex-3_true.yml true 9.39 6.12 None goblint-regression/13-privatized_37-traces-ex-4_true.yml true 9.05 5.95 None goblint-regression/13-privatized_38-traces-ex-4-switch_true.yml true 9.37 6.31 None goblint-regression/13-privatized_40-traces-ex-6_true.yml true 9.93 6.59 None goblint-regression/13-privatized_41-traces-ex-7_unknown_1_neg.yml true 9.54 6.25 None goblint-regression/13-privatized_41-traces-ex-7_unknown_1_pos.yml true 9.07 5.96 None goblint-regression/13-privatized_42-traces-ex-mini_true.yml true 10.12 6.60 None goblint-regression/13-privatized_44-traces-mine2_true.yml true 9.09 5.97 None goblint-regression/13-privatized_45-traces-per-global-and-current-lock-mine-incomparable_true.yml true 9.55 6.09 None goblint-regression/13-privatized_46-refine-protected1_true.yml true 9.76 6.26 None goblint-regression/13-privatized_47-refine-protected2_true.yml true 9.38 6.12 None goblint-regression/13-privatized_52-refine-protected-loop2-small_true.yml true 10.24 7.29 None goblint-regression/13-privatized_57-singlethreaded-unlock_true.yml true 9.24 6.00 None goblint-regression/13-privatized_58-singlethreaded-lock_true.yml true 10.45 6.55 None goblint-regression/13-privatized_66-mine-W-init_true.yml true 9.32 5.98 None goblint-regression/13-privatized_67-pthread_cond_wait_true.yml true 14.40 9.90 None goblint-regression/13-privatized_67-pthread_cond_wait_unknown_1_neg.yml true 14.75 10.44 None goblint-regression/13-privatized_67-pthread_cond_wait_unknown_1_pos.yml true 14.53 10.53 None goblint-regression/13-privatized_68-pfscan_protected_loop_minimal_interval_true.yml true 55.45 41.52 None goblint-regression/13-privatized_69-refine-protected-loop-interval_true.yml true 9.47 6.15 None goblint-regression/28-race_reach_01-simple_racing.yml OUT OF MEMORY 331.55 211.99 None goblint-regression/28-race_reach_02-simple_racefree.yml OUT OF MEMORY 209.69 145.61 None goblint-regression/28-race_reach_03-munge_racing.yml OUT OF MEMORY 307.35 178.08 None goblint-regression/28-race_reach_04-munge_racefree.yml OUT OF MEMORY 94.30 61.74 None goblint-regression/28-race_reach_05-lockfuns_racefree.yml OUT OF MEMORY 162.34 107.12 None goblint-regression/28-race_reach_06-cond_racing1.yml OUT OF MEMORY 252.76 164.61 None goblint-regression/28-race_reach_07-cond_racing2.yml OUT OF MEMORY 81.47 52.81 None goblint-regression/28-race_reach_08-cond_racefree.yml OUT OF MEMORY 174.99 117.84 None goblint-regression/28-race_reach_09-ptrmunge_racing.yml OUT OF MEMORY 85.37 58.86 None goblint-regression/28-race_reach_10-ptrmunge_racefree.yml OUT OF MEMORY 90.81 61.68 None goblint-regression/28-race_reach_11-ptr_racing.yml OUT OF MEMORY 436.29 268.86 None goblint-regression/28-race_reach_12-ptr_racefree.yml OUT OF MEMORY 238.87 148.65 None goblint-regression/28-race_reach_19-callback_racing.yml OUT OF MEMORY 163.74 107.76 None goblint-regression/28-race_reach_20-callback_racefree.yml OUT OF MEMORY 291.25 190.17 None goblint-regression/28-race_reach_21-deref_read_racing.yml OUT OF MEMORY 636.33 368.09 None goblint-regression/28-race_reach_22-deref_read_racefree.yml OUT OF MEMORY 635.00 363.10 None goblint-regression/28-race_reach_23-sound_unlock_racing.yml unknown 7.29 4.20 None goblint-regression/28-race_reach_24-sound_lock_racing.yml OUT OF MEMORY 330.51 208.36 None goblint-regression/28-race_reach_27-funptr_racing.yml OUT OF MEMORY 157.82 91.08 None goblint-regression/28-race_reach_28-funptr_racefree.yml OUT OF MEMORY 382.21 224.06 None goblint-regression/28-race_reach_36-indirect_racefree.yml OUT OF MEMORY 816.21 454.12 None goblint-regression/28-race_reach_37-indirect_racing.yml OUT OF MEMORY 430.84 277.02 None goblint-regression/28-race_reach_40-trylock_racing.yml unknown 7.25 4.29 None goblint-regression/28-race_reach_41-trylock_racefree.yml OUT OF MEMORY 217.03 143.65 None goblint-regression/28-race_reach_42-trylock2_racefree.yml OUT OF MEMORY 160.67 101.47 None goblint-regression/28-race_reach_45-escape_racing.yml unknown 10.03 6.01 None goblint-regression/28-race_reach_46-escape_racefree.yml unknown 9.61 5.30 None goblint-regression/28-race_reach_51-mutexptr_racefree.yml OUT OF MEMORY 252.72 157.29 None goblint-regression/28-race_reach_60-invariant_racefree.yml OUT OF MEMORY 462.34 286.91 None goblint-regression/28-race_reach_61-invariant_racing.yml OUT OF MEMORY 272.85 170.73 None goblint-regression/28-race_reach_70-funloop_racefree.yml OUT OF MEMORY 755.73 477.28 None goblint-regression/28-race_reach_71-funloop_racing.yml OUT OF MEMORY 671.39 440.76 None goblint-regression/28-race_reach_72-funloop_hard_racing.yml OUT OF MEMORY 724.52 480.05 None goblint-regression/28-race_reach_73-funloop_hard_racefree.yml OUT OF MEMORY 625.11 424.05 None goblint-regression/28-race_reach_74-tricky_address1_racefree.yml OUT OF MEMORY 410.41 293.95 None goblint-regression/28-race_reach_75-tricky_address2_racefree.yml OUT OF MEMORY 100.70 73.02 None goblint-regression/28-race_reach_76-tricky_address3_racefree.yml OUT OF MEMORY 267.39 179.35 None goblint-regression/28-race_reach_77-tricky_address4_racing.yml OUT OF MEMORY 217.72 156.28 None goblint-regression/28-race_reach_78-equ_racing.yml OUT OF MEMORY 299.24 213.06 None goblint-regression/28-race_reach_79-equ_racefree.yml OUT OF MEMORY 239.69 163.70 None goblint-regression/28-race_reach_81-list_racing.yml OUT OF MEMORY 408.03 239.43 None goblint-regression/28-race_reach_82-list_racefree.yml OUT OF MEMORY 133.59 88.83 None goblint-regression/28-race_reach_83-list2_racing1.yml OUT OF MEMORY 592.18 326.00 None goblint-regression/28-race_reach_84-list2_racing2.yml OUT OF MEMORY 664.10 353.42 None goblint-regression/28-race_reach_85-list2_racefree.yml OUT OF MEMORY 485.33 261.03 None goblint-regression/28-race_reach_86-lists_racing.yml TIMEOUT 901.38 835.47 None goblint-regression/28-race_reach_87-lists_racefree.yml TIMEOUT 902.47 850.43 None goblint-regression/28-race_reach_90-arrayloop2_racing.yml unknown 10.90 6.18 None goblint-regression/28-race_reach_91-arrayloop2_racefree.yml unknown 10.49 5.77 None goblint-regression/28-race_reach_92-evilcollapse_racing.yml unknown 10.76 5.73 None goblint-regression/28-race_reach_93-evilcollapse_racefree.yml unknown 10.46 5.72 None goblint-regression/28-race_reach_94-alloc_region_racing.yml OUT OF MEMORY 186.47 134.12 None goblint-regression/36-apron_11-traces-max-simple_true.yml true 9.54 6.62 None goblint-regression/36-apron_16-traces-unprot2_true.yml true 12.30 7.46 None goblint-regression/36-apron_17-traces-rpb-litmus_unknown_1_neg.yml true 9.83 6.41 None goblint-regression/36-apron_17-traces-rpb-litmus_unknown_1_pos.yml true 9.71 6.86 None goblint-regression/36-apron_21-traces-cluster-based_true.yml true 17.78 11.45 None goblint-regression/36-apron_22-traces-write-centered-vs-meet-mutex_true_no-overflow.yml true 10.94 6.90 None goblint-regression/36-apron_41-threadenter-no-locals_unknown_1_neg.yml true 9.63 7.10 None goblint-regression/36-apron_41-threadenter-no-locals_unknown_1_pos.yml true 9.64 6.20 None weaver/array-eq-symm.wvr.yml unknown 9.10 5.00 None weaver/array-eq-trans.wvr.yml unknown 7.10 4.38 None weaver/bench-exp1x3.wvr.yml true 15.71 10.55 None weaver/bench-exp2x3.wvr.yml true 26.64 19.03 None weaver/bench-exp2x4.wvr.yml true 35.18 23.77 None weaver/bench-exp2x6.wvr.yml true 71.02 47.61 None weaver/bench-exp2x9.wvr.yml true 130.73 102.22 None weaver/bench-exp3x3-opt.wvr.yml OUT OF MEMORY 104.54 76.74 None weaver/bench-exp3x3.wvr.yml OUT OF MEMORY 128.45 95.05 None weaver/chl-array-int-subst.wvr.yml unknown 9.59 5.37 None weaver/chl-array-int-symm.wvr.yml unknown 9.26 5.06 None weaver/chl-array-int-trans.wvr.yml unknown 8.79 4.92 None weaver/chl-chromosome-opt-symm.wvr.yml unknown 9.22 5.10 None weaver/chl-chromosome-subst.wvr.yml unknown 9.07 4.93 None weaver/chl-chromosome-symm.wvr.yml unknown 9.10 4.94 None weaver/chl-chromosome-trans.wvr.yml unknown 6.83 3.90 None weaver/chl-collitem-subst.wvr.yml true 26.66 17.12 None weaver/chl-collitem-symm.wvr.yml true 19.29 12.26 None weaver/chl-collitem-trans.wvr.yml true 18.58 13.15 None weaver/chl-exp-term-subst.wvr.yml true 133.01 95.28 None weaver/chl-exp-term-symm.wvr.yml true 14.63 10.54 None weaver/chl-file-item-subst.wvr.yml true 261.30 162.92 None weaver/chl-file-item-symm.wvr.yml true 15.61 10.63 None weaver/chl-file-item-trans.wvr.yml OUT OF MEMORY 214.41 133.24 None weaver/chl-match-subst.wvr.yml OUT OF MEMORY 242.97 154.47 None weaver/chl-match-symm.wvr.yml true 30.16 17.82 None weaver/chl-match-trans.wvr.yml OUT OF MEMORY 310.73 181.18 None weaver/chl-name-comparator-subst.wvr.yml unknown 7.63 4.39 None weaver/chl-name-comparator-symm.wvr.yml unknown 6.99 4.46 None weaver/chl-name-comparator-trans.wvr.yml unknown 7.71 4.30 None weaver/chl-node-subst.wvr.yml unknown 7.47 4.54 None weaver/chl-node-symm.wvr.yml unknown 6.82 4.35 None weaver/chl-node-trans.wvr.yml unknown 7.38 4.36 None weaver/chl-nzb-file-subst.wvr.yml OUT OF MEMORY 167.84 101.26 None weaver/chl-nzb-file-symm.wvr.yml OUT OF MEMORY 246.17 173.78 None weaver/chl-nzb-file-trans.wvr.yml OUT OF MEMORY 409.85 227.66 None weaver/chl-poker-hand-subst.wvr.yml unknown 7.57 4.63 None weaver/chl-poker-hand-symm.wvr.yml unknown 7.90 5.00 None weaver/chl-poker-hand-trans.wvr.yml unknown 7.35 4.37 None weaver/chl-simpl-str-subst.wvr.yml true 100.81 77.00 None weaver/chl-simpl-str-symm.wvr.yml true 14.53 10.89 None weaver/chl-simpl-str-trans.wvr.yml true 92.05 65.91 None weaver/chl-sre-subst.wvr.yml true 14.17 11.27 None weaver/chl-sre-symm.wvr.yml true 12.06 9.16 None weaver/chl-sre-trans.wvr.yml true 14.18 11.60 None weaver/chl-time-subst.wvr.yml true 15.90 12.02 None weaver/chl-time-symm.wvr.yml true 13.05 9.62 None weaver/chl-time-trans.wvr.yml true 16.40 12.45 None weaver/chl-word-subst.wvr.yml unknown 6.87 4.11 None weaver/chl-word-symm.wvr.yml unknown 7.28 4.35 None weaver/chl-word-trans.wvr.yml unknown 7.08 4.63 None weaver/clever.wvr.yml true 13.44 10.20 None weaver/fibonacci.wvr.yml true 19.91 13.34 None weaver/loop-tiling-eq.wvr.yml unknown 7.50 4.67 None weaver/mult-comm.wvr.yml true 12.67 9.53 None weaver/mult-dist.wvr.yml true 19.11 14.81 None weaver/mult-flipped-dist.wvr.yml true 17.79 13.32 None weaver/parallel-bakery-2.wvr.yml true 13.74 9.91 None weaver/parallel-bakery-3.wvr.yml true 46.64 29.76 None weaver/parallel-bakery-4.wvr.yml OUT OF MEMORY 165.93 111.19 None weaver/parallel-barrier-loop.wvr.yml OUT OF MEMORY 417.49 230.14 None weaver/parallel-barrier.wvr.yml OUT OF MEMORY 460.17 247.01 None weaver/parallel-bluetooth.wvr.yml true 14.26 10.45 None weaver/parallel-lamport.wvr.yml unknown 7.79 4.92 None weaver/parallel-min-max-1.wvr.yml unknown 9.39 5.19 None weaver/parallel-misc-1.wvr.yml unknown 7.58 4.52 None weaver/parallel-misc-2-unrolled-atomic.wvr.yml true 16.60 10.96 None weaver/parallel-misc-2-unrolled.wvr.yml true 13.02 9.72 None weaver/parallel-misc-2.wvr.yml true 14.56 10.41 None weaver/parallel-misc-3-extended.wvr.yml true 28.08 20.76 None weaver/parallel-misc-3.wvr.yml true 16.39 10.94 None weaver/parallel-misc-4.wvr.yml true 23.17 15.30 None weaver/parallel-misc-5.wvr.yml true 20.27 14.92 None weaver/parallel-parallel-sum-1-dsl.wvr.yml unknown 7.24 4.38 None weaver/parallel-parallel-sum-1.wvr.yml unknown 8.93 4.93 None weaver/parallel-parallel-sum-2.wvr.yml unknown 7.22 4.58 None weaver/parallel-parallel-sum-equiv.wvr.yml unknown 9.33 5.06 None weaver/parallel-simple-equiv.wvr.yml true 18.50 13.03 None weaver/parallel-ticket-2.wvr.yml true 13.11 9.96 None weaver/parallel-ticket-3.wvr.yml true 24.79 15.95 None weaver/parallel-ticket-4.wvr.yml true 50.16 35.19 None weaver/parallel-ticket-5.wvr.yml OUT OF MEMORY 232.38 164.82 None weaver/parallel-ticket-6.wvr.yml OUT OF MEMORY 290.74 205.44 None weaver/parallel-ticket-7.wvr.yml OUT OF MEMORY 266.95 169.69 None weaver/parallel-ticket-8.wvr.yml OUT OF MEMORY 453.82 265.51 None weaver/popl20-bad-buffer-mult-alt.wvr.yml unknown 9.30 5.00 None weaver/popl20-bad-buffer-mult-alt2.wvr.yml unknown 8.98 4.86 None weaver/popl20-bad-commit-1.wvr-bad.yml unknown 6.96 3.90 None weaver/popl20-bad-commit-2.wvr-bad.yml unknown 9.09 4.91 None weaver/popl20-bad-counter-queue.wvr.yml unknown 6.77 3.96 None weaver/popl20-bad-counter-queue2.wvr.yml unknown 8.53 4.68 None weaver/popl20-bad-dot-product-alt.wvr.yml unknown 6.58 3.87 None weaver/popl20-bad-dot-product.wvr.yml unknown 9.41 5.07 None weaver/popl20-bad-ring-nondet.wvr.yml unknown 7.50 4.95 None weaver/popl20-bad-ring.wvr.yml unknown 8.86 4.86 None weaver/popl20-bad-threaded-sum-2.wvr.yml true 12.87 9.39 None weaver/popl20-bad-three-array-sum-alt.wvr.yml unknown 9.37 5.20 None weaver/popl20-channel-sum.wvr.yml unknown 7.32 4.54 None weaver/popl20-commit-1.wvr.yml unknown 9.05 4.88 None weaver/popl20-commit-2.wvr.yml unknown 7.61 4.55 None weaver/popl20-counter-determinism.wvr.yml true 69.60 48.42 None weaver/popl20-counter-fun.wvr.yml unknown 8.74 4.76 None weaver/popl20-difference-det.wvr.yml true 51.50 39.84 None weaver/popl20-figure1-alt.wvr.yml true 13.18 10.08 None weaver/popl20-figure1.wvr.yml true 14.86 10.10 None weaver/popl20-figure3.wvr.yml true 12.90 10.39 None weaver/popl20-horseshoe.wvr.yml unknown 9.04 4.85 None weaver/popl20-min-max-dec.wvr.yml unknown 9.06 4.85 None weaver/popl20-min-max-inc-dec.wvr.yml unknown 6.86 4.39 None weaver/popl20-min-max-inc.wvr.yml unknown 7.67 4.62 None weaver/popl20-more-array-sum-alt.wvr.yml unknown 8.89 4.86 None weaver/popl20-more-array-sum-alt2.wvr.yml unknown 6.89 4.11 None weaver/popl20-more-array-sum.wvr.yml unknown 6.82 4.55 None weaver/popl20-more-array-sum2.wvr.yml unknown 7.87 4.74 None weaver/popl20-more-buffer-mult.wvr.yml unknown 9.12 5.01 None weaver/popl20-more-buffer-mult2.wvr.yml unknown 6.90 4.14 None weaver/popl20-more-buffer-series.wvr.yml unknown 7.53 4.62 None weaver/popl20-more-buffer-series2.wvr.yml unknown 8.56 4.72 None weaver/popl20-more-dec-subseq.wvr.yml unknown 7.04 4.49 None weaver/popl20-more-inc-subseq.wvr.yml unknown 7.59 5.12 None weaver/popl20-more-max-array-hom.wvr.yml unknown 7.54 4.30 None weaver/popl20-more-max-array.wvr.yml unknown 8.86 4.90 None weaver/popl20-more-min-array-hom.wvr.yml unknown 6.77 4.21 None weaver/popl20-more-min-array.wvr.yml unknown 7.01 4.28 None weaver/popl20-more-min-le-max.wvr.yml unknown 6.74 3.85 None weaver/popl20-more-mts.wvr.yml unknown 7.43 4.62 None weaver/popl20-more-multiply-verify.wvr.yml unknown 9.01 4.98 None weaver/popl20-more-nonblocking-counter-alt2.wvr.yml true 16.63 11.28 None weaver/popl20-more-queue-add-2-nl.wvr.yml unknown 7.14 4.47 None weaver/popl20-more-queue-add-3-nl.wvr.yml unknown 7.24 4.42 None weaver/popl20-more-sorted.wvr.yml unknown 7.00 3.98 None weaver/popl20-more-sum-array-hom.wvr.yml unknown 7.51 4.57 None weaver/popl20-more-vector-add.wvr.yml unknown 8.71 4.85 None weaver/popl20-mult-4.wvr.yml true 64.56 48.55 None weaver/popl20-mult-equiv.wvr.yml true 15.84 11.72 None weaver/popl20-nonblocking-cntr-alt.wvr.yml true 12.55 9.55 None weaver/popl20-nonblocking-cntr.wvr.yml true 13.20 10.47 None weaver/popl20-prod-cons-eq.wvr.yml unknown 9.23 5.03 None weaver/popl20-prod-cons.wvr.yml unknown 9.60 5.34 None weaver/popl20-prod-cons3.wvr.yml unknown 8.70 4.81 None weaver/popl20-proofs-counter-add-4-semi-Q67.wvr.yml true 28.09 19.48 None weaver/popl20-queue-add-2.wvr.yml unknown 7.01 4.09 None weaver/popl20-queue-add-3.wvr.yml unknown 9.64 5.27 None weaver/popl20-send-receive-alt.wvr.yml unknown 7.65 4.55 None weaver/popl20-send-receive.wvr.yml unknown 9.11 5.00 None weaver/popl20-simple-array-sum.wvr.yml unknown 7.15 4.16 None weaver/popl20-simple-queue.wvr.yml unknown 7.68 4.66 None weaver/popl20-threaded-sum-3.wvr.yml true 24.04 15.63 None weaver/popl20-three-array-max.wvr.yml unknown 8.76 4.85 None weaver/popl20-three-array-min.wvr.yml unknown 7.22 4.14 None weaver/popl20-three-array-sum.wvr.yml unknown 7.11 4.37 None weaver/popl20-two-queue.wvr.yml unknown 8.69 4.79 None weaver/security.wvr.yml true 11.39 8.48 None weaver/spaghetti.wvr.yml true 80.44 63.64 None weaver/test-context1.wvr.yml unknown 8.50 4.75 None weaver/test-easy1.wvr.yml true 11.89 9.18 None weaver/test-easy10.wvr.yml true 67.38 45.25 None weaver/test-easy11.wvr.yml true 12.13 8.68 None weaver/test-easy6.wvr.yml true 15.58 10.48 None weaver/test-easy7.wvr.yml true 12.61 9.45 None weaver/test-easy8.wvr.yml true 11.84 8.80 None weaver/test-hard1.wvr.yml true 49.53 31.02 None weaver/test-semi1.wvr.yml true 11.49 9.03 None weaver/unroll-2.wvr.yml unknown 7.14 4.48 None weaver/unroll-3.wvr.yml unknown 6.95 4.05 None weaver/unroll-4.wvr.yml unknown 7.16 4.25 None weaver/unroll-5.wvr.yml unknown 7.01 3.96 None weaver/unroll-cond-2.wvr.yml unknown 6.93 4.44 None weaver/unroll-cond-3.wvr.yml unknown 7.17 4.35 None weaver/unroll-cond-4.wvr.yml unknown 6.75 3.89 None weaver/unroll-cond-5.wvr.yml unknown 6.65 4.23 None pthread-deagle/arithmetic_prog_bad.yml true 17.91 11.95 None pthread-deagle/arithmetic_prog_ok.yml true 17.05 11.22 None pthread-deagle/circular_buffer_bad.yml ERROR: EXCEPTION 853.33 820.03 None pthread-deagle/circular_buffer_ok.yml true 49.80 35.23 None ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 8 done 84146.31 5370.06 - GemCutter.SleepMap.Incremental5_Seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 9 of 26: skipped GemCutter.SleepMap.Incremental10_Seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 10 of 26: skipped GemCutter.SleepMap.Incremental5_Seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 11 of 26: skipped GemCutter.SleepMap.Incremental10_Seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 12 of 26: skipped GemCutter.SleepMap.Flip05_seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 13 of 26: skipped GemCutter.SleepMap.Flip10_seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 14 of 26: skipped GemCutter.SleepMap.Flip15_seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 15 of 26: skipped GemCutter.SleepMap.Flip85_seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 16 of 26: skipped GemCutter.SleepMap.Flip90_seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 17 of 26: skipped GemCutter.SleepMap.Flip95_seed0_FALLBACK.SVCOMP-Concurrency-SafeDeref Run set 18 of 26: skipped GemCutter.SleepMap.Flip05_seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 19 of 26: skipped GemCutter.SleepMap.Flip10_seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 20 of 26: skipped GemCutter.SleepMap.Flip15_seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 21 of 26: skipped GemCutter.SleepMap.Flip85_seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 22 of 26: skipped GemCutter.SleepMap.Flip90_seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 23 of 26: skipped GemCutter.SleepMap.Flip95_seed0_PURE.SVCOMP-Concurrency-SafeDeref Run set 24 of 26: skipped GemCutter.NewStatesSleepPersistentFixedOrder.VarAbsGlobalSyntactic.SVCOMP-Concurrency-SafeDeref Run set 25 of 26: skipped GemCutter.NewStatesSleepPersistentFixedOrder.VarAbsGlobalSyntactic.Badger.SVCOMP-Concurrency-SafeDeref Run set 26 of 26: skipped Statistics: 744 Files correct: 444 correct true: 439 correct false: 5 incorrect: 0 incorrect true: 0 incorrect false: 0 unknown: 300 Score: 883 (max: 1480)