BENCHMARK INFORMATION benchmark definition: ../benchexec/concurrency-witness-validation.xml name: concurrency-witness-validation run sets: validate-goblint-witnesses date: Fri, 2024-02-02 16:06:36 CET tool: ULTIMATE Automizer 0.2.4-13967880 tool executable: ./Ultimate.py options: --full-output parallel runs: 14 resource limits: - memory: 8000.0 MB - time: 900 s - cpu cores: 2 hardware requirements: - cpu cores: 2 - memory: 8000.0 MB ------------------------------------------------------------ SYSTEM INFORMATION host: bench-02 os: Linux-5.15.108-1-pve-x86_64-with-glibc2.36 cpu: AMD Ryzen Threadripper 3970X 32-Core Processor - cores: 32 - max frequency: 3700.0 MHz - turbo boost enabled: True ram: 137438.953472 MB ------------------------------------------------------------ verify Run set 1 of 2: skipped validate-goblint-witnesses Run set 2 of 2 with options '--full-output --witness-type correctness_witness --witnessparser.only.consider.loop.invariants false --validate ./goblint.2023-12-19_14-39-08.files/SV-COMP24_unreach-call/${taskdef_name}/witness.yml' and propertyfile 'None' inputfile status cpu time wall time host ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ pthread-wmm/safe009_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 69.31 45.28 None pthread/bigshot_s.yml true 315.73 302.38 None pthread/bigshot_s2.yml OUT OF MEMORY 494.63 458.28 None pthread/fib_safe-10.yml unknown 16.82 10.58 None pthread/fib_safe-11.yml unknown 16.55 9.49 None pthread/fib_safe-12.yml unknown 20.41 11.28 None pthread/fib_safe-5.yml unknown 16.49 10.18 None pthread/fib_safe-6.yml unknown 20.47 11.21 None pthread/fib_safe-7.yml unknown 17.18 10.71 None pthread/queue_ok.yml ERROR (7) 16.72 10.09 None pthread/queue_ok_longer.yml ERROR (7) 16.54 10.19 None pthread/queue_ok_longest.yml ERROR (7) 15.63 9.25 None pthread/singleton_with-uninit-problems.yml true 26.80 15.60 None pthread/stack-1.yml OUT OF MEMORY 96.29 64.14 None pthread/stack_longer-2.yml OUT OF MEMORY 106.24 71.78 None pthread/stack_longest-2.yml OUT OF MEMORY 94.41 64.31 None pthread/stateful01-2.yml true 22.51 13.54 None pthread/sync01.yml true 15.64 9.13 None pthread/triangular-1.yml unknown 16.60 10.09 None pthread/triangular-longer-1.yml unknown 16.93 10.57 None pthread/triangular-longest-1.yml unknown 16.82 10.48 None pthread-atomic/dekker.yml ERROR (7) 19.46 10.68 None pthread-atomic/lamport.yml unknown 24.80 13.87 None pthread-atomic/peterson.yml unknown 18.12 11.25 None pthread-atomic/read_write_lock-1-pthread.yml OUT OF MEMORY 95.76 60.51 None pthread-atomic/read_write_lock-1.yml ERROR (7) 14.93 9.34 None pthread-atomic/szymanski.yml OUT OF MEMORY 119.41 91.04 None pthread-atomic/time_var_mutex.yml ERROR (7) 14.18 9.36 None pthread-ext/01b_inc-pthread.yml OUT OF MEMORY 83.52 52.98 None pthread-ext/01b_inc.yml ERROR (7) 15.06 9.59 None pthread-ext/02_inc_cas.yml ERROR (7) 18.03 10.02 None pthread-ext/03_incdec-pthread.yml false(unreach-call) 12.18 7.28 None pthread-ext/03_incdec.yml ERROR (7) 14.12 8.94 None pthread-ext/04_incdec_cas.yml ERROR (7) 14.98 8.93 None pthread-ext/08_rand_cas.yml ERROR (7) 14.64 9.15 None pthread-ext/09_fmaxsym-pthread.yml ERROR (7) 14.74 9.22 None pthread-ext/09_fmaxsym-zero.yml unknown 0.04 0.04 None pthread-ext/09_fmaxsym.yml ERROR (7) 17.68 9.76 None pthread-ext/11_fmaxsymopt-pthread.yml ERROR (7) 15.04 9.42 None pthread-ext/11_fmaxsymopt-zero.yml unknown 0.03 0.03 None pthread-ext/11_fmaxsymopt.yml ERROR (7) 14.79 9.15 None pthread-ext/14_spin2003-pthread.yml OUT OF MEMORY 91.98 59.15 None pthread-ext/14_spin2003.yml ERROR (7) 14.17 8.71 None pthread-ext/18_read_write_lock-pthread.yml ERROR (7) 16.93 10.30 None pthread-ext/18_read_write_lock.yml ERROR (7) 19.02 10.64 None pthread-ext/25_stack-pthread.yml ERROR (7) 14.31 8.77 None pthread-ext/25_stack.yml ERROR (7) 14.92 9.29 None pthread-ext/25_stack_longer-2-pthread.yml ERROR (7) 14.95 9.37 None pthread-ext/25_stack_longer-2.yml ERROR (7) 14.74 9.55 None pthread-ext/25_stack_longest-1-pthread.yml ERROR (7) 18.05 10.15 None pthread-ext/25_stack_longest-1.yml ERROR (7) 15.59 9.51 None pthread-ext/26_stack_cas.yml ERROR (7) 15.42 9.47 None pthread-ext/26_stack_cas_longer-2.yml ERROR (7) 14.72 8.95 None pthread-ext/26_stack_cas_longest-2.yml ERROR (7) 14.32 8.60 None pthread-ext/29_conditionals_vs.yml ERROR (7) 15.01 9.44 None pthread-ext/31_simple_loop5_vs-pthread.yml OUT OF MEMORY 71.99 45.81 None pthread-ext/31_simple_loop5_vs.yml ERROR (7) 14.55 9.34 None pthread-ext/35_double_lock_p3_vs-pthread.yml OUT OF MEMORY 58.29 38.04 None pthread-ext/35_double_lock_p3_vs.yml ERROR (7) 14.49 8.87 None pthread-ext/36_stack_cas_p0_vs_concur.yml ERROR (7) 14.57 8.72 None pthread-ext/37_stack_lock_p0_vs_concur-pthread.yml ERROR (7) 14.21 8.38 None pthread-ext/37_stack_lock_p0_vs_concur.yml ERROR (7) 14.75 9.15 None pthread-ext/39_rand_lock_p0_vs-pthread.yml ERROR (7) 17.92 10.00 None pthread-ext/39_rand_lock_p0_vs.yml ERROR (7) 14.99 9.41 None pthread-ext/43_NetBSD_sysmon_power_sliced-pthread.yml OUT OF MEMORY 59.83 36.80 None pthread-ext/43_NetBSD_sysmon_power_sliced.yml ERROR (7) 14.08 8.98 None pthread-ext/45_monabsex1_vs.yml OUT OF MEMORY 61.16 41.17 None pthread-ext/46_monabsex2_vs.yml OUT OF MEMORY 59.22 39.84 None pthread-ext/48_ticket_lock_low_contention_vs-pthread.yml OUT OF MEMORY 69.72 46.37 None pthread-ext/48_ticket_lock_low_contention_vs.yml ERROR (7) 19.07 11.70 None pthread-wmm/rfi000_tso.yml ERROR (7) 24.95 13.81 None pthread-wmm/rfi002_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 20.10 12.72 None pthread-wmm/rfi002_tso.yml ERROR (7) 24.19 15.88 None pthread-wmm/rfi003_tso.yml ERROR (7) 19.06 11.71 None pthread-wmm/safe000_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 64.26 39.86 None pthread-wmm/safe001_tso.yml OUT OF MEMORY 54.31 37.16 None pthread-wmm/safe002_tso.yml OUT OF MEMORY 63.25 40.25 None pthread-wmm/safe003_tso.yml OUT OF MEMORY 55.62 38.16 None pthread-wmm/safe004_tso.yml OUT OF MEMORY 55.64 36.88 None pthread-wmm/safe005_tso.yml OUT OF MEMORY 54.95 37.35 None pthread-wmm/safe006_pso.oepc_pso.opt_tso.oepc_tso.opt-thin000_pso.oepc_pso.opt_tso.oepc_tso.opt.yml false(unreach-call) 306.12 265.77 None pthread-wmm/safe007_pso.oepc_pso.opt_tso.oepc_tso.opt-thin001_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 67.84 42.21 None pthread-wmm/safe008_tso.yml OUT OF MEMORY 47.53 31.27 None pthread-wmm/safe009_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 54.16 35.94 None pthread-wmm/safe010_tso.yml false(unreach-call) 263.55 230.06 None pthread-wmm/safe011_tso.yml OUT OF MEMORY 51.72 34.78 None pthread-wmm/safe012_tso.yml OUT OF MEMORY 66.64 42.40 None pthread-wmm/safe013_tso.yml OUT OF MEMORY 53.82 35.84 None pthread-wmm/safe014_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 62.63 39.02 None pthread-wmm/safe015_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 55.10 37.42 None pthread-wmm/safe016_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 54.74 35.72 None pthread-wmm/safe017_tso.yml OUT OF MEMORY 54.20 37.03 None pthread-wmm/safe018_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 52.31 34.69 None pthread-wmm/safe019_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 66.74 41.65 None pthread-wmm/safe020_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 55.85 37.64 None pthread-wmm/safe021_tso.yml OUT OF MEMORY 54.96 36.53 None pthread-wmm/safe022_tso.yml false(unreach-call) 356.66 320.24 None pthread-wmm/safe023_tso.yml OUT OF MEMORY 59.55 41.53 None pthread-wmm/safe024_tso.yml OUT OF MEMORY 69.63 44.59 None pthread-wmm/safe025_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 64.54 40.15 None pthread-wmm/safe026_tso.yml OUT OF MEMORY 58.95 39.90 None pthread-wmm/safe027_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 53.79 36.50 None pthread-wmm/safe028_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 53.68 35.02 None pthread-wmm/safe029_tso.yml false(unreach-call) 253.25 218.74 None pthread-wmm/safe030_tso.yml OUT OF MEMORY 69.75 44.22 None pthread-wmm/safe031_tso.yml OUT OF MEMORY 56.15 38.00 None pthread-wmm/safe032_tso.yml OUT OF MEMORY 52.18 36.53 None pthread-wmm/safe033_tso.yml false(unreach-call) 256.95 222.57 None pthread-wmm/safe034_tso.yml OUT OF MEMORY 65.88 41.57 None pthread-wmm/safe035_power.yml ERROR (7) 21.33 13.88 None pthread-wmm/safe035_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 56.93 39.27 None pthread-wmm/safe036.yml false(unreach-call) 374.89 308.28 None pthread-wmm/safe037.yml OUT OF MEMORY 56.61 39.65 None pthread-wmm/thin002_pso.oepc_pso.opt_tso.oepc_tso.opt.yml OUT OF MEMORY 48.56 32.16 None pthread-lit/sssc12-pthread.yml ERROR (7) 18.53 10.53 None pthread-lit/sssc12.yml ERROR (7) 20.02 11.16 None pthread-lit/sssc12_variant-pthread.yml ERROR (7) 15.89 9.80 None pthread-lit/sssc12_variant.yml ERROR (7) 15.75 11.02 None ldv-races/race-1_1-join.yml ERROR (7) 18.17 10.31 None ldv-races/race-2_1-container_of.yml ERROR (7) 19.46 10.67 None ldv-races/race-3_1-container_of-global.yml ERROR (7) 16.21 9.78 None ldv-races/race-4_1-thread_local_vars.yml ERROR (7) 14.81 8.47 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-1.yml ERROR (7) 124.66 111.87 None pthread-complex/workstealqueue_mutex-2.yml unknown 0.04 0.04 None pthread-driver-races/char_generic_nvram_nvram_unlocked_ioctl_write_nvram.yml ERROR (7) 19.85 10.97 None pthread-driver-races/char_generic_nvram_read_nvram_nvram_unlocked_ioctl.yml ERROR (7) 18.76 11.64 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_configure.yml ERROR (7) 22.31 12.30 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_get.yml ERROR (7) 18.18 11.46 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_configure_pc8736x_gpio_current.yml ERROR (7) 17.00 9.77 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_configure_pc8736x_gpio_get.yml ERROR (7) 20.68 11.64 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_configure_pc8736x_gpio_set.yml ERROR (7) 16.24 10.18 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_get.yml ERROR (7) 18.85 12.00 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_get_pc8736x_gpio_set.yml ERROR (7) 24.51 14.14 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_change.yml ERROR (7) 16.62 9.41 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_configure.yml ERROR (7) 16.76 10.47 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_current.yml ERROR (7) 16.66 10.59 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_get.yml ERROR (7) 25.71 14.89 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_open_pc8736x_gpio_set.yml ERROR (7) 17.92 10.76 None pthread-C-DAC/pthread-demo-datarace-1.yml ERROR (7) 15.06 10.01 None pthread-C-DAC/pthread-finding-k-matches.yml ERROR (7) 22.63 12.62 None pthread-C-DAC/pthread-numerical-integration.yml ERROR (7) 15.70 9.44 None pthread-divine/tls_basic.yml ERROR (7) 14.82 9.18 None goblint-regression/13-privatized_01-priv_nr_true.yml unknown 15.63 9.08 None goblint-regression/13-privatized_04-priv_multi_true.yml unknown 18.01 11.03 None goblint-regression/13-privatized_18-first-reads_true.yml unknown 20.47 11.20 None goblint-regression/13-privatized_19-publish-precision_true.yml unknown 15.92 10.73 None goblint-regression/13-privatized_20-publish-regression_true.yml unknown 20.20 11.19 None goblint-regression/13-privatized_24-multiple-protecting_true.yml unknown 17.06 11.01 None goblint-regression/13-privatized_25-struct_nr_true.yml unknown 16.10 9.38 None goblint-regression/13-privatized_27-multiple-protecting2_true.yml unknown 17.70 10.95 None goblint-regression/13-privatized_29-multiple-protecting2-vesal_true.yml unknown 19.96 11.07 None goblint-regression/13-privatized_30-traces-oplus-vs-meet_true.yml unknown 16.25 10.66 None goblint-regression/13-privatized_31-traces-mine-vs-mutex_true.yml unknown 20.60 11.33 None goblint-regression/13-privatized_32-traces-mine-vs-oplus-vs-meet_true.yml unknown 16.34 10.01 None goblint-regression/13-privatized_33-traces-v-matters_true.yml true 15.86 8.96 None goblint-regression/13-privatized_34-traces-minepp-L-needs-to-be-um_true.yml unknown 16.82 10.22 None goblint-regression/13-privatized_35-traces-ex-2_true.yml unknown 18.95 10.69 None goblint-regression/13-privatized_36-traces-ex-3_true.yml unknown 16.02 10.04 None goblint-regression/13-privatized_37-traces-ex-4_true.yml unknown 14.52 8.64 None goblint-regression/13-privatized_38-traces-ex-4-switch_true.yml unknown 20.14 11.39 None goblint-regression/13-privatized_40-traces-ex-6_true.yml true 13.90 8.39 None goblint-regression/13-privatized_42-traces-ex-mini_true.yml unknown 16.50 10.35 None goblint-regression/13-privatized_44-traces-mine2_true.yml unknown 15.68 9.83 None goblint-regression/13-privatized_45-traces-per-global-and-current-lock-mine-incomparable_true.yml unknown 19.32 10.87 None goblint-regression/13-privatized_46-refine-protected1_true.yml unknown 14.93 8.59 None goblint-regression/13-privatized_47-refine-protected2_true.yml unknown 18.16 11.16 None goblint-regression/13-privatized_52-refine-protected-loop2-small_true.yml unknown 16.18 10.27 None goblint-regression/13-privatized_57-singlethreaded-unlock_true.yml true 14.41 8.03 None goblint-regression/13-privatized_58-singlethreaded-lock_true.yml unknown 16.16 10.10 None goblint-regression/13-privatized_66-mine-W-init_true.yml true 10.55 7.17 None goblint-regression/13-privatized_68-pfscan_protected_loop_minimal_interval_true.yml unknown 15.31 8.81 None goblint-regression/13-privatized_69-refine-protected-loop-interval_true.yml unknown 19.53 10.79 None goblint-regression/28-race_reach_02-simple_racefree.yml unknown 15.92 9.81 None goblint-regression/28-race_reach_04-munge_racefree.yml ERROR (7) 17.86 10.37 None goblint-regression/28-race_reach_05-lockfuns_racefree.yml ERROR (7) 15.14 9.42 None goblint-regression/28-race_reach_08-cond_racefree.yml ERROR (7) 14.56 9.90 None goblint-regression/28-race_reach_10-ptrmunge_racefree.yml ERROR (7) 14.77 9.47 None goblint-regression/28-race_reach_12-ptr_racefree.yml unknown 15.53 9.05 None goblint-regression/28-race_reach_20-callback_racefree.yml ERROR (7) 16.21 10.72 None goblint-regression/28-race_reach_22-deref_read_racefree.yml unknown 19.71 10.97 None goblint-regression/28-race_reach_28-funptr_racefree.yml unknown 17.08 10.73 None goblint-regression/28-race_reach_36-indirect_racefree.yml unknown 20.05 11.12 None goblint-regression/28-race_reach_41-trylock_racefree.yml unknown 16.72 10.19 None goblint-regression/28-race_reach_42-trylock2_racefree.yml unknown 17.17 10.19 None goblint-regression/28-race_reach_46-escape_racefree.yml ERROR (7) 16.63 9.88 None goblint-regression/28-race_reach_51-mutexptr_racefree.yml unknown 16.76 9.60 None goblint-regression/28-race_reach_60-invariant_racefree.yml unknown 17.31 10.71 None goblint-regression/28-race_reach_70-funloop_racefree.yml false(unreach-call) 12.80 7.57 None goblint-regression/28-race_reach_73-funloop_hard_racefree.yml false(unreach-call) 16.68 9.22 None goblint-regression/28-race_reach_74-tricky_address1_racefree.yml ERROR (7) 21.68 12.17 None goblint-regression/28-race_reach_75-tricky_address2_racefree.yml ERROR (7) 17.66 11.07 None goblint-regression/28-race_reach_76-tricky_address3_racefree.yml ERROR (7) 17.01 11.59 None goblint-regression/28-race_reach_79-equ_racefree.yml unknown 18.50 11.91 None goblint-regression/28-race_reach_85-list2_racefree.yml unknown 18.59 11.20 None goblint-regression/28-race_reach_87-lists_racefree.yml unknown 16.77 9.54 None goblint-regression/28-race_reach_91-arrayloop2_racefree.yml unknown 17.75 10.78 None goblint-regression/28-race_reach_93-evilcollapse_racefree.yml unknown 21.72 11.88 None goblint-regression/36-apron_11-traces-max-simple_true.yml unknown 17.10 10.58 None goblint-regression/36-apron_16-traces-unprot2_true.yml ERROR (7) 18.26 10.31 None goblint-regression/36-apron_21-traces-cluster-based_true.yml OUT OF MEMORY 63.43 45.21 None goblint-regression/36-apron_22-traces-write-centered-vs-meet-mutex_true_no-overflow.yml ERROR (7) 14.08 8.07 None weaver/array-eq-symm.wvr.yml ERROR (7) 14.27 9.37 None weaver/array-eq-trans.wvr.yml ERROR (7) 14.97 9.18 None weaver/bench-exp1x3.wvr.yml ERROR (7) 14.29 8.54 None weaver/bench-exp2x3.wvr.yml ERROR (7) 14.55 8.81 None weaver/bench-exp2x4.wvr.yml ERROR (7) 17.32 9.71 None weaver/bench-exp2x6.wvr.yml ERROR (7) 14.62 9.46 None weaver/bench-exp2x9.wvr.yml ERROR (7) 12.75 7.41 None weaver/bench-exp3x3-opt.wvr.yml ERROR (7) 17.65 9.74 None weaver/bench-exp3x3.wvr.yml ERROR (7) 14.40 9.00 None weaver/chl-array-int-subst.wvr.yml ERROR (7) 14.30 9.08 None weaver/chl-array-int-symm.wvr.yml ERROR (7) 14.38 8.98 None weaver/chl-array-int-trans.wvr.yml ERROR (7) 14.44 8.66 None weaver/chl-chromosome-opt-symm.wvr.yml ERROR (7) 14.38 8.71 None weaver/chl-chromosome-subst.wvr.yml ERROR (7) 13.47 7.87 None weaver/chl-chromosome-symm.wvr.yml ERROR (7) 15.88 10.15 None weaver/chl-chromosome-trans.wvr.yml ERROR (7) 18.16 10.14 None weaver/chl-collitem-subst.wvr.yml ERROR (7) 18.30 10.19 None weaver/chl-collitem-symm.wvr.yml ERROR (7) 15.44 9.60 None weaver/chl-collitem-trans.wvr.yml ERROR (7) 14.32 8.79 None weaver/chl-exp-term-subst.wvr.yml ERROR (7) 14.45 8.78 None weaver/chl-exp-term-symm.wvr.yml ERROR (7) 14.35 8.87 None weaver/chl-file-item-subst.wvr.yml ERROR (7) 14.07 8.45 None weaver/chl-file-item-symm.wvr.yml ERROR (7) 13.46 7.92 None weaver/chl-file-item-trans.wvr.yml ERROR (7) 15.28 9.39 None weaver/chl-match-subst.wvr.yml ERROR (7) 17.66 9.85 None weaver/chl-match-symm.wvr.yml ERROR (7) 13.96 9.19 None weaver/chl-match-trans.wvr.yml ERROR (7) 18.18 10.10 None weaver/chl-name-comparator-subst.wvr.yml ERROR (7) 15.08 9.29 None weaver/chl-name-comparator-symm.wvr.yml ERROR (7) 15.14 9.35 None weaver/chl-name-comparator-trans.wvr.yml ERROR (7) 14.58 9.26 None weaver/chl-node-subst.wvr.yml ERROR (7) 14.52 8.78 None weaver/chl-node-symm.wvr.yml ERROR (7) 14.13 8.38 None weaver/chl-node-trans.wvr.yml ERROR (7) 15.61 9.66 None weaver/chl-nzb-file-subst.wvr.yml ERROR (7) 18.35 10.07 None weaver/chl-nzb-file-symm.wvr.yml ERROR (7) 14.24 9.80 None weaver/chl-nzb-file-trans.wvr.yml ERROR (7) 14.90 9.42 None weaver/chl-poker-hand-subst.wvr.yml ERROR (7) 17.14 10.29 None weaver/chl-poker-hand-symm.wvr.yml ERROR (7) 20.45 11.25 None weaver/chl-poker-hand-trans.wvr.yml ERROR (7) 17.10 10.41 None weaver/chl-simpl-str-subst.wvr.yml ERROR (7) 13.94 8.27 None weaver/chl-simpl-str-symm.wvr.yml ERROR (7) 14.26 8.29 None weaver/chl-simpl-str-trans.wvr.yml ERROR (7) 14.33 8.77 None weaver/chl-sre-subst.wvr.yml ERROR (7) 14.85 9.22 None weaver/chl-sre-symm.wvr.yml ERROR (7) 15.70 10.33 None weaver/chl-sre-trans.wvr.yml ERROR (7) 17.48 9.94 None weaver/chl-time-subst.wvr.yml ERROR (7) 15.19 10.26 None weaver/chl-time-symm.wvr.yml ERROR (7) 14.85 9.58 None weaver/chl-time-trans.wvr.yml ERROR (7) 15.55 9.78 None weaver/chl-word-subst.wvr.yml ERROR (7) 14.79 8.58 None weaver/chl-word-symm.wvr.yml ERROR (7) 13.89 8.37 None weaver/chl-word-trans.wvr.yml ERROR (7) 19.33 10.58 None weaver/clever.wvr.yml ERROR (7) 14.61 10.21 None weaver/fibonacci.wvr.yml ERROR (7) 15.22 8.84 None weaver/loop-tiling-eq.wvr.yml unknown 15.45 9.28 None weaver/mult-comm.wvr.yml ERROR (7) 14.25 9.75 None weaver/mult-dist.wvr.yml ERROR (7) 18.19 10.39 None weaver/mult-flipped-dist.wvr.yml ERROR (7) 15.71 11.14 None weaver/parallel-bakery-2.wvr.yml ERROR (7) 16.26 10.90 None weaver/parallel-bakery-3.wvr.yml ERROR (7) 14.59 8.64 None weaver/parallel-bakery-4.wvr.yml ERROR (7) 15.60 9.14 None weaver/parallel-barrier.wvr.yml ERROR (7) 15.93 10.40 None weaver/parallel-bluetooth.wvr.yml ERROR (7) 15.16 10.04 None weaver/parallel-lamport.wvr.yml ERROR (7) 15.40 9.37 None weaver/parallel-min-max-1.wvr.yml ERROR (7) 14.50 8.69 None weaver/parallel-misc-1.wvr.yml ERROR (7) 18.31 10.22 None weaver/parallel-misc-2-unrolled-atomic.wvr.yml ERROR (7) 15.23 9.41 None weaver/parallel-misc-2-unrolled.wvr.yml ERROR (7) 14.56 9.26 None weaver/parallel-misc-2.wvr.yml ERROR (7) 13.81 8.54 None weaver/parallel-misc-3-extended.wvr.yml ERROR (7) 14.10 8.42 None weaver/parallel-misc-3.wvr.yml ERROR (7) 17.79 10.39 None weaver/parallel-misc-4.wvr.yml ERROR (7) 16.43 10.81 None weaver/parallel-misc-5.wvr.yml ERROR (7) 14.78 9.41 None weaver/parallel-parallel-sum-1-dsl.wvr.yml ERROR (7) 15.08 9.71 None weaver/parallel-parallel-sum-1.wvr.yml ERROR (7) 15.26 9.68 None weaver/parallel-parallel-sum-2.wvr.yml ERROR (7) 14.59 8.55 None weaver/parallel-parallel-sum-equiv.wvr.yml ERROR (7) 15.08 9.00 None weaver/parallel-simple-equiv.wvr.yml ERROR (7) 14.79 9.31 None weaver/parallel-ticket-2.wvr.yml ERROR (7) 18.42 10.45 None weaver/parallel-ticket-3.wvr.yml ERROR (7) 15.00 9.69 None weaver/parallel-ticket-4.wvr.yml ERROR (7) 14.59 8.75 None weaver/parallel-ticket-5.wvr.yml ERROR (7) 14.37 8.61 None weaver/parallel-ticket-6.wvr.yml ERROR (7) 18.32 10.37 None weaver/parallel-ticket-7.wvr.yml ERROR (7) 15.28 10.44 None weaver/parallel-ticket-8.wvr.yml ERROR (7) 15.07 10.40 None weaver/popl20-bad-buffer-mult-alt2.wvr.yml ERROR (7) 15.22 9.73 None weaver/popl20-bad-commit-1.wvr-bad.yml ERROR (7) 14.92 9.01 None weaver/popl20-bad-commit-2.wvr-bad.yml ERROR (7) 17.58 11.26 None weaver/popl20-bad-counter-queue2.wvr.yml ERROR (7) 14.74 8.62 None weaver/popl20-bad-dot-product-alt.wvr.yml unknown 0.04 0.04 None weaver/popl20-bad-dot-product.wvr.yml ERROR (7) 15.25 9.80 None weaver/popl20-bad-ring-nondet.wvr.yml ERROR (7) 19.05 10.73 None weaver/popl20-bad-ring.wvr.yml ERROR (7) 15.23 9.70 None weaver/popl20-bad-threaded-sum-2.wvr.yml ERROR (7) 14.94 8.95 None weaver/popl20-bad-three-array-sum-alt.wvr.yml ERROR (7) 14.83 8.67 None weaver/popl20-channel-sum.wvr.yml ERROR (7) 15.50 9.51 None weaver/popl20-commit-1.wvr.yml ERROR (7) 15.55 9.34 None weaver/popl20-commit-2.wvr.yml ERROR (7) 16.09 10.16 None weaver/popl20-counter-determinism.wvr.yml ERROR (7) 15.26 10.02 None weaver/popl20-counter-fun.wvr.yml ERROR (7) 18.60 10.39 None weaver/popl20-difference-det.wvr.yml ERROR (7) 15.36 10.56 None weaver/popl20-figure1-alt.wvr.yml ERROR (7) 17.09 10.76 None weaver/popl20-figure1.wvr.yml ERROR (7) 15.14 9.58 None weaver/popl20-figure3.wvr.yml ERROR (7) 15.13 9.88 None weaver/popl20-horseshoe.wvr.yml ERROR (7) 18.91 10.54 None weaver/popl20-min-max-dec.wvr.yml ERROR (7) 16.06 10.69 None weaver/popl20-min-max-inc-dec.wvr.yml ERROR (7) 14.81 8.75 None weaver/popl20-min-max-inc.wvr.yml ERROR (7) 15.09 9.27 None weaver/popl20-more-array-sum-alt2.wvr.yml ERROR (7) 16.04 10.09 None weaver/popl20-more-array-sum2.wvr.yml ERROR (7) 15.22 9.10 None weaver/popl20-more-buffer-mult2.wvr.yml ERROR (7) 15.83 10.46 None weaver/popl20-more-buffer-series2.wvr.yml ERROR (7) 15.56 10.83 None weaver/popl20-more-dec-subseq.wvr.yml ERROR (7) 18.15 10.35 None weaver/popl20-more-inc-subseq.wvr.yml ERROR (7) 15.47 9.77 None weaver/popl20-more-max-array-hom.wvr.yml ERROR (7) 15.10 9.77 None weaver/popl20-more-max-array.wvr.yml ERROR (7) 16.37 10.87 None weaver/popl20-more-min-array-hom.wvr.yml ERROR (7) 16.22 11.04 None weaver/popl20-more-min-array.wvr.yml ERROR (7) 15.03 9.02 None weaver/popl20-more-min-le-max.wvr.yml ERROR (7) 14.85 8.93 None weaver/popl20-more-mts.wvr.yml ERROR (7) 18.80 10.75 None weaver/popl20-more-multiply-verify.wvr.yml ERROR (7) 15.68 9.78 None weaver/popl20-more-nonblocking-counter-alt2.wvr.yml ERROR (7) 14.66 8.54 None weaver/popl20-more-queue-add-2-nl.wvr.yml ERROR (7) 15.23 9.42 None weaver/popl20-more-queue-add-3-nl.wvr.yml ERROR (7) 15.65 10.51 None weaver/popl20-more-sorted.wvr.yml ERROR (7) 18.70 10.42 None weaver/popl20-more-sum-array-hom.wvr.yml unknown 0.04 0.04 None weaver/popl20-more-vector-add.wvr.yml ERROR (7) 15.39 10.43 None weaver/popl20-mult-4.wvr.yml ERROR (7) 14.53 10.27 None weaver/popl20-mult-equiv.wvr.yml ERROR (7) 14.45 9.40 None weaver/popl20-nonblocking-cntr-alt.wvr.yml ERROR (7) 14.64 8.93 None weaver/popl20-nonblocking-cntr.wvr.yml ERROR (7) 14.09 8.54 None weaver/popl20-prod-cons-eq.wvr.yml ERROR (7) 17.05 11.38 None weaver/popl20-prod-cons.wvr.yml ERROR (7) 16.18 11.14 None weaver/popl20-prod-cons3.wvr.yml ERROR (7) 15.64 11.03 None weaver/popl20-proofs-counter-add-4-semi-Q67.wvr.yml ERROR (7) 18.21 10.24 None weaver/popl20-queue-add-2.wvr.yml ERROR (7) 15.16 8.94 None weaver/popl20-queue-add-3.wvr.yml ERROR (7) 15.09 9.20 None weaver/popl20-send-receive-alt.wvr.yml ERROR (7) 17.93 10.45 None weaver/popl20-send-receive.wvr.yml ERROR (7) 15.50 10.78 None weaver/popl20-simple-array-sum.wvr.yml ERROR (7) 15.28 10.07 None weaver/popl20-simple-queue.wvr.yml ERROR (7) 14.92 10.33 None weaver/popl20-threaded-sum-3.wvr.yml ERROR (7) 14.80 8.87 None weaver/popl20-three-array-max.wvr.yml ERROR (7) 14.33 8.85 None weaver/popl20-three-array-min.wvr.yml ERROR (7) 14.88 9.35 None weaver/popl20-three-array-sum.wvr.yml ERROR (7) 15.55 10.00 None weaver/popl20-two-queue.wvr.yml ERROR (7) 15.24 10.57 None weaver/security.wvr.yml ERROR (7) 14.91 9.48 None weaver/spaghetti.wvr.yml ERROR (7) 14.64 8.45 None weaver/test-context1.wvr.yml ERROR (7) 18.88 10.60 None weaver/test-easy1.wvr.yml ERROR (7) 15.15 8.88 None weaver/test-easy10.wvr.yml ERROR (7) 15.56 9.27 None weaver/test-easy11.wvr.yml ERROR (7) 14.01 8.46 None weaver/test-easy6.wvr.yml false(unreach-call) 43.51 29.75 None weaver/test-easy7.wvr.yml ERROR (7) 14.32 9.27 None weaver/test-easy8.wvr.yml ERROR (7) 17.78 9.98 None weaver/test-hard1.wvr.yml ERROR (7) 14.31 9.85 None weaver/test-semi1.wvr.yml ERROR (7) 14.75 9.31 None weaver/unroll-2.wvr.yml ERROR (7) 17.62 10.62 None weaver/unroll-3.wvr.yml ERROR (7) 14.52 8.51 None weaver/unroll-4.wvr.yml ERROR (7) 15.10 10.48 None weaver/unroll-5.wvr.yml ERROR (7) 14.73 9.59 None weaver/unroll-cond-2.wvr.yml ERROR (7) 15.36 9.68 None weaver/unroll-cond-3.wvr.yml ERROR (7) 17.95 9.99 None weaver/unroll-cond-4.wvr.yml ERROR (7) 15.35 8.95 None weaver/unroll-cond-5.wvr.yml ERROR (7) 14.26 8.40 None pthread-deagle/arithmetic_prog_ok.yml true 60.63 39.59 None pthread-deagle/circular_buffer_ok.yml ERROR (7) 14.59 9.38 None pthread-race-challenges/thread-local-pthread-value.yml unknown 17.24 10.84 None pthread-race-challenges/thread-local-value-dynamic.yml unknown 21.53 11.98 None pthread-race-challenges/thread-local-value.yml ERROR (7) 14.82 9.65 None pthread/fib_unsafe-10.yml unknown 17.40 10.68 None pthread/fib_unsafe-11.yml unknown 21.39 12.04 None pthread/fib_unsafe-12.yml unknown 17.90 11.79 None pthread/fib_unsafe-5.yml unknown 17.04 10.90 None pthread/fib_unsafe-6.yml unknown 17.03 10.07 None pthread/fib_unsafe-7.yml unknown 17.20 11.65 None pthread/lazy01.yml false(unreach-call) 31.90 16.87 None pthread/queue.yml ERROR (7) 15.10 8.79 None pthread/queue_longer.yml ERROR (7) 15.94 10.99 None pthread/queue_longest.yml ERROR (7) 17.59 10.73 None pthread/reorder_2.yml unknown 21.39 12.99 None pthread/reorder_5.yml unknown 25.76 14.15 None pthread/singleton.yml false(unreach-call) 28.49 16.04 None pthread/stack-2.yml ERROR (7) 15.94 9.61 None pthread/stack_longer-1.yml ERROR (7) 18.66 10.99 None pthread/stack_longest-1.yml ERROR (7) 16.64 11.12 None pthread/stateful01-1.yml false(unreach-call) 23.29 12.88 None pthread/triangular-2.yml unknown 17.83 11.12 None pthread/triangular-longer-2.yml unknown 17.93 11.80 None pthread/triangular-longest-2.yml unknown 17.18 10.79 None pthread/twostage_3.yml false(unreach-call) 17.47 10.30 None pthread-atomic/read_write_lock-2.yml ERROR (7) 15.52 10.33 None pthread-ext/25_stack_longer-1-pthread.yml ERROR (7) 18.89 10.70 None pthread-ext/25_stack_longer-1.yml ERROR (7) 15.56 10.09 None pthread-ext/25_stack_longest-2-pthread.yml ERROR (7) 14.60 8.80 None pthread-ext/25_stack_longest-2.yml ERROR (7) 18.45 10.56 None pthread-ext/26_stack_cas_longer-1.yml ERROR (7) 14.79 10.19 None pthread-ext/26_stack_cas_longest-1.yml ERROR (7) 17.93 9.91 None pthread-ext/28_buggy_simple_loop1_vf.yml false(unreach-call) 13.32 8.10 None pthread-ext/40_barrier_vf-pthread.yml OUT OF MEMORY 68.93 47.68 None pthread-ext/40_barrier_vf.yml ERROR (7) 14.47 8.81 None pthread-wmm/mix000.oepc.yml ERROR (7) 20.46 12.14 None pthread-wmm/mix000.opt.yml ERROR (7) 19.00 12.01 None pthread-wmm/mix001.oepc.yml ERROR (7) 22.12 14.42 None pthread-wmm/mix001.opt.yml ERROR (7) 20.39 12.68 None pthread-wmm/mix002.oepc.yml ERROR (7) 24.43 13.70 None pthread-wmm/mix002.opt.yml ERROR (7) 19.31 11.85 None pthread-wmm/mix003.oepc.yml ERROR (7) 21.13 13.39 None pthread-wmm/mix003_power.opt_pso.opt_rmo.opt_tso.opt.yml ERROR (7) 20.65 13.14 None pthread-wmm/mix004.oepc.yml ERROR (7) 25.68 14.50 None pthread-wmm/mix004.opt.yml ERROR (7) 22.07 14.04 None pthread-wmm/mix005.opt.yml ERROR (7) 26.57 15.13 None pthread-wmm/mix005_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 20.99 12.59 None pthread-wmm/mix005_tso.oepc.yml ERROR (7) 21.32 12.91 None pthread-wmm/mix006.opt.yml ERROR (7) 21.32 12.27 None pthread-wmm/mix006_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 21.23 12.85 None pthread-wmm/mix006_tso.oepc.yml unknown 0.04 0.04 None pthread-wmm/mix007.oepc.yml ERROR (7) 21.17 13.23 None pthread-wmm/mix007.opt.yml ERROR (7) 22.03 13.69 None pthread-wmm/mix008.opt.yml ERROR (7) 20.14 12.22 None pthread-wmm/mix008_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 25.72 14.58 None pthread-wmm/mix008_tso.oepc.yml ERROR (7) 28.78 18.95 None pthread-wmm/mix009.oepc.yml ERROR (7) 19.68 12.03 None pthread-wmm/mix009.opt.yml ERROR (7) 18.38 10.90 None pthread-wmm/mix010.oepc.yml ERROR (7) 19.37 11.47 None pthread-wmm/mix010.opt.yml ERROR (7) 21.22 13.93 None pthread-wmm/mix011.opt.yml ERROR (7) 24.00 13.51 None pthread-wmm/mix011_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 24.96 14.33 None pthread-wmm/mix011_tso.oepc.yml ERROR (7) 20.62 12.03 None pthread-wmm/mix012_power.oepc_power.opt_pso.oepc_rmo.oepc_rmo.opt_tso.oepc.yml ERROR (7) 17.44 10.84 None pthread-wmm/mix012_pso.opt_tso.opt.yml ERROR (7) 18.00 10.98 None pthread-wmm/mix013.oepc.yml ERROR (7) 21.69 12.65 None pthread-wmm/mix013.opt.yml ERROR (7) 21.29 13.22 None pthread-wmm/mix014.opt.yml ERROR (7) 20.91 13.35 None pthread-wmm/mix014_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 22.49 12.75 None pthread-wmm/mix014_tso.oepc.yml ERROR (7) 32.82 20.14 None pthread-wmm/mix015.oepc.yml ERROR (7) 20.10 11.73 None pthread-wmm/mix015.opt.yml ERROR (7) 19.26 12.24 None pthread-wmm/mix016.oepc.yml ERROR (7) 24.11 13.66 None pthread-wmm/mix016_power.opt_rmo.opt.yml ERROR (7) 19.51 11.37 None pthread-wmm/mix016_pso.opt_tso.opt.yml ERROR (7) 24.53 13.79 None pthread-wmm/mix017.oepc.yml ERROR (7) 21.30 13.81 None pthread-wmm/mix017_power.opt_rmo.opt.yml ERROR (7) 19.22 11.82 None pthread-wmm/mix017_pso.opt_tso.opt.yml ERROR (7) 19.89 12.82 None pthread-wmm/mix018.opt.yml ERROR (7) 19.71 11.90 None pthread-wmm/mix018_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 19.74 13.00 None pthread-wmm/mix018_tso.oepc.yml ERROR (7) 20.81 12.96 None pthread-wmm/mix019.opt.yml ERROR (7) 18.91 11.08 None pthread-wmm/mix019_power.oepc_pso.oepc_rmo.oepc.yml unknown 0.05 0.05 None pthread-wmm/mix019_tso.oepc.yml ERROR (7) 20.48 12.84 None pthread-wmm/mix020.oepc.yml ERROR (7) 21.14 14.05 None pthread-wmm/mix020.opt.yml ERROR (7) 21.23 13.69 None pthread-wmm/mix021.opt.yml ERROR (7) 19.27 11.92 None pthread-wmm/mix021_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 25.58 14.50 None pthread-wmm/mix021_tso.oepc.yml ERROR (7) 20.89 13.09 None pthread-wmm/mix022_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 24.04 13.24 None pthread-wmm/mix022_tso.yml ERROR (7) 18.79 11.85 None pthread-wmm/mix023_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 21.61 13.70 None pthread-wmm/mix023_power.opt_pso.opt_rmo.opt.yml ERROR (7) 25.51 14.67 None pthread-wmm/mix023_tso.yml ERROR (7) 26.14 16.21 None pthread-wmm/mix024_power.oepc_pso.oepc_rmo.oepc_tso.oepc_tso.opt.yml ERROR (7) 19.79 11.93 None pthread-wmm/mix024_power.opt_pso.opt_rmo.opt.yml ERROR (7) 19.44 12.44 None pthread-wmm/mix025_power.oepc_power.opt_pso.oepc_rmo.oepc_tso.oepc_tso.opt.yml ERROR (7) 19.49 11.53 None pthread-wmm/mix025_pso.opt_rmo.opt.yml ERROR (7) 19.66 12.56 None pthread-wmm/mix026.oepc.yml ERROR (7) 21.01 12.37 None pthread-wmm/mix026_power.opt_tso.opt.yml ERROR (7) 20.11 13.24 None pthread-wmm/mix026_pso.opt_rmo.opt.yml ERROR (7) 20.83 13.04 None pthread-wmm/mix027_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 20.41 12.82 None pthread-wmm/mix027_power.opt_pso.opt_rmo.opt.yml ERROR (7) 20.68 12.74 None pthread-wmm/mix027_tso.yml ERROR (7) 26.87 15.27 None pthread-wmm/mix028_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 24.33 13.68 None pthread-wmm/mix028_power.opt_pso.opt_rmo.opt.yml ERROR (7) 19.75 12.31 None pthread-wmm/mix028_tso.yml ERROR (7) 26.25 14.64 None pthread-wmm/mix029_power.oepc_pso.oepc_rmo.oepc_tso.oepc_tso.opt.yml ERROR (7) 20.43 11.94 None pthread-wmm/mix029_power.opt_pso.opt_rmo.opt.yml ERROR (7) 20.39 13.14 None pthread-wmm/mix030_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 20.24 11.89 None pthread-wmm/mix030_power.opt_pso.opt_rmo.opt.yml ERROR (7) 21.82 12.74 None pthread-wmm/mix030_tso.yml ERROR (7) 21.23 13.49 None pthread-wmm/mix031.oepc.yml ERROR (7) 19.80 11.25 None pthread-wmm/mix031.opt.yml ERROR (7) 19.56 12.75 None pthread-wmm/mix032.oepc.yml ERROR (7) 21.57 14.63 None pthread-wmm/mix032.opt.yml ERROR (7) 21.40 13.61 None pthread-wmm/mix033.opt.yml ERROR (7) 20.35 12.75 None pthread-wmm/mix033_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 25.56 14.21 None pthread-wmm/mix033_tso.oepc.yml ERROR (7) 20.15 12.88 None pthread-wmm/mix034_power.oepc_power.opt_pso.oepc_rmo.oepc_rmo.opt_tso.oepc.yml ERROR (7) 24.79 13.47 None pthread-wmm/mix034_pso.opt_tso.opt.yml unknown 0.04 0.04 None pthread-wmm/mix035.oepc.yml ERROR (7) 19.28 11.63 None pthread-wmm/mix035_power.opt_rmo.opt.yml ERROR (7) 19.35 11.27 None pthread-wmm/mix035_pso.opt_tso.opt.yml ERROR (7) 18.60 12.10 None pthread-wmm/mix036.oepc.yml ERROR (7) 24.77 14.39 None pthread-wmm/mix036_power.opt_rmo.opt.yml ERROR (7) 21.97 12.98 None pthread-wmm/mix036_pso.opt_tso.opt.yml ERROR (7) 19.33 11.11 None pthread-wmm/mix037.opt.yml ERROR (7) 21.34 14.12 None pthread-wmm/mix037_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 22.73 14.09 None pthread-wmm/mix037_tso.oepc.yml ERROR (7) 21.78 13.90 None pthread-wmm/mix038.opt.yml ERROR (7) 20.34 12.18 None pthread-wmm/mix038_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 19.49 12.55 None pthread-wmm/mix038_tso.oepc.yml ERROR (7) 20.09 12.66 None pthread-wmm/mix039.oepc.yml ERROR (7) 20.42 12.23 None pthread-wmm/mix039.opt.yml ERROR (7) 25.45 14.30 None pthread-wmm/mix040.opt.yml ERROR (7) 20.82 11.83 None pthread-wmm/mix040_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 24.90 14.36 None pthread-wmm/mix040_tso.oepc.yml ERROR (7) 21.84 13.53 None pthread-wmm/mix041_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 18.00 10.48 None pthread-wmm/mix041_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 18.19 10.36 None pthread-wmm/mix042.oepc.yml ERROR (7) 25.54 14.14 None pthread-wmm/mix042.opt.yml ERROR (7) 19.13 12.40 None pthread-wmm/mix043.oepc.yml ERROR (7) 20.93 13.20 None pthread-wmm/mix043.opt.yml ERROR (7) 21.29 13.31 None pthread-wmm/mix044.opt.yml ERROR (7) 19.69 12.48 None pthread-wmm/mix044_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 20.91 13.01 None pthread-wmm/mix044_tso.oepc.yml ERROR (7) 20.57 12.67 None pthread-wmm/mix045_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 18.81 12.57 None pthread-wmm/mix045_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 19.18 11.17 None pthread-wmm/mix046.oepc.yml ERROR (7) 21.76 12.47 None pthread-wmm/mix046.opt.yml ERROR (7) 20.73 12.49 None pthread-wmm/mix047_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 26.51 15.10 None pthread-wmm/mix047_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 20.55 13.21 None pthread-wmm/mix048_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt-podwr000_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 22.03 12.37 None pthread-wmm/mix049_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt-podwr001_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 24.31 13.43 None pthread-wmm/mix050.yml ERROR (7) 20.89 13.43 None pthread-wmm/mix051_power.oepc_power.opt_pso.oepc_rmo.oepc.yml ERROR (7) 21.29 12.97 None pthread-wmm/mix051_pso.opt_rmo.opt_tso.opt.yml ERROR (7) 21.25 12.87 None pthread-wmm/mix051_tso.oepc.yml ERROR (7) 19.77 12.80 None pthread-wmm/mix052_power.oepc_power.opt_pso.oepc_rmo.oepc.yml ERROR (7) 18.63 11.73 None pthread-wmm/mix052_pso.opt_rmo.opt_tso.opt.yml ERROR (7) 18.31 10.74 None pthread-wmm/mix052_tso.oepc.yml ERROR (7) 19.40 12.32 None pthread-wmm/mix053.opt.yml ERROR (7) 19.97 11.17 None pthread-wmm/mix053_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 19.22 11.58 None pthread-wmm/mix053_tso.oepc.yml ERROR (7) 19.07 11.40 None pthread-wmm/mix054_power.oepc_power.opt_pso.oepc_rmo.oepc.yml ERROR (7) 22.02 12.61 None pthread-wmm/mix054_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 18.40 11.41 None pthread-wmm/mix055.opt.yml ERROR (7) 24.08 13.53 None pthread-wmm/mix055_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 24.69 13.99 None pthread-wmm/mix055_tso.oepc.yml ERROR (7) 20.59 12.94 None pthread-wmm/mix056_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 17.80 11.11 None pthread-wmm/mix056_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 18.80 11.08 None pthread-wmm/mix057_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 21.58 13.01 None pthread-wmm/mix057_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 20.61 12.61 None pthread-wmm/rfi000_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 18.30 10.84 None pthread-wmm/rfi000_power.opt_pso.opt_rmo.opt.yml ERROR (7) 18.41 11.91 None pthread-wmm/rfi001_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 18.69 11.08 None pthread-wmm/rfi001_power.opt_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 17.67 10.19 None pthread-wmm/rfi003_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 18.75 10.87 None pthread-wmm/rfi004.yml ERROR (7) 18.37 11.37 None pthread-wmm/rfi005.yml ERROR (7) 25.24 14.51 None pthread-wmm/rfi006_power.oepc.yml ERROR (7) 23.18 12.91 None pthread-wmm/rfi006_power.opt.yml ERROR (7) 23.82 13.43 None pthread-wmm/rfi006_pso.oepc_pso.opt_tso.oepc_tso.opt.yml ERROR (7) 20.94 13.65 None pthread-wmm/rfi006_rmo.yml ERROR (7) 17.45 10.19 None pthread-wmm/rfi007_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 18.30 10.94 None pthread-wmm/rfi007_tso.yml ERROR (7) 19.34 12.30 None pthread-wmm/rfi008.oepc.yml ERROR (7) 19.87 12.26 None pthread-wmm/rfi008.opt.yml ERROR (7) 19.35 12.43 None pthread-wmm/rfi009_power.oepc.yml ERROR (7) 18.42 11.71 None pthread-wmm/rfi009_power.opt_pso.oepc_pso.opt_rmo.opt_tso.oepc_tso.opt.yml ERROR (7) 19.58 11.54 None pthread-wmm/rfi009_rmo.oepc.yml ERROR (7) 18.16 11.50 None pthread-wmm/rfi010.yml ERROR (7) 18.50 10.66 None pthread-wmm/safe000_power.oepc.yml ERROR (7) 18.36 11.27 None pthread-wmm/safe000_power.opt.yml ERROR (7) 25.21 14.03 None pthread-wmm/safe000_rmo.yml ERROR (7) 22.14 12.53 None pthread-wmm/safe001_power.oepc.yml ERROR (7) 17.67 9.95 None pthread-wmm/safe001_power.opt_pso.oepc_pso.opt_rmo.opt.yml ERROR (7) 18.28 10.74 None pthread-wmm/safe001_rmo.oepc.yml ERROR (7) 22.87 12.67 None pthread-wmm/safe002_power.oepc.yml ERROR (7) 17.65 10.81 None pthread-wmm/safe002_power.opt_pso.oepc_pso.opt_rmo.opt.yml ERROR (7) 19.49 12.21 None pthread-wmm/safe002_rmo.oepc.yml ERROR (7) 18.19 10.45 None pthread-wmm/safe003_power.oepc_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 19.74 11.82 None pthread-wmm/safe003_power.opt.yml ERROR (7) 19.38 11.27 None pthread-wmm/safe004_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 20.63 12.78 None pthread-wmm/safe004_power.opt_pso.opt_rmo.opt.yml ERROR (7) 20.30 12.57 None pthread-wmm/safe005_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 18.80 11.36 None pthread-wmm/safe006_power.oepc-thin000_power.oepc.yml ERROR (7) 17.01 10.11 None pthread-wmm/safe006_power.opt-thin000_power.opt.yml ERROR (7) 17.80 10.46 None pthread-wmm/safe006_rmo.oepc_rmo.opt-thin000_rmo.oepc_rmo.opt.yml ERROR (7) 20.59 11.38 None pthread-wmm/safe007_power.oepc-thin001_power.oepc.yml ERROR (7) 22.84 12.62 None pthread-wmm/safe007_power.opt-thin001_power.opt.yml ERROR (7) 18.70 10.98 None pthread-wmm/safe007_rmo.oepc_rmo.opt-thin001_rmo.oepc_rmo.opt.yml ERROR (7) 16.41 9.61 None pthread-wmm/safe008_power.oepc_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 19.27 12.08 None pthread-wmm/safe008_power.opt.yml ERROR (7) 19.48 11.89 None pthread-wmm/safe009_power.oepc.yml ERROR (7) 16.97 9.70 None pthread-wmm/safe009_power.opt.yml ERROR (7) 19.89 13.20 None pthread-wmm/safe009_rmo.oepc.yml ERROR (7) 18.17 10.77 None pthread-wmm/safe009_rmo.opt.yml ERROR (7) 21.10 12.03 None pthread-wmm/safe010_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 17.74 10.61 None pthread-wmm/safe011_power.oepc_pso.oepc_rmo.oepc_rmo.opt.yml ERROR (7) 20.24 12.96 None pthread-wmm/safe011_power.opt_pso.opt.yml ERROR (7) 18.28 11.68 None pthread-wmm/safe012_power.oepc.yml ERROR (7) 16.76 9.62 None pthread-wmm/safe012_power.opt.yml ERROR (7) 19.11 11.12 None pthread-wmm/safe012_pso.oepc_pso.opt_rmo.opt.yml ERROR (7) 23.04 12.72 None pthread-wmm/safe012_rmo.oepc.yml ERROR (7) 16.31 9.54 None pthread-wmm/safe013_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 24.07 13.28 None pthread-wmm/safe014_power.oepc.yml ERROR (7) 17.02 9.98 None pthread-wmm/safe014_power.opt.yml ERROR (7) 19.10 11.67 None pthread-wmm/safe014_rmo.oepc.yml ERROR (7) 16.84 10.72 None pthread-wmm/safe014_rmo.opt.yml ERROR (7) 18.55 11.70 None pthread-wmm/safe015_power.oepc.yml ERROR (7) 21.01 13.21 None pthread-wmm/safe015_power.opt.yml ERROR (7) 22.64 13.06 None pthread-wmm/safe015_rmo.yml ERROR (7) 18.37 11.10 None pthread-wmm/safe016_power.oepc.yml ERROR (7) 17.14 10.97 None pthread-wmm/safe016_power.opt.yml ERROR (7) 18.72 12.17 None pthread-wmm/safe016_rmo.oepc.yml ERROR (7) 17.04 10.17 None pthread-wmm/safe016_rmo.opt.yml ERROR (7) 17.48 10.33 None pthread-wmm/safe017_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 18.62 11.03 None pthread-wmm/safe018_power.oepc.yml ERROR (7) 17.80 10.03 None pthread-wmm/safe018_power.opt.yml ERROR (7) 23.91 13.74 None pthread-wmm/safe018_rmo.oepc.yml ERROR (7) 16.78 10.81 None pthread-wmm/safe018_rmo.opt.yml ERROR (7) 17.73 10.63 None pthread-wmm/safe019_power.oepc.yml ERROR (7) 18.13 11.74 None pthread-wmm/safe019_power.opt.yml ERROR (7) 25.52 14.82 None pthread-wmm/safe019_rmo.oepc.yml ERROR (7) 18.19 10.98 None pthread-wmm/safe019_rmo.opt.yml ERROR (7) 19.42 11.87 None pthread-wmm/safe020_power.yml ERROR (7) 20.20 13.23 None pthread-wmm/safe020_rmo.yml ERROR (7) 20.99 11.75 None pthread-wmm/safe021_power.oepc_pso.oepc_rmo.oepc_rmo.opt.yml ERROR (7) 18.05 10.17 None pthread-wmm/safe021_power.opt_pso.opt.yml ERROR (7) 20.09 12.49 None pthread-wmm/safe022_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 17.07 9.99 None pthread-wmm/safe023_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 20.38 12.30 None pthread-wmm/safe024_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 17.87 10.66 None pthread-wmm/safe025_power.yml unknown 0.04 0.04 None pthread-wmm/safe025_rmo.yml ERROR (7) 18.15 11.00 None pthread-wmm/safe026_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 17.90 11.52 None pthread-wmm/safe027_power.oepc.yml ERROR (7) 19.62 12.00 None pthread-wmm/safe027_power.opt.yml ERROR (7) 27.75 15.50 None pthread-wmm/safe027_rmo.yml ERROR (7) 19.81 12.81 None pthread-wmm/safe028_power.yml ERROR (7) 21.07 13.12 None pthread-wmm/safe028_rmo.yml ERROR (7) 16.62 9.71 None pthread-wmm/safe029_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 17.93 11.06 None pthread-wmm/safe029_power.opt_pso.opt_rmo.opt.yml ERROR (7) 22.26 12.49 None pthread-wmm/safe030_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 24.05 13.61 None pthread-wmm/safe030_power.opt_pso.opt_rmo.opt.yml ERROR (7) 18.11 10.91 None pthread-wmm/safe031_power.oepc_pso.oepc_rmo.oepc.yml ERROR (7) 18.82 12.08 None pthread-wmm/safe031_power.opt_pso.opt_rmo.opt.yml ERROR (7) 19.65 11.04 None pthread-wmm/safe032_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 21.64 12.81 None pthread-wmm/safe033_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 17.68 11.31 None pthread-wmm/safe034_power.oepc_power.opt_pso.oepc_pso.opt_rmo.oepc_rmo.opt.yml ERROR (7) 19.03 12.32 None pthread-wmm/thin002_power.oepc.yml ERROR (7) 17.63 10.03 None pthread-wmm/thin002_power.opt.yml ERROR (7) 20.41 12.74 None pthread-wmm/thin002_rmo.yml ERROR (7) 18.98 11.45 None pthread-lit/qw2004-2b.yml ERROR (7) 14.29 9.67 None ldv-races/race-1_2-join.yml ERROR (7) 15.86 9.85 None ldv-races/race-1_3-join.yml ERROR (7) 14.94 8.71 None ldv-races/race-2_2-container_of.yml ERROR (7) 18.45 10.29 None ldv-races/race-2_3-container_of.yml ERROR (7) 18.58 10.26 None ldv-races/race-2_4-container_of.yml ERROR (7) 14.95 10.06 None ldv-races/race-2_5-container_of.yml ERROR (7) 18.54 10.16 None ldv-races/race-3_2-container_of-global.yml ERROR (7) 14.80 8.72 None ldv-linux-3.14-races/linux-3.14--drivers--media--platform--marvell-ccic--cafe_ccic.ko.cil-2.yml ERROR (7) 113.30 97.96 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--nsc-ircc.ko.cil.yml unknown 0.04 0.04 None ldv-linux-3.14-races/linux-3.14--drivers--net--irda--w83977af_ir.ko.cil.yml ERROR (7) 45.47 37.62 None ldv-linux-3.14-races/linux-3.14--drivers--spi--spi-tegra20-slink.ko.cil.yml ERROR (7) 45.07 33.66 None ldv-linux-3.14-races/linux-3.14--drivers--usb--misc--adutux.ko.cil.yml unknown 103.50 91.95 None pthread-complex/bounded_buffer.yml unknown 19.81 11.36 None pthread-complex/elimination_backoff_stack.yml ERROR (7) 14.67 9.27 None pthread-complex/safestack_relacy.yml ERROR (7) 16.04 9.81 None pthread-driver-races/char_generic_nvram_read_nvram_write_nvram.yml ERROR (7) 25.72 18.58 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_current.yml ERROR (7) 24.30 16.77 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_change_pc8736x_gpio_set.yml ERROR (7) 26.65 16.35 None pthread-driver-races/char_pc8736x_gpio_pc8736x_gpio_current_pc8736x_gpio_set.yml ERROR (7) 26.69 16.66 None pthread-C-DAC/pthread-demo-datarace-3.yml ERROR (7) 14.77 9.26 None pthread-divine/tls_destructor_worker.yml ERROR (7) 13.89 8.06 None goblint-regression/13-privatized_18-first-reads_unknown_1_neg.yml unknown 19.94 10.94 None goblint-regression/13-privatized_18-first-reads_unknown_1_pos.yml unknown 15.50 9.68 None goblint-regression/13-privatized_18-first-reads_unknown_2_neg.yml unknown 15.68 9.29 None goblint-regression/13-privatized_18-first-reads_unknown_2_pos.yml unknown 15.15 8.87 None goblint-regression/13-privatized_19-publish-precision_unknown_1_neg.yml unknown 15.82 8.95 None goblint-regression/13-privatized_19-publish-precision_unknown_1_pos.yml unknown 16.27 9.89 None goblint-regression/13-privatized_19-publish-precision_unknown_2_neg.yml unknown 20.36 11.32 None goblint-regression/13-privatized_19-publish-precision_unknown_2_pos.yml unknown 15.81 9.78 None goblint-regression/13-privatized_41-traces-ex-7_unknown_1_neg.yml unknown 20.15 11.03 None goblint-regression/13-privatized_41-traces-ex-7_unknown_1_pos.yml unknown 19.76 11.03 None goblint-regression/13-privatized_67-pthread_cond_wait_true.yml unknown 16.59 9.90 None goblint-regression/13-privatized_67-pthread_cond_wait_unknown_1_neg.yml unknown 16.72 10.35 None goblint-regression/13-privatized_67-pthread_cond_wait_unknown_1_pos.yml unknown 16.44 9.93 None goblint-regression/28-race_reach_01-simple_racing.yml unknown 15.68 9.04 None goblint-regression/28-race_reach_03-munge_racing.yml ERROR (7) 14.24 8.42 None goblint-regression/28-race_reach_06-cond_racing1.yml ERROR (7) 14.57 9.26 None goblint-regression/28-race_reach_07-cond_racing2.yml ERROR (7) 18.40 10.30 None goblint-regression/28-race_reach_09-ptrmunge_racing.yml ERROR (7) 15.33 9.26 None goblint-regression/28-race_reach_11-ptr_racing.yml unknown 15.87 9.35 None goblint-regression/28-race_reach_19-callback_racing.yml ERROR (7) 17.83 9.94 None goblint-regression/28-race_reach_21-deref_read_racing.yml unknown 15.76 9.05 None goblint-regression/28-race_reach_23-sound_unlock_racing.yml ERROR (7) 14.94 8.99 None goblint-regression/28-race_reach_24-sound_lock_racing.yml ERROR (7) 15.10 9.43 None goblint-regression/28-race_reach_27-funptr_racing.yml ERROR (7) 16.45 10.24 None goblint-regression/28-race_reach_37-indirect_racing.yml unknown 19.78 10.83 None goblint-regression/28-race_reach_40-trylock_racing.yml unknown 15.34 8.74 None goblint-regression/28-race_reach_45-escape_racing.yml ERROR (7) 16.43 10.18 None goblint-regression/28-race_reach_61-invariant_racing.yml unknown 16.54 9.85 None goblint-regression/28-race_reach_71-funloop_racing.yml false(unreach-call) 16.68 9.15 None goblint-regression/28-race_reach_72-funloop_hard_racing.yml false(unreach-call) 14.16 9.57 None goblint-regression/28-race_reach_77-tricky_address4_racing.yml ERROR (7) 16.90 10.46 None goblint-regression/28-race_reach_78-equ_racing.yml unknown 17.60 10.31 None goblint-regression/28-race_reach_81-list_racing.yml unknown 16.68 9.77 None goblint-regression/28-race_reach_82-list_racefree.yml unknown 17.49 11.25 None goblint-regression/28-race_reach_83-list2_racing1.yml unknown 21.48 11.81 None goblint-regression/28-race_reach_84-list2_racing2.yml unknown 16.34 9.33 None goblint-regression/28-race_reach_86-lists_racing.yml unknown 18.41 11.85 None goblint-regression/28-race_reach_90-arrayloop2_racing.yml unknown 22.93 12.47 None goblint-regression/28-race_reach_92-evilcollapse_racing.yml unknown 17.52 10.45 None goblint-regression/28-race_reach_94-alloc_region_racing.yml ERROR (7) 14.82 9.35 None goblint-regression/36-apron_17-traces-rpb-litmus_unknown_1_neg.yml ERROR (7) 18.85 10.47 None goblint-regression/36-apron_17-traces-rpb-litmus_unknown_1_pos.yml ERROR (7) 15.52 9.68 None goblint-regression/36-apron_41-threadenter-no-locals_unknown_1_neg.yml false(unreach-call) 10.38 6.27 None goblint-regression/36-apron_41-threadenter-no-locals_unknown_1_pos.yml false(unreach-call) 11.02 6.76 None weaver/parallel-barrier-loop.wvr.yml ERROR (7) 13.94 8.20 None weaver/popl20-bad-buffer-mult-alt.wvr.yml ERROR (7) 14.02 8.05 None weaver/popl20-bad-counter-queue.wvr.yml ERROR (7) 14.33 9.17 None weaver/popl20-more-array-sum-alt.wvr.yml ERROR (7) 17.99 9.94 None weaver/popl20-more-array-sum.wvr.yml ERROR (7) 14.15 8.76 None weaver/popl20-more-buffer-mult.wvr.yml ERROR (7) 14.40 9.15 None weaver/popl20-more-buffer-series.wvr.yml ERROR (7) 14.40 8.52 None pthread-deagle/arithmetic_prog_bad.yml false(unreach-call) 66.38 40.15 None pthread-deagle/circular_buffer_bad.yml ERROR (7) 13.36 7.85 None ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Run set 2 done 17969.24 909.07 - Statistics: 715 Files correct: 19 correct true: 9 correct false: 10 incorrect: 10 incorrect true: 0 incorrect false: 10 unknown: 686 Score: -132 (max: 1085)