===== Benchmarks ===== === Reproducing Results from the Zhong et. al. paper using CitcomS 3.2.0 === **The following plots are from data generated by CitcomS 3.2.0 on Stampede. Figure numbers correspond to Zhong et al.** == Figure 5 == {{:software:citcoms:figure_5_a.png}} {{:software:citcoms:figure_5_b.png}} {{:software:citcoms:figure_5_c.png}} == Figure 7(a) == {{:software:citcoms:figure_7_a.png}} === Comparision of Values from Table 6 of the Zhong et. al. paper === ** Mean and standard deviations () are computed over the [t1,t2] interval ** ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A1 (Zhong et. al.) | 0.7 | 1.0 | 32.66 (6e-4) | 3.5126 (2e-4) | 0.2171 (2e-5)| | A1 (CitcomS 3.2.0) | 0.7 | 1.0 | 32.68 (4e-3) | 3.5263 (4e-4) | 0.2187 (6e-5)| | A1 (Gaia) | ? | 1.0 | 32.65 | 3.5096 | 0.2160 | ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A2 (Zhong et. al.) | 1.0 | 1.3 | 27.36 (1e-4) | 3.2674 (1e-5) | 0.2360 (3e-7)| | A2 (CitcomS 3.2.0) | 1.0 | 1.3 | 27.33 (6e-3) | 3.2831 (1e-3) | 0.2381 (1e-4)| | A2 (Gaia) | ? | 1.0 | 27.19 | 3.2550 | 0.2351 | ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A3 (Zhong et. al.) | 0.6 | 0.9 | 25.85 (1e-3) | 3.1724 (3e-4) | 0.2432 (3e-5)| | A3 (CitcomS 3.2.0) | 0.6 | 0.9 | 25.77 (1e-3) | 3.1768 (3e-4) | 0.2447 (3e-5)| | A3 (Gaia) | ? | 1.0 | 25.65 | 3.1601 | 0.2427 | ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A4 (Zhong et. al.) | 1.5 | 2.0 | 23.11 (3e-4) | 2.9354 (4e-5) | 0.2653 (2e-6)| | A4 (CitcomS 3.2.0) | 1.5 | 2.0 | 23.01 (5e-3) | 2.9175 (1e-3) | 0.2659 (2e-5)| | A4 (Gaia) | ? | 1.0 | 22.90 | 2.9259 | 0.2663 | ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A5 (Zhong et. al.) | 1.0 | 1.5 | 22.90 (3e-3) | 2.5468 (5e-4) | 0.3124 (1e-5)| | A5 (CitcomS 3.2.0) | 1.0 | 1.5 | 22.86 (3e-2) | 2.5380 (7e-4) | 0.3126 (7e-5)| | A5 (Gaia) | ? | 1.0 | 22.77 | 2.5386 | 0.3152 | ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A7 (Zhong et. al.) | 1.2 | 1.7 | 50.21 (8e-3) | 2.7382 (5e-4) | 0.5039 (1e-4)| | A7 (CitcomS 3.2.0) | 1.2 | 1.7 | 11.09 (5e-2) | 1.8972 (5e-3) | 0.3870 (3e-4)| | A7 (Gaia) | ? | 5.0 | 46.83 | 2.4917 | 0.4529 | ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | A8 (Zhong et. al.) | 0.8 | 1.0 | 87.27 (4e-2) | 3.0317 (2.8e-3) | 0.5461 (1e-4)| | A8 (CitcomS 3.2.0) | 0.8 | 1.0 | 88.01 (2e-2) | 3.0889 (1e-3) | 0.5530 (1e-4)| | A8 (Gaia) | ? | 4.1 | 83.35 | 3.1328 | 0.5531 | === Comparision of Values from Table 7 of the Zhong et. al. paper === ** Mean and standard deviations () are computed over the [t1,t2] interval** ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | B1 (Zhong et. al.) | 1.2 | 1.7 | 31.09 (1e-4) | 3.6254 (1e-5) | 0.2176 (6e-7)| | B1 (CitcomS 3.2.0) | 1.2 | 1.7 | 31.02 (1e-14) | 3.6212 (2e-6) | 0.2171 (3e-16)| ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | B2 (Zhong et. al.) | 0.8 | 1.1 | 25.13 (7e-5) | 3.3721 (2e-5) | 0.2527 (2e-6)| | B2 (CitcomS 3.2.0) | 0.8 | 1.1 | 25.09 (2e-4) | 3.3677 (2e-5) | 0.2525 (5e-6)| ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | B3 (Zhong et. al.) | 0.8 | 1.2 | 24.35 (8e-5) | 3.3162 (2e-5) | 0.2587 (2e-6)| | B3 (CitcomS 3.2.0) | 0.8 | 1.2 | 24.32 (5e-5) | 3.3122 (2e-5) | 0.2586 (3e-6)| ^ Benchmark ^ t1 ^ t2 ^ ^ ^ ^ | B4 (Zhong et. al.) | 1.0 | 1.3 | 22.49 (2e-5) | 3.1278 (6e-6) | 0.2797 (4e-7)| | B4 (CitcomS 3.2.0) | 1.0 | 1.3 | 22.47 (3e-14)| 3.1233 (4e-6) | 0.2797 (1e-16)| === Benchmarking Papers === [[http://dx.doi.org/10.1029/2008GC002048|Zhong et. al. (2008)]] === Configuration files used for the Benchmarks === {{:software:citcoms:a-benchmarks.tgz}}