Sidebar
software:citcoms:benchmarks
Benchmarks
Reproducing Results from the Zhong et. al. paper using CitcomS 3.2.0
The following plots are from data generated by CitcomS 3.2.0 on Stampede. Figure numbers correspond to Zhong et al.
Figure 5
Figure 7(a)
Comparision of Values from Table 6 of the Zhong et. al. paper
Mean and standard deviations () are computed over the [t1,t2] interval
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A1 (Zhong et. al.) | 0.7 | 1.0 | 32.66 (6e-4) | 3.5126 (2e-4) | 0.2171 (2e-5) |
| A1 (CitcomS 3.2.0) | 0.7 | 1.0 | 32.68 (4e-3) | 3.5263 (4e-4) | 0.2187 (6e-5) |
| A1 (Gaia) | ? | 1.0 | 32.65 | 3.5096 | 0.2160 |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A2 (Zhong et. al.) | 1.0 | 1.3 | 27.36 (1e-4) | 3.2674 (1e-5) | 0.2360 (3e-7) |
| A2 (CitcomS 3.2.0) | 1.0 | 1.3 | 27.33 (6e-3) | 3.2831 (1e-3) | 0.2381 (1e-4) |
| A2 (Gaia) | ? | 1.0 | 27.19 | 3.2550 | 0.2351 |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A3 (Zhong et. al.) | 0.6 | 0.9 | 25.85 (1e-3) | 3.1724 (3e-4) | 0.2432 (3e-5) |
| A3 (CitcomS 3.2.0) | 0.6 | 0.9 | 25.77 (1e-3) | 3.1768 (3e-4) | 0.2447 (3e-5) |
| A3 (Gaia) | ? | 1.0 | 25.65 | 3.1601 | 0.2427 |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A4 (Zhong et. al.) | 1.5 | 2.0 | 23.11 (3e-4) | 2.9354 (4e-5) | 0.2653 (2e-6) |
| A4 (CitcomS 3.2.0) | 1.5 | 2.0 | 23.01 (5e-3) | 2.9175 (1e-3) | 0.2659 (2e-5) |
| A4 (Gaia) | ? | 1.0 | 22.90 | 2.9259 | 0.2663 |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A5 (Zhong et. al.) | 1.0 | 1.5 | 22.90 (3e-3) | 2.5468 (5e-4) | 0.3124 (1e-5) |
| A5 (CitcomS 3.2.0) | 1.0 | 1.5 | 22.86 (3e-2) | 2.5380 (7e-4) | 0.3126 (7e-5) |
| A5 (Gaia) | ? | 1.0 | 22.77 | 2.5386 | 0.3152 |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A7 (Zhong et. al.) | 1.2 | 1.7 | 50.21 (8e-3) | 2.7382 (5e-4) | 0.5039 (1e-4) |
| A7 (CitcomS 3.2.0) | 1.2 | 1.7 | 11.09 (5e-2) | 1.8972 (5e-3) | 0.3870 (3e-4) |
| A7 (Gaia) | ? | 5.0 | 46.83 | 2.4917 | 0.4529 |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| A8 (Zhong et. al.) | 0.8 | 1.0 | 87.27 (4e-2) | 3.0317 (2.8e-3) | 0.5461 (1e-4) |
| A8 (CitcomS 3.2.0) | 0.8 | 1.0 | 88.01 (2e-2) | 3.0889 (1e-3) | 0.5530 (1e-4) |
| A8 (Gaia) | ? | 4.1 | 83.35 | 3.1328 | 0.5531 |
Comparision of Values from Table 7 of the Zhong et. al. paper
Mean and standard deviations () are computed over the [t1,t2] interval
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| B1 (Zhong et. al.) | 1.2 | 1.7 | 31.09 (1e-4) | 3.6254 (1e-5) | 0.2176 (6e-7) |
| B1 (CitcomS 3.2.0) | 1.2 | 1.7 | 31.02 (1e-14) | 3.6212 (2e-6) | 0.2171 (3e-16) |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| B2 (Zhong et. al.) | 0.8 | 1.1 | 25.13 (7e-5) | 3.3721 (2e-5) | 0.2527 (2e-6) |
| B2 (CitcomS 3.2.0) | 0.8 | 1.1 | 25.09 (2e-4) | 3.3677 (2e-5) | 0.2525 (5e-6) |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| B3 (Zhong et. al.) | 0.8 | 1.2 | 24.35 (8e-5) | 3.3162 (2e-5) | 0.2587 (2e-6) |
| B3 (CitcomS 3.2.0) | 0.8 | 1.2 | 24.32 (5e-5) | 3.3122 (2e-5) | 0.2586 (3e-6) |
| Benchmark | t1 | t2 | <V_rms> | <Nu_t> | <T> |
|---|---|---|---|---|---|
| B4 (Zhong et. al.) | 1.0 | 1.3 | 22.49 (2e-5) | 3.1278 (6e-6) | 0.2797 (4e-7) |
| B4 (CitcomS 3.2.0) | 1.0 | 1.3 | 22.47 (3e-14) | 3.1233 (4e-6) | 0.2797 (1e-16) |
Benchmarking Papers
Configuration files used for the Benchmarks
software/citcoms/benchmarks.txt · Last modified: 2014/09/10 19:34 by ljhwang
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 3.0 Unported
