It has been found tuning can improve the results, so these numbers should not be taken as indicative of the potential performance of the Kyoto HashDB and TreeDB.
Note this is with the default tuning parameters
| mapped value size (bytes) | total data (bytes) | database size (bytes) | space overhead per record (bytes) | open database time (ms) | write data time (s) | read data time (s) | close database time (ms) | effective write rate (MB/s) | effective read rate (MB/s) |
|---|---|---|---|---|---|---|---|---|---|
| 4 | 12,000,000 | 38,297,720 | 26.3 | 2.5 | 3.31 | 0.44 | 3.4 | 3.5 | 26.2 |
| 8 | 16,000,000 | 38,297,720 | 22.3 | 0.9 | 3.35 | 0.46 | 3.7 | 4.6 | 33.3 |
| 16 | 24,000,000 | 46,297,720 | 22.3 | 1.1 | 3.36 | 0.44 | 4.2 | 6.8 | 52.1 |
| 32 | 40,000,000 | 62,297,720 | 22.3 | 1.0 | 3.25 | 0.56 | 5.3 | 11.8 | 67.7 |
| 64 | 72,000,000 | 94,297,720 | 22.3 | 1.1 | 4.38 | 2.54 | 5.5 | 15.7 | 27.1 |
| 128 | 136,000,000 | 166,297,720 | 30.3 | 0.9 | 6.04 | 4.48 | 5.5 | 21.5 | 28.9 |
| 256 | 264,000,000 | 294,297,720 | 30.3 | 0.8 | 7.14 | 5.51 | 5.6 | 35.3 | 45.7 |
| 512 | 520,000,000 | 550,297,720 | 30.3 | 0.8 | 8.32 | 6.05 | 5.3 | 59.6 | 82.0 |
| 1,024 | 1,032,000,000 | 1,062,297,720 | 30.3 | 0.9 | 10.80 | 6.84 | 5.4 | 91.1 | 143.9 |
| 2,048 | 2,056,000,000 | 2,086,297,720 | 30.3 | 0.9 | 12.73 | 7.40 | 5.5 | 154.0 | 264.9 |
| 4,096 | 4,104,000,000 | 4,134,297,720 | 30.3 | 1.2 | 19.04 | 8.77 | 5.6 | 205.6 | 446.4 |
| 8,192 | 8,200,000,000 | 8,230,297,720 | 30.3 | 1.0 | 34.91 | 35.99 | 5.7 | 224.0 | 217.3 |
Note this is with the default tuning parameters.
| mapped value size (bytes) | total data (bytes) | database size (bytes) | space overhead per record (bytes) | open database time (ms) | write data time (s) | read data time (s) | close database time (ms) | effective write rate (MB/s) | effective read rate (MB/s) |
|---|---|---|---|---|---|---|---|---|---|
| 4 | 12,000,000 | 37,331,712 | 25.3 | 2.0 | 11.17 | 1.10 | 122.2 | 1.0 | 10.4 |
| 8 | 16,000,000 | 35,577,856 | 19.6 | 1.6 | 9.39 | 1.09 | 119.3 | 1.6 | 14.0 |
| 16 | 24,000,000 | 44,252,416 | 20.3 | 3.7 | 8.59 | 0.88 | 132.4 | 2.7 | 26.1 |
| 32 | 40,000,000 | 74,349,824 | 34.3 | 3.5 | 10.98 | 1.17 | 141.2 | 3.5 | 32.7 |
| 64 | 72,000,000 | 199,813,120 | 127.8 | 2.1 | 14.75 | 7.31 | 133.9 | 4.7 | 9.4 |
| 128 | 136,000,000 | 295,232,256 | 159.2 | 3.1 | 21.96 | 10.33 | 84.5 | 5.9 | 12.6 |
| 256 | 264,000,000 | 568,140,032 | 304.1 | 3.6 | 34.80 | 17.32 | 60.3 | 7.2 | 14.5 |
| 512 | 520,000,000 | 2,054,346,240 | 1,534.3 | 1.4 | 48.66 | 21.00 | 63.8 | 10.2 | 23.6 |
| 1,024 | 1,032,000,000 | 4,284,145,152 | 3,252.1 | 1.6 | 122.29 | 23.53 | 136.5 | 8.0 | 41.8 |
| 2,048 | 2,056,000,000 | 4,935,943,168 | 2,879.9 | 1.8 | 206.73 | 28.77 | 283.7 | 9.5 | 68.1 |
| 4,096 | 4,104,000,000 | 4,374,228,480 | 270.2 | 1.5 | 474.11 | 149.67 | 2,596.2 | 8.3 | 26.2 |
| 8,192 | 8,200,000,000 | 8,470,268,160 | 270.3 | 1.6 | 1,026.33 | 409.39 | 22,424.5 | 7.6 | 19.1 |
Note this is with the default tuning parameters
| mapped value size (bytes) | total data (bytes) | database size (bytes) | space overhead per record (bytes) | open database time (ms) | write data time (s) | read data time (s) | close database time (ms) | effective write rate (MB/s) | effective read rate (MB/s) |
|---|---|---|---|---|---|---|---|---|---|
| 4 | 12,000,000 | 38,297,720 | 26.3 | 2.2 | 2.28 | 0.43 | 18.8 | 5.0 | 26.7 |
| 8 | 16,000,000 | 38,297,720 | 22.3 | 4.5 | 2.26 | 0.43 | 19.1 | 6.7 | 35.5 |
| 16 | 24,000,000 | 46,297,720 | 22.3 | 3.5 | 2.24 | 0.43 | 22.9 | 10.2 | 53.3 |
| 32 | 40,000,000 | 62,297,720 | 22.3 | 4.8 | 2.25 | 0.56 | 30.2 | 17.0 | 68.7 |
| 64 | 72,000,000 | 94,297,720 | 22.3 | 3.5 | 2.99 | 2.28 | 32.5 | 22.9 | 30.2 |
| 128 | 136,000,000 | 166,297,720 | 30.3 | 4.2 | 4.26 | 3.99 | 57.0 | 30.4 | 32.5 |
| 256 | 264,000,000 | 294,297,720 | 30.3 | 1.7 | 5.17 | 5.01 | 105.9 | 48.7 | 50.3 |
| 512 | 520,000,000 | 550,297,720 | 30.3 | 3.8 | 6.12 | 5.43 | 151.9 | 81.1 | 91.4 |
| 1,024 | 1,032,000,000 | 1,062,297,720 | 30.3 | 1.6 | 7.30 | 5.94 | 195.0 | 134.9 | 165.8 |
| 2,048 | 2,056,000,000 | 2,086,297,720 | 30.3 | 4.3 | 8.68 | 6.73 | 288.8 | 225.8 | 291.4 |
| 4,096 | 4,104,000,000 | 4,134,297,720 | 30.3 | 4.0 | 11.45 | 7.70 | 356.5 | 341.9 | 508.2 |
Note this is with the default tuning parameters
| mapped value size (bytes) | total data (bytes) | database size (bytes) | space overhead per record (bytes) | open database time (ms) | write data time (s) | read data time (s) | close database time (ms) | effective write rate (MB/s) | effective read rate (MB/s) |
|---|---|---|---|---|---|---|---|---|---|
| 4 | 12,000,000 | 37,331,712 | 25.3 | 2.2 | 9.22 | 1.13 | 134.7 | 1.2 | 10.2 |
| 8 | 16,000,000 | 35,577,856 | 19.6 | 4.2 | 8.76 | 1.11 | 136.2 | 1.7 | 13.7 |
| 16 | 24,000,000 | 44,252,416 | 20.3 | 5.3 | 7.73 | 0.92 | 161.5 | 3.0 | 25.0 |
| 32 | 40,000,000 | 74,349,824 | 34.3 | 2.2 | 9.64 | 1.16 | 161.8 | 4.0 | 32.9 |
| 64 | 72,000,000 | 199,813,120 | 127.8 | 2.1 | 18.95 | 7.66 | 154.1 | 3.6 | 9.0 |
| 128 | 136,000,000 | 295,232,256 | 159.2 | 4.8 | 19.67 | 11.02 | 139.8 | 6.6 | 11.8 |
| 256 | 264,000,000 | 568,140,032 | 304.1 | 5.7 | 30.63 | 17.74 | 114.5 | 8.2 | 14.2 |
| 512 | 520,000,000 | 2,054,346,240 | 1,534.3 | 2.1 | 65.47 | 19.90 | 99.8 | 7.6 | 24.9 |