Introduction

This is a follow-up on our Postgresql Performance on Ubuntu 18.04 and Nutanix post. We document here the same pgbench tests on an Amazon EC2 i-XL instance with NVMe SSD storage.

Disclaimer

The following test results are not intended to give definitive numbers on the tested platform. These are only illustrative of the methodology used to test the platform for postgresql workloads.

Sustained database benchmark with different linux kernel parameters

We tested different linux kernel tuning recommendations that we will summarize as follows :

Nutanix best practices:
(https://www.nutanix.com/de/go/postgresql-best-practice ) 

elevator=noop scsi_mod.use_blk_mq=1 dm_mod.use_blk_mq=y transparent_hugepage=nevervm.swappiness=0  #NOTE: GRUB configuration
vm.overcommit_memory=1
vm.dirty_background_ratio=5
vm.dirty_ratio=15

percona :
(https://www.percona.com/blog/2018/08/29/tune-linux-kernel-parameters-for-postgresql-optimization/ )

vm.swappiness=1
vm.overcommit_memory=2
vm.dirty_background_ratio=5
vm.dirty_ratio=15

dbi :
(https://blog.dbi-services.com/stay-tuned-with-kernel-parameters/
(note: although this post was targeted at Oracle databases, we just took the following vm tunables)

vm.swappiness=1
vm.dirty_background_ratio=3
vm.dirty_ratio=80

VM:

vm.dirty_background_bytes = 209715200
vm.dirty_background_ratio = 0
vm.dirty_bytes = 0
vm.dirty_ratio = 40

Other considerations :
The Percona suggested parameter vm.overcommit_memory=2 caused the machine to crash (unable to allocate memory). By the way SWP=1 means vm.swappiness is set to 1.

We also tested a combination of vm.dirty_background_bytes and vm.dirty_bytes (see above VM set). We used tuned to create different tuning profiles for each test set and ran a series of pgbench-tools tests with the following characteristics:
scale: 10, 100, 1000
clients: 8, 16, 32, 64, 128

For each test set, pgbench-tools will test a TPC-B-like test iteratively over each scale factor (database size) and concurrency (number of concurrent clients). It will rebuild the database at each test and will execute each iteration test a configured number of times. Here are the overall TPS and latency results for different scaling factors and concurrency levels.

pgbench-tools results

Averages across all test sets (EC2 iXL):

Test sets comparison:

Ubuntu 18.04 i-XL/NVME

Averages for test set 2 by scale:

set scale tps avg_latency 90%< max_latency
2 10 1546 29.761 68.037 269.582
2 100 2700 16.207 25.611 167.905
2 1000 2480 17.628 27.134 475.732

Averages for test set 2 by clients:
set clients tps avg_latency 90%< max_latency
2 8 1251 6.397 7.907 27.489
2 16 2022 8.235 12.301 63.358
2 32 2600 13.426 23.872 338.986
2 64 2709 25.72 50.497 437.199
2 128 2628 52.215 106.726 655

Averages for test set 2 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
2 10 8   1187 6.732 10.502 26.962
2 10 16   1492 10.709 19.933 77.579
2 10 32   1636 19.523 41.237 200.372
2 10 64   1706 37.398 88.301 360.485
2 10 128   1708 74.444 180.215 682.512
2 100 8   1299 6.15 6.533 33.305
2 100 16   2379 6.71 8.61 71.657
2 100 32   3229 9.886 14.868 100.102
2 100 64   3375 18.868 30.483 247.111
2 100 128   3218 39.42 67.559 387.351
2 1000 8   1266 6.309 6.687 22.201
2 1000 16   2193 7.286 8.36 40.838
2 1000 32   2935 10.868 15.511 716.484
2 1000 64   3046 20.895 32.706 704
2 1000 128   2958 42.783 72.405 895.137

Detail for test set 2:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
2 91 10 8   1178 29.141 0 0 0 0 3472 0 0 6287360 167969848 00:00:00.720533
2 96 10 8   1189 25.626 0 0 0 0 461 0 0 3641344 172318504 00:00:00.691527
2 101 10 8   1193 26.118 0 0 0 0 466 0 0 3899392 174077792 00:00:00.718701
2 92 10 16   1491 82.53 0 0 0 0 640 0 0 4620288 184084216 00:00:00.655188
2 97 10 16   1489 70.207 0 0 0 0 590 0 0 4554752 192597152 00:00:00.761561
2 102 10 16   1495 80 0 0 0 0 591 0 0 4493312 185964160 00:00:00.737027
2 93 10 32   1628 195.183 0 0 0 0 655 0 0 5156864 191813200 00:00:00.673947
2 98 10 32   1644 217.353 0 0 0 0 751 0 0 5046272 203052448 00:00:00.808771
2 103 10 32   1636 188.58 0 0 0 0 651 0 0 4149248 195940704 00:00:00.776293
2 94 10 64   1702 377.207 0 0 0 0 789 0 0 5554176 201735504 00:00:00.72199
2 99 10 64   1709 358.191 0 0 0 0 839 0 0 5894144 206597712 00:00:00.84648
2 104 10 64   1706 346.058 0 0 0 0 717 0 0 5423104 203326744 00:00:00.804948
2 95 10 128   1712 658.775 0 0 0 0 815 0 0 6209536 206641416 00:00:00.798756
2 100 10 128   1709 676.636 0 0 0 0 922 0 0 6451200 208430640 00:00:00.871882
2 105 10 128   1703 712.124 0 0 0 0 802 0 0 4866048 208178056 00:00:00.840685
2 106 100 8   1292 40.493 0 0 0 0 27361 0 0 6967296 734261624 00:00:03.890531
2 111 100 8   1303 18.179 0 0 0 0 507 0 0 4075520 795133728 00:00:03.819137
2 116 100 8   1301 41.242 0 0 0 0 507 0 0 3911680 802892112 00:00:03.953933
2 107 100 16   2353 74.543 0 0 0 0 3032 0 0 9965568 1233427888 00:00:05.642895
2 112 100 16   2395 55.501 0 0 0 0 932 0 0 6021120 1212134688 00:00:05.4894
2 117 100 16   2390 84.926 0 0 0 0 931 0 0 5513216 1193138856 00:00:05.60325
2 108 100 32   3140 120.397 0 0 0 0 1549 0 0 9175040 1440475000 00:00:06.724276
2 113 100 32   3279 69.572 0 0 0 0 1318 0 0 7204864 1438086680 00:00:06.81569
2 118 100 32   3268 110.337 0 0 0 0 1283 0 0 7733248 1455986760 00:00:06.939426
2 109 100 64   3388 221.743 0 0 0 0 1481 0 0 9916416 1495460880 00:00:06.827397
2 114 100 64   3381 285.096 0 0 0 0 1345 0 0 7581696 1496335920 00:00:06.243027
2 119 100 64   3355 234.493 0 0 0 0 1358 0 0 7684096 1499785432 00:00:07.111096
2 110 100 128   3236 358.189 0 0 0 0 1525 0 0 8454144 1454408720 00:00:06.109986
2 115 100 128   3215 376.986 0 0 0 0 1386 0 0 8032256 1467956024 00:00:06.824378
2 120 100 128   3205 426.879 0 0 0 0 1381 0 0 6672384 1449245832 00:00:06.382684
2 121 1000 8   1270 28.177 0 0 0 0 144013 0 0 9539584 1145248984 00:00:12.126018
2 126 1000 8   1265 19.659 0 0 0 0 51586 0 0 3485696 1628160416 00:00:16.153522
2 131 1000 8   1264 18.767 0 0 0 0 30819 0 0 2797568 1628361672 00:00:16.426811
2 122 1000 16   2181 56.652 1 91786 0 1701 200786 0 0 760852480 2490924760 00:00:24.698595
2 127 1000 16   2199 34.893 1 137924 0 852 82282 0 0 1133445120 2821532176 00:00:28.506769
2 132 1000 16   2200 30.969 1 138422 0 868 49644 0 0 1137864704 2825119184 00:00:29.084123
2 123 1000 32   2973 832.712 1 229688 0 1923 213082 0 0 1799077888 3518712112 00:00:35.015695
2 128 1000 32   2909 655.716 2 236250 0 1135 97434 0 0 1632481280 3721609856 00:00:34.209941
2 133 1000 32   2924 661.024 2 238661 0 1156 60037 0 0 915886080 3739141016 00:00:35.257728
2 124 1000 64   3037 748.607 2 256780 0 1285 170382 0 0 1797824512 3879865832 00:00:37.184304
2 129 1000 64   3049 628.271 2 261874 0 1223 90171 0 0 1810231296 3912321784 00:00:35.175857
2 134 1000 64   3052 735.121 2 262573 0 1229 56483 0 0 733675520 3920201008 00:00:36.494432
2 125 1000 128   2994 734.973 2 248784 0 1395 138370 0 0 1697869824 3853982216 00:00:36.616807
2 130 1000 128   2907 934.865 2 240065 0 1285 77166 0 0 1259175936 3744805912 00:00:34.959165
2 135 1000 128   2974 1015.574 2 251151 0 1289 49814 0 0 769241088 3832608464 00:00:35.33193

Set 3 : Ubuntu 18.04 i-XL/NVME – SWP=1

Averages for test set 3 by scale:

set scale tps avg_latency 90%< max_latency
3 10 1581 28.665 66.83 300.967
3 100 2570 17.518 27.858 154.622
3 1000 2427 18.671 33.003 181.795

Averages for test set 3 by clients:
set clients tps avg_latency 90%< max_latency
3 8 1296 6.186 7.815 25.063
3 16 2135 7.933 12.922 59.435
3 32 2518 13.597 25.33 124.046
3 64 2561 26.403 52.669 268.128
3 128 2454 53.97 114.083 585.635

Averages for test set 3 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
3 10 8   1190 6.716 10.545 32.149
3 10 16   1473 10.847 20.027 78.89
3 10 32   1676 19.051 42.632 186.11
3 10 64   1767 36.089 86.971 384.14
3 10 128   1800 70.621 173.975 823.545
3 100 8   1361 5.868 6.395 22.175
3 100 16   2506 6.373 9.367 44.821
3 100 32   3038 10.505 16.101 98.878
3 100 64   3067 20.767 33.01 186.981
3 100 128   2877 44.077 74.419 420.254
3 1000 8   1337 5.974 6.507 20.864
3 1000 16   2427 6.58 9.371 54.595
3 1000 32   2841 11.234 17.256 87.15
3 1000 64   2847 22.354 38.027 233.263
3 1000 128   2684 47.211 93.854 513.104

Detail for test set 3:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
3 136 10 8   1181 30.64 0 0 0 0 3455 0 0 655360 184764432 00:00:00.629186
3 141 10 8   1193 35.967 0 0 0 0 467 0 0 540672 171916160 00:00:00.620049
3 146 10 8   1195 29.839 0 0 0 0 467 0 0 602112 171485016 00:00:00.618923
3 137 10 16   1469 76.845 0 0 0 0 593 0 0 610304 182245176 00:00:00.559589
3 142 10 16   1476 86.36 0 0 0 0 581 0 0 581632 191669120 00:00:00.67113
3 147 10 16   1475 73.465 0 0 0 0 582 0 0 634880 184030144 00:00:00.662941
3 138 10 32   1672 170.841 0 0 0 0 761 0 0 847872 194780720 00:00:00.588993
3 143 10 32   1682 195.566 0 0 0 0 675 0 0 647168 204089176 00:00:00.726788
3 148 10 32   1674 191.924 0 0 0 0 681 0 0 634880 194470272 00:00:00.669596
3 139 10 64   1769 392.99 0 0 0 0 753 0 0 1146880 202848768 00:00:00.651054
3 144 10 64   1770 365.962 0 0 0 0 884 0 0 1249280 207908392 00:00:00.725678
3 149 10 64   1763 393.469 0 0 0 0 739 0 0 675840 204126624 00:00:00.68413
3 140 10 128   1797 923.248 0 0 0 0 990 0 0 692224 208923912 00:00:00.709307
3 145 10 128   1808 751.702 0 0 0 0 951 0 0 1232896 211060304 00:00:00.74471
3 150 10 128   1796 795.686 0 0 0 0 815 0 0 720896 210703240 00:00:00.765598
3 151 100 8   1359 29.018 0 0 0 0 27697 0 0 606208 758646656 00:00:03.4585
3 156 100 8   1371 19.296 0 0 0 0 531 0 0 544768 859081608 00:00:03.427161
3 161 100 8   1354 18.211 0 0 0 0 533 0 0 655360 837054176 00:00:03.624153
3 152 100 16   2490 36.654 0 0 0 0 2837 0 0 827392 1262663080 00:00:04.934505
3 157 100 16   2512 42.211 0 0 0 0 978 0 0 864256 1285777960 00:00:04.899459
3 162 100 16   2515 55.598 0 0 0 0 962 0 0 802816 1287996480 00:00:05.751365
3 153 100 32   3048 108.295 0 0 0 0 1434 0 0 1089536 1438189544 00:00:05.207908
3 158 100 32   3023 85.325 0 0 0 0 1221 0 0 901120 1423190512 00:00:05.341652
3 163 100 32   3042 103.013 0 0 0 0 1209 0 0 1183744 1441786352 00:00:05.482009
3 154 100 64   3078 214.252 0 0 0 0 1328 0 0 974848 1465377288 00:00:05.768107
3 159 100 64   3049 174.173 0 0 0 0 1224 0 0 806912 1458513144 00:00:06.08091
3 164 100 64   3074 172.519 0 0 0 0 1259 0 0 1253376 1451870184 00:00:06.222266
3 155 100 128   2904 453.087 0 0 0 0 1278 0 0 1208320 1421531232 00:00:05.170205
3 160 100 128   2883 388.404 0 0 0 0 1226 0 0 933888 1420669728 00:00:05.335017
3 165 100 128   2844 419.271 0 0 0 0 1418 0 0 1138688 1429347576 00:00:05.448306
3 166 1000 8   1338 27.793 0 0 0 0 151490 0 0 663552 1203656000 00:00:13.918388
3 171 1000 8   1339 16.251 0 0 0 0 55435 0 0 593920 1708055512 00:00:15.692365
3 176 1000 8   1335 18.548 0 0 0 0 32601 0 0 606208 1720454832 00:00:15.842122
3 167 1000 16   2431 62.958 1 127019 0 1958 219090 0 0 2170880 2738647640 00:00:30.252614
3 172 1000 16   2427 62.793 1 179999 0 940 91804 0 0 1196032 3141315312 00:00:25.605551
3 177 1000 16   2422 38.033 1 179034 0 939 55517 0 0 1855488 3120642040 00:00:26.164569
3 168 1000 32   2841 84.917 1 229753 0 1488 197970 0 0 1204224 3495271352 00:00:28.308848
3 173 1000 32   2849 79.066 1 228581 0 1076 95497 0 0 1757184 3650460224 00:00:29.626469
3 178 1000 32   2833 97.468 1 228877 0 1065 58768 0 0 2088960 3648539536 00:00:29.662803
3 169 1000 64   2837 189.112 1 229535 0 1225 157761 0 0 2125824 3643828384 00:00:30.216003
3 174 1000 64   2858 196.671 2 229001 0 1230 85505 0 0 1409024 3683047696 00:00:29.519155
3 179 1000 64   2847 314.006 1 230028 0 1130 53773 0 0 1798144 3663274648 00:00:28.807923
3 170 1000 128   2677 537.547 1 228187 0 1123 125578 0 0 2949120 3470812944 00:00:26.839682
3 175 1000 128   2683 507.579 1 226751 0 1158 71796 0 0 1421312 3463320024 00:00:27.150271
3 180 1000 128   2690 494.187 1 227781 0 1181 45897 0 0 3846144 3471559808 00:00:27.157265

Set 4 : Ubuntu 18.04 i-XL/NVME – SWP1/VM

Averages for test set 4 by scale:

set scale tps avg_latency 90%< max_latency
4 10 1580 28.677 67.337 302.316
4 100 2582 17.399 27.524 151.406
4 1000 2431 18.65 33.2 197.705

Averages for test set 4 by clients:
set clients tps avg_latency 90%< max_latency
4 8 1300 6.169 7.853 24.18
4 16 2135 7.938 12.963 66.336
4 32 2526 13.561 25.277 139.909
4 64 2564 26.384 52.848 305.868
4 128 2462 53.825 114.493 549.42

Averages for test set 4 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
4 10 8   1187 6.728 10.575 28.807
4 10 16   1470 10.872 20.191 90.335
4 10 32   1679 19.016 42.683 201.094
4 10 64   1765 36.134 87.944 498.568
4 10 128   1800 70.636 175.294 692.777
4 100 8   1368 5.837 6.442 24.159
4 100 16   2508 6.368 9.36 42.511
4 100 32   3054 10.449 16 90.395
4 100 64   3077 20.697 32.741 196.693
4 100 128   2902 43.642 73.076 403.273
4 1000 8   1345 5.942 6.543 19.574
4 1000 16   2428 6.575 9.339 66.161
4 1000 32   2844 11.217 17.148 128.236
4 1000 64   2852 22.32 37.86 222.342
4 1000 128   2684 47.198 95.111 552.21

Detail for test set 4:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
4 181 10 8   1181 31.721 0 0 0 0 3450 0 0 1404928 184847120 00:00:00.730658
4 186 10 8   1191 27.965 0 0 0 0 464 0 0 884736 171859488 00:00:00.721412
4 191 10 8   1190 26.735 0 0 0 0 466 0 0 774144 171196424 00:00:00.716431
4 182 10 16   1470 98.247 0 0 0 0 624 0 0 1081344 182497368 00:00:01.536304
4 187 10 16   1467 81.735 0 0 0 0 578 0 0 737280 191486928 00:00:00.743209
4 192 10 16   1471 91.024 0 0 0 0 578 0 0 905216 183734568 00:00:00.759348
4 183 10 32   1675 204.326 0 0 0 0 684 0 0 1368064 193438416 00:00:00.712053
4 188 10 32   1682 198.94 0 0 0 0 728 0 0 1064960 204218656 00:00:00.820447
4 193 10 32   1681 200.016 0 0 0 0 680 0 0 1110016 194686176 00:00:00.747
4 184 10 64   1765 558.204 0 0 0 0 868 0 0 1830912 203852048 00:00:00.732146
4 189 10 64   1773 484.039 0 0 0 0 858 0 0 1400832 208024096 00:00:00.857839
4 194 10 64   1756 453.46 0 0 0 0 746 0 0 1257472 204354312 00:00:00.787663
4 185 10 128   1804 743.356 0 0 0 0 838 0 0 1339392 209296128 00:00:00.783072
4 190 10 128   1803 612.458 0 0 0 0 984 0 0 1720320 210816240 00:00:00.840888
4 195 10 128   1791 722.517 0 0 0 0 824 0 0 1523712 210356192 00:00:00.844288
4 196 100 8   1366 22.67 0 0 0 0 27688 0 0 1425408 759412368 00:00:03.571649
4 201 100 8   1362 26.771 0 0 0 0 530 0 0 794624 852227944 00:00:03.615306
4 206 100 8   1377 23.035 0 0 0 0 536 0 0 700416 864663304 00:00:04.143851
4 197 100 16   2498 42.401 0 0 0 0 2851 0 0 1462272 1263775088 00:00:05.125009
4 202 100 16   2512 32.492 0 0 0 0 973 0 0 1089536 1286178096 00:00:05.816032
4 207 100 16   2513 52.64 0 0 0 0 979 0 0 1265664 1270643104 00:00:05.277677
4 198 100 32   3055 73.038 0 0 0 0 1438 0 0 1654784 1438987088 00:00:05.28573
4 203 100 32   3055 87.091 0 0 0 0 1193 0 0 1597440 1429777864 00:00:05.433727
4 208 100 32   3052 111.057 0 0 0 0 1189 0 0 1507328 1443674264 00:00:06.293095
4 199 100 64   3083 174.244 0 0 0 0 1354 0 0 1736704 1464549496 00:00:05.975372
4 204 100 64   3082 173.45 0 0 0 0 1231 0 0 2007040 1465640360 00:00:06.176103
4 209 100 64   3066 242.384 0 0 0 0 1344 0 0 1933312 1469139480 00:00:05.648384
4 200 100 128   2936 396.937 0 0 0 0 1306 0 0 1810432 1415972336 00:00:05.298576
4 205 100 128   2875 387.533 0 0 0 0 1258 0 0 2064384 1420554488 00:00:05.469975
4 210 100 128   2897 425.35 0 0 0 0 1254 0 0 2207744 1403276248 00:00:06.212958
4 211 1000 8   1357 20.404 0 0 0 0 153019 0 0 1728512 1217637288 00:00:12.681765
4 216 1000 8   1332 20.285 0 0 0 0 55469 0 0 823296 1720917696 00:00:15.696853
4 221 1000 8   1345 18.032 0 0 0 0 32894 0 0 757760 1732996672 00:00:15.993959
4 212 1000 16   2428 68.557 1 127208 0 1932 218324 0 0 176144384 2741877304 00:00:27.391901
4 217 1000 16   2426 62.913 1 179728 0 942 91561 0 0 206622720 3126280680 00:00:27.215212
4 222 1000 16   2431 67.012 1 181319 0 948 55776 0 0 201629696 3134610704 00:00:26.966919
4 213 1000 32   2845 104.889 1 229873 0 1520 198081 0 0 207634432 3498665144 00:00:28.585913
4 218 1000 32   2838 151.634 1 228123 0 1081 95210 0 0 168157184 3644701424 00:00:30.094661
4 223 1000 32   2850 128.186 1 228421 0 1084 59378 0 0 160980992 3653246944 00:00:29.981191
4 214 1000 64   2842 164.89 1 229188 0 1125 157445 0 0 166281216 3648862040 00:00:32.359438
4 219 1000 64   2854 194.936 1 230022 0 1135 85117 0 0 187215872 3657565616 00:00:30.196119
4 224 1000 64   2859 307.201 2 230339 0 1224 54014 0 0 168476672 3675282368 00:00:30.074312
4 215 1000 128   2659 639.938 1 225613 0 1174 124781 0 0 190033920 3468082304 00:00:27.809445
4 220 1000 128   2690 490.959 1 228503 0 1289 72774 0 0 179830784 3483744984 00:00:27.882138
4 225 1000 128   2702 525.734 1 229737 0 1165 46086 0 0 203882496 3489598832 00:00:27.936172

Set 5 : Ubuntu 18.04 i-XL/NVME – NTNX BP

Averages for test set 5 by scale:

set scale tps avg_latency 90%< max_latency
5 10 1578 28.659 67.105 497.809
5 100 2573 17.509 27.767 156.634
5 1000 2426 18.658 33.171 251.203

Averages for test set 5 by clients:
set clients tps avg_latency 90%< max_latency
5 8 1291 6.219 7.844 341.371
5 16 2133 7.942 12.962 67.412
5 32 2518 13.599 25.36 230.258
5 64 2565 26.338 52.722 289.434
5 128 2454 53.945 114.516 580.934

Averages for test set 5 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
5 10 8   1170 6.835 10.56 981.177
5 10 16   1470 10.866 20.133 92.861
5 10 32   1675 19.058 42.915 212.283
5 10 64   1774 35.932 87.326 413.615
5 10 128   1800 70.604 174.589 789.108
5 100 8   1370 5.832 6.433 21.792
5 100 16   2505 6.375 9.38 46.433
5 100 32   3046 10.477 16.049 99.648
5 100 64   3071 20.74 32.998 200.245
5 100 128   2874 44.121 73.973 415.051
5 1000 8   1334 5.991 6.539 21.143
5 1000 16   2424 6.586 9.374 62.94
5 1000 32   2833 11.261 17.117 378.845
5 1000 64   2850 22.341 37.841 254.441
5 1000 128   2689 47.11 94.985 538.644

Detail for test set 5:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
5 226 10 8   1126 2883.232 0 0 0 0 3432 0 0 1703936 183087208 00:00:00.725932
5 231 10 8   1192 25.478 0 0 0 0 467 0 0 966656 172527376 00:00:00.69576
5 236 10 8   1191 34.82 0 0 0 0 462 0 0 540672 172803248 00:00:00.746963
5 227 10 16   1475 93.699 0 0 0 0 634 0 0 1073152 183949568 00:00:00.663571
5 232 10 16   1467 85.309 0 0 0 0 581 0 0 1007616 191804120 00:00:01.615975
5 237 10 16   1469 99.576 0 0 0 0 579 0 0 1003520 183736272 00:00:00.731783
5 228 10 32   1673 246.601 0 0 0 0 682 0 0 1069056 193276736 00:00:00.718034
5 233 10 32   1676 184.636 0 0 0 0 760 0 0 1130496 203831544 00:00:00.847917
5 238 10 32   1677 205.611 0 0 0 0 671 0 0 1056768 196491432 00:00:00.759223
5 229 10 64   1769 456.636 0 0 0 0 850 0 0 1163264 203741056 00:00:00.729947
5 234 10 64   1782 357.67 0 0 0 0 863 0 0 1327104 208403160 00:00:00.857067
5 239 10 64   1772 426.54 0 0 0 0 732 0 0 1622016 204562136 00:00:00.816161
5 230 10 128   1804 787.574 0 0 0 0 819 0 0 1556480 192190240 00:00:00.781581
5 235 10 128   1808 694.768 0 0 0 0 963 0 0 1564672 210952552 00:00:00.840718
5 240 10 128   1788 884.981 0 0 0 0 857 0 0 1695744 210434552 00:00:00.88583
5 241 100 8   1371 24.853 0 0 0 0 27676 0 0 1622016 761477456 00:00:03.977767
5 246 100 8   1359 18.97 0 0 0 0 531 0 0 901120 856414368 00:00:04.030756
5 251 100 8   1379 21.553 0 0 0 0 531 0 0 860160 862467008 00:00:04.834888
5 242 100 16   2485 45.532 0 0 0 0 2849 0 0 1437696 1262552176 00:00:05.500835
5 247 100 16   2511 50.748 0 0 0 0 981 0 0 1597440 1291841880 00:00:05.550941
5 252 100 16   2519 43.019 0 0 0 0 978 0 0 1359872 1271654304 00:00:05.64736
5 243 100 32   3020 130.638 0 0 0 0 1407 0 0 1593344 1437431752 00:00:05.85604
5 248 100 32   3054 84.275 0 0 0 0 1209 0 0 1597440 1449560920 00:00:06.586676
5 253 100 32   3063 84.031 0 0 0 0 1210 0 0 1597440 1447435968 00:00:06.703303
5 244 100 64   3034 185.249 0 0 0 0 1350 0 0 2387968 1458107936 00:00:06.405402
5 249 100 64   3096 192.899 0 0 0 0 1319 0 0 1761280 1451846280 00:00:05.992337
5 254 100 64   3082 222.586 0 0 0 0 1231 0 0 1785856 1468322144 00:00:06.131363
5 245 100 128   2796 442.131 0 0 0 0 1226 0 0 1826816 1388479704 00:00:05.679789
5 250 100 128   2919 414.38 0 0 0 0 1253 0 0 2301952 1430217696 00:00:06.583603
5 255 100 128   2908 388.643 0 0 0 0 1285 0 0 1814528 1414145984 00:00:07.736636
5 256 1000 8   1344 22.252 0 0 0 0 151989 0 0 2129920 1208934768 00:00:12.530276
5 261 1000 8   1329 23.637 0 0 0 0 54792 0 0 958464 1712893640 00:00:16.282535
5 266 1000 8   1327 17.541 0 0 0 0 32549 0 0 954368 1710940632 00:00:16.501709
5 257 1000 16   2423 49.396 1 126297 0 1940 218227 0 0 198066176 2734384224 00:00:28.381219
5 262 1000 16   2426 88.729 1 179768 0 948 91406 0 0 297340928 3123233624 00:00:28.476672
5 267 1000 16   2424 50.696 1 179510 0 941 55547 0 0 307957760 3122319896 00:00:29.162689
5 258 1000 32   2857 119.551 1 228389 0 1504 198965 0 0 346980352 3507717008 00:00:31.124834
5 263 1000 32   2817 483.621 1 228405 0 1064 94626 0 0 384282624 3615835960 00:00:31.689315
5 268 1000 32   2824 533.362 1 229345 0 1065 59191 0 0 395960320 3625593728 00:00:30.896585
5 259 1000 64   2849 298.505 1 229999 0 1183 158339 0 0 382959616 3659775248 00:00:30.627376
5 264 1000 64   2842 222.26 1 229041 0 1110 84666 0 0 368926720 3647564616 00:00:32.762477
5 269 1000 64   2860 242.559 2 230097 0 1160 53566 0 0 382799872 3673022944 00:00:33.025201
5 260 1000 128   2674 624.604 1 227076 0 1242 124917 0 0 232980480 3461254752 00:00:32.981694
5 265 1000 128   2703 497.979 1 229727 0 1168 72592 0 0 192356352 3490642888 00:00:30.502853
5 270 1000 128   2690 493.35 1 219916 0 1145 46235 0 0 246177792 3497565456 00:00:30.702698

Set 6 : Ubuntu 18.04 i-XL/NVME – dbi

Averages for test set 6 by scale:

set scale tps avg_latency 90%< max_latency
6 10 1549 29.718 68.107 305.706
6 100 2734 16.071 25.365 170.388
6 1000 2580 16.886 26.508 244.052

Averages for test set 6 by clients:
set clients tps avg_latency 90%< max_latency
6 8 1256 6.371 7.871 19.863
6 16 2033 8.199 12.175 69.765
6 32 2691 13.106 23.575 147.243
6 64 2780 25.228 49.91 331.657
6 128 2678 51.555 106.436 631.716

Averages for test set 6 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
6 10 8   1192 6.703 10.454 26.247
6 10 16   1493 10.704 19.92 76.583
6 10 32   1641 19.462 41.019 171.387
6 10 64   1713 37.239 87.72 420.109
6 10 128   1707 74.481 181.422 834.202
6 100 8   1303 6.131 6.512 18.084
6 100 16   2400 6.652 8.358 67.431
6 100 32   3323 9.6 14.513 130.063
6 100 64   3416 18.64 30.193 250.321
6 100 128   3228 39.331 67.252 386.043
6 1000 8   1273 6.278 6.649 15.258
6 1000 16   2206 7.239 8.248 65.281
6 1000 32   3110 10.255 15.194 140.279
6 1000 64   3213 19.805 31.817 324.539
6 1000 128   3099 40.852 70.633 674.905

Detail for test set 6:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
6 271 10 8   1182 26.054 0 0 0 0 3525 0 0 1765376 184646448 00:00:00.71487
6 276 10 8   1195 25.808 0 0 0 0 468 0 0 688128 171292720 00:00:00.682386
6 281 10 8   1199 26.878 0 0 0 0 467 0 0 663552 173768560 00:00:00.742797
6 272 10 16   1488 76.485 0 0 0 0 646 0 0 1200128 184776488 00:00:00.655438
6 277 10 16   1494 72.59 0 0 0 0 589 0 0 937984 192803072 00:00:00.764355
6 282 10 16   1496 80.675 0 0 0 0 586 0 0 983040 185435112 00:00:00.725532
6 273 10 32   1640 162.795 0 0 0 0 651 0 0 1007616 191651384 00:00:00.698767
6 278 10 32   1642 169.801 0 0 0 0 735 0 0 1118208 186195704 00:00:00.831054
6 283 10 32   1641 181.566 0 0 0 0 653 0 0 925696 195886456 00:00:00.745578
6 274 10 64   1712 374.778 0 0 0 0 820 0 0 1363968 202275376 00:00:00.741023
6 279 10 64   1709 410.985 0 0 0 0 858 0 0 1175552 206616232 00:00:00.813949
6 284 10 64   1717 474.565 0 0 0 0 719 0 0 1003520 203492016 00:00:01.701051
6 275 10 128   1698 744.708 0 0 0 0 833 0 0 1499136 206362584 00:00:00.761585
6 280 10 128   1704 990.128 0 0 0 0 907 0 0 1642496 208183784 00:00:00.854242
6 285 10 128   1719 767.769 0 0 0 0 790 0 0 1290240 208798640 00:00:00.85551
6 286 100 8   1296 16.706 0 0 0 0 27430 0 0 1286144 735891216 00:00:03.761017
6 291 100 8   1308 19.506 0 0 0 0 508 0 0 692224 777778104 00:00:03.789899
6 296 100 8   1305 18.04 0 0 0 0 507 0 0 688128 793795536 00:00:03.896195
6 287 100 16   2395 81.647 0 0 0 0 3000 0 0 1171456 1256243112 00:00:05.289763
6 292 100 16   2405 53.095 0 0 0 0 945 0 0 1191936 1206050248 00:00:05.233566
6 297 100 16   2400 67.55 0 0 0 0 941 0 0 1052672 1201314544 00:00:05.372147
6 288 100 32   3342 90.98 0 0 0 0 1651 0 0 1785856 1445380952 00:00:06.31747
6 293 100 32   3315 144.261 0 0 0 0 1343 0 0 1585152 1454494584 00:00:05.671153
6 298 100 32   3311 154.947 0 0 0 0 1313 0 0 1835008 1433422408 00:00:05.811271
6 289 100 64   3468 253.11 0 0 0 0 1468 0 0 1961984 1507416544 00:00:06.324296
6 294 100 64   3391 247.19 0 0 0 0 1353 0 0 1605632 1470950360 00:00:06.414747
6 299 100 64   3389 250.663 0 0 0 0 1386 0 0 1806336 1488002432 00:00:05.860598
6 290 100 128   3305 409.367 0 0 0 0 1499 0 0 2220032 1478005752 00:00:05.525089
6 295 100 128   3139 380.618 0 0 0 0 1358 0 0 1654784 1436133312 00:00:05.691557
6 300 100 128   3239 368.143 0 0 0 0 1459 0 0 2138112 1470874768 00:00:06.559404
6 301 1000 8   1277 18.325 0 0 0 0 144675 0 0 1519616 1133601712 00:00:11.965983
6 306 1000 8   1269 12.779 0 0 0 0 50287 0 0 573440 1630372968 00:00:15.948208
6 311 1000 8   1272 14.671 0 0 0 0 29484 0 0 593920 1630188864 00:00:15.50871
6 302 1000 16   2201 84.338 1 48852 0 1728 202772 0 0 213868544 2494507472 00:00:23.506007
6 307 1000 16   2209 35.799 1 94257 0 869 80899 0 0 229638144 2805342832 00:00:22.654457
6 312 1000 16   2208 75.706 1 93123 0 855 47835 0 0 212750336 2802734456 00:00:23.68863
6 303 1000 32   3131 156.423 1 209467 0 2065 221576 0 0 274264064 3643906064 00:00:34.115741
6 308 1000 32   3103 114.94 1 249482 0 1224 101012 0 0 234872832 3933360608 00:00:33.794646
6 313 1000 32   3096 149.473 1 248047 0 1215 61136 0 0 214712320 3923697168 00:00:32.774499
6 304 1000 64   3218 418.272 1 265746 0 1439 177395 0 0 352133120 4053152616 00:00:35.104572
6 309 1000 64   3219 286.86 1 266576 0 1285 92403 0 0 323739648 4082952192 00:00:34.949208
6 314 1000 64   3201 268.486 1 265704 0 1285 56542 0 0 328511488 4057334016 00:00:34.656982
6 305 1000 128   3119 505.456 1 255601 0 1452 141032 0 0 236339200 3978508520 00:00:34.220101
6 310 1000 128   3113 588.437 1 256176 0 1345 79436 0 0 367992832 3975288488 00:00:31.768822
6 315 1000 128   3065 930.821 1 246447 0 1310 48452 0 0 286085120 3909714240 00:00:34.026668

Set 7 : Ubuntu 18.04 i-XL/NVME – dbi/hugepages

Averages for test set 7 by scale:

set scale tps avg_latency 90%< max_latency
7 10 1555 29.559 67.508 296.425
7 100 2813 15.475 24.498 99.959
7 1000 2648 16.35 25.978 129.652

Averages for test set 7 by clients:
set clients tps avg_latency 90%< max_latency
7 8 1261 6.345 7.844 20.925
7 16 2043 8.164 12.119 57.795
7 32 2726 13.001 23.421 110.153
7 64 2861 24.805 49.668 221.33
7 128 2803 49.992 103.587 466.523

Averages for test set 7 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
7 10 8   1194 6.692 10.447 27.55
7 10 16   1498 10.665 19.866 86.084
7 10 32   1645 19.424 40.874 194.189
7 10 64   1714 37.221 88.303 428.745
7 10 128   1725 73.792 178.049 745.555
7 100 8   1311 6.097 6.468 19.616
7 100 16   2421 6.601 8.317 31.729
7 100 32   3363 9.501 14.379 50.747
7 100 64   3551 17.968 29.255 103.597
7 100 128   3421 37.21 64.072 294.106
7 1000 8   1279 6.246 6.616 15.608
7 1000 16   2211 7.228 8.174 55.573
7 1000 32   3170 10.077 15.011 85.523
7 1000 64   3318 19.225 31.447 131.649
7 1000 128   3263 38.975 68.641 359.909

Detail for test set 7:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
7 316 10 8   1184 30.688 0 0 0 0 3525 0 0 1413120 184668464 00:00:00.688876
7 321 10 8   1199 25.772 0 0 0 0 470 0 0 675840 172635312 00:00:00.659125
7 326 10 8   1199 26.19 0 0 0 0 466 0 0 606208 172740232 00:00:00.684299
7 317 10 16   1498 106.752 0 0 0 0 654 0 0 933888 184784624 00:00:00.628741
7 322 10 16   1500 70.562 0 0 0 0 594 0 0 704512 193272672 00:00:01.709108
7 327 10 16   1497 80.937 0 0 0 0 587 0 0 647168 185921448 00:00:00.723368
7 318 10 32   1641 192.219 0 0 0 0 653 0 0 811008 191571176 00:00:00.669101
7 323 10 32   1643 174.981 0 0 0 0 763 0 0 1081344 203172280 00:00:00.801191
7 328 10 32   1651 215.367 0 0 0 0 685 0 0 888832 193974344 00:00:00.732978
7 319 10 64   1719 390.629 0 0 0 0 811 0 0 974848 185727792 00:00:00.693322
7 324 10 64   1714 444.038 0 0 0 0 801 0 0 1236992 206593080 00:00:00.806395
7 329 10 64   1710 451.568 0 0 0 0 703 0 0 827392 203550240 00:00:00.774027
7 320 10 128   1725 859.85 0 0 0 0 829 0 0 1437696 207086808 00:00:00.761369
7 325 10 128   1720 699.742 0 0 0 0 1070 0 0 2572288 208763960 00:00:00.83686
7 330 10 128   1729 677.073 0 0 0 0 807 0 0 1789952 208838696 00:00:00.828326
7 331 100 8   1309 16.963 0 0 0 0 27438 0 0 933888 739585912 00:00:03.371009
7 336 100 8   1310 16.674 0 0 0 0 509 0 0 626688 791859528 00:00:03.271137
7 341 100 8   1313 25.212 0 0 0 0 517 0 0 569344 792085656 00:00:03.379785
7 332 100 16   2413 31.349 0 0 0 0 3002 0 0 1347584 1244099024 00:00:04.769175
7 337 100 16   2424 26.544 0 0 0 0 940 0 0 1286144 1201042032 00:00:04.678225
7 342 100 16   2425 37.294 0 0 0 0 947 0 0 1359872 1185896200 00:00:04.817173
7 333 100 32   3280 70.105 0 0 0 0 1612 0 0 2215936 1457494928 00:00:05.157665
7 338 100 32   3403 43.222 0 0 0 0 1388 0 0 1622016 1461240312 00:00:05.913314
7 343 100 32   3406 38.913 0 0 0 0 1347 0 0 1634304 1461714680 00:00:05.377767
7 334 100 64   3560 87.167 0 0 0 0 1547 0 0 2334720 1511124264 00:00:05.832009
7 339 100 64   3550 95.049 0 0 0 0 1389 0 0 1839104 1492423792 00:00:05.982401
7 344 100 64   3543 128.576 0 0 0 0 1400 0 0 1728512 1515223432 00:00:06.343324
7 335 100 128   3431 279.85 0 0 0 0 1565 0 0 3215360 1474107760 00:00:05.808593
7 340 100 128   3414 242.487 0 0 0 0 1421 0 0 1617920 1491388624 00:00:05.273035
7 345 100 128   3417 359.981 0 0 0 0 1448 0 0 1974272 1476167808 00:00:06.140701
7 346 1000 8   1286 17.31 0 0 0 0 145648 0 0 1601536 1157834656 00:00:14.857332
7 351 1000 8   1276 14.475 0 0 0 0 50064 0 0 679936 1617311928 00:00:14.549456
7 356 1000 8   1276 15.04 0 0 0 0 29134 0 0 610304 1633288520 00:00:14.962471
7 347 1000 16   2210 81.626 1 48992 0 1726 202497 0 0 30085120 2482105112 00:00:29.307165
7 352 1000 16   2202 40.255 1 91613 0 867 79563 0 0 217583616 2805407312 00:00:21.327166
7 357 1000 16   2220 44.839 1 93337 0 852 47180 0 0 234971136 2812964872 00:00:20.717571
7 348 1000 32   3175 99.633 1 213970 0 2120 223757 0 0 323547136 3675922184 00:00:50.446482
7 353 1000 32   3158 72.4 1 256937 0 1235 101873 0 0 294899712 4004194168 00:00:33.212219
7 358 1000 32   3176 84.536 1 259696 0 1244 61653 0 0 301195264 4007209536 00:00:33.247557
7 349 1000 64   3279 141.671 1 265282 0 1411 179573 0 0 330682368 4120368496 00:00:41.778235
7 354 1000 64   3322 125.495 1 265894 0 1304 93596 0 0 314081280 4166581400 00:00:34.540226
7 359 1000 64   3354 127.78 1 267204 0 1332 57612 0 0 371449856 4206860680 00:00:36.016989
7 350 1000 128   3236 388.558 1 265729 0 1403 143794 0 0 354279424 4089732104 00:00:40.539349
7 355 1000 128   3261 355.472 1 267446 0 1409 81524 0 0 361766912 4112692608 00:00:33.551044
7 360 1000 128   3293 335.696 1 266245 0 1413 50568 0 0 380850176 4151255040 00:00:34.249225

Set 8 : Ubuntu 18.04 i-XL/NVME – hugepages

Averages for test set 8 by scale:

set scale tps avg_latency 90%< max_latency
8 10 1548 29.654 69.353 309.134
8 100 2686 16.235 26.226 112.509
8 1000 2554 17.037 27.838 213.243

Averages for test set 8 by clients:
set clients tps avg_latency 90%< max_latency
8 8 1232 6.491 8.158 21.602
8 16 2052 8.156 12.65 57.846
8 32 2587 13.448 24.379 122.111
8 64 2746 25.479 51.918 286.8
8 128 2696 51.303 108.589 569.784

Averages for test set 8 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
8 10 8   1183 6.753 10.789 24.861
8 10 16   1482 10.78 20.016 76.324
8 10 32   1642 19.451 41.363 196.949
8 10 64   1711 37.293 89.986 403.081
8 10 128   1719 73.992 184.61 844.456
8 100 8   1272 6.282 6.777 20.675
8 100 16   2415 6.615 9.083 42.081
8 100 32   3124 10.224 15.592 55.102
8 100 64   3365 18.959 31.708 120.115
8 100 128   3253 39.092 67.97 324.574
8 1000 8   1242 6.436 6.908 19.271
8 1000 16   2258 7.074 8.852 55.134
8 1000 32   2994 10.668 16.182 114.282
8 1000 64   3161 20.186 34.059 337.205
8 1000 128   3115 40.824 73.188 540.323

Detail for test set 8:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
8 361 10 8   1179 25.953 0 0 0 0 3484 0 0 1417216 184651736 00:00:00.714647
8 366 10 8   1184 24.086 0 0 0 0 463 0 0 573440 172012608 00:00:00.664655
8 371 10 8   1187 24.544 0 0 0 0 463 0 0 581632 173246792 00:00:00.696978
8 362 10 16   1482 83.129 0 0 0 0 644 0 0 696320 184294896 00:00:00.629533
8 367 10 16   1483 71.165 0 0 0 0 587 0 0 786432 191746424 00:00:00.708088
8 372 10 16   1482 74.678 0 0 0 0 586 0 0 643072 185178296 00:00:00.730957
8 363 10 32   1644 214.063 0 0 0 0 654 0 0 815104 191873864 00:00:00.65015
8 368 10 32   1636 169.462 0 0 0 0 745 0 0 843776 202745856 00:00:00.780766
8 373 10 32   1647 207.321 0 0 0 0 662 0 0 806912 179184216 00:00:00.721334
8 364 10 64   1708 385.17 0 0 0 0 810 0 0 1269760 202251552 00:00:00.695162
8 369 10 64   1709 411.424 0 0 0 0 875 0 0 1359872 206554400 00:00:00.793329
8 374 10 64   1715 412.648 0 0 0 0 737 0 0 929792 203787176 00:00:00.777031
8 365 10 128   1718 770.456 0 0 0 0 822 0 0 1265664 207093408 00:00:00.750427
8 370 10 128   1714 870.173 0 0 0 0 902 0 0 1241088 208518176 00:00:00.832039
8 375 10 128   1726 892.738 0 0 0 0 795 0 0 1351680 208951432 00:00:00.811331
8 376 100 8   1267 20.194 0 0 0 0 27313 0 0 1351680 724748024 00:00:02.970905
8 381 100 8   1274 19.049 0 0 0 0 499 0 0 552960 791420152 00:00:03.590818
8 386 100 8   1274 22.781 0 0 0 0 496 0 0 544768 791285472 00:00:03.727602
8 377 100 16   2410 36.53 0 0 0 0 3111 0 0 1257472 1255761920 00:00:05.230625
8 382 100 16   2424 36.377 0 0 0 0 943 0 0 1511424 1207691888 00:00:05.227196
8 387 100 16   2412 53.337 0 0 0 0 936 0 0 1146880 1223451200 00:00:05.371825
8 378 100 32   3062 53.156 0 0 0 0 1460 0 0 1536000 1435791728 00:00:05.72208
8 383 100 32   3155 56.487 0 0 0 0 1275 0 0 1671168 1433975152 00:00:06.509181
8 388 100 32   3156 55.662 0 0 0 0 1232 0 0 1548288 1415543704 00:00:05.981118
8 379 100 64   3359 145.954 0 0 0 0 1491 0 0 1794048 1473960352 00:00:06.453477
8 384 100 64   3367 108.12 0 0 0 0 1335 0 0 2011136 1490074424 00:00:05.885821
8 389 100 64   3371 106.271 0 0 0 0 1347 0 0 2330624 1495540872 00:00:06.754518
8 380 100 128   3230 285.39 0 0 0 0 1543 0 0 2576384 1471519704 00:00:06.428947
8 385 100 128   3263 330.743 0 0 0 0 1393 0 0 2207744 1463152072 00:00:06.597693
8 390 100 128   3266 357.588 0 0 0 0 1388 0 0 2564096 1490362944 00:00:06.163103
8 391 1000 8   1242 14.886 0 0 0 0 141093 0 0 1368064 1104721312 00:00:15.237731
8 396 1000 8   1241 23.559 0 0 0 0 50026 0 0 598016 1580883760 00:00:15.166186
8 401 1000 8   1242 19.369 0 0 0 0 29350 0 0 577536 1594404848 00:00:14.890181
8 392 1000 16   2258 50.036 1 52545 0 1826 207339 0 0 99500032 2522024280 00:00:29.554981
8 397 1000 16   2257 65.21 1 102519 0 884 83503 0 0 298770432 2886142968 00:00:21.768544
8 402 1000 16   2261 50.156 1 103632 0 878 49854 0 0 302972928 2876905192 00:00:21.506183
8 393 1000 32   2992 115.817 1 196494 0 1889 212547 0 0 235524096 3547919768 00:00:50.915687
8 398 1000 32   2998 98.944 1 232144 0 1168 98894 0 0 352071680 3822873944 00:00:32.149313
8 403 1000 32   2992 128.084 1 230453 0 1187 60429 0 0 336715776 3795723816 00:00:31.542406
8 394 1000 64   3120 710.948 1 246476 0 1383 173678 0 0 304013312 3910942176 00:00:39.059943
8 399 1000 64   3180 167.538 1 259523 0 1331 92677 0 0 317435904 4006235384 00:00:34.229148
8 404 1000 64   3182 133.13 1 262275 0 1282 56885 0 0 320450560 4041732208 00:00:33.462165
8 395 1000 128   3090 479.37 1 249264 0 1315 140813 0 0 350629888 3928768288 00:00:36.98219
8 400 1000 128   3149 467.475 1 257279 0 1380 80769 0 0 269529088 3989488232 00:00:33.105721
8 405 1000 128   3107 674.123 1 251583 0 1309 49599 0 0 262127616 3947901656 00:00:33.551154

pgbench-tools results

Averages across all test sets (EC2 iXL) – latencies:

Test sets comparison:

Set 6 : Ubuntu 18.04 i-XL/NVME – dbi

Averages for test set 6 by scale:

set scale tps avg_latency 90%< max_latency
6 10 1549 29.718 68.107 305.706
6 100 2734 16.071 25.365 170.388
6 1000 2580 16.886 26.508 244.052

Averages for test set 6 by clients:
set clients tps avg_latency 90%< max_latency
6 8 1256 6.371 7.871 19.863
6 16 2033 8.199 12.175 69.765
6 32 2691 13.106 23.575 147.243
6 64 2780 25.228 49.91 331.657
6 128 2678 51.555 106.436 631.716

Averages for test set 6 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
6 10 8   1192 6.703 10.454 26.247
6 10 16   1493 10.704 19.92 76.583
6 10 32   1641 19.462 41.019 171.387
6 10 64   1713 37.239 87.72 420.109
6 10 128   1707 74.481 181.422 834.202
6 100 8   1303 6.131 6.512 18.084
6 100 16   2400 6.652 8.358 67.431
6 100 32   3323 9.6 14.513 130.063
6 100 64   3416 18.64 30.193 250.321
6 100 128   3228 39.331 67.252 386.043
6 1000 8   1273 6.278 6.649 15.258
6 1000 16   2206 7.239 8.248 65.281
6 1000 32   3110 10.255 15.194 140.279
6 1000 64   3213 19.805 31.817 324.539
6 1000 128   3099 40.852 70.633 674.905

Detail for test set 6:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
6 271 10 8   1182 26.054 0 0 0 0 3525 0 0 1765376 184646448 00:00:00.71487
6 276 10 8   1195 25.808 0 0 0 0 468 0 0 688128 171292720 00:00:00.682386
6 281 10 8   1199 26.878 0 0 0 0 467 0 0 663552 173768560 00:00:00.742797
6 272 10 16   1488 76.485 0 0 0 0 646 0 0 1200128 184776488 00:00:00.655438
6 277 10 16   1494 72.59 0 0 0 0 589 0 0 937984 192803072 00:00:00.764355
6 282 10 16   1496 80.675 0 0 0 0 586 0 0 983040 185435112 00:00:00.725532
6 273 10 32   1640 162.795 0 0 0 0 651 0 0 1007616 191651384 00:00:00.698767
6 278 10 32   1642 169.801 0 0 0 0 735 0 0 1118208 186195704 00:00:00.831054
6 283 10 32   1641 181.566 0 0 0 0 653 0 0 925696 195886456 00:00:00.745578
6 274 10 64   1712 374.778 0 0 0 0 820 0 0 1363968 202275376 00:00:00.741023
6 279 10 64   1709 410.985 0 0 0 0 858 0 0 1175552 206616232 00:00:00.813949
6 284 10 64   1717 474.565 0 0 0 0 719 0 0 1003520 203492016 00:00:01.701051
6 275 10 128   1698 744.708 0 0 0 0 833 0 0 1499136 206362584 00:00:00.761585
6 280 10 128   1704 990.128 0 0 0 0 907 0 0 1642496 208183784 00:00:00.854242
6 285 10 128   1719 767.769 0 0 0 0 790 0 0 1290240 208798640 00:00:00.85551
6 286 100 8   1296 16.706 0 0 0 0 27430 0 0 1286144 735891216 00:00:03.761017
6 291 100 8   1308 19.506 0 0 0 0 508 0 0 692224 777778104 00:00:03.789899
6 296 100 8   1305 18.04 0 0 0 0 507 0 0 688128 793795536 00:00:03.896195
6 287 100 16   2395 81.647 0 0 0 0 3000 0 0 1171456 1256243112 00:00:05.289763
6 292 100 16   2405 53.095 0 0 0 0 945 0 0 1191936 1206050248 00:00:05.233566
6 297 100 16   2400 67.55 0 0 0 0 941 0 0 1052672 1201314544 00:00:05.372147
6 288 100 32   3342 90.98 0 0 0 0 1651 0 0 1785856 1445380952 00:00:06.31747
6 293 100 32   3315 144.261 0 0 0 0 1343 0 0 1585152 1454494584 00:00:05.671153
6 298 100 32   3311 154.947 0 0 0 0 1313 0 0 1835008 1433422408 00:00:05.811271
6 289 100 64   3468 253.11 0 0 0 0 1468 0 0 1961984 1507416544 00:00:06.324296
6 294 100 64   3391 247.19 0 0 0 0 1353 0 0 1605632 1470950360 00:00:06.414747
6 299 100 64   3389 250.663 0 0 0 0 1386 0 0 1806336 1488002432 00:00:05.860598
6 290 100 128   3305 409.367 0 0 0 0 1499 0 0 2220032 1478005752 00:00:05.525089
6 295 100 128   3139 380.618 0 0 0 0 1358 0 0 1654784 1436133312 00:00:05.691557
6 300 100 128   3239 368.143 0 0 0 0 1459 0 0 2138112 1470874768 00:00:06.559404
6 301 1000 8   1277 18.325 0 0 0 0 144675 0 0 1519616 1133601712 00:00:11.965983
6 306 1000 8   1269 12.779 0 0 0 0 50287 0 0 573440 1630372968 00:00:15.948208
6 311 1000 8   1272 14.671 0 0 0 0 29484 0 0 593920 1630188864 00:00:15.50871
6 302 1000 16   2201 84.338 1 48852 0 1728 202772 0 0 213868544 2494507472 00:00:23.506007
6 307 1000 16   2209 35.799 1 94257 0 869 80899 0 0 229638144 2805342832 00:00:22.654457
6 312 1000 16   2208 75.706 1 93123 0 855 47835 0 0 212750336 2802734456 00:00:23.68863
6 303 1000 32   3131 156.423 1 209467 0 2065 221576 0 0 274264064 3643906064 00:00:34.115741
6 308 1000 32   3103 114.94 1 249482 0 1224 101012 0 0 234872832 3933360608 00:00:33.794646
6 313 1000 32   3096 149.473 1 248047 0 1215 61136 0 0 214712320 3923697168 00:00:32.774499
6 304 1000 64   3218 418.272 1 265746 0 1439 177395 0 0 352133120 4053152616 00:00:35.104572
6 309 1000 64   3219 286.86 1 266576 0 1285 92403 0 0 323739648 4082952192 00:00:34.949208
6 314 1000 64   3201 268.486 1 265704 0 1285 56542 0 0 328511488 4057334016 00:00:34.656982
6 305 1000 128   3119 505.456 1 255601 0 1452 141032 0 0 236339200 3978508520 00:00:34.220101
6 310 1000 128   3113 588.437 1 256176 0 1345 79436 0 0 367992832 3975288488 00:00:31.768822
6 315 1000 128   3065 930.821 1 246447 0 1310 48452 0 0 286085120 3909714240 00:00:34.026668

Set 7 : Ubuntu 18.04 i-XL/NVME – dbi/hugepages

Averages for test set 7 by scale:

set scale tps avg_latency 90%< max_latency
7 10 1555 29.559 67.508 296.425
7 100 2813 15.475 24.498 99.959
7 1000 2648 16.35 25.978 129.652

Averages for test set 7 by clients:
set clients tps avg_latency 90%< max_latency
7 8 1261 6.345 7.844 20.925
7 16 2043 8.164 12.119 57.795
7 32 2726 13.001 23.421 110.153
7 64 2861 24.805 49.668 221.33
7 128 2803 49.992 103.587 466.523

Averages for test set 7 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
7 10 8   1194 6.692 10.447 27.55
7 10 16   1498 10.665 19.866 86.084
7 10 32   1645 19.424 40.874 194.189
7 10 64   1714 37.221 88.303 428.745
7 10 128   1725 73.792 178.049 745.555
7 100 8   1311 6.097 6.468 19.616
7 100 16   2421 6.601 8.317 31.729
7 100 32   3363 9.501 14.379 50.747
7 100 64   3551 17.968 29.255 103.597
7 100 128   3421 37.21 64.072 294.106
7 1000 8   1279 6.246 6.616 15.608
7 1000 16   2211 7.228 8.174 55.573
7 1000 32   3170 10.077 15.011 85.523
7 1000 64   3318 19.225 31.447 131.649
7 1000 128   3263 38.975 68.641 359.909

Detail for test set 7:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
7 316 10 8   1184 30.688 0 0 0 0 3525 0 0 1413120 184668464 00:00:00.688876
7 321 10 8   1199 25.772 0 0 0 0 470 0 0 675840 172635312 00:00:00.659125
7 326 10 8   1199 26.19 0 0 0 0 466 0 0 606208 172740232 00:00:00.684299
7 317 10 16   1498 106.752 0 0 0 0 654 0 0 933888 184784624 00:00:00.628741
7 322 10 16   1500 70.562 0 0 0 0 594 0 0 704512 193272672 00:00:01.709108
7 327 10 16   1497 80.937 0 0 0 0 587 0 0 647168 185921448 00:00:00.723368
7 318 10 32   1641 192.219 0 0 0 0 653 0 0 811008 191571176 00:00:00.669101
7 323 10 32   1643 174.981 0 0 0 0 763 0 0 1081344 203172280 00:00:00.801191
7 328 10 32   1651 215.367 0 0 0 0 685 0 0 888832 193974344 00:00:00.732978
7 319 10 64   1719 390.629 0 0 0 0 811 0 0 974848 185727792 00:00:00.693322
7 324 10 64   1714 444.038 0 0 0 0 801 0 0 1236992 206593080 00:00:00.806395
7 329 10 64   1710 451.568 0 0 0 0 703 0 0 827392 203550240 00:00:00.774027
7 320 10 128   1725 859.85 0 0 0 0 829 0 0 1437696 207086808 00:00:00.761369
7 325 10 128   1720 699.742 0 0 0 0 1070 0 0 2572288 208763960 00:00:00.83686
7 330 10 128   1729 677.073 0 0 0 0 807 0 0 1789952 208838696 00:00:00.828326
7 331 100 8   1309 16.963 0 0 0 0 27438 0 0 933888 739585912 00:00:03.371009
7 336 100 8   1310 16.674 0 0 0 0 509 0 0 626688 791859528 00:00:03.271137
7 341 100 8   1313 25.212 0 0 0 0 517 0 0 569344 792085656 00:00:03.379785
7 332 100 16   2413 31.349 0 0 0 0 3002 0 0 1347584 1244099024 00:00:04.769175
7 337 100 16   2424 26.544 0 0 0 0 940 0 0 1286144 1201042032 00:00:04.678225
7 342 100 16   2425 37.294 0 0 0 0 947 0 0 1359872 1185896200 00:00:04.817173
7 333 100 32   3280 70.105 0 0 0 0 1612 0 0 2215936 1457494928 00:00:05.157665
7 338 100 32   3403 43.222 0 0 0 0 1388 0 0 1622016 1461240312 00:00:05.913314
7 343 100 32   3406 38.913 0 0 0 0 1347 0 0 1634304 1461714680 00:00:05.377767
7 334 100 64   3560 87.167 0 0 0 0 1547 0 0 2334720 1511124264 00:00:05.832009
7 339 100 64   3550 95.049 0 0 0 0 1389 0 0 1839104 1492423792 00:00:05.982401
7 344 100 64   3543 128.576 0 0 0 0 1400 0 0 1728512 1515223432 00:00:06.343324
7 335 100 128   3431 279.85 0 0 0 0 1565 0 0 3215360 1474107760 00:00:05.808593
7 340 100 128   3414 242.487 0 0 0 0 1421 0 0 1617920 1491388624 00:00:05.273035
7 345 100 128   3417 359.981 0 0 0 0 1448 0 0 1974272 1476167808 00:00:06.140701
7 346 1000 8   1286 17.31 0 0 0 0 145648 0 0 1601536 1157834656 00:00:14.857332
7 351 1000 8   1276 14.475 0 0 0 0 50064 0 0 679936 1617311928 00:00:14.549456
7 356 1000 8   1276 15.04 0 0 0 0 29134 0 0 610304 1633288520 00:00:14.962471
7 347 1000 16   2210 81.626 1 48992 0 1726 202497 0 0 30085120 2482105112 00:00:29.307165
7 352 1000 16   2202 40.255 1 91613 0 867 79563 0 0 217583616 2805407312 00:00:21.327166
7 357 1000 16   2220 44.839 1 93337 0 852 47180 0 0 234971136 2812964872 00:00:20.717571
7 348 1000 32   3175 99.633 1 213970 0 2120 223757 0 0 323547136 3675922184 00:00:50.446482
7 353 1000 32   3158 72.4 1 256937 0 1235 101873 0 0 294899712 4004194168 00:00:33.212219
7 358 1000 32   3176 84.536 1 259696 0 1244 61653 0 0 301195264 4007209536 00:00:33.247557
7 349 1000 64   3279 141.671 1 265282 0 1411 179573 0 0 330682368 4120368496 00:00:41.778235
7 354 1000 64   3322 125.495 1 265894 0 1304 93596 0 0 314081280 4166581400 00:00:34.540226
7 359 1000 64   3354 127.78 1 267204 0 1332 57612 0 0 371449856 4206860680 00:00:36.016989
7 350 1000 128   3236 388.558 1 265729 0 1403 143794 0 0 354279424 4089732104 00:00:40.539349
7 355 1000 128   3261 355.472 1 267446 0 1409 81524 0 0 361766912 4112692608 00:00:33.551044
7 360 1000 128   3293 335.696 1 266245 0 1413 50568 0 0 380850176 4151255040 00:00:34.249225

Set 8 : Ubuntu 18.04 i-XL/NVME – hugepages

Averages for test set 8 by scale:

set scale tps avg_latency 90%< max_latency
8 10 1548 29.654 69.353 309.134
8 100 2686 16.235 26.226 112.509
8 1000 2554 17.037 27.838 213.243

Averages for test set 8 by clients:
set clients tps avg_latency 90%< max_latency
8 8 1232 6.491 8.158 21.602
8 16 2052 8.156 12.65 57.846
8 32 2587 13.448 24.379 122.111
8 64 2746 25.479 51.918 286.8
8 128 2696 51.303 108.589 569.784

Averages for test set 8 by scale, client, and rate limit:
set scale clients rate_limit tps avg_latency 90%< max_latency
8 10 8   1183 6.753 10.789 24.861
8 10 16   1482 10.78 20.016 76.324
8 10 32   1642 19.451 41.363 196.949
8 10 64   1711 37.293 89.986 403.081
8 10 128   1719 73.992 184.61 844.456
8 100 8   1272 6.282 6.777 20.675
8 100 16   2415 6.615 9.083 42.081
8 100 32   3124 10.224 15.592 55.102
8 100 64   3365 18.959 31.708 120.115
8 100 128   3253 39.092 67.97 324.574
8 1000 8   1242 6.436 6.908 19.271
8 1000 16   2258 7.074 8.852 55.134
8 1000 32   2994 10.668 16.182 114.282
8 1000 64   3161 20.186 34.059 337.205
8 1000 128   3115 40.824 73.188 540.323

Detail for test set 8:
set test scale clients rate_limit tps max_latency chkpts buf_check buf_clean buf_backend buf_alloc max_clean backend_sync max_dirty wal_written cleanup
8 361 10 8   1179 25.953 0 0 0 0 3484 0 0 1417216 184651736 00:00:00.714647
8 366 10 8   1184 24.086 0 0 0 0 463 0 0 573440 172012608 00:00:00.664655
8 371 10 8   1187 24.544 0 0 0 0 463 0 0 581632 173246792 00:00:00.696978
8 362 10 16   1482 83.129 0 0 0 0 644 0 0 696320 184294896 00:00:00.629533
8 367 10 16   1483 71.165 0 0 0 0 587 0 0 786432 191746424 00:00:00.708088
8 372 10 16   1482 74.678 0 0 0 0 586 0 0 643072 185178296 00:00:00.730957
8 363 10 32   1644 214.063 0 0 0 0 654 0 0 815104 191873864 00:00:00.65015
8 368 10 32   1636 169.462 0 0 0 0 745 0 0 843776 202745856 00:00:00.780766
8 373 10 32   1647 207.321 0 0 0 0 662 0 0 806912 179184216 00:00:00.721334
8 364 10 64   1708 385.17 0 0 0 0 810 0 0 1269760 202251552 00:00:00.695162
8 369 10 64   1709 411.424 0 0 0 0 875 0 0 1359872 206554400 00:00:00.793329
8 374 10 64   1715 412.648 0 0 0 0 737 0 0 929792 203787176 00:00:00.777031
8 365 10 128   1718 770.456 0 0 0 0 822 0 0 1265664 207093408 00:00:00.750427
8 370 10 128   1714 870.173 0 0 0 0 902 0 0 1241088 208518176 00:00:00.832039
8 375 10 128   1726 892.738 0 0 0 0 795 0 0 1351680 208951432 00:00:00.811331
8 376 100 8   1267 20.194 0 0 0 0 27313 0 0 1351680 724748024 00:00:02.970905
8 381 100 8   1274 19.049 0 0 0 0 499 0 0 552960 791420152 00:00:03.590818
8 386 100 8   1274 22.781 0 0 0 0 496 0 0 544768 791285472 00:00:03.727602
8 377 100 16   2410 36.53 0 0 0 0 3111 0 0 1257472 1255761920 00:00:05.230625
8 382 100 16   2424 36.377 0 0 0 0 943 0 0 1511424 1207691888 00:00:05.227196
8 387 100 16   2412 53.337 0 0 0 0 936 0 0 1146880 1223451200 00:00:05.371825
8 378 100 32   3062 53.156 0 0 0 0 1460 0 0 1536000 1435791728 00:00:05.72208
8 383 100 32   3155 56.487 0 0 0 0 1275 0 0 1671168 1433975152 00:00:06.509181
8 388 100 32   3156 55.662 0 0 0 0 1232 0 0 1548288 1415543704 00:00:05.981118
8 379 100 64   3359 145.954 0 0 0 0 1491 0 0 1794048 1473960352 00:00:06.453477
8 384 100 64   3367 108.12 0 0 0 0 1335 0 0 2011136 1490074424 00:00:05.885821
8 389 100 64   3371 106.271 0 0 0 0 1347 0 0 2330624 1495540872 00:00:06.754518
8 380 100 128   3230 285.39 0 0 0 0 1543 0 0 2576384 1471519704 00:00:06.428947
8 385 100 128   3263 330.743 0 0 0 0 1393 0 0 2207744 1463152072 00:00:06.597693
8 390 100 128   3266 357.588 0 0 0 0 1388 0 0 2564096 1490362944 00:00:06.163103
8 391 1000 8   1242 14.886 0 0 0 0 141093 0 0 1368064 1104721312 00:00:15.237731
8 396 1000 8   1241 23.559 0 0 0 0 50026 0 0 598016 1580883760 00:00:15.166186
8 401 1000 8   1242 19.369 0 0 0 0 29350 0 0 577536 1594404848 00:00:14.890181
8 392 1000 16   2258 50.036 1 52545 0 1826 207339 0 0 99500032 2522024280 00:00:29.554981
8 397 1000 16   2257 65.21 1 102519 0 884 83503 0 0 298770432 2886142968 00:00:21.768544
8 402 1000 16   2261 50.156 1 103632 0 878 49854 0 0 302972928 2876905192 00:00:21.506183
8 393 1000 32   2992 115.817 1 196494 0 1889 212547 0 0 235524096 3547919768 00:00:50.915687
8 398 1000 32   2998 98.944 1 232144 0 1168 98894 0 0 352071680 3822873944 00:00:32.149313
8 403 1000 32   2992 128.084 1 230453 0 1187 60429 0 0 336715776 3795723816 00:00:31.542406
8 394 1000 64   3120 710.948 1 246476 0 1383 173678 0 0 304013312 3910942176 00:00:39.059943
8 399 1000 64   3180 167.538 1 259523 0 1331 92677 0 0 317435904 4006235384 00:00:34.229148
8 404 1000 64   3182 133.13 1 262275 0 1282 56885 0 0 320450560 4041732208 00:00:33.462165
8 395 1000 128   3090 479.37 1 249264 0 1315 140813 0 0 350629888 3928768288 00:00:36.98219
8 400 1000 128   3149 467.475 1 257279 0 1380 80769 0 0 269529088 3989488232 00:00:33.105721
8 405 1000 128   3107 674.123 1 251583 0 1309 49599 0 0 262127616 3947901656 00:00:33.551154

Reports

The pgbench-tools project has a few interesting SQL reports. Here are a couple ones we found great:

 


 Results by decreasing tps (fastest_extended)
 

  set |  script   | scale | clients | workers | tps  | max_latency | p90_latency
 -----+-----------+-------+---------+---------+------+-------------+-------------
    7 | tpc-b.sql |   100 |      64 |       4 | 3560 |      87.167 |      29.025
    7 | tpc-b.sql |   100 |      64 |       4 | 3550 |      95.049 |      29.384
    7 | tpc-b.sql |   100 |      64 |       4 | 3543 |     128.576 |      29.355
    6 | tpc-b.sql |   100 |      64 |       4 | 3468 |      253.11 |      29.818
    7 | tpc-b.sql |   100 |     128 |       4 | 3431 |      279.85 |      64.031
    7 | tpc-b.sql |   100 |     128 |       4 | 3417 |     359.981 |      64.196
    7 | tpc-b.sql |   100 |     128 |       4 | 3414 |     242.487 |       63.99
    7 | tpc-b.sql |   100 |      32 |       4 | 3406 |      38.913 |      14.234
    7 | tpc-b.sql |   100 |      32 |       4 | 3403 |      43.222 |      14.255
    6 | tpc-b.sql |   100 |      64 |       4 | 3391 |      247.19 |      30.446
    6 | tpc-b.sql |   100 |      64 |       4 | 3389 |     250.663 |      30.314
    2 | tpc-b.sql |   100 |      64 |       4 | 3388 |     221.743 |      30.276
    2 | tpc-b.sql |   100 |      64 |       4 | 3381 |     285.096 |       30.51
    8 | tpc-b.sql |   100 |      64 |       4 | 3371 |     106.271 |       31.65
    8 | tpc-b.sql |   100 |      64 |       4 | 3367 |      108.12 |        31.6
    8 | tpc-b.sql |   100 |      64 |       4 | 3359 |     145.954 |      31.875
    2 | tpc-b.sql |   100 |      64 |       4 | 3355 |     234.493 |      30.662
    7 | tpc-b.sql |  1000 |      64 |       4 | 3354 |      127.78 |      30.772
    6 | tpc-b.sql |   100 |      32 |       4 | 3342 |       90.98 |      14.441
    7 | tpc-b.sql |  1000 |      64 |       4 | 3322 |     125.495 |      31.441
 

 Results by decreasing tps and ascending 90th percentile latency (compromise_tps_lat_lim)
 

  set |                  info                  |  script   | scale | clients | workers | tps  | p90_latency
 -----+----------------------------------------+-----------+-------+---------+---------+------+-------------
    7 | Ubuntu 18.04 i-XL/NVME - dbi/hugepages | tpc-b.sql |  1000 |      32 |       4 | 3176 |       14.96
    4 | Ubuntu 18.04 i-XL/NVME - SWP1/VM       | tpc-b.sql |  1000 |      16 |       4 | 2431 |       9.249
    3 | Ubuntu 18.04 i-XL/NVME - SWP=1         | tpc-b.sql |  1000 |      16 |       4 | 2431 |       9.294
    5 | Ubuntu 18.04 i-XL/NVME - NTNX BP       | tpc-b.sql |  1000 |      16 |       4 | 2426 |       9.301
    8 | Ubuntu 18.04 i-XL/NVME - hugepages     | tpc-b.sql |  1000 |      16 |       4 | 2261 |       8.697
    7 | Ubuntu 18.04 i-XL/NVME - dbi/hugepages | tpc-b.sql |  1000 |      16 |       4 | 2220 |        8.11
    6 | Ubuntu 18.04 i-XL/NVME - dbi           | tpc-b.sql |  1000 |      16 |       4 | 2209 |       8.194
    2 | Ubuntu 18.04 i-XL/NVME                 | tpc-b.sql |  1000 |      16 |       4 | 2200 |       8.275
    4 | Ubuntu 18.04 i-XL/NVME - SWP1/VM       | tpc-b.sql |  1000 |       8 |       4 | 1357 |       6.512
    5 | Ubuntu 18.04 i-XL/NVME - NTNX BP       | tpc-b.sql |  1000 |       8 |       4 | 1344 |       6.503
    3 | Ubuntu 18.04 i-XL/NVME - SWP=1         | tpc-b.sql |  1000 |       8 |       4 | 1339 |        6.46
    7 | Ubuntu 18.04 i-XL/NVME - dbi/hugepages | tpc-b.sql |  1000 |       8 |       4 | 1286 |       6.611
    6 | Ubuntu 18.04 i-XL/NVME - dbi           | tpc-b.sql |  1000 |       8 |       4 | 1277 |       6.629
    2 | Ubuntu 18.04 i-XL/NVME                 | tpc-b.sql |  1000 |       8 |       4 | 1270 |       6.668
    8 | Ubuntu 18.04 i-XL/NVME - hugepages     | tpc-b.sql |  1000 |       8 |       4 | 1242 |       6.893

Conclusions

Pgbench-tools is a handy project to execute configurable pgbench tests in a grid of scale and concurrency parameter. In this platform, it seems the test set 7 (dbi/hugepages) gets interesting results across all the spectrum of scale and concurrency, in the very limited scope of a simple tpc-b (sort of) test.

Again, a final word of caution on “best practices”: they will be as good as your tests. Pgbench tests provide indications of how the database could behave under certain parameters of scale and concurrency, but the test model is very simple and may be very far from a real workload. Pgreplay could provide another insight on how a real workload could behave in your test environment.

I shall also note that the webreport and limited_webreport html and plot generation scripts where tweaked a bit to use different line styles by plot and place the chart legend in the right bottom edge instead of the top right corner as we got in the previous post.


Alexis

Alexis is the founder of Aleph Technologies, a data infrastructure consulting and professional services provider based in Brussels, Belgium.

More Posts - Website

Follow Me:
TwitterLinkedIn