BonsaiDb Commerce Benchmark

large, writeheavy, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2678
FindProduct 2803
CreateCart 987
AddProductToCart 4942
Checkout 874
RateProduct 3902

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 14.11s 3.528s None
bonsaidb-local+lz4 14.79s 3.697s TCP
bonsaidb-quic 23.37s 5.842s UDP with TLS
bonsaidb-ws 19.17s 4.793s TCP
postgresql 174.3s 43.57s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 472.7ms 472.7ms 472.7ms 0s 0
bonsaidb-local+lz4 499.1ms 499.1ms 499.1ms 0s 0
bonsaidb-quic 550.7ms 550.7ms 550.7ms 0s 0
bonsaidb-ws 602.6ms 602.6ms 602.6ms 0s 0
postgresql 44.24s 44.24s 44.24s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2678 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 237.5us 44.30us 9.322ms 301.3us 23
bonsaidb-local+lz4 243.5us 51.10us 5.865ms 278.5us 35
bonsaidb-quic 1.105ms 445.4us 11.55ms 562.5us 34
bonsaidb-ws 829.0us 288.5us 8.254ms 398.9us 41
postgresql 7.480ms 636.0us 35.99ms 5.423ms 14
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2803 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 500.8us 81.10us 13.57ms 463.5us 36
bonsaidb-local+lz4 500.6us 97.70us 18.26ms 513.2us 20
bonsaidb-quic 1.281ms 580.3us 10.53ms 586.3us 39
bonsaidb-ws 1.025ms 424.3us 7.587ms 488.8us 44
postgresql 8.072ms 669.4us 44.17ms 5.828ms 23
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 987 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 431.1us 115.9us 5.374ms 338.9us 13
bonsaidb-local+lz4 493.3us 115.5us 4.781ms 447.9us 19
bonsaidb-quic 763.3us 313.6us 9.527ms 613.7us 14
bonsaidb-ws 608.6us 255.7us 5.681ms 378.3us 13
postgresql 3.239ms 948.8us 44.95ms 2.802ms 15
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4942 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 606.1us 132.2us 37.63ms 681.4us 31
bonsaidb-local+lz4 627.6us 149.0us 14.88ms 563.5us 46
bonsaidb-quic 1.307ms 589.4us 11.83ms 652.4us 67
bonsaidb-ws 1.043ms 358.8us 42.27ms 780.1us 32
postgresql 2.987ms 925.8us 21.08ms 2.280ms 108
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 874 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.063ms 248.3us 9.734ms 797.4us 14
bonsaidb-local+lz4 1.106ms 325.4us 15.22ms 888.1us 12
bonsaidb-quic 2.077ms 1.050ms 12.42ms 1.037ms 15
bonsaidb-ws 1.642ms 782.8us 8.356ms 660.6us 17
postgresql 3.136ms 1.021ms 23.85ms 2.225ms 13
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3902 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.858ms 358.2us 51.76ms 1.757ms 26
bonsaidb-local+lz4 1.968ms 226.9us 51.06ms 1.902ms 28
bonsaidb-quic 1.856ms 765.8us 55.90ms 1.654ms 27
bonsaidb-ws 1.611ms 653.7us 49.24ms 1.461ms 21
postgresql 17.09ms 5.321ms 54.35ms 5.789ms 33