BonsaiDb Commerce Benchmark

medium, balanced, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2824
FindProduct 2760
CreateCart 723
AddProductToCart 1379
Checkout 200
RateProduct 96

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 2.546s 636.5ms None
bonsaidb-local+lz4 2.538s 634.6ms TCP
bonsaidb-quic 8.099s 2.025s UDP with TLS
bonsaidb-ws 6.211s 1.553s TCP
postgresql 23.69s 5.921s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 96.19ms 96.19ms 96.19ms 0s 0
bonsaidb-local+lz4 102.2ms 102.2ms 102.2ms 0s 0
bonsaidb-quic 114.5ms 114.5ms 114.5ms 0s 0
bonsaidb-ws 114.0ms 114.0ms 114.0ms 0s 0
postgresql 7.078s 7.078s 7.078s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2824 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 159.1us 33.40us 3.894ms 199.0us 34
bonsaidb-local+lz4 150.2us 32.00us 2.966ms 137.8us 44
bonsaidb-quic 927.3us 356.3us 7.550ms 380.5us 40
bonsaidb-ws 679.6us 256.2us 8.868ms 412.2us 27
postgresql 1.591ms 433.8us 52.31ms 1.984ms 21
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2760 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 296.7us 54.20us 4.566ms 260.5us 36
bonsaidb-local+lz4 298.7us 52.00us 4.269ms 225.7us 33
bonsaidb-quic 1.019ms 421.3us 6.109ms 387.4us 37
bonsaidb-ws 790.7us 345.9us 10.11ms 506.6us 34
postgresql 1.678ms 468.8us 49.85ms 1.836ms 23
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 723 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 350.3us 104.4us 16.90ms 664.0us 3
bonsaidb-local+lz4 328.4us 96.80us 4.309ms 238.4us 9
bonsaidb-quic 646.0us 280.6us 8.086ms 472.1us 7
bonsaidb-ws 490.7us 239.4us 7.104ms 386.9us 5
postgresql 2.988ms 1.145ms 13.48ms 1.443ms 12
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1379 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 454.2us 136.7us 2.592ms 245.9us 24
bonsaidb-local+lz4 460.3us 135.1us 14.81ms 454.8us 6
bonsaidb-quic 1.129ms 554.4us 8.998ms 514.4us 20
bonsaidb-ws 879.3us 397.4us 9.035ms 567.0us 12
postgresql 2.827ms 1.087ms 13.44ms 1.219ms 25
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 200 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 777.6us 265.3us 3.515ms 396.5us 4
bonsaidb-local+lz4 809.8us 357.0us 5.460ms 471.2us 2
bonsaidb-quic 1.724ms 1.025ms 8.900ms 611.4us 1
bonsaidb-ws 1.347ms 676.4us 8.567ms 647.7us 4
postgresql 3.216ms 1.306ms 15.18ms 1.815ms 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 96 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.526ms 537.4us 27.06ms 3.463ms 3
bonsaidb-local+lz4 1.601ms 523.5us 26.26ms 3.565ms 3
bonsaidb-quic 1.933ms 992.7us 30.42ms 3.121ms 2
bonsaidb-ws 1.654ms 889.1us 26.78ms 2.786ms 2
postgresql 8.150ms 4.137ms 54.46ms 5.292ms 1