BonsaiDb Commerce Benchmark

medium, writeheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2721
FindProduct 2726
CreateCart 994
AddProductToCart 4911
Checkout 887
RateProduct 3927

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 22.18s 22.18s None
bonsaidb-local+lz4 19.82s 19.82s TCP
bonsaidb-quic 29.22s 29.22s UDP with TLS
bonsaidb-ws 26.45s 26.45s TCP
postgresql 22.53s 22.53s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 267.1ms 267.1ms 267.1ms 0s 0
bonsaidb-local+lz4 273.0ms 273.0ms 273.0ms 0s 0
bonsaidb-quic 295.5ms 295.5ms 295.5ms 0s 0
bonsaidb-ws 304.4ms 304.4ms 304.4ms 0s 0
postgresql 4.181s 4.181s 4.181s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2721 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 99.68us 72.30us 336.5us 11.58us 26
bonsaidb-local+lz4 102.1us 74.12us 277.5us 11.71us 31
bonsaidb-quic 468.7us 318.2us 1.140ms 33.66us 33
bonsaidb-ws 344.9us 300.7us 1.125ms 25.25us 16
postgresql 410.1us 257.7us 1.501ms 103.8us 9
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2726 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 186.4us 115.5us 2.066ms 40.00us 3
bonsaidb-local+lz4 193.4us 117.9us 2.590ms 51.04us 3
bonsaidb-quic 755.4us 632.3us 4.410ms 84.33us 5
bonsaidb-ws 568.7us 456.1us 2.947ms 72.59us 10
postgresql 483.5us 275.6us 1.583ms 151.3us 2
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 994 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.216ms 588.9us 11.81ms 553.3us 12
bonsaidb-local+lz4 1.097ms 641.0us 6.709ms 443.6us 12
bonsaidb-quic 1.422ms 834.9us 6.114ms 492.4us 12
bonsaidb-ws 1.315ms 741.5us 7.101ms 435.9us 14
postgresql 687.2us 522.1us 5.063ms 265.0us 10
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4911 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.256ms 642.9us 9.271ms 501.1us 66
bonsaidb-local+lz4 1.128ms 638.8us 21.84ms 520.8us 47
bonsaidb-quic 1.670ms 1.010ms 12.90ms 534.1us 70
bonsaidb-ws 1.511ms 910.7us 93.04ms 1.384ms 7
postgresql 643.9us 469.3us 5.244ms 217.1us 40
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 887 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.449ms 1.400ms 7.130ms 694.9us 11
bonsaidb-local+lz4 2.127ms 1.331ms 6.059ms 520.8us 16
bonsaidb-quic 3.083ms 2.007ms 8.619ms 754.4us 17
bonsaidb-ws 2.792ms 1.738ms 10.77ms 695.0us 13
postgresql 967.5us 767.5us 5.040ms 205.3us 11
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3927 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.951ms 1.662ms 36.48ms 924.7us 33
bonsaidb-local+lz4 2.605ms 1.666ms 21.88ms 692.4us 37
bonsaidb-quic 3.372ms 2.032ms 35.44ms 967.1us 57
bonsaidb-ws 3.172ms 1.847ms 9.959ms 755.8us 66
postgresql 2.854ms 1.829ms 37.80ms 2.226ms 17