BonsaiDb Commerce Benchmark

medium, balanced, 8 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 8 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2830
FindProduct 2774
CreateCart 727
AddProductToCart 1386
Checkout 203
RateProduct 97

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 16.42s 2.053s None
bonsaidb-local+lz4 16.14s 2.018s TCP
bonsaidb-quic 18.26s 2.282s UDP with TLS
bonsaidb-ws 17.14s 2.142s TCP
postgresql 15.39s 1.924s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 284.2ms 284.2ms 284.2ms 0s 0
bonsaidb-local+lz4 278.4ms 278.4ms 278.4ms 0s 0
bonsaidb-quic 297.9ms 297.9ms 297.9ms 0s 0
bonsaidb-ws 332.6ms 332.6ms 332.6ms 0s 0
postgresql 4.144s 4.144s 4.144s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2830 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 111.9us 50.52us 2.457ms 89.19us 5
bonsaidb-local+lz4 114.2us 53.00us 2.517ms 94.81us 5
bonsaidb-quic 647.5us 385.6us 7.699ms 326.0us 12
bonsaidb-ws 454.9us 292.9us 3.885ms 159.0us 6
postgresql 1.121ms 303.6us 35.58ms 1.156ms 32
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2774 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 194.1us 90.20us 2.139ms 70.55us 4
bonsaidb-local+lz4 201.5us 82.53us 2.383ms 76.95us 4
bonsaidb-quic 1.020ms 623.5us 7.617ms 316.8us 28
bonsaidb-ws 728.4us 486.8us 3.682ms 141.6us 16
postgresql 1.172ms 399.0us 33.86ms 995.5us 29
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 727 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.410ms 1.421ms 11.57ms 1.140ms 15
bonsaidb-local+lz4 5.311ms 965.0us 9.954ms 1.129ms 20
bonsaidb-quic 4.587ms 1.411ms 14.04ms 1.463ms 11
bonsaidb-ws 4.684ms 1.203ms 10.82ms 1.264ms 15
postgresql 1.886ms 859.9us 18.29ms 896.2us 6
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1386 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.884ms 1.479ms 15.90ms 1.248ms 45
bonsaidb-local+lz4 5.734ms 1.551ms 14.12ms 1.113ms 28
bonsaidb-quic 5.202ms 1.439ms 11.59ms 1.447ms 23
bonsaidb-ws 5.227ms 1.373ms 10.47ms 1.229ms 23
postgresql 1.764ms 649.6us 6.875ms 627.6us 25
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 203 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 10.85ms 3.421ms 16.71ms 2.014ms 2
bonsaidb-local+lz4 10.90ms 3.740ms 19.32ms 2.104ms 5
bonsaidb-quic 9.356ms 3.019ms 16.15ms 2.077ms 2
bonsaidb-ws 9.802ms 3.388ms 15.63ms 1.927ms 5
postgresql 2.682ms 1.068ms 5.246ms 677.6us 2
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 97 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 10.24ms 2.111ms 16.93ms 2.102ms 3
bonsaidb-local+lz4 9.892ms 2.122ms 19.15ms 2.076ms 2
bonsaidb-quic 8.786ms 4.321ms 15.34ms 1.980ms 1
bonsaidb-ws 8.838ms 2.385ms 15.36ms 1.837ms 2
postgresql 4.805ms 2.030ms 8.413ms 1.048ms 1