BonsaiDb Commerce Benchmark

medium, readheavy, 8 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 8 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2771
FindProduct 2737
CreateCart 418
AddProductToCart 531
Checkout 39
RateProduct 4

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 9.129s 1.141s None
bonsaidb-local+lz4 7.173s 896.7ms TCP
bonsaidb-quic 9.092s 1.136s UDP with TLS
bonsaidb-ws 8.986s 1.123s TCP
postgresql 10.96s 1.371s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 269.2ms 269.2ms 269.2ms 0s 0
bonsaidb-local+lz4 276.7ms 276.7ms 276.7ms 0s 0
bonsaidb-quic 293.5ms 293.5ms 293.5ms 0s 0
bonsaidb-ws 292.7ms 292.7ms 292.7ms 0s 0
postgresql 4.182s 4.182s 4.182s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2771 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 108.4us 48.52us 2.686ms 96.18us 4
bonsaidb-local+lz4 110.7us 43.06us 2.453ms 94.19us 6
bonsaidb-quic 803.3us 372.0us 9.224ms 336.7us 6
bonsaidb-ws 481.9us 262.5us 3.778ms 162.9us 16
postgresql 873.1us 272.7us 27.12ms 834.9us 10
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2737 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 181.1us 73.10us 2.606ms 97.57us 9
bonsaidb-local+lz4 191.6us 85.89us 2.360ms 109.2us 13
bonsaidb-quic 1.246ms 637.2us 8.999ms 384.7us 9
bonsaidb-ws 758.4us 462.5us 3.840ms 185.7us 21
postgresql 927.7us 290.3us 21.76ms 777.2us 12
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 418 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 7.433ms 1.679ms 28.35ms 3.231ms 12
bonsaidb-local+lz4 5.714ms 838.3us 11.90ms 1.422ms 6
bonsaidb-quic 2.720ms 974.2us 9.286ms 1.430ms 4
bonsaidb-ws 4.768ms 982.2us 12.09ms 1.532ms 2
postgresql 1.807ms 774.1us 5.745ms 636.9us 13
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 531 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 8.069ms 905.3us 29.92ms 3.479ms 13
bonsaidb-local+lz4 6.030ms 1.193ms 12.79ms 1.416ms 14
bonsaidb-quic 3.363ms 1.270ms 8.467ms 1.500ms 3
bonsaidb-ws 5.351ms 1.543ms 11.75ms 1.520ms 5
postgresql 1.757ms 596.7us 6.483ms 570.4us 8
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 39 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 16.14ms 2.942ms 36.89ms 6.233ms 1
bonsaidb-local+lz4 11.26ms 1.565ms 17.91ms 2.531ms 1
bonsaidb-quic 5.604ms 2.290ms 11.76ms 2.284ms 0
bonsaidb-ws 10.63ms 2.578ms 17.24ms 2.547ms 1
postgresql 2.933ms 1.172ms 6.052ms 961.0us 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 4 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 10.79ms 8.902ms 12.68ms 1.569ms 0
bonsaidb-local+lz4 9.120ms 6.151ms 10.73ms 1.849ms 0
bonsaidb-quic 4.962ms 3.633ms 6.132ms 956.1us 0
bonsaidb-ws 8.377ms 5.371ms 10.43ms 2.044ms 0
postgresql 5.229ms 4.146ms 6.630ms 929.9us 0