BonsaiDb Commerce Benchmark

large, readheavy, 8 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 8 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2721
FindProduct 2748
CreateCart 389
AddProductToCart 538
Checkout 34
RateProduct 3

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 8.509s 1.064s None
bonsaidb-local+lz4 8.847s 1.106s TCP
bonsaidb-quic 11.44s 1.430s UDP with TLS
bonsaidb-ws 9.980s 1.247s TCP
postgresql 33.67s 4.208s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.321s 1.321s 1.321s 0s 0
bonsaidb-local+lz4 1.357s 1.357s 1.357s 0s 0
bonsaidb-quic 1.413s 1.413s 1.413s 0s 0
bonsaidb-ws 1.388s 1.388s 1.388s 0s 0
postgresql 25.70s 25.70s 25.70s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2721 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 117.9us 46.32us 2.895ms 96.01us 12
bonsaidb-local+lz4 117.9us 44.32us 3.457ms 114.0us 4
bonsaidb-quic 702.0us 346.3us 9.522ms 320.8us 6
bonsaidb-ws 502.8us 287.4us 5.129ms 196.9us 16
postgresql 1.050ms 362.2us 21.13ms 725.6us 10
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2748 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 202.5us 82.10us 2.799ms 130.5us 23
bonsaidb-local+lz4 206.9us 79.66us 3.442ms 148.3us 15
bonsaidb-quic 1.103ms 516.0us 9.460ms 421.7us 11
bonsaidb-ws 802.6us 473.9us 5.243ms 256.8us 31
postgresql 1.145ms 398.2us 23.00ms 789.8us 13
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 389 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.960ms 985.8us 21.63ms 2.000ms 8
bonsaidb-local+lz4 6.344ms 1.032ms 13.99ms 1.582ms 5
bonsaidb-quic 4.886ms 1.259ms 21.42ms 2.499ms 5
bonsaidb-ws 4.770ms 1.173ms 15.52ms 1.768ms 6
postgresql 2.042ms 706.6us 6.553ms 725.6us 10
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 538 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 6.567ms 1.419ms 21.76ms 1.883ms 12
bonsaidb-local+lz4 6.807ms 1.394ms 14.17ms 1.599ms 12
bonsaidb-quic 5.297ms 1.659ms 11.22ms 1.872ms 1
bonsaidb-ws 5.209ms 1.577ms 10.55ms 1.567ms 5
postgresql 1.925ms 637.1us 5.928ms 526.3us 8
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 34 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 12.64ms 8.895ms 27.50ms 3.334ms 1
bonsaidb-local+lz4 12.84ms 9.721ms 18.93ms 2.239ms 0
bonsaidb-quic 9.321ms 3.638ms 16.02ms 2.988ms 0
bonsaidb-ws 9.805ms 2.881ms 16.58ms 2.711ms 0
postgresql 3.408ms 1.807ms 6.941ms 1.152ms 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 9.883ms 9.364ms 10.43ms 437.4us 0
bonsaidb-local+lz4 11.33ms 10.91ms 12.02ms 489.2us 0
bonsaidb-quic 5.979ms 4.629ms 7.534ms 1.195ms 0
bonsaidb-ws 9.055ms 7.501ms 10.42ms 1.199ms 0
postgresql 6.295ms 4.998ms 7.024ms 919.2us 0