BonsaiDb Commerce Benchmark

small, balanced, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 100
Categories 10
Customers 100
Orders 125
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2757
FindProduct 2863
CreateCart 706
AddProductToCart 1432
Checkout 177
RateProduct 96

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 8.117s 2.029s None
bonsaidb-local+lz4 9.731s 2.433s TCP
bonsaidb-quic 10.48s 2.621s UDP with TLS
bonsaidb-ws 9.370s 2.342s TCP
postgresql 6.457s 1.614s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 30.64ms 30.64ms 30.64ms 0s 0
bonsaidb-local+lz4 33.47ms 33.47ms 33.47ms 0s 0
bonsaidb-quic 35.28ms 35.28ms 35.28ms 0s 0
bonsaidb-ws 33.91ms 33.91ms 33.91ms 0s 0
postgresql 288.3ms 288.3ms 288.3ms 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2757 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 100.7us 41.49us 1.360ms 38.13us 4
bonsaidb-local+lz4 103.4us 35.63us 2.547ms 69.95us 3
bonsaidb-quic 554.4us 382.7us 4.612ms 131.1us 7
bonsaidb-ws 419.5us 282.8us 2.793ms 84.25us 8
postgresql 564.8us 237.5us 17.08ms 490.7us 13
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2863 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 178.7us 88.06us 1.360ms 48.01us 6
bonsaidb-local+lz4 181.5us 86.72us 2.570ms 73.99us 4
bonsaidb-quic 880.2us 621.7us 4.808ms 146.3us 9
bonsaidb-ws 676.9us 468.8us 2.900ms 92.55us 7
postgresql 631.2us 274.5us 12.05ms 434.2us 27
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 706 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.543ms 870.9us 7.933ms 846.3us 10
bonsaidb-local+lz4 3.059ms 897.2us 19.52ms 1.105ms 4
bonsaidb-quic 2.112ms 962.2us 5.889ms 787.0us 13
bonsaidb-ws 2.085ms 895.5us 14.99ms 1.034ms 11
postgresql 1.042ms 607.9us 11.33ms 483.5us 4
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1432 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.913ms 781.4us 17.63ms 910.4us 14
bonsaidb-local+lz4 3.585ms 841.0us 19.91ms 1.153ms 13
bonsaidb-quic 2.597ms 1.282ms 9.266ms 871.5us 15
bonsaidb-ws 2.529ms 1.067ms 15.68ms 1.024ms 12
postgresql 1.039ms 571.8us 16.57ms 647.0us 6
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 177 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.253ms 2.170ms 10.85ms 1.325ms 3
bonsaidb-local+lz4 6.424ms 3.116ms 21.48ms 1.862ms 1
bonsaidb-quic 4.568ms 2.492ms 12.35ms 1.419ms 3
bonsaidb-ws 4.412ms 2.412ms 8.977ms 1.223ms 1
postgresql 1.661ms 866.2us 4.424ms 391.9us 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 96 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 4.168ms 2.156ms 7.128ms 1.006ms 0
bonsaidb-local+lz4 4.812ms 2.262ms 8.898ms 1.294ms 1
bonsaidb-quic 3.964ms 2.678ms 6.551ms 857.7us 1
bonsaidb-ws 3.819ms 2.419ms 7.036ms 928.7us 3
postgresql 2.991ms 1.636ms 18.78ms 1.725ms 1