BonsaiDb Commerce Benchmark

large, readheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2719
FindProduct 2738
CreateCart 390
AddProductToCart 539
Checkout 34
RateProduct 3

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.421s 1.421s None
bonsaidb-local+lz4 1.436s 1.436s TCP
bonsaidb-quic 3.830s 3.830s UDP with TLS
bonsaidb-ws 3.261s 3.261s TCP
postgresql 48.38s 48.38s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 482.2ms 482.2ms 482.2ms 0s 0
bonsaidb-local+lz4 516.8ms 516.8ms 516.8ms 0s 0
bonsaidb-quic 535.4ms 535.4ms 535.4ms 0s 0
bonsaidb-ws 526.5ms 526.5ms 526.5ms 0s 0
postgresql 43.01s 43.01s 43.01s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2719 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 92.62us 40.80us 9.223ms 232.7us 13
bonsaidb-local+lz4 86.90us 37.20us 2.850ms 88.16us 21
bonsaidb-quic 445.9us 324.4us 9.456ms 292.8us 21
bonsaidb-ws 378.4us 221.8us 10.37ms 390.7us 13
postgresql 721.8us 403.1us 17.81ms 553.4us 19
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2738 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 147.7us 72.10us 9.389ms 265.2us 22
bonsaidb-local+lz4 144.4us 74.00us 3.156ms 129.9us 30
bonsaidb-quic 543.0us 382.7us 11.10ms 319.3us 26
bonsaidb-ws 433.2us 255.6us 8.532ms 222.0us 31
postgresql 760.4us 400.9us 5.931ms 336.6us 41
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 390 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 199.3us 121.6us 2.786ms 216.7us 8
bonsaidb-local+lz4 187.7us 124.4us 1.553ms 117.9us 5
bonsaidb-quic 414.0us 311.7us 4.781ms 276.5us 4
bonsaidb-ws 343.5us 207.7us 1.995ms 155.2us 9
postgresql 1.450ms 935.3us 21.08ms 1.334ms 4
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 539 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 257.5us 169.5us 3.363ms 227.4us 7
bonsaidb-local+lz4 256.5us 178.4us 6.101ms 269.6us 2
bonsaidb-quic 655.7us 495.3us 8.748ms 400.2us 4
bonsaidb-ws 578.4us 336.1us 9.576ms 481.4us 2
postgresql 1.290ms 887.2us 11.18ms 927.5us 12
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 34 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 504.5us 333.6us 2.406ms 367.8us 1
bonsaidb-local+lz4 455.9us 341.2us 917.7us 127.2us 1
bonsaidb-quic 1.057ms 861.2us 3.241ms 402.0us 1
bonsaidb-ws 881.2us 596.2us 1.767ms 213.4us 1
postgresql 1.407ms 957.5us 4.112ms 590.9us 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 16.22ms 960.8us 46.54ms 21.44ms 0
bonsaidb-local+lz4 20.03ms 750.4us 58.55ms 27.24ms 0
bonsaidb-quic 14.88ms 1.242ms 41.95ms 19.14ms 0
bonsaidb-ws 14.67ms 1.035ms 41.94ms 19.28ms 0
postgresql 6.852ms 6.010ms 7.995ms 838.1us 0