BonsaiDb Commerce Benchmark

large, balanced, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2729
FindProduct 2762
CreateCart 714
AddProductToCart 1350
Checkout 165
RateProduct 81

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.973s 1.973s None
bonsaidb-local+lz4 2.133s 2.133s TCP
bonsaidb-quic 5.372s 5.372s UDP with TLS
bonsaidb-ws 4.448s 4.448s TCP
postgresql 51.47s 51.47s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 490.9ms 490.9ms 490.9ms 0s 0
bonsaidb-local+lz4 508.7ms 508.7ms 508.7ms 0s 0
bonsaidb-quic 552.3ms 552.3ms 552.3ms 0s 0
bonsaidb-ws 580.2ms 580.2ms 580.2ms 0s 0
postgresql 44.21s 44.21s 44.21s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2729 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 99.67us 40.50us 2.117ms 107.9us 33
bonsaidb-local+lz4 116.7us 41.20us 9.434ms 296.6us 18
bonsaidb-quic 514.9us 346.1us 10.43ms 421.4us 31
bonsaidb-ws 393.4us 220.1us 5.182ms 210.9us 44
postgresql 726.9us 367.8us 7.217ms 355.9us 32
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2762 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 181.8us 76.80us 3.792ms 160.8us 36
bonsaidb-local+lz4 195.3us 70.10us 5.988ms 260.1us 30
bonsaidb-quic 636.2us 391.5us 8.436ms 465.0us 39
bonsaidb-ws 506.5us 266.9us 12.51ms 396.5us 23
postgresql 797.2us 407.6us 19.57ms 646.6us 19
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 714 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 201.7us 112.7us 2.720ms 192.1us 12
bonsaidb-local+lz4 238.8us 107.6us 7.596ms 521.7us 6
bonsaidb-quic 461.3us 285.5us 5.798ms 395.9us 12
bonsaidb-ws 385.3us 211.9us 13.54ms 660.5us 2
postgresql 1.256ms 863.9us 10.71ms 768.5us 13
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1350 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 272.3us 155.8us 9.153ms 328.4us 11
bonsaidb-local+lz4 285.1us 146.3us 8.421ms 371.2us 12
bonsaidb-quic 746.0us 497.1us 8.772ms 587.2us 18
bonsaidb-ws 604.3us 337.8us 10.32ms 478.5us 11
postgresql 1.174ms 853.5us 9.526ms 590.7us 19
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 165 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 536.5us 318.4us 7.642ms 659.4us 3
bonsaidb-local+lz4 506.7us 301.9us 3.630ms 375.5us 4
bonsaidb-quic 1.088ms 795.0us 2.920ms 300.6us 4
bonsaidb-ws 1.019ms 737.5us 10.64ms 829.7us 1
postgresql 1.271ms 905.0us 5.314ms 487.6us 2
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 81 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.332ms 557.7us 44.78ms 4.866ms 1
bonsaidb-local+lz4 1.574ms 588.3us 49.70ms 5.486ms 1
bonsaidb-quic 1.743ms 930.9us 42.33ms 4.552ms 1
bonsaidb-ws 1.687ms 817.6us 44.87ms 4.848ms 1
postgresql 4.773ms 3.829ms 9.617ms 979.8us 3