BonsaiDb Commerce Benchmark

large, balanced, 2 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 2 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2729
FindProduct 2762
CreateCart 714
AddProductToCart 1350
Checkout 165
RateProduct 81

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 2.182s 1.091s None
bonsaidb-local+lz4 2.299s 1.149s TCP
bonsaidb-quic 5.292s 2.646s UDP with TLS
bonsaidb-ws 4.274s 2.137s TCP
postgresql 52.73s 26.36s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 514.0ms 514.0ms 514.0ms 0s 0
bonsaidb-local+lz4 529.9ms 529.9ms 529.9ms 0s 0
bonsaidb-quic 551.7ms 551.7ms 551.7ms 0s 0
bonsaidb-ws 535.9ms 535.9ms 535.9ms 0s 0
postgresql 42.82s 42.82s 42.82s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2729 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 114.9us 37.40us 8.221ms 192.0us 18
bonsaidb-local+lz4 117.6us 37.00us 4.307ms 166.6us 20
bonsaidb-quic 538.2us 341.8us 7.442ms 332.4us 44
bonsaidb-ws 390.7us 209.1us 11.09ms 394.6us 22
postgresql 1.022ms 413.6us 30.76ms 1.107ms 13
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2762 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 212.5us 57.20us 1.912ms 144.3us 47
bonsaidb-local+lz4 217.6us 60.40us 4.588ms 227.3us 26
bonsaidb-quic 618.0us 371.3us 7.521ms 298.5us 39
bonsaidb-ws 491.0us 255.9us 7.206ms 396.2us 33
postgresql 1.043ms 421.0us 12.99ms 567.3us 49
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 714 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 200.2us 103.0us 970.6us 80.45us 13
bonsaidb-local+lz4 249.5us 97.20us 7.354ms 368.5us 6
bonsaidb-quic 403.8us 257.3us 3.257ms 193.8us 13
bonsaidb-ws 337.9us 201.6us 2.681ms 193.8us 12
postgresql 1.718ms 854.4us 9.286ms 718.6us 17
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1350 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 290.0us 135.6us 8.272ms 295.2us 6
bonsaidb-local+lz4 318.5us 132.1us 7.532ms 318.6us 17
bonsaidb-quic 702.3us 449.0us 6.657ms 355.3us 24
bonsaidb-ws 567.3us 340.6us 9.355ms 527.8us 14
postgresql 1.667ms 875.7us 11.18ms 742.1us 19
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 165 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 484.4us 259.9us 2.407ms 224.7us 3
bonsaidb-local+lz4 557.6us 306.4us 3.305ms 329.7us 4
bonsaidb-quic 1.055ms 760.6us 2.249ms 223.1us 4
bonsaidb-ws 900.2us 599.7us 5.861ms 553.5us 3
postgresql 1.788ms 945.9us 8.903ms 766.8us 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 81 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.892ms 517.7us 50.37ms 6.921ms 2
bonsaidb-local+lz4 1.812ms 578.6us 49.16ms 6.543ms 2
bonsaidb-quic 1.898ms 839.9us 47.99ms 5.249ms 1
bonsaidb-ws 1.975ms 736.0us 47.24ms 5.567ms 2
postgresql 5.786ms 4.107ms 10.16ms 1.084ms 2