BonsaiDb Commerce Benchmark

medium, readheavy, 2 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 2 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2758
FindProduct 2727
CreateCart 416
AddProductToCart 531
Checkout 37
RateProduct 4

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.159s 579.3ms None
bonsaidb-local+lz4 1.277s 638.6ms TCP
bonsaidb-quic 3.699s 1.849s UDP with TLS
bonsaidb-ws 2.597s 1.299s TCP
postgresql 14.77s 7.384s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 94.69ms 94.69ms 94.69ms 0s 0
bonsaidb-local+lz4 101.9ms 101.9ms 101.9ms 0s 0
bonsaidb-quic 119.3ms 119.3ms 119.3ms 0s 0
bonsaidb-ws 108.4ms 108.4ms 108.4ms 0s 0
postgresql 8.179s 8.179s 8.179s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2758 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 104.8us 30.60us 4.260ms 228.0us 22
bonsaidb-local+lz4 120.0us 32.00us 7.431ms 338.1us 23
bonsaidb-quic 513.4us 316.8us 7.872ms 338.9us 29
bonsaidb-ws 331.9us 205.4us 5.082ms 181.7us 29
postgresql 850.4us 334.0us 18.23ms 602.0us 33
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2727 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 174.2us 47.10us 5.189ms 286.1us 20
bonsaidb-local+lz4 191.2us 47.60us 7.346ms 354.0us 24
bonsaidb-quic 575.3us 360.9us 5.472ms 326.5us 36
bonsaidb-ws 411.8us 248.1us 5.049ms 229.2us 37
postgresql 881.8us 372.7us 23.54ms 882.6us 15
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 416 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 239.9us 98.10us 5.681ms 441.7us 4
bonsaidb-local+lz4 233.9us 111.7us 3.659ms 269.6us 6
bonsaidb-quic 398.5us 247.5us 1.964ms 176.1us 10
bonsaidb-ws 316.9us 199.3us 1.878ms 160.4us 8
postgresql 1.879ms 983.6us 12.01ms 1.200ms 9
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 531 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 286.7us 120.8us 3.837ms 290.4us 8
bonsaidb-local+lz4 333.7us 125.0us 7.789ms 552.5us 5
bonsaidb-quic 681.5us 444.9us 7.869ms 380.4us 4
bonsaidb-ws 505.2us 331.9us 3.259ms 212.7us 8
postgresql 1.768ms 973.7us 11.73ms 927.4us 5
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 37 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 448.9us 296.2us 1.041ms 150.3us 1
bonsaidb-local+lz4 532.7us 309.1us 3.930ms 594.9us 1
bonsaidb-quic 1.062ms 802.8us 1.996ms 283.9us 1
bonsaidb-ws 741.2us 600.1us 1.085ms 86.67us 1
postgresql 2.504ms 1.198ms 14.54ms 2.177ms 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 4 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 7.832ms 831.5us 28.37ms 11.86ms 0
bonsaidb-local+lz4 7.124ms 757.0us 25.60ms 10.67ms 0
bonsaidb-quic 6.956ms 996.6us 24.66ms 10.22ms 0
bonsaidb-ws 5.780ms 830.3us 20.55ms 8.529ms 0
postgresql 6.292ms 5.953ms 6.586ms 258.3us 0