BonsaiDb Commerce Benchmark

large, writeheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2678
FindProduct 2803
CreateCart 987
AddProductToCart 4942
Checkout 874
RateProduct 3902

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 6.215s 6.215s None
bonsaidb-local+lz4 6.640s 6.640s TCP
bonsaidb-quic 12.87s 12.87s UDP with TLS
bonsaidb-ws 11.69s 11.69s TCP
postgresql 86.77s 86.77s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 463.5ms 463.5ms 463.5ms 0s 0
bonsaidb-local+lz4 487.2ms 487.2ms 487.2ms 0s 0
bonsaidb-quic 519.6ms 519.6ms 519.6ms 0s 0
bonsaidb-ws 514.4ms 514.4ms 514.4ms 0s 0
postgresql 43.31s 43.31s 43.31s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2678 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 112.2us 45.70us 1.936ms 79.47us 34
bonsaidb-local+lz4 123.3us 53.70us 6.394ms 186.1us 15
bonsaidb-quic 465.8us 357.3us 5.315ms 188.4us 37
bonsaidb-ws 425.4us 241.2us 9.739ms 309.3us 24
postgresql 1.165ms 514.3us 10.58ms 566.3us 31
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2803 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 242.9us 94.10us 5.436ms 241.0us 22
bonsaidb-local+lz4 255.8us 89.10us 9.794ms 296.2us 16
bonsaidb-quic 666.3us 459.5us 12.00ms 489.9us 20
bonsaidb-ws 574.0us 298.7us 9.945ms 316.7us 26
postgresql 1.367ms 561.9us 20.84ms 850.1us 21
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 987 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 199.9us 114.7us 4.893ms 211.9us 11
bonsaidb-local+lz4 206.5us 119.3us 6.728ms 272.5us 5
bonsaidb-quic 415.4us 295.6us 7.258ms 318.5us 9
bonsaidb-ws 394.5us 216.8us 9.212ms 543.1us 7
postgresql 1.416ms 940.9us 16.79ms 936.6us 10
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4942 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 257.6us 141.4us 9.183ms 321.4us 27
bonsaidb-local+lz4 280.2us 164.6us 9.809ms 376.3us 29
bonsaidb-quic 657.2us 484.1us 10.26ms 405.1us 51
bonsaidb-ws 602.0us 346.5us 13.05ms 497.3us 34
postgresql 1.298ms 883.3us 23.54ms 881.8us 74
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 874 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 446.3us 256.1us 10.00ms 458.3us 6
bonsaidb-local+lz4 497.1us 309.0us 9.692ms 670.2us 7
bonsaidb-quic 1.045ms 797.2us 4.911ms 330.9us 14
bonsaidb-ws 953.4us 596.3us 10.70ms 461.0us 8
postgresql 1.472ms 886.9us 9.981ms 657.6us 10
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3902 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 745.9us 415.0us 45.58ms 882.0us 22
bonsaidb-local+lz4 790.0us 508.5us 51.23ms 1.026ms 21
bonsaidb-quic 1.195ms 833.6us 43.63ms 933.7us 28
bonsaidb-ws 1.083ms 642.4us 44.21ms 911.4us 28
postgresql 7.026ms 3.854ms 27.83ms 1.986ms 65