BonsaiDb Commerce Benchmark

large, readheavy, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2719
FindProduct 2738
CreateCart 390
AddProductToCart 539
Checkout 34
RateProduct 3

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 2.231s 557.8ms None
bonsaidb-local+lz4 2.191s 547.6ms TCP
bonsaidb-quic 6.824s 1.706s UDP with TLS
bonsaidb-ws 5.106s 1.277s TCP
postgresql 59.43s 14.86s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 460.2ms 460.2ms 460.2ms 0s 0
bonsaidb-local+lz4 485.6ms 485.6ms 485.6ms 0s 0
bonsaidb-quic 553.4ms 553.4ms 553.4ms 0s 0
bonsaidb-ws 544.8ms 544.8ms 544.8ms 0s 0
postgresql 47.41s 47.41s 47.41s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2719 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 157.3us 33.10us 10.74ms 358.0us 15
bonsaidb-local+lz4 141.8us 33.60us 3.477ms 141.0us 31
bonsaidb-quic 927.2us 391.7us 6.320ms 398.4us 39
bonsaidb-ws 648.0us 239.5us 10.02ms 380.0us 35
postgresql 1.607ms 399.1us 43.65ms 1.184ms 20
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2738 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 290.7us 52.30us 10.17ms 501.1us 28
bonsaidb-local+lz4 267.8us 51.90us 8.308ms 310.6us 31
bonsaidb-quic 1.012ms 490.7us 6.937ms 392.3us 43
bonsaidb-ws 743.4us 329.6us 9.745ms 379.5us 43
postgresql 1.702ms 499.6us 47.69ms 1.881ms 10
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 390 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 412.0us 96.90us 22.20ms 1.511ms 3
bonsaidb-local+lz4 452.1us 105.3us 25.09ms 1.772ms 3
bonsaidb-quic 614.4us 299.1us 2.099ms 229.0us 6
bonsaidb-ws 481.4us 256.1us 3.671ms 245.8us 7
postgresql 3.073ms 1.235ms 10.33ms 1.085ms 7
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 539 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 445.7us 126.5us 5.528ms 454.0us 9
bonsaidb-local+lz4 466.6us 129.9us 11.31ms 703.4us 2
bonsaidb-quic 1.135ms 636.0us 6.641ms 520.2us 8
bonsaidb-ws 877.6us 442.4us 11.84ms 701.5us 5
postgresql 3.013ms 1.074ms 8.031ms 925.8us 7
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 34 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 655.1us 352.4us 1.084ms 165.8us 0
bonsaidb-local+lz4 746.1us 348.5us 2.718ms 391.3us 1
bonsaidb-quic 1.762ms 1.073ms 3.260ms 428.9us 1
bonsaidb-ws 1.254ms 902.9us 2.274ms 271.5us 1
postgresql 4.314ms 1.682ms 9.550ms 1.813ms 0
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 41.39ms 919.6us 99.95ms 42.41ms 0
bonsaidb-local+lz4 44.27ms 1.053ms 105.5ms 44.48ms 0
bonsaidb-quic 22.36ms 1.374ms 63.81ms 29.31ms 0
bonsaidb-ws 20.11ms 1.334ms 57.56ms 26.48ms 0
postgresql 9.129ms 8.802ms 9.686ms 395.3us 0