BonsaiDb Commerce Benchmark

medium, readheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2758
FindProduct 2727
CreateCart 416
AddProductToCart 531
Checkout 37
RateProduct 4

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 866.0ms 866.0ms None
bonsaidb-local+lz4 943.8ms 943.8ms TCP
bonsaidb-quic 3.509s 3.509s UDP with TLS
bonsaidb-ws 2.965s 2.965s TCP
postgresql 12.15s 12.15s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 94.15ms 94.15ms 94.15ms 0s 0
bonsaidb-local+lz4 104.0ms 104.0ms 104.0ms 0s 0
bonsaidb-quic 125.1ms 125.1ms 125.1ms 0s 0
bonsaidb-ws 112.8ms 112.8ms 112.8ms 0s 0
postgresql 7.537s 7.537s 7.537s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2758 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 75.82us 36.60us 1.489ms 61.29us 21
bonsaidb-local+lz4 83.33us 35.20us 2.194ms 84.14us 25
bonsaidb-quic 464.5us 331.6us 9.931ms 328.4us 22
bonsaidb-ws 385.9us 228.8us 5.052ms 226.8us 20
postgresql 591.3us 346.8us 9.346ms 370.6us 30
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2727 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 123.6us 71.00us 2.426ms 110.6us 33
bonsaidb-local+lz4 130.0us 72.10us 2.115ms 98.12us 34
bonsaidb-quic 550.0us 357.6us 8.098ms 349.5us 32
bonsaidb-ws 458.1us 269.6us 11.55ms 311.1us 22
postgresql 638.8us 361.8us 19.90ms 665.8us 14
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 416 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 165.3us 112.1us 1.229ms 75.85us 7
bonsaidb-local+lz4 200.7us 124.1us 5.125ms 324.7us 4
bonsaidb-quic 439.7us 271.4us 5.717ms 423.1us 3
bonsaidb-ws 391.0us 216.7us 4.479ms 310.5us 5
postgresql 1.229ms 853.7us 5.707ms 454.9us 8
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 531 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 225.7us 163.4us 1.172ms 87.91us 11
bonsaidb-local+lz4 247.8us 171.2us 4.001ms 193.0us 4
bonsaidb-quic 676.8us 505.3us 4.584ms 352.0us 9
bonsaidb-ws 598.9us 430.9us 5.711ms 332.4us 8
postgresql 1.239ms 834.8us 15.45ms 833.7us 9
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 37 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 370.1us 303.6us 1.074ms 121.4us 1
bonsaidb-local+lz4 403.9us 335.2us 939.0us 103.6us 1
bonsaidb-quic 1.003ms 864.5us 1.823ms 213.1us 2
bonsaidb-ws 923.0us 763.4us 1.356ms 157.6us 0
postgresql 1.341ms 928.7us 3.416ms 486.6us 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 4 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.843ms 645.1us 21.32ms 8.935ms 0
bonsaidb-local+lz4 6.387ms 726.6us 23.26ms 9.743ms 0
bonsaidb-quic 5.756ms 1.016ms 19.82ms 8.119ms 0
bonsaidb-ws 5.996ms 1.101ms 20.47ms 8.357ms 0
postgresql 4.400ms 3.604ms 5.461ms 688.1us 0