BonsaiDb Commerce Benchmark

medium, writeheavy, 2 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 2 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2721
FindProduct 2728
CreateCart 994
AddProductToCart 4913
Checkout 887
RateProduct 3929

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 7.875s 3.937s None
bonsaidb-local+lz4 7.502s 3.751s TCP
bonsaidb-quic 13.48s 6.742s UDP with TLS
bonsaidb-ws 11.08s 5.538s TCP
postgresql 59.60s 29.80s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 101.7ms 101.7ms 101.7ms 0s 0
bonsaidb-local+lz4 106.2ms 106.2ms 106.2ms 0s 0
bonsaidb-quic 117.2ms 117.2ms 117.2ms 0s 0
bonsaidb-ws 126.1ms 126.1ms 126.1ms 0s 0
postgresql 6.731s 6.731s 6.731s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2721 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 163.6us 45.70us 7.392ms 253.0us 14
bonsaidb-local+lz4 156.3us 42.80us 3.340ms 129.2us 25
bonsaidb-quic 579.2us 345.6us 7.468ms 297.0us 22
bonsaidb-ws 429.7us 236.2us 4.374ms 257.3us 27
postgresql 2.077ms 471.7us 57.41ms 2.579ms 12
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2728 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 342.4us 77.40us 7.846ms 324.2us 28
bonsaidb-local+lz4 318.1us 82.90us 5.873ms 209.1us 21
bonsaidb-quic 727.7us 381.0us 7.695ms 342.6us 35
bonsaidb-ws 570.7us 297.7us 8.932ms 308.8us 30
postgresql 2.249ms 509.3us 57.38ms 2.250ms 14
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 994 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 253.7us 91.30us 3.031ms 188.1us 15
bonsaidb-local+lz4 252.2us 106.8us 8.853ms 301.4us 4
bonsaidb-quic 433.7us 261.4us 3.042ms 171.8us 16
bonsaidb-ws 371.6us 200.5us 8.333ms 318.3us 5
postgresql 2.001ms 975.8us 45.57ms 2.001ms 10
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4913 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 362.5us 122.0us 13.72ms 399.6us 42
bonsaidb-local+lz4 342.4us 139.9us 7.386ms 227.7us 49
bonsaidb-quic 741.9us 464.2us 7.373ms 319.3us 62
bonsaidb-ws 597.6us 338.5us 9.655ms 399.2us 48
postgresql 1.894ms 867.0us 54.94ms 1.586ms 46
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 887 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 595.6us 250.1us 5.511ms 362.4us 14
bonsaidb-local+lz4 589.3us 280.9us 5.379ms 303.1us 15
bonsaidb-quic 1.184ms 768.0us 6.889ms 430.0us 15
bonsaidb-ws 942.2us 573.2us 8.098ms 502.2us 12
postgresql 2.197ms 1.009ms 11.69ms 1.146ms 13
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3929 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 975.4us 222.1us 25.85ms 771.5us 24
bonsaidb-local+lz4 928.2us 244.8us 24.38ms 628.3us 33
bonsaidb-quic 1.191ms 722.1us 22.74ms 670.9us 37
bonsaidb-ws 1.039ms 640.9us 26.14ms 674.5us 41
postgresql 7.086ms 3.440ms 118.9ms 4.720ms 27