BonsaiDb Commerce Benchmark

medium, balanced, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2830
FindProduct 2774
CreateCart 727
AddProductToCart 1386
Checkout 203
RateProduct 97

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 3.550s 3.550s None
bonsaidb-local+lz4 3.457s 3.457s TCP
bonsaidb-quic 7.832s 7.832s UDP with TLS
bonsaidb-ws 6.423s 6.423s TCP
postgresql 7.714s 7.714s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 267.6ms 267.6ms 267.6ms 0s 0
bonsaidb-local+lz4 277.4ms 277.4ms 277.4ms 0s 0
bonsaidb-quic 306.7ms 306.7ms 306.7ms 0s 0
bonsaidb-ws 289.7ms 289.7ms 289.7ms 0s 0
postgresql 4.176s 4.176s 4.176s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2830 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 91.07us 54.45us 598.8us 15.31us 11
bonsaidb-local+lz4 89.62us 65.30us 257.9us 11.92us 8
bonsaidb-quic 483.5us 310.8us 864.2us 31.37us 23
bonsaidb-ws 341.3us 279.8us 810.0us 24.28us 21
postgresql 307.6us 237.6us 816.9us 53.44us 89
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2774 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 157.6us 101.3us 1.886ms 47.26us 7
bonsaidb-local+lz4 157.8us 97.69us 2.038ms 47.12us 2
bonsaidb-quic 764.7us 479.1us 3.998ms 98.32us 7
bonsaidb-ws 544.5us 447.3us 2.663ms 60.66us 8
postgresql 341.6us 254.2us 1.429ms 71.33us 97
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 727 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 901.3us 611.9us 8.657ms 495.4us 7
bonsaidb-local+lz4 877.1us 602.5us 5.183ms 317.0us 8
bonsaidb-quic 1.339ms 837.5us 8.758ms 525.0us 11
bonsaidb-ws 1.242ms 791.1us 12.14ms 690.1us 12
postgresql 636.4us 501.2us 4.287ms 219.9us 4
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1386 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 939.0us 639.3us 8.901ms 401.6us 22
bonsaidb-local+lz4 926.2us 623.1us 6.134ms 395.9us 21
bonsaidb-quic 1.580ms 1.060ms 12.74ms 620.7us 18
bonsaidb-ws 1.390ms 922.6us 15.31ms 680.2us 11
postgresql 612.4us 479.6us 4.681ms 205.0us 7
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 203 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.966ms 1.344ms 28.70ms 1.968ms 1
bonsaidb-local+lz4 1.751ms 1.305ms 4.654ms 434.6us 5
bonsaidb-quic 2.868ms 1.964ms 6.755ms 643.6us 3
bonsaidb-ws 2.697ms 1.852ms 13.98ms 1.370ms 5
postgresql 1.004ms 776.7us 8.121ms 545.7us 2
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 97 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.390ms 1.633ms 6.507ms 771.9us 2
bonsaidb-local+lz4 2.181ms 1.688ms 5.376ms 543.5us 2
bonsaidb-quic 2.991ms 2.049ms 8.669ms 761.6us 2
bonsaidb-ws 2.876ms 2.058ms 4.990ms 586.8us 2
postgresql 2.109ms 1.848ms 6.295ms 556.0us 2