BonsaiDb Commerce Benchmark

large, readheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2721
FindProduct 2748
CreateCart 389
AddProductToCart 538
Checkout 34
RateProduct 3

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 3.171s 3.171s None
bonsaidb-local+lz4 3.307s 3.307s TCP
bonsaidb-quic 6.333s 6.333s UDP with TLS
bonsaidb-ws 5.399s 5.399s TCP
postgresql 28.41s 28.41s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.314s 1.314s 1.314s 0s 0
bonsaidb-local+lz4 1.373s 1.373s 1.373s 0s 0
bonsaidb-quic 1.409s 1.409s 1.409s 0s 0
bonsaidb-ws 1.419s 1.419s 1.419s 0s 0
postgresql 25.74s 25.74s 25.74s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2721 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 92.50us 67.23us 2.244ms 42.09us 1
bonsaidb-local+lz4 94.22us 68.20us 2.449ms 46.07us 1
bonsaidb-quic 492.0us 303.9us 4.815ms 85.97us 2
bonsaidb-ws 342.8us 295.0us 4.060ms 73.60us 3
postgresql 346.6us 266.5us 1.463ms 68.76us 29
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2748 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 149.6us 94.85us 412.4us 24.68us 16
bonsaidb-local+lz4 155.6us 107.6us 450.0us 26.65us 10
bonsaidb-quic 763.6us 489.3us 1.236ms 40.87us 15
bonsaidb-ws 536.0us 466.7us 1.011ms 36.02us 17
postgresql 385.2us 291.1us 1.490ms 62.65us 25
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 389 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.184ms 676.4us 7.790ms 515.6us 4
bonsaidb-local+lz4 1.250ms 700.6us 5.414ms 513.6us 8
bonsaidb-quic 1.378ms 908.7us 9.220ms 624.4us 5
bonsaidb-ws 1.505ms 892.0us 9.836ms 668.2us 7
postgresql 700.4us 508.6us 4.179ms 342.4us 7
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 538 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.210ms 718.9us 9.152ms 570.0us 7
bonsaidb-local+lz4 1.255ms 749.2us 10.11ms 610.4us 7
bonsaidb-quic 1.561ms 1.133ms 5.226ms 324.7us 11
bonsaidb-ws 1.636ms 1.005ms 5.775ms 507.6us 9
postgresql 661.7us 484.2us 4.764ms 274.8us 7
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 34 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.199ms 1.587ms 3.856ms 531.5us 1
bonsaidb-local+lz4 2.393ms 1.753ms 6.228ms 811.4us 1
bonsaidb-quic 2.864ms 2.176ms 4.996ms 491.3us 1
bonsaidb-ws 2.913ms 2.206ms 4.028ms 463.2us 0
postgresql 978.1us 816.5us 1.629ms 178.8us 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.731ms 2.642ms 2.808ms 68.23us 0
bonsaidb-local+lz4 2.496ms 2.142ms 2.721ms 253.2us 0
bonsaidb-quic 4.700ms 2.857ms 7.666ms 2.118ms 0
bonsaidb-ws 3.260ms 2.675ms 3.620ms 417.2us 0
postgresql 2.574ms 2.298ms 2.979ms 292.4us 0