BonsaiDb Commerce Benchmark

medium, balanced, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2824
FindProduct 2760
CreateCart 723
AddProductToCart 1379
Checkout 200
RateProduct 96

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.491s 1.491s None
bonsaidb-local+lz4 1.552s 1.552s TCP
bonsaidb-quic 4.734s 4.734s UDP with TLS
bonsaidb-ws 4.234s 4.234s TCP
postgresql 14.96s 14.96s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 100.5ms 100.5ms 100.5ms 0s 0
bonsaidb-local+lz4 109.5ms 109.5ms 109.5ms 0s 0
bonsaidb-quic 117.3ms 117.3ms 117.3ms 0s 0
bonsaidb-ws 110.2ms 110.2ms 110.2ms 0s 0
postgresql 7.117s 7.117s 7.117s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2824 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 89.39us 31.70us 2.963ms 104.9us 29
bonsaidb-local+lz4 94.48us 41.00us 4.242ms 152.9us 18
bonsaidb-quic 481.9us 337.1us 9.967ms 364.8us 28
bonsaidb-ws 428.2us 224.8us 12.28ms 543.4us 30
postgresql 704.4us 329.1us 12.55ms 670.9us 38
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2760 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 169.5us 47.10us 8.546ms 276.4us 15
bonsaidb-local+lz4 168.1us 55.30us 5.523ms 210.5us 22
bonsaidb-quic 597.4us 381.2us 10.18ms 417.8us 31
bonsaidb-ws 512.5us 258.3us 13.36ms 475.0us 30
postgresql 758.5us 350.1us 22.35ms 843.0us 28
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 723 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 171.9us 91.60us 1.836ms 89.55us 11
bonsaidb-local+lz4 193.3us 113.1us 2.808ms 196.2us 10
bonsaidb-quic 430.4us 307.5us 7.430ms 345.9us 6
bonsaidb-ws 396.5us 209.6us 6.964ms 480.5us 9
postgresql 1.484ms 844.7us 15.34ms 1.275ms 19
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1379 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 249.6us 114.8us 5.193ms 252.7us 11
bonsaidb-local+lz4 281.2us 157.5us 9.982ms 487.2us 9
bonsaidb-quic 676.8us 493.6us 5.723ms 323.1us 23
bonsaidb-ws 613.0us 344.0us 10.75ms 515.6us 21
postgresql 1.425ms 845.9us 18.13ms 1.369ms 30
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 200 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 487.5us 211.7us 7.430ms 726.4us 2
bonsaidb-local+lz4 459.1us 315.4us 4.341ms 403.4us 3
bonsaidb-quic 1.147ms 859.3us 7.401ms 689.3us 3
bonsaidb-ws 1.103ms 581.8us 9.054ms 1.023ms 5
postgresql 1.331ms 910.4us 7.130ms 609.8us 3
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 96 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.088ms 387.0us 24.62ms 2.703ms 2
bonsaidb-local+lz4 966.1us 533.4us 26.82ms 2.666ms 1
bonsaidb-quic 1.391ms 904.9us 20.86ms 2.063ms 1
bonsaidb-ws 1.540ms 746.8us 19.72ms 2.186ms 1
postgresql 4.741ms 3.290ms 15.20ms 2.156ms 3