BonsaiDb Commerce Benchmark

small, readheavy, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 100
Categories 10
Customers 100
Orders 125
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2764
FindProduct 2872
CreateCart 435
AddProductToCart 592
Checkout 38
RateProduct 5

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 4.068s 1.017s None
bonsaidb-local+lz4 3.931s 982.7ms TCP
bonsaidb-quic 6.252s 1.563s UDP with TLS
bonsaidb-ws 5.316s 1.329s TCP
postgresql 4.400s 1.100s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 31.09ms 31.09ms 31.09ms 0s 0
bonsaidb-local+lz4 30.95ms 30.95ms 30.95ms 0s 0
bonsaidb-quic 33.45ms 33.45ms 33.45ms 0s 0
bonsaidb-ws 32.85ms 32.85ms 32.85ms 0s 0
postgresql 289.2ms 289.2ms 289.2ms 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2764 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 100.7us 37.42us 2.274ms 61.00us 2
bonsaidb-local+lz4 102.7us 35.16us 1.931ms 52.62us 3
bonsaidb-quic 555.3us 349.8us 4.808ms 159.2us 16
bonsaidb-ws 422.5us 275.5us 2.800ms 93.00us 18
postgresql 492.3us 228.7us 10.87ms 355.7us 10
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2872 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 169.7us 58.91us 2.280ms 65.70us 4
bonsaidb-local+lz4 171.9us 72.17us 1.919ms 58.24us 3
bonsaidb-quic 859.2us 603.6us 4.834ms 165.9us 29
bonsaidb-ws 665.3us 455.2us 2.753ms 112.7us 21
postgresql 540.8us 249.0us 12.47ms 381.2us 14
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 435 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.695ms 823.6us 8.074ms 1.017ms 8
bonsaidb-local+lz4 2.557ms 811.8us 8.026ms 908.9us 7
bonsaidb-quic 1.735ms 949.6us 7.601ms 718.3us 6
bonsaidb-ws 1.765ms 901.5us 6.669ms 839.4us 9
postgresql 1.149ms 631.0us 13.32ms 1.083ms 4
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 592 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 3.190ms 831.7us 8.142ms 1.008ms 7
bonsaidb-local+lz4 3.028ms 746.6us 8.637ms 942.0us 8
bonsaidb-quic 2.193ms 1.216ms 8.735ms 779.1us 5
bonsaidb-ws 2.165ms 1.062ms 7.738ms 791.8us 6
postgresql 1.029ms 632.7us 4.061ms 283.8us 9
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 38 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.104ms 2.546ms 8.467ms 1.139ms 0
bonsaidb-local+lz4 5.270ms 2.125ms 10.23ms 1.533ms 1
bonsaidb-quic 3.800ms 2.496ms 11.24ms 1.491ms 1
bonsaidb-ws 3.624ms 2.546ms 5.283ms 742.9us 0
postgresql 1.869ms 1.302ms 3.077ms 506.0us 0
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 5 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 3.362ms 2.151ms 4.272ms 906.7us 0
bonsaidb-local+lz4 3.331ms 2.436ms 3.924ms 552.5us 0
bonsaidb-quic 3.690ms 2.800ms 5.693ms 1.056ms 0
bonsaidb-ws 3.481ms 2.796ms 4.401ms 570.4us 0
postgresql 3.332ms 3.060ms 3.700ms 259.7us 0