BonsaiDb Commerce Benchmark

medium, balanced, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2830
FindProduct 2774
CreateCart 727
AddProductToCart 1386
Checkout 203
RateProduct 97

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 9.012s 2.253s None
bonsaidb-local+lz4 9.729s 2.432s TCP
bonsaidb-quic 10.75s 2.687s UDP with TLS
bonsaidb-ws 10.34s 2.584s TCP
postgresql 10.85s 2.713s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 269.0ms 269.0ms 269.0ms 0s 0
bonsaidb-local+lz4 274.5ms 274.5ms 274.5ms 0s 0
bonsaidb-quic 294.8ms 294.8ms 294.8ms 0s 0
bonsaidb-ws 290.6ms 290.6ms 290.6ms 0s 0
postgresql 4.199s 4.199s 4.199s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2830 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 110.8us 52.49us 1.935ms 52.20us 8
bonsaidb-local+lz4 112.1us 49.22us 2.048ms 59.56us 3
bonsaidb-quic 566.7us 359.0us 4.920ms 155.0us 17
bonsaidb-ws 423.7us 287.7us 2.892ms 81.42us 4
postgresql 613.6us 252.8us 12.48ms 453.1us 42
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2774 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 195.8us 91.64us 1.919ms 59.52us 8
bonsaidb-local+lz4 199.9us 112.4us 1.974ms 61.59us 10
bonsaidb-quic 904.3us 576.7us 4.909ms 187.0us 22
bonsaidb-ws 687.5us 489.2us 2.890ms 90.75us 11
postgresql 712.6us 293.5us 13.59ms 555.9us 39
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 727 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.723ms 756.0us 10.16ms 847.4us 9
bonsaidb-local+lz4 2.973ms 813.7us 7.538ms 933.9us 9
bonsaidb-quic 2.049ms 915.1us 8.550ms 785.9us 11
bonsaidb-ws 2.283ms 892.8us 23.21ms 1.522ms 7
postgresql 1.110ms 629.2us 10.00ms 717.5us 13
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1386 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 3.105ms 1.029ms 10.65ms 833.0us 16
bonsaidb-local+lz4 3.424ms 951.9us 8.507ms 953.9us 23
bonsaidb-quic 2.568ms 1.210ms 10.85ms 920.9us 17
bonsaidb-ws 2.792ms 1.144ms 23.04ms 1.291ms 18
postgresql 1.049ms 611.0us 11.17ms 545.4us 19
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 203 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.739ms 2.424ms 13.16ms 1.430ms 5
bonsaidb-local+lz4 6.047ms 2.251ms 11.24ms 1.358ms 1
bonsaidb-quic 4.400ms 2.509ms 8.516ms 1.137ms 2
bonsaidb-ws 5.019ms 2.078ms 28.94ms 2.390ms 2
postgresql 1.755ms 999.3us 11.33ms 888.1us 5
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 97 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 4.509ms 2.366ms 8.896ms 994.9us 1
bonsaidb-local+lz4 4.621ms 2.424ms 9.873ms 1.168ms 1
bonsaidb-quic 4.088ms 2.847ms 6.858ms 827.9us 1
bonsaidb-ws 4.033ms 2.710ms 7.900ms 1.043ms 2
postgresql 3.339ms 2.008ms 7.391ms 733.7us 2