BonsaiDb Commerce Benchmark

medium, readheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2771
FindProduct 2737
CreateCart 418
AddProductToCart 531
Checkout 39
RateProduct 4

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.829s 1.829s None
bonsaidb-local+lz4 1.855s 1.855s TCP
bonsaidb-quic 4.988s 4.988s UDP with TLS
bonsaidb-ws 3.917s 3.917s TCP
postgresql 6.591s 6.591s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 265.1ms 265.1ms 265.1ms 0s 0
bonsaidb-local+lz4 278.8ms 278.8ms 278.8ms 0s 0
bonsaidb-quic 297.2ms 297.2ms 297.2ms 0s 0
bonsaidb-ws 293.0ms 293.0ms 293.0ms 0s 0
postgresql 4.159s 4.159s 4.159s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2771 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 87.94us 63.07us 153.9us 7.954us 21
bonsaidb-local+lz4 88.68us 63.61us 762.6us 15.73us 5
bonsaidb-quic 485.6us 374.1us 1.980ms 36.87us 8
bonsaidb-ws 337.5us 291.2us 477.9us 15.08us 29
postgresql 301.4us 233.3us 789.2us 33.23us 19
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2737 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 143.7us 97.65us 2.112ms 44.49us 1
bonsaidb-local+lz4 146.7us 97.47us 2.207ms 46.44us 2
bonsaidb-quic 756.1us 552.4us 4.082ms 76.97us 6
bonsaidb-ws 531.8us 446.5us 2.898ms 59.04us 4
postgresql 325.7us 252.4us 1.380ms 39.71us 25
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 418 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 868.1us 636.8us 2.986ms 214.4us 6
bonsaidb-local+lz4 882.8us 638.9us 5.030ms 375.3us 7
bonsaidb-quic 1.129ms 877.9us 5.762ms 419.2us 6
bonsaidb-ws 1.109ms 795.7us 4.763ms 354.8us 6
postgresql 732.4us 491.7us 4.456ms 317.0us 9
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 531 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 920.8us 676.1us 9.607ms 474.9us 6
bonsaidb-local+lz4 912.6us 676.5us 6.032ms 348.1us 8
bonsaidb-quic 1.321ms 1.033ms 5.323ms 314.4us 5
bonsaidb-ws 1.271ms 918.0us 6.296ms 393.9us 11
postgresql 660.8us 494.0us 2.113ms 144.6us 8
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 39 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.696ms 1.408ms 2.532ms 199.8us 1
bonsaidb-local+lz4 1.723ms 1.481ms 2.279ms 169.8us 1
bonsaidb-quic 2.355ms 2.093ms 4.394ms 362.9us 1
bonsaidb-ws 2.174ms 1.809ms 3.633ms 343.1us 1
postgresql 1.021ms 797.6us 1.639ms 158.7us 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 4 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.280ms 1.867ms 2.610ms 266.1us 0
bonsaidb-local+lz4 2.041ms 1.750ms 2.332ms 217.5us 0
bonsaidb-quic 2.481ms 2.266ms 2.816ms 210.1us 0
bonsaidb-ws 2.515ms 2.192ms 2.792ms 233.2us 0
postgresql 2.312ms 2.243ms 2.379ms 52.77us 0