BonsaiDb Commerce Benchmark

medium, writeheavy, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2721
FindProduct 2728
CreateCart 994
AddProductToCart 4913
Checkout 887
RateProduct 3929

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 11.91s 2.978s None
bonsaidb-local+lz4 12.02s 3.004s TCP
bonsaidb-quic 21.30s 5.326s UDP with TLS
bonsaidb-ws 17.15s 4.287s TCP
postgresql 107.7s 26.92s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 95.34ms 95.34ms 95.34ms 0s 0
bonsaidb-local+lz4 103.7ms 103.7ms 103.7ms 0s 0
bonsaidb-quic 155.3ms 155.3ms 155.3ms 0s 0
bonsaidb-ws 151.9ms 151.9ms 151.9ms 0s 0
postgresql 6.787s 6.787s 6.787s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2721 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 201.4us 42.30us 7.998ms 250.4us 16
bonsaidb-local+lz4 212.4us 51.30us 1.602ms 160.4us 44
bonsaidb-quic 1.065ms 450.4us 11.21ms 445.9us 32
bonsaidb-ws 779.6us 264.9us 7.510ms 331.1us 32
postgresql 5.427ms 455.9us 101.1ms 5.425ms 19
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2728 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 449.3us 76.80us 17.08ms 633.7us 19
bonsaidb-local+lz4 450.4us 83.60us 3.292ms 278.3us 46
bonsaidb-quic 1.206ms 536.2us 7.514ms 408.2us 36
bonsaidb-ws 949.6us 373.7us 5.910ms 345.2us 44
postgresql 5.728ms 577.5us 59.38ms 4.652ms 16
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 994 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 359.2us 109.2us 5.074ms 255.5us 10
bonsaidb-local+lz4 382.2us 116.6us 1.583ms 188.4us 15
bonsaidb-quic 678.3us 316.0us 9.607ms 376.1us 10
bonsaidb-ws 552.7us 239.1us 3.072ms 238.6us 16
postgresql 3.166ms 934.4us 94.52ms 3.728ms 4
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4913 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 520.7us 136.2us 9.583ms 431.7us 45
bonsaidb-local+lz4 536.1us 146.4us 3.785ms 268.7us 71
bonsaidb-quic 1.224ms 545.6us 14.40ms 559.1us 40
bonsaidb-ws 958.4us 336.7us 14.47ms 398.1us 62
postgresql 2.867ms 925.1us 62.78ms 2.664ms 53
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 887 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 884.1us 242.5us 9.577ms 572.4us 8
bonsaidb-local+lz4 936.6us 291.0us 3.201ms 355.0us 13
bonsaidb-quic 1.903ms 1.081ms 10.20ms 571.3us 12
bonsaidb-ws 1.514ms 797.9us 6.305ms 429.5us 12
postgresql 3.039ms 1.015ms 21.04ms 1.918ms 15
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3929 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.615ms 238.9us 24.02ms 1.165ms 54
bonsaidb-local+lz4 1.593ms 518.2us 29.55ms 948.0us 10
bonsaidb-quic 1.677ms 830.9us 28.31ms 885.2us 28
bonsaidb-ws 1.447ms 606.5us 29.40ms 806.2us 20
postgresql 12.87ms 3.848ms 118.6ms 6.828ms 48