BonsaiDb Commerce Benchmark

large, writeheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2676
FindProduct 2815
CreateCart 987
AddProductToCart 4951
Checkout 876
RateProduct 3918

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 21.78s 21.78s None
bonsaidb-local+lz4 22.08s 22.08s TCP
bonsaidb-quic 28.68s 28.68s UDP with TLS
bonsaidb-ws 25.77s 25.77s TCP
postgresql 48.35s 48.35s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.315s 1.315s 1.315s 0s 0
bonsaidb-local+lz4 1.352s 1.352s 1.352s 0s 0
bonsaidb-quic 1.420s 1.420s 1.420s 0s 0
bonsaidb-ws 1.412s 1.412s 1.412s 0s 0
postgresql 25.89s 25.89s 25.89s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2676 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 104.1us 73.07us 3.161ms 60.36us 2
bonsaidb-local+lz4 108.6us 75.32us 2.603ms 49.78us 1
bonsaidb-quic 477.9us 400.1us 5.692ms 110.1us 7
bonsaidb-ws 352.4us 302.1us 8.415ms 159.9us 3
postgresql 504.4us 293.2us 2.399ms 122.2us 10
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2815 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 192.3us 114.4us 875.6us 23.85us 13
bonsaidb-local+lz4 204.3us 110.9us 615.2us 21.50us 50
bonsaidb-quic 768.2us 635.5us 1.595ms 47.97us 21
bonsaidb-ws 574.1us 468.7us 1.881ms 64.91us 15
postgresql 602.9us 307.3us 1.674ms 152.5us 3
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 987 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.102ms 624.6us 4.816ms 354.5us 18
bonsaidb-local+lz4 1.165ms 650.9us 6.746ms 465.8us 17
bonsaidb-quic 1.300ms 825.9us 11.33ms 522.1us 14
bonsaidb-ws 1.190ms 757.1us 7.079ms 480.4us 18
postgresql 715.2us 515.6us 10.57ms 464.2us 9
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4951 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.166ms 655.8us 51.24ms 847.6us 24
bonsaidb-local+lz4 1.182ms 662.6us 9.607ms 486.3us 73
bonsaidb-quic 1.549ms 1.050ms 8.970ms 462.8us 85
bonsaidb-ws 1.382ms 888.5us 43.81ms 864.3us 44
postgresql 667.4us 489.7us 15.37ms 339.3us 47
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 876 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.282ms 1.418ms 18.48ms 851.6us 12
bonsaidb-local+lz4 2.304ms 1.437ms 7.259ms 621.1us 11
bonsaidb-quic 2.866ms 1.913ms 13.18ms 778.8us 12
bonsaidb-ws 2.579ms 1.667ms 24.00ms 1.025ms 12
postgresql 979.1us 794.2us 4.599ms 224.4us 11
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3918 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.753ms 1.676ms 19.46ms 684.0us 61
bonsaidb-local+lz4 2.768ms 1.661ms 21.21ms 892.3us 49
bonsaidb-quic 3.153ms 1.964ms 18.96ms 838.4us 67
bonsaidb-ws 2.942ms 1.860ms 35.42ms 1.014ms 56
postgresql 3.713ms 2.278ms 12.91ms 783.2us 45