BonsaiDb Commerce Benchmark

large, balanced, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2731
FindProduct 2766
CreateCart 715
AddProductToCart 1350
Checkout 165
RateProduct 81

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 9.414s 2.353s None
bonsaidb-local+lz4 9.683s 2.421s TCP
bonsaidb-quic 11.76s 2.940s UDP with TLS
bonsaidb-ws 10.94s 2.735s TCP
postgresql 32.78s 8.194s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.318s 1.318s 1.318s 0s 0
bonsaidb-local+lz4 1.353s 1.353s 1.353s 0s 0
bonsaidb-quic 1.404s 1.404s 1.404s 0s 0
bonsaidb-ws 1.439s 1.439s 1.439s 0s 0
postgresql 25.79s 25.79s 25.79s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2731 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 115.8us 69.87us 2.531ms 51.33us 3
bonsaidb-local+lz4 115.6us 56.79us 2.873ms 57.43us 5
bonsaidb-quic 563.9us 356.7us 7.044ms 145.2us 4
bonsaidb-ws 435.0us 284.0us 3.955ms 92.25us 5
postgresql 712.7us 314.2us 9.450ms 469.7us 74
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2766 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 207.7us 111.2us 2.504ms 84.69us 6
bonsaidb-local+lz4 211.1us 119.3us 2.967ms 96.94us 5
bonsaidb-quic 912.3us 647.9us 7.019ms 228.3us 5
bonsaidb-ws 705.8us 476.1us 4.051ms 138.4us 13
postgresql 809.9us 357.1us 15.28ms 638.0us 38
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 715 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.647ms 712.4us 10.25ms 970.7us 12
bonsaidb-local+lz4 2.719ms 886.8us 11.51ms 1.022ms 10
bonsaidb-quic 2.238ms 1.008ms 13.61ms 1.015ms 7
bonsaidb-ws 2.183ms 871.0us 9.038ms 960.1us 15
postgresql 1.079ms 651.4us 4.038ms 278.8us 12
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1350 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 3.000ms 838.4us 11.91ms 977.1us 23
bonsaidb-local+lz4 3.115ms 1.100ms 12.37ms 872.0us 21
bonsaidb-quic 2.646ms 1.205ms 13.15ms 922.6us 18
bonsaidb-ws 2.761ms 1.067ms 11.89ms 1.093ms 21
postgresql 1.060ms 593.4us 3.274ms 243.8us 18
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 165 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.471ms 2.547ms 10.43ms 1.236ms 4
bonsaidb-local+lz4 5.617ms 2.253ms 11.18ms 1.415ms 4
bonsaidb-quic 4.720ms 2.703ms 9.872ms 1.336ms 4
bonsaidb-ws 4.619ms 2.182ms 10.43ms 1.359ms 3
postgresql 1.723ms 1.253ms 4.777ms 425.4us 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 81 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 4.451ms 2.426ms 7.091ms 903.8us 0
bonsaidb-local+lz4 4.374ms 2.154ms 9.598ms 1.084ms 1
bonsaidb-quic 4.208ms 2.854ms 8.462ms 924.2us 1
bonsaidb-ws 3.841ms 2.590ms 8.604ms 899.7us 2
postgresql 3.822ms 2.987ms 5.996ms 590.2us 2