BonsaiDb Commerce Benchmark

small, balanced, 2 agent(s)

Configuration

Initial Data Set
Type Count
Products 100
Categories 10
Customers 100
Orders 125
Shopping Plans

This run executed 1000 shopping plans across 2 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2768
FindProduct 2860
CreateCart 708
AddProductToCart 1436
Checkout 177
RateProduct 95

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.429s 714.7ms None
bonsaidb-local+lz4 1.475s 737.3ms TCP
bonsaidb-quic 4.642s 2.321s UDP with TLS
bonsaidb-ws 3.404s 1.702s TCP
postgresql 9.188s 4.594s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 11.70ms 11.70ms 11.70ms 0s 0
bonsaidb-local+lz4 10.22ms 10.22ms 10.22ms 0s 0
bonsaidb-quic 15.30ms 15.30ms 15.30ms 0s 0
bonsaidb-ws 12.25ms 12.25ms 12.25ms 0s 0
postgresql 554.4ms 554.4ms 554.4ms 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2768 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 93.13us 25.70us 2.682ms 108.9us 21
bonsaidb-local+lz4 91.01us 23.10us 3.452ms 106.5us 16
bonsaidb-quic 494.1us 310.9us 6.404ms 288.2us 32
bonsaidb-ws 342.5us 197.9us 5.830ms 271.4us 22
postgresql 753.1us 317.2us 19.53ms 551.1us 24
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2860 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 169.0us 40.40us 2.824ms 126.5us 40
bonsaidb-local+lz4 172.5us 48.40us 4.555ms 173.2us 25
bonsaidb-quic 586.8us 345.6us 10.21ms 455.1us 32
bonsaidb-ws 422.1us 233.4us 8.801ms 317.5us 24
postgresql 827.1us 354.6us 26.96ms 859.6us 11
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 708 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 200.5us 94.10us 1.312ms 100.5us 10
bonsaidb-local+lz4 225.0us 103.6us 3.879ms 225.9us 7
bonsaidb-quic 407.7us 245.6us 5.519ms 336.6us 6
bonsaidb-ws 348.3us 180.4us 6.195ms 352.0us 10
postgresql 1.665ms 864.0us 42.76ms 1.778ms 2
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1436 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 271.3us 119.8us 3.396ms 153.5us 30
bonsaidb-local+lz4 287.1us 122.9us 5.141ms 203.3us 16
bonsaidb-quic 698.2us 457.2us 9.622ms 470.7us 16
bonsaidb-ws 522.5us 328.6us 6.090ms 305.3us 19
postgresql 1.599ms 840.8us 46.61ms 1.350ms 7
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 177 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 452.0us 221.2us 2.530ms 243.5us 3
bonsaidb-local+lz4 467.6us 293.9us 2.696ms 205.7us 1
bonsaidb-quic 1.073ms 773.0us 5.189ms 469.9us 3
bonsaidb-ws 866.3us 528.7us 8.941ms 696.7us 3
postgresql 1.731ms 1.069ms 5.772ms 645.0us 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 95 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 685.6us 411.7us 4.563ms 548.8us 2
bonsaidb-local+lz4 679.9us 458.5us 2.799ms 279.6us 2
bonsaidb-quic 1.053ms 705.0us 4.171ms 437.9us 2
bonsaidb-ws 909.3us 614.8us 4.672ms 492.5us 2
postgresql 4.238ms 2.778ms 10.97ms 1.037ms 1