BonsaiDb Commerce Benchmark

small, balanced, 4 agent(s)

Configuration

Initial Data Set
Type Count
Products 100
Categories 10
Customers 100
Orders 125
Shopping Plans

This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2768
FindProduct 2860
CreateCart 708
AddProductToCart 1436
Checkout 177
RateProduct 95

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 2.035s 508.8ms None
bonsaidb-local+lz4 2.178s 544.5ms TCP
bonsaidb-quic 7.567s 1.892s UDP with TLS
bonsaidb-ws 5.570s 1.393s TCP
postgresql 15.79s 3.947s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 9.946ms 9.946ms 9.946ms 0s 0
bonsaidb-local+lz4 11.02ms 11.02ms 11.02ms 0s 0
bonsaidb-quic 13.97ms 13.97ms 13.97ms 0s 0
bonsaidb-ws 12.85ms 12.85ms 12.85ms 0s 0
postgresql 643.7ms 643.7ms 643.7ms 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2768 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 126.3us 21.50us 1.744ms 115.2us 45
bonsaidb-local+lz4 136.6us 24.50us 1.477ms 116.2us 48
bonsaidb-quic 866.3us 337.0us 5.991ms 375.3us 41
bonsaidb-ws 614.9us 283.6us 7.645ms 333.1us 23
postgresql 1.365ms 337.3us 41.20ms 1.437ms 17
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2860 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 240.5us 46.80us 6.995ms 271.3us 13
bonsaidb-local+lz4 244.3us 48.40us 1.684ms 164.3us 49
bonsaidb-quic 941.0us 367.4us 6.714ms 383.7us 50
bonsaidb-ws 702.9us 316.8us 7.329ms 329.0us 32
postgresql 1.467ms 411.4us 43.18ms 1.605ms 27
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 708 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 280.9us 90.70us 1.621ms 150.9us 7
bonsaidb-local+lz4 330.0us 86.90us 3.398ms 217.0us 8
bonsaidb-quic 620.4us 311.6us 9.451ms 533.9us 11
bonsaidb-ws 500.8us 242.5us 8.672ms 563.5us 5
postgresql 2.800ms 1.050ms 17.62ms 1.575ms 13
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1436 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 411.6us 141.0us 6.927ms 271.3us 14
bonsaidb-local+lz4 447.2us 137.8us 2.948ms 233.3us 21
bonsaidb-quic 1.082ms 572.0us 9.889ms 547.6us 21
bonsaidb-ws 808.6us 413.4us 6.806ms 356.6us 19
postgresql 2.770ms 1.062ms 30.60ms 1.809ms 22
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 177 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 694.6us 333.0us 3.325ms 289.0us 2
bonsaidb-local+lz4 737.1us 300.5us 3.272ms 314.0us 2
bonsaidb-quic 1.770ms 1.021ms 14.02ms 1.272ms 4
bonsaidb-ws 1.234ms 805.2us 3.091ms 318.1us 3
postgresql 3.145ms 1.164ms 14.77ms 1.635ms 5
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 95 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 789.3us 455.7us 2.953ms 330.8us 2
bonsaidb-local+lz4 884.7us 489.9us 5.163ms 510.3us 1
bonsaidb-quic 1.647ms 964.7us 14.59ms 1.461ms 1
bonsaidb-ws 1.166ms 830.3us 3.651ms 406.7us 3
postgresql 6.871ms 3.825ms 18.43ms 2.682ms 3