BonsaiDb Commerce Benchmark

medium, balanced, 2 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 2 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2824
FindProduct 2760
CreateCart 723
AddProductToCart 1379
Checkout 200
RateProduct 96

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.977s 988.6ms None
bonsaidb-local+lz4 1.908s 954.1ms TCP
bonsaidb-quic 4.849s 2.424s UDP with TLS
bonsaidb-ws 4.153s 2.077s TCP
postgresql 18.13s 9.063s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 128.7ms 128.7ms 128.7ms 0s 0
bonsaidb-local+lz4 103.3ms 103.3ms 103.3ms 0s 0
bonsaidb-quic 117.8ms 117.8ms 117.8ms 0s 0
bonsaidb-ws 153.3ms 153.3ms 153.3ms 0s 0
postgresql 7.956s 7.956s 7.956s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2824 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 115.9us 30.10us 4.817ms 247.4us 15
bonsaidb-local+lz4 120.6us 35.30us 5.178ms 217.4us 19
bonsaidb-quic 510.9us 320.0us 7.874ms 247.5us 34
bonsaidb-ws 399.5us 224.0us 9.353ms 418.9us 25
postgresql 935.7us 340.8us 20.65ms 760.6us 31
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2760 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 223.1us 54.20us 5.977ms 335.7us 24
bonsaidb-local+lz4 221.0us 54.70us 8.024ms 275.1us 20
bonsaidb-quic 601.8us 362.0us 8.298ms 315.8us 26
bonsaidb-ws 509.5us 253.6us 11.30ms 546.5us 27
postgresql 1.041ms 409.0us 28.21ms 1.027ms 24
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 723 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 264.2us 95.80us 5.236ms 456.8us 11
bonsaidb-local+lz4 240.6us 86.20us 4.225ms 256.3us 8
bonsaidb-quic 429.1us 251.2us 5.061ms 340.2us 7
bonsaidb-ws 385.5us 205.8us 9.872ms 468.1us 8
postgresql 1.834ms 825.4us 17.79ms 1.122ms 8
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1379 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 342.1us 111.4us 6.171ms 531.4us 20
bonsaidb-local+lz4 339.3us 116.0us 6.988ms 428.9us 19
bonsaidb-quic 698.4us 443.9us 7.377ms 402.5us 14
bonsaidb-ws 608.6us 338.4us 10.19ms 591.0us 16
postgresql 1.789ms 896.9us 17.41ms 1.082ms 27
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 200 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 646.7us 230.5us 9.972ms 996.7us 6
bonsaidb-local+lz4 522.6us 289.1us 1.829ms 189.5us 2
bonsaidb-quic 1.099ms 777.2us 6.205ms 471.7us 2
bonsaidb-ws 1.015ms 577.9us 12.43ms 1.029ms 2
postgresql 1.896ms 1.122ms 8.335ms 786.2us 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 96 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.182ms 517.4us 20.73ms 2.273ms 1
bonsaidb-local+lz4 1.124ms 542.4us 27.96ms 2.821ms 1
bonsaidb-quic 1.400ms 803.2us 26.67ms 2.685ms 1
bonsaidb-ws 1.505ms 686.4us 22.13ms 2.485ms 2
postgresql 5.021ms 3.517ms 10.72ms 1.283ms 4