BonsaiDb Commerce Benchmark

large, balanced, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2731
FindProduct 2766
CreateCart 715
AddProductToCart 1350
Checkout 165
RateProduct 81

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 5.125s 5.125s None
bonsaidb-local+lz4 4.729s 4.729s TCP
bonsaidb-quic 8.884s 8.884s UDP with TLS
bonsaidb-ws 7.305s 7.305s TCP
postgresql 29.75s 29.75s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.313s 1.313s 1.313s 0s 0
bonsaidb-local+lz4 1.364s 1.364s 1.364s 0s 0
bonsaidb-quic 1.410s 1.410s 1.410s 0s 0
bonsaidb-ws 1.402s 1.402s 1.402s 0s 0
postgresql 25.82s 25.82s 25.82s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2731 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 94.01us 68.47us 2.196ms 43.85us 8
bonsaidb-local+lz4 97.19us 68.03us 2.235ms 43.47us 5
bonsaidb-quic 489.0us 274.3us 4.887ms 90.99us 4
bonsaidb-ws 347.4us 292.3us 3.542ms 65.93us 5
postgresql 365.3us 268.9us 1.449ms 73.74us 51
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2766 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 161.0us 101.2us 933.3us 44.71us 16
bonsaidb-local+lz4 168.4us 103.3us 639.4us 33.05us 6
bonsaidb-quic 765.5us 592.0us 1.436ms 51.91us 13
bonsaidb-ws 552.9us 464.6us 1.748ms 54.35us 15
postgresql 406.4us 297.7us 1.219ms 80.96us 83
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 715 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.184ms 604.1us 5.610ms 514.2us 10
bonsaidb-local+lz4 995.2us 585.2us 13.97ms 679.5us 6
bonsaidb-quic 1.423ms 831.0us 11.76ms 624.4us 6
bonsaidb-ws 1.216ms 744.3us 6.073ms 521.9us 13
postgresql 713.0us 506.7us 5.220ms 340.8us 8
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1350 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.213ms 687.5us 8.173ms 471.7us 23
bonsaidb-local+lz4 1.046ms 614.6us 39.77ms 1.124ms 5
bonsaidb-quic 1.668ms 1.028ms 18.40ms 789.4us 12
bonsaidb-ws 1.400ms 930.4us 17.68ms 689.7us 20
postgresql 668.5us 484.1us 4.028ms 224.5us 22
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 165 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.338ms 1.524ms 6.976ms 637.5us 2
bonsaidb-local+lz4 1.974ms 1.334ms 8.551ms 693.1us 2
bonsaidb-quic 3.071ms 2.064ms 11.05ms 990.5us 3
bonsaidb-ws 2.626ms 1.874ms 18.06ms 1.306ms 1
postgresql 1.026ms 802.8us 3.606ms 268.8us 2
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 81 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 2.947ms 1.707ms 8.207ms 993.6us 1
bonsaidb-local+lz4 2.283ms 1.653ms 4.691ms 436.3us 1
bonsaidb-quic 3.026ms 2.232ms 4.423ms 505.2us 0
bonsaidb-ws 2.872ms 2.008ms 6.748ms 851.9us 4
postgresql 2.704ms 2.366ms 4.390ms 321.7us 2