BonsaiDb Commerce Benchmark

medium, writeheavy, 1 agent(s)

Configuration

Initial Data Set
Type Count
Products 1000
Categories 50
Customers 1000
Orders 1500
Shopping Plans

This run executed 1000 shopping plans across 1 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2721
FindProduct 2728
CreateCart 994
AddProductToCart 4913
Checkout 887
RateProduct 3929

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 5.785s 5.785s None
bonsaidb-local+lz4 5.780s 5.780s TCP
bonsaidb-quic 12.35s 12.35s UDP with TLS
bonsaidb-ws 10.80s 10.80s TCP
postgresql 44.56s 44.56s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 102.9ms 102.9ms 102.9ms 0s 0
bonsaidb-local+lz4 112.6ms 112.6ms 112.6ms 0s 0
bonsaidb-quic 120.7ms 120.7ms 120.7ms 0s 0
bonsaidb-ws 111.1ms 111.1ms 111.1ms 0s 0
postgresql 6.903s 6.903s 6.903s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2721 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 106.7us 47.20us 4.480ms 148.5us 14
bonsaidb-local+lz4 114.3us 49.80us 3.606ms 107.9us 21
bonsaidb-quic 474.9us 339.9us 17.24ms 415.5us 18
bonsaidb-ws 410.5us 261.9us 4.879ms 185.5us 35
postgresql 1.026ms 421.3us 12.64ms 750.4us 40
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2728 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 238.3us 80.10us 8.922ms 293.7us 19
bonsaidb-local+lz4 240.4us 93.40us 4.940ms 169.8us 28
bonsaidb-quic 654.0us 430.1us 10.15ms 425.7us 31
bonsaidb-ws 566.5us 309.0us 6.172ms 297.3us 39
postgresql 1.154ms 455.5us 22.96ms 796.1us 34
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 994 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 208.5us 104.9us 7.416ms 348.8us 6
bonsaidb-local+lz4 194.5us 131.8us 3.783ms 140.0us 9
bonsaidb-quic 412.1us 273.1us 6.330ms 354.7us 8
bonsaidb-ws 369.6us 226.8us 7.548ms 391.4us 5
postgresql 1.477ms 947.9us 25.15ms 1.237ms 19
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 4913 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 255.5us 121.8us 8.277ms 300.4us 37
bonsaidb-local+lz4 262.7us 160.8us 7.565ms 215.5us 50
bonsaidb-quic 659.7us 475.2us 9.174ms 359.2us 78
bonsaidb-ws 583.1us 347.6us 11.33ms 345.5us 55
postgresql 1.360ms 877.9us 31.16ms 1.041ms 94
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 887 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 448.9us 205.3us 8.384ms 417.8us 12
bonsaidb-local+lz4 431.0us 293.2us 5.979ms 268.6us 6
bonsaidb-quic 1.059ms 814.3us 8.539ms 528.2us 12
bonsaidb-ws 919.6us 584.2us 7.244ms 382.1us 12
postgresql 1.588ms 924.1us 16.68ms 923.3us 13
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3929 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 733.1us 406.3us 21.60ms 802.0us 40
bonsaidb-local+lz4 721.4us 482.9us 23.09ms 551.4us 33
bonsaidb-quic 1.162ms 783.5us 22.94ms 718.3us 49
bonsaidb-ws 1.013ms 671.3us 22.32ms 683.2us 29
postgresql 5.640ms 3.139ms 119.2ms 4.054ms 33