BonsaiDb Commerce Benchmark

large, balanced, 8 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 8 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2731
FindProduct 2766
CreateCart 715
AddProductToCart 1350
Checkout 165
RateProduct 81

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 23.30s 2.912s None
bonsaidb-local+lz4 21.90s 2.738s TCP
bonsaidb-quic 20.83s 2.603s UDP with TLS
bonsaidb-ws 19.88s 2.485s TCP
postgresql 37.47s 4.683s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 1.316s 1.316s 1.316s 0s 0
bonsaidb-local+lz4 1.324s 1.324s 1.324s 0s 0
bonsaidb-quic 1.429s 1.429s 1.429s 0s 0
bonsaidb-ws 1.399s 1.399s 1.399s 0s 0
postgresql 25.67s 25.67s 25.67s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2731 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 117.6us 54.12us 4.002ms 130.1us 4
bonsaidb-local+lz4 117.9us 66.13us 4.135ms 133.2us 3
bonsaidb-quic 605.6us 380.3us 9.151ms 289.9us 10
bonsaidb-ws 444.3us 309.6us 5.351ms 171.2us 7
postgresql 1.238ms 369.6us 26.16ms 1.077ms 40
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2766 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 208.4us 106.1us 4.208ms 168.6us 9
bonsaidb-local+lz4 210.7us 114.3us 4.155ms 166.8us 6
bonsaidb-quic 968.2us 667.5us 9.452ms 366.7us 11
bonsaidb-ws 725.1us 490.5us 5.298ms 210.7us 12
postgresql 1.373ms 323.9us 22.62ms 1.163ms 41
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 715 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 7.993ms 1.987ms 15.61ms 1.903ms 8
bonsaidb-local+lz4 7.402ms 1.684ms 15.83ms 1.729ms 9
bonsaidb-quic 5.522ms 1.294ms 16.31ms 1.552ms 10
bonsaidb-ws 5.565ms 1.222ms 17.23ms 1.567ms 12
postgresql 1.851ms 820.4us 12.01ms 627.2us 5
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1350 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 8.535ms 1.634ms 17.01ms 1.997ms 15
bonsaidb-local+lz4 8.065ms 2.011ms 18.52ms 1.911ms 17
bonsaidb-quic 6.182ms 1.777ms 17.62ms 1.433ms 21
bonsaidb-ws 6.289ms 1.257ms 18.99ms 1.700ms 23
postgresql 1.777ms 610.4us 6.851ms 553.5us 14
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 165 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 16.05ms 8.129ms 22.71ms 3.002ms 0
bonsaidb-local+lz4 14.64ms 6.689ms 24.78ms 3.251ms 1
bonsaidb-quic 11.59ms 6.732ms 19.47ms 1.911ms 1
bonsaidb-ws 11.71ms 5.826ms 22.06ms 2.272ms 3
postgresql 2.766ms 1.247ms 6.368ms 822.3us 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 81 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 14.81ms 7.719ms 22.20ms 2.823ms 0
bonsaidb-local+lz4 13.31ms 7.523ms 18.70ms 2.443ms 0
bonsaidb-quic 10.61ms 4.019ms 15.61ms 2.049ms 1
bonsaidb-ws 10.59ms 3.893ms 18.05ms 2.071ms 2
postgresql 5.405ms 3.417ms 10.35ms 999.1us 1