BonsaiDb Commerce Benchmark

large, readheavy, 2 agent(s)

Configuration

Initial Data Set
Type Count
Products 5000
Categories 100
Customers 5000
Orders 5000
Shopping Plans

This run executed 1000 shopping plans across 2 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2719
FindProduct 2738
CreateCart 390
AddProductToCart 539
Checkout 34
RateProduct 3

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 1.510s 755.0ms None
bonsaidb-local+lz4 1.562s 781.1ms TCP
bonsaidb-quic 3.988s 1.994s UDP with TLS
bonsaidb-ws 3.067s 1.533s TCP
postgresql 50.46s 25.23s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 464.3ms 464.3ms 464.3ms 0s 0
bonsaidb-local+lz4 488.5ms 488.5ms 488.5ms 0s 0
bonsaidb-quic 572.0ms 572.0ms 572.0ms 0s 0
bonsaidb-ws 545.6ms 545.6ms 545.6ms 0s 0
postgresql 42.67s 42.67s 42.67s 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2719 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 98.75us 30.20us 3.799ms 172.3us 18
bonsaidb-local+lz4 92.91us 31.50us 4.444ms 125.9us 15
bonsaidb-quic 485.3us 314.4us 4.928ms 248.4us 30
bonsaidb-ws 331.5us 220.2us 7.674ms 194.1us 25
postgresql 1.021ms 448.0us 28.52ms 926.2us 23
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2738 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 173.1us 49.50us 5.911ms 245.3us 24
bonsaidb-local+lz4 178.5us 53.60us 9.649ms 286.7us 15
bonsaidb-quic 551.4us 364.5us 3.867ms 205.3us 38
bonsaidb-ws 414.3us 256.1us 7.941ms 254.1us 27
postgresql 1.095ms 464.3us 21.64ms 910.0us 30
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 390 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 203.7us 92.90us 4.120ms 248.5us 3
bonsaidb-local+lz4 246.8us 112.0us 10.19ms 599.1us 4
bonsaidb-quic 387.2us 251.3us 2.667ms 163.4us 5
bonsaidb-ws 327.3us 200.8us 4.487ms 280.7us 6
postgresql 2.098ms 978.5us 22.15ms 1.674ms 7
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 539 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 277.0us 119.4us 4.527ms 318.6us 9
bonsaidb-local+lz4 280.6us 143.6us 3.813ms 278.2us 8
bonsaidb-quic 646.1us 441.9us 4.337ms 266.7us 11
bonsaidb-ws 523.9us 347.7us 7.579ms 368.6us 3
postgresql 2.028ms 954.3us 12.30ms 1.483ms 18
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 34 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 513.3us 238.3us 2.772ms 494.2us 2
bonsaidb-local+lz4 446.1us 311.4us 689.6us 97.77us 0
bonsaidb-quic 1.073ms 805.8us 2.087ms 255.2us 1
bonsaidb-ws 826.1us 595.7us 1.874ms 243.1us 1
postgresql 2.333ms 1.416ms 6.969ms 1.100ms 1
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 3 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 18.98ms 723.6us 55.45ms 25.79ms 0
bonsaidb-local+lz4 23.19ms 870.7us 67.73ms 31.49ms 0
bonsaidb-quic 16.98ms 992.1us 48.95ms 22.61ms 0
bonsaidb-ws 15.78ms 981.6us 44.96ms 20.63ms 0
postgresql 6.111ms 5.626ms 6.366ms 343.3us 0