BonsaiDb Commerce Benchmark

small, balanced, 8 agent(s)

Configuration

Initial Data Set
Type Count
Products 100
Categories 10
Customers 100
Orders 125
Shopping Plans

This run executed 1000 shopping plans across 8 worker(s). All total, the workers will execute the following breakdown of operations:

Operation Invocations
Load 1
LookupProduct 2757
FindProduct 2863
CreateCart 706
AddProductToCart 1432
Checkout 177
RateProduct 96

Summary

Backend Total Time Wall Time Transport
bonsaidb-local 16.34s 2.043s None
bonsaidb-local+lz4 16.53s 2.066s TCP
bonsaidb-quic 18.58s 2.323s UDP with TLS
bonsaidb-ws 17.89s 2.237s TCP
postgresql 10.14s 1.268s TCP
Table of Contents:

Operation Results

Load

Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.

This operation was executed 1 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 30.33ms 30.33ms 30.33ms 0s 0
bonsaidb-local+lz4 31.19ms 31.19ms 31.19ms 0s 0
bonsaidb-quic 34.25ms 34.25ms 34.25ms 0s 0
bonsaidb-ws 33.28ms 33.28ms 33.28ms 0s 0
postgresql 287.4ms 287.4ms 287.4ms 0s 0
LookupProduct

Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.

This operation was executed 2757 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 101.7us 46.57us 1.924ms 57.93us 6
bonsaidb-local+lz4 103.3us 43.62us 2.278ms 72.41us 3
bonsaidb-quic 608.8us 363.2us 8.041ms 267.3us 5
bonsaidb-ws 442.5us 276.7us 3.410ms 119.2us 13
postgresql 946.8us 285.4us 19.48ms 737.8us 27
FindProduct

Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.

This operation was executed 2863 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 180.5us 76.26us 1.876ms 75.47us 6
bonsaidb-local+lz4 182.4us 68.98us 2.523ms 95.57us 5
bonsaidb-quic 970.9us 608.5us 7.856ms 330.6us 14
bonsaidb-ws 712.9us 476.3us 3.206ms 155.4us 26
postgresql 1.012ms 277.9us 27.72ms 938.8us 15
CreateCart

Measures the time spent creating a shopping cart.

This operation was executed 706 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 5.573ms 1.057ms 13.55ms 1.212ms 14
bonsaidb-local+lz4 5.736ms 1.037ms 11.57ms 1.322ms 17
bonsaidb-quic 4.910ms 1.208ms 28.00ms 1.918ms 3
bonsaidb-ws 5.140ms 1.631ms 16.55ms 1.400ms 4
postgresql 1.719ms 801.1us 29.48ms 1.165ms 3
AddProductToCart

Measures the time spent adding a product to a shopping cart.

This operation was executed 1432 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 6.022ms 678.7us 14.35ms 1.226ms 26
bonsaidb-local+lz4 6.086ms 717.3us 12.30ms 1.184ms 31
bonsaidb-quic 5.543ms 1.172ms 29.03ms 1.676ms 6
bonsaidb-ws 5.721ms 1.253ms 17.07ms 1.410ms 9
postgresql 1.615ms 540.9us 6.035ms 482.6us 15
Checkout

Measures the time spent converting a shopping cart into an order for a customer.

This operation was executed 177 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 11.05ms 1.549ms 19.13ms 2.342ms 5
bonsaidb-local+lz4 11.00ms 1.831ms 17.63ms 2.261ms 1
bonsaidb-quic 10.10ms 2.941ms 16.67ms 2.042ms 2
bonsaidb-ws 10.50ms 1.867ms 16.04ms 2.074ms 1
postgresql 2.521ms 847.6us 7.305ms 753.4us 4
RateProduct

Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.

This operation was executed 96 time(s) across each backend.

Backend Avg Min Max StdDev Outliers
bonsaidb-local 10.44ms 1.981ms 19.64ms 2.108ms 2
bonsaidb-local+lz4 10.18ms 1.811ms 13.90ms 1.837ms 1
bonsaidb-quic 9.336ms 3.289ms 33.96ms 3.133ms 1
bonsaidb-ws 9.577ms 2.614ms 14.92ms 2.079ms 1
postgresql 3.918ms 1.555ms 6.068ms 722.5us 1