BonsaiDb Commerce Benchmark
large, readheavy, 4 agent(s)
Configuration
Initial Data Set
| Type | Count |
|---|---|
| Products | 5000 |
| Categories | 100 |
| Customers | 5000 |
| Orders | 5000 |
Shopping Plans
This run executed 1000 shopping plans across 4 worker(s). All total, the workers will execute the following breakdown of operations:
| Operation | Invocations |
|---|---|
| Load | 1 |
| LookupProduct | 2721 |
| FindProduct | 2748 |
| CreateCart | 389 |
| AddProductToCart | 538 |
| Checkout | 34 |
| RateProduct | 3 |
Summary
| Backend | Total Time | Wall Time | Transport |
|---|---|---|---|
| bonsaidb-local | 5.420s | 1.355s | None |
| bonsaidb-local+lz4 | 4.822s | 1.206s | TCP |
| bonsaidb-quic | 7.392s | 1.848s | UDP with TLS |
| bonsaidb-ws | 6.540s | 1.635s | TCP |
| postgresql | 30.48s | 7.621s | TCP |
Table of Contents:
Operation Results
Load
Measures the time spent loading the initial data set and performing any pre-cache operations that most database administrators would perform on their databases periodically to ensure good performance.
This operation was executed 1 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 1.321s | 1.321s | 1.321s | 0s | 0 |
| bonsaidb-local+lz4 | 1.354s | 1.354s | 1.354s | 0s | 0 |
| bonsaidb-quic | 1.422s | 1.422s | 1.422s | 0s | 0 |
| bonsaidb-ws | 1.390s | 1.390s | 1.390s | 0s | 0 |
| postgresql | 25.70s | 25.70s | 25.70s | 0s | 0 |
LookupProduct
Meaures the time spent looking up a product by its id. This operation is meant to simulate the basic needs of the database to provide a product details page after a user clicked a direct link that contians the product's unique id, including the product's current rating.
This operation was executed 2721 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 113.1us | 51.85us | 2.494ms | 50.64us | 4 |
| bonsaidb-local+lz4 | 114.9us | 50.36us | 2.596ms | 52.40us | 3 |
| bonsaidb-quic | 558.0us | 379.8us | 6.522ms | 136.7us | 3 |
| bonsaidb-ws | 427.0us | 285.7us | 5.005ms | 104.8us | 7 |
| postgresql | 640.0us | 301.5us | 12.98ms | 372.5us | 9 |
FindProduct
Measures the time spent looking up a product by its name (exact match, indexed). This operation is meant to simulate the basic needs of the database to provide a product details after finding a product by its name, including the product's current rating.
This operation was executed 2748 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 192.5us | 86.14us | 2.541ms | 91.32us | 7 |
| bonsaidb-local+lz4 | 202.1us | 85.15us | 2.565ms | 88.52us | 9 |
| bonsaidb-quic | 885.3us | 604.5us | 6.872ms | 222.5us | 8 |
| bonsaidb-ws | 683.4us | 439.0us | 5.194ms | 165.0us | 10 |
| postgresql | 715.8us | 367.7us | 12.83ms | 449.5us | 9 |
CreateCart
Measures the time spent creating a shopping cart.
This operation was executed 389 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 3.119ms | 797.2us | 20.65ms | 2.174ms | 8 |
| bonsaidb-local+lz4 | 2.415ms | 787.8us | 14.27ms | 1.318ms | 7 |
| bonsaidb-quic | 1.817ms | 948.4us | 11.53ms | 960.3us | 4 |
| bonsaidb-ws | 1.918ms | 909.4us | 13.94ms | 1.185ms | 4 |
| postgresql | 1.076ms | 629.9us | 4.413ms | 279.7us | 3 |
AddProductToCart
Measures the time spent adding a product to a shopping cart.
This operation was executed 538 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 3.408ms | 964.1us | 10.23ms | 1.119ms | 5 |
| bonsaidb-local+lz4 | 2.765ms | 809.9us | 15.40ms | 1.379ms | 7 |
| bonsaidb-quic | 2.163ms | 1.251ms | 5.033ms | 672.7us | 7 |
| bonsaidb-ws | 2.243ms | 1.115ms | 12.89ms | 1.011ms | 6 |
| postgresql | 1.073ms | 609.5us | 5.244ms | 401.6us | 6 |
Checkout
Measures the time spent converting a shopping cart into an order for a customer.
This operation was executed 34 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 5.910ms | 2.872ms | 8.950ms | 1.378ms | 0 |
| bonsaidb-local+lz4 | 4.715ms | 2.533ms | 7.770ms | 1.146ms | 0 |
| bonsaidb-quic | 4.037ms | 2.629ms | 6.743ms | 1.076ms | 0 |
| bonsaidb-ws | 4.164ms | 2.557ms | 15.00ms | 2.291ms | 1 |
| postgresql | 1.966ms | 1.379ms | 3.499ms | 486.1us | 1 |
RateProduct
Measures the time spent adding or updating a review of a product by a customer. Each customer can only have one review per product. When this operation is complete, all subsequent calls to LookupProduct and FindProduct should reflect the new rating. This simulates an 'upsert' (insert or update) operation using a unique index.
This operation was executed 3 time(s) across each backend.
| Backend | Avg | Min | Max | StdDev | Outliers |
|---|---|---|---|---|---|
| bonsaidb-local | 4.728ms | 3.472ms | 6.836ms | 1.500ms | 0 |
| bonsaidb-local+lz4 | 4.492ms | 4.222ms | 4.843ms | 259.9us | 0 |
| bonsaidb-quic | 3.960ms | 3.838ms | 4.089ms | 102.6us | 0 |
| bonsaidb-ws | 5.161ms | 4.596ms | 5.796ms | 492.2us | 0 |
| postgresql | 4.386ms | 4.002ms | 4.594ms | 271.9us | 0 |
