add rely-sqlite to benchmark

2025-11-20 20:55:37 +00:00
parent 00a6a78a41
commit 55add34ac1
54 changed files with 5519 additions and 4442 deletions
--- a/cmd/benchmark/reports/run_20251120_160925/khatru-badger_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/khatru-badger_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_khatru-badger_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763655776959677ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763655776959730ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763655776959750ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763655776959756ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763655776959766ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763655776959781ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763655776959786ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763655776959799ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763655776959805ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:22:56 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:22:56 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.557122297s
+Events/sec: 14056.31
+Avg latency: 1.628852ms
+P90 latency: 2.412548ms
+P95 latency: 2.884718ms
+P99 latency: 4.67527ms
+Bottom 10% Avg latency: 792.955µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 405.911535ms
+Burst completed: 5000 events in 380.53618ms
+Burst completed: 5000 events in 280.754351ms
+Burst completed: 5000 events in 297.565192ms
+Burst completed: 5000 events in 302.520216ms
+Burst completed: 5000 events in 350.323686ms
+Burst completed: 5000 events in 371.767707ms
+Burst completed: 5000 events in 285.38171ms
+Burst completed: 5000 events in 274.748193ms
+Burst completed: 5000 events in 271.260586ms
+Burst test completed: 50000 events in 8.226487654s, errors: 0
+Events/sec: 6077.93
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.533132193s
+Combined ops/sec: 2038.06
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 394302 queries in 1m0.00447925s
+Queries/sec: 6571.21
+Avg query latency: 1.70837ms
+P95 query latency: 6.773469ms
+P99 query latency: 10.899944ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 317462 operations (267462 queries, 50000 writes) in 1m0.00322203s
+Operations/sec: 5290.75
+Avg latency: 1.435958ms
+Avg query latency: 1.421544ms
+Avg write latency: 1.513062ms
+P95 latency: 3.617935ms
+P99 latency: 5.869627ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.557122297s
+Total Events: 50000
+Events/sec: 14056.31
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 156 MB
+Avg Latency: 1.628852ms
+P90 Latency: 2.412548ms
+P95 Latency: 2.884718ms
+P99 Latency: 4.67527ms
+Bottom 10% Avg Latency: 792.955µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.226487654s
+Total Events: 50000
+Events/sec: 6077.93
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 205 MB
+Avg Latency: 1.310069ms
+P90 Latency: 2.055438ms
+P95 Latency: 2.49215ms
+P99 Latency: 4.005986ms
+Bottom 10% Avg Latency: 461.037µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.533132193s
+Total Events: 50000
+Events/sec: 2038.06
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 199 MB
+Avg Latency: 388.704µs
+P90 Latency: 808.702µs
+P95 Latency: 904.254µs
+P99 Latency: 1.136966ms
+Bottom 10% Avg Latency: 1.056324ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.00447925s
+Total Events: 394302
+Events/sec: 6571.21
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 115 MB
+Avg Latency: 1.70837ms
+P90 Latency: 5.078238ms
+P95 Latency: 6.773469ms
+P99 Latency: 10.899944ms
+Bottom 10% Avg Latency: 7.587998ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.00322203s
+Total Events: 317462
+Events/sec: 5290.75
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 123 MB
+Avg Latency: 1.435958ms
+P90 Latency: 2.91748ms
+P95 Latency: 3.617935ms
+P99 Latency: 5.869627ms
+Bottom 10% Avg Latency: 4.184418ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_khatru-badger_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_khatru-badger_8/benchmark_report.adoc
+
+RELAY_NAME: khatru-badger
+RELAY_URL: ws://khatru-badger:3334
+TEST_TIMESTAMP: 2025-11-20T16:26:15+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/khatru-sqlite_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/khatru-sqlite_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_khatru-sqlite_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763655574035860ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763655574035914ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763655574035943ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763655574035949ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763655574035958ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763655574035975ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763655574035982ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763655574035992ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763655574035997ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:19:34 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:19:34 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.232222717s
+Events/sec: 15469.23
+Avg latency: 1.469007ms
+P90 latency: 2.035701ms
+P95 latency: 2.349899ms
+P99 latency: 3.271326ms
+Bottom 10% Avg latency: 801.936µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 299.732401ms
+Burst completed: 5000 events in 329.942997ms
+Burst completed: 5000 events in 277.351209ms
+Burst completed: 5000 events in 317.930408ms
+Burst completed: 5000 events in 273.472906ms
+Burst completed: 5000 events in 337.06975ms
+Burst completed: 5000 events in 340.407772ms
+Burst completed: 5000 events in 358.760144ms
+Burst completed: 5000 events in 309.592493ms
+Burst completed: 5000 events in 273.260581ms
+Burst test completed: 50000 events in 8.125781511s, errors: 0
+Events/sec: 6153.25
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.566923076s
+Combined ops/sec: 2035.26
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 402485 queries in 1m0.004783968s
+Queries/sec: 6707.55
+Avg query latency: 1.665358ms
+P95 query latency: 6.573038ms
+P99 query latency: 10.409271ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 311988 operations (261988 queries, 50000 writes) in 1m0.003852034s
+Operations/sec: 5199.47
+Avg latency: 1.508403ms
+Avg query latency: 1.478354ms
+Avg write latency: 1.665855ms
+P95 latency: 3.826874ms
+P99 latency: 6.740607ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.232222717s
+Total Events: 50000
+Events/sec: 15469.23
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 101 MB
+Avg Latency: 1.469007ms
+P90 Latency: 2.035701ms
+P95 Latency: 2.349899ms
+P99 Latency: 3.271326ms
+Bottom 10% Avg Latency: 801.936µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.125781511s
+Total Events: 50000
+Events/sec: 6153.25
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 253 MB
+Avg Latency: 1.339912ms
+P90 Latency: 1.931472ms
+P95 Latency: 2.248376ms
+P99 Latency: 3.415521ms
+Bottom 10% Avg Latency: 558.036µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.566923076s
+Total Events: 50000
+Events/sec: 2035.26
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 183 MB
+Avg Latency: 387.89µs
+P90 Latency: 800.235µs
+P95 Latency: 893.473µs
+P99 Latency: 1.116417ms
+Bottom 10% Avg Latency: 1.061513ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.004783968s
+Total Events: 402485
+Events/sec: 6707.55
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 122 MB
+Avg Latency: 1.665358ms
+P90 Latency: 4.967519ms
+P95 Latency: 6.573038ms
+P99 Latency: 10.409271ms
+Bottom 10% Avg Latency: 7.318028ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.003852034s
+Total Events: 311988
+Events/sec: 5199.47
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 123 MB
+Avg Latency: 1.508403ms
+P90 Latency: 3.026719ms
+P95 Latency: 3.826874ms
+P99 Latency: 6.740607ms
+Bottom 10% Avg Latency: 4.581461ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.adoc
+
+RELAY_NAME: khatru-sqlite
+RELAY_URL: ws://khatru-sqlite:3334
+TEST_TIMESTAMP: 2025-11-20T16:22:51+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/next-orly-badger_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/next-orly-badger_results.txt
@@ -0,0 +1,195 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_next-orly-badger_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763654965967981ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763654965968059ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763654965968086ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763654965968093ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763654965968104ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763654965968128ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763654965968134ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763654965968148ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763654965968155ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:09:25 INFO: Extracted embedded libsecp256k1 to /tmp/orly-libsecp256k1/libsecp256k1.so
+2025/11/20 16:09:25 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:09:25 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 2.86284713s
+Events/sec: 17465.13
+Avg latency: 1.240021ms
+P90 latency: 1.632975ms
+P95 latency: 1.88702ms
+P99 latency: 2.588648ms
+Bottom 10% Avg latency: 720.664µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 283.916078ms
+Burst completed: 5000 events in 308.835391ms
+Burst completed: 5000 events in 271.738649ms
+Burst completed: 5000 events in 294.190093ms
+Burst completed: 5000 events in 270.874739ms
+Burst completed: 5000 events in 353.277008ms
+Burst completed: 5000 events in 291.31675ms
+Burst completed: 5000 events in 260.143176ms
+Burst completed: 5000 events in 278.682529ms
+Burst completed: 5000 events in 270.618556ms
+Burst test completed: 50000 events in 7.890214694s, errors: 0
+Events/sec: 6336.96
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.398091289s
+Combined ops/sec: 2049.34
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 375020 queries in 1m0.004407142s
+Queries/sec: 6249.87
+Avg query latency: 1.807546ms
+P95 query latency: 7.404502ms
+P99 query latency: 12.127148ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 310651 operations (260651 queries, 50000 writes) in 1m0.003771057s
+Operations/sec: 5177.19
+Avg latency: 1.509233ms
+Avg query latency: 1.487291ms
+Avg write latency: 1.623615ms
+P95 latency: 3.906611ms
+P99 latency: 6.304613ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 2.86284713s
+Total Events: 50000
+Events/sec: 17465.13
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 164 MB
+Avg Latency: 1.240021ms
+P90 Latency: 1.632975ms
+P95 Latency: 1.88702ms
+P99 Latency: 2.588648ms
+Bottom 10% Avg Latency: 720.664µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 7.890214694s
+Total Events: 50000
+Events/sec: 6336.96
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 170 MB
+Avg Latency: 1.17176ms
+P90 Latency: 1.637524ms
+P95 Latency: 1.909102ms
+P99 Latency: 2.743443ms
+Bottom 10% Avg Latency: 504.67µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.398091289s
+Total Events: 50000
+Events/sec: 2049.34
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 114 MB
+Avg Latency: 363.633µs
+P90 Latency: 765.71µs
+P95 Latency: 855.742µs
+P99 Latency: 1.047598ms
+Bottom 10% Avg Latency: 974.416µs
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.004407142s
+Total Events: 375020
+Events/sec: 6249.87
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 133 MB
+Avg Latency: 1.807546ms
+P90 Latency: 5.438031ms
+P95 Latency: 7.404502ms
+P99 Latency: 12.127148ms
+Bottom 10% Avg Latency: 8.375567ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.003771057s
+Total Events: 310651
+Events/sec: 5177.19
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 127 MB
+Avg Latency: 1.509233ms
+P90 Latency: 3.084923ms
+P95 Latency: 3.906611ms
+P99 Latency: 6.304613ms
+Bottom 10% Avg Latency: 4.476784ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_next-orly-badger_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_next-orly-badger_8/benchmark_report.adoc
+
+RELAY_NAME: next-orly-badger
+RELAY_URL: ws://next-orly-badger:8080
+TEST_TIMESTAMP: 2025-11-20T16:12:43+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/next-orly-dgraph_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/next-orly-dgraph_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_next-orly-dgraph_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763655168222493ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763655168222619ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763655168222661ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763655168222668ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763655168222679ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763655168222696ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763655168222702ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763655168222720ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763655168222727ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:12:48 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:12:48 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.077632558s
+Events/sec: 16246.25
+Avg latency: 1.364467ms
+P90 latency: 1.883291ms
+P95 latency: 2.256624ms
+P99 latency: 3.300984ms
+Bottom 10% Avg latency: 745.8µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 289.470058ms
+Burst completed: 5000 events in 331.754037ms
+Burst completed: 5000 events in 300.084597ms
+Burst completed: 5000 events in 307.645494ms
+Burst completed: 5000 events in 438.270616ms
+Burst completed: 5000 events in 438.889425ms
+Burst completed: 5000 events in 312.922304ms
+Burst completed: 5000 events in 276.60434ms
+Burst completed: 5000 events in 415.149503ms
+Burst completed: 5000 events in 287.798655ms
+Burst test completed: 50000 events in 8.404871327s, errors: 0
+Events/sec: 5948.93
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.600967028s
+Combined ops/sec: 2032.44
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 356380 queries in 1m0.003804202s
+Queries/sec: 5939.29
+Avg query latency: 1.921866ms
+P95 query latency: 7.932755ms
+P99 query latency: 13.087413ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 313316 operations (263316 queries, 50000 writes) in 1m0.002399217s
+Operations/sec: 5221.72
+Avg latency: 1.496966ms
+Avg query latency: 1.470501ms
+Avg write latency: 1.636338ms
+P95 latency: 3.78214ms
+P99 latency: 6.576619ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.077632558s
+Total Events: 50000
+Events/sec: 16246.25
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 101 MB
+Avg Latency: 1.364467ms
+P90 Latency: 1.883291ms
+P95 Latency: 2.256624ms
+P99 Latency: 3.300984ms
+Bottom 10% Avg Latency: 745.8µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.404871327s
+Total Events: 50000
+Events/sec: 5948.93
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 178 MB
+Avg Latency: 1.479051ms
+P90 Latency: 2.357616ms
+P95 Latency: 2.873991ms
+P99 Latency: 4.41552ms
+Bottom 10% Avg Latency: 536.061µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.600967028s
+Total Events: 50000
+Events/sec: 2032.44
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 183 MB
+Avg Latency: 400.294µs
+P90 Latency: 824.673µs
+P95 Latency: 918.06µs
+P99 Latency: 1.128421ms
+Bottom 10% Avg Latency: 1.06369ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.003804202s
+Total Events: 356380
+Events/sec: 5939.29
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 124 MB
+Avg Latency: 1.921866ms
+P90 Latency: 5.832521ms
+P95 Latency: 7.932755ms
+P99 Latency: 13.087413ms
+Bottom 10% Avg Latency: 9.018017ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.002399217s
+Total Events: 313316
+Events/sec: 5221.72
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 143 MB
+Avg Latency: 1.496966ms
+P90 Latency: 3.008265ms
+P95 Latency: 3.78214ms
+P99 Latency: 6.576619ms
+Bottom 10% Avg Latency: 4.546974ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_next-orly-dgraph_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_next-orly-dgraph_8/benchmark_report.adoc
+
+RELAY_NAME: next-orly-dgraph
+RELAY_URL: ws://next-orly-dgraph:8080
+TEST_TIMESTAMP: 2025-11-20T16:16:06+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/next-orly-neo4j_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/next-orly-neo4j_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_next-orly-neo4j_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763655371282183ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763655371282260ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763655371282294ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763655371282304ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763655371282313ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763655371282328ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763655371282332ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763655371282347ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763655371282352ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:16:11 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:16:11 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.322036094s
+Events/sec: 15051.01
+Avg latency: 1.501127ms
+P90 latency: 2.132576ms
+P95 latency: 2.573527ms
+P99 latency: 4.7262ms
+Bottom 10% Avg latency: 773.812µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 297.948317ms
+Burst completed: 5000 events in 318.841207ms
+Burst completed: 5000 events in 280.549165ms
+Burst completed: 5000 events in 306.213632ms
+Burst completed: 5000 events in 296.343565ms
+Burst completed: 5000 events in 344.885086ms
+Burst completed: 5000 events in 302.324928ms
+Burst completed: 5000 events in 275.70635ms
+Burst completed: 5000 events in 291.656138ms
+Burst completed: 5000 events in 279.144014ms
+Burst test completed: 50000 events in 8.000273258s, errors: 0
+Events/sec: 6249.79
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.493058795s
+Combined ops/sec: 2041.39
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 379691 queries in 1m0.00424271s
+Queries/sec: 6327.74
+Avg query latency: 1.786907ms
+P95 query latency: 7.280158ms
+P99 query latency: 11.561961ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 307993 operations (257993 queries, 50000 writes) in 1m0.003271216s
+Operations/sec: 5132.94
+Avg latency: 1.52949ms
+Avg query latency: 1.502605ms
+Avg write latency: 1.668216ms
+P95 latency: 3.920904ms
+P99 latency: 6.58322ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.322036094s
+Total Events: 50000
+Events/sec: 15051.01
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 169 MB
+Avg Latency: 1.501127ms
+P90 Latency: 2.132576ms
+P95 Latency: 2.573527ms
+P99 Latency: 4.7262ms
+Bottom 10% Avg Latency: 773.812µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.000273258s
+Total Events: 50000
+Events/sec: 6249.79
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 175 MB
+Avg Latency: 1.219984ms
+P90 Latency: 1.785173ms
+P95 Latency: 2.089965ms
+P99 Latency: 2.950085ms
+Bottom 10% Avg Latency: 487.01µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.493058795s
+Total Events: 50000
+Events/sec: 2041.39
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 216 MB
+Avg Latency: 380.334µs
+P90 Latency: 796.668µs
+P95 Latency: 892.09µs
+P99 Latency: 1.120225ms
+Bottom 10% Avg Latency: 1.010816ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.00424271s
+Total Events: 379691
+Events/sec: 6327.74
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 112 MB
+Avg Latency: 1.786907ms
+P90 Latency: 5.418278ms
+P95 Latency: 7.280158ms
+P99 Latency: 11.561961ms
+Bottom 10% Avg Latency: 8.118513ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.003271216s
+Total Events: 307993
+Events/sec: 5132.94
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 92 MB
+Avg Latency: 1.52949ms
+P90 Latency: 3.119146ms
+P95 Latency: 3.920904ms
+P99 Latency: 6.58322ms
+Bottom 10% Avg Latency: 4.575079ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_next-orly-neo4j_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_next-orly-neo4j_8/benchmark_report.adoc
+
+RELAY_NAME: next-orly-neo4j
+RELAY_URL: ws://next-orly-neo4j:8080
+TEST_TIMESTAMP: 2025-11-20T16:19:28+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/nostr-rs-relay_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/nostr-rs-relay_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_nostr-rs-relay_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763656386931745ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763656386931817ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763656386931845ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763656386931852ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763656386931865ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763656386931881ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763656386931888ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763656386931904ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763656386931912ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:33:06 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:33:06 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.042476532s
+Events/sec: 16433.98
+Avg latency: 1.35254ms
+P90 latency: 1.869292ms
+P95 latency: 2.195555ms
+P99 latency: 3.118533ms
+Bottom 10% Avg latency: 756.615µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 279.583533ms
+Burst completed: 5000 events in 302.418629ms
+Burst completed: 5000 events in 282.144904ms
+Burst completed: 5000 events in 312.16919ms
+Burst completed: 5000 events in 282.829388ms
+Burst completed: 5000 events in 377.502102ms
+Burst completed: 5000 events in 331.038047ms
+Burst completed: 5000 events in 272.690016ms
+Burst completed: 5000 events in 289.250685ms
+Burst completed: 5000 events in 304.392921ms
+Burst test completed: 50000 events in 8.03944091s, errors: 0
+Events/sec: 6219.34
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.582126193s
+Combined ops/sec: 2034.00
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 374420 queries in 1m0.004508333s
+Queries/sec: 6239.86
+Avg query latency: 1.807473ms
+P95 query latency: 7.370553ms
+P99 query latency: 11.712034ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 305067 operations (255067 queries, 50000 writes) in 1m0.003563304s
+Operations/sec: 5084.15
+Avg latency: 1.548146ms
+Avg query latency: 1.529466ms
+Avg write latency: 1.643441ms
+P95 latency: 4.045539ms
+P99 latency: 6.60567ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.042476532s
+Total Events: 50000
+Events/sec: 16433.98
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 160 MB
+Avg Latency: 1.35254ms
+P90 Latency: 1.869292ms
+P95 Latency: 2.195555ms
+P99 Latency: 3.118533ms
+Bottom 10% Avg Latency: 756.615µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.03944091s
+Total Events: 50000
+Events/sec: 6219.34
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 209 MB
+Avg Latency: 1.18202ms
+P90 Latency: 1.750716ms
+P95 Latency: 2.092537ms
+P99 Latency: 3.047477ms
+Bottom 10% Avg Latency: 434.92µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.582126193s
+Total Events: 50000
+Events/sec: 2034.00
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 174 MB
+Avg Latency: 392.213µs
+P90 Latency: 813.45µs
+P95 Latency: 906.498µs
+P99 Latency: 1.156113ms
+Bottom 10% Avg Latency: 1.043137ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.004508333s
+Total Events: 374420
+Events/sec: 6239.86
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 156 MB
+Avg Latency: 1.807473ms
+P90 Latency: 5.506507ms
+P95 Latency: 7.370553ms
+P99 Latency: 11.712034ms
+Bottom 10% Avg Latency: 8.221454ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.003563304s
+Total Events: 305067
+Events/sec: 5084.15
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 166 MB
+Avg Latency: 1.548146ms
+P90 Latency: 3.172868ms
+P95 Latency: 4.045539ms
+P99 Latency: 6.60567ms
+Bottom 10% Avg Latency: 4.666667ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_nostr-rs-relay_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_nostr-rs-relay_8/benchmark_report.adoc
+
+RELAY_NAME: nostr-rs-relay
+RELAY_URL: ws://nostr-rs-relay:8080
+TEST_TIMESTAMP: 2025-11-20T16:36:24+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/relayer-basic_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/relayer-basic_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_relayer-basic_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763655980207009ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763655980207065ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763655980207089ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763655980207095ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763655980207103ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763655980207116ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763655980207120ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763655980207133ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763655980207139ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:26:20 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:26:20 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.140113498s
+Events/sec: 15922.99
+Avg latency: 1.417584ms
+P90 latency: 1.918927ms
+P95 latency: 2.251932ms
+P99 latency: 3.24845ms
+Bottom 10% Avg latency: 781.19µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 295.016917ms
+Burst completed: 5000 events in 302.477205ms
+Burst completed: 5000 events in 296.524079ms
+Burst completed: 5000 events in 316.859334ms
+Burst completed: 5000 events in 283.043959ms
+Burst completed: 5000 events in 599.696348ms
+Burst completed: 5000 events in 348.408531ms
+Burst completed: 5000 events in 328.489308ms
+Burst completed: 5000 events in 346.767823ms
+Burst completed: 5000 events in 266.423432ms
+Burst test completed: 50000 events in 8.390681222s, errors: 0
+Events/sec: 5958.99
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.729378008s
+Combined ops/sec: 2021.89
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 377608 queries in 1m0.004159666s
+Queries/sec: 6293.03
+Avg query latency: 1.78194ms
+P95 query latency: 7.313999ms
+P99 query latency: 11.571994ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 300761 operations (250761 queries, 50000 writes) in 1m0.003300562s
+Operations/sec: 5012.41
+Avg latency: 1.581357ms
+Avg query latency: 1.557006ms
+Avg write latency: 1.703485ms
+P95 latency: 4.198041ms
+P99 latency: 7.134837ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.140113498s
+Total Events: 50000
+Events/sec: 15922.99
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 159 MB
+Avg Latency: 1.417584ms
+P90 Latency: 1.918927ms
+P95 Latency: 2.251932ms
+P99 Latency: 3.24845ms
+Bottom 10% Avg Latency: 781.19µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.390681222s
+Total Events: 50000
+Events/sec: 5958.99
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 210 MB
+Avg Latency: 1.446634ms
+P90 Latency: 2.254246ms
+P95 Latency: 2.884237ms
+P99 Latency: 5.436852ms
+Bottom 10% Avg Latency: 520.884µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.729378008s
+Total Events: 50000
+Events/sec: 2021.89
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 204 MB
+Avg Latency: 382.367µs
+P90 Latency: 799.193µs
+P95 Latency: 904.063µs
+P99 Latency: 1.193034ms
+Bottom 10% Avg Latency: 1.047507ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.004159666s
+Total Events: 377608
+Events/sec: 6293.03
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 117 MB
+Avg Latency: 1.78194ms
+P90 Latency: 5.391074ms
+P95 Latency: 7.313999ms
+P99 Latency: 11.571994ms
+Bottom 10% Avg Latency: 8.16248ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.003300562s
+Total Events: 300761
+Events/sec: 5012.41
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 133 MB
+Avg Latency: 1.581357ms
+P90 Latency: 3.256466ms
+P95 Latency: 4.198041ms
+P99 Latency: 7.134837ms
+Bottom 10% Avg Latency: 4.912876ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_relayer-basic_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_relayer-basic_8/benchmark_report.adoc
+
+RELAY_NAME: relayer-basic
+RELAY_URL: ws://relayer-basic:7447
+TEST_TIMESTAMP: 2025-11-20T16:29:38+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s
--- a/cmd/benchmark/reports/run_20251120_160925/rely-sqlite_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/rely-sqlite_results.txt
@@ -0,0 +1,3 @@
+RELAY: rely-sqlite
+STATUS: FAILED - Relay not responding
+ERROR: Connection failed
--- a/cmd/benchmark/reports/run_20251120_160925/strfry_results.txt
+++ b/cmd/benchmark/reports/run_20251120_160925/strfry_results.txt
@@ -0,0 +1,194 @@
+Starting Nostr Relay Benchmark (Badger Backend)
+Data Directory: /tmp/benchmark_strfry_8
+Events: 50000, Workers: 24, Duration: 1m0s
+1763656183528413ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
+1763656183528497ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
+1763656183528519ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
+1763656183528525ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
+1763656183528536ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
+1763656183528550ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
+1763656183528556ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
+1763656183528578ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
+1763656183528584ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
+
+╔════════════════════════════════════════════════════════╗
+║         BADGER BACKEND BENCHMARK SUITE                 ║
+╚════════════════════════════════════════════════════════╝
+
+=== Starting Badger benchmark ===
+RunPeakThroughputTest (Badger)..
+
+=== Peak Throughput Test ===
+2025/11/20 16:29:43 WARN: Failed to load embedded library from /tmp/orly-libsecp256k1/libsecp256k1.so: Error relocating /tmp/orly-libsecp256k1/libsecp256k1.so: __fprintf_chk: symbol not found, falling back to system paths
+2025/11/20 16:29:43 INFO: Successfully loaded libsecp256k1 v5.0.0 from system path: libsecp256k1.so.2
+Events saved: 50000/50000 (100.0%), errors: 0
+Duration: 3.202996786s
+Events/sec: 15610.38
+Avg latency: 1.448999ms
+P90 latency: 2.008548ms
+P95 latency: 2.330532ms
+P99 latency: 3.434816ms
+Bottom 10% Avg latency: 777.487µs
+Wiping database between tests...
+RunBurstPatternTest (Badger)..
+
+=== Burst Pattern Test ===
+Burst completed: 5000 events in 343.057172ms
+Burst completed: 5000 events in 368.804651ms
+Burst completed: 5000 events in 421.980578ms
+Burst completed: 5000 events in 432.299904ms
+Burst completed: 5000 events in 386.556991ms
+Burst completed: 5000 events in 405.196753ms
+Burst completed: 5000 events in 321.87791ms
+Burst completed: 5000 events in 271.42499ms
+Burst completed: 5000 events in 289.817431ms
+Burst completed: 5000 events in 273.783645ms
+Burst test completed: 50000 events in 8.519189117s, errors: 0
+Events/sec: 5869.10
+Wiping database between tests...
+RunMixedReadWriteTest (Badger)..
+
+=== Mixed Read/Write Test ===
+Generating 1000 unique synthetic events (minimum 300 bytes each)...
+Generated 1000 events:
+  Average content size: 312 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database for read tests...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Mixed test completed: 25000 writes, 25000 reads in 24.676790113s
+Combined ops/sec: 2026.20
+Wiping database between tests...
+RunQueryTest (Badger)..
+
+=== Query Test ===
+Generating 10000 unique synthetic events (minimum 300 bytes each)...
+Generated 10000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 10000 events for query tests...
+Query test completed: 385413 queries in 1m0.004991772s
+Queries/sec: 6423.02
+Avg query latency: 1.750064ms
+P95 query latency: 7.022112ms
+P99 query latency: 11.130131ms
+Wiping database between tests...
+RunConcurrentQueryStoreTest (Badger)..
+
+=== Concurrent Query/Store Test ===
+Generating 5000 unique synthetic events (minimum 300 bytes each)...
+Generated 5000 events:
+  Average content size: 313 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Pre-populating database with 5000 events for concurrent query/store test...
+Generating 50000 unique synthetic events (minimum 300 bytes each)...
+Generated 50000 events:
+  Average content size: 314 bytes
+  All events are unique (incremental timestamps)
+  All events are properly signed
+
+Concurrent test completed: 304406 operations (254406 queries, 50000 writes) in 1m0.002847365s
+Operations/sec: 5073.19
+Avg latency: 1.53117ms
+Avg query latency: 1.533671ms
+Avg write latency: 1.518448ms
+P95 latency: 4.027706ms
+P99 latency: 6.601701ms
+
+=== Badger benchmark completed ===
+
+
+================================================================================
+BENCHMARK REPORT
+================================================================================
+
+Test: Peak Throughput
+Duration: 3.202996786s
+Total Events: 50000
+Events/sec: 15610.38
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 101 MB
+Avg Latency: 1.448999ms
+P90 Latency: 2.008548ms
+P95 Latency: 2.330532ms
+P99 Latency: 3.434816ms
+Bottom 10% Avg Latency: 777.487µs
+----------------------------------------
+
+Test: Burst Pattern
+Duration: 8.519189117s
+Total Events: 50000
+Events/sec: 5869.10
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 210 MB
+Avg Latency: 1.564388ms
+P90 Latency: 2.434829ms
+P95 Latency: 2.893144ms
+P99 Latency: 4.236454ms
+Bottom 10% Avg Latency: 598.315µs
+----------------------------------------
+
+Test: Mixed Read/Write
+Duration: 24.676790113s
+Total Events: 50000
+Events/sec: 2026.20
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 123 MB
+Avg Latency: 398.546µs
+P90 Latency: 824.051µs
+P95 Latency: 923.8µs
+P99 Latency: 1.195979ms
+Bottom 10% Avg Latency: 1.080906ms
+----------------------------------------
+
+Test: Query Performance
+Duration: 1m0.004991772s
+Total Events: 385413
+Events/sec: 6423.02
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 133 MB
+Avg Latency: 1.750064ms
+P90 Latency: 5.273981ms
+P95 Latency: 7.022112ms
+P99 Latency: 11.130131ms
+Bottom 10% Avg Latency: 7.835129ms
+----------------------------------------
+
+Test: Concurrent Query/Store
+Duration: 1m0.002847365s
+Total Events: 304406
+Events/sec: 5073.19
+Success Rate: 100.0%
+Concurrent Workers: 24
+Memory Used: 112 MB
+Avg Latency: 1.53117ms
+P90 Latency: 3.181282ms
+P95 Latency: 4.027706ms
+P99 Latency: 6.601701ms
+Bottom 10% Avg Latency: 4.654966ms
+----------------------------------------
+
+Report saved to: /tmp/benchmark_strfry_8/benchmark_report.txt
+AsciiDoc report saved to: /tmp/benchmark_strfry_8/benchmark_report.adoc
+
+RELAY_NAME: strfry
+RELAY_URL: ws://strfry:8080
+TEST_TIMESTAMP: 2025-11-20T16:33:01+00:00
+BENCHMARK_CONFIG:
+  Events: 50000
+  Workers: 24
+  Duration: 60s