fixed error comparing hex/binary in pubkey white/blacklist, complete neo4j and tests"
Some checks failed
Go / build-and-release (push) Has been cancelled
Some checks failed
Go / build-and-release (push) Has been cancelled
This commit is contained in:
257
cmd/benchmark/CPU_OPTIMIZATION.md
Normal file
257
cmd/benchmark/CPU_OPTIMIZATION.md
Normal file
@@ -0,0 +1,257 @@
|
||||
# Benchmark CPU Usage Optimization
|
||||
|
||||
This document describes the CPU optimization settings for the ORLY benchmark suite, specifically tuned for systems with limited CPU resources (6-core/12-thread and lower).
|
||||
|
||||
## Problem Statement
|
||||
|
||||
The original benchmark implementation was designed for maximum throughput testing, which caused:
|
||||
- **CPU saturation**: 95-100% sustained CPU usage across all cores
|
||||
- **System instability**: Other services unable to run alongside benchmarks
|
||||
- **Thermal throttling**: Long benchmark runs causing CPU frequency reduction
|
||||
- **Unrealistic load**: Tight loops not representative of real-world relay usage
|
||||
|
||||
## Solution: Aggressive Rate Limiting
|
||||
|
||||
The benchmark now implements multi-layered CPU usage controls:
|
||||
|
||||
### 1. Reduced Worker Concurrency
|
||||
|
||||
**Default Worker Count**: `NumCPU() / 4` (minimum 2)
|
||||
|
||||
For a 6-core/12-thread system:
|
||||
- Previous: 12 workers
|
||||
- **Current: 3 workers**
|
||||
|
||||
This 4x reduction dramatically lowers:
|
||||
- Goroutine context switching overhead
|
||||
- Lock contention on shared resources
|
||||
- CPU cache thrashing
|
||||
|
||||
### 2. Per-Operation Delays
|
||||
|
||||
All benchmark operations now include mandatory delays to prevent CPU saturation:
|
||||
|
||||
| Operation Type | Delay | Rationale |
|
||||
|---------------|-------|-----------|
|
||||
| Event writes | 500µs | Simulates network latency and client pacing |
|
||||
| Queries | 1ms | Queries are CPU-intensive, need more spacing |
|
||||
| Concurrent writes | 500µs | Balanced for mixed workloads |
|
||||
| Burst writes | 500µs | Prevents CPU spikes during bursts |
|
||||
|
||||
### 3. Implementation Locations
|
||||
|
||||
#### Main Benchmark (Badger backend)
|
||||
|
||||
**Peak Throughput Test** ([main.go:471-473](main.go#L471-L473)):
|
||||
```go
|
||||
const eventDelay = 500 * time.Microsecond
|
||||
time.Sleep(eventDelay) // After each event save
|
||||
```
|
||||
|
||||
**Burst Pattern Test** ([main.go:599-600](main.go#L599-L600)):
|
||||
```go
|
||||
const eventDelay = 500 * time.Microsecond
|
||||
time.Sleep(eventDelay) // In worker loop
|
||||
```
|
||||
|
||||
**Query Test** ([main.go:899](main.go#L899)):
|
||||
```go
|
||||
time.Sleep(1 * time.Millisecond) // After each query
|
||||
```
|
||||
|
||||
**Concurrent Query/Store** ([main.go:900, 1068](main.go#L900)):
|
||||
```go
|
||||
time.Sleep(1 * time.Millisecond) // Readers
|
||||
time.Sleep(500 * time.Microsecond) // Writers
|
||||
```
|
||||
|
||||
#### BenchmarkAdapter (DGraph/Neo4j backends)
|
||||
|
||||
**Peak Throughput** ([benchmark_adapter.go:58](benchmark_adapter.go#L58)):
|
||||
```go
|
||||
const eventDelay = 500 * time.Microsecond
|
||||
```
|
||||
|
||||
**Burst Pattern** ([benchmark_adapter.go:142](benchmark_adapter.go#L142)):
|
||||
```go
|
||||
const eventDelay = 500 * time.Microsecond
|
||||
```
|
||||
|
||||
## Expected CPU Usage
|
||||
|
||||
### Before Optimization
|
||||
- **Workers**: 12 (on 12-thread system)
|
||||
- **Delays**: None or minimal
|
||||
- **CPU Usage**: 95-100% sustained
|
||||
- **System Impact**: Severe - other processes starved
|
||||
|
||||
### After Optimization
|
||||
- **Workers**: 3 (on 12-thread system)
|
||||
- **Delays**: 500µs-1ms per operation
|
||||
- **Expected CPU Usage**: 40-60% average, 70% peak
|
||||
- **System Impact**: Minimal - plenty of headroom for other processes
|
||||
|
||||
## Performance Impact
|
||||
|
||||
### Throughput Reduction
|
||||
The aggressive rate limiting will reduce benchmark throughput:
|
||||
|
||||
**Before** (unrealistic, CPU-bound):
|
||||
- ~50,000 events/second with 12 workers
|
||||
|
||||
**After** (realistic, rate-limited):
|
||||
- ~5,000-10,000 events/second with 3 workers
|
||||
- More representative of real-world relay load
|
||||
- Network latency and client pacing simulated
|
||||
|
||||
### Latency Accuracy
|
||||
**Improved**: With lower CPU contention, latency measurements are more accurate:
|
||||
- Less queueing delay in database operations
|
||||
- More consistent response times
|
||||
- Better P95/P99 metric reliability
|
||||
|
||||
## Tuning Guide
|
||||
|
||||
If you need to adjust CPU usage further:
|
||||
|
||||
### Further Reduce CPU (< 40%)
|
||||
|
||||
1. **Reduce workers**:
|
||||
```bash
|
||||
./benchmark --workers 2 # Half of default
|
||||
```
|
||||
|
||||
2. **Increase delays** in code:
|
||||
```go
|
||||
// Change from 500µs to 1ms for writes
|
||||
const eventDelay = 1 * time.Millisecond
|
||||
|
||||
// Change from 1ms to 2ms for queries
|
||||
time.Sleep(2 * time.Millisecond)
|
||||
```
|
||||
|
||||
3. **Reduce event count**:
|
||||
```bash
|
||||
./benchmark --events 5000 # Shorter test runs
|
||||
```
|
||||
|
||||
### Increase CPU (for faster testing)
|
||||
|
||||
1. **Increase workers**:
|
||||
```bash
|
||||
./benchmark --workers 6 # More concurrency
|
||||
```
|
||||
|
||||
2. **Decrease delays** in code:
|
||||
```go
|
||||
// Change from 500µs to 100µs
|
||||
const eventDelay = 100 * time.Microsecond
|
||||
|
||||
// Change from 1ms to 500µs
|
||||
time.Sleep(500 * time.Microsecond)
|
||||
```
|
||||
|
||||
## Monitoring CPU Usage
|
||||
|
||||
### Real-time Monitoring
|
||||
|
||||
```bash
|
||||
# Terminal 1: Run benchmark
|
||||
cd cmd/benchmark
|
||||
./benchmark --workers 3 --events 10000
|
||||
|
||||
# Terminal 2: Monitor CPU
|
||||
watch -n 1 'ps aux | grep benchmark | grep -v grep | awk "{print \$3\" %CPU\"}"'
|
||||
```
|
||||
|
||||
### With htop (recommended)
|
||||
|
||||
```bash
|
||||
# Install htop if needed
|
||||
sudo apt install htop
|
||||
|
||||
# Run htop and filter for benchmark process
|
||||
htop -p $(pgrep -f benchmark)
|
||||
```
|
||||
|
||||
### System-wide CPU Usage
|
||||
|
||||
```bash
|
||||
# Check overall system load
|
||||
mpstat 1
|
||||
|
||||
# Or with sar
|
||||
sar -u 1
|
||||
```
|
||||
|
||||
## Docker Compose Considerations
|
||||
|
||||
When running the full benchmark suite in Docker Compose:
|
||||
|
||||
### Resource Limits
|
||||
|
||||
The compose file should limit CPU allocation:
|
||||
|
||||
```yaml
|
||||
services:
|
||||
benchmark-runner:
|
||||
deploy:
|
||||
resources:
|
||||
limits:
|
||||
cpus: '4' # Limit to 4 CPU cores
|
||||
```
|
||||
|
||||
### Sequential vs Parallel
|
||||
|
||||
Current implementation runs benchmarks **sequentially** to avoid overwhelming the system.
|
||||
Each relay is tested one at a time, ensuring:
|
||||
- Consistent baseline for comparisons
|
||||
- No CPU competition between tests
|
||||
- Reliable latency measurements
|
||||
|
||||
## Best Practices
|
||||
|
||||
1. **Always monitor CPU during first run** to verify settings work for your system
|
||||
2. **Close other applications** during benchmarking for consistent results
|
||||
3. **Use consistent worker counts** across test runs for fair comparisons
|
||||
4. **Document your settings** if you modify delay constants
|
||||
5. **Test with small event counts first** (--events 1000) to verify CPU usage
|
||||
|
||||
## Realistic Workload Simulation
|
||||
|
||||
The delays aren't just for CPU management - they simulate real-world conditions:
|
||||
|
||||
- **500µs write delay**: Typical network round-trip time for local clients
|
||||
- **1ms query delay**: Client thinking time between queries
|
||||
- **3 workers**: Simulates 3 concurrent users/clients
|
||||
- **Burst patterns**: Models social media posting patterns (busy hours vs quiet periods)
|
||||
|
||||
This makes benchmark results more applicable to production relay deployment planning.
|
||||
|
||||
## System Requirements
|
||||
|
||||
### Minimum
|
||||
- 4 CPU cores (2 physical cores with hyperthreading)
|
||||
- 8GB RAM
|
||||
- SSD storage for database
|
||||
|
||||
### Recommended
|
||||
- 6+ CPU cores
|
||||
- 16GB RAM
|
||||
- NVMe SSD
|
||||
|
||||
### For Full Suite (Docker Compose)
|
||||
- 8+ CPU cores (allows multiple relays + benchmark runner)
|
||||
- 32GB RAM (Neo4j, DGraph are memory-hungry)
|
||||
- Fast SSD with 100GB+ free space
|
||||
|
||||
## Conclusion
|
||||
|
||||
These aggressive CPU optimizations ensure the benchmark suite:
|
||||
- ✅ Runs reliably on modest hardware
|
||||
- ✅ Doesn't interfere with other system processes
|
||||
- ✅ Produces realistic, production-relevant metrics
|
||||
- ✅ Completes without thermal throttling
|
||||
- ✅ Allows fair comparison across different relay implementations
|
||||
|
||||
The trade-off is longer test duration, but the results are far more valuable for actual relay deployment planning.
|
||||
@@ -2,7 +2,7 @@
|
||||
|
||||
A comprehensive benchmarking system for testing and comparing the performance of multiple Nostr relay implementations, including:
|
||||
|
||||
- **next.orly.dev** (this repository) - Badger and DGraph backend variants
|
||||
- **next.orly.dev** (this repository) - Badger, DGraph, and Neo4j backend variants
|
||||
- **Khatru** - SQLite and Badger variants
|
||||
- **Relayer** - Basic example implementation
|
||||
- **Strfry** - C++ LMDB-based relay
|
||||
@@ -95,14 +95,16 @@ ls reports/run_YYYYMMDD_HHMMSS/
|
||||
| ------------------ | ---- | ----------------------------------------- |
|
||||
| next-orly-badger | 8001 | This repository's Badger relay |
|
||||
| next-orly-dgraph | 8007 | This repository's DGraph relay |
|
||||
| next-orly-neo4j | 8008 | This repository's Neo4j relay |
|
||||
| dgraph-zero | 5080 | DGraph cluster coordinator |
|
||||
| dgraph-alpha | 9080 | DGraph data node |
|
||||
| neo4j | 7474/7687 | Neo4j graph database |
|
||||
| khatru-sqlite | 8002 | Khatru with SQLite backend |
|
||||
| khatru-badger | 8003 | Khatru with Badger backend |
|
||||
| relayer-basic | 8004 | Basic relayer example |
|
||||
| strfry | 8005 | Strfry C++ LMDB relay |
|
||||
| nostr-rs-relay | 8006 | Rust SQLite relay |
|
||||
| benchmark-runner | - | Orchestrates tests and aggregates results |
|
||||
| nostr-rs-relay | 8006 | Rust SQLite relay |
|
||||
| benchmark-runner | - | Orchestrates tests and aggregates results |
|
||||
|
||||
### File Structure
|
||||
|
||||
@@ -178,7 +180,7 @@ go build -o benchmark main.go
|
||||
|
||||
## Database Backend Comparison
|
||||
|
||||
The benchmark suite includes **next.orly.dev** with two different database backends to compare architectural approaches:
|
||||
The benchmark suite includes **next.orly.dev** with three different database backends to compare architectural approaches:
|
||||
|
||||
### Badger Backend (next-orly-badger)
|
||||
- **Type**: Embedded key-value store
|
||||
@@ -200,14 +202,28 @@ The benchmark suite includes **next.orly.dev** with two different database backe
|
||||
- Built-in replication and sharding
|
||||
- More complex deployment
|
||||
|
||||
### Neo4j Backend (next-orly-neo4j)
|
||||
- **Type**: Native graph database
|
||||
- **Architecture**: Client-server with Neo4j Community Edition
|
||||
- **Best for**: Graph queries, relationship-heavy workloads, social network analysis
|
||||
- **Characteristics**:
|
||||
- Optimized for relationship traversal (e.g., follow graphs, event references)
|
||||
- Native Cypher query language for graph patterns
|
||||
- ACID transactions with graph-native storage
|
||||
- Network overhead from Bolt protocol
|
||||
- Excellent for complex graph queries (finding common connections, recommendation systems)
|
||||
- Higher memory usage for graph indexes
|
||||
- Ideal for analytics and social graph exploration
|
||||
|
||||
### Comparing the Backends
|
||||
|
||||
The benchmark results will show:
|
||||
- **Latency differences**: Embedded vs. distributed overhead
|
||||
- **Throughput trade-offs**: Single-process optimization vs. distributed scalability
|
||||
- **Latency differences**: Embedded vs. distributed overhead, graph traversal efficiency
|
||||
- **Throughput trade-offs**: Single-process optimization vs. distributed scalability vs. graph query optimization
|
||||
- **Resource usage**: Memory and CPU patterns for different architectures
|
||||
- **Query performance**: Graph queries (Neo4j) vs. key-value lookups (Badger) vs. distributed queries (DGraph)
|
||||
|
||||
This comparison helps determine which backend is appropriate for different deployment scenarios.
|
||||
This comparison helps determine which backend is appropriate for different deployment scenarios and workload patterns.
|
||||
|
||||
## Benchmark Results Interpretation
|
||||
|
||||
|
||||
@@ -18,10 +18,12 @@ import (
|
||||
|
||||
// BenchmarkAdapter adapts a database.Database interface to work with benchmark tests
|
||||
type BenchmarkAdapter struct {
|
||||
config *BenchmarkConfig
|
||||
db database.Database
|
||||
results []*BenchmarkResult
|
||||
mu sync.RWMutex
|
||||
config *BenchmarkConfig
|
||||
db database.Database
|
||||
results []*BenchmarkResult
|
||||
mu sync.RWMutex
|
||||
cachedEvents []*event.E // Cache generated events to avoid expensive re-generation
|
||||
eventCacheMu sync.Mutex
|
||||
}
|
||||
|
||||
// NewBenchmarkAdapter creates a new benchmark adapter
|
||||
@@ -53,16 +55,23 @@ func (ba *BenchmarkAdapter) RunPeakThroughputTest() {
|
||||
}
|
||||
close(eventChan)
|
||||
|
||||
// Start workers
|
||||
// Calculate per-worker rate to avoid mutex contention
|
||||
perWorkerRate := 20000.0 / float64(ba.config.ConcurrentWorkers)
|
||||
|
||||
for i := 0; i < ba.config.ConcurrentWorkers; i++ {
|
||||
wg.Add(1)
|
||||
go func(workerID int) {
|
||||
defer wg.Done()
|
||||
|
||||
// Each worker gets its own rate limiter
|
||||
workerLimiter := NewRateLimiter(perWorkerRate)
|
||||
|
||||
ctx := context.Background()
|
||||
for ev := range eventChan {
|
||||
eventStart := time.Now()
|
||||
// Wait for rate limiter to allow this event
|
||||
workerLimiter.Wait()
|
||||
|
||||
eventStart := time.Now()
|
||||
_, err := ba.db.SaveEvent(ctx, ev)
|
||||
latency := time.Since(eventStart)
|
||||
|
||||
@@ -132,6 +141,9 @@ func (ba *BenchmarkAdapter) RunBurstPatternTest() {
|
||||
burstSize := 100
|
||||
bursts := ba.config.NumEvents / burstSize
|
||||
|
||||
// Create rate limiter: cap at 20,000 events/second globally
|
||||
rateLimiter := NewRateLimiter(20000)
|
||||
|
||||
for i := 0; i < bursts; i++ {
|
||||
// Generate a burst of events
|
||||
events := ba.generateEvents(burstSize)
|
||||
@@ -142,6 +154,9 @@ func (ba *BenchmarkAdapter) RunBurstPatternTest() {
|
||||
go func(e *event.E) {
|
||||
defer wg.Done()
|
||||
|
||||
// Wait for rate limiter to allow this event
|
||||
rateLimiter.Wait()
|
||||
|
||||
eventStart := time.Now()
|
||||
_, err := ba.db.SaveEvent(ctx, e)
|
||||
latency := time.Since(eventStart)
|
||||
@@ -212,6 +227,9 @@ func (ba *BenchmarkAdapter) RunMixedReadWriteTest() {
|
||||
var mu sync.Mutex
|
||||
var wg sync.WaitGroup
|
||||
|
||||
// Create rate limiter for writes: cap at 20,000 events/second
|
||||
rateLimiter := NewRateLimiter(20000)
|
||||
|
||||
// Start workers doing mixed read/write
|
||||
for i := 0; i < ba.config.ConcurrentWorkers; i++ {
|
||||
wg.Add(1)
|
||||
@@ -235,7 +253,8 @@ func (ba *BenchmarkAdapter) RunMixedReadWriteTest() {
|
||||
readCount++
|
||||
mu.Unlock()
|
||||
} else {
|
||||
// Write operation
|
||||
// Write operation - apply rate limiting
|
||||
rateLimiter.Wait()
|
||||
_, _ = ba.db.SaveEvent(ctx, ev)
|
||||
|
||||
mu.Lock()
|
||||
@@ -401,6 +420,9 @@ func (ba *BenchmarkAdapter) RunConcurrentQueryStoreTest() {
|
||||
halfWorkers = 1
|
||||
}
|
||||
|
||||
// Create rate limiter for writes: cap at 20,000 events/second
|
||||
rateLimiter := NewRateLimiter(20000)
|
||||
|
||||
// Writers
|
||||
for i := 0; i < halfWorkers; i++ {
|
||||
wg.Add(1)
|
||||
@@ -409,6 +431,9 @@ func (ba *BenchmarkAdapter) RunConcurrentQueryStoreTest() {
|
||||
|
||||
events := ba.generateEvents(ba.config.NumEvents / halfWorkers)
|
||||
for _, ev := range events {
|
||||
// Wait for rate limiter to allow this event
|
||||
rateLimiter.Wait()
|
||||
|
||||
eventStart := time.Now()
|
||||
ba.db.SaveEvent(ctx, ev)
|
||||
latency := time.Since(eventStart)
|
||||
@@ -480,37 +505,67 @@ func (ba *BenchmarkAdapter) RunConcurrentQueryStoreTest() {
|
||||
ba.printResult(result)
|
||||
}
|
||||
|
||||
// generateEvents generates test events with proper signatures
|
||||
// generateEvents generates unique synthetic events with realistic content sizes
|
||||
func (ba *BenchmarkAdapter) generateEvents(count int) []*event.E {
|
||||
events := make([]*event.E, count)
|
||||
fmt.Printf("Generating %d unique synthetic events (minimum 300 bytes each)...\n", count)
|
||||
|
||||
// Create a test signer
|
||||
// Create a single signer for all events (reusing key is faster)
|
||||
signer := p8k.MustNew()
|
||||
if err := signer.Generate(); err != nil {
|
||||
panic(fmt.Sprintf("failed to generate test key: %v", err))
|
||||
panic(fmt.Sprintf("Failed to generate keypair: %v", err))
|
||||
}
|
||||
|
||||
// Base timestamp - start from current time and increment
|
||||
baseTime := time.Now().Unix()
|
||||
|
||||
// Minimum content size
|
||||
const minContentSize = 300
|
||||
|
||||
// Base content template
|
||||
baseContent := "This is a benchmark test event with realistic content size. "
|
||||
|
||||
// Pre-calculate how much padding we need
|
||||
paddingNeeded := minContentSize - len(baseContent)
|
||||
if paddingNeeded < 0 {
|
||||
paddingNeeded = 0
|
||||
}
|
||||
|
||||
// Create padding string (with varied characters for realistic size)
|
||||
padding := make([]byte, paddingNeeded)
|
||||
for i := range padding {
|
||||
padding[i] = ' ' + byte(i%94) // Printable ASCII characters
|
||||
}
|
||||
|
||||
events := make([]*event.E, count)
|
||||
for i := 0; i < count; i++ {
|
||||
ev := event.New()
|
||||
ev.Kind = kind.TextNote.ToU16()
|
||||
ev.CreatedAt = time.Now().Unix()
|
||||
ev.Content = []byte(fmt.Sprintf("Benchmark event #%d - Testing Nostr relay performance with automated load generation", i))
|
||||
ev.Kind = kind.TextNote.K
|
||||
ev.CreatedAt = baseTime + int64(i) // Unique timestamp for each event
|
||||
ev.Tags = tag.NewS()
|
||||
|
||||
// Add some tags for variety
|
||||
if i%10 == 0 {
|
||||
benchmarkTag := tag.NewFromBytesSlice([]byte("t"), []byte("benchmark"))
|
||||
ev.Tags.Append(benchmarkTag)
|
||||
}
|
||||
// Create content with unique identifier and padding
|
||||
ev.Content = []byte(fmt.Sprintf("%s Event #%d. %s", baseContent, i, string(padding)))
|
||||
|
||||
// Sign the event (sets Pubkey, ID, and Sig)
|
||||
// Sign the event (this calculates ID and Sig)
|
||||
if err := ev.Sign(signer); err != nil {
|
||||
panic(fmt.Sprintf("failed to sign event: %v", err))
|
||||
panic(fmt.Sprintf("Failed to sign event %d: %v", i, err))
|
||||
}
|
||||
|
||||
events[i] = ev
|
||||
}
|
||||
|
||||
// Print stats
|
||||
totalSize := int64(0)
|
||||
for _, ev := range events {
|
||||
totalSize += int64(len(ev.Content))
|
||||
}
|
||||
avgSize := totalSize / int64(count)
|
||||
|
||||
fmt.Printf("Generated %d events:\n", count)
|
||||
fmt.Printf(" Average content size: %d bytes\n", avgSize)
|
||||
fmt.Printf(" All events are unique (incremental timestamps)\n")
|
||||
fmt.Printf(" All events are properly signed\n\n")
|
||||
|
||||
return events
|
||||
}
|
||||
|
||||
|
||||
@@ -91,18 +91,26 @@ func (dgb *DgraphBenchmark) RunSuite() {
|
||||
|
||||
fmt.Printf("RunPeakThroughputTest (dgraph)..\n")
|
||||
dgb.bench.RunPeakThroughputTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
dgb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunBurstPatternTest (dgraph)..\n")
|
||||
dgb.bench.RunBurstPatternTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
dgb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunMixedReadWriteTest (dgraph)..\n")
|
||||
dgb.bench.RunMixedReadWriteTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
dgb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunQueryTest (dgraph)..\n")
|
||||
dgb.bench.RunQueryTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
dgb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunConcurrentQueryStoreTest (dgraph)..\n")
|
||||
|
||||
37
cmd/benchmark/docker-compose-neo4j.yml
Normal file
37
cmd/benchmark/docker-compose-neo4j.yml
Normal file
@@ -0,0 +1,37 @@
|
||||
version: "3.9"
|
||||
|
||||
services:
|
||||
neo4j:
|
||||
image: neo4j:5.15-community
|
||||
container_name: orly-benchmark-neo4j
|
||||
ports:
|
||||
- "7474:7474" # HTTP
|
||||
- "7687:7687" # Bolt
|
||||
environment:
|
||||
- NEO4J_AUTH=neo4j/benchmark123
|
||||
- NEO4J_server_memory_heap_initial__size=2G
|
||||
- NEO4J_server_memory_heap_max__size=4G
|
||||
- NEO4J_server_memory_pagecache_size=2G
|
||||
- NEO4J_dbms_security_procedures_unrestricted=apoc.*
|
||||
- NEO4J_dbms_security_procedures_allowlist=apoc.*
|
||||
- NEO4JLABS_PLUGINS=["apoc"]
|
||||
volumes:
|
||||
- neo4j-data:/data
|
||||
- neo4j-logs:/logs
|
||||
networks:
|
||||
- orly-benchmark
|
||||
healthcheck:
|
||||
test: ["CMD-SHELL", "cypher-shell -u neo4j -p benchmark123 'RETURN 1;' || exit 1"]
|
||||
interval: 10s
|
||||
timeout: 5s
|
||||
retries: 10
|
||||
start_period: 40s
|
||||
|
||||
networks:
|
||||
orly-benchmark:
|
||||
name: orly-benchmark-network
|
||||
driver: bridge
|
||||
|
||||
volumes:
|
||||
neo4j-data:
|
||||
neo4j-logs:
|
||||
@@ -98,6 +98,64 @@ services:
|
||||
retries: 6
|
||||
start_period: 10s
|
||||
|
||||
# Next.orly.dev relay with Neo4j (this repository)
|
||||
next-orly-neo4j:
|
||||
build:
|
||||
context: ../..
|
||||
dockerfile: cmd/benchmark/Dockerfile.next-orly
|
||||
container_name: benchmark-next-orly-neo4j
|
||||
environment:
|
||||
- ORLY_DATA_DIR=/data
|
||||
- ORLY_LISTEN=0.0.0.0
|
||||
- ORLY_PORT=8080
|
||||
- ORLY_LOG_LEVEL=off
|
||||
- ORLY_DB_TYPE=neo4j
|
||||
- ORLY_NEO4J_URI=bolt://neo4j:7687
|
||||
- ORLY_NEO4J_USER=neo4j
|
||||
- ORLY_NEO4J_PASSWORD=benchmark123
|
||||
volumes:
|
||||
- ./data/next-orly-neo4j:/data
|
||||
ports:
|
||||
- "8008:8080"
|
||||
networks:
|
||||
- benchmark-net
|
||||
depends_on:
|
||||
neo4j:
|
||||
condition: service_healthy
|
||||
healthcheck:
|
||||
test: ["CMD", "curl", "-f", "http://localhost:8080/"]
|
||||
interval: 30s
|
||||
timeout: 10s
|
||||
retries: 3
|
||||
start_period: 60s
|
||||
|
||||
# Neo4j database
|
||||
neo4j:
|
||||
image: neo4j:5.15-community
|
||||
container_name: benchmark-neo4j
|
||||
ports:
|
||||
- "7474:7474" # HTTP
|
||||
- "7687:7687" # Bolt
|
||||
environment:
|
||||
- NEO4J_AUTH=neo4j/benchmark123
|
||||
- NEO4J_server_memory_heap_initial__size=2G
|
||||
- NEO4J_server_memory_heap_max__size=4G
|
||||
- NEO4J_server_memory_pagecache_size=2G
|
||||
- NEO4J_dbms_security_procedures_unrestricted=apoc.*
|
||||
- NEO4J_dbms_security_procedures_allowlist=apoc.*
|
||||
- NEO4JLABS_PLUGINS=["apoc"]
|
||||
volumes:
|
||||
- ./data/neo4j:/data
|
||||
- ./data/neo4j-logs:/logs
|
||||
networks:
|
||||
- benchmark-net
|
||||
healthcheck:
|
||||
test: ["CMD-SHELL", "cypher-shell -u neo4j -p benchmark123 'RETURN 1;' || exit 1"]
|
||||
interval: 10s
|
||||
timeout: 5s
|
||||
retries: 10
|
||||
start_period: 40s
|
||||
|
||||
# Khatru with SQLite
|
||||
khatru-sqlite:
|
||||
build:
|
||||
@@ -222,6 +280,8 @@ services:
|
||||
condition: service_healthy
|
||||
next-orly-dgraph:
|
||||
condition: service_healthy
|
||||
next-orly-neo4j:
|
||||
condition: service_healthy
|
||||
khatru-sqlite:
|
||||
condition: service_healthy
|
||||
khatru-badger:
|
||||
@@ -233,7 +293,7 @@ services:
|
||||
nostr-rs-relay:
|
||||
condition: service_healthy
|
||||
environment:
|
||||
- BENCHMARK_TARGETS=next-orly-badger:8080,next-orly-dgraph:8080,khatru-sqlite:3334,khatru-badger:3334,relayer-basic:7447,strfry:8080,nostr-rs-relay:8080
|
||||
- BENCHMARK_TARGETS=next-orly-badger:8080,next-orly-dgraph:8080,next-orly-neo4j:8080,khatru-sqlite:3334,khatru-badger:3334,relayer-basic:7447,strfry:8080,nostr-rs-relay:8080
|
||||
- BENCHMARK_EVENTS=50000
|
||||
- BENCHMARK_WORKERS=24
|
||||
- BENCHMARK_DURATION=60s
|
||||
|
||||
@@ -1,7 +1,10 @@
|
||||
package main
|
||||
|
||||
import (
|
||||
"bufio"
|
||||
"bytes"
|
||||
"context"
|
||||
"encoding/json"
|
||||
"flag"
|
||||
"fmt"
|
||||
"log"
|
||||
@@ -16,12 +19,13 @@ import (
|
||||
"next.orly.dev/pkg/database"
|
||||
"next.orly.dev/pkg/encoders/envelopes/eventenvelope"
|
||||
"next.orly.dev/pkg/encoders/event"
|
||||
examples "next.orly.dev/pkg/encoders/event/examples"
|
||||
"next.orly.dev/pkg/encoders/filter"
|
||||
"next.orly.dev/pkg/encoders/kind"
|
||||
"next.orly.dev/pkg/encoders/tag"
|
||||
"next.orly.dev/pkg/encoders/timestamp"
|
||||
"next.orly.dev/pkg/protocol/ws"
|
||||
"next.orly.dev/pkg/interfaces/signer/p8k"
|
||||
"next.orly.dev/pkg/protocol/ws"
|
||||
)
|
||||
|
||||
type BenchmarkConfig struct {
|
||||
@@ -39,6 +43,7 @@ type BenchmarkConfig struct {
|
||||
|
||||
// Backend selection
|
||||
UseDgraph bool
|
||||
UseNeo4j bool
|
||||
}
|
||||
|
||||
type BenchmarkResult struct {
|
||||
@@ -57,12 +62,46 @@ type BenchmarkResult struct {
|
||||
Errors []string
|
||||
}
|
||||
|
||||
// RateLimiter implements a simple token bucket rate limiter
|
||||
type RateLimiter struct {
|
||||
rate float64 // events per second
|
||||
interval time.Duration // time between events
|
||||
lastEvent time.Time
|
||||
mu sync.Mutex
|
||||
}
|
||||
|
||||
// NewRateLimiter creates a rate limiter for the specified events per second
|
||||
func NewRateLimiter(eventsPerSecond float64) *RateLimiter {
|
||||
return &RateLimiter{
|
||||
rate: eventsPerSecond,
|
||||
interval: time.Duration(float64(time.Second) / eventsPerSecond),
|
||||
lastEvent: time.Now(),
|
||||
}
|
||||
}
|
||||
|
||||
// Wait blocks until the next event is allowed based on the rate limit
|
||||
func (rl *RateLimiter) Wait() {
|
||||
rl.mu.Lock()
|
||||
defer rl.mu.Unlock()
|
||||
|
||||
now := time.Now()
|
||||
nextAllowed := rl.lastEvent.Add(rl.interval)
|
||||
|
||||
if now.Before(nextAllowed) {
|
||||
time.Sleep(nextAllowed.Sub(now))
|
||||
rl.lastEvent = nextAllowed
|
||||
} else {
|
||||
rl.lastEvent = now
|
||||
}
|
||||
}
|
||||
|
||||
type Benchmark struct {
|
||||
config *BenchmarkConfig
|
||||
db *database.D
|
||||
eventStream *EventStream
|
||||
results []*BenchmarkResult
|
||||
mu sync.RWMutex
|
||||
config *BenchmarkConfig
|
||||
db *database.D
|
||||
results []*BenchmarkResult
|
||||
mu sync.RWMutex
|
||||
cachedEvents []*event.E // Real-world events from examples.Cache
|
||||
eventCacheMu sync.Mutex
|
||||
}
|
||||
|
||||
func main() {
|
||||
@@ -81,6 +120,12 @@ func main() {
|
||||
return
|
||||
}
|
||||
|
||||
if config.UseNeo4j {
|
||||
// Run Neo4j benchmark
|
||||
runNeo4jBenchmark(config)
|
||||
return
|
||||
}
|
||||
|
||||
// Run standard Badger benchmark
|
||||
fmt.Printf("Starting Nostr Relay Benchmark (Badger Backend)\n")
|
||||
fmt.Printf("Data Directory: %s\n", config.DataDir)
|
||||
@@ -122,6 +167,28 @@ func runDgraphBenchmark(config *BenchmarkConfig) {
|
||||
dgraphBench.GenerateAsciidocReport()
|
||||
}
|
||||
|
||||
func runNeo4jBenchmark(config *BenchmarkConfig) {
|
||||
fmt.Printf("Starting Nostr Relay Benchmark (Neo4j Backend)\n")
|
||||
fmt.Printf("Data Directory: %s\n", config.DataDir)
|
||||
fmt.Printf(
|
||||
"Events: %d, Workers: %d\n",
|
||||
config.NumEvents, config.ConcurrentWorkers,
|
||||
)
|
||||
|
||||
neo4jBench, err := NewNeo4jBenchmark(config)
|
||||
if err != nil {
|
||||
log.Fatalf("Failed to create Neo4j benchmark: %v", err)
|
||||
}
|
||||
defer neo4jBench.Close()
|
||||
|
||||
// Run Neo4j benchmark suite
|
||||
neo4jBench.RunSuite()
|
||||
|
||||
// Generate reports
|
||||
neo4jBench.GenerateReport()
|
||||
neo4jBench.GenerateAsciidocReport()
|
||||
}
|
||||
|
||||
func parseFlags() *BenchmarkConfig {
|
||||
config := &BenchmarkConfig{}
|
||||
|
||||
@@ -132,8 +199,8 @@ func parseFlags() *BenchmarkConfig {
|
||||
&config.NumEvents, "events", 10000, "Number of events to generate",
|
||||
)
|
||||
flag.IntVar(
|
||||
&config.ConcurrentWorkers, "workers", runtime.NumCPU(),
|
||||
"Number of concurrent workers",
|
||||
&config.ConcurrentWorkers, "workers", max(2, runtime.NumCPU()/4),
|
||||
"Number of concurrent workers (default: CPU cores / 4 for low CPU usage)",
|
||||
)
|
||||
flag.DurationVar(
|
||||
&config.TestDuration, "duration", 60*time.Second, "Test duration",
|
||||
@@ -162,6 +229,10 @@ func parseFlags() *BenchmarkConfig {
|
||||
&config.UseDgraph, "dgraph", false,
|
||||
"Use dgraph backend (requires Docker)",
|
||||
)
|
||||
flag.BoolVar(
|
||||
&config.UseNeo4j, "neo4j", false,
|
||||
"Use Neo4j backend (requires Docker)",
|
||||
)
|
||||
|
||||
flag.Parse()
|
||||
return config
|
||||
@@ -330,23 +401,10 @@ func NewBenchmark(config *BenchmarkConfig) *Benchmark {
|
||||
log.Fatalf("Failed to create database: %v", err)
|
||||
}
|
||||
|
||||
// Create event stream (stores events on disk to avoid memory bloat)
|
||||
eventStream, err := NewEventStream(config.DataDir, config.NumEvents)
|
||||
if err != nil {
|
||||
log.Fatalf("Failed to create event stream: %v", err)
|
||||
}
|
||||
|
||||
// Pre-generate all events to disk
|
||||
fmt.Printf("Pre-generating %d events to disk to avoid memory bloat...\n", config.NumEvents)
|
||||
if err := eventStream.Generate(); err != nil {
|
||||
log.Fatalf("Failed to generate events: %v", err)
|
||||
}
|
||||
|
||||
b := &Benchmark{
|
||||
config: config,
|
||||
db: db,
|
||||
eventStream: eventStream,
|
||||
results: make([]*BenchmarkResult, 0),
|
||||
config: config,
|
||||
db: db,
|
||||
results: make([]*BenchmarkResult, 0),
|
||||
}
|
||||
|
||||
// Trigger compaction/GC before starting tests
|
||||
@@ -361,49 +419,42 @@ func (b *Benchmark) Close() {
|
||||
}
|
||||
}
|
||||
|
||||
// RunSuite runs the memory-optimized tests (Peak Throughput and Burst Pattern only)
|
||||
// RunSuite runs the full benchmark test suite
|
||||
func (b *Benchmark) RunSuite() {
|
||||
fmt.Printf("\n=== Running Memory-Optimized Tests ===\n")
|
||||
fmt.Println("\n╔════════════════════════════════════════════════════════╗")
|
||||
fmt.Println("║ BADGER BACKEND BENCHMARK SUITE ║")
|
||||
fmt.Println("╚════════════════════════════════════════════════════════╝")
|
||||
|
||||
fmt.Printf("RunPeakThroughputTest..\n")
|
||||
fmt.Printf("\n=== Starting Badger benchmark ===\n")
|
||||
|
||||
fmt.Printf("RunPeakThroughputTest (Badger)..\n")
|
||||
b.RunPeakThroughputTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
b.db.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
// Clear database between tests to avoid duplicate event issues
|
||||
fmt.Printf("\nClearing database for next test...\n")
|
||||
if err := b.db.Close(); err != nil {
|
||||
log.Printf("Error closing database: %v", err)
|
||||
}
|
||||
time.Sleep(1 * time.Second)
|
||||
|
||||
// Remove database files (.sst, .vlog, MANIFEST, etc.)
|
||||
// Badger stores files directly in the data directory
|
||||
matches, err := filepath.Glob(filepath.Join(b.config.DataDir, "*.sst"))
|
||||
if err == nil {
|
||||
for _, f := range matches {
|
||||
os.Remove(f)
|
||||
}
|
||||
}
|
||||
matches, err = filepath.Glob(filepath.Join(b.config.DataDir, "*.vlog"))
|
||||
if err == nil {
|
||||
for _, f := range matches {
|
||||
os.Remove(f)
|
||||
}
|
||||
}
|
||||
os.Remove(filepath.Join(b.config.DataDir, "MANIFEST"))
|
||||
os.Remove(filepath.Join(b.config.DataDir, "DISCARD"))
|
||||
os.Remove(filepath.Join(b.config.DataDir, "KEYREGISTRY"))
|
||||
|
||||
// Create fresh database
|
||||
ctx := context.Background()
|
||||
cancel := func() {}
|
||||
db, err := database.New(ctx, cancel, b.config.DataDir, "warn")
|
||||
if err != nil {
|
||||
log.Fatalf("Failed to create fresh database: %v", err)
|
||||
}
|
||||
b.db = db
|
||||
|
||||
fmt.Printf("RunBurstPatternTest..\n")
|
||||
fmt.Printf("RunBurstPatternTest (Badger)..\n")
|
||||
b.RunBurstPatternTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
b.db.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunMixedReadWriteTest (Badger)..\n")
|
||||
b.RunMixedReadWriteTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
b.db.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunQueryTest (Badger)..\n")
|
||||
b.RunQueryTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
b.db.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunConcurrentQueryStoreTest (Badger)..\n")
|
||||
b.RunConcurrentQueryStoreTest()
|
||||
|
||||
fmt.Printf("\n=== Badger benchmark completed ===\n\n")
|
||||
}
|
||||
|
||||
// compactDatabase triggers a Badger value log GC before starting tests.
|
||||
@@ -430,17 +481,28 @@ func (b *Benchmark) RunPeakThroughputTest() {
|
||||
var errorCount int64
|
||||
var mu sync.Mutex
|
||||
|
||||
// Stream events from disk with reasonable buffer
|
||||
eventChan, errChan := b.eventStream.GetEventChannel(1000)
|
||||
// Stream events from memory (real-world sample events)
|
||||
eventChan, errChan := b.getEventChannel(b.config.NumEvents, 1000)
|
||||
|
||||
// Start workers
|
||||
// Calculate per-worker rate: 20k events/sec total divided by worker count
|
||||
// This prevents all workers from synchronizing and hitting DB simultaneously
|
||||
perWorkerRate := 20000.0 / float64(b.config.ConcurrentWorkers)
|
||||
|
||||
// Start workers with rate limiting
|
||||
ctx := context.Background()
|
||||
|
||||
for i := 0; i < b.config.ConcurrentWorkers; i++ {
|
||||
wg.Add(1)
|
||||
go func(workerID int) {
|
||||
defer wg.Done()
|
||||
|
||||
// Each worker gets its own rate limiter to avoid mutex contention
|
||||
workerLimiter := NewRateLimiter(perWorkerRate)
|
||||
|
||||
for ev := range eventChan {
|
||||
// Wait for rate limiter to allow this event
|
||||
workerLimiter.Wait()
|
||||
|
||||
eventStart := time.Now()
|
||||
_, err := b.db.SaveEvent(ctx, ev)
|
||||
latency := time.Since(eventStart)
|
||||
@@ -531,8 +593,8 @@ func (b *Benchmark) RunBurstPatternTest() {
|
||||
var errorCount int64
|
||||
var mu sync.Mutex
|
||||
|
||||
// Stream events from disk
|
||||
eventChan, errChan := b.eventStream.GetEventChannel(500)
|
||||
// Stream events from memory (real-world sample events)
|
||||
eventChan, errChan := b.getEventChannel(b.config.NumEvents, 500)
|
||||
|
||||
// Check for streaming errors
|
||||
go func() {
|
||||
@@ -556,11 +618,21 @@ func (b *Benchmark) RunBurstPatternTest() {
|
||||
eventQueue := make(chan *event.E, numWorkers*4)
|
||||
var wg sync.WaitGroup
|
||||
|
||||
// Calculate per-worker rate to avoid mutex contention
|
||||
perWorkerRate := 20000.0 / float64(numWorkers)
|
||||
|
||||
for w := 0; w < numWorkers; w++ {
|
||||
wg.Add(1)
|
||||
go func() {
|
||||
defer wg.Done()
|
||||
|
||||
// Each worker gets its own rate limiter
|
||||
workerLimiter := NewRateLimiter(perWorkerRate)
|
||||
|
||||
for ev := range eventQueue {
|
||||
// Wait for rate limiter to allow this event
|
||||
workerLimiter.Wait()
|
||||
|
||||
eventStart := time.Now()
|
||||
_, err := b.db.SaveEvent(ctx, ev)
|
||||
latency := time.Since(eventStart)
|
||||
@@ -669,17 +741,25 @@ func (b *Benchmark) RunMixedReadWriteTest() {
|
||||
events := b.generateEvents(b.config.NumEvents)
|
||||
var wg sync.WaitGroup
|
||||
|
||||
// Calculate per-worker rate to avoid mutex contention
|
||||
perWorkerRate := 20000.0 / float64(b.config.ConcurrentWorkers)
|
||||
|
||||
// Start mixed read/write workers
|
||||
for i := 0; i < b.config.ConcurrentWorkers; i++ {
|
||||
wg.Add(1)
|
||||
go func(workerID int) {
|
||||
defer wg.Done()
|
||||
|
||||
// Each worker gets its own rate limiter
|
||||
workerLimiter := NewRateLimiter(perWorkerRate)
|
||||
|
||||
eventIndex := workerID
|
||||
for time.Since(start) < b.config.TestDuration && eventIndex < len(events) {
|
||||
// Alternate between write and read operations
|
||||
if eventIndex%2 == 0 {
|
||||
// Write operation
|
||||
// Write operation - apply rate limiting
|
||||
workerLimiter.Wait()
|
||||
|
||||
writeStart := time.Now()
|
||||
_, err := b.db.SaveEvent(ctx, events[eventIndex])
|
||||
writeLatency := time.Since(writeStart)
|
||||
@@ -850,9 +930,8 @@ func (b *Benchmark) RunQueryTest() {
|
||||
mu.Unlock()
|
||||
|
||||
queryCount++
|
||||
if queryCount%10 == 0 {
|
||||
time.Sleep(10 * time.Millisecond) // Small delay every 10 queries
|
||||
}
|
||||
// Always add delay to prevent CPU saturation (queries are CPU-intensive)
|
||||
time.Sleep(1 * time.Millisecond)
|
||||
}
|
||||
}(i)
|
||||
}
|
||||
@@ -952,6 +1031,9 @@ func (b *Benchmark) RunConcurrentQueryStoreTest() {
|
||||
numReaders := b.config.ConcurrentWorkers / 2
|
||||
numWriters := b.config.ConcurrentWorkers - numReaders
|
||||
|
||||
// Calculate per-worker write rate to avoid mutex contention
|
||||
perWorkerRate := 20000.0 / float64(numWriters)
|
||||
|
||||
// Start query workers (readers)
|
||||
for i := 0; i < numReaders; i++ {
|
||||
wg.Add(1)
|
||||
@@ -986,9 +1068,8 @@ func (b *Benchmark) RunConcurrentQueryStoreTest() {
|
||||
mu.Unlock()
|
||||
|
||||
queryCount++
|
||||
if queryCount%5 == 0 {
|
||||
time.Sleep(5 * time.Millisecond) // Small delay
|
||||
}
|
||||
// Always add delay to prevent CPU saturation (queries are CPU-intensive)
|
||||
time.Sleep(1 * time.Millisecond)
|
||||
}
|
||||
}(i)
|
||||
}
|
||||
@@ -999,11 +1080,16 @@ func (b *Benchmark) RunConcurrentQueryStoreTest() {
|
||||
go func(workerID int) {
|
||||
defer wg.Done()
|
||||
|
||||
// Each worker gets its own rate limiter
|
||||
workerLimiter := NewRateLimiter(perWorkerRate)
|
||||
|
||||
eventIndex := workerID
|
||||
writeCount := 0
|
||||
|
||||
for time.Since(start) < b.config.TestDuration && eventIndex < len(writeEvents) {
|
||||
// Write operation
|
||||
// Write operation - apply rate limiting
|
||||
workerLimiter.Wait()
|
||||
|
||||
writeStart := time.Now()
|
||||
_, err := b.db.SaveEvent(ctx, writeEvents[eventIndex])
|
||||
writeLatency := time.Since(writeStart)
|
||||
@@ -1019,10 +1105,6 @@ func (b *Benchmark) RunConcurrentQueryStoreTest() {
|
||||
|
||||
eventIndex += numWriters
|
||||
writeCount++
|
||||
|
||||
if writeCount%10 == 0 {
|
||||
time.Sleep(10 * time.Millisecond) // Small delay every 10 writes
|
||||
}
|
||||
}
|
||||
}(i)
|
||||
}
|
||||
@@ -1083,111 +1165,203 @@ func (b *Benchmark) RunConcurrentQueryStoreTest() {
|
||||
}
|
||||
|
||||
func (b *Benchmark) generateEvents(count int) []*event.E {
|
||||
fmt.Printf("Generating %d unique synthetic events (minimum 300 bytes each)...\n", count)
|
||||
|
||||
// Create a single signer for all events (reusing key is faster)
|
||||
signer := p8k.MustNew()
|
||||
if err := signer.Generate(); err != nil {
|
||||
log.Fatalf("Failed to generate keypair: %v", err)
|
||||
}
|
||||
|
||||
// Base timestamp - start from current time and increment
|
||||
baseTime := time.Now().Unix()
|
||||
|
||||
// Minimum content size
|
||||
const minContentSize = 300
|
||||
|
||||
// Base content template
|
||||
baseContent := "This is a benchmark test event with realistic content size. "
|
||||
|
||||
// Pre-calculate how much padding we need
|
||||
paddingNeeded := minContentSize - len(baseContent)
|
||||
if paddingNeeded < 0 {
|
||||
paddingNeeded = 0
|
||||
}
|
||||
|
||||
// Create padding string (with varied characters for realistic size)
|
||||
padding := make([]byte, paddingNeeded)
|
||||
for i := range padding {
|
||||
padding[i] = ' ' + byte(i%94) // Printable ASCII characters
|
||||
}
|
||||
|
||||
events := make([]*event.E, count)
|
||||
now := timestamp.Now()
|
||||
|
||||
// Generate a keypair for signing all events
|
||||
var keys *p8k.Signer
|
||||
var err error
|
||||
if keys, err = p8k.New(); err != nil {
|
||||
fmt.Printf("failed to create signer: %v\n", err)
|
||||
return nil
|
||||
}
|
||||
if err := keys.Generate(); err != nil {
|
||||
log.Fatalf("Failed to generate keys for benchmark events: %v", err)
|
||||
}
|
||||
|
||||
// Define size distribution - from minimal to 500KB
|
||||
// We'll create a logarithmic distribution to test various sizes
|
||||
sizeBuckets := []int{
|
||||
0, // Minimal: empty content, no tags
|
||||
10, // Tiny: ~10 bytes
|
||||
100, // Small: ~100 bytes
|
||||
1024, // 1 KB
|
||||
10 * 1024, // 10 KB
|
||||
50 * 1024, // 50 KB
|
||||
100 * 1024, // 100 KB
|
||||
250 * 1024, // 250 KB
|
||||
500 * 1024, // 500 KB (max realistic size for Nostr)
|
||||
}
|
||||
|
||||
for i := 0; i < count; i++ {
|
||||
ev := event.New()
|
||||
|
||||
ev.CreatedAt = now.I64()
|
||||
ev.Kind = kind.TextNote.K
|
||||
ev.CreatedAt = baseTime + int64(i) // Unique timestamp for each event
|
||||
ev.Tags = tag.NewS()
|
||||
|
||||
// Distribute events across size buckets
|
||||
bucketIndex := i % len(sizeBuckets)
|
||||
targetSize := sizeBuckets[bucketIndex]
|
||||
// Create content with unique identifier and padding
|
||||
ev.Content = []byte(fmt.Sprintf("%s Event #%d. %s", baseContent, i, string(padding)))
|
||||
|
||||
// Generate content based on target size
|
||||
if targetSize == 0 {
|
||||
// Minimal event: empty content, no tags
|
||||
ev.Content = []byte{}
|
||||
ev.Tags = tag.NewS() // Empty tag set
|
||||
} else if targetSize < 1024 {
|
||||
// Small events: simple text content
|
||||
ev.Content = []byte(fmt.Sprintf(
|
||||
"Event %d - Size bucket: %d bytes. %s",
|
||||
i, targetSize, strings.Repeat("x", max(0, targetSize-50)),
|
||||
))
|
||||
// Add minimal tags
|
||||
ev.Tags = tag.NewS(
|
||||
tag.NewFromBytesSlice([]byte("t"), []byte("benchmark")),
|
||||
)
|
||||
} else {
|
||||
// Larger events: fill with repeated content to reach target size
|
||||
// Account for JSON overhead (~200 bytes for event structure)
|
||||
contentSize := targetSize - 200
|
||||
if contentSize < 0 {
|
||||
contentSize = targetSize
|
||||
}
|
||||
|
||||
// Build content with repeated pattern
|
||||
pattern := fmt.Sprintf("Event %d, target size %d bytes. ", i, targetSize)
|
||||
repeatCount := contentSize / len(pattern)
|
||||
if repeatCount < 1 {
|
||||
repeatCount = 1
|
||||
}
|
||||
ev.Content = []byte(strings.Repeat(pattern, repeatCount))
|
||||
|
||||
// Add some tags (contributes to total size)
|
||||
numTags := min(5, max(1, targetSize/10000)) // More tags for larger events
|
||||
tags := make([]*tag.T, 0, numTags+1)
|
||||
tags = append(tags, tag.NewFromBytesSlice([]byte("t"), []byte("benchmark")))
|
||||
for j := 0; j < numTags; j++ {
|
||||
tags = append(tags, tag.NewFromBytesSlice(
|
||||
[]byte("e"),
|
||||
[]byte(fmt.Sprintf("ref_%d_%d", i, j)),
|
||||
))
|
||||
}
|
||||
ev.Tags = tag.NewS(tags...)
|
||||
}
|
||||
|
||||
// Properly sign the event
|
||||
if err := ev.Sign(keys); err != nil {
|
||||
// Sign the event (this calculates ID and Sig)
|
||||
if err := ev.Sign(signer); err != nil {
|
||||
log.Fatalf("Failed to sign event %d: %v", i, err)
|
||||
}
|
||||
|
||||
events[i] = ev
|
||||
}
|
||||
|
||||
// Log size distribution summary
|
||||
fmt.Printf("\nGenerated %d events with size distribution:\n", count)
|
||||
for idx, size := range sizeBuckets {
|
||||
eventsInBucket := count / len(sizeBuckets)
|
||||
if idx < count%len(sizeBuckets) {
|
||||
eventsInBucket++
|
||||
}
|
||||
sizeStr := formatSize(size)
|
||||
fmt.Printf(" %s: ~%d events\n", sizeStr, eventsInBucket)
|
||||
// Print stats
|
||||
totalSize := int64(0)
|
||||
for _, ev := range events {
|
||||
totalSize += int64(len(ev.Content))
|
||||
}
|
||||
fmt.Println()
|
||||
avgSize := totalSize / int64(count)
|
||||
|
||||
fmt.Printf("Generated %d events:\n", count)
|
||||
fmt.Printf(" Average content size: %d bytes\n", avgSize)
|
||||
fmt.Printf(" All events are unique (incremental timestamps)\n")
|
||||
fmt.Printf(" All events are properly signed\n\n")
|
||||
|
||||
return events
|
||||
}
|
||||
|
||||
// printEventStats prints statistics about the loaded real-world events
|
||||
func (b *Benchmark) printEventStats() {
|
||||
if len(b.cachedEvents) == 0 {
|
||||
return
|
||||
}
|
||||
|
||||
// Analyze event distribution
|
||||
kindCounts := make(map[uint16]int)
|
||||
var totalSize int64
|
||||
|
||||
for _, ev := range b.cachedEvents {
|
||||
kindCounts[ev.Kind]++
|
||||
totalSize += int64(len(ev.Content))
|
||||
}
|
||||
|
||||
avgSize := totalSize / int64(len(b.cachedEvents))
|
||||
|
||||
fmt.Printf("\nEvent Statistics:\n")
|
||||
fmt.Printf(" Total events: %d\n", len(b.cachedEvents))
|
||||
fmt.Printf(" Average content size: %d bytes\n", avgSize)
|
||||
fmt.Printf(" Event kinds found: %d unique\n", len(kindCounts))
|
||||
fmt.Printf(" Most common kinds:\n")
|
||||
|
||||
// Print top 5 kinds
|
||||
type kindCount struct {
|
||||
kind uint16
|
||||
count int
|
||||
}
|
||||
var counts []kindCount
|
||||
for k, c := range kindCounts {
|
||||
counts = append(counts, kindCount{k, c})
|
||||
}
|
||||
sort.Slice(counts, func(i, j int) bool {
|
||||
return counts[i].count > counts[j].count
|
||||
})
|
||||
for i := 0; i < min(5, len(counts)); i++ {
|
||||
fmt.Printf(" Kind %d: %d events\n", counts[i].kind, counts[i].count)
|
||||
}
|
||||
fmt.Println()
|
||||
}
|
||||
|
||||
// loadRealEvents loads events from embedded examples.Cache on first call
|
||||
func (b *Benchmark) loadRealEvents() {
|
||||
b.eventCacheMu.Lock()
|
||||
defer b.eventCacheMu.Unlock()
|
||||
|
||||
// Only load once
|
||||
if len(b.cachedEvents) > 0 {
|
||||
return
|
||||
}
|
||||
|
||||
fmt.Println("Loading real-world sample events (11,596 events from 6 months of Nostr)...")
|
||||
scanner := bufio.NewScanner(bytes.NewReader(examples.Cache))
|
||||
|
||||
buf := make([]byte, 0, 64*1024)
|
||||
scanner.Buffer(buf, 1024*1024)
|
||||
|
||||
for scanner.Scan() {
|
||||
var ev event.E
|
||||
if err := json.Unmarshal(scanner.Bytes(), &ev); err != nil {
|
||||
fmt.Printf("Warning: failed to unmarshal event: %v\n", err)
|
||||
continue
|
||||
}
|
||||
b.cachedEvents = append(b.cachedEvents, &ev)
|
||||
}
|
||||
|
||||
if err := scanner.Err(); err != nil {
|
||||
log.Fatalf("Failed to read events: %v", err)
|
||||
}
|
||||
|
||||
fmt.Printf("Loaded %d real-world events (already signed, zero crypto overhead)\n", len(b.cachedEvents))
|
||||
b.printEventStats()
|
||||
}
|
||||
|
||||
// getEventChannel returns a channel that streams unique synthetic events
|
||||
// bufferSize controls memory usage - larger buffers improve throughput but use more memory
|
||||
func (b *Benchmark) getEventChannel(count int, bufferSize int) (<-chan *event.E, <-chan error) {
|
||||
eventChan := make(chan *event.E, bufferSize)
|
||||
errChan := make(chan error, 1)
|
||||
|
||||
go func() {
|
||||
defer close(eventChan)
|
||||
defer close(errChan)
|
||||
|
||||
// Create a single signer for all events
|
||||
signer := p8k.MustNew()
|
||||
if err := signer.Generate(); err != nil {
|
||||
errChan <- fmt.Errorf("failed to generate keypair: %w", err)
|
||||
return
|
||||
}
|
||||
|
||||
// Base timestamp - start from current time and increment
|
||||
baseTime := time.Now().Unix()
|
||||
|
||||
// Minimum content size
|
||||
const minContentSize = 300
|
||||
|
||||
// Base content template
|
||||
baseContent := "This is a benchmark test event with realistic content size. "
|
||||
|
||||
// Pre-calculate padding
|
||||
paddingNeeded := minContentSize - len(baseContent)
|
||||
if paddingNeeded < 0 {
|
||||
paddingNeeded = 0
|
||||
}
|
||||
|
||||
// Create padding string (with varied characters for realistic size)
|
||||
padding := make([]byte, paddingNeeded)
|
||||
for i := range padding {
|
||||
padding[i] = ' ' + byte(i%94) // Printable ASCII characters
|
||||
}
|
||||
|
||||
// Stream unique events
|
||||
for i := 0; i < count; i++ {
|
||||
ev := event.New()
|
||||
ev.Kind = kind.TextNote.K
|
||||
ev.CreatedAt = baseTime + int64(i) // Unique timestamp for each event
|
||||
ev.Tags = tag.NewS()
|
||||
|
||||
// Create content with unique identifier and padding
|
||||
ev.Content = []byte(fmt.Sprintf("%s Event #%d. %s", baseContent, i, string(padding)))
|
||||
|
||||
// Sign the event (this calculates ID and Sig)
|
||||
if err := ev.Sign(signer); err != nil {
|
||||
errChan <- fmt.Errorf("failed to sign event %d: %w", i, err)
|
||||
return
|
||||
}
|
||||
|
||||
eventChan <- ev
|
||||
}
|
||||
}()
|
||||
|
||||
return eventChan, errChan
|
||||
}
|
||||
|
||||
// formatSize formats byte size in human-readable format
|
||||
func formatSize(bytes int) string {
|
||||
if bytes == 0 {
|
||||
|
||||
135
cmd/benchmark/neo4j_benchmark.go
Normal file
135
cmd/benchmark/neo4j_benchmark.go
Normal file
@@ -0,0 +1,135 @@
|
||||
package main
|
||||
|
||||
import (
|
||||
"context"
|
||||
"fmt"
|
||||
"log"
|
||||
"os"
|
||||
"time"
|
||||
|
||||
"next.orly.dev/pkg/database"
|
||||
_ "next.orly.dev/pkg/neo4j" // Import to register neo4j factory
|
||||
)
|
||||
|
||||
// Neo4jBenchmark wraps a Benchmark with Neo4j-specific setup
|
||||
type Neo4jBenchmark struct {
|
||||
config *BenchmarkConfig
|
||||
docker *Neo4jDocker
|
||||
database database.Database
|
||||
bench *BenchmarkAdapter
|
||||
}
|
||||
|
||||
// NewNeo4jBenchmark creates a new Neo4j benchmark instance
|
||||
func NewNeo4jBenchmark(config *BenchmarkConfig) (*Neo4jBenchmark, error) {
|
||||
// Create Docker manager
|
||||
docker, err := NewNeo4jDocker()
|
||||
if err != nil {
|
||||
return nil, fmt.Errorf("failed to create Neo4j docker manager: %w", err)
|
||||
}
|
||||
|
||||
// Start Neo4j container
|
||||
if err := docker.Start(); err != nil {
|
||||
return nil, fmt.Errorf("failed to start Neo4j: %w", err)
|
||||
}
|
||||
|
||||
// Set environment variables for Neo4j connection
|
||||
os.Setenv("ORLY_NEO4J_URI", "bolt://localhost:7687")
|
||||
os.Setenv("ORLY_NEO4J_USER", "neo4j")
|
||||
os.Setenv("ORLY_NEO4J_PASSWORD", "benchmark123")
|
||||
|
||||
// Create database instance using Neo4j backend
|
||||
ctx := context.Background()
|
||||
cancel := func() {}
|
||||
db, err := database.NewDatabase(ctx, cancel, "neo4j", config.DataDir, "warn")
|
||||
if err != nil {
|
||||
docker.Stop()
|
||||
return nil, fmt.Errorf("failed to create Neo4j database: %w", err)
|
||||
}
|
||||
|
||||
// Wait for database to be ready
|
||||
fmt.Println("Waiting for Neo4j database to be ready...")
|
||||
select {
|
||||
case <-db.Ready():
|
||||
fmt.Println("Neo4j database is ready")
|
||||
case <-time.After(30 * time.Second):
|
||||
db.Close()
|
||||
docker.Stop()
|
||||
return nil, fmt.Errorf("Neo4j database failed to become ready")
|
||||
}
|
||||
|
||||
// Create adapter to use Database interface with Benchmark
|
||||
adapter := NewBenchmarkAdapter(config, db)
|
||||
|
||||
neo4jBench := &Neo4jBenchmark{
|
||||
config: config,
|
||||
docker: docker,
|
||||
database: db,
|
||||
bench: adapter,
|
||||
}
|
||||
|
||||
return neo4jBench, nil
|
||||
}
|
||||
|
||||
// Close closes the Neo4j benchmark and stops Docker container
|
||||
func (ngb *Neo4jBenchmark) Close() {
|
||||
fmt.Println("Closing Neo4j benchmark...")
|
||||
|
||||
if ngb.database != nil {
|
||||
ngb.database.Close()
|
||||
}
|
||||
|
||||
if ngb.docker != nil {
|
||||
if err := ngb.docker.Stop(); err != nil {
|
||||
log.Printf("Error stopping Neo4j Docker: %v", err)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// RunSuite runs the benchmark suite on Neo4j
|
||||
func (ngb *Neo4jBenchmark) RunSuite() {
|
||||
fmt.Println("\n╔════════════════════════════════════════════════════════╗")
|
||||
fmt.Println("║ NEO4J BACKEND BENCHMARK SUITE ║")
|
||||
fmt.Println("╚════════════════════════════════════════════════════════╝")
|
||||
|
||||
// Run benchmark tests
|
||||
fmt.Printf("\n=== Starting Neo4j benchmark ===\n")
|
||||
|
||||
fmt.Printf("RunPeakThroughputTest (Neo4j)..\n")
|
||||
ngb.bench.RunPeakThroughputTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
ngb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunBurstPatternTest (Neo4j)..\n")
|
||||
ngb.bench.RunBurstPatternTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
ngb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunMixedReadWriteTest (Neo4j)..\n")
|
||||
ngb.bench.RunMixedReadWriteTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
ngb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunQueryTest (Neo4j)..\n")
|
||||
ngb.bench.RunQueryTest()
|
||||
fmt.Println("Wiping database between tests...")
|
||||
ngb.database.Wipe()
|
||||
time.Sleep(10 * time.Second)
|
||||
|
||||
fmt.Printf("RunConcurrentQueryStoreTest (Neo4j)..\n")
|
||||
ngb.bench.RunConcurrentQueryStoreTest()
|
||||
|
||||
fmt.Printf("\n=== Neo4j benchmark completed ===\n\n")
|
||||
}
|
||||
|
||||
// GenerateReport generates the benchmark report
|
||||
func (ngb *Neo4jBenchmark) GenerateReport() {
|
||||
ngb.bench.GenerateReport()
|
||||
}
|
||||
|
||||
// GenerateAsciidocReport generates asciidoc format report
|
||||
func (ngb *Neo4jBenchmark) GenerateAsciidocReport() {
|
||||
ngb.bench.GenerateAsciidocReport()
|
||||
}
|
||||
147
cmd/benchmark/neo4j_docker.go
Normal file
147
cmd/benchmark/neo4j_docker.go
Normal file
@@ -0,0 +1,147 @@
|
||||
package main
|
||||
|
||||
import (
|
||||
"context"
|
||||
"fmt"
|
||||
"os"
|
||||
"os/exec"
|
||||
"path/filepath"
|
||||
"time"
|
||||
)
|
||||
|
||||
// Neo4jDocker manages a Neo4j instance via Docker Compose
|
||||
type Neo4jDocker struct {
|
||||
composeFile string
|
||||
projectName string
|
||||
}
|
||||
|
||||
// NewNeo4jDocker creates a new Neo4j Docker manager
|
||||
func NewNeo4jDocker() (*Neo4jDocker, error) {
|
||||
// Look for docker-compose-neo4j.yml in current directory or cmd/benchmark
|
||||
composeFile := "docker-compose-neo4j.yml"
|
||||
if _, err := os.Stat(composeFile); os.IsNotExist(err) {
|
||||
// Try in cmd/benchmark directory
|
||||
composeFile = filepath.Join("cmd", "benchmark", "docker-compose-neo4j.yml")
|
||||
}
|
||||
|
||||
return &Neo4jDocker{
|
||||
composeFile: composeFile,
|
||||
projectName: "orly-benchmark-neo4j",
|
||||
}, nil
|
||||
}
|
||||
|
||||
// Start starts the Neo4j Docker container
|
||||
func (d *Neo4jDocker) Start() error {
|
||||
fmt.Println("Starting Neo4j Docker container...")
|
||||
|
||||
// Pull image first
|
||||
pullCmd := exec.Command("docker-compose",
|
||||
"-f", d.composeFile,
|
||||
"-p", d.projectName,
|
||||
"pull",
|
||||
)
|
||||
pullCmd.Stdout = os.Stdout
|
||||
pullCmd.Stderr = os.Stderr
|
||||
if err := pullCmd.Run(); err != nil {
|
||||
return fmt.Errorf("failed to pull Neo4j image: %w", err)
|
||||
}
|
||||
|
||||
// Start containers
|
||||
upCmd := exec.Command("docker-compose",
|
||||
"-f", d.composeFile,
|
||||
"-p", d.projectName,
|
||||
"up", "-d",
|
||||
)
|
||||
upCmd.Stdout = os.Stdout
|
||||
upCmd.Stderr = os.Stderr
|
||||
if err := upCmd.Run(); err != nil {
|
||||
return fmt.Errorf("failed to start Neo4j container: %w", err)
|
||||
}
|
||||
|
||||
fmt.Println("Waiting for Neo4j to be healthy...")
|
||||
if err := d.waitForHealthy(); err != nil {
|
||||
return err
|
||||
}
|
||||
|
||||
fmt.Println("Neo4j is ready!")
|
||||
return nil
|
||||
}
|
||||
|
||||
// waitForHealthy waits for Neo4j to become healthy
|
||||
func (d *Neo4jDocker) waitForHealthy() error {
|
||||
timeout := 120 * time.Second
|
||||
deadline := time.Now().Add(timeout)
|
||||
|
||||
containerName := "orly-benchmark-neo4j"
|
||||
|
||||
for time.Now().Before(deadline) {
|
||||
// Check container health status
|
||||
checkCmd := exec.Command("docker", "inspect",
|
||||
"--format={{.State.Health.Status}}",
|
||||
containerName,
|
||||
)
|
||||
output, err := checkCmd.Output()
|
||||
if err == nil && string(output) == "healthy\n" {
|
||||
return nil
|
||||
}
|
||||
|
||||
time.Sleep(2 * time.Second)
|
||||
}
|
||||
|
||||
return fmt.Errorf("Neo4j failed to become healthy within %v", timeout)
|
||||
}
|
||||
|
||||
// Stop stops and removes the Neo4j Docker container
|
||||
func (d *Neo4jDocker) Stop() error {
|
||||
ctx, cancel := context.WithTimeout(context.Background(), 30*time.Second)
|
||||
defer cancel()
|
||||
|
||||
// Get logs before stopping (useful for debugging)
|
||||
logsCmd := exec.CommandContext(ctx, "docker-compose",
|
||||
"-f", d.composeFile,
|
||||
"-p", d.projectName,
|
||||
"logs", "--tail=50",
|
||||
)
|
||||
logsCmd.Stdout = os.Stdout
|
||||
logsCmd.Stderr = os.Stderr
|
||||
_ = logsCmd.Run() // Ignore errors
|
||||
|
||||
fmt.Println("Stopping Neo4j Docker container...")
|
||||
|
||||
// Stop and remove containers
|
||||
downCmd := exec.Command("docker-compose",
|
||||
"-f", d.composeFile,
|
||||
"-p", d.projectName,
|
||||
"down", "-v",
|
||||
)
|
||||
downCmd.Stdout = os.Stdout
|
||||
downCmd.Stderr = os.Stderr
|
||||
if err := downCmd.Run(); err != nil {
|
||||
return fmt.Errorf("failed to stop Neo4j container: %w", err)
|
||||
}
|
||||
|
||||
return nil
|
||||
}
|
||||
|
||||
// GetBoltEndpoint returns the Neo4j Bolt endpoint
|
||||
func (d *Neo4jDocker) GetBoltEndpoint() string {
|
||||
return "bolt://localhost:7687"
|
||||
}
|
||||
|
||||
// IsRunning returns whether Neo4j is running
|
||||
func (d *Neo4jDocker) IsRunning() bool {
|
||||
checkCmd := exec.Command("docker", "ps", "--filter", "name=orly-benchmark-neo4j", "--format", "{{.Names}}")
|
||||
output, err := checkCmd.Output()
|
||||
return err == nil && len(output) > 0
|
||||
}
|
||||
|
||||
// Logs returns the logs from Neo4j container
|
||||
func (d *Neo4jDocker) Logs(tail int) (string, error) {
|
||||
logsCmd := exec.Command("docker-compose",
|
||||
"-f", d.composeFile,
|
||||
"-p", d.projectName,
|
||||
"logs", "--tail", fmt.Sprintf("%d", tail),
|
||||
)
|
||||
output, err := logsCmd.CombinedOutput()
|
||||
return string(output), err
|
||||
}
|
||||
@@ -1,134 +0,0 @@
|
||||
Starting Nostr Relay Benchmark
|
||||
Data Directory: /tmp/benchmark_next-orly_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763394450181444ℹ️ /tmp/benchmark_next-orly_8: All 0 tables opened in 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:161 /build/pkg/database/logger.go:56
|
||||
1763394450184981ℹ️ /tmp/benchmark_next-orly_8: Discard stats nextEmptySlot: 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/discard.go:55 /build/pkg/database/logger.go:56
|
||||
1763394450185044ℹ️ /tmp/benchmark_next-orly_8: Set nextTxnTs to 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:358 /build/pkg/database/logger.go:56
|
||||
1763394450185315ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763394450185349ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763394450185369ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763394450185374ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763394450185381ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763394450185396ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763394450185400ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763394450185410ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763394450185415ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
|
||||
=== Starting test round 1/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
2025/11/17 15:47:30 INFO: Successfully loaded libsecp256k1 v5.0.0 from libsecp256k1.so.2
|
||||
1763394452185466ℹ️ /tmp/benchmark_next-orly_8: database warmup complete, ready to serve requests
|
||||
/usr/local/go/src/runtime/asm_amd64.s:1693 /build/pkg/database/logger.go:56
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 4.816237891s
|
||||
Events/sec: 10381.55
|
||||
Avg latency: 1.655686ms
|
||||
P90 latency: 2.061483ms
|
||||
P95 latency: 2.348178ms
|
||||
P99 latency: 3.856522ms
|
||||
Bottom 10% Avg latency: 2.985064ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 308.793395ms
|
||||
Burst completed: 5000 events in 320.69366ms
|
||||
Burst completed: 5000 events in 324.127721ms
|
||||
Burst completed: 5000 events in 342.594802ms
|
||||
Burst completed: 5000 events in 302.350819ms
|
||||
Burst completed: 5000 events in 309.16143ms
|
||||
Burst completed: 5000 events in 306.739193ms
|
||||
Burst completed: 5000 events in 329.275972ms
|
||||
Burst completed: 5000 events in 329.234395ms
|
||||
Burst completed: 5000 events in 348.105403ms
|
||||
Burst test completed: 50000 events in 9.543815189s
|
||||
Events/sec: 5238.99
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.491349518s
|
||||
Combined ops/sec: 2041.54
|
||||
1763394510174043ℹ️ /tmp/benchmark_next-orly_8: Block cache metrics: hit: 248593 miss: 322620 keys-added: 236208 keys-updated: 73483 keys-evicted: 236188 cost-added: 12658387393408 cost-evicted: 12657366958988 sets-dropped: 0 sets-rejected: 12869 gets-dropped: 64 gets-kept: 570624 gets-total: 571213 hit-ratio: 0.44
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:454 /build/pkg/database/logger.go:56
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 258436 queries in 1m0.014042961s
|
||||
Queries/sec: 4306.26
|
||||
Avg query latency: 4.008354ms
|
||||
P95 query latency: 12.985167ms
|
||||
P99 query latency: 23.424372ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 252445 operations (202445 queries, 50000 writes) in 1m0.005913119s
|
||||
Operations/sec: 4207.00
|
||||
Avg latency: 2.121776ms
|
||||
Avg query latency: 2.374689ms
|
||||
Avg write latency: 1.097756ms
|
||||
P95 latency: 3.545393ms
|
||||
P99 latency: 4.795537ms
|
||||
|
||||
Pausing 10s before next round...
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
=== Starting test round 2/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 5.086723437s
|
||||
Events/sec: 9829.51
|
||||
Avg latency: 1.777699ms
|
||||
P90 latency: 2.219786ms
|
||||
P95 latency: 2.443201ms
|
||||
P99 latency: 3.504646ms
|
||||
Bottom 10% Avg latency: 3.103013ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 324.341799ms
|
||||
Burst completed: 5000 events in 319.047042ms
|
||||
Burst completed: 5000 events in 324.104589ms
|
||||
Burst completed: 5000 events in 342.464953ms
|
||||
Burst completed: 5000 events in 342.679451ms
|
||||
Burst completed: 5000 events in 359.150337ms
|
||||
Burst completed: 5000 events in 367.952516ms
|
||||
Burst completed: 5000 events in 338.4073ms
|
||||
Burst completed: 5000 events in 326.796197ms
|
||||
Burst completed: 5000 events in 357.71787ms
|
||||
Burst test completed: 50000 events in 9.769325434s
|
||||
Events/sec: 5118.06
|
||||
1763394684274617ℹ️ /tmp/benchmark_next-orly_8: [4] [E] LOG Compact 0->6 (8, 0 -> 4 tables with 1 splits). [00001 00002 00003 00004 00005 00006 00007 00008 . .] -> [00009 00010 00011 00012 .], took 2.954s
|
||||
, deleted 1904950 bytes
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:1479 /build/pkg/database/logger.go:56
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.464062793s
|
||||
Combined ops/sec: 2043.81
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 293040 queries in 1m0.010621036s
|
||||
Queries/sec: 4883.14
|
||||
Avg query latency: 3.419764ms
|
||||
P95 query latency: 11.042876ms
|
||||
P99 query latency: 19.984912ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
1763394810173629ℹ️ /tmp/benchmark_next-orly_8: Block cache metrics: hit: 517421289 miss: 4606293 keys-added: 1664534 keys-updated: 2530425 keys-evicted: 1664512 cost-added: 85045328540032 cost-evicted: 85044318079141 sets-dropped: 0 sets-rejected: 349798 gets-dropped: 404194112 gets-kept: 117717888 gets-total: 522027608 hit-ratio: 0.99
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:454 /build/pkg/database/logger.go:56
|
||||
@@ -1,53 +0,0 @@
|
||||
Starting Nostr Relay Benchmark
|
||||
Data Directory: /tmp/benchmark_khatru-badger_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763397432159815ℹ️ /tmp/benchmark_khatru-badger_8: All 0 tables opened in 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:161 /build/pkg/database/logger.go:56
|
||||
1763397432162963ℹ️ /tmp/benchmark_khatru-badger_8: Discard stats nextEmptySlot: 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/discard.go:55 /build/pkg/database/logger.go:56
|
||||
1763397432163005ℹ️ /tmp/benchmark_khatru-badger_8: Set nextTxnTs to 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:358 /build/pkg/database/logger.go:56
|
||||
1763397432163282ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763397432163367ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763397432163401ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763397432163409ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763397432163473ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763397432163564ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763397432163574ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763397432163594ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763397432163600ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
|
||||
=== Starting test round 1/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
2025/11/17 16:37:12 INFO: Successfully loaded libsecp256k1 v5.0.0 from libsecp256k1.so.2
|
||||
1763397434164165ℹ️ /tmp/benchmark_khatru-badger_8: database warmup complete, ready to serve requests
|
||||
/usr/local/go/src/runtime/asm_amd64.s:1693 /build/pkg/database/logger.go:56
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 4.924203666s
|
||||
Events/sec: 10153.93
|
||||
Avg latency: 1.696974ms
|
||||
P90 latency: 2.11483ms
|
||||
P95 latency: 2.344067ms
|
||||
P99 latency: 3.241477ms
|
||||
Bottom 10% Avg latency: 2.7865ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 312.680497ms
|
||||
Burst completed: 5000 events in 320.868898ms
|
||||
Burst completed: 5000 events in 317.096109ms
|
||||
Burst completed: 5000 events in 356.971689ms
|
||||
Burst completed: 5000 events in 301.615682ms
|
||||
Burst completed: 5000 events in 306.525096ms
|
||||
Burst completed: 5000 events in 320.037813ms
|
||||
Burst completed: 5000 events in 318.017102ms
|
||||
Burst completed: 5000 events in 320.394281ms
|
||||
Burst completed: 5000 events in 333.619741ms
|
||||
Burst test completed: 50000 events in 9.552105607s
|
||||
Events/sec: 5234.45
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
@@ -1,323 +0,0 @@
|
||||
Starting Nostr Relay Benchmark
|
||||
Data Directory: /tmp/benchmark_khatru-sqlite_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763397017138391ℹ️ /tmp/benchmark_khatru-sqlite_8: All 0 tables opened in 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:161 /build/pkg/database/logger.go:56
|
||||
1763397017141550ℹ️ /tmp/benchmark_khatru-sqlite_8: Discard stats nextEmptySlot: 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/discard.go:55 /build/pkg/database/logger.go:56
|
||||
1763397017141593ℹ️ /tmp/benchmark_khatru-sqlite_8: Set nextTxnTs to 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:358 /build/pkg/database/logger.go:56
|
||||
1763397017141951ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763397017142013ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763397017142036ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763397017142042ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763397017142055ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763397017142080ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763397017142086ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763397017142103ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763397017142109ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
|
||||
=== Starting test round 1/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
2025/11/17 16:30:17 INFO: Successfully loaded libsecp256k1 v5.0.0 from libsecp256k1.so.2
|
||||
1763397019142156ℹ️ /tmp/benchmark_khatru-sqlite_8: database warmup complete, ready to serve requests
|
||||
/usr/local/go/src/runtime/asm_amd64.s:1693 /build/pkg/database/logger.go:56
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 4.697220167s
|
||||
Events/sec: 10644.59
|
||||
Avg latency: 1.589521ms
|
||||
P90 latency: 1.927686ms
|
||||
P95 latency: 2.072081ms
|
||||
P99 latency: 2.794007ms
|
||||
Bottom 10% Avg latency: 2.449508ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 331.053594ms
|
||||
Burst completed: 5000 events in 339.97436ms
|
||||
Burst completed: 5000 events in 352.328844ms
|
||||
Burst completed: 5000 events in 376.613834ms
|
||||
Burst completed: 5000 events in 321.307729ms
|
||||
Burst completed: 5000 events in 314.265411ms
|
||||
Burst completed: 5000 events in 321.656622ms
|
||||
Burst completed: 5000 events in 325.689539ms
|
||||
Burst completed: 5000 events in 367.767832ms
|
||||
Burst completed: 5000 events in 367.275402ms
|
||||
Burst test completed: 50000 events in 9.780316233s
|
||||
Events/sec: 5112.31
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.45356557s
|
||||
Combined ops/sec: 2044.69
|
||||
1763397077132611⚠️ /tmp/benchmark_khatru-sqlite_8: Block cache might be too small. Metrics: hit: 164850 miss: 294509 keys-added: 226622 keys-updated: 54881 keys-evicted: 226603 cost-added: 12429978548485 cost-evicted: 12428976154843 sets-dropped: 0 sets-rejected: 12954 gets-dropped: 192 gets-kept: 458368 gets-total: 459359 hit-ratio: 0.36
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:450 /build/pkg/database/logger.go:46
|
||||
1763397077132680⚠️ /tmp/benchmark_khatru-sqlite_8: Cache life expectancy (in seconds):
|
||||
-- Histogram:
|
||||
Min value: 0
|
||||
Max value: 11
|
||||
Count: 226603
|
||||
50p: 2.00
|
||||
75p: 2.00
|
||||
90p: 2.00
|
||||
[0, 2) 226567 99.98% 99.98%
|
||||
[8, 16) 36 0.02% 100.00%
|
||||
--
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:451 /build/pkg/database/logger.go:46
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 253442 queries in 1m0.011742602s
|
||||
Queries/sec: 4223.21
|
||||
Avg query latency: 4.105842ms
|
||||
P95 query latency: 13.288591ms
|
||||
P99 query latency: 23.937862ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 237910 operations (187910 queries, 50000 writes) in 1m0.007412985s
|
||||
Operations/sec: 3964.68
|
||||
Avg latency: 2.360698ms
|
||||
Avg query latency: 2.630397ms
|
||||
Avg write latency: 1.347113ms
|
||||
P95 latency: 4.390739ms
|
||||
P99 latency: 6.940329ms
|
||||
|
||||
Pausing 10s before next round...
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
=== Starting test round 2/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 4.792392684s
|
||||
Events/sec: 10433.20
|
||||
Avg latency: 1.649743ms
|
||||
P90 latency: 1.991666ms
|
||||
P95 latency: 2.145348ms
|
||||
P99 latency: 2.77034ms
|
||||
Bottom 10% Avg latency: 2.781523ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 330.357755ms
|
||||
Burst completed: 5000 events in 334.984623ms
|
||||
Burst completed: 5000 events in 345.478382ms
|
||||
Burst completed: 5000 events in 340.589233ms
|
||||
Burst completed: 5000 events in 348.792025ms
|
||||
Burst completed: 5000 events in 354.019658ms
|
||||
Burst completed: 5000 events in 356.823662ms
|
||||
Burst completed: 5000 events in 347.496865ms
|
||||
Burst completed: 5000 events in 342.618798ms
|
||||
Burst completed: 5000 events in 337.759666ms
|
||||
Burst test completed: 50000 events in 9.775603327s
|
||||
Events/sec: 5114.77
|
||||
1763397250998218ℹ️ /tmp/benchmark_khatru-sqlite_8: [6] [E] LOG Compact 0->6 (8, 0 -> 4 tables with 1 splits). [00001 00002 00003 00004 00005 00006 00007 00008 . .] -> [00009 00010 00011 00012 .], took 2.922s
|
||||
, deleted 1932516 bytes
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:1479 /build/pkg/database/logger.go:56
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.35620806s
|
||||
Combined ops/sec: 2052.86
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 334922 queries in 1m0.011826287s
|
||||
Queries/sec: 5580.93
|
||||
Avg query latency: 2.871941ms
|
||||
P95 query latency: 8.86787ms
|
||||
P99 query latency: 16.075646ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
1763397377131811ℹ️ /tmp/benchmark_khatru-sqlite_8: Block cache metrics: hit: 485497199 miss: 4802603 keys-added: 1628313 keys-updated: 2776240 keys-evicted: 1628292 cost-added: 85662348259200 cost-evicted: 85661362474446 sets-dropped: 0 sets-rejected: 336231 gets-dropped: 382997632 gets-kept: 107185536 gets-total: 490299843 hit-ratio: 0.99
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:454 /build/pkg/database/logger.go:56
|
||||
Concurrent test completed: 266462 operations (216462 queries, 50000 writes) in 1m0.004503525s
|
||||
Operations/sec: 4440.70
|
||||
Avg latency: 1.968296ms
|
||||
Avg query latency: 2.154689ms
|
||||
Avg write latency: 1.161355ms
|
||||
P95 latency: 3.329033ms
|
||||
P99 latency: 4.878236ms
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.697220167s
|
||||
Total Events: 50000
|
||||
Events/sec: 10644.59
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 432 MB
|
||||
Avg Latency: 1.589521ms
|
||||
P90 Latency: 1.927686ms
|
||||
P95 Latency: 2.072081ms
|
||||
P99 Latency: 2.794007ms
|
||||
Bottom 10% Avg Latency: 2.449508ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 9.780316233s
|
||||
Total Events: 50000
|
||||
Events/sec: 5112.31
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 147 MB
|
||||
Avg Latency: 3.589724ms
|
||||
P90 Latency: 7.397294ms
|
||||
P95 Latency: 9.015658ms
|
||||
P99 Latency: 12.848707ms
|
||||
Bottom 10% Avg Latency: 10.286462ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 24.45356557s
|
||||
Total Events: 50000
|
||||
Events/sec: 2044.69
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 189 MB
|
||||
Avg Latency: 439.984µs
|
||||
P90 Latency: 878.495µs
|
||||
P95 Latency: 980.94µs
|
||||
P99 Latency: 1.17514ms
|
||||
Bottom 10% Avg Latency: 1.261937ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.011742602s
|
||||
Total Events: 253442
|
||||
Events/sec: 4223.21
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 165 MB
|
||||
Avg Latency: 4.105842ms
|
||||
P90 Latency: 8.468483ms
|
||||
P95 Latency: 13.288591ms
|
||||
P99 Latency: 23.937862ms
|
||||
Bottom 10% Avg Latency: 15.251447ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.007412985s
|
||||
Total Events: 237910
|
||||
Events/sec: 3964.68
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 149 MB
|
||||
Avg Latency: 2.360698ms
|
||||
P90 Latency: 3.517024ms
|
||||
P95 Latency: 4.390739ms
|
||||
P99 Latency: 6.940329ms
|
||||
Bottom 10% Avg Latency: 5.015416ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.792392684s
|
||||
Total Events: 50000
|
||||
Events/sec: 10433.20
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 523 MB
|
||||
Avg Latency: 1.649743ms
|
||||
P90 Latency: 1.991666ms
|
||||
P95 Latency: 2.145348ms
|
||||
P99 Latency: 2.77034ms
|
||||
Bottom 10% Avg Latency: 2.781523ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 9.775603327s
|
||||
Total Events: 50000
|
||||
Events/sec: 5114.77
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 541 MB
|
||||
Avg Latency: 2.925486ms
|
||||
P90 Latency: 5.542703ms
|
||||
P95 Latency: 7.775478ms
|
||||
P99 Latency: 11.125804ms
|
||||
Bottom 10% Avg Latency: 8.91184ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 24.35620806s
|
||||
Total Events: 50000
|
||||
Events/sec: 2052.86
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 200 MB
|
||||
Avg Latency: 424.333µs
|
||||
P90 Latency: 865.429µs
|
||||
P95 Latency: 968.085µs
|
||||
P99 Latency: 1.174568ms
|
||||
Bottom 10% Avg Latency: 1.224002ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.011826287s
|
||||
Total Events: 334922
|
||||
Events/sec: 5580.93
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 129 MB
|
||||
Avg Latency: 2.871941ms
|
||||
P90 Latency: 5.60422ms
|
||||
P95 Latency: 8.86787ms
|
||||
P99 Latency: 16.075646ms
|
||||
Bottom 10% Avg Latency: 10.23636ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.004503525s
|
||||
Total Events: 266462
|
||||
Events/sec: 4440.70
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 155 MB
|
||||
Avg Latency: 1.968296ms
|
||||
P90 Latency: 2.729181ms
|
||||
P95 Latency: 3.329033ms
|
||||
P99 Latency: 4.878236ms
|
||||
Bottom 10% Avg Latency: 3.768185ms
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.adoc
|
||||
1763397425682348ℹ️ /tmp/benchmark_khatru-sqlite_8: Lifetime L0 stalled for: 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:536 /build/pkg/database/logger.go:56
|
||||
1763397426982581ℹ️ /tmp/benchmark_khatru-sqlite_8:
|
||||
Level 0 [ ]: NumTables: 00. Size: 0 B of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 4 [B]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 5 [ ]: NumTables: 01. Size: 94 MiB of 23 MiB. Score: 4.08->4.08 StaleData: 0 B Target FileSize: 122 MiB
|
||||
Level 6 [ ]: NumTables: 04. Size: 230 MiB of 230 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 244 MiB
|
||||
Level Done
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:615 /build/pkg/database/logger.go:56
|
||||
|
||||
RELAY_NAME: khatru-sqlite
|
||||
RELAY_URL: ws://khatru-sqlite:3334
|
||||
TEST_TIMESTAMP: 2025-11-17T16:37:07+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -1,311 +0,0 @@
|
||||
Starting Nostr Relay Benchmark
|
||||
Data Directory: /tmp/benchmark_next-orly-badger_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763396182850462ℹ️ /tmp/benchmark_next-orly-badger_8: All 0 tables opened in 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:161 /build/pkg/database/logger.go:56
|
||||
1763396182853668ℹ️ /tmp/benchmark_next-orly-badger_8: Discard stats nextEmptySlot: 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/discard.go:55 /build/pkg/database/logger.go:56
|
||||
1763396182853712ℹ️ /tmp/benchmark_next-orly-badger_8: Set nextTxnTs to 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:358 /build/pkg/database/logger.go:56
|
||||
1763396182854009ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763396182854056ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763396182854078ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763396182854082ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763396182854129ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763396182854260ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763396182854271ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763396182854295ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763396182854302ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
|
||||
=== Starting test round 1/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
2025/11/17 16:16:22 INFO: Successfully loaded libsecp256k1 v5.0.0 from libsecp256k1.so.2
|
||||
1763396184854370ℹ️ /tmp/benchmark_next-orly-badger_8: database warmup complete, ready to serve requests
|
||||
/usr/local/go/src/runtime/asm_amd64.s:1693 /build/pkg/database/logger.go:56
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 5.666497805s
|
||||
Events/sec: 8823.79
|
||||
Avg latency: 2.020722ms
|
||||
P90 latency: 2.645436ms
|
||||
P95 latency: 2.995948ms
|
||||
P99 latency: 4.460502ms
|
||||
Bottom 10% Avg latency: 3.520179ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 352.025605ms
|
||||
Burst completed: 5000 events in 363.623929ms
|
||||
Burst completed: 5000 events in 367.475139ms
|
||||
Burst completed: 5000 events in 396.276199ms
|
||||
Burst completed: 5000 events in 334.007635ms
|
||||
Burst completed: 5000 events in 342.086817ms
|
||||
Burst completed: 5000 events in 360.687805ms
|
||||
Burst completed: 5000 events in 392.627451ms
|
||||
Burst completed: 5000 events in 397.635203ms
|
||||
Burst completed: 5000 events in 376.061572ms
|
||||
Burst test completed: 50000 events in 10.132858185s
|
||||
Events/sec: 4934.44
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
1763396242843490ℹ️ /tmp/benchmark_next-orly-badger_8: Block cache metrics: hit: 232171 miss: 337826 keys-added: 235144 keys-updated: 89642 keys-evicted: 235124 cost-added: 12615246695866 cost-evicted: 12614243474391 sets-dropped: 0 sets-rejected: 12961 gets-dropped: 1280 gets-kept: 568192 gets-total: 569997 hit-ratio: 0.41
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:454 /build/pkg/database/logger.go:56
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.625333257s
|
||||
Combined ops/sec: 2030.43
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 197562 queries in 1m0.011972513s
|
||||
Queries/sec: 3292.04
|
||||
Avg query latency: 5.52205ms
|
||||
P95 query latency: 18.40165ms
|
||||
P99 query latency: 32.139723ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 224870 operations (174870 queries, 50000 writes) in 1m0.006047854s
|
||||
Operations/sec: 3747.46
|
||||
Avg latency: 2.665369ms
|
||||
Avg query latency: 2.866192ms
|
||||
Avg write latency: 1.963009ms
|
||||
P95 latency: 5.204253ms
|
||||
P99 latency: 8.129537ms
|
||||
|
||||
Pausing 10s before next round...
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
=== Starting test round 2/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 5.145620568s
|
||||
Events/sec: 9717.00
|
||||
Avg latency: 1.788996ms
|
||||
P90 latency: 2.241725ms
|
||||
P95 latency: 2.442669ms
|
||||
P99 latency: 3.110506ms
|
||||
Bottom 10% Avg latency: 3.016821ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 362.292309ms
|
||||
Burst completed: 5000 events in 446.105376ms
|
||||
Burst completed: 5000 events in 414.443306ms
|
||||
Burst completed: 5000 events in 378.792051ms
|
||||
Burst completed: 5000 events in 381.274883ms
|
||||
Burst completed: 5000 events in 397.941224ms
|
||||
Burst completed: 5000 events in 449.109795ms
|
||||
Burst completed: 5000 events in 410.566974ms
|
||||
Burst completed: 5000 events in 385.220958ms
|
||||
Burst completed: 5000 events in 383.149443ms
|
||||
1763396419122547ℹ️ /tmp/benchmark_next-orly-badger_8: [0] [E] LOG Compact 0->6 (8, 0 -> 4 tables with 1 splits). [00001 00002 00003 00004 00005 00006 00007 00008 . .] -> [00009 00010 00011 00012 .], took 3.061s
|
||||
, deleted 1899050 bytes
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:1479 /build/pkg/database/logger.go:56
|
||||
Burst test completed: 50000 events in 10.438224172s
|
||||
Events/sec: 4790.09
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.485622359s
|
||||
Combined ops/sec: 2042.01
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 293294 queries in 1m0.013023948s
|
||||
Queries/sec: 4887.17
|
||||
Avg query latency: 3.408294ms
|
||||
P95 query latency: 10.965419ms
|
||||
P99 query latency: 19.184675ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
1763396542843038ℹ️ /tmp/benchmark_next-orly-badger_8: Block cache metrics: hit: 411640922 miss: 5406705 keys-added: 1627143 keys-updated: 3422501 keys-evicted: 1627125 cost-added: 84304242021549 cost-evicted: 84303233712402 sets-dropped: 0 sets-rejected: 295382 gets-dropped: 325582080 gets-kept: 91360192 gets-total: 417047650 hit-ratio: 0.99
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:454 /build/pkg/database/logger.go:56
|
||||
Concurrent test completed: 254899 operations (204899 queries, 50000 writes) in 1m0.006656731s
|
||||
Operations/sec: 4247.85
|
||||
Avg latency: 2.125728ms
|
||||
Avg query latency: 2.314927ms
|
||||
Avg write latency: 1.350394ms
|
||||
P95 latency: 3.778776ms
|
||||
P99 latency: 5.393909ms
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 5.666497805s
|
||||
Total Events: 50000
|
||||
Events/sec: 8823.79
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 257 MB
|
||||
Avg Latency: 2.020722ms
|
||||
P90 Latency: 2.645436ms
|
||||
P95 Latency: 2.995948ms
|
||||
P99 Latency: 4.460502ms
|
||||
Bottom 10% Avg Latency: 3.520179ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 10.132858185s
|
||||
Total Events: 50000
|
||||
Events/sec: 4934.44
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 122 MB
|
||||
Avg Latency: 7.197024ms
|
||||
P90 Latency: 12.546513ms
|
||||
P95 Latency: 15.216454ms
|
||||
P99 Latency: 23.682573ms
|
||||
Bottom 10% Avg Latency: 18.172083ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 24.625333257s
|
||||
Total Events: 50000
|
||||
Events/sec: 2030.43
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 120 MB
|
||||
Avg Latency: 467.389µs
|
||||
P90 Latency: 914.891µs
|
||||
P95 Latency: 1.0349ms
|
||||
P99 Latency: 1.268268ms
|
||||
Bottom 10% Avg Latency: 1.393626ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.011972513s
|
||||
Total Events: 197562
|
||||
Events/sec: 3292.04
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 152 MB
|
||||
Avg Latency: 5.52205ms
|
||||
P90 Latency: 12.226879ms
|
||||
P95 Latency: 18.40165ms
|
||||
P99 Latency: 32.139723ms
|
||||
Bottom 10% Avg Latency: 20.985445ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.006047854s
|
||||
Total Events: 224870
|
||||
Events/sec: 3747.46
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 127 MB
|
||||
Avg Latency: 2.665369ms
|
||||
P90 Latency: 4.194993ms
|
||||
P95 Latency: 5.204253ms
|
||||
P99 Latency: 8.129537ms
|
||||
Bottom 10% Avg Latency: 5.884586ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 5.145620568s
|
||||
Total Events: 50000
|
||||
Events/sec: 9717.00
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 522 MB
|
||||
Avg Latency: 1.788996ms
|
||||
P90 Latency: 2.241725ms
|
||||
P95 Latency: 2.442669ms
|
||||
P99 Latency: 3.110506ms
|
||||
Bottom 10% Avg Latency: 3.016821ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 10.438224172s
|
||||
Total Events: 50000
|
||||
Events/sec: 4790.09
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 623 MB
|
||||
Avg Latency: 9.406859ms
|
||||
P90 Latency: 21.810715ms
|
||||
P95 Latency: 35.119382ms
|
||||
P99 Latency: 66.001509ms
|
||||
Bottom 10% Avg Latency: 39.782175ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 24.485622359s
|
||||
Total Events: 50000
|
||||
Events/sec: 2042.01
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 165 MB
|
||||
Avg Latency: 445.318µs
|
||||
P90 Latency: 907.915µs
|
||||
P95 Latency: 1.021172ms
|
||||
P99 Latency: 1.227095ms
|
||||
Bottom 10% Avg Latency: 1.265835ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.013023948s
|
||||
Total Events: 293294
|
||||
Events/sec: 4887.17
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 136 MB
|
||||
Avg Latency: 3.408294ms
|
||||
P90 Latency: 7.156129ms
|
||||
P95 Latency: 10.965419ms
|
||||
P99 Latency: 19.184675ms
|
||||
Bottom 10% Avg Latency: 12.469832ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.006656731s
|
||||
Total Events: 254899
|
||||
Events/sec: 4247.85
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 147 MB
|
||||
Avg Latency: 2.125728ms
|
||||
P90 Latency: 3.131901ms
|
||||
P95 Latency: 3.778776ms
|
||||
P99 Latency: 5.393909ms
|
||||
Bottom 10% Avg Latency: 4.22837ms
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_next-orly-badger_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_next-orly-badger_8/benchmark_report.adoc
|
||||
1763396593981772ℹ️ /tmp/benchmark_next-orly-badger_8: Lifetime L0 stalled for: 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:536 /build/pkg/database/logger.go:56
|
||||
1763396595378747ℹ️ /tmp/benchmark_next-orly-badger_8:
|
||||
Level 0 [ ]: NumTables: 00. Size: 0 B of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 4 [B]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 5 [ ]: NumTables: 01. Size: 94 MiB of 23 MiB. Score: 4.08->4.08 StaleData: 0 B Target FileSize: 122 MiB
|
||||
Level 6 [ ]: NumTables: 04. Size: 230 MiB of 230 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 244 MiB
|
||||
Level Done
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:615 /build/pkg/database/logger.go:56
|
||||
|
||||
RELAY_NAME: next-orly-badger
|
||||
RELAY_URL: ws://next-orly-badger:8080
|
||||
TEST_TIMESTAMP: 2025-11-17T16:23:15+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -1,323 +0,0 @@
|
||||
Starting Nostr Relay Benchmark
|
||||
Data Directory: /tmp/benchmark_next-orly-dgraph_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763396600574205ℹ️ /tmp/benchmark_next-orly-dgraph_8: All 0 tables opened in 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:161 /build/pkg/database/logger.go:56
|
||||
1763396600577795ℹ️ /tmp/benchmark_next-orly-dgraph_8: Discard stats nextEmptySlot: 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/discard.go:55 /build/pkg/database/logger.go:56
|
||||
1763396600577852ℹ️ /tmp/benchmark_next-orly-dgraph_8: Set nextTxnTs to 0
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:358 /build/pkg/database/logger.go:56
|
||||
1763396600578216ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763396600578287ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763396600578319ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763396600578325ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763396600578334ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763396600578350ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763396600578355ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763396600578372ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763396600578378ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
|
||||
=== Starting test round 1/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
2025/11/17 16:23:20 INFO: Successfully loaded libsecp256k1 v5.0.0 from libsecp256k1.so.2
|
||||
1763396602578437ℹ️ /tmp/benchmark_next-orly-dgraph_8: database warmup complete, ready to serve requests
|
||||
/usr/local/go/src/runtime/asm_amd64.s:1693 /build/pkg/database/logger.go:56
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 4.932431923s
|
||||
Events/sec: 10136.99
|
||||
Avg latency: 1.667317ms
|
||||
P90 latency: 2.069461ms
|
||||
P95 latency: 2.249895ms
|
||||
P99 latency: 2.861303ms
|
||||
Bottom 10% Avg latency: 2.592597ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 335.655402ms
|
||||
Burst completed: 5000 events in 330.360552ms
|
||||
Burst completed: 5000 events in 350.90491ms
|
||||
Burst completed: 5000 events in 373.041958ms
|
||||
Burst completed: 5000 events in 347.11564ms
|
||||
Burst completed: 5000 events in 315.949199ms
|
||||
Burst completed: 5000 events in 331.42993ms
|
||||
Burst completed: 5000 events in 352.164361ms
|
||||
Burst completed: 5000 events in 359.115619ms
|
||||
Burst completed: 5000 events in 360.397544ms
|
||||
Burst test completed: 50000 events in 9.808342155s
|
||||
Events/sec: 5097.70
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.59623701s
|
||||
Combined ops/sec: 2032.83
|
||||
1763396660567060⚠️ /tmp/benchmark_next-orly-dgraph_8: Block cache might be too small. Metrics: hit: 153935 miss: 305257 keys-added: 227607 keys-updated: 64636 keys-evicted: 227588 cost-added: 12452581576986 cost-evicted: 12451583862757 sets-dropped: 0 sets-rejected: 12954 gets-dropped: 256 gets-kept: 458496 gets-total: 459192 hit-ratio: 0.34
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:450 /build/pkg/database/logger.go:46
|
||||
1763396660567121⚠️ /tmp/benchmark_next-orly-dgraph_8: Cache life expectancy (in seconds):
|
||||
-- Histogram:
|
||||
Min value: 0
|
||||
Max value: 11
|
||||
Count: 227588
|
||||
50p: 2.00
|
||||
75p: 2.00
|
||||
90p: 2.00
|
||||
[0, 2) 227552 99.98% 99.98%
|
||||
[8, 16) 36 0.02% 100.00%
|
||||
--
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:451 /build/pkg/database/logger.go:46
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 221626 queries in 1m0.014161671s
|
||||
Queries/sec: 3692.90
|
||||
Avg query latency: 4.849059ms
|
||||
P95 query latency: 15.966874ms
|
||||
P99 query latency: 27.859712ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 235023 operations (185023 queries, 50000 writes) in 1m0.005568823s
|
||||
Operations/sec: 3916.69
|
||||
Avg latency: 2.401379ms
|
||||
Avg query latency: 2.672573ms
|
||||
Avg write latency: 1.397837ms
|
||||
P95 latency: 4.398002ms
|
||||
P99 latency: 6.207183ms
|
||||
|
||||
Pausing 10s before next round...
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
=== Starting test round 2/2 ===
|
||||
RunPeakThroughputTest..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
Events saved: 50000/50000 (100.0%)
|
||||
Duration: 5.127096799s
|
||||
Events/sec: 9752.11
|
||||
Avg latency: 1.795821ms
|
||||
P90 latency: 2.25461ms
|
||||
P95 latency: 2.466785ms
|
||||
P99 latency: 3.159176ms
|
||||
Bottom 10% Avg latency: 3.072242ms
|
||||
RunBurstPatternTest..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 358.012209ms
|
||||
Burst completed: 5000 events in 336.300441ms
|
||||
Burst completed: 5000 events in 363.657063ms
|
||||
Burst completed: 5000 events in 356.771817ms
|
||||
Burst completed: 5000 events in 368.000986ms
|
||||
Burst completed: 5000 events in 441.821658ms
|
||||
Burst completed: 5000 events in 451.146122ms
|
||||
Burst completed: 5000 events in 455.159014ms
|
||||
Burst completed: 5000 events in 359.826504ms
|
||||
Burst completed: 5000 events in 358.602207ms
|
||||
1763396835570723ℹ️ /tmp/benchmark_next-orly-dgraph_8: [6] [E] LOG Compact 0->6 (8, 0 -> 4 tables with 1 splits). [00001 00002 00003 00004 00005 00006 00007 00008 . .] -> [00009 00010 00011 00012 .], took 3.055s
|
||||
, deleted 1901003 bytes
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/levels.go:1479 /build/pkg/database/logger.go:56
|
||||
Burst test completed: 50000 events in 10.25458455s
|
||||
Events/sec: 4875.87
|
||||
RunMixedReadWriteTest..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 25000 writes, 25000 reads in 24.474786024s
|
||||
Combined ops/sec: 2042.92
|
||||
RunQueryTest..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 287727 queries in 1m0.012156857s
|
||||
Queries/sec: 4794.48
|
||||
Avg query latency: 3.504598ms
|
||||
P95 query latency: 11.416502ms
|
||||
P99 query latency: 19.871886ms
|
||||
RunConcurrentQueryStoreTest..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
1763396960566384ℹ️ /tmp/benchmark_next-orly-dgraph_8: Block cache metrics: hit: 436764091 miss: 4871096 keys-added: 1584381 keys-updated: 2919606 keys-evicted: 1584361 cost-added: 83226283032882 cost-evicted: 83225259887553 sets-dropped: 0 sets-rejected: 305847 gets-dropped: 344794880 gets-kept: 96734656 gets-total: 441635219 hit-ratio: 0.99
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:454 /build/pkg/database/logger.go:56
|
||||
Concurrent test completed: 252209 operations (202209 queries, 50000 writes) in 1m0.008028818s
|
||||
Operations/sec: 4202.92
|
||||
Avg latency: 2.189461ms
|
||||
Avg query latency: 2.337704ms
|
||||
Avg write latency: 1.58994ms
|
||||
P95 latency: 3.919323ms
|
||||
P99 latency: 5.959314ms
|
||||
|
||||
=== Test round completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.932431923s
|
||||
Total Events: 50000
|
||||
Events/sec: 10136.99
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 432 MB
|
||||
Avg Latency: 1.667317ms
|
||||
P90 Latency: 2.069461ms
|
||||
P95 Latency: 2.249895ms
|
||||
P99 Latency: 2.861303ms
|
||||
Bottom 10% Avg Latency: 2.592597ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 9.808342155s
|
||||
Total Events: 50000
|
||||
Events/sec: 5097.70
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 149 MB
|
||||
Avg Latency: 3.805495ms
|
||||
P90 Latency: 6.632151ms
|
||||
P95 Latency: 8.069195ms
|
||||
P99 Latency: 13.244195ms
|
||||
Bottom 10% Avg Latency: 9.922762ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 24.59623701s
|
||||
Total Events: 50000
|
||||
Events/sec: 2032.83
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 121 MB
|
||||
Avg Latency: 467.746µs
|
||||
P90 Latency: 911.189µs
|
||||
P95 Latency: 1.018554ms
|
||||
P99 Latency: 1.250848ms
|
||||
Bottom 10% Avg Latency: 1.345857ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.014161671s
|
||||
Total Events: 221626
|
||||
Events/sec: 3692.90
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 125 MB
|
||||
Avg Latency: 4.849059ms
|
||||
P90 Latency: 10.564822ms
|
||||
P95 Latency: 15.966874ms
|
||||
P99 Latency: 27.859712ms
|
||||
Bottom 10% Avg Latency: 18.180391ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.005568823s
|
||||
Total Events: 235023
|
||||
Events/sec: 3916.69
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 177 MB
|
||||
Avg Latency: 2.401379ms
|
||||
P90 Latency: 3.659643ms
|
||||
P95 Latency: 4.398002ms
|
||||
P99 Latency: 6.207183ms
|
||||
Bottom 10% Avg Latency: 4.857955ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 5.127096799s
|
||||
Total Events: 50000
|
||||
Events/sec: 9752.11
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 480 MB
|
||||
Avg Latency: 1.795821ms
|
||||
P90 Latency: 2.25461ms
|
||||
P95 Latency: 2.466785ms
|
||||
P99 Latency: 3.159176ms
|
||||
Bottom 10% Avg Latency: 3.072242ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 10.25458455s
|
||||
Total Events: 50000
|
||||
Events/sec: 4875.87
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 621 MB
|
||||
Avg Latency: 9.266976ms
|
||||
P90 Latency: 24.12544ms
|
||||
P95 Latency: 34.465042ms
|
||||
P99 Latency: 55.446215ms
|
||||
Bottom 10% Avg Latency: 37.317916ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 24.474786024s
|
||||
Total Events: 50000
|
||||
Events/sec: 2042.92
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 182 MB
|
||||
Avg Latency: 452.46µs
|
||||
P90 Latency: 909.806µs
|
||||
P95 Latency: 1.014516ms
|
||||
P99 Latency: 1.214797ms
|
||||
Bottom 10% Avg Latency: 1.304994ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.012156857s
|
||||
Total Events: 287727
|
||||
Events/sec: 4794.48
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 150 MB
|
||||
Avg Latency: 3.504598ms
|
||||
P90 Latency: 7.480817ms
|
||||
P95 Latency: 11.416502ms
|
||||
P99 Latency: 19.871886ms
|
||||
Bottom 10% Avg Latency: 12.934864ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.008028818s
|
||||
Total Events: 252209
|
||||
Events/sec: 4202.92
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 98 MB
|
||||
Avg Latency: 2.189461ms
|
||||
P90 Latency: 3.213337ms
|
||||
P95 Latency: 3.919323ms
|
||||
P99 Latency: 5.959314ms
|
||||
Bottom 10% Avg Latency: 4.521426ms
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_next-orly-dgraph_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_next-orly-dgraph_8/benchmark_report.adoc
|
||||
1763397010410098ℹ️ /tmp/benchmark_next-orly-dgraph_8: Lifetime L0 stalled for: 0s
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:536 /build/pkg/database/logger.go:56
|
||||
1763397011943178ℹ️ /tmp/benchmark_next-orly-dgraph_8:
|
||||
Level 0 [ ]: NumTables: 00. Size: 0 B of 0 B. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 1 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 2 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 3 [ ]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 4 [B]: NumTables: 00. Size: 0 B of 10 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 61 MiB
|
||||
Level 5 [ ]: NumTables: 01. Size: 94 MiB of 23 MiB. Score: 4.08->4.08 StaleData: 0 B Target FileSize: 122 MiB
|
||||
Level 6 [ ]: NumTables: 04. Size: 230 MiB of 230 MiB. Score: 0.00->0.00 StaleData: 0 B Target FileSize: 244 MiB
|
||||
Level Done
|
||||
/go/pkg/mod/github.com/dgraph-io/badger/v4@v4.8.0/db.go:615 /build/pkg/database/logger.go:56
|
||||
|
||||
RELAY_NAME: next-orly-dgraph
|
||||
RELAY_URL: ws://next-orly-dgraph:8080
|
||||
TEST_TIMESTAMP: 2025-11-17T16:30:12+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
176
cmd/benchmark/reports/run_20251119_054648/aggregate_report.txt
Normal file
176
cmd/benchmark/reports/run_20251119_054648/aggregate_report.txt
Normal file
@@ -0,0 +1,176 @@
|
||||
================================================================
|
||||
NOSTR RELAY BENCHMARK AGGREGATE REPORT
|
||||
================================================================
|
||||
Generated: 2025-11-19T06:13:40+00:00
|
||||
Benchmark Configuration:
|
||||
Events per test: 50000
|
||||
Concurrent workers: 24
|
||||
Test duration: 60s
|
||||
|
||||
Relays tested: 8
|
||||
|
||||
================================================================
|
||||
SUMMARY BY RELAY
|
||||
================================================================
|
||||
|
||||
Relay: next-orly-badger
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2911.52
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2911.52
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 3.938925ms
|
||||
Bottom 10% Avg Latency: 1.115318ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 4.624387ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 112.915µs
|
||||
|
||||
Relay: next-orly-dgraph
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2661.66
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2661.66
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 4.795769ms
|
||||
Bottom 10% Avg Latency: 1.212562ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 6.029522ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 115.35µs
|
||||
|
||||
Relay: next-orly-neo4j
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2827.54
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2827.54
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 4.203722ms
|
||||
Bottom 10% Avg Latency: 1.124184ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 4.568189ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 112.755µs
|
||||
|
||||
Relay: khatru-sqlite
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2840.91
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2840.91
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 4.23095ms
|
||||
Bottom 10% Avg Latency: 1.142932ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 4.703046ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 113.897µs
|
||||
|
||||
Relay: khatru-badger
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2885.30
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2885.30
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 3.985846ms
|
||||
Bottom 10% Avg Latency: 1.120349ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 4.23797ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 114.277µs
|
||||
|
||||
Relay: relayer-basic
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2707.76
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2707.76
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 4.657987ms
|
||||
Bottom 10% Avg Latency: 1.266467ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 5.603449ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 112.123µs
|
||||
|
||||
Relay: strfry
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2841.22
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2841.22
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 4.088506ms
|
||||
Bottom 10% Avg Latency: 1.135387ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 4.517428ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 113.396µs
|
||||
|
||||
Relay: nostr-rs-relay
|
||||
----------------------------------------
|
||||
Status: COMPLETED
|
||||
Events/sec: 2883.32
|
||||
Events/sec: 0.00
|
||||
Events/sec: 2883.32
|
||||
Success Rate: 23.2%
|
||||
Success Rate: 0.0%
|
||||
Success Rate: 50.0%
|
||||
Avg Latency: 4.044321ms
|
||||
Bottom 10% Avg Latency: 1.103637ms
|
||||
Avg Latency: 0s
|
||||
P95 Latency: 4.602719ms
|
||||
P95 Latency: 0s
|
||||
P95 Latency: 114.679µs
|
||||
|
||||
|
||||
================================================================
|
||||
DETAILED RESULTS
|
||||
================================================================
|
||||
|
||||
Individual relay reports are available in:
|
||||
- /reports/run_20251119_054648/khatru-badger_results.txt
|
||||
- /reports/run_20251119_054648/khatru-sqlite_results.txt
|
||||
- /reports/run_20251119_054648/next-orly-badger_results.txt
|
||||
- /reports/run_20251119_054648/next-orly-dgraph_results.txt
|
||||
- /reports/run_20251119_054648/next-orly-neo4j_results.txt
|
||||
- /reports/run_20251119_054648/nostr-rs-relay_results.txt
|
||||
- /reports/run_20251119_054648/relayer-basic_results.txt
|
||||
- /reports/run_20251119_054648/strfry_results.txt
|
||||
|
||||
================================================================
|
||||
BENCHMARK COMPARISON TABLE
|
||||
================================================================
|
||||
|
||||
Relay Status Peak Tput/s Avg Latency Success Rate
|
||||
---- ------ ----------- ----------- ------------
|
||||
next-orly-badger OK 2911.52 3.938925ms 23.2%
|
||||
next-orly-dgraph OK 2661.66 4.795769ms 23.2%
|
||||
next-orly-neo4j OK 2827.54 4.203722ms 23.2%
|
||||
khatru-sqlite OK 2840.91 4.23095ms 23.2%
|
||||
khatru-badger OK 2885.30 3.985846ms 23.2%
|
||||
relayer-basic OK 2707.76 4.657987ms 23.2%
|
||||
strfry OK 2841.22 4.088506ms 23.2%
|
||||
nostr-rs-relay OK 2883.32 4.044321ms 23.2%
|
||||
|
||||
================================================================
|
||||
End of Report
|
||||
================================================================
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_khatru-badger_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763532013820368ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763532013820438ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763532013820599ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763532013820636ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763532013820660ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763532013820689ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763532013820696ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763532013820709ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763532013820716ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763532014234684🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014251555🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014251585🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014251639🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014254033🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014254683🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014260808🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014260870🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014260812🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014277104🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014277657🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014278205🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014278285🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014336903🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014363478🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014364290🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014364354🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014372904🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014372959🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532014372971⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532014372938🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014373003🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532014373014⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532014383001🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014388837🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014388919🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014391202🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014391216🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014395794🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014396847🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014396979🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014396873🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014396880🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014396846🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014397913🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014398032🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014398153🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014398247🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014398524🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014400310🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014403460🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014403895🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014404002🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014470332🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014934773🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014936459🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014936494🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014936497🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014937911🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014939536🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014940367🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014941984🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014942689🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014942709🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014942750🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014942741🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014942816🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014943338🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014943451🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014943893🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014944522🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014944537🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014945141🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014946012🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014946045🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532014946054⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532014952520🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014952585🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014952570🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014952563🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014952804🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014952823🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014962010🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014964509🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014966546🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014967125🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014967251🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014967275🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532014967285⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532014967615🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014967952🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014968056🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014969528🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014970610🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014971146🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014971229🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014972191🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014972290🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014972853🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014972895🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014974659🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014974684🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014974733🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014974970🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014975040🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014977640🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014978813🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014978844🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014979660🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014980760🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014981739🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014984695🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014987050🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014990255🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014990268🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014993000🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014993071🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014996648🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014997887🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014997959🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014999208🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532014999202🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015000529🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015000865🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015000886🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532015000896⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532015002409🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015004222🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015004801🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015008082🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015008121🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015009296🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015009474🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015009686🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015012705🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015012722🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015012772🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532015012781⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532015012725🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015013275🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015015485🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015019833🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015020302🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015020468🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015021079🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015021179🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015021350🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532015021469⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532015064798🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015093196🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015094045🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015094353🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015095456🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015095647🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015096130🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015097710🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015098568🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015098646🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015098916🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015098980🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015099247🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015099372🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015108396🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015119916🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015119977🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015120078🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015120399🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015120616🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015122335🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015122440🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015123578🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015124232🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015124271🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015124633🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015125046🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015125334🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015125478🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015126491🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015128111🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015129915🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015130524🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015130922🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015130936🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532015130947⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532015132041🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015132140🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015132159🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532015132169⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532015132455🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015133481🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015135204🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015136901🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015139167🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015139314🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015139559🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015141275🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015142111🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015142160🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015142311🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015142362🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015142802🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015144182🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015145669🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015146606🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015146730🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015146734🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015146823🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015149126🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015149475🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015150317🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015150316🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015151297🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015151530🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015153167🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015153511🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015153573🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015155305🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015155850🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015156230🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015156939🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015156993🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015157067🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015157244🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015157507🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015157735🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015158040🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015158976🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015158977🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015159156🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015169407🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015169419🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015169831🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015169843🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015170898🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015171507🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015171504🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015171625🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015171670🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015171725🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015171739🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532015172695🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11594/50000 (23.2%), errors: 38406
|
||||
Duration: 4.018301066s
|
||||
Events/sec: 2885.30
|
||||
Avg latency: 3.985846ms
|
||||
P90 latency: 3.336914ms
|
||||
P95 latency: 4.23797ms
|
||||
P99 latency: 73.250512ms
|
||||
Bottom 10% Avg latency: 1.120349ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 340.161594ms
|
||||
Burst completed: 5000 events in 341.757352ms
|
||||
Burst completed: 5000 events in 343.518235ms
|
||||
Burst completed: 5000 events in 351.096045ms
|
||||
Burst completed: 5000 events in 332.761293ms
|
||||
Burst completed: 5000 events in 335.458889ms
|
||||
Burst completed: 5000 events in 331.664424ms
|
||||
Burst completed: 5000 events in 347.834073ms
|
||||
Burst completed: 5000 events in 356.191406ms
|
||||
Burst completed: 5000 events in 335.250061ms
|
||||
Burst test completed: 0 events in 8.421134295s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.626390359s
|
||||
Combined ops/sec: 1104.90
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 403899 queries in 1m0.00394972s
|
||||
Queries/sec: 6731.21
|
||||
Avg query latency: 1.574327ms
|
||||
P95 query latency: 5.370236ms
|
||||
P99 query latency: 9.259041ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 564827 operations (564827 queries, 0 writes) in 1m0.001868516s
|
||||
Operations/sec: 9413.49
|
||||
Avg latency: 45.49µs
|
||||
Avg query latency: 45.49µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 87.116µs
|
||||
P99 latency: 128.965µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.018301066s
|
||||
Total Events: 11594
|
||||
Events/sec: 2885.30
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 398 MB
|
||||
Avg Latency: 3.985846ms
|
||||
P90 Latency: 3.336914ms
|
||||
P95 Latency: 4.23797ms
|
||||
P99 Latency: 73.250512ms
|
||||
Bottom 10% Avg Latency: 1.120349ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.421134295s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 226 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.626390359s
|
||||
Total Events: 25000
|
||||
Events/sec: 1104.90
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 400 MB
|
||||
Avg Latency: 82.006µs
|
||||
P90 Latency: 103.006µs
|
||||
P95 Latency: 114.277µs
|
||||
P99 Latency: 141.409µs
|
||||
Bottom 10% Avg Latency: 128.204µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 193c67d51dab9dc19eeebcde810364f2ba7d105ab9206de1f4f0f884db23e6e2
|
||||
- blocked: event already exists: 06061b630fd0881cbe7ed02114584fea59b9621c2e9479e6e6aa2be561240a90
|
||||
- blocked: event already exists: 1642d6770a74de7ca45169bc76dab334591bcb2191044da0b18459888164f9fc
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 11aa0b6defe3d58cef2f93c06fb194bc72241f17fb35312594d279f6c8f13d44
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.00394972s
|
||||
Total Events: 403899
|
||||
Events/sec: 6731.21
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 343 MB
|
||||
Avg Latency: 1.574327ms
|
||||
P90 Latency: 4.377275ms
|
||||
P95 Latency: 5.370236ms
|
||||
P99 Latency: 9.259041ms
|
||||
Bottom 10% Avg Latency: 6.283482ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.001868516s
|
||||
Total Events: 564827
|
||||
Events/sec: 9413.49
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 314 MB
|
||||
Avg Latency: 45.49µs
|
||||
P90 Latency: 77.518µs
|
||||
P95 Latency: 87.116µs
|
||||
P99 Latency: 128.965µs
|
||||
Bottom 10% Avg Latency: 98.509µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 0ce484c600cb1c0b33f1e38ddea4b38a47069615d22114a9c621a9164d9b6218
|
||||
- blocked: event already exists: 0e0b4dfd5e4ecfb0d3acb8db48d13833edeac5163fbcba9fb94160b686c07595
|
||||
- blocked: event already exists: 048d7b07155b3832a76eac0b46bea764cac3597dfbc28b559698d51f915cb6d1
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
- blocked: event already exists: 03edc6b095b2a314733ea3dc689bb54e8739d443e9e69dd61334a5d376bf72a4
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_khatru-badger_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_khatru-badger_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: khatru-badger
|
||||
RELAY_URL: ws://khatru-badger:3334
|
||||
TEST_TIMESTAMP: 2025-11-19T06:03:30+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_khatru-sqlite_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763531812447164ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763531812447229ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763531812447253ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763531812447258ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763531812447267ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763531812447280ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763531812447284ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763531812447299ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763531812447305ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763531812868715🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812885777🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812885785🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812885781🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812888045🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812888883🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812894492🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812894803🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812894864🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812906496🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812906886🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812907798🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812907811🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812970866🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812994211🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812994242🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531812995432🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813002343🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813002408🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813002419⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813002352🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813002444🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813002453⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813015072🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813021384🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813021454🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813024080🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813024096🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813028103🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813028164🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813028163🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813028172🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813029347🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813029380🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813029352🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813029730🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813030214🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813030785🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813030957🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813031557🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813035531🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813036469🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813036495🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813099067🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813562314🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813562971🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813565216🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813565216🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813567538🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813567585🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813567716🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813568218🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813568287🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813569557🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813570316🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813570360🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813570365🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813571136🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813571233🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813572029🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813572530🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813572639🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813574021🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813574064🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813574094🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813574102⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813580239🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813580983🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813581043🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813581051🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813581057🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813582095🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813591212🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813592938🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813595510🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813595557🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813595567⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813596639🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813597830🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813597913🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813597995🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813598000🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813601235🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813601369🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813601858🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813603356🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813603525🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813604715🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813604863🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813605574🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813605606🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813607117🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813607278🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813607509🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813607624🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813612677🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813612797🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813614702🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813614764🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813614882🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813617726🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813623543🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813625833🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813626707🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813627647🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813632382🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813632571🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813635724🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813636426🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813636441🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813639483🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813639507🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813639674🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813639722🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813639732🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813639741⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813640713🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813643809🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813644009🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813647476🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813647510🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813647627🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813648800🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813648916🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813650458🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813651830🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813651871🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813651882⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813652883🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813652944🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813653924🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813659588🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813659716🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813659733🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813660461🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813660671🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813660696🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813660706⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813665655🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813667093🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813669863🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813669986🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813670282🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813717436🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813717882🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813717901🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813718988🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813719942🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813721821🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813738580🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813738746🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813739264🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813748490🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813759607🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813759605🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813760687🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813762309🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813765035🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813765052🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813765323🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813765579🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813765764🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813766675🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813766899🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813767155🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813767196🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813772016🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813772674🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813776484🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813776639🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813778873🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813779242🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813779285🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813779295⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813779456🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813779483🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531813779497⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531813779697🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813780185🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813781185🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813785435🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813786078🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813787727🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813788738🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813788858🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813791644🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813791838🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813791870🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813792007🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813792229🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813793643🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813795596🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813796358🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813797479🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813798679🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813800350🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813800531🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813800925🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813800936🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813800925🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813803971🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813803969🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813804958🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813806100🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813817052🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813817048🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813818064🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813818135🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813818275🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813818876🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813818912🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813819267🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813819296🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813819709🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813820510🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813820746🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813821066🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813821216🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813821322🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813821776🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813822026🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813822031🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813826902🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813827998🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813828498🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813828596🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813828687🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813828721🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813828601🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813829312🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531813830658🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11596/50000 (23.2%), errors: 38404
|
||||
Duration: 4.081787895s
|
||||
Events/sec: 2840.91
|
||||
Avg latency: 4.23095ms
|
||||
P90 latency: 3.400435ms
|
||||
P95 latency: 4.703046ms
|
||||
P99 latency: 81.047331ms
|
||||
Bottom 10% Avg latency: 1.142932ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 346.663376ms
|
||||
Burst completed: 5000 events in 333.067587ms
|
||||
Burst completed: 5000 events in 330.484528ms
|
||||
Burst completed: 5000 events in 338.487447ms
|
||||
Burst completed: 5000 events in 341.447764ms
|
||||
Burst completed: 5000 events in 364.127901ms
|
||||
Burst completed: 5000 events in 344.947769ms
|
||||
Burst completed: 5000 events in 341.432775ms
|
||||
Burst completed: 5000 events in 347.698657ms
|
||||
Burst completed: 5000 events in 341.10947ms
|
||||
Burst test completed: 0 events in 8.436449617s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.467041454s
|
||||
Combined ops/sec: 1112.74
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 408433 queries in 1m0.005096356s
|
||||
Queries/sec: 6806.64
|
||||
Avg query latency: 1.551089ms
|
||||
P95 query latency: 5.244046ms
|
||||
P99 query latency: 9.025085ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 564551 operations (564551 queries, 0 writes) in 1m0.000283858s
|
||||
Operations/sec: 9409.14
|
||||
Avg latency: 45.619µs
|
||||
Avg query latency: 45.619µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 87.236µs
|
||||
P99 latency: 130.949µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.081787895s
|
||||
Total Events: 11596
|
||||
Events/sec: 2840.91
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 384 MB
|
||||
Avg Latency: 4.23095ms
|
||||
P90 Latency: 3.400435ms
|
||||
P95 Latency: 4.703046ms
|
||||
P99 Latency: 81.047331ms
|
||||
Bottom 10% Avg Latency: 1.142932ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.436449617s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 215 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.467041454s
|
||||
Total Events: 25000
|
||||
Events/sec: 1112.74
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 385 MB
|
||||
Avg Latency: 82.061µs
|
||||
P90 Latency: 102.695µs
|
||||
P95 Latency: 113.897µs
|
||||
P99 Latency: 140.147µs
|
||||
Bottom 10% Avg Latency: 129.144µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 06061b630fd0881cbe7ed02114584fea59b9621c2e9479e6e6aa2be561240a90
|
||||
- blocked: event already exists: 048d7b07155b3832a76eac0b46bea764cac3597dfbc28b559698d51f915cb6d1
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 11aa0b6defe3d58cef2f93c06fb194bc72241f17fb35312594d279f6c8f13d44
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.005096356s
|
||||
Total Events: 408433
|
||||
Events/sec: 6806.64
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 366 MB
|
||||
Avg Latency: 1.551089ms
|
||||
P90 Latency: 4.323112ms
|
||||
P95 Latency: 5.244046ms
|
||||
P99 Latency: 9.025085ms
|
||||
Bottom 10% Avg Latency: 6.133631ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.000283858s
|
||||
Total Events: 564551
|
||||
Events/sec: 9409.14
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 353 MB
|
||||
Avg Latency: 45.619µs
|
||||
P90 Latency: 77.388µs
|
||||
P95 Latency: 87.236µs
|
||||
P99 Latency: 130.949µs
|
||||
Bottom 10% Avg Latency: 98.767µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 01e9943cf5e805283c512b9c26cf69f7e9ff412710d7543a3a52dc93ac7e8a57
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 03edc6b095b2a314733ea3dc689bb54e8739d443e9e69dd61334a5d376bf72a4
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_khatru-sqlite_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: khatru-sqlite
|
||||
RELAY_URL: ws://khatru-sqlite:3334
|
||||
TEST_TIMESTAMP: 2025-11-19T06:00:08+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_next-orly-badger_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763531208053542ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763531208053690ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763531208053742ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763531208053750ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763531208053760ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763531208053778ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763531208053784ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763531208053801ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763531208053808ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763531208465992🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208483000🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208483002🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208483661🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208485058🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208485701🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208491992🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208492314🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208492945🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208507228🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208507404🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208507623🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208508352🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208565748🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208593189🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208593671🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208594027🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208602302🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208602343🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531208602353⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531208602584🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208602605🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531208602611⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531208610060🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208618508🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208618604🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208622203🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208622231🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626334🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626349🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626357🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626874🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626909🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626885🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208626879🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208627275🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208627366🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208628641🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208628657🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208630021🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208632589🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208633861🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208633918🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531208707199🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209162276🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209162272🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209162817🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209162842🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209165303🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209165301🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209166674🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209166730🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209167368🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209167390🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209167886🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209168683🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209168686🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209169118🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209169150🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209170268🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209170273🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209170304🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209171666🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209171826🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209171854🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209171863⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209177425🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209177559🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209178508🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209178569🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209178611🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209179115🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209187446🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209190525🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209192408🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209192833🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209193582🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209193679🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209193698🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209193706🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209193707⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209193752🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209195157🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209197056🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209197225🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209197585🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209198217🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209198927🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209198996🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209199967🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209200128🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209200229🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209201976🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209202454🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209202456🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209204631🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209204834🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209205952🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209206128🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209206132🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209208116🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209211081🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209213252🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209214253🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209215036🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209218532🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209219160🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209222863🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209222881🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209222965🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209224623🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209225425🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209225575🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209225925🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209225963🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209225976⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209227378🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209230128🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209231247🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209234368🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209234474🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209235586🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209235721🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209235726🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209237302🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209237697🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209238490🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209238511🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209238521⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209238633🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209240817🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209244908🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209246392🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209247168🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209247218🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209247624🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209247733🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209247887⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209258006🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209279804🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209281422🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209281504🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209282064🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209282725🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209302439🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209302967🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209303684🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209304213🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209304357🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209304523🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209304583🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209305101🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209330784🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209340122🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209340215🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209345768🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209346170🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209346179🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209346425🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209346897🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209347883🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209347912🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209347965🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209348714🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209349164🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209349193🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209350881🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209350968🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209352091🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209353585🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209355263🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209355876🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209355928🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209355941⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209355985🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209356002🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531209356010⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531209356081🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209356450🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209356604🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209359937🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209360087🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209361772🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209361849🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209362879🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209363754🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209365054🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209365110🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209365144🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209365175🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209366595🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209366598🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209368981🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209369366🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209369921🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209369991🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209370020🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209371151🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209372195🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209372361🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209372416🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209372441🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209374373🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209375330🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209375383🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209375621🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209376946🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209376950🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209377448🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209377499🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209378356🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209378357🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209378418🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209378454🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209382899🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209383451🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209387993🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209388236🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209401957🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209402627🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209402903🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209403446🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209403453🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209404336🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209404676🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209404984🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209405085🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209405676🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209405823🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209405861🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531209406920🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11592/50000 (23.2%), errors: 38408
|
||||
Duration: 3.98141893s
|
||||
Events/sec: 2911.52
|
||||
Avg latency: 3.938925ms
|
||||
P90 latency: 3.357143ms
|
||||
P95 latency: 4.624387ms
|
||||
P99 latency: 71.546396ms
|
||||
Bottom 10% Avg latency: 1.115318ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 342.062444ms
|
||||
Burst completed: 5000 events in 342.428441ms
|
||||
Burst completed: 5000 events in 331.568769ms
|
||||
Burst completed: 5000 events in 325.104719ms
|
||||
Burst completed: 5000 events in 336.284199ms
|
||||
Burst completed: 5000 events in 336.312002ms
|
||||
Burst completed: 5000 events in 336.094447ms
|
||||
Burst completed: 5000 events in 333.072923ms
|
||||
Burst completed: 5000 events in 350.917627ms
|
||||
Burst completed: 5000 events in 329.621891ms
|
||||
Burst test completed: 0 events in 8.368751649s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.617040249s
|
||||
Combined ops/sec: 1105.36
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 404906 queries in 1m0.003855016s
|
||||
Queries/sec: 6748.00
|
||||
Avg query latency: 1.567428ms
|
||||
P95 query latency: 5.346663ms
|
||||
P99 query latency: 9.186414ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 565785 operations (565785 queries, 0 writes) in 1m0.000685928s
|
||||
Operations/sec: 9429.64
|
||||
Avg latency: 45.237µs
|
||||
Avg query latency: 45.237µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 86.405µs
|
||||
P99 latency: 126.221µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 3.98141893s
|
||||
Total Events: 11592
|
||||
Events/sec: 2911.52
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 409 MB
|
||||
Avg Latency: 3.938925ms
|
||||
P90 Latency: 3.357143ms
|
||||
P95 Latency: 4.624387ms
|
||||
P99 Latency: 71.546396ms
|
||||
Bottom 10% Avg Latency: 1.115318ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.368751649s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 316 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.617040249s
|
||||
Total Events: 25000
|
||||
Events/sec: 1105.36
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 358 MB
|
||||
Avg Latency: 81.046µs
|
||||
P90 Latency: 102.124µs
|
||||
P95 Latency: 112.915µs
|
||||
P99 Latency: 137.351µs
|
||||
Bottom 10% Avg Latency: 122.82µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 2197ff7ffc723d2fb4f7e44aeaf0ed8c2e0e2f3fb3aae29f2e33e0683ddf1a99
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 0ce484c600cb1c0b33f1e38ddea4b38a47069615d22114a9c621a9164d9b6218
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
- blocked: event already exists: 1642d6770a74de7ca45169bc76dab334591bcb2191044da0b18459888164f9fc
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.003855016s
|
||||
Total Events: 404906
|
||||
Events/sec: 6748.00
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 370 MB
|
||||
Avg Latency: 1.567428ms
|
||||
P90 Latency: 4.371194ms
|
||||
P95 Latency: 5.346663ms
|
||||
P99 Latency: 9.186414ms
|
||||
Bottom 10% Avg Latency: 6.253752ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.000685928s
|
||||
Total Events: 565785
|
||||
Events/sec: 9429.64
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 285 MB
|
||||
Avg Latency: 45.237µs
|
||||
P90 Latency: 76.916µs
|
||||
P95 Latency: 86.405µs
|
||||
P99 Latency: 126.221µs
|
||||
Bottom 10% Avg Latency: 96.947µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 0f06ba91f371d4f8647a3f9529af3b9a012988eabf9f7c2eb42b39aa86697ea9
|
||||
- blocked: event already exists: 06061b630fd0881cbe7ed02114584fea59b9621c2e9479e6e6aa2be561240a90
|
||||
- blocked: event already exists: 01e9943cf5e805283c512b9c26cf69f7e9ff412710d7543a3a52dc93ac7e8a57
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_next-orly-badger_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_next-orly-badger_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: next-orly-badger
|
||||
RELAY_URL: ws://next-orly-badger:8080
|
||||
TEST_TIMESTAMP: 2025-11-19T05:50:04+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_next-orly-dgraph_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763531409344607ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763531409344681ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763531409344706ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763531409344712ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763531409344720ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763531409344735ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763531409344740ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763531409344750ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763531409344755ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763531409759610🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409776086🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409776771🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409776804🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409778374🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409779152🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409784971🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409785617🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409785633🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409800163🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409801153🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409801420🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409802414🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409862218🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409893021🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409893729🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409893845🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409903047🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409903106🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531409903118⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531409903232🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409903259🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531409903268⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531409915985🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409923045🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409923074🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409924533🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409924591🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931212🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931262🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931215🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931529🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931623🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931683🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409931717🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409932268🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409932860🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409933379🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409934990🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409935370🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409940251🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409940354🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531409940445🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410018217🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410580488🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410581675🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410581900🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410582040🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410585617🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410585827🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410586939🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410587543🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410589137🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410589245🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410589709🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410589866🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410590173🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410591177🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410591619🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410591882🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410591940🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410593576🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410593582🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410595220🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410595270🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410595283⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410601931🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410602639🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410602948🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410603018🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410603032🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410604054🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410615476🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410618852🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410621310🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410622085🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410622542🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410622694🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410623081🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410623190⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410625660🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410625875🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410627147🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410628773🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410628799🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410631527🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410633749🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410635043🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410635129🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410636981🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410637344🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410637661🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410637900🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410640346🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410640479🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410641582🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410642954🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410643510🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410644729🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410645234🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410646826🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410653499🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410655186🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410656858🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410657174🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410662374🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410663158🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410667648🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410667651🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410669820🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410670020🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410670837🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410670876🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410671525🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410671553🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410671564⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410672779🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410674901🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410676001🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410681122🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410681358🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410681494🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410683894🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410685543🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410687981🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410688533🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410724866🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410724928🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410724940⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410724987🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410770270🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410777849🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410778883🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410779911🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410780788🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410780841🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410780854⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410781677🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410791857🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410794114🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410794283🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410796455🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410797679🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410798175🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410799065🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410802177🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410803368🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410804150🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410804338🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410804382🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410804458🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410804719🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410821062🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410833464🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410834106🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410834246🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410835105🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410836569🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410837441🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410837610🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410837763🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410840857🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410841784🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410842816🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410842931🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410843145🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410843483🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410844039🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410846135🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410846834🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410848379🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410850717🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410852878🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410853093🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410853211⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410852879🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410853359🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531410853372⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531410853308🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410853791🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410855175🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410856611🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410857598🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410858251🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410859031🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410860805🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410862140🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410862321🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410862439🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410863187🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410863202🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410864904🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410868122🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410869575🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410869665🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410870058🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410870128🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410870884🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410874467🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410875395🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410891523🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410892283🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410893472🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410894764🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410895562🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410895719🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410896070🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410897173🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410897187🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410897198🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410897778🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410897979🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410898440🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410898758🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410898832🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410899952🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410900622🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410933276🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410933374🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410933901🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410934099🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410934447🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410934494🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410935849🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410935923🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410936168🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410936541🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410936556🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410936570🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410937707🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531410937742🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11594/50000 (23.2%), errors: 38406
|
||||
Duration: 4.355930627s
|
||||
Events/sec: 2661.66
|
||||
Avg latency: 4.795769ms
|
||||
P90 latency: 4.155613ms
|
||||
P95 latency: 6.029522ms
|
||||
P99 latency: 90.290502ms
|
||||
Bottom 10% Avg latency: 1.212562ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 347.262129ms
|
||||
Burst completed: 5000 events in 340.789843ms
|
||||
Burst completed: 5000 events in 335.779512ms
|
||||
Burst completed: 5000 events in 337.508905ms
|
||||
Burst completed: 5000 events in 332.483505ms
|
||||
Burst completed: 5000 events in 330.245503ms
|
||||
Burst completed: 5000 events in 327.047944ms
|
||||
Burst completed: 5000 events in 337.854803ms
|
||||
Burst completed: 5000 events in 341.472684ms
|
||||
Burst completed: 5000 events in 338.139736ms
|
||||
Burst test completed: 0 events in 8.375225019s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.648388132s
|
||||
Combined ops/sec: 1103.83
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 392001 queries in 1m0.005057189s
|
||||
Queries/sec: 6532.80
|
||||
Avg query latency: 1.635372ms
|
||||
P95 query latency: 5.6029ms
|
||||
P99 query latency: 9.496203ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 566246 operations (566246 queries, 0 writes) in 1m0.00114177s
|
||||
Operations/sec: 9437.25
|
||||
Avg latency: 45.308µs
|
||||
Avg query latency: 45.308µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 87.115µs
|
||||
P99 latency: 132.623µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.355930627s
|
||||
Total Events: 11594
|
||||
Events/sec: 2661.66
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 344 MB
|
||||
Avg Latency: 4.795769ms
|
||||
P90 Latency: 4.155613ms
|
||||
P95 Latency: 6.029522ms
|
||||
P99 Latency: 90.290502ms
|
||||
Bottom 10% Avg Latency: 1.212562ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.375225019s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 368 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.648388132s
|
||||
Total Events: 25000
|
||||
Events/sec: 1103.83
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 335 MB
|
||||
Avg Latency: 82.523µs
|
||||
P90 Latency: 103.357µs
|
||||
P95 Latency: 115.35µs
|
||||
P99 Latency: 145.828µs
|
||||
Bottom 10% Avg Latency: 129.81µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 06061b630fd0881cbe7ed02114584fea59b9621c2e9479e6e6aa2be561240a90
|
||||
- blocked: event already exists: 0ce484c600cb1c0b33f1e38ddea4b38a47069615d22114a9c621a9164d9b6218
|
||||
- blocked: event already exists: 2197ff7ffc723d2fb4f7e44aeaf0ed8c2e0e2f3fb3aae29f2e33e0683ddf1a99
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.005057189s
|
||||
Total Events: 392001
|
||||
Events/sec: 6532.80
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 421 MB
|
||||
Avg Latency: 1.635372ms
|
||||
P90 Latency: 4.618756ms
|
||||
P95 Latency: 5.6029ms
|
||||
P99 Latency: 9.496203ms
|
||||
Bottom 10% Avg Latency: 6.522705ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.00114177s
|
||||
Total Events: 566246
|
||||
Events/sec: 9437.25
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 437 MB
|
||||
Avg Latency: 45.308µs
|
||||
P90 Latency: 76.856µs
|
||||
P95 Latency: 87.115µs
|
||||
P99 Latency: 132.623µs
|
||||
Bottom 10% Avg Latency: 98.925µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 01e9943cf5e805283c512b9c26cf69f7e9ff412710d7543a3a52dc93ac7e8a57
|
||||
- blocked: event already exists: 1642d6770a74de7ca45169bc76dab334591bcb2191044da0b18459888164f9fc
|
||||
- blocked: event already exists: 15c0a862ce4191bc51a1b668f77869c13cd81fd0af9473759a04ce2637a8860a
|
||||
- blocked: event already exists: 0e0b4dfd5e4ecfb0d3acb8db48d13833edeac5163fbcba9fb94160b686c07595
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_next-orly-dgraph_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_next-orly-dgraph_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: next-orly-dgraph
|
||||
RELAY_URL: ws://next-orly-dgraph:8080
|
||||
TEST_TIMESTAMP: 2025-11-19T05:53:26+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_next-orly-neo4j_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763531611066103ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763531611066178ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763531611066207ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763531611066214ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763531611066225ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763531611066244ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763531611066251ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763531611066267ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763531611066274ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763531611477120🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611493941🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611494126🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611494926🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611496231🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611496246🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611502279🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611503297🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611503330🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611518900🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611518891🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611519488🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611519747🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611577871🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611606029🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611606900🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611606947🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611614519🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611614565🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531611614574⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531611614525🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611614608🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531611614621⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531611624602🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611629772🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611629796🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611631851🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611631931🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611636831🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611636859🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611638048🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611638089🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611638115🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611638587🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611638716🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611639199🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611639225🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611639803🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611639863🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611640930🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611644335🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611644684🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611644898🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531611708589🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612171835🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612172653🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612172732🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612173556🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612175511🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612177118🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612177776🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612178379🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612178372🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612178397🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612179258🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612179440🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612179480🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612179957🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612180057🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612181198🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612181239🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612181692🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612182749🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612183455🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612183483🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612183491⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612189208🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612189347🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612189377🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612189422🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612189435🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612190775🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612199207🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612202839🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612204455🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612204751🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612204774🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612204782⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612205235🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612205306🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612205344🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612206263🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612209033🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612209322🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612209353🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612210019🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612210383🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612210675🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612211567🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612211774🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612211848🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612212220🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612212273🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612213270🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612213282🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612216359🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612216384🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612217080🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612217427🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612218474🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612219554🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612221869🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612224539🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612225032🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612228378🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612230581🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612230736🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612232890🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612234376🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612234461🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612236593🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612236643🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612236655⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612236622🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612236896🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612236930🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612242225🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612243552🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612244820🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612247851🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612248039🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612248536🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612248584🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612249053🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612251606🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612251935🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612251974🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612251979🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612251986⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612253040🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612255159🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612261269🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612261370🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612261469🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612262573🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612262697🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612262722🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612262731⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612294932🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612296429🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612315617🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612316570🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612317612🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612317766🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612317970🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612318694🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612321488🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612342151🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612342215🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612342415🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612342612🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612342903🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612351936🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612360967🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612361147🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612362355🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612364716🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612365603🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612365742🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612365902🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612365920🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612367122🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612367371🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612367380🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612368070🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612368460🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612368669🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612370166🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612372335🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612372509🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612373590🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612373895🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612374191🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612374269🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612374283🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612374293⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612374421🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612374456🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763531612374466⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763531612374683🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612377078🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612378475🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612379970🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612380111🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612380109🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612382815🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612382875🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612382834🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612383146🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612383524🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612384208🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612386086🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612386271🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612387633🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612388100🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612388149🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612388240🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612388288🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612388990🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612389041🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612389077🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612390273🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612391060🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612392786🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612392907🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612394095🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612394516🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612394715🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612394732🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612395297🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612395359🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612395657🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612395823🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612395851🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612396829🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612397908🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612399692🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612401330🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612401868🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612404794🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612404977🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612405122🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612405322🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612405815🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612405838🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612406058🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612418956🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612419108🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612419316🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612419579🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763531612420418🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11592/50000 (23.2%), errors: 38408
|
||||
Duration: 4.099682418s
|
||||
Events/sec: 2827.54
|
||||
Avg latency: 4.203722ms
|
||||
P90 latency: 3.345671ms
|
||||
P95 latency: 4.568189ms
|
||||
P99 latency: 88.030281ms
|
||||
Bottom 10% Avg latency: 1.124184ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 335.33957ms
|
||||
Burst completed: 5000 events in 338.195898ms
|
||||
Burst completed: 5000 events in 346.791988ms
|
||||
Burst completed: 5000 events in 361.72302ms
|
||||
Burst completed: 5000 events in 332.900946ms
|
||||
Burst completed: 5000 events in 335.52954ms
|
||||
Burst completed: 5000 events in 342.175918ms
|
||||
Burst completed: 5000 events in 339.522755ms
|
||||
Burst completed: 5000 events in 334.46846ms
|
||||
Burst completed: 5000 events in 336.071402ms
|
||||
Burst test completed: 0 events in 8.409696337s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.513827505s
|
||||
Combined ops/sec: 1110.43
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 405671 queries in 1m0.004332664s
|
||||
Queries/sec: 6760.70
|
||||
Avg query latency: 1.570056ms
|
||||
P95 query latency: 5.35134ms
|
||||
P99 query latency: 9.169641ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 567760 operations (567760 queries, 0 writes) in 1m0.000235118s
|
||||
Operations/sec: 9462.63
|
||||
Avg latency: 46.433µs
|
||||
Avg query latency: 46.433µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 89.831µs
|
||||
P99 latency: 135.768µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.099682418s
|
||||
Total Events: 11592
|
||||
Events/sec: 2827.54
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 356 MB
|
||||
Avg Latency: 4.203722ms
|
||||
P90 Latency: 3.345671ms
|
||||
P95 Latency: 4.568189ms
|
||||
P99 Latency: 88.030281ms
|
||||
Bottom 10% Avg Latency: 1.124184ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.409696337s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 393 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.513827505s
|
||||
Total Events: 25000
|
||||
Events/sec: 1110.43
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 363 MB
|
||||
Avg Latency: 79.478µs
|
||||
P90 Latency: 101.042µs
|
||||
P95 Latency: 112.755µs
|
||||
P99 Latency: 136.991µs
|
||||
Bottom 10% Avg Latency: 121.765µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 238d2d2e1ddb3af636472dbf573fa52cbfc81509a9ba2f4a6902efacd5e32bbf
|
||||
- blocked: event already exists: 048d7b07155b3832a76eac0b46bea764cac3597dfbc28b559698d51f915cb6d1
|
||||
- blocked: event already exists: 1ebc80bd3bb172fc38ce786e0717e9c82691cd495f0de9863c892284cbe47ca3
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 2197ff7ffc723d2fb4f7e44aeaf0ed8c2e0e2f3fb3aae29f2e33e0683ddf1a99
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.004332664s
|
||||
Total Events: 405671
|
||||
Events/sec: 6760.70
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 372 MB
|
||||
Avg Latency: 1.570056ms
|
||||
P90 Latency: 4.354101ms
|
||||
P95 Latency: 5.35134ms
|
||||
P99 Latency: 9.169641ms
|
||||
Bottom 10% Avg Latency: 6.228096ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.000235118s
|
||||
Total Events: 567760
|
||||
Events/sec: 9462.63
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 303 MB
|
||||
Avg Latency: 46.433µs
|
||||
P90 Latency: 79.071µs
|
||||
P95 Latency: 89.831µs
|
||||
P99 Latency: 135.768µs
|
||||
Bottom 10% Avg Latency: 102.136µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 01e9943cf5e805283c512b9c26cf69f7e9ff412710d7543a3a52dc93ac7e8a57
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 05bf5bbba1a1fa85b9a5aaca7ff384d8e09a1b2441c01df5780c1bc99e377f85
|
||||
- blocked: event already exists: 0b50149a50e29b084c63f0b0d16a8d280445eb389e53b5c688f654665e9d56f5
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_next-orly-neo4j_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_next-orly-neo4j_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: next-orly-neo4j
|
||||
RELAY_URL: ws://next-orly-neo4j:8080
|
||||
TEST_TIMESTAMP: 2025-11-19T05:56:47+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_nostr-rs-relay_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763532618524528ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763532618524580ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763532618524706ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763532618524736ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763532618524748ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763532618524776ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763532618524782ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763532618524802ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763532618524809ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763532618930740🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618947610🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618948005🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618948153🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618950675🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618950682🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618956383🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618956435🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618957227🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618969491🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618970468🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618971159🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532618971247🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619031025🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619056683🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619056939🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619056952🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619066084🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619066142🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619066155⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619066695🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619066714🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619066722⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619075600🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619081811🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619081988🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619084508🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619084568🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619088652🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619088683🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619088782🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619088783🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619090006🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619090001🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619090069🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619090084🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619090099🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619090832🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619091518🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619092595🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619096499🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619096548🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619096606🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619162379🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619614266🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619615621🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619615626🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619616541🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619618933🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619618974🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619620317🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619620397🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619620471🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619620484🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619621043🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619621631🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619622165🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619622167🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619622439🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619623174🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619623181🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619623220🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619624801🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619625240🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619625269🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619625280⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619630065🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619630165🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619630661🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619630663🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619630821🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619631497🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619640145🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619642792🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619644723🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619644791🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619645300🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619645371🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619645379🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619645401⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619645510🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619646269🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619648954🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619649062🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619649394🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619649929🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619650596🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619650999🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619651453🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619652135🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619652189🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619652230🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619652643🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619652686🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619654452🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619656038🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619656545🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619657094🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619658010🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619658015🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619660069🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619661973🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619665795🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619665815🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619668940🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619671219🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619671256🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619675066🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619675407🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619675880🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619676648🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619676831🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619678445🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619678987🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619679007🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619679017⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619680059🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619682110🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619682946🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619686593🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619686642🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619686672🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619688599🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619688980🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619689992🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619691023🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619691071🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619691081⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619691290🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619691789🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619693914🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619698356🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619701647🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619701967🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619702011🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619702023⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619701971🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619702353🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619767837🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619770711🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619771475🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619771496🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619771616🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619771785🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619773121🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619773706🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619774076🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619775012🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619775202🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619775616🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619776224🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619776225🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619783510🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619793083🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619793319🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619795252🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619795257🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619797760🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619798203🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619798747🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619798803🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619799361🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619799645🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619799874🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619800049🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619801225🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619801611🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619801686🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619803757🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619804436🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619805033🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619805964🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619806089🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619806114🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619806125⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619806587🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619806617🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532619806627⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532619806746🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619806955🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619809241🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619809253🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619812247🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619812468🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619812745🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619814622🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619815324🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619815599🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619816082🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619816174🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619816840🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619818752🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619819942🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619820073🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619820832🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619821226🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619821604🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619822845🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619822980🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619823804🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619823916🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619824109🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619826241🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619827137🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619827419🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619827882🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619828527🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619828762🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619829430🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619829777🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619829830🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619829856🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619829867🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619830712🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619831911🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619835536🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619835629🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619839021🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619839121🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619839259🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619841819🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619842315🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619843356🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619843525🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619846344🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619859073🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619859232🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619859436🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619859611🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619859674🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532619859797🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11594/50000 (23.2%), errors: 38406
|
||||
Duration: 4.021053985s
|
||||
Events/sec: 2883.32
|
||||
Avg latency: 4.044321ms
|
||||
P90 latency: 3.344231ms
|
||||
P95 latency: 4.602719ms
|
||||
P99 latency: 79.2846ms
|
||||
Bottom 10% Avg latency: 1.103637ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 352.280501ms
|
||||
Burst completed: 5000 events in 344.717192ms
|
||||
Burst completed: 5000 events in 342.785392ms
|
||||
Burst completed: 5000 events in 348.707543ms
|
||||
Burst completed: 5000 events in 365.85074ms
|
||||
Burst completed: 5000 events in 351.601335ms
|
||||
Burst completed: 5000 events in 349.046538ms
|
||||
Burst completed: 5000 events in 345.187947ms
|
||||
Burst completed: 5000 events in 343.795123ms
|
||||
Burst completed: 5000 events in 331.851049ms
|
||||
Burst test completed: 0 events in 8.481561189s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.659489061s
|
||||
Combined ops/sec: 1103.29
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 405016 queries in 1m0.004544583s
|
||||
Queries/sec: 6749.76
|
||||
Avg query latency: 1.573632ms
|
||||
P95 query latency: 5.332888ms
|
||||
P99 query latency: 9.122117ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 566215 operations (566215 queries, 0 writes) in 1m0.001155402s
|
||||
Operations/sec: 9436.73
|
||||
Avg latency: 45.72µs
|
||||
Avg query latency: 45.72µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 88.218µs
|
||||
P99 latency: 131.26µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.021053985s
|
||||
Total Events: 11594
|
||||
Events/sec: 2883.32
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 379 MB
|
||||
Avg Latency: 4.044321ms
|
||||
P90 Latency: 3.344231ms
|
||||
P95 Latency: 4.602719ms
|
||||
P99 Latency: 79.2846ms
|
||||
Bottom 10% Avg Latency: 1.103637ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.481561189s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 259 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.659489061s
|
||||
Total Events: 25000
|
||||
Events/sec: 1103.29
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 267 MB
|
||||
Avg Latency: 82.3µs
|
||||
P90 Latency: 102.856µs
|
||||
P95 Latency: 114.679µs
|
||||
P99 Latency: 142.963µs
|
||||
Bottom 10% Avg Latency: 130.591µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 238d2d2e1ddb3af636472dbf573fa52cbfc81509a9ba2f4a6902efacd5e32bbf
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 1ebc80bd3bb172fc38ce786e0717e9c82691cd495f0de9863c892284cbe47ca3
|
||||
- blocked: event already exists: 1642d6770a74de7ca45169bc76dab334591bcb2191044da0b18459888164f9fc
|
||||
- blocked: event already exists: 2197ff7ffc723d2fb4f7e44aeaf0ed8c2e0e2f3fb3aae29f2e33e0683ddf1a99
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.004544583s
|
||||
Total Events: 405016
|
||||
Events/sec: 6749.76
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 446 MB
|
||||
Avg Latency: 1.573632ms
|
||||
P90 Latency: 4.427874ms
|
||||
P95 Latency: 5.332888ms
|
||||
P99 Latency: 9.122117ms
|
||||
Bottom 10% Avg Latency: 6.229587ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.001155402s
|
||||
Total Events: 566215
|
||||
Events/sec: 9436.73
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 333 MB
|
||||
Avg Latency: 45.72µs
|
||||
P90 Latency: 78.159µs
|
||||
P95 Latency: 88.218µs
|
||||
P99 Latency: 131.26µs
|
||||
Bottom 10% Avg Latency: 99.957µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 0ce484c600cb1c0b33f1e38ddea4b38a47069615d22114a9c621a9164d9b6218
|
||||
- blocked: event already exists: 048d7b07155b3832a76eac0b46bea764cac3597dfbc28b559698d51f915cb6d1
|
||||
- blocked: event already exists: 05bf5bbba1a1fa85b9a5aaca7ff384d8e09a1b2441c01df5780c1bc99e377f85
|
||||
- blocked: event already exists: 0e0b4dfd5e4ecfb0d3acb8db48d13833edeac5163fbcba9fb94160b686c07595
|
||||
- blocked: event already exists: 0b50149a50e29b084c63f0b0d16a8d280445eb389e53b5c688f654665e9d56f5
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_nostr-rs-relay_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_nostr-rs-relay_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: nostr-rs-relay
|
||||
RELAY_URL: ws://nostr-rs-relay:8080
|
||||
TEST_TIMESTAMP: 2025-11-19T06:13:35+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_relayer-basic_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763532215281177ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763532215281256ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763532215281278ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763532215281284ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763532215281295ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763532215281311ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763532215281316ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763532215281327ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763532215281332ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763532215753642🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215771026🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215771047🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215771043🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215773057🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215773950🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215779106🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215779989🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215780044🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215794879🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215794911🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215795258🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215795902🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215864347🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215895247🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215897706🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215897846🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215909272🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215909338🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532215909351⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532215909277🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215909376🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532215909396⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532215921004🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215927644🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215927729🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215932204🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215932223🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215937326🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215937353🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215937533🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215937559🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215937604🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215938283🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215938525🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215938584🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215939171🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215941078🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215942075🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215942140🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215946108🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215946935🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532215947070🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216034256🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216575480🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216575680🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216576613🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216577132🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216579189🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216580190🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216581187🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216581297🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216581843🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216581932🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216582485🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216583310🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216583354🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216583797🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216584179🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216584829🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216584822🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216584849🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216586369🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216586560🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216586587🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216586598⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216592409🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216594068🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216594133🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216594171🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216595199🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216596193🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216604932🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216608011🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216610501🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216610709🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216610735🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216610746⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216611730🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216611905🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216612710🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216612972🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216614620🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216614890🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216616830🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216617705🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216617912🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216618767🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216619811🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216619813🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216620154🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216622289🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216622299🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216622670🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216622759🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216627036🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216627071🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216627681🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216628332🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216628497🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216630956🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216634023🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216636620🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216637097🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216640322🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216640755🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216642971🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216646272🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216646356🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216646716🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216649588🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216649624🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216649707🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216651798🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216651837🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216651846⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216652546🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216652647🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216654682🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216660436🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216660454🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216660818🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216660850🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216660892🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216664192🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216664242🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216664233🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216664284🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216664252⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216664431🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216666902🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216671811🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216671937🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216702320🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216702414🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216705566🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216705636🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216705653⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216736068🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216772632🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216772740🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216772872🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216775232🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216776926🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216778944🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216780479🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216781325🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216781901🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216782007🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216781924🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216782662🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216782943🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216792109🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216801957🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216802118🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216805275🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216805608🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216806675🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216806729🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216807256🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216807332🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216807702🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216808008🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216809164🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216809928🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216810178🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216810343🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216810553🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216813468🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216813917🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216815051🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216815580🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216815621🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216815633⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216815855🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216815887🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532216815896⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532216817137🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216817988🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216818038🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216820280🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216820593🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216822434🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216822533🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216823260🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216825570🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216825661🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216825770🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216825766🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216828334🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216828596🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216830967🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216832985🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216834147🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216834169🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216834173🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216834249🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216835001🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216835042🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216835016🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216835898🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216835986🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216840462🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216841175🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216841614🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216842304🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216847871🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216864133🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216905124🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216905300🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216905361🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216905362🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216905440🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216906234🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216907434🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216907471🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216907464🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216908059🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216908080🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216908591🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216908908🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216909192🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216910036🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216910306🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216910950🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216931514🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216931602🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216931779🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216931793🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216932984🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532216933171🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11592/50000 (23.2%), errors: 38408
|
||||
Duration: 4.281033199s
|
||||
Events/sec: 2707.76
|
||||
Avg latency: 4.657987ms
|
||||
P90 latency: 4.233468ms
|
||||
P95 latency: 5.603449ms
|
||||
P99 latency: 68.611381ms
|
||||
Bottom 10% Avg latency: 1.266467ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 351.189041ms
|
||||
Burst completed: 5000 events in 345.793588ms
|
||||
Burst completed: 5000 events in 349.58856ms
|
||||
Burst completed: 5000 events in 347.409606ms
|
||||
Burst completed: 5000 events in 336.805967ms
|
||||
Burst completed: 5000 events in 342.539694ms
|
||||
Burst completed: 5000 events in 333.331965ms
|
||||
Burst completed: 5000 events in 343.768734ms
|
||||
Burst completed: 5000 events in 348.390792ms
|
||||
Burst completed: 5000 events in 349.455321ms
|
||||
Burst test completed: 0 events in 8.454879556s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.626268963s
|
||||
Combined ops/sec: 1104.91
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 406188 queries in 1m0.004608218s
|
||||
Queries/sec: 6769.28
|
||||
Avg query latency: 1.56602ms
|
||||
P95 query latency: 5.365294ms
|
||||
P99 query latency: 9.302026ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 563863 operations (563863 queries, 0 writes) in 1m0.001226916s
|
||||
Operations/sec: 9397.52
|
||||
Avg latency: 46.484µs
|
||||
Avg query latency: 46.484µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 89.861µs
|
||||
P99 latency: 137.252µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.281033199s
|
||||
Total Events: 11592
|
||||
Events/sec: 2707.76
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 344 MB
|
||||
Avg Latency: 4.657987ms
|
||||
P90 Latency: 4.233468ms
|
||||
P95 Latency: 5.603449ms
|
||||
P99 Latency: 68.611381ms
|
||||
Bottom 10% Avg Latency: 1.266467ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.454879556s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 368 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.626268963s
|
||||
Total Events: 25000
|
||||
Events/sec: 1104.91
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 339 MB
|
||||
Avg Latency: 81.834µs
|
||||
P90 Latency: 101.664µs
|
||||
P95 Latency: 112.123µs
|
||||
P99 Latency: 136.991µs
|
||||
Bottom 10% Avg Latency: 123.871µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 06061b630fd0881cbe7ed02114584fea59b9621c2e9479e6e6aa2be561240a90
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 1ebc80bd3bb172fc38ce786e0717e9c82691cd495f0de9863c892284cbe47ca3
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 2197ff7ffc723d2fb4f7e44aeaf0ed8c2e0e2f3fb3aae29f2e33e0683ddf1a99
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.004608218s
|
||||
Total Events: 406188
|
||||
Events/sec: 6769.28
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 466 MB
|
||||
Avg Latency: 1.56602ms
|
||||
P90 Latency: 4.291057ms
|
||||
P95 Latency: 5.365294ms
|
||||
P99 Latency: 9.302026ms
|
||||
Bottom 10% Avg Latency: 6.278431ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.001226916s
|
||||
Total Events: 563863
|
||||
Events/sec: 9397.52
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 347 MB
|
||||
Avg Latency: 46.484µs
|
||||
P90 Latency: 79.592µs
|
||||
P95 Latency: 89.861µs
|
||||
P99 Latency: 137.252µs
|
||||
Bottom 10% Avg Latency: 102.019µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 0f06ba91f371d4f8647a3f9529af3b9a012988eabf9f7c2eb42b39aa86697ea9
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
- blocked: event already exists: 0b50149a50e29b084c63f0b0d16a8d280445eb389e53b5c688f654665e9d56f5
|
||||
- blocked: event already exists: 05bf5bbba1a1fa85b9a5aaca7ff384d8e09a1b2441c01df5780c1bc99e377f85
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_relayer-basic_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_relayer-basic_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: relayer-basic
|
||||
RELAY_URL: ws://relayer-basic:7447
|
||||
TEST_TIMESTAMP: 2025-11-19T06:06:51+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
422
cmd/benchmark/reports/run_20251119_054648/strfry_results.txt
Normal file
422
cmd/benchmark/reports/run_20251119_054648/strfry_results.txt
Normal file
@@ -0,0 +1,422 @@
|
||||
Starting Nostr Relay Benchmark (Badger Backend)
|
||||
Data Directory: /tmp/benchmark_strfry_8
|
||||
Events: 50000, Workers: 24, Duration: 1m0s
|
||||
1763532417029005ℹ️ migrating to version 1... /build/pkg/database/migrations.go:66
|
||||
1763532417029081ℹ️ migrating to version 2... /build/pkg/database/migrations.go:73
|
||||
1763532417029106ℹ️ migrating to version 3... /build/pkg/database/migrations.go:80
|
||||
1763532417029112ℹ️ cleaning up ephemeral events (kinds 20000-29999)... /build/pkg/database/migrations.go:287
|
||||
1763532417029144ℹ️ cleaned up 0 ephemeral events from database /build/pkg/database/migrations.go:332
|
||||
1763532417029202ℹ️ migrating to version 4... /build/pkg/database/migrations.go:87
|
||||
1763532417029209ℹ️ converting events to optimized inline storage (Reiser4 optimization)... /build/pkg/database/migrations.go:340
|
||||
1763532417029219ℹ️ found 0 events to convert (0 regular, 0 replaceable, 0 addressable) /build/pkg/database/migrations.go:429
|
||||
1763532417029225ℹ️ migration complete: converted 0 events to optimized inline storage, deleted 0 old keys /build/pkg/database/migrations.go:538
|
||||
Loading real-world sample events from embedded data...
|
||||
Loading real-world sample events (11,596 events from 6 months of Nostr)...
|
||||
Loaded 11596 real-world events (already signed, zero crypto overhead)
|
||||
|
||||
Event Statistics:
|
||||
Total events: 11596
|
||||
Average content size: 588 bytes
|
||||
Event kinds found: 25 unique
|
||||
Most common kinds:
|
||||
Kind 1: 7152 events
|
||||
Kind 7: 1973 events
|
||||
Kind 6: 934 events
|
||||
Kind 10002: 337 events
|
||||
Kind 0: 290 events
|
||||
|
||||
|
||||
╔════════════════════════════════════════════════════════╗
|
||||
║ BADGER BACKEND BENCHMARK SUITE ║
|
||||
╚════════════════════════════════════════════════════════╝
|
||||
|
||||
=== Starting Badger benchmark ===
|
||||
RunPeakThroughputTest (Badger)..
|
||||
|
||||
=== Peak Throughput Test ===
|
||||
1763532417446740🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417463442🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417463517🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417463528🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417465778🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417465773🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417471681🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417472327🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417473046🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417487367🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417488733🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417489155🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417489204🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417547895🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417576271🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417576642🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417577031🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417584020🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417584080🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532417584092⚠️ failed to process deletion for event 900e73566bb098d7ec1880ec68521ef76e066b933d4d6b71dbe99ee156c4b307: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532417584057🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417584119🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532417584130⚠️ failed to process deletion for event ecd7b942d5a473589b4a3bc34f0b3dadf0c6e0ba9325d7a47604167acc757d5c: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532417593777🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417599107🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417599108🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417601718🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417601761🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417605646🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417606054🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417606057🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417607124🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417607136🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417607268🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417607238🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417607238🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417607152🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417608114🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417609053🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417609524🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417612855🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417613254🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417613805🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532417677741🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418142727🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418142864🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418144600🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418144630🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418145646🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418146916🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418147551🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418148156🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418148197🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418148912🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418149551🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418149549🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418150165🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418150344🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418150653🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418151668🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418151756🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418151768🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418152942🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418153239🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418153258🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418153267⚠️ failed to process deletion for event 63eae8af9f42e2d37f93b1277bcf708c94aeb8935dd83d1e8e80136c4e4f8292: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418158828🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418159056🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418159184🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418160314🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418160324🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418161260🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418169316🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418172059🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418173558🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418174651🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418174692🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418174703⚠️ failed to process deletion for event 2f5e01050c81c0d711e9f391726af47933b5fcfbe497434164069787d201e3b9: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418175319🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418175322🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418175328🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418176201🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418178579🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418178687🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418179266🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418179679🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418179929🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418180514🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418180740🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418181634🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418182020🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418182137🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418182727🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418183912🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418183942🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418186474🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418186791🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418186808🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418186793🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418188620🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418189953🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418192500🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418194606🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418195626🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418199354🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418200303🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418200464🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418203342🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418204634🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418204728🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418205766🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418207111🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418207142🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418207931🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418207969🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418207980⚠️ failed to process deletion for event e56f683d8a3ad6a1d7ed41f50bf2739179ac8f6e1418ff34e5e20903172237ea: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418208766🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418210821🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418211495🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418215604🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418215614🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418216006🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418216035🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418219145🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418220994🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418221037🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418221052⚠️ failed to process deletion for event 4b07094ff22787f584f5ceddc11ae44c66ab513d01d7529e156d6adb75323eca: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418221209🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418222796🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418223147🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418227727🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418233362🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418233725🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418233725🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418233803🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418233816⚠️ failed to process deletion for event 59475e9f41d77977a2b2c0d9acf7c32bad368dafdeab1e8f7be8cf0fe0e00ceb: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418234917🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418234938🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418302772🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418304188🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418304225🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418307646🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418308235🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418309609🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418309963🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418310289🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418312036🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418312787🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418314158🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418315296🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418317296🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418317453🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418326901🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418336363🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418336826🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418337215🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418338156🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418338897🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418341107🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418341261🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418341288🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418341578🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418341805🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418344423🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418344476🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418344490🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418345300🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418345329🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418347344🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418349365🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418349398🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418349748🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418349778🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418349790⚠️ failed to process deletion for event bd502ba9dc5c173b3b82708561f35118e2ca580f9c7e5baffceccdd9f6502462: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418351994🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418352043🚨 id not found in database /build/pkg/database/save-event.go:332
|
||||
1763532418352055⚠️ failed to process deletion for event 961a3d9582d896fcd8755ccc634b7846e549131284740f6fec0d635d0bb072af: id not found in database /build/pkg/database/save-event.go:333
|
||||
1763532418354024🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418354037🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418354129🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418355732🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418357513🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418359713🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418360257🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418361239🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418361614🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418362673🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418362796🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418362959🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418363024🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418363609🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418364681🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418366172🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418366978🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418367050🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418367077🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418367056🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418368723🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418369089🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418369211🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418369213🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418369858🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418371869🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418373452🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418373544🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418373609🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418375088🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418375238🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418375309🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418375530🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418375554🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418375966🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418376137🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418376407🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418377845🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418377890🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418378015🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418378051🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418378088🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418379151🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418379686🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418390200🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418391344🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418391364🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418391484🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418392146🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418392202🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418392283🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418392401🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418393317🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
1763532418393350🚨 id not found in database /build/pkg/database/process-delete.go:43
|
||||
Events saved: 11596/50000 (23.2%), errors: 38404
|
||||
Duration: 4.081350203s
|
||||
Events/sec: 2841.22
|
||||
Avg latency: 4.088506ms
|
||||
P90 latency: 3.424405ms
|
||||
P95 latency: 4.517428ms
|
||||
P99 latency: 75.080835ms
|
||||
Bottom 10% Avg latency: 1.135387ms
|
||||
Wiping database between tests...
|
||||
RunBurstPatternTest (Badger)..
|
||||
|
||||
=== Burst Pattern Test ===
|
||||
Burst completed: 5000 events in 342.084914ms
|
||||
Burst completed: 5000 events in 368.596807ms
|
||||
Burst completed: 5000 events in 328.015947ms
|
||||
Burst completed: 5000 events in 335.615145ms
|
||||
Burst completed: 5000 events in 336.465114ms
|
||||
Burst completed: 5000 events in 339.72787ms
|
||||
Burst completed: 5000 events in 337.178121ms
|
||||
Burst completed: 5000 events in 337.603762ms
|
||||
Burst completed: 5000 events in 311.194123ms
|
||||
Burst completed: 5000 events in 320.093358ms
|
||||
Burst test completed: 0 events in 8.36134004s, errors: 50000
|
||||
Events/sec: 0.00
|
||||
Wiping database between tests...
|
||||
RunMixedReadWriteTest (Badger)..
|
||||
|
||||
=== Mixed Read/Write Test ===
|
||||
Pre-populating database for read tests...
|
||||
Mixed test completed: 0 writes, 25000 reads in 22.58702292s
|
||||
Combined ops/sec: 1106.83
|
||||
Wiping database between tests...
|
||||
RunQueryTest (Badger)..
|
||||
|
||||
=== Query Test ===
|
||||
Pre-populating database with 10000 events for query tests...
|
||||
Query test completed: 410409 queries in 1m0.005823994s
|
||||
Queries/sec: 6839.49
|
||||
Avg query latency: 1.547004ms
|
||||
P95 query latency: 5.256194ms
|
||||
P99 query latency: 9.085129ms
|
||||
Wiping database between tests...
|
||||
RunConcurrentQueryStoreTest (Badger)..
|
||||
|
||||
=== Concurrent Query/Store Test ===
|
||||
Pre-populating database with 5000 events for concurrent query/store test...
|
||||
Concurrent test completed: 568449 operations (568449 queries, 0 writes) in 1m0.000557559s
|
||||
Operations/sec: 9474.06
|
||||
Avg latency: 45.257µs
|
||||
Avg query latency: 45.257µs
|
||||
Avg write latency: 0s
|
||||
P95 latency: 86.775µs
|
||||
P99 latency: 128.615µs
|
||||
|
||||
=== Badger benchmark completed ===
|
||||
|
||||
|
||||
================================================================================
|
||||
BENCHMARK REPORT
|
||||
================================================================================
|
||||
|
||||
Test: Peak Throughput
|
||||
Duration: 4.081350203s
|
||||
Total Events: 11596
|
||||
Events/sec: 2841.22
|
||||
Success Rate: 23.2%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 322 MB
|
||||
Avg Latency: 4.088506ms
|
||||
P90 Latency: 3.424405ms
|
||||
P95 Latency: 4.517428ms
|
||||
P99 Latency: 75.080835ms
|
||||
Bottom 10% Avg Latency: 1.135387ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Burst Pattern
|
||||
Duration: 8.36134004s
|
||||
Total Events: 0
|
||||
Events/sec: 0.00
|
||||
Success Rate: 0.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 352 MB
|
||||
Avg Latency: 0s
|
||||
P90 Latency: 0s
|
||||
P95 Latency: 0s
|
||||
P99 Latency: 0s
|
||||
Bottom 10% Avg Latency: 0s
|
||||
----------------------------------------
|
||||
|
||||
Test: Mixed Read/Write
|
||||
Duration: 22.58702292s
|
||||
Total Events: 25000
|
||||
Events/sec: 1106.83
|
||||
Success Rate: 50.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 319 MB
|
||||
Avg Latency: 81.227µs
|
||||
P90 Latency: 102.275µs
|
||||
P95 Latency: 113.396µs
|
||||
P99 Latency: 139.054µs
|
||||
Bottom 10% Avg Latency: 125.516µs
|
||||
Errors (25000):
|
||||
- blocked: event already exists: 11aa0b6defe3d58cef2f93c06fb194bc72241f17fb35312594d279f6c8f13d44
|
||||
- blocked: event already exists: 00a5f5f6c7f1c4e6f71ab7df2c056e238ccd9b441e59ddf119d7ab7f1d7510e0
|
||||
- blocked: event already exists: 1ebc80bd3bb172fc38ce786e0717e9c82691cd495f0de9863c892284cbe47ca3
|
||||
- blocked: event already exists: 0ce484c600cb1c0b33f1e38ddea4b38a47069615d22114a9c621a9164d9b6218
|
||||
- blocked: event already exists: 1642d6770a74de7ca45169bc76dab334591bcb2191044da0b18459888164f9fc
|
||||
... and 24995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Test: Query Performance
|
||||
Duration: 1m0.005823994s
|
||||
Total Events: 410409
|
||||
Events/sec: 6839.49
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 403 MB
|
||||
Avg Latency: 1.547004ms
|
||||
P90 Latency: 4.258013ms
|
||||
P95 Latency: 5.256194ms
|
||||
P99 Latency: 9.085129ms
|
||||
Bottom 10% Avg Latency: 6.154516ms
|
||||
----------------------------------------
|
||||
|
||||
Test: Concurrent Query/Store
|
||||
Duration: 1m0.000557559s
|
||||
Total Events: 568449
|
||||
Events/sec: 9474.06
|
||||
Success Rate: 100.0%
|
||||
Concurrent Workers: 24
|
||||
Memory Used: 403 MB
|
||||
Avg Latency: 45.257µs
|
||||
P90 Latency: 77.187µs
|
||||
P95 Latency: 86.775µs
|
||||
P99 Latency: 128.615µs
|
||||
Bottom 10% Avg Latency: 98.387µs
|
||||
Errors (50000):
|
||||
- blocked: event already exists: 0312061d336fd22dc64b98130663835242e4479c54c7ca88b72c3b3093ef29a2
|
||||
- blocked: event already exists: 06061b630fd0881cbe7ed02114584fea59b9621c2e9479e6e6aa2be561240a90
|
||||
- blocked: event already exists: 0ea6723d131534cf6e2209169a518c4bc598e3acad0618c2ef34df34c867cca1
|
||||
- blocked: event already exists: 0ce484c600cb1c0b33f1e38ddea4b38a47069615d22114a9c621a9164d9b6218
|
||||
- blocked: event already exists: 0f06ba91f371d4f8647a3f9529af3b9a012988eabf9f7c2eb42b39aa86697ea9
|
||||
... and 49995 more errors
|
||||
----------------------------------------
|
||||
|
||||
Report saved to: /tmp/benchmark_strfry_8/benchmark_report.txt
|
||||
AsciiDoc report saved to: /tmp/benchmark_strfry_8/benchmark_report.adoc
|
||||
|
||||
RELAY_NAME: strfry
|
||||
RELAY_URL: ws://strfry:8080
|
||||
TEST_TIMESTAMP: 2025-11-19T06:10:13+00:00
|
||||
BENCHMARK_CONFIG:
|
||||
Events: 50000
|
||||
Workers: 24
|
||||
Duration: 60s
|
||||
@@ -29,11 +29,27 @@ if [ -d "data" ]; then
|
||||
fi
|
||||
fi
|
||||
|
||||
# Stop any running containers from previous runs
|
||||
echo "Stopping any running containers..."
|
||||
$DOCKER_COMPOSE down 2>/dev/null || true
|
||||
|
||||
# Create fresh data directories with correct permissions
|
||||
echo "Preparing data directories..."
|
||||
mkdir -p data/{next-orly-badger,next-orly-dgraph,dgraph-zero,dgraph-alpha,khatru-sqlite,khatru-badger,relayer-basic,strfry,nostr-rs-relay,postgres}
|
||||
chmod 777 data/{next-orly-badger,next-orly-dgraph,dgraph-zero,dgraph-alpha,khatru-sqlite,khatru-badger,relayer-basic,strfry,nostr-rs-relay,postgres}
|
||||
|
||||
# Clean Neo4j data to prevent "already running" errors
|
||||
if [ -d "data/neo4j" ]; then
|
||||
echo "Cleaning Neo4j data directory..."
|
||||
rm -rf data/neo4j/*
|
||||
fi
|
||||
|
||||
mkdir -p data/{next-orly-badger,next-orly-dgraph,next-orly-neo4j,dgraph-zero,dgraph-alpha,neo4j,neo4j-logs,khatru-sqlite,khatru-badger,relayer-basic,strfry,nostr-rs-relay,postgres}
|
||||
chmod 777 data/{next-orly-badger,next-orly-dgraph,next-orly-neo4j,dgraph-zero,dgraph-alpha,neo4j,neo4j-logs,khatru-sqlite,khatru-badger,relayer-basic,strfry,nostr-rs-relay,postgres}
|
||||
|
||||
echo "Building fresh Docker images..."
|
||||
# Force rebuild to pick up latest code changes
|
||||
$DOCKER_COMPOSE build --no-cache benchmark-runner next-orly-badger next-orly-dgraph next-orly-neo4j
|
||||
|
||||
echo ""
|
||||
echo "Starting benchmark suite..."
|
||||
echo "This will automatically shut down all containers when the benchmark completes."
|
||||
echo ""
|
||||
|
||||
Reference in New Issue
Block a user