mleku/next.orly.dev
1
0
Fork 1
Code Issues 5 Pull Requests Actions 9 Packages Projects Releases Wiki Activity
Files
4522081506b22ba06468193262f484f0c75e3a1a
next.orly.dev/pkg/database
History
woikos 4522081506
Some checks are pending
Go / build-and-release (push) Waiting to run
Details
Fix memory exhaustion from concurrent Badger queries (v0.52.17) 
- Add query semaphore limiting concurrent database queries to 3
- Reuse single iterator in FetchEventsBySerials instead of one per serial
- Disable expensive e-tag fallback lookup in deletion processing
- Add empty ID validation in access tracker loop
- Reduce log spam from GetSerialById empty ID errors

These changes reduce memory usage from ~5GB to ~150MB under load by
limiting concurrent Badger iterators which consume significant memory.

Files modified:
- pkg/database/database.go: Add query semaphore with acquire/release
- pkg/database/fetch-events-by-serials.go: Reuse iterator for sev lookups
- pkg/database/query-events.go: Add semaphore, disable e-tag fallback
- pkg/database/get-serial-by-id.go: Don't log empty ID errors
- app/handle-req.go: Validate event ID before GetSerialById
- pkg/version/version: Bump to v0.52.17

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-21 17:23:30 +01:00
..
bufpool
Add NRC (Nostr Relay Connect) protocol and web UI (v0.48.9)
2026-01-07 03:40:12 +01:00
indexes
Add Blossom bandwidth limiting and tune rate limiters (v0.49.0)
2026-01-14 08:09:39 +01:00
querycache
migrate to new nostr library
2025-11-23 08:15:06 +00:00
access_tracking.go
Add archive relay query augmentation and access-based GC (v0.45.0)
2026-01-02 19:35:16 +01:00
benchmark_test.go
migrate to new nostr library
2025-11-23 08:15:06 +00:00
binary_tag_filter_test.go
Add fixed-size type support for IdPkTs and EventRef
2025-12-23 14:47:50 +01:00
cleanup-kind3_test.go
Add extensive tests and improve policy configuration handling
2025-12-02 07:51:59 +00:00
cleanup-kind3.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
compact_event.go
Fix OOM crash from corrupt compact event data
2026-01-09 11:46:36 +01:00
compact_stats.go
merge authors/nostruser in neo4j, add compact pubkey/e/p serial refs
2025-12-03 20:49:49 +00:00
compact-storage_test.go
remove outdated configuration items for obsolete tail packing optimization
2025-12-03 21:24:43 +00:00
count.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
curating-acl.go
feat(curating): add user event viewer and delete functionality (v0.50.0)
2026-01-14 19:19:33 +01:00
database.go
Fix memory exhaustion from concurrent Badger queries (v0.52.17)
2026-01-21 17:23:30 +01:00
delete-event.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
delete-expired.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
dual-storage_test.go
migrate to new nostr library
2025-11-23 08:15:06 +00:00
etag-graph_test.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
export_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
export.go
Fix NIP-11 caching and export streaming issues (v0.46.2)
2026-01-03 07:17:48 +01:00
factory_wasm.go
Add Neo4j memory tuning config and query result limits (v0.43.0)
2025-12-29 02:18:05 +02:00
factory.go
Add BBolt database backend for HDD-optimized archival relays (v0.48.0)
2026-01-06 06:50:58 +01:00
fetch-event-by-serial_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
fetch-event-by-serial.go
Fix corrupted events with zero-filled IDs/pubkeys/sigs (v0.47.1)
2026-01-06 05:51:34 +01:00
fetch-events-by-serials.go
Fix memory exhaustion from concurrent Badger queries (v0.52.17)
2026-01-21 17:23:30 +01:00
filter_utils.go
Fix binary tag value handling for e/p tags across database layer
2025-11-26 21:16:46 +00:00
get-fullidpubkey-by-serial.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
get-fullidpubkey-by-serials.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
get-indexes-for-event_test.go
migrate to new nostr library
2025-11-23 08:15:06 +00:00
get-indexes-for-event.go
Add memory optimization improvements for reduced GC pressure (v0.36.16)
2025-12-25 06:03:53 +01:00
get-indexes-from-filter_test.go
migrate to new nostr library
2025-11-23 08:15:06 +00:00
get-indexes-from-filter.go
Add Blossom bandwidth limiting and tune rate limiters (v0.49.0)
2026-01-14 08:09:39 +01:00
get-serial-by-id_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
get-serial-by-id.go
Fix memory exhaustion from concurrent Badger queries (v0.52.17)
2026-01-21 17:23:30 +01:00
get-serials-by-range_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
get-serials-by-range.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
graph-adapter.go
Add curation ACL mode and complete graph query implementation (v0.47.0)
2026-01-05 21:42:17 +01:00
graph-follows_test.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
graph-follows.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
graph-mentions.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
graph-refs.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
graph-result.go
Add curation ACL mode and complete graph query implementation (v0.47.0)
2026-01-05 21:42:17 +01:00
graph-thread.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
graph-traversal_test.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
graph-traversal.go
add first draft graph query implementation
2025-12-04 09:28:13 +00:00
identity.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
IMPORT_MEMORY_OPTIMIZATION_PLAN.md
Fix broken submodule and add import memory optimization plan
2025-12-11 21:36:39 +01:00
import_utils.go
Interim release: documentation updates and rate limiting improvements
2025-12-12 08:47:25 +01:00
import.go
Update event import process and improve user feedback
2025-12-05 14:42:22 +00:00
interface.go
Add archive relay query augmentation and access-based GC (v0.45.0)
2026-01-02 19:35:16 +01:00
logger.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
lrucache_test.go
Add LRU cache for serial lookups with dynamic scaling (v0.36.17)
2025-12-25 06:25:21 +01:00
lrucache.go
Add LRU cache for serial lookups with dynamic scaling (v0.36.17)
2025-12-25 06:25:21 +01:00
managed-acl.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
markers.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
migrations.go
Add curation ACL mode and complete graph query implementation (v0.47.0)
2026-01-05 21:42:17 +01:00
nip43_test.go
implemented and tested NIP-43 invite based ACL
2025-11-09 10:41:58 +00:00
nip43.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
nrc.go
Remove Cashu Access Token (CAT) system entirely (v0.52.3)
2026-01-19 05:29:21 +01:00
PERFORMANCE_REPORT.md
Add benchmark tests and optimize database performance
2025-11-02 18:19:52 +00:00
process-delete.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
PTAG_GRAPH_OPTIMIZATION.md
add vertexes between npubs and events, use for p tags
2025-11-20 09:16:54 +00:00
PTAG_QUERY_IMPLEMENTATION.md
add vertexes between npubs and events, use for p tags
2025-11-20 09:16:54 +00:00
PUBKEY_GRAPH.md
create new index that records the links between pubkeys, events, kinds, and inbound/outbound/author
2025-11-20 05:13:56 +00:00
pubkey-graph_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
pubkey-serial.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
query-events_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-events-multiple-param-replaceable_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-events-search_test.go
migrate to new nostr library
2025-11-23 08:15:06 +00:00
query-events.go
Fix memory exhaustion from concurrent Badger queries (v0.52.17)
2026-01-21 17:23:30 +01:00
query-for-authors-tags_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-created-at_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-deleted.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
query-for-ids_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-ids.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
query-for-kinds_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-kinds-authors_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-kinds-authors-tags_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-kinds-tags_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
query-for-ptag-graph_test.go
migrate to new nostr library
2025-11-23 08:15:06 +00:00
query-for-ptag-graph.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
query-for-serials_test.go
Add comprehensive tests for new policy fields and combinations
2025-12-01 18:21:38 +00:00
query-for-serials.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
query-for-tags_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
save-event_test.go
Add comprehensive tests for new policy fields and combinations
2025-12-01 18:21:38 +00:00
save-event.go
Add memory optimization improvements for reduced GC pressure (v0.36.16)
2025-12-25 06:03:53 +01:00
serial_cache.go
Fix corrupted events with zero-filled IDs/pubkeys/sigs (v0.47.1)
2026-01-06 05:51:34 +01:00
subscriptions_test.go
Migrate package imports from next.orly.dev to new orly domain structure; add new varint and binary encoders with comprehensive tests; enhance existing tag and envelope implementations with additional methods, validations, and test coverage; introduce shared test.sh script for streamlined testing across modules.
2025-08-31 16:52:24 +01:00
subscriptions.go
implement wasm/js specific database engine
2025-12-03 12:31:25 +00:00
testmain_test.go
Decompose handle-event.go into DDD domain services (v0.36.15)
2025-12-25 05:30:07 +01:00
tokenize_wasm.go
Add NRC (Nostr Relay Connect) protocol and web UI (v0.48.9)
2026-01-07 03:40:12 +01:00
tokenize.go
Add unicode normalization for word indexing (v0.36.10)
2025-12-22 18:53:30 +01:00
types.go
implement wasm/js specific database engine
2025-12-03 12:31:40 +00:00
unicode_normalize_test.go
Add unicode normalization for word indexing (v0.36.10)
2025-12-22 18:53:30 +01:00
unicode_normalize_wasm.go
Add NRC (Nostr Relay Connect) protocol and web UI (v0.48.9)
2026-01-07 03:40:12 +01:00
unicode_normalize.go
Add unicode normalization for word indexing (v0.36.10)
2025-12-22 18:53:30 +01:00
wireguard.go
Add WireGuard VPN with random /31 subnet isolation (v0.40.0)
2025-12-27 16:32:48 +02:00