Skip to content

Update benchmarks with M3 Max criterion results - #5

Merged
rendro merged 1 commit into
mainfrom
update-benchmarks
Jan 30, 2026
Merged

rendro merged 1 commit into
mainfrom
update-benchmarks

Conversation

@rendro

@rendro rendro commented Jan 30, 2026

Copy link
Copy Markdown
Owner

Summary

  • Replace stale M1 Pro benchmark numbers with actual M3 Max criterion.rs results
  • 100 items: ~15ms (graph on), 1K items: ~65ms (graph on)
  • Remove 10K row (not currently benchmarked)

🤖 Generated with Claude Code

@rendro
rendro merged commit 9f0b668 into main Jan 30, 2026
2 checks passed
@rendro
rendro deleted the update-benchmarks branch January 30, 2026 23:52
rendro pushed a commit that referenced this pull request Jan 31, 2026
…orrectness

Critical fixes:
- #1: Replace lock-free CAS rate limiter with Mutex to eliminate race condition
- #2: Add retry loop to expire_item re-insert to prevent data loss after delete
- #3: Escape backslashes in SQL sanitization alongside single quotes

High severity fixes:
- #4: Clean stale pending consolidation entries after 30 days (was unbounded)
- #5: Record validation on NEW item instead of deleted old item on replace
- #6: Transfer graph edges before removing old node on replace (was losing all relationships)

Medium severity fixes:
- #7: Filter input IDs from get_neighbors results to prevent self-references
- #8: Normalize co-access edge direction (smaller ID first) to prevent duplicates
- #9: Recompute similarity from embeddings during consolidation instead of using stale scores
- #10: Cap search limit inside search_items to prevent overflow before min(100)
- #11: Stricter YAML detection requiring identifier-like keys (prevents false positives on prose)
- #12: Log PRAGMA failures instead of silently ignoring them

Low severity fixes:
- #13: Remove unused sha2 dependency
- #14: Delete chunks belonging to expired items during cleanup
- #15: Use i32::try_from for chunk_index instead of silent truncation
- #16: Wrap background tasks with spawn_logged to catch and log panics
- #17: Change ListScope default from All to Project to match tool schema
- #18: Use atomic temp-file-then-rename for project config to prevent TOCTOU race

Added 15 new tests covering all major fixes. All 50 tests pass, clippy clean, fmt clean.

https://claude.ai/code/session_01SHu7vSzBbG33DzYec2DFqe
rendro pushed a commit that referenced this pull request Jan 31, 2026
Chunker (issues #4, #5):
- Use chars().count() instead of .len() for chunk threshold check
- Ensure all byte offsets in split_by_chars land on UTF-8 char boundaries
- Added tests: multibyte threshold, CJK splitting, mixed content

Retry (issue #10):
- Use checked_shl/saturating_mul to prevent overflow panic on large attempts
- Added test: delay_for_attempt with attempt=64 and attempt=99

Recall (issue #6):
- Added 100KB query size limit to prevent OOM during tokenization

Unwrap elimination (issues #13, #14):
- Replace all serde_json::to_string_pretty().unwrap() with unwrap_or_else
- Replace Arrow StringArray downcast unwrap with graceful fallback

Atomic ordering (issue #12):
- Change recall_count from Relaxed to AcqRel ordering

Path leakage (issue #9):
- Provenance now stores only directory name, not full filesystem path

Dangling edges (issue #11):
- Validate related IDs exist in LanceDB before creating graph edges
- Ensure target nodes exist in graph before creating edges

Score transparency (issue #8):
- Track raw_similarity alongside boosted similarity in recall results
- Include raw_similarity in JSON output when it differs from boosted score

Data loss prevention (issue #2):
- expire_item: emergency recovery re-inserts original item if update fails

Graceful shutdown (issue #7):
- Wait up to 10s for consolidation semaphore before shutdown
- Increased runtime shutdown timeout from 2s to 5s

Cross-database atomicity (issues #1, #3):
- Replace workflow now aborts with compensation on transfer_edges failure
- Deletes new item and graph node if edge transfer fails
- Preserves original item instead of leaving inconsistent state

https://claude.ai/code/session_01WLA4gnq7gQrAgquAVB4p8r
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant