Skip to content

ANG-007: Markdown preprocessing & embedding pipeline#11

Open
yugalkaushik wants to merge 5 commits into
devfrom
ANG-007
Open

ANG-007: Markdown preprocessing & embedding pipeline#11
yugalkaushik wants to merge 5 commits into
devfrom
ANG-007

Conversation

@yugalkaushik

@yugalkaushik yugalkaushik commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator
  • Joplin now indexes notes into chunks and stores their vectors locally. This PR adds a provider that reads those vectors directly from that index. It checks if the index is ready, then pages through all stored vectors, averages them into one vector per note, and normalizes them. It handles model changes mid-flight by restarting, and notes that aren't indexed yet get reported as errors without blocking everything else. No preprocessing on our side since Joplin already handles cleanup and chunking during indexing.
  • Updated the joplin's api
  • Added export as SVG

This comment was marked as resolved.

This comment was marked as resolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants