33 Commits

Author	SHA1	Message	Date
perf3ct	d2072c2a6f	"lock" notes that are having their embeddings created	2025-03-16 20:36:47 +00:00
perf3ct	781a2506f0	fix embeddings w/ cls.init()	2025-03-16 18:55:53 +00:00
perf3ct	0081e6f1d0	fix sql error and add missing options	2025-03-16 18:53:01 +00:00
perf3ct	c315b32c99	wait for DB init even to emit before starting LLM services	2025-03-16 18:21:43 +00:00
perf3ct	697d348286	set up more reasonable context window and dimension sizes	2025-03-16 18:08:50 +00:00
perf3ct	8d7e5c8d43	fix the maths for stats	2025-03-12 21:18:59 +00:00
perf3ct	ee7b2283de	correctly style the failed embeddings section	2025-03-12 21:13:49 +00:00
perf3ct	c914aaa4a8	do a better job of handling failed note embeddings	2025-03-12 21:04:06 +00:00
perf3ct	a930b79cf5	synchronize embeddings	2025-03-12 18:22:05 +00:00
perf3ct	b6df3a721c	allow user to select *where* they want to generate embeddings	2025-03-12 18:02:51 +00:00
perf3ct	3fee82eaa5	rename files with the same name	2025-03-12 16:51:09 +00:00
perf3ct	73445d97e7	move chunking to its own folder	2025-03-12 16:33:46 +00:00
perf3ct	46a6533e57	update chunking management	2025-03-12 01:26:25 +00:00
perf3ct	e5afbc6ddc	better manage chunking errors	2025-03-12 01:21:36 +00:00
perf3ct	fcba151287	allow for manual index rebuild, and ONLY rebuild the index	2025-03-12 00:17:30 +00:00
perf3ct	eaa947ef7c	"rebuild index" functionality for users	2025-03-12 00:08:39 +00:00
perf3ct	72b1426d94	break up large vector_store into smaller files	2025-03-12 00:02:02 +00:00
perf3ct	0d2858c7e9	upgrade chunking	2025-03-11 23:04:51 +00:00
perf3ct	1f661e4c90	make sure to not retry chunks if they fail or something else	2025-03-11 20:38:40 +00:00
perf3ct	f47b070f0f	I think this works to handle failed embeddings	2025-03-11 20:22:01 +00:00
perf3ct	71b3b04c53	break up the huge context_extractor into smaller files	2025-03-11 18:39:59 +00:00
perf3ct	0985cec8d6	implement chunking and use becca for some functionality	2025-03-11 18:17:41 +00:00
perf3ct	f482b3b4c8	do a better job of extracting context	2025-03-10 18:53:36 +00:00
perf3ct	adaac46fbf	I'm 100% going to have to destroy this commit later	2025-03-09 02:19:26 +00:00
perf3ct	733fdcf8ba	update relationship weights	2025-03-08 23:36:04 +00:00
perf3ct	7e232d17e1	Create better relationships between notes, sanitize ridiculous spacing to save tokens	2025-03-08 23:34:09 +00:00
perf3ct	51c83bbbc8	show fancier stats	2025-03-08 23:21:21 +00:00
perf3ct	0cd1be5568	Show embedding generation stats to user	2025-03-08 23:17:13 +00:00
perf3ct	6ace4d5692	nearly able to process embeddings	2025-03-08 23:08:25 +00:00
perf3ct	d3013c925e	add additional options for ollama embeddings	2025-03-08 22:23:50 +00:00
perf3ct	ea6f9c8e18	initialize embeddings if option is enabled	2025-03-08 22:04:31 +00:00
perf3ct	b248a7a2b5	create embedding services	2025-03-08 22:02:47 +00:00
perf3ct	e09e15ad05	start from scratch again	2025-03-02 18:58:25 -08:00