Commit Graph
4 Commits
Author SHA1 Message Date
bendtherules ff1c97af44 fix(agent-tools, setup): standardize metadata keys to lowercase and update HTML ingestion
- Renamed `partIndex`/`totalParts` to `partindex`/`totalparts` in `section_retriever.ts`, `spec_retriever.ts`, and document creation logic.
- Adjusted sorting logic to use the new `partindex` field.
- Updated metadata handling and string interpolation to reference the lowercase keys.
- Fixed import path for `HTMLTextSplitter` and moved the file to `setup/textsplitters/HtmlTextSplitter.ts`.
- Added HTML preprocessing utilities (`addNewlinesAfterBlocks`, `convertTablesToMarkdown`) in ingestion workflow.
- Integrated table-to‑markdown conversion and newline insertion to improve text splitting and document structure.
2026-04-04 12:33:05 +05:30
bendtherules 09f4f929ae Rename snake cased files to HTMLTextSplitter 2026-04-03 13:30:40 +05:30
bendtherules b3c9ed6dfd test(textsplitters): add more tests
- Verify that `splitDocuments` correctly prepends the provided `chunkHeader` to each chunk.
- Ensure `splitDocuments` returns an empty array when the source HTML yields no chunks.
2026-04-03 13:20:09 +05:30
bendtherules ec5669dcd7 feat: Impl HtmlTextSplitter 2026-04-03 11:04:40 +05:30