Repository navigation
Conversation
- 空白输入(isBlank)返回空列表:空/纯空白块流入 RAG 管道会产生 无可嵌入内容的 Document,部分 embedding 提供方直接拒绝 - 拼块结果过滤纯空白块,保留存活块的内容与顺序(chunkId 由 TextReader.createDocuments 对过滤后列表顺序编号,天然连续)
testChunkEmptyText 与 testEmptyText 断言旧行为(空文本产出 1 个空 Document);契约已改为空白输入不产出块/文档,同步更新并新增 whitespace-only 中间块被丢弃的用例。
Contributor
Author
|
The two CI failures are existing assertions of the old contract — |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #3305
What
isBlank) now returns an empty chunk list instead ofList.of("").TextReaderneeds no change:createDocumentsnumberschunkIds by index over the (now-filtered) chunk list, so IDs stay sequential.Downstream effect: blank
Documents no longer enterSimpleKnowledge.addDocuments, so no embedding request is spent on nothing-to-embed content.