[ERROR] Incorrect explanation about standard analyzer #1037
Description
Where is the error
There is no length filter anymore since this pull request
However, the document still writes:
By default, Milvus uses the standard analyzer, which tokenizes text based on whitespace and punctuation, removes tokens longer than 40 characters, and converts text to lowercase. No additional parameters are needed to apply this default setting. For more information, refer to Standard.
The description "removes tokens longer than 40 characters" is not correct anymore. The following links need reviewing:
- https://milvus.io/docs/v2.5.x/keyword-match.md#Optional-Configure-an-analyzer
- https://milvus.io/docs/phrase-match.md#Optional-Configure-an-analyzer
- https://milvus.io/docs/keyword-match.md#Optional-Configure-an-analyzer
How would you like to improve it
By default, Milvus uses the standard analyzer, which tokenizes text based on whitespace and punctuation,
removes tokens longer than 40 characters,and converts text to lowercase. No additional parameters are needed to apply this default setting. For more information, refer to Standard.
Screenshots
If applicable, add screenshots to help explain your problem.