-
Notifications
You must be signed in to change notification settings - Fork 377
Open
Description
When ngram_vocab=True is used, single words seem to be ignored in the vocabulary. In previous versions, this behavior did not occur, so I wanted to check if this change was intentional or an unintended regression.
Here’s the relevant line in the code:
Line 890 in 2435731
| vocab = phrases |
Suggested fix:
vocab += phrases Could merging the phrases with the previously built vocabulary resolve the issue, or is this the expected behavior in the latest version?
CodingKoopa, alesalloum and marvinscham
Metadata
Metadata
Assignees
Labels
No labels