Skip to content

Pull requests: pytorch-labs/tokenizers

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

Fix CQS signal facebook-unused-include-check in fbcode/pytorch/tokenizers CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#115 opened Jul 26, 2025 by facebook-github-bot Loading…
Fix CQS signal facebook-unused-include-check in fbcode/pytorch/tokenizers/src [A] CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#114 opened Jul 23, 2025 by facebook-github-bot Loading…
Fix CQS signal facebook-unused-include-check in fbcode/pytorch/tokenizers/src [B] CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#113 opened Jul 23, 2025 by facebook-github-bot Loading…
Fix CQS signal performance-faster-string-find in fbcode/pytorch/tokenizers CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#109 opened Jul 18, 2025 by facebook-github-bot Loading…
Fix CQS signal performance-faster-string-find in fbcode/pytorch/tokenizers CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#101 opened Jul 15, 2025 by facebook-github-bot Loading…
Fix CQS signal performance-faster-string-find in fbcode/pytorch/tokenizers/src CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#99 opened Jul 10, 2025 by facebook-github-bot Loading…
Add python sentencepiece tokenizer CLA Signed This label is managed by the Meta Open Source bot.
#88 opened Jun 26, 2025 by jackzhxng Loading…
Fix CQS signal performance-faster-string-find in fbcode/pytorch/tokenizers/src CLA Signed This label is managed by the Meta Open Source bot. fb-exported
#86 opened Jun 25, 2025 by facebook-github-bot Loading…
Make pretokenizer optional in hf tokenizer CLA Signed This label is managed by the Meta Open Source bot.
#81 opened Jun 5, 2025 by jackzhxng Draft
ProTip! Updated in the last three days: updated:>2025-07-24.