v3.4.0
gpt-tokenizer
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
BPE encoder decoder tokenizer GPT GPT-2 GPT-3 GPT-3.5 GPT-4 GPT-4o NLP Natural Language Processing Text Generation OpenAI Machine Learning ml
Click the AI button to generate exact installation commands and usage examples for your environment.
Dependencies (0)
Zero dependencies
Dev Dependencies (8)
Package Info
License
MIT
Last Publish
November 7, 2025
Unpacked Size
50.64 MB
Total Files
1348
Issue Tracker
Report a bugMaintainers (1)
niieani npm@invent.life