v4.0.0

gpt-tokenizer

A pure JavaScript BPE tokenizer with model metadata and pricing for GPT-5, GPT-4o, o-series, and other OpenAI models

BPE encoder decoder tokenizer GPT GPT-2 GPT-3 GPT-3.5 GPT-4 GPT-4.1 GPT-4o GPT-5 o1 o3 o4 gpt-oss tiktoken tokens LLM token counting API pricing NLP Natural Language Processing Text Generation OpenAI Machine Learning ml
Website Repository

Click the AI button to generate exact installation commands and usage examples for your environment.

Dependencies (0)

Zero dependencies

Dev Dependencies (10)

Package Info

License

MIT

Last Publish

August 16, 2026

Unpacked Size

25.95 MB

Total Files

1537

Issue Tracker

Report a bug

Maintainers (1)