Reference
About 85 wordsLess than 1 minute
2026-07-10
The reference section summarizes the stable public API surface and links to the full API page for exhaustive signatures.
| Package area | Page | Typical imports |
|---|---|---|
| Tokenizer facade | Tokenizer(Open in new window) | @tokenizer |
| Components | Components(Open in new window) | @model, @normalizer, @pretokenizer, @processor, @decoder |
| Types and errors | Types and Errors(Open in new window) | @types |
| Hub | Hub(Open in new window) | @hub |
| Trainers | Trainer(Open in new window) | @trainer / tokenizer trainer APIs |
For exhaustive signatures, see the full API page: API Reference(Open in new window).