# diasks2/pragmatic_tokenizer

> A multilingual tokenizer to split a string into tokens

- **Canonical URL**: https://githubrepo.cloud/repo/diasks2/pragmatic_tokenizer
- **GitHub Repository**: https://github.com/diasks2/pragmatic_tokenizer
- **Maintainer / Creator**: https://github.com/diasks2
- **Discovered On**: Nov 2, 2026

---
*Indexed by GitHubRepo (https://githubrepo.cloud). Real-time open-source discovery & telemetry.*