# taoyuan/node-tokenizer

> A tokenizer that looks like a stream for JavaScript and node.js

- **Canonical URL**: https://githubrepo.cloud/repo/taoyuan/node-tokenizer
- **GitHub Repository**: https://github.com/taoyuan/node-tokenizer
- **Maintainer / Creator**: https://github.com/taoyuan
- **Discovered On**: Oct 31, 2026

---
*Indexed by GitHubRepo (https://githubrepo.cloud). Real-time open-source discovery & telemetry.*