Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / wangkuiyi / cjk-tokenzier
Public GitHub Catalog Discovered Sep 28, 2026

wangkuiyi / cjk-tokenzier

A unigram CJK tokenizer

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.

#12097060GitHub System ID
wangkuiyiOrganization / User
PublicVisibility
ActiveCatalog Status

More from wangkuiyi

↗

wangkuiyi/nan

`nan` rewrites your Go program to add panic checks for NaN. It can also remove these panic checks. Machine learning guys would love `nan`.

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.

SPONSORED Sponsored Partner