Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / nyxtom / tokens
Public GitHub Catalog Discovered Oct 3, 2026

nyxtom / tokens

Tokens is a simple nlp utility (written in go) for tokenizing strings using common split regular expressions for whitespace, words, emoticons, urls and more.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#26742099GitHub System ID
nyxtomOrganization / User
PublicVisibility
ActiveCatalog Status

More from nyxtom

↗

nyxtom/gracefulhttp

Graceful http server as referenced from http://grisha.org/blog/2014/06/03/graceful-restart-in-golang/

Discovered
↗

nyxtom/workclient

Simple abstraction for common worker routines, heartbeat to etcd, metrics to statsd/influx/graphite, boilerplate pipelining...etc

Discovered
↗

nyxtom/webterm

webterm is a simple web-based terminal built with golang and javascript

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.