Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / dbc / tokenizertools
Public GitHub Catalog Discovered Oct 1, 2026

dbc / tokenizertools

Python text file tokenizers supporting multiple start states, lexical tracking, and lookahead.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#20908056GitHub System ID
dbcOrganization / User
PublicVisibility
ActiveCatalog Status

More from dbc

↗

dbc/landmaker

footprint generator for printed circuit board layout tools.

Discovered
↗

dbc/lookaheadtools

Lookahead iterators for Python. Turn any iterator into a lookahead iterator. Text file lookahead utilities.

Discovered
↗

dbc/ansisym

Creates ANSI-style gschem symbols from a simple specification.

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.