Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / jirkamarsik / trainable-tokenizer
Public GitHub Catalog Discovered Sep 24, 2026

jirkamarsik / trainable-tokenizer

Fast and trainable tokenizer for natural languages relying on maximum entropy methods.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.

#1430407GitHub System ID
jirkamarsikOrganization / User
PublicVisibility
ActiveCatalog Status

More from jirkamarsik

↗

jirkamarsik/ling-eff

Effects and Handlers in Natural Language -- the working repository for my PhD research

Discovered
↗

jirkamarsik/effects-paper

Source code for my LNCS 2014 paper, Algebraic Effects and Handlers in Natural Language Interpretation.

Discovered
↗

jirkamarsik/acgtk

A publicly open Git mirror for the ACG toolkit hosted at

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.