fnl/tokenizer
a concurrent, deterministic finite state tokenizer (for letter-based scripts)
jump-start a simple GNU C project
This repository is cataloged as part of our automated global GitHub synchronization. Full telemetry, velocity snapshots, and code summaries are scheduled for continuous enrichment.
a concurrent, deterministic finite state tokenizer (for letter-based scripts)
an informative progress bar for Python 2+3 command-line tools
scripts to pre-process plain-text: sentence segmentation, tokenization, and stemming
a Python 3 command-line tool to maintain a DB mirror of MEDLINE (https://pypi.python.org/pypi/medic) - ALERT: As I have moved out of science and am working as a consultant now, this project might need a new maintainer once PubMed changes its XML format. Heroes?