unknown

wikimedia-textcat is a PHP port of the TextCat language detection utility that uses n-gram-based models to identify the language of a given text. It includes a classifier script (catus.php), a model-generation script (felis.php), and a model-conversion script (lm2php.php). The package ships with 70+ wiki-text language models and 30+ query-based models, all built from Wikipedia corpora. It also handles edge cases like wrong-keyboard input (e.g., Russian typed on a US keyboard) and wrong-encoding scenarios (e.g., UTF-8 misread as Windows-1251). Installation is managed via Composer, and users can tune performance by limiting active language models and adjusting the number of n-grams used.

wikimedia/wikimedia-textcat: Mirror of https://gerrit.wikimedia.org/g/wikimedia/textcat See https://www.mediawiki.org/wiki/Developer_access for contributing

Welcome to PHP Dev, a dedicated space for sharing knowledge about PHP and its ecosystem (only PHP directly related).
Help us find good articles and blogposts and provide links. Upvote or downvote, after reading, it's essential