R package for (almost) language-agnostic sentence tokenization

sentenceR is a language-agnostic utility designed for sentence tokenization of a raw text. Using the UDPipe POS tagging pipeline, the package automatically extracts sentences with their appropriate indexes (hence the “crowbar” logo as a reference to extraction). The package works with any of the 100+ language models natively provided by UDPipe package (for more information and installation instructions see GitHub repository).


R package for bootstrapping wrodscores models

bws is a bootstrapping utility designed for stabilizing scaling scores across different reference documents. Build on top of quanteda wordscores function, the package automatically scales multiple wordscores models using user-defined pairs of reference documents and average the results as stabilized scaling scores (for more information and installation instructions see GitHub repository)..