AIAC-TR-2026-01: Baseline Evaluation of Tokenization and Morphological Parsing for Kannada Corpora
Comprehensive empirical analysis comparing byte-pair encoding (BPE) vs sentencepiece subword segmentation on low-resource regional text with vocabulary boundary metrics. Evaluates agglutinative morphology preservation across 10,000 sentences from regional public administrative records.
