AIPython★ 201⑂ 9 forksMIT
cdcailf/cjkfold
Normalize Similar CJK Glyphs
Folds visually similar CJK glyphs (Kangxi radicals and CJK radical supplements) into a canonical form, enabling PDF‑extracted text to match searchable Unicode.
// KEY FEATURES
- Maps Kangxi radicals and CJK radical supplements to their base CJK Unicode equivalents.
- Provides a pure‑Python `fold_cjk` function that normalizes input strings in place.
- Useful for cleaning PDF‑extracted text where OCR substitutes look‑alike CJK glyphs.
New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram