edit/tools/grapheme-table-gen
Leonard Hecker f8bea2be19
Some checks are pending
CI / check (ubuntu-latest) (push) Waiting to run
CI / check (windows-latest) (push) Waiting to run
Implement support for Ambiguous = Wide (#406)
Does what it says on the tin. It's just a lot in the can.

Closes #115
2025-06-04 23:39:56 +02:00
..
src Implement support for Ambiguous = Wide (#406) 2025-06-04 23:39:56 +02:00
Cargo.lock Initial import 2025-03-19 03:13:50 +01:00
Cargo.toml Initial import 2025-03-19 03:13:50 +01:00
README.md Document everything 2025-05-16 01:12:59 +02:00

Grapheme Table Generator

This tool processes Unicode Character Database (UCD) XML files to generate efficient, multi-stage trie lookup tables for properties relevant to terminal applications:

  • Grapheme cluster breaking rules
  • Line breaking rules (optional)
  • Character width properties

Usage

  • Download ucd.nounihan.grouped.zip
  • Run some equivalent of:
    grapheme-table-gen --lang=rust --extended --no-ambiguous --line-breaks path/to/ucd.nounihan.grouped.xml
    
  • Place the result in src/unicode/tables.rs