Skip to content

Replace handcrafted case_ignorable with generation from Unicode data - #15866

Closed
AlexGx wants to merge 1 commit into
elixir-lang:mainfrom
AlexGx:ag-unicode_case_ignorable_gen-fix
Closed

AlexGx wants to merge 1 commit into
elixir-lang:mainfrom
AlexGx:ag-unicode_case_ignorable_gen-fix

Conversation

@AlexGx

@AlexGx AlexGx commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Replaces handcrafted case_ignorable list (word breaks) with generation from WordBreakProperty.txt (https://www.unicode.org/Public/17.0.0/ucd/auxiliary/WordBreakProperty.txt).

Old and generated lists are equal by elements, but in different order (doesn’t matter, they sorted later).

May improve future maintenance/Unicode version upgrade.

(Reviewed) Assisted-by: GPT-6

@josevalim

Copy link
Copy Markdown
Member

Since we use only a small portion of that file, I think we are fine with hardcoding for now. But if we are bit by them getting out of sync again, we should indeed add it. Thanks!

@josevalim josevalim closed this Sep 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants