Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

EastAsianWidth.txt Format Change after Unicode 15.1.0 #585

Merged
merged 3 commits into from
Aug 23, 2023
Merged

EastAsianWidth.txt Format Change after Unicode 15.1.0 #585

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
aa4c5b0
fix bin/generate_east_asian_width for Unicode 15.1.0
elfham Aug 22, 2023
d29b526
fix a regexp of parsing EastAsianWidth.txt line
elfham Aug 23, 2023
44b145c
Fix to use MatchData#[] instead of Regexp::last_match
elfham Aug 23, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 5 additions & 10 deletions bin/generate_east_asian_width
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,16 +8,11 @@ end
open(ARGV.first, 'rt') do |f|
list = []
f.each_line do |line|
next if line.start_with?(?#)
line.chomp!.sub!(/ .*/, '')
next if line.empty?
range, type = line.chomp.split(';')
type = type.to_sym
if range =~ /\h+\.\.\h+/
first, last = range.split('..').map{ |_| _.to_i(16) }
else
first = last = range.to_i(16)
end
next unless m = line.match(/^(\h+)(?:\.\.(\h+))?\s*;\s*(\w+)\s+#.+/)

first = m[1].to_i(16)
last = m[2]&.to_i(16) || first
type = m[3].to_sym
if !list.empty? and (list.last[:range].last + 1) == first and list.last[:type] == type
list.last[:range] = (list.last[:range].first..last)
else
Expand Down