Project

General

Profile

Actions

Feature #14802

closed

Update Unicode data to Unicode Version 11.0.0

Added by duerst (Martin Dürst) over 6 years ago. Updated almost 6 years ago.

Status:
Closed
Target version:
[ruby-core:87335]

Description

Unicode Version 11.0.0 will be published sometimes later this year, probably in late June. This is an issue to manage updating Ruby to Unicode 11.0.0. Details to follow.


Related issues 7 (0 open7 closed)

Related to Ruby master - Feature #13685: Update Unicode data to Unicode Version 10.0.0Closedduerst (Martin Dürst)Actions
Related to Ruby master - Feature #17750: Update Unicode data to Unicode Version 13.0.0Closedduerst (Martin Dürst)Actions
Blocked by Ruby master - Feature #14839: How to deal with capitalizing Georgian in Unicode 11.0.0Closedduerst (Martin Dürst)Actions
Blocked by Ruby master - Feature #15182: Update extended grapheme cluster implementation for Unicode 11Closedduerst (Martin Dürst)Actions
Blocked by Ruby master - Feature #15317: How to deal with obsolete property values in Unicode 11.0.0ClosedActions
Blocks Ruby master - Feature #15321: Update Unicode data to Unicode Version 12.0.0Closedduerst (Martin Dürst)Actions
Blocked by Ruby master - Bug #15337: String#each_grapheme_cluster wrongly splits "\r\n"Closednaruse (Yui NARUSE)Actions
Actions #1

Updated by duerst (Martin Dürst) over 6 years ago

  • Related to Feature #13685: Update Unicode data to Unicode Version 10.0.0 added

Updated by shevegen (Robert A. Heiler) over 6 years ago

All power to the emoji. \o/

Updated by duerst (Martin Dürst) over 6 years ago

Unicode Version 11.0.0 has been published, the official announcement can be found at http://blog.unicode.org/2018/06/announcing-unicode-standard-version-110.html.

Actions #4

Updated by duerst (Martin Dürst) over 6 years ago

  • Blocked by Feature #14839: How to deal with capitalizing Georgian in Unicode 11.0.0 added

Updated by naruse (Yui NARUSE) about 6 years ago

Just a note, the definition of extended grapheme cluster is changed in Unicode 11 (Unicode® Standard Annex #29
UNICODE TEXT SEGMENTATION revision 33: https://www.unicode.org/reports/tr29/tr29-33.html)
This affects Regexp /\X/ which is hardcoded in node_extended_grapheme_cluster() in regparse.c.

( CRLF
| Prepend*
( RI-sequence | Hangul-Syllable | !Control )
( Grapheme_Extend | SpacingMark )*
| . )
crlf 
| Control 
| precore* core postcore*
Actions #6

Updated by duerst (Martin Dürst) about 6 years ago

  • Blocked by Feature #15182: Update extended grapheme cluster implementation for Unicode 11 added

Updated by duerst (Martin Dürst) about 6 years ago

naruse (Yui NARUSE) wrote:

Just a note, the definition of extended grapheme cluster is changed in Unicode 11

This is mentioned at http://www.unicode.org/versions/Unicode11.0.0/, so I was (vaguely) aware of it, but thanks for the reminder. I have created a subissue at #15182. I may have to get back to you for some help, but first I have to fight with #14802 :-(.

Actions #8

Updated by duerst (Martin Dürst) almost 6 years ago

  • Blocked by Feature #15317: How to deal with obsolete property values in Unicode 11.0.0 added
Actions #9

Updated by duerst (Martin Dürst) almost 6 years ago

  • Blocks Feature #15321: Update Unicode data to Unicode Version 12.0.0 added
Actions #10

Updated by duerst (Martin Dürst) almost 6 years ago

  • Blocked by Bug #15337: String#each_grapheme_cluster wrongly splits "\r\n" added

Updated by duerst (Martin Dürst) almost 6 years ago

  • Status changed from Open to Closed

Some hints for future Unicode updates:

  • Check early whether modification to algorithms,... are necessary.

  • For tests, these are the main ones:
    test/test_unicode_normalize.rb
    test/ruby/enc
    test/ruby/test_m17n*
    test/ruby/test_regexp.rb
    test/ruby/test_string*

  • There are also some specs involved, so make sure to check them, too.

Actions #12

Updated by duerst (Martin Dürst) over 3 years ago

  • Related to Feature #17750: Update Unicode data to Unicode Version 13.0.0 added
Actions

Also available in: Atom PDF

Like0
Like0Like0Like0Like0Like0Like0Like0Like0Like0Like0Like0Like0