Carrot2

Korean unicode missing in JFlex tokenizer

Details

  • Type: Improvement Improvement
  • Status: Closed Closed
  • Priority: Minor Minor
  • Resolution: Fixed
  • Affects Version/s: 2.1
  • Fix Version/s: 2.1.1
  • Component/s: None
  • Labels:
    None

Description

The tokenizer should also include Korean characters in range: \uac00-\ud7a3

Activity

Hide
Stanisław Osiński added a comment -

Implemented in trunk.

Show
Stanisław Osiński added a comment - Implemented in trunk.
Hide
Stanisław Osiński added a comment -

Closing issues for the 2.1.1 release.

Show
Stanisław Osiński added a comment - Closing issues for the 2.1.1 release.

People

Vote (0)
Watch (0)

Dates

  • Created:
    Updated:
    Resolved: