Home | History | Annotate | Download | only in translit
      1 Copyright (c) 2002-2010, International Business Machines Corporation and others. All Rights Reserved.
      2 
      3 
      4 IMPORTANT:
      5 
      6 This sample was originally intended as an exercise for the ICU Workshop (September 2000).
      7 The code currently provided in the solution file is the answer to the exercises, each step can still be found in the 'answers' subdirectory.
      8 
      9 
     10 
     11   http://www.icu-project.org/docs/workshop_2000/agenda.html
     12 
     13   Day 2: September 12th 2000
     14   Pre-requisite:
     15   1. All the hardware and software requirements from Day 1.
     16   2. Attended or fully understand Day 1 material.
     17   3. Read through the ICU user's guide at
     18   http://www.icu-project.org/userguide/.
     19 
     20   #Transformation Support
     21   10:45am - 12:00pm
     22   Alan Liu
     23 
     24   Topics:
     25   1. What is the Unicode normalization?
     26   2. What kind of case mapping support is available in ICU?
     27   3. What is Transliteration and how do I use a Transliterator on a document?
     28   4. How do I add my own Transliterator?
     29 
     30 
     31 INSTRUCTIONS
     32 ------------
     33 
     34 This exercise was developed and tested on ICU release 1.6.0, Win32,
     35 Microsoft Visual C++ 6.0.  It should work on other ICU releases and
     36 other platforms as well.
     37 
     38  MSVC:
     39    Open the file "translit.sln" in Microsoft Visual C++.
     40 
     41  Unix:
     42    - Build and install ICU with a prefix, for example '--prefix=/home/srl/ICU'
     43    - Set the variable  ICU_PREFIX=/home/srl/ICU and use GNU make in 
     44         this directory.
     45    - You may use 'make check' to invoke this sample.
     46 
     47 
     48 PROBLEMS
     49 --------
     50 
     51 Problem 0:
     52 
     53   To start with, the program prints out a series of dates formatted in
     54   Greek.  Set up the program, build it, and run it.
     55 
     56 Problem 1: Basic Transliterator (Easy)
     57 
     58   The Greek text shows up almost entirely as Unicode escapes.  These
     59   are unreadable on a US machine.  Use an existing system
     60   transliterator to transliterate the Greek text to Latin so it can be
     61   phonetically read on a US machine.  If you don't know the names of
     62   the system transliterators, use Transliterator::getAvailableID() and
     63   Transliterator::countAvailableIDs(), or look directly in the index
     64   table icu/data/translit_index.txt.
     65 
     66 Problem 2: RuleBasedTransliterator (Medium)
     67 
     68   Some of the text is still unreadable and shows up as Unicode escape
     69   sequences.  Create a RuleBasedTransliterator to change the
     70   unreadable characters to close ASCII equivalents.  For example, the
     71   rule "\u00C0 > A;" will change an 'A' with a grave accent to a plain
     72   'A'.
     73 
     74   To save typing, use UnicodeSets to handle ranges of characters.
     75 
     76   See the included file "U0080.pdf" for a table of the U+00C0 to U+00FF
     77   Unicode block.
     78 
     79 Problem 3: Transliterator subclassing; Normalizer (Difficult)
     80 
     81   The rule-based approach is flexible and, in most cases, the best
     82   choice for creating a new transliterator.  Sometimes, however, a
     83   more elegant algorithmic solution is available.  Instead of typing
     84   in a list of rules, you can write C++ code to accomplish the desired
     85   transliteration.
     86 
     87   Use a Normalizer to remove accents from characters.  You will need
     88   to convert each character to a sequence of base and combining
     89   characters by applying a canonical denormalization transformation.
     90   Then discard the combining characters (the accents etc.) leaving the
     91   base character.  Wrap this all up in a subclass of the
     92   Transliterator class that overrides the pure virtual
     93   handleTransliterate() method.
     94 
     95 
     96 ANSWERS
     97 -------
     98 
     99 The exercise includes answers.  These are in the "answers" directory,
    100 and are numbered 1, 2, etc.  In some cases new files that the user
    101 needs to create are included in the answers directory.
    102 
    103 If you get stuck and you want to move to the next step, copy the
    104 answers file into the main directory in order to proceed.  E.g.,
    105 "main_1.cpp" contains the original "main.cpp" file.  "main_2.cpp"
    106 contains the "main.cpp" file after problem 1.  Etc.
    107 
    108 
    109 Have fun!
    110