Home | History | Annotate | Download | only in tts

Lines Matching full:token

587  *  @tokstart - address of a variable to receive the start of the token found
588 * @tokstart - address of a variable to receive the length of the token found
589 * return : 1=token found, 0=token not found
590 * notes : the token separator set could be enlarged adding characters in "seps"
615 * Searches for subtokens in a token having a compound structure with camel case like "xxxYyyy"
619 * @tokstart - address of a variable to receive the start of the sub token found
620 * @tokstart - address of a variable to receive the length of the sub token found
621 * return : 1=sub token found, 0=sub token not found
622 * notes : the sub token separator set could be enlarged adding characters in "seps"
639 /*characters all in seps found whithin string : return full token*/
649 /*transition non seps->seps not found : return full token*/
673 int toklen, tokstart; /*legnth and start of generic token*/
674 int stoklen, stokstart; /*legnth and start of generic sub-token*/
675 int pos, tokpos, outpos; /*postion of current char in input string and token and output*/
687 /*counting characters after sub token splitting including spaces*/