![[ICO]](/icons/blank.gif){kind=icon}
![[PARENTDIR]](/icons/back.gif){kind=icon}
![[ ]](/icons/unknown.gif){kind=icon}
| Name | Last modified | Size | Description |
|---|---|---|---|---|
| Parent Directory | - | ||
| basic-protected-patterns | 2015-01-29 14:50 | 178 | |
| deescape-special-chars-PTB.perl | 2015-01-29 14:50 | 497 | |
| deescape-special-chars.perl | 2015-01-29 14:50 | 466 | |
| detokenizer.perl | 2015-01-29 14:50 | 11K | |
| escape-special-chars.perl | 2015-01-29 14:50 | 586 | |
| lowercase.perl | 2015-01-29 14:50 | 120 | |
| normalize-punctuation.perl | 2015-01-29 14:50 | 1.7K | |
| pre-tokenizer.perl | 2015-01-29 14:50 | 801 | |
| remove-non-printing-char.perl | 2015-01-29 14:50 | 286 | |
| replace-unicode-punctuation.perl | 2015-01-29 14:50 | 609 | |
| tokenizer.perl | 2015-01-29 14:50 | 16K | |
| tokenizer_PTB.perl | 2015-01-29 14:50 | 12K | |