aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Make character properties unavailable in bracket expressionsRyo Nihei2021-12-115-33/+105
|
* Simplify process that generates UTF-8 byte sequences from a code point rangeRyo Nihei2021-12-113-371/+266
|
* Use new parser and DFA compilerRyo Nihei2021-12-1018-5152/+181
|
* Add a new DFA compiler that generates DFA from a set of CPTreeRyo Nihei2021-12-106-0/+1402
|
* Add a new parser that constructs a tree representing characters as code ↵Ryo Nihei2021-12-107-0/+3134
| | | | points, not byte sequences
* Move UTF8-related processes to utf8 packageRyo Nihei2021-12-013-702/+535
|
* Remove default value's code points of General_CategoryRyo Nihei2021-11-284-716/+40
|
* Support Script property (Meet RL1.2 of UTS #18 partially)Ryo Nihei2021-11-288-13/+2888
|
* Make contributory properties unavailable except internal useRyo Nihei2021-11-284-1/+89
| | | | | | | | | | | | This change follows [UAX #44 5.13 Property APIs]. > The following subtypes of Unicode character properties should generally not be exposed in APIs, > except in limited circumstances. They may not be useful, particularly in public API collections, > and may instead prove misleading to the users of such API collections. > > * Contributory properties are not recommended for public APIs. > ... https://unicode.org/reports/tr44/#Property_APIs
* Move all UCD-related processes to ucd packageRyo Nihei2021-11-279-4688/+4648
|
* Support Alphabetic property (Meet RL1.2 of UTS #18 partially)Ryo Nihei2021-11-265-8/+433
|
* Make character properties available in an inverse expression (Make ↵Ryo Nihei2021-11-252-0/+20
| | | | [^\p{...}] available)
* Support Lowercase and Uppercase property (Meet RL1.2 of UTS #18 partially)Ryo Nihei2021-11-256-29/+174
|
* Support White_Space property (Meet RL1.2 of UTS #18 partially)Ryo Nihei2021-11-247-26/+161
|
* Fix key of generalCategoryCodePoints mapRyo Nihei2021-11-233-731/+740
| | | | Use the abbreviation `cn` of the general category value `unassigned` as a key of the `generalCategoryCodePoints` map.
* Refactor the UCD file parsersRyo Nihei2021-11-233-155/+202
|
* Update CHANGELOGRyo Nihei2021-10-091-0/+12
|
* Update godocRyo Nihei2021-10-052-8/+16
|
* Remove the ModeName and KindName fields from the driver.Token structRyo Nihei2021-10-035-273/+316
|
* Format the source code of a lexer maleeni-go generatesRyo Nihei2021-10-021-40/+140
|
* Disallow upper cases in an identifierRyo Nihei2021-09-244-99/+116
|
* Remove --debug option from compile commandRyo Nihei2021-09-233-107/+2
|
* Keep the order of AST nodes constantRyo Nihei2021-09-224-20/+50
|
* Add name field to the lexical specificationRyo Nihei2021-09-188-23/+97
|
* Generate constant values representing mode IDs, mode names, kind IDs, and ↵Ryo Nihei2021-09-184-106/+515
| | | | kind names
* Update CHANGELOGRyo Nihei2021-09-141-0/+7
|
* Add maleeni-go commandRyo Nihei2021-09-144-37/+668
| | | | maleeni-go generates a lexer that recognizes a specific lexical specification.
* Define a lexical specification interfaceRyo Nihei2021-09-116-356/+373
|
* Remove --debug option from the lex commandRyo Nihei2021-09-082-63/+1
|
* Update CHANGELOGRyo Nihei2021-08-221-0/+7
|
* Add lexeme positions to tokensRyo Nihei2021-08-073-39/+226
| | | | close #1
* Use Go 1.16Ryo Nihei2021-08-072-2/+2
|
* Update CHANGELOGRyo Nihei2021-08-021-0/+7
|
* Change APIsRyo Nihei2021-08-0111-231/+289
| | | | | | | | | | | | | | | | | | | | | | Change fields of tokens, results of lexical analysis, as follows: - Rename: mode -> mode_id - Rename: kind_id -> mode_kind_id - Add: kind_id The kind ID is unique across all modes, but the mode kind ID is unique only within a mode. Change fields of a transition table as follows: - Rename: initial_mode -> initial_mode_id - Rename: modes -> mode_names - Rename: kinds -> kind_names - Rename: specs[].kinds -> specs[].kind_names - Rename: specs[].dfa.initial_state -> specs[].dfa.initial_state_id Change public types defined in the spec package as follows: - Rename: LexModeNum -> LexModeID - Rename: LexKind -> LexKindName - Add: LexKindID - Add: StateID
* Add unique kind IDs to tokensRyo Nihei2021-08-015-178/+239
|
* Fix CHANGELOGRyo Nihei2021-07-291-1/+1
|
* Update CHANGELOGRyo Nihei2021-07-221-0/+7
|
* Add CHANGELOGRyo Nihei2021-07-221-0/+17
|
* Add spec.EscapePattern functionRyo Nihei2021-07-222-0/+49
|
* Support passive mode transitionRyo Nihei2021-06-103-25/+140
|
* Update READMERyo Nihei2021-06-081-1/+1
|
* Update READMERyo Nihei2021-06-041-2/+30
|
* Add status badgeRyo Nihei2021-06-031-0/+2
|
* Set up CIRyo Nihei2021-06-031-0/+22
|
* Update READMERyo Nihei2021-06-021-0/+13
|
* Update READMERyo Nihei2021-05-281-0/+59
|
* Add example lexical specificationRyo Nihei2021-05-273-0/+604
|
* Allow duplicate names between fragments and non-fragmentsRyo Nihei2021-05-273-11/+123
|
* Add fragment expressionRyo Nihei2021-05-2511-61/+540
| | | | A fragment entry is defined by an entry whose `fragment` field is `true`, and is referenced by a fragment expression (`\f{...}`).
* Fix the initial state numberRyo Nihei2021-05-191-1/+5
| | | | Since 0 represents an invalid value in a transition table, assign a number greater than or equal to 1 to states.