Lexer: merge utf8 support and reduce distance with upstream

voodoos · Dec 12, 2024 · d21481f · d21481f
1 parent 41ee322
commit d21481f
Show file tree

Hide file tree

Showing 2 changed files with 275 additions and 136 deletions.
diff --git a/src/ocaml/preprocess/lexer_raw.mli b/src/ocaml/preprocess/lexer_raw.mli
@@ -22,7 +22,13 @@ type error =
   | Unterminated_string_in_comment of Location.t * Location.t
   | Empty_character_literal
   | Keyword_as_label of string
+  | Capitalized_label of string
   | Invalid_literal of string
+  | Invalid_directive of string * string option
+  | Invalid_encoding of string
+  | Invalid_char_in_ident of Uchar.t
+  | Non_lowercase_delimiter of string
+  | Capitalized_raw_identifier of string
   | Unknown_keyword of string
 exception Error of error * Location.t