1
Fork 0
Commit graph

16 commits

Author SHA1 Message Date
Jake Wheat 9fd2970f26 work on lexing: error cases
fix so following a number with either . or e or E without whitespace
  will cause a lexing error
remove */ from symbols in postgres (although postgres strictly
  speaking allows this I think, it is not a good idea)
reject */ anywhere with an error
reject ||| (or more pipes) in ansi, etc. dialects instead of trying to
  parse it as something like '||', '|'
2016-02-15 20:31:06 +02:00
Jake Wheat 4bca2fa2ec work on lexing
add utility function to tell if two tokens will pretty print then lex
back to the same two tokens or not

add notes for some final missing lexing bits that are in hssqlppp

add token combo tests for postgres

add start of sql server, oracle and odbc lexing tests
2016-02-15 20:20:24 +02:00
Jake Wheat 47198c78c1 add tests for + - followed by comment edge cases 2016-02-13 20:38:49 +02:00
Jake Wheat c24008444c work on postgres operator parsing 2016-02-13 20:28:12 +02:00
Jake Wheat 5084c0c3ab add lexing for \' only in e' strings and dollar strings in pg dialect 2016-02-13 17:07:27 +02:00
Jake Wheat b41803427d work on postgresql lexing
add positional arg
add e' quoted strings
add \' escaping in strings (not finished)
add ::, :=, : symbols
2016-02-13 16:31:20 +02:00
Jake Wheat a59f19aae9 don't unescape quotes in string literals and identifiers 2016-02-13 15:54:40 +02:00
Jake Wheat aa5c2e89c7 refactor the identifier syntax 2016-02-12 14:13:47 +02:00
Jake Wheat 52f035b718 new syntax for names and string literals 2016-02-12 13:09:58 +02:00
Jake Wheat 1b4eefc431 refactor dialect into a non enum and separate to own file 2016-02-12 12:51:06 +02:00
Jake Wheat 2b73907119 rename modules lexer->lex, parser->parse 2016-02-12 12:22:19 +02:00
Jake Wheat 91875b7e7e rearrange tests slightly and hide/show tests in the website a bit better 2015-08-15 19:04:29 +03:00
Jake Wheat 056cd1afda tweak lexer tests 2015-08-02 15:58:09 +03:00
Jake Wheat 3b5deec2e5 fix positioning in lexer? and fix line comment token missing trailing \n 2015-08-02 15:29:35 +03:00
Jake Wheat bbb793c160 small fixes
fix positions?
small fixes to haddock
add notes to top of lexer module
simplify line comment lexer
remove some trys from lexer
fix the block comment parser to return all the comment text when there
  are embedded / * in the comment
refactor the symbol, keyword and identifier blacklist checking into
  the low level token parsers instead of a separate step using guard
2015-08-01 13:22:07 +03:00
Jake Wheat 2df76e3095 add separate lexer 2015-08-01 00:04:18 +03:00