4 commits

Author	SHA1	Message	Date
Jake Wheat	056cd1afda	tweak lexer tests	2015-08-02 15:58:09 +03:00
Jake Wheat	3b5deec2e5	fix positioning in lexer? and fix line comment token missing trailing \n	2015-08-02 15:29:35 +03:00
Jake Wheat	bbb793c160	small fixes ... fix positions? small fixes to haddock add notes to top of lexer module simplify line comment lexer remove some trys from lexer fix the block comment parser to return all the comment text when there are embedded / * in the comment refactor the symbol, keyword and identifier blacklist checking into the low level token parsers instead of a separate step using guard	2015-08-01 13:22:07 +03:00
Jake Wheat	2df76e3095	add separate lexer	2015-08-01 00:04:18 +03:00