7 commits

Author	SHA1	Message	Date
Aleksey Kladov	850c3219fb	Move jointness censoring to proc_macro ... Proc-macro API currently exposes jointness in `Punct` tokens. That is, `+` in `+one` is **non** joint. Our lexer produces jointness info for all tokens, so we need to censor it *somewhere* Previously we did this in a lexer, but it makes more sense to do this in a proc-macro server.	2020-09-03 15:22:07 +02:00
Aleksey Kladov	fabd8a6834	Simplify TokenTreesReader ... This `joint_to_prev` bit of state is no longer needed.	2020-09-01 11:46:49 +02:00
Aleksey Kladov	5326361fc0	Remove trivia tokens	2020-09-01 11:39:11 +02:00
Aleksey Kladov	8f24c2ec9d	Don't emit trivia tokens	2020-09-01 11:39:11 +02:00
Aleksey Kladov	30ce15f1fa	Make StringReader private ... After the recent refactorings, we can actually completely hide this type. It should help with #63689.	2020-08-31 18:01:01 +02:00
Aleksey Kladov	518cac9190	Remove unused function	2020-08-30 19:54:45 +02:00
mark	9e5f7d5631	mv compiler to compiler/	2020-08-30 18:45:07 +03:00