rust/compiler/rustc_ast/src
bors f242d6c26c Auto merge of #127516 - nnethercote:simplify-LazyAttrTokenStream, r=petrochenkov
Simplify `LazyAttrTokenStream`

`LazyAttrTokenStream` is an unpleasant type: `Lrc<Box<dyn ToAttrTokenStream>>`. Why does it look like that?
- There are two `ToAttrTokenStream` impls, one for the lazy case, and one for the case where we already have an `AttrTokenStream`.
- The lazy case (`LazyAttrTokenStreamImpl`) is implemented in `rustc_parse`, but `LazyAttrTokenStream` is defined in `rustc_ast`, which does not depend on `rustc_parse`. The use of the trait lets `rustc_ast` implicitly depend on `rustc_parse`. This explains the `dyn`.
- `LazyAttrTokenStream` must have a `size_of` as small as possible, because it's used in many AST nodes. This explains the `Lrc<Box<_>>`, which keeps it to one word. (It's required `Lrc<dyn _>` would be a fat pointer.)

This PR moves `LazyAttrTokenStreamImpl` (and a few other token stream things) from `rustc_parse` to `rustc_ast`. This lets us replace the `ToAttrTokenStream` trait with a two-variant enum and also remove the `Box`, changing `LazyAttrTokenStream` to `Lrc<LazyAttrTokenStreamInner>`. Plus it does a few cleanups.

r? `@petrochenkov`
2025-04-30 00:09:21 +00:00
..
attr Auto merge of #139897 - nnethercote:rm-OpenDelim-CloseDelim, r=petrochenkov 2025-04-22 01:15:06 +00:00
expand Rollup merge of #139351 - EnzymeAD:autodiff-batching2, r=oli-obk 2025-04-17 21:53:23 +02:00
util Replace rustc_lexer/unescape with rustc-literal-escaper crate 2025-04-04 14:44:45 +02:00
ast.rs Add or-patterns to pattern types 2025-04-28 07:50:18 +00:00
ast_traits.rs Remove NtBlock, Nonterminal, and TokenKind::Interpolated. 2025-04-02 16:07:02 +11:00
entry.rs remove support for the #[start] attribute 2025-01-21 06:59:15 -07:00
format.rs Limit formatting width and precision to 16 bits. 2025-03-10 12:20:05 +01:00
lib.rs Simplify LazyAttrTokenStream. 2025-04-30 07:10:56 +10:00
mut_visit.rs Auto merge of #127516 - nnethercote:simplify-LazyAttrTokenStream, r=petrochenkov 2025-04-30 00:09:21 +00:00
node_id.rs Reformat use declarations. 2024-07-29 08:26:52 +10:00
ptr.rs Convert some Into impls into From impls 2024-12-31 01:56:33 +00:00
token.rs Remove token::{Open,Close}Delim. 2025-04-21 07:35:56 +10:00
tokenstream.rs Use ThinVec to shrink LazyAttrTokenStreamInner. 2025-04-30 07:12:09 +10:00
visit.rs Add or-patterns to pattern types 2025-04-28 07:50:18 +00:00