Simplify span caches Split from https://github.com/rust-lang/rust/pull/143882 r? `@petrochenkov`
compiler/