Commit graph

6479 commits

Author SHA1 Message Date
The 8472
1abe485e89 fix missing ns units in bootstrap's benchmark rendering 2024-12-20 13:37:45 +01:00
许杰友 Jieyou Xu (Joe)
cc3053a1f3
Rollup merge of #134437 - onur-ozkan:improve-compiler-build, r=jieyouxu
reduce compiler `Assemble` complexity

`compile::Assemble` is already complicated by its nature (as it handles core internals like recursive building logic, etc.) and also handles half of `LldWrapper` tool logic for no good reason since it should be done in the build step directly.

This change moves it there to reduce complexity of `compile::Assemble` logic.
2024-12-19 16:48:09 +08:00
onur-ozkan
bb1a90f939 reduce compiler Assemble complexity
`compile::Assemble` is already complicated by its nature (as it handles core
internals like recursive building logic, etc.) and also handles half of `LldWrapper`
tool logic for no good reason since it should be done in the build step directly.

This change moves it there to reduce complexity of `compile::Assemble` logic.

Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-18 21:42:54 +03:00
许杰友 Jieyou Xu (Joe)
88428f4dc3
Rollup merge of #134444 - jyn514:cranelift-std, r=bjorn3
Fix `x build --stage 1 std` when using cg_cranelift as the default backend

Before, cg_cranelift would ICE when trying to lower f16 and f128. The library/ crates had all the infrastructure to omit using them, it just wasn't hooked up to bootstrap.

r? `````@bjorn3`````
2024-12-18 22:56:57 +08:00
许杰友 Jieyou Xu (Joe)
099faa8beb
Rollup merge of #134420 - Integral-Tech:pathbuf-refactor, r=compiler-errors
refactor: replace &PathBuf with &Path to enhance generality

- According to [style.md](https://github.com/rust-lang/rust/blob/master/src/tools/rust-analyzer/docs/dev/style.md#useless-types):

> More generally, always prefer types on the left
```rust
// GOOD      BAD
&[T]         &Vec<T>
&str         &String
Option<&T>   &Option<T>
&Path        &PathBuf
```
2024-12-18 22:56:56 +08:00
jyn
39305bfaf2 Fix x build --stage 1 std when using cg_cranelift as the default backend
Before, cg_cranelift would ICE when trying to lower f16 and f128. The
library/ crates had all the infrastructure to omit using them, it just
wasn't hooked up to bootstrap.
2024-12-17 18:47:19 -05:00
Matthias Krüger
4b905c8a5d
Rollup merge of #134423 - jieyouxu:bootstrap-test-valid, r=onur-ozkan
bootstrap: use specific-purpose ui test path for `test_valid` self-test

I wanted to move some ui tests around in #134418, which broke `test_valid` since it was referencing two non-specific-purpose ui tests. This PR instead adds two dummy tests under `tests/ui/bootstrap/self-test/`, for that purpose specifically.

r? bootstrap
2024-12-17 22:34:44 +01:00
Matthias Krüger
ca5dfa74f1
Rollup merge of #133801 - Gelbpunkt:powerpc64le-unknown-linux-musl-tier-2, r=jieyouxu,Urgau,Kobzol
Promote powerpc64le-unknown-linux-musl to tier 2 with host tools

MCP: https://github.com/rust-lang/compiler-team/issues/803

I'm using crosstool-ng for building a toolchain because GCC 9 from `musl-toolchain.sh` has float ABI issues (?) and can't compile LLVM, and writing a crosstool-ng config for a target feels less hacky than yet another target specific shell script. I also defined a kernel version, since there wasn't one specified before. If a lower version is desired, just let me know. I also tried to match the rust configure args with the loongarch64 musl tier 2 target.

The resulting compiler works fine, built with `DEPLOY=1 ./src/ci/docker/run.sh dist-powerpc64le-linux` and tested on Alpine Linux in a VM and on a bare metal POWER8 machine:
```
qemu-ppc64le:/tmp/rust-nightly-powerpc64le-unknown-linux-musl$ ash install.sh
install: creating uninstall script at /usr/local/lib/rustlib/uninstall.sh
install: installing component 'rustc'
install: installing component 'rust-std-powerpc64le-unknown-linux-musl'
install: installing component 'cargo'
install: installing component 'rustfmt-preview'
install: installing component 'rls-preview'
install: installing component 'rust-analyzer-preview'
install: installing component 'llvm-tools-preview'
install: installing component 'clippy-preview'
install: installing component 'miri-preview'
install: installing component 'rust-analysis-powerpc64le-unknown-linux-musl'
install: installing component 'llvm-bitcode-linker-preview'
install: WARNING: failed to run ldconfig. this may happen when not installing as root. run with --verbose to see the error

    rust installed.

qemu-ppc64le:~$ echo 'fn main() { println!("hello world"); }' > test.rs
qemu-ppc64le:~$ rustc test.rs
qemu-ppc64le:~$ ./test
hello world
qemu-ppc64le:~$ file test
test: ELF 64-bit LSB executable, 64-bit PowerPC or cisco 7500, OpenPOWER ELF V2 ABI, version 1 (SYSV), statically linked, BuildID[sha1]=596ee6abf9add487ebc54fb71c2076fb6faea013, with debug_info, not stripped
```

try-job: dist-powerpc64le-linux
2024-12-17 22:34:41 +01:00
Integral
7eb0d84424
refactor: replace &PathBuf with &Path to enhance generality 2024-12-18 00:28:34 +08:00
许杰友 Jieyou Xu (Joe)
13e8313f15 bootstrap: use specific-purpose ui test path
I wanted to move some ui tests around, which broke `test_valid` since it
was referencing a non-specific-purpose ui test.
2024-12-17 21:01:45 +08:00
Ralf Jung
7dbfe4d4cf clarify that path() is for on-disk paths 2024-12-17 07:37:46 +01:00
Ralf Jung
6ace653a2f bootstrap: fix a comment 2024-12-17 07:35:21 +01:00
Ralf Jung
4795399ab6 bootstrap: make ./x test error-index work 2024-12-15 09:55:44 +01:00
bors
f1ec5d64b3 Auto merge of #134296 - matthiaskrgr:rollup-o0sxozj, r=matthiaskrgr
Rollup of 6 pull requests

Successful merges:

 - #132150 (Fix powerpc64 big-endian FreeBSD ABI)
 - #133942 (Clarify how to use `black_box()`)
 - #134081 (Try to evaluate constants in legacy mangling)
 - #134192 (Remove `Lexer`'s dependency on `Parser`.)
 - #134208 (coverage: Tidy up creation of covmap and covfun records)
 - #134211 (On Neutrino QNX, reduce the need to set archiver via environment variables)

r? `@ghost`
`@rustbot` modify labels: rollup
2024-12-14 13:06:18 +00:00
Matthias Krüger
a942794775
Rollup merge of #134211 - flba-eb:add_qnx_archiver, r=compiler-errors
On Neutrino QNX, reduce the need to set archiver via environment variables

This adds support for automatically selecting the correct `ar` tool when compiling for Neutrino QNX.
Once https://github.com/rust-lang/cc-rs/pull/1319 is merged and a new cc version is integrated, all environment variables of the [Neutrino documentation](https://github.com/rust-lang/rust/blob/stable/src/doc/rustc/src/platform-support/nto-qnx.md) can be removed.

CC: ````````@jonathanpallant```````` ````````@japaric```````` ````````@gh-tr```````` ````````@AkhilTThomas````````
2024-12-14 05:01:08 +01:00
Matthias Krüger
a53a3ccab4
Rollup merge of #134240 - cuviper:dist-llvm-tools, r=jieyouxu
Only dist `llvm-objcopy` if llvm tools are enabled

This uses the same condition that #132720 added in the compilation phase.

r? ``@jieyouxu``
2024-12-14 03:54:34 +01:00
Matthias Krüger
6cf13b0036
Rollup merge of #134209 - onur-ozkan:check-skip-paths, r=jieyouxu
validate `--skip` and `--exclude` paths

Fixes #134198

cc ``@ChrisDenton``
2024-12-14 03:54:32 +01:00
bors
dd436ae2a6 Auto merge of #133899 - scottmcm:strip-mir-debuginfo, r=oli-obk
We don't need `NonNull::as_ptr` debuginfo

In order to stop pessimizing the use of local variables in core, skip debug info for MIR temporaries in tiny (single-BB) functions.

For functions as simple as this -- `Pin::new`, etc -- nobody every actually wants debuginfo for them in the first place.  They're more like intrinsics than real functions, and stepping over them is good.
2024-12-13 08:32:20 +00:00
onur-ozkan
65a609b4f2 validate --skip and --exclude paths
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-13 10:05:39 +03:00
Josh Stone
4c6d793c66 Only dist llvm-objcopy if llvm tools are enabled 2024-12-12 17:06:03 -08:00
Matthias Krüger
8d2759b2ee
Rollup merge of #134207 - jieyouxu:revert-134040, r=lqd
Revert "bootstrap: print{ln}! -> eprint{ln}! (take 2) #134040"

Unfortunately, #134040 is proving to have caused more output interleaving problems that are tricky to diagnose and fix, and I think we probably should leave these untouched as bootstrap and compiletest has a bunch of interconnecting parts, and the commands and tools that they exercise do not consistently use stderr/stdout either. This causes hard-to-diagnose output interleaving bugs, which unfortunately degrades contributor experience.

This PR reverts two PRs in order to cleanly revert #134040:

1. Revert #134123 which is a fix-forward after #134040.
2. Revert #134040 itself.

I don't regret the initial effort `@clubby789,` and thank you for making the attempts, but I think we need to refrain from touching too many of these at once because some of the interleaving are very non-obvious and we don't have test coverage for.

r? `@clubby789`
cc `@Zalathar`
2024-12-12 19:00:44 +01:00
Florian Bartels
37bb774219 Reduce the need to set archiver via environment variables 2024-12-12 14:39:01 +01:00
许杰友 Jieyou Xu (Joe)
3c3512cf8c Revert "Rollup merge of #134040 - clubby789:bootstrap-eprintln, r=jieyouxu"
This reverts commit b282774aaf, reversing
changes made to e0f3db0056.
2024-12-12 19:24:01 +08:00
许杰友 Jieyou Xu (Joe)
50fac07281 Revert "Rollup merge of #134123 - Zalathar:json-output, r=jieyouxu,clubby789"
This reverts commit c42c248009, reversing
changes made to 0f1b827881.
2024-12-12 19:23:38 +08:00
Matthias Krüger
958fc08e68
Rollup merge of #134173 - onur-ozkan:allow-symbol-intern-string-literal, r=jieyouxu
allow `symbol_intern_string_literal` lint in test modules

Since #133545, `x check compiler --stage 1` no longer works because compiler test modules trigger `symbol_intern_string_literal` lint errors. Bootstrap shouldn't control when to ignore or enable this lint in the compiler tree (using `Kind != Test` was ineffective for obvious reasons).

Also, conditionally adding this rustflag invalidates the build cache between `x test` and other commands.

This PR removes the `Kind` check from bootstrap and handles it directly in the compiler tree in a more natural way.
2024-12-12 08:07:03 +01:00
onur-ozkan
12684456d3 remove Kind check for symbol_intern_string_literal
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-11 20:39:05 +03:00
bors
33c245b9e9 Auto merge of #134125 - fmease:rollup-u38o3ob, r=fmease
Rollup of 11 pull requests

Successful merges:

 - #133478 (jsondocck: Parse, don't validate commands.)
 - #133967 ([AIX] Pass -bnoipath when adding rust upstream dynamic crates)
 - #133970 ([AIX] Replace sa_sigaction with sa_union.__su_sigaction for AIX)
 - #133980 ([AIX] Remove option "-n" from AIX "ln" command)
 - #134008 (Make `Copy` unsafe to implement for ADTs with `unsafe` fields)
 - #134017 (Don't use `AsyncFnOnce::CallOnceFuture` bounds for signature deduction)
 - #134023 (handle cygwin environment in `install::sanitize_sh`)
 - #134041 (Use SourceMap to load debugger visualizer files)
 - #134065 (Move `write_graphviz_results`)
 - #134106 (Add compiler-maintainers who requested to be on review rotation)
 - #134123 (bootstrap: Forward cargo JSON output to stdout, not stderr)

Failed merges:

 - #134120 (Remove Felix from ping groups and review rotation)

r? `@ghost`
`@rustbot` modify labels: rollup
2024-12-10 13:16:09 +00:00
León Orell Valerian Liehr
c42c248009
Rollup merge of #134123 - Zalathar:json-output, r=jieyouxu,clubby789
bootstrap: Forward cargo JSON output to stdout, not stderr

This fixes the RA errors I've been seeing on proc-macros after the re-landing of #134040.

r? clubby789
2024-12-10 13:51:14 +01:00
León Orell Valerian Liehr
8e9953fc5c
Rollup merge of #134023 - onur-ozkan:132507, r=jieyouxu
handle cygwin environment in `install::sanitize_sh`

Resolves #132507
2024-12-10 13:51:11 +01:00
Zalathar
604ba9214d bootstrap: Forward cargo JSON output to stout, not stderr 2024-12-10 23:09:00 +11:00
Scott McMurray
a7fc76a3ab We don't need NonNull::as_ptr debuginfo
Stop pessimizing the use of local variables in core by skipping debug info for MIR temporaries in tiny (single-BB) functions.

For functions as simple as this -- `Pin::new`, etc -- nobody every actually wants debuginfo for them in the first place.  They're more like intrinsics than real functions, and stepping over them is good.
2024-12-10 01:29:43 -08:00
León Orell Valerian Liehr
ea64a5d811
Rollup merge of #133853 - onur-ozkan:use-vendor-directory-on-dist-build, r=Kobzol
use vendor sources by default on dist tarballs

Tarball sources are distributed with vendor sources along with the `.cargo/config.toml` file configured for vendor sources. This means we can use vendor sources by default unless explicitly disabled with `build.vendor=false` by the user. So, let's do that.
2024-12-10 08:55:57 +01:00
clubby789
15d7331a01 bootstrap: print{,ln}! -> eprint{,ln}! 2024-12-09 19:41:56 +08:00
onur-ozkan
d3b5340878 handle cygwin environments in install::sanitize_sh
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-08 18:27:46 +03:00
onur-ozkan
c4d7f1d29f implement TargetSelection::is_cygwin function
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-08 18:27:22 +03:00
Matthias Krüger
8c78d7a02f
Rollup merge of #133875 - onur-ozkan:early-return-rustfmt, r=jieyouxu
handle `--json-output` properly

Because `rustfmt` doesn't support JSON output, `x test --json-output` doesn't respect the `--json-output` flag during formatting step. This change makes that `x test` skips the formatting step if `--json-output` is specified. In addition, resolves #133855 with the 2nd commit.
2024-12-06 21:21:06 +01:00
onur-ozkan
31c4057bb8 handle json_output in test::run_cargo_test
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-06 11:23:56 +03:00
onur-ozkan
83909b6b05 skip formatting when --json-output is used
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-06 11:23:51 +03:00
Jens Reidel
68ce6596ec
Promote powerpc64le-unknown-linux-musl to tier 2 with host tools
MCP: https://github.com/rust-lang/compiler-team/issues/803

Signed-off-by: Jens Reidel <adrian@travitia.xyz>
2024-12-06 04:35:21 +01:00
Guillaume Gomez
5a9c9ef541
Rollup merge of #133821 - Kobzol:replace-black-with-ruff, r=onur-ozkan
Replace black with ruff in `tidy`

`ruff` can both lint and format Python code (in fact, it should be a mostly drop-in replacement for `black` in terms of formatting), so it's not needed to use `black` anymore. This PR removes `black` and replaces it with `ruff`, to get rid of one Python dependency, and also to make Python formatting faster (although that's a small thing).

If we decide to merge this, we'll need to "reformat the world" - `ruff` is not perfectly compatible with `black`, and it also looks like `black` was actually ignoring some files before. I tried it locally (`./x test tidy --extra-checks=py:fmt --bless`) and it also reformatted some code in subtrees (e.g. `clippy` or `rustc_codegen_gcc`) - I'm not sure how to handle that.
2024-12-05 23:47:11 +01:00
Jacob Pratt
6b58941688
Rollup merge of #133898 - onur-ozkan:ignore-git-hook-on-dist-sources, r=jieyouxu
skip `setup::Hook` on non-git sources

Running `setup::Hook` (with `x setup`) leads tarball sources to panic and this PR resolves that problem by skipping `Hook` step on non-git sources.
2024-12-05 05:50:55 -05:00
Jacob Pratt
3c58e5d522
Rollup merge of #133888 - ChrisDenton:job, r=jieyouxu
Improve bootstrap job objects

This attempts to fix a few comments on bootstrap job objects.

I also fixed an issue where if duplicating the job object handle into the python process failed, it would close the job object. This would then result in the job object closing all attached processes, which at that point includes the current process. The fix is to simply never close the job object handle at any point after the current process is assigned to it.
2024-12-05 05:50:54 -05:00
onur-ozkan
34d6a269e9 skip setup::Hook on non-git sources
Signed-off-by: onur-ozkan <work@onurozkan.dev>
2024-12-05 11:17:13 +03:00
Jieyou Xu
5b75493d99 Revert "Rollup merge of #133817 - clubby789:bootstrap-eprintln, r=jieyouxu"
This reverts commit 0585134e70, reversing
changes made to 5530869e0f.

The PR unfortunately only converted the `ln!` instances, meaning that
test output was messed up because stdout/stderr output interleaved when
some `println!` instances were converted to `eprintln!` instances, while
some `println!` instances remain unchanged.
2024-12-05 05:59:28 +00:00
Chris Denton
898d75122f
Update comments on Windows job objects 2024-12-05 03:45:05 +00:00
Chris Denton
a89f340efe
Nested job objects are now supported in CI
Nested job objects aren't supported on Windows 7 but we've long since moved on from that.
2024-12-05 03:18:53 +00:00
Chris Denton
01442e70a7
Never close a job after the process is assigned 2024-12-05 03:13:47 +00:00
Jakub Beránek
536516f949
Reformat Python code with ruff 2024-12-04 23:03:44 +01:00
Matthias Krüger
670affb122
Rollup merge of #133856 - GuillaumeGomez:update-sysinfo, r=clubby789
Update sysinfo version to 0.33.0
2024-12-04 18:23:44 +01:00
Matthias Krüger
adeb603052
Rollup merge of #133737 - Walnut356:msvc_visualizers, r=onur-ozkan
Include LLDB and GDB visualizers in MSVC distribution

MSVC distributions currently don't include the lldb or GDB python files. MSVC and LLDB/GDB are not mutually exclusive (and end up being a common case with vscode + codelldb/lldb-dap), so they should probably be included.

the existing visualizers currently only partially work on MSVC due to the differences in how the debug info is generated, but they also only partially work on GNU anyway - both of which are actively being fixed.
2024-12-04 18:23:36 +01:00