Update pyproject-toml to support PEP 639

[konstin]

PEP 639 is provisionally accepted, we were previously shipping definitions from an earlier draft.

We don't validate all that's in the PEP (license vs. license-files compatibility, SPDX expressions), only the overall structure of pyproject.toml.

Updates pep440_rs in the process.

Fixes #13869

[konstin]

This now became a valid example

[konstin]

Currently, we only emit a single error when various things are broken

[konstin]

The error message isn't ideal but the span should sufficiently prompt users to fix their authors table

[codspeed-hq]

CodSpeed Performance Report

Merging #13902 will improve performances by 5.21%

_{Comparing konsti/pep639 (6a54d3b) with main (70bdde4)}

Summary

⚡ 1 improvements
✅ 31 untouched benchmarks

Benchmarks breakdown

	Benchmark	main	konsti/pep639	Change
⚡	red_knot_check_file[incremental]	4.3 ms	4.1 ms	+5.21%

[MichaReiser]

Thanks. This looks good. Unfortunately, we need to find a solution for wasm :(

[github-actions]

ruff-ecosystem results

Linter (stable)

ℹ️ ecosystem check detected linter changes. (+2 -0 violations, +0 -0 fixes in 2 projects; 52 projects unchanged)

apache/airflow (+2 -0 violations, +0 -0 fixes)

ruff check --no-cache --exit-zero --ignore RUF9 --output-format concise --no-preview --select ALL

+ clients/python/pyproject.toml:27:1: RUF200 Failed to parse pyproject.toml: invalid type: map, expected a sequence
+ pyproject.toml:58:1: RUF200 Failed to parse pyproject.toml: invalid type: map, expected a sequence

pandas-dev/pandas (+0 -0 violations, +0 -0 fixes)

Changes by rule (1 rules affected)

code	total	+ violation	- violation	+ fix	- fix
RUF200	2	2	0	0	0

Linter (preview)

ℹ️ ecosystem check detected linter changes. (+2 -0 violations, +0 -0 fixes in 1 projects; 53 projects unchanged)

apache/airflow (+2 -0 violations, +0 -0 fixes)

ruff check --no-cache --exit-zero --ignore RUF9 --output-format concise --preview --select ALL

+ clients/python/pyproject.toml:27:1: RUF200 Failed to parse pyproject.toml: invalid type: map, expected a sequence
+ pyproject.toml:58:1: RUF200 Failed to parse pyproject.toml: invalid type: map, expected a sequence

Changes by rule (1 rules affected)

code	total	+ violation	- violation	+ fix	- fix
RUF200	2	2	0	0	0

Formatter (stable)

✅ ecosystem check detected no format changes.

Formatter (preview)

✅ ecosystem check detected no format changes.

[MichaReiser]

I went ahead and disabled the pyproject_toml linting for wasm to unblock this PR. That's why I request review from someone else.

[dhruvmanila]

Looking at the ecosystem changes, it seems that we'll now create diagnostic for the old definition related to license-files: https://github.com/apache/airflow/blob/476e77d9aba492a2159b256bc7a4aa86e560dee5/clients/python/pyproject.toml#L27. Do we want to maintain backwards compatibility?

[konstin]

I don't think so, that syntax was only part of a draft and never of any (provisionally) accepted PEP. It makes sense to lint against it to migrate the early adopters to the final version (and i'm expecting that hatch will migrate, too).

[MichaReiser]

Let's make this a breaking change.

[MichaReiser]

@konstin added wasm upstream. We can roll-back my rule exclusion once the new version is out. See PyO3/pyproject-toml-rs@2ed4df2