mirror of
https://github.com/YuanDevTeam/Vole.git
synced 2026-11-18 16:06:28 +00:00
feat: add client protocols, TLS capabilities, and platform validation (#1)
* chore: download latest official mihomo for interop tests * test: capture N0 baseline and protocol feasibility probes * docs: record N0 hybrid REALITY fork verification * test: verify N0 controlled Hysteria2 auth and streams Add an isolated Quinn adapter over existing DIRECT and SOCKS5 datagrams, bounded queues, protect rejection probes, and official latest peer fixtures. Record passing auth/TCP checks and the native Hysteria half-close failure separately. N0 remains incomplete; production sources and dependency locks are unchanged. * test: validate N0 native QUIC hopping and XHTTP H3 Keep the probes isolated from production. Verify one-state Hysteria hopping, protected rebind rejection, Xray H3 entry and existing HY2 regressions. Set only the owned Linux peer MTU to avoid Initial-packet EMSGSIZE; retain native half-close failures as separate gates. * fix: align XHTTP shutdown with Mihomo connection close * test: verify N0 supplied-stream transport interfaces Add isolated TLS, ordinary WebSocket and gRPC probes with owned I/O, bounded buffers and cancellation barriers. Match Mihomo close behavior: preserve TLS/WS reads, distinguish clean WS underlay EOF from truncation, and close both gRPC directions. Use separate official SOCKS5 peers to avoid fixture loop detection. Record 12 Debug/Release tests, 42 official Mihomo checks, dependency audits and Apple/Android compile checks. Keep production dependencies, third-party sources and remaining N0 gates unchanged. * fix: upgrade h2 and retain completed responses after reset * chore: use the current OneXray rustls fork origin * chore: adopt published rustls 0.23.45 and official TLS binding * chore: refresh N1 foundation and spike dependencies * feat: validate next-protocol field and combination catalogs * feat: share immutable TLS policies and bounded close semantics * feat: add shared stream transports and decouple XUDP framing * feat: add controlled datagram foundations and N1 acceptance harness * chore: finalize N1 with verified x25519 dependency * chore: publish N1 against the rustls release branch * feat: add bounded Trojan request and datagram codecs * feat: connect Trojan TLS TCP and UDP through the runtime * feat: support Trojan WebSocket and duplex gRPC transports * feat: enable Trojan and complete N2 consumer acceptance * feat(vmess): add bounded AEAD header and body codecs * fix(vmess): align close acceptance with Mihomo transports * feat(vmess): add UDP codecs and isolated peer comparisons * feat(vmess): complete public runtime and N3 acceptance * docs: bind N3 acceptance and refresh validation guidance * feat(vless): complete N4 transports, Vision and UDP support Extract VLESS assembly, add plain/TLS stream transports, HTTPUpgrade, node-owned gRPC pooling, mTLS and classic REALITY, and implement Vision through public TLS record boundaries. Preserve XHTTP and the XUDP default while adding raw and packetaddr. Complete 145 required groups and 39 field rows against isolated latest official peers, with 160 lifecycle/resource rounds, independent coverage and Apple/Android release builds. Preserve the three explicit WS/REALITY layered close comparisons and historical failures in the acceptance report. No third-party or dependency-lock changes. * feat(vless): complete N5 XHTTP and sing-mux support Add H1/H2/H3 request fields, independent download security and pools, bounded packet-up batching, and h2mux/smux/yamux over controlled transports. Keep Mihomo-aligned close and path semantics, node-owned shutdown barriers, and isolated official-peer fixtures including the approved Caddy mTLS gateway. Validate 416 required groups, 57 fields, 112 two-leg security checks, 240 lifecycle/resource cycles, independent coverage, and Apple/Android release builds. Record native-peer gaps and leave N6-N10, devices, CI, and release gates separate. * feat: integrate boring TLS profiles and retire rustls fork * test(tls): freeze selected fingerprint reference baseline * docs(tls): record selected-profile library acceptance * feat(tls): integrate selected client fingerprints and REALITY profiles * feat(tls): complete selected fingerprint CF5 acceptance * feat(hysteria2): complete N6 client support and acceptance Implement Hysteria2 over official Quinn/h3/rustls and shared controlled IO, including TCP/UDP, bandwidth pacing, Salamander, port hopping, upstream snapshots and synchronous Stop. Keep old-path receives active for the full bounded handover window, preserve independent reader wakeups, and require the exact nested TCP evidence assertions. Validate one frozen N6 run: 36 required groups, 20 field rows, native Mihomo/Hysteria peers, H3 regression, 40 lifecycle rounds and Apple/Android production builds. Record independent coverage, artifact hashes and native-peer limitations. * test(tls): record N7 hybrid REALITY prerequisite evidence Preserve the locked classic-only API failure and distinguish the locally accepted boring hybrid extension from pending VCore S03/D16 integration. Record wrapper feasibility and publication boundaries without changing production configuration or dependencies. * feat(vless): support explicitly required hybrid REALITY * feat(crypto): wrap official BLAKE3 binary-context derivation * feat(vless): implement authenticated Encryption wire transport * feat(vless): enable authenticated Encryption across public transports * build(tls): pin the authenticated ShadowTLS ClientHello hook * feat(vless): add authenticated JLS transport security Pin the separately approved boring JLS revision and expose strict main/download credentials under schema 24. Preserve native CertificateVerify and Finished, cancellation, and controlled IO ownership. Accept the JLS field slice with 122 isolated cases, 80 lifecycle/resource cycles, and Apple/Android release libraries; keep broader N7 gates separate. * docs(n7): reconcile current JLS acceptance progress * chore(vless): retire Restls while retaining JLS * feat(vless): complete N7 static ECH and security combinations Add static ECH for VLESS main and XHTTP download legs using existing TLS backends and official Rust HPKE. Keep Invoke v5 and advance the internal schema to revision 27. Accept the narrowed N7 scope with 43 required groups, 11 fields, 301 isolated native cases, 240 lifecycle/resource rounds, and Apple/Android release builds. Record frozen inputs, 470 container cleanups, explicit upstream comparison gaps, and prior failed runs in docs/acceptance/next-protocols/N7.md. * chore(protocols): retire WireGuard scope and foundations * test: complete N9 protocol integration and resource gates * build: add N10 production artifact evidence gates * fix: restore Windows snapshot encoding and fail-closed delivery CI * fix: use native ARM64 LLVM assembly and scoped delivery CI * build: keep delivery lockfile bytes stable across platforms * fix: preserve production guard lifecycle and isolate CI feature checks * build: adopt released boring and registry shadowsocks * ci: use release-oriented workflow names * docs: consolidate contracts and streamline test tooling Merge current protocol and platform contracts, remove milestone reports and obsolete spikes, and share core checks between local development and CI. Preserve all 884 executable case definitions and unique legacy assertions. Validation: core Debug/Release, feature checks, Clippy, netstack, offline script tests, formatting and documentation links passed locally. Container interop smoke attempts failed during official peer downloads; business paths remain NOT RUN. * test: replace milestone names with capability-based validation Rename protocol and fingerprint suites, fixtures, and evidence identifiers by capability. Preserve acceptance cases and golden wire data while documenting reference, wire, and interoperability evidence separately. * fix: address review findings and stabilize core CI Flush accepted gRPC/H2 data through the supplied IO before reset, and wait for pending smux writes before FIN. Sanitize AnyTLS peer failures, reject XHTTP userinfo, and remove stale Android delivery artifacts. Close container log capture even when inventory fails. Keep legacy host suites blocked before resource acquisition. Separate Shadowsocks adapter codec checks from upstream strict server acceptance. Lock the random empty-request zero-padding failure with deterministic negative and positive fixtures, without changing the dependency or production behavior. * test: isolate delivery fixture from Windows home lookup * test: preserve UDP socket semantics during peer teardown The memory peer treated its counterpart closing an mpsc channel as a local UDP BrokenPipe. That could terminate Quinn endpoint IO without waking a pending wait_idle, despite all four datagrams and CONNECTION_CLOSE having arrived. Keep a closed peer link silent and late sends best-effort, add a deterministic fixture regression, and preserve the existing data and shutdown deadlines. Debug/Release, Clippy, and 300 consecutive regression iterations pass. * fix: drain XHTTP uploads before releasing connection drivers * fix: enforce lazy setup deadlines and safe delivery paths Check the original deadline before accepting ready gRPC/H2 headers or sing-mux status, without limiting established reads. Reject symlinks and Windows reparse points in every delivery output path before filesystem mutations. Add deterministic memory and temporary-filesystem regressions. * test: join XHTTP H3 peer tasks during cleanup Quinn retains closed connections for three probe timeouts, so a delayed handshake can legitimately exceed the fixture's two-second wait_idle budget. Own, abort, and join the passive peer tasks after upload and client shutdown instead. Preserve upload integrity and client close bounds, and cover delayed handshakes in both streaming modes.
This commit is contained in:
@@ -0,0 +1,600 @@
|
||||
"""Executable requirements and fail-closed structured result checks."""
|
||||
|
||||
from __future__ import annotations
|
||||
|
||||
import hashlib
|
||||
import json
|
||||
import re
|
||||
from pathlib import Path
|
||||
|
||||
from .protocol_catalogs import (
|
||||
CATALOG_DIR,
|
||||
CATEGORIES,
|
||||
FIELD_IDS,
|
||||
SUITES,
|
||||
_unique_object,
|
||||
)
|
||||
|
||||
FOUNDATIONS_REQUIRED_IDS = {
|
||||
"FOUNDATIONS-SCHEMA",
|
||||
"FOUNDATIONS-LIMITS",
|
||||
"FOUNDATIONS-STREAM",
|
||||
"FOUNDATIONS-DATAGRAM",
|
||||
"FOUNDATIONS-QUIC",
|
||||
"FOUNDATIONS-RESOLUTION",
|
||||
"FOUNDATIONS-RESOURCES",
|
||||
"FOUNDATIONS-SECURITY",
|
||||
"FOUNDATIONS-XUDP",
|
||||
"FOUNDATIONS-REGRESSION",
|
||||
"FOUNDATIONS-M-WS",
|
||||
"FOUNDATIONS-M-WSS",
|
||||
"FOUNDATIONS-M-GRPC",
|
||||
"FOUNDATIONS-M-GRPC-TLS",
|
||||
"FOUNDATIONS-M-WS-ED",
|
||||
"FOUNDATIONS-V2-HTTP",
|
||||
"FOUNDATIONS-V2-H2",
|
||||
"FOUNDATIONS-V2-WS-HEADER",
|
||||
"FOUNDATIONS-V2-WS-PATH",
|
||||
"FOUNDATIONS-FEATURES",
|
||||
"FOUNDATIONS-SCRIPTS",
|
||||
}
|
||||
HEX = re.compile(r"[0-9a-f]{64}")
|
||||
RESOURCE_KINDS = {
|
||||
"task",
|
||||
"socket",
|
||||
"session",
|
||||
"association",
|
||||
"reassembly",
|
||||
"pool",
|
||||
"waiter",
|
||||
"handshake",
|
||||
}
|
||||
|
||||
|
||||
def idle_resources(snapshot) -> bool:
|
||||
if not isinstance(snapshot, dict) or not isinstance(snapshot.get("counts"), list):
|
||||
return False
|
||||
counts = snapshot["counts"]
|
||||
return (
|
||||
len(counts) == len(RESOURCE_KINDS)
|
||||
and all(isinstance(count, dict) for count in counts)
|
||||
and {count.get("kind") for count in counts} == RESOURCE_KINDS
|
||||
and all(
|
||||
type(count.get("current")) is int
|
||||
and count["current"] == 0
|
||||
and type(count.get("peak")) is int
|
||||
and count["peak"] >= 0
|
||||
for count in counts
|
||||
)
|
||||
)
|
||||
|
||||
|
||||
def read_events(path: Path) -> list[dict]:
|
||||
if path.stat().st_size > 4 * 1024 * 1024:
|
||||
raise ValueError("case events exceeded bound")
|
||||
events = [
|
||||
json.loads(line, object_pairs_hook=_unique_object)
|
||||
for line in path.read_text().splitlines()
|
||||
]
|
||||
if not all(isinstance(event, dict) for event in events):
|
||||
raise ValueError("malformed structured case event")
|
||||
return events
|
||||
|
||||
|
||||
def read_json(path: Path):
|
||||
if path.stat().st_size > 4 * 1024 * 1024:
|
||||
raise ValueError("protocol evidence exceeds bounded document size")
|
||||
return json.loads(
|
||||
path.read_text(encoding="utf-8"), object_pairs_hook=_unique_object
|
||||
)
|
||||
|
||||
|
||||
def executable_cases() -> list[dict]:
|
||||
"""Single source: retained foundation fixtures plus current protocol catalogs."""
|
||||
from .protocol_hysteria2_catalog import definitions as hysteria2
|
||||
from .protocol_integration_catalog import definitions as integration
|
||||
from .protocol_security_catalog import definitions as security
|
||||
from .protocol_vless_acceptance import definitions as vless
|
||||
from .protocol_vmess_acceptance import definitions as vmess
|
||||
from .protocol_xhttp_acceptance import definitions as xhttp
|
||||
|
||||
foundation = read_json(CATALOG_DIR / "foundation-cases.json")["cases"]
|
||||
return foundation + [
|
||||
case
|
||||
for define in (vmess, vless, xhttp, hysteria2, security, integration)
|
||||
for case in define()
|
||||
]
|
||||
|
||||
|
||||
def load_manifest(path: Path | None = None) -> list[dict]:
|
||||
expected = executable_cases()
|
||||
data = (
|
||||
read_json(path)
|
||||
if path is not None
|
||||
else {
|
||||
"schema_version": 1,
|
||||
"kind": "executable-case-manifest",
|
||||
"cases": expected,
|
||||
}
|
||||
)
|
||||
if (
|
||||
not isinstance(data, dict)
|
||||
or type(data.get("schema_version")) is not int
|
||||
or data.get("schema_version") != 1
|
||||
or data.get("kind") != "executable-case-manifest"
|
||||
):
|
||||
raise ValueError("unsupported executable case manifest")
|
||||
cases = data.get("cases")
|
||||
if not isinstance(cases, list) or not cases:
|
||||
raise ValueError("empty executable case manifest")
|
||||
seen = set()
|
||||
for case in cases:
|
||||
required = {
|
||||
"case_id",
|
||||
"stage",
|
||||
"substage",
|
||||
"required",
|
||||
"row_ids",
|
||||
"protocol",
|
||||
"network",
|
||||
"security",
|
||||
"udp_codec",
|
||||
"field_values",
|
||||
"outer_family",
|
||||
"inner_family",
|
||||
"target_type",
|
||||
"upstream_graph",
|
||||
"peer_kind",
|
||||
"peer_config",
|
||||
"gap_source",
|
||||
"expected_observation",
|
||||
"required_evidence",
|
||||
"prerequisites",
|
||||
"runner",
|
||||
"timeout_seconds",
|
||||
}
|
||||
if not isinstance(case, dict) or not required <= case.keys():
|
||||
raise ValueError("incomplete executable case metadata")
|
||||
identifier = case["case_id"]
|
||||
if (
|
||||
not isinstance(identifier, str)
|
||||
or not re.fullmatch(r"[A-Z0-9-]+", identifier)
|
||||
or identifier in seen
|
||||
):
|
||||
raise ValueError("invalid or duplicate executable case ID")
|
||||
seen.add(identifier)
|
||||
if (
|
||||
case["stage"] not in SUITES
|
||||
or case["substage"] not in CATEGORIES
|
||||
or not case["substage"].startswith(case["stage"] + ".")
|
||||
):
|
||||
raise ValueError("invalid case ownership")
|
||||
if (
|
||||
type(case["required"]) is not bool
|
||||
or not isinstance(case["row_ids"], list)
|
||||
or len(set(case["row_ids"])) != len(case["row_ids"])
|
||||
or not set(case["row_ids"]) <= FIELD_IDS
|
||||
):
|
||||
raise ValueError("invalid required flag or field references")
|
||||
if case["peer_kind"] not in {"M", "H", "XR", "V2", "SS", "unit"}:
|
||||
raise ValueError("unknown peer kind")
|
||||
for key in ["expected_observation", "required_evidence", "prerequisites"]:
|
||||
items = case[key]
|
||||
if (
|
||||
not isinstance(items, list)
|
||||
or not items
|
||||
or not all(isinstance(item, str) and item for item in items)
|
||||
or len(items) != len(set(items))
|
||||
):
|
||||
raise ValueError("empty or duplicate executable observations")
|
||||
if (
|
||||
not isinstance(case["field_values"], dict)
|
||||
or not isinstance(case["peer_config"], dict)
|
||||
or type(case["timeout_seconds"]) is not int
|
||||
or not 1 <= case["timeout_seconds"] <= 3600
|
||||
):
|
||||
raise ValueError("invalid case bounds or configuration reference")
|
||||
if {
|
||||
case["case_id"]
|
||||
for case in cases
|
||||
if case["stage"] == "FOUNDATIONS" and case["required"]
|
||||
} != FOUNDATIONS_REQUIRED_IDS:
|
||||
raise ValueError("FOUNDATIONS required set was removed, renamed or downgraded")
|
||||
from .protocol_trojan_acceptance import REQUIRED_IDS
|
||||
|
||||
if {
|
||||
case["case_id"]
|
||||
for case in cases
|
||||
if case["stage"] == "TROJAN" and case["required"]
|
||||
} != REQUIRED_IDS:
|
||||
raise ValueError("TROJAN required set was removed, renamed or downgraded")
|
||||
if cases != expected:
|
||||
raise ValueError("manifest differs from the current executable catalog")
|
||||
return cases
|
||||
|
||||
|
||||
def check_limit_references(
|
||||
cases: list[dict], path: Path = CATALOG_DIR / "limits.json"
|
||||
) -> None:
|
||||
limits = read_json(path)
|
||||
identifiers = {case["case_id"] for case in cases}
|
||||
if (
|
||||
limits.get("schema_version") != 1
|
||||
or limits.get("kind") != "runtime-limit-registry"
|
||||
):
|
||||
raise ValueError("unsupported runtime limit registry")
|
||||
entries = limits.get("limits", [])
|
||||
names = [entry.get("id") for entry in entries]
|
||||
if not entries or len(names) != len(set(names)):
|
||||
raise ValueError("empty or duplicate runtime limits")
|
||||
for entry in entries:
|
||||
if (
|
||||
not entry.get("boundary_cases")
|
||||
or not set(entry["boundary_cases"]) <= identifiers
|
||||
):
|
||||
raise ValueError("runtime limit has no executable boundary case")
|
||||
|
||||
|
||||
def select_cases(
|
||||
cases: list[dict],
|
||||
*,
|
||||
stage: str,
|
||||
identifiers: list[str] | None = None,
|
||||
protocol: str | None = None,
|
||||
) -> list[dict]:
|
||||
if identifiers and (
|
||||
len(identifiers) != len(set(identifiers))
|
||||
or not set(identifiers) <= {case["case_id"] for case in cases}
|
||||
):
|
||||
raise ValueError("duplicate or unknown requested case")
|
||||
selected = [
|
||||
case
|
||||
for case in cases
|
||||
if case["stage"] == stage
|
||||
and case["required"]
|
||||
and (not identifiers or case["case_id"] in identifiers)
|
||||
and (protocol is None or case["protocol"] == protocol)
|
||||
]
|
||||
if not selected:
|
||||
raise ValueError("selection has no executable required cases; stage is NOT RUN")
|
||||
if identifiers and {case["case_id"] for case in selected} != set(identifiers):
|
||||
raise ValueError("case selection conflicts with stage or protocol")
|
||||
return selected
|
||||
|
||||
|
||||
def validate_results(required: list[dict], results: list[dict]) -> None:
|
||||
if not required:
|
||||
raise ValueError("empty required result set")
|
||||
expected = {case["case_id"]: case for case in required}
|
||||
identifiers = [result.get("case_id") for result in results]
|
||||
if len(identifiers) != len(set(identifiers)) or set(identifiers) != set(expected):
|
||||
raise ValueError("missing, duplicate or unknown case result")
|
||||
for result in results:
|
||||
case = expected[result["case_id"]]
|
||||
if (
|
||||
result.get("status") != "PASS"
|
||||
or result.get("cleanup") is not True
|
||||
or type(result.get("command_exit_code")) is not int
|
||||
or result["command_exit_code"] != 0
|
||||
):
|
||||
raise ValueError(
|
||||
"required case failed, was blocked/not run, or did not clean up"
|
||||
)
|
||||
observations = result.get("assertions", {})
|
||||
if (
|
||||
not isinstance(observations, dict)
|
||||
or set(observations) != set(case["expected_observation"])
|
||||
or not all(value is True for value in observations.values())
|
||||
):
|
||||
raise ValueError("missing or false required behavioral assertion")
|
||||
evidence = result.get("evidence", [])
|
||||
if (
|
||||
not isinstance(evidence, list)
|
||||
or len(evidence) != len(set(evidence))
|
||||
or set(evidence) != set(case["required_evidence"])
|
||||
):
|
||||
raise ValueError(
|
||||
"incomplete behavior evidence; CFG alone is not acceptance"
|
||||
)
|
||||
if (
|
||||
result.get("row_ids") != case["row_ids"]
|
||||
or result.get("peer_kind") != case["peer_kind"]
|
||||
or result.get("scope")
|
||||
!= (
|
||||
"protocol-consumer"
|
||||
if case["stage"]
|
||||
in {
|
||||
"TROJAN",
|
||||
"VMESS",
|
||||
"VLESS",
|
||||
"XHTTP",
|
||||
"HYSTERIA2",
|
||||
"SECURITY",
|
||||
"INTEGRATION",
|
||||
}
|
||||
else "foundation-only"
|
||||
)
|
||||
):
|
||||
raise ValueError("case mapping or evidence scope differs from manifest")
|
||||
|
||||
|
||||
def rust_results(case: dict, events: list[dict], returncode: int) -> dict:
|
||||
observed = [
|
||||
event
|
||||
for event in events
|
||||
if event.get("suite") == case.get("event_suite", case["case_id"])
|
||||
]
|
||||
names = case["expected_observation"]
|
||||
assertions = {name: False for name in names}
|
||||
unknown = any(
|
||||
event.get("assertion") not in assertions or event.get("schema_version") != 1
|
||||
for event in observed
|
||||
)
|
||||
for name in names:
|
||||
entries = [event for event in observed if event.get("assertion") == name]
|
||||
assertions[name] = len(entries) == 2 and [
|
||||
entry.get("status") for entry in entries
|
||||
] == ["BEGIN", "PASS"]
|
||||
if assertions[name] and "resources" in case["required_evidence"]:
|
||||
assertions[name] = idle_resources(entries[-1].get("resources"))
|
||||
result = new_result(case)
|
||||
result.update(assertions=assertions, command_exit_code=returncode, cleanup=True)
|
||||
result["status"] = (
|
||||
"PASS"
|
||||
if not unknown and returncode == 0 and all(assertions.values())
|
||||
else "FAIL"
|
||||
)
|
||||
if result["status"] == "PASS":
|
||||
result["evidence"] = [
|
||||
item for item in case["required_evidence"] if item != "peer-identity"
|
||||
]
|
||||
return result
|
||||
|
||||
|
||||
def new_result(case: dict) -> dict:
|
||||
return {
|
||||
"case_id": case["case_id"],
|
||||
"row_ids": case["row_ids"],
|
||||
"peer_kind": case["peer_kind"],
|
||||
"scope": "protocol-consumer"
|
||||
if case["stage"]
|
||||
in {"TROJAN", "VMESS", "VLESS", "XHTTP", "HYSTERIA2", "SECURITY", "INTEGRATION"}
|
||||
else "foundation-only",
|
||||
"status": "NOT RUN",
|
||||
"assertions": {},
|
||||
"evidence": [],
|
||||
"cleanup": False,
|
||||
"command_exit_code": None,
|
||||
}
|
||||
|
||||
|
||||
def artifact(run_dir: Path, relative: str, digest: str) -> Path:
|
||||
path = run_dir / relative
|
||||
if (
|
||||
Path(relative).is_absolute()
|
||||
or ".." in Path(relative).parts
|
||||
or path.is_symlink()
|
||||
or not path.resolve().is_relative_to(run_dir.resolve())
|
||||
or not HEX.fullmatch(digest)
|
||||
):
|
||||
raise ValueError("unsafe evidence path or invalid hash")
|
||||
with path.open("rb") as stream:
|
||||
actual = hashlib.file_digest(stream, "sha256").hexdigest()
|
||||
if actual != digest:
|
||||
raise ValueError("evidence content hash mismatch")
|
||||
return path
|
||||
|
||||
|
||||
def check_run(run_dir: Path, stage: str, manifest: Path | None = None) -> None:
|
||||
if manifest is None and (run_dir / "manifest.json").is_file():
|
||||
manifest = run_dir / "manifest.json"
|
||||
cases = load_manifest(manifest)
|
||||
check_limit_references(cases)
|
||||
required = select_cases(cases, stage=stage)
|
||||
run = read_json(run_dir / "run.json")
|
||||
result = read_json(run_dir / "cases.json")
|
||||
peers = read_json(run_dir / "peers.json")
|
||||
if (
|
||||
run.get("stage") != stage
|
||||
or run.get("mode") != "execute"
|
||||
or run.get("cleanup") is not True
|
||||
or run.get("source_unchanged") is not True
|
||||
or run.get("selected_cases") != [case["case_id"] for case in required]
|
||||
):
|
||||
raise ValueError(
|
||||
"partial/preflight run or changing source cannot sign off the stage"
|
||||
)
|
||||
for key in ["source_tree_sha256", "lock_sha256", "dirty_patch_sha256"]:
|
||||
if not isinstance(run.get(key), str) or not HEX.fullmatch(run[key]):
|
||||
raise ValueError("missing immutable input identity")
|
||||
validate_results(required, result)
|
||||
artifacts = run.get("artifacts", [])
|
||||
paths = [entry["path"] for entry in artifacts]
|
||||
if len(paths) != len(set(paths)):
|
||||
raise ValueError("duplicate evidence artifact")
|
||||
if stage in {
|
||||
"TROJAN",
|
||||
"VMESS",
|
||||
"VLESS",
|
||||
"XHTTP",
|
||||
"HYSTERIA2",
|
||||
"SECURITY",
|
||||
"INTEGRATION",
|
||||
}:
|
||||
if stage == "TROJAN":
|
||||
from .protocol_trojan_acceptance import check
|
||||
elif stage == "VMESS":
|
||||
from .protocol_vmess_acceptance import check
|
||||
elif stage == "VLESS":
|
||||
from .protocol_vless_acceptance import check
|
||||
elif stage == "XHTTP":
|
||||
from .protocol_xhttp_acceptance import check
|
||||
elif stage == "HYSTERIA2":
|
||||
from .protocol_hysteria2_acceptance import check
|
||||
elif stage == "SECURITY":
|
||||
from .protocol_security_acceptance import check
|
||||
else:
|
||||
from .protocol_integration_acceptance import check
|
||||
|
||||
for evidence in artifacts:
|
||||
artifact(run_dir, evidence["path"], evidence["sha256"])
|
||||
check(run_dir, required, run, result, peers, paths)
|
||||
return
|
||||
necessary = {
|
||||
"cases.json",
|
||||
"peers.json",
|
||||
"resources.jsonl",
|
||||
"summary.md",
|
||||
"rust-events.jsonl",
|
||||
"legacy-events.jsonl",
|
||||
"native/stream-cases.json",
|
||||
"script-tests.json",
|
||||
}
|
||||
if not necessary <= set(paths):
|
||||
raise ValueError("missing persisted behavior artifacts")
|
||||
for evidence in artifacts:
|
||||
artifact(run_dir, evidence["path"], evidence["sha256"])
|
||||
commands = run.get("commands", [])
|
||||
command_names = [command.get("name") for command in commands]
|
||||
required_commands = {
|
||||
"rust-foundations",
|
||||
"native-probe-build",
|
||||
"legacy-mihomo",
|
||||
"offline-scripts",
|
||||
"feature-default",
|
||||
"feature-minimal",
|
||||
"feature-outbound-trojan",
|
||||
"feature-outbound-vmess",
|
||||
"feature-outbound-hysteria2",
|
||||
"feature-stream-transport",
|
||||
"feature-quic-transport",
|
||||
}
|
||||
if (
|
||||
len(command_names) != len(set(command_names))
|
||||
or set(command_names) != required_commands
|
||||
or any(
|
||||
type(command.get("exit_code")) is not int
|
||||
or command["exit_code"] != 0
|
||||
or command.get("cleanup") is not True
|
||||
for command in commands
|
||||
)
|
||||
):
|
||||
raise ValueError("missing, failed or unjoined acceptance command")
|
||||
for command in commands:
|
||||
if command.get("log") and command["log"] not in paths:
|
||||
raise ValueError("command log has no content identity")
|
||||
rust_events = read_events(run_dir / "rust-events.jsonl")
|
||||
legacy_events = read_events(run_dir / "legacy-events.jsonl")
|
||||
native = read_json(run_dir / "native/stream-cases.json")
|
||||
native_cases = [case for case in required if case["runner"] == "native-stream"]
|
||||
if [item.get("case_id") for item in native.get("cases", [])] != [
|
||||
case["case_id"] for case in native_cases
|
||||
]:
|
||||
raise ValueError("missing, duplicate or unknown native case evidence")
|
||||
# Use exactly the same structured evaluators as execution, never console text.
|
||||
from .protocol_harness import SCRIPT_OBSERVATIONS, _native_results
|
||||
|
||||
recalculated = _native_results(native_cases, native)
|
||||
for case in required:
|
||||
if case["runner"] in {"rust", "mihomo-legacy"}:
|
||||
calculated = rust_results(
|
||||
case,
|
||||
legacy_events if case["runner"] == "mihomo-legacy" else rust_events,
|
||||
0,
|
||||
)
|
||||
if case["runner"] == "mihomo-legacy" and calculated["status"] == "PASS":
|
||||
calculated["evidence"] = case["required_evidence"]
|
||||
recalculated.append(calculated)
|
||||
actual = {item["case_id"]: item for item in result}
|
||||
for calculated in recalculated:
|
||||
for key in ["status", "assertions", "evidence", "cleanup", "command_exit_code"]:
|
||||
if actual[calculated["case_id"]].get(key) != calculated[key]:
|
||||
raise ValueError(
|
||||
"case result disagrees with original structured evidence"
|
||||
)
|
||||
script = read_json(run_dir / "script-tests.json")
|
||||
scripts = script.get("cases", [])
|
||||
tests = {entry["test"]: entry["status"] for entry in scripts}
|
||||
if (
|
||||
not scripts
|
||||
or len(tests) != len(scripts)
|
||||
or len(tests) != script.get("tests_run")
|
||||
or any(status != "PASS" for status in tests.values())
|
||||
or any(
|
||||
tests.get(identifier) != "PASS"
|
||||
for identifier in SCRIPT_OBSERVATIONS.values()
|
||||
)
|
||||
):
|
||||
raise ValueError("missing or failed offline harness failure-path proof")
|
||||
resources = read_events(run_dir / "resources.jsonl")
|
||||
if not resources or not all(
|
||||
idle_resources(event.get("resources")) for event in resources
|
||||
):
|
||||
raise ValueError("missing, nonidle or malformed owned resource evidence")
|
||||
resource_passes = [
|
||||
event
|
||||
for event in rust_events
|
||||
if event.get("suite") == "FOUNDATIONS-RESOURCES"
|
||||
and event.get("status") == "PASS"
|
||||
]
|
||||
for event in resource_passes:
|
||||
checkpoints = event.get("checkpoints", [])
|
||||
by_phase = {point["phase"]: point["resources"] for point in checkpoints}
|
||||
if (
|
||||
len(checkpoints) != len(by_phase)
|
||||
or not {"baseline", "after-stop"} <= by_phase.keys()
|
||||
or not idle_resources(by_phase["baseline"])
|
||||
or not idle_resources(by_phase["after-stop"])
|
||||
):
|
||||
raise ValueError("resource ownership has no baseline/Stop evidence")
|
||||
if "remain_quiet" in event["assertion"] and (
|
||||
by_phase.get("quiet") != by_phase["after-stop"]
|
||||
or event.get("seconds", 0) < 5
|
||||
):
|
||||
raise ValueError("resource quiet-window evidence missing")
|
||||
for case in required:
|
||||
if "peer-identity" in case["required_evidence"]:
|
||||
matches = [
|
||||
peer
|
||||
for peer in peers
|
||||
if peer.get("kind") == case["peer_kind"]
|
||||
and peer.get("status") == "READY"
|
||||
]
|
||||
if (
|
||||
len(matches) != 1
|
||||
or not matches[0].get("version")
|
||||
or not HEX.fullmatch(matches[0].get("binary_sha256", ""))
|
||||
or not HEX.fullmatch(matches[0].get("archive_sha256", ""))
|
||||
or not matches[0]
|
||||
.get("source_url", "")
|
||||
.startswith("https://github.com/")
|
||||
):
|
||||
raise ValueError("missing official peer identity")
|
||||
if case["runner"] == "native-stream":
|
||||
native_peers = [
|
||||
peer
|
||||
for peer in native.get("peers", [])
|
||||
if peer.get("kind") == case["peer_kind"]
|
||||
]
|
||||
if (
|
||||
len(native_peers) != 1
|
||||
or native_peers[0].get("binary_sha256")
|
||||
!= matches[0]["binary_sha256"]
|
||||
):
|
||||
raise ValueError("case used a different peer from preflight")
|
||||
if case["runner"] == "mihomo-legacy":
|
||||
peer = matches[0]
|
||||
if (
|
||||
peer.get("container_status") != "READY"
|
||||
or not HEX.fullmatch(
|
||||
peer.get("container_artifact", {}).get("binary_sha256", "")
|
||||
)
|
||||
or peer["container_artifact"].get("release") != peer.get("release")
|
||||
):
|
||||
raise ValueError(
|
||||
"legacy peer did not use the same official release snapshot"
|
||||
)
|
||||
print(
|
||||
f"{stage}: PASS ({len(required)} required foundation cases); "
|
||||
"production field consumers remain NOT RUN"
|
||||
)
|
||||
Reference in New Issue
Block a user