mirror of
https://github.com/stablyai/orca.git
synced 2026-09-25 16:02:38 +00:00
* feat(search): bundle ripgrep for local, WSL, and SSH search Ship @vscode/ripgrep-universal's prebuilt rg for all six relay platforms in every desktop artifact. Local and WSL searches spawn the bundled binary and drop the git ls-files / git grep fallbacks; SSH deploys upload the remote's binary once per ripgrep version and the relay prefers it over PATH rg. * fix(search): address bundled ripgrep review findings - Key the SSH ripgrep cache on the binary's content hash; a package bump is the only update step - glibc verifier: read arch tokens below the slice root and accept static ELFs (arm64 release blocker) - Ship ripgrep/PCRE2/musl license notices; bundle rg with orcad - Packaged builds never spawn a bare rg; report fd pressure as transient - SSH: install rg before sweep/GC, size-validate installs, back off instead of disabling on launch failure - Scope Dependabot to @vscode/ripgrep-universal; revert unrelated lockfile churn * chore(search): drop bundled-ripgrep reference doc; assert full packaging layout parity * refactor(search): one entry point for spawning the bundled ripgrep Local Quick Open, Quick Open path search, the Explorer name filter, and runtime text search each repeated the same three steps: resolve the bundled command, spread in the WSL distro, spread in the WSL shell expression. Fold that into spawnBundledRipgrep so one place owns the rule that a bare 'rg' must never reach spawn, and simplify the resolver's command/packaged checks. Restore the AGENTS.md ripgrep rule dropped alongside its reference doc in63f4dac, and note why the relay's availability probe may spawn a bare 'rg'. No behaviour change; verified by the existing suites plus a new test that pins the local, WSL-routed, and distro-routed-but-Windows-output cases. * refactor(search): drop the local install-ripgrep path; enforce the rg rule Bundling rg removed the local git/readdir fallback, so nothing can produce the "install ripgrep on the host running the Quick Open scan" guidance any more -- only a remote host an upload never reached still reaches the capped listing. Drop the host parameter, the renderer's local branch and its translation key, and the relay wrapper that existed only to pass 'remote'. Add a ratchet test for bare 'rg' spawns, since the AGENTS.md rule alone had nothing enforcing it. Its one allowlist entry is the relay's PATH probe, which asks about PATH by definition. Verified the guard catches a planted offender rather than passing vacuously. Also stop chaining the remote cleanup sweep behind the ripgrep upload: on a cold host that is a multi-MB transfer, and stale upload stages and superseded version dirs were left on the remote for its whole duration. The two touch different trees, so they now run concurrently. * test(ssh): pin that the cleanup sweep does not wait on the ripgrep upload * fix(search): derive rg spawn types instead of importing node:child_process A type-only import still counts against the child_process ratchet, whose pin and allowlist only ever shrink. Derive both types from wslAwareSpawn instead. * fix(search): surface an unreachable WSL workspace instead of an empty result Inside `bash -c`, a failed `cd` exits 1 -- the same code ripgrep uses for "no matches" -- so a WSL workspace whose directory had gone away reported an empty listing as a successful scan. main did not have this hole: checkRgAvailable ran the same `cd` wrapper first and settled on `code === 0`, diverting to the git fallback that this PR deletes. The WSL wrapper now takes an optional cwdFailureExitCode; rg passes 97, and all four close handlers reject with a clear error before the unavailable check can blame the install. Also from review: - Bound the fire-and-forget ripgrep upload with deploySignal. The controller aborts only on the deploy timeout, never on success, so this cancels a still-running upload when the deploy gives up. - Run the stale-stage sweep before the installed check rather than inside its else branch. Once rg was installed every later deploy took the PRESENT path, so a stage orphaned by a dropped connection was never collected again. - Note in orcad-remote-deploy.ts why wiring it up needs ripgrep work first: build-orcad.mjs copies only the build host's rg, and orcad reports isPackaged() === true, so a remote of another platform would find nothing. ssh-relay-deploy.test.ts sat at the max-lines cap, so any edit to it failed the gate. Split the four Windows named-pipe deploys into their own file (926 -> 737 + 333); both are now well clear of it. * fix(search): name the unreachable root in every handler, not three of four Round-two review caught that the missing-cwd branch in scanRipgrepPaths sat AFTER isRipgrepUnavailableExit, which classifies any code above 2 as a broken install -- so for exit 97 it was dead code and Quick Open still told the user to reinstall Orca. Reordered; all four handlers now check it first. Also from review: - A vanished workspace makes spawn fail with ENOENT, which read as a damaged install on every local path. Confirm the cwd with isRipgrepSpawnCwdUsable -- the guard the relay already applies -- before blaming the binary. The async continuation re-checks `resolved`, because finish() drops its argument once settled and the rejected promise would otherwise go unhandled. - bundledRipgrepCommand returned a bare 'rg' for an arch outside the bundled set, bypassing the guard that exists so Windows cannot resolve a bare name against the repo cwd. A packaged app now always names an absolute path. Drop ci-shards/unit-assignment.json, a 9,425-line CI artifact swept in from reproducing a shard locally, and gitignore the directory that produced it. The "rg genuinely cannot start" test pointed at a synthetic /repo, which the new guard correctly reports as unreachable; it now resolves to a real root so it still tests what its name says. * fix(search): let the error handler own the spawn-failure verdict A failed spawn emits 'error' and THEN 'close' with a negative code. The cwd check added in the error handler did not settle, so the close handler settled first -- synchronously, with the reinstall message -- and won the race every time. The branch was not merely flaky, it was unreachable in all four handlers: it is guarded by pid === undefined, which is exactly the case that always produces a following close(code < 0). Verified against a real spawn: 3/3 runs give error(ENOENT) -> close(-2). The error handler now detaches 'close' before the probe, so it owns the outcome. The probe also had no rejection handler, so a probe that rejected left the search unsettled forever -- a hang, not just a wrong message. It now falls back to the prior verdict rather than inventing one. Tests: filesystem-search-rg-timeout and orca-runtime-files-search already cover error-first and close-first, but against synthetic roots that the new guard correctly calls unreachable; they now resolve to a real root, keeping each test's stated intent. Added a Quick Open case for the vanished-workspace path and confirmed it fails with the old ordering. * test(search): cover exit code 97 in all four ripgrep close handlers Round-four review found the missing-cwd branch had zero handler coverage: no test anywhere emitted close(97), only -2/0/1/2/127. Ordering was correct, but guarded by source-line order alone -- and that exact ordering was wrong in three of four handlers two commits ago. Each suite now drives close(97) through its real handler and expects the unreachable-root message. Verified the tests earn their place: neutering the missing-cwd check fails exactly four tests, one per handler. Also drop a Reflect.get the anti-slop gate rejects, in favour of `in` narrowing. * docs(search): stop claiming the close handler always wins the race The previous commit asserted close "would beat this threadpool round-trip every time", from an n=3 sample that measured event ordering -- which was never in dispute -- rather than probe-vs-close. Two later measurements disagree with each other: 50/50 close-first here, 30/50 probe-first in review. Either way it is a race on a sub-millisecond margin, and the detach is what makes the verdict deterministic. Why this wording matters: "close wins every time" is an argument for deleting the detach as a guard against an impossible race. No test would catch that -- the suites emit error and close in the same synchronous tick. * chore(search): ship the jemalloc and libunwind notices the Linux rg needs The statically linked Linux builds carry jemalloc (BSD-2-Clause) and LLVM libunwind (Apache-2.0 WITH LLVM-exception) in addition to PCRE2 and musl, and both require their notice on binary redistribution. Confirmed with `strings`: their symbols are present in linux-x64 and linux-arm64 and absent from the darwin and win32 builds. Texts taken from the upstream canonical sources. extraResources already copies the whole licenses directory, so these ship without a packaging change. * fix(relay): stop spawning a bare rg, name unreachable roots, collect old builds Three gaps the reviews surfaced on the remote side, all pre-existing on main. Bare `rg` on Windows remotes. Both relay spawn sites pass the user's repo as cwd, and CreateProcessW searches the cwd before PATH -- the same hijack the desktop side already fixes. The relay now walks PATH itself and spawns an absolute rg.exe, skipping relative PATH entries because those resolve against the cwd. No rg on PATH yields null, which callers treat as "ripgrep unavailable" rather than handing spawn a bare name. POSIX keeps the bare name: execvp never consults the cwd, so there is nothing to resolve and nothing to gain. With the last probe converted, the bare-spawn ratchet allowlist is empty. Empty results for an unreachable root. settleLaunchFailure resolved an empty, successful-looking scan when the root was gone but PATH rg existed, and the git/readdir chain never engaged because it only triggers on RipgrepUnavailableError. Both relay paths now reject naming the root, matching local workspaces. Missing-rg keeps precedence over a missing root, because only that verdict engages the fallback chain -- two tests pinned that deliberately and it would have been wrong to flip it. Unbounded ~/.orca-remote/ripgrep/. Nothing collected this tree; the relay's version GC only matches `relay-*`, so every rg bump left another ~5 MB per host forever. The probe command now also drops sibling builds older than two weeks, sparing the current one and live upload stages, on POSIX and PowerShell alike. Two weeks because a client pinned to an older build may still be using it; the cost of collecting one early is that client re-uploading once. * fix(relay): probe the rg that failed, and close the drive-relative PATH hole Five review findings against the previous commit, all reproduced first. The launch-failure classifier probed PATH rg, but the spawn that failed was the bundled binary. On the normal remote setup -- no rg on PATH, which is why Orca uploads one -- the probe failed and a moved workspace was reported as a missing ripgrep, telling the user to install what Orca already ships. So the fix was inert on exactly the hosts the uploader exists for. It now takes a candidate list and asks the binary that actually failed first, then PATH. path.win32.isAbsolute accepts `\tools` and `/tools`: rooted, but carrying no drive, so they resolve against whatever drive the process is on. The probe would have validated one against the relay's drive while the spawn, running with the user's repo as cwd, resolved it against the repo's -- the same cwd-dependence this lookup removes, narrowed from directory to drive. A real drive letter or UNC root is now required. probeRipgrepVersion had lost the timeout's kill in the rewrite, leaking a live process and a ref'd handle per launch failure -- for a hang, which is the very case the bundled-rg back-off exists for. It also spawned without windowsHide, which would flash a console; fixing that made an allowlist entry stale, so the entry is gone and the pin ratchets down 63 -> 62. `windowsPathRipgrep ??= …` never memoised a miss, because null is nullish. The caching was inverted against cost: a hit stops at the first directory, a miss stats every one, and only the miss was repeated -- per spawn. The bare-spawn ratchet claimed "nothing in production spawns a bare rg", which is false on POSIX. It now also matches PATH_RIPGREP_COMMAND at a spawn site, and the comment states plainly what a textual guard cannot see: the POSIX bare name reaches spawn as a parameter, and is safe because execvp ignores the cwd. The drive-rooted predicate is tested directly rather than through the filesystem -- a temp dir on a POSIX CI host has no drive letter to exercise win32 semantics with, so the filesystem test could never have caught this. * test(mobile): repin the session closure past #22452's two shared modules Merging main brought the closure to 4220 against a pin of 4218. The two extra modules are `src/shared/agent-turn-outcome.ts` and `src/shared/main-agent-status.ts` from #22452, which the status projection this route already reaches import. That change was src/shared-only, so the mobile job never ran on it -- the same way the structured tool line slipped past, as the ledger above already records. Repinned here because this PR's file set is what next made the job run, not because this PR reaches either module. Verified: of the 28 source files this branch changes, none appear anywhere in the route's 4220-module closure. * fix(search): preserve remote binaries and complete runtime packaging * test(relay): pin the probe's env now that it inherits the relay's PATH8d6759athreaded the relay env into probeRipgrepVersion -- correctly, since the probe decides whether a launch failure was the binary or the root and so has to resolve the same rg the failed spawn would have. It left the assertion that pins the probe's spawn arguments behind, which is what CI caught. Asserting buildRelayCommandEnv() rather than loosening the match to any object: under process.env the probe could resolve a different rg, or none, which is the regression the change exists to prevent. * feat(ssh): collect remote ripgrep builds by reference, not by age Nothing collected `~/.orca-remote/ripgrep/`: the version GC matches only `relay-*`, so every change to the shipped bytes left another ~5 MB on every SSH host, permanently. The age window this replaces was the wrong instrument -- a directory's mtime is when it was written, not when it was last used, so it cannot tell a superseded build from the one a live relay was launched against. Deleting the latter is not graceful degradation: without a PATH ripgrep remote text search rejects outright, and listing drops to the capped walk this PR exists to remove. So the question is reference. Each relay directory now records the build it runs against in `.ripgrep-ref`, written only once that binary is confirmed present, and the GC collects a build only when no installation names it. The discipline is ssh-relay-native-deps-cache-gc.ts': anything the pass cannot account for blocks the whole pass. A relay directory with no readable marker is an older Orca's, possibly running right now against a binary it never recorded, so the pass declines rather than guessing. Those directories are removed by the version GC in time, which is what makes their builds collectable -- hence running after it, not beside it. Deletion is the same tombstone, recheck under the rename, then remove, so a deploy that takes a reference mid-pass gets its tree restored. Windows has no pass yet, matching the native-deps cache's gate. One test note: the first version of the "unaccountable blocks the pass" test passed against a deliberately broken guard, because the tombstone recheck masked its absence. The test now puts a readable recheck behind an unreadable first scan, which is the only shape that fails when that guard is removed. Recording the reference lives inside ensureRemoteBundledRipgrep rather than at the call site: it is the same concern, and it keeps the deploy's ripgrep surface to one call for the tests that mock it to protect their exec queues. * feat(ssh): collect Windows remotes too, and ship the Rust crate notices Three items previously left documented-but-open. Windows remote accumulation. The cache GC was POSIX-gated, so the leak did not go away -- it moved to the platform with the larger binary (rg.exe is 5.43 MB on win32-x64, against 4.77 MB for linux-arm64). The PowerShell dialect now does the same reference scan: entries and references carry token prefixes, because PowerShell writes every uncaptured value to stdout and an untokenised listing would feed Remove-Item whatever a cmdlet happened to emit. Verified on a real Windows host rather than a mock: the listing emits its ENTRY/LIST_OK tokens, a relay directory carrying a marker yields REF <entry>, and a relay directory without one yields REFS_ERR -- the safety path, on the real interpreter. Rust crate notices. The crate set was read out of the shipped binary's symbols and the licence identifiers taken from crates.io rather than assumed. Where a crate offers the Unlicense, Orca elects it: a public-domain dedication carries no notice obligation, and that covers eight of them. The four that do not offer it get their MIT text reproduced. encoding_rs carries a BSD-3-Clause notice for its WHATWG-derived encoding data that is joined by AND, not OR, so electing MIT does not discharge it. Release-only validation, corrected rather than repeated. Linux AppImage/deb/rpm already runs in CI's package job on every PR, and Windows signing was already rehearsed on this branch. macOS notarization is the only item a release must still exercise, and the exposure is narrow: notarization requires signatures on Mach-O binaries, and of the six bundled builds only the two darwin ones are Mach-O -- `file` reports ELF for linux and PE32+ for win32 -- so signIgnore excludes only files the notary never asks about. orcad-artifacts.test.ts caught the new notice file missing from the standalone runtime's shipped list, which is exactly the gap that test exists to catch: a notice committed to the repo but never actually shipped. * fix(search): protect relay cache references and handle failed spawns * fix(ripgrep): close review gaps and repair deployment fixtures * test(mobile): refresh merged session module census * fix(ssh): preserve ripgrep caches with empty legacy references * test(mobile): assert bundle boundaries instead of global module count
422 lines
18 KiB
JavaScript
422 lines
18 KiB
JavaScript
import { mkdtemp, mkdir, writeFile, symlink, rm } from 'node:fs/promises'
|
|
import { createRequire } from 'node:module'
|
|
import { tmpdir } from 'node:os'
|
|
import { dirname, join } from 'node:path'
|
|
import { describe, expect, it } from 'vitest'
|
|
|
|
const require = createRequire(import.meta.url)
|
|
const {
|
|
readElfMachine,
|
|
declaredArchFromPath,
|
|
findArchViolation,
|
|
ELF_MACHINE_BY_ARCH,
|
|
parseGlibcVersion,
|
|
compareGlibcVersions,
|
|
parseVersionNeeds,
|
|
parseNeededLibraries,
|
|
parseImportedSymbols,
|
|
isVersionNodeAboveFloor,
|
|
findFloorViolations,
|
|
findMissingProviderDeps,
|
|
collectNativeBinaries,
|
|
verifyLinuxGlibcFloor
|
|
} = require('./verify-linux-glibc-floor.cjs')
|
|
|
|
// 0x7f 'E' 'L' 'F' + class/data/version padding — enough for the magic check.
|
|
const ELF_HEADER = Buffer.from([0x7f, 0x45, 0x4c, 0x46, 0x02, 0x01, 0x01, 0x00])
|
|
|
|
// Real `objdump -p` "Version References" shape (entry: 0xHASH 0xFLAGS <n> NAME;
|
|
// flags 0x02 = VER_FLG_WEAK). Includes a symbol-less ABI marker, a weak need,
|
|
// and a libstdc++ need.
|
|
const OBJDUMP_P = [
|
|
'Dynamic Section:',
|
|
' NEEDED libc.so.6',
|
|
'',
|
|
'Version References:',
|
|
' required from libc.so.6:',
|
|
' 0x09691a75 0x00 06 GLIBC_2.2.5',
|
|
' 0x069691b4 0x00 05 GLIBC_2.34',
|
|
' 0x0d696914 0x02 04 GLIBC_2.18',
|
|
' 0x00fd0e42 0x00 03 GLIBC_ABI_DT_RELR',
|
|
' required from libstdc++.so.6:',
|
|
' 0x0b481abc 0x00 07 GLIBCXX_3.4.29',
|
|
''
|
|
].join('\n')
|
|
|
|
describe('verify-linux-glibc-floor parsing', () => {
|
|
it('parses and compares numeric version tuples', () => {
|
|
expect(parseGlibcVersion('2.34')).toEqual([2, 34])
|
|
expect(parseGlibcVersion('3.4.28')).toEqual([3, 4, 28])
|
|
expect(compareGlibcVersions([2, 2, 5], [2, 14])).toBe(-1)
|
|
expect(compareGlibcVersions([2, 31], [2, 32])).toBe(-1)
|
|
expect(compareGlibcVersions([2, 34], [2, 31])).toBe(1)
|
|
expect(compareGlibcVersions([2, 31], [2, 31])).toBe(0)
|
|
expect(compareGlibcVersions([2, 31], [2, 31, 0])).toBe(0)
|
|
expect(compareGlibcVersions([3, 4, 29], [3, 4, 28])).toBe(1)
|
|
})
|
|
|
|
it('parses objdump -p Version References into per-library version needs', () => {
|
|
const needs = parseVersionNeeds(OBJDUMP_P)
|
|
expect(needs).toContainEqual({ library: 'libc.so.6', name: 'GLIBC_2.34', weak: false })
|
|
expect(needs).toContainEqual({ library: 'libc.so.6', name: 'GLIBC_ABI_DT_RELR', weak: false })
|
|
expect(needs).toContainEqual({ library: 'libc.so.6', name: 'GLIBC_2.18', weak: true })
|
|
expect(needs).toContainEqual({ library: 'libstdc++.so.6', name: 'GLIBCXX_3.4.29', weak: false })
|
|
})
|
|
|
|
it('classifies version nodes across glibc and libstdc++ families', () => {
|
|
expect(isVersionNodeAboveFloor('GLIBC_2.34')).toBe(true)
|
|
expect(isVersionNodeAboveFloor('GLIBC_2.31')).toBe(false)
|
|
expect(isVersionNodeAboveFloor('GLIBC_ABI_DT_RELR')).toBe(true) // symbol-less marker (2.36+)
|
|
// GLIBC_PRIVATE is not a stable ABI contract; a needed private symbol can be
|
|
// absent on the floor even though the version node exists — reject it.
|
|
expect(isVersionNodeAboveFloor('GLIBC_PRIVATE')).toBe(true)
|
|
expect(isVersionNodeAboveFloor('CXXABI_TM_1')).toBe(false) // named libstdc++ node on 20.04
|
|
expect(isVersionNodeAboveFloor('GLIBCXX_3.4.29')).toBe(true) // GCC 11, above 20.04's 3.4.28
|
|
expect(isVersionNodeAboveFloor('GLIBCXX_3.4.28')).toBe(false)
|
|
expect(isVersionNodeAboveFloor('CXXABI_1.3.13')).toBe(true)
|
|
expect(isVersionNodeAboveFloor('CXXABI_1.3.12')).toBe(false)
|
|
expect(isVersionNodeAboveFloor('GCC_3.0')).toBe(false) // family not gated
|
|
})
|
|
|
|
it('flags strong too-new glibc + libstdc++ needs, skipping weak and ungated families', () => {
|
|
const violations = findFloorViolations(parseVersionNeeds(OBJDUMP_P), '/opt/app/pty.node')
|
|
const names = violations.map((v) => v.name).sort()
|
|
// GLIBC_2.34, GLIBC_ABI_DT_RELR, GLIBCXX_3.4.29 fail; weak GLIBC_2.18 and
|
|
// GLIBC_2.2.5 are excluded.
|
|
expect(names).toEqual(['GLIBCXX_3.4.29', 'GLIBC_2.34', 'GLIBC_ABI_DT_RELR'].sort())
|
|
})
|
|
|
|
it('exempts sherpa-onnx from the libstdc++ floor but still gates its glibc', () => {
|
|
const needs = [
|
|
{ library: 'libstdc++.so.6', name: 'GLIBCXX_3.4.29', weak: false },
|
|
{ library: 'libc.so.6', name: 'GLIBC_2.34', weak: false }
|
|
]
|
|
// A launch-critical module: both are violations.
|
|
expect(
|
|
findFloorViolations(needs, '/opt/app/node_modules/node-pty/pty.node').map((v) => v.name)
|
|
).toEqual(['GLIBCXX_3.4.29', 'GLIBC_2.34'])
|
|
// sherpa: GLIBCXX exempt (lazy speech prebuilt), glibc still enforced.
|
|
expect(
|
|
findFloorViolations(
|
|
needs,
|
|
'/opt/app/node_modules/sherpa-onnx-linux-x64/sherpa-onnx.node'
|
|
).map((v) => v.name)
|
|
).toEqual(['GLIBC_2.34'])
|
|
})
|
|
|
|
it('reports no violations when every strong need is at or below the floor', () => {
|
|
const needs = parseVersionNeeds(
|
|
[
|
|
'Version References:',
|
|
' required from libc.so.6:',
|
|
' 0x00 0x00 02 GLIBC_2.2.5',
|
|
' 0x00 0x00 03 GLIBC_2.28',
|
|
' required from libstdc++.so.6:',
|
|
' 0x00 0x00 04 GLIBCXX_3.4.22'
|
|
].join('\n')
|
|
)
|
|
expect(findFloorViolations(needs, '/opt/app/pty.node')).toEqual([])
|
|
})
|
|
})
|
|
|
|
describe('DT_NEEDED provider check', () => {
|
|
const OBJDUMP_P_DYNAMIC = [
|
|
'Dynamic Section:',
|
|
' NEEDED libutil.so.1',
|
|
' NEEDED libpthread.so.0',
|
|
' NEEDED libc.so.6',
|
|
'',
|
|
'Version References:',
|
|
' required from libc.so.6:',
|
|
' 0x0 0x00 02 GLIBC_2.2.5'
|
|
].join('\n')
|
|
|
|
it('parses DT_NEEDED shared libraries from objdump -p', () => {
|
|
const needed = parseNeededLibraries(OBJDUMP_P_DYNAMIC)
|
|
expect([...needed].sort()).toEqual(['libc.so.6', 'libpthread.so.0', 'libutil.so.1'])
|
|
})
|
|
|
|
it('parses undefined imported symbols from objdump -T, stripping @VERSION', () => {
|
|
const output = [
|
|
'0000000000000000 DF *UND*\t0000000000000000 (GLIBC_2.2.5) openpty',
|
|
'0000000000000000 w DF *UND*\t0000000000000000 __cxa_finalize@GLIBC_2.2.5',
|
|
'0000000000000000 DF .text\t0000000000000000 defined_symbol'
|
|
].join('\n')
|
|
const imported = parseImportedSymbols(output)
|
|
expect(imported.has('openpty')).toBe(true)
|
|
expect(imported.has('__cxa_finalize')).toBe(true)
|
|
expect(imported.has('defined_symbol')).toBe(false) // not *UND*
|
|
})
|
|
|
|
it('flags a binary that imports openpty/forkpty without libutil.so.1 in DT_NEEDED', () => {
|
|
const importsPty = new Set(['openpty', 'forkpty', 'free'])
|
|
// Missing libutil.so.1 -> the pinned symbols would not resolve on the floor.
|
|
expect(
|
|
findMissingProviderDeps(importsPty, new Set(['libc.so.6'])).map((m) => m.symbol)
|
|
).toEqual(['openpty', 'forkpty'])
|
|
// With libutil.so.1 present, no violation.
|
|
expect(findMissingProviderDeps(importsPty, new Set(['libc.so.6', 'libutil.so.1']))).toEqual([])
|
|
// A binary that doesn't import the relocated symbols is never flagged.
|
|
expect(findMissingProviderDeps(new Set(['free']), new Set(['libc.so.6']))).toEqual([])
|
|
})
|
|
})
|
|
|
|
describe('collectNativeBinaries', () => {
|
|
it('collects only ELF .node/.so/executable files, skipping non-ELF and symlinks', async () => {
|
|
const root = await mkdtemp(join(tmpdir(), 'orca-glibc-collect-'))
|
|
try {
|
|
await mkdir(join(root, 'nested'), { recursive: true })
|
|
await writeFile(join(root, 'addon.node'), ELF_HEADER)
|
|
await writeFile(join(root, 'nested', 'lib.so'), ELF_HEADER)
|
|
await writeFile(join(root, 'nested', 'lib.so.1'), ELF_HEADER)
|
|
await writeFile(join(root, 'orca-ide'), ELF_HEADER) // extensionless executable
|
|
await writeFile(join(root, 'script.js'), ELF_HEADER) // has extension, not native
|
|
await writeFile(join(root, 'text.node'), 'not an elf file') // native name, non-ELF
|
|
await writeFile(join(root, 'notes.md'), ELF_HEADER)
|
|
try {
|
|
await symlink(join(root, 'addon.node'), join(root, 'alias.node'))
|
|
} catch {
|
|
// Symlink creation can be restricted; the rest of the assertions still hold.
|
|
}
|
|
|
|
const found = collectNativeBinaries(root).map((p) => p.slice(root.length + 1))
|
|
expect(found).toContain('addon.node')
|
|
expect(found).toContain(join('nested', 'lib.so'))
|
|
expect(found).toContain(join('nested', 'lib.so.1'))
|
|
expect(found).toContain('orca-ide')
|
|
expect(found).not.toContain('script.js')
|
|
expect(found).not.toContain('text.node')
|
|
expect(found).not.toContain('notes.md')
|
|
expect(found).not.toContain('alias.node')
|
|
} finally {
|
|
await rm(root, { recursive: true, force: true })
|
|
}
|
|
})
|
|
})
|
|
|
|
describe.skipIf(process.platform === 'win32')('verifyLinuxGlibcFloor', () => {
|
|
// A stub objdump keyed on the inspected file's basename. Handles `-p` (Dynamic
|
|
// Section DT_NEEDED + Version References) and `-T` (undefined symbols).
|
|
// `*fail*` exits non-zero (fail-closed branch); `*noutil*` omits libutil.so.1
|
|
// from DT_NEEDED; `*pty*` imports openpty. Match on basename only so the
|
|
// (random) temp-dir path cannot collide.
|
|
async function writeStubObjdump(dir) {
|
|
const stubPath = join(dir, 'objdump-stub.sh')
|
|
await writeFile(
|
|
stubPath,
|
|
[
|
|
'#!/bin/sh',
|
|
'if [ "$1" = "--version" ]; then echo "GNU objdump (stub)"; exit 0; fi',
|
|
'f=$(basename "$2")',
|
|
'case "$f" in',
|
|
' *fail*) echo "objdump: $f: File format not recognized" >&2; exit 1 ;;',
|
|
'esac',
|
|
'if [ "$1" = "-T" ]; then',
|
|
' case "$f" in',
|
|
' *pty*) printf "0000 DF *UND* 0000 (GLIBC_2.2.5) openpty\\n" ;;',
|
|
' esac',
|
|
' exit 0',
|
|
'fi',
|
|
'printf "Dynamic Section:\\n NEEDED libc.so.6\\n"',
|
|
'case "$f" in',
|
|
' *noutil*) : ;;',
|
|
' *) printf " NEEDED libutil.so.1\\n NEEDED libpthread.so.0\\n" ;;',
|
|
'esac',
|
|
'printf "\\nVersion References:\\n required from libc.so.6:\\n"',
|
|
'case "$f" in',
|
|
' *bad*) printf " 0x0 0x00 03 GLIBC_2.34\\n 0x0 0x00 04 GLIBC_2.2.5\\n" ;;',
|
|
' *relr*) printf " 0x0 0x00 05 GLIBC_ABI_DT_RELR\\n 0x0 0x00 04 GLIBC_2.2.5\\n" ;;',
|
|
' *weakonly*) printf " 0x0 0x02 06 GLIBC_2.32\\n 0x0 0x00 04 GLIBC_2.2.5\\n" ;;',
|
|
' *cxx*|*sherpa*)',
|
|
' printf " required from libstdc++.so.6:\\n 0x0 0x00 07 GLIBCXX_3.4.29\\n" ;;',
|
|
' *) printf " 0x0 0x00 08 GLIBC_2.28\\n 0x0 0x00 04 GLIBC_2.2.5\\n" ;;',
|
|
'esac',
|
|
'exit 0'
|
|
].join('\n'),
|
|
{ mode: 0o755 }
|
|
)
|
|
return stubPath
|
|
}
|
|
|
|
it('throws listing binaries over the floor (glibc, DT_RELR marker, and libstdc++)', async () => {
|
|
const root = await mkdtemp(join(tmpdir(), 'orca-glibc-over-'))
|
|
try {
|
|
const objdumpPath = await writeStubObjdump(root)
|
|
await mkdir(join(root, 'app', 'resources'), { recursive: true })
|
|
await writeFile(join(root, 'app', 'resources', 'bad-pty.node'), ELF_HEADER)
|
|
await writeFile(join(root, 'app', 'relr-exe.node'), ELF_HEADER)
|
|
await writeFile(join(root, 'app', 'cxx-addon.node'), ELF_HEADER) // launch-critical GLIBCXX_3.4.29
|
|
await writeFile(join(root, 'app', 'good.so'), ELF_HEADER)
|
|
|
|
let error
|
|
try {
|
|
verifyLinuxGlibcFloor(join(root, 'app'), { objdumpPath })
|
|
} catch (e) {
|
|
error = e
|
|
}
|
|
expect(error).toBeDefined()
|
|
expect(error.message).toMatch(/bad-pty\.node needs GLIBC_2\.34/)
|
|
expect(error.message).toMatch(/relr-exe\.node needs GLIBC_ABI_DT_RELR/)
|
|
expect(error.message).toMatch(/cxx-addon\.node needs GLIBCXX_3\.4\.29/)
|
|
} finally {
|
|
await rm(root, { recursive: true, force: true })
|
|
}
|
|
})
|
|
|
|
it('throws when a pinned binary imports openpty without libutil.so.1 in DT_NEEDED', async () => {
|
|
const root = await mkdtemp(join(tmpdir(), 'orca-glibc-noutil-'))
|
|
try {
|
|
const objdumpPath = await writeStubObjdump(root)
|
|
await mkdir(join(root, 'app'), { recursive: true })
|
|
// Below the version floor (so the version check passes) but libutil.so.1
|
|
// is missing from DT_NEEDED — openpty would not resolve on Ubuntu 20.04.
|
|
await writeFile(join(root, 'app', 'noutil-pty.node'), ELF_HEADER)
|
|
|
|
expect(() => verifyLinuxGlibcFloor(join(root, 'app'), { objdumpPath })).toThrow(
|
|
/noutil-pty\.node imports openpty but libutil\.so\.1 is not in DT_NEEDED/
|
|
)
|
|
} finally {
|
|
await rm(root, { recursive: true, force: true })
|
|
}
|
|
})
|
|
|
|
it('passes weak/at-floor needs and the exempt sherpa-onnx libstdc++ prebuilt', async () => {
|
|
const root = await mkdtemp(join(tmpdir(), 'orca-glibc-under-'))
|
|
try {
|
|
const objdumpPath = await writeStubObjdump(root)
|
|
const sherpaDir = join(root, 'app', 'node_modules', 'sherpa-onnx-linux-x64')
|
|
await mkdir(sherpaDir, { recursive: true })
|
|
await writeFile(join(root, 'app', 'good-pty.node'), ELF_HEADER)
|
|
await writeFile(join(root, 'app', 'weakonly-lib.so'), ELF_HEADER) // weak GLIBC_2.32 → OK
|
|
await writeFile(join(root, 'app', 'orca-ide'), ELF_HEADER)
|
|
await writeFile(join(sherpaDir, 'sherpa-onnx.node'), ELF_HEADER) // GLIBCXX_3.4.29, exempt
|
|
|
|
expect(() => verifyLinuxGlibcFloor(join(root, 'app'), { objdumpPath })).not.toThrow()
|
|
} finally {
|
|
await rm(root, { recursive: true, force: true })
|
|
}
|
|
})
|
|
|
|
it('fails closed when objdump cannot read a binary (non-zero exit)', async () => {
|
|
const root = await mkdtemp(join(tmpdir(), 'orca-glibc-closed-'))
|
|
try {
|
|
const objdumpPath = await writeStubObjdump(root)
|
|
await mkdir(join(root, 'app'), { recursive: true })
|
|
await writeFile(join(root, 'app', 'unreadable-fail.node'), ELF_HEADER)
|
|
|
|
expect(() => verifyLinuxGlibcFloor(join(root, 'app'), { objdumpPath })).toThrow(
|
|
/objdump -p failed/
|
|
)
|
|
} finally {
|
|
await rm(root, { recursive: true, force: true })
|
|
}
|
|
})
|
|
|
|
it('is a no-op (no objdump needed) when there are no native binaries', async () => {
|
|
const root = await mkdtemp(join(tmpdir(), 'orca-glibc-empty-'))
|
|
try {
|
|
await mkdir(join(root, 'app'), { recursive: true })
|
|
await writeFile(join(root, 'app', 'readme.txt'), 'no binaries here')
|
|
expect(() =>
|
|
verifyLinuxGlibcFloor(join(root, 'app'), { objdumpPath: '/nonexistent/objdump' })
|
|
).not.toThrow()
|
|
} finally {
|
|
await rm(root, { recursive: true, force: true })
|
|
}
|
|
})
|
|
})
|
|
|
|
/** Minimal little-endian 64-bit ELF header with the given e_machine. */
|
|
function elfHeader(machine) {
|
|
const header = Buffer.alloc(64)
|
|
header.write('\x7fELF', 0, 'latin1')
|
|
header[4] = 2 // ELFCLASS64
|
|
header[5] = 1 // ELFDATA2LSB
|
|
header[6] = 1 // EV_CURRENT
|
|
header.writeUInt16LE(3, 16) // ET_DYN
|
|
header.writeUInt16LE(machine, 18)
|
|
return header
|
|
}
|
|
|
|
describe('bundled native binary architecture', () => {
|
|
it('reads e_machine from a little-endian ELF', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const file = join(dir, 'pty.node')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.arm64))
|
|
expect(readElfMachine(file)).toBe(ELF_MACHINE_BY_ARCH.arm64)
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
|
|
// The observed failure: cross-building arm64 on an x64 host packed an x86-64 pty.node, whose
|
|
// symbol versions are valid, so every other gate here passed it.
|
|
// Real CI hit: @parcel/watcher ships every architecture and its loader picks the match, so the
|
|
// arm64 copy is present in an x64 build on purpose.
|
|
it('accepts a per-arch vendored package that matches its own path', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const pkg = join(dir, '@parcel', 'watcher-linux-arm64-glibc')
|
|
await mkdir(pkg, { recursive: true })
|
|
const file = join(pkg, 'watcher.node')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.arm64))
|
|
expect(declaredArchFromPath(file)).toBe('arm64')
|
|
expect(findArchViolation(file, 'x64')).toBeNull()
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
|
|
// But a path that names an arch must actually hold it — this is the Pi 5 failure.
|
|
it('flags a binary that contradicts the architecture its own path names', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const nested = join(dir, 'bin', 'linux-arm64-148')
|
|
await mkdir(nested, { recursive: true })
|
|
const file = join(nested, 'node-pty.node')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.x64))
|
|
expect(findArchViolation(file, 'arm64')).toMatchObject({ actual: 'x64', expectedArch: 'arm64' })
|
|
// Still caught even when the slice being built is x64.
|
|
expect(findArchViolation(file, 'x64')).toMatchObject({ actual: 'x64', expectedArch: 'arm64' })
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
|
|
// Release arm64 slices live in `linux-arm64-unpacked`; bundled ripgrep ships linux-x64 beside it.
|
|
it('reads arch tokens only below the slice root', async () => {
|
|
const root = join(await mkdtemp(join(tmpdir(), 'orca-elf-arch-')), 'linux-arm64-unpacked')
|
|
const dir = join(root, 'resources', 'ripgrep', 'linux-x64')
|
|
await mkdir(dir, { recursive: true })
|
|
const file = join(dir, 'rg')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.x64))
|
|
expect(findArchViolation(file, 'arm64', root)).toBeNull()
|
|
await rm(dirname(root), { recursive: true, force: true })
|
|
})
|
|
|
|
it('flags an x86-64 binary in an arm64 slice', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const file = join(dir, 'pty.node')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.x64))
|
|
expect(findArchViolation(file, 'arm64')).toMatchObject({ actual: 'x64' })
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
|
|
it('accepts a matching architecture', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const file = join(dir, 'pty.node')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.x64))
|
|
expect(findArchViolation(file, 'x64')).toBeNull()
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
|
|
it('stays silent when no target architecture is supplied', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const file = join(dir, 'pty.node')
|
|
await writeFile(file, elfHeader(ELF_MACHINE_BY_ARCH.x64))
|
|
expect(findArchViolation(file, undefined)).toBeNull()
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
|
|
it('ignores a file that is not a readable little-endian ELF', async () => {
|
|
const dir = await mkdtemp(join(tmpdir(), 'orca-elf-arch-'))
|
|
const file = join(dir, 'not-elf.node')
|
|
await writeFile(file, Buffer.from('not an elf at all'))
|
|
expect(readElfMachine(file)).toBeNull()
|
|
expect(findArchViolation(file, 'arm64')).toBeNull()
|
|
await rm(dir, { recursive: true, force: true })
|
|
})
|
|
})
|