Files
openidea/evals/projects.json
T
l0ng-ai b2d506a929 test(evals): measure Java code intelligence as the user sees it (#2758)
pnpm eval drives the production workbench in Chromium against a release openidea-server and real jdtls, judging each scenario (navigation, usages, implementations, gutter markers, lenses, diagnostics, completion, docs, rename) on time to feedback, first and complete result, and checking results against evals/java/golden/. Supporting changes: data-* hooks in the usages popup, hints and rows; a shared in-page Tauri shim for smoke tests and evals; a shared perf bundle builder; language-server versions in .github/tool-versions.env shared with Language smoke; the eval agent skill.
2026-11-12 12:17:07 +08:00

17 lines
724 B
JSON

{
"$comment": "Open-source projects the evals run on besides fixtures/: cloned at `commit` into target/eval/sources/, `remove`d paths dropped from the copy, `prepare` run once per checkout (dependencies downloaded before anything is timed; Maven needs to reach Central, a proxy goes in ~/.m2/settings.xml).",
"spring-petclinic": {
"repo": "https://github.com/spring-projects/spring-petclinic.git",
"commit": "500158f732419217507c7656904b8e6aa1bcc0d6",
"remove": ["build.gradle", "settings.gradle", "gradle", "gradlew", "gradlew.bat"],
"prepare": [
"mvn",
"-q",
"-B",
"dependency:go-offline",
"dependency:sources",
"-DfailOnMissingClassifierArtifact=false"
]
}
}