mirror of
https://github.com/lancedb/lancedb.git
synced 2026-08-18 12:08:35 +00:00
Dan Tasse
a8f1c5a69f
Agents seemed to have trouble finding the right calls to work with branches (create, list, delete) and passing the right params to get it to work. We probably don't need a big skill to get it on the right track but a little nudge seems helpful. Doing a couple simple tasks, it saved about half the time and tokens, so feels worthwhile. Created with the Claude skills creator, hence the "skill.md in a bare folder" organization - happy to move it if that's not the standard anymore. ``` Benchmark results (3 evals, with-skill vs baseline): ┌────────────────┬────────────┬────────────────────┐ │ Metric │ With skill │ Without skill │ ├────────────────┼────────────┼────────────────────┤ │ Pass rate │ 3/3 (100%) │ 3/3 (100%) │ ├────────────────┼────────────┼────────────────────┤ │ Avg time │ 51s │ 142s (2.8× slower) │ ├────────────────┼────────────┼────────────────────┤ │ Avg tokens │ 19,305 │ 36,513 (47% more) │ ├────────────────┼────────────┼────────────────────┤ │ Avg tool calls │ 5.7 │ 26 (4.5× more) │ └────────────────┴────────────┴────────────────────┘ ```