Repository navigation
fix(uipath-agents): count Studio Web's resources add where tasks required resources refresh - #5004
astridstaicu wants to merge 2 commits into
Conversation
…ired resources refresh Eight low-code agent tasks gate on `uip solution resources refresh`. The studioweb skill (#4868) now tells Studio Web agents not to run it, because it always fails there (no .uipx on disk), and to declare each resource with `uip solution resources add` instead. On the 2026-11-19 Studio Web daily all eight failed only this criterion, after the agents declared the resource with `resources add` (CLI or the ManageSolutionResources host tool). The day before, the agent ran refresh, it errored, and the criterion passed. Each criterion now accepts refresh, or an add of the task's own resource kind (Process, Index, Connection, MemorySpace), through the CLI or the host tool, with the same guards as the #4867 lookup patterns. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Claude finished @astridstaicu's task in 1m 11s —— View job SummaryThe PR changes the "declare resource" criterion in 8 low-code Change-by-Change Review1. The 8 task YAMLs (
|
| Area | Status | Notes |
|---|---|---|
| Frontmatter | OK | No skill files changed |
| E2E Tests | OK | Criteria now match the studioweb skill rule from #4868 |
| Skill Body | OK | n/a |
| References & Assets | OK | n/a |
| Repo Hygiene | OK | Scoped to uipath-agents tasks. The cloudKey GUID in the test is a recorded test-tenant id, not a secret |
Issues for Manual Review
- I couldn't run pytest or ad-hoc Python here because the commands needed approval. The pass counts above come from the PR description, and the regex behaviour comes from reading the patterns.
- Please confirm that Studio Web's
ManageSolutionResourcesaddtakeskind: "Process"for a published agent (EmailDrafter), the same way the CLI does. No call was recorded forexternal_agent_tool.
Conclusion
Approve, with optional fixes. The change is correct, consistent with #4867, and fixes a real grading penalty. The suggestions above are Low-severity test-coverage improvements.
|
Claude finished @astridstaicu's task in 54s —— View job Coder-eval task lint (advisory)8 task YAMLs changed. Verdicts: 0 Critical, 0 High, 0 Medium, 8 Low, 0 OK. One PR-level High: the PR body has no passing-run claim. Rubric: .claude/commands/lint-task.md. This check is advisory and never blocks merge. Evidence of passing run
Per-task lintThe scope is the changed criterion. The rest of each task is unchanged from main. I couldn't run
|
… guard tests cover refresh and add Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
What
Eight low-code agent tasks gate on
uip solution resources refresh. They now also acceptuip solution resources addfor the task's own resource kind, through the CLI or Studio Web's ManageSolutionResources host tool.addrefreshstill counts, so terminal harnesses grade as before.Why
#4868 added this rule to the studioweb
uipath-agentsskill: "Never runuip solution resources refreshin Studio Web; declare each tenant resource withuip solution resources add". Refresh always fails there, because Studio Web keeps no.uipxon disk. The tasks still required refresh, so they penalized agents that followed the skill.Evidence from the Studio Web daily eval:
2026-11-18_09-22-24): on external_rpa_tool the agent ranuip solution resources refresh. The command errored, and the criterion passed anyway.2026-11-19_09-23-02): all eight tasks failed only this criterion ("Matched 0/1 required commands"). Each agent had declared the resource withresources add, for example ManageSolutionResources{"action": "add", "kind": "Connection", ...}on is_connector_tool and{"action": "add", "kind": "MemorySpace", ...}on memory_space.The patterns follow the #4867 lookup patterns. The
\A(?!\{")guard keeps the CLI alternative off other tools' JSON, and the host-tool alternative needsaction: addand the rightkindinparams.Testing
tests/scripts/test_task_command_patterns.py:test_declaring_the_resource_counts_refresh_or_add, built from the calls recorded on 11-19.test_declaring_the_resource_needs_add_of_the_same_kind.addcall. The old criteria were also filtered to Bash, so the host tool could never count.tests/scripts(1271 passed), the uipath-agents checker tests, andcheck-task-driver.py,check-task-host-paths.pyandcheck-task-doc-citations.pypass. One unrelated local failure,test_stage_shared.py, fails the same way on main.🤖 Generated with Claude Code