User Instruction
View on GitHubI recently purchased a Kenmore top load washer at Mosi Shop (address: http://localhost:1234/), but now I realize it's not portable enough. Please help me refund it at my orders of Mosi Shop (address: http://localhost:1234/, open it in your browser) and then buy a portable washer with a rating of 4.6 or higher. Please refund the old order first, and then choose the correct washer and add to cart, and finally make payment.
Task Description
EN: The purchased item is not portable enough; exchange it for a washing machine rated at least 4.6 and portable, completing the return and re-ordering
中文: 已购商品不够便携，换个评分达到 4.6 且是 portable 的洗衣机，完成退货并重新下单。
Complexity Factors
A1
✗
Cross-Service Dependency
A2
✗
Contaminated Initial State
B1
✗
Implicit Goal Resolution
B2
✗
Knowledge System Maintenance
C1
✗
Environmental State Invalidation
C2
✗
Outcome Verification under Altered State
Evaluation
Verifier Type:
verify.py Partial Credit: Yes
Reward Range:
0 – 1 Results for This Task
| Model | Avg Score | Attempts | All Passed |
|---|---|---|---|
| deepseek-v4-pro | 1 | 3 | ✓ |
| gpt-5.5 | 1 | 3 | ✓ |
| qwen3.5-flash | 1 | 3 | ✓ |
| qwen3.6-27b | 1 | 3 | ✓ |
| qwen3.6-flash | 1 | 3 | ✓ |
| qwen3.6-plus | 1 | 3 | ✓ |
| qwen3.5-397b-a17b | 0.833 | 3 | ✗ |
| deepseek-v4-flash | 0.667 | 3 | ✗ |
| qwen3.5-27b | 0.5 | 3 | ✗ |
Public Trajectories
Run trajectories for this task live on HuggingFace.
View trajectories on HuggingFaceSource Files
task.toml: tasks/washer-change/task.toml
instruction: tasks/washer-change/instruction.md
environment: tasks/washer-change/environment/Dockerfile