User Instruction
View on GitHubPlease help me purchase a washer from the Mosi Shop (address: http://localhost:1234/, open it in your browser). The product must have a rating of 4.6 stars or higher and be portable. Please choose the correct product and add to cart, and finally make payment.
Task Description
EN: Buy a washing machine from Mosi Shop with a rating of at least 4.6 and portable
中文: 我希望从 Mosi Shop 上买个洗衣机,评分达到 4.6 且是 portable。
Complexity Factors
A1
✗
Cross-Service Dependency
A2
✗
Contaminated Initial State
B1
✗
Implicit Goal Resolution
B2
✗
Knowledge System Maintenance
C1
✗
Environmental State Invalidation
C2
✗
Outcome Verification under Altered State
Evaluation
Verifier Type:
verify.py Partial Credit: Yes
Reward Range:
0 – 1 Results for This Task
| Model | Avg Score | Attempts | All Passed |
|---|---|---|---|
| gpt-5.5 | 1 | 3 | ✓ |
| qwen3.5-flash | 1 | 3 | ✓ |
| qwen3.6-flash | 1 | 3 | ✓ |
| qwen3.6-plus | 1 | 3 | ✓ |
| deepseek-v4-flash | 0.833 | 3 | ✗ |
| qwen3.5-397b-a17b | 0.833 | 3 | ✗ |
| qwen3.6-27b | 0.667 | 3 | ✗ |
| deepseek-v4-pro | 0.333 | 3 | ✗ |
| qwen3.5-27b | 0.333 | 3 | ✗ |
Public Trajectories
Run trajectories for this task live on HuggingFace.
View trajectories on HuggingFaceSource Files
task.toml: tasks/washer-shop/task.toml
instruction: tasks/washer-shop/instruction.md
environment: tasks/washer-shop/environment/Dockerfile