wf_httpbin_form_postv1httpbin.orgeasy
Submit the HTTPBin form and return the echoed submission payload
timeout 300s • started Aug 19, 3:13 PM
Cohort status
completed
Attempts
1
Pass rate
--
Live attempts
0
Cohort verdicts
TinyFishn/a
Task prompt
Collapsed preview. Expand for the full prompt.
Expand
Benchmark case: Submit the HTTPBin form and return the echoed submission payload Goal: Open the form at https://httpbin.org/forms/post, fill it with the provided input data, submit it, and return the echoed submitted_form object. Preferred start URL: https://httpbin.org/forms/post Input guidance: Use these exact values when filling the form. Structured input data: { "comments": "Leave at reception", "custemail": "ada@example.com", "custname": "Ada Lovelace", "custtel": "+1-415-555-0136", "delivery": "19:45", "size": "medium", "topping": "bacon" } Return a final JSON object matching this schema: { "type": "object", "required": [ "submitted_form" ], "properties": { "submission_url": { "type": "string", "format": "uri", "optional": true }, "submitted_form": { "type": "object", "required": [ "custname", "custtel", "custemail", "size", "topping", "delivery", "comments" ], "properties": { "comments": { "type": "string" }, "custemail": { "type": "string" }, "custname": { "type": "string" }, "custtel": { "type": "string" }, "delivery": { "type": "string" }, "size": { "type": "string" }, "topping": { "type": "string" } } } } } Work the website directly. Prefer exact values over paraphrases. Return only the final structured answer when done.
Benchmark case: Submit the HTTPBin form and return the echoed submission payload

Goal: Open the form at https://httpbin.org/forms/post, fill it with the provided input data, submit it, and return the echoed submitted_form object.

Preferred start URL: https://httpbin.org/forms/post

Input guidance: Use these exact values when filling the form.

Structured input data:
{
  "comments": "Leave at reception",
  "custemail": "ada@example.com",
  "custname": "Ada Lovelace",
  "custtel": "+1-415-555-0136",
  "delivery": "19:45",
  "size": "medium",
  "topping": "bacon"
}

Return a final JSON object matching this schema:
{
  "type": "object",
  "required": [
    "submitted_form"
  ],
  "properties": {
    "submission_url": {
      "type": "string",
      "format": "uri",
      "optional": true
    },
    "submitted_form": {
      "type": "object",
      "required": [
        "custname",
        "custtel",
        "custemail",
        "size",
        "topping",
        "delivery",
        "comments"
      ],
      "properties": {
        "comments": {
          "type": "string"
        },
        "custemail": {
          "type": "string"
        },
        "custname": {
          "type": "string"
        },
        "custtel": {
          "type": "string"
        },
        "delivery": {
          "type": "string"
        },
        "size": {
          "type": "string"
        },
        "topping": {
          "type": "string"
        }
      }
    }
  }
}

Work the website directly. Prefer exact values over paraphrases. Return only the final structured answer when done.
Benchmark contract
Frozen case metadata for this cohort
This is the versioned case payload the arena executed and later submitted to tinyeval.
Case ID
wf_httpbin_form_post
Version
1
Domain
httpbin.org
Difficulty
easy
Timeout
300s
Entrypoint
https://httpbin.org/forms/post
Structured input data
{
  "comments": "Leave at reception",
  "custemail": "ada@example.com",
  "custname": "Ada Lovelace",
  "custtel": "+1-415-555-0136",
  "delivery": "19:45",
  "size": "medium",
  "topping": "bacon"
}
Output schema
{
  "type": "object",
  "required": [
    "submitted_form"
  ],
  "properties": {
    "submission_url": {
      "type": "string",
      "format": "uri",
      "optional": true
    },
    "submitted_form": {
      "type": "object",
      "required": [
        "custname",
        "custtel",
        "custemail",
        "size",
        "topping",
        "delivery",
        "comments"
      ],
      "properties": {
        "comments": {
          "type": "string"
        },
        "custemail": {
          "type": "string"
        },
        "custname": {
          "type": "string"
        },
        "custtel": {
          "type": "string"
        },
        "delivery": {
          "type": "string"
        },
        "size": {
          "type": "string"
        },
        "topping": {
          "type": "string"
        }
      }
    }
  }
}
TinyFish
Eval status: n_a
completed
Success
--
Latency
188.92s
Cost
$0.00
Tokens
68,065
Steps
10
Current URL
https://httpbingo.org/forms/post
Submitted output
Exact structured payload submitted to tinyeval for scoring.
Expand
{
  "submission_url": "https://httpbingo.org/post",
  "submitted_form": {
    "comments": "Leave at reception",
    "custemail": "ada@example.com",
    "custname": "Ada Lovelace",
    "custtel": "+1-415-555-0136",
    "delivery": "19:45",
    "size": "medium",
    "topping": "bacon"
  }
}
Output
{"submission_url":"https://httpbingo.org/post","submitted_form":{"comments":"Leave at reception","custemail":"ada@example.com","custname":"Ada Lovelace","custtel":"+1-415-555-0136","delivery":"19:45","size":"medium","topping":"bacon"}}
Live viewer
Viewer URL retained for this attempt. Availability depends on the underlying provider session.
Open viewer
Agent steps
19 logged steps. Expand for the full timeline.
Expand
1. set_value
Aug 19, 3:14 PM
Fill text input fields
https://httpbin.org/forms/post
1. set_value
Aug 19, 3:14 PM
page_map: 690 chars
https://httpbin.org/forms/post
2. click
Aug 19, 3:15 PM
Select Medium radio and Bacon checkbox
https://httpbin.org/forms/post
2. click
Aug 19, 3:15 PM
page_map: 495 chars
https://httpbin.org/forms/post
3. click
Aug 19, 3:15 PM
Select Bacon checkbox and Submit
https://httpbin.org/forms/post
3. click
Aug 19, 3:15 PM
page_map: 505 chars
https://httpbin.org/forms/post
4. click
Aug 19, 3:15 PM
Submit the form
https://httpbin.org/forms/post
4. click
Aug 19, 3:15 PM
page_map: 284 chars
https://httpbin.org/forms/post
5. navigate_to
Aug 19, 3:15 PM
Navigate to httpbingo mirror after 503 error
https://httpbin.org/forms/post
5. navigate_to
Aug 19, 3:15 PM
page_map: 315 chars
https://httpbingo.org/forms/post
6. set_value
Aug 19, 3:16 PM
Fill all text fields on httpbingo mirror
https://httpbingo.org/forms/post
6. set_value
Aug 19, 3:16 PM
page_map: 698 chars
https://httpbingo.org/forms/post
7. click
Aug 19, 3:16 PM
Select Medium radio button
https://httpbingo.org/forms/post
7. click
Aug 19, 3:16 PM
page_map: 503 chars
https://httpbingo.org/forms/post
8. click
Aug 19, 3:16 PM
Select Bacon checkbox
https://httpbingo.org/forms/post
8. click
Aug 19, 3:16 PM
page_map: 513 chars
https://httpbingo.org/forms/post
9. click
Aug 19, 3:16 PM
Submit the order form
https://httpbingo.org/forms/post
9. click
Aug 19, 3:16 PM
page_map: 2379 chars
https://httpbingo.org/forms/post
10. end
Aug 19, 3:17 PM
{"error":"none","notes":"Successfully submitted form on httpbingo mirror after httpbin 503 error. Extracted the echoed form values, unwrapping the arrays as required by the site...
https://httpbingo.org/forms/post
Evaluation
N A
Evaluation unavailable at this time.
n_a
Failure reason
--
Failed checkpoint
--
Checkpoint summary
0 passed • 0 failed
Evaluated
Aug 19, 3:17 PM
Raw evaluation payload
{
  "submit": {
    "eval_id": "run_d00d0d8e3c4f4432",
    "run_id": "run_d00d0d8e3c4f4432",
    "status": "n_a",
    "note": "Evaluation unavailable at this time."
  },
  "detail": {
    "eval": {
      "run_id": "run_d00d0d8e3c4f4432",
      "case_id": "wf_httpbin_form_post",
      "case_version": 1,
      "status": "n_a",
      "agent_name": "TinyFish",
      "last_evaluation": {
        "event_id": "evt_14bab20bd4f151f8",
        "status": "n_a",
        "note": "Evaluation unavailable at this time.",
        "evaluated_at": "2026-08-19T15:17:15.782231159Z"
      },
      "created_at": "2026-08-19T15:17:05.76981333Z",
      "updated_at": "2026-08-19T15:17:15.782232212Z",
      "completed_at": "2026-08-19T15:17:15.782232212Z"
    },
    "run": {
      "run_id": "run_d00d0d8e3c4f4432",
      "case_id": "wf_httpbin_form_post",
      "case_version": 1,
      "status": "n_a",
      "agent_name": "TinyFish",
      "last_evaluation": {
        "event_id": "evt_14bab20bd4f151f8",
        "status": "n_a",
        "note": "Evaluation unavailable at this time.",
        "evaluated_at": "2026-08-19T15:17:15.782231159Z"
      },
      "created_at": "2026-08-19T15:17:05.76981333Z",
      "updated_at": "2026-08-19T15:17:15.782232212Z",
      "completed_at": "2026-08-19T15:17:15.782232212Z"
    },
    "case": {
      "case_id": "wf_httpbin_form_post",
      "version": 1,
      "status": "active",
      "created_at": "2026-04-09T00:00:00Z",
      "updated_at": "2026-04-09T00:00:00Z",
      "title": "Submit the HTTPBin form and return the echoed submission payload",
      "task_description": "Open the form at https://httpbin.org/forms/post, fill it with the provided input data, submit it, and return the echoed submitted_form object.",
      "domains": [
        "httpbin.org"
      ],
      "tags": [
        "forms",
        "httpbin",
        "submission",
        "echo"
      ],
      "difficulty": "easy",
      "locale": "en-US",
      "input_spec": {
        "description": "Use these exact values when filling the form.",
        "schema": {
          "type": "object",
          "required": [
            "custname",
            "custtel",
            "custemail",
            "size",
            "topping",
            "delivery",
            "comments"
          ],
          "properties": {
            "comments": {
              "type": "string"
            },
            "custemail": {
              "type": "string"
            },
            "custname": {
              "type": "string"
            },
            "custtel": {
              "type": "string"
            },
            "delivery": {
              "type": "string"
            },
            "size": {
              "type": "string"
            },
            "topping": {
              "type": "string"
            }
          }
        },
        "data": {
          "comments": "Leave at reception",
          "custemail": "ada@example.com",
          "custname": "Ada Lovelace",
          "custtel": "+1-415-555-0136",
          "delivery": "19:45",
          "size": "medium",
          "topping": "bacon"
        }
      },
      "output_schema": {
        "type": "object",
        "required": [
          "submitted_form"
        ],
        "properties": {
          "submission_url": {
            "type": "string",
            "format": "uri",
            "optional": true
          },
          "submitted_form": {
            "type": "object",
            "required": [
              "custname",
              "custtel",
              "custemail",
              "size",
              "topping",
              "delivery",
              "comments"
            ],
            "properties": {
              "comments": {
                "type": "string"
              },
              "custemail": {
                "type": "string"
              },
              "custname": {
                "type": "string"
              },
              "custtel": {
                "type": "string"
              },
              "delivery": {
                "type": "string"
              },
              "size": {
                "type": "string"
              },
              "topping": {
                "type": "string"
              }
            }
          }
        }
      },
      "entrypoint": {
        "mode": "url",
        "url": "https://httpbin.org/forms/post"
      },
      "run_policy": {
        "timeout_seconds": 300
      }
    },
    "events": [
      {
        "event_id": "evt_14bab20bd4f151f8",
        "run_id": "run_d00d0d8e3c4f4432",
        "event_type": "final",
        "payload": {
          "event_type": "final",
          "timestamp": "2026-08-19T15:17:05.77444346Z",
          "page_state": {},
          "intermediate_data": {
            "raw_submission": {
              "submission_url": "https://httpbingo.org/post",
              "submitted_form": {
                "comments": "Leave at reception",
                "custemail": "ada@example.com",
                "custname": "Ada Lovelace",
                "custtel": "+1-415-555-0136",
                "delivery": "19:45",
                "size": "medium",
                "topping": "bacon"
              }
            }
          },
          "final_output": {
            "submission_url": "https://httpbingo.org/post",
            "submitted_form": {
              "comments": "Leave at reception",
              "custemail": "ada@example.com",
              "custname": "Ada Lovelace",
              "custtel": "+1-415-555-0136",
              "delivery": "19:45",
              "size": "medium",
              "topping": "bacon"
            }
          },
          "artifacts": {},
          "agent": {}
        },
        "created_at": "2026-08-19T15:17:05.774706139Z"
      }
    ],
    "timeout_seconds": 300,
    "deadline_at": "2026-08-19T15:22:05.76981333Z"
  }
}
Provider terminal payload
Raw terminal result retained from the provider adapter.
Expand
{
  "answer": "{\"submission_url\":\"https://httpbingo.org/post\",\"submitted_form\":{\"comments\":\"Leave at reception\",\"custemail\":\"ada@example.com\",\"custname\":\"Ada Lovelace\",\"custtel\":\"+1-415-555-0136\",\"delivery\":\"19:45\",\"size\":\"medium\",\"topping\":\"bacon\"}}",
  "cachedInputTokens": 34783,
  "data": {
    "error": "none",
    "notes": "Successfully submitted form on httpbingo mirror after httpbin 503 error. Extracted the echoed form values, unwrapping the arrays as required by the site manual and output schema.",
    "result": "{\"submission_url\":\"https://httpbingo.org/post\",\"submitted_form\":{\"comments\":\"Leave at reception\",\"custemail\":\"ada@example.com\",\"custname\":\"Ada Lovelace\",\"custtel\":\"+1-415-555-0136\",\"delivery\":\"19:45\",\"size\":\"medium\",\"topping\":\"bacon\"}}",
    "success": true
  },
  "durationMs": 188922,
  "error": "none",
  "inputTokens": 66698,
  "llmDurationMs": 40262,
  "llmErrorDurationMs": 117647,
  "model": "gemini-3-flash-preview",
  "notes": "Successfully submitted form on httpbingo mirror after httpbin 503 error. Extracted the echoed form values, unwrapping the arrays as required by the site manual and output schema.",
  "outputTokens": 1367,
  "recordingId": "",
  "result": "{\"submission_url\":\"https://httpbingo.org/post\",\"submitted_form\":{\"comments\":\"Leave at reception\",\"custemail\":\"ada@example.com\",\"custname\":\"Ada Lovelace\",\"custtel\":\"+1-415-555-0136\",\"delivery\":\"19:45\",\"size\":\"medium\",\"topping\":\"bacon\"}}",
  "success": true,
  "thinkingTokens": 0,
  "totalSteps": 10,
  "totalTokens": 68065,
  "type": "done"
}