Submission Format

If you would like to add your model to the ShoppingComp leaderboard, please send your model response to zhangyuan.zhang@bytedance.com.

Email subject

[ShoppingComp Leaderboard] Submission - <Model Name> - <Organization>

Required files

predictions.jsonl: model responses for the evaluated ShoppingComp split.
metadata.json: basic run information (model, org, date, settings).

metadata.json example

{
  "model_name": "YourModelName",
  "organization": "YourOrg",
  "submission_date": "YYYY-MM-DD",
  "eval_version": "v1",
  "dataset_version": "v2",
  "notes": "optional notes"
}

predictions.jsonl format (one JSON per line)

{"uuid":"task-uuid-1","response":"your full model response text"}
{"uuid":"task-uuid-2","response":"your full model response text"}