{
  "id": 579181,
  "title": "Does the Scoring for submission executed on another hidden set as well as the public test set?",
  "url": "/competitions/stanford-rna-3d-folding/discussion/579181",
  "author_name": "",
  "post_date": "2025-05-15T17:48:00.810922900Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>The execution of the notebook takes much longer than the Scoring itself. When the notebook executes, it create submission.csv on the public test set. But during Scoring, is the tm score getting calculated only on this test set or in the background the notebook is executed on another hidden test set, and that's the reason why scoring takes so long?<br>\n<a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> </p>",
  "messages": [
    {
      "id": "3202654",
      "postDate": "05/15/2025 17:48:00",
      "content": "<p>The execution of the notebook takes much longer than the Scoring itself. When the notebook executes, it create submission.csv on the public test set. But during Scoring, is the tm score getting calculated only on this test set or in the background the notebook is executed on another hidden test set, and that's the reason why scoring takes so long?<br>\n<a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> </p>",
      "rawMarkdown": "The execution of the notebook takes much longer than the Scoring itself. When the notebook executes, it create submission.csv on the public test set. But during Scoring, is the tm score getting calculated only on this test set or in the background the notebook is executed on another hidden test set, and that's the reason why scoring takes so long?\n@rhijudas",
      "votes": null
    },
    {
      "id": "3202749",
      "postDate": "05/15/2025 20:48:20",
      "content": "<p>Yes, there are hidden datasets. You can find the declaration on the submission page.</p>",
      "rawMarkdown": "Yes, there are hidden datasets. You can find the declaration on the submission page.",
      "votes": null
    },
    {
      "id": "3205354",
      "postDate": "05/19/2025 18:04:41",
      "content": "<p>At this phase, the hidden test set is run when we submit or will it be re-run when the submission deadline ends?</p>",
      "rawMarkdown": "At this phase, the hidden test set is run when we submit or will it be re-run when the submission deadline ends?",
      "votes": null
    },
    {
      "id": "3209495",
      "postDate": "05/25/2025 23:33:00",
      "content": "<p>I'm having trouble with the submission process—could someone walk me through it? I've already generated my output.</p>",
      "rawMarkdown": "I'm having trouble with the submission process—could someone walk me through it? I've already generated my output.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3202749,
      "author_name": "nigmatrahim4",
      "author_url": "",
      "post_date": "05/15/2025 20:48:20",
      "content": "<p>Yes, there are hidden datasets. You can find the declaration on the submission page.</p>",
      "votes": null,
      "replies": [
        {
          "id": 3205354,
          "author_name": "nguyenhoa",
          "author_url": "",
          "post_date": "05/19/2025 18:04:41",
          "content": "<p>At this phase, the hidden test set is run when we submit or will it be re-run when the submission deadline ends?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3209495,
      "author_name": "obiagelinwachukwu",
      "author_url": "",
      "post_date": "05/25/2025 23:33:00",
      "content": "<p>I'm having trouble with the submission process—could someone walk me through it? I've already generated my output.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3202654": "The execution of the notebook takes much longer than the Scoring itself. When the notebook executes, it create submission.csv on the public test set. But during Scoring, is the tm score getting calculated only on this test set or in the background the notebook is executed on another hidden test set, and that's the reason why scoring takes so long?\n@rhijudas",
    "3202749": "Yes, there are hidden datasets. You can find the declaration on the submission page.",
    "3205354": "At this phase, the hidden test set is run when we submit or will it be re-run when the submission deadline ends?",
    "3209495": "I'm having trouble with the submission process—could someone walk me through it? I've already generated my output."
  },
  "source": "meta"
}