{
  "id": 139269,
  "title": "Code Requirements",
  "url": "/competitions/jigsaw-multilingual-toxic-comment-classification/discussion/139269",
  "author_name": "",
  "post_date": "2020-03-28T04:29:32.959898700Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<h3>What does this mean?</h3>\n\n<blockquote>\n  <p>Your code will not be re-run, as there is no completely hidden test set.</p>\n</blockquote>",
  "messages": [
    {
      "id": "788844",
      "postDate": "03/28/2020 04:29:32",
      "content": "<h3>What does this mean?</h3>\n\n<blockquote>\n  <p>Your code will not be re-run, as there is no completely hidden test set.</p>\n</blockquote>",
      "rawMarkdown": "### What does this mean?\n&gt; Your code will not be re-run, as there is no completely hidden test set.",
      "votes": null
    },
    {
      "id": "788849",
      "postDate": "03/28/2020 04:36:05",
      "content": "<p>Your submission notebook is expected to run on the test set, which is accessible, and generate predictions. You submit your predictions file. Commit your  notebook, then go to the output section, if you generated a submission file with predictions, it will have a \"submit to leaderboard\" button next to it.</p>",
      "rawMarkdown": "Your submission notebook is expected to run on the test set, which is accessible, and generate predictions. You submit your predictions file. Commit your  notebook, then go to the output section, if you generated a submission file with predictions, it will have a \"submit to leaderboard\" button next to it.",
      "votes": null
    },
    {
      "id": "788907",
      "postDate": "03/28/2020 06:18:37",
      "content": "<p>I was asking for clarification for the latter part of the sentence. Does this mean there will be no private test set on which our code will re-run and so our score on the public leaderboard will be our final score?</p>",
      "rawMarkdown": "I was asking for clarification for the latter part of the sentence. Does this mean there will be no private test set on which our code will re-run and so our score on the public leaderboard will be our final score?",
      "votes": null
    },
    {
      "id": "791822",
      "postDate": "03/30/2020 17:36:02",
      "content": "<p>Your code will not be re-run but the leaderboard score is calculated in two steps. Part of the answers are used to calculate the public leaderboard score. Another part of the answers are used to calculate a private score which is not visible on the leaderboard but which will be used for the final evaluation.</p>",
      "rawMarkdown": "Your code will not be re-run but the leaderboard score is calculated in two steps. Part of the answers are used to calculate the public leaderboard score. Another part of the answers are used to calculate a private score which is not visible on the leaderboard but which will be used for the final evaluation.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 788849,
      "author_name": "mgorner",
      "author_url": "",
      "post_date": "03/28/2020 04:36:05",
      "content": "<p>Your submission notebook is expected to run on the test set, which is accessible, and generate predictions. You submit your predictions file. Commit your  notebook, then go to the output section, if you generated a submission file with predictions, it will have a \"submit to leaderboard\" button next to it.</p>",
      "votes": null,
      "replies": [
        {
          "id": 788907,
          "author_name": "jahidahsan",
          "author_url": "",
          "post_date": "03/28/2020 06:18:37",
          "content": "<p>I was asking for clarification for the latter part of the sentence. Does this mean there will be no private test set on which our code will re-run and so our score on the public leaderboard will be our final score?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 791822,
          "author_name": "mgorner",
          "author_url": "",
          "post_date": "03/30/2020 17:36:02",
          "content": "<p>Your code will not be re-run but the leaderboard score is calculated in two steps. Part of the answers are used to calculate the public leaderboard score. Another part of the answers are used to calculate a private score which is not visible on the leaderboard but which will be used for the final evaluation.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "788844": "### What does this mean?\n&gt; Your code will not be re-run, as there is no completely hidden test set.",
    "788849": "Your submission notebook is expected to run on the test set, which is accessible, and generate predictions. You submit your predictions file. Commit your  notebook, then go to the output section, if you generated a submission file with predictions, it will have a \"submit to leaderboard\" button next to it.",
    "788907": "I was asking for clarification for the latter part of the sentence. Does this mean there will be no private test set on which our code will re-run and so our score on the public leaderboard will be our final score?",
    "791822": "Your code will not be re-run but the leaderboard score is calculated in two steps. Part of the answers are used to calculate the public leaderboard score. Another part of the answers are used to calculate a private score which is not visible on the leaderboard but which will be used for the final evaluation."
  },
  "source": "meta"
}