{
  "id": 122312,
  "title": "What’s the point of providing public test set?",
  "url": "/competitions/deepfake-detection-challenge/discussion/122312",
  "author_name": "",
  "post_date": "2019-12-19T08:58:04.521159Z",
  "votes": null,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Public LB is calculated with all test videos, and test videos are also downloadable. So, everyone can manually label the public test set to reach perfect score. Probing LB is however necessary, because by doing that we can augment more training samples. </p>\n\n<p>Then, public LB cannot reflect true teams’ ranking. </p>",
  "messages": [
    {
      "id": "698447",
      "postDate": "12/19/2019 08:58:04",
      "content": "<p>Public LB is calculated with all test videos, and test videos are also downloadable. So, everyone can manually label the public test set to reach perfect score. Probing LB is however necessary, because by doing that we can augment more training samples. </p>\n\n<p>Then, public LB cannot reflect true teams’ ranking. </p>",
      "rawMarkdown": "Public LB is calculated with all test videos, and test videos are also downloadable. So, everyone can manually label the public test set to reach perfect score. Probing LB is however necessary, because by doing that we can augment more training samples. \n\nThen, public LB cannot reflect true teams’ ranking.",
      "votes": null
    },
    {
      "id": "698488",
      "postDate": "12/19/2019 10:04:52",
      "content": "<p>All videos on \"test videos\" folder are there just for fun, When you trigger the submission it re-runs your notebook with the test_videos file (and corresponding sample submission file) swapped out for the hidden public test set. </p>",
      "rawMarkdown": "All videos on \"test videos\" folder are there just for fun, When you trigger the submission it re-runs your notebook with the test_videos file (and corresponding sample submission file) swapped out for the hidden public test set.",
      "votes": null
    },
    {
      "id": "698492",
      "postDate": "12/19/2019 10:10:02",
      "content": "<p>Thanks Toadman! Do you mean, test files on LB and test files for download are different?</p>",
      "rawMarkdown": "Thanks Toadman! Do you mean, test files on LB and test files for download are different?",
      "votes": null
    },
    {
      "id": "698501",
      "postDate": "12/19/2019 10:17:30",
      "content": "<p>Yes, they are different. </p>",
      "rawMarkdown": "Yes, they are different.",
      "votes": null
    },
    {
      "id": "698773",
      "postDate": "12/19/2019 17:20:44",
      "content": "<p>This is all clarified in the <a href=\"https://www.kaggle.com/c/deepfake-detection-challenge/overview/getting-started\">Getting Started</a> page.</p>",
      "rawMarkdown": "This is all clarified in the [Getting Started](https://www.kaggle.com/c/deepfake-detection-challenge/overview/getting-started) page.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 698488,
      "author_name": "behrouzp",
      "author_url": "",
      "post_date": "12/19/2019 10:04:52",
      "content": "<p>All videos on \"test videos\" folder are there just for fun, When you trigger the submission it re-runs your notebook with the test_videos file (and corresponding sample submission file) swapped out for the hidden public test set. </p>",
      "votes": null,
      "replies": [
        {
          "id": 698492,
          "author_name": "khahuras",
          "author_url": "",
          "post_date": "12/19/2019 10:10:02",
          "content": "<p>Thanks Toadman! Do you mean, test files on LB and test files for download are different?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 698501,
          "author_name": "behrouzp",
          "author_url": "",
          "post_date": "12/19/2019 10:17:30",
          "content": "<p>Yes, they are different. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 698773,
      "author_name": "juliaelliott",
      "author_url": "",
      "post_date": "12/19/2019 17:20:44",
      "content": "<p>This is all clarified in the <a href=\"https://www.kaggle.com/c/deepfake-detection-challenge/overview/getting-started\">Getting Started</a> page.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "698447": "Public LB is calculated with all test videos, and test videos are also downloadable. So, everyone can manually label the public test set to reach perfect score. Probing LB is however necessary, because by doing that we can augment more training samples. \n\nThen, public LB cannot reflect true teams’ ranking.",
    "698488": "All videos on \"test videos\" folder are there just for fun, When you trigger the submission it re-runs your notebook with the test_videos file (and corresponding sample submission file) swapped out for the hidden public test set.",
    "698492": "Thanks Toadman! Do you mean, test files on LB and test files for download are different?",
    "698501": "Yes, they are different.",
    "698773": "This is all clarified in the [Getting Started](https://www.kaggle.com/c/deepfake-detection-challenge/overview/getting-started) page."
  },
  "source": "meta"
}