{
  "id": 11072,
  "title": "Only 3 submissions per day?",
  "url": "/competitions/inria-bci-challenge/discussion/11072",
  "author_name": "",
  "post_date": "2014-11-27T18:29:18.640Z",
  "votes": 2,
  "comment_count": 5,
  "views": 1485,
  "content": "<p>Hi, just wondering if the submission limit per day can be increased?</p>\n\n<p>Cheers</p>",
  "messages": [
    {
      "id": "59112",
      "postDate": "11/27/2014 18:29:18",
      "content": "<p>Hi, just wondering if the submission limit per day can be increased?</p>\n\n<p>Cheers</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "59113",
      "postDate": "11/27/2014 18:30:41",
      "content": "<p>that will just increase the chances of overfitting . the dataset is very small...</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "59115",
      "postDate": "11/27/2014 19:42:31",
      "content": "<p>I am sure going from 3 submissions per day to 5 or 6 wouldnt make too much difference!&nbsp;</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "59145",
      "postDate": "11/28/2014 08:13:57",
      "content": "<p>Also if you are worried about overfitting then just use 3 submissions</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "59147",
      "postDate": "11/28/2014 08:47:15",
      "content": "<p>There is a more complicated reason to keep the submission limit lower than normal (5).</p>\n<p>With enough submissions and so few data points, competitors can use submissions to find meaningful information about the data held out. The obvious reason to do so--tuning&nbsp;to the leaderboard distribution--isn't advantageous if we&nbsp;assume they're keeping 2 subjects in public and 8 private. Nonetheless, people will try to find a way to&nbsp;gain some&nbsp;(slighter) advantage in a similar manner, and the higher the daily submission limit, the more effective that effort will be.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "59151",
      "postDate": "11/28/2014 10:52:27",
      "content": "<p>Aahh ok, I see :)</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 59113,
      "author_name": "abhishek",
      "author_url": "",
      "post_date": "11/27/2014 18:30:41",
      "content": "<p>that will just increase the chances of overfitting . the dataset is very small...</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 59115,
      "author_name": "davidjames",
      "author_url": "",
      "post_date": "11/27/2014 19:42:31",
      "content": "<p>I am sure going from 3 submissions per day to 5 or 6 wouldnt make too much difference!&nbsp;</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 59145,
      "author_name": "davidjames",
      "author_url": "",
      "post_date": "11/28/2014 08:13:57",
      "content": "<p>Also if you are worried about overfitting then just use 3 submissions</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 59147,
      "author_name": "mlandry",
      "author_url": "",
      "post_date": "11/28/2014 08:47:15",
      "content": "<p>There is a more complicated reason to keep the submission limit lower than normal (5).</p>\n<p>With enough submissions and so few data points, competitors can use submissions to find meaningful information about the data held out. The obvious reason to do so--tuning&nbsp;to the leaderboard distribution--isn't advantageous if we&nbsp;assume they're keeping 2 subjects in public and 8 private. Nonetheless, people will try to find a way to&nbsp;gain some&nbsp;(slighter) advantage in a similar manner, and the higher the daily submission limit, the more effective that effort will be.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 59151,
      "author_name": "davidjames",
      "author_url": "",
      "post_date": "11/28/2014 10:52:27",
      "content": "<p>Aahh ok, I see :)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "59112": "",
    "59113": "",
    "59115": "",
    "59145": "",
    "59147": "",
    "59151": ""
  },
  "source": "meta"
}