{
  "id": 131157,
  "title": "A question about submissions",
  "url": "/competitions/deepfake-detection-challenge/discussion/131157",
  "author_name": "",
  "post_date": "2020-02-18T15:57:59.235286800Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>When the private test set become available, how many models could I submit to it? Will all the models I submit to the public test set be evaluated on the private? or just the with best public score will be evaluated or the k of them with best scores? How do this work?  </p>",
  "messages": [
    {
      "id": "749342",
      "postDate": "02/18/2020 15:57:59",
      "content": "<p>When the private test set become available, how many models could I submit to it? Will all the models I submit to the public test set be evaluated on the private? or just the with best public score will be evaluated or the k of them with best scores? How do this work?  </p>",
      "rawMarkdown": "When the private test set become available, how many models could I submit to it? Will all the models I submit to the public test set be evaluated on the private? or just the with best public score will be evaluated or the k of them with best scores? How do this work?",
      "votes": null
    },
    {
      "id": "749673",
      "postDate": "02/18/2020 21:00:52",
      "content": "<p>Hey <a href=\"/luizfelipebjcosta\">@luizfelipebjcosta</a> \nYou have to create notebooks to submit to the public leaderboard. You can have as many models inside each notebook as you wish (like an ensemble of models), to a max of 1GB of binaries.\nYour 2 best notebooks will be automatically run on the private leaderboard, when the time comes. You can either select 2 notebooks yourself on \"My Submissions\", or the 2 best submissions (according to the public leaderboard) will be automatically selected for the private evaluation.\nWe'll never see either the public or the private test sets. It all runs the background (offline) after you click submit.\nI hope that clarifies your question?</p>",
      "rawMarkdown": "Hey @luizfelipebjcosta \nYou have to create notebooks to submit to the public leaderboard. You can have as many models inside each notebook as you wish (like an ensemble of models), to a max of 1GB of binaries.\nYour 2 best notebooks will be automatically run on the private leaderboard, when the time comes. You can either select 2 notebooks yourself on \"My Submissions\", or the 2 best submissions (according to the public leaderboard) will be automatically selected for the private evaluation.\nWe'll never see either the public or the private test sets. It all runs the background (offline) after you click submit.\nI hope that clarifies your question?",
      "votes": null
    },
    {
      "id": "777510",
      "postDate": "03/17/2020 18:23:03",
      "content": "<p>thank you! (and sorry! I forgot to thank you before)</p>",
      "rawMarkdown": "thank you! (and sorry! I forgot to thank you before)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 749673,
      "author_name": "hmendonca",
      "author_url": "",
      "post_date": "02/18/2020 21:00:52",
      "content": "<p>Hey <a href=\"/luizfelipebjcosta\">@luizfelipebjcosta</a> \nYou have to create notebooks to submit to the public leaderboard. You can have as many models inside each notebook as you wish (like an ensemble of models), to a max of 1GB of binaries.\nYour 2 best notebooks will be automatically run on the private leaderboard, when the time comes. You can either select 2 notebooks yourself on \"My Submissions\", or the 2 best submissions (according to the public leaderboard) will be automatically selected for the private evaluation.\nWe'll never see either the public or the private test sets. It all runs the background (offline) after you click submit.\nI hope that clarifies your question?</p>",
      "votes": null,
      "replies": [
        {
          "id": 777510,
          "author_name": "luizfelipebjcosta",
          "author_url": "",
          "post_date": "03/17/2020 18:23:03",
          "content": "<p>thank you! (and sorry! I forgot to thank you before)</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "749342": "When the private test set become available, how many models could I submit to it? Will all the models I submit to the public test set be evaluated on the private? or just the with best public score will be evaluated or the k of them with best scores? How do this work?",
    "749673": "Hey @luizfelipebjcosta \nYou have to create notebooks to submit to the public leaderboard. You can have as many models inside each notebook as you wish (like an ensemble of models), to a max of 1GB of binaries.\nYour 2 best notebooks will be automatically run on the private leaderboard, when the time comes. You can either select 2 notebooks yourself on \"My Submissions\", or the 2 best submissions (according to the public leaderboard) will be automatically selected for the private evaluation.\nWe'll never see either the public or the private test sets. It all runs the background (offline) after you click submit.\nI hope that clarifies your question?",
    "777510": "thank you! (and sorry! I forgot to thank you before)"
  },
  "source": "meta"
}