{
  "id": 254399,
  "title": "About evaluation phase",
  "url": "/competitions/mlb-player-digital-engagement-forecasting/discussion/254399",
  "author_name": "",
  "post_date": "2021-07-21T15:50:14.568114900Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi everyone,<br>\nI don't have any prior experience on time seires competitions, so the evaluation pattern still confuses me.<br>\nSince the test data for private leaderboard is of a time frame around August, Sepetember, etc. Do we get our final score months after the deadline? Am I correct? It is weird for me because I've never participated in a comp that releases the result way later than the deadline. <br>\nAny explanation is really appreciated!</p>",
  "messages": [
    {
      "id": "1395900",
      "postDate": "07/21/2021 15:50:14",
      "content": "<p>Hi everyone,<br>\nI don't have any prior experience on time seires competitions, so the evaluation pattern still confuses me.<br>\nSince the test data for private leaderboard is of a time frame around August, Sepetember, etc. Do we get our final score months after the deadline? Am I correct? It is weird for me because I've never participated in a comp that releases the result way later than the deadline. <br>\nAny explanation is really appreciated!</p>",
      "rawMarkdown": "Hi everyone,\nI don't have any prior experience on time seires competitions, so the evaluation pattern still confuses me.\nSince the test data for private leaderboard is of a time frame around August, Sepetember, etc. Do we get our final score months after the deadline? Am I correct? It is weird for me because I've never participated in a comp that releases the result way later than the deadline. \nAny explanation is really appreciated!",
      "votes": null
    },
    {
      "id": "1395909",
      "postDate": "07/21/2021 15:56:28",
      "content": "<p>We will get our final score after the final private leaderboard rerun. Kaggle staff has said in another thread that they're not sure if it's going to be a single rerun or multiple, so I'm not sure that we have a good read on exactly when we'll get our final results. If it ends up being a single rerun, we should likely expect to have our results ~1 month after the competition closes. If you're curious what a competition with delayed results from multiple reruns looks like, check out the Jane Street competition.</p>",
      "rawMarkdown": "We will get our final score after the final private leaderboard rerun. Kaggle staff has said in another thread that they're not sure if it's going to be a single rerun or multiple, so I'm not sure that we have a good read on exactly when we'll get our final results. If it ends up being a single rerun, we should likely expect to have our results ~1 month after the competition closes. If you're curious what a competition with delayed results from multiple reruns looks like, check out the Jane Street competition.",
      "votes": null
    },
    {
      "id": "1395964",
      "postDate": "07/21/2021 16:51:27",
      "content": "<p>That's a clear explanation, thanks a lot!</p>",
      "rawMarkdown": "That's a clear explanation, thanks a lot!",
      "votes": null
    },
    {
      "id": "1396118",
      "postDate": "07/21/2021 19:32:33",
      "content": "<p>We will aim to fit it one or two interim refreshes, but are avoiding announcing specific dates because it's hard to estimate how long they take to run (particularly because we allow up to 2 retries per submission in the event of errors).</p>",
      "rawMarkdown": "We will aim to fit it one or two interim refreshes, but are avoiding announcing specific dates because it's hard to estimate how long they take to run (particularly because we allow up to 2 retries per submission in the event of errors).",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1395909,
      "author_name": "marktenenholtz",
      "author_url": "",
      "post_date": "07/21/2021 15:56:28",
      "content": "<p>We will get our final score after the final private leaderboard rerun. Kaggle staff has said in another thread that they're not sure if it's going to be a single rerun or multiple, so I'm not sure that we have a good read on exactly when we'll get our final results. If it ends up being a single rerun, we should likely expect to have our results ~1 month after the competition closes. If you're curious what a competition with delayed results from multiple reruns looks like, check out the Jane Street competition.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1395964,
          "author_name": "zacchaeus",
          "author_url": "",
          "post_date": "07/21/2021 16:51:27",
          "content": "<p>That's a clear explanation, thanks a lot!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1396118,
          "author_name": "wcukierski",
          "author_url": "",
          "post_date": "07/21/2021 19:32:33",
          "content": "<p>We will aim to fit it one or two interim refreshes, but are avoiding announcing specific dates because it's hard to estimate how long they take to run (particularly because we allow up to 2 retries per submission in the event of errors).</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1395900": "Hi everyone,\nI don't have any prior experience on time seires competitions, so the evaluation pattern still confuses me.\nSince the test data for private leaderboard is of a time frame around August, Sepetember, etc. Do we get our final score months after the deadline? Am I correct? It is weird for me because I've never participated in a comp that releases the result way later than the deadline. \nAny explanation is really appreciated!",
    "1395909": "We will get our final score after the final private leaderboard rerun. Kaggle staff has said in another thread that they're not sure if it's going to be a single rerun or multiple, so I'm not sure that we have a good read on exactly when we'll get our final results. If it ends up being a single rerun, we should likely expect to have our results ~1 month after the competition closes. If you're curious what a competition with delayed results from multiple reruns looks like, check out the Jane Street competition.",
    "1395964": "That's a clear explanation, thanks a lot!",
    "1396118": "We will aim to fit it one or two interim refreshes, but are avoiding announcing specific dates because it's hard to estimate how long they take to run (particularly because we allow up to 2 retries per submission in the event of errors)."
  },
  "source": "meta"
}