{
  "id": 246488,
  "title": "Question about evaluation phase",
  "url": "/competitions/mlb-player-digital-engagement-forecasting/discussion/246488",
  "author_name": "",
  "post_date": "2021-06-15T12:54:51.130900600Z",
  "votes": 7,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Not sure if this is obvious/standard for competitions that use the time series module, but does the date range of the training data get extended until the day before the new evaluation period during the private leaderboard evaluation phase? In other words, our training data goes until the end of April 2021 currently and we're evaluated on May 2021. Let's just say the evaluation period ends up being August 2021 (obviously we don't know this yet) -- does that mean that we would have training data that goes until the end of July 2021? Thanks!</p>",
  "messages": [
    {
      "id": "1350450",
      "postDate": "06/15/2021 12:54:51",
      "content": "<p>Not sure if this is obvious/standard for competitions that use the time series module, but does the date range of the training data get extended until the day before the new evaluation period during the private leaderboard evaluation phase? In other words, our training data goes until the end of April 2021 currently and we're evaluated on May 2021. Let's just say the evaluation period ends up being August 2021 (obviously we don't know this yet) -- does that mean that we would have training data that goes until the end of July 2021? Thanks!</p>",
      "rawMarkdown": "Not sure if this is obvious/standard for competitions that use the time series module, but does the date range of the training data get extended until the day before the new evaluation period during the private leaderboard evaluation phase? In other words, our training data goes until the end of April 2021 currently and we're evaluated on May 2021. Let's just say the evaluation period ends up being August 2021 (obviously we don't know this yet) -- does that mean that we would have training data that goes until the end of July 2021? Thanks!",
      "votes": null
    },
    {
      "id": "1350777",
      "postDate": "06/15/2021 18:32:19",
      "content": "<p>Our plan is to append an optional, opt-in, updated version of the training set 1-2 weeks prior to the deadline, targeting roughly July 20th. We will then update it again prior to the evaluation period (containing data up to July 31).</p>\n<ul>\n<li>Why optional? It will be optional so that anyone who does not wish to retrain or use it does not end up with broken notebooks, memory errors, etc.</li>\n<li>Why near the end? We want to minimize contamination of the public leaderboard.</li>\n</ul>",
      "rawMarkdown": "Our plan is to append an optional, opt-in, updated version of the training set 1-2 weeks prior to the deadline, targeting roughly July 20th. We will then update it again prior to the evaluation period (containing data up to July 31).\n\n - Why optional? It will be optional so that anyone who does not wish to retrain or use it does not end up with broken notebooks, memory errors, etc.\n - Why near the end? We want to minimize contamination of the public leaderboard.",
      "votes": null
    },
    {
      "id": "1357272",
      "postDate": "06/19/2021 15:19:05",
      "content": "<p>Good question Mark and is that picture updated just for this competition? Bravo!</p>",
      "rawMarkdown": "Good question Mark and is that picture updated just for this competition? Bravo!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1350777,
      "author_name": "wcukierski",
      "author_url": "",
      "post_date": "06/15/2021 18:32:19",
      "content": "<p>Our plan is to append an optional, opt-in, updated version of the training set 1-2 weeks prior to the deadline, targeting roughly July 20th. We will then update it again prior to the evaluation period (containing data up to July 31).</p>\n<ul>\n<li>Why optional? It will be optional so that anyone who does not wish to retrain or use it does not end up with broken notebooks, memory errors, etc.</li>\n<li>Why near the end? We want to minimize contamination of the public leaderboard.</li>\n</ul>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1357272,
      "author_name": "crained",
      "author_url": "",
      "post_date": "06/19/2021 15:19:05",
      "content": "<p>Good question Mark and is that picture updated just for this competition? Bravo!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1350450": "Not sure if this is obvious/standard for competitions that use the time series module, but does the date range of the training data get extended until the day before the new evaluation period during the private leaderboard evaluation phase? In other words, our training data goes until the end of April 2021 currently and we're evaluated on May 2021. Let's just say the evaluation period ends up being August 2021 (obviously we don't know this yet) -- does that mean that we would have training data that goes until the end of July 2021? Thanks!",
    "1350777": "Our plan is to append an optional, opt-in, updated version of the training set 1-2 weeks prior to the deadline, targeting roughly July 20th. We will then update it again prior to the evaluation period (containing data up to July 31).\n\n - Why optional? It will be optional so that anyone who does not wish to retrain or use it does not end up with broken notebooks, memory errors, etc.\n - Why near the end? We want to minimize contamination of the public leaderboard.",
    "1357272": "Good question Mark and is that picture updated just for this competition? Bravo!"
  },
  "source": "meta"
}