{
  "id": 544429,
  "title": "First Time Kaggler here, Why does it take so long to get submission scores? ",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/544429",
  "author_name": "",
  "post_date": "2024-11-05T05:26:07.423527600Z",
  "votes": -2,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Something Related to Inference setup or my submission code has inefficiencies? For example I was testing submissions with a simple NN and it took 6hrs and threw out a 'Notebook Timeout' error. It doesnt even take that long to train it!</p>\n<p>I am curious, what actually happens when a submission.parquet is sent for evaluation, any ideas?</p>",
  "messages": [
    {
      "id": "3036945",
      "postDate": "11/05/2024 05:26:07",
      "content": "<p>Something Related to Inference setup or my submission code has inefficiencies? For example I was testing submissions with a simple NN and it took 6hrs and threw out a 'Notebook Timeout' error. It doesnt even take that long to train it!</p>\n<p>I am curious, what actually happens when a submission.parquet is sent for evaluation, any ideas?</p>",
      "rawMarkdown": "Something Related to Inference setup or my submission code has inefficiencies? For example I was testing submissions with a simple NN and it took 6hrs and threw out a 'Notebook Timeout' error. It doesnt even take that long to train it!\n\nI am curious, what actually happens when a submission.parquet is sent for evaluation, any ideas?",
      "votes": null
    },
    {
      "id": "3037150",
      "postDate": "11/05/2024 12:12:57",
      "content": "<p>The dataset used for leaderboard evaluation is quite large. Based on my estimate, each prediction should ideally complete in under 0.15 seconds to meet the 9-hour submission limit. If your notebook times out after 6 hours, it might be more than just prediction speed—sometimes issues like incorrect submission format or memory problems can also cause this error. </p>",
      "rawMarkdown": "The dataset used for leaderboard evaluation is quite large. Based on my estimate, each prediction should ideally complete in under 0.15 seconds to meet the 9-hour submission limit. If your notebook times out after 6 hours, it might be more than just prediction speed—sometimes issues like incorrect submission format or memory problems can also cause this error.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3037150,
      "author_name": "xuliangxu",
      "author_url": "",
      "post_date": "11/05/2024 12:12:57",
      "content": "<p>The dataset used for leaderboard evaluation is quite large. Based on my estimate, each prediction should ideally complete in under 0.15 seconds to meet the 9-hour submission limit. If your notebook times out after 6 hours, it might be more than just prediction speed—sometimes issues like incorrect submission format or memory problems can also cause this error. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3036945": "Something Related to Inference setup or my submission code has inefficiencies? For example I was testing submissions with a simple NN and it took 6hrs and threw out a 'Notebook Timeout' error. It doesnt even take that long to train it!\n\nI am curious, what actually happens when a submission.parquet is sent for evaluation, any ideas?",
    "3037150": "The dataset used for leaderboard evaluation is quite large. Based on my estimate, each prediction should ideally complete in under 0.15 seconds to meet the 9-hour submission limit. If your notebook times out after 6 hours, it might be more than just prediction speed—sometimes issues like incorrect submission format or memory problems can also cause this error."
  },
  "source": "meta"
}