{
  "id": 397938,
  "title": "Submission Scoring time",
  "url": "/competitions/tlvmc-parkinsons-freezing-gait-prediction/discussion/397938",
  "author_name": "",
  "post_date": "2023-03-27T21:19:26.079110Z",
  "votes": 1,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Hey,<br>\nI just wanted to know, how long is it taking for you all to get your submissions scored. Its been an hour for my recent submission. It's just scoring and not throwing an exception. Let me know how long is it taking for you guys</p>",
  "messages": [
    {
      "id": "2199616",
      "postDate": "03/27/2023 21:19:26",
      "content": "<p>Hey,<br>\nI just wanted to know, how long is it taking for you all to get your submissions scored. Its been an hour for my recent submission. It's just scoring and not throwing an exception. Let me know how long is it taking for you guys</p>",
      "rawMarkdown": "Hey,\nI just wanted to know, how long is it taking for you all to get your submissions scored. Its been an hour for my recent submission. It's just scoring and not throwing an exception. Let me know how long is it taking for you guys",
      "votes": null
    },
    {
      "id": "2202259",
      "postDate": "03/29/2023 21:15:40",
      "content": "<p>Any estimates on how many items in the hidden test data? My model is slow and for the visible test submission (286370 rows in submission.csv) it takes 4 mins. The hidden test submission times out (timeout is 9 hours), so my guess is there &gt; 40million rows to calculate in the hidden submission (9hrs * 60mins / 4mins * 286370rows), possibly may millions more.</p>",
      "rawMarkdown": "Any estimates on how many items in the hidden test data? My model is slow and for the visible test submission (286370 rows in submission.csv) it takes 4 mins. The hidden test submission times out (timeout is 9 hours), so my guess is there > 40million rows to calculate in the hidden submission (9hrs * 60mins / 4mins * 286370rows), possibly may millions more.",
      "votes": null
    },
    {
      "id": "2204915",
      "postDate": "04/01/2023 04:44:29",
      "content": "<p>I doubt it is that large. It usually takes my notebook 80 seconds to run on the visible test data and ~22 minutes on the hidden test data. Maybe your runtimes don't scale linearly with the amount of input data?</p>",
      "rawMarkdown": "I doubt it is that large. It usually takes my notebook 80 seconds to run on the visible test data and ~22 minutes on the hidden test data. Maybe your runtimes don't scale linearly with the amount of input data?",
      "votes": null
    },
    {
      "id": "2210734",
      "postDate": "04/05/2023 15:32:52",
      "content": "<p>For one of my inference notebooks, it takes 4 mins and 49 seconds for visible test data  and somewhere between 1½ to 2 hours for hidden test data.</p>",
      "rawMarkdown": "For one of my inference notebooks, it takes 4 mins and 49 seconds for visible test data  and somewhere between 1½ to 2 hours for hidden test data.",
      "votes": null
    },
    {
      "id": "2268110",
      "postDate": "05/21/2023 13:13:58",
      "content": "<p>When I did the testing of my inference notebook  for 250 timeseries , my test data contains around <strong>14992734 rows</strong></p>\n<p>This testing only took approx 10 mins to finish. </p>\n<p>But the same submitted notebook is still running from last 1 hour 😑</p>\n<p>What's wrong here ??</p>",
      "rawMarkdown": "When I did the testing of my inference notebook  for 250 timeseries , my test data contains around **14992734 rows**\n\nThis testing only took approx 10 mins to finish. \n\nBut the same submitted notebook is still running from last 1 hour 😑\n\nWhat's wrong here ??",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2202259,
      "author_name": "rayzinnz",
      "author_url": "",
      "post_date": "03/29/2023 21:15:40",
      "content": "<p>Any estimates on how many items in the hidden test data? My model is slow and for the visible test submission (286370 rows in submission.csv) it takes 4 mins. The hidden test submission times out (timeout is 9 hours), so my guess is there &gt; 40million rows to calculate in the hidden submission (9hrs * 60mins / 4mins * 286370rows), possibly may millions more.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2204915,
          "author_name": "jsday96",
          "author_url": "",
          "post_date": "04/01/2023 04:44:29",
          "content": "<p>I doubt it is that large. It usually takes my notebook 80 seconds to run on the visible test data and ~22 minutes on the hidden test data. Maybe your runtimes don't scale linearly with the amount of input data?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2210734,
          "author_name": "coderrkj",
          "author_url": "",
          "post_date": "04/05/2023 15:32:52",
          "content": "<p>For one of my inference notebooks, it takes 4 mins and 49 seconds for visible test data  and somewhere between 1½ to 2 hours for hidden test data.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2268110,
      "author_name": "shobhitupadhyaya",
      "author_url": "",
      "post_date": "05/21/2023 13:13:58",
      "content": "<p>When I did the testing of my inference notebook  for 250 timeseries , my test data contains around <strong>14992734 rows</strong></p>\n<p>This testing only took approx 10 mins to finish. </p>\n<p>But the same submitted notebook is still running from last 1 hour 😑</p>\n<p>What's wrong here ??</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2199616": "Hey,\nI just wanted to know, how long is it taking for you all to get your submissions scored. Its been an hour for my recent submission. It's just scoring and not throwing an exception. Let me know how long is it taking for you guys",
    "2202259": "Any estimates on how many items in the hidden test data? My model is slow and for the visible test submission (286370 rows in submission.csv) it takes 4 mins. The hidden test submission times out (timeout is 9 hours), so my guess is there > 40million rows to calculate in the hidden submission (9hrs * 60mins / 4mins * 286370rows), possibly may millions more.",
    "2204915": "I doubt it is that large. It usually takes my notebook 80 seconds to run on the visible test data and ~22 minutes on the hidden test data. Maybe your runtimes don't scale linearly with the amount of input data?",
    "2210734": "For one of my inference notebooks, it takes 4 mins and 49 seconds for visible test data  and somewhere between 1½ to 2 hours for hidden test data.",
    "2268110": "When I did the testing of my inference notebook  for 250 timeseries , my test data contains around **14992734 rows**\n\nThis testing only took approx 10 mins to finish. \n\nBut the same submitted notebook is still running from last 1 hour 😑\n\nWhat's wrong here ??"
  },
  "source": "meta"
}