![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5570457%2Fe47daa05c6d969e13eff4fd6d2e09224%2F2025-01-07_22h16_25.png?generation=1736255829979233&alt=media\")
Submissions which took 3 hours 2 days ago take more than 9 hours today. What the hell is happening with Kaggle?
\nOr has the test set been silently enlarged 3x?
\nWill it look like this in the forecasting phase, random people will time-out because of infrastructure problems and infrastructure variability?
", "messages": [ { "id": "3090307", "postDate": "01/07/2025 06:00:36", "content": "Submissions which took 3 hours 2 days ago take more than 9 hours today. What the hell is happening with Kaggle?
\nOr has the test set been silently enlarged 3x?
\nWill it look like this in the forecasting phase, random people will time-out because of infrastructure problems and infrastructure variability?
", "rawMarkdown": "Submissions which took 3 hours 2 days ago take more than 9 hours today. What the hell is happening with Kaggle?\n\nOr has the test set been silently enlarged 3x?\n\nWill it look like this in the forecasting phase, random people will time-out because of infrastructure problems and infrastructure variability?", "votes": null }, { "id": "3090355", "postDate": "01/07/2025 07:21:31", "content": "\n\nSubmissions which took 3 hours 2 days ago take more than 9 hours today.
\n
Similar situation, so hard to test and debug in this terrible online environment.
", "rawMarkdown": ">Submissions which took 3 hours 2 days ago take more than 9 hours today.\n\nSimilar situation, so hard to test and debug in this terrible online environment.", "votes": null }, { "id": "3090382", "postDate": "01/07/2025 07:47:44", "content": "It is impossible to test the running time now. Almost all submissions took about a whole day to finish.
", "rawMarkdown": "It is impossible to test the running time now. Almost all submissions took about a whole day to finish.", "votes": null }, { "id": "3090419", "postDate": "01/07/2025 09:11:41", "content": "LOL took my GPU Accelerator allowance too fast too. Have one safe approach using a non-gpu dependent submission to at least land on the leaderboard. Have seen this happen many times.
\nhttps://www.kaggle.com/code/jazivxt/the-market-is-reactive-part-2
", "rawMarkdown": "LOL took my GPU Accelerator allowance too fast too. Have one safe approach using a non-gpu dependent submission to at least land on the leaderboard. Have seen this happen many times.\n\nhttps://www.kaggle.com/code/jazivxt/the-market-is-reactive-part-2", "votes": null }, { "id": "3090470", "postDate": "01/07/2025 10:42:55", "content": "Please, we need someone to have a look at the 'Notebook timeout' issue.
", "rawMarkdown": "Please, we need someone to have a look at the 'Notebook timeout' issue.", "votes": null }, { "id": "3090583", "postDate": "01/07/2025 13:21:42", "content": "@dabrowski , thank you for your raising that topic here. I am facing the same issue and my submission took more than time limit of this competition, 8hrs. However the submission itself was success and got the score without time out error 🤔 In that case, can we consider actual run time is not exceeding the time limit from competition rule or should we select the solution which can be score within 8 hrs under current condition?
\nI appreciate if some of you share your thought about that 🙏
\n
all my submissions are now an overnight job 😬
", "rawMarkdown": "all my submissions are now an overnight job 😬", "votes": null }, { "id": "3090618", "postDate": "01/07/2025 13:54:54", "content": "I really enjoyed your post on zhihu about the \"独特的发现\" a couple years ago, thanks for the post!
", "rawMarkdown": "I really enjoyed your post on zhihu about the \"独特的发现\" a couple years ago, thanks for the post!", "votes": null }, { "id": "3090624", "postDate": "01/07/2025 13:56:11", "content": "As the competition approaches towards the end, many participants are submitting at the same time. I believe this has heavily overwhelmed the server, and thus each submission has to queue for a long time until getting to run and score.
\nIf you trust your kenel to be finished within, i.e. 3 hrs but it actually took 10hrs (or more) to score, that implies the queue time is 7 hrs.
\nIn this case, your submission won't get time-out as the actually run time remains 3 hrs.
\nI hope my theory is correct. I would draw the attention of @ryanholbrook . An official reply would be appreciated.
", "rawMarkdown": "As the competition approaches towards the end, many participants are submitting at the same time. I believe this has heavily overwhelmed the server, and thus each submission has to queue for a long time until getting to run and score. \n\nIf you trust your kenel to be finished within, i.e. 3 hrs but it actually took 10hrs (or more) to score, that implies the queue time is 7 hrs. \n\nIn this case, your submission won't get time-out as the actually run time remains 3 hrs. \n\nI hope my theory is correct. I would draw the attention of @ryanholbrook . An official reply would be appreciated.", "votes": null }, { "id": "3090819", "postDate": "01/07/2025 17:27:21", "content": "Yes even you are using KaggleApi you could not get when your sub is actually running for you could always only get pending status before you get completed.
", "rawMarkdown": "Yes even you are using KaggleApi you could not get when your sub is actually running for you could always only get pending status before you get completed.", "votes": null }, { "id": "3090828", "postDate": "01/07/2025 17:33:33", "content": "Please see https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/555505
", "rawMarkdown": "Please see https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/555505", "votes": null } ], "comments": [ { "id": 3090355, "author_name": "sweetyheehee", "author_url": "", "post_date": "01/07/2025 07:21:31", "content": "\n\nSubmissions which took 3 hours 2 days ago take more than 9 hours today.
\n
Similar situation, so hard to test and debug in this terrible online environment.
", "votes": null, "replies": [] }, { "id": 3090382, "author_name": "yuanzhezhou", "author_url": "", "post_date": "01/07/2025 07:47:44", "content": "It is impossible to test the running time now. Almost all submissions took about a whole day to finish.
", "votes": null, "replies": [ { "id": 3090618, "author_name": "alexmason11", "author_url": "", "post_date": "01/07/2025 13:54:54", "content": "I really enjoyed your post on zhihu about the \"独特的发现\" a couple years ago, thanks for the post!
", "votes": null, "replies": [] } ] }, { "id": 3090419, "author_name": "jazivxt", "author_url": "", "post_date": "01/07/2025 09:11:41", "content": "LOL took my GPU Accelerator allowance too fast too. Have one safe approach using a non-gpu dependent submission to at least land on the leaderboard. Have seen this happen many times.
\nhttps://www.kaggle.com/code/jazivxt/the-market-is-reactive-part-2
", "votes": null, "replies": [] }, { "id": 3090470, "author_name": "abdonson", "author_url": "", "post_date": "01/07/2025 10:42:55", "content": "Please, we need someone to have a look at the 'Notebook timeout' issue.
", "votes": null, "replies": [] }, { "id": 3090583, "author_name": "hechtjp", "author_url": "", "post_date": "01/07/2025 13:21:42", "content": "@dabrowski , thank you for your raising that topic here. I am facing the same issue and my submission took more than time limit of this competition, 8hrs. However the submission itself was success and got the score without time out error 🤔 In that case, can we consider actual run time is not exceeding the time limit from competition rule or should we select the solution which can be score within 8 hrs under current condition?
\nI appreciate if some of you share your thought about that 🙏
\n
all my submissions are now an overnight job 😬
", "votes": null, "replies": [] }, { "id": 3090624, "author_name": "shiyili", "author_url": "", "post_date": "01/07/2025 13:56:11", "content": "As the competition approaches towards the end, many participants are submitting at the same time. I believe this has heavily overwhelmed the server, and thus each submission has to queue for a long time until getting to run and score.
\nIf you trust your kenel to be finished within, i.e. 3 hrs but it actually took 10hrs (or more) to score, that implies the queue time is 7 hrs.
\nIn this case, your submission won't get time-out as the actually run time remains 3 hrs.
\nI hope my theory is correct. I would draw the attention of @ryanholbrook . An official reply would be appreciated.
", "votes": null, "replies": [ { "id": 3090819, "author_name": "goldenlock", "author_url": "", "post_date": "01/07/2025 17:27:21", "content": "Yes even you are using KaggleApi you could not get when your sub is actually running for you could always only get pending status before you get completed.
", "votes": null, "replies": [] } ] }, { "id": 3090828, "author_name": "sohier", "author_url": "", "post_date": "01/07/2025 17:33:33", "content": "Please see https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/555505
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "3090307": "Submissions which took 3 hours 2 days ago take more than 9 hours today. What the hell is happening with Kaggle?\n\nOr has the test set been silently enlarged 3x?\n\nWill it look like this in the forecasting phase, random people will time-out because of infrastructure problems and infrastructure variability?", "3090355": ">Submissions which took 3 hours 2 days ago take more than 9 hours today.\n\nSimilar situation, so hard to test and debug in this terrible online environment.", "3090382": "It is impossible to test the running time now. Almost all submissions took about a whole day to finish.", "3090419": "LOL took my GPU Accelerator allowance too fast too. Have one safe approach using a non-gpu dependent submission to at least land on the leaderboard. Have seen this happen many times.\n\nhttps://www.kaggle.com/code/jazivxt/the-market-is-reactive-part-2", "3090470": "Please, we need someone to have a look at the 'Notebook timeout' issue.", "3090583": "dabrowski , thank you for your raising that topic here. I am facing the same issue and my submission took more than time limit of this competition, 8hrs. However the submission itself was success and got the score without time out error 🤔 In that case, can we consider actual run time is not exceeding the time limit from competition rule or should we select the solution which can be score within 8 hrs under current condition? \n\nI appreciate if some of you share your thought about that 🙏\n\n", "3090617": "all my submissions are now an overnight job 😬", "3090618": "I really enjoyed your post on zhihu about the \"独特的发现\" a couple years ago, thanks for the post!", "3090624": "As the competition approaches towards the end, many participants are submitting at the same time. I believe this has heavily overwhelmed the server, and thus each submission has to queue for a long time until getting to run and score. \n\nIf you trust your kenel to be finished within, i.e. 3 hrs but it actually took 10hrs (or more) to score, that implies the queue time is 7 hrs. \n\nIn this case, your submission won't get time-out as the actually run time remains 3 hrs. \n\nI hope my theory is correct. I would draw the attention of @ryanholbrook . An official reply would be appreciated.", "3090819": "Yes even you are using KaggleApi you could not get when your sub is actually running for you could always only get pending status before you get completed.", "3090828": "Please see https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/555505" }, "source": "meta" }