{ "id": 491856, "title": "Submission keep showing scoring", "url": "/competitions/hms-harmful-brain-activity-classification/discussion/491856", "author_name": "", "post_date": "2024-04-07T16:18:22.816962900Z", "votes": 10, "comment_count": 8, "views": 0, "content": "

I submitted one small model which used to finish in 10 minutes, and I re tested using 2700 test case it should finish in 10 minutes, but after submission it keep showing scoring for 30 mintutes now…😂
\nUpdate finished in 30 minutes, is it due to traffic issue? I wanna to know so I could estimate how many models to ensemble..

", "messages": [ { "id": "2740153", "postDate": "04/07/2024 16:18:22", "content": "

I submitted one small model which used to finish in 10 minutes, and I re tested using 2700 test case it should finish in 10 minutes, but after submission it keep showing scoring for 30 mintutes now…😂
\nUpdate finished in 30 minutes, is it due to traffic issue? I wanna to know so I could estimate how many models to ensemble..

", "rawMarkdown": "I submitted one small model which used to finish in 10 minutes, and I re tested using 2700 test case it should finish in 10 minutes, but after submission it keep showing scoring for 30 mintutes now...😂\nUpdate finished in 30 minutes, is it due to traffic issue? I wanna to know so I could estimate how many models to ensemble..", "votes": null }, { "id": "2740167", "postDate": "04/07/2024 16:35:12", "content": "

We should wait for official clarification, but I think if the scoring took long just for waiting to get new instance (i.e. queuing), it shouldn't affect scoring time.

", "rawMarkdown": "We should wait for official clarification, but I think if the scoring took long just for waiting to get new instance (i.e. queuing), it shouldn't affect scoring time.", "votes": null }, { "id": "2740168", "postDate": "04/07/2024 16:36:49", "content": "

Yes, there is about a 20 minute wait for GPU right now. We observe if we commit a GPU notebook it is queued for like 20 minutes. Similarly when we submit a notebook first it is queued and then second it is run. So your 30 minutes = Queue time + Run time. I also just submitted a notebook and it took about 20 minutes longer than usual.

\n

(Note that interactive GPU notebooks use a shorter different queue and have shorter (or no) wait times right now).

", "rawMarkdown": "Yes, there is about a 20 minute wait for GPU right now. We observe if we **commit** a GPU notebook it is queued for like 20 minutes. Similarly when we **submit** a notebook first it is queued and then second it is run. So your 30 minutes = Queue time + Run time. I also just submitted a notebook and it took about 20 minutes longer than usual.\n\n(Note that **interactive** GPU notebooks use a shorter different queue and have shorter (or no) wait times right now).", "votes": null }, { "id": "2740203", "postDate": "04/07/2024 17:05:32", "content": "

Thanks ! @cdeotte

", "rawMarkdown": "Thanks ! @cdeotte", "votes": null }, { "id": "2741350", "postDate": "04/08/2024 09:26:07", "content": "

Thanks Chris.

\n

I committed a GPU notebook and queued for 40 minutes, I stopped it before seeing this message, maybe I should just wait longer.

\n

Only 15 hours to go….

", "rawMarkdown": "Thanks Chris.\n\nI committed a GPU notebook and queued for 40 minutes, I stopped it before seeing this message, maybe I should just wait longer.\n\nOnly 15 hours to go....", "votes": null }, { "id": "2741408", "postDate": "04/08/2024 10:35:08", "content": "

Could be time spent waiting for resources to be available?
\nTo investigate further, try to have a CPU vs GPU submission and compare the execution times. 👌

", "rawMarkdown": "Could be time spent waiting for resources to be available? \nTo investigate further, try to have a CPU vs GPU submission and compare the execution times. 👌", "votes": null }, { "id": "2741727", "postDate": "04/08/2024 15:08:37", "content": "

for me today doing a commit is like taking ages to complete :( stuck in queued status

", "rawMarkdown": "for me today doing a commit is like taking ages to complete :( stuck in queued status", "votes": null }, { "id": "2741794", "postDate": "04/08/2024 15:48:06", "content": "

First try:
\n

\n

I tried again:
\n

\n

Well, at least they put me in line!
\n😍☕

", "rawMarkdown": "**First try**:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F292812%2Ff7abf1176a009de4c6c005482799fcb4%2F2024-04-08%2019-27-28.png?generation=1712590996430132&alt=media)\n\n**I tried again**:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F292812%2Fffe9cf9e0c253bf5980466d3cf2196ab%2F2024-04-08%2019-33-09.png?generation=1712591009117718&alt=media)\n\n**Well, at least they put me in line!**\n😍☕", "votes": null }, { "id": "2742084", "postDate": "04/08/2024 18:22:27", "content": "

Time in line for more than 2 hours. The notebook, which was estimated at about an hour, was estimated at 2 hours. The one that was estimated for about 2 hours already 5 hours without evaluation. It's good that there is still time)

", "rawMarkdown": "Time in line for more than 2 hours. The notebook, which was estimated at about an hour, was estimated at 2 hours. The one that was estimated for about 2 hours already 5 hours without evaluation. It's good that there is still time)", "votes": null } ], "comments": [ { "id": 2740167, "author_name": "tatamikenn", "author_url": "", "post_date": "04/07/2024 16:35:12", "content": "

We should wait for official clarification, but I think if the scoring took long just for waiting to get new instance (i.e. queuing), it shouldn't affect scoring time.

", "votes": null, "replies": [] }, { "id": 2740168, "author_name": "cdeotte", "author_url": "", "post_date": "04/07/2024 16:36:49", "content": "

Yes, there is about a 20 minute wait for GPU right now. We observe if we commit a GPU notebook it is queued for like 20 minutes. Similarly when we submit a notebook first it is queued and then second it is run. So your 30 minutes = Queue time + Run time. I also just submitted a notebook and it took about 20 minutes longer than usual.

\n

(Note that interactive GPU notebooks use a shorter different queue and have shorter (or no) wait times right now).

", "votes": null, "replies": [ { "id": 2740203, "author_name": "goldenlock", "author_url": "", "post_date": "04/07/2024 17:05:32", "content": "

Thanks ! @cdeotte

", "votes": null, "replies": [] }, { "id": 2741350, "author_name": "peterty", "author_url": "", "post_date": "04/08/2024 09:26:07", "content": "

Thanks Chris.

\n

I committed a GPU notebook and queued for 40 minutes, I stopped it before seeing this message, maybe I should just wait longer.

\n

Only 15 hours to go….

", "votes": null, "replies": [] } ] }, { "id": 2741408, "author_name": "yassinealouini", "author_url": "", "post_date": "04/08/2024 10:35:08", "content": "

Could be time spent waiting for resources to be available?
\nTo investigate further, try to have a CPU vs GPU submission and compare the execution times. 👌

", "votes": null, "replies": [] }, { "id": 2741727, "author_name": "gauravbrills", "author_url": "", "post_date": "04/08/2024 15:08:37", "content": "

for me today doing a commit is like taking ages to complete :( stuck in queued status

", "votes": null, "replies": [] }, { "id": 2741794, "author_name": "maatkara", "author_url": "", "post_date": "04/08/2024 15:48:06", "content": "

First try:
\n

\n

I tried again:
\n

\n

Well, at least they put me in line!
\n😍☕

", "votes": null, "replies": [] }, { "id": 2742084, "author_name": "zaakciiru", "author_url": "", "post_date": "04/08/2024 18:22:27", "content": "

Time in line for more than 2 hours. The notebook, which was estimated at about an hour, was estimated at 2 hours. The one that was estimated for about 2 hours already 5 hours without evaluation. It's good that there is still time)

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "2740153": "I submitted one small model which used to finish in 10 minutes, and I re tested using 2700 test case it should finish in 10 minutes, but after submission it keep showing scoring for 30 mintutes now...😂\nUpdate finished in 30 minutes, is it due to traffic issue? I wanna to know so I could estimate how many models to ensemble..", "2740167": "We should wait for official clarification, but I think if the scoring took long just for waiting to get new instance (i.e. queuing), it shouldn't affect scoring time.", "2740168": "Yes, there is about a 20 minute wait for GPU right now. We observe if we **commit** a GPU notebook it is queued for like 20 minutes. Similarly when we **submit** a notebook first it is queued and then second it is run. So your 30 minutes = Queue time + Run time. I also just submitted a notebook and it took about 20 minutes longer than usual.\n\n(Note that **interactive** GPU notebooks use a shorter different queue and have shorter (or no) wait times right now).", "2740203": "Thanks ! @cdeotte", "2741350": "Thanks Chris.\n\nI committed a GPU notebook and queued for 40 minutes, I stopped it before seeing this message, maybe I should just wait longer.\n\nOnly 15 hours to go....", "2741408": "Could be time spent waiting for resources to be available? \nTo investigate further, try to have a CPU vs GPU submission and compare the execution times. 👌", "2741727": "for me today doing a commit is like taking ages to complete :( stuck in queued status", "2741794": "**First try**:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F292812%2Ff7abf1176a009de4c6c005482799fcb4%2F2024-04-08%2019-27-28.png?generation=1712590996430132&alt=media)\n\n**I tried again**:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F292812%2Fffe9cf9e0c253bf5980466d3cf2196ab%2F2024-04-08%2019-33-09.png?generation=1712591009117718&alt=media)\n\n**Well, at least they put me in line!**\n😍☕", "2742084": "Time in line for more than 2 hours. The notebook, which was estimated at about an hour, was estimated at 2 hours. The one that was estimated for about 2 hours already 5 hours without evaluation. It's good that there is still time)" }, "source": "meta" }