![](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5444116%2F38cfb0b1515935ff6a8abb39f1c3893d%2F2024-04-05%20193037.png?generation=1712313237969158&alt=media\")
I have wasted many submissions trying to fix the \"Submission Scoring Error,\" but with no luck. In another competition, a similar issue occurred due to the Kaggle system, so I can't determine if the error is on my side or with Kaggle. Additionally, so far, there hasn't been any submission with a score > 0.5, which also makes me wonder what is going on. If you have faced this issue and resolved it, kindly let me know.
", "messages": [ { "id": 2735679, "postDate": "2024-04-04T20:39:54.927Z", "content": "I have wasted many submissions trying to fix the \"Submission Scoring Error,\" but with no luck. In another competition, a similar issue occurred due to the Kaggle system, so I can't determine if the error is on my side or with Kaggle. Additionally, so far, there hasn't been any submission with a score > 0.5, which also makes me wonder what is going on. If you have faced this issue and resolved it, kindly let me know.
", "rawMarkdown": "I have wasted many submissions trying to fix the \"Submission Scoring Error,\" but with no luck. In another competition, a similar issue occurred due to the Kaggle system, so I can't determine if the error is on my side or with Kaggle. Additionally, so far, there hasn't been any submission with a score > 0.5, which also makes me wonder what is going on. If you have faced this issue and resolved it, kindly let me know.", "votes": 16 }, { "id": 2736468, "postDate": "2024-04-05T08:05:02.310Z", "content": "It seems like something is off with the number of rows the scoring system is expecting. The audio files however, are 4min long with no exception. We'll take a closer look and update ASAP. Thanks for your patience.
", "rawMarkdown": "It seems like something is off with the number of rows the scoring system is expecting. The audio files however, are 4min long with no exception. We'll take a closer look and update ASAP. Thanks for your patience.", "votes": 8 }, { "id": 2737202, "postDate": "2024-04-05T16:29:56Z", "content": "I used this code and got a result of 0.5. It looks like instead of comparing to the test sample, the kaggle validation code is comparing our submission to sample_submission. I think it is worth waiting for a response from the organizers.
\n\n , row in subs.iterrows():\n row_id = row[]\n\n \n pred_row = pred_df[pred_df[] == row_id]\n\n \n pred_row.empty:\n \n subs.loc[, subs.columns != ] = pred_row.iloc[, :]\n\n\nsubs.to_csv(, =False)\nYes, I got the same error with your last year's notebook
", "rawMarkdown": "Yes, I got the same error with your last year's notebook", "votes": 1 }, { "id": 2735891, "postDate": "2024-04-05T00:09:54.493Z", "content": "i just made a sub will see if i also get that error …
", "rawMarkdown": "i just made a sub will see if i also get that error ...", "votes": 1, "replies": [ { "id": 2736293, "postDate": "2024-04-05T05:55:20.547Z", "content": "@ludovick did you face any error?
", "rawMarkdown": "@ludovick did you face any error?", "replies": [ { "id": 2736378, "postDate": "2024-04-05T06:53:13.837Z", "content": "timeout error unfortunately. going to redo one later today to double check
", "rawMarkdown": "timeout error unfortunately. going to redo one later today to double check" }, { "id": 2736474, "postDate": "2024-04-05T08:07:46.503Z", "content": "I hope you are not submitting with GPU as it will allow only 1min time for submission.
just made a relaunch, end up by having same error than you probably an error from their platform
", "rawMarkdown": "just made a relaunch, end up by having same error than you probably an error from their platform", "votes": 1 } ] } ] }, { "id": 2737405, "postDate": "2024-04-05T18:48:22.200Z", "content": "We've gotten to the bottom of this; Sohier addresses it in this post:
\nhttps://www.kaggle.com/competitions/birdclef-2024/discussion/491387
When I use Thread to submit inference, I will get an error.
", "rawMarkdown": "When I use Thread to submit inference, I will get an error." }, { "id": 2779610, "postDate": "2024-04-27T18:17:56.103Z", "content": "Hey, how did you solve this issue?
", "rawMarkdown": "Hey, how did you solve this issue?" }, { "id": 2745330, "postDate": "2024-04-10T14:51:16.817Z", "content": "Is this issue resolved? I am still facing issue. https://www.kaggle.com/code/sonujha090/birdclef-2024-inference
", "rawMarkdown": "Is this issue resolved? I am still facing issue. https://www.kaggle.com/code/sonujha090/birdclef-2024-inference" }, { "id": 2736670, "postDate": "2024-04-05T10:33:22.093Z", "content": "I also encountered a similar error and ended up stopping.
\nAfter reading this discussion and trying it out somewhat incredulously, it got scored.
\nWhat should we compete on?
I am facing the issue. I used today's submissions to verify the scoring error, but I can't get out of it.
\nI started the thread thinking that the row_id formatting was the cause, but it may be caused by something else.
\nhttps://www.kaggle.com/competitions/birdclef-2024/discussion/490964
Thanks for the thread. I submitted the right way with {test_filename}_{last} => soundscape_{soundscape_id}_{last} but still getting error.
have you remove the extension of the file?
", "rawMarkdown": "have you remove the extension of the file? " }, { "id": 2736380, "postDate": "2024-04-05T06:54:12.267Z", "content": "i am not sure you have to include 'soundscape' if not written. It was not the case in previous year
", "rawMarkdown": "i am not sure you have to include 'soundscape' if not written. It was not the case in previous year\n" }, { "id": 2736477, "postDate": "2024-04-05T08:08:11.997Z", "content": "Yes, I did remove .ogg but still same error.
Yes, I tried that too by not including soundscape_ but still got same error.
It seems like something is off with the number of rows the scoring system is expecting. The audio files however, are 4min long with no exception. We'll take a closer look and update ASAP. Thanks for your patience.
", "votes": 8, "replies": [] }, { "id": 2737202, "author_name": "Andrij", "author_url": "", "post_date": "2024-04-05T16:29:56", "content": "I used this code and got a result of 0.5. It looks like instead of comparing to the test sample, the kaggle validation code is comparing our submission to sample_submission. I think it is worth waiting for a response from the organizers.
\n\n , row in subs.iterrows():\n row_id = row[]\n\n \n pred_row = pred_df[pred_df[] == row_id]\n\n \n pred_row.empty:\n \n subs.loc[, subs.columns != ] = pred_row.iloc[, :]\n\n\nsubs.to_csv(, =False)\nYes, I got the same error with your last year's notebook
", "votes": 1, "replies": [] }, { "id": 2735891, "author_name": "Shiro", "author_url": "", "post_date": "2024-04-05T00:09:54.493000", "content": "i just made a sub will see if i also get that error …
", "votes": 1, "replies": [ { "id": 2736293, "author_name": "Awsaf", "author_url": "", "post_date": "2024-04-05T05:55:20.547000", "content": "@ludovick did you face any error?
", "votes": 0, "replies": [ { "id": 2736378, "author_name": "Shiro", "author_url": "", "post_date": "2024-04-05T06:53:13.837000", "content": "timeout error unfortunately. going to redo one later today to double check
", "votes": 0, "replies": [] }, { "id": 2736474, "author_name": "Awsaf", "author_url": "", "post_date": "2024-04-05T08:07:46.503000", "content": "I hope you are not submitting with GPU as it will allow only 1min time for submission.
just made a relaunch, end up by having same error than you probably an error from their platform
", "votes": 1, "replies": [] } ] } ] }, { "id": 2737405, "author_name": "Tom Denton", "author_url": "", "post_date": "2024-04-05T18:48:22.200000", "content": "We've gotten to the bottom of this; Sohier addresses it in this post:
\nhttps://www.kaggle.com/competitions/birdclef-2024/discussion/491387
When I use Thread to submit inference, I will get an error.
", "votes": 0, "replies": [] }, { "id": 2779610, "author_name": "Max Melichov", "author_url": "", "post_date": "2024-04-27T18:17:56.103000", "content": "Hey, how did you solve this issue?
", "votes": 0, "replies": [] }, { "id": 2745330, "author_name": "Sonu Jha", "author_url": "", "post_date": "2024-04-10T14:51:16.817000", "content": "Is this issue resolved? I am still facing issue. https://www.kaggle.com/code/sonujha090/birdclef-2024-inference
", "votes": 0, "replies": [] }, { "id": 2736670, "author_name": "Tomoki Hirose", "author_url": "", "post_date": "2024-04-05T10:33:22.093000", "content": "I also encountered a similar error and ended up stopping.
\nAfter reading this discussion and trying it out somewhat incredulously, it got scored.
\nWhat should we compete on?
I am facing the issue. I used today's submissions to verify the scoring error, but I can't get out of it.
\nI started the thread thinking that the row_id formatting was the cause, but it may be caused by something else.
\nhttps://www.kaggle.com/competitions/birdclef-2024/discussion/490964
Thanks for the thread. I submitted the right way with {test_filename}_{last} => soundscape_{soundscape_id}_{last} but still getting error.
have you remove the extension of the file?
", "votes": 0, "replies": [] }, { "id": 2736380, "author_name": "Shiro", "author_url": "", "post_date": "2024-04-05T06:54:12.267000", "content": "i am not sure you have to include 'soundscape' if not written. It was not the case in previous year
", "votes": 0, "replies": [] }, { "id": 2736477, "author_name": "Awsaf", "author_url": "", "post_date": "2024-04-05T08:08:11.997000", "content": "Yes, I did remove .ogg but still same error.
Yes, I tried that too by not including soundscape_ but still got same error.