I'm suffering from Submission Scoring Error.
\nI checked that submission file's shape for each day was equal to sample submission file's shape.
\nAnd I confirmed submission file was no null values.
\nI tried to submit file sort by date_playerId but didn't accept.
\nCould you tell me how to solve this problem?
I'm suffering from Submission Scoring Error.
\nI checked that submission file's shape for each day was equal to sample submission file's shape.
\nAnd I confirmed submission file was no null values.
\nI tried to submit file sort by date_playerId but didn't accept.
\nCould you tell me how to solve this problem?
Did not see anything obvious - forked your script and Saving it now. Hopefully can get a submit done before its bedtime here in Pittsburgh.
", "rawMarkdown": "Did not see anything obvious - forked your script and Saving it now. Hopefully can get a submit done before its bedtime here in Pittsburgh.", "votes": 3, "replies": [ { "id": 1348417, "postDate": "2021-06-14T03:33:00.997Z", "content": "I believe the error in your use of pickle files for the two test files - you need to process the two example files directly from the supplied csv. If you just pickled the two files than simple change - but if you added more than it gets messy.
\nWhen you do the Save it runs your code with those supplied files and is OK using your pickles.
\nWhen you do your Submit it replaces those files with the hidden data for May.
", "rawMarkdown": "I believe the error in your use of pickle files for the two test files - you need to process the two example files directly from the supplied csv. If you just pickled the two files than simple change - but if you added more than it gets messy.\n\nWhen you do the Save it runs your code with those supplied files and is OK using your pickles. \n\nWhen you do your Submit it replaces those files with the hidden data for May.\n\n", "votes": 3 }, { "id": 1348421, "postDate": "2021-06-14T03:37:25.507Z", "content": "Jimmy,
\nIf you have a spare submission to burn, could you try just submitting the sample predictions and let me know if they go through? I had trouble just submitting the sample predictions.
", "rawMarkdown": "Jimmy,\n\nIf you have a spare submission to burn, could you try just submitting the sample predictions and let me know if they go through? I had trouble just submitting the sample predictions.", "votes": 2 }, { "id": 1348423, "postDate": "2021-06-14T03:41:49.680Z", "content": "Got some to burn - did try to submit as you wrote it and got the error. Now running with a change to the last cell - I replaced it with one that \"worked\" on submission of mine today.
\nDarn - I had more crap added to mine than I realized - so back to using your final cell. ):
", "rawMarkdown": "Got some to burn - did try to submit as you wrote it and got the error. Now running with a change to the last cell - I replaced it with one that \"worked\" on submission of mine today. \n\nDarn - I had more crap added to mine than I realized - so back to using your final cell. ):", "votes": 2 }, { "id": 1348424, "postDate": "2021-06-14T03:48:56.827Z", "content": "Will now try to just replace your pickle reads with csv reads of the two example files and see what stuff sticks to the wall.
", "rawMarkdown": "Will now try to just replace your pickle reads with csv reads of the two example files and see what stuff sticks to the wall.", "votes": 2 }, { "id": 1348433, "postDate": "2021-06-14T04:08:17.990Z", "content": "Only one of the files can easily be changed to use csv (still got scoring error). But now not sure that's the issue. I think the API takes care of using the right test files during Save and during Submit - will look some more tomorrow.
", "rawMarkdown": "Only one of the files can easily be changed to use csv (still got scoring error). But now not sure that's the issue. I think the API takes care of using the right test files during Save and during Submit - will look some more tomorrow.", "votes": 2 }, { "id": 1348517, "postDate": "2021-06-14T05:38:50.053Z", "content": "Jimmmy,
\nThanks to your advice!
\nI didn't come to the conclusion that pickle files were the cause.
\nI'll check once again.
Apologies if this wasn't clear, but example_test.csv and example_sample_submission.csv are NOT present in the private dataset. They are simply dummy files (copied from the last 5 days of the training set) we use to support interactively running the mlb module. There is no reason to use these files directly when submitting. The module provides the real test data and does all submission I/O for you.
Is it possible that input datas cause Submission Scoring Error?
\nThe notebook I currently use spends 20 minutes finishing(most of spend training the model).
\nBut when I submit this notebook,Submission Scoring Error happened a few minutes later.
\nSo I thought input datas causes this error input datas because I felt this error happened before training the model.
Yes, I think the test data is causing issues. I have tried to investigate this but have received zero follow up from the competition hosts.
", "rawMarkdown": "Yes, I think the test data is causing issues. I [have tried to investigate this](https://www.kaggle.com/c/mlb-player-digital-engagement-forecasting/discussion/246774) but have received zero follow up from the competition hosts." } ] }, { "id": 1349538, "postDate": "2021-06-14T21:26:00.903Z", "content": "Jane Street flashbacks are incoming.
\nOn a more serious note, maybe you should look at the discussion of the similar issues of the previous coding competitions or try to modify existing kernels line by line until your code begins to work.
", "rawMarkdown": "Jane Street flashbacks are incoming.\n\nOn a more serious note, maybe you should look at the discussion of the similar issues of the previous coding competitions or try to modify existing kernels line by line until your code begins to work.", "votes": 2, "replies": [ { "id": 1349613, "postDate": "2021-06-15T00:54:45.177Z", "content": "@avtobusbratiev
\nThanks to your comment!
\nI'll do check other code competition's discussion.
This competition used a similiar API - might want to look at the shared code there. I had no luck finding your error so far.
", "rawMarkdown": "[RIID](https://www.kaggle.com/c/riiid-test-answer-prediction)\n\nThis competition used a similiar API - might want to look at the shared code there. I had no luck finding your error so far.", "votes": 1 }, { "id": 1350954, "postDate": "2021-06-16T01:07:13.200Z", "content": "Thanks to your comment!
\nAnd I am grateful for the consultation so far.
\nI'll check if the implementation is okay to see riiid's discussion.
Submission errors are a common event on kernels only competitions. Lots of root causes - you will not likely get any real help unless you make your kernel public and provide a link.
", "rawMarkdown": "Submission errors are a common event on kernels only competitions. Lots of root causes - you will not likely get any real help unless you make your kernel public and provide a link. ", "votes": 2, "replies": [ { "id": 1348391, "postDate": "2021-06-14T03:08:44.603Z", "content": "@PC Jimmmy
\nThanks to your comment!
\nI share my notebook.
\nThank you for your advice.
Did not see anything obvious - forked your script and Saving it now. Hopefully can get a submit done before its bedtime here in Pittsburgh.
", "votes": 3, "replies": [ { "id": 1348417, "author_name": "PC Jimmmy", "author_url": "", "post_date": "2021-06-14T03:33:00.997000", "content": "I believe the error in your use of pickle files for the two test files - you need to process the two example files directly from the supplied csv. If you just pickled the two files than simple change - but if you added more than it gets messy.
\nWhen you do the Save it runs your code with those supplied files and is OK using your pickles.
\nWhen you do your Submit it replaces those files with the hidden data for May.
", "votes": 3, "replies": [] }, { "id": 1348421, "author_name": "Nick Zeak", "author_url": "", "post_date": "2021-06-14T03:37:25.507000", "content": "Jimmy,
\nIf you have a spare submission to burn, could you try just submitting the sample predictions and let me know if they go through? I had trouble just submitting the sample predictions.
", "votes": 2, "replies": [] }, { "id": 1348423, "author_name": "PC Jimmmy", "author_url": "", "post_date": "2021-06-14T03:41:49.680000", "content": "Got some to burn - did try to submit as you wrote it and got the error. Now running with a change to the last cell - I replaced it with one that \"worked\" on submission of mine today.
\nDarn - I had more crap added to mine than I realized - so back to using your final cell. ):
", "votes": 2, "replies": [] }, { "id": 1348424, "author_name": "PC Jimmmy", "author_url": "", "post_date": "2021-06-14T03:48:56.827000", "content": "Will now try to just replace your pickle reads with csv reads of the two example files and see what stuff sticks to the wall.
", "votes": 2, "replies": [] }, { "id": 1348433, "author_name": "PC Jimmmy", "author_url": "", "post_date": "2021-06-14T04:08:17.990000", "content": "Only one of the files can easily be changed to use csv (still got scoring error). But now not sure that's the issue. I think the API takes care of using the right test files during Save and during Submit - will look some more tomorrow.
", "votes": 2, "replies": [] }, { "id": 1348517, "author_name": "XS 330", "author_url": "", "post_date": "2021-06-14T05:38:50.053000", "content": "Jimmmy,
\nThanks to your advice!
\nI didn't come to the conclusion that pickle files were the cause.
\nI'll check once again.
Apologies if this wasn't clear, but example_test.csv and example_sample_submission.csv are NOT present in the private dataset. They are simply dummy files (copied from the last 5 days of the training set) we use to support interactively running the mlb module. There is no reason to use these files directly when submitting. The module provides the real test data and does all submission I/O for you.
Is it possible that input datas cause Submission Scoring Error?
\nThe notebook I currently use spends 20 minutes finishing(most of spend training the model).
\nBut when I submit this notebook,Submission Scoring Error happened a few minutes later.
\nSo I thought input datas causes this error input datas because I felt this error happened before training the model.
Yes, I think the test data is causing issues. I have tried to investigate this but have received zero follow up from the competition hosts.
", "votes": 0, "replies": [] } ] }, { "id": 1349538, "author_name": "majoraregalia", "author_url": "", "post_date": "2021-06-14T21:26:00.903000", "content": "Jane Street flashbacks are incoming.
\nOn a more serious note, maybe you should look at the discussion of the similar issues of the previous coding competitions or try to modify existing kernels line by line until your code begins to work.
", "votes": 2, "replies": [ { "id": 1349613, "author_name": "XS 330", "author_url": "", "post_date": "2021-06-15T00:54:45.177000", "content": "@avtobusbratiev
\nThanks to your comment!
\nI'll do check other code competition's discussion.
This competition used a similiar API - might want to look at the shared code there. I had no luck finding your error so far.
", "votes": 1, "replies": [] }, { "id": 1350954, "author_name": "XS 330", "author_url": "", "post_date": "2021-06-16T01:07:13.200000", "content": "Thanks to your comment!
\nAnd I am grateful for the consultation so far.
\nI'll check if the implementation is okay to see riiid's discussion.
Submission errors are a common event on kernels only competitions. Lots of root causes - you will not likely get any real help unless you make your kernel public and provide a link.
", "votes": 2, "replies": [ { "id": 1348391, "author_name": "XS 330", "author_url": "", "post_date": "2021-06-14T03:08:44.603000", "content": "@PC Jimmmy
\nThanks to your comment!
\nI share my notebook.
\nThank you for your advice.