My notebook returned a submission scoring error, but without any further descriptions. In other words, I have no idea what went wrong. It wasn't the runtime because this was a simple baseline that only takes to run for 7 minutes on the public test set.
\n\nCould the organizers provide more informative error codes? Has anybody else run into this problem?
", "messages": [ { "id": "662688", "postDate": "10/31/2019 21:31:33", "content": "My notebook returned a submission scoring error, but without any further descriptions. In other words, I have no idea what went wrong. It wasn't the runtime because this was a simple baseline that only takes to run for 7 minutes on the public test set.
\n\nCould the organizers provide more informative error codes? Has anybody else run into this problem?
", "rawMarkdown": "My notebook returned a submission scoring error, but without any further descriptions. In other words, I have no idea what went wrong. It wasn't the runtime because this was a simple baseline that only takes to run for 7 minutes on the public test set.\n\nCould the organizers provide more informative error codes? Has anybody else run into this problem?", "votes": null }, { "id": "664223", "postDate": "11/03/2019 11:23:25", "content": "I'm facing the same problem. Currently I'm only submitting '' for _long answers and 'YES' for _short ones.
", "rawMarkdown": "I'm facing the same problem. Currently I'm only submitting '' for _long answers and 'YES' for _short ones.", "votes": null }, { "id": "664256", "postDate": "11/03/2019 12:11:59", "content": "I've solved my error:
\n\n\n\n\n\n
submission.to_csv('submission.csv', index=False)
If you don't specify \"index=False\" your submission would have an extra column \"Unnamed:0\"
", "rawMarkdown": "I've solved my error:\n\n> `submission.to_csv('submission.csv', index=False)`\n\nIf you don't specify \"index=False\" your submission would have an extra column \"Unnamed:0\"", "votes": null }, { "id": "664432", "postDate": "11/03/2019 16:53:55", "content": "Don't load the test set into a pandas dataframe! Running your script/notebook on the full test set (10x larger than the test set the public score is computed on) will cause a scoring error.\nRead in the test set incrementally and read in the json line by line:
\n\n\nwith open(PATH_TEST, 'rt') as f:\n for cnt, line in enumerate(f):\n dic = json.loads(line)\n q = dic['question_text']\n
I am getting the same error as well. I was trying to submit a notebook by another author.
", "rawMarkdown": "I am getting the same error as well. I was trying to submit a notebook by another author.", "votes": null }, { "id": "668807", "postDate": "11/08/2019 22:37:13", "content": "Sorry you're having trouble. We intentionally are unable to disclose specific errors, because of the vulnerability of using any error feedback to probe the leaderboard. Some hints for things you may want to check are (a) whether your kernel is generating an output submission that matches the sample_submission file, and (b) the IDs are labeled correctly (including negative numbers).
", "rawMarkdown": "Sorry you're having trouble. We intentionally are unable to disclose specific errors, because of the vulnerability of using any error feedback to probe the leaderboard. Some hints for things you may want to check are (a) whether your kernel is generating an output submission that matches the sample_submission file, and (b) the IDs are labeled correctly (including negative numbers).", "votes": null }, { "id": "668894", "postDate": "11/09/2019 03:13:13", "content": "Can you check or share the evaluate script with us ？ I try the others ‘ notebook has been success submited，however get a score error anyway
", "rawMarkdown": "Can you check or share the evaluate script with us ？ I try the others ‘ notebook has been success submited，however get a score error anyway", "votes": null }, { "id": "668919", "postDate": "11/09/2019 05:01:28", "content": "Just adding to the discussion -- I ran the starter notebook and also got a submission scoring error.
", "rawMarkdown": "Just adding to the discussion -- I ran the starter notebook and also got a submission scoring error.", "votes": null } ], "comments": [ { "id": 664223, "author_name": "cayala", "author_url": "", "post_date": "11/03/2019 11:23:25", "content": "I'm facing the same problem. Currently I'm only submitting '' for _long answers and 'YES' for _short ones.
", "votes": null, "replies": [ { "id": 664256, "author_name": "cayala", "author_url": "", "post_date": "11/03/2019 12:11:59", "content": "I've solved my error:
\n\n\n\n\n\n
submission.to_csv('submission.csv', index=False)
If you don't specify \"index=False\" your submission would have an extra column \"Unnamed:0\"
", "votes": null, "replies": [] } ] }, { "id": 664432, "author_name": "fschilder", "author_url": "", "post_date": "11/03/2019 16:53:55", "content": "Don't load the test set into a pandas dataframe! Running your script/notebook on the full test set (10x larger than the test set the public score is computed on) will cause a scoring error.\nRead in the test set incrementally and read in the json line by line:
\n\n\nwith open(PATH_TEST, 'rt') as f:\n for cnt, line in enumerate(f):\n dic = json.loads(line)\n q = dic['question_text']\n
I am getting the same error as well. I was trying to submit a notebook by another author.
", "votes": null, "replies": [] }, { "id": 668807, "author_name": "juliaelliott", "author_url": "", "post_date": "11/08/2019 22:37:13", "content": "Sorry you're having trouble. We intentionally are unable to disclose specific errors, because of the vulnerability of using any error feedback to probe the leaderboard. Some hints for things you may want to check are (a) whether your kernel is generating an output submission that matches the sample_submission file, and (b) the IDs are labeled correctly (including negative numbers).
", "votes": null, "replies": [ { "id": 668894, "author_name": "wangyunazx", "author_url": "", "post_date": "11/09/2019 03:13:13", "content": "Can you check or share the evaluate script with us ？ I try the others ‘ notebook has been success submited，however get a score error anyway
", "votes": null, "replies": [] }, { "id": 668919, "author_name": "tank13", "author_url": "", "post_date": "11/09/2019 05:01:28", "content": "Just adding to the discussion -- I ran the starter notebook and also got a submission scoring error.
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "662688": "My notebook returned a submission scoring error, but without any further descriptions. In other words, I have no idea what went wrong. It wasn't the runtime because this was a simple baseline that only takes to run for 7 minutes on the public test set.\n\nCould the organizers provide more informative error codes? Has anybody else run into this problem?", "664223": "I'm facing the same problem. Currently I'm only submitting '' for _long answers and 'YES' for _short ones.", "664256": "I've solved my error:\n\n> `submission.to_csv('submission.csv', index=False)`\n\nIf you don't specify \"index=False\" your submission would have an extra column \"Unnamed:0\"", "664432": "Don't load the test set into a pandas dataframe! Running your script/notebook on the full test set (10x larger than the test set the public score is computed on) will cause a scoring error.\nRead in the test set incrementally and read in the json line by line:\n\n```\nwith open(PATH_TEST, 'rt') as f:\n for cnt, line in enumerate(f):\n dic = json.loads(line)\n q = dic['question_text']\n```", "668646": "I am getting the same error as well. I was trying to submit a notebook by another author.", "668807": "Sorry you're having trouble. We intentionally are unable to disclose specific errors, because of the vulnerability of using any error feedback to probe the leaderboard. Some hints for things you may want to check are (a) whether your kernel is generating an output submission that matches the sample_submission file, and (b) the IDs are labeled correctly (including negative numbers).", "668894": "Can you check or share the evaluate script with us ？ I try the others ‘ notebook has been success submited，however get a score error anyway", "668919": "Just adding to the discussion -- I ran the starter notebook and also got a submission scoring error." }, "source": "meta" }