{ "id": 207062, "title": "Sub scoring error after 9 hrs", "url": "/competitions/riiid-test-answer-prediction/discussion/207062", "author_name": "", "post_date": "2020-12-28T02:17:07.594537700Z", "votes": 2, "comment_count": 5, "views": 0, "content": "

Can any one please help out for cause .
\nSame kernel ran fine first time ,it's with the cpu ,same model transformer architecture ensembled with lgb .
\nJust change of ensemble weights.
\nIs it a time out error or some thing else .

", "messages": [ { "id": "1129024", "postDate": "12/28/2020 02:17:07", "content": "

Can any one please help out for cause .
\nSame kernel ran fine first time ,it's with the cpu ,same model transformer architecture ensembled with lgb .
\nJust change of ensemble weights.
\nIs it a time out error or some thing else .

", "rawMarkdown": "Can any one please help out for cause .\nSame kernel ran fine first time ,it's with the cpu ,same model transformer architecture ensembled with lgb .\nJust change of ensemble weights. \nIs it a time out error or some thing else .", "votes": null }, { "id": "1129141", "postDate": "12/28/2020 05:42:23", "content": "

I am facing the same problem, since it is not timing out, its probably a memory error.

", "rawMarkdown": "I am facing the same problem, since it is not timing out, its probably a memory error.", "votes": null }, { "id": "1129142", "postDate": "12/28/2020 05:43:46", "content": "

I have seen in some post people reporting it..earlier.
\nI think in this notebook timeout is not happening only sub scoring error.

", "rawMarkdown": "I have seen in some post people reporting it..earlier. \nI think in this notebook timeout is not happening only sub scoring error.", "votes": null }, { "id": "1129144", "postDate": "12/28/2020 05:45:51", "content": "

For my case, with the same set weights and parameters, one time my notebooks fails to be graded, and the other time it succeeds. If you found a solution please report back.

", "rawMarkdown": "For my case, with the same set weights and parameters, one time my notebooks fails to be graded, and the other time it succeeds. If you found a solution please report back.", "votes": null }, { "id": "1129198", "postDate": "12/28/2020 06:28:30", "content": "

After some thinking, here is my second guess: There is not only one test set, there are two or more, one of them has a batch size big enough to cause an OOM.
\nThis is very possible and can explain very well some unexpected errors yielded by the notebooks.

", "rawMarkdown": "After some thinking, here is my second guess: There is not only one test set, there are two or more, one of them has a batch size big enough to cause an OOM. \nThis is very possible and can explain very well some unexpected errors yielded by the notebooks.", "votes": null }, { "id": "1129269", "postDate": "12/28/2020 07:46:26", "content": "

Why it dint happen 1st time.. not sure if host have increased test data size

", "rawMarkdown": "Why it dint happen 1st time.. not sure if host have increased test data size", "votes": null } ], "comments": [ { "id": 1129141, "author_name": "abdessalemboukil", "author_url": "", "post_date": "12/28/2020 05:42:23", "content": "

I am facing the same problem, since it is not timing out, its probably a memory error.

", "votes": null, "replies": [ { "id": 1129142, "author_name": "jaideepvalani", "author_url": "", "post_date": "12/28/2020 05:43:46", "content": "

I have seen in some post people reporting it..earlier.
\nI think in this notebook timeout is not happening only sub scoring error.

", "votes": null, "replies": [] }, { "id": 1129144, "author_name": "abdessalemboukil", "author_url": "", "post_date": "12/28/2020 05:45:51", "content": "

For my case, with the same set weights and parameters, one time my notebooks fails to be graded, and the other time it succeeds. If you found a solution please report back.

", "votes": null, "replies": [] }, { "id": 1129198, "author_name": "abdessalemboukil", "author_url": "", "post_date": "12/28/2020 06:28:30", "content": "

After some thinking, here is my second guess: There is not only one test set, there are two or more, one of them has a batch size big enough to cause an OOM.
\nThis is very possible and can explain very well some unexpected errors yielded by the notebooks.

", "votes": null, "replies": [] }, { "id": 1129269, "author_name": "jaideepvalani", "author_url": "", "post_date": "12/28/2020 07:46:26", "content": "

Why it dint happen 1st time.. not sure if host have increased test data size

", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "1129024": "Can any one please help out for cause .\nSame kernel ran fine first time ,it's with the cpu ,same model transformer architecture ensembled with lgb .\nJust change of ensemble weights. \nIs it a time out error or some thing else .", "1129141": "I am facing the same problem, since it is not timing out, its probably a memory error.", "1129142": "I have seen in some post people reporting it..earlier. \nI think in this notebook timeout is not happening only sub scoring error.", "1129144": "For my case, with the same set weights and parameters, one time my notebooks fails to be graded, and the other time it succeeds. If you found a solution please report back.", "1129198": "After some thinking, here is my second guess: There is not only one test set, there are two or more, one of them has a batch size big enough to cause an OOM. \nThis is very possible and can explain very well some unexpected errors yielded by the notebooks.", "1129269": "Why it dint happen 1st time.. not sure if host have increased test data size" }, "source": "meta" }