{
  "id": 196517,
  "title": "Help!! Submission not working",
  "url": "/competitions/riiid-test-answer-prediction/discussion/196517",
  "author_name": "",
  "post_date": "2020-11-11T14:15:18.080199100Z",
  "votes": 1,
  "comment_count": 9,
  "views": 0,
  "content": "<p>Hi! Everyone. I'm confused. My previous successfully submitted notebooks are now getting Scoring Error. So I submitted the following simple script, as it can be seen, I'm not doing any heavy computation, it is just returning a constant value.<br>\nIt runs for around 9 hours and after shows <strong>Notebook Timeout</strong>. Am I the only one to face this?</p>\n<pre><code>import riiideducation\nenv = riiideducation.make_env()\niter_test = env.iter_test()\nfor (test_df, sample_prediction_df) in iter_test:\n    test_df = test_df[test_df['content_type_id'] == 0]\n    test_df['answered_correctly'] = 0.5\n    env.predict(test_df[['row_id', 'answered_correctly']])\n</code></pre>\n<p><a href=\"https://www.kaggle.com/tchaye59/riiid-just-submit\" target=\"_blank\">https://www.kaggle.com/tchaye59/riiid-just-submit</a></p>",
  "messages": [
    {
      "id": "1075244",
      "postDate": "11/11/2020 14:15:18",
      "content": "<p>Hi! Everyone. I'm confused. My previous successfully submitted notebooks are now getting Scoring Error. So I submitted the following simple script, as it can be seen, I'm not doing any heavy computation, it is just returning a constant value.<br>\nIt runs for around 9 hours and after shows <strong>Notebook Timeout</strong>. Am I the only one to face this?</p>\n<pre><code>import riiideducation\nenv = riiideducation.make_env()\niter_test = env.iter_test()\nfor (test_df, sample_prediction_df) in iter_test:\n    test_df = test_df[test_df['content_type_id'] == 0]\n    test_df['answered_correctly'] = 0.5\n    env.predict(test_df[['row_id', 'answered_correctly']])\n</code></pre>\n<p><a href=\"https://www.kaggle.com/tchaye59/riiid-just-submit\" target=\"_blank\">https://www.kaggle.com/tchaye59/riiid-just-submit</a></p>",
      "rawMarkdown": "Hi! Everyone. I'm confused. My previous successfully submitted notebooks are now getting Scoring Error. So I submitted the following simple script, as it can be seen, I'm not doing any heavy computation, it is just returning a constant value.\nIt runs for around 9 hours and after shows **Notebook Timeout**. Am I the only one to face this?\n\n\n```\nimport riiideducation\nenv = riiideducation.make_env()\niter_test = env.iter_test()\nfor (test_df, sample_prediction_df) in iter_test:\n    test_df = test_df[test_df['content_type_id'] == 0]\n    test_df['answered_correctly'] = 0.5\n    env.predict(test_df[['row_id', 'answered_correctly']])\n\n```\n\nhttps://www.kaggle.com/tchaye59/riiid-just-submit",
      "votes": null
    },
    {
      "id": "1075458",
      "postDate": "11/11/2020 18:29:17",
      "content": "<p>Do you still face the same issue? When I open your notebook it seems there is a public score attached to it now of 0.500.<br>\nMy submissions are running &gt;4 hrs now and not finished yet. Whereas before the duration was 1hr in total.</p>\n<p>EDIT: One of the submissions did complete. Probably a bug in the other</p>",
      "rawMarkdown": "Do you still face the same issue? When I open your notebook it seems there is a public score attached to it now of 0.500.\nMy submissions are running >4 hrs now and not finished yet. Whereas before the duration was 1hr in total.\n\nEDIT: One of the submissions did complete. Probably a bug in the other",
      "votes": null
    },
    {
      "id": "1075631",
      "postDate": "11/11/2020 20:42:58",
      "content": "<p>Is that possible the server has some issue?</p>",
      "rawMarkdown": "Is that possible the server has some issue?",
      "votes": null
    },
    {
      "id": "1075760",
      "postDate": "11/12/2020 00:01:30",
      "content": "<p>The previous one wasn't ok. Maybe the issue is solved now</p>",
      "rawMarkdown": "The previous one wasn't ok. Maybe the issue is solved now",
      "votes": null
    },
    {
      "id": "1075767",
      "postDate": "11/12/2020 00:12:50",
      "content": "<p>I found an issue in my code. During preprocessing the row_id colum is set to 0. This is probably what I'm doing wrong</p>",
      "rawMarkdown": "I found an issue in my code. During preprocessing the row_id colum is set to 0. This is probably what I'm doing wrong",
      "votes": null
    },
    {
      "id": "1083511",
      "postDate": "11/19/2020 04:09:24",
      "content": "<p>I have also met this problem.<br>\nIs that possible the server has some issue?<br>\n<a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> </p>",
      "rawMarkdown": "I have also met this problem.\nIs that possible the server has some issue?\n@sohier",
      "votes": null
    },
    {
      "id": "1083550",
      "postDate": "11/19/2020 05:28:07",
      "content": "<p>It was my mistake. Make sure lecture rows are removed and the row_id column is consistent and everything will be fine.</p>",
      "rawMarkdown": "It was my mistake. Make sure lecture rows are removed and the row_id column is consistent and everything will be fine.",
      "votes": null
    },
    {
      "id": "1083563",
      "postDate": "11/19/2020 05:43:17",
      "content": "<p>Yes, I have removed lecture rows and the row_id column is consistent.<br>\nThe following is my eval code and submission result.<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F42de2e3e8ed4c76ae26e0e6245d63d3a%2F4.png?generation=1605764572689998&amp;alt=media\" alt=\"\"><br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F78a03e596bb12876df16c0cac3af58e2%2F3.png?generation=1605764594792312&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Yes, I have removed lecture rows and the row_id column is consistent.\nThe following is my eval code and submission result.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F42de2e3e8ed4c76ae26e0e6245d63d3a%2F4.png?generation=1605764572689998&alt=media)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F78a03e596bb12876df16c0cac3af58e2%2F3.png?generation=1605764594792312&alt=media)",
      "votes": null
    },
    {
      "id": "1083581",
      "postDate": "11/19/2020 06:09:34",
      "content": "<p>What about <strong>prior_group_answers_correct</strong> and <strong>prior_group_responses</strong>. If you use them to update the dataset, you should remove lecture entries</p>",
      "rawMarkdown": "What about **prior_group_answers_correct** and **prior_group_responses**. If you use them to update the dataset, you should remove lecture entries",
      "votes": null
    },
    {
      "id": "1083588",
      "postDate": "11/19/2020 06:15:03",
      "content": "<p>I don't use <strong>prior_group_answers_correct</strong> and <strong>prior_group_responses</strong> columns.<br>\nI just only use content_id to do a simple prediction.</p>\n<p>Thanks for your reply!</p>",
      "rawMarkdown": "I don't use **prior_group_answers_correct** and **prior_group_responses** columns.\nI just only use content_id to do a simple prediction.\n\nThanks for your reply!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1075458,
      "author_name": "rafiko1",
      "author_url": "",
      "post_date": "11/11/2020 18:29:17",
      "content": "<p>Do you still face the same issue? When I open your notebook it seems there is a public score attached to it now of 0.500.<br>\nMy submissions are running &gt;4 hrs now and not finished yet. Whereas before the duration was 1hr in total.</p>\n<p>EDIT: One of the submissions did complete. Probably a bug in the other</p>",
      "votes": null,
      "replies": [
        {
          "id": 1075760,
          "author_name": "tchaye59",
          "author_url": "",
          "post_date": "11/12/2020 00:01:30",
          "content": "<p>The previous one wasn't ok. Maybe the issue is solved now</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1075631,
      "author_name": "chenmingml",
      "author_url": "",
      "post_date": "11/11/2020 20:42:58",
      "content": "<p>Is that possible the server has some issue?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1075767,
      "author_name": "tchaye59",
      "author_url": "",
      "post_date": "11/12/2020 00:12:50",
      "content": "<p>I found an issue in my code. During preprocessing the row_id colum is set to 0. This is probably what I'm doing wrong</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1083511,
      "author_name": "suhehs",
      "author_url": "",
      "post_date": "11/19/2020 04:09:24",
      "content": "<p>I have also met this problem.<br>\nIs that possible the server has some issue?<br>\n<a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> </p>",
      "votes": null,
      "replies": [
        {
          "id": 1083550,
          "author_name": "tchaye59",
          "author_url": "",
          "post_date": "11/19/2020 05:28:07",
          "content": "<p>It was my mistake. Make sure lecture rows are removed and the row_id column is consistent and everything will be fine.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1083563,
          "author_name": "suhehs",
          "author_url": "",
          "post_date": "11/19/2020 05:43:17",
          "content": "<p>Yes, I have removed lecture rows and the row_id column is consistent.<br>\nThe following is my eval code and submission result.<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F42de2e3e8ed4c76ae26e0e6245d63d3a%2F4.png?generation=1605764572689998&amp;alt=media\" alt=\"\"><br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F78a03e596bb12876df16c0cac3af58e2%2F3.png?generation=1605764594792312&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1083581,
          "author_name": "tchaye59",
          "author_url": "",
          "post_date": "11/19/2020 06:09:34",
          "content": "<p>What about <strong>prior_group_answers_correct</strong> and <strong>prior_group_responses</strong>. If you use them to update the dataset, you should remove lecture entries</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1083588,
          "author_name": "suhehs",
          "author_url": "",
          "post_date": "11/19/2020 06:15:03",
          "content": "<p>I don't use <strong>prior_group_answers_correct</strong> and <strong>prior_group_responses</strong> columns.<br>\nI just only use content_id to do a simple prediction.</p>\n<p>Thanks for your reply!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1075244": "Hi! Everyone. I'm confused. My previous successfully submitted notebooks are now getting Scoring Error. So I submitted the following simple script, as it can be seen, I'm not doing any heavy computation, it is just returning a constant value.\nIt runs for around 9 hours and after shows **Notebook Timeout**. Am I the only one to face this?\n\n\n```\nimport riiideducation\nenv = riiideducation.make_env()\niter_test = env.iter_test()\nfor (test_df, sample_prediction_df) in iter_test:\n    test_df = test_df[test_df['content_type_id'] == 0]\n    test_df['answered_correctly'] = 0.5\n    env.predict(test_df[['row_id', 'answered_correctly']])\n\n```\n\nhttps://www.kaggle.com/tchaye59/riiid-just-submit",
    "1075458": "Do you still face the same issue? When I open your notebook it seems there is a public score attached to it now of 0.500.\nMy submissions are running >4 hrs now and not finished yet. Whereas before the duration was 1hr in total.\n\nEDIT: One of the submissions did complete. Probably a bug in the other",
    "1075631": "Is that possible the server has some issue?",
    "1075760": "The previous one wasn't ok. Maybe the issue is solved now",
    "1075767": "I found an issue in my code. During preprocessing the row_id colum is set to 0. This is probably what I'm doing wrong",
    "1083511": "I have also met this problem.\nIs that possible the server has some issue?\n@sohier",
    "1083550": "It was my mistake. Make sure lecture rows are removed and the row_id column is consistent and everything will be fine.",
    "1083563": "Yes, I have removed lecture rows and the row_id column is consistent.\nThe following is my eval code and submission result.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F42de2e3e8ed4c76ae26e0e6245d63d3a%2F4.png?generation=1605764572689998&alt=media)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F979626%2F78a03e596bb12876df16c0cac3af58e2%2F3.png?generation=1605764594792312&alt=media)",
    "1083581": "What about **prior_group_answers_correct** and **prior_group_responses**. If you use them to update the dataset, you should remove lecture entries",
    "1083588": "I don't use **prior_group_answers_correct** and **prior_group_responses** columns.\nI just only use content_id to do a simple prediction.\n\nThanks for your reply!"
  },
  "source": "meta"
}