{
  "id": 188986,
  "title": "Submission bug on new Kaggle environment",
  "url": "/competitions/riiid-test-answer-prediction/discussion/188986",
  "author_name": "",
  "post_date": "2020-10-06T06:39:38.875307200Z",
  "votes": 6,
  "comment_count": 12,
  "views": 0,
  "content": "<p>Hello everyone,</p>\n<p>I made the following notebook: <a href=\"https://www.kaggle.com/thomasseleck/beating-the-benchmark-with-lightgbm/output\" target=\"_blank\">here</a>, and the code executed sucessfully. Then, I tried to make a submission from it and it doesn't work. It just shows \"failed\" at the top of the notebook, without any error message:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F241358%2Fe3e57de89d5a5ad21ddcb73150940bc6%2Fkaggle_error.png?generation=1601966303395984&amp;alt=media\" alt=\"\"></p>\n<p>How can I debug my code if it work sucessfully to pass the commit phase, but fails during the submission, without any indication ?</p>\n<p>Thanks for your answer.</p>",
  "messages": [
    {
      "id": "1038900",
      "postDate": "10/06/2020 06:39:38",
      "content": "<p>Hello everyone,</p>\n<p>I made the following notebook: <a href=\"https://www.kaggle.com/thomasseleck/beating-the-benchmark-with-lightgbm/output\" target=\"_blank\">here</a>, and the code executed sucessfully. Then, I tried to make a submission from it and it doesn't work. It just shows \"failed\" at the top of the notebook, without any error message:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F241358%2Fe3e57de89d5a5ad21ddcb73150940bc6%2Fkaggle_error.png?generation=1601966303395984&amp;alt=media\" alt=\"\"></p>\n<p>How can I debug my code if it work sucessfully to pass the commit phase, but fails during the submission, without any indication ?</p>\n<p>Thanks for your answer.</p>",
      "rawMarkdown": "Hello everyone,\n\nI made the following notebook: [here](https://www.kaggle.com/thomasseleck/beating-the-benchmark-with-lightgbm/output), and the code executed sucessfully. Then, I tried to make a submission from it and it doesn't work. It just shows \"failed\" at the top of the notebook, without any error message:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F241358%2Fe3e57de89d5a5ad21ddcb73150940bc6%2Fkaggle_error.png?generation=1601966303395984&alt=media)\n\nHow can I debug my code if it work sucessfully to pass the commit phase, but fails during the submission, without any indication ?\n\nThanks for your answer.",
      "votes": null
    },
    {
      "id": "1039413",
      "postDate": "10/06/2020 15:02:58",
      "content": "<p>I also have the same problem and no idea what could go wrong.</p>",
      "rawMarkdown": "I also have the same problem and no idea what could go wrong.",
      "votes": null
    },
    {
      "id": "1039442",
      "postDate": "10/06/2020 15:21:41",
      "content": "<p>Me too.<br>\nI noticed you use questions dataframe same as mine, so there is dataframe merge problem?</p>",
      "rawMarkdown": "Me too.\nI noticed you use questions dataframe same as mine, so there is dataframe merge problem?",
      "votes": null
    },
    {
      "id": "1039444",
      "postDate": "10/06/2020 15:22:55",
      "content": "<p>I think this could be a problem, yes. But considering I'm doing a left join - not sure what could go wrong.</p>",
      "rawMarkdown": "I think this could be a problem, yes. But considering I'm doing a left join - not sure what could go wrong.",
      "votes": null
    },
    {
      "id": "1039475",
      "postDate": "10/06/2020 15:55:43",
      "content": "<p>Yes, I removed merge and was able to submit (in another notebook). For some reason the score is 0.5, but this is a different problem</p>",
      "rawMarkdown": "Yes, I removed merge and was able to submit (in another notebook). For some reason the score is 0.5, but this is a different problem",
      "votes": null
    },
    {
      "id": "1039484",
      "postDate": "10/06/2020 16:04:58",
      "content": "<p>Thanks for checking!<br>\nIt means some of the test data don't have 'content_id' column…?</p>",
      "rawMarkdown": "Thanks for checking!\nIt means some of the test data don't have 'content_id' column...?",
      "votes": null
    },
    {
      "id": "1039518",
      "postDate": "10/06/2020 16:21:02",
      "content": "<p>It could be possible. I can't think about a different reason.</p>",
      "rawMarkdown": "It could be possible. I can't think about a different reason.",
      "votes": null
    },
    {
      "id": "1039680",
      "postDate": "10/06/2020 18:00:58",
      "content": "<p>Oh…, I'm struggling with the same problem for several hours. Thank you for your discussions.</p>",
      "rawMarkdown": "Oh..., I'm struggling with the same problem for several hours. Thank you for your discussions.",
      "votes": null
    },
    {
      "id": "1039849",
      "postDate": "10/06/2020 20:37:12",
      "content": "<p>The test data has all of the columns. Your notebook doesn't handle certain nulls that the joint questions/lectures merge introduces.</p>",
      "rawMarkdown": "The test data has all of the columns. Your notebook doesn't handle certain nulls that the joint questions/lectures merge introduces.",
      "votes": null
    },
    {
      "id": "1039916",
      "postDate": "10/06/2020 21:53:58",
      "content": "<p>Thank you for the clarification. I'll check my implementation…</p>",
      "rawMarkdown": "Thank you for the clarification. I'll check my implementation...",
      "votes": null
    },
    {
      "id": "1039935",
      "postDate": "10/06/2020 22:47:11",
      "content": "<p>I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.</p>",
      "rawMarkdown": "I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.",
      "votes": null
    },
    {
      "id": "1043114",
      "postDate": "10/08/2020 17:43:57",
      "content": "<p>So, did anyone manage to successfully merge test data with questions at sumbit? I tried filtering out lectures before merging, but it didn't help. Tried filling the columns from questions.csv with only possible values, also didn't help.</p>",
      "rawMarkdown": "So, did anyone manage to successfully merge test data with questions at sumbit? I tried filtering out lectures before merging, but it didn't help. Tried filling the columns from questions.csv with only possible values, also didn't help.",
      "votes": null
    },
    {
      "id": "1045075",
      "postDate": "10/10/2020 10:34:09",
      "content": "<blockquote>\n  <p>I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.</p>\n</blockquote>\n<p>I wasn't accounting for lectures in the test set, merging by taking the <code>content_type_id</code> into account fixed the submission error for me.</p>",
      "rawMarkdown": "> I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.\n\nI wasn't accounting for lectures in the test set, merging by taking the `content_type_id` into account fixed the submission error for me.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1039413,
      "author_name": "artgor",
      "author_url": "",
      "post_date": "10/06/2020 15:02:58",
      "content": "<p>I also have the same problem and no idea what could go wrong.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1039442,
          "author_name": "yasufuminakama",
          "author_url": "",
          "post_date": "10/06/2020 15:21:41",
          "content": "<p>Me too.<br>\nI noticed you use questions dataframe same as mine, so there is dataframe merge problem?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039444,
          "author_name": "artgor",
          "author_url": "",
          "post_date": "10/06/2020 15:22:55",
          "content": "<p>I think this could be a problem, yes. But considering I'm doing a left join - not sure what could go wrong.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039475,
          "author_name": "artgor",
          "author_url": "",
          "post_date": "10/06/2020 15:55:43",
          "content": "<p>Yes, I removed merge and was able to submit (in another notebook). For some reason the score is 0.5, but this is a different problem</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039484,
          "author_name": "yasufuminakama",
          "author_url": "",
          "post_date": "10/06/2020 16:04:58",
          "content": "<p>Thanks for checking!<br>\nIt means some of the test data don't have 'content_id' column…?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039518,
          "author_name": "artgor",
          "author_url": "",
          "post_date": "10/06/2020 16:21:02",
          "content": "<p>It could be possible. I can't think about a different reason.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039680,
          "author_name": "sishihara",
          "author_url": "",
          "post_date": "10/06/2020 18:00:58",
          "content": "<p>Oh…, I'm struggling with the same problem for several hours. Thank you for your discussions.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039849,
          "author_name": "sohier",
          "author_url": "",
          "post_date": "10/06/2020 20:37:12",
          "content": "<p>The test data has all of the columns. Your notebook doesn't handle certain nulls that the joint questions/lectures merge introduces.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039916,
          "author_name": "sishihara",
          "author_url": "",
          "post_date": "10/06/2020 21:53:58",
          "content": "<p>Thank you for the clarification. I'll check my implementation…</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1039935,
          "author_name": "sohier",
          "author_url": "",
          "post_date": "10/06/2020 22:47:11",
          "content": "<p>I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1043114,
          "author_name": "artgor",
          "author_url": "",
          "post_date": "10/08/2020 17:43:57",
          "content": "<p>So, did anyone manage to successfully merge test data with questions at sumbit? I tried filtering out lectures before merging, but it didn't help. Tried filling the columns from questions.csv with only possible values, also didn't help.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1045075,
          "author_name": "gautham11",
          "author_url": "",
          "post_date": "10/10/2020 10:34:09",
          "content": "<blockquote>\n  <p>I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.</p>\n</blockquote>\n<p>I wasn't accounting for lectures in the test set, merging by taking the <code>content_type_id</code> into account fixed the submission error for me.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1038900": "Hello everyone,\n\nI made the following notebook: [here](https://www.kaggle.com/thomasseleck/beating-the-benchmark-with-lightgbm/output), and the code executed sucessfully. Then, I tried to make a submission from it and it doesn't work. It just shows \"failed\" at the top of the notebook, without any error message:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F241358%2Fe3e57de89d5a5ad21ddcb73150940bc6%2Fkaggle_error.png?generation=1601966303395984&alt=media)\n\nHow can I debug my code if it work sucessfully to pass the commit phase, but fails during the submission, without any indication ?\n\nThanks for your answer.",
    "1039413": "I also have the same problem and no idea what could go wrong.",
    "1039442": "Me too.\nI noticed you use questions dataframe same as mine, so there is dataframe merge problem?",
    "1039444": "I think this could be a problem, yes. But considering I'm doing a left join - not sure what could go wrong.",
    "1039475": "Yes, I removed merge and was able to submit (in another notebook). For some reason the score is 0.5, but this is a different problem",
    "1039484": "Thanks for checking!\nIt means some of the test data don't have 'content_id' column...?",
    "1039518": "It could be possible. I can't think about a different reason.",
    "1039680": "Oh..., I'm struggling with the same problem for several hours. Thank you for your discussions.",
    "1039849": "The test data has all of the columns. Your notebook doesn't handle certain nulls that the joint questions/lectures merge introduces.",
    "1039916": "Thank you for the clarification. I'll check my implementation...",
    "1039935": "I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.",
    "1043114": "So, did anyone manage to successfully merge test data with questions at sumbit? I tried filtering out lectures before merging, but it didn't help. Tried filling the columns from questions.csv with only possible values, also didn't help.",
    "1045075": "> I'd try working with a larger local debugging case; example_test.csv is a very small file that doesn't happen to include any lectures.\n\nI wasn't accounting for lectures in the test set, merging by taking the `content_type_id` into account fixed the submission error for me."
  },
  "source": "meta"
}