{
  "id": 396468,
  "title": "if you can't wait for ...",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/396468",
  "author_name": "",
  "post_date": "2023-03-21T18:10:26.438393100Z",
  "votes": 6,
  "comment_count": 8,
  "views": 0,
  "content": "<p>if you are eager to try submission with new data and you don't want to wait until  sample data will be updated<br>\n(see discussion <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/396202#2191003\" target=\"_blank\">https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/396202#2191003</a>)</p>\n<p>you can modify your current submission in something like this:</p>\n<pre><code>#for sample_submission, test in iter_test:\nfor test, sample_submission in iter_test:\n...\n        try:\n            sample_submission.loc[mask,'correct'] = int(p.item()&gt;BEST_THRESHOLD)    \n        except Exception as e: \n            print(\"p.shape:\", p.shape)\n            print(e)            \n...\n</code></pre>",
  "messages": [
    {
      "id": "2191124",
      "postDate": "03/21/2023 18:10:26",
      "content": "<p>if you are eager to try submission with new data and you don't want to wait until  sample data will be updated<br>\n(see discussion <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/396202#2191003\" target=\"_blank\">https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/396202#2191003</a>)</p>\n<p>you can modify your current submission in something like this:</p>\n<pre><code>#for sample_submission, test in iter_test:\nfor test, sample_submission in iter_test:\n...\n        try:\n            sample_submission.loc[mask,'correct'] = int(p.item()&gt;BEST_THRESHOLD)    \n        except Exception as e: \n            print(\"p.shape:\", p.shape)\n            print(e)            \n...\n</code></pre>",
      "rawMarkdown": "if you are eager to try submission with new data and you don't want to wait until  sample data will be updated\n(see discussion https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/396202#2191003)\n\nyou can modify your current submission in something like this:\n```\n#for sample_submission, test in iter_test:\nfor test, sample_submission in iter_test:\n...\n\t\ttry:\n            sample_submission.loc[mask,'correct'] = int(p.item()>BEST_THRESHOLD)    \n        except Exception as e: \n            print(\"p.shape:\", p.shape)\n            print(e)            \n...\n```",
      "votes": null
    },
    {
      "id": "2191206",
      "postDate": "03/21/2023 19:44:56",
      "content": "<p>is the new test set smaller ? <br>\nI just submit a notebook that usually takes around 3h but this time only took around 1h </p>",
      "rawMarkdown": "is the new test set smaller ? \nI just submit a notebook that usually takes around 3h but this time only took around 1h",
      "votes": null
    },
    {
      "id": "2191215",
      "postDate": "03/21/2023 19:54:18",
      "content": "<blockquote>\n  <p>is the new test set smaller ? <br>\n  That's what it looks like to me too</p>\n</blockquote>",
      "rawMarkdown": "> is the new test set smaller ? \nThat's what it looks like to me too",
      "votes": null
    },
    {
      "id": "2191462",
      "postDate": "03/22/2023 02:10:41",
      "content": "<p></p>",
      "rawMarkdown": "~~is sample data fixed now? I just changed the order of (test, sample_submission), it didn't throw an exception.~~",
      "votes": null
    },
    {
      "id": "2191494",
      "postDate": "03/22/2023 02:51:39",
      "content": "<p>Hi, could you post a notebook that successfully runs in both notebook and submission? I'm having a hard time debugging, and my notebooks still are successful when run in kaggle but fail when submitted</p>",
      "rawMarkdown": "Hi, could you post a notebook that successfully runs in both notebook and submission? I'm having a hard time debugging, and my notebooks still are successful when run in kaggle but fail when submitted",
      "votes": null
    },
    {
      "id": "2192481",
      "postDate": "03/22/2023 17:18:57",
      "content": "<p>there could be several reasons for that. Maybe you have a Out of Memory error or there could be a bug in your code that's not detected during your local testing. For testing Out of Memory error, I would recommend trying this notebook: <a href=\"https://www.kaggle.com/code/zakopur0/psp-debug-inference\" target=\"_blank\">https://www.kaggle.com/code/zakopur0/psp-debug-inference</a>. </p>",
      "rawMarkdown": "there could be several reasons for that. Maybe you have a Out of Memory error or there could be a bug in your code that's not detected during your local testing. For testing Out of Memory error, I would recommend trying this notebook: https://www.kaggle.com/code/zakopur0/psp-debug-inference.",
      "votes": null
    },
    {
      "id": "2192569",
      "postDate": "03/22/2023 18:21:39",
      "content": "<p>Thanks for the response! If my notebook did have an out of memory error, would kaggle list it as a \"notebook threw exception\" or a \"notebook exceeded allowed compute\"? The documentation says that it would list it as a \"notebook exceeded allowed compute\", while my notebook fails with a \"notebook threw exception\". However, because it runs without error on my local machine, I'm hesitant to say that it has a bug… Nevertheless, I'll try out this method to see if it is an out of memory error</p>",
      "rawMarkdown": "Thanks for the response! If my notebook did have an out of memory error, would kaggle list it as a \"notebook threw exception\" or a \"notebook exceeded allowed compute\"? The documentation says that it would list it as a \"notebook exceeded allowed compute\", while my notebook fails with a \"notebook threw exception\". However, because it runs without error on my local machine, I'm hesitant to say that it has a bug... Nevertheless, I'll try out this method to see if it is an out of memory error",
      "votes": null
    },
    {
      "id": "2192596",
      "postDate": "03/22/2023 18:51:34",
      "content": "<p>You made me share my way too!</p>\n<p>It is a bit weird we have to do this.</p>",
      "rawMarkdown": "You made me share my way too!\n\nIt is a bit weird we have to do this.",
      "votes": null
    },
    {
      "id": "2192857",
      "postDate": "03/23/2023 00:34:21",
      "content": "<p>is sample data fixed now?</p>",
      "rawMarkdown": "is sample data fixed now?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2191206,
      "author_name": "ihebch",
      "author_url": "",
      "post_date": "03/21/2023 19:44:56",
      "content": "<p>is the new test set smaller ? <br>\nI just submit a notebook that usually takes around 3h but this time only took around 1h </p>",
      "votes": null,
      "replies": [
        {
          "id": 2191215,
          "author_name": "steubk",
          "author_url": "",
          "post_date": "03/21/2023 19:54:18",
          "content": "<blockquote>\n  <p>is the new test set smaller ? <br>\n  That's what it looks like to me too</p>\n</blockquote>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2191462,
      "author_name": "hookman",
      "author_url": "",
      "post_date": "03/22/2023 02:10:41",
      "content": "<p></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2191494,
      "author_name": "modelmusique",
      "author_url": "",
      "post_date": "03/22/2023 02:51:39",
      "content": "<p>Hi, could you post a notebook that successfully runs in both notebook and submission? I'm having a hard time debugging, and my notebooks still are successful when run in kaggle but fail when submitted</p>",
      "votes": null,
      "replies": [
        {
          "id": 2192481,
          "author_name": "mrhantato",
          "author_url": "",
          "post_date": "03/22/2023 17:18:57",
          "content": "<p>there could be several reasons for that. Maybe you have a Out of Memory error or there could be a bug in your code that's not detected during your local testing. For testing Out of Memory error, I would recommend trying this notebook: <a href=\"https://www.kaggle.com/code/zakopur0/psp-debug-inference\" target=\"_blank\">https://www.kaggle.com/code/zakopur0/psp-debug-inference</a>. </p>",
          "votes": null,
          "replies": [
            {
              "id": 2192569,
              "author_name": "modelmusique",
              "author_url": "",
              "post_date": "03/22/2023 18:21:39",
              "content": "<p>Thanks for the response! If my notebook did have an out of memory error, would kaggle list it as a \"notebook threw exception\" or a \"notebook exceeded allowed compute\"? The documentation says that it would list it as a \"notebook exceeded allowed compute\", while my notebook fails with a \"notebook threw exception\". However, because it runs without error on my local machine, I'm hesitant to say that it has a bug… Nevertheless, I'll try out this method to see if it is an out of memory error</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2192596,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "03/22/2023 18:51:34",
      "content": "<p>You made me share my way too!</p>\n<p>It is a bit weird we have to do this.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2192857,
      "author_name": "librauee",
      "author_url": "",
      "post_date": "03/23/2023 00:34:21",
      "content": "<p>is sample data fixed now?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2191124": "if you are eager to try submission with new data and you don't want to wait until  sample data will be updated\n(see discussion https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/396202#2191003)\n\nyou can modify your current submission in something like this:\n```\n#for sample_submission, test in iter_test:\nfor test, sample_submission in iter_test:\n...\n\t\ttry:\n            sample_submission.loc[mask,'correct'] = int(p.item()>BEST_THRESHOLD)    \n        except Exception as e: \n            print(\"p.shape:\", p.shape)\n            print(e)            \n...\n```",
    "2191206": "is the new test set smaller ? \nI just submit a notebook that usually takes around 3h but this time only took around 1h",
    "2191215": "> is the new test set smaller ? \nThat's what it looks like to me too",
    "2191462": "~~is sample data fixed now? I just changed the order of (test, sample_submission), it didn't throw an exception.~~",
    "2191494": "Hi, could you post a notebook that successfully runs in both notebook and submission? I'm having a hard time debugging, and my notebooks still are successful when run in kaggle but fail when submitted",
    "2192481": "there could be several reasons for that. Maybe you have a Out of Memory error or there could be a bug in your code that's not detected during your local testing. For testing Out of Memory error, I would recommend trying this notebook: https://www.kaggle.com/code/zakopur0/psp-debug-inference.",
    "2192569": "Thanks for the response! If my notebook did have an out of memory error, would kaggle list it as a \"notebook threw exception\" or a \"notebook exceeded allowed compute\"? The documentation says that it would list it as a \"notebook exceeded allowed compute\", while my notebook fails with a \"notebook threw exception\". However, because it runs without error on my local machine, I'm hesitant to say that it has a bug... Nevertheless, I'll try out this method to see if it is an out of memory error",
    "2192596": "You made me share my way too!\n\nIt is a bit weird we have to do this.",
    "2192857": "is sample data fixed now?"
  },
  "source": "meta"
}