{
  "id": 388476,
  "title": "Question: How to cache history data/features/results of same session?",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/388476",
  "author_name": "Carno Zhao",
  "post_date": "2023-02-17T16:19:00.128000",
  "votes": 4,
  "comment_count": 3,
  "views": 0,
  "content": "<p>As mentioned in these threads:<br>\n<a href=\"url\" target=\"_blank\">https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388365</a><br>\n<a href=\"url\" target=\"_blank\">https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388244</a></p>\n<p>If you try to save what you met in previous steps, the submission will stop in less than 1min and throw \"Submission Score Error\". I think this means that the notebook crashes because of a non-python error (cannot be caught as normal notebook errors) and only makes a partial submission.csv, which will cause the scoring system throw \"Submission Score Error\". </p>\n<p>But in data description of this competition, it says \"At each checkpoint, you will have access to all previous test data for that section.\". I think this situation is not what the hosts want.</p>\n<p>What I have tried:</p>\n<ul>\n<li><p>use a simple dict to save features of previous level_groups (write/read memory during loop)</p></li>\n<li><p>write the features into disk and load it back later (write/read disk during loop)</p></li>\n</ul>\n<p>but neither works.</p>",
  "messages": [
    {
      "id": 2148705,
      "postDate": "2023-02-17T16:19:00.130Z",
      "content": "<p>As mentioned in these threads:<br>\n<a href=\"url\" target=\"_blank\">https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388365</a><br>\n<a href=\"url\" target=\"_blank\">https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388244</a></p>\n<p>If you try to save what you met in previous steps, the submission will stop in less than 1min and throw \"Submission Score Error\". I think this means that the notebook crashes because of a non-python error (cannot be caught as normal notebook errors) and only makes a partial submission.csv, which will cause the scoring system throw \"Submission Score Error\". </p>\n<p>But in data description of this competition, it says \"At each checkpoint, you will have access to all previous test data for that section.\". I think this situation is not what the hosts want.</p>\n<p>What I have tried:</p>\n<ul>\n<li><p>use a simple dict to save features of previous level_groups (write/read memory during loop)</p></li>\n<li><p>write the features into disk and load it back later (write/read disk during loop)</p></li>\n</ul>\n<p>but neither works.</p>",
      "rawMarkdown": "As mentioned in these threads:\n[https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388365](url)\n[https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388244](url)\n\nIf you try to save what you met in previous steps, the submission will stop in less than 1min and throw \"Submission Score Error\". I think this means that the notebook crashes because of a non-python error (cannot be caught as normal notebook errors) and only makes a partial submission.csv, which will cause the scoring system throw \"Submission Score Error\". \n\nBut in data description of this competition, it says \"At each checkpoint, you will have access to all previous test data for that section.\". I think this situation is not what the hosts want.\n\nWhat I have tried:\n\n- use a simple dict to save features of previous level_groups (write/read memory during loop)\n\n- write the features into disk and load it back later (write/read disk during loop)\n\nbut neither works.",
      "votes": 4
    },
    {
      "id": 2149664,
      "postDate": "2023-02-18T14:50:48.557Z",
      "content": "<p>Hello Carno Zhao! I don't know If I understood your question correctly, but there is a data leak on test set,which the organizers will solve in the next few days. See <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388479\" target=\"_blank\">Is Test Data Leak Intentional or Accidental?</a>) for more information.</p>",
      "rawMarkdown": "Hello Carno Zhao! I don't know If I understood your question correctly, but there is a data leak on test set,which the organizers will solve in the next few days. See [Is Test Data Leak Intentional or Accidental?](https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388479)) for more information.",
      "votes": 1,
      "replies": [
        {
          "id": 2149736,
          "postDate": "2023-02-18T16:14:11.297Z",
          "content": "<p>Yes I have also noticed this issue and made a successful submission after fixing.<br>\nAnyway, thank you Carlos.</p>",
          "rawMarkdown": "Yes I have also noticed this issue and made a successful submission after fixing.\nAnyway, thank you Carlos.",
          "votes": 1,
          "replies": [
            {
              "id": 2188678,
              "postDate": "2023-03-19T21:47:48.360Z",
              "rawMarkdown": "",
              "isDeleted": true
            }
          ]
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2149664,
      "author_name": "Carlos A. S. de Souza",
      "author_url": "",
      "post_date": "2023-02-18T14:50:48.557000",
      "content": "<p>Hello Carno Zhao! I don't know If I understood your question correctly, but there is a data leak on test set,which the organizers will solve in the next few days. See <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388479\" target=\"_blank\">Is Test Data Leak Intentional or Accidental?</a>) for more information.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 2149736,
          "author_name": "Carno Zhao",
          "author_url": "",
          "post_date": "2023-02-18T16:14:11.297000",
          "content": "<p>Yes I have also noticed this issue and made a successful submission after fixing.<br>\nAnyway, thank you Carlos.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 2188678,
              "author_name": "",
              "author_url": "",
              "post_date": "2023-03-19T21:47:48.360000",
              "content": "",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2148705": "As mentioned in these threads:\n[https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388365](url)\n[https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388244](url)\n\nIf you try to save what you met in previous steps, the submission will stop in less than 1min and throw \"Submission Score Error\". I think this means that the notebook crashes because of a non-python error (cannot be caught as normal notebook errors) and only makes a partial submission.csv, which will cause the scoring system throw \"Submission Score Error\". \n\nBut in data description of this competition, it says \"At each checkpoint, you will have access to all previous test data for that section.\". I think this situation is not what the hosts want.\n\nWhat I have tried:\n\n- use a simple dict to save features of previous level_groups (write/read memory during loop)\n\n- write the features into disk and load it back later (write/read disk during loop)\n\nbut neither works.",
    "2149664": "Hello Carno Zhao! I don't know If I understood your question correctly, but there is a data leak on test set,which the organizers will solve in the next few days. See [Is Test Data Leak Intentional or Accidental?](https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/388479)) for more information."
  }
}