{
  "id": 399824,
  "title": "Not allowed to use all the info?",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/399824",
  "author_name": "Arnout Van Avermaet",
  "post_date": "2023-04-05T17:45:15",
  "votes": 1,
  "comment_count": 7,
  "views": 0,
  "content": "<p>It says we are only allowed to use previous level data to evaluate a set of questions.</p>\n<p>Does that mean that for the first three questions (L0-L4) we are not allowed to use the full train set for example?</p>",
  "messages": [
    {
      "id": 2211186,
      "postDate": "2023-04-05T21:28:29.993Z",
      "content": "<p>When your code makes its final predictions, it is served the data for all test sessions for L0-L4, then your code needs to submit predictions for the associated questions before it is allowed to see the next data (L5-L12).  If you want to use data from L0-L4 to make predictions for questions associated with L5-L12, then you will need to save that data.</p>\n<p>You can use the full train set for data explorations, etc, however, since the test interface will not let you see into the future (now), any features derived from future data in the train set will not be calculated the same way in the test set.</p>",
      "rawMarkdown": "When your code makes its final predictions, it is served the data for all test sessions for L0-L4, then your code needs to submit predictions for the associated questions before it is allowed to see the next data (L5-L12).  If you want to use data from L0-L4 to make predictions for questions associated with L5-L12, then you will need to save that data.\n\nYou can use the full train set for data explorations, etc, however, since the test interface will not let you see into the future (now), any features derived from future data in the train set will not be calculated the same way in the test set.",
      "votes": 3,
      "replies": [
        {
          "id": 2212016,
          "postDate": "2023-04-06T12:55:28.223Z",
          "content": "<p>Thanks Daniel! But as I understand, we are allowed to use the results of L0-L4 questions for example to determine L5-L12 predictions?</p>\n<p>And how about can we use the result of question 1, to influence our prediction on question 2? </p>",
          "rawMarkdown": "Thanks Daniel! But as I understand, we are allowed to use the results of L0-L4 questions for example to determine L5-L12 predictions?\n\nAnd how about can we use the result of question 1, to influence our prediction on question 2? ",
          "replies": [
            {
              "id": 2212036,
              "postDate": "2023-04-06T13:18:47.043Z",
              "content": "<p>Not the results, no.  You can use the indicators from a previous set of levels, but you will not know how the player did on the first few questions to answer the next set.</p>",
              "rawMarkdown": "Not the results, no.  You can use the indicators from a previous set of levels, but you will not know how the player did on the first few questions to answer the next set.",
              "votes": 1
            },
            {
              "id": 2212714,
              "postDate": "2023-04-07T02:54:53.253Z",
              "content": "<p>Alright thanks a lot for the info Daniel!</p>",
              "rawMarkdown": "Alright thanks a lot for the info Daniel!"
            },
            {
              "id": 2215512,
              "postDate": "2023-04-09T11:12:35.323Z",
              "content": "<p>Hi <a href=\"https://www.kaggle.com/theupgrade\" target=\"_blank\">@theupgrade</a>, you will not know the test_label (how the player actually did on the previous questions) but you can save your predictions for further use. You actually have  2 possible designs.<br>\nDuring inference:</p>\n<ul>\n<li>you save all events on the sessions for further use in the next level_groups</li>\n<li>you save the predictions on questions for further use in the next level_groups (additional features)<br>\nYou can also try both together!<br>\nMake sure you train and infer with the same set of information!<br>\nThis will slow down the inference though.</li>\n</ul>",
              "rawMarkdown": "\nHi @theupgrade, you will not know the test_label (how the player actually did on the previous questions) but you can save your predictions for further use. You actually have  2 possible designs.\n\nDuring inference:\n-  you save all events on the sessions for further use in the next level_groups\n- you save the predictions on questions for further use in the next level_groups (additional features)\n\nYou can also try both together!\nMake sure you train and infer with the same set of information!\nThis will slow down the inference though.\n"
            },
            {
              "id": 2215868,
              "postDate": "2023-04-09T16:29:45.033Z",
              "content": "<p>Thanks for the hint Elias, will try to upload a prediction soonish :)</p>",
              "rawMarkdown": "Thanks for the hint Elias, will try to upload a prediction soonish :)"
            }
          ]
        }
      ]
    },
    {
      "id": 2210919,
      "postDate": "2023-04-05T17:45:15Z",
      "content": "<p>It says we are only allowed to use previous level data to evaluate a set of questions.</p>\n<p>Does that mean that for the first three questions (L0-L4) we are not allowed to use the full train set for example?</p>",
      "rawMarkdown": "It says we are only allowed to use previous level data to evaluate a set of questions.\n\nDoes that mean that for the first three questions (L0-L4) we are not allowed to use the full train set for example?",
      "votes": 1
    },
    {
      "id": 2211039,
      "postDate": "2023-04-05T19:02:18.677Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 2211186,
      "author_name": "Daniel Phalen",
      "author_url": "",
      "post_date": "2023-04-05T21:28:29.993000",
      "content": "<p>When your code makes its final predictions, it is served the data for all test sessions for L0-L4, then your code needs to submit predictions for the associated questions before it is allowed to see the next data (L5-L12).  If you want to use data from L0-L4 to make predictions for questions associated with L5-L12, then you will need to save that data.</p>\n<p>You can use the full train set for data explorations, etc, however, since the test interface will not let you see into the future (now), any features derived from future data in the train set will not be calculated the same way in the test set.</p>",
      "votes": 3,
      "replies": [
        {
          "id": 2212016,
          "author_name": "Arnout Van Avermaet",
          "author_url": "",
          "post_date": "2023-04-06T12:55:28.223000",
          "content": "<p>Thanks Daniel! But as I understand, we are allowed to use the results of L0-L4 questions for example to determine L5-L12 predictions?</p>\n<p>And how about can we use the result of question 1, to influence our prediction on question 2? </p>",
          "votes": 0,
          "replies": [
            {
              "id": 2212036,
              "author_name": "Daniel Phalen",
              "author_url": "",
              "post_date": "2023-04-06T13:18:47.043000",
              "content": "<p>Not the results, no.  You can use the indicators from a previous set of levels, but you will not know how the player did on the first few questions to answer the next set.</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 2212714,
              "author_name": "Arnout Van Avermaet",
              "author_url": "",
              "post_date": "2023-04-07T02:54:53.253000",
              "content": "<p>Alright thanks a lot for the info Daniel!</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2215512,
              "author_name": "Elias",
              "author_url": "",
              "post_date": "2023-04-09T11:12:35.323000",
              "content": "<p>Hi <a href=\"https://www.kaggle.com/theupgrade\" target=\"_blank\">@theupgrade</a>, you will not know the test_label (how the player actually did on the previous questions) but you can save your predictions for further use. You actually have  2 possible designs.<br>\nDuring inference:</p>\n<ul>\n<li>you save all events on the sessions for further use in the next level_groups</li>\n<li>you save the predictions on questions for further use in the next level_groups (additional features)<br>\nYou can also try both together!<br>\nMake sure you train and infer with the same set of information!<br>\nThis will slow down the inference though.</li>\n</ul>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2215868,
              "author_name": "Arnout Van Avermaet",
              "author_url": "",
              "post_date": "2023-04-09T16:29:45.033000",
              "content": "<p>Thanks for the hint Elias, will try to upload a prediction soonish :)</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2211039,
      "author_name": "",
      "author_url": "",
      "post_date": "2023-04-05T19:02:18.677000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2211186": "When your code makes its final predictions, it is served the data for all test sessions for L0-L4, then your code needs to submit predictions for the associated questions before it is allowed to see the next data (L5-L12).  If you want to use data from L0-L4 to make predictions for questions associated with L5-L12, then you will need to save that data.\n\nYou can use the full train set for data explorations, etc, however, since the test interface will not let you see into the future (now), any features derived from future data in the train set will not be calculated the same way in the test set.",
    "2210919": "It says we are only allowed to use previous level data to evaluate a set of questions.\n\nDoes that mean that for the first three questions (L0-L4) we are not allowed to use the full train set for example?",
    "2211039": ""
  }
}