{
  "id": 193880,
  "title": "does hidden test set has both new users and question?",
  "url": "/competitions/riiid-test-answer-prediction/discussion/193880",
  "author_name": "",
  "post_date": "2020-10-29T11:15:33.393861900Z",
  "votes": null,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I think i'm sure that there are new users !<br>\nbut not sure there are new question ids or not!!!</p>",
  "messages": [
    {
      "id": "1063811",
      "postDate": "10/29/2020 11:15:33",
      "content": "<p>I think i'm sure that there are new users !<br>\nbut not sure there are new question ids or not!!!</p>",
      "rawMarkdown": "I think i'm sure that there are new users !\nbut not sure there are new question ids or not!!!",
      "votes": null
    },
    {
      "id": "1063819",
      "postDate": "10/29/2020 11:28:43",
      "content": "<p>Check the second point <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/191106\" target=\"_blank\">here</a>.</p>",
      "rawMarkdown": "Check the second point [here](https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/191106).",
      "votes": null
    },
    {
      "id": "1063833",
      "postDate": "10/29/2020 11:41:45",
      "content": "<p>i read it but really didn't get it!!!<br>\nfirst i tried with some of my assumption but it failed as it is still showing submission error!!!<br>\ni checked all the possiblities mentioned in the discussion, but it did't work!!<br>\nthat's why i'm asking it !!<br>\nand expecting yes or no as answer!!!!<br>\nsorry if you find to be rude!!</p>",
      "rawMarkdown": "i read it but really didn't get it!!!\nfirst i tried with some of my assumption but it failed as it is still showing submission error!!!\ni checked all the possiblities mentioned in the discussion, but it did't work!!\nthat's why i'm asking it !!\nand expecting yes or no as answer!!!!\nsorry if you find to be rude!!",
      "votes": null
    },
    {
      "id": "1063876",
      "postDate": "10/29/2020 12:57:21",
      "content": "<p><a href=\"https://www.kaggle.com/dhyeypatel1234\" target=\"_blank\">@dhyeypatel1234</a> This was already discussed in other forum posts.<br>\nSummary:</p>\n<ul>\n<li>Yes, there will be new users</li>\n<li>No, question ids have been updated and there are no new questions in test</li>\n</ul>\n<p>Your submission error is probably because of exceeding kernel limits:<br>\n(i) out of memory or<br>\n(ii) out of time<br>\nDebugging tip: Use \"last\" <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/data\" target=\"_blank\">2.5 million rows</a> as test data and run your \"complete\" inference code on this testset and verify memory &amp; time taken.</p>",
      "rawMarkdown": "dhyeypatel1234 This was already discussed in other forum posts.\nSummary:\n- Yes, there will be new users\n- No, question ids have been updated and there are no new questions in test\n\nYour submission error is probably because of exceeding kernel limits:\n(i) out of memory or\n(ii) out of time\nDebugging tip: Use \"last\" [2.5 million rows](https://www.kaggle.com/c/riiid-test-answer-prediction/data) as test data and run your \"complete\" inference code on this testset and verify memory & time taken.",
      "votes": null
    },
    {
      "id": "1063899",
      "postDate": "10/29/2020 13:24:56",
      "content": "<p>As others have mentioned, the organizers have already verified that there aren't new question ids. I can also add that I've successfully made a submission that should definitely break if there are new question ids, so I'm essentially certain there are no new questions.</p>",
      "rawMarkdown": "As others have mentioned, the organizers have already verified that there aren't new question ids. I can also add that I've successfully made a submission that should definitely break if there are new question ids, so I'm essentially certain there are no new questions.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1063819,
      "author_name": "rohanrao",
      "author_url": "",
      "post_date": "10/29/2020 11:28:43",
      "content": "<p>Check the second point <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/191106\" target=\"_blank\">here</a>.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1063833,
          "author_name": "dhyeypatel1234",
          "author_url": "",
          "post_date": "10/29/2020 11:41:45",
          "content": "<p>i read it but really didn't get it!!!<br>\nfirst i tried with some of my assumption but it failed as it is still showing submission error!!!<br>\ni checked all the possiblities mentioned in the discussion, but it did't work!!<br>\nthat's why i'm asking it !!<br>\nand expecting yes or no as answer!!!!<br>\nsorry if you find to be rude!!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1063876,
          "author_name": "sirishks",
          "author_url": "",
          "post_date": "10/29/2020 12:57:21",
          "content": "<p><a href=\"https://www.kaggle.com/dhyeypatel1234\" target=\"_blank\">@dhyeypatel1234</a> This was already discussed in other forum posts.<br>\nSummary:</p>\n<ul>\n<li>Yes, there will be new users</li>\n<li>No, question ids have been updated and there are no new questions in test</li>\n</ul>\n<p>Your submission error is probably because of exceeding kernel limits:<br>\n(i) out of memory or<br>\n(ii) out of time<br>\nDebugging tip: Use \"last\" <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/data\" target=\"_blank\">2.5 million rows</a> as test data and run your \"complete\" inference code on this testset and verify memory &amp; time taken.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1063899,
      "author_name": "aquatic",
      "author_url": "",
      "post_date": "10/29/2020 13:24:56",
      "content": "<p>As others have mentioned, the organizers have already verified that there aren't new question ids. I can also add that I've successfully made a submission that should definitely break if there are new question ids, so I'm essentially certain there are no new questions.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1063811": "I think i'm sure that there are new users !\nbut not sure there are new question ids or not!!!",
    "1063819": "Check the second point [here](https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/191106).",
    "1063833": "i read it but really didn't get it!!!\nfirst i tried with some of my assumption but it failed as it is still showing submission error!!!\ni checked all the possiblities mentioned in the discussion, but it did't work!!\nthat's why i'm asking it !!\nand expecting yes or no as answer!!!!\nsorry if you find to be rude!!",
    "1063876": "dhyeypatel1234 This was already discussed in other forum posts.\nSummary:\n- Yes, there will be new users\n- No, question ids have been updated and there are no new questions in test\n\nYour submission error is probably because of exceeding kernel limits:\n(i) out of memory or\n(ii) out of time\nDebugging tip: Use \"last\" [2.5 million rows](https://www.kaggle.com/c/riiid-test-answer-prediction/data) as test data and run your \"complete\" inference code on this testset and verify memory & time taken.",
    "1063899": "As others have mentioned, the organizers have already verified that there aren't new question ids. I can also add that I've successfully made a submission that should definitely break if there are new question ids, so I'm essentially certain there are no new questions."
  },
  "source": "meta"
}