{
  "id": 189479,
  "title": "bug or leak?",
  "url": "/competitions/riiid-test-answer-prediction/discussion/189479",
  "author_name": "",
  "post_date": "2020-10-07T17:48:32.767314200Z",
  "votes": 2,
  "comment_count": 2,
  "views": 0,
  "content": "<p>And what prevents from going through the test set twice: remember the correct answers for the first time and send them to the second iteration? Or did I miss something in this wonderful algorithm?</p>",
  "messages": [
    {
      "id": "1041367",
      "postDate": "10/07/2020 17:48:32",
      "content": "<p>And what prevents from going through the test set twice: remember the correct answers for the first time and send them to the second iteration? Or did I miss something in this wonderful algorithm?</p>",
      "rawMarkdown": "And what prevents from going through the test set twice: remember the correct answers for the first time and send them to the second iteration? Or did I miss something in this wonderful algorithm?",
      "votes": null
    },
    {
      "id": "1041377",
      "postDate": "10/07/2020 17:53:47",
      "content": "<p>The competition package doesn't allow for this, you have to restart the kernel before going through the iterator again. At least that's what it says in the demo kernel, didn't try it yet myself.</p>\n<p>If you're thinking of running a submission notebook and somehow saving the output, that doesn't work either afaik. You can't access any output files or even console output after running the private set, the only thing you get is the public score.</p>",
      "rawMarkdown": "The competition package doesn't allow for this, you have to restart the kernel before going through the iterator again. At least that's what it says in the demo kernel, didn't try it yet myself.\n\nIf you're thinking of running a submission notebook and somehow saving the output, that doesn't work either afaik. You can't access any output files or even console output after running the private set, the only thing you get is the public score.",
      "votes": null
    },
    {
      "id": "1041381",
      "postDate": "10/07/2020 17:56:41",
      "content": "<p>Thanks. I don't plan to do this myself, I'm just trying to figure out what the catch is)</p>",
      "rawMarkdown": "Thanks. I don't plan to do this myself, I'm just trying to figure out what the catch is)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1041377,
      "author_name": "spacelx",
      "author_url": "",
      "post_date": "10/07/2020 17:53:47",
      "content": "<p>The competition package doesn't allow for this, you have to restart the kernel before going through the iterator again. At least that's what it says in the demo kernel, didn't try it yet myself.</p>\n<p>If you're thinking of running a submission notebook and somehow saving the output, that doesn't work either afaik. You can't access any output files or even console output after running the private set, the only thing you get is the public score.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1041381,
          "author_name": "sapr3s",
          "author_url": "",
          "post_date": "10/07/2020 17:56:41",
          "content": "<p>Thanks. I don't plan to do this myself, I'm just trying to figure out what the catch is)</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1041367": "And what prevents from going through the test set twice: remember the correct answers for the first time and send them to the second iteration? Or did I miss something in this wonderful algorithm?",
    "1041377": "The competition package doesn't allow for this, you have to restart the kernel before going through the iterator again. At least that's what it says in the demo kernel, didn't try it yet myself.\n\nIf you're thinking of running a submission notebook and somehow saving the output, that doesn't work either afaik. You can't access any output files or even console output after running the private set, the only thing you get is the public score.",
    "1041381": "Thanks. I don't plan to do this myself, I'm just trying to figure out what the catch is)"
  },
  "source": "meta"
}