{
  "id": 122736,
  "title": "Notebook timeout",
  "url": "/competitions/deepfake-detection-challenge/discussion/122736",
  "author_name": "",
  "post_date": "2019-12-22T14:32:03.344815Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>According to this <em>\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\"</em></p>\n\n<p>My notebook was run successfully with 400 test videos and I was able to submit the submission.csv to the competition but I got the public score 'error' with status 'notebook timeout'.\nI know that the real data is 10 times larger but being able to submit to the competition means the code should be working (logical and timing) in public test set right? So why I got this error?</p>\n\n<p>Thank you</p>",
  "messages": [
    {
      "id": "700740",
      "postDate": "12/22/2019 14:32:03",
      "content": "<p>According to this <em>\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\"</em></p>\n\n<p>My notebook was run successfully with 400 test videos and I was able to submit the submission.csv to the competition but I got the public score 'error' with status 'notebook timeout'.\nI know that the real data is 10 times larger but being able to submit to the competition means the code should be working (logical and timing) in public test set right? So why I got this error?</p>\n\n<p>Thank you</p>",
      "rawMarkdown": "According to this *\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\"*\n\nMy notebook was run successfully with 400 test videos and I was able to submit the submission.csv to the competition but I got the public score 'error' with status 'notebook timeout'.\nI know that the real data is 10 times larger but being able to submit to the competition means the code should be working (logical and timing) in public test set right? So why I got this error?\n\nThank you",
      "votes": null
    },
    {
      "id": "700760",
      "postDate": "12/22/2019 15:06:29",
      "content": "<p>As noted in many other discussions - the submission runs against a much larger test set of videos.  I have seen 10x as a common assumption of the size.  If your kernel took 3 hours to run - than at 10x it will timeout.  Check out how long your kernel ran on the 400.  </p>",
      "rawMarkdown": "As noted in many other discussions - the submission runs against a much larger test set of videos.  I have seen 10x as a common assumption of the size.  If your kernel took 3 hours to run - than at 10x it will timeout.  Check out how long your kernel ran on the 400.",
      "votes": null
    },
    {
      "id": "700763",
      "postDate": "12/22/2019 15:08:46",
      "content": "<p>I had this confusion at first too. The 400 videos are not the full public test. It’s actually the public validation set. When you click submit it runs on 4000 public test videos (10x the size) . This means your initial commit should take at least less than 1 hour or else your submission will probably be more then the 9 hour limit.</p>",
      "rawMarkdown": "I had this confusion at first too. The 400 videos are not the full public test. It’s actually the public validation set. When you click submit it runs on 4000 public test videos (10x the size) . This means your initial commit should take at least less than 1 hour or else your submission will probably be more then the 9 hour limit.",
      "votes": null
    },
    {
      "id": "700810",
      "postDate": "12/22/2019 16:24:37",
      "content": "<p>I know about the size but according to this\n\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\" \nand the code requirement does say about run-time requirement so I am not sure why I was able to submit to competition but got timeout error later.\nThank you</p>",
      "rawMarkdown": "I know about the size but according to this\n\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\" \nand the code requirement does say about run-time requirement so I am not sure why I was able to submit to competition but got timeout error later.\nThank you",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 700760,
      "author_name": "pcjimmmy",
      "author_url": "",
      "post_date": "12/22/2019 15:06:29",
      "content": "<p>As noted in many other discussions - the submission runs against a much larger test set of videos.  I have seen 10x as a common assumption of the size.  If your kernel took 3 hours to run - than at 10x it will timeout.  Check out how long your kernel ran on the 400.  </p>",
      "votes": null,
      "replies": [
        {
          "id": 700810,
          "author_name": "suthidasukhonn",
          "author_url": "",
          "post_date": "12/22/2019 16:24:37",
          "content": "<p>I know about the size but according to this\n\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\" \nand the code requirement does say about run-time requirement so I am not sure why I was able to submit to competition but got timeout error later.\nThank you</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 700763,
      "author_name": "robikscube",
      "author_url": "",
      "post_date": "12/22/2019 15:08:46",
      "content": "<p>I had this confusion at first too. The 400 videos are not the full public test. It’s actually the public validation set. When you click submit it runs on 4000 public test videos (10x the size) . This means your initial commit should take at least less than 1 hour or else your submission will probably be more then the 9 hour limit.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "700740": "According to this *\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\"*\n\nMy notebook was run successfully with 400 test videos and I was able to submit the submission.csv to the competition but I got the public score 'error' with status 'notebook timeout'.\nI know that the real data is 10 times larger but being able to submit to the competition means the code should be working (logical and timing) in public test set right? So why I got this error?\n\nThank you",
    "700760": "As noted in many other discussions - the submission runs against a much larger test set of videos.  I have seen 10x as a common assumption of the size.  If your kernel took 3 hours to run - than at 10x it will timeout.  Check out how long your kernel ran on the 400.",
    "700763": "I had this confusion at first too. The 400 videos are not the full public test. It’s actually the public validation set. When you click submit it runs on 4000 public test videos (10x the size) . This means your initial commit should take at least less than 1 hour or else your submission will probably be more then the 9 hour limit.",
    "700810": "I know about the size but according to this\n\"The “Submit to Competition” button will only be available if your notebook meets the requirements specified in Code Requirements\" \nand the code requirement does say about run-time requirement so I am not sure why I was able to submit to competition but got timeout error later.\nThank you"
  },
  "source": "meta"
}