{
  "id": 161553,
  "title": "Final submission duration",
  "url": "/competitions/siim-isic-melanoma-classification/discussion/161553",
  "author_name": "Fizpok",
  "post_date": "2020-06-25T08:47:23.377000",
  "votes": 0,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hi,\nAs I understand, a final submission is done as \"Save and Submit\", right? Or should I mark it as final somehow?\nAlso, how long (max) can the final submission notebook run? Like \"3h max\"?</p>\n\n<p>Thank you.</p>",
  "messages": [
    {
      "id": 904276,
      "postDate": "2020-06-27T13:48:21.460Z",
      "content": "<p>Correct me if I am wrong but I think this is not a kernel competition so you can prepare submission on your home computer offline. In that case you can take any resources and any number of hours (before the deadline) for that.</p>",
      "rawMarkdown": "Correct me if I am wrong but I think this is not a kernel competition so you can prepare submission on your home computer offline. In that case you can take any resources and any number of hours (before the deadline) for that."
    },
    {
      "id": 903945,
      "postDate": "2020-06-27T08:22:54.407Z",
      "content": "<p>The question remaining is \"how long\". What is the max duration of notebook running while submitting?</p>",
      "rawMarkdown": "The question remaining is \"how long\". What is the max duration of notebook running while submitting?",
      "replies": [
        {
          "id": 904163,
          "postDate": "2020-06-27T12:03:35.353Z",
          "content": "<p>The contest has no compute/time limits. Your code does not need to be run in any specific timeframe. If you have the resources, your model could take 500 hrs to train.</p>\n\n<p>If you use Kaggle Notebooks, they have their own limits. see <a href=\"https://www.kaggle.com/docs/notebooks\">https://www.kaggle.com/docs/notebooks</a>. But these limits are not related to this contest specifically and are simply to make sure the shared resources are fairly available to all users.</p>\n\n<p>If you run interactively, I think a Notebook runs for 9 hours (3 hours with TPU on). But you will time-out every hour or so if you don't interact with the editor, so you need to move your mouse or click every hour.</p>\n\n<p>You have a weekly Quota of GPU (30 hour) and TPU (30 hr). These appear to reset weekly on Friday night. You can see your current status at the top of the \"Notebooks\" tab.</p>\n\n<p>If you \"Save &amp; Run All\" (what we used to call \"Commit\") your notebook runs in the background for up to 9 hours (3 hours with TPU enabled). If you think your notebook will run longer than that, add in Checkpoints, so you don't lose your work.</p>\n\n<p>Notebooks can save the output, so you can run a model for 10 epochs, save the model weights, then start a new notebook and reload the model weights and continue training.</p>\n\n<p>Best of luck,</p>\n\n<p>-Rich</p>",
          "rawMarkdown": "The contest has no compute/time limits. Your code does not need to be run in any specific timeframe. If you have the resources, your model could take 500 hrs to train.\n\nIf you use Kaggle Notebooks, they have their own limits. see https://www.kaggle.com/docs/notebooks. But these limits are not related to this contest specifically and are simply to make sure the shared resources are fairly available to all users.\n\nIf you run interactively, I think a Notebook runs for 9 hours (3 hours with TPU on). But you will time-out every hour or so if you don't interact with the editor, so you need to move your mouse or click every hour.\n\nYou have a weekly Quota of GPU (30 hour) and TPU (30 hr). These appear to reset weekly on Friday night. You can see your current status at the top of the \"Notebooks\" tab.\n\nIf you \"Save &amp; Run All\" (what we used to call \"Commit\") your notebook runs in the background for up to 9 hours (3 hours with TPU enabled). If you think your notebook will run longer than that, add in Checkpoints, so you don't lose your work.\n\nNotebooks can save the output, so you can run a model for 10 epochs, save the model weights, then start a new notebook and reload the model weights and continue training.\n\nBest of luck,\n\n-Rich"
        }
      ]
    },
    {
      "id": 901728,
      "postDate": "2020-06-25T16:42:37.947Z",
      "content": "<p>So... Let's say I have committed 5 results to a leader board. Does it mean that at the final calculation of scores, the best one will be used? Or do I have to tell you somehow that THIS is the final commit?</p>",
      "rawMarkdown": "So... Let's say I have committed 5 results to a leader board. Does it mean that at the final calculation of scores, the best one will be used? Or do I have to tell you somehow that THIS is the final commit?",
      "replies": [
        {
          "id": 901773,
          "postDate": "2020-06-25T17:26:05.503Z",
          "content": "<p>Yes, that's right. the leaderboard will reflect your Public score that ranks the highest of all of your submissions. Note that there is the concept of a public vs. private leaderboard. Which means that we have split the full test set (and do not disclose which observations represent the public v. private). What you see now is a score against the public leaderboard. </p>\n\n<p>Before the competition's submission deadline, you will need to go to \"My Submissions\" and select your final 2 submissions for scoring against the private leaderboard. It will be the higher of these 2 submissions' private scores which will determine your final ranking when the private leaderboard is revealed. If you do not make a selection, we auto-select the submission representing your highest public leaderboard submission.</p>",
          "rawMarkdown": "Yes, that's right. the leaderboard will reflect your Public score that ranks the highest of all of your submissions. Note that there is the concept of a public vs. private leaderboard. Which means that we have split the full test set (and do not disclose which observations represent the public v. private). What you see now is a score against the public leaderboard. \n\nBefore the competition's submission deadline, you will need to go to \"My Submissions\" and select your final 2 submissions for scoring against the private leaderboard. It will be the higher of these 2 submissions' private scores which will determine your final ranking when the private leaderboard is revealed. If you do not make a selection, we auto-select the submission representing your highest public leaderboard submission."
        }
      ]
    },
    {
      "id": 901647,
      "postDate": "2020-06-25T16:08:44.617Z",
      "content": "<p>You will also need to be sure that to make an actual submission to the competition, go to the notebook in viewer mode, find the \"Output\" and \"Submit to competition.\" Saving/Committing the notebook alone does <strong>not</strong> make your submission to the leaderboard.</p>",
      "rawMarkdown": "You will also need to be sure that to make an actual submission to the competition, go to the notebook in viewer mode, find the \"Output\" and \"Submit to competition.\" Saving/Committing the notebook alone does **not** make your submission to the leaderboard.",
      "replies": [
        {
          "id": 966366,
          "postDate": "2020-08-11T11:15:19.010Z",
          "content": "<p>Should I need to submit only the test data set prediction CVS file? Or also I need to submit the model? Is it necessary to make the notebook publicly available on the Kaggle? Sorry for this question but I am new to Kaggle and this is my first competition.</p>",
          "rawMarkdown": "Should I need to submit only the test data set prediction CVS file? Or also I need to submit the model? Is it necessary to make the notebook publicly available on the Kaggle? Sorry for this question but I am new to Kaggle and this is my first competition."
        },
        {
          "id": 966521,
          "postDate": "2020-08-11T13:42:40.400Z",
          "rawMarkdown": "",
          "isDeleted": true
        }
      ]
    },
    {
      "id": 901085,
      "postDate": "2020-06-25T08:47:23.377Z",
      "content": "<p>Hi,\nAs I understand, a final submission is done as \"Save and Submit\", right? Or should I mark it as final somehow?\nAlso, how long (max) can the final submission notebook run? Like \"3h max\"?</p>\n\n<p>Thank you.</p>",
      "rawMarkdown": "Hi,\nAs I understand, a final submission is done as \"Save and Submit\", right? Or should I mark it as final somehow?\nAlso, how long (max) can the final submission notebook run? Like \"3h max\"?\n\nThank you."
    }
  ],
  "comments": [
    {
      "id": 904276,
      "author_name": "Jacek Poplawski",
      "author_url": "",
      "post_date": "2020-06-27T13:48:21.460000",
      "content": "<p>Correct me if I am wrong but I think this is not a kernel competition so you can prepare submission on your home computer offline. In that case you can take any resources and any number of hours (before the deadline) for that.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 903945,
      "author_name": "Fizpok",
      "author_url": "",
      "post_date": "2020-06-27T08:22:54.407000",
      "content": "<p>The question remaining is \"how long\". What is the max duration of notebook running while submitting?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 904163,
          "author_name": "quadcore/Richard Epstein",
          "author_url": "",
          "post_date": "2020-06-27T12:03:35.353000",
          "content": "<p>The contest has no compute/time limits. Your code does not need to be run in any specific timeframe. If you have the resources, your model could take 500 hrs to train.</p>\n\n<p>If you use Kaggle Notebooks, they have their own limits. see <a href=\"https://www.kaggle.com/docs/notebooks\">https://www.kaggle.com/docs/notebooks</a>. But these limits are not related to this contest specifically and are simply to make sure the shared resources are fairly available to all users.</p>\n\n<p>If you run interactively, I think a Notebook runs for 9 hours (3 hours with TPU on). But you will time-out every hour or so if you don't interact with the editor, so you need to move your mouse or click every hour.</p>\n\n<p>You have a weekly Quota of GPU (30 hour) and TPU (30 hr). These appear to reset weekly on Friday night. You can see your current status at the top of the \"Notebooks\" tab.</p>\n\n<p>If you \"Save &amp; Run All\" (what we used to call \"Commit\") your notebook runs in the background for up to 9 hours (3 hours with TPU enabled). If you think your notebook will run longer than that, add in Checkpoints, so you don't lose your work.</p>\n\n<p>Notebooks can save the output, so you can run a model for 10 epochs, save the model weights, then start a new notebook and reload the model weights and continue training.</p>\n\n<p>Best of luck,</p>\n\n<p>-Rich</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 901728,
      "author_name": "Fizpok",
      "author_url": "",
      "post_date": "2020-06-25T16:42:37.947000",
      "content": "<p>So... Let's say I have committed 5 results to a leader board. Does it mean that at the final calculation of scores, the best one will be used? Or do I have to tell you somehow that THIS is the final commit?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 901773,
          "author_name": "Julia Elliott",
          "author_url": "",
          "post_date": "2020-06-25T17:26:05.503000",
          "content": "<p>Yes, that's right. the leaderboard will reflect your Public score that ranks the highest of all of your submissions. Note that there is the concept of a public vs. private leaderboard. Which means that we have split the full test set (and do not disclose which observations represent the public v. private). What you see now is a score against the public leaderboard. </p>\n\n<p>Before the competition's submission deadline, you will need to go to \"My Submissions\" and select your final 2 submissions for scoring against the private leaderboard. It will be the higher of these 2 submissions' private scores which will determine your final ranking when the private leaderboard is revealed. If you do not make a selection, we auto-select the submission representing your highest public leaderboard submission.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 901647,
      "author_name": "Julia Elliott",
      "author_url": "",
      "post_date": "2020-06-25T16:08:44.617000",
      "content": "<p>You will also need to be sure that to make an actual submission to the competition, go to the notebook in viewer mode, find the \"Output\" and \"Submit to competition.\" Saving/Committing the notebook alone does <strong>not</strong> make your submission to the leaderboard.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 966366,
          "author_name": "SANKET PATEL108784",
          "author_url": "",
          "post_date": "2020-08-11T11:15:19.010000",
          "content": "<p>Should I need to submit only the test data set prediction CVS file? Or also I need to submit the model? Is it necessary to make the notebook publicly available on the Kaggle? Sorry for this question but I am new to Kaggle and this is my first competition.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 966521,
          "author_name": "",
          "author_url": "",
          "post_date": "2020-08-11T13:42:40.400000",
          "content": "",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "904276": "Correct me if I am wrong but I think this is not a kernel competition so you can prepare submission on your home computer offline. In that case you can take any resources and any number of hours (before the deadline) for that.",
    "903945": "The question remaining is \"how long\". What is the max duration of notebook running while submitting?",
    "901728": "So... Let's say I have committed 5 results to a leader board. Does it mean that at the final calculation of scores, the best one will be used? Or do I have to tell you somehow that THIS is the final commit?",
    "901647": "You will also need to be sure that to make an actual submission to the competition, go to the notebook in viewer mode, find the \"Output\" and \"Submit to competition.\" Saving/Committing the notebook alone does **not** make your submission to the leaderboard.",
    "901085": "Hi,\nAs I understand, a final submission is done as \"Save and Submit\", right? Or should I mark it as final somehow?\nAlso, how long (max) can the final submission notebook run? Like \"3h max\"?\n\nThank you."
  }
}