{
  "id": 200313,
  "title": "How to submit using TPU?",
  "url": "/competitions/hubmap-kidney-segmentation/discussion/200313",
  "author_name": "",
  "post_date": "2020-11-30T00:40:30.816636800Z",
  "votes": 4,
  "comment_count": 10,
  "views": 0,
  "content": "<p>In the <strong>Code Requirements</strong>, it's mentioned that we can submit <strong>TPU</strong> notebooks. But as we know, a TPU notebook requires <strong>internet access ON</strong> and code competition requires <strong>internet access OFF</strong>, which is creating confusion here. It would be really nice if the organizers clear it.<br>\n<img src=\"https://i.ibb.co/PYsNdjh/TPU.png\" alt=\"\"></p>",
  "messages": [
    {
      "id": "1095788",
      "postDate": "11/30/2020 00:40:30",
      "content": "<p>In the <strong>Code Requirements</strong>, it's mentioned that we can submit <strong>TPU</strong> notebooks. But as we know, a TPU notebook requires <strong>internet access ON</strong> and code competition requires <strong>internet access OFF</strong>, which is creating confusion here. It would be really nice if the organizers clear it.<br>\n<img src=\"https://i.ibb.co/PYsNdjh/TPU.png\" alt=\"\"></p>",
      "rawMarkdown": "In the **Code Requirements**, it's mentioned that we can submit **TPU** notebooks. But as we know, a TPU notebook requires **internet access ON** and code competition requires **internet access OFF**, which is creating confusion here. It would be really nice if the organizers clear it.\n![](https://i.ibb.co/PYsNdjh/TPU.png)",
      "votes": null
    },
    {
      "id": "1096504",
      "postDate": "11/30/2020 14:51:05",
      "content": "<p>Thank you for pointing this out, <a href=\"https://www.kaggle.com/awsaf49\" target=\"_blank\">@awsaf49</a> . You are correct: running TPUs requires internet access but this competition has a strict no internet access for security reasons. We will notify the competition team to point out this inconsistency.</p>\n<p>One potential work around is posted <a href=\"https://www.kaggle.com/product-feedback/129828\" target=\"_blank\">here</a>: <br>\nFrom Martin Gorner of Kaggle: \"The internet connection is required for TPUs. TPUs read data from GCS which is a data service connected through the internet. If you want to use TPUs in a competition with a hidden dataset and a strict \"no internet\" rule for submissions, pease use TPUs for training and use a separate notebook for inference-only submissions.\"</p>\n<p>I hope this helps; I will let you know once we hear back regarding the inconsistency with respect to TPUs.</p>",
      "rawMarkdown": "Thank you for pointing this out, @awsaf49 . You are correct: running TPUs requires internet access but this competition has a strict no internet access for security reasons. We will notify the competition team to point out this inconsistency.\n\nOne potential work around is posted [here](https://www.kaggle.com/product-feedback/129828): \nFrom Martin Gorner of Kaggle: \"The internet connection is required for TPUs. TPUs read data from GCS which is a data service connected through the internet. If you want to use TPUs in a competition with a hidden dataset and a strict \"no internet\" rule for submissions, pease use TPUs for training and use a separate notebook for inference-only submissions.\"\n\nI hope this helps; I will let you know once we hear back regarding the inconsistency with respect to TPUs.",
      "votes": null
    },
    {
      "id": "1096513",
      "postDate": "11/30/2020 14:59:19",
      "content": "<p>Thank you for your response.</p>",
      "rawMarkdown": "Thank you for your response.",
      "votes": null
    },
    {
      "id": "1096550",
      "postDate": "11/30/2020 15:36:35",
      "content": "<p>Just to add onto Brendan's comment you are not prevented from training with internet access, only the submission. So you can train with a TPU and then submit via GPU. </p>",
      "rawMarkdown": "Just to add onto Brendan's comment you are not prevented from training with internet access, only the submission. So you can train with a TPU and then submit via GPU.",
      "votes": null
    },
    {
      "id": "1096561",
      "postDate": "11/30/2020 15:50:09",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/budsims\" target=\"_blank\">@budsims</a> if you could also clear the doubts on the following discussion thread it would be really helpful.</p>\n<p><a href=\"https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/198948\" target=\"_blank\">https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/198948</a></p>",
      "rawMarkdown": "Hi @budsims if you could also clear the doubts on the following discussion thread it would be really helpful.\n\nhttps://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/198948",
      "votes": null
    },
    {
      "id": "1096611",
      "postDate": "11/30/2020 16:38:01",
      "content": "<p><a href=\"https://www.kaggle.com/yovinyahathugoda\" target=\"_blank\">@yovinyahathugoda</a> - will do and thank you for providing the link. </p>",
      "rawMarkdown": "yovinyahathugoda - will do and thank you for providing the link.",
      "votes": null
    },
    {
      "id": "1096658",
      "postDate": "11/30/2020 17:10:42",
      "content": "<p>Instructions <a href=\"https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu\" target=\"_blank\">https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu</a></p>",
      "rawMarkdown": "Instructions [https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu](https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu)",
      "votes": null
    },
    {
      "id": "1096662",
      "postDate": "11/30/2020 17:14:06",
      "content": "<p><a href=\"https://www.kaggle.com/budsims\" target=\"_blank\">@budsims</a> I think in most of the competition I can train using TPU and then submit using GPU. But in this competition, it is specifically mentioned that we can use TPU notebook for submission that what confused me.</p>",
      "rawMarkdown": "budsims I think in most of the competition I can train using TPU and then submit using GPU. But in this competition, it is specifically mentioned that we can use TPU notebook for submission that what confused me.",
      "votes": null
    },
    {
      "id": "1096669",
      "postDate": "11/30/2020 17:22:30",
      "content": "<p><a href=\"https://www.kaggle.com/awsaf49\" target=\"_blank\">@awsaf49</a> understood. Thank you for explaining and we will make the language clearer. </p>",
      "rawMarkdown": "awsaf49 understood. Thank you for explaining and we will make the language clearer.",
      "votes": null
    },
    {
      "id": "1096784",
      "postDate": "11/30/2020 19:19:44",
      "content": "<p>They just updated the requirements to state:</p>\n<blockquote>\n  <p>TPUs will not be available for making submissions to this competition. You are still welcome to use them for training models. A walk-through for how to train on TPUs and run inference/submit on GPUs, see our TPU Docs.</p>\n</blockquote>",
      "rawMarkdown": "They just updated the requirements to state:\n> TPUs will not be available for making submissions to this competition. You are still welcome to use them for training models. A walk-through for how to train on TPUs and run inference/submit on GPUs, see our TPU Docs.",
      "votes": null
    },
    {
      "id": "1102044",
      "postDate": "12/04/2020 14:09:00",
      "content": "<p>Thank you for explaining</p>",
      "rawMarkdown": "Thank you for explaining",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1096504,
      "author_name": "brendandoohan",
      "author_url": "",
      "post_date": "11/30/2020 14:51:05",
      "content": "<p>Thank you for pointing this out, <a href=\"https://www.kaggle.com/awsaf49\" target=\"_blank\">@awsaf49</a> . You are correct: running TPUs requires internet access but this competition has a strict no internet access for security reasons. We will notify the competition team to point out this inconsistency.</p>\n<p>One potential work around is posted <a href=\"https://www.kaggle.com/product-feedback/129828\" target=\"_blank\">here</a>: <br>\nFrom Martin Gorner of Kaggle: \"The internet connection is required for TPUs. TPUs read data from GCS which is a data service connected through the internet. If you want to use TPUs in a competition with a hidden dataset and a strict \"no internet\" rule for submissions, pease use TPUs for training and use a separate notebook for inference-only submissions.\"</p>\n<p>I hope this helps; I will let you know once we hear back regarding the inconsistency with respect to TPUs.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1096513,
          "author_name": "awsaf49",
          "author_url": "",
          "post_date": "11/30/2020 14:59:19",
          "content": "<p>Thank you for your response.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1096550,
          "author_name": "budsims",
          "author_url": "",
          "post_date": "11/30/2020 15:36:35",
          "content": "<p>Just to add onto Brendan's comment you are not prevented from training with internet access, only the submission. So you can train with a TPU and then submit via GPU. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1096561,
          "author_name": "yovinyahathugoda",
          "author_url": "",
          "post_date": "11/30/2020 15:50:09",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/budsims\" target=\"_blank\">@budsims</a> if you could also clear the doubts on the following discussion thread it would be really helpful.</p>\n<p><a href=\"https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/198948\" target=\"_blank\">https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/198948</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1096611,
          "author_name": "budsims",
          "author_url": "",
          "post_date": "11/30/2020 16:38:01",
          "content": "<p><a href=\"https://www.kaggle.com/yovinyahathugoda\" target=\"_blank\">@yovinyahathugoda</a> - will do and thank you for providing the link. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1096658,
          "author_name": "budsims",
          "author_url": "",
          "post_date": "11/30/2020 17:10:42",
          "content": "<p>Instructions <a href=\"https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu\" target=\"_blank\">https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1096662,
          "author_name": "awsaf49",
          "author_url": "",
          "post_date": "11/30/2020 17:14:06",
          "content": "<p><a href=\"https://www.kaggle.com/budsims\" target=\"_blank\">@budsims</a> I think in most of the competition I can train using TPU and then submit using GPU. But in this competition, it is specifically mentioned that we can use TPU notebook for submission that what confused me.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1096669,
          "author_name": "budsims",
          "author_url": "",
          "post_date": "11/30/2020 17:22:30",
          "content": "<p><a href=\"https://www.kaggle.com/awsaf49\" target=\"_blank\">@awsaf49</a> understood. Thank you for explaining and we will make the language clearer. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1102044,
          "author_name": "lazythor",
          "author_url": "",
          "post_date": "12/04/2020 14:09:00",
          "content": "<p>Thank you for explaining</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1096784,
      "author_name": "matthewmasters",
      "author_url": "",
      "post_date": "11/30/2020 19:19:44",
      "content": "<p>They just updated the requirements to state:</p>\n<blockquote>\n  <p>TPUs will not be available for making submissions to this competition. You are still welcome to use them for training models. A walk-through for how to train on TPUs and run inference/submit on GPUs, see our TPU Docs.</p>\n</blockquote>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1095788": "In the **Code Requirements**, it's mentioned that we can submit **TPU** notebooks. But as we know, a TPU notebook requires **internet access ON** and code competition requires **internet access OFF**, which is creating confusion here. It would be really nice if the organizers clear it.\n![](https://i.ibb.co/PYsNdjh/TPU.png)",
    "1096504": "Thank you for pointing this out, @awsaf49 . You are correct: running TPUs requires internet access but this competition has a strict no internet access for security reasons. We will notify the competition team to point out this inconsistency.\n\nOne potential work around is posted [here](https://www.kaggle.com/product-feedback/129828): \nFrom Martin Gorner of Kaggle: \"The internet connection is required for TPUs. TPUs read data from GCS which is a data service connected through the internet. If you want to use TPUs in a competition with a hidden dataset and a strict \"no internet\" rule for submissions, pease use TPUs for training and use a separate notebook for inference-only submissions.\"\n\nI hope this helps; I will let you know once we hear back regarding the inconsistency with respect to TPUs.",
    "1096513": "Thank you for your response.",
    "1096550": "Just to add onto Brendan's comment you are not prevented from training with internet access, only the submission. So you can train with a TPU and then submit via GPU.",
    "1096561": "Hi @budsims if you could also clear the doubts on the following discussion thread it would be really helpful.\n\nhttps://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/198948",
    "1096611": "yovinyahathugoda - will do and thank you for providing the link.",
    "1096658": "Instructions [https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu](https://www.kaggle.com/marcosnovaes/hubmap-unet-keras-model-fit-with-tpu)",
    "1096662": "budsims I think in most of the competition I can train using TPU and then submit using GPU. But in this competition, it is specifically mentioned that we can use TPU notebook for submission that what confused me.",
    "1096669": "awsaf49 understood. Thank you for explaining and we will make the language clearer.",
    "1096784": "They just updated the requirements to state:\n> TPUs will not be available for making submissions to this competition. You are still welcome to use them for training models. A walk-through for how to train on TPUs and run inference/submit on GPUs, see our TPU Docs.",
    "1102044": "Thank you for explaining"
  },
  "source": "meta"
}