{
  "id": 118073,
  "title": "TPU and GCP usage in kernels",
  "url": "/competitions/tensorflow2-question-answering/discussion/118073",
  "author_name": "",
  "post_date": "2019-11-19T13:19:52.550840Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>In the Getting Started notebook, there are some <code>FLAGS</code> about passing a TPU address to the notebook.</p>\n\n<p>Currently I don't quite understand what is the interplay between the Kaggle Submission Kernels and the GCP services like TPU or GCP Storage Buckets. Could you help me, sort this out:</p>\n\n<ol>\n<li>When I commit a kernel it will be executed and generate a submission file. During this \"commit\" execution of the kernel, is there any way of using a TPU or accessing a GCP storage bucket (containing a trained checkpoint for example)?</li>\n<li>Or are there any TPU resources that would be used by the evaluation script during the commit?</li>\n</ol>\n\n<p>As for the GCP Storage, I guess I can link my GCP account, and this would authorize my notebook  for accessing a GCP storage bucket, right? But if I pass a TPU address how and what would authorize the notebook to use the TPU?</p>\n\n<p>Or is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?</p>",
  "messages": [
    {
      "id": "676731",
      "postDate": "11/19/2019 13:19:52",
      "content": "<p>In the Getting Started notebook, there are some <code>FLAGS</code> about passing a TPU address to the notebook.</p>\n\n<p>Currently I don't quite understand what is the interplay between the Kaggle Submission Kernels and the GCP services like TPU or GCP Storage Buckets. Could you help me, sort this out:</p>\n\n<ol>\n<li>When I commit a kernel it will be executed and generate a submission file. During this \"commit\" execution of the kernel, is there any way of using a TPU or accessing a GCP storage bucket (containing a trained checkpoint for example)?</li>\n<li>Or are there any TPU resources that would be used by the evaluation script during the commit?</li>\n</ol>\n\n<p>As for the GCP Storage, I guess I can link my GCP account, and this would authorize my notebook  for accessing a GCP storage bucket, right? But if I pass a TPU address how and what would authorize the notebook to use the TPU?</p>\n\n<p>Or is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?</p>",
      "rawMarkdown": "In the Getting Started notebook, there are some `FLAGS` about passing a TPU address to the notebook.\n\nCurrently I don't quite understand what is the interplay between the Kaggle Submission Kernels and the GCP services like TPU or GCP Storage Buckets. Could you help me, sort this out:\n\n1. When I commit a kernel it will be executed and generate a submission file. During this \"commit\" execution of the kernel, is there any way of using a TPU or accessing a GCP storage bucket (containing a trained checkpoint for example)?\n2. Or are there any TPU resources that would be used by the evaluation script during the commit?\n\nAs for the GCP Storage, I guess I can link my GCP account, and this would authorize my notebook  for accessing a GCP storage bucket, right? But if I pass a TPU address how and what would authorize the notebook to use the TPU?\n\nOr is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?",
      "votes": null
    },
    {
      "id": "676801",
      "postDate": "11/19/2019 14:10:44",
      "content": "<blockquote>\n  <p>Or is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?</p>\n</blockquote>\n\n<p>I think that's the case, I have not heard about TPU support in kaggle kernels, although I've heard it's coming.</p>",
      "rawMarkdown": "&gt; Or is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?\n\nI think that's the case, I have not heard about TPU support in kaggle kernels, although I've heard it's coming.",
      "votes": null
    },
    {
      "id": "683368",
      "postDate": "11/28/2019 10:55:56",
      "content": "<p>Anyway, for submitting to competition, only CPU or GPU code is accepted: <a href=\"https://www.kaggle.com/c/tensorflow2-question-answering/overview/code-requirements\">https://www.kaggle.com/c/tensorflow2-question-answering/overview/code-requirements</a></p>",
      "rawMarkdown": "Anyway, for submitting to competition, only CPU or GPU code is accepted: https://www.kaggle.com/c/tensorflow2-question-answering/overview/code-requirements",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 676801,
      "author_name": "lopuhin",
      "author_url": "",
      "post_date": "11/19/2019 14:10:44",
      "content": "<blockquote>\n  <p>Or is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?</p>\n</blockquote>\n\n<p>I think that's the case, I have not heard about TPU support in kaggle kernels, although I've heard it's coming.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 683368,
      "author_name": "arvindpdmn",
      "author_url": "",
      "post_date": "11/28/2019 10:55:56",
      "content": "<p>Anyway, for submitting to competition, only CPU or GPU code is accepted: <a href=\"https://www.kaggle.com/c/tensorflow2-question-answering/overview/code-requirements\">https://www.kaggle.com/c/tensorflow2-question-answering/overview/code-requirements</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "676731": "In the Getting Started notebook, there are some `FLAGS` about passing a TPU address to the notebook.\n\nCurrently I don't quite understand what is the interplay between the Kaggle Submission Kernels and the GCP services like TPU or GCP Storage Buckets. Could you help me, sort this out:\n\n1. When I commit a kernel it will be executed and generate a submission file. During this \"commit\" execution of the kernel, is there any way of using a TPU or accessing a GCP storage bucket (containing a trained checkpoint for example)?\n2. Or are there any TPU resources that would be used by the evaluation script during the commit?\n\nAs for the GCP Storage, I guess I can link my GCP account, and this would authorize my notebook  for accessing a GCP storage bucket, right? But if I pass a TPU address how and what would authorize the notebook to use the TPU?\n\nOr is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?",
    "676801": "&gt; Or is the TPU related code in the notebook just copy paste from the original example, that is never meant to execute during evaluation as the Kaggle Notebooks do not support TPU?\n\nI think that's the case, I have not heard about TPU support in kaggle kernels, although I've heard it's coming.",
    "683368": "Anyway, for submitting to competition, only CPU or GPU code is accepted: https://www.kaggle.com/c/tensorflow2-question-answering/overview/code-requirements"
  },
  "source": "meta"
}