{
  "id": 312725,
  "title": "Anyone can train model well with Pytorch and TPU ？",
  "url": "/competitions/happy-whale-and-dolphin/discussion/312725",
  "author_name": "",
  "post_date": "2022-03-13T18:58:18.742980700Z",
  "votes": 2,
  "comment_count": 6,
  "views": 0,
  "content": "<p>I'm trying to train my model with Pytorch and TPU. To use TPU, I ran a lot of notebooks or sample code(even official notebook). However, almost all of then didn't work because of errors, or even work , it's  slower than GPU.  Did anyone use TPU with Pytorch and train well ?  If you could, could you share your notebook with me ?<br>\nThank you for reading.</p>",
  "messages": [
    {
      "id": "1721535",
      "postDate": "03/13/2022 18:58:18",
      "content": "<p>I'm trying to train my model with Pytorch and TPU. To use TPU, I ran a lot of notebooks or sample code(even official notebook). However, almost all of then didn't work because of errors, or even work , it's  slower than GPU.  Did anyone use TPU with Pytorch and train well ?  If you could, could you share your notebook with me ?<br>\nThank you for reading.</p>",
      "rawMarkdown": "I'm trying to train my model with Pytorch and TPU. To use TPU, I ran a lot of notebooks or sample code(even official notebook). However, almost all of then didn't work because of errors, or even work , it's  slower than GPU.  Did anyone use TPU with Pytorch and train well ?  If you could, could you share your notebook with me ?\nThank you for reading.",
      "votes": null
    },
    {
      "id": "1722197",
      "postDate": "03/14/2022 09:39:07",
      "content": "<p><a href=\"https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309935\" target=\"_blank\">https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309935</a></p>",
      "rawMarkdown": "https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309935",
      "votes": null
    },
    {
      "id": "1722269",
      "postDate": "03/14/2022 11:31:11",
      "content": "<p>i tried on ventilator challenge from google but failed with XLA :) tried huggingface accelerate as well</p>",
      "rawMarkdown": "i tried on ventilator challenge from google but failed with XLA :) tried huggingface accelerate as well",
      "votes": null
    },
    {
      "id": "1722489",
      "postDate": "03/14/2022 15:22:56",
      "content": "<p><a href=\"https://www.kaggle.com/lukaszborecki\" target=\"_blank\">@lukaszborecki</a> I have read great things about accelerate and have been eager to try it. <br>\nMay I ask how was your experience/workflow with it?</p>\n<p>Thanks in advance!</p>",
      "rawMarkdown": "lukaszborecki I have read great things about accelerate and have been eager to try it. \nMay I ask how was your experience/workflow with it?\n\nThanks in advance!",
      "votes": null
    },
    {
      "id": "1722640",
      "postDate": "03/14/2022 18:38:08",
      "content": "<p>Thank you for sharing your  great notebook！<br>\nPlease tell me how long it takes per epoch  for reference ?</p>",
      "rawMarkdown": "Thank you for sharing your  great notebook！\nPlease tell me how long it takes per epoch  for reference ?",
      "votes": null
    },
    {
      "id": "1722648",
      "postDate": "03/14/2022 18:41:38",
      "content": "<p><a href=\"https://www.kaggle.com/lukaszborecki\" target=\"_blank\">@lukaszborecki</a> <br>\nSo, did you get 10th place score without TPU？<br>\nI thought TPU is almost must for enough training because GPU is slow for metric learning… </p>",
      "rawMarkdown": "lukaszborecki \nSo, did you get 10th place score without TPU？\nI thought TPU is almost must for enough training because GPU is slow for metric learning...",
      "votes": null
    },
    {
      "id": "1722652",
      "postDate": "03/14/2022 18:45:55",
      "content": "<p>Guys ventilator challenge not here. Amd i switch to tpu and tf because i failed with it🙂</p>",
      "rawMarkdown": "Guys ventilator challenge not here. Amd i switch to tpu and tf because i failed with it🙂",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1722197,
      "author_name": "dragonzhang",
      "author_url": "",
      "post_date": "03/14/2022 09:39:07",
      "content": "<p><a href=\"https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309935\" target=\"_blank\">https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309935</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 1722640,
          "author_name": "whitelily",
          "author_url": "",
          "post_date": "03/14/2022 18:38:08",
          "content": "<p>Thank you for sharing your  great notebook！<br>\nPlease tell me how long it takes per epoch  for reference ?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1722269,
      "author_name": "lukaszborecki",
      "author_url": "",
      "post_date": "03/14/2022 11:31:11",
      "content": "<p>i tried on ventilator challenge from google but failed with XLA :) tried huggingface accelerate as well</p>",
      "votes": null,
      "replies": [
        {
          "id": 1722489,
          "author_name": "init27",
          "author_url": "",
          "post_date": "03/14/2022 15:22:56",
          "content": "<p><a href=\"https://www.kaggle.com/lukaszborecki\" target=\"_blank\">@lukaszborecki</a> I have read great things about accelerate and have been eager to try it. <br>\nMay I ask how was your experience/workflow with it?</p>\n<p>Thanks in advance!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1722648,
          "author_name": "whitelily",
          "author_url": "",
          "post_date": "03/14/2022 18:41:38",
          "content": "<p><a href=\"https://www.kaggle.com/lukaszborecki\" target=\"_blank\">@lukaszborecki</a> <br>\nSo, did you get 10th place score without TPU？<br>\nI thought TPU is almost must for enough training because GPU is slow for metric learning… </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1722652,
          "author_name": "lukaszborecki",
          "author_url": "",
          "post_date": "03/14/2022 18:45:55",
          "content": "<p>Guys ventilator challenge not here. Amd i switch to tpu and tf because i failed with it🙂</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1721535": "I'm trying to train my model with Pytorch and TPU. To use TPU, I ran a lot of notebooks or sample code(even official notebook). However, almost all of then didn't work because of errors, or even work , it's  slower than GPU.  Did anyone use TPU with Pytorch and train well ?  If you could, could you share your notebook with me ?\nThank you for reading.",
    "1722197": "https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309935",
    "1722269": "i tried on ventilator challenge from google but failed with XLA :) tried huggingface accelerate as well",
    "1722489": "lukaszborecki I have read great things about accelerate and have been eager to try it. \nMay I ask how was your experience/workflow with it?\n\nThanks in advance!",
    "1722640": "Thank you for sharing your  great notebook！\nPlease tell me how long it takes per epoch  for reference ?",
    "1722648": "lukaszborecki \nSo, did you get 10th place score without TPU？\nI thought TPU is almost must for enough training because GPU is slow for metric learning...",
    "1722652": "Guys ventilator challenge not here. Amd i switch to tpu and tf because i failed with it🙂"
  },
  "source": "meta"
}