{
  "id": 234729,
  "title": "TPU training with PyTorch/Lightning",
  "url": "/competitions/bms-molecular-translation/discussion/234729",
  "author_name": "Adam Mehdi",
  "post_date": "2021-04-25T22:47:56.260000",
  "votes": 3,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I've been experimenting with applying the TPU to ViT &amp; CNN/LSTM networks (similar to this <a href=\"https://www.kaggle.com/juansensio/e2e-transformer\" target=\"_blank\">transformer notebook using Lightning</a>) but have gotten several cryptic error messages. I'm using Lightning, and after following docs and sample notebooks, the TPU is recognized by my Trainer but aborts as I begin training.</p>\n<p>Has anyone gotten the TPU to work on PyTorch or Lightning on these sequence tasks, and any tips for a beginner to do the same? 🙏🙏</p>",
  "messages": [
    {
      "id": 1284428,
      "postDate": "2021-04-25T22:47:56.260Z",
      "content": "<p>I've been experimenting with applying the TPU to ViT &amp; CNN/LSTM networks (similar to this <a href=\"https://www.kaggle.com/juansensio/e2e-transformer\" target=\"_blank\">transformer notebook using Lightning</a>) but have gotten several cryptic error messages. I'm using Lightning, and after following docs and sample notebooks, the TPU is recognized by my Trainer but aborts as I begin training.</p>\n<p>Has anyone gotten the TPU to work on PyTorch or Lightning on these sequence tasks, and any tips for a beginner to do the same? 🙏🙏</p>",
      "rawMarkdown": "I've been experimenting with applying the TPU to ViT & CNN/LSTM networks (similar to this [transformer notebook using Lightning](https://www.kaggle.com/juansensio/e2e-transformer)) but have gotten several cryptic error messages. I'm using Lightning, and after following docs and sample notebooks, the TPU is recognized by my Trainer but aborts as I begin training.\n\nHas anyone gotten the TPU to work on PyTorch or Lightning on these sequence tasks, and any tips for a beginner to do the same? 🙏🙏",
      "votes": 3
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1284428": "I've been experimenting with applying the TPU to ViT & CNN/LSTM networks (similar to this [transformer notebook using Lightning](https://www.kaggle.com/juansensio/e2e-transformer)) but have gotten several cryptic error messages. I'm using Lightning, and after following docs and sample notebooks, the TPU is recognized by my Trainer but aborts as I begin training.\n\nHas anyone gotten the TPU to work on PyTorch or Lightning on these sequence tasks, and any tips for a beginner to do the same? 🙏🙏"
  }
}