{
  "id": 155749,
  "title": "Weird error while training the model on TPU",
  "url": "/competitions/siim-isic-melanoma-classification/discussion/155749",
  "author_name": "",
  "post_date": "2020-06-02T20:32:35.544246400Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Hi,</p>\n\n<p>While I was training my model on TPU, it gives a weird error:</p>\n\n<blockquote>\n  <p>NotFoundError: {{function_node __inference_distributed_function_431538}} No registered 'PyFunc' OpKernel for 'CPU' devices compatible with node {{node PyFunc}} . \n  Registered:  [[PyFunc]] [[MultiDeviceIteratorGetNextFromShard]] [[RemoteCall]] [[IteratorGetNextAsOptional]]</p>\n</blockquote>\n\n<p>PS: The same model runs smoothly on GPU/No Accelerator. </p>\n\n<p>Please Help.</p>\n\n<p>Thank You!</p>",
  "messages": [
    {
      "id": "872021",
      "postDate": "06/02/2020 20:32:35",
      "content": "<p>Hi,</p>\n\n<p>While I was training my model on TPU, it gives a weird error:</p>\n\n<blockquote>\n  <p>NotFoundError: {{function_node __inference_distributed_function_431538}} No registered 'PyFunc' OpKernel for 'CPU' devices compatible with node {{node PyFunc}} . \n  Registered:  [[PyFunc]] [[MultiDeviceIteratorGetNextFromShard]] [[RemoteCall]] [[IteratorGetNextAsOptional]]</p>\n</blockquote>\n\n<p>PS: The same model runs smoothly on GPU/No Accelerator. </p>\n\n<p>Please Help.</p>\n\n<p>Thank You!</p>",
      "rawMarkdown": "Hi,\n\nWhile I was training my model on TPU, it gives a weird error:\n\n&gt;  NotFoundError: {{function_node __inference_distributed_function_431538}} No registered 'PyFunc' OpKernel for 'CPU' devices compatible with node {{node PyFunc}} . \nRegistered:",
      "votes": null
    },
    {
      "id": "872023",
      "postDate": "06/02/2020 20:34:05",
      "content": "<p>PS: The same model runs well on GPU/None accelerator</p>",
      "rawMarkdown": "PS: The same model runs well on GPU/None accelerator",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 872023,
      "author_name": "sudippadhye",
      "author_url": "",
      "post_date": "06/02/2020 20:34:05",
      "content": "<p>PS: The same model runs well on GPU/None accelerator</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "872021": "Hi,\n\nWhile I was training my model on TPU, it gives a weird error:\n\n&gt;  NotFoundError: {{function_node __inference_distributed_function_431538}} No registered 'PyFunc' OpKernel for 'CPU' devices compatible with node {{node PyFunc}} . \nRegistered:",
    "872023": "PS: The same model runs well on GPU/None accelerator"
  },
  "source": "meta"
}