{
  "id": 117716,
  "title": "Hugging Face Transformers: PyTorch Setup",
  "url": "/competitions/tensorflow2-question-answering/discussion/117716",
  "author_name": "Ram Ramrakhya",
  "post_date": "2019-11-17T10:02:14.970000",
  "votes": 14,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I've created a  kernel that provides the required datasets and commands to setup Hugging Face Transformers setup in offline mode. You can find the required github codebases in the datasets.</p>\n\n<ol>\n<li>sacremoses dependency - <a href=\"https://www.kaggle.com/axel81/sacremoses\">https://www.kaggle.com/axel81/sacremoses</a></li>\n<li>transformers - <a href=\"https://www.kaggle.com/axel81/transformers\">https://www.kaggle.com/axel81/transformers</a></li>\n</ol>\n\n<p>Sacremoses is a dependency for Hugging Face transformer. As we don't have internet access we have to install it manually.</p>\n\n<p>Here is the link to kernel: <a href=\"https://www.kaggle.com/axel81/hugging-face-transformers-pytorch-setup/\">https://www.kaggle.com/axel81/hugging-face-transformers-pytorch-setup/</a></p>\n\n<p>Hope this helps! :)</p>",
  "messages": [
    {
      "id": 674949,
      "postDate": "2019-11-17T10:02:14.970Z",
      "content": "<p>I've created a  kernel that provides the required datasets and commands to setup Hugging Face Transformers setup in offline mode. You can find the required github codebases in the datasets.</p>\n\n<ol>\n<li>sacremoses dependency - <a href=\"https://www.kaggle.com/axel81/sacremoses\">https://www.kaggle.com/axel81/sacremoses</a></li>\n<li>transformers - <a href=\"https://www.kaggle.com/axel81/transformers\">https://www.kaggle.com/axel81/transformers</a></li>\n</ol>\n\n<p>Sacremoses is a dependency for Hugging Face transformer. As we don't have internet access we have to install it manually.</p>\n\n<p>Here is the link to kernel: <a href=\"https://www.kaggle.com/axel81/hugging-face-transformers-pytorch-setup/\">https://www.kaggle.com/axel81/hugging-face-transformers-pytorch-setup/</a></p>\n\n<p>Hope this helps! :)</p>",
      "rawMarkdown": "I've created a  kernel that provides the required datasets and commands to setup Hugging Face Transformers setup in offline mode. You can find the required github codebases in the datasets.\n\n1. sacremoses dependency - https://www.kaggle.com/axel81/sacremoses\n2. transformers - https://www.kaggle.com/axel81/transformers\n\nSacremoses is a dependency for Hugging Face transformer. As we don't have internet access we have to install it manually.\n\nHere is the link to kernel: https://www.kaggle.com/axel81/hugging-face-transformers-pytorch-setup/\n\nHope this helps! :)",
      "votes": 14
    },
    {
      "id": 1112011,
      "postDate": "2020-12-14T07:55:29.323Z",
      "content": "<p>Came across another blog about hugging face transformers, which Could help someone.</p>\n<p><a href=\"https://tanmay17061.medium.com/transformers-retraining-roberta-base-using-the-roberta-mlm-procedure-7422160d5764\" target=\"_blank\">https://tanmay17061.medium.com/transformers-retraining-roberta-base-using-the-roberta-mlm-procedure-7422160d5764</a></p>",
      "rawMarkdown": "Came across another blog about hugging face transformers, which Could help someone.\n\nhttps://tanmay17061.medium.com/transformers-retraining-roberta-base-using-the-roberta-mlm-procedure-7422160d5764"
    },
    {
      "id": 727533,
      "postDate": "2020-01-23T19:14:36.270Z",
      "content": "<p>Thanks for the setup. This is indeed very useful without internet. ;)</p>",
      "rawMarkdown": "Thanks for the setup. This is indeed very useful without internet. ;)"
    },
    {
      "id": 693930,
      "postDate": "2019-12-13T00:53:56.393Z",
      "content": "<p>Thanks for posting this! I'm pretty new to kaggle, so I appreciated the pointers on how to use the packages I need within the kernels-type competitions.</p>",
      "rawMarkdown": "Thanks for posting this! I'm pretty new to kaggle, so I appreciated the pointers on how to use the packages I need within the kernels-type competitions."
    },
    {
      "id": 674967,
      "postDate": "2019-11-17T10:53:35.253Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1112011,
      "author_name": "Urvashi Choudhary",
      "author_url": "",
      "post_date": "2020-12-14T07:55:29.323000",
      "content": "<p>Came across another blog about hugging face transformers, which Could help someone.</p>\n<p><a href=\"https://tanmay17061.medium.com/transformers-retraining-roberta-base-using-the-roberta-mlm-procedure-7422160d5764\" target=\"_blank\">https://tanmay17061.medium.com/transformers-retraining-roberta-base-using-the-roberta-mlm-procedure-7422160d5764</a></p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 727533,
      "author_name": "Yassine Alouini",
      "author_url": "",
      "post_date": "2020-01-23T19:14:36.270000",
      "content": "<p>Thanks for the setup. This is indeed very useful without internet. ;)</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 693930,
      "author_name": "Melissa Rajaram",
      "author_url": "",
      "post_date": "2019-12-13T00:53:56.393000",
      "content": "<p>Thanks for posting this! I'm pretty new to kaggle, so I appreciated the pointers on how to use the packages I need within the kernels-type competitions.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 674967,
      "author_name": "",
      "author_url": "",
      "post_date": "2019-11-17T10:53:35.253000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "674949": "I've created a  kernel that provides the required datasets and commands to setup Hugging Face Transformers setup in offline mode. You can find the required github codebases in the datasets.\n\n1. sacremoses dependency - https://www.kaggle.com/axel81/sacremoses\n2. transformers - https://www.kaggle.com/axel81/transformers\n\nSacremoses is a dependency for Hugging Face transformer. As we don't have internet access we have to install it manually.\n\nHere is the link to kernel: https://www.kaggle.com/axel81/hugging-face-transformers-pytorch-setup/\n\nHope this helps! :)",
    "1112011": "Came across another blog about hugging face transformers, which Could help someone.\n\nhttps://tanmay17061.medium.com/transformers-retraining-roberta-base-using-the-roberta-mlm-procedure-7422160d5764",
    "727533": "Thanks for the setup. This is indeed very useful without internet. ;)",
    "693930": "Thanks for posting this! I'm pretty new to kaggle, so I appreciated the pointers on how to use the packages I need within the kernels-type competitions.",
    "674967": ""
  }
}