{
  "id": 160186,
  "title": "re-structure fine-tuned model",
  "url": "/competitions/jigsaw-multilingual-toxic-comment-classification/discussion/160186",
  "author_name": "Ziwei-base-uncased",
  "post_date": "2020-06-20T07:18:15.858000",
  "votes": 0,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I am not very familiar with pretrained model and I am wondering what should if I would like to change the structure of xlm-r(e.g. structure of the encoder-layers)and create my own custom xlm-r? Should I get the source code from huggingface and modify from scratch? Besides there seems to be no xlm-r source code...\nCan someone please give me a hint about it ? Thanks</p>",
  "messages": [
    {
      "id": 894115,
      "postDate": "2020-06-20T07:18:15.857Z",
      "content": "<p>I am not very familiar with pretrained model and I am wondering what should if I would like to change the structure of xlm-r(e.g. structure of the encoder-layers)and create my own custom xlm-r? Should I get the source code from huggingface and modify from scratch? Besides there seems to be no xlm-r source code...\nCan someone please give me a hint about it ? Thanks</p>",
      "rawMarkdown": "I am not very familiar with pretrained model and I am wondering what should if I would like to change the structure of xlm-r(e.g. structure of the encoder-layers)and create my own custom xlm-r? Should I get the source code from huggingface and modify from scratch? Besides there seems to be no xlm-r source code...\nCan someone please give me a hint about it ? Thanks"
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "894115": "I am not very familiar with pretrained model and I am wondering what should if I would like to change the structure of xlm-r(e.g. structure of the encoder-layers)and create my own custom xlm-r? Should I get the source code from huggingface and modify from scratch? Besides there seems to be no xlm-r source code...\nCan someone please give me a hint about it ? Thanks"
  }
}