{
  "id": 167262,
  "title": "Weight/snapshot ensembling? ",
  "url": "/competitions/siim-isic-melanoma-classification/discussion/167262",
  "author_name": "Phaedrus",
  "post_date": "2020-07-15T20:15:03.038000",
  "votes": 0,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Hi All,</p>\n\n<p>I want to ask if anyone has had any success with model weight ensemble. I recently tried to average weights for 2 of the best epochs, however, the result turned out to be worse than the single best epoch weight based predictions.</p>\n\n<p>I am not too sure why that is the case, usually whenever I have tried weight averaging it gave me a boost.</p>\n\n<p>Looking to get some thoughts on this. Has anyone had success with this strategy yet?</p>\n\n<p>Thanks</p>",
  "messages": [
    {
      "id": 930923,
      "postDate": "2020-07-15T20:15:03.037Z",
      "content": "<p>Hi All,</p>\n\n<p>I want to ask if anyone has had any success with model weight ensemble. I recently tried to average weights for 2 of the best epochs, however, the result turned out to be worse than the single best epoch weight based predictions.</p>\n\n<p>I am not too sure why that is the case, usually whenever I have tried weight averaging it gave me a boost.</p>\n\n<p>Looking to get some thoughts on this. Has anyone had success with this strategy yet?</p>\n\n<p>Thanks</p>",
      "rawMarkdown": "Hi All,\n\nI want to ask if anyone has had any success with model weight ensemble. I recently tried to average weights for 2 of the best epochs, however, the result turned out to be worse than the single best epoch weight based predictions.\n\nI am not too sure why that is the case, usually whenever I have tried weight averaging it gave me a boost.\n\nLooking to get some thoughts on this. Has anyone had success with this strategy yet?\n\nThanks"
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "930923": "Hi All,\n\nI want to ask if anyone has had any success with model weight ensemble. I recently tried to average weights for 2 of the best epochs, however, the result turned out to be worse than the single best epoch weight based predictions.\n\nI am not too sure why that is the case, usually whenever I have tried weight averaging it gave me a boost.\n\nLooking to get some thoughts on this. Has anyone had success with this strategy yet?\n\nThanks"
  }
}