{
  "id": 200179,
  "title": "Cosine Annealing Warm Restarts Scheduler Research Paper",
  "url": "/competitions/cassava-leaf-disease-classification/discussion/200179",
  "author_name": "",
  "post_date": "2020-11-29T08:46:28.181728100Z",
  "votes": 7,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Cosine annealing warm restarts perform really well in this competition🙌, learn together with the competition. I have added paper url[<a href=\"https://arxiv.org/abs/1608.03983v5\" target=\"_blank\">https://arxiv.org/abs/1608.03983v5</a>]</p>",
  "messages": [
    {
      "id": "1095106",
      "postDate": "11/29/2020 08:46:28",
      "content": "<p>Cosine annealing warm restarts perform really well in this competition🙌, learn together with the competition. I have added paper url[<a href=\"https://arxiv.org/abs/1608.03983v5\" target=\"_blank\">https://arxiv.org/abs/1608.03983v5</a>]</p>",
      "rawMarkdown": "Cosine annealing warm restarts perform really well in this competition🙌, learn together with the competition. I have added paper url[https://arxiv.org/abs/1608.03983v5]",
      "votes": null
    },
    {
      "id": "1096442",
      "postDate": "11/30/2020 13:54:36",
      "content": "<p>Fastai default scheduler is warm restarts only😋 for more info i would suggest to read the below<br>\n[<a href=\"https://www.google.com/amp/s/www.jeremyjordan.me/nn-learning-rate/amp/\" target=\"_blank\">https://www.google.com/amp/s/www.jeremyjordan.me/nn-learning-rate/amp/</a>]</p>",
      "rawMarkdown": "Fastai default scheduler is warm restarts only😋 for more info i would suggest to read the below\n[https://www.google.com/amp/s/www.jeremyjordan.me/nn-learning-rate/amp/]",
      "votes": null
    },
    {
      "id": "1130982",
      "postDate": "12/29/2020 13:26:09",
      "content": "<p>In my experiments, I have found that Adam with no LR  schedulers perform the same as Cosine Annealing Warm Restarts Scheduler does.</p>",
      "rawMarkdown": "In my experiments, I have found that Adam with no LR  schedulers perform the same as Cosine Annealing Warm Restarts Scheduler does.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1096442,
      "author_name": "santhoshkumarv",
      "author_url": "",
      "post_date": "11/30/2020 13:54:36",
      "content": "<p>Fastai default scheduler is warm restarts only😋 for more info i would suggest to read the below<br>\n[<a href=\"https://www.google.com/amp/s/www.jeremyjordan.me/nn-learning-rate/amp/\" target=\"_blank\">https://www.google.com/amp/s/www.jeremyjordan.me/nn-learning-rate/amp/</a>]</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1130982,
      "author_name": "prateek0x",
      "author_url": "",
      "post_date": "12/29/2020 13:26:09",
      "content": "<p>In my experiments, I have found that Adam with no LR  schedulers perform the same as Cosine Annealing Warm Restarts Scheduler does.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1095106": "Cosine annealing warm restarts perform really well in this competition🙌, learn together with the competition. I have added paper url[https://arxiv.org/abs/1608.03983v5]",
    "1096442": "Fastai default scheduler is warm restarts only😋 for more info i would suggest to read the below\n[https://www.google.com/amp/s/www.jeremyjordan.me/nn-learning-rate/amp/]",
    "1130982": "In my experiments, I have found that Adam with no LR  schedulers perform the same as Cosine Annealing Warm Restarts Scheduler does."
  },
  "source": "meta"
}