{
  "id": 120210,
  "title": "Trying RAdam and....",
  "url": "/competitions/pku-autonomous-driving/discussion/120210",
  "author_name": "",
  "post_date": "2019-12-04T11:58:06.556978400Z",
  "votes": 5,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Adam worked good,AdamW worked well too but when trying RAdam - my situation : </p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2034058%2F3e2750056b55c2c2be92faf30e85ab11%2Fradam_Meme.gif?generation=1575460543691203&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": "687475",
      "postDate": "12/04/2019 11:58:06",
      "content": "<p>Adam worked good,AdamW worked well too but when trying RAdam - my situation : </p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2034058%2F3e2750056b55c2c2be92faf30e85ab11%2Fradam_Meme.gif?generation=1575460543691203&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Adam worked good,AdamW worked well too but when trying RAdam - my situation : \n \n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2034058%2F3e2750056b55c2c2be92faf30e85ab11%2Fradam_Meme.gif?generation=1575460543691203&amp;alt=media)",
      "votes": null
    },
    {
      "id": "688464",
      "postDate": "12/05/2019 16:04:36",
      "content": "<p>Yeah, I'm also still on the fence if RAdam works well in the general case. Is well better than good? In other words, does AdamW perform better than Adam? 😉 </p>",
      "rawMarkdown": "Yeah, I'm also still on the fence if RAdam works well in the general case. Is well better than good? In other words, does AdamW perform better than Adam? 😉",
      "votes": null
    },
    {
      "id": "688484",
      "postDate": "12/05/2019 16:23:17",
      "content": "<p>my friend <a href=\"/carlolepelaars\">@carlolepelaars</a> \nnone of my model that used RAdam converged but adam and adamW converged\nif i use RAdam then the model doesn't even predict anything because it doesn't converge\ni think AdamW is doing slightly better job than Adam,let me know if you got any success trying other optimizer?</p>",
      "rawMarkdown": "my friend @carlolepelaars \nnone of my model that used RAdam converged but adam and adamW converged\nif i use RAdam then the model doesn't even predict anything because it doesn't converge\ni think AdamW is doing slightly better job than Adam,let me know if you got any success trying other optimizer?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 688464,
      "author_name": "carlolepelaars",
      "author_url": "",
      "post_date": "12/05/2019 16:04:36",
      "content": "<p>Yeah, I'm also still on the fence if RAdam works well in the general case. Is well better than good? In other words, does AdamW perform better than Adam? 😉 </p>",
      "votes": null,
      "replies": [
        {
          "id": 688484,
          "author_name": "mobassir",
          "author_url": "",
          "post_date": "12/05/2019 16:23:17",
          "content": "<p>my friend <a href=\"/carlolepelaars\">@carlolepelaars</a> \nnone of my model that used RAdam converged but adam and adamW converged\nif i use RAdam then the model doesn't even predict anything because it doesn't converge\ni think AdamW is doing slightly better job than Adam,let me know if you got any success trying other optimizer?</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "687475": "Adam worked good,AdamW worked well too but when trying RAdam - my situation : \n \n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2034058%2F3e2750056b55c2c2be92faf30e85ab11%2Fradam_Meme.gif?generation=1575460543691203&amp;alt=media)",
    "688464": "Yeah, I'm also still on the fence if RAdam works well in the general case. Is well better than good? In other words, does AdamW perform better than Adam? 😉",
    "688484": "my friend @carlolepelaars \nnone of my model that used RAdam converged but adam and adamW converged\nif i use RAdam then the model doesn't even predict anything because it doesn't converge\ni think AdamW is doing slightly better job than Adam,let me know if you got any success trying other optimizer?"
  },
  "source": "meta"
}