{
  "id": 126128,
  "title": "Boosted result using Adamod optimizer",
  "url": "/competitions/pku-autonomous-driving/discussion/126128",
  "author_name": "",
  "post_date": "2020-01-15T20:47:10.515974700Z",
  "votes": 1,
  "comment_count": 4,
  "views": 0,
  "content": "<p>` pip install adamod</p>\n\n<p>optimizer = adamod.AdaMod(model.parameters(), lr=1e-3, beta3=0.999)</p>\n\n<p>`</p>\n\n<p>Find more about adamod <a href=\"https://github.com/lancopku/AdaMod\">here.</a></p>\n\n<p>This helped me to boost my leaderboard ranking. I hope it helps you guys too. Have fun :)</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2718818%2F49ae2c7e0153f420b57ae6f2616870b7%2Fpasted%20image%200.png?generation=1579120940452742&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": "719778",
      "postDate": "01/15/2020 20:47:10",
      "content": "<p>` pip install adamod</p>\n\n<p>optimizer = adamod.AdaMod(model.parameters(), lr=1e-3, beta3=0.999)</p>\n\n<p>`</p>\n\n<p>Find more about adamod <a href=\"https://github.com/lancopku/AdaMod\">here.</a></p>\n\n<p>This helped me to boost my leaderboard ranking. I hope it helps you guys too. Have fun :)</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2718818%2F49ae2c7e0153f420b57ae6f2616870b7%2Fpasted%20image%200.png?generation=1579120940452742&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "` pip install adamod\n\n  optimizer = adamod.AdaMod(model.parameters(), lr=1e-3, beta3=0.999)\n\n`\n\nFind more about adamod [here.](https://github.com/lancopku/AdaMod)\n\nThis helped me to boost my leaderboard ranking. I hope it helps you guys too. Have fun :)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2718818%2F49ae2c7e0153f420b57ae6f2616870b7%2Fpasted%20image%200.png?generation=1579120940452742&amp;alt=media)",
      "votes": null
    },
    {
      "id": "719781",
      "postDate": "01/15/2020 20:51:40",
      "content": "<p>Thanks for share, I'll give it a try.\nBut pardon my doubts: a 0.002 increase in PB LB score might as well be random fluctuations. \nI get similar differences for just a rerun of a model.</p>",
      "rawMarkdown": "Thanks for share, I'll give it a try.\nBut pardon my doubts: a 0.002 increase in PB LB score might as well be random fluctuations. \nI get similar differences for just a rerun of a model.",
      "votes": null
    },
    {
      "id": "719858",
      "postDate": "01/15/2020 23:48:51",
      "content": "<p>You could be right. Here is a nice writeup about the advantage of this optimizer. Please check it out. It might give you some insights.<a href=\"https://medium.com/@lessw/meet-adamod-a-new-deep-learning-optimizer-with-memory-f01e831b80bd\">Link </a></p>",
      "rawMarkdown": "You could be right. Here is a nice writeup about the advantage of this optimizer. Please check it out. It might give you some insights.[Link ](https://medium.com/@lessw/meet-adamod-a-new-deep-learning-optimizer-with-memory-f01e831b80bd)",
      "votes": null
    },
    {
      "id": "721251",
      "postDate": "01/17/2020 08:21:47",
      "content": "",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "721592",
      "postDate": "01/17/2020 14:15:42",
      "content": "<p>Thanks <a href=\"/syoya1997\">@syoya1997</a> ! I will make sure to take a note about Less Wright.</p>",
      "rawMarkdown": "Thanks @syoya1997 ! I will make sure to take a note about Less Wright.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 719781,
      "author_name": "ilu000",
      "author_url": "",
      "post_date": "01/15/2020 20:51:40",
      "content": "<p>Thanks for share, I'll give it a try.\nBut pardon my doubts: a 0.002 increase in PB LB score might as well be random fluctuations. \nI get similar differences for just a rerun of a model.</p>",
      "votes": null,
      "replies": [
        {
          "id": 719858,
          "author_name": "subediaarjun",
          "author_url": "",
          "post_date": "01/15/2020 23:48:51",
          "content": "<p>You could be right. Here is a nice writeup about the advantage of this optimizer. Please check it out. It might give you some insights.<a href=\"https://medium.com/@lessw/meet-adamod-a-new-deep-learning-optimizer-with-memory-f01e831b80bd\">Link </a></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 721251,
      "author_name": "syoya1997",
      "author_url": "",
      "post_date": "01/17/2020 08:21:47",
      "content": "",
      "votes": null,
      "replies": [
        {
          "id": 721592,
          "author_name": "subediaarjun",
          "author_url": "",
          "post_date": "01/17/2020 14:15:42",
          "content": "<p>Thanks <a href=\"/syoya1997\">@syoya1997</a> ! I will make sure to take a note about Less Wright.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "719778": "` pip install adamod\n\n  optimizer = adamod.AdaMod(model.parameters(), lr=1e-3, beta3=0.999)\n\n`\n\nFind more about adamod [here.](https://github.com/lancopku/AdaMod)\n\nThis helped me to boost my leaderboard ranking. I hope it helps you guys too. Have fun :)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2718818%2F49ae2c7e0153f420b57ae6f2616870b7%2Fpasted%20image%200.png?generation=1579120940452742&amp;alt=media)",
    "719781": "Thanks for share, I'll give it a try.\nBut pardon my doubts: a 0.002 increase in PB LB score might as well be random fluctuations. \nI get similar differences for just a rerun of a model.",
    "719858": "You could be right. Here is a nice writeup about the advantage of this optimizer. Please check it out. It might give you some insights.[Link ](https://medium.com/@lessw/meet-adamod-a-new-deep-learning-optimizer-with-memory-f01e831b80bd)",
    "721251": "",
    "721592": "Thanks @syoya1997 ! I will make sure to take a note about Less Wright."
  },
  "source": "meta"
}