{
  "id": 174778,
  "title": "MishBeta + ExponentialLR",
  "url": "/competitions/birdsong-recognition/discussion/174778",
  "author_name": "",
  "post_date": "2020-08-15T09:09:36.011366700Z",
  "votes": 7,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Looks smooth with the MishBeta+ExponentialLR setup</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2F9672257237d226fbf5e77ec69c7c3e06%2FlossMishExp.png?generation=1597482471496697&amp;alt=media\" alt=\"\"><br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2Fb06968586942b6794726c6ea111ff86f%2FlrMishExp.png?generation=1597482455842795&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": "971190",
      "postDate": "08/15/2020 09:09:36",
      "content": "<p>Looks smooth with the MishBeta+ExponentialLR setup</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2F9672257237d226fbf5e77ec69c7c3e06%2FlossMishExp.png?generation=1597482471496697&amp;alt=media\" alt=\"\"><br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2Fb06968586942b6794726c6ea111ff86f%2FlrMishExp.png?generation=1597482455842795&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Looks smooth with the MishBeta+ExponentialLR setup\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2F9672257237d226fbf5e77ec69c7c3e06%2FlossMishExp.png?generation=1597482471496697&alt=media)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2Fb06968586942b6794726c6ea111ff86f%2FlrMishExp.png?generation=1597482455842795&alt=media)",
      "votes": null
    },
    {
      "id": "971689",
      "postDate": "08/15/2020 20:02:39",
      "content": "<p>Looks stable, but what is an Mishbeta? </p>",
      "rawMarkdown": "Looks stable, but what is an Mishbeta?",
      "votes": null
    },
    {
      "id": "971694",
      "postDate": "08/15/2020 20:06:59",
      "content": "<p>It's the Mish layer with beta, instead of Relu.</p>",
      "rawMarkdown": "It's the Mish layer with beta, instead of Relu.",
      "votes": null
    },
    {
      "id": "971806",
      "postDate": "08/15/2020 23:02:58",
      "content": "<p>Wow, your model converges in like 15-20 epochs, that is impressive dude…</p>",
      "rawMarkdown": "Wow, your model converges in like 15-20 epochs, that is impressive dude...",
      "votes": null
    },
    {
      "id": "972037",
      "postDate": "08/16/2020 07:27:07",
      "content": "<p>then it's time to change the lr</p>",
      "rawMarkdown": "then it's time to change the lr",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 971689,
      "author_name": "koza4ukdmitrij",
      "author_url": "",
      "post_date": "08/15/2020 20:02:39",
      "content": "<p>Looks stable, but what is an Mishbeta? </p>",
      "votes": null,
      "replies": [
        {
          "id": 971694,
          "author_name": "kirderf",
          "author_url": "",
          "post_date": "08/15/2020 20:06:59",
          "content": "<p>It's the Mish layer with beta, instead of Relu.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 971806,
      "author_name": "returnofsputnik",
      "author_url": "",
      "post_date": "08/15/2020 23:02:58",
      "content": "<p>Wow, your model converges in like 15-20 epochs, that is impressive dude…</p>",
      "votes": null,
      "replies": [
        {
          "id": 972037,
          "author_name": "kirderf",
          "author_url": "",
          "post_date": "08/16/2020 07:27:07",
          "content": "<p>then it's time to change the lr</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "971190": "Looks smooth with the MishBeta+ExponentialLR setup\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2F9672257237d226fbf5e77ec69c7c3e06%2FlossMishExp.png?generation=1597482471496697&alt=media)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3924325%2Fb06968586942b6794726c6ea111ff86f%2FlrMishExp.png?generation=1597482455842795&alt=media)",
    "971689": "Looks stable, but what is an Mishbeta?",
    "971694": "It's the Mish layer with beta, instead of Relu.",
    "971806": "Wow, your model converges in like 15-20 epochs, that is impressive dude...",
    "972037": "then it's time to change the lr"
  },
  "source": "meta"
}