{
  "id": 182859,
  "title": "Hard Swish",
  "url": "/competitions/birdsong-recognition/discussion/182859",
  "author_name": "Kirderf",
  "post_date": "2020-09-14T16:04:00.427000",
  "votes": 6,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Hard Swish is now implemented in Pytorch as a built-in activation.<br>\n<a href=\"https://pytorch.org/docs/stable/generated/torch.nn.Hardswish.html#torch.nn.Hardswish\" target=\"_blank\">https://pytorch.org/docs/stable/generated/torch.nn.Hardswish.html#torch.nn.Hardswish</a></p>\n<p>\"swish was introduced that when used as a drop-in replacement for ReLU, that significantly improves the accuracy of neural networks.\"<br>\n\" The properties of Hard-Swish are similar to Swish…\"<br>\n\" Hard Swish faster in computation compared to swish…\"</p>\n<p><a href=\"https://arxiv.org/pdf/1905.02244.pdf\" target=\"_blank\">https://arxiv.org/pdf/1905.02244.pdf</a><br>\n<a href=\"https://paperswithcode.com/method/hard-swish\" target=\"_blank\">https://paperswithcode.com/method/hard-swish</a><br>\n<a href=\"https://www.semanticscholar.org/paper/Semantic-Segmentation-of-Satellite-Images-using-a-Avenash-Viswanath/78e865981aedf49d57d354136c0e97bb11379b25\" target=\"_blank\">https://www.semanticscholar.org/paper/Semantic-Segmentation-of-Satellite-Images-using-a-Avenash-Viswanath/78e865981aedf49d57d354136c0e97bb11379b25</a></p>",
  "messages": [
    {
      "id": 1010249,
      "postDate": "2020-09-14T16:04:00.427Z",
      "content": "<p>Hard Swish is now implemented in Pytorch as a built-in activation.<br>\n<a href=\"https://pytorch.org/docs/stable/generated/torch.nn.Hardswish.html#torch.nn.Hardswish\" target=\"_blank\">https://pytorch.org/docs/stable/generated/torch.nn.Hardswish.html#torch.nn.Hardswish</a></p>\n<p>\"swish was introduced that when used as a drop-in replacement for ReLU, that significantly improves the accuracy of neural networks.\"<br>\n\" The properties of Hard-Swish are similar to Swish…\"<br>\n\" Hard Swish faster in computation compared to swish…\"</p>\n<p><a href=\"https://arxiv.org/pdf/1905.02244.pdf\" target=\"_blank\">https://arxiv.org/pdf/1905.02244.pdf</a><br>\n<a href=\"https://paperswithcode.com/method/hard-swish\" target=\"_blank\">https://paperswithcode.com/method/hard-swish</a><br>\n<a href=\"https://www.semanticscholar.org/paper/Semantic-Segmentation-of-Satellite-Images-using-a-Avenash-Viswanath/78e865981aedf49d57d354136c0e97bb11379b25\" target=\"_blank\">https://www.semanticscholar.org/paper/Semantic-Segmentation-of-Satellite-Images-using-a-Avenash-Viswanath/78e865981aedf49d57d354136c0e97bb11379b25</a></p>",
      "rawMarkdown": "Hard Swish is now implemented in Pytorch as a built-in activation.\nhttps://pytorch.org/docs/stable/generated/torch.nn.Hardswish.html#torch.nn.Hardswish\n\n\"swish was introduced that when used as a drop-in replacement for ReLU, that significantly improves the accuracy of neural networks.\"\n\" The properties of Hard-Swish are similar to Swish...\"\n\" Hard Swish faster in computation compared to swish...\"\n\nhttps://arxiv.org/pdf/1905.02244.pdf\nhttps://paperswithcode.com/method/hard-swish\nhttps://www.semanticscholar.org/paper/Semantic-Segmentation-of-Satellite-Images-using-a-Avenash-Viswanath/78e865981aedf49d57d354136c0e97bb11379b25",
      "votes": 6
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1010249": "Hard Swish is now implemented in Pytorch as a built-in activation.\nhttps://pytorch.org/docs/stable/generated/torch.nn.Hardswish.html#torch.nn.Hardswish\n\n\"swish was introduced that when used as a drop-in replacement for ReLU, that significantly improves the accuracy of neural networks.\"\n\" The properties of Hard-Swish are similar to Swish...\"\n\" Hard Swish faster in computation compared to swish...\"\n\nhttps://arxiv.org/pdf/1905.02244.pdf\nhttps://paperswithcode.com/method/hard-swish\nhttps://www.semanticscholar.org/paper/Semantic-Segmentation-of-Satellite-Images-using-a-Avenash-Viswanath/78e865981aedf49d57d354136c0e97bb11379b25"
  }
}