{
  "id": 232333,
  "title": "EfficientNet V2",
  "url": "/competitions/bms-molecular-translation/discussion/232333",
  "author_name": "",
  "post_date": "2021-04-13T09:55:50.424508500Z",
  "votes": 11,
  "comment_count": 3,
  "views": 0,
  "content": "<p>The second iteration of the famous EfficientNet model family has been released. The authors claim huge improvements.</p>\n<pre><code>Compared to EfficientNet and more recent works, our EfficientNetV2 trains up to 11x faster while being up to 6.8x smaller.\n</code></pre>\n<p>This image from the paper sums it up quite nicely (model tagged with 21K are pretrained on ImageNet21k)</p>\n<p><img src=\"https://i.postimg.cc/X7vsbKJh/image.png\" alt=\"image\"></p>\n<p>A detailed comparison between the V1 EfficientNetB7 model and the V2 M model show the potential improvements, especially the training time reduction is fascinating.</p>\n<p><img src=\"https://i.postimg.cc/NjGhH2dv/image2.png\" alt=\"image2\"></p>\n<p>The paper can be found <a href=\"https://arxiv.org/pdf/2104.00298.pdf\" target=\"_blank\">here</a> and a <a href=\"https://github.com/lukemelas/EfficientNet-PyTorch\" target=\"_blank\">Pytorch implementation</a> is on its way. A Tensorflow implementation should be released <a href=\"https://github.com/google/automl/tree/master/efficientnetv2\" target=\"_blank\">here</a>.</p>\n<p>As this competition is hugely computationally intensive, these models could cause a breakthrough for the encoders.</p>",
  "messages": [
    {
      "id": "1272197",
      "postDate": "04/13/2021 09:55:50",
      "content": "<p>The second iteration of the famous EfficientNet model family has been released. The authors claim huge improvements.</p>\n<pre><code>Compared to EfficientNet and more recent works, our EfficientNetV2 trains up to 11x faster while being up to 6.8x smaller.\n</code></pre>\n<p>This image from the paper sums it up quite nicely (model tagged with 21K are pretrained on ImageNet21k)</p>\n<p><img src=\"https://i.postimg.cc/X7vsbKJh/image.png\" alt=\"image\"></p>\n<p>A detailed comparison between the V1 EfficientNetB7 model and the V2 M model show the potential improvements, especially the training time reduction is fascinating.</p>\n<p><img src=\"https://i.postimg.cc/NjGhH2dv/image2.png\" alt=\"image2\"></p>\n<p>The paper can be found <a href=\"https://arxiv.org/pdf/2104.00298.pdf\" target=\"_blank\">here</a> and a <a href=\"https://github.com/lukemelas/EfficientNet-PyTorch\" target=\"_blank\">Pytorch implementation</a> is on its way. A Tensorflow implementation should be released <a href=\"https://github.com/google/automl/tree/master/efficientnetv2\" target=\"_blank\">here</a>.</p>\n<p>As this competition is hugely computationally intensive, these models could cause a breakthrough for the encoders.</p>",
      "rawMarkdown": "The second iteration of the famous EfficientNet model family has been released. The authors claim huge improvements.\n\n```\nCompared to EfficientNet and more recent works, our EfficientNetV2 trains up to 11x faster while being up to 6.8x smaller.\n```\n\nThis image from the paper sums it up quite nicely (model tagged with 21K are pretrained on ImageNet21k)\n\n![image](https://i.postimg.cc/X7vsbKJh/image.png)\n\nA detailed comparison between the V1 EfficientNetB7 model and the V2 M model show the potential improvements, especially the training time reduction is fascinating.\n\n![image2](https://i.postimg.cc/NjGhH2dv/image2.png)\n\nThe paper can be found [here](https://arxiv.org/pdf/2104.00298.pdf) and a [Pytorch implementation](https://github.com/lukemelas/EfficientNet-PyTorch) is on its way. A Tensorflow implementation should be released [here](https://github.com/google/automl/tree/master/efficientnetv2).\n\nAs this competition is hugely computationally intensive, these models could cause a breakthrough for the encoders.",
      "votes": null
    },
    {
      "id": "1272268",
      "postDate": "04/13/2021 11:18:27",
      "content": "<p>this is interesting, from the paper:</p>\n<p>\"4.2. Progressive Learning with adaptive Regularization\"</p>\n<p>Then, we gradually increase image size but also<br>\nmaking learning more difficult by adding stronger regularization. Our approach is built upon (Howard, 2018) that<br>\nprogressively changes image size, but here we adaptively<br>\nadjust regularization as well.</p>",
      "rawMarkdown": "this is interesting, from the paper:\n\n\"4.2. Progressive Learning with adaptive Regularization\"\n\nThen, we gradually increase image size but also\nmaking learning more difficult by adding stronger regularization. Our approach is built upon (Howard, 2018) that\nprogressively changes image size, but here we adaptively\nadjust regularization as well.",
      "votes": null
    },
    {
      "id": "1280492",
      "postDate": "04/22/2021 03:22:51",
      "content": "<p>Waiting for tensorflow/keras model to come-up sooner 🌈</p>",
      "rawMarkdown": "Waiting for tensorflow/keras model to come-up sooner 🌈",
      "votes": null
    },
    {
      "id": "1283712",
      "postDate": "04/25/2021 07:43:43",
      "content": "<p>release early so that we can use it . appreciate.</p>",
      "rawMarkdown": "release early so that we can use it . appreciate.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1272268,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "04/13/2021 11:18:27",
      "content": "<p>this is interesting, from the paper:</p>\n<p>\"4.2. Progressive Learning with adaptive Regularization\"</p>\n<p>Then, we gradually increase image size but also<br>\nmaking learning more difficult by adding stronger regularization. Our approach is built upon (Howard, 2018) that<br>\nprogressively changes image size, but here we adaptively<br>\nadjust regularization as well.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1280492,
      "author_name": "akhileshdkapse",
      "author_url": "",
      "post_date": "04/22/2021 03:22:51",
      "content": "<p>Waiting for tensorflow/keras model to come-up sooner 🌈</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1283712,
      "author_name": "dragonzhang",
      "author_url": "",
      "post_date": "04/25/2021 07:43:43",
      "content": "<p>release early so that we can use it . appreciate.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1272197": "The second iteration of the famous EfficientNet model family has been released. The authors claim huge improvements.\n\n```\nCompared to EfficientNet and more recent works, our EfficientNetV2 trains up to 11x faster while being up to 6.8x smaller.\n```\n\nThis image from the paper sums it up quite nicely (model tagged with 21K are pretrained on ImageNet21k)\n\n![image](https://i.postimg.cc/X7vsbKJh/image.png)\n\nA detailed comparison between the V1 EfficientNetB7 model and the V2 M model show the potential improvements, especially the training time reduction is fascinating.\n\n![image2](https://i.postimg.cc/NjGhH2dv/image2.png)\n\nThe paper can be found [here](https://arxiv.org/pdf/2104.00298.pdf) and a [Pytorch implementation](https://github.com/lukemelas/EfficientNet-PyTorch) is on its way. A Tensorflow implementation should be released [here](https://github.com/google/automl/tree/master/efficientnetv2).\n\nAs this competition is hugely computationally intensive, these models could cause a breakthrough for the encoders.",
    "1272268": "this is interesting, from the paper:\n\n\"4.2. Progressive Learning with adaptive Regularization\"\n\nThen, we gradually increase image size but also\nmaking learning more difficult by adding stronger regularization. Our approach is built upon (Howard, 2018) that\nprogressively changes image size, but here we adaptively\nadjust regularization as well.",
    "1280492": "Waiting for tensorflow/keras model to come-up sooner 🌈",
    "1283712": "release early so that we can use it . appreciate."
  },
  "source": "meta"
}