{
  "id": 307831,
  "title": "🎖 Summary of all solutions shared + Tricks🎖",
  "url": "/competitions/tensorflow-great-barrier-reef/discussion/307831",
  "author_name": "",
  "post_date": "2022-02-15T20:01:35.661665600Z",
  "votes": 30,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi All! </p>\n<p>For a long time I have wanted to create summary videos of every competition where I can share interesting bits &amp; tricks from each solution (with due credit, ofcourse). </p>\n<p>I have been working on the idea for this comp and <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307598\" target=\"_blank\">reading through every solution</a> shared, so I decided to summarise interesting bits in a thread as well:</p>\n<hr>\n<h3>Models:</h3>\n<p>Based on all top readups, I learned YOLO family was a large part of the majority solutions, some teams had also used RCNNs in the ensembles or as single models:</p>\n<ul>\n<li>Why Yolov5s6 is more effective was discussed <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/300638\" target=\"_blank\">here</a></li>\n<li><a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786\" target=\"_blank\">7th Pos solution</a> used a <em>single</em> model: Custom Cascade RCNN </li>\n<li><a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307735\" target=\"_blank\">8th Pos Solution</a> used a <code>Cascade RCNN with a backbone: convnext base</code>, I would be super curious to check their code out if they post it </li>\n</ul>\n<h3>Image Augmentations</h3>\n<p>I was curious about seeing what Image Augmentations work really well in this setting: </p>\n<p>I saw many new techniques named, again apologies to everyone who is familiar with these: CLAHE, Image Compression, Coarse Dropout, Mosaic, a few more. Need to learn more about these!</p>\n<p>Most interestingly, <a href=\"https://www.kaggle.com/bestfitting\" target=\"_blank\">@bestfitting</a> shared they were working on using GANs for image Augmentations! I'm really curious to explore this further and would love to know if anyone has had any success working with this!</p>\n<p>Tricks:</p>\n<p>The Devil is in the details and there is a lot of gold too, from inventing a new Augmentation technique, to discovering tricks of reducing GPU usage by splitting images, Decreasing stride to increase model resolution there were many interesting tricks shared:</p>\n<ul>\n<li>\"Background Mix Augmentation\" by <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307707\" target=\"_blank\">3rd Position</a>: Mixing an image with a BBOX + Image without BBOX to improve generalisation &gt;&gt; Cut paste Aug</li>\n<li>Reduce GPU Usage: <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307753v\" target=\"_blank\">13th Pos</a>-Upscale images, split them and discard split without bounding box for optimising GPU usage!</li>\n<li>Progressive Learning</li>\n<li>Multiscale inference </li>\n<li>Strong + Weak Augmentation: <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786\" target=\"_blank\">7th Place</a></li>\n<li>Decrease stride to increase model resolution: <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307756\" target=\"_blank\">10th place</a> </li>\n</ul>\n<p>Most imp trick in book of Kaggle: Trusting CV, demonstrated by 1st Pos and everyone that survived the shake up well</p>\n<p>PS: I have been reading all day in enthusiastic preparation for my chai interviews and summary video, so I will update this once more solutions are shared and getting some sleep 😅</p>\n<p>Thanks everyone and congratulations to everyone for the awesome finish!</p>",
  "messages": [
    {
      "id": "1692097",
      "postDate": "02/15/2022 20:01:35",
      "content": "<p>Hi All! </p>\n<p>For a long time I have wanted to create summary videos of every competition where I can share interesting bits &amp; tricks from each solution (with due credit, ofcourse). </p>\n<p>I have been working on the idea for this comp and <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307598\" target=\"_blank\">reading through every solution</a> shared, so I decided to summarise interesting bits in a thread as well:</p>\n<hr>\n<h3>Models:</h3>\n<p>Based on all top readups, I learned YOLO family was a large part of the majority solutions, some teams had also used RCNNs in the ensembles or as single models:</p>\n<ul>\n<li>Why Yolov5s6 is more effective was discussed <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/300638\" target=\"_blank\">here</a></li>\n<li><a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786\" target=\"_blank\">7th Pos solution</a> used a <em>single</em> model: Custom Cascade RCNN </li>\n<li><a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307735\" target=\"_blank\">8th Pos Solution</a> used a <code>Cascade RCNN with a backbone: convnext base</code>, I would be super curious to check their code out if they post it </li>\n</ul>\n<h3>Image Augmentations</h3>\n<p>I was curious about seeing what Image Augmentations work really well in this setting: </p>\n<p>I saw many new techniques named, again apologies to everyone who is familiar with these: CLAHE, Image Compression, Coarse Dropout, Mosaic, a few more. Need to learn more about these!</p>\n<p>Most interestingly, <a href=\"https://www.kaggle.com/bestfitting\" target=\"_blank\">@bestfitting</a> shared they were working on using GANs for image Augmentations! I'm really curious to explore this further and would love to know if anyone has had any success working with this!</p>\n<p>Tricks:</p>\n<p>The Devil is in the details and there is a lot of gold too, from inventing a new Augmentation technique, to discovering tricks of reducing GPU usage by splitting images, Decreasing stride to increase model resolution there were many interesting tricks shared:</p>\n<ul>\n<li>\"Background Mix Augmentation\" by <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307707\" target=\"_blank\">3rd Position</a>: Mixing an image with a BBOX + Image without BBOX to improve generalisation &gt;&gt; Cut paste Aug</li>\n<li>Reduce GPU Usage: <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307753v\" target=\"_blank\">13th Pos</a>-Upscale images, split them and discard split without bounding box for optimising GPU usage!</li>\n<li>Progressive Learning</li>\n<li>Multiscale inference </li>\n<li>Strong + Weak Augmentation: <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786\" target=\"_blank\">7th Place</a></li>\n<li>Decrease stride to increase model resolution: <a href=\"https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307756\" target=\"_blank\">10th place</a> </li>\n</ul>\n<p>Most imp trick in book of Kaggle: Trusting CV, demonstrated by 1st Pos and everyone that survived the shake up well</p>\n<p>PS: I have been reading all day in enthusiastic preparation for my chai interviews and summary video, so I will update this once more solutions are shared and getting some sleep 😅</p>\n<p>Thanks everyone and congratulations to everyone for the awesome finish!</p>",
      "rawMarkdown": "Hi All! \n\nFor a long time I have wanted to create summary videos of every competition where I can share interesting bits & tricks from each solution (with due credit, ofcourse). \n\nI have been working on the idea for this comp and [reading through every solution](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307598) shared, so I decided to summarise interesting bits in a thread as well:\n\n____\n\n\n### Models:\n\nBased on all top readups, I learned YOLO family was a large part of the majority solutions, some teams had also used RCNNs in the ensembles or as single models:\n\n- Why Yolov5s6 is more effective was discussed [here](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/300638)\n- [7th Pos solution](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786) used a *single* model: Custom Cascade RCNN \n- [8th Pos Solution](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307735) used a `Cascade RCNN with a backbone: convnext base`, I would be super curious to check their code out if they post it \n\n### Image Augmentations\n\nI was curious about seeing what Image Augmentations work really well in this setting: \n\nI saw many new techniques named, again apologies to everyone who is familiar with these: CLAHE, Image Compression, Coarse Dropout, Mosaic, a few more. Need to learn more about these!\n\nMost interestingly, @bestfitting shared they were working on using GANs for image Augmentations! I'm really curious to explore this further and would love to know if anyone has had any success working with this!\n\nTricks:\n\nThe Devil is in the details and there is a lot of gold too, from inventing a new Augmentation technique, to discovering tricks of reducing GPU usage by splitting images, Decreasing stride to increase model resolution there were many interesting tricks shared:\n\n- \"Background Mix Augmentation\" by [3rd Position](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307707): Mixing an image with a BBOX + Image without BBOX to improve generalisation >> Cut paste Aug\n- Reduce GPU Usage: [13th Pos](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307753v)-Upscale images, split them and discard split without bounding box for optimising GPU usage!\n- Progressive Learning\n- Multiscale inference \n- Strong + Weak Augmentation: [7th Place](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786)\n- Decrease stride to increase model resolution: [10th place](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307756) \n\nMost imp trick in book of Kaggle: Trusting CV, demonstrated by 1st Pos and everyone that survived the shake up well\n\nPS: I have been reading all day in enthusiastic preparation for my chai interviews and summary video, so I will update this once more solutions are shared and getting some sleep 😅\n\nThanks everyone and congratulations to everyone for the awesome finish!",
      "votes": null
    },
    {
      "id": "1709383",
      "postDate": "03/02/2022 06:50:30",
      "content": "<p>Thank you so much for sharing👍</p>",
      "rawMarkdown": "Thank you so much for sharing👍",
      "votes": null
    },
    {
      "id": "2030090",
      "postDate": "11/15/2022 07:31:52",
      "content": "<p>Good work! Thanks for your efforts!</p>",
      "rawMarkdown": "Good work! Thanks for your efforts!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1709383,
      "author_name": "imnoob",
      "author_url": "",
      "post_date": "03/02/2022 06:50:30",
      "content": "<p>Thank you so much for sharing👍</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2030090,
      "author_name": "hridaym25",
      "author_url": "",
      "post_date": "11/15/2022 07:31:52",
      "content": "<p>Good work! Thanks for your efforts!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1692097": "Hi All! \n\nFor a long time I have wanted to create summary videos of every competition where I can share interesting bits & tricks from each solution (with due credit, ofcourse). \n\nI have been working on the idea for this comp and [reading through every solution](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307598) shared, so I decided to summarise interesting bits in a thread as well:\n\n____\n\n\n### Models:\n\nBased on all top readups, I learned YOLO family was a large part of the majority solutions, some teams had also used RCNNs in the ensembles or as single models:\n\n- Why Yolov5s6 is more effective was discussed [here](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/300638)\n- [7th Pos solution](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786) used a *single* model: Custom Cascade RCNN \n- [8th Pos Solution](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307735) used a `Cascade RCNN with a backbone: convnext base`, I would be super curious to check their code out if they post it \n\n### Image Augmentations\n\nI was curious about seeing what Image Augmentations work really well in this setting: \n\nI saw many new techniques named, again apologies to everyone who is familiar with these: CLAHE, Image Compression, Coarse Dropout, Mosaic, a few more. Need to learn more about these!\n\nMost interestingly, @bestfitting shared they were working on using GANs for image Augmentations! I'm really curious to explore this further and would love to know if anyone has had any success working with this!\n\nTricks:\n\nThe Devil is in the details and there is a lot of gold too, from inventing a new Augmentation technique, to discovering tricks of reducing GPU usage by splitting images, Decreasing stride to increase model resolution there were many interesting tricks shared:\n\n- \"Background Mix Augmentation\" by [3rd Position](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307707): Mixing an image with a BBOX + Image without BBOX to improve generalisation >> Cut paste Aug\n- Reduce GPU Usage: [13th Pos](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307753v)-Upscale images, split them and discard split without bounding box for optimising GPU usage!\n- Progressive Learning\n- Multiscale inference \n- Strong + Weak Augmentation: [7th Place](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307786)\n- Decrease stride to increase model resolution: [10th place](https://www.kaggle.com/c/tensorflow-great-barrier-reef/discussion/307756) \n\nMost imp trick in book of Kaggle: Trusting CV, demonstrated by 1st Pos and everyone that survived the shake up well\n\nPS: I have been reading all day in enthusiastic preparation for my chai interviews and summary video, so I will update this once more solutions are shared and getting some sleep 😅\n\nThanks everyone and congratulations to everyone for the awesome finish!",
    "1709383": "Thank you so much for sharing👍",
    "2030090": "Good work! Thanks for your efforts!"
  },
  "source": "meta"
}