{
  "id": 35432,
  "title": "Overview of approaches used",
  "url": "/competitions/noaa-fisheries-steller-sea-lion-population-count/discussion/35432",
  "author_name": "Daft Vader",
  "post_date": "2017-06-28T12:13:18.131000",
  "votes": 5,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Congratulation to all the winners and medal winners and thanks to threeplusone for the great <a href=\"https://www.kaggle.com/threeplusone/sea-lion-coordinates\">script</a> to calculate the coordinates.</p>\n\n<p>Overview of the approaches used:</p>\n\n<ol>\n<li><strong>Segmentation</strong>: Segmentation is applied to the image to predict small squares centered on the coordinates of the dots as shown in the image below. <a href=\"https://arxiv.org/abs/1611.09326\">Tiramisu</a> network is used with 1:1 upsampling to predict 6 classes(5 types of sea lions and background), Log loss is used with Nadam optimizer for training. Results with this approach were not satisfactory, the model was biased towards predicting the background.\n<img src=\"http://i.imgur.com/D4XEui4.png\" alt=\"Imgur\" title=\"\"></li>\n<li><strong>Masking with segmentation</strong>: A mask is created to focus the predictor on the areas where sea lions might be present using the same segmentation approach as above by increasing the size of the squares for sea lions and using the dice coefficient loss, it was able to provide satisfactory results in detecting the regions of interest but after running a regression it seems to overfit a lot, due to lack of time more experiments were not performed with this approach. An example is shown for predicting ROI\n<img src=\"http://i.imgur.com/9HFCf4t.png\" alt=\"Imgur\" title=\"\">1. Actual Image   2.Mask   3. Predicted Mask</li>\n<li><strong>FCN Regression</strong>: Thanks to <a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/33900\">@mrgloom</a> we were able to get into top 100 using the fully connected net to perform regression on the whole image, an average of our two best-performing models give us our current position the leaderboard.</li>\n</ol>\n\n<p>It was a great competition with a lot of data which helped us to learn a lot of new things, some of the other approaches that just remained on the to-do list were the new object detection API from tensorflow and using U-net for segmentation. We will share our github soon after performing some cleaning.</p>\n\n<p>Cheers !</p>",
  "messages": [
    {
      "id": 196924,
      "postDate": "2017-06-28T12:13:18.130Z",
      "content": "<p>Congratulation to all the winners and medal winners and thanks to threeplusone for the great <a href=\"https://www.kaggle.com/threeplusone/sea-lion-coordinates\">script</a> to calculate the coordinates.</p>\n\n<p>Overview of the approaches used:</p>\n\n<ol>\n<li><strong>Segmentation</strong>: Segmentation is applied to the image to predict small squares centered on the coordinates of the dots as shown in the image below. <a href=\"https://arxiv.org/abs/1611.09326\">Tiramisu</a> network is used with 1:1 upsampling to predict 6 classes(5 types of sea lions and background), Log loss is used with Nadam optimizer for training. Results with this approach were not satisfactory, the model was biased towards predicting the background.\n<img src=\"http://i.imgur.com/D4XEui4.png\" alt=\"Imgur\" title=\"\"></li>\n<li><strong>Masking with segmentation</strong>: A mask is created to focus the predictor on the areas where sea lions might be present using the same segmentation approach as above by increasing the size of the squares for sea lions and using the dice coefficient loss, it was able to provide satisfactory results in detecting the regions of interest but after running a regression it seems to overfit a lot, due to lack of time more experiments were not performed with this approach. An example is shown for predicting ROI\n<img src=\"http://i.imgur.com/9HFCf4t.png\" alt=\"Imgur\" title=\"\">1. Actual Image   2.Mask   3. Predicted Mask</li>\n<li><strong>FCN Regression</strong>: Thanks to <a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/33900\">@mrgloom</a> we were able to get into top 100 using the fully connected net to perform regression on the whole image, an average of our two best-performing models give us our current position the leaderboard.</li>\n</ol>\n\n<p>It was a great competition with a lot of data which helped us to learn a lot of new things, some of the other approaches that just remained on the to-do list were the new object detection API from tensorflow and using U-net for segmentation. We will share our github soon after performing some cleaning.</p>\n\n<p>Cheers !</p>",
      "rawMarkdown": "Congratulation to all the winners and medal winners and thanks to threeplusone for the great [script][1] to calculate the coordinates.\n\nOverview of the approaches used:\n\n 1. **Segmentation**: Segmentation is applied to the image to predict small squares centered on the coordinates of the dots as shown in the image below. [Tiramisu][2] network is used with 1:1 upsampling to predict 6 classes(5 types of sea lions and background), Log loss is used with Nadam optimizer for training. Results with this approach were not satisfactory, the model was biased towards predicting the background.\n![Imgur](http://i.imgur.com/D4XEui4.png)\n 2. **Masking with segmentation**: A mask is created to focus the predictor on the areas where sea lions might be present using the same segmentation approach as above by increasing the size of the squares for sea lions and using the dice coefficient loss, it was able to provide satisfactory results in detecting the regions of interest but after running a regression it seems to overfit a lot, due to lack of time more experiments were not performed with this approach. An example is shown for predicting ROI\n![Imgur](http://i.imgur.com/9HFCf4t.png)1. Actual Image   2.Mask   3. Predicted Mask\n 3. **FCN Regression**: Thanks to [@mrgloom][3] we were able to get into top 100 using the fully connected net to perform regression on the whole image, an average of our two best-performing models give us our current position the leaderboard.\n\nIt was a great competition with a lot of data which helped us to learn a lot of new things, some of the other approaches that just remained on the to-do list were the new object detection API from tensorflow and using U-net for segmentation. We will share our github soon after performing some cleaning.\n\nCheers !\n\n\n  [1]: https://www.kaggle.com/threeplusone/sea-lion-coordinates\n  [2]: https://arxiv.org/abs/1611.09326\n  [3]: https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/33900",
      "votes": 5
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "196924": "Congratulation to all the winners and medal winners and thanks to threeplusone for the great [script][1] to calculate the coordinates.\n\nOverview of the approaches used:\n\n 1. **Segmentation**: Segmentation is applied to the image to predict small squares centered on the coordinates of the dots as shown in the image below. [Tiramisu][2] network is used with 1:1 upsampling to predict 6 classes(5 types of sea lions and background), Log loss is used with Nadam optimizer for training. Results with this approach were not satisfactory, the model was biased towards predicting the background.\n![Imgur](http://i.imgur.com/D4XEui4.png)\n 2. **Masking with segmentation**: A mask is created to focus the predictor on the areas where sea lions might be present using the same segmentation approach as above by increasing the size of the squares for sea lions and using the dice coefficient loss, it was able to provide satisfactory results in detecting the regions of interest but after running a regression it seems to overfit a lot, due to lack of time more experiments were not performed with this approach. An example is shown for predicting ROI\n![Imgur](http://i.imgur.com/9HFCf4t.png)1. Actual Image   2.Mask   3. Predicted Mask\n 3. **FCN Regression**: Thanks to [@mrgloom][3] we were able to get into top 100 using the fully connected net to perform regression on the whole image, an average of our two best-performing models give us our current position the leaderboard.\n\nIt was a great competition with a lot of data which helped us to learn a lot of new things, some of the other approaches that just remained on the to-do list were the new object detection API from tensorflow and using U-net for segmentation. We will share our github soon after performing some cleaning.\n\nCheers !\n\n\n  [1]: https://www.kaggle.com/threeplusone/sea-lion-coordinates\n  [2]: https://arxiv.org/abs/1611.09326\n  [3]: https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/33900"
  }
}