{
  "id": 218198,
  "title": "Interesting Paper/Code on Weakly Supervised Instance Segmentation Using MIL Framework",
  "url": "/competitions/hpa-single-cell-image-classification/discussion/218198",
  "author_name": "Darien Schettler",
  "post_date": "2021-02-09T16:40:32.980000",
  "votes": 8,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Hi there.</p>\n<p>I was doing research on weakly-supervised instance segmentation and found this interesting paper. Hopefully, it inspires you as much as it did me!</p>\n<hr>\n<p><br></p>\n<h4>PAPER</h4>\n<hr>\n<p>--&gt; <a href=\"http://mftp.mmcheng.net/Papers/21PAMI_InsImgDatasetWSIS.pdf\" target=\"_blank\"><strong>Leveraging Instance-, Image- and Dataset-Level Information for Weakly Supervised Instance Segmentation</strong></a></p>\n<hr>\n<p><br></p>\n<h4>CODE</h4>\n<hr>\n<p>--&gt; <a href=\"https://github.com/yun-liu/LIID\" target=\"_blank\"><strong>Pytorch Implementation By Author on Github</strong></a></p>\n<hr>\n<p><br></p>\n<h4>OVERVIEW</h4>\n<hr>\n<blockquote>\n  <p>Weakly supervised semantic instance segmentation with only image-level supervision, instead of relying on expensive pixel-wise masks or bounding box annotations, is an important problem to alleviate the data-hungry nature of deep learning. In this paper, <strong>we tackle this challenging problem by aggregating the image-level information of all training images into a large knowledge graph and exploiting semantic relationships from this graph</strong>. Specifically, our effort starts with some generic segment-based object proposals (SOP) without category priors. <strong>We propose a multiple instance learning (MIL) framework, which can be trained in an end-to-end manner using training images with image-level labels</strong>. For each proposal, this MIL framework can simultaneously compute probability distributions and category-aware semantic features, with which we can formulate a large undirected graph. The category of background is also included in this graph to remove the massive noisy object proposals. An optimal multi-way cut of this graph can thus assign a reliable category label to each proposal. The denoised SOP with assigned category labels can be viewed as pseudo instance segmentation of training images, which are used to train fully supervised models. <strong>The proposed approach achieves state-of-the-art performance for both weakly supervised instance segmentation and semantic segmentation</strong>.</p>\n</blockquote>\n<hr>",
  "messages": [
    {
      "id": 1193446,
      "postDate": "2021-02-09T16:40:32.980Z",
      "content": "<p>Hi there.</p>\n<p>I was doing research on weakly-supervised instance segmentation and found this interesting paper. Hopefully, it inspires you as much as it did me!</p>\n<hr>\n<p><br></p>\n<h4>PAPER</h4>\n<hr>\n<p>--&gt; <a href=\"http://mftp.mmcheng.net/Papers/21PAMI_InsImgDatasetWSIS.pdf\" target=\"_blank\"><strong>Leveraging Instance-, Image- and Dataset-Level Information for Weakly Supervised Instance Segmentation</strong></a></p>\n<hr>\n<p><br></p>\n<h4>CODE</h4>\n<hr>\n<p>--&gt; <a href=\"https://github.com/yun-liu/LIID\" target=\"_blank\"><strong>Pytorch Implementation By Author on Github</strong></a></p>\n<hr>\n<p><br></p>\n<h4>OVERVIEW</h4>\n<hr>\n<blockquote>\n  <p>Weakly supervised semantic instance segmentation with only image-level supervision, instead of relying on expensive pixel-wise masks or bounding box annotations, is an important problem to alleviate the data-hungry nature of deep learning. In this paper, <strong>we tackle this challenging problem by aggregating the image-level information of all training images into a large knowledge graph and exploiting semantic relationships from this graph</strong>. Specifically, our effort starts with some generic segment-based object proposals (SOP) without category priors. <strong>We propose a multiple instance learning (MIL) framework, which can be trained in an end-to-end manner using training images with image-level labels</strong>. For each proposal, this MIL framework can simultaneously compute probability distributions and category-aware semantic features, with which we can formulate a large undirected graph. The category of background is also included in this graph to remove the massive noisy object proposals. An optimal multi-way cut of this graph can thus assign a reliable category label to each proposal. The denoised SOP with assigned category labels can be viewed as pseudo instance segmentation of training images, which are used to train fully supervised models. <strong>The proposed approach achieves state-of-the-art performance for both weakly supervised instance segmentation and semantic segmentation</strong>.</p>\n</blockquote>\n<hr>",
      "rawMarkdown": "Hi there.\n\nI was doing research on weakly-supervised instance segmentation and found this interesting paper. Hopefully, it inspires you as much as it did me!\n\n---\n\n<br>\n\n<h4>PAPER</h4>\n\n---\n\n  --> [**Leveraging Instance-, Image- and Dataset-Level Information for Weakly Supervised Instance Segmentation**](http://mftp.mmcheng.net/Papers/21PAMI_InsImgDatasetWSIS.pdf)\n\n---\n\n<br>\n\n<h4>CODE</h4>\n\n---\n\n  --> [**Pytorch Implementation By Author on Github**](https://github.com/yun-liu/LIID)\n\n---\n\n<br>\n\n<h4>OVERVIEW</h4>\n\n---\n\n> Weakly supervised semantic instance segmentation with only image-level supervision, instead of relying on expensive pixel-wise masks or bounding box annotations, is an important problem to alleviate the data-hungry nature of deep learning. In this paper, **we tackle this challenging problem by aggregating the image-level information of all training images into a large knowledge graph and exploiting semantic relationships from this graph**. Specifically, our effort starts with some generic segment-based object proposals (SOP) without category priors. **We propose a multiple instance learning (MIL) framework, which can be trained in an end-to-end manner using training images with image-level labels**. For each proposal, this MIL framework can simultaneously compute probability distributions and category-aware semantic features, with which we can formulate a large undirected graph. The category of background is also included in this graph to remove the massive noisy object proposals. An optimal multi-way cut of this graph can thus assign a reliable category label to each proposal. The denoised SOP with assigned category labels can be viewed as pseudo instance segmentation of training images, which are used to train fully supervised models. **The proposed approach achieves state-of-the-art performance for both weakly supervised instance segmentation and semantic segmentation**.\n\n---",
      "votes": 7
    },
    {
      "id": 1211878,
      "postDate": "2021-02-20T16:19:37.453Z",
      "content": "<p>Another interesting/relevant paper: <a href=\"https://arxiv.org/abs/1812.10885\" target=\"_blank\">Coarse-to-fine Semantic Segmentation from Image-level Labels</a></p>",
      "rawMarkdown": "Another interesting/relevant paper: [Coarse-to-fine Semantic Segmentation from Image-level Labels](https://arxiv.org/abs/1812.10885)",
      "votes": 1
    }
  ],
  "comments": [
    {
      "id": 1211878,
      "author_name": "Ayush Thakur",
      "author_url": "",
      "post_date": "2021-02-20T16:19:37.453000",
      "content": "<p>Another interesting/relevant paper: <a href=\"https://arxiv.org/abs/1812.10885\" target=\"_blank\">Coarse-to-fine Semantic Segmentation from Image-level Labels</a></p>",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1193446": "Hi there.\n\nI was doing research on weakly-supervised instance segmentation and found this interesting paper. Hopefully, it inspires you as much as it did me!\n\n---\n\n<br>\n\n<h4>PAPER</h4>\n\n---\n\n  --> [**Leveraging Instance-, Image- and Dataset-Level Information for Weakly Supervised Instance Segmentation**](http://mftp.mmcheng.net/Papers/21PAMI_InsImgDatasetWSIS.pdf)\n\n---\n\n<br>\n\n<h4>CODE</h4>\n\n---\n\n  --> [**Pytorch Implementation By Author on Github**](https://github.com/yun-liu/LIID)\n\n---\n\n<br>\n\n<h4>OVERVIEW</h4>\n\n---\n\n> Weakly supervised semantic instance segmentation with only image-level supervision, instead of relying on expensive pixel-wise masks or bounding box annotations, is an important problem to alleviate the data-hungry nature of deep learning. In this paper, **we tackle this challenging problem by aggregating the image-level information of all training images into a large knowledge graph and exploiting semantic relationships from this graph**. Specifically, our effort starts with some generic segment-based object proposals (SOP) without category priors. **We propose a multiple instance learning (MIL) framework, which can be trained in an end-to-end manner using training images with image-level labels**. For each proposal, this MIL framework can simultaneously compute probability distributions and category-aware semantic features, with which we can formulate a large undirected graph. The category of background is also included in this graph to remove the massive noisy object proposals. An optimal multi-way cut of this graph can thus assign a reliable category label to each proposal. The denoised SOP with assigned category labels can be viewed as pseudo instance segmentation of training images, which are used to train fully supervised models. **The proposed approach achieves state-of-the-art performance for both weakly supervised instance segmentation and semantic segmentation**.\n\n---",
    "1211878": "Another interesting/relevant paper: [Coarse-to-fine Semantic Segmentation from Image-level Labels](https://arxiv.org/abs/1812.10885)"
  }
}