{
  "id": 218309,
  "title": "Instance segmentation and its metric comprehension",
  "url": "/competitions/hpa-single-cell-image-classification/discussion/218309",
  "author_name": "cool_rabbit",
  "post_date": "2021-02-10T05:05:02.834000",
  "votes": 6,
  "comment_count": 6,
  "views": 0,
  "content": "<p>Hello everyone!!</p>\n<p>So far I've been reading excellent discussion and notebooks such as;<br>\n<a href=\"https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/214659\" target=\"_blank\">https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/214659</a><br>\n<a href=\"https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/215141\" target=\"_blank\">https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/215141</a><br>\n<a href=\"https://www.kaggle.com/lnhtrang/single-cell-patterns\" target=\"_blank\">https://www.kaggle.com/lnhtrang/single-cell-patterns</a><br>\n<a href=\"https://www.kaggle.com/thedrcat/hpa-single-cell-classification-eda\" target=\"_blank\">https://www.kaggle.com/thedrcat/hpa-single-cell-classification-eda</a></p>\n<p>But still I'm confused at instance segmentation's metric.</p>\n<p>For example, hosts say that we should segment the full cell, but if we use the model segmenting the whole part of every cell for prediction, there's gonna be many FP (IoU &lt; 0.6) when true mask locates only inside the nucleus (ex: 5. nuclear bodies).</p>\n<p>Here is my question.<br>\nShould we segment each cell efficiently in order to get high score, like only nucleus, plasma membrane or cytoplasm etc?<br>\nOr just segmenting the full cell is inevitable approach?<br>\nI guess it's a little bit risky to use different segmentation models for each cell, though…</p>",
  "messages": [
    {
      "id": 1194205,
      "postDate": "2021-02-10T05:05:02.833Z",
      "content": "<p>Hello everyone!!</p>\n<p>So far I've been reading excellent discussion and notebooks such as;<br>\n<a href=\"https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/214659\" target=\"_blank\">https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/214659</a><br>\n<a href=\"https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/215141\" target=\"_blank\">https://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/215141</a><br>\n<a href=\"https://www.kaggle.com/lnhtrang/single-cell-patterns\" target=\"_blank\">https://www.kaggle.com/lnhtrang/single-cell-patterns</a><br>\n<a href=\"https://www.kaggle.com/thedrcat/hpa-single-cell-classification-eda\" target=\"_blank\">https://www.kaggle.com/thedrcat/hpa-single-cell-classification-eda</a></p>\n<p>But still I'm confused at instance segmentation's metric.</p>\n<p>For example, hosts say that we should segment the full cell, but if we use the model segmenting the whole part of every cell for prediction, there's gonna be many FP (IoU &lt; 0.6) when true mask locates only inside the nucleus (ex: 5. nuclear bodies).</p>\n<p>Here is my question.<br>\nShould we segment each cell efficiently in order to get high score, like only nucleus, plasma membrane or cytoplasm etc?<br>\nOr just segmenting the full cell is inevitable approach?<br>\nI guess it's a little bit risky to use different segmentation models for each cell, though…</p>",
      "rawMarkdown": "Hello everyone!!\n\nSo far I've been reading excellent discussion and notebooks such as;\nhttps://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/214659\nhttps://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/215141\nhttps://www.kaggle.com/lnhtrang/single-cell-patterns\nhttps://www.kaggle.com/thedrcat/hpa-single-cell-classification-eda\n\nBut still I'm confused at instance segmentation's metric.\n\nFor example, hosts say that we should segment the full cell, but if we use the model segmenting the whole part of every cell for prediction, there's gonna be many FP (IoU < 0.6) when true mask locates only inside the nucleus (ex: 5. nuclear bodies).\n\nHere is my question.\nShould we segment each cell efficiently in order to get high score, like only nucleus, plasma membrane or cytoplasm etc?\nOr just segmenting the full cell is inevitable approach?\nI guess it's a little bit risky to use different segmentation models for each cell, though...",
      "votes": 6
    },
    {
      "id": 1194712,
      "postDate": "2021-02-10T10:16:46.747Z",
      "content": "<p>In this competition, you should submit the whole cell segmentation.</p>\n<p>From a research perspective, individual organelle segmentation is definitely an interesting task. But since they are morphologically so different as you see in the Single Cell Pattern notebook, and so are their functions, it is more efficient to develop and analyze a model for each organelle of interest. In fact this is what happens in the biological image analysis space right now with individual deep learning models for Mitochondria, Golgi etc. </p>\n<p>There are more considerations that we took into account when designing this challenge. We want to study the integrated cell, with organelles in relation to it. Cell segmentation task can be considered an auxiliary task (depending on your approach to modelling of course) on a generalized deep learning model of the cell. </p>",
      "rawMarkdown": "In this competition, you should submit the whole cell segmentation.\n\nFrom a research perspective, individual organelle segmentation is definitely an interesting task. But since they are morphologically so different as you see in the Single Cell Pattern notebook, and so are their functions, it is more efficient to develop and analyze a model for each organelle of interest. In fact this is what happens in the biological image analysis space right now with individual deep learning models for Mitochondria, Golgi etc. \n\nThere are more considerations that we took into account when designing this challenge. We want to study the integrated cell, with organelles in relation to it. Cell segmentation task can be considered an auxiliary task (depending on your approach to modelling of course) on a generalized deep learning model of the cell. ",
      "votes": 2,
      "replies": [
        {
          "id": 1194714,
          "postDate": "2021-02-10T10:20:55.223Z",
          "content": "<p>Thank you so much for the fast clarification.<br>\nNow I can concentrate on this interesting task.</p>",
          "rawMarkdown": "Thank you so much for the fast clarification.\nNow I can concentrate on this interesting task.",
          "votes": 2
        },
        {
          "id": 1195726,
          "postDate": "2021-02-11T03:12:13.750Z",
          "content": "<p>This clears up the confusion, thanks a lot!</p>",
          "rawMarkdown": "This clears up the confusion, thanks a lot!",
          "votes": 1
        },
        {
          "id": 1207404,
          "postDate": "2021-02-17T20:34:12.983Z",
          "content": "<p>Thus <a href=\"https://www.kaggle.com/Inhtrang\" target=\"_blank\">@Inhtrang</a>, the main task is to correctly label each segmented cell? Segmentation is an auxiliary task.</p>\n<p>Also, will the scoring depend on labeling the cells that have the presence of the protein of interest? Are we to leave the cells that don't have any overlap with protein(green channel)?</p>",
          "rawMarkdown": "Thus @Inhtrang, the main task is to correctly label each segmented cell? Segmentation is an auxiliary task.\n\nAlso, will the scoring depend on labeling the cells that have the presence of the protein of interest? Are we to leave the cells that don't have any overlap with protein(green channel)?"
        },
        {
          "id": 1208162,
          "postDate": "2021-02-18T07:32:12.253Z",
          "content": "<p>Hi! The task is predicting subcellular patterns for each cell. Segmentation is a way to identify which cell you are predicting. It can also be considered as auxiliary task <strong>depending on your modelling approach</strong>.<br>\nScoring depends on classifying each cell correctly in one or more of the 19 classes. Please check out this <a href=\"https://www.kaggle.com/lnhtrang/single-cell-patterns\" target=\"_blank\">Single Cell Pattern</a> notebook to understand more about each pattern in this competition, including <code>Negative</code> class.</p>",
          "rawMarkdown": "Hi! The task is predicting subcellular patterns for each cell. Segmentation is a way to identify which cell you are predicting. It can also be considered as auxiliary task **depending on your modelling approach**.\nScoring depends on classifying each cell correctly in one or more of the 19 classes. Please check out this [Single Cell Pattern](https://www.kaggle.com/lnhtrang/single-cell-patterns) notebook to understand more about each pattern in this competition, including `Negative` class.",
          "votes": 1
        },
        {
          "id": 1208264,
          "postDate": "2021-02-18T08:20:10.870Z",
          "content": "<p>Got it! Thanks. </p>\n<p>Thus in the <code>submission.csv</code> file, the RLE encoded mask is just a way for the evaluation system to understand to which cell a label(s) is associated. Am I correct?</p>",
          "rawMarkdown": "Got it! Thanks. \n\nThus in the `submission.csv` file, the RLE encoded mask is just a way for the evaluation system to understand to which cell a label(s) is associated. Am I correct?"
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1194712,
      "author_name": "Trang Le",
      "author_url": "",
      "post_date": "2021-02-10T10:16:46.747000",
      "content": "<p>In this competition, you should submit the whole cell segmentation.</p>\n<p>From a research perspective, individual organelle segmentation is definitely an interesting task. But since they are morphologically so different as you see in the Single Cell Pattern notebook, and so are their functions, it is more efficient to develop and analyze a model for each organelle of interest. In fact this is what happens in the biological image analysis space right now with individual deep learning models for Mitochondria, Golgi etc. </p>\n<p>There are more considerations that we took into account when designing this challenge. We want to study the integrated cell, with organelles in relation to it. Cell segmentation task can be considered an auxiliary task (depending on your approach to modelling of course) on a generalized deep learning model of the cell. </p>",
      "votes": 2,
      "replies": [
        {
          "id": 1194714,
          "author_name": "cool_rabbit",
          "author_url": "",
          "post_date": "2021-02-10T10:20:55.223000",
          "content": "<p>Thank you so much for the fast clarification.<br>\nNow I can concentrate on this interesting task.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1195726,
          "author_name": "Arka Saha",
          "author_url": "",
          "post_date": "2021-02-11T03:12:13.750000",
          "content": "<p>This clears up the confusion, thanks a lot!</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1207404,
          "author_name": "Ayush Thakur",
          "author_url": "",
          "post_date": "2021-02-17T20:34:12.983000",
          "content": "<p>Thus <a href=\"https://www.kaggle.com/Inhtrang\" target=\"_blank\">@Inhtrang</a>, the main task is to correctly label each segmented cell? Segmentation is an auxiliary task.</p>\n<p>Also, will the scoring depend on labeling the cells that have the presence of the protein of interest? Are we to leave the cells that don't have any overlap with protein(green channel)?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1208162,
          "author_name": "Trang Le",
          "author_url": "",
          "post_date": "2021-02-18T07:32:12.253000",
          "content": "<p>Hi! The task is predicting subcellular patterns for each cell. Segmentation is a way to identify which cell you are predicting. It can also be considered as auxiliary task <strong>depending on your modelling approach</strong>.<br>\nScoring depends on classifying each cell correctly in one or more of the 19 classes. Please check out this <a href=\"https://www.kaggle.com/lnhtrang/single-cell-patterns\" target=\"_blank\">Single Cell Pattern</a> notebook to understand more about each pattern in this competition, including <code>Negative</code> class.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1208264,
          "author_name": "Ayush Thakur",
          "author_url": "",
          "post_date": "2021-02-18T08:20:10.870000",
          "content": "<p>Got it! Thanks. </p>\n<p>Thus in the <code>submission.csv</code> file, the RLE encoded mask is just a way for the evaluation system to understand to which cell a label(s) is associated. Am I correct?</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1194205": "Hello everyone!!\n\nSo far I've been reading excellent discussion and notebooks such as;\nhttps://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/214659\nhttps://www.kaggle.com/c/hpa-single-cell-image-classification/discussion/215141\nhttps://www.kaggle.com/lnhtrang/single-cell-patterns\nhttps://www.kaggle.com/thedrcat/hpa-single-cell-classification-eda\n\nBut still I'm confused at instance segmentation's metric.\n\nFor example, hosts say that we should segment the full cell, but if we use the model segmenting the whole part of every cell for prediction, there's gonna be many FP (IoU < 0.6) when true mask locates only inside the nucleus (ex: 5. nuclear bodies).\n\nHere is my question.\nShould we segment each cell efficiently in order to get high score, like only nucleus, plasma membrane or cytoplasm etc?\nOr just segmenting the full cell is inevitable approach?\nI guess it's a little bit risky to use different segmentation models for each cell, though...",
    "1194712": "In this competition, you should submit the whole cell segmentation.\n\nFrom a research perspective, individual organelle segmentation is definitely an interesting task. But since they are morphologically so different as you see in the Single Cell Pattern notebook, and so are their functions, it is more efficient to develop and analyze a model for each organelle of interest. In fact this is what happens in the biological image analysis space right now with individual deep learning models for Mitochondria, Golgi etc. \n\nThere are more considerations that we took into account when designing this challenge. We want to study the integrated cell, with organelles in relation to it. Cell segmentation task can be considered an auxiliary task (depending on your approach to modelling of course) on a generalized deep learning model of the cell. "
  }
}