{
  "id": 294898,
  "title": "Accept uncertainty of labels: Bayesian inference",
  "url": "/competitions/sartorius-cell-instance-segmentation/discussion/294898",
  "author_name": "John Doe",
  "post_date": "2021-12-13T12:27:47.090000",
  "votes": 2,
  "comment_count": 0,
  "views": 0,
  "content": "<p>The paper \"<a href=\"https://arxiv.org/pdf/2102.08021.pdf\" target=\"_blank\">UNCERTAINTY-BASED METHOD FOR IMPROVING POORLY LABELED SEGMENTATION DATASETS</a>\" approaches noisy mask relabeling problem using <a href=\"https://en.wikipedia.org/wiki/Bayesian_inference\" target=\"_blank\"><strong>Bayesian inference</strong></a>.<br>\nBe careful. This paper is not for inference but for <strong>relabeling</strong>.<br>\nBut if we could obtain relabeled dataset for inference by this method, we may improve the accuracy.</p>\n<h3>Key passage</h3>\n<p>I picked up several key passages from the paper and emphasized the key phrases in bold.</p>\n<p><br><em>In image segmentation, noisy labels refer to inaccuracies or ambiguities of mask boundaries. The major sources of label noise include inter-observer variability due to human subjectivity, <strong>random</strong> mistakes made by human annotators, and errors in computer-generated labels.</em><br></p>\n<p><br><em>The authors used <strong>uncertainty estimation</strong> for iterative detection and filtering of noisy labels, which showed promising performance for the image classification task. In this work we extend this approach to the task of binary image segmentation by using pixel-level uncertainty estimation to detect and relabel noisy ground truth masks for dermatoscopy and liver CT data.</em><br></p>\n<p><br><em>It is assumed that the segmentation masks given in the training set are <strong>inherently noisy</strong>, otherwise clean ground truth masks should be artificially deteriorated.</em><br></p>\n<p><br><em>Automatic relabeling improves segmentation quality without overfitting to data inaccuracies. The proposed algorithm can be used to generate cleaner datasets for training other deep learning algorithms without having to consider the impact of noisy labels.</em><br></p>",
  "messages": [
    {
      "id": 1616448,
      "postDate": "2021-12-13T12:27:47.090Z",
      "content": "<p>The paper \"<a href=\"https://arxiv.org/pdf/2102.08021.pdf\" target=\"_blank\">UNCERTAINTY-BASED METHOD FOR IMPROVING POORLY LABELED SEGMENTATION DATASETS</a>\" approaches noisy mask relabeling problem using <a href=\"https://en.wikipedia.org/wiki/Bayesian_inference\" target=\"_blank\"><strong>Bayesian inference</strong></a>.<br>\nBe careful. This paper is not for inference but for <strong>relabeling</strong>.<br>\nBut if we could obtain relabeled dataset for inference by this method, we may improve the accuracy.</p>\n<h3>Key passage</h3>\n<p>I picked up several key passages from the paper and emphasized the key phrases in bold.</p>\n<p><br><em>In image segmentation, noisy labels refer to inaccuracies or ambiguities of mask boundaries. The major sources of label noise include inter-observer variability due to human subjectivity, <strong>random</strong> mistakes made by human annotators, and errors in computer-generated labels.</em><br></p>\n<p><br><em>The authors used <strong>uncertainty estimation</strong> for iterative detection and filtering of noisy labels, which showed promising performance for the image classification task. In this work we extend this approach to the task of binary image segmentation by using pixel-level uncertainty estimation to detect and relabel noisy ground truth masks for dermatoscopy and liver CT data.</em><br></p>\n<p><br><em>It is assumed that the segmentation masks given in the training set are <strong>inherently noisy</strong>, otherwise clean ground truth masks should be artificially deteriorated.</em><br></p>\n<p><br><em>Automatic relabeling improves segmentation quality without overfitting to data inaccuracies. The proposed algorithm can be used to generate cleaner datasets for training other deep learning algorithms without having to consider the impact of noisy labels.</em><br></p>",
      "rawMarkdown": "The paper \"[UNCERTAINTY-BASED METHOD FOR IMPROVING POORLY LABELED SEGMENTATION DATASETS](https://arxiv.org/pdf/2102.08021.pdf)\" approaches noisy mask relabeling problem using [**Bayesian inference**](https://en.wikipedia.org/wiki/Bayesian_inference).\nBe careful. This paper is not for inference but for **relabeling**.\nBut if we could obtain relabeled dataset for inference by this method, we may improve the accuracy.\n\n### Key passage\nI picked up several key passages from the paper and emphasized the key phrases in bold.\n\n\n<br>*In image segmentation, noisy labels refer to inaccuracies or ambiguities of mask boundaries. The major sources of label noise include inter-observer variability due to human subjectivity, **random** mistakes made by human annotators, and errors in computer-generated labels.*</br>\n\n\n<br>*The authors used **uncertainty estimation** for iterative detection and filtering of noisy labels, which showed promising performance for the image classification task. In this work we extend this approach to the task of binary image segmentation by using pixel-level uncertainty estimation to detect and relabel noisy ground truth masks for dermatoscopy and liver CT data.*</br>\n\n\n<br>*It is assumed that the segmentation masks given in the training set are **inherently noisy**, otherwise clean ground truth masks should be artificially deteriorated.*</br>\n\n\n<br>*Automatic relabeling improves segmentation quality without overfitting to data inaccuracies. The proposed algorithm can be used to generate cleaner datasets for training other deep learning algorithms without having to consider the impact of noisy labels.*</br>",
      "votes": 2
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1616448": "The paper \"[UNCERTAINTY-BASED METHOD FOR IMPROVING POORLY LABELED SEGMENTATION DATASETS](https://arxiv.org/pdf/2102.08021.pdf)\" approaches noisy mask relabeling problem using [**Bayesian inference**](https://en.wikipedia.org/wiki/Bayesian_inference).\nBe careful. This paper is not for inference but for **relabeling**.\nBut if we could obtain relabeled dataset for inference by this method, we may improve the accuracy.\n\n### Key passage\nI picked up several key passages from the paper and emphasized the key phrases in bold.\n\n\n<br>*In image segmentation, noisy labels refer to inaccuracies or ambiguities of mask boundaries. The major sources of label noise include inter-observer variability due to human subjectivity, **random** mistakes made by human annotators, and errors in computer-generated labels.*</br>\n\n\n<br>*The authors used **uncertainty estimation** for iterative detection and filtering of noisy labels, which showed promising performance for the image classification task. In this work we extend this approach to the task of binary image segmentation by using pixel-level uncertainty estimation to detect and relabel noisy ground truth masks for dermatoscopy and liver CT data.*</br>\n\n\n<br>*It is assumed that the segmentation masks given in the training set are **inherently noisy**, otherwise clean ground truth masks should be artificially deteriorated.*</br>\n\n\n<br>*Automatic relabeling improves segmentation quality without overfitting to data inaccuracies. The proposed algorithm can be used to generate cleaner datasets for training other deep learning algorithms without having to consider the impact of noisy labels.*</br>"
  }
}