{
  "id": 241848,
  "title": "Why does a Study in test sets correspond to multiple labels?",
  "url": "/competitions/siim-covid19-detection/discussion/241848",
  "author_name": "",
  "post_date": "2021-05-26T11:42:25.636155800Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Are not the study labels for classification mutually exclusive？</p>",
  "messages": [
    {
      "id": "1323664",
      "postDate": "05/26/2021 11:42:25",
      "content": "<p>Are not the study labels for classification mutually exclusive？</p>",
      "rawMarkdown": "Are not the study labels for classification mutually exclusive？",
      "votes": null
    },
    {
      "id": "1324071",
      "postDate": "05/26/2021 15:39:11",
      "content": "<p>Yes, study labels are mutually exclusive even though its mentioned <code>\"Studies in the test set may contain more than one label.\"</code> in <a href=\"https://www.kaggle.com/c/siim-covid19-detection/overview/evaluation\" target=\"_blank\">Evaluation</a> page. There is also mention to mutually exclusiveness <a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/240250\" target=\"_blank\">here</a>. In the training data each study has only 1 label. Although, this information alone doesn't guarantee this will be the case for the hidden test set all the public information provided from the host supports mutually exclusive study labels.</p>\n<p>Also, most of the studies have 1 image and since a radiograph/image can have 1 of the 4 labels study will also have only 1 label. There are studies with multiple images but those images are mostly augmented versions of another image from the same study. By taking all of the information into account it is easier to assume that a study is labelled with either one of the <code>\"negative\", \"typical\", \"indeterminate\", \"atypical\"</code> labels.</p>",
      "rawMarkdown": "Yes, study labels are mutually exclusive even though its mentioned `\"Studies in the test set may contain more than one label.\"` in [Evaluation](https://www.kaggle.com/c/siim-covid19-detection/overview/evaluation) page. There is also mention to mutually exclusiveness [here](https://www.kaggle.com/c/siim-covid19-detection/discussion/240250). In the training data each study has only 1 label. Although, this information alone doesn't guarantee this will be the case for the hidden test set all the public information provided from the host supports mutually exclusive study labels.\n\nAlso, most of the studies have 1 image and since a radiograph/image can have 1 of the 4 labels study will also have only 1 label. There are studies with multiple images but those images are mostly augmented versions of another image from the same study. By taking all of the information into account it is easier to assume that a study is labelled with either one of the `\"negative\", \"typical\", \"indeterminate\", \"atypical\"` labels.",
      "votes": null
    },
    {
      "id": "1324236",
      "postDate": "05/26/2021 18:13:20",
      "content": "<p>In my thread I got <a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/241238\" target=\"_blank\">https://www.kaggle.com/c/siim-covid19-detection/discussion/241238</a> response from Phil from Kaggle \"all studies should have one study-level label.\"</p>",
      "rawMarkdown": "In my thread I got https://www.kaggle.com/c/siim-covid19-detection/discussion/241238 response from Phil from Kaggle \"all studies should have one study-level label.\"",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1324071,
      "author_name": "keremt",
      "author_url": "",
      "post_date": "05/26/2021 15:39:11",
      "content": "<p>Yes, study labels are mutually exclusive even though its mentioned <code>\"Studies in the test set may contain more than one label.\"</code> in <a href=\"https://www.kaggle.com/c/siim-covid19-detection/overview/evaluation\" target=\"_blank\">Evaluation</a> page. There is also mention to mutually exclusiveness <a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/240250\" target=\"_blank\">here</a>. In the training data each study has only 1 label. Although, this information alone doesn't guarantee this will be the case for the hidden test set all the public information provided from the host supports mutually exclusive study labels.</p>\n<p>Also, most of the studies have 1 image and since a radiograph/image can have 1 of the 4 labels study will also have only 1 label. There are studies with multiple images but those images are mostly augmented versions of another image from the same study. By taking all of the information into account it is easier to assume that a study is labelled with either one of the <code>\"negative\", \"typical\", \"indeterminate\", \"atypical\"</code> labels.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1324236,
          "author_name": "jacekpoplawski",
          "author_url": "",
          "post_date": "05/26/2021 18:13:20",
          "content": "<p>In my thread I got <a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/241238\" target=\"_blank\">https://www.kaggle.com/c/siim-covid19-detection/discussion/241238</a> response from Phil from Kaggle \"all studies should have one study-level label.\"</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1323664": "Are not the study labels for classification mutually exclusive？",
    "1324071": "Yes, study labels are mutually exclusive even though its mentioned `\"Studies in the test set may contain more than one label.\"` in [Evaluation](https://www.kaggle.com/c/siim-covid19-detection/overview/evaluation) page. There is also mention to mutually exclusiveness [here](https://www.kaggle.com/c/siim-covid19-detection/discussion/240250). In the training data each study has only 1 label. Although, this information alone doesn't guarantee this will be the case for the hidden test set all the public information provided from the host supports mutually exclusive study labels.\n\nAlso, most of the studies have 1 image and since a radiograph/image can have 1 of the 4 labels study will also have only 1 label. There are studies with multiple images but those images are mostly augmented versions of another image from the same study. By taking all of the information into account it is easier to assume that a study is labelled with either one of the `\"negative\", \"typical\", \"indeterminate\", \"atypical\"` labels.",
    "1324236": "In my thread I got https://www.kaggle.com/c/siim-covid19-detection/discussion/241238 response from Phil from Kaggle \"all studies should have one study-level label.\""
  },
  "source": "meta"
}