{
  "id": 221513,
  "title": "Is this multi-label or multi-class?",
  "url": "/competitions/ranzcr-clip-catheter-line-classification/discussion/221513",
  "author_name": "Chris Deotte",
  "post_date": "2021-02-23T01:09:50.502000",
  "votes": 30,
  "comment_count": 24,
  "views": 0,
  "content": "<p>At first i thought that CVC would be either be <code>normal</code>, <code>abnormal</code> or <code>neither</code> making this a multi-class problem where we can use <code>softmax</code> output. However, i notice that some train examples are simultaneously <code>normal</code> and <code>abnormal</code>, thus perhaps this is multi-label and we should use <code>sigmoid</code> output.</p>\n<p>What does it mean for CVC to be both <code>normal</code> and <code>abnormal</code>?</p>\n<p>I do notice that ETT is multi-class. It is either <code>normal</code>, <code>abnormal</code>, <code>borderline</code>, or <code>neither</code>. And it takes exactly 1 and only 1 of those classes.</p>",
  "messages": [
    {
      "id": 1214561,
      "postDate": "2021-02-23T01:09:50.503Z",
      "content": "<p>At first i thought that CVC would be either be <code>normal</code>, <code>abnormal</code> or <code>neither</code> making this a multi-class problem where we can use <code>softmax</code> output. However, i notice that some train examples are simultaneously <code>normal</code> and <code>abnormal</code>, thus perhaps this is multi-label and we should use <code>sigmoid</code> output.</p>\n<p>What does it mean for CVC to be both <code>normal</code> and <code>abnormal</code>?</p>\n<p>I do notice that ETT is multi-class. It is either <code>normal</code>, <code>abnormal</code>, <code>borderline</code>, or <code>neither</code>. And it takes exactly 1 and only 1 of those classes.</p>",
      "rawMarkdown": "At first i thought that CVC would be either be `normal`, `abnormal` or `neither` making this a multi-class problem where we can use `softmax` output. However, i notice that some train examples are simultaneously `normal` and `abnormal`, thus perhaps this is multi-label and we should use `sigmoid` output.\n\nWhat does it mean for CVC to be both `normal` and `abnormal`?\n\nI do notice that ETT is multi-class. It is either `normal`, `abnormal`, `borderline`, or `neither`. And it takes exactly 1 and only 1 of those classes.",
      "votes": 30
    },
    {
      "id": 1215426,
      "postDate": "2021-02-23T15:44:01.863Z",
      "content": "<p>Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D</p>",
      "rawMarkdown": "Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D",
      "votes": 21,
      "replies": [
        {
          "id": 1216240,
          "postDate": "2021-02-24T06:47:58.717Z",
          "content": "<p>Once he understands it, he will get to the top positions. :p</p>\n<p>Best of luck to both of you!</p>",
          "rawMarkdown": "Once he understands it, he will get to the top positions. :p\n\nBest of luck to both of you!",
          "votes": 1
        },
        {
          "id": 1216389,
          "postDate": "2021-02-24T08:41:12.787Z",
          "content": "<blockquote>\n  <p>Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D</p>\n</blockquote>\n<p>In a lousy day at work, I had a good laugh reading this :) Thank you </p>",
          "rawMarkdown": "> Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D\n\nIn a lousy day at work, I had a good laugh reading this :) Thank you ",
          "votes": 8
        },
        {
          "id": 1216939,
          "postDate": "2021-02-24T16:22:34.720Z",
          "content": "<p>Sure, that's machine learning 😉</p>",
          "rawMarkdown": "Sure, that's machine learning 😉",
          "votes": 4
        },
        {
          "id": 1220039,
          "postDate": "2021-02-27T13:36:58.417Z",
          "content": "<p><a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> ,</p>\n<p>still laughing… =)</p>",
          "rawMarkdown": "@raddar ,\n\nstill laughing... =)"
        },
        {
          "id": 1220160,
          "postDate": "2021-02-27T16:42:51.910Z",
          "content": "<p>Whether what's the acutal problem, I think bce and ensemble always work</p>",
          "rawMarkdown": "Whether what's the acutal problem, I think bce and ensemble always work",
          "votes": 2
        }
      ]
    },
    {
      "id": 1214566,
      "postDate": "2021-02-23T01:15:55.617Z",
      "content": "<p>Is <strong>multi label binary classification</strong>, i did the same question <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/203339\" target=\"_blank\">here</a> and you can read the host's answer.</p>",
      "rawMarkdown": "Is **multi label binary classification**, i did the same question [here](https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/203339) and you can read the host's answer.",
      "votes": 3,
      "replies": [
        {
          "id": 1214568,
          "postDate": "2021-02-23T01:19:32.087Z",
          "content": "<p>Thanks for the link. Yes, the host says this is multi label. But what does it mean to be both normal and abnormal. Can any doctors shed some light on this?</p>",
          "rawMarkdown": "Thanks for the link. Yes, the host says this is multi label. But what does it mean to be both normal and abnormal. Can any doctors shed some light on this?",
          "votes": 6
        },
        {
          "id": 1214574,
          "postDate": "2021-02-23T01:28:10.457Z",
          "content": "<ul>\n<li><code>normal</code>:  Includes lines (tubes) that were appropriately positioned and did not require repositioning</li>\n<li><code>abnormal</code>: <strong>Is the reason of this competition</strong>, lines (tubes) placed so bad that could lead a medical complication and required immediate repositioning.</li>\n<li><code>borderline</code>:  Are lines that would ideally require some repositioning but would in most cases still function adequately in their current position.</li>\n</ul>",
          "rawMarkdown": "- `normal`:  Includes lines (tubes) that were appropriately positioned and did not require repositioning\n- `abnormal`: **Is the reason of this competition**, lines (tubes) placed so bad that could lead a medical complication and required immediate repositioning.\n- `borderline`:  Are lines that would ideally require some repositioning but would in most cases still function adequately in their current position.",
          "votes": 2
        },
        {
          "id": 1214588,
          "postDate": "2021-02-23T01:39:57.200Z",
          "content": "<p>Then it is strange that lines (tubes) are both <code>appropriately positioned</code> and <code>placed so bad</code> simultaneously</p>",
          "rawMarkdown": "Then it is strange that lines (tubes) are both `appropriately positioned` and `placed so bad` simultaneously",
          "votes": 6
        },
        {
          "id": 1214593,
          "postDate": "2021-02-23T01:47:57.413Z",
          "content": "<p>In the \"Overview\" section they wrote \"lines\" as plural, i think (maybe i'm wrong) that one is labeled as <code>normal</code> and the other as <code>abnormal</code>. A quick visualization could help. Someone soon is going to answer your question properly.</p>",
          "rawMarkdown": "In the \"Overview\" section they wrote \"lines\" as plural, i think (maybe i'm wrong) that one is labeled as `normal` and the other as `abnormal`. A quick visualization could help. Someone soon is going to answer your question properly.",
          "votes": 1
        },
        {
          "id": 1214612,
          "postDate": "2021-02-23T02:14:21.957Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 1214614,
          "postDate": "2021-02-23T02:14:31.980Z",
          "content": "<p>You can see this <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/216887\" target=\"_blank\">Reason why a person can have CVC(Normal) And CVC(Abnormal) values at the same time?</a>.</p>",
          "rawMarkdown": "You can see this [Reason why a person can have CVC(Normal) And CVC(Abnormal) values at the same time?](https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/216887).",
          "votes": 4
        },
        {
          "id": 1214662,
          "postDate": "2021-02-23T03:12:20.420Z",
          "content": "<p>Thanks <a href=\"https://www.kaggle.com/h053473666\" target=\"_blank\">@h053473666</a> It sounds like a person can have two tubes whereas one is position correctly and the second is not. I'll review some more images to confirm this.</p>",
          "rawMarkdown": "Thanks @h053473666 It sounds like a person can have two tubes whereas one is position correctly and the second is not. I'll review some more images to confirm this.",
          "votes": 11
        },
        {
          "id": 1216943,
          "postDate": "2021-02-24T16:25:56.820Z",
          "content": "<p>Maybe this evaluation is helpful: <a href=\"https://www.kaggle.com/docxian/ranzcr-clip-target-structure-analysis\" target=\"_blank\">https://www.kaggle.com/docxian/ranzcr-clip-target-structure-analysis</a></p>",
          "rawMarkdown": "Maybe this evaluation is helpful: https://www.kaggle.com/docxian/ranzcr-clip-target-structure-analysis",
          "votes": 2
        },
        {
          "id": 1217164,
          "postDate": "2021-02-24T20:02:54.710Z",
          "content": "<p>These are very interesting insights. Thanks to all. 👌 </p>",
          "rawMarkdown": "These are very interesting insights. Thanks to all. 👌 "
        },
        {
          "id": 1219770,
          "postDate": "2021-02-27T08:15:30.300Z",
          "content": "<p>Yes, it is the case that people can have multiple lines. Some even have &gt;5 lines in this dataset</p>",
          "rawMarkdown": "Yes, it is the case that people can have multiple lines. Some even have >5 lines in this dataset"
        },
        {
          "id": 1220388,
          "postDate": "2021-02-27T23:02:17.373Z",
          "content": "<p>Some images contain more than 1 tube of the same kind.</p>",
          "rawMarkdown": "Some images contain more than 1 tube of the same kind."
        }
      ]
    },
    {
      "id": 1227927,
      "postDate": "2021-03-06T00:03:23.287Z",
      "content": "<p>Thanks everyone for answering my question. It appears the explanation for having seemingly contradicting labels is that some images have more than one CVC inserted. I displayed some EDA <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/223880\" target=\"_blank\">here</a></p>",
      "rawMarkdown": "Thanks everyone for answering my question. It appears the explanation for having seemingly contradicting labels is that some images have more than one CVC inserted. I displayed some EDA [here][1]\n\n[1]: https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/223880",
      "votes": 1
    },
    {
      "id": 1219771,
      "postDate": "2021-02-27T08:16:48.393Z",
      "content": "<p>Regardless of whether it is multi label or multi class because we are being scored against individual columns auc I would think that softmax would yield some undesirable properties. Confidence of one class would affect another and change the sort order. </p>",
      "rawMarkdown": "Regardless of whether it is multi label or multi class because we are being scored against individual columns auc I would think that softmax would yield some undesirable properties. Confidence of one class would affect another and change the sort order. ",
      "votes": 1
    },
    {
      "id": 1216238,
      "postDate": "2021-02-24T06:47:24.680Z",
      "content": "<p>I had exactly the same question regarding the CVC classes. Thanks for asking the question. :)<br>\nI think one approach to explore is to train a separate model for CVC classes one that outputs multi-labels.</p>\n<p>Or maybe the problem is with the annotated data?</p>",
      "rawMarkdown": "I had exactly the same question regarding the CVC classes. Thanks for asking the question. :)\nI think one approach to explore is to train a separate model for CVC classes one that outputs multi-labels.\n\nOr maybe the problem is with the annotated data?",
      "votes": 1
    },
    {
      "id": 1219187,
      "postDate": "2021-02-26T14:28:09.133Z",
      "content": "<p>Does system configuration affects your score? in a cometition please answer?</p>",
      "rawMarkdown": "Does system configuration affects your score? in a cometition please answer?",
      "replies": [
        {
          "id": 1219224,
          "postDate": "2021-02-26T15:19:38.950Z",
          "content": "<p>What do you mean by <code>system configuration</code> ? Can you elaborate?</p>",
          "rawMarkdown": "What do you mean by `system configuration` ? Can you elaborate?"
        },
        {
          "id": 1219910,
          "postDate": "2021-02-27T10:55:42.153Z",
          "content": "<p>Are you asking about the resources one is using,  i.e. local GPU vs cloud GPU? Or rather the software used i.e. Pytorch vs Tensorflow? <a href=\"https://www.kaggle.com/santoshd3\" target=\"_blank\">@santoshd3</a> </p>",
          "rawMarkdown": "Are you asking about the resources one is using,  i.e. local GPU vs cloud GPU? Or rather the software used i.e. Pytorch vs Tensorflow? @santoshd3 "
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1215426,
      "author_name": "raddar",
      "author_url": "",
      "post_date": "2021-02-23T15:44:01.863000",
      "content": "<p>Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D</p>",
      "votes": 21,
      "replies": [
        {
          "id": 1216240,
          "author_name": "Yassine Alouini",
          "author_url": "",
          "post_date": "2021-02-24T06:47:58.717000",
          "content": "<p>Once he understands it, he will get to the top positions. :p</p>\n<p>Best of luck to both of you!</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1216389,
          "author_name": "yukiya",
          "author_url": "",
          "post_date": "2021-02-24T08:41:12.787000",
          "content": "<blockquote>\n  <p>Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D</p>\n</blockquote>\n<p>In a lousy day at work, I had a good laugh reading this :) Thank you </p>",
          "votes": 8,
          "replies": []
        },
        {
          "id": 1216939,
          "author_name": "Chris X",
          "author_url": "",
          "post_date": "2021-02-24T16:22:34.720000",
          "content": "<p>Sure, that's machine learning 😉</p>",
          "votes": 4,
          "replies": []
        },
        {
          "id": 1220039,
          "author_name": "dr. Konya",
          "author_url": "",
          "post_date": "2021-02-27T13:36:58.417000",
          "content": "<p><a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> ,</p>\n<p>still laughing… =)</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1220160,
          "author_name": "sheep",
          "author_url": "",
          "post_date": "2021-02-27T16:42:51.910000",
          "content": "<p>Whether what's the acutal problem, I think bce and ensemble always work</p>",
          "votes": 2,
          "replies": []
        }
      ]
    },
    {
      "id": 1214566,
      "author_name": "Hiram Coria 🧬",
      "author_url": "",
      "post_date": "2021-02-23T01:15:55.617000",
      "content": "<p>Is <strong>multi label binary classification</strong>, i did the same question <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/203339\" target=\"_blank\">here</a> and you can read the host's answer.</p>",
      "votes": 3,
      "replies": [
        {
          "id": 1214568,
          "author_name": "Chris Deotte",
          "author_url": "",
          "post_date": "2021-02-23T01:19:32.087000",
          "content": "<p>Thanks for the link. Yes, the host says this is multi label. But what does it mean to be both normal and abnormal. Can any doctors shed some light on this?</p>",
          "votes": 6,
          "replies": []
        },
        {
          "id": 1214574,
          "author_name": "Hiram Coria 🧬",
          "author_url": "",
          "post_date": "2021-02-23T01:28:10.457000",
          "content": "<ul>\n<li><code>normal</code>:  Includes lines (tubes) that were appropriately positioned and did not require repositioning</li>\n<li><code>abnormal</code>: <strong>Is the reason of this competition</strong>, lines (tubes) placed so bad that could lead a medical complication and required immediate repositioning.</li>\n<li><code>borderline</code>:  Are lines that would ideally require some repositioning but would in most cases still function adequately in their current position.</li>\n</ul>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1214588,
          "author_name": "Chris Deotte",
          "author_url": "",
          "post_date": "2021-02-23T01:39:57.200000",
          "content": "<p>Then it is strange that lines (tubes) are both <code>appropriately positioned</code> and <code>placed so bad</code> simultaneously</p>",
          "votes": 6,
          "replies": []
        },
        {
          "id": 1214593,
          "author_name": "Hiram Coria 🧬",
          "author_url": "",
          "post_date": "2021-02-23T01:47:57.413000",
          "content": "<p>In the \"Overview\" section they wrote \"lines\" as plural, i think (maybe i'm wrong) that one is labeled as <code>normal</code> and the other as <code>abnormal</code>. A quick visualization could help. Someone soon is going to answer your question properly.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1214612,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-02-23T02:14:21.957000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1214614,
          "author_name": "Alien",
          "author_url": "",
          "post_date": "2021-02-23T02:14:31.980000",
          "content": "<p>You can see this <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/216887\" target=\"_blank\">Reason why a person can have CVC(Normal) And CVC(Abnormal) values at the same time?</a>.</p>",
          "votes": 4,
          "replies": []
        },
        {
          "id": 1214662,
          "author_name": "Chris Deotte",
          "author_url": "",
          "post_date": "2021-02-23T03:12:20.420000",
          "content": "<p>Thanks <a href=\"https://www.kaggle.com/h053473666\" target=\"_blank\">@h053473666</a> It sounds like a person can have two tubes whereas one is position correctly and the second is not. I'll review some more images to confirm this.</p>",
          "votes": 11,
          "replies": []
        },
        {
          "id": 1216943,
          "author_name": "Chris X",
          "author_url": "",
          "post_date": "2021-02-24T16:25:56.820000",
          "content": "<p>Maybe this evaluation is helpful: <a href=\"https://www.kaggle.com/docxian/ranzcr-clip-target-structure-analysis\" target=\"_blank\">https://www.kaggle.com/docxian/ranzcr-clip-target-structure-analysis</a></p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1217164,
          "author_name": "Yassine Alouini",
          "author_url": "",
          "post_date": "2021-02-24T20:02:54.710000",
          "content": "<p>These are very interesting insights. Thanks to all. 👌 </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1219770,
          "author_name": "ryches",
          "author_url": "",
          "post_date": "2021-02-27T08:15:30.300000",
          "content": "<p>Yes, it is the case that people can have multiple lines. Some even have &gt;5 lines in this dataset</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1220388,
          "author_name": "Tolga",
          "author_url": "",
          "post_date": "2021-02-27T23:02:17.373000",
          "content": "<p>Some images contain more than 1 tube of the same kind.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1227927,
      "author_name": "Chris Deotte",
      "author_url": "",
      "post_date": "2021-03-06T00:03:23.287000",
      "content": "<p>Thanks everyone for answering my question. It appears the explanation for having seemingly contradicting labels is that some images have more than one CVC inserted. I displayed some EDA <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/223880\" target=\"_blank\">here</a></p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1219771,
      "author_name": "ryches",
      "author_url": "",
      "post_date": "2021-02-27T08:16:48.393000",
      "content": "<p>Regardless of whether it is multi label or multi class because we are being scored against individual columns auc I would think that softmax would yield some undesirable properties. Confidence of one class would affect another and change the sort order. </p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1216238,
      "author_name": "Yassine Alouini",
      "author_url": "",
      "post_date": "2021-02-24T06:47:24.680000",
      "content": "<p>I had exactly the same question regarding the CVC classes. Thanks for asking the question. :)<br>\nI think one approach to explore is to train a separate model for CVC classes one that outputs multi-labels.</p>\n<p>Or maybe the problem is with the annotated data?</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1219187,
      "author_name": "Santosh kumar",
      "author_url": "",
      "post_date": "2021-02-26T14:28:09.133000",
      "content": "<p>Does system configuration affects your score? in a cometition please answer?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1219224,
          "author_name": "Chris Deotte",
          "author_url": "",
          "post_date": "2021-02-26T15:19:38.950000",
          "content": "<p>What do you mean by <code>system configuration</code> ? Can you elaborate?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1219910,
          "author_name": "Yassine Alouini",
          "author_url": "",
          "post_date": "2021-02-27T10:55:42.153000",
          "content": "<p>Are you asking about the resources one is using,  i.e. local GPU vs cloud GPU? Or rather the software used i.e. Pytorch vs Tensorflow? <a href=\"https://www.kaggle.com/santoshd3\" target=\"_blank\">@santoshd3</a> </p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1214561": "At first i thought that CVC would be either be `normal`, `abnormal` or `neither` making this a multi-class problem where we can use `softmax` output. However, i notice that some train examples are simultaneously `normal` and `abnormal`, thus perhaps this is multi-label and we should use `sigmoid` output.\n\nWhat does it mean for CVC to be both `normal` and `abnormal`?\n\nI do notice that ETT is multi-class. It is either `normal`, `abnormal`, `borderline`, or `neither`. And it takes exactly 1 and only 1 of those classes.",
    "1215426": "Nice question - it seems you do not need to know what the acual problem is to score 0.968 on LB :D",
    "1214566": "Is **multi label binary classification**, i did the same question [here](https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/203339) and you can read the host's answer.",
    "1227927": "Thanks everyone for answering my question. It appears the explanation for having seemingly contradicting labels is that some images have more than one CVC inserted. I displayed some EDA [here][1]\n\n[1]: https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/223880",
    "1219771": "Regardless of whether it is multi label or multi class because we are being scored against individual columns auc I would think that softmax would yield some undesirable properties. Confidence of one class would affect another and change the sort order. ",
    "1216238": "I had exactly the same question regarding the CVC classes. Thanks for asking the question. :)\nI think one approach to explore is to train a separate model for CVC classes one that outputs multi-labels.\n\nOr maybe the problem is with the annotated data?",
    "1219187": "Does system configuration affects your score? in a cometition please answer?"
  }
}