{
  "id": 395109,
  "title": "clarification about evaluation language",
  "url": "/competitions/tlvmc-parkinsons-freezing-gait-prediction/discussion/395109",
  "author_name": "",
  "post_date": "2023-03-15T23:39:12.005496600Z",
  "votes": 3,
  "comment_count": 4,
  "views": 0,
  "content": "<p>The description of the submission file in the evaluation description states that \"In the ground truth, only one event class has a non-zero value for each Id.\" Just confirming that I should read this as \"<strong>at most one</strong> event class has a non-zero value for each Id,\" i.e., scored ids may not be of any of the event types?</p>",
  "messages": [
    {
      "id": "2183797",
      "postDate": "03/15/2023 23:39:12",
      "content": "<p>The description of the submission file in the evaluation description states that \"In the ground truth, only one event class has a non-zero value for each Id.\" Just confirming that I should read this as \"<strong>at most one</strong> event class has a non-zero value for each Id,\" i.e., scored ids may not be of any of the event types?</p>",
      "rawMarkdown": "The description of the submission file in the evaluation description states that \"In the ground truth, only one event class has a non-zero value for each Id.\" Just confirming that I should read this as \"**at most one** event class has a non-zero value for each Id,\" i.e., scored ids may not be of any of the event types?",
      "votes": null
    },
    {
      "id": "2184495",
      "postDate": "03/16/2023 12:14:09",
      "content": "<p>That's correct. I'll amend the description to clarify. Thanks!</p>",
      "rawMarkdown": "That's correct. I'll amend the description to clarify. Thanks!",
      "votes": null
    },
    {
      "id": "2184968",
      "postDate": "03/16/2023 17:58:00",
      "content": "<p>In other words the possible combinations for the ground truth are the following:</p>\n<p>0, 0, 0<br>\n1, 0, 0<br>\n0, 1, 0<br>\n0, 0, 1</p>\n<p>Therefore you have 4 classes, then you can also try this problem as a multi class problem. </p>",
      "rawMarkdown": "In other words the possible combinations for the ground truth are the following:\n\n0, 0, 0\n1, 0, 0\n0, 1, 0\n0, 0, 1\n\nTherefore you have 4 classes, then you can also try this problem as a multi class problem.",
      "votes": null
    },
    {
      "id": "2185135",
      "postDate": "03/16/2023 20:48:44",
      "content": "<p>what else would it be than a multi class problem?</p>",
      "rawMarkdown": "what else would it be than a multi class problem?",
      "votes": null
    },
    {
      "id": "2185270",
      "postDate": "03/16/2023 23:05:30",
      "content": "<p>My understanding is that there are several options:  Multi-label multi-class  classifications allow for more than one class to be a 1.  Single label Multi-class problems allow for only a single 1.  Fuzzy Classification allows for P(x) &lt; 1 for each input where sum(P(x)) = 1.     Since the results seem to allow for fuzzy classification (or even values that are not restricted to probabilities), you don't have to try this problem as a single-label multi-class problem for the end submission and thus, your methods are not limited to identifying thresholds to decide on how to re-code the answer into a single label.  (I may be very wrong on this since I'm just learning, so I'm very sorry if this is totally off the mark.)</p>",
      "rawMarkdown": "My understanding is that there are several options:  Multi-label multi-class  classifications allow for more than one class to be a 1.  Single label Multi-class problems allow for only a single 1.  Fuzzy Classification allows for P(x) < 1 for each input where sum(P(x)) = 1.     Since the results seem to allow for fuzzy classification (or even values that are not restricted to probabilities), you don't have to try this problem as a single-label multi-class problem for the end submission and thus, your methods are not limited to identifying thresholds to decide on how to re-code the answer into a single label.  (I may be very wrong on this since I'm just learning, so I'm very sorry if this is totally off the mark.)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2184495,
      "author_name": "ryanholbrook",
      "author_url": "",
      "post_date": "03/16/2023 12:14:09",
      "content": "<p>That's correct. I'll amend the description to clarify. Thanks!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2184968,
      "author_name": "ragnar123",
      "author_url": "",
      "post_date": "03/16/2023 17:58:00",
      "content": "<p>In other words the possible combinations for the ground truth are the following:</p>\n<p>0, 0, 0<br>\n1, 0, 0<br>\n0, 1, 0<br>\n0, 0, 1</p>\n<p>Therefore you have 4 classes, then you can also try this problem as a multi class problem. </p>",
      "votes": null,
      "replies": [
        {
          "id": 2185135,
          "author_name": "richarddinga",
          "author_url": "",
          "post_date": "03/16/2023 20:48:44",
          "content": "<p>what else would it be than a multi class problem?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2185270,
              "author_name": "josephreid",
              "author_url": "",
              "post_date": "03/16/2023 23:05:30",
              "content": "<p>My understanding is that there are several options:  Multi-label multi-class  classifications allow for more than one class to be a 1.  Single label Multi-class problems allow for only a single 1.  Fuzzy Classification allows for P(x) &lt; 1 for each input where sum(P(x)) = 1.     Since the results seem to allow for fuzzy classification (or even values that are not restricted to probabilities), you don't have to try this problem as a single-label multi-class problem for the end submission and thus, your methods are not limited to identifying thresholds to decide on how to re-code the answer into a single label.  (I may be very wrong on this since I'm just learning, so I'm very sorry if this is totally off the mark.)</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2183797": "The description of the submission file in the evaluation description states that \"In the ground truth, only one event class has a non-zero value for each Id.\" Just confirming that I should read this as \"**at most one** event class has a non-zero value for each Id,\" i.e., scored ids may not be of any of the event types?",
    "2184495": "That's correct. I'll amend the description to clarify. Thanks!",
    "2184968": "In other words the possible combinations for the ground truth are the following:\n\n0, 0, 0\n1, 0, 0\n0, 1, 0\n0, 0, 1\n\nTherefore you have 4 classes, then you can also try this problem as a multi class problem.",
    "2185135": "what else would it be than a multi class problem?",
    "2185270": "My understanding is that there are several options:  Multi-label multi-class  classifications allow for more than one class to be a 1.  Single label Multi-class problems allow for only a single 1.  Fuzzy Classification allows for P(x) < 1 for each input where sum(P(x)) = 1.     Since the results seem to allow for fuzzy classification (or even values that are not restricted to probabilities), you don't have to try this problem as a single-label multi-class problem for the end submission and thus, your methods are not limited to identifying thresholds to decide on how to re-code the answer into a single label.  (I may be very wrong on this since I'm just learning, so I'm very sorry if this is totally off the mark.)"
  },
  "source": "meta"
}