{
  "id": 508522,
  "title": "Metric patch and rescore (complete)",
  "url": "/competitions/rsna-2024-lumbar-spine-degenerative-classification/discussion/508522",
  "author_name": "Sohier Dane",
  "post_date": "2024-05-30T01:28:59.038000",
  "votes": 21,
  "comment_count": 0,
  "views": 0,
  "content": "<p>As pointed out <a href=\"https://www.kaggle.com/competitions/rsna-2024-lumbar-spine-degenerative-classification/discussion/508319\" target=\"_blank\">in this thread</a>, the metric contained a bug that essentially eliminated the impact of the <code>any_severe_spinal</code> calculation. It was the same for all submissions. I've posted a preliminary patch to <a href=\"https://www.kaggle.com/code/metric/rsna-lumbar-metric-71549\" target=\"_blank\">the metric</a> and will rescore all submissions after I have time to conduct another review of the metric to make sure that was the only oversight.</p>\n<p>Apologies for the mistake and confusion, and thank you to <a href=\"https://www.kaggle.com/yosukeyama\" target=\"_blank\">@yosukeyama</a> for flagging the issue.</p>\n<p>Edit: the rescore is in progress.</p>\n<p>Edit 2: the rescore is now complete.</p>",
  "messages": [
    {
      "id": 2844145,
      "postDate": "2024-05-30T01:28:59.040Z",
      "content": "<p>As pointed out <a href=\"https://www.kaggle.com/competitions/rsna-2024-lumbar-spine-degenerative-classification/discussion/508319\" target=\"_blank\">in this thread</a>, the metric contained a bug that essentially eliminated the impact of the <code>any_severe_spinal</code> calculation. It was the same for all submissions. I've posted a preliminary patch to <a href=\"https://www.kaggle.com/code/metric/rsna-lumbar-metric-71549\" target=\"_blank\">the metric</a> and will rescore all submissions after I have time to conduct another review of the metric to make sure that was the only oversight.</p>\n<p>Apologies for the mistake and confusion, and thank you to <a href=\"https://www.kaggle.com/yosukeyama\" target=\"_blank\">@yosukeyama</a> for flagging the issue.</p>\n<p>Edit: the rescore is in progress.</p>\n<p>Edit 2: the rescore is now complete.</p>",
      "rawMarkdown": "As pointed out [in this thread](https://www.kaggle.com/competitions/rsna-2024-lumbar-spine-degenerative-classification/discussion/508319), the metric contained a bug that essentially eliminated the impact of the `any_severe_spinal` calculation. It was the same for all submissions. I've posted a preliminary patch to [the metric](https://www.kaggle.com/code/metric/rsna-lumbar-metric-71549) and will rescore all submissions after I have time to conduct another review of the metric to make sure that was the only oversight.\n\nApologies for the mistake and confusion, and thank you to @yosukeyama for flagging the issue.\n\nEdit: the rescore is in progress.\n\nEdit 2: the rescore is now complete.",
      "votes": 21
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2844145": "As pointed out [in this thread](https://www.kaggle.com/competitions/rsna-2024-lumbar-spine-degenerative-classification/discussion/508319), the metric contained a bug that essentially eliminated the impact of the `any_severe_spinal` calculation. It was the same for all submissions. I've posted a preliminary patch to [the metric](https://www.kaggle.com/code/metric/rsna-lumbar-metric-71549) and will rescore all submissions after I have time to conduct another review of the metric to make sure that was the only oversight.\n\nApologies for the mistake and confusion, and thank you to @yosukeyama for flagging the issue.\n\nEdit: the rescore is in progress.\n\nEdit 2: the rescore is now complete."
  }
}