{
  "id": 580801,
  "title": "Score Error After Metric Bug Fix?",
  "url": "/competitions/image-matching-challenge-2025/discussion/580801",
  "author_name": "",
  "post_date": "2025-05-26T14:23:11.829327900Z",
  "votes": 3,
  "comment_count": 1,
  "views": 0,
  "content": "<p>After the recent fix to the metric bug, I've started encountering score errors when I submit my notebook.<br>\nSubmissions that previously ran fine are now showing errors or unexpected behavior in the scoring process.</p>\n<p>In fact, even when I submit exactly the same notebook that was scored successfully before the fix, it now results in an error.</p>\n<p>Has anyone else experienced this issue since the update?<br>\nCould this be related to the recent changes in the evaluation metric?</p>\n<p>Any insights or suggestions would be greatly appreciated. Thanks!</p>",
  "messages": [
    {
      "id": "3209937",
      "postDate": "05/26/2025 14:23:11",
      "content": "<p>After the recent fix to the metric bug, I've started encountering score errors when I submit my notebook.<br>\nSubmissions that previously ran fine are now showing errors or unexpected behavior in the scoring process.</p>\n<p>In fact, even when I submit exactly the same notebook that was scored successfully before the fix, it now results in an error.</p>\n<p>Has anyone else experienced this issue since the update?<br>\nCould this be related to the recent changes in the evaluation metric?</p>\n<p>Any insights or suggestions would be greatly appreciated. Thanks!</p>",
      "rawMarkdown": "After the recent fix to the metric bug, I've started encountering score errors when I submit my notebook.\nSubmissions that previously ran fine are now showing errors or unexpected behavior in the scoring process.\n\nIn fact, even when I submit exactly the same notebook that was scored successfully before the fix, it now results in an error.\n\nHas anyone else experienced this issue since the update?\nCould this be related to the recent changes in the evaluation metric?\n\nAny insights or suggestions would be greatly appreciated. Thanks!",
      "votes": null
    },
    {
      "id": "3210106",
      "postDate": "05/26/2025 18:24:20",
      "content": "<p>Yes, I’ve noticed the same issue. Submissions that used to work fine are now throwing errors after the metric bug fix. It definitely seems like something has changed in the backend scoring logic. I think it might be helpful to double-check your output format or runtime environment. Sometimes even minor version changes in dependencies can cause unexpected behavior after a backend update.</p>",
      "rawMarkdown": "Yes, I’ve noticed the same issue. Submissions that used to work fine are now throwing errors after the metric bug fix. It definitely seems like something has changed in the backend scoring logic. I think it might be helpful to double-check your output format or runtime environment. Sometimes even minor version changes in dependencies can cause unexpected behavior after a backend update.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3210106,
      "author_name": "",
      "author_url": "",
      "post_date": "05/26/2025 18:24:20",
      "content": "<p>Yes, I’ve noticed the same issue. Submissions that used to work fine are now throwing errors after the metric bug fix. It definitely seems like something has changed in the backend scoring logic. I think it might be helpful to double-check your output format or runtime environment. Sometimes even minor version changes in dependencies can cause unexpected behavior after a backend update.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3209937": "After the recent fix to the metric bug, I've started encountering score errors when I submit my notebook.\nSubmissions that previously ran fine are now showing errors or unexpected behavior in the scoring process.\n\nIn fact, even when I submit exactly the same notebook that was scored successfully before the fix, it now results in an error.\n\nHas anyone else experienced this issue since the update?\nCould this be related to the recent changes in the evaluation metric?\n\nAny insights or suggestions would be greatly appreciated. Thanks!",
    "3210106": "Yes, I’ve noticed the same issue. Submissions that used to work fine are now throwing errors after the metric bug fix. It definitely seems like something has changed in the backend scoring logic. I think it might be helpful to double-check your output format or runtime environment. Sometimes even minor version changes in dependencies can cause unexpected behavior after a backend update."
  },
  "source": "meta"
}