{
  "id": 613049,
  "title": "Leaderboard score not representative of private test performance.",
  "url": "/competitions/physionet-ecg-image-digitization/discussion/613049",
  "author_name": "",
  "post_date": "2025-10-23T23:20:06.845601800Z",
  "votes": 3,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Just want to make sure that the leaderboard score is based on just the two images generated by ECG-image-kit. This is bound to be widely different from the score on a large and varied private test set, correct?</p>",
  "messages": [
    {
      "id": "3306008",
      "postDate": "10/23/2025 23:20:06",
      "content": "<p>Just want to make sure that the leaderboard score is based on just the two images generated by ECG-image-kit. This is bound to be widely different from the score on a large and varied private test set, correct?</p>",
      "rawMarkdown": "Just want to make sure that the leaderboard score is based on just the two images generated by ECG-image-kit. This is bound to be widely different from the score on a large and varied private test set, correct?",
      "votes": null
    },
    {
      "id": "3306089",
      "postDate": "10/24/2025 01:12:04",
      "content": "<p>No. <br>\nThe Leaderboard page says:: \"This leaderboard is calculated with approximately 20% of the test data. The final results will be based on the other 80%, so the final standings may be different.\"<br>\nSo, private test set = 0.2 * ~1000  = ~200</p>",
      "rawMarkdown": "No. \nThe Leaderboard page says:: \"This leaderboard is calculated with approximately 20% of the test data. The final results will be based on the other 80%, so the final standings may be different.\"\nSo, private test set = 0.2 * ~1000  = ~200",
      "votes": null
    },
    {
      "id": "3306117",
      "postDate": "10/24/2025 01:54:31",
      "content": "<p>Thank you. I missed that description.</p>",
      "rawMarkdown": "Thank you. I missed that description.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3306089,
      "author_name": "sapr3s",
      "author_url": "",
      "post_date": "10/24/2025 01:12:04",
      "content": "<p>No. <br>\nThe Leaderboard page says:: \"This leaderboard is calculated with approximately 20% of the test data. The final results will be based on the other 80%, so the final standings may be different.\"<br>\nSo, private test set = 0.2 * ~1000  = ~200</p>",
      "votes": null,
      "replies": [
        {
          "id": 3306117,
          "author_name": "pauljurczak",
          "author_url": "",
          "post_date": "10/24/2025 01:54:31",
          "content": "<p>Thank you. I missed that description.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3306008": "Just want to make sure that the leaderboard score is based on just the two images generated by ECG-image-kit. This is bound to be widely different from the score on a large and varied private test set, correct?",
    "3306089": "No. \nThe Leaderboard page says:: \"This leaderboard is calculated with approximately 20% of the test data. The final results will be based on the other 80%, so the final standings may be different.\"\nSo, private test set = 0.2 * ~1000  = ~200",
    "3306117": "Thank you. I missed that description."
  },
  "source": "meta"
}