{
  "id": 502238,
  "title": "How to no_call chunk effect to ROC AUC score in test_soundscape?",
  "url": "/competitions/birdclef-2024/discussion/502238",
  "author_name": "",
  "post_date": "2024-05-12T17:15:54.746247600Z",
  "votes": 5,
  "comment_count": 3,
  "views": 0,
  "content": "<p>In the test_soundscape recording, there are some no_call chunks. What label of these chunks in ground truth of test set. What effect of these chunks to ROC AUC score? I have bug in eval code, stranger is CV of bug code ~ 0.67 close to PB. CV no correlate with PB.</p>",
  "messages": [
    {
      "id": "2809341",
      "postDate": "05/12/2024 17:15:54",
      "content": "<p>In the test_soundscape recording, there are some no_call chunks. What label of these chunks in ground truth of test set. What effect of these chunks to ROC AUC score? I have bug in eval code, stranger is CV of bug code ~ 0.67 close to PB. CV no correlate with PB.</p>",
      "rawMarkdown": "In the test_soundscape recording, there are some no_call chunks. What label of these chunks in ground truth of test set. What effect of these chunks to ROC AUC score? I have bug in eval code, stranger is CV of bug code ~ 0.67 close to PB. CV no correlate with PB.",
      "votes": null
    },
    {
      "id": "2809680",
      "postDate": "05/12/2024 22:23:37",
      "content": "<p>If there is no call then label is 0 for all species. More generally, label is 0 except for the species for which there is a call.</p>",
      "rawMarkdown": "If there is no call then label is 0 for all species. More generally, label is 0 except for the species for which there is a call.",
      "votes": null
    },
    {
      "id": "2809776",
      "postDate": "05/13/2024 01:45:00",
      "content": "<p>Thank for answer. Now, I known why there is a gap between CV and LB. Un known sample effect a lot to ROC AUC score.</p>",
      "rawMarkdown": "Thank for answer. Now, I known why there is a gap between CV and LB. Un known sample effect a lot to ROC AUC score.",
      "votes": null
    },
    {
      "id": "2809777",
      "postDate": "05/13/2024 01:48:04",
      "content": "<p>snippet code demonstrate how no call chunk effect to roc auc. <a href=\"https://ideone.com/uleNMv\" target=\"_blank\">https://ideone.com/uleNMv</a></p>",
      "rawMarkdown": "snippet code demonstrate how no call chunk effect to roc auc. https://ideone.com/uleNMv",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2809680,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "05/12/2024 22:23:37",
      "content": "<p>If there is no call then label is 0 for all species. More generally, label is 0 except for the species for which there is a call.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2809776,
          "author_name": "quan0095",
          "author_url": "",
          "post_date": "05/13/2024 01:45:00",
          "content": "<p>Thank for answer. Now, I known why there is a gap between CV and LB. Un known sample effect a lot to ROC AUC score.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2809777,
          "author_name": "quan0095",
          "author_url": "",
          "post_date": "05/13/2024 01:48:04",
          "content": "<p>snippet code demonstrate how no call chunk effect to roc auc. <a href=\"https://ideone.com/uleNMv\" target=\"_blank\">https://ideone.com/uleNMv</a></p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2809341": "In the test_soundscape recording, there are some no_call chunks. What label of these chunks in ground truth of test set. What effect of these chunks to ROC AUC score? I have bug in eval code, stranger is CV of bug code ~ 0.67 close to PB. CV no correlate with PB.",
    "2809680": "If there is no call then label is 0 for all species. More generally, label is 0 except for the species for which there is a call.",
    "2809776": "Thank for answer. Now, I known why there is a gap between CV and LB. Un known sample effect a lot to ROC AUC score.",
    "2809777": "snippet code demonstrate how no call chunk effect to roc auc. https://ideone.com/uleNMv"
  },
  "source": "meta"
}