{
  "id": 254199,
  "title": "Huge AUC difference between CV and LB",
  "url": "/competitions/seti-breakthrough-listen/discussion/254199",
  "author_name": "batchelor",
  "post_date": "2021-07-20T15:13:20.745000",
  "votes": 1,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I'm getting an AUC of 0.957 during CV, but when I submit to the leaderboard, it's scored at 0.627 AUC.  Is this happening to everyone else?</p>",
  "messages": [
    {
      "id": 1394753,
      "postDate": "2021-07-20T15:21:43.123Z",
      "content": "<p>people reported a smaller gap, but still large gap of 0.1 roughly.</p>",
      "rawMarkdown": "people reported a smaller gap, but still large gap of 0.1 roughly.",
      "votes": 4
    },
    {
      "id": 1395168,
      "postDate": "2021-07-21T01:44:23.647Z",
      "content": "<p>Do you use old data? If so, then the gap is relatively normal</p>",
      "rawMarkdown": "Do you use old data? If so, then the gap is relatively normal",
      "votes": 1
    },
    {
      "id": 1395145,
      "postDate": "2021-07-21T00:41:18.317Z",
      "content": "<p>The data is created artificially right? That means the gap is created intentionally…</p>\n<p>If so I wonder what's the practical reason behind doing this.</p>",
      "rawMarkdown": "The data is created artificially right? That means the gap is created intentionally...\n\nIf so I wonder what's the practical reason behind doing this.",
      "votes": 1,
      "replies": [
        {
          "id": 1395544,
          "postDate": "2021-07-21T09:52:30.810Z",
          "content": "<p>Maybe because of domain shift between train and test data, but as this is kind of special spectrogram data and the target is difficult to visible, even the new data is more difficult to see the target by human eyes, maybe figure out how to relief the domain gap is the key for this competition.</p>",
          "rawMarkdown": "Maybe because of domain shift between train and test data, but as this is kind of special spectrogram data and the target is difficult to visible, even the new data is more difficult to see the target by human eyes, maybe figure out how to relief the domain gap is the key for this competition.",
          "votes": 1
        }
      ]
    },
    {
      "id": 1394748,
      "postDate": "2021-07-20T15:13:20.747Z",
      "content": "<p>I'm getting an AUC of 0.957 during CV, but when I submit to the leaderboard, it's scored at 0.627 AUC.  Is this happening to everyone else?</p>",
      "rawMarkdown": "I'm getting an AUC of 0.957 during CV, but when I submit to the leaderboard, it's scored at 0.627 AUC.  Is this happening to everyone else?",
      "votes": 1
    }
  ],
  "comments": [
    {
      "id": 1394753,
      "author_name": "CPMP",
      "author_url": "",
      "post_date": "2021-07-20T15:21:43.123000",
      "content": "<p>people reported a smaller gap, but still large gap of 0.1 roughly.</p>",
      "votes": 4,
      "replies": []
    },
    {
      "id": 1395168,
      "author_name": "zhangeng",
      "author_url": "",
      "post_date": "2021-07-21T01:44:23.647000",
      "content": "<p>Do you use old data? If so, then the gap is relatively normal</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1395145,
      "author_name": "dan",
      "author_url": "",
      "post_date": "2021-07-21T00:41:18.317000",
      "content": "<p>The data is created artificially right? That means the gap is created intentionally…</p>\n<p>If so I wonder what's the practical reason behind doing this.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1395544,
          "author_name": "Hao",
          "author_url": "",
          "post_date": "2021-07-21T09:52:30.810000",
          "content": "<p>Maybe because of domain shift between train and test data, but as this is kind of special spectrogram data and the target is difficult to visible, even the new data is more difficult to see the target by human eyes, maybe figure out how to relief the domain gap is the key for this competition.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1394753": "people reported a smaller gap, but still large gap of 0.1 roughly.",
    "1395168": "Do you use old data? If so, then the gap is relatively normal",
    "1395145": "The data is created artificially right? That means the gap is created intentionally...\n\nIf so I wonder what's the practical reason behind doing this.",
    "1394748": "I'm getting an AUC of 0.957 during CV, but when I submit to the leaderboard, it's scored at 0.627 AUC.  Is this happening to everyone else?"
  }
}