{
  "id": 254298,
  "title": "Are pseudo-labeling, semi-superwised and unsuperwised techniques on test allowed?",
  "url": "/competitions/seti-breakthrough-listen/discussion/254298",
  "author_name": "Victor Zaguskin",
  "post_date": "2021-07-21T06:07:18.328000",
  "votes": 2,
  "comment_count": 10,
  "views": 0,
  "content": "<p>Hello.<br>\nCan we use test data for training unsuperwised/semi-superwised models?<br>\nI have not found that explicitly in the rules so I guess it should be allowed, but would like a confirmation from the hosts.</p>",
  "messages": [
    {
      "id": 1402080,
      "postDate": "2021-07-27T20:33:46.340Z",
      "content": "<blockquote>\n  <p>Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.</p>\n</blockquote>\n<p>Unsupervised methods are definitely encouraged, but hand labelling will be a no unfortunately.</p>",
      "rawMarkdown": "> Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.\n\nUnsupervised methods are definitely encouraged, but hand labelling will be a no unfortunately.",
      "votes": 5,
      "replies": [
        {
          "id": 1458512,
          "postDate": "2021-08-07T23:08:31.350Z",
          "content": "<p>So pseudo-labeling are considered to be SSL (not hand labeling)?<br>\nIt's not human prediction, but the result may overfit to test set.</p>",
          "rawMarkdown": "So pseudo-labeling are considered to be SSL (not hand labeling)?\nIt's not human prediction, but the result may overfit to test set."
        }
      ]
    },
    {
      "id": 1395310,
      "postDate": "2021-07-21T06:07:18.330Z",
      "content": "<p>Hello.<br>\nCan we use test data for training unsuperwised/semi-superwised models?<br>\nI have not found that explicitly in the rules so I guess it should be allowed, but would like a confirmation from the hosts.</p>",
      "rawMarkdown": "Hello.\nCan we use test data for training unsuperwised/semi-superwised models?\nI have not found that explicitly in the rules so I guess it should be allowed, but would like a confirmation from the hosts.",
      "votes": 2
    },
    {
      "id": 1395560,
      "postDate": "2021-07-21T10:12:18.760Z",
      "content": "<p>Of course it`s allowed, but I wonder how could SSL help in this competition. As if you have confirmation bias on test dataset how you gonna fix it?</p>",
      "rawMarkdown": "Of course it`s allowed, but I wonder how could SSL help in this competition. As if you have confirmation bias on test dataset how you gonna fix it?",
      "replies": [
        {
          "id": 1395572,
          "postDate": "2021-07-21T10:25:23.520Z",
          "content": "<blockquote>\n  <p>Of course it`s allowed</p>\n</blockquote>\n<p>How do you know that?</p>",
          "rawMarkdown": "> Of course it`s allowed\n\nHow do you know that?"
        }
      ]
    },
    {
      "id": 1395495,
      "postDate": "2021-07-21T09:07:23.977Z",
      "content": "<p>Yes, we can. Why not?</p>",
      "rawMarkdown": "Yes, we can. Why not?",
      "replies": [
        {
          "id": 1395517,
          "postDate": "2021-07-21T09:24:17.753Z",
          "content": "<p>sometimes hosts do not allow that. So I just want to make sure that is not the case here.</p>",
          "rawMarkdown": "sometimes hosts do not allow that. So I just want to make sure that is not the case here."
        },
        {
          "id": 1395521,
          "postDate": "2021-07-21T09:29:24.960Z",
          "content": "<blockquote>\n  <p>sometimes hosts do not allow that</p>\n</blockquote>\n<p>Never seen. Could you show example of that competitions?</p>",
          "rawMarkdown": "> sometimes hosts do not allow that\n\nNever seen. Could you show example of that competitions?"
        },
        {
          "id": 1395542,
          "postDate": "2021-07-21T09:51:58.870Z",
          "content": "<p><a href=\"https://www.kaggle.com/c/freesound-audio-tagging-2019/discussion/88064\" target=\"_blank\">Yes</a></p>",
          "rawMarkdown": "[Yes](https://www.kaggle.com/c/freesound-audio-tagging-2019/discussion/88064)"
        },
        {
          "id": 1395679,
          "postDate": "2021-07-21T12:58:37.987Z",
          "content": "<p>There it was forbidden by competition rules.  Do you see the same here?</p>",
          "rawMarkdown": "There it was forbidden by competition rules.  Do you see the same here?"
        },
        {
          "id": 1395693,
          "postDate": "2021-07-21T13:16:07.603Z",
          "content": "<p>I don't. But I'd prefer getting a confirmation from the hosts that they are ok with mentioned techniques.</p>",
          "rawMarkdown": "I don't. But I'd prefer getting a confirmation from the hosts that they are ok with mentioned techniques.",
          "votes": 1
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1402080,
      "author_name": "Yuhong Chen",
      "author_url": "",
      "post_date": "2021-07-27T20:33:46.340000",
      "content": "<blockquote>\n  <p>Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.</p>\n</blockquote>\n<p>Unsupervised methods are definitely encouraged, but hand labelling will be a no unfortunately.</p>",
      "votes": 5,
      "replies": [
        {
          "id": 1458512,
          "author_name": "Bilzard",
          "author_url": "",
          "post_date": "2021-08-07T23:08:31.350000",
          "content": "<p>So pseudo-labeling are considered to be SSL (not hand labeling)?<br>\nIt's not human prediction, but the result may overfit to test set.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1395560,
      "author_name": "Hao",
      "author_url": "",
      "post_date": "2021-07-21T10:12:18.760000",
      "content": "<p>Of course it`s allowed, but I wonder how could SSL help in this competition. As if you have confirmation bias on test dataset how you gonna fix it?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1395572,
          "author_name": "Victor Zaguskin",
          "author_url": "",
          "post_date": "2021-07-21T10:25:23.520000",
          "content": "<blockquote>\n  <p>Of course it`s allowed</p>\n</blockquote>\n<p>How do you know that?</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1395495,
      "author_name": "Sergey Bryansky",
      "author_url": "",
      "post_date": "2021-07-21T09:07:23.977000",
      "content": "<p>Yes, we can. Why not?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1395517,
          "author_name": "Victor Zaguskin",
          "author_url": "",
          "post_date": "2021-07-21T09:24:17.753000",
          "content": "<p>sometimes hosts do not allow that. So I just want to make sure that is not the case here.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1395521,
          "author_name": "Sergey Bryansky",
          "author_url": "",
          "post_date": "2021-07-21T09:29:24.960000",
          "content": "<blockquote>\n  <p>sometimes hosts do not allow that</p>\n</blockquote>\n<p>Never seen. Could you show example of that competitions?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1395542,
          "author_name": "Victor Zaguskin",
          "author_url": "",
          "post_date": "2021-07-21T09:51:58.870000",
          "content": "<p><a href=\"https://www.kaggle.com/c/freesound-audio-tagging-2019/discussion/88064\" target=\"_blank\">Yes</a></p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1395679,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2021-07-21T12:58:37.987000",
          "content": "<p>There it was forbidden by competition rules.  Do you see the same here?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1395693,
          "author_name": "Victor Zaguskin",
          "author_url": "",
          "post_date": "2021-07-21T13:16:07.603000",
          "content": "<p>I don't. But I'd prefer getting a confirmation from the hosts that they are ok with mentioned techniques.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1402080": "> Submissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.\n\nUnsupervised methods are definitely encouraged, but hand labelling will be a no unfortunately.",
    "1395310": "Hello.\nCan we use test data for training unsuperwised/semi-superwised models?\nI have not found that explicitly in the rules so I guess it should be allowed, but would like a confirmation from the hosts.",
    "1395560": "Of course it`s allowed, but I wonder how could SSL help in this competition. As if you have confirmation bias on test dataset how you gonna fix it?",
    "1395495": "Yes, we can. Why not?"
  }
}