{
  "id": 6531,
  "title": "A Label issue",
  "url": "/competitions/yandex-personalized-web-search-challenge/discussion/6531",
  "author_name": "",
  "post_date": "2013-12-04T13:45:00.443Z",
  "votes": null,
  "comment_count": 2,
  "views": 982,
  "content": "<p>Hello everyone,</p>\n<p>I do not understand the discrepencies between the results I have on my benchmark and those I get on the leaderboard. Thus, I am suspecting a problem with my labels (highly relevant, relevant, not relevant) in my training set.</p>\n<p>Attached, I upload 100 random queries from different SessionIDs extracted from my training. Does someone could help me and tell me if my labels are correct ?</p>\n<p>Thanks in advance,</p>\n<p>&nbsp;</p>",
  "messages": [
    {
      "id": "35822",
      "postDate": "12/04/2013 13:45:00",
      "content": "<p>Hello everyone,</p>\n<p>I do not understand the discrepencies between the results I have on my benchmark and those I get on the leaderboard. Thus, I am suspecting a problem with my labels (highly relevant, relevant, not relevant) in my training set.</p>\n<p>Attached, I upload 100 random queries from different SessionIDs extracted from my training. Does someone could help me and tell me if my labels are correct ?</p>\n<p>Thanks in advance,</p>\n<p>&nbsp;</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "35841",
      "postDate": "12/04/2013 22:24:20",
      "content": "<p>It seems there are some errors in your file.</p>\n<p>For example, you file says that &quot;567149,28036330,0&quot;. However, from the TRAIN file we can see the following:</p>\n<p>567149&nbsp; 6254&nbsp;&nbsp;&nbsp; C&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 28036330</p>\n<p>567149&nbsp; 6307&nbsp;&nbsp;&nbsp; C&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 58386881</p>\n<p>The dwell time on &quot;28036330&quot; is longer than 50, which should get label &quot;1&quot;, instead of &quot;0&quot;.</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "35857",
      "postDate": "12/05/2013 08:30:40",
      "content": "<p>Sorry I should have put the SERPID in my file.</p>\n<p>It seems that query is OK since it corresponds to the SERPID 1. Indeed you are right for the SERPID 5 for which&nbsp;&quot;28036330&quot; appears as &quot;relevant&quot; in my case too.</p>\n<p>Thanks</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 35841,
      "author_name": "sunnyuanovo",
      "author_url": "",
      "post_date": "12/04/2013 22:24:20",
      "content": "<p>It seems there are some errors in your file.</p>\n<p>For example, you file says that &quot;567149,28036330,0&quot;. However, from the TRAIN file we can see the following:</p>\n<p>567149&nbsp; 6254&nbsp;&nbsp;&nbsp; C&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 28036330</p>\n<p>567149&nbsp; 6307&nbsp;&nbsp;&nbsp; C&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 58386881</p>\n<p>The dwell time on &quot;28036330&quot; is longer than 50, which should get label &quot;1&quot;, instead of &quot;0&quot;.</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 35857,
      "author_name": "quentinjerome",
      "author_url": "",
      "post_date": "12/05/2013 08:30:40",
      "content": "<p>Sorry I should have put the SERPID in my file.</p>\n<p>It seems that query is OK since it corresponds to the SERPID 1. Indeed you are right for the SERPID 5 for which&nbsp;&quot;28036330&quot; appears as &quot;relevant&quot; in my case too.</p>\n<p>Thanks</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "35822": "",
    "35841": "",
    "35857": ""
  },
  "source": "meta"
}