{
  "id": 6454,
  "title": "New users in test set?",
  "url": "/competitions/yandex-personalized-web-search-challenge/discussion/6454",
  "author_name": "",
  "post_date": "2013-11-26T23:26:10.907Z",
  "votes": 1,
  "comment_count": 2,
  "views": 950,
  "content": "<p>According to the test format:</p>\n<p>&nbsp;</p>\n<p>&quot;If the sampled query does not have any short-term context (it is the first one in the session) and<strong> the user that asked this query has no search sessions in the training period</strong>, we remove this query from the test set (since, it has neither short nor long-term context useful for personalization). We do not disclose any user actions made after the test query. However, the user's actions performed in the same session before the test query are provided (if any).&quot;</p>\n<p>&nbsp;</p>\n<p>I have found some users in the test data that does not have any information at the training data, for example user 66 is not in the training data:</p>\n<p>34573642 M 29 66<br>34573642 0 Q 0 8723129 3000365,2482577,3133129 43222359,3802407 39999644,3596990 44638858,3874577 40789531,3640951 17618621,1862061 21906406,2251977 26058104,2597528 40112490,3602207 45139074,3906094 13949939,1423442</p>\n<p>34573642 1592 T 1 13028695 3601218,2980919 57002736,4510996 23958325,2393729 71070782,5287734 43211360,3801521 21381898,2194256 71070801,5287737 21381923,2194262 71070834,5287744 71070769,5287733 32447550,3151611</p>\n<p>Can someone please confirm that this is not an error in the test set? Am I misreading/not thinking about something? Thank you!</p>",
  "messages": [
    {
      "id": "35323",
      "postDate": "11/26/2013 23:26:10",
      "content": "<p>According to the test format:</p>\n<p>&nbsp;</p>\n<p>&quot;If the sampled query does not have any short-term context (it is the first one in the session) and<strong> the user that asked this query has no search sessions in the training period</strong>, we remove this query from the test set (since, it has neither short nor long-term context useful for personalization). We do not disclose any user actions made after the test query. However, the user's actions performed in the same session before the test query are provided (if any).&quot;</p>\n<p>&nbsp;</p>\n<p>I have found some users in the test data that does not have any information at the training data, for example user 66 is not in the training data:</p>\n<p>34573642 M 29 66<br>34573642 0 Q 0 8723129 3000365,2482577,3133129 43222359,3802407 39999644,3596990 44638858,3874577 40789531,3640951 17618621,1862061 21906406,2251977 26058104,2597528 40112490,3602207 45139074,3906094 13949939,1423442</p>\n<p>34573642 1592 T 1 13028695 3601218,2980919 57002736,4510996 23958325,2393729 71070782,5287734 43211360,3801521 21381898,2194256 71070801,5287737 21381923,2194262 71070834,5287744 71070769,5287733 32447550,3151611</p>\n<p>Can someone please confirm that this is not an error in the test set? Am I misreading/not thinking about something? Thank you!</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "35331",
      "postDate": "11/27/2013 03:30:18",
      "content": "<p>&quot;If the sampled query <strong>does not have any short-term context (it is the first one in the session)</strong> and the user that asked this query has no search sessions in the training period, we remove this query from the test set (since, it has neither short nor long-term context useful for personalization). We do not disclose any user actions made after the test query. However, the user's actions performed in the same session before the test query are provided (if any).&quot;</p>\n<p>&nbsp;</p>\n<p>In your example, Test query isn't the first one in the session</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "35338",
      "postDate": "11/27/2013 06:48:32",
      "content": "<p>Thank you but in this case since the user did not click on any result on the first query, I cannot see how the short-term context is useful in this case...</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 35331,
      "author_name": "ducktile",
      "author_url": "",
      "post_date": "11/27/2013 03:30:18",
      "content": "<p>&quot;If the sampled query <strong>does not have any short-term context (it is the first one in the session)</strong> and the user that asked this query has no search sessions in the training period, we remove this query from the test set (since, it has neither short nor long-term context useful for personalization). We do not disclose any user actions made after the test query. However, the user's actions performed in the same session before the test query are provided (if any).&quot;</p>\n<p>&nbsp;</p>\n<p>In your example, Test query isn't the first one in the session</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 35338,
      "author_name": "speedup",
      "author_url": "",
      "post_date": "11/27/2013 06:48:32",
      "content": "<p>Thank you but in this case since the user did not click on any result on the first query, I cannot see how the short-term context is useful in this case...</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "35323": "",
    "35331": "",
    "35338": ""
  },
  "source": "meta"
}