{
  "id": 6034,
  "title": "Pitfalls, Tips & Tricks",
  "url": "/competitions/yandex-personalized-web-search-challenge/discussion/6034",
  "author_name": "",
  "post_date": "2013-10-16T13:18:06.347Z",
  "votes": null,
  "comment_count": 2,
  "views": 2114,
  "content": "<p>Pitfall:</p>\n<p>I thought on my first submission this was purely personalized search. Personalized search to me means a different SERP for everyone depending on their click history (or other factors like location, browse history and user-agent).</p>\n<p>[quote]The goal of this competition is to re-rank top-10 URLs returned by the search engine in response to a user query <strong>using the history of clicks on URLs for all users</strong> and the user issuing the current query in particular.[/quote]</p>\n<p>I think now this is more about improving general search result quality for all users. Many users from the test set are shown page_id's to re-order (Query action T) that they have never clicked on in the training set. So we probably have to gauge relevancy from the clicks of their peers.</p>\n<p>This will make it so that all SERPS look quite the same. The goal then is not as much to personalize, it is to increase relevancy of the results for everyone. Please correct me if I am wrong.</p>",
  "messages": [
    {
      "id": "32361",
      "postDate": "10/16/2013 13:18:06",
      "content": "<p>Pitfall:</p>\n<p>I thought on my first submission this was purely personalized search. Personalized search to me means a different SERP for everyone depending on their click history (or other factors like location, browse history and user-agent).</p>\n<p>[quote]The goal of this competition is to re-rank top-10 URLs returned by the search engine in response to a user query <strong>using the history of clicks on URLs for all users</strong> and the user issuing the current query in particular.[/quote]</p>\n<p>I think now this is more about improving general search result quality for all users. Many users from the test set are shown page_id's to re-order (Query action T) that they have never clicked on in the training set. So we probably have to gauge relevancy from the clicks of their peers.</p>\n<p>This will make it so that all SERPS look quite the same. The goal then is not as much to personalize, it is to increase relevancy of the results for everyone. Please correct me if I am wrong.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "32362",
      "postDate": "10/16/2013 13:25:45",
      "content": "<p>It is personalized in the sense that relevance judgments are personal, based on actual user clicks and their dwell times. If you do not assume that all users make the same clicks, then it's not always a good idea to show the same SERP to everyone. That's the idea of personalization.</p>\n<p>It does not mean that you can improve any query by taking personal preferences into account. The task of finding those queries that would benefit from personalization is also a part of the task. The fact that users never clicked on the result or never issued the test query before, of course, does not mean that the SERP for this query cannot be personalized, as well as finding the user's &quot;peers&quot; and looking at how they click is also a way to personalize. So, I see no contradiction here.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "35570",
      "postDate": "12/01/2013 03:47:58",
      "content": "<p>Just to be clear, the SERP is personalized for each user based on what that user has clicked, and possibly based on urls that others have clicked on? &nbsp;Thanks!</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 32362,
      "author_name": "serdyukovpv",
      "author_url": "",
      "post_date": "10/16/2013 13:25:45",
      "content": "<p>It is personalized in the sense that relevance judgments are personal, based on actual user clicks and their dwell times. If you do not assume that all users make the same clicks, then it's not always a good idea to show the same SERP to everyone. That's the idea of personalization.</p>\n<p>It does not mean that you can improve any query by taking personal preferences into account. The task of finding those queries that would benefit from personalization is also a part of the task. The fact that users never clicked on the result or never issued the test query before, of course, does not mean that the SERP for this query cannot be personalized, as well as finding the user's &quot;peers&quot; and looking at how they click is also a way to personalize. So, I see no contradiction here.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 35570,
      "author_name": "jhuang314",
      "author_url": "",
      "post_date": "12/01/2013 03:47:58",
      "content": "<p>Just to be clear, the SERP is personalized for each user based on what that user has clicked, and possibly based on urls that others have clicked on? &nbsp;Thanks!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "32361": "",
    "32362": "",
    "35570": ""
  },
  "source": "meta"
}