{
  "id": 369728,
  "title": "How many candidates you used?",
  "url": "/competitions/otto-recommender-system/discussion/369728",
  "author_name": "",
  "post_date": "2022-12-01T08:03:18.658965600Z",
  "votes": 6,
  "comment_count": 6,
  "views": 0,
  "content": "<p>I think sharing the number of candidates and recall score can help us.</p>\n<p>Mine is: (Do not confused with this below recall and LB recall. This is just calculated by <code>|candidates ⋂ targets| / |targets|</code>. I used <a href=\"https://www.kaggle.com/cdeotte\" target=\"_blank\">@cdeotte</a> 's codes for calculating recall.)</p>\n<pre><code># of candidates: 67.17\n=============\nclicks recall = 0.5342\ncarts recall = 0.4374\norders recall = 0.6677\n=============\nOverall Recall = 0.5852\n=============\n</code></pre>\n<p>How about yours? I really want to know. </p>",
  "messages": [
    {
      "id": "2051113",
      "postDate": "12/01/2022 08:03:18",
      "content": "<p>I think sharing the number of candidates and recall score can help us.</p>\n<p>Mine is: (Do not confused with this below recall and LB recall. This is just calculated by <code>|candidates ⋂ targets| / |targets|</code>. I used <a href=\"https://www.kaggle.com/cdeotte\" target=\"_blank\">@cdeotte</a> 's codes for calculating recall.)</p>\n<pre><code># of candidates: 67.17\n=============\nclicks recall = 0.5342\ncarts recall = 0.4374\norders recall = 0.6677\n=============\nOverall Recall = 0.5852\n=============\n</code></pre>\n<p>How about yours? I really want to know. </p>",
      "rawMarkdown": "I think sharing the number of candidates and recall score can help us.\n\nMine is: (Do not confused with this below recall and LB recall. This is just calculated by `|candidates ⋂ targets| / |targets|`. I used @cdeotte 's codes for calculating recall.)\n\n```\n# of candidates: 67.17\n=============\nclicks recall = 0.5342\ncarts recall = 0.4374\norders recall = 0.6677\n=============\nOverall Recall = 0.5852\n=============\n```\n\nHow about yours? I really want to know.",
      "votes": null
    },
    {
      "id": "2051143",
      "postDate": "12/01/2022 08:42:00",
      "content": "<p>Hey <a href=\"https://www.kaggle.com/baekseungyun\" target=\"_blank\">@baekseungyun</a>! That is an interesting question 🙂 I am generating on average 85.86 candidates per session. This is how I got to my current position on the LB.</p>\n<p>Hope this helps! 🙌 Hope others will reply as well, curious about what other people are doing 🙂</p>",
      "rawMarkdown": "Hey @baekseungyun! That is an interesting question 🙂 I am generating on average 85.86 candidates per session. This is how I got to my current position on the LB.\n\nHope this helps! 🙌 Hope others will reply as well, curious about what other people are doing 🙂",
      "votes": null
    },
    {
      "id": "2051154",
      "postDate": "12/01/2022 08:54:50",
      "content": "<p>Oh, that's smaller than I think! Thanks you for sharing.</p>",
      "rawMarkdown": "Oh, that's smaller than I think! Thanks you for sharing.",
      "votes": null
    },
    {
      "id": "2051158",
      "postDate": "12/01/2022 08:57:40",
      "content": "<p>np 🙂 just to add a bit more, I am only generating candidates from \"strong  sources\"  so far (the co-visitation matrices, popularity-based candidates)</p>\n<p>I would really love to hear what people at the top of the LB are doing 😄 I am thinking they maybe be training with any more candidates per session but I might be wrong!</p>",
      "rawMarkdown": "np 🙂 just to add a bit more, I am only generating candidates from \"strong  sources\"  so far (the co-visitation matrices, popularity-based candidates)\n\nI would really love to hear what people at the top of the LB are doing 😄 I am thinking they maybe be training with any more candidates per session but I might be wrong!",
      "votes": null
    },
    {
      "id": "2051451",
      "postDate": "12/01/2022 12:28:00",
      "content": "<p>I have built a model with almost 100 candidates, but it has not worked well.<br>\nCandidates are the same as <a href=\"https://www.kaggle.com/radek1\" target=\"_blank\">@radek1</a> </p>\n<blockquote>\n  <p>of candidates: 96<br>\n  clicks recall =clicks: 0.5091<br>\n  carts recall = 0.4105<br>\n  orders recall = 0.6499<br>\n  Overall Recall = 0.5640</p>\n</blockquote>",
      "rawMarkdown": "I have built a model with almost 100 candidates, but it has not worked well.\nCandidates are the same as @radek1 \n\n> of candidates: 96\nclicks recall =clicks: 0.5091\ncarts recall = 0.4105\norders recall = 0.6499\nOverall Recall = 0.5640",
      "votes": null
    },
    {
      "id": "2051510",
      "postDate": "12/01/2022 13:28:08",
      "content": "<p>I suspect we need to study this comment by <a href=\"https://www.kaggle.com/cdeotte\" target=\"_blank\">@cdeotte</a> <a href=\"https://www.kaggle.com/dehokanta\" target=\"_blank\">@dehokanta</a> and generate a bunch of better candidates 🙂</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F03e7f381efdce85fb0ae98931166a7cd%2Ffeatures_to_generate.png?generation=1669901142143022&amp;alt=media\" alt=\"\"></p>\n<p>I am not sure where I found this on Kaggle but here is another one that is pure gold:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F5c4be47de8d468e97e66b40bf9743354%2Freranking_by_Chris.png?generation=1669901197754319&amp;alt=media\" alt=\"\"></p>\n<p>Anyhow, if you got to 0.5640 which would be around 0.576 on the LB by using covisitation matrix features and a ranking model, I believe you are off to a great start 🙂</p>\n<p>Crossing my fingers for the next set of good candidates you will be able to find! 🙂 (in that regard, we are in the same boat! 🙂)</p>",
      "rawMarkdown": "I suspect we need to study this comment by @cdeotte @dehokanta and generate a bunch of better candidates 🙂\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F03e7f381efdce85fb0ae98931166a7cd%2Ffeatures_to_generate.png?generation=1669901142143022&alt=media)\n\nI am not sure where I found this on Kaggle but here is another one that is pure gold:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F5c4be47de8d468e97e66b40bf9743354%2Freranking_by_Chris.png?generation=1669901197754319&alt=media)\n\nAnyhow, if you got to 0.5640 which would be around 0.576 on the LB by using covisitation matrix features and a ranking model, I believe you are off to a great start 🙂\n\nCrossing my fingers for the next set of good candidates you will be able to find! 🙂 (in that regard, we are in the same boat! 🙂)",
      "votes": null
    },
    {
      "id": "2052097",
      "postDate": "12/01/2022 23:02:30",
      "content": "<p>Thanks for your kind comments.<br>\nI did not see the second <a href=\"https://www.kaggle.com/cdeotte\" target=\"_blank\">@cdeotte</a> comment, so that helps.</p>",
      "rawMarkdown": "Thanks for your kind comments.\nI did not see the second @cdeotte comment, so that helps.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2051143,
      "author_name": "radek1",
      "author_url": "",
      "post_date": "12/01/2022 08:42:00",
      "content": "<p>Hey <a href=\"https://www.kaggle.com/baekseungyun\" target=\"_blank\">@baekseungyun</a>! That is an interesting question 🙂 I am generating on average 85.86 candidates per session. This is how I got to my current position on the LB.</p>\n<p>Hope this helps! 🙌 Hope others will reply as well, curious about what other people are doing 🙂</p>",
      "votes": null,
      "replies": [
        {
          "id": 2051154,
          "author_name": "baekseungyun",
          "author_url": "",
          "post_date": "12/01/2022 08:54:50",
          "content": "<p>Oh, that's smaller than I think! Thanks you for sharing.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2051158,
          "author_name": "radek1",
          "author_url": "",
          "post_date": "12/01/2022 08:57:40",
          "content": "<p>np 🙂 just to add a bit more, I am only generating candidates from \"strong  sources\"  so far (the co-visitation matrices, popularity-based candidates)</p>\n<p>I would really love to hear what people at the top of the LB are doing 😄 I am thinking they maybe be training with any more candidates per session but I might be wrong!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2051451,
      "author_name": "dehokanta",
      "author_url": "",
      "post_date": "12/01/2022 12:28:00",
      "content": "<p>I have built a model with almost 100 candidates, but it has not worked well.<br>\nCandidates are the same as <a href=\"https://www.kaggle.com/radek1\" target=\"_blank\">@radek1</a> </p>\n<blockquote>\n  <p>of candidates: 96<br>\n  clicks recall =clicks: 0.5091<br>\n  carts recall = 0.4105<br>\n  orders recall = 0.6499<br>\n  Overall Recall = 0.5640</p>\n</blockquote>",
      "votes": null,
      "replies": [
        {
          "id": 2051510,
          "author_name": "radek1",
          "author_url": "",
          "post_date": "12/01/2022 13:28:08",
          "content": "<p>I suspect we need to study this comment by <a href=\"https://www.kaggle.com/cdeotte\" target=\"_blank\">@cdeotte</a> <a href=\"https://www.kaggle.com/dehokanta\" target=\"_blank\">@dehokanta</a> and generate a bunch of better candidates 🙂</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F03e7f381efdce85fb0ae98931166a7cd%2Ffeatures_to_generate.png?generation=1669901142143022&amp;alt=media\" alt=\"\"></p>\n<p>I am not sure where I found this on Kaggle but here is another one that is pure gold:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F5c4be47de8d468e97e66b40bf9743354%2Freranking_by_Chris.png?generation=1669901197754319&amp;alt=media\" alt=\"\"></p>\n<p>Anyhow, if you got to 0.5640 which would be around 0.576 on the LB by using covisitation matrix features and a ranking model, I believe you are off to a great start 🙂</p>\n<p>Crossing my fingers for the next set of good candidates you will be able to find! 🙂 (in that regard, we are in the same boat! 🙂)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2052097,
          "author_name": "dehokanta",
          "author_url": "",
          "post_date": "12/01/2022 23:02:30",
          "content": "<p>Thanks for your kind comments.<br>\nI did not see the second <a href=\"https://www.kaggle.com/cdeotte\" target=\"_blank\">@cdeotte</a> comment, so that helps.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2051113": "I think sharing the number of candidates and recall score can help us.\n\nMine is: (Do not confused with this below recall and LB recall. This is just calculated by `|candidates ⋂ targets| / |targets|`. I used @cdeotte 's codes for calculating recall.)\n\n```\n# of candidates: 67.17\n=============\nclicks recall = 0.5342\ncarts recall = 0.4374\norders recall = 0.6677\n=============\nOverall Recall = 0.5852\n=============\n```\n\nHow about yours? I really want to know.",
    "2051143": "Hey @baekseungyun! That is an interesting question 🙂 I am generating on average 85.86 candidates per session. This is how I got to my current position on the LB.\n\nHope this helps! 🙌 Hope others will reply as well, curious about what other people are doing 🙂",
    "2051154": "Oh, that's smaller than I think! Thanks you for sharing.",
    "2051158": "np 🙂 just to add a bit more, I am only generating candidates from \"strong  sources\"  so far (the co-visitation matrices, popularity-based candidates)\n\nI would really love to hear what people at the top of the LB are doing 😄 I am thinking they maybe be training with any more candidates per session but I might be wrong!",
    "2051451": "I have built a model with almost 100 candidates, but it has not worked well.\nCandidates are the same as @radek1 \n\n> of candidates: 96\nclicks recall =clicks: 0.5091\ncarts recall = 0.4105\norders recall = 0.6499\nOverall Recall = 0.5640",
    "2051510": "I suspect we need to study this comment by @cdeotte @dehokanta and generate a bunch of better candidates 🙂\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F03e7f381efdce85fb0ae98931166a7cd%2Ffeatures_to_generate.png?generation=1669901142143022&alt=media)\n\nI am not sure where I found this on Kaggle but here is another one that is pure gold:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F83267%2F5c4be47de8d468e97e66b40bf9743354%2Freranking_by_Chris.png?generation=1669901197754319&alt=media)\n\nAnyhow, if you got to 0.5640 which would be around 0.576 on the LB by using covisitation matrix features and a ranking model, I believe you are off to a great start 🙂\n\nCrossing my fingers for the next set of good candidates you will be able to find! 🙂 (in that regard, we are in the same boat! 🙂)",
    "2052097": "Thanks for your kind comments.\nI did not see the second @cdeotte comment, so that helps."
  },
  "source": "meta"
}