{
  "id": 1675,
  "title": "user_ids in training.txt and userid_profile.txt are different",
  "url": "/competitions/kddcup2012-track2/discussion/1675",
  "author_name": "",
  "post_date": "2012-04-03T16:01:25.420Z",
  "votes": null,
  "comment_count": 5,
  "views": 4333,
  "content": "<p>Can someone please explain why the number of distinct user_ids in the training data set is less than number of user_ids in userid_profile.txt.</p>\r\n<p>We have:</p>\r\n<p>training.txt - has <strong>22023546</strong> distinct user_ids</p>\r\n<p>userid_profile.txt - has <strong>23669283</strong> distinct user_ids</p>\r\n<p><span style=\"text-decoration:line-through\"><strong>989532</strong></span> <strong>\r\n231598</strong> user_ids in training.txt are missed from userid_profile.txt.</p>\r\n<p>Can someone elaborate why not all user_ids exist in userid_profile file, and why there are 1645737 &#43;&nbsp;231598\r\n<span style=\"text-decoration:line-through\">989532</span> extra user_ids in the userid_profile? for testing data set?)</p>\r\n<p>&nbsp;</p>\r\n<p>Thank you,</p>\r\n<p>-Alex</p>",
  "messages": [
    {
      "id": "9923",
      "postDate": "04/03/2012 16:01:25",
      "content": "<p>Can someone please explain why the number of distinct user_ids in the training data set is less than number of user_ids in userid_profile.txt.</p>\r\n<p>We have:</p>\r\n<p>training.txt - has <strong>22023546</strong> distinct user_ids</p>\r\n<p>userid_profile.txt - has <strong>23669283</strong> distinct user_ids</p>\r\n<p><span style=\"text-decoration:line-through\"><strong>989532</strong></span> <strong>\r\n231598</strong> user_ids in training.txt are missed from userid_profile.txt.</p>\r\n<p>Can someone elaborate why not all user_ids exist in userid_profile file, and why there are 1645737 &#43;&nbsp;231598\r\n<span style=\"text-decoration:line-through\">989532</span> extra user_ids in the userid_profile? for testing data set?)</p>\r\n<p>&nbsp;</p>\r\n<p>Thank you,</p>\r\n<p>-Alex</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "9941",
      "postDate": "04/04/2012 04:08:41",
      "content": "<p>Would you clarify what do you mean by &quot;989,532 user<em>ids in training.txt are missed from userid</em>profile.txt&quot; ?</p>\r\n<p>Do you mean that the details for 989,532 users are missing from the user profile ?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "9945",
      "postDate": "04/04/2012 10:40:50",
      "content": "<p>[quote=ArabSpring;9941]</p>\r\n<p>Would you clarify what do you mean by &quot;989,532 user<em>ids in training.txt are missed from userid</em>profile.txt&quot; ?</p>\r\n<p>Do you mean that the details for 989,532 users are missing from the user profile ?</p>\r\n<p>[/quote]</p>\r\n<p>That's right. The real number of <strong>missed</strong> distinct user_ids in userid_proile.txt is\r\n<strong>231'598</strong>. 989'532 - is the number of observations (records) in file training.txt with user_ids which are missed in userid_profile.txt.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "9973",
      "postDate": "04/05/2012 11:01:41",
      "content": "<p>I also find this problem, for example, the flowing userids are found in taining.txt, but do not exist in user_profile.txt:</p>\r\n<p>10008262</p>\r\n<p>1001740</p>\r\n<p>10017404</p>\r\n<p>100257</p>\r\n<p>10042643</p>\r\n<p>tens of thousands users' profile are missed in user_profile.txt, is there any <span style=\"\">\r\nconvincing</span> explanation?</p>\r\n<p>Thank you~</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "10042",
      "postDate": "04/10/2012 02:19:17",
      "content": "<p>You can find the answer in the &quot;ADDITIONAL DATA FILES&quot; section in the &quot;Description&quot; page:</p>\r\n<p><em>Each line of ‘userid_profile.txt’ is composed of UserID, Gender, and Age, delimited by the TAB character. Note that not every UserID in the training and the testing set will be present in ‘userid_profile.txt’.</em></p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "10051",
      "postDate": "04/10/2012 08:04:25",
      "content": "<p>Merci, nglasses,</p>\r\n<p>Why do you think they didn't put 0 (zero) for such cases as they did when user is undefined.</p>\r\n<p>Thank you.</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 9941,
      "author_name": "soufanom",
      "author_url": "",
      "post_date": "04/04/2012 04:08:41",
      "content": "<p>Would you clarify what do you mean by &quot;989,532 user<em>ids in training.txt are missed from userid</em>profile.txt&quot; ?</p>\r\n<p>Do you mean that the details for 989,532 users are missing from the user profile ?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 9945,
      "author_name": "ladderrunner",
      "author_url": "",
      "post_date": "04/04/2012 10:40:50",
      "content": "<p>[quote=ArabSpring;9941]</p>\r\n<p>Would you clarify what do you mean by &quot;989,532 user<em>ids in training.txt are missed from userid</em>profile.txt&quot; ?</p>\r\n<p>Do you mean that the details for 989,532 users are missing from the user profile ?</p>\r\n<p>[/quote]</p>\r\n<p>That's right. The real number of <strong>missed</strong> distinct user_ids in userid_proile.txt is\r\n<strong>231'598</strong>. 989'532 - is the number of observations (records) in file training.txt with user_ids which are missed in userid_profile.txt.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 9973,
      "author_name": "solari",
      "author_url": "",
      "post_date": "04/05/2012 11:01:41",
      "content": "<p>I also find this problem, for example, the flowing userids are found in taining.txt, but do not exist in user_profile.txt:</p>\r\n<p>10008262</p>\r\n<p>1001740</p>\r\n<p>10017404</p>\r\n<p>100257</p>\r\n<p>10042643</p>\r\n<p>tens of thousands users' profile are missed in user_profile.txt, is there any <span style=\"\">\r\nconvincing</span> explanation?</p>\r\n<p>Thank you~</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 10042,
      "author_name": "nglasses",
      "author_url": "",
      "post_date": "04/10/2012 02:19:17",
      "content": "<p>You can find the answer in the &quot;ADDITIONAL DATA FILES&quot; section in the &quot;Description&quot; page:</p>\r\n<p><em>Each line of ‘userid_profile.txt’ is composed of UserID, Gender, and Age, delimited by the TAB character. Note that not every UserID in the training and the testing set will be present in ‘userid_profile.txt’.</em></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 10051,
      "author_name": "ladderrunner",
      "author_url": "",
      "post_date": "04/10/2012 08:04:25",
      "content": "<p>Merci, nglasses,</p>\r\n<p>Why do you think they didn't put 0 (zero) for such cases as they did when user is undefined.</p>\r\n<p>Thank you.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "9923": "",
    "9941": "",
    "9945": "",
    "9973": "",
    "10042": "",
    "10051": ""
  },
  "source": "meta"
}