{
  "id": 15960,
  "title": "Number of files for evaluation",
  "url": "/competitions/dato-native/discussion/15960",
  "author_name": "",
  "post_date": "2015-08-15T22:37:23.327Z",
  "votes": 1,
  "comment_count": 3,
  "views": 721,
  "content": "<p>Hi,</p>\n\n<p>Maybe I missed something, but when I want to evaluate my results, I have more rows in my csv than the reference.</p>\n\n<p>Because, there are :\n67507+67534+67122+67605+67536 (as said in the topic about the number of files)\n= 337304 files</p>\n\n<p>And when counting the number of rows in the csv for training :\n101107 rows</p>\n\n<p>so, if we take the total number of files and substract the ones for training : 337304 - 101107 = 236197\nWhich is not the number of rows that the system wants, and not the one that are in the sample submission.</p>\n\n<p>I missed something ? Or there is a problem ?</p>\n\n<p>Thanks :)\npalkeo.</p>",
  "messages": [
    {
      "id": "89472",
      "postDate": "08/15/2015 22:37:23",
      "content": "<p>Hi,</p>\n\n<p>Maybe I missed something, but when I want to evaluate my results, I have more rows in my csv than the reference.</p>\n\n<p>Because, there are :\n67507+67534+67122+67605+67536 (as said in the topic about the number of files)\n= 337304 files</p>\n\n<p>And when counting the number of rows in the csv for training :\n101107 rows</p>\n\n<p>so, if we take the total number of files and substract the ones for training : 337304 - 101107 = 236197\nWhich is not the number of rows that the system wants, and not the one that are in the sample submission.</p>\n\n<p>I missed something ? Or there is a problem ?</p>\n\n<p>Thanks :)\npalkeo.</p>",
      "rawMarkdown": "Hi,\r\n\r\nMaybe I missed something, but when I want to evaluate my results, I have more rows in my csv than the reference.\r\n\r\nBecause, there are :\r\n67507+67534+67122+67605+67536 (as said in the topic about the number of files)\r\n= 337304 files\r\n\r\nAnd when counting the number of rows in the csv for training :\r\n101107 rows\r\n\r\nso, if we take the total number of files and substract the ones for training : 337304 - 101107 = 236197\r\nWhich is not the number of rows that the system wants, and not the one that are in the sample submission.\r\n\r\nI missed something ? Or there is a problem ?\r\n\r\nThanks :)\r\npalkeo.",
      "votes": null
    },
    {
      "id": "89485",
      "postDate": "08/16/2015 02:39:01",
      "content": "<p>I look at what's in the train.csv and sampleSubmission.csv files. Maybe not all HTML files are referenced. 101107 for train, 235917 for test.</p>",
      "rawMarkdown": "I look at what's in the train.csv and sampleSubmission.csv files. Maybe not all HTML files are referenced. 101107 for train, 235917 for test.",
      "votes": null
    },
    {
      "id": "89506",
      "postDate": "08/16/2015 13:02:55",
      "content": "<p>I think you'll find the answers in this thread:\n<a href=\"https://www.kaggle.com/c/dato-native/forums/t/15832/what-do-we-do-with-empty-files/88902#post88902\">https://www.kaggle.com/c/dato-native/forums/t/15832/what-do-we-do-with-empty-files/88902#post88902</a></p>",
      "rawMarkdown": "I think you'll find the answers in this thread:\r\nhttps://www.kaggle.com/c/dato-native/forums/t/15832/what-do-we-do-with-empty-files/88902#post88902",
      "votes": null
    },
    {
      "id": "89555",
      "postDate": "08/17/2015 10:26:52",
      "content": "<p>Thanks. The problem is that I've displayed the files that I have but are not in the reference submission, and they are not empty, so it's quite strange&#8230;</p>\n\n<p>But i will keep files that are in the reference submission, and that's it.</p>\n\n<p>Thanks</p>",
      "rawMarkdown": "Thanks. The problem is that I've displayed the files that I have but are not in the reference submission, and they are not empty, so it's quite strange…\r\n\r\nBut i will keep files that are in the reference submission, and that's it.\r\n\r\nThanks",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 89485,
      "author_name": "remap1",
      "author_url": "",
      "post_date": "08/16/2015 02:39:01",
      "content": "<p>I look at what's in the train.csv and sampleSubmission.csv files. Maybe not all HTML files are referenced. 101107 for train, 235917 for test.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 89506,
      "author_name": "mandalsubhajit",
      "author_url": "",
      "post_date": "08/16/2015 13:02:55",
      "content": "<p>I think you'll find the answers in this thread:\n<a href=\"https://www.kaggle.com/c/dato-native/forums/t/15832/what-do-we-do-with-empty-files/88902#post88902\">https://www.kaggle.com/c/dato-native/forums/t/15832/what-do-we-do-with-empty-files/88902#post88902</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 89555,
      "author_name": "palkeo",
      "author_url": "",
      "post_date": "08/17/2015 10:26:52",
      "content": "<p>Thanks. The problem is that I've displayed the files that I have but are not in the reference submission, and they are not empty, so it's quite strange&#8230;</p>\n\n<p>But i will keep files that are in the reference submission, and that's it.</p>\n\n<p>Thanks</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "89472": "Hi,\r\n\r\nMaybe I missed something, but when I want to evaluate my results, I have more rows in my csv than the reference.\r\n\r\nBecause, there are :\r\n67507+67534+67122+67605+67536 (as said in the topic about the number of files)\r\n= 337304 files\r\n\r\nAnd when counting the number of rows in the csv for training :\r\n101107 rows\r\n\r\nso, if we take the total number of files and substract the ones for training : 337304 - 101107 = 236197\r\nWhich is not the number of rows that the system wants, and not the one that are in the sample submission.\r\n\r\nI missed something ? Or there is a problem ?\r\n\r\nThanks :)\r\npalkeo.",
    "89485": "I look at what's in the train.csv and sampleSubmission.csv files. Maybe not all HTML files are referenced. 101107 for train, 235917 for test.",
    "89506": "I think you'll find the answers in this thread:\r\nhttps://www.kaggle.com/c/dato-native/forums/t/15832/what-do-we-do-with-empty-files/88902#post88902",
    "89555": "Thanks. The problem is that I've displayed the files that I have but are not in the reference submission, and they are not empty, so it's quite strange…\r\n\r\nBut i will keep files that are in the reference submission, and that's it.\r\n\r\nThanks"
  },
  "source": "meta"
}