{
  "id": 79218,
  "title": "Do long misspell dictionaries count as external data?",
  "url": "/competitions/quora-insincere-questions-classification/discussion/79218",
  "author_name": "",
  "post_date": "2019-02-01T09:13:10.541159600Z",
  "votes": 9,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I haven't been able to find a clear answer to this issue so I thought I would bring it up again.</p>\n\n<p>I am hesitating about using long misspell dictionaries, such as the one in <a href=\"https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/comments\">this</a> impressive kernel by @sunnymarkliu (it has around 2000 entries). As @sunnymarkliu explains <a href=\"https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/notebook#462645\">here</a>, this was generated 'from bad case analysis, and correcting the misspell words manually or using NLTK'.</p>\n\n<p>Does this count as external data?</p>\n\n<p>Many thanks!</p>",
  "messages": [
    {
      "id": "464670",
      "postDate": "02/01/2019 09:13:10",
      "content": "<p>I haven't been able to find a clear answer to this issue so I thought I would bring it up again.</p>\n\n<p>I am hesitating about using long misspell dictionaries, such as the one in <a href=\"https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/comments\">this</a> impressive kernel by @sunnymarkliu (it has around 2000 entries). As @sunnymarkliu explains <a href=\"https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/notebook#462645\">here</a>, this was generated 'from bad case analysis, and correcting the misspell words manually or using NLTK'.</p>\n\n<p>Does this count as external data?</p>\n\n<p>Many thanks!</p>",
      "rawMarkdown": "I haven't been able to find a clear answer to this issue so I thought I would bring it up again.\n\nI am hesitating about using long misspell dictionaries, such as the one in [this][1] impressive kernel by @sunnymarkliu (it has around 2000 entries). As @sunnymarkliu explains [here][2], this was generated 'from bad case analysis, and correcting the misspell words manually or using NLTK'.\n\nDoes this count as external data?\n\nMany thanks!\n\n  [1]: https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/comments\n  [2]: https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/notebook#462645",
      "votes": null
    },
    {
      "id": "464717",
      "postDate": "02/01/2019 11:00:22",
      "content": "<p>This limit is not clearly defined in the rules. Strictly any dictionary initialized manually is an external data. It would be important for the organizers to define a clear limit of Kbytes of the kernel, or number of keys in a dictionary, or the size of any data that is manually included in the kernels.</p>",
      "rawMarkdown": "This limit is not clearly defined in the rules. Strictly any dictionary initialized manually is an external data. It would be important for the organizers to define a clear limit of Kbytes of the kernel, or number of keys in a dictionary, or the size of any data that is manually included in the kernels.",
      "votes": null
    },
    {
      "id": "464733",
      "postDate": "02/01/2019 12:00:52",
      "content": "<p>Just make them public and you should be ok - I think.</p>\n\n<p> <a href=\"https://www.kaggle.com/springmanndaniel/preprocessing-in-r\">https://www.kaggle.com/springmanndaniel/preprocessing-in-r</a> </p>",
      "rawMarkdown": "Just make them public and you should be ok - I think.\n\n<a> https://www.kaggle.com/springmanndaniel/preprocessing-in-r </a>",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 464717,
      "author_name": "paulorzp",
      "author_url": "",
      "post_date": "02/01/2019 11:00:22",
      "content": "<p>This limit is not clearly defined in the rules. Strictly any dictionary initialized manually is an external data. It would be important for the organizers to define a clear limit of Kbytes of the kernel, or number of keys in a dictionary, or the size of any data that is manually included in the kernels.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 464733,
      "author_name": "springmanndaniel",
      "author_url": "",
      "post_date": "02/01/2019 12:00:52",
      "content": "<p>Just make them public and you should be ok - I think.</p>\n\n<p> <a href=\"https://www.kaggle.com/springmanndaniel/preprocessing-in-r\">https://www.kaggle.com/springmanndaniel/preprocessing-in-r</a> </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "464670": "I haven't been able to find a clear answer to this issue so I thought I would bring it up again.\n\nI am hesitating about using long misspell dictionaries, such as the one in [this][1] impressive kernel by @sunnymarkliu (it has around 2000 entries). As @sunnymarkliu explains [here][2], this was generated 'from bad case analysis, and correcting the misspell words manually or using NLTK'.\n\nDoes this count as external data?\n\nMany thanks!\n\n  [1]: https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/comments\n  [2]: https://www.kaggle.com/sunnymarkliu/more-text-cleaning-to-increase-word-coverage/notebook#462645",
    "464717": "This limit is not clearly defined in the rules. Strictly any dictionary initialized manually is an external data. It would be important for the organizers to define a clear limit of Kbytes of the kernel, or number of keys in a dictionary, or the size of any data that is manually included in the kernels.",
    "464733": "Just make them public and you should be ok - I think.\n\n<a> https://www.kaggle.com/springmanndaniel/preprocessing-in-r </a>"
  },
  "source": "meta"
}