{
  "id": 56930,
  "title": "Clean description",
  "url": "/competitions/avito-demand-prediction/discussion/56930",
  "author_name": "",
  "post_date": "2018-05-16T21:38:11.170463500Z",
  "votes": 3,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I am looking for tools to clean the description corpus. I don't know any Russian, if the description has misspellings,  I am unable to catch them or even correct them. </p>",
  "messages": [
    {
      "id": "329648",
      "postDate": "05/16/2018 21:38:11",
      "content": "<p>I am looking for tools to clean the description corpus. I don't know any Russian, if the description has misspellings,  I am unable to catch them or even correct them. </p>",
      "rawMarkdown": "I am looking for tools to clean the description corpus. I don't know any Russian, if the description has misspellings,  I am unable to catch them or even correct them.",
      "votes": null
    },
    {
      "id": "329789",
      "postDate": "05/17/2018 07:06:45",
      "content": "<p>Try removing russian vowels except first letter in the word. This removes some misprints and converts multiple word forms to smaller number, while keeping info (russian speakers can understand meaning of sentences in most cases)</p>",
      "rawMarkdown": "Try removing russian vowels except first letter in the word. This removes some misprints and converts multiple word forms to smaller number, while keeping info (russian speakers can understand meaning of sentences in most cases)",
      "votes": null
    },
    {
      "id": "329976",
      "postDate": "05/17/2018 18:19:38",
      "content": "<p>@ MengYe \nI believe someone has already uploaded the tranlations as a dataset. Link is here <a href=\"https://www.kaggle.com/kaparna/translations/data\">Avito Russian to English DataSet</a>\nI haven't used them yet. But should be a good start. </p>",
      "rawMarkdown": "MengYe \nI believe someone has already uploaded the tranlations as a dataset. Link is here [Avito Russian to English DataSet][1]\nI haven't used them yet. But should be a good start. \n\n\n  [1]: https://www.kaggle.com/kaparna/translations/data",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 329789,
      "author_name": "alexfir",
      "author_url": "",
      "post_date": "05/17/2018 07:06:45",
      "content": "<p>Try removing russian vowels except first letter in the word. This removes some misprints and converts multiple word forms to smaller number, while keeping info (russian speakers can understand meaning of sentences in most cases)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 329976,
      "author_name": "shanth84",
      "author_url": "",
      "post_date": "05/17/2018 18:19:38",
      "content": "<p>@ MengYe \nI believe someone has already uploaded the tranlations as a dataset. Link is here <a href=\"https://www.kaggle.com/kaparna/translations/data\">Avito Russian to English DataSet</a>\nI haven't used them yet. But should be a good start. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "329648": "I am looking for tools to clean the description corpus. I don't know any Russian, if the description has misspellings,  I am unable to catch them or even correct them.",
    "329789": "Try removing russian vowels except first letter in the word. This removes some misprints and converts multiple word forms to smaller number, while keeping info (russian speakers can understand meaning of sentences in most cases)",
    "329976": "MengYe \nI believe someone has already uploaded the tranlations as a dataset. Link is here [Avito Russian to English DataSet][1]\nI haven't used them yet. But should be a good start. \n\n\n  [1]: https://www.kaggle.com/kaparna/translations/data"
  },
  "source": "meta"
}