{
  "id": 20850,
  "title": "Tips from previous Avito Competitions",
  "url": "/competitions/avito-duplicate-ads-detection/discussion/20850",
  "author_name": "",
  "post_date": "2016-05-11T07:16:34.057Z",
  "votes": null,
  "comment_count": 6,
  "views": 893,
  "content": "<p>Hi\nI was wondering if some would like to share Tips from previous Avito competitions - specially on Russian. I have the following queries</p>\n\n<p>1) Title / Description / Json attributes : Are they uniform in their spelling and grammar across the train and test ? I.e Is some kind of spell corrections (like HomeDepot) recommended ?</p>\n\n<p>2) <a href=\"http://wordnet.ru/\">http://wordnet.ru/</a> : Did any one use it ? Good / Bad ?</p>\n\n<p>3) Stemming and Lemma with nltk on Russian : Did any one use it ? Good / Bad ? . </p>\n\n<p>4) How about WordNetLemmatizer with NLTK ?</p>\n\n<p>Thanks\n(if no one answers :) will find out in few days time and post here)</p>",
  "messages": [
    {
      "id": "119527",
      "postDate": "05/11/2016 07:16:34",
      "content": "<p>Hi\nI was wondering if some would like to share Tips from previous Avito competitions - specially on Russian. I have the following queries</p>\n\n<p>1) Title / Description / Json attributes : Are they uniform in their spelling and grammar across the train and test ? I.e Is some kind of spell corrections (like HomeDepot) recommended ?</p>\n\n<p>2) <a href=\"http://wordnet.ru/\">http://wordnet.ru/</a> : Did any one use it ? Good / Bad ?</p>\n\n<p>3) Stemming and Lemma with nltk on Russian : Did any one use it ? Good / Bad ? . </p>\n\n<p>4) How about WordNetLemmatizer with NLTK ?</p>\n\n<p>Thanks\n(if no one answers :) will find out in few days time and post here)</p>",
      "rawMarkdown": "Hi\r\nI was wondering if some would like to share Tips from previous Avito competitions - specially on Russian. I have the following queries\r\n\r\n1) Title / Description / Json attributes : Are they uniform in their spelling and grammar across the train and test ? I.e Is some kind of spell corrections (like HomeDepot) recommended ?\r\n\r\n2) http://wordnet.ru/ : Did any one use it ? Good / Bad ?\r\n\r\n3) Stemming and Lemma with nltk on Russian : Did any one use it ? Good / Bad ? . \r\n\r\n4) How about WordNetLemmatizer with NLTK ?\r\n\r\nThanks\r\n(if no one answers :) will find out in few days time and post here)",
      "votes": null
    },
    {
      "id": "119536",
      "postDate": "05/11/2016 08:31:09",
      "content": "<p>There are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. </p>\n\n<p>The json attributes seem fine though, probably they are mostly selections from multiple predefined choices.</p>",
      "rawMarkdown": "There are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. \r\n\r\nThe json attributes seem fine though, probably they are mostly selections from multiple predefined choices.",
      "votes": null
    },
    {
      "id": "119537",
      "postDate": "05/11/2016 08:34:35",
      "content": "<p>[quote=ololo;119536]</p>\n\n<p>There are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. </p>\n\n<p>The json attributes seem fine though, probably they are mostly selections from multiple predefined choices.</p>\n\n<p>[/quote]\nThanks ololo. Interesting. Can you share why you believe it might be intentional ?</p>\n\n<p>And since there are spelling mistakes, my wordnet question becomes more relevant. Can you comment on the same ?</p>",
      "rawMarkdown": "[quote=ololo;119536]\r\n\r\nThere are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. \r\n\r\nThe json attributes seem fine though, probably they are mostly selections from multiple predefined choices.\r\n\r\n[/quote]\r\nThanks ololo. Interesting. Can you share why you believe it might be intentional ?\r\n\r\nAnd since there are spelling mistakes, my wordnet question becomes more relevant. Can you comment on the same ?",
      "votes": null
    },
    {
      "id": "119540",
      "postDate": "05/11/2016 09:07:38",
      "content": "<p>I never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? </p>\n\n<p>Example of what I think might be an intentional mistake: </p>\n\n<p><img src=\"https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png\" alt=\"enter image description here\" title></p>\n\n<p>The words from the left are shortened and the last word is misspelled</p>",
      "rawMarkdown": "I never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? \r\n\r\nExample of what I think might be an intentional mistake: \r\n\r\n![enter image description here][1]\r\n\r\nThe words from the left are shortened and the last word is misspelled\r\n\r\n  [1]: https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png",
      "votes": null
    },
    {
      "id": "119542",
      "postDate": "05/11/2016 09:11:15",
      "content": "<p>[quote=ololo;119540]</p>\n\n<p>I never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? </p>\n\n<p>Example of what I think might be an intentional mistake: </p>\n\n<p><img src=\"https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png\" alt=\"enter image description here\" title></p>\n\n<p>The words from the left are shortened and the last word is misspelled</p>\n\n<p>[/quote]\nYes - wordnet was very useful in Homedepot. Is that example from yours showing Title and Description ?</p>",
      "rawMarkdown": "[quote=ololo;119540]\r\n\r\nI never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? \r\n\r\nExample of what I think might be an intentional mistake: \r\n\r\n![enter image description here][1]\r\n\r\nThe words from the left are shortened and the last word is misspelled\r\n\r\n  [1]: https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png\r\n\r\n[/quote]\r\nYes - wordnet was very useful in Homedepot. Is that example from yours showing Title and Description ?",
      "votes": null
    },
    {
      "id": "119544",
      "postDate": "05/11/2016 09:15:16",
      "content": "<p>Nope, it's two descriptions from a duplicate ad pair </p>",
      "rawMarkdown": "Nope, it's two descriptions from a duplicate ad pair",
      "votes": null
    },
    {
      "id": "119547",
      "postDate": "05/11/2016 10:00:12",
      "content": "<p>[quote=ololo;119544]</p>\n\n<p>Nope, it's two descriptions from a duplicate ad pair </p>\n\n<p>[/quote]\nOk</p>",
      "rawMarkdown": "[quote=ololo;119544]\r\n\r\nNope, it's two descriptions from a duplicate ad pair \r\n\r\n[/quote]\r\nOk",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 119536,
      "author_name": "agrigorev",
      "author_url": "",
      "post_date": "05/11/2016 08:31:09",
      "content": "<p>There are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. </p>\n\n<p>The json attributes seem fine though, probably they are mostly selections from multiple predefined choices.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 119537,
      "author_name": "rightfit",
      "author_url": "",
      "post_date": "05/11/2016 08:34:35",
      "content": "<p>[quote=ololo;119536]</p>\n\n<p>There are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. </p>\n\n<p>The json attributes seem fine though, probably they are mostly selections from multiple predefined choices.</p>\n\n<p>[/quote]\nThanks ololo. Interesting. Can you share why you believe it might be intentional ?</p>\n\n<p>And since there are spelling mistakes, my wordnet question becomes more relevant. Can you comment on the same ?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 119540,
      "author_name": "agrigorev",
      "author_url": "",
      "post_date": "05/11/2016 09:07:38",
      "content": "<p>I never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? </p>\n\n<p>Example of what I think might be an intentional mistake: </p>\n\n<p><img src=\"https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png\" alt=\"enter image description here\" title></p>\n\n<p>The words from the left are shortened and the last word is misspelled</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 119542,
      "author_name": "rightfit",
      "author_url": "",
      "post_date": "05/11/2016 09:11:15",
      "content": "<p>[quote=ololo;119540]</p>\n\n<p>I never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? </p>\n\n<p>Example of what I think might be an intentional mistake: </p>\n\n<p><img src=\"https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png\" alt=\"enter image description here\" title></p>\n\n<p>The words from the left are shortened and the last word is misspelled</p>\n\n<p>[/quote]\nYes - wordnet was very useful in Homedepot. Is that example from yours showing Title and Description ?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 119544,
      "author_name": "agrigorev",
      "author_url": "",
      "post_date": "05/11/2016 09:15:16",
      "content": "<p>Nope, it's two descriptions from a duplicate ad pair </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 119547,
      "author_name": "rightfit",
      "author_url": "",
      "post_date": "05/11/2016 10:00:12",
      "content": "<p>[quote=ololo;119544]</p>\n\n<p>Nope, it's two descriptions from a duplicate ad pair </p>\n\n<p>[/quote]\nOk</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "119527": "Hi\r\nI was wondering if some would like to share Tips from previous Avito competitions - specially on Russian. I have the following queries\r\n\r\n1) Title / Description / Json attributes : Are they uniform in their spelling and grammar across the train and test ? I.e Is some kind of spell corrections (like HomeDepot) recommended ?\r\n\r\n2) http://wordnet.ru/ : Did any one use it ? Good / Bad ?\r\n\r\n3) Stemming and Lemma with nltk on Russian : Did any one use it ? Good / Bad ? . \r\n\r\n4) How about WordNetLemmatizer with NLTK ?\r\n\r\nThanks\r\n(if no one answers :) will find out in few days time and post here)",
    "119536": "There are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. \r\n\r\nThe json attributes seem fine though, probably they are mostly selections from multiple predefined choices.",
    "119537": "[quote=ololo;119536]\r\n\r\nThere are a lot of spelling mistakes in titles and description, and sometimes I feel like these mistakes are intentional. \r\n\r\nThe json attributes seem fine though, probably they are mostly selections from multiple predefined choices.\r\n\r\n[/quote]\r\nThanks ololo. Interesting. Can you share why you believe it might be intentional ?\r\n\r\nAnd since there are spelling mistakes, my wordnet question becomes more relevant. Can you comment on the same ?",
    "119540": "I never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? \r\n\r\nExample of what I think might be an intentional mistake: \r\n\r\n![enter image description here][1]\r\n\r\nThe words from the left are shortened and the last word is misspelled\r\n\r\n  [1]: https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png",
    "119542": "[quote=ololo;119540]\r\n\r\nI never knew wordnet for Russian existed, so I can't comment :) I imagine it could be useful. Was English wordnet useful for home depot? \r\n\r\nExample of what I think might be an intentional mistake: \r\n\r\n![enter image description here][1]\r\n\r\nThe words from the left are shortened and the last word is misspelled\r\n\r\n  [1]: https://habrastorage.org/files/30a/860/632/30a860632a2f43ac92eef33498f6ba71.png\r\n\r\n[/quote]\r\nYes - wordnet was very useful in Homedepot. Is that example from yours showing Title and Description ?",
    "119544": "Nope, it's two descriptions from a duplicate ad pair",
    "119547": "[quote=ololo;119544]\r\n\r\nNope, it's two descriptions from a duplicate ad pair \r\n\r\n[/quote]\r\nOk"
  },
  "source": "meta"
}