One more dataset with all comments translated into English. @bamps53 was the first to share same thing, but in my case it's Yandex.Translate, not Google, so the translation is a bit different. Maybe that helps.
", "messages": [ { "id": "786853", "postDate": "03/26/2020 09:10:00", "content": "One more dataset with all comments translated into English. @bamps53 was the first to share same thing, but in my case it's Yandex.Translate, not Google, so the translation is a bit different. Maybe that helps.
", "rawMarkdown": "One more [dataset](https://www.kaggle.com/kashnitsky/jigsaw-multilingual-toxic-test-translated) with all comments translated into English. @bamps53 was the first to share same thing, but in my case it's Yandex.Translate, not Google, so the translation is a bit different. Maybe that helps.", "votes": null }, { "id": "786881", "postDate": "03/26/2020 09:47:23", "content": "I confirm it helps :D
\n\nThanks for sharing!
", "rawMarkdown": "I confirm it helps :D\n\nThanks for sharing!", "votes": null }, { "id": "786914", "postDate": "03/26/2020 10:39:28", "content": "Good :)
", "rawMarkdown": "Good :)", "votes": null }, { "id": "787582", "postDate": "03/26/2020 22:35:51", "content": "Thanks for sharing! @kashnitsky
", "rawMarkdown": "Thanks for sharing! @kashnitsky", "votes": null }, { "id": "787629", "postDate": "03/26/2020 23:53:45", "content": "Thanks!! Have anyone confirmed which performs better??
", "rawMarkdown": "Thanks!! Have anyone confirmed which performs better??", "votes": null }, { "id": "788442", "postDate": "03/27/2020 17:10:33", "content": "In my test. google translate is better than yandex a little.
\n\nBTW. Thanks @bamps53 and @kashnitsky provide the translated test set.
", "rawMarkdown": "In my test. google translate is better than yandex a little.\n\nBTW. Thanks @bamps53 and @kashnitsky provide the translated test set.", "votes": null }, { "id": "788699", "postDate": "03/27/2020 22:41:21", "content": "@arvissu Thanks, that's interesting! But as Abhishek is doing, obviously ensemble is the best!
", "rawMarkdown": "arvissu Thanks, that's interesting! But as Abhishek is doing, obviously ensemble is the best!", "votes": null }, { "id": "789157", "postDate": "03/28/2020 13:00:09", "content": "Thank you, Yury. I will use it. 1 vote from me
", "rawMarkdown": "Thank you, Yury. I will use it. 1 vote from me", "votes": null }, { "id": "789678", "postDate": "03/28/2020 22:02:49", "content": "Much Appreciated. +1
", "rawMarkdown": "Much Appreciated. +1", "votes": null }, { "id": "790360", "postDate": "03/29/2020 14:14:33", "content": "@kashnitsky can you also add the translated validation set. thanks in advance. 🙏
", "rawMarkdown": "kashnitsky can you also add the translated validation set. thanks in advance. 🙏", "votes": null }, { "id": "790369", "postDate": "03/29/2020 14:21:32", "content": "Ok, but tomorrow, laptop-free weekends :)
", "rawMarkdown": "Ok, but tomorrow, laptop-free weekends :)", "votes": null }, { "id": "790690", "postDate": "03/29/2020 19:28:22", "content": "google translate perform better for me, thanks both of you
", "rawMarkdown": "google translate perform better for me, thanks both of you", "votes": null }, { "id": "790697", "postDate": "03/29/2020 19:33:25", "content": "Yes, Google Translate is better in general so it makes sense :)
", "rawMarkdown": "Yes, Google Translate is better in general so it makes sense :)", "votes": null }, { "id": "790756", "postDate": "03/29/2020 20:39:42", "content": "Here validation dataset has also translated.
", "rawMarkdown": "[Here](https://www.kaggle.com/pchlq82/jigsaw-translate-en) validation dataset has also translated.", "votes": null }, { "id": "791399", "postDate": "03/30/2020 11:52:57", "content": "Updated the dataset with a translation of the validation set.
", "rawMarkdown": "Updated the dataset with a translation of the validation set.", "votes": null }, { "id": "791633", "postDate": "03/30/2020 15:04:11", "content": "Thanks for sharing, this is really useful and already used by a number of notebooks.
\n\nI notice that after today's update to include the translated validation (thanks) some notebooks are broken. This used to work:\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv')
\n\nBut now there is an extra directory in the way and this is currently required.
\n\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv/jigsaw_miltilingual_test_translated.csv')
\n\nIt's probably best to keep the path to jigsaw_miltilingual_test_translated.csv as it was before if possible.
", "rawMarkdown": "Thanks for sharing, this is really useful and already used by a number of notebooks.\n\nI notice that after today's update to include the translated validation (thanks) some notebooks are broken. This used to work:\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv')\n\nBut now there is an extra directory in the way and this is currently required.\n\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv/jigsaw_miltilingual_test_translated.csv')\n\nIt's probably best to keep the path to jigsaw_miltilingual_test_translated.csv as it was before if possible.", "votes": null }, { "id": "791733", "postDate": "03/30/2020 16:07:52", "content": "Oh yes, thanks, it's the difference in uploading raw or zipped CSV files. Fixed that.
", "rawMarkdown": "Oh yes, thanks, it's the difference in uploading raw or zipped CSV files. Fixed that.", "votes": null }, { "id": "792036", "postDate": "03/30/2020 21:18:56", "content": "Thanks - that's fixed it.
", "rawMarkdown": "Thanks - that's fixed it.", "votes": null }, { "id": "802984", "postDate": "04/10/2020 02:55:11", "content": "Clicking download gives me 404 on the dataset?
", "rawMarkdown": "Clicking download gives me 404 on the dataset?", "votes": null }, { "id": "803183", "postDate": "04/10/2020 08:07:50", "content": "Some Kaggle bug, you can still download separate files.
", "rawMarkdown": "Some Kaggle bug, you can still download separate files.", "votes": null }, { "id": "804870", "postDate": "04/12/2020 04:17:55", "content": "Thank you for the data Yury. \nAs for my experience, the Yandex dataset is also shows some insignificant quality drop.
", "rawMarkdown": "Thank you for the data Yury. \nAs for my experience, the Yandex dataset is also shows some insignificant quality drop.", "votes": null }, { "id": "804929", "postDate": "04/12/2020 06:41:52", "content": "Yes, we all know, Google Translate is the best translator, so the translation quality also has effect on performance in toxicity prediction task.
", "rawMarkdown": "Yes, we all know, Google Translate is the best translator, so the translation quality also has effect on performance in toxicity prediction task.", "votes": null } ], "comments": [ { "id": 786881, "author_name": "abhishek", "author_url": "", "post_date": "03/26/2020 09:47:23", "content": "I confirm it helps :D
\n\nThanks for sharing!
", "votes": null, "replies": [ { "id": 786914, "author_name": "kashnitsky", "author_url": "", "post_date": "03/26/2020 10:39:28", "content": "Good :)
", "votes": null, "replies": [] } ] }, { "id": 787582, "author_name": "hamditarek", "author_url": "", "post_date": "03/26/2020 22:35:51", "content": "Thanks for sharing! @kashnitsky
", "votes": null, "replies": [] }, { "id": 787629, "author_name": "bamps53", "author_url": "", "post_date": "03/26/2020 23:53:45", "content": "Thanks!! Have anyone confirmed which performs better??
", "votes": null, "replies": [ { "id": 788442, "author_name": "arvissu", "author_url": "", "post_date": "03/27/2020 17:10:33", "content": "In my test. google translate is better than yandex a little.
\n\nBTW. Thanks @bamps53 and @kashnitsky provide the translated test set.
", "votes": null, "replies": [] }, { "id": 788699, "author_name": "bamps53", "author_url": "", "post_date": "03/27/2020 22:41:21", "content": "@arvissu Thanks, that's interesting! But as Abhishek is doing, obviously ensemble is the best!
", "votes": null, "replies": [] }, { "id": 790690, "author_name": "hamditarek", "author_url": "", "post_date": "03/29/2020 19:28:22", "content": "google translate perform better for me, thanks both of you
", "votes": null, "replies": [] }, { "id": 790697, "author_name": "kashnitsky", "author_url": "", "post_date": "03/29/2020 19:33:25", "content": "Yes, Google Translate is better in general so it makes sense :)
", "votes": null, "replies": [] } ] }, { "id": 789157, "author_name": "podsyp", "author_url": "", "post_date": "03/28/2020 13:00:09", "content": "Thank you, Yury. I will use it. 1 vote from me
", "votes": null, "replies": [] }, { "id": 789678, "author_name": "mk9440", "author_url": "", "post_date": "03/28/2020 22:02:49", "content": "Much Appreciated. +1
", "votes": null, "replies": [] }, { "id": 790360, "author_name": "carriesmi", "author_url": "", "post_date": "03/29/2020 14:14:33", "content": "@kashnitsky can you also add the translated validation set. thanks in advance. 🙏
", "votes": null, "replies": [ { "id": 790369, "author_name": "kashnitsky", "author_url": "", "post_date": "03/29/2020 14:21:32", "content": "Ok, but tomorrow, laptop-free weekends :)
", "votes": null, "replies": [] } ] }, { "id": 790756, "author_name": "pchlq82", "author_url": "", "post_date": "03/29/2020 20:39:42", "content": "Here validation dataset has also translated.
", "votes": null, "replies": [] }, { "id": 791399, "author_name": "kashnitsky", "author_url": "", "post_date": "03/30/2020 11:52:57", "content": "Updated the dataset with a translation of the validation set.
", "votes": null, "replies": [] }, { "id": 791633, "author_name": "andypenrose", "author_url": "", "post_date": "03/30/2020 15:04:11", "content": "Thanks for sharing, this is really useful and already used by a number of notebooks.
\n\nI notice that after today's update to include the translated validation (thanks) some notebooks are broken. This used to work:\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv')
\n\nBut now there is an extra directory in the way and this is currently required.
\n\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv/jigsaw_miltilingual_test_translated.csv')
\n\nIt's probably best to keep the path to jigsaw_miltilingual_test_translated.csv as it was before if possible.
", "votes": null, "replies": [ { "id": 791733, "author_name": "kashnitsky", "author_url": "", "post_date": "03/30/2020 16:07:52", "content": "Oh yes, thanks, it's the difference in uploading raw or zipped CSV files. Fixed that.
", "votes": null, "replies": [] }, { "id": 792036, "author_name": "andypenrose", "author_url": "", "post_date": "03/30/2020 21:18:56", "content": "Thanks - that's fixed it.
", "votes": null, "replies": [] } ] }, { "id": 802984, "author_name": "aroraaman", "author_url": "", "post_date": "04/10/2020 02:55:11", "content": "Clicking download gives me 404 on the dataset?
", "votes": null, "replies": [ { "id": 803183, "author_name": "kashnitsky", "author_url": "", "post_date": "04/10/2020 08:07:50", "content": "Some Kaggle bug, you can still download separate files.
", "votes": null, "replies": [] } ] }, { "id": 804870, "author_name": "perevalov540", "author_url": "", "post_date": "04/12/2020 04:17:55", "content": "Thank you for the data Yury. \nAs for my experience, the Yandex dataset is also shows some insignificant quality drop.
", "votes": null, "replies": [ { "id": 804929, "author_name": "kashnitsky", "author_url": "", "post_date": "04/12/2020 06:41:52", "content": "Yes, we all know, Google Translate is the best translator, so the translation quality also has effect on performance in toxicity prediction task.
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "786853": "One more [dataset](https://www.kaggle.com/kashnitsky/jigsaw-multilingual-toxic-test-translated) with all comments translated into English. @bamps53 was the first to share same thing, but in my case it's Yandex.Translate, not Google, so the translation is a bit different. Maybe that helps.", "786881": "I confirm it helps :D\n\nThanks for sharing!", "786914": "Good :)", "787582": "Thanks for sharing! @kashnitsky", "787629": "Thanks!! Have anyone confirmed which performs better??", "788442": "In my test. google translate is better than yandex a little.\n\nBTW. Thanks @bamps53 and @kashnitsky provide the translated test set.", "788699": "arvissu Thanks, that's interesting! But as Abhishek is doing, obviously ensemble is the best!", "789157": "Thank you, Yury. I will use it. 1 vote from me", "789678": "Much Appreciated. +1", "790360": "kashnitsky can you also add the translated validation set. thanks in advance. 🙏", "790369": "Ok, but tomorrow, laptop-free weekends :)", "790690": "google translate perform better for me, thanks both of you", "790697": "Yes, Google Translate is better in general so it makes sense :)", "790756": "[Here](https://www.kaggle.com/pchlq82/jigsaw-translate-en) validation dataset has also translated.", "791399": "Updated the dataset with a translation of the validation set.", "791633": "Thanks for sharing, this is really useful and already used by a number of notebooks.\n\nI notice that after today's update to include the translated validation (thanks) some notebooks are broken. This used to work:\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv')\n\nBut now there is an extra directory in the way and this is currently required.\n\ntest2 = pd.read_csv('/kaggle/input/jigsaw-multilingual-toxic-test-translated/jigsaw_miltilingual_test_translated.csv/jigsaw_miltilingual_test_translated.csv')\n\nIt's probably best to keep the path to jigsaw_miltilingual_test_translated.csv as it was before if possible.", "791733": "Oh yes, thanks, it's the difference in uploading raw or zipped CSV files. Fixed that.", "792036": "Thanks - that's fixed it.", "802984": "Clicking download gives me 404 on the dataset?", "803183": "Some Kaggle bug, you can still download separate files.", "804870": "Thank you for the data Yury. \nAs for my experience, the Yandex dataset is also shows some insignificant quality drop.", "804929": "Yes, we all know, Google Translate is the best translator, so the translation quality also has effect on performance in toxicity prediction task." }, "source": "meta" }