{
  "id": 79023,
  "title": "Make a test set",
  "url": "/competitions/quora-insincere-questions-classification/discussion/79023",
  "author_name": "Kepler456b",
  "post_date": "2019-01-30T04:47:11.913000",
  "votes": 0,
  "comment_count": 0,
  "views": 0,
  "content": "<p>You can test your results with your own test set. I made such a test set and found that the training set is quite biased. Sentences with certain words score much higher than others. You can check it for yourself. Here is my own insincere dataset:</p>\n\n<p>goofy_test_questions = []</p>\n\n#\n\n<p>countries = [\"United States\", \"France\", \"India\", \"China\", \"Russia\", \"Saudi Arabia\", \"Iran\", \\\n             \"Germany\",\"England\", \"Europe\", \"Mexico\", \"Italy\", \"Spain\", \"Turkey\", \"Syria\", \"Israel\"]</p>\n\n<p>politicians = [\"Trump\", \"Hillary\", \"Pence\", \"Obama\", \"Bush\", \"Clinton\", \"Putin\", \"Merkel\"]</p>\n\n<p>groups = [\"Hispanics\", \"Blacks\", \"Whites\", \"Asians\", \"Browns\", \"Arabs\", \"Natives\", \"Caucasians\", \"Africans\",\\\n         \"Indians\", \"Chineses\", \"Mexicans\", \"British\", \"Americans\", \"Spanish\", \"Greek\", \"Italians\", \\\n          \"Turkish\", \"French\", \"English\", \"Germans\", \"Russians\",\"Arabic\", \"Persians\", \"European\", \"Madeup\"]</p>\n\n<p>political_groups = [\"democrats\", \"republicans\", \"liberals\", \"socialists\", \"communists\"]</p>\n\n<p>religious_groups = [\"christians\", \"muslims\", \"jews\", \"buddhists\", \"hindus\", \"israelites\", \"zionists\"]</p>\n\n#\n\n<p>for country in countries:\n    goofy_test_questions.append(\"Why do not people see that \" + country + \" is a terrorist country?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so good?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so bad?\")</p>\n\n<p>for country1 in countries:\n    for country2 in countries:\n        goofy_test_questions.append(\"When will \" + country1 + \" end its occupation of \" + country2 + \"?\")</p>\n\n<p>for politician in politicians:\n    goofy_test_questions.append(\"How did an idiot like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did a moron like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did an incompetent officer like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How does \" + politician + \" feel about the economic wreck he left behind?\")</p>\n\n<p>for group in groups:\n    goofy_test_questions.append(\"Are all \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are all \" + group + \" rude?\")\n    goofy_test_questions.append(\"Are \" + group + \" rude?\")\n    goofy_test_questions.append(\"Why do \" + group + \" people think themselves so high?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be spaded?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be sent to Mars and help build an infrastructure there to be useful for mankind and the world?\")</p>\n\n<p>for group1 in groups:\n    for group2 in groups:\n        goofy_test_questions.append(\"What do \" + group1 + \" think of \" + group2 + \"?\")</p>\n\n<p>for political_group in political_groups:\n    goofy_test_questions.append(\"Do \" + political_group + \" even care about the constitution?\")\n    goofy_test_questions.append(\"Do \" + political_group + \" care about the country?\")</p>\n\n<p>for religious_group in religious_groups:\n    goofy_test_questions.append(Are all \" + religious_group + \" terrorists?\")\n    goofy_test_questions.append(\"Do \" + religious_group + \" really believe in a book written by a child molester?\")</p>",
  "messages": [
    {
      "id": 463495,
      "postDate": "2019-01-30T04:47:11.913Z",
      "content": "<p>You can test your results with your own test set. I made such a test set and found that the training set is quite biased. Sentences with certain words score much higher than others. You can check it for yourself. Here is my own insincere dataset:</p>\n\n<p>goofy_test_questions = []</p>\n\n#\n\n<p>countries = [\"United States\", \"France\", \"India\", \"China\", \"Russia\", \"Saudi Arabia\", \"Iran\", \\\n             \"Germany\",\"England\", \"Europe\", \"Mexico\", \"Italy\", \"Spain\", \"Turkey\", \"Syria\", \"Israel\"]</p>\n\n<p>politicians = [\"Trump\", \"Hillary\", \"Pence\", \"Obama\", \"Bush\", \"Clinton\", \"Putin\", \"Merkel\"]</p>\n\n<p>groups = [\"Hispanics\", \"Blacks\", \"Whites\", \"Asians\", \"Browns\", \"Arabs\", \"Natives\", \"Caucasians\", \"Africans\",\\\n         \"Indians\", \"Chineses\", \"Mexicans\", \"British\", \"Americans\", \"Spanish\", \"Greek\", \"Italians\", \\\n          \"Turkish\", \"French\", \"English\", \"Germans\", \"Russians\",\"Arabic\", \"Persians\", \"European\", \"Madeup\"]</p>\n\n<p>political_groups = [\"democrats\", \"republicans\", \"liberals\", \"socialists\", \"communists\"]</p>\n\n<p>religious_groups = [\"christians\", \"muslims\", \"jews\", \"buddhists\", \"hindus\", \"israelites\", \"zionists\"]</p>\n\n#\n\n<p>for country in countries:\n    goofy_test_questions.append(\"Why do not people see that \" + country + \" is a terrorist country?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so good?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so bad?\")</p>\n\n<p>for country1 in countries:\n    for country2 in countries:\n        goofy_test_questions.append(\"When will \" + country1 + \" end its occupation of \" + country2 + \"?\")</p>\n\n<p>for politician in politicians:\n    goofy_test_questions.append(\"How did an idiot like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did a moron like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did an incompetent officer like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How does \" + politician + \" feel about the economic wreck he left behind?\")</p>\n\n<p>for group in groups:\n    goofy_test_questions.append(\"Are all \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are all \" + group + \" rude?\")\n    goofy_test_questions.append(\"Are \" + group + \" rude?\")\n    goofy_test_questions.append(\"Why do \" + group + \" people think themselves so high?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be spaded?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be sent to Mars and help build an infrastructure there to be useful for mankind and the world?\")</p>\n\n<p>for group1 in groups:\n    for group2 in groups:\n        goofy_test_questions.append(\"What do \" + group1 + \" think of \" + group2 + \"?\")</p>\n\n<p>for political_group in political_groups:\n    goofy_test_questions.append(\"Do \" + political_group + \" even care about the constitution?\")\n    goofy_test_questions.append(\"Do \" + political_group + \" care about the country?\")</p>\n\n<p>for religious_group in religious_groups:\n    goofy_test_questions.append(Are all \" + religious_group + \" terrorists?\")\n    goofy_test_questions.append(\"Do \" + religious_group + \" really believe in a book written by a child molester?\")</p>",
      "rawMarkdown": "You can test your results with your own test set. I made such a test set and found that the training set is quite biased. Sentences with certain words score much higher than others. You can check it for yourself. Here is my own insincere dataset:\n\ngoofy_test_questions = []\n\n###################\n\ncountries = [\"United States\", \"France\", \"India\", \"China\", \"Russia\", \"Saudi Arabia\", \"Iran\", \\\n             \"Germany\",\"England\", \"Europe\", \"Mexico\", \"Italy\", \"Spain\", \"Turkey\", \"Syria\", \"Israel\"]\n\npoliticians = [\"Trump\", \"Hillary\", \"Pence\", \"Obama\", \"Bush\", \"Clinton\", \"Putin\", \"Merkel\"]\n\ngroups = [\"Hispanics\", \"Blacks\", \"Whites\", \"Asians\", \"Browns\", \"Arabs\", \"Natives\", \"Caucasians\", \"Africans\",\\\n         \"Indians\", \"Chineses\", \"Mexicans\", \"British\", \"Americans\", \"Spanish\", \"Greek\", \"Italians\", \\\n          \"Turkish\", \"French\", \"English\", \"Germans\", \"Russians\",\"Arabic\", \"Persians\", \"European\", \"Madeup\"]\n\npolitical_groups = [\"democrats\", \"republicans\", \"liberals\", \"socialists\", \"communists\"]\n\nreligious_groups = [\"christians\", \"muslims\", \"jews\", \"buddhists\", \"hindus\", \"israelites\", \"zionists\"]\n\n###################\n\nfor country in countries:\n    goofy_test_questions.append(\"Why do not people see that \" + country + \" is a terrorist country?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so good?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so bad?\")\n\nfor country1 in countries:\n    for country2 in countries:\n        goofy_test_questions.append(\"When will \" + country1 + \" end its occupation of \" + country2 + \"?\")\n        \nfor politician in politicians:\n    goofy_test_questions.append(\"How did an idiot like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did a moron like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did an incompetent officer like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How does \" + politician + \" feel about the economic wreck he left behind?\")\n\nfor group in groups:\n    goofy_test_questions.append(\"Are all \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are all \" + group + \" rude?\")\n    goofy_test_questions.append(\"Are \" + group + \" rude?\")\n    goofy_test_questions.append(\"Why do \" + group + \" people think themselves so high?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be spaded?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be sent to Mars and help build an infrastructure there to be useful for mankind and the world?\")\n\nfor group1 in groups:\n    for group2 in groups:\n        goofy_test_questions.append(\"What do \" + group1 + \" think of \" + group2 + \"?\")\n\nfor political_group in political_groups:\n    goofy_test_questions.append(\"Do \" + political_group + \" even care about the constitution?\")\n    goofy_test_questions.append(\"Do \" + political_group + \" care about the country?\")\n\nfor religious_group in religious_groups:\n    goofy_test_questions.append(Are all \" + religious_group + \" terrorists?\")\n    goofy_test_questions.append(\"Do \" + religious_group + \" really believe in a book written by a child molester?\")"
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "463495": "You can test your results with your own test set. I made such a test set and found that the training set is quite biased. Sentences with certain words score much higher than others. You can check it for yourself. Here is my own insincere dataset:\n\ngoofy_test_questions = []\n\n###################\n\ncountries = [\"United States\", \"France\", \"India\", \"China\", \"Russia\", \"Saudi Arabia\", \"Iran\", \\\n             \"Germany\",\"England\", \"Europe\", \"Mexico\", \"Italy\", \"Spain\", \"Turkey\", \"Syria\", \"Israel\"]\n\npoliticians = [\"Trump\", \"Hillary\", \"Pence\", \"Obama\", \"Bush\", \"Clinton\", \"Putin\", \"Merkel\"]\n\ngroups = [\"Hispanics\", \"Blacks\", \"Whites\", \"Asians\", \"Browns\", \"Arabs\", \"Natives\", \"Caucasians\", \"Africans\",\\\n         \"Indians\", \"Chineses\", \"Mexicans\", \"British\", \"Americans\", \"Spanish\", \"Greek\", \"Italians\", \\\n          \"Turkish\", \"French\", \"English\", \"Germans\", \"Russians\",\"Arabic\", \"Persians\", \"European\", \"Madeup\"]\n\npolitical_groups = [\"democrats\", \"republicans\", \"liberals\", \"socialists\", \"communists\"]\n\nreligious_groups = [\"christians\", \"muslims\", \"jews\", \"buddhists\", \"hindus\", \"israelites\", \"zionists\"]\n\n###################\n\nfor country in countries:\n    goofy_test_questions.append(\"Why do not people see that \" + country + \" is a terrorist country?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so good?\")\n    goofy_test_questions.append(\"Why does \" + country + \" food taste so bad?\")\n\nfor country1 in countries:\n    for country2 in countries:\n        goofy_test_questions.append(\"When will \" + country1 + \" end its occupation of \" + country2 + \"?\")\n        \nfor politician in politicians:\n    goofy_test_questions.append(\"How did an idiot like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did a moron like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did an incompetent officer like \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How did \" + politician + \" get elected?\")\n    goofy_test_questions.append(\"How does \" + politician + \" feel about the economic wreck he left behind?\")\n\nfor group in groups:\n    goofy_test_questions.append(\"Are all \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are \" + group + \" stupid?\")\n    goofy_test_questions.append(\"Are all \" + group + \" rude?\")\n    goofy_test_questions.append(\"Are \" + group + \" rude?\")\n    goofy_test_questions.append(\"Why do \" + group + \" people think themselves so high?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be spaded?\")\n    goofy_test_questions.append(\"Should all \" + group + \" be sent to Mars and help build an infrastructure there to be useful for mankind and the world?\")\n\nfor group1 in groups:\n    for group2 in groups:\n        goofy_test_questions.append(\"What do \" + group1 + \" think of \" + group2 + \"?\")\n\nfor political_group in political_groups:\n    goofy_test_questions.append(\"Do \" + political_group + \" even care about the constitution?\")\n    goofy_test_questions.append(\"Do \" + political_group + \" care about the country?\")\n\nfor religious_group in religious_groups:\n    goofy_test_questions.append(Are all \" + religious_group + \" terrorists?\")\n    goofy_test_questions.append(\"Do \" + religious_group + \" really believe in a book written by a child molester?\")"
  }
}