{
  "id": 93949,
  "title": "The parable of the Ox.",
  "url": "/competitions/LANL-Earthquake-Prediction/discussion/93949",
  "author_name": "Manoj",
  "post_date": "2019-05-31T10:44:10.051000",
  "votes": 8,
  "comment_count": 26,
  "views": 0,
  "content": "<p><a href=\"https://www.ft.com/content/bfb7e6b8-d57b-11e1-af40-00144feabdc0\">https://www.ft.com/content/bfb7e6b8-d57b-11e1-af40-00144feabdc0</a>\n &gt; \nIn 1906, the great statistician Francis Galton observed a competition to guess the weight of an ox at a country fair. Eight hundred people entered. Galton, being the kind of man he was, ran statistical tests on the numbers. He discovered that the average guess (1,197lb) was extremely close to the actual weight (1,198lb) of the ox. This story was told by James Surowiecki, in his entertaining book The Wisdom of Crowds.</p>\n\n<p>We all are believing  there is going to be shake-up. lets say it follows some distribution. what do you think will be</p>\n\n<p>&gt;  Mean shake up ( absolute number of  places )</p>\n\n<p>if you care to guess and answer i will compile the answer and compare after the competition. let's see how it goes.</p>\n\n<p>PS: please don't influence your guess by someone else's guess. (ie. don't read the comments before commenting)</p>\n\n<p><strong>UPDATE:</strong></p>\n\n<p>here is the analysis\n<a href=\"https://www.kaggle.com/mks2192/shake-up\">https://www.kaggle.com/mks2192/shake-up</a></p>",
  "messages": [
    {
      "id": 540307,
      "postDate": "2019-05-31T10:44:10.053Z",
      "content": "<p><a href=\"https://www.ft.com/content/bfb7e6b8-d57b-11e1-af40-00144feabdc0\">https://www.ft.com/content/bfb7e6b8-d57b-11e1-af40-00144feabdc0</a>\n &gt; \nIn 1906, the great statistician Francis Galton observed a competition to guess the weight of an ox at a country fair. Eight hundred people entered. Galton, being the kind of man he was, ran statistical tests on the numbers. He discovered that the average guess (1,197lb) was extremely close to the actual weight (1,198lb) of the ox. This story was told by James Surowiecki, in his entertaining book The Wisdom of Crowds.</p>\n\n<p>We all are believing  there is going to be shake-up. lets say it follows some distribution. what do you think will be</p>\n\n<p>&gt;  Mean shake up ( absolute number of  places )</p>\n\n<p>if you care to guess and answer i will compile the answer and compare after the competition. let's see how it goes.</p>\n\n<p>PS: please don't influence your guess by someone else's guess. (ie. don't read the comments before commenting)</p>\n\n<p><strong>UPDATE:</strong></p>\n\n<p>here is the analysis\n<a href=\"https://www.kaggle.com/mks2192/shake-up\">https://www.kaggle.com/mks2192/shake-up</a></p>",
      "rawMarkdown": "https://www.ft.com/content/bfb7e6b8-d57b-11e1-af40-00144feabdc0\n &gt; \nIn 1906, the great statistician Francis Galton observed a competition to guess the weight of an ox at a country fair. Eight hundred people entered. Galton, being the kind of man he was, ran statistical tests on the numbers. He discovered that the average guess (1,197lb) was extremely close to the actual weight (1,198lb) of the ox. This story was told by James Surowiecki, in his entertaining book The Wisdom of Crowds.\n\n\n\nWe all are believing  there is going to be shake-up. lets say it follows some distribution. what do you think will be\n\n &gt;  Mean shake up ( absolute number of  places )\n\nif you care to guess and answer i will compile the answer and compare after the competition. let's see how it goes.\n\nPS: please don't influence your guess by someone else's guess. (ie. don't read the comments before commenting)\n\n\n\n\n**UPDATE:**\n\nhere is the analysis\nhttps://www.kaggle.com/mks2192/shake-up",
      "votes": 6
    },
    {
      "id": 540390,
      "postDate": "2019-05-31T12:52:01.210Z",
      "content": "<p>For those who do not know about Scott E. Page's Diversity Prediction Theorem</p>\n\n<p><code>Crowd's square error = the mean square error - the diversity of the crowd</code></p>\n\n<p><a href=\"https://www.coursera.org/lecture/model-thinking/diversity-prediction-theorem-rVbCg\">Diversity Prediction Theorem</a></p>",
      "rawMarkdown": "For those who do not know about Scott E. Page's Diversity Prediction Theorem\n\n`Crowd's square error = the mean square error - the diversity of the crowd`\n\n[Diversity Prediction Theorem](https://www.coursera.org/lecture/model-thinking/diversity-prediction-theorem-rVbCg)\n",
      "votes": 3
    },
    {
      "id": 541654,
      "postDate": "2019-06-02T20:40:02.010Z",
      "content": "<p>210</p>",
      "rawMarkdown": "210",
      "votes": 1
    },
    {
      "id": 541104,
      "postDate": "2019-06-01T18:16:23.873Z",
      "content": "<p>280</p>",
      "rawMarkdown": "280",
      "votes": 1
    },
    {
      "id": 540946,
      "postDate": "2019-06-01T12:15:42.027Z",
      "content": "<p>230</p>",
      "rawMarkdown": "230",
      "votes": 1
    },
    {
      "id": 540921,
      "postDate": "2019-06-01T11:22:56.753Z",
      "content": "<p>246</p>",
      "rawMarkdown": "246",
      "votes": 1
    },
    {
      "id": 540914,
      "postDate": "2019-06-01T11:15:31.523Z",
      "content": "<p>350  (with gaussian distribution)</p>",
      "rawMarkdown": "350  (with gaussian distribution)",
      "votes": 1
    },
    {
      "id": 540680,
      "postDate": "2019-05-31T20:48:40.457Z",
      "content": "<p>In my case? Approximately 4112.</p>\n\n<p>In general? I think around 500.</p>",
      "rawMarkdown": "In my case? Approximately 4112.\n\nIn general? I think around 500.",
      "votes": 1
    },
    {
      "id": 540643,
      "postDate": "2019-05-31T19:36:18.650Z",
      "content": "<p>100</p>",
      "rawMarkdown": "100",
      "votes": 1
    },
    {
      "id": 540589,
      "postDate": "2019-05-31T17:40:21.963Z",
      "content": "<p>I think major quake will be closer to the top only - about 800-1200 positions, where scores are tight. Probably quite a few blended overfitted models will go down severely. Looking down the leaderboard I guess mainly it will not change much.\nMy estimate is around 100 :)</p>",
      "rawMarkdown": "I think major quake will be closer to the top only - about 800-1200 positions, where scores are tight. Probably quite a few blended overfitted models will go down severely. Looking down the leaderboard I guess mainly it will not change much.\nMy estimate is around 100 :)",
      "votes": 1
    },
    {
      "id": 540567,
      "postDate": "2019-05-31T17:01:05.993Z",
      "content": "<p>666 ;)</p>",
      "rawMarkdown": "666 ;)",
      "votes": 1
    },
    {
      "id": 540544,
      "postDate": "2019-05-31T16:06:57.817Z",
      "content": "<p>400</p>",
      "rawMarkdown": "400\n",
      "votes": 1
    },
    {
      "id": 540382,
      "postDate": "2019-05-31T12:39:08.900Z",
      "content": "<p>Wisdom of crowds is an excellent book. The craziest thing in there is the submarine story in the beginning.</p>\n\n<p>I think mean shake will be 10, with a few very extreme (+/- 1000) cases.</p>",
      "rawMarkdown": "Wisdom of crowds is an excellent book. The craziest thing in there is the submarine story in the beginning.\n\nI think mean shake will be 10, with a few very extreme (+/- 1000) cases.",
      "votes": 1,
      "replies": [
        {
          "id": 540383,
          "postDate": "2019-05-31T12:41:14.497Z",
          "content": "<p>Thanks for guessing. in that case median can be compared.</p>",
          "rawMarkdown": "Thanks for guessing. in that case median can be compared."
        }
      ]
    },
    {
      "id": 540319,
      "postDate": "2019-05-31T11:01:23.843Z",
      "content": "<p>Isn't there a database/compilation of past shakeups? And wouldn't the statistics from other competitions be affected by the number of participants N? Based on <a href=\"https://www.kaggle.com/c/sberbank-russian-housing-market/discussion/35522\">this competition</a> I think It will be closer to 0, but I'll say 150. I like around numbers.</p>",
      "rawMarkdown": "Isn't there a database/compilation of past shakeups? And wouldn't the statistics from other competitions be affected by the number of participants N? Based on [this competition](https://www.kaggle.com/c/sberbank-russian-housing-market/discussion/35522) I think It will be closer to 0, but I'll say 150. I like around numbers.",
      "votes": 1,
      "replies": [
        {
          "id": 540320,
          "postDate": "2019-05-31T11:02:30.477Z",
          "content": "<p>Not really, thats where exactly wisdom of crowd will come, from your past experience.</p>",
          "rawMarkdown": "Not really, thats where exactly wisdom of crowd will come, from your past experience."
        }
      ]
    },
    {
      "id": 540920,
      "postDate": "2019-06-01T11:22:53.243Z",
      "content": "<p>400</p>",
      "rawMarkdown": "400",
      "votes": 2
    },
    {
      "id": 543755,
      "postDate": "2019-06-04T19:12:58.833Z",
      "content": "<p>pretty far off guess\n<a href=\"https://www.kaggle.com/mks2192/shake-up\">https://www.kaggle.com/mks2192/shake-up</a></p>",
      "rawMarkdown": "pretty far off guess\nhttps://www.kaggle.com/mks2192/shake-up"
    },
    {
      "id": 542466,
      "postDate": "2019-06-04T00:14:53.530Z",
      "content": "<p>hahaha, i was way off</p>",
      "rawMarkdown": "hahaha, i was way off"
    },
    {
      "id": 542463,
      "postDate": "2019-06-04T00:13:20.953Z",
      "content": "<p>I was overly optimistic/pessimistic (depends on how you look at it ;) - I couldn't even imagine so many people jumping thousands of spots, not mentioning hundreds...</p>",
      "rawMarkdown": "I was overly optimistic/pessimistic (depends on how you look at it ;) - I couldn't even imagine so many people jumping thousands of spots, not mentioning hundreds...\n",
      "replies": [
        {
          "id": 543667,
          "postDate": "2019-06-04T17:20:40.447Z",
          "content": "<p>That because a lot of other people insanely blended public kernels which was obviously overfited.</p>",
          "rawMarkdown": "That because a lot of other people insanely blended public kernels which was obviously overfited."
        }
      ]
    },
    {
      "id": 540311,
      "postDate": "2019-05-31T10:51:17.883Z",
      "content": "<p>My guess : 45</p>",
      "rawMarkdown": "My guess : 45",
      "replies": [
        {
          "id": 540543,
          "postDate": "2019-05-31T16:05:06.230Z",
          "content": "<blockquote>\n  <p>My guess : 45</p>\n</blockquote>\n\n<p>no typo here?</p>",
          "rawMarkdown": "&gt; My guess : 45\n\nno typo here?",
          "votes": 2
        },
        {
          "id": 540628,
          "postDate": "2019-05-31T19:06:52.940Z",
          "content": "<p>hahaha , zero is missing maybe ;).\nI still have a gut feeling your team  will be in top 0-10</p>",
          "rawMarkdown": "hahaha , zero is missing maybe ;).\nI still have a gut feeling your team  will be in top 0-10",
          "votes": 1
        }
      ]
    },
    {
      "id": 540310,
      "postDate": "2019-05-31T10:50:46.907Z",
      "content": "<p>Subscription to FT is needed to read this. Your credentials might help if you could share 😉 </p>",
      "rawMarkdown": "Subscription to FT is needed to read this. Your credentials might help if you could share 😉 ",
      "replies": [
        {
          "id": 540312,
          "postDate": "2019-05-31T10:51:47.033Z",
          "content": "<p>i wrote the content. look again</p>",
          "rawMarkdown": "i wrote the content. look again"
        }
      ]
    },
    {
      "id": 540917,
      "postDate": "2019-06-01T11:20:19.960Z",
      "rawMarkdown": "",
      "votes": 2,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 540390,
      "author_name": "steubk",
      "author_url": "",
      "post_date": "2019-05-31T12:52:01.210000",
      "content": "<p>For those who do not know about Scott E. Page's Diversity Prediction Theorem</p>\n\n<p><code>Crowd's square error = the mean square error - the diversity of the crowd</code></p>\n\n<p><a href=\"https://www.coursera.org/lecture/model-thinking/diversity-prediction-theorem-rVbCg\">Diversity Prediction Theorem</a></p>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 541654,
      "author_name": "Pascal Pfeiffer",
      "author_url": "",
      "post_date": "2019-06-02T20:40:02.010000",
      "content": "<p>210</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 541104,
      "author_name": "Nickolay Safronov",
      "author_url": "",
      "post_date": "2019-06-01T18:16:23.873000",
      "content": "<p>280</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540946,
      "author_name": "Ilham Firdausi Putra",
      "author_url": "",
      "post_date": "2019-06-01T12:15:42.027000",
      "content": "<p>230</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540921,
      "author_name": "Kha Vo",
      "author_url": "",
      "post_date": "2019-06-01T11:22:56.753000",
      "content": "<p>246</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540914,
      "author_name": "Bellò Filippo",
      "author_url": "",
      "post_date": "2019-06-01T11:15:31.523000",
      "content": "<p>350  (with gaussian distribution)</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540680,
      "author_name": "RNA",
      "author_url": "",
      "post_date": "2019-05-31T20:48:40.457000",
      "content": "<p>In my case? Approximately 4112.</p>\n\n<p>In general? I think around 500.</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540643,
      "author_name": "Sergey Zlobin",
      "author_url": "",
      "post_date": "2019-05-31T19:36:18.650000",
      "content": "<p>100</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540589,
      "author_name": "Alexey Kotlik",
      "author_url": "",
      "post_date": "2019-05-31T17:40:21.963000",
      "content": "<p>I think major quake will be closer to the top only - about 800-1200 positions, where scores are tight. Probably quite a few blended overfitted models will go down severely. Looking down the leaderboard I guess mainly it will not change much.\nMy estimate is around 100 :)</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540567,
      "author_name": "Kain",
      "author_url": "",
      "post_date": "2019-05-31T17:01:05.993000",
      "content": "<p>666 ;)</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540544,
      "author_name": "CPMP",
      "author_url": "",
      "post_date": "2019-05-31T16:06:57.817000",
      "content": "<p>400</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 540382,
      "author_name": "interneuron",
      "author_url": "",
      "post_date": "2019-05-31T12:39:08.900000",
      "content": "<p>Wisdom of crowds is an excellent book. The craziest thing in there is the submarine story in the beginning.</p>\n\n<p>I think mean shake will be 10, with a few very extreme (+/- 1000) cases.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 540383,
          "author_name": "Manoj",
          "author_url": "",
          "post_date": "2019-05-31T12:41:14.497000",
          "content": "<p>Thanks for guessing. in that case median can be compared.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 540319,
      "author_name": "Tim Yee",
      "author_url": "",
      "post_date": "2019-05-31T11:01:23.843000",
      "content": "<p>Isn't there a database/compilation of past shakeups? And wouldn't the statistics from other competitions be affected by the number of participants N? Based on <a href=\"https://www.kaggle.com/c/sberbank-russian-housing-market/discussion/35522\">this competition</a> I think It will be closer to 0, but I'll say 150. I like around numbers.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 540320,
          "author_name": "Manoj",
          "author_url": "",
          "post_date": "2019-05-31T11:02:30.477000",
          "content": "<p>Not really, thats where exactly wisdom of crowd will come, from your past experience.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 540920,
      "author_name": "Felipe Loque",
      "author_url": "",
      "post_date": "2019-06-01T11:22:53.243000",
      "content": "<p>400</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 543755,
      "author_name": "Manoj",
      "author_url": "",
      "post_date": "2019-06-04T19:12:58.833000",
      "content": "<p>pretty far off guess\n<a href=\"https://www.kaggle.com/mks2192/shake-up\">https://www.kaggle.com/mks2192/shake-up</a></p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 542466,
      "author_name": "interneuron",
      "author_url": "",
      "post_date": "2019-06-04T00:14:53.530000",
      "content": "<p>hahaha, i was way off</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 542463,
      "author_name": "Alexey Kotlik",
      "author_url": "",
      "post_date": "2019-06-04T00:13:20.953000",
      "content": "<p>I was overly optimistic/pessimistic (depends on how you look at it ;) - I couldn't even imagine so many people jumping thousands of spots, not mentioning hundreds...</p>",
      "votes": 0,
      "replies": [
        {
          "id": 543667,
          "author_name": "Nickolay Safronov",
          "author_url": "",
          "post_date": "2019-06-04T17:20:40.447000",
          "content": "<p>That because a lot of other people insanely blended public kernels which was obviously overfited.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 540311,
      "author_name": "Manoj",
      "author_url": "",
      "post_date": "2019-05-31T10:51:17.883000",
      "content": "<p>My guess : 45</p>",
      "votes": 0,
      "replies": [
        {
          "id": 540543,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-05-31T16:05:06.230000",
          "content": "<blockquote>\n  <p>My guess : 45</p>\n</blockquote>\n\n<p>no typo here?</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 540628,
          "author_name": "Manoj",
          "author_url": "",
          "post_date": "2019-05-31T19:06:52.940000",
          "content": "<p>hahaha , zero is missing maybe ;).\nI still have a gut feeling your team  will be in top 0-10</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 540310,
      "author_name": "cyberia",
      "author_url": "",
      "post_date": "2019-05-31T10:50:46.907000",
      "content": "<p>Subscription to FT is needed to read this. Your credentials might help if you could share 😉 </p>",
      "votes": 0,
      "replies": [
        {
          "id": 540312,
          "author_name": "Manoj",
          "author_url": "",
          "post_date": "2019-05-31T10:51:47.033000",
          "content": "<p>i wrote the content. look again</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 540917,
      "author_name": "",
      "author_url": "",
      "post_date": "2019-06-01T11:20:19.960000",
      "content": "",
      "votes": 2,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "540307": "https://www.ft.com/content/bfb7e6b8-d57b-11e1-af40-00144feabdc0\n &gt; \nIn 1906, the great statistician Francis Galton observed a competition to guess the weight of an ox at a country fair. Eight hundred people entered. Galton, being the kind of man he was, ran statistical tests on the numbers. He discovered that the average guess (1,197lb) was extremely close to the actual weight (1,198lb) of the ox. This story was told by James Surowiecki, in his entertaining book The Wisdom of Crowds.\n\n\n\nWe all are believing  there is going to be shake-up. lets say it follows some distribution. what do you think will be\n\n &gt;  Mean shake up ( absolute number of  places )\n\nif you care to guess and answer i will compile the answer and compare after the competition. let's see how it goes.\n\nPS: please don't influence your guess by someone else's guess. (ie. don't read the comments before commenting)\n\n\n\n\n**UPDATE:**\n\nhere is the analysis\nhttps://www.kaggle.com/mks2192/shake-up",
    "540390": "For those who do not know about Scott E. Page's Diversity Prediction Theorem\n\n`Crowd's square error = the mean square error - the diversity of the crowd`\n\n[Diversity Prediction Theorem](https://www.coursera.org/lecture/model-thinking/diversity-prediction-theorem-rVbCg)\n",
    "541654": "210",
    "541104": "280",
    "540946": "230",
    "540921": "246",
    "540914": "350  (with gaussian distribution)",
    "540680": "In my case? Approximately 4112.\n\nIn general? I think around 500.",
    "540643": "100",
    "540589": "I think major quake will be closer to the top only - about 800-1200 positions, where scores are tight. Probably quite a few blended overfitted models will go down severely. Looking down the leaderboard I guess mainly it will not change much.\nMy estimate is around 100 :)",
    "540567": "666 ;)",
    "540544": "400\n",
    "540382": "Wisdom of crowds is an excellent book. The craziest thing in there is the submarine story in the beginning.\n\nI think mean shake will be 10, with a few very extreme (+/- 1000) cases.",
    "540319": "Isn't there a database/compilation of past shakeups? And wouldn't the statistics from other competitions be affected by the number of participants N? Based on [this competition](https://www.kaggle.com/c/sberbank-russian-housing-market/discussion/35522) I think It will be closer to 0, but I'll say 150. I like around numbers.",
    "540920": "400",
    "543755": "pretty far off guess\nhttps://www.kaggle.com/mks2192/shake-up",
    "542466": "hahaha, i was way off",
    "542463": "I was overly optimistic/pessimistic (depends on how you look at it ;) - I couldn't even imagine so many people jumping thousands of spots, not mentioning hundreds...\n",
    "540311": "My guess : 45",
    "540310": "Subscription to FT is needed to read this. Your credentials might help if you could share 😉 ",
    "540917": ""
  }
}