![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1788308%2F75c31a3ea54c227b4dff449b14118854%2FScreenshot_20191113-102642__01.jpg?generation=1573637476614709&alt=media\")
With almost no shakeup, what happened with these three teams? Any idea why?
\n\n
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1788308%2F346ff4c7cb2c9a62abb4ac0aa032a47f%2FScreenshot_20191113-102635__01.jpg?generation=1573637643077823&alt=media\")
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1788308%2Fb1a2e5fa82579863ce5793b85a949226%2FScreenshot_20191113-102621__01.jpg?generation=1573637659516373&alt=media\")
With almost no shakeup, what happened with these three teams? Any idea why?
\n\n
Normally, this happens when you completely ignore local validation and validate models on the leaderboard. But these are extreme cases for sure.
", "rawMarkdown": "Normally, this happens when you completely ignore local validation and validate models on the leaderboard. But these are extreme cases for sure.", "votes": null }, { "id": "671993", "postDate": "11/13/2019 12:37:13", "content": "The selection of the final two models plays a big role many times in the final leaderboard!
", "rawMarkdown": "The selection of the final two models plays a big role many times in the final leaderboard!", "votes": null }, { "id": "672081", "postDate": "11/13/2019 13:53:36", "content": "I think shapeups didn't affect the results, because of the huge amount of bounding boxes in each test set. I found about 920k boxes total.
", "rawMarkdown": "I think shapeups didn't affect the results, because of the huge amount of bounding boxes in each test set. I found about 920k boxes total.", "votes": null }, { "id": "672215", "postDate": "11/13/2019 16:28:20", "content": "I am very confused about this as well. For the steel competition I saw many people fall thousands of places to the bottom and getting a score of 0. How does that work?
", "rawMarkdown": "I am very confused about this as well. For the steel competition I saw many people fall thousands of places to the bottom and getting a score of 0. How does that work?", "votes": null }, { "id": "672226", "postDate": "11/13/2019 16:55:16", "content": "Steel was a different case, there many people were using \"quick submissions\" which didn't account for the private test set resulting in zero scores in private LB.
", "rawMarkdown": "Steel was a different case, there many people were using \"quick submissions\" which didn't account for the private test set resulting in zero scores in private LB.", "votes": null }, { "id": "672227", "postDate": "11/13/2019 16:59:16", "content": "They haven't participated in any other competitions, so I think they are someone's accounts created for this competition entirely, possibly for LB probing. I think they have picked zero score submissions, there's no other explanation.
", "rawMarkdown": "They haven't participated in any other competitions, so I think they are someone's accounts created for this competition entirely, possibly for LB probing. I think they have picked zero score submissions, there's no other explanation.", "votes": null }, { "id": "673673", "postDate": "11/15/2019 10:06:00", "content": "sekiro111 has been removed
", "rawMarkdown": "sekiro111 has been removed", "votes": null } ], "comments": [ { "id": 671962, "author_name": "artyomp", "author_url": "", "post_date": "11/13/2019 11:28:55", "content": "Normally, this happens when you completely ignore local validation and validate models on the leaderboard. But these are extreme cases for sure.
", "votes": null, "replies": [] }, { "id": 671993, "author_name": "tayorm", "author_url": "", "post_date": "11/13/2019 12:37:13", "content": "The selection of the final two models plays a big role many times in the final leaderboard!
", "votes": null, "replies": [] }, { "id": 672081, "author_name": "doncalculator", "author_url": "", "post_date": "11/13/2019 13:53:36", "content": "I think shapeups didn't affect the results, because of the huge amount of bounding boxes in each test set. I found about 920k boxes total.
", "votes": null, "replies": [] }, { "id": 672215, "author_name": "cweed28", "author_url": "", "post_date": "11/13/2019 16:28:20", "content": "I am very confused about this as well. For the steel competition I saw many people fall thousands of places to the bottom and getting a score of 0. How does that work?
", "votes": null, "replies": [ { "id": 672226, "author_name": "rishabhiitbhu", "author_url": "", "post_date": "11/13/2019 16:55:16", "content": "Steel was a different case, there many people were using \"quick submissions\" which didn't account for the private test set resulting in zero scores in private LB.
", "votes": null, "replies": [] } ] }, { "id": 672227, "author_name": "artyomp", "author_url": "", "post_date": "11/13/2019 16:59:16", "content": "They haven't participated in any other competitions, so I think they are someone's accounts created for this competition entirely, possibly for LB probing. I think they have picked zero score submissions, there's no other explanation.
", "votes": null, "replies": [] }, { "id": 673673, "author_name": "artyomp", "author_url": "", "post_date": "11/15/2019 10:06:00", "content": "sekiro111 has been removed
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "671893": "With almost no shakeup, what happened with these three teams? Any idea why?\n\n\n\n\n\n\n", "671962": "Normally, this happens when you completely ignore local validation and validate models on the leaderboard. But these are extreme cases for sure.", "671993": "The selection of the final two models plays a big role many times in the final leaderboard!", "672081": "I think shapeups didn't affect the results, because of the huge amount of bounding boxes in each test set. I found about 920k boxes total.", "672215": "I am very confused about this as well. For the steel competition I saw many people fall thousands of places to the bottom and getting a score of 0. How does that work?", "672226": "Steel was a different case, there many people were using \"quick submissions\" which didn't account for the private test set resulting in zero scores in private LB.", "672227": "They haven't participated in any other competitions, so I think they are someone's accounts created for this competition entirely, possibly for LB probing. I think they have picked zero score submissions, there's no other explanation.", "673673": "sekiro111 has been removed" }, "source": "meta" }