{
  "id": 551700,
  "title": "Is it fake fairness when hundreds of teams lead by same shared code?",
  "url": "/competitions/child-mind-institute-problematic-internet-use/discussion/551700",
  "author_name": "",
  "post_date": "2024-12-14T20:29:38.796032700Z",
  "votes": 3,
  "comment_count": 12,
  "views": 0,
  "content": "<p>It is the first time for me to participated in Kaggle competition. After months of effort, I got LB=0.492 in Dec., located in a position of over 300 on leaderboard. There're 300+ 0.494s ranked before me. I guessed these 0.494s were all copied from the shared code. When I finally got LB=0.495 on Dec. 10, I was ranked 27th which made me so excited. I overcame the obstacle of 0.494s. But today, I logined and found I fell to 350th again. There're 300+ 0.497s once again! Only because the top 1 shared code updated and got 0.497. </p>\n<p>Is it fair? We had put in months of hard work to improve by one thousandth, then were defeated by hundreds of copies in an instant. Are Kaggle's rules meant to encourage this situation?</p>",
  "messages": [
    {
      "id": "3072185",
      "postDate": "12/14/2024 20:29:38",
      "content": "<p>It is the first time for me to participated in Kaggle competition. After months of effort, I got LB=0.492 in Dec., located in a position of over 300 on leaderboard. There're 300+ 0.494s ranked before me. I guessed these 0.494s were all copied from the shared code. When I finally got LB=0.495 on Dec. 10, I was ranked 27th which made me so excited. I overcame the obstacle of 0.494s. But today, I logined and found I fell to 350th again. There're 300+ 0.497s once again! Only because the top 1 shared code updated and got 0.497. </p>\n<p>Is it fair? We had put in months of hard work to improve by one thousandth, then were defeated by hundreds of copies in an instant. Are Kaggle's rules meant to encourage this situation?</p>",
      "rawMarkdown": "It is the first time for me to participated in Kaggle competition. After months of effort, I got LB=0.492 in Dec., located in a position of over 300 on leaderboard. There're 300+ 0.494s ranked before me. I guessed these 0.494s were all copied from the shared code. When I finally got LB=0.495 on Dec. 10, I was ranked 27th which made me so excited. I overcame the obstacle of 0.494s. But today, I logined and found I fell to 350th again. There're 300+ 0.497s once again! Only because the top 1 shared code updated and got 0.497. \n\nIs it fair? We had put in months of hard work to improve by one thousandth, then were defeated by hundreds of copies in an instant. Are Kaggle's rules meant to encourage this situation?",
      "votes": null
    },
    {
      "id": "3072200",
      "postDate": "12/14/2024 21:00:29",
      "content": "<p>Well, this is why sharing in the last week is forbidden.  <br>\nNow I'm gonna try to improve this shared solution…I have no idea what is going on in this competition, but I also want to participate in this fun and cute lottery competition! (at least this is what it looks like?)</p>",
      "rawMarkdown": "Well, this is why sharing in the last week is forbidden.  \nNow I'm gonna try to improve this shared solution...I have no idea what is going on in this competition, but I also want to participate in this fun and cute lottery competition! (at least this is what it looks like?)",
      "votes": null
    },
    {
      "id": "3072212",
      "postDate": "12/14/2024 21:34:56",
      "content": "<blockquote>\n  <p>We had put in months of hard work to improve by one thousandth,</p>\n</blockquote>\n<p>This is not that kind of competition where you should steadily climb to LB position and care about it so much. What you really need to think about is the robustness of the solution. A balanced trade-off is all you need, because you can't go through chaos if you are too conservative.</p>",
      "rawMarkdown": ">We had put in months of hard work to improve by one thousandth,\n\nThis is not that kind of competition where you should steadily climb to LB position and care about it so much. What you really need to think about is the robustness of the solution. A balanced trade-off is all you need, because you can't go through chaos if you are too conservative.",
      "votes": null
    },
    {
      "id": "3072245",
      "postDate": "12/14/2024 22:57:31",
      "content": "<p>Why not add something you found to this public code?</p>",
      "rawMarkdown": "Why not add something you found to this public code?",
      "votes": null
    },
    {
      "id": "3072371",
      "postDate": "12/15/2024 05:02:27",
      "content": "<p>This is the fastest way to get notebook(discussion) GM. Sharing ensemble notebooks with a high score but full of unreasonable code or writing down thousands of waffle, you could be entitled as a \"GM\".<br>\nYou need to distinguish which notebooks are valuable and helpful for private leaderboard.</p>",
      "rawMarkdown": "This is the fastest way to get notebook(discussion) GM. Sharing ensemble notebooks with a high score but full of unreasonable code or writing down thousands of waffle, you could be entitled as a \"GM\".\nYou need to distinguish which notebooks are valuable and helpful for private leaderboard.",
      "votes": null
    },
    {
      "id": "3072375",
      "postDate": "12/15/2024 05:06:14",
      "content": "<p>Usually the public notebook with high public LB doesnt perform well eventually, so take it easy. But with that being said, this is one of the most fun competitions I've ever encountered… really looking forward to seeing the outcome</p>",
      "rawMarkdown": "Usually the public notebook with high public LB doesnt perform well eventually, so take it easy. But with that being said, this is one of the most fun competitions I've ever encountered... really looking forward to seeing the outcome",
      "votes": null
    },
    {
      "id": "3072407",
      "postDate": "12/15/2024 06:17:36",
      "content": "<p>No problem, what truly matters is not your ranking on the LB, but your ranking on the PB and your personal growth.</p>",
      "rawMarkdown": "No problem, what truly matters is not your ranking on the LB, but your ranking on the PB and your personal growth.",
      "votes": null
    },
    {
      "id": "3072486",
      "postDate": "12/15/2024 09:30:08",
      "content": "<p>There are two very decent notebooks that is shared in this competition thanks to <a href=\"https://www.kaggle.com/ambrosm\" target=\"_blank\">@ambrosm</a> and <a href=\"https://www.kaggle.com/antoninadolgorukova\" target=\"_blank\">@antoninadolgorukova</a>. Normally, you don't see that often in lottery competitions.  </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/code/ambrosm/piu-eda-which-makes-sense\" target=\"_blank\">https://www.kaggle.com/code/ambrosm/piu-eda-which-makes-sense</a></li>\n<li><a href=\"https://www.kaggle.com/code/antoninadolgorukova/cmi-piu-features-eda\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/cmi-piu-features-eda</a></li>\n</ul>",
      "rawMarkdown": "There are two very decent notebooks that is shared in this competition thanks to @ambrosm and @antoninadolgorukova. Normally, you don't see that often in lottery competitions.  \n* https://www.kaggle.com/code/ambrosm/piu-eda-which-makes-sense\n* https://www.kaggle.com/code/antoninadolgorukova/cmi-piu-features-eda",
      "votes": null
    },
    {
      "id": "3072498",
      "postDate": "12/15/2024 09:56:02",
      "content": "<p>They are truly great. And I have learnt a lot from AmbrosM's notebooks in many competitions.</p>",
      "rawMarkdown": "They are truly great. And I have learnt a lot from AmbrosM's notebooks in many competitions.",
      "votes": null
    },
    {
      "id": "3073096",
      "postDate": "12/16/2024 03:56:15",
      "content": "<p>being good is not enough. you have to be better than the rest in a competition.<br>\nIn today's LLM/chatgpt age, anyone (skilled or less skilled, spent much time or less time) who knows how to use AI as a tool will have the same score.</p>",
      "rawMarkdown": "being good is not enough. you have to be better than the rest in a competition.\nIn today's LLM/chatgpt age, anyone (skilled or less skilled, spent much time or less time) who knows how to use AI as a tool will have the same score.",
      "votes": null
    },
    {
      "id": "3075358",
      "postDate": "12/18/2024 18:23:39",
      "content": "<p>await shake up</p>",
      "rawMarkdown": "await shake up",
      "votes": null
    },
    {
      "id": "3076532",
      "postDate": "12/20/2024 03:14:26",
      "content": "<p>Hey, your hard work prevailed over our copy pasta shenanigans.. congratulations for medal win</p>",
      "rawMarkdown": "Hey, your hard work prevailed over our copy pasta shenanigans.. congratulations for medal win",
      "votes": null
    },
    {
      "id": "3076567",
      "postDate": "12/20/2024 04:36:43",
      "content": "<p>The open-source 0.497 code didn't score well on the private leaderboard. Instead, those who last logged in over a month ago and submitted only once or twice ended up winning gold medals. I think the randomness of such competitions takes away much of the fun, though you can still learn a lot from them. All in all, it's probably best to avoid these kinds of \"lottery-style competitions\" in the future.</p>",
      "rawMarkdown": "The open-source 0.497 code didn't score well on the private leaderboard. Instead, those who last logged in over a month ago and submitted only once or twice ended up winning gold medals. I think the randomness of such competitions takes away much of the fun, though you can still learn a lot from them. All in all, it's probably best to avoid these kinds of \"lottery-style competitions\" in the future.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3072200,
      "author_name": "shlomoron",
      "author_url": "",
      "post_date": "12/14/2024 21:00:29",
      "content": "<p>Well, this is why sharing in the last week is forbidden.  <br>\nNow I'm gonna try to improve this shared solution…I have no idea what is going on in this competition, but I also want to participate in this fun and cute lottery competition! (at least this is what it looks like?)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3072212,
      "author_name": "yekenot",
      "author_url": "",
      "post_date": "12/14/2024 21:34:56",
      "content": "<blockquote>\n  <p>We had put in months of hard work to improve by one thousandth,</p>\n</blockquote>\n<p>This is not that kind of competition where you should steadily climb to LB position and care about it so much. What you really need to think about is the robustness of the solution. A balanced trade-off is all you need, because you can't go through chaos if you are too conservative.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3072245,
      "author_name": "aisysxd",
      "author_url": "",
      "post_date": "12/14/2024 22:57:31",
      "content": "<p>Why not add something you found to this public code?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3072371,
      "author_name": "takanashihumbert",
      "author_url": "",
      "post_date": "12/15/2024 05:02:27",
      "content": "<p>This is the fastest way to get notebook(discussion) GM. Sharing ensemble notebooks with a high score but full of unreasonable code or writing down thousands of waffle, you could be entitled as a \"GM\".<br>\nYou need to distinguish which notebooks are valuable and helpful for private leaderboard.</p>",
      "votes": null,
      "replies": [
        {
          "id": 3072486,
          "author_name": "gunesevitan",
          "author_url": "",
          "post_date": "12/15/2024 09:30:08",
          "content": "<p>There are two very decent notebooks that is shared in this competition thanks to <a href=\"https://www.kaggle.com/ambrosm\" target=\"_blank\">@ambrosm</a> and <a href=\"https://www.kaggle.com/antoninadolgorukova\" target=\"_blank\">@antoninadolgorukova</a>. Normally, you don't see that often in lottery competitions.  </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/code/ambrosm/piu-eda-which-makes-sense\" target=\"_blank\">https://www.kaggle.com/code/ambrosm/piu-eda-which-makes-sense</a></li>\n<li><a href=\"https://www.kaggle.com/code/antoninadolgorukova/cmi-piu-features-eda\" target=\"_blank\">https://www.kaggle.com/code/antoninadolgorukova/cmi-piu-features-eda</a></li>\n</ul>",
          "votes": null,
          "replies": [
            {
              "id": 3072498,
              "author_name": "takanashihumbert",
              "author_url": "",
              "post_date": "12/15/2024 09:56:02",
              "content": "<p>They are truly great. And I have learnt a lot from AmbrosM's notebooks in many competitions.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3072375,
      "author_name": "yannan90",
      "author_url": "",
      "post_date": "12/15/2024 05:06:14",
      "content": "<p>Usually the public notebook with high public LB doesnt perform well eventually, so take it easy. But with that being said, this is one of the most fun competitions I've ever encountered… really looking forward to seeing the outcome</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3072407,
      "author_name": "yosynory",
      "author_url": "",
      "post_date": "12/15/2024 06:17:36",
      "content": "<p>No problem, what truly matters is not your ranking on the LB, but your ranking on the PB and your personal growth.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3073096,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "12/16/2024 03:56:15",
      "content": "<p>being good is not enough. you have to be better than the rest in a competition.<br>\nIn today's LLM/chatgpt age, anyone (skilled or less skilled, spent much time or less time) who knows how to use AI as a tool will have the same score.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3075358,
      "author_name": "bassetkerouche",
      "author_url": "",
      "post_date": "12/18/2024 18:23:39",
      "content": "<p>await shake up</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3076532,
      "author_name": "jagatkiran",
      "author_url": "",
      "post_date": "12/20/2024 03:14:26",
      "content": "<p>Hey, your hard work prevailed over our copy pasta shenanigans.. congratulations for medal win</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3076567,
      "author_name": "kitsuha",
      "author_url": "",
      "post_date": "12/20/2024 04:36:43",
      "content": "<p>The open-source 0.497 code didn't score well on the private leaderboard. Instead, those who last logged in over a month ago and submitted only once or twice ended up winning gold medals. I think the randomness of such competitions takes away much of the fun, though you can still learn a lot from them. All in all, it's probably best to avoid these kinds of \"lottery-style competitions\" in the future.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3072185": "It is the first time for me to participated in Kaggle competition. After months of effort, I got LB=0.492 in Dec., located in a position of over 300 on leaderboard. There're 300+ 0.494s ranked before me. I guessed these 0.494s were all copied from the shared code. When I finally got LB=0.495 on Dec. 10, I was ranked 27th which made me so excited. I overcame the obstacle of 0.494s. But today, I logined and found I fell to 350th again. There're 300+ 0.497s once again! Only because the top 1 shared code updated and got 0.497. \n\nIs it fair? We had put in months of hard work to improve by one thousandth, then were defeated by hundreds of copies in an instant. Are Kaggle's rules meant to encourage this situation?",
    "3072200": "Well, this is why sharing in the last week is forbidden.  \nNow I'm gonna try to improve this shared solution...I have no idea what is going on in this competition, but I also want to participate in this fun and cute lottery competition! (at least this is what it looks like?)",
    "3072212": ">We had put in months of hard work to improve by one thousandth,\n\nThis is not that kind of competition where you should steadily climb to LB position and care about it so much. What you really need to think about is the robustness of the solution. A balanced trade-off is all you need, because you can't go through chaos if you are too conservative.",
    "3072245": "Why not add something you found to this public code?",
    "3072371": "This is the fastest way to get notebook(discussion) GM. Sharing ensemble notebooks with a high score but full of unreasonable code or writing down thousands of waffle, you could be entitled as a \"GM\".\nYou need to distinguish which notebooks are valuable and helpful for private leaderboard.",
    "3072375": "Usually the public notebook with high public LB doesnt perform well eventually, so take it easy. But with that being said, this is one of the most fun competitions I've ever encountered... really looking forward to seeing the outcome",
    "3072407": "No problem, what truly matters is not your ranking on the LB, but your ranking on the PB and your personal growth.",
    "3072486": "There are two very decent notebooks that is shared in this competition thanks to @ambrosm and @antoninadolgorukova. Normally, you don't see that often in lottery competitions.  \n* https://www.kaggle.com/code/ambrosm/piu-eda-which-makes-sense\n* https://www.kaggle.com/code/antoninadolgorukova/cmi-piu-features-eda",
    "3072498": "They are truly great. And I have learnt a lot from AmbrosM's notebooks in many competitions.",
    "3073096": "being good is not enough. you have to be better than the rest in a competition.\nIn today's LLM/chatgpt age, anyone (skilled or less skilled, spent much time or less time) who knows how to use AI as a tool will have the same score.",
    "3075358": "await shake up",
    "3076532": "Hey, your hard work prevailed over our copy pasta shenanigans.. congratulations for medal win",
    "3076567": "The open-source 0.497 code didn't score well on the private leaderboard. Instead, those who last logged in over a month ago and submitted only once or twice ended up winning gold medals. I think the randomness of such competitions takes away much of the fun, though you can still learn a lot from them. All in all, it's probably best to avoid these kinds of \"lottery-style competitions\" in the future."
  },
  "source": "meta"
}