{
  "id": 117950,
  "title": "Wondering what happened to those who advanced 500+ places",
  "url": "/competitions/understanding_cloud_organization/discussion/117950",
  "author_name": "",
  "post_date": "2019-11-19T00:06:18.741423200Z",
  "votes": 7,
  "comment_count": 9,
  "views": 0,
  "content": "<p>For those who advanced 500+ place on the private leaderboard, what did you do?</p>",
  "messages": [
    {
      "id": "676054",
      "postDate": "11/19/2019 00:06:18",
      "content": "<p>For those who advanced 500+ place on the private leaderboard, what did you do?</p>",
      "rawMarkdown": "For those who advanced 500+ place on the private leaderboard, what did you do?",
      "votes": null
    },
    {
      "id": "676062",
      "postDate": "11/19/2019 00:15:09",
      "content": "<p>I dropped 605 places :(   My mistake was I reduced the holdout size too much and overfit the Public leaderboard, my best private results would have kept me at around 300th place</p>",
      "rawMarkdown": "I dropped 605 places :(   My mistake was I reduced the holdout size too much and overfit the Public leaderboard, my best private results would have kept me at around 300th place",
      "votes": null
    },
    {
      "id": "676071",
      "postDate": "11/19/2019 00:23:32",
      "content": "<p>yikes! </p>",
      "rawMarkdown": "yikes!",
      "votes": null
    },
    {
      "id": "676085",
      "postDate": "11/19/2019 00:32:35",
      "content": "<p>They are The Flash (superhuman speeds).</p>",
      "rawMarkdown": "They are The Flash (superhuman speeds).",
      "votes": null
    },
    {
      "id": "676089",
      "postDate": "11/19/2019 00:34:19",
      "content": "<p>i think here is same. We used 11 folds :) 1 as hold out.</p>",
      "rawMarkdown": "i think here is same. We used 11 folds :) 1 as hold out.",
      "votes": null
    },
    {
      "id": "676218",
      "postDate": "11/19/2019 03:08:14",
      "content": "<p>I think you are referring me XD\nActually I just ensemble six models (each run with 3-fold), using another GCN multilabel classifier to remove false masks.</p>",
      "rawMarkdown": "I think you are referring me XD\nActually I just ensemble six models (each run with 3-fold), using another GCN multilabel classifier to remove false masks.",
      "votes": null
    },
    {
      "id": "676410",
      "postDate": "11/19/2019 06:34:42",
      "content": "<p>I had pretty common approach nothing fancy, got 0.6565 on public LB using efficientnet-b4 (BCEDice Loss) and normal post processing technique. Ensemble was never able to cross that score nor any new approaches were able to. I didn't change threshold or min area much so that I don't overfit public LB that is it. And got Private LB 0.65477 and +533. I never expected this to happen. </p>",
      "rawMarkdown": "I had pretty common approach nothing fancy, got 0.6565 on public LB using efficientnet-b4 (BCEDice Loss) and normal post processing technique. Ensemble was never able to cross that score nor any new approaches were able to. I didn't change threshold or min area much so that I don't overfit public LB that is it. And got Private LB 0.65477 and +533. I never expected this to happen.",
      "votes": null
    },
    {
      "id": "677079",
      "postDate": "11/19/2019 19:01:07",
      "content": "<p><a href=\"/joeychuang\">@joeychuang</a>  By ensamble six models (each run with 3-fold) do you mean that you make 6 different types of architectures(u-net vs fpn, resnet50 vs rse_resnext101_32x4d, batch size..etc), then in each one you split the data in 3 folds (train on 1 and 2, test on 3....train on 2 and 3,test on 1..... train on 1 and 3, test on 2), then make the mean of the 3 folds results for each of the 9 clasifiers and then make the mean of the 9 clasifiers? </p>\n\n<p>Thanks</p>",
      "rawMarkdown": "joeychuang  By ensamble six models (each run with 3-fold) do you mean that you make 6 different types of architectures(u-net vs fpn, resnet50 vs rse_resnext101_32x4d, batch size..etc), then in each one you split the data in 3 folds (train on 1 and 2, test on 3....train on 2 and 3,test on 1..... train on 1 and 3, test on 2), then make the mean of the 3 folds results for each of the 9 clasifiers and then make the mean of the 9 clasifiers? \n\nThanks",
      "votes": null
    },
    {
      "id": "677322",
      "postDate": "11/20/2019 03:32:32",
      "content": "<p>Almost like this! I also tried different augmentation.</p>",
      "rawMarkdown": "Almost like this! I also tried different augmentation.",
      "votes": null
    },
    {
      "id": "677557",
      "postDate": "11/20/2019 10:16:46",
      "content": "<p>Nice ! Congratulations for you place ! </p>",
      "rawMarkdown": "Nice ! Congratulations for you place !",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 676062,
      "author_name": "s13658695",
      "author_url": "",
      "post_date": "11/19/2019 00:15:09",
      "content": "<p>I dropped 605 places :(   My mistake was I reduced the holdout size too much and overfit the Public leaderboard, my best private results would have kept me at around 300th place</p>",
      "votes": null,
      "replies": [
        {
          "id": 676071,
          "author_name": "ekan825",
          "author_url": "",
          "post_date": "11/19/2019 00:23:32",
          "content": "<p>yikes! </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 676089,
          "author_name": "tugstugi",
          "author_url": "",
          "post_date": "11/19/2019 00:34:19",
          "content": "<p>i think here is same. We used 11 folds :) 1 as hold out.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 676085,
      "author_name": "mpwolke",
      "author_url": "",
      "post_date": "11/19/2019 00:32:35",
      "content": "<p>They are The Flash (superhuman speeds).</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 676218,
      "author_name": "joeychuang",
      "author_url": "",
      "post_date": "11/19/2019 03:08:14",
      "content": "<p>I think you are referring me XD\nActually I just ensemble six models (each run with 3-fold), using another GCN multilabel classifier to remove false masks.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 676410,
      "author_name": "hansol1sol",
      "author_url": "",
      "post_date": "11/19/2019 06:34:42",
      "content": "<p>I had pretty common approach nothing fancy, got 0.6565 on public LB using efficientnet-b4 (BCEDice Loss) and normal post processing technique. Ensemble was never able to cross that score nor any new approaches were able to. I didn't change threshold or min area much so that I don't overfit public LB that is it. And got Private LB 0.65477 and +533. I never expected this to happen. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 677079,
      "author_name": "vladvdv",
      "author_url": "",
      "post_date": "11/19/2019 19:01:07",
      "content": "<p><a href=\"/joeychuang\">@joeychuang</a>  By ensamble six models (each run with 3-fold) do you mean that you make 6 different types of architectures(u-net vs fpn, resnet50 vs rse_resnext101_32x4d, batch size..etc), then in each one you split the data in 3 folds (train on 1 and 2, test on 3....train on 2 and 3,test on 1..... train on 1 and 3, test on 2), then make the mean of the 3 folds results for each of the 9 clasifiers and then make the mean of the 9 clasifiers? </p>\n\n<p>Thanks</p>",
      "votes": null,
      "replies": [
        {
          "id": 677322,
          "author_name": "joeychuang",
          "author_url": "",
          "post_date": "11/20/2019 03:32:32",
          "content": "<p>Almost like this! I also tried different augmentation.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 677557,
          "author_name": "vladvdv",
          "author_url": "",
          "post_date": "11/20/2019 10:16:46",
          "content": "<p>Nice ! Congratulations for you place ! </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "676054": "For those who advanced 500+ place on the private leaderboard, what did you do?",
    "676062": "I dropped 605 places :(   My mistake was I reduced the holdout size too much and overfit the Public leaderboard, my best private results would have kept me at around 300th place",
    "676071": "yikes!",
    "676085": "They are The Flash (superhuman speeds).",
    "676089": "i think here is same. We used 11 folds :) 1 as hold out.",
    "676218": "I think you are referring me XD\nActually I just ensemble six models (each run with 3-fold), using another GCN multilabel classifier to remove false masks.",
    "676410": "I had pretty common approach nothing fancy, got 0.6565 on public LB using efficientnet-b4 (BCEDice Loss) and normal post processing technique. Ensemble was never able to cross that score nor any new approaches were able to. I didn't change threshold or min area much so that I don't overfit public LB that is it. And got Private LB 0.65477 and +533. I never expected this to happen.",
    "677079": "joeychuang  By ensamble six models (each run with 3-fold) do you mean that you make 6 different types of architectures(u-net vs fpn, resnet50 vs rse_resnext101_32x4d, batch size..etc), then in each one you split the data in 3 folds (train on 1 and 2, test on 3....train on 2 and 3,test on 1..... train on 1 and 3, test on 2), then make the mean of the 3 folds results for each of the 9 clasifiers and then make the mean of the 9 clasifiers? \n\nThanks",
    "677322": "Almost like this! I also tried different augmentation.",
    "677557": "Nice ! Congratulations for you place !"
  },
  "source": "meta"
}