{
  "id": 62305,
  "title": "How to work on a massively unbalanced dataset?",
  "url": "/competitions/airbus-ship-detection/discussion/62305",
  "author_name": "",
  "post_date": "2018-07-31T02:27:31.115639300Z",
  "votes": 5,
  "comment_count": 5,
  "views": 0,
  "content": "<p>The class imbalance in this dataset is extreme to the say the least. How would someone go about this dataset? How to deal with the class imbalance?</p>",
  "messages": [
    {
      "id": "364213",
      "postDate": "07/31/2018 02:27:31",
      "content": "<p>The class imbalance in this dataset is extreme to the say the least. How would someone go about this dataset? How to deal with the class imbalance?</p>",
      "rawMarkdown": "The class imbalance in this dataset is extreme to the say the least. How would someone go about this dataset? How to deal with the class imbalance?",
      "votes": null
    },
    {
      "id": "364246",
      "postDate": "07/31/2018 05:42:59",
      "content": "<p>Data Augmentation &amp; Transfer Learning can be used to deal with sparse image datasets</p>",
      "rawMarkdown": "Data Augmentation &amp; Transfer Learning can be used to deal with sparse image datasets",
      "votes": null
    },
    {
      "id": "364294",
      "postDate": "07/31/2018 08:43:06",
      "content": "<p>Could you please post a good resource on how class imbalance hurts?</p>",
      "rawMarkdown": "Could you please post a good resource on how class imbalance hurts?",
      "votes": null
    },
    {
      "id": "364473",
      "postDate": "07/31/2018 15:27:28",
      "content": "<p>This <a href=\"http://www.chioka.in/class-imbalance-problem/\">blog post</a> explains quite well why class imbalance is a problem and <a href=\"https://towardsdatascience.com/dealing-with-imbalanced-classes-in-machine-learning-d43d6fa19d2\">this article</a> gives you insights into how you could resolve the problem.</p>",
      "rawMarkdown": "This [blog post][1] explains quite well why class imbalance is a problem and [this article][2] gives you insights into how you could resolve the problem.\n\n\n  [1]: http://www.chioka.in/class-imbalance-problem/\n  [2]: https://towardsdatascience.com/dealing-with-imbalanced-classes-in-machine-learning-d43d6fa19d2",
      "votes": null
    },
    {
      "id": "364506",
      "postDate": "07/31/2018 16:41:52",
      "content": "<p>The dice coefficient is a good way to handle unbalanced datasets in segmentation problems</p>",
      "rawMarkdown": "The dice coefficient is a good way to handle unbalanced datasets in segmentation problems",
      "votes": null
    },
    {
      "id": "366180",
      "postDate": "08/04/2018 08:08:32",
      "content": "<p>Are there any similar resources specific to computer vision, or it's all the same?</p>",
      "rawMarkdown": "Are there any similar resources specific to computer vision, or it's all the same?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 364246,
      "author_name": "mohitr",
      "author_url": "",
      "post_date": "07/31/2018 05:42:59",
      "content": "<p>Data Augmentation &amp; Transfer Learning can be used to deal with sparse image datasets</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 364294,
      "author_name": "mbaytas",
      "author_url": "",
      "post_date": "07/31/2018 08:43:06",
      "content": "<p>Could you please post a good resource on how class imbalance hurts?</p>",
      "votes": null,
      "replies": [
        {
          "id": 364473,
          "author_name": "differentialmind",
          "author_url": "",
          "post_date": "07/31/2018 15:27:28",
          "content": "<p>This <a href=\"http://www.chioka.in/class-imbalance-problem/\">blog post</a> explains quite well why class imbalance is a problem and <a href=\"https://towardsdatascience.com/dealing-with-imbalanced-classes-in-machine-learning-d43d6fa19d2\">this article</a> gives you insights into how you could resolve the problem.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 366180,
          "author_name": "markup",
          "author_url": "",
          "post_date": "08/04/2018 08:08:32",
          "content": "<p>Are there any similar resources specific to computer vision, or it's all the same?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 364506,
      "author_name": "fseiler",
      "author_url": "",
      "post_date": "07/31/2018 16:41:52",
      "content": "<p>The dice coefficient is a good way to handle unbalanced datasets in segmentation problems</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "364213": "The class imbalance in this dataset is extreme to the say the least. How would someone go about this dataset? How to deal with the class imbalance?",
    "364246": "Data Augmentation &amp; Transfer Learning can be used to deal with sparse image datasets",
    "364294": "Could you please post a good resource on how class imbalance hurts?",
    "364473": "This [blog post][1] explains quite well why class imbalance is a problem and [this article][2] gives you insights into how you could resolve the problem.\n\n\n  [1]: http://www.chioka.in/class-imbalance-problem/\n  [2]: https://towardsdatascience.com/dealing-with-imbalanced-classes-in-machine-learning-d43d6fa19d2",
    "364506": "The dice coefficient is a good way to handle unbalanced datasets in segmentation problems",
    "366180": "Are there any similar resources specific to computer vision, or it's all the same?"
  },
  "source": "meta"
}