{
  "id": 201854,
  "title": "Are we allowed to fix the masks?",
  "url": "/competitions/hubmap-kidney-segmentation/discussion/201854",
  "author_name": "",
  "post_date": "2020-12-07T06:05:02.326479900Z",
  "votes": 10,
  "comment_count": 4,
  "views": 0,
  "content": "<p><a href=\"https://www.kaggle.com/addisonhoward\" target=\"_blank\">@addisonhoward</a> <a href=\"https://www.kaggle.com/leahscherschel\" target=\"_blank\">@leahscherschel</a> </p>\n<p>As <a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> have pointed out, some of the masks seem to be off. <br>\n<a href=\"https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/201816\" target=\"_blank\">https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/201816</a></p>\n<p>The image below represents the mask in figure <code>095bf7a1f</code>, which he also pointed out.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2F982dcbd71feef057a74d75a08696cbf2%2F095bf7a1f_bf_correction.jpg?generation=1607320094167381&amp;alt=media\" alt=\"\"></p>\n<p>The mask in the above figure seems off to me, and in fact the CV of this figure is not very good. If we shift this figure by <strong>25 horizontally</strong> and <strong>15 vertically</strong>, it looks like the figure below.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2Fa53c2b19ea0ca65a54c5dcf2e145e361%2F095bf7a1f_af_correction.jpg?generation=1607320377057733&amp;alt=media\" alt=\"\"></p>\n<p>This seems better, but are we allowed to fix the mask ourselves? If this is allowed, then the next question is whether we can get unlabeled external data and apply minor modifications ourselves according to the predicted masks.</p>\n<p>What is allowed and what is not?</p>\n<p>I personally suppose that if this is not cleared, the competition can become opaque and unfair.</p>",
  "messages": [
    {
      "id": "1104620",
      "postDate": "12/07/2020 06:05:02",
      "content": "<p><a href=\"https://www.kaggle.com/addisonhoward\" target=\"_blank\">@addisonhoward</a> <a href=\"https://www.kaggle.com/leahscherschel\" target=\"_blank\">@leahscherschel</a> </p>\n<p>As <a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> have pointed out, some of the masks seem to be off. <br>\n<a href=\"https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/201816\" target=\"_blank\">https://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/201816</a></p>\n<p>The image below represents the mask in figure <code>095bf7a1f</code>, which he also pointed out.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2F982dcbd71feef057a74d75a08696cbf2%2F095bf7a1f_bf_correction.jpg?generation=1607320094167381&amp;alt=media\" alt=\"\"></p>\n<p>The mask in the above figure seems off to me, and in fact the CV of this figure is not very good. If we shift this figure by <strong>25 horizontally</strong> and <strong>15 vertically</strong>, it looks like the figure below.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2Fa53c2b19ea0ca65a54c5dcf2e145e361%2F095bf7a1f_af_correction.jpg?generation=1607320377057733&amp;alt=media\" alt=\"\"></p>\n<p>This seems better, but are we allowed to fix the mask ourselves? If this is allowed, then the next question is whether we can get unlabeled external data and apply minor modifications ourselves according to the predicted masks.</p>\n<p>What is allowed and what is not?</p>\n<p>I personally suppose that if this is not cleared, the competition can become opaque and unfair.</p>",
      "rawMarkdown": "addisonhoward @leahscherschel \n\nAs @hengck23 have pointed out, some of the masks seem to be off. \nhttps://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/201816\n\nThe image below represents the mask in figure `095bf7a1f`, which he also pointed out.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2F982dcbd71feef057a74d75a08696cbf2%2F095bf7a1f_bf_correction.jpg?generation=1607320094167381&alt=media)\n\nThe mask in the above figure seems off to me, and in fact the CV of this figure is not very good. If we shift this figure by **25 horizontally** and **15 vertically**, it looks like the figure below.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2Fa53c2b19ea0ca65a54c5dcf2e145e361%2F095bf7a1f_af_correction.jpg?generation=1607320377057733&alt=media)\n\nThis seems better, but are we allowed to fix the mask ourselves? If this is allowed, then the next question is whether we can get unlabeled external data and apply minor modifications ourselves according to the predicted masks.\n\nWhat is allowed and what is not?\n\nI personally suppose that if this is not cleared, the competition can become opaque and unfair.",
      "votes": null
    },
    {
      "id": "1104627",
      "postDate": "12/07/2020 06:12:15",
      "content": "<p>actually, the main concern is the test set. we hope the test ground truth at the server is not shifted.</p>\n<p>for train set, you are free to do what you want.</p>\n<p>\"25 horizontally and 15 vertically,\"<br>\nthe best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images. I think manually shifting (or judgment by eye) is not optimum.</p>",
      "rawMarkdown": "actually, the main concern is the test set. we hope the test ground truth at the server is not shifted.\n\nfor train set, you are free to do what you want.\n\n\"25 horizontally and 15 vertically,\"\nthe best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images. I think manually shifting (or judgment by eye) is not optimum.",
      "votes": null
    },
    {
      "id": "1104648",
      "postDate": "12/07/2020 06:53:34",
      "content": "<p><a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> </p>\n<p>Thank you for your comment.</p>\n<blockquote>\n  <p>for train set, you are free to do what you want.</p>\n</blockquote>\n<p>Does \"the train data\" you refer to include external data? Is it okay to hand label for external data?</p>",
      "rawMarkdown": "hengck23 \n\nThank you for your comment.\n\n>for train set, you are free to do what you want.\n\nDoes \"the train data\" you refer to include external data? Is it okay to hand label for external data?",
      "votes": null
    },
    {
      "id": "1104701",
      "postDate": "12/07/2020 07:20:54",
      "content": "<p>you can label external data</p>",
      "rawMarkdown": "you can label external data",
      "votes": null
    },
    {
      "id": "1112125",
      "postDate": "12/14/2020 10:00:20",
      "content": "<p><a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> thanks for your comment.<br>\n I dont understand why flip can help us find out the shifted images.<br>\nIn my opinion,whenwe flip images,mask need flip together.<br>\nWould your explain more about it ?<br>\nThx.</p>\n<blockquote>\n  <p>the best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images.</p>\n</blockquote>",
      "rawMarkdown": "hengck23 thanks for your comment.\n I dont understand why flip can help us find out the shifted images.\nIn my opinion,whenwe flip images,mask need flip together.\nWould your explain more about it ?\nThx.\n> the best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1104627,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "12/07/2020 06:12:15",
      "content": "<p>actually, the main concern is the test set. we hope the test ground truth at the server is not shifted.</p>\n<p>for train set, you are free to do what you want.</p>\n<p>\"25 horizontally and 15 vertically,\"<br>\nthe best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images. I think manually shifting (or judgment by eye) is not optimum.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1104648,
          "author_name": "maxwell110",
          "author_url": "",
          "post_date": "12/07/2020 06:53:34",
          "content": "<p><a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> </p>\n<p>Thank you for your comment.</p>\n<blockquote>\n  <p>for train set, you are free to do what you want.</p>\n</blockquote>\n<p>Does \"the train data\" you refer to include external data? Is it okay to hand label for external data?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1104701,
          "author_name": "hengck23",
          "author_url": "",
          "post_date": "12/07/2020 07:20:54",
          "content": "<p>you can label external data</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1112125,
      "author_name": "mashepburn8",
      "author_url": "",
      "post_date": "12/14/2020 10:00:20",
      "content": "<p><a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> thanks for your comment.<br>\n I dont understand why flip can help us find out the shifted images.<br>\nIn my opinion,whenwe flip images,mask need flip together.<br>\nWould your explain more about it ?<br>\nThx.</p>\n<blockquote>\n  <p>the best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images.</p>\n</blockquote>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1104620": "addisonhoward @leahscherschel \n\nAs @hengck23 have pointed out, some of the masks seem to be off. \nhttps://www.kaggle.com/c/hubmap-kidney-segmentation/discussion/201816\n\nThe image below represents the mask in figure `095bf7a1f`, which he also pointed out.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2F982dcbd71feef057a74d75a08696cbf2%2F095bf7a1f_bf_correction.jpg?generation=1607320094167381&alt=media)\n\nThe mask in the above figure seems off to me, and in fact the CV of this figure is not very good. If we shift this figure by **25 horizontally** and **15 vertically**, it looks like the figure below.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F479538%2Fa53c2b19ea0ca65a54c5dcf2e145e361%2F095bf7a1f_af_correction.jpg?generation=1607320377057733&alt=media)\n\nThis seems better, but are we allowed to fix the mask ourselves? If this is allowed, then the next question is whether we can get unlabeled external data and apply minor modifications ourselves according to the predicted masks.\n\nWhat is allowed and what is not?\n\nI personally suppose that if this is not cleared, the competition can become opaque and unfair.",
    "1104627": "actually, the main concern is the test set. we hope the test ground truth at the server is not shifted.\n\nfor train set, you are free to do what you want.\n\n\"25 horizontally and 15 vertically,\"\nthe best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images. I think manually shifting (or judgment by eye) is not optimum.",
    "1104648": "hengck23 \n\nThank you for your comment.\n\n>for train set, you are free to do what you want.\n\nDoes \"the train data\" you refer to include external data? Is it okay to hand label for external data?",
    "1104701": "you can label external data",
    "1112125": "hengck23 thanks for your comment.\n I dont understand why flip can help us find out the shifted images.\nIn my opinion,whenwe flip images,mask need flip together.\nWould your explain more about it ?\nThx.\n> the best way to determine this is to write a program to do brute force search that will max your CV for a variety of model and flip images."
  },
  "source": "meta"
}