{
  "id": 210733,
  "title": "Question on using external datasets for training",
  "url": "/competitions/ranzcr-clip-catheter-line-classification/discussion/210733",
  "author_name": "",
  "post_date": "2021-01-12T04:29:31.992998200Z",
  "votes": 22,
  "comment_count": 13,
  "views": 0,
  "content": "<p>Before many of us wasting our precious drive storage and TPU runtime, can the host disclose if external datasets like CheXpert, chest14 or MIMIC was allowed for this competition? Thanks in advance!</p>",
  "messages": [
    {
      "id": "1149696",
      "postDate": "01/12/2021 04:29:31",
      "content": "<p>Before many of us wasting our precious drive storage and TPU runtime, can the host disclose if external datasets like CheXpert, chest14 or MIMIC was allowed for this competition? Thanks in advance!</p>",
      "rawMarkdown": "Before many of us wasting our precious drive storage and TPU runtime, can the host disclose if external datasets like CheXpert, chest14 or MIMIC was allowed for this competition? Thanks in advance!",
      "votes": null
    },
    {
      "id": "1149981",
      "postDate": "01/12/2021 09:22:17",
      "content": "<p>from the rules:</p>\n<ol>\n<li>EXTERNAL DATA.<br>\nPublicly, freely available external data is permitted. Entrants may re-annotate images in the training set, however Entrants will (i) ensure the re-annotated data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the re-annotated data for the participants to the official competition forum prior to the Entry Deadline. Entrants may not hand-label predictions in the test data set, including having human observers rate and evaluate the test data set.</li>\n</ol>\n<p>chest14 is freely available with the best licence there is (CC0) - you can do anything you want with it.<br>\nMIMIC/CheXpert on the other hand has more strict licences, and I would personally leave them out.</p>\n<p>on the other hand, chest14 is the perfect external data and could be sufficient, as it contains more unhealthy patients - more than half of the photos have cvc/ett/ngt present</p>",
      "rawMarkdown": "from the rules:\n\n2. EXTERNAL DATA.\nPublicly, freely available external data is permitted. Entrants may re-annotate images in the training set, however Entrants will (i) ensure the re-annotated data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the re-annotated data for the participants to the official competition forum prior to the Entry Deadline. Entrants may not hand-label predictions in the test data set, including having human observers rate and evaluate the test data set.\n\nchest14 is freely available with the best licence there is (CC0) - you can do anything you want with it.\nMIMIC/CheXpert on the other hand has more strict licences, and I would personally leave them out.\n\non the other hand, chest14 is the perfect external data and could be sufficient, as it contains more unhealthy patients - more than half of the photos have cvc/ett/ngt present",
      "votes": null
    },
    {
      "id": "1150016",
      "postDate": "01/12/2021 09:48:27",
      "content": "<p>yes. but in some other competition like SIIM-ACR the rules was:</p>\n<blockquote>\n  <p>EXTERNAL DATA: Publicly, freely available external data is permitted. No hand-labeling of the test set.</p>\n</blockquote>\n<p>but the host still allowed chexpert dataset in that competition. so I guess it's still nothing to lose to ask first :D otherwise, i will be happy with chest14</p>",
      "rawMarkdown": "yes. but in some other competition like SIIM-ACR the rules was:\n> EXTERNAL DATA: Publicly, freely available external data is permitted. No hand-labeling of the test set.\n\n\nbut the host still allowed chexpert dataset in that competition. so I guess it's still nothing to lose to ask first :D otherwise, i will be happy with chest14",
      "votes": null
    },
    {
      "id": "1150132",
      "postDate": "01/12/2021 11:57:23",
      "content": "<p>i think it is good to confirm with the host.<br>\ni recalled some of the previous chest x-ray competitions are using \"external data\" as private data. </p>",
      "rawMarkdown": "i think it is good to confirm with the host.\ni recalled some of the previous chest x-ray competitions are using \"external data\" as private data.",
      "votes": null
    },
    {
      "id": "1151846",
      "postDate": "01/13/2021 15:52:22",
      "content": "<p>sure. but if the host doesnt provide any further information, leave chexpert and mimic aside might a safe move</p>",
      "rawMarkdown": "sure. but if the host doesnt provide any further information, leave chexpert and mimic aside might a safe move",
      "votes": null
    },
    {
      "id": "1152230",
      "postDate": "01/14/2021 00:35:28",
      "content": "<p>Hi, are these links right for these datasets?</p>\n<p>Chest14: <a href=\"https://www.kaggle.com/nih-chest-xrays/data\" target=\"_blank\">https://www.kaggle.com/nih-chest-xrays/data</a><br>\nChexpert: <a href=\"https://stanfordmlgroup.github.io/competitions/chexpert/\" target=\"_blank\">https://stanfordmlgroup.github.io/competitions/chexpert/</a></p>",
      "rawMarkdown": "Hi, are these links right for these datasets?\n\nChest14: https://www.kaggle.com/nih-chest-xrays/data\nChexpert: https://stanfordmlgroup.github.io/competitions/chexpert/",
      "votes": null
    },
    {
      "id": "1152239",
      "postDate": "01/14/2021 01:04:43",
      "content": "<p>Yes i download chest14 from the kaggle link above</p>",
      "rawMarkdown": "Yes i download chest14 from the kaggle link above",
      "votes": null
    },
    {
      "id": "1152268",
      "postDate": "01/14/2021 01:59:12",
      "content": "<p>Oh, Thanks :) </p>",
      "rawMarkdown": "Oh, Thanks :)",
      "votes": null
    },
    {
      "id": "1176303",
      "postDate": "01/29/2021 15:13:59",
      "content": "<p>Can we use the chest14 data?</p>",
      "rawMarkdown": "Can we use the chest14 data?",
      "votes": null
    },
    {
      "id": "1176499",
      "postDate": "01/29/2021 16:50:56",
      "content": "<p>Yes yo can</p>",
      "rawMarkdown": "Yes yo can",
      "votes": null
    },
    {
      "id": "1184189",
      "postDate": "02/03/2021 12:31:13",
      "content": "<p><a href=\"https://www.kaggle.com/moewie94\" target=\"_blank\">@moewie94</a> Do you use the chest14 data?Thanks!</p>",
      "rawMarkdown": "moewie94 Do you use the chest14 data?Thanks!",
      "votes": null
    },
    {
      "id": "1220157",
      "postDate": "02/27/2021 16:37:42",
      "content": "<p><a href=\"https://www.kaggle.com/moewie94\" target=\"_blank\">@moewie94</a>  does these images contain any of catheter tubes positioned ?</p>",
      "rawMarkdown": "moewie94  does these images contain any of catheter tubes positioned ?",
      "votes": null
    },
    {
      "id": "1220304",
      "postDate": "02/27/2021 20:38:22",
      "content": "<p>It was discussed in some other thread. All of the images for this competition come from the chest14 dataset. It is very large. The chest14 dataset was relabeled for this competition. They must have selected for catheter presence and then ran some labeling on it. </p>",
      "rawMarkdown": "It was discussed in some other thread. All of the images for this competition come from the chest14 dataset. It is very large. The chest14 dataset was relabeled for this competition. They must have selected for catheter presence and then ran some labeling on it.",
      "votes": null
    },
    {
      "id": "1220305",
      "postDate": "02/27/2021 20:39:33",
      "content": "<p>discussed here <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/221808\" target=\"_blank\">https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/221808</a></p>",
      "rawMarkdown": "discussed here https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/221808",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1149981,
      "author_name": "raddar",
      "author_url": "",
      "post_date": "01/12/2021 09:22:17",
      "content": "<p>from the rules:</p>\n<ol>\n<li>EXTERNAL DATA.<br>\nPublicly, freely available external data is permitted. Entrants may re-annotate images in the training set, however Entrants will (i) ensure the re-annotated data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the re-annotated data for the participants to the official competition forum prior to the Entry Deadline. Entrants may not hand-label predictions in the test data set, including having human observers rate and evaluate the test data set.</li>\n</ol>\n<p>chest14 is freely available with the best licence there is (CC0) - you can do anything you want with it.<br>\nMIMIC/CheXpert on the other hand has more strict licences, and I would personally leave them out.</p>\n<p>on the other hand, chest14 is the perfect external data and could be sufficient, as it contains more unhealthy patients - more than half of the photos have cvc/ett/ngt present</p>",
      "votes": null,
      "replies": [
        {
          "id": 1150016,
          "author_name": "moewie94",
          "author_url": "",
          "post_date": "01/12/2021 09:48:27",
          "content": "<p>yes. but in some other competition like SIIM-ACR the rules was:</p>\n<blockquote>\n  <p>EXTERNAL DATA: Publicly, freely available external data is permitted. No hand-labeling of the test set.</p>\n</blockquote>\n<p>but the host still allowed chexpert dataset in that competition. so I guess it's still nothing to lose to ask first :D otherwise, i will be happy with chest14</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1152230,
          "author_name": "youhanlee",
          "author_url": "",
          "post_date": "01/14/2021 00:35:28",
          "content": "<p>Hi, are these links right for these datasets?</p>\n<p>Chest14: <a href=\"https://www.kaggle.com/nih-chest-xrays/data\" target=\"_blank\">https://www.kaggle.com/nih-chest-xrays/data</a><br>\nChexpert: <a href=\"https://stanfordmlgroup.github.io/competitions/chexpert/\" target=\"_blank\">https://stanfordmlgroup.github.io/competitions/chexpert/</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1152239,
          "author_name": "moewie94",
          "author_url": "",
          "post_date": "01/14/2021 01:04:43",
          "content": "<p>Yes i download chest14 from the kaggle link above</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1152268,
          "author_name": "youhanlee",
          "author_url": "",
          "post_date": "01/14/2021 01:59:12",
          "content": "<p>Oh, Thanks :) </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1176303,
          "author_name": "bcwang",
          "author_url": "",
          "post_date": "01/29/2021 15:13:59",
          "content": "<p>Can we use the chest14 data?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1176499,
          "author_name": "raddar",
          "author_url": "",
          "post_date": "01/29/2021 16:50:56",
          "content": "<p>Yes yo can</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1184189,
          "author_name": "bcwang",
          "author_url": "",
          "post_date": "02/03/2021 12:31:13",
          "content": "<p><a href=\"https://www.kaggle.com/moewie94\" target=\"_blank\">@moewie94</a> Do you use the chest14 data?Thanks!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1220157,
          "author_name": "jaideepvalani",
          "author_url": "",
          "post_date": "02/27/2021 16:37:42",
          "content": "<p><a href=\"https://www.kaggle.com/moewie94\" target=\"_blank\">@moewie94</a>  does these images contain any of catheter tubes positioned ?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1220304,
          "author_name": "ryches",
          "author_url": "",
          "post_date": "02/27/2021 20:38:22",
          "content": "<p>It was discussed in some other thread. All of the images for this competition come from the chest14 dataset. It is very large. The chest14 dataset was relabeled for this competition. They must have selected for catheter presence and then ran some labeling on it. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1220305,
          "author_name": "ryches",
          "author_url": "",
          "post_date": "02/27/2021 20:39:33",
          "content": "<p>discussed here <a href=\"https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/221808\" target=\"_blank\">https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/221808</a></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1150132,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "01/12/2021 11:57:23",
      "content": "<p>i think it is good to confirm with the host.<br>\ni recalled some of the previous chest x-ray competitions are using \"external data\" as private data. </p>",
      "votes": null,
      "replies": [
        {
          "id": 1151846,
          "author_name": "moewie94",
          "author_url": "",
          "post_date": "01/13/2021 15:52:22",
          "content": "<p>sure. but if the host doesnt provide any further information, leave chexpert and mimic aside might a safe move</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1149696": "Before many of us wasting our precious drive storage and TPU runtime, can the host disclose if external datasets like CheXpert, chest14 or MIMIC was allowed for this competition? Thanks in advance!",
    "1149981": "from the rules:\n\n2. EXTERNAL DATA.\nPublicly, freely available external data is permitted. Entrants may re-annotate images in the training set, however Entrants will (i) ensure the re-annotated data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the re-annotated data for the participants to the official competition forum prior to the Entry Deadline. Entrants may not hand-label predictions in the test data set, including having human observers rate and evaluate the test data set.\n\nchest14 is freely available with the best licence there is (CC0) - you can do anything you want with it.\nMIMIC/CheXpert on the other hand has more strict licences, and I would personally leave them out.\n\non the other hand, chest14 is the perfect external data and could be sufficient, as it contains more unhealthy patients - more than half of the photos have cvc/ett/ngt present",
    "1150016": "yes. but in some other competition like SIIM-ACR the rules was:\n> EXTERNAL DATA: Publicly, freely available external data is permitted. No hand-labeling of the test set.\n\n\nbut the host still allowed chexpert dataset in that competition. so I guess it's still nothing to lose to ask first :D otherwise, i will be happy with chest14",
    "1150132": "i think it is good to confirm with the host.\ni recalled some of the previous chest x-ray competitions are using \"external data\" as private data.",
    "1151846": "sure. but if the host doesnt provide any further information, leave chexpert and mimic aside might a safe move",
    "1152230": "Hi, are these links right for these datasets?\n\nChest14: https://www.kaggle.com/nih-chest-xrays/data\nChexpert: https://stanfordmlgroup.github.io/competitions/chexpert/",
    "1152239": "Yes i download chest14 from the kaggle link above",
    "1152268": "Oh, Thanks :)",
    "1176303": "Can we use the chest14 data?",
    "1176499": "Yes yo can",
    "1184189": "moewie94 Do you use the chest14 data?Thanks!",
    "1220157": "moewie94  does these images contain any of catheter tubes positioned ?",
    "1220304": "It was discussed in some other thread. All of the images for this competition come from the chest14 dataset. It is very large. The chest14 dataset was relabeled for this competition. They must have selected for catheter presence and then ran some labeling on it.",
    "1220305": "discussed here https://www.kaggle.com/c/ranzcr-clip-catheter-line-classification/discussion/221808"
  },
  "source": "meta"
}