{
  "id": 64270,
  "title": "Welcome!",
  "url": "/competitions/rsna-pneumonia-detection-challenge/discussion/64270",
  "author_name": "Phil Culliton",
  "post_date": "2018-08-27T16:03:29.885000",
  "votes": 19,
  "comment_count": 62,
  "views": 0,
  "content": "<p>Welcome to RSNA Pneumonia Detection Challenge!</p>\n\n<p>In this competition, we are finding and localizing pneumonia in images of human lungs. You should familiarize yourself with the competition metric - as well as the concept of Intersection over Union if you haven't encountered it - and the file descriptions on the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data\">Data</a> tab.</p>\n\n<p>Also be sure to check out our excellent Getting Started resources at:</p>\n\n<p><a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Getting%20Started\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Getting%20Started</a></p>\n\n<p>We have a kernel for exploratory data analysis, as well as a starter notebook that walks through getting the data loaded and modeled. Both provide insights on the data that competitors won't want to miss.</p>\n\n<p>Note that images can contain <strong>multiple bounding boxes</strong>. Each box is represented by a row in the training data, but (as described in the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">Evaluation</a> page) your submission should have one row per image that includes all of its bounding boxes. Please check the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">Evaluation</a> and <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data\">Data</a> pages for a more detailed description of how this works.</p>\n\n<p>We'll start a separate thread in a few days for domain-specific questions. In the meantime, please feel free to ask your questions in this thread.</p>\n\n<p>Best of luck to you all!</p>",
  "messages": [
    {
      "id": 376495,
      "postDate": "2018-08-27T16:03:29.887Z",
      "content": "<p>Welcome to RSNA Pneumonia Detection Challenge!</p>\n\n<p>In this competition, we are finding and localizing pneumonia in images of human lungs. You should familiarize yourself with the competition metric - as well as the concept of Intersection over Union if you haven't encountered it - and the file descriptions on the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data\">Data</a> tab.</p>\n\n<p>Also be sure to check out our excellent Getting Started resources at:</p>\n\n<p><a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Getting%20Started\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Getting%20Started</a></p>\n\n<p>We have a kernel for exploratory data analysis, as well as a starter notebook that walks through getting the data loaded and modeled. Both provide insights on the data that competitors won't want to miss.</p>\n\n<p>Note that images can contain <strong>multiple bounding boxes</strong>. Each box is represented by a row in the training data, but (as described in the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">Evaluation</a> page) your submission should have one row per image that includes all of its bounding boxes. Please check the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">Evaluation</a> and <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data\">Data</a> pages for a more detailed description of how this works.</p>\n\n<p>We'll start a separate thread in a few days for domain-specific questions. In the meantime, please feel free to ask your questions in this thread.</p>\n\n<p>Best of luck to you all!</p>",
      "rawMarkdown": "Welcome to RSNA Pneumonia Detection Challenge!\n\nIn this competition, we are finding and localizing pneumonia in images of human lungs. You should familiarize yourself with the competition metric - as well as the concept of Intersection over Union if you haven't encountered it - and the file descriptions on the [Data][1] tab.\n\nAlso be sure to check out our excellent Getting Started resources at:\n\nhttps://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Getting%20Started\n\nWe have a kernel for exploratory data analysis, as well as a starter notebook that walks through getting the data loaded and modeled. Both provide insights on the data that competitors won't want to miss.\n\nNote that images can contain **multiple bounding boxes**. Each box is represented by a row in the training data, but (as described in the [Evaluation][2] page) your submission should have one row per image that includes all of its bounding boxes. Please check the [Evaluation][3] and [Data][4] pages for a more detailed description of how this works.\n\nWe'll start a separate thread in a few days for domain-specific questions. In the meantime, please feel free to ask your questions in this thread.\n\nBest of luck to you all!\n\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data\n  [2]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\n  [3]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\n  [4]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data",
      "votes": 19
    },
    {
      "id": 383294,
      "postDate": "2018-09-08T09:38:53.277Z",
      "content": "<p>although the information in the evaluation page is probably enough it would be fantastic if the host or support team will release a github or kernel with official evaluation matrix that we can run against subset of gt. I would guess that in the long run it would save us millions of submissions and millions of questions for the host team.\nA python script that takes gt format csv and predictions csv and calculate score would really really help.</p>",
      "rawMarkdown": "although the information in the evaluation page is probably enough it would be fantastic if the host or support team will release a github or kernel with official evaluation matrix that we can run against subset of gt. I would guess that in the long run it would save us millions of submissions and millions of questions for the host team.\nA python script that takes gt format csv and predictions csv and calculate score would really really help.",
      "votes": 3
    },
    {
      "id": 380154,
      "postDate": "2018-09-01T20:55:47.297Z",
      "content": "<p>The evaluation script is really needed - <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64542\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64542</a></p>",
      "rawMarkdown": "The evaluation script is really needed - https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64542",
      "votes": 3,
      "replies": [
        {
          "id": 381486,
          "postDate": "2018-09-04T17:37:21.993Z",
          "content": "<p>Thanks Ivan.  I have provided a response in the thread.</p>",
          "rawMarkdown": "Thanks Ivan.  I have provided a response in the thread."
        }
      ]
    },
    {
      "id": 378690,
      "postDate": "2018-08-30T13:29:28.320Z",
      "content": "<p>Hi <a href=\"/philculliton\">@philculliton</a>, if an image has no ground-truth bounding box, then no matter what the prediction string is (even leaving as blank), the score for that image is always 0, is that right? </p>",
      "rawMarkdown": "Hi @philculliton, if an image has no ground-truth bounding box, then no matter what the prediction string is (even leaving as blank), the score for that image is always 0, is that right? ",
      "votes": 1,
      "replies": [
        {
          "id": 378701,
          "postDate": "2018-08-30T13:37:59.513Z",
          "content": "<p>If the image has no ground-truth bounding box, and the prediction is empty, the image is not included in the mean.  If any bounding boxes are predicted for the image, the score is 0 and it is included in the mean.</p>",
          "rawMarkdown": "If the image has no ground-truth bounding box, and the prediction is empty, the image is not included in the mean.  If any bounding boxes are predicted for the image, the score is 0 and it is included in the mean.",
          "votes": 5
        }
      ]
    },
    {
      "id": 377439,
      "postDate": "2018-08-29T06:48:19.627Z",
      "content": "<p>In the light of recent leak from \"Airbus Ship Detection Challenge\" and based on the fact that in the description is stipulated that the data source is \"<a href=\"https://nihcc.app.box.com/v/ChestXray-NIHCC/folder/36938765345\">NIHCC</a>\" that contains more labeled images than the current set - Can the organizers confirm that the \"test\" data is not based on \"train\" data in NIHCC?</p>",
      "rawMarkdown": "In the light of recent leak from \"Airbus Ship Detection Challenge\" and based on the fact that in the description is stipulated that the data source is \"[NIHCC][1]\" that contains more labeled images than the current set - Can the organizers confirm that the \"test\" data is not based on \"train\" data in NIHCC?\n\n\n  [1]: https://nihcc.app.box.com/v/ChestXray-NIHCC/folder/36938765345",
      "votes": 1,
      "replies": [
        {
          "id": 377902,
          "postDate": "2018-08-29T23:32:36.647Z",
          "content": "<p>Hi Mihai,</p>\n\n<p>The labels used for this competition - the bounding boxes and pneumonia diagnoses - are definitely not from NIHCC.  The images used here, however, are from NIHCC.</p>",
          "rawMarkdown": "Hi Mihai,\n\nThe labels used for this competition - the bounding boxes and pneumonia diagnoses - are definitely not from NIHCC.  The images used here, however, are from NIHCC.",
          "votes": 1
        },
        {
          "id": 378678,
          "postDate": "2018-08-30T13:21:03.780Z",
          "content": "<p>I've sent you a private message .</p>",
          "rawMarkdown": "I've sent you a private message ."
        },
        {
          "id": 378888,
          "postDate": "2018-08-30T16:33:07.577Z",
          "content": "<p>Hi Mihai,</p>\n\n<p>Thanks very much for your message.  Please see our response in <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64345#378885\">this thread</a> regarding using external annotations like these.</p>",
          "rawMarkdown": "Hi Mihai,\n\nThanks very much for your message.  Please see our response in [this thread][1] regarding using external annotations like these.\n\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64345#378885"
        }
      ]
    },
    {
      "id": 376739,
      "postDate": "2018-08-28T02:08:06.097Z",
      "content": "<p>Hi Phil, I have two questions: \ncould you explain the \"confidence\" number that should be submitted with each bounding box. should it be between 0 and 1?\nAlso, in the rules I see that the \"model\" is required to be submitted by the end of stage 1. Is \"model\" means the source code? Does it matter what programming software we are using?</p>\n\n<p>thanks.</p>",
      "rawMarkdown": "Hi Phil, I have two questions: \ncould you explain the \"confidence\" number that should be submitted with each bounding box. should it be between 0 and 1?\nAlso, in the rules I see that the \"model\" is required to be submitted by the end of stage 1. Is \"model\" means the source code? Does it matter what programming software we are using?\n\nthanks.\n ",
      "votes": 1,
      "replies": [
        {
          "id": 376816,
          "postDate": "2018-08-28T05:31:48.587Z",
          "content": "<p>I am also confused about 'confidence' </p>",
          "rawMarkdown": "I am also confused about 'confidence' "
        },
        {
          "id": 377149,
          "postDate": "2018-08-28T16:40:09.030Z",
          "content": "<p>Hey Rami - </p>\n\n<p>The confidence number should ideally be between 0 and 1.  It can be any value, but 0 and 1 are useful boundaries if you want to generate those values using a model (say, using a probability as a confidence score).</p>\n\n<p>For the \"model\" - it needs to be possible to verify that the model you upload at the end of stage 1 is the same one that was used to generate your stage 2 submission.  So source code and any other supporting documentation you think would be necessary to do that should be submitted.</p>\n\n<p>Some guidelines are provided on the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Timeline\">Timeline</a> page.</p>",
          "rawMarkdown": "Hey Rami - \n\nThe confidence number should ideally be between 0 and 1.  It can be any value, but 0 and 1 are useful boundaries if you want to generate those values using a model (say, using a probability as a confidence score).\n\nFor the \"model\" - it needs to be possible to verify that the model you upload at the end of stage 1 is the same one that was used to generate your stage 2 submission.  So source code and any other supporting documentation you think would be necessary to do that should be submitted.\n\nSome guidelines are provided on the [Timeline][1] page.\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Timeline"
        },
        {
          "id": 377154,
          "postDate": "2018-08-28T16:45:45.663Z",
          "content": "<p>Hey Attaullah -</p>\n\n<p>I'm happy to help - what can I clear up about confidence?</p>",
          "rawMarkdown": "Hey Attaullah -\n\nI'm happy to help - what can I clear up about confidence?"
        },
        {
          "id": 377306,
          "postDate": "2018-08-28T23:44:03.047Z",
          "content": "<p>Thanks Phil. Your previous reply to Rami, cleared my misconception.</p>",
          "rawMarkdown": "Thanks Phil. Your previous reply to Rami, cleared my misconception."
        },
        {
          "id": 377483,
          "postDate": "2018-08-29T08:32:22.067Z",
          "content": "<p>An additional question about role of confidence in <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">evaluation</a>： At some threshold t, it seems that all three cases(TP, FP or FN) of bounding box are evaluated by its IoU and IoU only, how does confidence affect the score?</p>",
          "rawMarkdown": "An additional question about role of confidence in [evaluation][1]： At some threshold t, it seems that all three cases(TP, FP or FN) of bounding box are evaluated by its IoU and IoU only, how does confidence affect the score?\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation"
        },
        {
          "id": 381489,
          "postDate": "2018-09-04T17:38:24.873Z",
          "content": "<p>Thanks Firebomber.  I have updated the Evaluation page with more information, and have provided a general response to questions about <code>confidence</code> in <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64860\">this thread</a>.</p>",
          "rawMarkdown": "Thanks Firebomber.  I have updated the Evaluation page with more information, and have provided a general response to questions about `confidence` in [this thread][1].\n\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64860"
        }
      ]
    },
    {
      "id": 391109,
      "postDate": "2018-09-21T09:21:13.987Z",
      "content": "<p>can you please address <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/66323\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/66323</a> ?</p>",
      "rawMarkdown": "can you please address https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/66323 ?",
      "votes": 2
    },
    {
      "id": 1121534,
      "postDate": "2020-12-21T18:11:35.473Z",
      "content": "<p>What type of preprocessing should I do for those X-ray Images and what is best technique to find the opacity ? <br>\nPlease anyone help me regarding this :)</p>",
      "rawMarkdown": "What type of preprocessing should I do for those X-ray Images and what is best technique to find the opacity ? \nPlease anyone help me regarding this :)"
    },
    {
      "id": 755151,
      "postDate": "2020-02-24T13:48:35.877Z",
      "content": "<p>Great dataset! I'm very interested in this competition!</p>",
      "rawMarkdown": "Great dataset! I'm very interested in this competition!"
    },
    {
      "id": 525984,
      "postDate": "2019-05-02T05:51:15.313Z",
      "content": "<p>How can i download dataset?</p>",
      "rawMarkdown": "How can i download dataset?\n"
    },
    {
      "id": 405712,
      "postDate": "2018-10-18T01:12:30.813Z",
      "content": "<p>our team missed the team merging deadline... we were too busy with developing the model. Is there any way for us to ask for a team merge privately? Hope to get a reply. Thank you</p>",
      "rawMarkdown": "our team missed the team merging deadline... we were too busy with developing the model. Is there any way for us to ask for a team merge privately? Hope to get a reply. Thank you"
    },
    {
      "id": 405342,
      "postDate": "2018-10-17T09:20:37.557Z",
      "content": "<p>I have a question about the evaluation metric. If we predict a box with IoU below the threshold, would the box be counted as a false negative or a false positive? What if we also predicted another box that had better IoU with the same ground truth box? Would it then be counted as best of the 2 or as 1 true positive and 1 false positive?</p>",
      "rawMarkdown": "I have a question about the evaluation metric. If we predict a box with IoU below the threshold, would the box be counted as a false negative or a false positive? What if we also predicted another box that had better IoU with the same ground truth box? Would it then be counted as best of the 2 or as 1 true positive and 1 false positive?",
      "replies": [
        {
          "id": 405651,
          "postDate": "2018-10-17T21:18:24.113Z",
          "content": "<p>Good question!  If you predict a box with IoU below the threshold for all ground truth boxes, the box is counted as a false positive.  If a predicted box has an IoU above the threshold, it's counted as a true positive.  So in the case you're talking about, you'd have 1 false positive and 1 true positive.</p>",
          "rawMarkdown": "Good question!  If you predict a box with IoU below the threshold for all ground truth boxes, the box is counted as a false positive.  If a predicted box has an IoU above the threshold, it's counted as a true positive.  So in the case you're talking about, you'd have 1 false positive and 1 true positive.",
          "votes": 1
        },
        {
          "id": 405895,
          "postDate": "2018-10-18T09:50:34.583Z",
          "content": "<p>Thanks!</p>",
          "rawMarkdown": "Thanks!"
        }
      ]
    },
    {
      "id": 404355,
      "postDate": "2018-10-15T16:10:19.683Z",
      "content": "<p>Great dataset! An awesome competition for those who want to start applying DL for medical data. </p>",
      "rawMarkdown": "Great dataset! An awesome competition for those who want to start applying DL for medical data. "
    },
    {
      "id": 390999,
      "postDate": "2018-09-21T06:10:28.307Z",
      "content": "<p>writing it just to lift my rank....sorry</p>",
      "rawMarkdown": "writing it just to lift my rank....sorry"
    },
    {
      "id": 381648,
      "postDate": "2018-09-04T23:29:09.247Z",
      "content": "<p>Great dataset! I'm looking forward to joining the competition!</p>",
      "rawMarkdown": "Great dataset! I'm looking forward to joining the competition!"
    },
    {
      "id": 380626,
      "postDate": "2018-09-03T05:40:25.600Z",
      "content": "<p>I know, i shouldn't ask this , but is it necessary to download this 3gb of data or any other option is available .</p>",
      "rawMarkdown": "I know, i shouldn't ask this , but is it necessary to download this 3gb of data or any other option is available .",
      "replies": [
        {
          "id": 381650,
          "postDate": "2018-09-04T23:30:45.650Z",
          "content": "<p>It looks as though you can add the dataset within a Kernel without having to download. </p>",
          "rawMarkdown": "It looks as though you can add the dataset within a Kernel without having to download. ",
          "votes": 1
        }
      ]
    },
    {
      "id": 380142,
      "postDate": "2018-09-01T19:53:47.650Z",
      "content": "<p>Could you please clarify on this - <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64644\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64644</a>\n?</p>",
      "rawMarkdown": "Could you please clarify on this - https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64644\n?"
    },
    {
      "id": 379210,
      "postDate": "2018-08-31T02:49:27.480Z",
      "content": "<p>Hi Phil,\nWould you please confirm the number of training images in stage_1_train_images.zip? After unzipping, I'm showing there are 25,685 dcm files while the stage_1_train_labels.csv file has 28,989 patient entries. Thanks for a great contest!</p>",
      "rawMarkdown": "Hi Phil,\nWould you please confirm the number of training images in stage_1_train_images.zip? After unzipping, I'm showing there are 25,685 dcm files while the stage_1_train_labels.csv file has 28,989 patient entries. Thanks for a great contest!",
      "replies": [
        {
          "id": 379644,
          "postDate": "2018-08-31T17:40:15.110Z",
          "content": "<p>Hi David,</p>\n\n<p>Some images have multiple bounding boxes. Each bounding box is a row in the training labels file. There are the same number of unique patientIds in the training set as there are images.</p>",
          "rawMarkdown": "Hi David,\n\nSome images have multiple bounding boxes. Each bounding box is a row in the training labels file. There are the same number of unique patientIds in the training set as there are images."
        }
      ]
    },
    {
      "id": 379051,
      "postDate": "2018-08-30T19:34:48.070Z",
      "content": "<p>I'm wondering about the GCP credits. Under \"Getting Started\" it says \"View the Data page for the URL\" but I see no URL there.  Is this because:</p>\n\n<ol>\n<li>All credits have already been awarded, and the URL has been removed;</li>\n<li>The URL hasn't been added yet; </li>\n<li>It is only visible to people who have already made a submission; or</li>\n<li>I didn't look closely enough?</li>\n</ol>\n\n<p>(Note: I have accepted the rules but have not made a submission. Have not decided whether to do so yet, but the \"get 'em before they run out\" offer would certainly be an issue in that decision.)</p>",
      "rawMarkdown": "I'm wondering about the GCP credits. Under \"Getting Started\" it says \"View the Data page for the URL\" but I see no URL there.  Is this because:\n\n 1. All credits have already been awarded, and the URL has been removed;\n 2. The URL hasn't been added yet; \n 3. It is only visible to people who have already made a submission; or\n 4. I didn't look closely enough?\n\n(Note: I have accepted the rules but have not made a submission. Have not decided whether to do so yet, but the \"get 'em before they run out\" offer would certainly be an issue in that decision.)",
      "replies": [
        {
          "id": 379062,
          "postDate": "2018-08-30T19:52:31.140Z",
          "content": "<p>The GCP credit URL is in a separate file in the competition data, called \"GCP Credits Request Link - RSNA.txt\".</p>",
          "rawMarkdown": "The GCP credit URL is in a separate file in the competition data, called \"GCP Credits Request Link - RSNA.txt\"."
        },
        {
          "id": 379063,
          "postDate": "2018-08-30T19:55:00.007Z",
          "content": "<p>Yes, sorry, just now I was looking at the data and realized that #4 on my list of possibilities was the right one :)</p>",
          "rawMarkdown": "Yes, sorry, just now I was looking at the data and realized that #4 on my list of possibilities was the right one :)"
        },
        {
          "id": 379068,
          "postDate": "2018-08-30T20:03:36.823Z",
          "content": "<p>How would mergers affect the credits? For example, if two teams that have each received credits subsequently merge, are both credits still valid?</p>",
          "rawMarkdown": "How would mergers affect the credits? For example, if two teams that have each received credits subsequently merge, are both credits still valid?"
        },
        {
          "id": 379077,
          "postDate": "2018-08-30T20:24:01.640Z",
          "content": "<p>Yes. Both would still be valid.</p>",
          "rawMarkdown": "Yes. Both would still be valid."
        },
        {
          "id": 379233,
          "postDate": "2018-08-31T03:55:49.647Z",
          "content": "<p>When will the credits be given? I am waiting for the credits to get started on the competition</p>",
          "rawMarkdown": "When will the credits be given? I am waiting for the credits to get started on the competition"
        },
        {
          "id": 382327,
          "postDate": "2018-09-06T06:18:11.600Z",
          "content": "<p>@Phil : When I am opening the GCP credit url provided in the \"GCP Credits Request Link - RSNA.txt\" file, it says \"404 page not found\". Any update on it?</p>",
          "rawMarkdown": "@Phil : When I am opening the GCP credit url provided in the \"GCP Credits Request Link - RSNA.txt\" file, it says \"404 page not found\". Any update on it?"
        },
        {
          "id": 383104,
          "postDate": "2018-09-07T17:18:29.237Z",
          "content": "<p>We have hit the maximum number of coupons to issue, so the form has been disabled. For those who have submitted eligible requests, you should receive your coupons soon.</p>",
          "rawMarkdown": "We have hit the maximum number of coupons to issue, so the form has been disabled. For those who have submitted eligible requests, you should receive your coupons soon.",
          "votes": 1
        }
      ]
    },
    {
      "id": 378682,
      "postDate": "2018-08-30T13:24:35.693Z",
      "content": "<p>Hi Phil. Should I upload (and license OpenSource if I win) my training code, as well as inference code? Or, if my uploaded model and inference code can reproduce the result, do I only have to upload them? Thank you!</p>",
      "rawMarkdown": "Hi Phil. Should I upload (and license OpenSource if I win) my training code, as well as inference code? Or, if my uploaded model and inference code can reproduce the result, do I only have to upload them? Thank you!",
      "replies": [
        {
          "id": 379131,
          "postDate": "2018-08-30T23:19:13.593Z",
          "content": "<p>Hi Yuchiro,</p>\n\n<p>Sure!  There's a great explanation of what we're looking for in the model upload process <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64336#376968\">here</a>.  The important thing is that it needs to be possible to verify that the model you upload at the end of stage 1 is the same one that was used to generate your stage 2 submission. So source code and any other supporting documentation that you think would be necessary to do that should be submitted.</p>",
          "rawMarkdown": "Hi Yuchiro,\n\nSure!  There's a great explanation of what we're looking for in the model upload process [here][1].  The important thing is that it needs to be possible to verify that the model you upload at the end of stage 1 is the same one that was used to generate your stage 2 submission. So source code and any other supporting documentation that you think would be necessary to do that should be submitted.\n\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64336#376968",
          "votes": 1
        }
      ]
    },
    {
      "id": 376714,
      "postDate": "2018-08-28T01:09:38.033Z",
      "content": "<p>Hi, Phill!\nMay I confirm about the label data? (stage_1_train_labels.csv)</p>\n\n<p>I found some duplicated patient ID in labels. \nThat is what you mentioned about the multiple bouncing box, doesn't it? And Does it just mean the label is stored in multiple rows in train_labels, doesn't it?\n(For example, patientId = '7d674c82-5501-4730-92c5-d241fd6911e7' appears 4 times in labels.csv file.)</p>\n\n<p>Thanks.</p>",
      "rawMarkdown": "Hi, Phill!\nMay I confirm about the label data? (stage_1_train_labels.csv)\n\nI found some duplicated patient ID in labels. \nThat is what you mentioned about the multiple bouncing box, doesn't it? And Does it just mean the label is stored in multiple rows in train_labels, doesn't it?\n(For example, patientId = '7d674c82-5501-4730-92c5-d241fd6911e7' appears 4 times in labels.csv file.)\n\nThanks.",
      "replies": [
        {
          "id": 376719,
          "postDate": "2018-08-28T01:19:53.200Z",
          "content": "<p>That's correct!  The patient ID has multiple bounding boxes, provided over multiple rows.</p>",
          "rawMarkdown": "That's correct!  The patient ID has multiple bounding boxes, provided over multiple rows.",
          "votes": 2
        },
        {
          "id": 376728,
          "postDate": "2018-08-28T01:42:51.217Z",
          "content": "<p>Thanks! Now I'm clear that the label data and submission file format is different.</p>",
          "rawMarkdown": "Thanks! Now I'm clear that the label data and submission file format is different.",
          "votes": 1
        },
        {
          "id": 385696,
          "postDate": "2018-09-11T13:14:11.210Z",
          "content": "<p>Hey masato and phil. I want your help in understanding the bounding boxes representation. We know that more than 1 row in training label file represents more than one bounding boxes. So how the dimensions of each bounding box will be interpreted. I mean that only one coordinate of X &amp; Y is given and I am not able to understand that whether it is top left, right or bottom left, right coordinate. I hope my question is clear and making sense to you guys. Please solve my dilemma. Thanks in advance. </p>",
          "rawMarkdown": "Hey masato and phil. I want your help in understanding the bounding boxes representation. We know that more than 1 row in training label file represents more than one bounding boxes. So how the dimensions of each bounding box will be interpreted. I mean that only one coordinate of X &amp; Y is given and I am not able to understand that whether it is top left, right or bottom left, right coordinate. I hope my question is clear and making sense to you guys. Please solve my dilemma. Thanks in advance. "
        }
      ]
    },
    {
      "id": 376611,
      "postDate": "2018-08-27T19:41:31.207Z",
      "content": "<p>Thanks Phil. I am unable to download the data. I get a network error if I try downloading it directly. Or a \"TqdmKeyError(\"Unknown argument(s): \" + str(kwargs)))\" error if I use the kaggle api. Is there a problem at your end or am I downloading it incorrectly.</p>",
      "rawMarkdown": "Thanks Phil. I am unable to download the data. I get a network error if I try downloading it directly. Or a \"TqdmKeyError(\"Unknown argument(s): \" + str(kwargs)))\" error if I use the kaggle api. Is there a problem at your end or am I downloading it incorrectly.",
      "replies": [
        {
          "id": 376616,
          "postDate": "2018-08-27T19:50:39.067Z",
          "content": "<p>Thanks.  We'll check it out.</p>",
          "rawMarkdown": "Thanks.  We'll check it out."
        },
        {
          "id": 376618,
          "postDate": "2018-08-27T19:55:11Z",
          "content": "<p>Which version of the API are you using?</p>",
          "rawMarkdown": "Which version of the API are you using?"
        },
        {
          "id": 376619,
          "postDate": "2018-08-27T19:58:38.763Z",
          "content": "<p>Sorry for the trouble. Was able to download it on the 4th try.</p>",
          "rawMarkdown": "Sorry for the trouble. Was able to download it on the 4th try."
        },
        {
          "id": 376626,
          "postDate": "2018-08-27T20:46:44.743Z",
          "content": "<p>I'm glad you resolved the problem.</p>",
          "rawMarkdown": "I'm glad you resolved the problem."
        }
      ]
    },
    {
      "id": 376568,
      "postDate": "2018-08-27T18:30:12.730Z",
      "content": "<p>Thanks Phil.  The link to the starter kernel is bad - 404 error.</p>",
      "rawMarkdown": "Thanks Phil.  The link to the starter kernel is bad - 404 error.",
      "replies": [
        {
          "id": 376576,
          "postDate": "2018-08-27T18:39:52.643Z",
          "content": "<p>Thanks Dan!  Should be available now.</p>",
          "rawMarkdown": "Thanks Dan!  Should be available now."
        },
        {
          "id": 379137,
          "postDate": "2018-08-30T23:38:06.780Z",
          "content": "<p>What is the link to the starter code?</p>",
          "rawMarkdown": "What is the link to the starter code?"
        },
        {
          "id": 381491,
          "postDate": "2018-09-04T17:39:55.960Z",
          "content": "<p>The page containing the starter code is <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">here</a>.  It is also linked in the original post at the top of this thread.</p>",
          "rawMarkdown": "The page containing the starter code is [here][1].  It is also linked in the original post at the top of this thread.\n\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation"
        },
        {
          "id": 381585,
          "postDate": "2018-09-04T20:11:25.833Z",
          "content": "<p>Thanks.</p>",
          "rawMarkdown": "Thanks."
        }
      ]
    },
    {
      "id": 399807,
      "postDate": "2018-10-06T20:13:24.633Z",
      "rawMarkdown": "",
      "isDeleted": true
    },
    {
      "id": 379208,
      "postDate": "2018-08-31T02:45:07.080Z",
      "rawMarkdown": "",
      "isDeleted": true,
      "replies": [
        {
          "id": 379211,
          "postDate": "2018-08-31T02:50:33.140Z",
          "content": "<p>Some images have multiple bounding boxes.  Each bounding box is a row.  There are the same number of unique patientIds in the training set as there are images.</p>",
          "rawMarkdown": "Some images have multiple bounding boxes.  Each bounding box is a row.  There are the same number of unique patientIds in the training set as there are images.",
          "votes": 1
        }
      ]
    },
    {
      "id": 377069,
      "postDate": "2018-08-28T14:45:03.960Z",
      "rawMarkdown": "",
      "isDeleted": true
    },
    {
      "id": 377174,
      "postDate": "2018-08-28T17:23:01.297Z",
      "content": "<p>Thank you Phil.</p>",
      "rawMarkdown": "Thank you Phil."
    },
    {
      "id": 376823,
      "postDate": "2018-08-28T05:49:54.280Z",
      "content": "<p>Thanks Phil.</p>",
      "rawMarkdown": "Thanks Phil."
    }
  ],
  "comments": [
    {
      "id": 383294,
      "author_name": "Moshel",
      "author_url": "",
      "post_date": "2018-09-08T09:38:53.277000",
      "content": "<p>although the information in the evaluation page is probably enough it would be fantastic if the host or support team will release a github or kernel with official evaluation matrix that we can run against subset of gt. I would guess that in the long run it would save us millions of submissions and millions of questions for the host team.\nA python script that takes gt format csv and predictions csv and calculate score would really really help.</p>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 380154,
      "author_name": "Ivan Pozdnyakov",
      "author_url": "",
      "post_date": "2018-09-01T20:55:47.297000",
      "content": "<p>The evaluation script is really needed - <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64542\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64542</a></p>",
      "votes": 3,
      "replies": [
        {
          "id": 381486,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-09-04T17:37:21.993000",
          "content": "<p>Thanks Ivan.  I have provided a response in the thread.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 378690,
      "author_name": "Kha Vo",
      "author_url": "",
      "post_date": "2018-08-30T13:29:28.320000",
      "content": "<p>Hi <a href=\"/philculliton\">@philculliton</a>, if an image has no ground-truth bounding box, then no matter what the prediction string is (even leaving as blank), the score for that image is always 0, is that right? </p>",
      "votes": 1,
      "replies": [
        {
          "id": 378701,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-30T13:37:59.513000",
          "content": "<p>If the image has no ground-truth bounding box, and the prediction is empty, the image is not included in the mean.  If any bounding boxes are predicted for the image, the score is 0 and it is included in the mean.</p>",
          "votes": 5,
          "replies": []
        }
      ]
    },
    {
      "id": 377439,
      "author_name": "Mihai Cvasnievschi",
      "author_url": "",
      "post_date": "2018-08-29T06:48:19.627000",
      "content": "<p>In the light of recent leak from \"Airbus Ship Detection Challenge\" and based on the fact that in the description is stipulated that the data source is \"<a href=\"https://nihcc.app.box.com/v/ChestXray-NIHCC/folder/36938765345\">NIHCC</a>\" that contains more labeled images than the current set - Can the organizers confirm that the \"test\" data is not based on \"train\" data in NIHCC?</p>",
      "votes": 1,
      "replies": [
        {
          "id": 377902,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-29T23:32:36.647000",
          "content": "<p>Hi Mihai,</p>\n\n<p>The labels used for this competition - the bounding boxes and pneumonia diagnoses - are definitely not from NIHCC.  The images used here, however, are from NIHCC.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 378678,
          "author_name": "Mihai Cvasnievschi",
          "author_url": "",
          "post_date": "2018-08-30T13:21:03.780000",
          "content": "<p>I've sent you a private message .</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 378888,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-30T16:33:07.577000",
          "content": "<p>Hi Mihai,</p>\n\n<p>Thanks very much for your message.  Please see our response in <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64345#378885\">this thread</a> regarding using external annotations like these.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 376739,
      "author_name": "Rami",
      "author_url": "",
      "post_date": "2018-08-28T02:08:06.097000",
      "content": "<p>Hi Phil, I have two questions: \ncould you explain the \"confidence\" number that should be submitted with each bounding box. should it be between 0 and 1?\nAlso, in the rules I see that the \"model\" is required to be submitted by the end of stage 1. Is \"model\" means the source code? Does it matter what programming software we are using?</p>\n\n<p>thanks.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 376816,
          "author_name": "Attaullah Sahito",
          "author_url": "",
          "post_date": "2018-08-28T05:31:48.587000",
          "content": "<p>I am also confused about 'confidence' </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 377149,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-28T16:40:09.030000",
          "content": "<p>Hey Rami - </p>\n\n<p>The confidence number should ideally be between 0 and 1.  It can be any value, but 0 and 1 are useful boundaries if you want to generate those values using a model (say, using a probability as a confidence score).</p>\n\n<p>For the \"model\" - it needs to be possible to verify that the model you upload at the end of stage 1 is the same one that was used to generate your stage 2 submission.  So source code and any other supporting documentation you think would be necessary to do that should be submitted.</p>\n\n<p>Some guidelines are provided on the <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Timeline\">Timeline</a> page.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 377154,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-28T16:45:45.663000",
          "content": "<p>Hey Attaullah -</p>\n\n<p>I'm happy to help - what can I clear up about confidence?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 377306,
          "author_name": "Attaullah Sahito",
          "author_url": "",
          "post_date": "2018-08-28T23:44:03.047000",
          "content": "<p>Thanks Phil. Your previous reply to Rami, cleared my misconception.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 377483,
          "author_name": "Firebomber",
          "author_url": "",
          "post_date": "2018-08-29T08:32:22.067000",
          "content": "<p>An additional question about role of confidence in <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">evaluation</a>： At some threshold t, it seems that all three cases(TP, FP or FN) of bounding box are evaluated by its IoU and IoU only, how does confidence affect the score?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 381489,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-09-04T17:38:24.873000",
          "content": "<p>Thanks Firebomber.  I have updated the Evaluation page with more information, and have provided a general response to questions about <code>confidence</code> in <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64860\">this thread</a>.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 391109,
      "author_name": "Moshel",
      "author_url": "",
      "post_date": "2018-09-21T09:21:13.987000",
      "content": "<p>can you please address <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/66323\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/66323</a> ?</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 1121534,
      "author_name": "Rohit Wagh",
      "author_url": "",
      "post_date": "2020-12-21T18:11:35.473000",
      "content": "<p>What type of preprocessing should I do for those X-ray Images and what is best technique to find the opacity ? <br>\nPlease anyone help me regarding this :)</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 755151,
      "author_name": "",
      "author_url": "",
      "post_date": "2020-02-24T13:48:35.877000",
      "content": "<p>Great dataset! I'm very interested in this competition!</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 525984,
      "author_name": "Dr. Syed Adnan",
      "author_url": "",
      "post_date": "2019-05-02T05:51:15.313000",
      "content": "<p>How can i download dataset?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 405712,
      "author_name": "chadrick kwag",
      "author_url": "",
      "post_date": "2018-10-18T01:12:30.813000",
      "content": "<p>our team missed the team merging deadline... we were too busy with developing the model. Is there any way for us to ask for a team merge privately? Hope to get a reply. Thank you</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 405342,
      "author_name": "Adithya Seshasayee",
      "author_url": "",
      "post_date": "2018-10-17T09:20:37.557000",
      "content": "<p>I have a question about the evaluation metric. If we predict a box with IoU below the threshold, would the box be counted as a false negative or a false positive? What if we also predicted another box that had better IoU with the same ground truth box? Would it then be counted as best of the 2 or as 1 true positive and 1 false positive?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 405651,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-10-17T21:18:24.113000",
          "content": "<p>Good question!  If you predict a box with IoU below the threshold for all ground truth boxes, the box is counted as a false positive.  If a predicted box has an IoU above the threshold, it's counted as a true positive.  So in the case you're talking about, you'd have 1 false positive and 1 true positive.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 405895,
          "author_name": "Adithya Seshasayee",
          "author_url": "",
          "post_date": "2018-10-18T09:50:34.583000",
          "content": "<p>Thanks!</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 404355,
      "author_name": "Angelo Menezes",
      "author_url": "",
      "post_date": "2018-10-15T16:10:19.683000",
      "content": "<p>Great dataset! An awesome competition for those who want to start applying DL for medical data. </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 390999,
      "author_name": "Andrew",
      "author_url": "",
      "post_date": "2018-09-21T06:10:28.307000",
      "content": "<p>writing it just to lift my rank....sorry</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 381648,
      "author_name": "Aaron Gudmundson",
      "author_url": "",
      "post_date": "2018-09-04T23:29:09.247000",
      "content": "<p>Great dataset! I'm looking forward to joining the competition!</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 380626,
      "author_name": "Neel kamal",
      "author_url": "",
      "post_date": "2018-09-03T05:40:25.600000",
      "content": "<p>I know, i shouldn't ask this , but is it necessary to download this 3gb of data or any other option is available .</p>",
      "votes": 0,
      "replies": [
        {
          "id": 381650,
          "author_name": "Aaron Gudmundson",
          "author_url": "",
          "post_date": "2018-09-04T23:30:45.650000",
          "content": "<p>It looks as though you can add the dataset within a Kernel without having to download. </p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 380142,
      "author_name": "Ivan Pozdnyakov",
      "author_url": "",
      "post_date": "2018-09-01T19:53:47.650000",
      "content": "<p>Could you please clarify on this - <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64644\">https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64644</a>\n?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 379210,
      "author_name": "David Martinez",
      "author_url": "",
      "post_date": "2018-08-31T02:49:27.480000",
      "content": "<p>Hi Phil,\nWould you please confirm the number of training images in stage_1_train_images.zip? After unzipping, I'm showing there are 25,685 dcm files while the stage_1_train_labels.csv file has 28,989 patient entries. Thanks for a great contest!</p>",
      "votes": 0,
      "replies": [
        {
          "id": 379644,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-31T17:40:15.110000",
          "content": "<p>Hi David,</p>\n\n<p>Some images have multiple bounding boxes. Each bounding box is a row in the training labels file. There are the same number of unique patientIds in the training set as there are images.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 379051,
      "author_name": "Andy Harless",
      "author_url": "",
      "post_date": "2018-08-30T19:34:48.070000",
      "content": "<p>I'm wondering about the GCP credits. Under \"Getting Started\" it says \"View the Data page for the URL\" but I see no URL there.  Is this because:</p>\n\n<ol>\n<li>All credits have already been awarded, and the URL has been removed;</li>\n<li>The URL hasn't been added yet; </li>\n<li>It is only visible to people who have already made a submission; or</li>\n<li>I didn't look closely enough?</li>\n</ol>\n\n<p>(Note: I have accepted the rules but have not made a submission. Have not decided whether to do so yet, but the \"get 'em before they run out\" offer would certainly be an issue in that decision.)</p>",
      "votes": 0,
      "replies": [
        {
          "id": 379062,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-30T19:52:31.140000",
          "content": "<p>The GCP credit URL is in a separate file in the competition data, called \"GCP Credits Request Link - RSNA.txt\".</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 379063,
          "author_name": "Andy Harless",
          "author_url": "",
          "post_date": "2018-08-30T19:55:00.007000",
          "content": "<p>Yes, sorry, just now I was looking at the data and realized that #4 on my list of possibilities was the right one :)</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 379068,
          "author_name": "Andy Harless",
          "author_url": "",
          "post_date": "2018-08-30T20:03:36.823000",
          "content": "<p>How would mergers affect the credits? For example, if two teams that have each received credits subsequently merge, are both credits still valid?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 379077,
          "author_name": "Julia Elliott",
          "author_url": "",
          "post_date": "2018-08-30T20:24:01.640000",
          "content": "<p>Yes. Both would still be valid.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 379233,
          "author_name": "Jithu R Jacob",
          "author_url": "",
          "post_date": "2018-08-31T03:55:49.647000",
          "content": "<p>When will the credits be given? I am waiting for the credits to get started on the competition</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 382327,
          "author_name": "Pankaj Kumar Sharma",
          "author_url": "",
          "post_date": "2018-09-06T06:18:11.600000",
          "content": "<p>@Phil : When I am opening the GCP credit url provided in the \"GCP Credits Request Link - RSNA.txt\" file, it says \"404 page not found\". Any update on it?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 383104,
          "author_name": "Julia Elliott",
          "author_url": "",
          "post_date": "2018-09-07T17:18:29.237000",
          "content": "<p>We have hit the maximum number of coupons to issue, so the form has been disabled. For those who have submitted eligible requests, you should receive your coupons soon.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 378682,
      "author_name": "Yuichiro Hirano",
      "author_url": "",
      "post_date": "2018-08-30T13:24:35.693000",
      "content": "<p>Hi Phil. Should I upload (and license OpenSource if I win) my training code, as well as inference code? Or, if my uploaded model and inference code can reproduce the result, do I only have to upload them? Thank you!</p>",
      "votes": 0,
      "replies": [
        {
          "id": 379131,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-30T23:19:13.593000",
          "content": "<p>Hi Yuchiro,</p>\n\n<p>Sure!  There's a great explanation of what we're looking for in the model upload process <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64336#376968\">here</a>.  The important thing is that it needs to be possible to verify that the model you upload at the end of stage 1 is the same one that was used to generate your stage 2 submission. So source code and any other supporting documentation that you think would be necessary to do that should be submitted.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 376714,
      "author_name": "Masato",
      "author_url": "",
      "post_date": "2018-08-28T01:09:38.033000",
      "content": "<p>Hi, Phill!\nMay I confirm about the label data? (stage_1_train_labels.csv)</p>\n\n<p>I found some duplicated patient ID in labels. \nThat is what you mentioned about the multiple bouncing box, doesn't it? And Does it just mean the label is stored in multiple rows in train_labels, doesn't it?\n(For example, patientId = '7d674c82-5501-4730-92c5-d241fd6911e7' appears 4 times in labels.csv file.)</p>\n\n<p>Thanks.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 376719,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-28T01:19:53.200000",
          "content": "<p>That's correct!  The patient ID has multiple bounding boxes, provided over multiple rows.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 376728,
          "author_name": "Masato",
          "author_url": "",
          "post_date": "2018-08-28T01:42:51.217000",
          "content": "<p>Thanks! Now I'm clear that the label data and submission file format is different.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 385696,
          "author_name": "Divyang Deep Tiwari",
          "author_url": "",
          "post_date": "2018-09-11T13:14:11.210000",
          "content": "<p>Hey masato and phil. I want your help in understanding the bounding boxes representation. We know that more than 1 row in training label file represents more than one bounding boxes. So how the dimensions of each bounding box will be interpreted. I mean that only one coordinate of X &amp; Y is given and I am not able to understand that whether it is top left, right or bottom left, right coordinate. I hope my question is clear and making sense to you guys. Please solve my dilemma. Thanks in advance. </p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 376611,
      "author_name": "Kobe Python",
      "author_url": "",
      "post_date": "2018-08-27T19:41:31.207000",
      "content": "<p>Thanks Phil. I am unable to download the data. I get a network error if I try downloading it directly. Or a \"TqdmKeyError(\"Unknown argument(s): \" + str(kwargs)))\" error if I use the kaggle api. Is there a problem at your end or am I downloading it incorrectly.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 376616,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-27T19:50:39.067000",
          "content": "<p>Thanks.  We'll check it out.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 376618,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-27T19:55:11",
          "content": "<p>Which version of the API are you using?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 376619,
          "author_name": "Kobe Python",
          "author_url": "",
          "post_date": "2018-08-27T19:58:38.763000",
          "content": "<p>Sorry for the trouble. Was able to download it on the 4th try.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 376626,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-27T20:46:44.743000",
          "content": "<p>I'm glad you resolved the problem.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 376568,
      "author_name": "Dan Chernoff",
      "author_url": "",
      "post_date": "2018-08-27T18:30:12.730000",
      "content": "<p>Thanks Phil.  The link to the starter kernel is bad - 404 error.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 376576,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-27T18:39:52.643000",
          "content": "<p>Thanks Dan!  Should be available now.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 379137,
          "author_name": "YaGana Sheriff-Hussaini",
          "author_url": "",
          "post_date": "2018-08-30T23:38:06.780000",
          "content": "<p>What is the link to the starter code?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 381491,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-09-04T17:39:55.960000",
          "content": "<p>The page containing the starter code is <a href=\"https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\">here</a>.  It is also linked in the original post at the top of this thread.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 381585,
          "author_name": "YaGana Sheriff-Hussaini",
          "author_url": "",
          "post_date": "2018-09-04T20:11:25.833000",
          "content": "<p>Thanks.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 399807,
      "author_name": "",
      "author_url": "",
      "post_date": "2018-10-06T20:13:24.633000",
      "content": "",
      "votes": 0,
      "replies": []
    },
    {
      "id": 379208,
      "author_name": "",
      "author_url": "",
      "post_date": "2018-08-31T02:45:07.080000",
      "content": "",
      "votes": 0,
      "replies": [
        {
          "id": 379211,
          "author_name": "Phil Culliton",
          "author_url": "",
          "post_date": "2018-08-31T02:50:33.140000",
          "content": "<p>Some images have multiple bounding boxes.  Each bounding box is a row.  There are the same number of unique patientIds in the training set as there are images.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 377069,
      "author_name": "",
      "author_url": "",
      "post_date": "2018-08-28T14:45:03.960000",
      "content": "",
      "votes": 0,
      "replies": []
    },
    {
      "id": 377174,
      "author_name": "VijayaKakumani",
      "author_url": "",
      "post_date": "2018-08-28T17:23:01.297000",
      "content": "<p>Thank you Phil.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 376823,
      "author_name": "Harini Perera",
      "author_url": "",
      "post_date": "2018-08-28T05:49:54.280000",
      "content": "<p>Thanks Phil.</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "376495": "Welcome to RSNA Pneumonia Detection Challenge!\n\nIn this competition, we are finding and localizing pneumonia in images of human lungs. You should familiarize yourself with the competition metric - as well as the concept of Intersection over Union if you haven't encountered it - and the file descriptions on the [Data][1] tab.\n\nAlso be sure to check out our excellent Getting Started resources at:\n\nhttps://www.kaggle.com/c/rsna-pneumonia-detection-challenge#Getting%20Started\n\nWe have a kernel for exploratory data analysis, as well as a starter notebook that walks through getting the data loaded and modeled. Both provide insights on the data that competitors won't want to miss.\n\nNote that images can contain **multiple bounding boxes**. Each box is represented by a row in the training data, but (as described in the [Evaluation][2] page) your submission should have one row per image that includes all of its bounding boxes. Please check the [Evaluation][3] and [Data][4] pages for a more detailed description of how this works.\n\nWe'll start a separate thread in a few days for domain-specific questions. In the meantime, please feel free to ask your questions in this thread.\n\nBest of luck to you all!\n\n\n  [1]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data\n  [2]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\n  [3]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge#evaluation\n  [4]: https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data",
    "383294": "although the information in the evaluation page is probably enough it would be fantastic if the host or support team will release a github or kernel with official evaluation matrix that we can run against subset of gt. I would guess that in the long run it would save us millions of submissions and millions of questions for the host team.\nA python script that takes gt format csv and predictions csv and calculate score would really really help.",
    "380154": "The evaluation script is really needed - https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64542",
    "378690": "Hi @philculliton, if an image has no ground-truth bounding box, then no matter what the prediction string is (even leaving as blank), the score for that image is always 0, is that right? ",
    "377439": "In the light of recent leak from \"Airbus Ship Detection Challenge\" and based on the fact that in the description is stipulated that the data source is \"[NIHCC][1]\" that contains more labeled images than the current set - Can the organizers confirm that the \"test\" data is not based on \"train\" data in NIHCC?\n\n\n  [1]: https://nihcc.app.box.com/v/ChestXray-NIHCC/folder/36938765345",
    "376739": "Hi Phil, I have two questions: \ncould you explain the \"confidence\" number that should be submitted with each bounding box. should it be between 0 and 1?\nAlso, in the rules I see that the \"model\" is required to be submitted by the end of stage 1. Is \"model\" means the source code? Does it matter what programming software we are using?\n\nthanks.\n ",
    "391109": "can you please address https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/66323 ?",
    "1121534": "What type of preprocessing should I do for those X-ray Images and what is best technique to find the opacity ? \nPlease anyone help me regarding this :)",
    "755151": "Great dataset! I'm very interested in this competition!",
    "525984": "How can i download dataset?\n",
    "405712": "our team missed the team merging deadline... we were too busy with developing the model. Is there any way for us to ask for a team merge privately? Hope to get a reply. Thank you",
    "405342": "I have a question about the evaluation metric. If we predict a box with IoU below the threshold, would the box be counted as a false negative or a false positive? What if we also predicted another box that had better IoU with the same ground truth box? Would it then be counted as best of the 2 or as 1 true positive and 1 false positive?",
    "404355": "Great dataset! An awesome competition for those who want to start applying DL for medical data. ",
    "390999": "writing it just to lift my rank....sorry",
    "381648": "Great dataset! I'm looking forward to joining the competition!",
    "380626": "I know, i shouldn't ask this , but is it necessary to download this 3gb of data or any other option is available .",
    "380142": "Could you please clarify on this - https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/discussion/64644\n?",
    "379210": "Hi Phil,\nWould you please confirm the number of training images in stage_1_train_images.zip? After unzipping, I'm showing there are 25,685 dcm files while the stage_1_train_labels.csv file has 28,989 patient entries. Thanks for a great contest!",
    "379051": "I'm wondering about the GCP credits. Under \"Getting Started\" it says \"View the Data page for the URL\" but I see no URL there.  Is this because:\n\n 1. All credits have already been awarded, and the URL has been removed;\n 2. The URL hasn't been added yet; \n 3. It is only visible to people who have already made a submission; or\n 4. I didn't look closely enough?\n\n(Note: I have accepted the rules but have not made a submission. Have not decided whether to do so yet, but the \"get 'em before they run out\" offer would certainly be an issue in that decision.)",
    "378682": "Hi Phil. Should I upload (and license OpenSource if I win) my training code, as well as inference code? Or, if my uploaded model and inference code can reproduce the result, do I only have to upload them? Thank you!",
    "376714": "Hi, Phill!\nMay I confirm about the label data? (stage_1_train_labels.csv)\n\nI found some duplicated patient ID in labels. \nThat is what you mentioned about the multiple bouncing box, doesn't it? And Does it just mean the label is stored in multiple rows in train_labels, doesn't it?\n(For example, patientId = '7d674c82-5501-4730-92c5-d241fd6911e7' appears 4 times in labels.csv file.)\n\nThanks.",
    "376611": "Thanks Phil. I am unable to download the data. I get a network error if I try downloading it directly. Or a \"TqdmKeyError(\"Unknown argument(s): \" + str(kwargs)))\" error if I use the kaggle api. Is there a problem at your end or am I downloading it incorrectly.",
    "376568": "Thanks Phil.  The link to the starter kernel is bad - 404 error.",
    "399807": "",
    "379208": "",
    "377069": "",
    "377174": "Thank you Phil.",
    "376823": "Thanks Phil."
  }
}