{
  "id": 178590,
  "title": "Question about the data",
  "url": "/competitions/osic-pulmonary-fibrosis-progression/discussion/178590",
  "author_name": "",
  "post_date": "2020-08-30T15:44:33.846908Z",
  "votes": 1,
  "comment_count": 12,
  "views": 0,
  "content": "<p>Train file consists of these rows for some particular patient:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1659719%2Fb3cde63c43d619e8a4e2e33a66aaf9c5%2FTopic.png?generation=1598802081003605&amp;alt=media\" alt=\"\"></p>\n<p>But there are only 30 files inside train directory for this patient. Does it mean that I have to ignore rows with week equals -4, 41 and 57?</p>",
  "messages": [
    {
      "id": "991693",
      "postDate": "08/30/2020 15:44:33",
      "content": "<p>Train file consists of these rows for some particular patient:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1659719%2Fb3cde63c43d619e8a4e2e33a66aaf9c5%2FTopic.png?generation=1598802081003605&amp;alt=media\" alt=\"\"></p>\n<p>But there are only 30 files inside train directory for this patient. Does it mean that I have to ignore rows with week equals -4, 41 and 57?</p>",
      "rawMarkdown": "Train file consists of these rows for some particular patient:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1659719%2Fb3cde63c43d619e8a4e2e33a66aaf9c5%2FTopic.png?generation=1598802081003605&alt=media)\n\nBut there are only 30 files inside train directory for this patient. Does it mean that I have to ignore rows with week equals -4, 41 and 57?",
      "votes": null
    },
    {
      "id": "991736",
      "postDate": "08/30/2020 16:21:09",
      "content": "<p>The dcm files for each patient do not correspond to the number of weeks on the CSV file. Each folder is a single CT scan with multiple slices. Therefore, each patient has only 1 CT scan taken at week 0.</p>",
      "rawMarkdown": "The dcm files for each patient do not correspond to the number of weeks on the CSV file. Each folder is a single CT scan with multiple slices. Therefore, each patient has only 1 CT scan taken at week 0.",
      "votes": null
    },
    {
      "id": "991754",
      "postDate": "08/30/2020 16:34:31",
      "content": "<p>I've understood, thank you! </p>",
      "rawMarkdown": "I've understood, thank you!",
      "votes": null
    },
    {
      "id": "991780",
      "postDate": "08/30/2020 16:57:42",
      "content": "<p>Hi! <a href=\"https://www.kaggle.com/koza4ukdmitrij\" target=\"_blank\">@koza4ukdmitrij</a>, there is only one CT per patient, below extract from competition notes \"In the dataset, you are provided with a baseline chest CT scan and associated clinical information for a set of patients. A patient has an image acquired at time Week = 0 and has numerous follow up visits over the course of approximately 1-2 years, at which time their FVC is measured.\"</p>",
      "rawMarkdown": "Hi! @koza4ukdmitrij, there is only one CT per patient, below extract from competition notes \"In the dataset, you are provided with a baseline chest CT scan and associated clinical information for a set of patients. A patient has an image acquired at time Week = 0 and has numerous follow up visits over the course of approximately 1-2 years, at which time their FVC is measured.\"",
      "votes": null
    },
    {
      "id": "991828",
      "postDate": "08/30/2020 17:24:09",
      "content": "<p>I was confused with this formulation: there is no information about CT scan's slices, looks like other scaning prosudures can be done during next visits too. So presumably CT scans were made for each visit but that data just unavailable by the host of the competition. By the way, thank you for response) </p>",
      "rawMarkdown": "I was confused with this formulation: there is no information about CT scan's slices, looks like other scaning prosudures can be done during next visits too. So presumably CT scans were made for each visit but that data just unavailable by the host of the competition. By the way, thank you for response)",
      "votes": null
    },
    {
      "id": "991874",
      "postDate": "08/30/2020 17:56:41",
      "content": "<p>CT Scans are expensive (In general, you can expect to see CT scan costs that range from $270 on the very low end to nearly $5,000 on the high end. The cost varies depends on the facility) and time-consuming, so I think they want to do their best with only one and some less resource-intensive sampling (FVC) to measure or predict the patient's condition.</p>",
      "rawMarkdown": "CT Scans are expensive (In general, you can expect to see CT scan costs that range from $270 on the very low end to nearly $5,000 on the high end. The cost varies depends on the facility) and time-consuming, so I think they want to do their best with only one and some less resource-intensive sampling (FVC) to measure or predict the patient's condition.",
      "votes": null
    },
    {
      "id": "991878",
      "postDate": "08/30/2020 17:57:19",
      "content": "<p>It is unlikely that patients had a CT scan each visit. We tend to use CT scans sparingly, due both to cost and radiation exposure. And if the patient's clinical condition hasn't changed much, we don't need to waste resources on another CT scan. However, it is surely possible that some patients had more than one CT scan during their overall treatment.</p>\n<p>In either case, we are only provided with a single CT scan per patient.</p>",
      "rawMarkdown": "It is unlikely that patients had a CT scan each visit. We tend to use CT scans sparingly, due both to cost and radiation exposure. And if the patient's clinical condition hasn't changed much, we don't need to waste resources on another CT scan. However, it is surely possible that some patients had more than one CT scan during their overall treatment.\n\nIn either case, we are only provided with a single CT scan per patient.",
      "votes": null
    },
    {
      "id": "991894",
      "postDate": "08/30/2020 18:06:55",
      "content": "<p>Oh, thanks! So, is that possible to measure FVC without CT scans? </p>",
      "rawMarkdown": "Oh, thanks! So, is that possible to measure FVC without CT scans?",
      "votes": null
    },
    {
      "id": "991906",
      "postDate": "08/30/2020 18:18:25",
      "content": "<p>Ok, so my understanding now is the next one: expensive CT scans were taken in the begining of the treatment only, than only FVC were mesured (without CT scans) each in several weeks (particular, for saving up money) . Do you have the same standpoint? (if you are, task statement has become more clear for me and level of motivation has incresed:)) </p>",
      "rawMarkdown": "Ok, so my understanding now is the next one: expensive CT scans were taken in the begining of the treatment only, than only FVC were mesured (without CT scans) each in several weeks (particular, for saving up money) . Do you have the same standpoint? (if you are, task statement has become more clear for me and level of motivation has incresed:))",
      "votes": null
    },
    {
      "id": "991943",
      "postDate": "08/30/2020 18:46:32",
      "content": "<p>Yes, It makes sense to me; basically, you build a solid baseline and rely on an ML solution to predict patient performance so that you can save resources, if the prediction has High Confidence and Show Deterioration of the patient probably a CT will be recommended allocating resources properly :) I think this competition has enormous potential to improve diagnosing of decline in lung function :)</p>",
      "rawMarkdown": "Yes, It makes sense to me; basically, you build a solid baseline and rely on an ML solution to predict patient performance so that you can save resources, if the prediction has High Confidence and Show Deterioration of the patient probably a CT will be recommended allocating resources properly :) I think this competition has enormous potential to improve diagnosing of decline in lung function :)",
      "votes": null
    },
    {
      "id": "991967",
      "postDate": "08/30/2020 19:04:03",
      "content": "<p>Yeah, agree. That's why it becomes more motivated. At first glance it looks like host just hide the most part of CT scans for some reason. And the wrong understanding that FVC relys on CT scans vanishes either idea to use CT scans at all and correspondingly a motivation. </p>",
      "rawMarkdown": "Yeah, agree. That's why it becomes more motivated. At first glance it looks like host just hide the most part of CT scans for some reason. And the wrong understanding that FVC relys on CT scans vanishes either idea to use CT scans at all and correspondingly a motivation.",
      "votes": null
    },
    {
      "id": "992088",
      "postDate": "08/30/2020 22:46:14",
      "content": "<p>Yes, \"Forced vital capacity (FVC) is the amount of air that can be forcibly exhaled from your lungs after taking the deepest breath possible, as measured by spirometry.\"</p>",
      "rawMarkdown": "Yes, \"Forced vital capacity (FVC) is the amount of air that can be forcibly exhaled from your lungs after taking the deepest breath possible, as measured by spirometry.\"",
      "votes": null
    },
    {
      "id": "992292",
      "postDate": "08/31/2020 05:08:27",
      "content": "<p>Right, thanks! </p>",
      "rawMarkdown": "Right, thanks!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 991736,
      "author_name": "yovinyahathugoda",
      "author_url": "",
      "post_date": "08/30/2020 16:21:09",
      "content": "<p>The dcm files for each patient do not correspond to the number of weeks on the CSV file. Each folder is a single CT scan with multiple slices. Therefore, each patient has only 1 CT scan taken at week 0.</p>",
      "votes": null,
      "replies": [
        {
          "id": 991754,
          "author_name": "koza4ukdmitrij",
          "author_url": "",
          "post_date": "08/30/2020 16:34:31",
          "content": "<p>I've understood, thank you! </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 991780,
      "author_name": "cv13j0",
      "author_url": "",
      "post_date": "08/30/2020 16:57:42",
      "content": "<p>Hi! <a href=\"https://www.kaggle.com/koza4ukdmitrij\" target=\"_blank\">@koza4ukdmitrij</a>, there is only one CT per patient, below extract from competition notes \"In the dataset, you are provided with a baseline chest CT scan and associated clinical information for a set of patients. A patient has an image acquired at time Week = 0 and has numerous follow up visits over the course of approximately 1-2 years, at which time their FVC is measured.\"</p>",
      "votes": null,
      "replies": [
        {
          "id": 991828,
          "author_name": "koza4ukdmitrij",
          "author_url": "",
          "post_date": "08/30/2020 17:24:09",
          "content": "<p>I was confused with this formulation: there is no information about CT scan's slices, looks like other scaning prosudures can be done during next visits too. So presumably CT scans were made for each visit but that data just unavailable by the host of the competition. By the way, thank you for response) </p>",
          "votes": null,
          "replies": [
            {
              "id": 991878,
              "author_name": "richardepstein",
              "author_url": "",
              "post_date": "08/30/2020 17:57:19",
              "content": "<p>It is unlikely that patients had a CT scan each visit. We tend to use CT scans sparingly, due both to cost and radiation exposure. And if the patient's clinical condition hasn't changed much, we don't need to waste resources on another CT scan. However, it is surely possible that some patients had more than one CT scan during their overall treatment.</p>\n<p>In either case, we are only provided with a single CT scan per patient.</p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 991894,
              "author_name": "koza4ukdmitrij",
              "author_url": "",
              "post_date": "08/30/2020 18:06:55",
              "content": "<p>Oh, thanks! So, is that possible to measure FVC without CT scans? </p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 992088,
              "author_name": "cv13j0",
              "author_url": "",
              "post_date": "08/30/2020 22:46:14",
              "content": "<p>Yes, \"Forced vital capacity (FVC) is the amount of air that can be forcibly exhaled from your lungs after taking the deepest breath possible, as measured by spirometry.\"</p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 992292,
              "author_name": "koza4ukdmitrij",
              "author_url": "",
              "post_date": "08/31/2020 05:08:27",
              "content": "<p>Right, thanks! </p>",
              "votes": null,
              "replies": []
            }
          ]
        },
        {
          "id": 991874,
          "author_name": "cv13j0",
          "author_url": "",
          "post_date": "08/30/2020 17:56:41",
          "content": "<p>CT Scans are expensive (In general, you can expect to see CT scan costs that range from $270 on the very low end to nearly $5,000 on the high end. The cost varies depends on the facility) and time-consuming, so I think they want to do their best with only one and some less resource-intensive sampling (FVC) to measure or predict the patient's condition.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 991906,
          "author_name": "koza4ukdmitrij",
          "author_url": "",
          "post_date": "08/30/2020 18:18:25",
          "content": "<p>Ok, so my understanding now is the next one: expensive CT scans were taken in the begining of the treatment only, than only FVC were mesured (without CT scans) each in several weeks (particular, for saving up money) . Do you have the same standpoint? (if you are, task statement has become more clear for me and level of motivation has incresed:)) </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 991943,
          "author_name": "cv13j0",
          "author_url": "",
          "post_date": "08/30/2020 18:46:32",
          "content": "<p>Yes, It makes sense to me; basically, you build a solid baseline and rely on an ML solution to predict patient performance so that you can save resources, if the prediction has High Confidence and Show Deterioration of the patient probably a CT will be recommended allocating resources properly :) I think this competition has enormous potential to improve diagnosing of decline in lung function :)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 991967,
          "author_name": "koza4ukdmitrij",
          "author_url": "",
          "post_date": "08/30/2020 19:04:03",
          "content": "<p>Yeah, agree. That's why it becomes more motivated. At first glance it looks like host just hide the most part of CT scans for some reason. And the wrong understanding that FVC relys on CT scans vanishes either idea to use CT scans at all and correspondingly a motivation. </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "991693": "Train file consists of these rows for some particular patient:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1659719%2Fb3cde63c43d619e8a4e2e33a66aaf9c5%2FTopic.png?generation=1598802081003605&alt=media)\n\nBut there are only 30 files inside train directory for this patient. Does it mean that I have to ignore rows with week equals -4, 41 and 57?",
    "991736": "The dcm files for each patient do not correspond to the number of weeks on the CSV file. Each folder is a single CT scan with multiple slices. Therefore, each patient has only 1 CT scan taken at week 0.",
    "991754": "I've understood, thank you!",
    "991780": "Hi! @koza4ukdmitrij, there is only one CT per patient, below extract from competition notes \"In the dataset, you are provided with a baseline chest CT scan and associated clinical information for a set of patients. A patient has an image acquired at time Week = 0 and has numerous follow up visits over the course of approximately 1-2 years, at which time their FVC is measured.\"",
    "991828": "I was confused with this formulation: there is no information about CT scan's slices, looks like other scaning prosudures can be done during next visits too. So presumably CT scans were made for each visit but that data just unavailable by the host of the competition. By the way, thank you for response)",
    "991874": "CT Scans are expensive (In general, you can expect to see CT scan costs that range from $270 on the very low end to nearly $5,000 on the high end. The cost varies depends on the facility) and time-consuming, so I think they want to do their best with only one and some less resource-intensive sampling (FVC) to measure or predict the patient's condition.",
    "991878": "It is unlikely that patients had a CT scan each visit. We tend to use CT scans sparingly, due both to cost and radiation exposure. And if the patient's clinical condition hasn't changed much, we don't need to waste resources on another CT scan. However, it is surely possible that some patients had more than one CT scan during their overall treatment.\n\nIn either case, we are only provided with a single CT scan per patient.",
    "991894": "Oh, thanks! So, is that possible to measure FVC without CT scans?",
    "991906": "Ok, so my understanding now is the next one: expensive CT scans were taken in the begining of the treatment only, than only FVC were mesured (without CT scans) each in several weeks (particular, for saving up money) . Do you have the same standpoint? (if you are, task statement has become more clear for me and level of motivation has incresed:))",
    "991943": "Yes, It makes sense to me; basically, you build a solid baseline and rely on an ML solution to predict patient performance so that you can save resources, if the prediction has High Confidence and Show Deterioration of the patient probably a CT will be recommended allocating resources properly :) I think this competition has enormous potential to improve diagnosing of decline in lung function :)",
    "991967": "Yeah, agree. That's why it becomes more motivated. At first glance it looks like host just hide the most part of CT scans for some reason. And the wrong understanding that FVC relys on CT scans vanishes either idea to use CT scans at all and correspondingly a motivation.",
    "992088": "Yes, \"Forced vital capacity (FVC) is the amount of air that can be forcibly exhaled from your lungs after taking the deepest breath possible, as measured by spirometry.\"",
    "992292": "Right, thanks!"
  },
  "source": "meta"
}