{
  "id": 244579,
  "title": "Using ImageDataGenerator ",
  "url": "/competitions/siim-covid19-detection/discussion/244579",
  "author_name": "Rad",
  "post_date": "2021-06-07T12:30:29.530000",
  "votes": 1,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Hi All,<br>\nI am trying to use Keras ImageDataGenerator for the provided data sets.<br>\nMost of the examples related to ImageDataGenerator I have seen uses a single directory for training data. However, in this competition  our train folder contains multiple folders and some folders are used for classification(\"study) and other folders are used for detection(\"image\").</p>\n<ol>\n<li><p>Is it possible to know whether I can use ImageDataGenerator in this case?</p></li>\n<li><p>I have created two lists with train image paths for \"study\" and \"image\" data. Can I use these list with the ImageDataGenerator? <br>\nAn example list shown below.<br>\n<strong><em>['/kaggle/input/siim-covid19-detection/train/ffc6679e82d6/34422fde18a5/346ea1e7619e.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/d4d43f6fe855/84ed5f7f71bf.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/4a4a9ae34a66/1c96d9b08487.dcm', '/kaggle/input/siim-covid19-detection/train/ffe4d6e8fbb0/cc4df88fb786/e6215d0188e5.dcm', '/kaggle/input/siim-covid19-detection/train/ffe94fcb14fa/c0382e85ff25/7d27b1bb3987.dcm', '/kaggle/input/siim-covid19-detection/train/ffebf1ef4a9c/e11401cd12d0/52478e480a15.dcm']</em></strong></p></li>\n<li><p>Should I create a separate folders in /kaggle and try to copy each image into separate \"train\" and \"validation\" folders? I am not sure whether there will be enough space available.</p></li>\n<li><p>Is there is a better approach I can implement?</p></li>\n</ol>\n<p>Thanks a lot!!</p>",
  "messages": [
    {
      "id": 1339727,
      "postDate": "2021-06-07T12:30:29.530Z",
      "content": "<p>Hi All,<br>\nI am trying to use Keras ImageDataGenerator for the provided data sets.<br>\nMost of the examples related to ImageDataGenerator I have seen uses a single directory for training data. However, in this competition  our train folder contains multiple folders and some folders are used for classification(\"study) and other folders are used for detection(\"image\").</p>\n<ol>\n<li><p>Is it possible to know whether I can use ImageDataGenerator in this case?</p></li>\n<li><p>I have created two lists with train image paths for \"study\" and \"image\" data. Can I use these list with the ImageDataGenerator? <br>\nAn example list shown below.<br>\n<strong><em>['/kaggle/input/siim-covid19-detection/train/ffc6679e82d6/34422fde18a5/346ea1e7619e.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/d4d43f6fe855/84ed5f7f71bf.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/4a4a9ae34a66/1c96d9b08487.dcm', '/kaggle/input/siim-covid19-detection/train/ffe4d6e8fbb0/cc4df88fb786/e6215d0188e5.dcm', '/kaggle/input/siim-covid19-detection/train/ffe94fcb14fa/c0382e85ff25/7d27b1bb3987.dcm', '/kaggle/input/siim-covid19-detection/train/ffebf1ef4a9c/e11401cd12d0/52478e480a15.dcm']</em></strong></p></li>\n<li><p>Should I create a separate folders in /kaggle and try to copy each image into separate \"train\" and \"validation\" folders? I am not sure whether there will be enough space available.</p></li>\n<li><p>Is there is a better approach I can implement?</p></li>\n</ol>\n<p>Thanks a lot!!</p>",
      "rawMarkdown": "Hi All,\nI am trying to use Keras ImageDataGenerator for the provided data sets.\nMost of the examples related to ImageDataGenerator I have seen uses a single directory for training data. However, in this competition  our train folder contains multiple folders and some folders are used for classification(\"study) and other folders are used for detection(\"image\").\n1. Is it possible to know whether I can use ImageDataGenerator in this case?\n2. I have created two lists with train image paths for \"study\" and \"image\" data. Can I use these list with the ImageDataGenerator? \nAn example list shown below.\n***['/kaggle/input/siim-covid19-detection/train/ffc6679e82d6/34422fde18a5/346ea1e7619e.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/d4d43f6fe855/84ed5f7f71bf.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/4a4a9ae34a66/1c96d9b08487.dcm', '/kaggle/input/siim-covid19-detection/train/ffe4d6e8fbb0/cc4df88fb786/e6215d0188e5.dcm', '/kaggle/input/siim-covid19-detection/train/ffe94fcb14fa/c0382e85ff25/7d27b1bb3987.dcm', '/kaggle/input/siim-covid19-detection/train/ffebf1ef4a9c/e11401cd12d0/52478e480a15.dcm']***\n\n3. Should I create a separate folders in /kaggle and try to copy each image into separate \"train\" and \"validation\" folders? I am not sure whether there will be enough space available.\n4. Is there is a better approach I can implement?\n\nThanks a lot!!",
      "votes": 1
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1339727": "Hi All,\nI am trying to use Keras ImageDataGenerator for the provided data sets.\nMost of the examples related to ImageDataGenerator I have seen uses a single directory for training data. However, in this competition  our train folder contains multiple folders and some folders are used for classification(\"study) and other folders are used for detection(\"image\").\n1. Is it possible to know whether I can use ImageDataGenerator in this case?\n2. I have created two lists with train image paths for \"study\" and \"image\" data. Can I use these list with the ImageDataGenerator? \nAn example list shown below.\n***['/kaggle/input/siim-covid19-detection/train/ffc6679e82d6/34422fde18a5/346ea1e7619e.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/d4d43f6fe855/84ed5f7f71bf.dcm', '/kaggle/input/siim-covid19-detection/train/ffcb4630f46f/4a4a9ae34a66/1c96d9b08487.dcm', '/kaggle/input/siim-covid19-detection/train/ffe4d6e8fbb0/cc4df88fb786/e6215d0188e5.dcm', '/kaggle/input/siim-covid19-detection/train/ffe94fcb14fa/c0382e85ff25/7d27b1bb3987.dcm', '/kaggle/input/siim-covid19-detection/train/ffebf1ef4a9c/e11401cd12d0/52478e480a15.dcm']***\n\n3. Should I create a separate folders in /kaggle and try to copy each image into separate \"train\" and \"validation\" folders? I am not sure whether there will be enough space available.\n4. Is there is a better approach I can implement?\n\nThanks a lot!!"
  }
}