{
  "id": 229411,
  "title": "File copy issue.",
  "url": "/competitions/hubmap-kidney-segmentation/discussion/229411",
  "author_name": "Jaideep",
  "post_date": "2021-03-30T03:58:12.558000",
  "votes": 1,
  "comment_count": 7,
  "views": 0,
  "content": "<p>Hi.<br>\nI am copying the files from input data set to  two tmp folders of output .using script below<br>\n<code>!mkdir masks_512</code></p>\n<pre><code>for i in range(15):\n    !cp ../input/hubmap-512-ds/mask_512_{i}/kaggle/working/*.png  /kaggle/working/masks_512/\n\nI\n</code></pre>\n<p>t takes too long time to generate the output  even though cp command finishes fast in 20 min,but it gets stuck at <strong>nb converting html… step</strong></p>\n<p>After it gets generated  when i check the output ,i dont see  child parent folder structures as we see for Input dataset like you expand input folder, you see one folder train and then you expand train you see the files, in above case its not happening  instead the file gets copied directly under output kernel folder </p>\n<p>Expected:  output_kernel/masks_512/ files</p>\n<p>actual   :     output_kernel/files</p>\n<p>however when i do ls -l  i do see the folder masks_512  but while viewing in the navigation it dsnt shows the created folder, it directly shows in navigation files under the output kernel folder as i shown above in actual<br>\nI cant past the screen shot as kaggle has disabled it.</p>",
  "messages": [
    {
      "id": 1256598,
      "postDate": "2021-03-30T03:58:12.560Z",
      "content": "<p>Hi.<br>\nI am copying the files from input data set to  two tmp folders of output .using script below<br>\n<code>!mkdir masks_512</code></p>\n<pre><code>for i in range(15):\n    !cp ../input/hubmap-512-ds/mask_512_{i}/kaggle/working/*.png  /kaggle/working/masks_512/\n\nI\n</code></pre>\n<p>t takes too long time to generate the output  even though cp command finishes fast in 20 min,but it gets stuck at <strong>nb converting html… step</strong></p>\n<p>After it gets generated  when i check the output ,i dont see  child parent folder structures as we see for Input dataset like you expand input folder, you see one folder train and then you expand train you see the files, in above case its not happening  instead the file gets copied directly under output kernel folder </p>\n<p>Expected:  output_kernel/masks_512/ files</p>\n<p>actual   :     output_kernel/files</p>\n<p>however when i do ls -l  i do see the folder masks_512  but while viewing in the navigation it dsnt shows the created folder, it directly shows in navigation files under the output kernel folder as i shown above in actual<br>\nI cant past the screen shot as kaggle has disabled it.</p>",
      "rawMarkdown": "Hi.\nI am copying the files from input data set to  two tmp folders of output .using script below\n`!mkdir masks_512`\n```\nfor i in range(15):\n    !cp ../input/hubmap-512-ds/mask_512_{i}/kaggle/working/*.png  /kaggle/working/masks_512/\n\nI\n```t takes too long time to generate the output  even though cp command finishes fast in 20 min,but it gets stuck at **nb converting html... step**\n\nAfter it gets generated  when i check the output ,i dont see  child parent folder structures as we see for Input dataset like you expand input folder, you see one folder train and then you expand train you see the files, in above case its not happening  instead the file gets copied directly under output kernel folder \n\nExpected:  output_kernel/masks_512/ files\n\nactual   :     output_kernel/files\n\nhowever when i do ls -l  i do see the folder masks_512  but while viewing in the navigation it dsnt shows the created folder, it directly shows in navigation files under the output kernel folder as i shown above in actual\nI cant past the screen shot as kaggle has disabled it.\n\n\n\n\n \n",
      "votes": 2
    },
    {
      "id": 1256608,
      "postDate": "2021-03-30T04:21:02.483Z",
      "rawMarkdown": "",
      "isDeleted": true,
      "replies": [
        {
          "id": 1256673,
          "postDate": "2021-03-30T06:39:53.763Z",
          "content": "<p>here is what i use and kernel is running now.<br>\nBut i think it would do same thing as before based on what i see. Taking too long at <br>\nNb converting message</p>\n<pre><code>!mkdir masks_512\n!mkdir train_512\ndst_dir1='/kaggle/working/masks_512/'\ndst_dir2='/kaggle/working/train_512/'\nj=0\nfor name in glob.glob('../input/hubmap-512-ds/*/*/*/*'):  \n    #print('name',name )\n    j=j+1\n    if name.endswith(\".png\") and 'train_512' in name : \n        shutil.copy(name, dst_dir2)\n    elif name.endswith(\".png\") and 'mask_512' in name:\n        shutil.copy(name, dst_dir1)\n\n    else:\n        print('x')\n        #print ('\\t', name)\nprint('files count',j) \n</code></pre>",
          "rawMarkdown": "here is what i use and kernel is running now.\nBut i think it would do same thing as before based on what i see. Taking too long at \nNb converting message\n\n```\n!mkdir masks_512\n!mkdir train_512\ndst_dir1='/kaggle/working/masks_512/'\ndst_dir2='/kaggle/working/train_512/'\nj=0\nfor name in glob.glob('../input/hubmap-512-ds/*/*/*/*'):  \n    #print('name',name )\n    j=j+1\n    if name.endswith(\".png\") and 'train_512' in name : \n        shutil.copy(name, dst_dir2)\n    elif name.endswith(\".png\") and 'mask_512' in name:\n        shutil.copy(name, dst_dir1)\n        \n    else:\n        print('x')\n        #print ('\\t', name)\nprint('files count',j) \n```"
        },
        {
          "id": 1256768,
          "postDate": "2021-03-30T08:08:19.787Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 1256774,
          "postDate": "2021-03-30T08:18:47.680Z",
          "content": "<p>python code block gets overfast why does it takes long in generating output.<br>\nWill try with zipping next.</p>",
          "rawMarkdown": "python code block gets overfast why does it takes long in generating output.\nWill try with zipping next."
        },
        {
          "id": 1256777,
          "postDate": "2021-03-30T08:21:12.410Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 1256858,
          "postDate": "2021-03-30T10:02:17.203Z",
          "content": "<p>yes committing</p>",
          "rawMarkdown": "yes committing"
        },
        {
          "id": 1256882,
          "postDate": "2021-03-30T10:29:53.337Z",
          "rawMarkdown": "",
          "isDeleted": true
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1256608,
      "author_name": "",
      "author_url": "",
      "post_date": "2021-03-30T04:21:02.483000",
      "content": "",
      "votes": 0,
      "replies": [
        {
          "id": 1256673,
          "author_name": "Jaideep",
          "author_url": "",
          "post_date": "2021-03-30T06:39:53.763000",
          "content": "<p>here is what i use and kernel is running now.<br>\nBut i think it would do same thing as before based on what i see. Taking too long at <br>\nNb converting message</p>\n<pre><code>!mkdir masks_512\n!mkdir train_512\ndst_dir1='/kaggle/working/masks_512/'\ndst_dir2='/kaggle/working/train_512/'\nj=0\nfor name in glob.glob('../input/hubmap-512-ds/*/*/*/*'):  \n    #print('name',name )\n    j=j+1\n    if name.endswith(\".png\") and 'train_512' in name : \n        shutil.copy(name, dst_dir2)\n    elif name.endswith(\".png\") and 'mask_512' in name:\n        shutil.copy(name, dst_dir1)\n\n    else:\n        print('x')\n        #print ('\\t', name)\nprint('files count',j) \n</code></pre>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1256768,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-03-30T08:08:19.787000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1256774,
          "author_name": "Jaideep",
          "author_url": "",
          "post_date": "2021-03-30T08:18:47.680000",
          "content": "<p>python code block gets overfast why does it takes long in generating output.<br>\nWill try with zipping next.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1256777,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-03-30T08:21:12.410000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1256858,
          "author_name": "Jaideep",
          "author_url": "",
          "post_date": "2021-03-30T10:02:17.203000",
          "content": "<p>yes committing</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1256882,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-03-30T10:29:53.337000",
          "content": "",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1256598": "Hi.\nI am copying the files from input data set to  two tmp folders of output .using script below\n`!mkdir masks_512`\n```\nfor i in range(15):\n    !cp ../input/hubmap-512-ds/mask_512_{i}/kaggle/working/*.png  /kaggle/working/masks_512/\n\nI\n```t takes too long time to generate the output  even though cp command finishes fast in 20 min,but it gets stuck at **nb converting html... step**\n\nAfter it gets generated  when i check the output ,i dont see  child parent folder structures as we see for Input dataset like you expand input folder, you see one folder train and then you expand train you see the files, in above case its not happening  instead the file gets copied directly under output kernel folder \n\nExpected:  output_kernel/masks_512/ files\n\nactual   :     output_kernel/files\n\nhowever when i do ls -l  i do see the folder masks_512  but while viewing in the navigation it dsnt shows the created folder, it directly shows in navigation files under the output kernel folder as i shown above in actual\nI cant past the screen shot as kaggle has disabled it.\n\n\n\n\n \n",
    "1256608": ""
  }
}