{
  "id": 40967,
  "title": "OSError: [Errno 28] No space left on device: ",
  "url": "/competitions/cdiscount-image-classification-challenge/discussion/40967",
  "author_name": "",
  "post_date": "2017-10-11T02:05:27.009027400Z",
  "votes": 1,
  "comment_count": 6,
  "views": 0,
  "content": "<p>Bad luck!  </p>\n\n<p>11930000 step done !\n11940000 step done !\n11950000 step done !\n11960000 step done !\nTraceback (most recent call last):\n  File \"data_transfer.py\", line 36, in \n    plt.imsave(picture_file, picture)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/pyplot.py\", line 2302, in imsave\n    return _imsave(*args, <strong>kwargs)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/image.py\", line 1372, in imsave\n    fig.savefig(fname, dpi=dpi, format=format, transparent=True)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/figure.py\", line 1563, in savefig\n    self.canvas.print_figure(*args, **kwargs)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/backend_bases.py\", line 2232, in print_figure\n    **kwargs)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/backends/backend_agg.py\", line 583, in print_jpg\n    return image.save(filename_or_obj, format='jpeg', **options)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/PIL/Image.py\", line 1682, in save\n    fp = builtins.open(filename, \"wb\")\n**OSError: [Errno 28] No space left on device: '/home/public/DataSet/kaggle/CICC/train/22764628_0.jpg'</strong></p>\n\n<p>But：\nkaggle@administrator-MS-7883:~/project/CICC/VGG$ df -h\nFilesystem      Size  Used Avail Use% Mounted on\nudev             32G  8.0K   32G   1% /dev\ntmpfs           6.3G  7.1M  6.3G   1% /run\n/dev/sdb3       114G   93G   16G  86% /\nnone            4.0K     0  4.0K   0% /sys/fs/cgroup\nnone            5.0M     0  5.0M   0% /run/lock\nnone             32G   72K   32G   1% /run/shm\nnone            100M  8.0K  100M   1% /run/user\n<strong>/dev/sda5       1.7T  403G  1.3T  25% /home/public</strong>\n/dev/sda2       202G   76G  117G  40% /data</p>\n\n<p>why？</p>",
  "messages": [
    {
      "id": "230001",
      "postDate": "10/11/2017 02:05:27",
      "content": "<p>Bad luck!  </p>\n\n<p>11930000 step done !\n11940000 step done !\n11950000 step done !\n11960000 step done !\nTraceback (most recent call last):\n  File \"data_transfer.py\", line 36, in \n    plt.imsave(picture_file, picture)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/pyplot.py\", line 2302, in imsave\n    return _imsave(*args, <strong>kwargs)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/image.py\", line 1372, in imsave\n    fig.savefig(fname, dpi=dpi, format=format, transparent=True)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/figure.py\", line 1563, in savefig\n    self.canvas.print_figure(*args, **kwargs)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/backend_bases.py\", line 2232, in print_figure\n    **kwargs)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/matplotlib/backends/backend_agg.py\", line 583, in print_jpg\n    return image.save(filename_or_obj, format='jpeg', **options)\n  File \"/home/kaggle/anaconda3/lib/python3.5/site-packages/PIL/Image.py\", line 1682, in save\n    fp = builtins.open(filename, \"wb\")\n**OSError: [Errno 28] No space left on device: '/home/public/DataSet/kaggle/CICC/train/22764628_0.jpg'</strong></p>\n\n<p>But：\nkaggle@administrator-MS-7883:~/project/CICC/VGG$ df -h\nFilesystem      Size  Used Avail Use% Mounted on\nudev             32G  8.0K   32G   1% /dev\ntmpfs           6.3G  7.1M  6.3G   1% /run\n/dev/sdb3       114G   93G   16G  86% /\nnone            4.0K     0  4.0K   0% /sys/fs/cgroup\nnone            5.0M     0  5.0M   0% /run/lock\nnone             32G   72K   32G   1% /run/shm\nnone            100M  8.0K  100M   1% /run/user\n<strong>/dev/sda5       1.7T  403G  1.3T  25% /home/public</strong>\n/dev/sda2       202G   76G  117G  40% /data</p>\n\n<p>why？</p>",
      "rawMarkdown": "Bad luck!  \n\n11930000 step done !\n11940000 step done !\n11950000 step done !\n11960000 step done !\nTraceback (most recent call last):\n  File \"data_transfer.py\", line 36, in",
      "votes": null
    },
    {
      "id": "230002",
      "postDate": "10/11/2017 02:08:32",
      "content": "<p>Maybe this <a href=\"https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40827\">https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40827</a> ?</p>",
      "rawMarkdown": "Maybe this https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40827 ?",
      "votes": null
    },
    {
      "id": "230009",
      "postDate": "10/11/2017 03:00:05",
      "content": "<p>yes , the same problem. </p>",
      "rawMarkdown": "yes , the same problem.",
      "votes": null
    },
    {
      "id": "238306",
      "postDate": "11/01/2017 05:08:11",
      "content": "<p>probably filled up you inode table. Ubuntu defaults to max (~20 million file) you'll have to reformat and manually specify the size of the inode table  </p>",
      "rawMarkdown": "probably filled up you inode table. Ubuntu defaults to max (~20 million file) you'll have to reformat and manually specify the size of the inode table",
      "votes": null
    },
    {
      "id": "292144",
      "postDate": "03/07/2018 14:34:53",
      "content": "<p>I overcame this problem by setting JOBLIB_TEMP_FOLDER variable using following code in Python notebook.</p>\n\n<pre><code>%env JOBLIB_TEMP_FOLDER=/tmp\n</code></pre>",
      "rawMarkdown": "I overcame this problem by setting JOBLIB_TEMP_FOLDER variable using following code in Python notebook.\n\n    %env JOBLIB_TEMP_FOLDER=/tmp",
      "votes": null
    },
    {
      "id": "295900",
      "postDate": "03/14/2018 11:57:38",
      "content": "<p>Can you explain more, why this line can solve the problem?</p>",
      "rawMarkdown": "Can you explain more, why this line can solve the problem?",
      "votes": null
    },
    {
      "id": "295912",
      "postDate": "03/14/2018 12:20:08",
      "content": "<p>It seems that we are running out of shared memory and by setting JOBLIB_TEMP_FOLDER environment variable to something else (/tmp) may increase the size of the shared memory.\nHence, it solves the problem of having less space on the device.</p>",
      "rawMarkdown": "It seems that we are running out of shared memory and by setting JOBLIB_TEMP_FOLDER environment variable to something else (/tmp) may increase the size of the shared memory.\nHence, it solves the problem of having less space on the device.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 230002,
      "author_name": "jandjenter",
      "author_url": "",
      "post_date": "10/11/2017 02:08:32",
      "content": "<p>Maybe this <a href=\"https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40827\">https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40827</a> ?</p>",
      "votes": null,
      "replies": [
        {
          "id": 230009,
          "author_name": "lijihw",
          "author_url": "",
          "post_date": "10/11/2017 03:00:05",
          "content": "<p>yes , the same problem. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 238306,
      "author_name": "rcodddow",
      "author_url": "",
      "post_date": "11/01/2017 05:08:11",
      "content": "<p>probably filled up you inode table. Ubuntu defaults to max (~20 million file) you'll have to reformat and manually specify the size of the inode table  </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 292144,
      "author_name": "abhinavwalia95",
      "author_url": "",
      "post_date": "03/07/2018 14:34:53",
      "content": "<p>I overcame this problem by setting JOBLIB_TEMP_FOLDER variable using following code in Python notebook.</p>\n\n<pre><code>%env JOBLIB_TEMP_FOLDER=/tmp\n</code></pre>",
      "votes": null,
      "replies": [
        {
          "id": 295900,
          "author_name": "abdalwhab",
          "author_url": "",
          "post_date": "03/14/2018 11:57:38",
          "content": "<p>Can you explain more, why this line can solve the problem?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 295912,
          "author_name": "abhinavwalia95",
          "author_url": "",
          "post_date": "03/14/2018 12:20:08",
          "content": "<p>It seems that we are running out of shared memory and by setting JOBLIB_TEMP_FOLDER environment variable to something else (/tmp) may increase the size of the shared memory.\nHence, it solves the problem of having less space on the device.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "230001": "Bad luck!  \n\n11930000 step done !\n11940000 step done !\n11950000 step done !\n11960000 step done !\nTraceback (most recent call last):\n  File \"data_transfer.py\", line 36, in",
    "230002": "Maybe this https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40827 ?",
    "230009": "yes , the same problem.",
    "238306": "probably filled up you inode table. Ubuntu defaults to max (~20 million file) you'll have to reformat and manually specify the size of the inode table",
    "292144": "I overcame this problem by setting JOBLIB_TEMP_FOLDER variable using following code in Python notebook.\n\n    %env JOBLIB_TEMP_FOLDER=/tmp",
    "295900": "Can you explain more, why this line can solve the problem?",
    "295912": "It seems that we are running out of shared memory and by setting JOBLIB_TEMP_FOLDER environment variable to something else (/tmp) may increase the size of the shared memory.\nHence, it solves the problem of having less space on the device."
  },
  "source": "meta"
}