{
  "id": 233647,
  "title": "Why there is my generated output \"submission.csv\" in notebook, but the submission score is always 0.251 or ERROR.",
  "url": "/competitions/plant-pathology-2021-fgvc8/discussion/233647",
  "author_name": "",
  "post_date": "2021-04-20T11:23:30.252151Z",
  "votes": null,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Dear PP2021 - FGVC8 team,</p>\n<p>In my notebooks, it does clearly show that there is my generated output \"submission.csv\", but the submission score is always 0.251 or ERROR. Could any help me fix this problem? Thank you very much.</p>\n<p>Best regards,<br>\nSifan</p>",
  "messages": [
    {
      "id": "1278885",
      "postDate": "04/20/2021 11:23:30",
      "content": "<p>Dear PP2021 - FGVC8 team,</p>\n<p>In my notebooks, it does clearly show that there is my generated output \"submission.csv\", but the submission score is always 0.251 or ERROR. Could any help me fix this problem? Thank you very much.</p>\n<p>Best regards,<br>\nSifan</p>",
      "rawMarkdown": "Dear PP2021 - FGVC8 team,\n\nIn my notebooks, it does clearly show that there is my generated output \"submission.csv\", but the submission score is always 0.251 or ERROR. Could any help me fix this problem? Thank you very much.\n\nBest regards,\nSifan",
      "votes": null
    },
    {
      "id": "1278892",
      "postDate": "04/20/2021 11:28:19",
      "content": "<p>here is my log. </p>\n<p>total 0</p>\n<p>drwxr-xr-x 3 nobody nogroup 0 Apr 20 10:45 lightening-checkpoint1</p>\n<p>drwxr-xr-x 4 nobody nogroup 0 Mar 24 17:46 plant-pathology-2021-fgvc8</p>\n<p>total 580</p>\n<p>-rw-r--r-- 1 nobody nogroup    100 Mar 24 17:46 sample_submission.csv</p>\n<p>drwxr-xr-x 2 nobody nogroup      0 Mar 24 17:46 test_images</p>\n<p>-rw-r--r-- 1 nobody nogroup 586183 Mar 24 17:46 train.csv</p>\n<p>drwxr-xr-x 2 nobody nogroup      0 Mar 24 17:48 train_images</p>\n<p>total 596828</p>\n<p>-rw-r--r-- 1 nobody nogroup 282678666 Apr 20 10:46 epoch04-valid_acc0.9561-valid_f10.8634.ckpt</p>\n<p>-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_1_9394.34604.pt</p>\n<p>-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_3_9372.87529.pt</p>\n<p>-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_4_9431.91984.pt</p>\n<p>drwxr-xr-x 2 nobody nogroup         0 Apr 20 10:45 pytorch-packages</p>\n<p>total 516</p>\n<p>-rw-r--r-- 1 nobody nogroup 527629 Apr 20 10:45 pytorchcv-0.0.65-py2.py3-none-any.whl</p>\n<p>Looking in links: /tmp/pip/cache/</p>\n<p>Processing /tmp/pip/cache/pytorchcv-0.0.65-py2.py3-none-any.whl</p>\n<p>Requirement already satisfied: requests in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (2.25.1)</p>\n<p>Requirement already satisfied: numpy in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (1.19.5)</p>\n<p>Requirement already satisfied: chardet=3.0.2 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (3.0.4)</p>\n<p>Requirement already satisfied: urllib3=1.21.1 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (1.26.3)</p>\n<p>Requirement already satisfied: idna=2.5 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (2.10)</p>\n<p>Requirement already satisfied: certifi&gt;=2017.4.17 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (2020.12.5)</p>\n<p>Installing collected packages: pytorchcv</p>\n<p>Successfully installed pytorchcv-0.0.65</p>\n<p>len(test_loader) 3</p>\n<p>../input/lightening-checkpoint1/model_val_3_9372.87529.pt</p>\n<pre><code>              image                      labels\n</code></pre>\n<p>0  ad8770db05586b59.jpg  complex frog_eye_leaf_spot</p>\n<p>1  c7b03e718489f3ca.jpg          frog_eye_leaf_spot</p>\n<p>2  85f8cb619c66b863.jpg                     complex</p>\n<p>/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.</p>\n<p>FutureWarning,</p>\n<p>[NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to notebook</p>\n<p>[NbConvertApp] Writing 76428 bytes to <strong>notebook</strong>.ipynb</p>\n<p>/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.</p>\n<p>FutureWarning,</p>\n<p>[NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to html</p>\n<p>[NbConvertApp] Writing 398206 bytes to <strong>results</strong>.html</p>",
      "rawMarkdown": "here is my log. \n\ntotal 0\n\ndrwxr-xr-x 3 nobody nogroup 0 Apr 20 10:45 lightening-checkpoint1\n\ndrwxr-xr-x 4 nobody nogroup 0 Mar 24 17:46 plant-pathology-2021-fgvc8\n\ntotal 580\n\n-rw-r--r-- 1 nobody nogroup    100 Mar 24 17:46 sample_submission.csv\n\ndrwxr-xr-x 2 nobody nogroup      0 Mar 24 17:46 test_images\n\n-rw-r--r-- 1 nobody nogroup 586183 Mar 24 17:46 train.csv\n\ndrwxr-xr-x 2 nobody nogroup      0 Mar 24 17:48 train_images\n\ntotal 596828\n\n-rw-r--r-- 1 nobody nogroup 282678666 Apr 20 10:46 epoch04-valid_acc0.9561-valid_f10.8634.ckpt\n\n-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_1_9394.34604.pt\n\n-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_3_9372.87529.pt\n\n-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_4_9431.91984.pt\n\ndrwxr-xr-x 2 nobody nogroup         0 Apr 20 10:45 pytorch-packages\n\ntotal 516\n\n-rw-r--r-- 1 nobody nogroup 527629 Apr 20 10:45 pytorchcv-0.0.65-py2.py3-none-any.whl\n\nLooking in links: /tmp/pip/cache/\n\nProcessing /tmp/pip/cache/pytorchcv-0.0.65-py2.py3-none-any.whl\n\nRequirement already satisfied: requests in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (2.25.1)\n\nRequirement already satisfied: numpy in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (1.19.5)\n\nRequirement already satisfied: chardet<5,>=3.0.2 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (3.0.4)\n\nRequirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (1.26.3)\n\nRequirement already satisfied: idna<3,>=2.5 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (2.10)\n\nRequirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (2020.12.5)\n\nInstalling collected packages: pytorchcv\n\nSuccessfully installed pytorchcv-0.0.65\n\nlen(test_loader) 3\n\n../input/lightening-checkpoint1/model_val_3_9372.87529.pt\n\n                  image                      labels\n\n0  ad8770db05586b59.jpg  complex frog_eye_leaf_spot\n\n1  c7b03e718489f3ca.jpg          frog_eye_leaf_spot\n\n2  85f8cb619c66b863.jpg                     complex\n\n/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n\n  FutureWarning,\n\n[NbConvertApp] Converting notebook __notebook__.ipynb to notebook\n\n[NbConvertApp] Writing 76428 bytes to __notebook__.ipynb\n\n/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n\n  FutureWarning,\n\n[NbConvertApp] Converting notebook __notebook__.ipynb to html\n\n[NbConvertApp] Writing 398206 bytes to __results__.html",
      "votes": null
    },
    {
      "id": "1279067",
      "postDate": "04/20/2021 14:59:33",
      "content": "<p>Hi there,</p>\n<p>I don't really know how to solve the problem, but I noted 2 things that may help you.</p>\n<p>1 - this score is exactly the same you get when you create a submission file as 'healthy' for all images.<br>\n2 - the output file has an index column (0,1,2,3…) and the 'submission_sample.csv' uses the image as index.</p>\n<p>I hope I can help.</p>",
      "rawMarkdown": "Hi there,\n\nI don't really know how to solve the problem, but I noted 2 things that may help you.\n\n1 - this score is exactly the same you get when you create a submission file as 'healthy' for all images.\n2 - the output file has an index column (0,1,2,3...) and the 'submission_sample.csv' uses the image as index.\n\nI hope I can help.",
      "votes": null
    },
    {
      "id": "1279133",
      "postDate": "04/20/2021 15:57:24",
      "content": "<p>Do you have \"Submission not found\" error?</p>",
      "rawMarkdown": "Do you have \"Submission not found\" error?",
      "votes": null
    },
    {
      "id": "1279919",
      "postDate": "04/21/2021 11:23:21",
      "content": "<p><a href=\"https://www.kaggle.com/atamazian\" target=\"_blank\">@atamazian</a> yes… exactly… very sorry this competition is disabled uploading images…</p>",
      "rawMarkdown": "atamazian yes... exactly... very sorry this competition is disabled uploading images...",
      "votes": null
    },
    {
      "id": "1281069",
      "postDate": "04/22/2021 15:57:03",
      "content": "<p>This means that your code crashes on the private test dataset. I recommend you to double-check your code for any possible errors. (I agree, that 3 images is just too few for an abequate testing.)</p>",
      "rawMarkdown": "This means that your code crashes on the private test dataset. I recommend you to double-check your code for any possible errors. (I agree, that 3 images is just too few for an abequate testing.)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1278892,
      "author_name": "mylonsong",
      "author_url": "",
      "post_date": "04/20/2021 11:28:19",
      "content": "<p>here is my log. </p>\n<p>total 0</p>\n<p>drwxr-xr-x 3 nobody nogroup 0 Apr 20 10:45 lightening-checkpoint1</p>\n<p>drwxr-xr-x 4 nobody nogroup 0 Mar 24 17:46 plant-pathology-2021-fgvc8</p>\n<p>total 580</p>\n<p>-rw-r--r-- 1 nobody nogroup    100 Mar 24 17:46 sample_submission.csv</p>\n<p>drwxr-xr-x 2 nobody nogroup      0 Mar 24 17:46 test_images</p>\n<p>-rw-r--r-- 1 nobody nogroup 586183 Mar 24 17:46 train.csv</p>\n<p>drwxr-xr-x 2 nobody nogroup      0 Mar 24 17:48 train_images</p>\n<p>total 596828</p>\n<p>-rw-r--r-- 1 nobody nogroup 282678666 Apr 20 10:46 epoch04-valid_acc0.9561-valid_f10.8634.ckpt</p>\n<p>-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_1_9394.34604.pt</p>\n<p>-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_3_9372.87529.pt</p>\n<p>-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_4_9431.91984.pt</p>\n<p>drwxr-xr-x 2 nobody nogroup         0 Apr 20 10:45 pytorch-packages</p>\n<p>total 516</p>\n<p>-rw-r--r-- 1 nobody nogroup 527629 Apr 20 10:45 pytorchcv-0.0.65-py2.py3-none-any.whl</p>\n<p>Looking in links: /tmp/pip/cache/</p>\n<p>Processing /tmp/pip/cache/pytorchcv-0.0.65-py2.py3-none-any.whl</p>\n<p>Requirement already satisfied: requests in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (2.25.1)</p>\n<p>Requirement already satisfied: numpy in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (1.19.5)</p>\n<p>Requirement already satisfied: chardet=3.0.2 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (3.0.4)</p>\n<p>Requirement already satisfied: urllib3=1.21.1 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (1.26.3)</p>\n<p>Requirement already satisfied: idna=2.5 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (2.10)</p>\n<p>Requirement already satisfied: certifi&gt;=2017.4.17 in /opt/conda/lib/python3.7/site-packages (from requests-&gt;pytorchcv) (2020.12.5)</p>\n<p>Installing collected packages: pytorchcv</p>\n<p>Successfully installed pytorchcv-0.0.65</p>\n<p>len(test_loader) 3</p>\n<p>../input/lightening-checkpoint1/model_val_3_9372.87529.pt</p>\n<pre><code>              image                      labels\n</code></pre>\n<p>0  ad8770db05586b59.jpg  complex frog_eye_leaf_spot</p>\n<p>1  c7b03e718489f3ca.jpg          frog_eye_leaf_spot</p>\n<p>2  85f8cb619c66b863.jpg                     complex</p>\n<p>/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.</p>\n<p>FutureWarning,</p>\n<p>[NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to notebook</p>\n<p>[NbConvertApp] Writing 76428 bytes to <strong>notebook</strong>.ipynb</p>\n<p>/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass <code>--Exporter.preprocessors item</code> … multiple times to add items to a list.</p>\n<p>FutureWarning,</p>\n<p>[NbConvertApp] Converting notebook <strong>notebook</strong>.ipynb to html</p>\n<p>[NbConvertApp] Writing 398206 bytes to <strong>results</strong>.html</p>",
      "votes": null,
      "replies": [
        {
          "id": 1279067,
          "author_name": "thalesgaluchi",
          "author_url": "",
          "post_date": "04/20/2021 14:59:33",
          "content": "<p>Hi there,</p>\n<p>I don't really know how to solve the problem, but I noted 2 things that may help you.</p>\n<p>1 - this score is exactly the same you get when you create a submission file as 'healthy' for all images.<br>\n2 - the output file has an index column (0,1,2,3…) and the 'submission_sample.csv' uses the image as index.</p>\n<p>I hope I can help.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1279133,
      "author_name": "atamazian",
      "author_url": "",
      "post_date": "04/20/2021 15:57:24",
      "content": "<p>Do you have \"Submission not found\" error?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1279919,
      "author_name": "mylonsong",
      "author_url": "",
      "post_date": "04/21/2021 11:23:21",
      "content": "<p><a href=\"https://www.kaggle.com/atamazian\" target=\"_blank\">@atamazian</a> yes… exactly… very sorry this competition is disabled uploading images…</p>",
      "votes": null,
      "replies": [
        {
          "id": 1281069,
          "author_name": "atamazian",
          "author_url": "",
          "post_date": "04/22/2021 15:57:03",
          "content": "<p>This means that your code crashes on the private test dataset. I recommend you to double-check your code for any possible errors. (I agree, that 3 images is just too few for an abequate testing.)</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1278885": "Dear PP2021 - FGVC8 team,\n\nIn my notebooks, it does clearly show that there is my generated output \"submission.csv\", but the submission score is always 0.251 or ERROR. Could any help me fix this problem? Thank you very much.\n\nBest regards,\nSifan",
    "1278892": "here is my log. \n\ntotal 0\n\ndrwxr-xr-x 3 nobody nogroup 0 Apr 20 10:45 lightening-checkpoint1\n\ndrwxr-xr-x 4 nobody nogroup 0 Mar 24 17:46 plant-pathology-2021-fgvc8\n\ntotal 580\n\n-rw-r--r-- 1 nobody nogroup    100 Mar 24 17:46 sample_submission.csv\n\ndrwxr-xr-x 2 nobody nogroup      0 Mar 24 17:46 test_images\n\n-rw-r--r-- 1 nobody nogroup 586183 Mar 24 17:46 train.csv\n\ndrwxr-xr-x 2 nobody nogroup      0 Mar 24 17:48 train_images\n\ntotal 596828\n\n-rw-r--r-- 1 nobody nogroup 282678666 Apr 20 10:46 epoch04-valid_acc0.9561-valid_f10.8634.ckpt\n\n-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_1_9394.34604.pt\n\n-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_3_9372.87529.pt\n\n-rw-r--r-- 1 nobody nogroup 109489615 Apr 20 10:45 model_val_4_9431.91984.pt\n\ndrwxr-xr-x 2 nobody nogroup         0 Apr 20 10:45 pytorch-packages\n\ntotal 516\n\n-rw-r--r-- 1 nobody nogroup 527629 Apr 20 10:45 pytorchcv-0.0.65-py2.py3-none-any.whl\n\nLooking in links: /tmp/pip/cache/\n\nProcessing /tmp/pip/cache/pytorchcv-0.0.65-py2.py3-none-any.whl\n\nRequirement already satisfied: requests in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (2.25.1)\n\nRequirement already satisfied: numpy in /opt/conda/lib/python3.7/site-packages (from pytorchcv) (1.19.5)\n\nRequirement already satisfied: chardet<5,>=3.0.2 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (3.0.4)\n\nRequirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (1.26.3)\n\nRequirement already satisfied: idna<3,>=2.5 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (2.10)\n\nRequirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.7/site-packages (from requests->pytorchcv) (2020.12.5)\n\nInstalling collected packages: pytorchcv\n\nSuccessfully installed pytorchcv-0.0.65\n\nlen(test_loader) 3\n\n../input/lightening-checkpoint1/model_val_3_9372.87529.pt\n\n                  image                      labels\n\n0  ad8770db05586b59.jpg  complex frog_eye_leaf_spot\n\n1  c7b03e718489f3ca.jpg          frog_eye_leaf_spot\n\n2  85f8cb619c66b863.jpg                     complex\n\n/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"remove_papermill_header.RemovePapermillHeader\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n\n  FutureWarning,\n\n[NbConvertApp] Converting notebook __notebook__.ipynb to notebook\n\n[NbConvertApp] Writing 76428 bytes to __notebook__.ipynb\n\n/opt/conda/lib/python3.7/site-packages/traitlets/traitlets.py:2561: FutureWarning: --Exporter.preprocessors=[\"nbconvert.preprocessors.ExtractOutputPreprocessor\"] for containers is deprecated in traitlets 5.0. You can pass `--Exporter.preprocessors item` ... multiple times to add items to a list.\n\n  FutureWarning,\n\n[NbConvertApp] Converting notebook __notebook__.ipynb to html\n\n[NbConvertApp] Writing 398206 bytes to __results__.html",
    "1279067": "Hi there,\n\nI don't really know how to solve the problem, but I noted 2 things that may help you.\n\n1 - this score is exactly the same you get when you create a submission file as 'healthy' for all images.\n2 - the output file has an index column (0,1,2,3...) and the 'submission_sample.csv' uses the image as index.\n\nI hope I can help.",
    "1279133": "Do you have \"Submission not found\" error?",
    "1279919": "atamazian yes... exactly... very sorry this competition is disabled uploading images...",
    "1281069": "This means that your code crashes on the private test dataset. I recommend you to double-check your code for any possible errors. (I agree, that 3 images is just too few for an abequate testing.)"
  },
  "source": "meta"
}