{
  "id": 159731,
  "title": "potentially corrupt file found in train_audio",
  "url": "/competitions/birdsong-recognition/discussion/159731",
  "author_name": "",
  "post_date": "2020-06-18T14:36:32.873475Z",
  "votes": 5,
  "comment_count": 9,
  "views": 0,
  "content": "<p>I found that I was unable to read <code>train_audio/lotduc/XC195038.mp3</code> using <code>librosa</code>. You might want to remove this file after you download the data to ensure you don't get an error while training / processing data.</p>\n\n<p>(maybe the file can be read via something else, have not looked into what is causing the problem)</p>",
  "messages": [
    {
      "id": "891923",
      "postDate": "06/18/2020 14:36:32",
      "content": "<p>I found that I was unable to read <code>train_audio/lotduc/XC195038.mp3</code> using <code>librosa</code>. You might want to remove this file after you download the data to ensure you don't get an error while training / processing data.</p>\n\n<p>(maybe the file can be read via something else, have not looked into what is causing the problem)</p>",
      "rawMarkdown": "I found that I was unable to read `train_audio/lotduc/XC195038.mp3` using `librosa`. You might want to remove this file after you download the data to ensure you don't get an error while training / processing data.\n\n(maybe the file can be read via something else, have not looked into what is causing the problem)",
      "votes": null
    },
    {
      "id": "892001",
      "postDate": "06/18/2020 15:32:58",
      "content": "<p>It may be because the file has two channels? I have been able to read it in using pydub.</p>",
      "rawMarkdown": "It may be because the file has two channels? I have been able to read it in using pydub.",
      "votes": null
    },
    {
      "id": "892501",
      "postDate": "06/18/2020 23:54:35",
      "content": "<p>I also faced that problem and removed it</p>",
      "rawMarkdown": "I also faced that problem and removed it",
      "votes": null
    },
    {
      "id": "892802",
      "postDate": "06/19/2020 07:03:46",
      "content": "<p>In my kernel I see significantly more files being problematic, only a handful, but more than just the one you mentioned. I don't believe it is an issue related to mono vs stereo because librosa has a setting to crush the audio down to mono. </p>",
      "rawMarkdown": "In my kernel I see significantly more files being problematic, only a handful, but more than just the one you mentioned. I don't believe it is an issue related to mono vs stereo because librosa has a setting to crush the audio down to mono.",
      "votes": null
    },
    {
      "id": "892818",
      "postDate": "06/19/2020 07:22:27",
      "content": "<p>Could you list a few more of these problem files?</p>",
      "rawMarkdown": "Could you list a few more of these problem files?",
      "votes": null
    },
    {
      "id": "892820",
      "postDate": "06/19/2020 07:24:48",
      "content": "<p>I did not save them in any way. I just showed in my kernel that the spectrogram generation is failing for whatever reason. I havent had the time to inspect and it seemed to be relatively rare so I skimmed over it for now. Just want to get a skeleton up that can at least make reasonable predictions. </p>\n\n<p><a href=\"https://www.kaggle.com/ryches/birdsong-data-prep-datasetpls\">https://www.kaggle.com/ryches/birdsong-data-prep-datasetpls</a></p>",
      "rawMarkdown": "I did not save them in any way. I just showed in my kernel that the spectrogram generation is failing for whatever reason. I havent had the time to inspect and it seemed to be relatively rare so I skimmed over it for now. Just want to get a skeleton up that can at least make reasonable predictions. \n\nhttps://www.kaggle.com/ryches/birdsong-data-prep-datasetpls",
      "votes": null
    },
    {
      "id": "892821",
      "postDate": "06/19/2020 07:25:47",
      "content": "<p>wrapped generation in a try except and printed off every time it failed \"spectrogram generation failed\"</p>",
      "rawMarkdown": "wrapped generation in a try except and printed off every time it failed \"spectrogram generation failed\"",
      "votes": null
    },
    {
      "id": "892823",
      "postDate": "06/19/2020 07:27:08",
      "content": "<p><a href=\"https://librosa.org/librosa/generated/librosa.core.load.html#librosa.core.load\">https://librosa.org/librosa/generated/librosa.core.load.html#librosa.core.load</a></p>\n\n<p>default behavior is to convert to mono. hence why I dont think multi-channel should really be an issue. </p>",
      "rawMarkdown": "https://librosa.org/librosa/generated/librosa.core.load.html#librosa.core.load\n\ndefault behavior is to convert to mono. hence why I dont think multi-channel should really be an issue.",
      "votes": null
    },
    {
      "id": "892829",
      "postDate": "06/19/2020 07:32:24",
      "content": "<p>Not sure what it may be then. If you find some files that don't work can you post the file names?</p>",
      "rawMarkdown": "Not sure what it may be then. If you find some files that don't work can you post the file names?",
      "votes": null
    },
    {
      "id": "963164",
      "postDate": "08/08/2020 18:08:40",
      "content": "<p>Was able to load it via ffmpeg version 2.x.x</p>",
      "rawMarkdown": "Was able to load it via ffmpeg version 2.x.x",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 963164,
      "author_name": "yaroshevskiy",
      "author_url": "",
      "post_date": "08/08/2020 18:08:40",
      "content": "<p>Was able to load it via ffmpeg version 2.x.x</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 892001,
      "author_name": "cwthompson",
      "author_url": "",
      "post_date": "06/18/2020 15:32:58",
      "content": "<p>It may be because the file has two channels? I have been able to read it in using pydub.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 892501,
      "author_name": "hidehisaarai1213",
      "author_url": "",
      "post_date": "06/18/2020 23:54:35",
      "content": "<p>I also faced that problem and removed it</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 892802,
      "author_name": "ryches",
      "author_url": "",
      "post_date": "06/19/2020 07:03:46",
      "content": "<p>In my kernel I see significantly more files being problematic, only a handful, but more than just the one you mentioned. I don't believe it is an issue related to mono vs stereo because librosa has a setting to crush the audio down to mono. </p>",
      "votes": null,
      "replies": [
        {
          "id": 892818,
          "author_name": "cwthompson",
          "author_url": "",
          "post_date": "06/19/2020 07:22:27",
          "content": "<p>Could you list a few more of these problem files?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 892820,
          "author_name": "ryches",
          "author_url": "",
          "post_date": "06/19/2020 07:24:48",
          "content": "<p>I did not save them in any way. I just showed in my kernel that the spectrogram generation is failing for whatever reason. I havent had the time to inspect and it seemed to be relatively rare so I skimmed over it for now. Just want to get a skeleton up that can at least make reasonable predictions. </p>\n\n<p><a href=\"https://www.kaggle.com/ryches/birdsong-data-prep-datasetpls\">https://www.kaggle.com/ryches/birdsong-data-prep-datasetpls</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 892821,
          "author_name": "ryches",
          "author_url": "",
          "post_date": "06/19/2020 07:25:47",
          "content": "<p>wrapped generation in a try except and printed off every time it failed \"spectrogram generation failed\"</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 892823,
          "author_name": "ryches",
          "author_url": "",
          "post_date": "06/19/2020 07:27:08",
          "content": "<p><a href=\"https://librosa.org/librosa/generated/librosa.core.load.html#librosa.core.load\">https://librosa.org/librosa/generated/librosa.core.load.html#librosa.core.load</a></p>\n\n<p>default behavior is to convert to mono. hence why I dont think multi-channel should really be an issue. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 892829,
          "author_name": "cwthompson",
          "author_url": "",
          "post_date": "06/19/2020 07:32:24",
          "content": "<p>Not sure what it may be then. If you find some files that don't work can you post the file names?</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "891923": "I found that I was unable to read `train_audio/lotduc/XC195038.mp3` using `librosa`. You might want to remove this file after you download the data to ensure you don't get an error while training / processing data.\n\n(maybe the file can be read via something else, have not looked into what is causing the problem)",
    "892001": "It may be because the file has two channels? I have been able to read it in using pydub.",
    "892501": "I also faced that problem and removed it",
    "892802": "In my kernel I see significantly more files being problematic, only a handful, but more than just the one you mentioned. I don't believe it is an issue related to mono vs stereo because librosa has a setting to crush the audio down to mono.",
    "892818": "Could you list a few more of these problem files?",
    "892820": "I did not save them in any way. I just showed in my kernel that the spectrogram generation is failing for whatever reason. I havent had the time to inspect and it seemed to be relatively rare so I skimmed over it for now. Just want to get a skeleton up that can at least make reasonable predictions. \n\nhttps://www.kaggle.com/ryches/birdsong-data-prep-datasetpls",
    "892821": "wrapped generation in a try except and printed off every time it failed \"spectrogram generation failed\"",
    "892823": "https://librosa.org/librosa/generated/librosa.core.load.html#librosa.core.load\n\ndefault behavior is to convert to mono. hence why I dont think multi-channel should really be an issue.",
    "892829": "Not sure what it may be then. If you find some files that don't work can you post the file names?",
    "963164": "Was able to load it via ffmpeg version 2.x.x"
  },
  "source": "meta"
}