{
  "id": 493877,
  "title": "Why can't the test_soundscapes directory be read when submitting code ",
  "url": "/competitions/birdclef-2024/discussion/493877",
  "author_name": "",
  "post_date": "2024-04-15T07:32:39.027788100Z",
  "votes": 1,
  "comment_count": 7,
  "views": 0,
  "content": "<p>Hello, I used the pathlib to read the test audio file as follow code, but the output of file number always is 0. Is there something wrong?<br>\n*<br>\ntest_audio_dir = '/kaggle/input/birdclef-2024/test_soundscapes/'<br>\nrootdir = pathlib.Path(test_audio_dir)<br>\nfile_list = list(rootdir.rglob('*.ogg'))<br>\nprint('Number of test soundscapes:', len(file_list))<br>\n*<br>\nNumber of test soundscapes: 0</p>",
  "messages": [
    {
      "id": "2752872",
      "postDate": "04/15/2024 07:32:39",
      "content": "<p>Hello, I used the pathlib to read the test audio file as follow code, but the output of file number always is 0. Is there something wrong?<br>\n*<br>\ntest_audio_dir = '/kaggle/input/birdclef-2024/test_soundscapes/'<br>\nrootdir = pathlib.Path(test_audio_dir)<br>\nfile_list = list(rootdir.rglob('*.ogg'))<br>\nprint('Number of test soundscapes:', len(file_list))<br>\n*<br>\nNumber of test soundscapes: 0</p>",
      "rawMarkdown": "Hello, I used the pathlib to read the test audio file as follow code, but the output of file number always is 0. Is there something wrong?\n*\ntest_audio_dir = '/kaggle/input/birdclef-2024/test_soundscapes/'\nrootdir = pathlib.Path(test_audio_dir)\nfile_list = list(rootdir.rglob('*.ogg'))\nprint('Number of test soundscapes:', len(file_list))\n*\nNumber of test soundscapes: 0",
      "votes": null
    },
    {
      "id": "2752883",
      "postDate": "04/15/2024 07:44:16",
      "content": "<p>Test soundscapes are only visible during submission inference. When submitting the code above, it'll list the test files in the folder.</p>",
      "rawMarkdown": "Test soundscapes are only visible during submission inference. When submitting the code above, it'll list the test files in the folder.",
      "votes": null
    },
    {
      "id": "2758084",
      "postDate": "04/17/2024 23:46:07",
      "content": "<p>Hello</p>\n<p>No matter what I do, when I commit-submit, my notebook always reports zero files in the test_soundscapes folder. I understand this will be empty in non-commit-submit runs, but it is also empty when I commit-submit -- so I am unable to run my model on the competition test data.</p>\n<p>Any advice greatly appreciated.</p>\n<p>Here's my code:</p>\n<p>directory_in_str=\"/kaggle/input/birdclef-2024/test_soundscapes\"<br>\nrootdir = Path(directory_in_str)<br>\nfile_list = list(rootdir.rglob('*.ogg'))<br>\nprint('Number of test soundscapes:', len(file_list))</p>\n<p>Always prints Number of test soundscapes: 0 </p>",
      "rawMarkdown": "Hello\n\nNo matter what I do, when I commit-submit, my notebook always reports zero files in the test_soundscapes folder. I understand this will be empty in non-commit-submit runs, but it is also empty when I commit-submit -- so I am unable to run my model on the competition test data.\n\nAny advice greatly appreciated.\n\nHere's my code:\n\ndirectory_in_str=\"/kaggle/input/birdclef-2024/test_soundscapes\"\nrootdir = Path(directory_in_str)\nfile_list = list(rootdir.rglob('*.ogg'))\nprint('Number of test soundscapes:', len(file_list))\n\nAlways prints Number of test soundscapes: 0",
      "votes": null
    },
    {
      "id": "2759135",
      "postDate": "04/18/2024 13:56:28",
      "content": "<p>I use unlabel sound for the test, and the code submitted to the competition is worked well.</p>",
      "rawMarkdown": "I use unlabel sound for the test, and the code submitted to the competition is worked well.",
      "votes": null
    },
    {
      "id": "2759180",
      "postDate": "04/18/2024 14:22:01",
      "content": "<p>Thanks, Haitao. I do the same. I use the unlabelled soundscapes folder for testing, then the test soundscapes folder for submission. But every submission fails because the test soundscapes folder is always empty. So frustrating. I've tried everything I can think of e.g. using three different approaches to folder/file parsing. I simply cannot get the submissions to find any test data. I have no idea how others get this to work. It should not be so difficult!</p>",
      "rawMarkdown": "Thanks, Haitao. I do the same. I use the unlabelled soundscapes folder for testing, then the test soundscapes folder for submission. But every submission fails because the test soundscapes folder is always empty. So frustrating. I've tried everything I can think of e.g. using three different approaches to folder/file parsing. I simply cannot get the submissions to find any test data. I have no idea how others get this to work. It should not be so difficult!",
      "votes": null
    },
    {
      "id": "2759517",
      "postDate": "04/18/2024 18:02:22",
      "content": "<p>When you submit to the competition there will generate two events, one is your script version, which can't read the test data, and the other is the scoring for the competition, the scoring event will use the data from the tes_tsoundscapes folder.</p>",
      "rawMarkdown": "When you submit to the competition there will generate two events, one is your script version, which can't read the test data, and the other is the scoring for the competition, the scoring event will use the data from the tes_tsoundscapes folder.",
      "votes": null
    },
    {
      "id": "2759525",
      "postDate": "04/18/2024 18:10:58",
      "content": "<p>Thank you, again Haito. Is there anywhere in the portal where I can see those running events ?  All I see are the failing ones. They fail after about 60 seconds (because there is no data). I cannot see any other running notebooks/events…?</p>",
      "rawMarkdown": "Thank you, again Haito. Is there anywhere in the portal where I can see those running events ?  All I see are the failing ones. They fail after about 60 seconds (because there is no data). I cannot see any other running notebooks/events...?",
      "votes": null
    },
    {
      "id": "2760362",
      "postDate": "04/19/2024 09:08:57",
      "content": "<p>Hello Haitao. OK, I think I've got it now. It seems that the test_soundscapes always returns empty even though, behind the scenes, when processing a submission, it is not empty. This is confusing to say the least. Anyway, after two days of confusion, I can submit runs now. Thanks again for your help.</p>",
      "rawMarkdown": "Hello Haitao. OK, I think I've got it now. It seems that the test_soundscapes always returns empty even though, behind the scenes, when processing a submission, it is not empty. This is confusing to say the least. Anyway, after two days of confusion, I can submit runs now. Thanks again for your help.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2752883,
      "author_name": "stefankahl",
      "author_url": "",
      "post_date": "04/15/2024 07:44:16",
      "content": "<p>Test soundscapes are only visible during submission inference. When submitting the code above, it'll list the test files in the folder.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2758084,
      "author_name": "yusufjafry",
      "author_url": "",
      "post_date": "04/17/2024 23:46:07",
      "content": "<p>Hello</p>\n<p>No matter what I do, when I commit-submit, my notebook always reports zero files in the test_soundscapes folder. I understand this will be empty in non-commit-submit runs, but it is also empty when I commit-submit -- so I am unable to run my model on the competition test data.</p>\n<p>Any advice greatly appreciated.</p>\n<p>Here's my code:</p>\n<p>directory_in_str=\"/kaggle/input/birdclef-2024/test_soundscapes\"<br>\nrootdir = Path(directory_in_str)<br>\nfile_list = list(rootdir.rglob('*.ogg'))<br>\nprint('Number of test soundscapes:', len(file_list))</p>\n<p>Always prints Number of test soundscapes: 0 </p>",
      "votes": null,
      "replies": [
        {
          "id": 2759135,
          "author_name": "haitaowong",
          "author_url": "",
          "post_date": "04/18/2024 13:56:28",
          "content": "<p>I use unlabel sound for the test, and the code submitted to the competition is worked well.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2759180,
              "author_name": "yusufjafry",
              "author_url": "",
              "post_date": "04/18/2024 14:22:01",
              "content": "<p>Thanks, Haitao. I do the same. I use the unlabelled soundscapes folder for testing, then the test soundscapes folder for submission. But every submission fails because the test soundscapes folder is always empty. So frustrating. I've tried everything I can think of e.g. using three different approaches to folder/file parsing. I simply cannot get the submissions to find any test data. I have no idea how others get this to work. It should not be so difficult!</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2759517,
                  "author_name": "haitaowong",
                  "author_url": "",
                  "post_date": "04/18/2024 18:02:22",
                  "content": "<p>When you submit to the competition there will generate two events, one is your script version, which can't read the test data, and the other is the scoring for the competition, the scoring event will use the data from the tes_tsoundscapes folder.</p>",
                  "votes": null,
                  "replies": [
                    {
                      "id": 2759525,
                      "author_name": "yusufjafry",
                      "author_url": "",
                      "post_date": "04/18/2024 18:10:58",
                      "content": "<p>Thank you, again Haito. Is there anywhere in the portal where I can see those running events ?  All I see are the failing ones. They fail after about 60 seconds (because there is no data). I cannot see any other running notebooks/events…?</p>",
                      "votes": null,
                      "replies": []
                    }
                  ]
                }
              ]
            },
            {
              "id": 2760362,
              "author_name": "yusufjafry",
              "author_url": "",
              "post_date": "04/19/2024 09:08:57",
              "content": "<p>Hello Haitao. OK, I think I've got it now. It seems that the test_soundscapes always returns empty even though, behind the scenes, when processing a submission, it is not empty. This is confusing to say the least. Anyway, after two days of confusion, I can submit runs now. Thanks again for your help.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2752872": "Hello, I used the pathlib to read the test audio file as follow code, but the output of file number always is 0. Is there something wrong?\n*\ntest_audio_dir = '/kaggle/input/birdclef-2024/test_soundscapes/'\nrootdir = pathlib.Path(test_audio_dir)\nfile_list = list(rootdir.rglob('*.ogg'))\nprint('Number of test soundscapes:', len(file_list))\n*\nNumber of test soundscapes: 0",
    "2752883": "Test soundscapes are only visible during submission inference. When submitting the code above, it'll list the test files in the folder.",
    "2758084": "Hello\n\nNo matter what I do, when I commit-submit, my notebook always reports zero files in the test_soundscapes folder. I understand this will be empty in non-commit-submit runs, but it is also empty when I commit-submit -- so I am unable to run my model on the competition test data.\n\nAny advice greatly appreciated.\n\nHere's my code:\n\ndirectory_in_str=\"/kaggle/input/birdclef-2024/test_soundscapes\"\nrootdir = Path(directory_in_str)\nfile_list = list(rootdir.rglob('*.ogg'))\nprint('Number of test soundscapes:', len(file_list))\n\nAlways prints Number of test soundscapes: 0",
    "2759135": "I use unlabel sound for the test, and the code submitted to the competition is worked well.",
    "2759180": "Thanks, Haitao. I do the same. I use the unlabelled soundscapes folder for testing, then the test soundscapes folder for submission. But every submission fails because the test soundscapes folder is always empty. So frustrating. I've tried everything I can think of e.g. using three different approaches to folder/file parsing. I simply cannot get the submissions to find any test data. I have no idea how others get this to work. It should not be so difficult!",
    "2759517": "When you submit to the competition there will generate two events, one is your script version, which can't read the test data, and the other is the scoring for the competition, the scoring event will use the data from the tes_tsoundscapes folder.",
    "2759525": "Thank you, again Haito. Is there anywhere in the portal where I can see those running events ?  All I see are the failing ones. They fail after about 60 seconds (because there is no data). I cannot see any other running notebooks/events...?",
    "2760362": "Hello Haitao. OK, I think I've got it now. It seems that the test_soundscapes always returns empty even though, behind the scenes, when processing a submission, it is not empty. This is confusing to say the least. Anyway, after two days of confusion, I can submit runs now. Thanks again for your help."
  },
  "source": "meta"
}