{
  "id": 499692,
  "title": "test_soundscapes is not populating despite submitting notebook",
  "url": "/competitions/birdclef-2024/discussion/499692",
  "author_name": "",
  "post_date": "2024-05-02T17:07:55.928022200Z",
  "votes": 1,
  "comment_count": 12,
  "views": 0,
  "content": "<p>I am not much familiar notebook style submission, and am having difficulties. I submitted a notebook with sample submissions a number of times, and I got 0.5 as expected; however, my test_soundscapes folder is never populated. I guess I need the test audio files to make the predictions and submit. Am I missing something like a specific parameter setting, or doing something wrong, any thoughts?</p>",
  "messages": [
    {
      "id": "2789440",
      "postDate": "05/02/2024 17:07:55",
      "content": "<p>I am not much familiar notebook style submission, and am having difficulties. I submitted a notebook with sample submissions a number of times, and I got 0.5 as expected; however, my test_soundscapes folder is never populated. I guess I need the test audio files to make the predictions and submit. Am I missing something like a specific parameter setting, or doing something wrong, any thoughts?</p>",
      "rawMarkdown": "I am not much familiar notebook style submission, and am having difficulties. I submitted a notebook with sample submissions a number of times, and I got 0.5 as expected; however, my test_soundscapes folder is never populated. I guess I need the test audio files to make the predictions and submit. Am I missing something like a specific parameter setting, or doing something wrong, any thoughts?",
      "votes": null
    },
    {
      "id": "2789928",
      "postDate": "05/02/2024 22:48:57",
      "content": "<p>Hello! </p>\n<p>The test files are only visible to the notebook running /during submission/ - they are not observable by humans such as (hopefully) yourself.</p>",
      "rawMarkdown": "Hello! \n\nThe test files are only visible to the notebook running /during submission/ - they are not observable by humans such as (hopefully) yourself.",
      "votes": null
    },
    {
      "id": "2790915",
      "postDate": "05/03/2024 11:41:48",
      "content": "<p>On what dataset can I do the inference for submissions, considering the test data is unreachable? I tried unlabeled dataset but then the submission fails. This is I find hard to understand.</p>",
      "rawMarkdown": "On what dataset can I do the inference for submissions, considering the test data is unreachable? I tried unlabeled dataset but then the submission fails. This is I find hard to understand.",
      "votes": null
    },
    {
      "id": "2791505",
      "postDate": "05/03/2024 17:31:15",
      "content": "<p>Hi; check the 'Data' description in the competition description. While the submission notebook is running, it will have access to the test files. </p>\n<p>It will also be helpful to start from one of the basic submission notebooks, like this one:<br>\n<a href=\"https://www.kaggle.com/code/myso1987/how-to-submit-to-birdclef-2024\" target=\"_blank\">https://www.kaggle.com/code/myso1987/how-to-submit-to-birdclef-2024</a><br>\nAdapting this code will make it easier to focus on modeling, rather than spending a lot of time getting the submission format right.</p>",
      "rawMarkdown": "Hi; check the 'Data' description in the competition description. While the submission notebook is running, it will have access to the test files. \n\nIt will also be helpful to start from one of the basic submission notebooks, like this one:\nhttps://www.kaggle.com/code/myso1987/how-to-submit-to-birdclef-2024\nAdapting this code will make it easier to focus on modeling, rather than spending a lot of time getting the submission format right.",
      "votes": null
    },
    {
      "id": "2823079",
      "postDate": "05/19/2024 03:07:53",
      "content": "<p><a href=\"https://www.kaggle.com/tomdenton\" target=\"_blank\">@tomdenton</a> </p>\n<p>Hello, I apologize for jumping into the thread.<br>\nI copied your code above, and submit to verify the \"test_soundscapes\" whether it works or not.<br>\nbut, displayed ”Number of test soundscapes: 0”.</p>\n<p>In \"Session options\" , I toggled \"Internet\" and turn of the Internet.<br>\nThen, in \"Submit to competition\", I pressed the \"submit\" button.<br>\nWhat should I do anything else?<br>\nCould you tell me how to submit in this competion?</p>",
      "rawMarkdown": "tomdenton \n\nHello, I apologize for jumping into the thread.\nI copied your code above, and submit to verify the \"test_soundscapes\" whether it works or not.\nbut, displayed ”Number of test soundscapes: 0”.\n\nIn \"Session options\" , I toggled \"Internet\" and turn of the Internet.\nThen, in \"Submit to competition\", I pressed the \"submit\" button.\nWhat should I do anything else?\nCould you tell me how to submit in this competion?",
      "votes": null
    },
    {
      "id": "2823756",
      "postDate": "05/19/2024 12:04:29",
      "content": "<p>If you submit you can't see any prints. Maybe you saved your notebook, and did not submit it?</p>",
      "rawMarkdown": "If you submit you can't see any prints. Maybe you saved your notebook, and did not submit it?",
      "votes": null
    },
    {
      "id": "2823803",
      "postDate": "05/19/2024 12:29:48",
      "content": "<p>Thank you for your responce.</p>\n<p>I pressed the \"submit\" button, followed by \"Save and Run all\" was done.<br>\nSo, I was aware of \"Submission was done\".<br>\nBut Notebooks log opened by \"Open logs in viewer\" displayed \"Number of test soundscapes: 0\".<br>\nIs this method incorrect?</p>",
      "rawMarkdown": "Thank you for your responce.\n\nI pressed the \"submit\" button, followed by \"Save and Run all\" was done.\nSo, I was aware of \"Submission was done\".\nBut Notebooks log opened by \"Open logs in viewer\" displayed \"Number of test soundscapes: 0\".\nIs this method incorrect?",
      "votes": null
    },
    {
      "id": "2823965",
      "postDate": "05/19/2024 14:05:24",
      "content": "<p>\"Save and Run all\" is saving your notebook, not submitting it.</p>",
      "rawMarkdown": "\"Save and Run all\" is saving your notebook, not submitting it.",
      "votes": null
    },
    {
      "id": "2824581",
      "postDate": "05/19/2024 21:22:56",
      "content": "<p>Thank you for your responce.</p>\n<p>I'm sorry for my poor explanation.<br>\nWhen the ”Submit” button was pressed, the notebook was run all at the same time.<br>\nBut you meant that it was not inference, didn't you?</p>\n<p>If you don't mind, could you tell me how to submit in your way?</p>",
      "rawMarkdown": "Thank you for your responce.\n\nI'm sorry for my poor explanation.\nWhen the ”Submit” button was pressed, the notebook was run all at the same time.\nBut you meant that it was not inference, didn't you?\n\nIf you don't mind, could you tell me how to submit in your way?",
      "votes": null
    },
    {
      "id": "2824677",
      "postDate": "05/20/2024 01:36:27",
      "content": "<p>You cannot see the log of what happens when you submit.</p>",
      "rawMarkdown": "You cannot see the log of what happens when you submit.",
      "votes": null
    },
    {
      "id": "2825395",
      "postDate": "05/20/2024 11:27:01",
      "content": "<p>Thank you for your responce in many times.<br>\nIn Competition top page, and \"Submission\" tab, we can select submitted notebook for scoring.<br>\nAnd we can open notebook preview in inference.<br>\nThe logs for inference is displayed, is it correct?<br>\nFor collecting test data, the code in my notebook was below.<br>\n<code>ROOT_FOLDER = '/kaggle/input/birdclef-2024'</code><br>\n<code>test_audio_dir = '../input/birdclef-2024/test_soundscapes/'</code><br>\n<code>audio_folder = True</code><br>\n<code>ogg_file_paths = [f for f in sorted(os.listdir(test_audio_dir))]</code><br>\n<code>ogg_file_paths = [file.split('.')[0] for file in ogg_file_paths if file.endswith('.ogg')]</code><br>\n<code>if len(ogg_file_paths) == 0:</code><br>\n<code>ogg_file_paths = sorted(glob.glob(f'{ROOT_FOLDER}/unlabeled_soundscapes/*.ogg'))[:10]</code><br>\n<code>audio_folder = False</code><br>\n<code>print(audio_folder)</code><br>\n<code>print(ogg_file_paths[:5])</code></p>\n<p>And displayed like below.<br>\n<code>False</code><br>\n<code>['/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000170626.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000308629.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000389428.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000424265.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000450112.ogg']</code><br>\nAnd \"Notebook Threw Exception\" error occured that is because unlabeled data were used for inference, then submission.csv was smaller.<br>\nI have no idea for correct submission…</p>",
      "rawMarkdown": "Thank you for your responce in many times.\nIn Competition top page, and \"Submission\" tab, we can select submitted notebook for scoring.\nAnd we can open notebook preview in inference.\nThe logs for inference is displayed, is it correct?\nFor collecting test data, the code in my notebook was below.\n`ROOT_FOLDER = '/kaggle/input/birdclef-2024'`\n`test_audio_dir = '../input/birdclef-2024/test_soundscapes/'`\n`audio_folder = True`\n`ogg_file_paths = [f for f in sorted(os.listdir(test_audio_dir))]`\n`ogg_file_paths = [file.split('.')[0] for file in ogg_file_paths if file.endswith('.ogg')]`\n`if len(ogg_file_paths) == 0:`\n`    ogg_file_paths = sorted(glob.glob(f'{ROOT_FOLDER}/unlabeled_soundscapes/*.ogg'))[:10]`\n`    audio_folder = False`\n`print(audio_folder)`\n`print(ogg_file_paths[:5])`\n\nAnd displayed like below.\n`False`\n`['/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000170626.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000308629.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000389428.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000424265.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000450112.ogg']`\nAnd \"Notebook Threw Exception\" error occured that is because unlabeled data were used for inference, then submission.csv was smaller.\nI have no idea for correct submission...",
      "votes": null
    },
    {
      "id": "2825499",
      "postDate": "05/20/2024 12:44:53",
      "content": "<p>You see the log of the run that happens when you save the notebook. When you submit a new run starts with test data. You cannot see the log of the submit run.</p>",
      "rawMarkdown": "You see the log of the run that happens when you save the notebook. When you submit a new run starts with test data. You cannot see the log of the submit run.",
      "votes": null
    },
    {
      "id": "2825592",
      "postDate": "05/20/2024 13:40:29",
      "content": "<p>Oh…<br>\nYou meant my notebook reached test data, but any other bug caused \"Notebook Threw Exception\" error?<br>\n\"Save and Run all\" was correctly done, then how do I solve this problem?</p>",
      "rawMarkdown": "Oh...\nYou meant my notebook reached test data, but any other bug caused \"Notebook Threw Exception\" error?\n\"Save and Run all\" was correctly done, then how do I solve this problem?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2789928,
      "author_name": "tomdenton",
      "author_url": "",
      "post_date": "05/02/2024 22:48:57",
      "content": "<p>Hello! </p>\n<p>The test files are only visible to the notebook running /during submission/ - they are not observable by humans such as (hopefully) yourself.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2790915,
          "author_name": "gurselkaracor",
          "author_url": "",
          "post_date": "05/03/2024 11:41:48",
          "content": "<p>On what dataset can I do the inference for submissions, considering the test data is unreachable? I tried unlabeled dataset but then the submission fails. This is I find hard to understand.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2791505,
              "author_name": "tomdenton",
              "author_url": "",
              "post_date": "05/03/2024 17:31:15",
              "content": "<p>Hi; check the 'Data' description in the competition description. While the submission notebook is running, it will have access to the test files. </p>\n<p>It will also be helpful to start from one of the basic submission notebooks, like this one:<br>\n<a href=\"https://www.kaggle.com/code/myso1987/how-to-submit-to-birdclef-2024\" target=\"_blank\">https://www.kaggle.com/code/myso1987/how-to-submit-to-birdclef-2024</a><br>\nAdapting this code will make it easier to focus on modeling, rather than spending a lot of time getting the submission format right.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2823079,
                  "author_name": "asdfgkaggle",
                  "author_url": "",
                  "post_date": "05/19/2024 03:07:53",
                  "content": "<p><a href=\"https://www.kaggle.com/tomdenton\" target=\"_blank\">@tomdenton</a> </p>\n<p>Hello, I apologize for jumping into the thread.<br>\nI copied your code above, and submit to verify the \"test_soundscapes\" whether it works or not.<br>\nbut, displayed ”Number of test soundscapes: 0”.</p>\n<p>In \"Session options\" , I toggled \"Internet\" and turn of the Internet.<br>\nThen, in \"Submit to competition\", I pressed the \"submit\" button.<br>\nWhat should I do anything else?<br>\nCould you tell me how to submit in this competion?</p>",
                  "votes": null,
                  "replies": [
                    {
                      "id": 2823756,
                      "author_name": "cpmpml",
                      "author_url": "",
                      "post_date": "05/19/2024 12:04:29",
                      "content": "<p>If you submit you can't see any prints. Maybe you saved your notebook, and did not submit it?</p>",
                      "votes": null,
                      "replies": [
                        {
                          "id": 2823803,
                          "author_name": "asdfgkaggle",
                          "author_url": "",
                          "post_date": "05/19/2024 12:29:48",
                          "content": "<p>Thank you for your responce.</p>\n<p>I pressed the \"submit\" button, followed by \"Save and Run all\" was done.<br>\nSo, I was aware of \"Submission was done\".<br>\nBut Notebooks log opened by \"Open logs in viewer\" displayed \"Number of test soundscapes: 0\".<br>\nIs this method incorrect?</p>",
                          "votes": null,
                          "replies": [
                            {
                              "id": 2823965,
                              "author_name": "cpmpml",
                              "author_url": "",
                              "post_date": "05/19/2024 14:05:24",
                              "content": "<p>\"Save and Run all\" is saving your notebook, not submitting it.</p>",
                              "votes": null,
                              "replies": [
                                {
                                  "id": 2824581,
                                  "author_name": "asdfgkaggle",
                                  "author_url": "",
                                  "post_date": "05/19/2024 21:22:56",
                                  "content": "<p>Thank you for your responce.</p>\n<p>I'm sorry for my poor explanation.<br>\nWhen the ”Submit” button was pressed, the notebook was run all at the same time.<br>\nBut you meant that it was not inference, didn't you?</p>\n<p>If you don't mind, could you tell me how to submit in your way?</p>",
                                  "votes": null,
                                  "replies": [
                                    {
                                      "id": 2824677,
                                      "author_name": "cpmpml",
                                      "author_url": "",
                                      "post_date": "05/20/2024 01:36:27",
                                      "content": "<p>You cannot see the log of what happens when you submit.</p>",
                                      "votes": null,
                                      "replies": [
                                        {
                                          "id": 2825395,
                                          "author_name": "asdfgkaggle",
                                          "author_url": "",
                                          "post_date": "05/20/2024 11:27:01",
                                          "content": "<p>Thank you for your responce in many times.<br>\nIn Competition top page, and \"Submission\" tab, we can select submitted notebook for scoring.<br>\nAnd we can open notebook preview in inference.<br>\nThe logs for inference is displayed, is it correct?<br>\nFor collecting test data, the code in my notebook was below.<br>\n<code>ROOT_FOLDER = '/kaggle/input/birdclef-2024'</code><br>\n<code>test_audio_dir = '../input/birdclef-2024/test_soundscapes/'</code><br>\n<code>audio_folder = True</code><br>\n<code>ogg_file_paths = [f for f in sorted(os.listdir(test_audio_dir))]</code><br>\n<code>ogg_file_paths = [file.split('.')[0] for file in ogg_file_paths if file.endswith('.ogg')]</code><br>\n<code>if len(ogg_file_paths) == 0:</code><br>\n<code>ogg_file_paths = sorted(glob.glob(f'{ROOT_FOLDER}/unlabeled_soundscapes/*.ogg'))[:10]</code><br>\n<code>audio_folder = False</code><br>\n<code>print(audio_folder)</code><br>\n<code>print(ogg_file_paths[:5])</code></p>\n<p>And displayed like below.<br>\n<code>False</code><br>\n<code>['/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000170626.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000308629.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000389428.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000424265.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000450112.ogg']</code><br>\nAnd \"Notebook Threw Exception\" error occured that is because unlabeled data were used for inference, then submission.csv was smaller.<br>\nI have no idea for correct submission…</p>",
                                          "votes": null,
                                          "replies": [
                                            {
                                              "id": 2825499,
                                              "author_name": "cpmpml",
                                              "author_url": "",
                                              "post_date": "05/20/2024 12:44:53",
                                              "content": "<p>You see the log of the run that happens when you save the notebook. When you submit a new run starts with test data. You cannot see the log of the submit run.</p>",
                                              "votes": null,
                                              "replies": [
                                                {
                                                  "id": 2825592,
                                                  "author_name": "asdfgkaggle",
                                                  "author_url": "",
                                                  "post_date": "05/20/2024 13:40:29",
                                                  "content": "<p>Oh…<br>\nYou meant my notebook reached test data, but any other bug caused \"Notebook Threw Exception\" error?<br>\n\"Save and Run all\" was correctly done, then how do I solve this problem?</p>",
                                                  "votes": null,
                                                  "replies": []
                                                }
                                              ]
                                            }
                                          ]
                                        }
                                      ]
                                    }
                                  ]
                                }
                              ]
                            }
                          ]
                        }
                      ]
                    }
                  ]
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2789440": "I am not much familiar notebook style submission, and am having difficulties. I submitted a notebook with sample submissions a number of times, and I got 0.5 as expected; however, my test_soundscapes folder is never populated. I guess I need the test audio files to make the predictions and submit. Am I missing something like a specific parameter setting, or doing something wrong, any thoughts?",
    "2789928": "Hello! \n\nThe test files are only visible to the notebook running /during submission/ - they are not observable by humans such as (hopefully) yourself.",
    "2790915": "On what dataset can I do the inference for submissions, considering the test data is unreachable? I tried unlabeled dataset but then the submission fails. This is I find hard to understand.",
    "2791505": "Hi; check the 'Data' description in the competition description. While the submission notebook is running, it will have access to the test files. \n\nIt will also be helpful to start from one of the basic submission notebooks, like this one:\nhttps://www.kaggle.com/code/myso1987/how-to-submit-to-birdclef-2024\nAdapting this code will make it easier to focus on modeling, rather than spending a lot of time getting the submission format right.",
    "2823079": "tomdenton \n\nHello, I apologize for jumping into the thread.\nI copied your code above, and submit to verify the \"test_soundscapes\" whether it works or not.\nbut, displayed ”Number of test soundscapes: 0”.\n\nIn \"Session options\" , I toggled \"Internet\" and turn of the Internet.\nThen, in \"Submit to competition\", I pressed the \"submit\" button.\nWhat should I do anything else?\nCould you tell me how to submit in this competion?",
    "2823756": "If you submit you can't see any prints. Maybe you saved your notebook, and did not submit it?",
    "2823803": "Thank you for your responce.\n\nI pressed the \"submit\" button, followed by \"Save and Run all\" was done.\nSo, I was aware of \"Submission was done\".\nBut Notebooks log opened by \"Open logs in viewer\" displayed \"Number of test soundscapes: 0\".\nIs this method incorrect?",
    "2823965": "\"Save and Run all\" is saving your notebook, not submitting it.",
    "2824581": "Thank you for your responce.\n\nI'm sorry for my poor explanation.\nWhen the ”Submit” button was pressed, the notebook was run all at the same time.\nBut you meant that it was not inference, didn't you?\n\nIf you don't mind, could you tell me how to submit in your way?",
    "2824677": "You cannot see the log of what happens when you submit.",
    "2825395": "Thank you for your responce in many times.\nIn Competition top page, and \"Submission\" tab, we can select submitted notebook for scoring.\nAnd we can open notebook preview in inference.\nThe logs for inference is displayed, is it correct?\nFor collecting test data, the code in my notebook was below.\n`ROOT_FOLDER = '/kaggle/input/birdclef-2024'`\n`test_audio_dir = '../input/birdclef-2024/test_soundscapes/'`\n`audio_folder = True`\n`ogg_file_paths = [f for f in sorted(os.listdir(test_audio_dir))]`\n`ogg_file_paths = [file.split('.')[0] for file in ogg_file_paths if file.endswith('.ogg')]`\n`if len(ogg_file_paths) == 0:`\n`    ogg_file_paths = sorted(glob.glob(f'{ROOT_FOLDER}/unlabeled_soundscapes/*.ogg'))[:10]`\n`    audio_folder = False`\n`print(audio_folder)`\n`print(ogg_file_paths[:5])`\n\nAnd displayed like below.\n`False`\n`['/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000170626.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000308629.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000389428.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000424265.ogg', '/kaggle/input/birdclef-2024/unlabeled_soundscapes/1000450112.ogg']`\nAnd \"Notebook Threw Exception\" error occured that is because unlabeled data were used for inference, then submission.csv was smaller.\nI have no idea for correct submission...",
    "2825499": "You see the log of the run that happens when you save the notebook. When you submit a new run starts with test data. You cannot see the log of the submit run.",
    "2825592": "Oh...\nYou meant my notebook reached test data, but any other bug caused \"Notebook Threw Exception\" error?\n\"Save and Run all\" was correctly done, then how do I solve this problem?"
  },
  "source": "meta"
}