{
  "id": 96002,
  "title": "error in 2nd stage test ",
  "url": "/competitions/freesound-audio-tagging-2019/discussion/96002",
  "author_name": "",
  "post_date": "2019-06-17T05:57:42.413376500Z",
  "votes": 5,
  "comment_count": 11,
  "views": 0,
  "content": "<p>This is our first experience on kernel-only competition in Kaggle. </p>\n\n<p>When we ran our kernel in 2nd stage test, it ran for two hours without any results. Then we found out that our kernel ran out of memory during data preprocessing and it will cause kernel to restart repeatedly. In 1st stage test, we only control time limit but ignore memory restrictions. This is a painful lesson for us. Did anyone meet the same errors?</p>\n\n<p>Good luck to everyone! </p>",
  "messages": [
    {
      "id": "554192",
      "postDate": "06/17/2019 05:57:42",
      "content": "<p>This is our first experience on kernel-only competition in Kaggle. </p>\n\n<p>When we ran our kernel in 2nd stage test, it ran for two hours without any results. Then we found out that our kernel ran out of memory during data preprocessing and it will cause kernel to restart repeatedly. In 1st stage test, we only control time limit but ignore memory restrictions. This is a painful lesson for us. Did anyone meet the same errors?</p>\n\n<p>Good luck to everyone! </p>",
      "rawMarkdown": "This is our first experience on kernel-only competition in Kaggle. \n\nWhen we ran our kernel in 2nd stage test, it ran for two hours without any results. Then we found out that our kernel ran out of memory during data preprocessing and it will cause kernel to restart repeatedly. In 1st stage test, we only control time limit but ignore memory restrictions. This is a painful lesson for us. Did anyone meet the same errors?\n\nGood luck to everyone!",
      "votes": null
    },
    {
      "id": "554298",
      "postDate": "06/17/2019 08:41:20",
      "content": "<p>You should use 3 times test-set in 1st stage to make sure there are no problems with your kernel, hope you can get a good result next time.</p>",
      "rawMarkdown": "You should use 3 times test-set in 1st stage to make sure there are no problems with your kernel, hope you can get a good result next time.",
      "votes": null
    },
    {
      "id": "554314",
      "postDate": "06/17/2019 08:59:28",
      "content": "<p>I am sorry for you..</p>\n\n<p>I think kaggle team is working on a better version. The instant gratification comp is an example of synchronous kernel submission, where the 2nd stage will run in real time in background, so you will know whether there is any error just after your submission.  So hopefully such painful experiences will not happen again..</p>",
      "rawMarkdown": "I am sorry for you..\n\nI think kaggle team is working on a better version. The instant gratification comp is an example of synchronous kernel submission, where the 2nd stage will run in real time in background, so you will know whether there is any error just after your submission.  So hopefully such painful experiences will not happen again..",
      "votes": null
    },
    {
      "id": "554475",
      "postDate": "06/17/2019 13:17:54",
      "content": "<p>Do we have to run on the new test set by ourselves? I thought Kaggle will re-run it automatically</p>",
      "rawMarkdown": "Do we have to run on the new test set by ourselves? I thought Kaggle will re-run it automatically",
      "votes": null
    },
    {
      "id": "554476",
      "postDate": "06/17/2019 13:19:06",
      "content": "<p>I am truly sorry for that to happen. But your public LB is super splendid anyway! Could you please share your method and get a gold discussion medal instead ?</p>",
      "rawMarkdown": "I am truly sorry for that to happen. But your public LB is super splendid anyway! Could you please share your method and get a gold discussion medal instead ?",
      "votes": null
    },
    {
      "id": "554516",
      "postDate": "06/17/2019 14:59:59",
      "content": "<p>Kaggle will re-run your 2 selected submissions. But as the new \"private\" test set has recently replaced the \"public\" test set in the dataset of this competition, you can simulate what will happen by re-running your kernels to see if everything is fine with this new dataset version. As the \"private\" test set contains about 3x number of elements of \"public\" test set, two common issues may occur: time limit exceeded or memory limit exceeded.\nGood luck everyone with the \"private\" test set. 🤞 </p>",
      "rawMarkdown": "Kaggle will re-run your 2 selected submissions. But as the new \"private\" test set has recently replaced the \"public\" test set in the dataset of this competition, you can simulate what will happen by re-running your kernels to see if everything is fine with this new dataset version. As the \"private\" test set contains about 3x number of elements of \"public\" test set, two common issues may occur: time limit exceeded or memory limit exceeded.\nGood luck everyone with the \"private\" test set. 🤞",
      "votes": null
    },
    {
      "id": "554530",
      "postDate": "06/17/2019 15:41:04",
      "content": "<p>or you could even share your Kernel and get a kernel gold.</p>",
      "rawMarkdown": "or you could even share your Kernel and get a kernel gold.",
      "votes": null
    },
    {
      "id": "554748",
      "postDate": "06/18/2019 01:31:50",
      "content": "<p>Thanks for your interest. We have submitted our technical report to DCASE Challenge, and it will be post on the DCASE website soon. Welcome to read our paper and have discussions.</p>",
      "rawMarkdown": "Thanks for your interest. We have submitted our technical report to DCASE Challenge, and it will be post on the DCASE website soon. Welcome to read our paper and have discussions.",
      "votes": null
    },
    {
      "id": "556288",
      "postDate": "06/20/2019 04:34:12",
      "content": "<p>I forgot to submit in the 2nd stage.can i use late submission？</p>",
      "rawMarkdown": "I forgot to submit in the 2nd stage.can i use late submission？",
      "votes": null
    },
    {
      "id": "556308",
      "postDate": "06/20/2019 05:17:32",
      "content": "<p>if you didn't select it manually, then you selection would be auto-selected based on best public lb scores. Late submission won't count towards final standings</p>",
      "rawMarkdown": "if you didn't select it manually, then you selection would be auto-selected based on best public lb scores. Late submission won't count towards final standings",
      "votes": null
    },
    {
      "id": "556370",
      "postDate": "06/20/2019 06:57:24",
      "content": "<p>I have selected two version of my submission,but I forgot the 2nd stage test,so I receive Invalidated for stage2 returns,what should  I do now?</p>",
      "rawMarkdown": "I have selected two version of my submission,but I forgot the 2nd stage test,so I receive Invalidated for stage2 returns,what should  I do now?",
      "votes": null
    },
    {
      "id": "556371",
      "postDate": "06/20/2019 06:58:04",
      "content": "<p>Thank you for your reply</p>",
      "rawMarkdown": "Thank you for your reply",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 554298,
      "author_name": "garybios",
      "author_url": "",
      "post_date": "06/17/2019 08:41:20",
      "content": "<p>You should use 3 times test-set in 1st stage to make sure there are no problems with your kernel, hope you can get a good result next time.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 554314,
      "author_name": "www141",
      "author_url": "",
      "post_date": "06/17/2019 08:59:28",
      "content": "<p>I am sorry for you..</p>\n\n<p>I think kaggle team is working on a better version. The instant gratification comp is an example of synchronous kernel submission, where the 2nd stage will run in real time in background, so you will know whether there is any error just after your submission.  So hopefully such painful experiences will not happen again..</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 554475,
      "author_name": "smallfade",
      "author_url": "",
      "post_date": "06/17/2019 13:17:54",
      "content": "<p>Do we have to run on the new test set by ourselves? I thought Kaggle will re-run it automatically</p>",
      "votes": null,
      "replies": [
        {
          "id": 554516,
          "author_name": "ebouteillon",
          "author_url": "",
          "post_date": "06/17/2019 14:59:59",
          "content": "<p>Kaggle will re-run your 2 selected submissions. But as the new \"private\" test set has recently replaced the \"public\" test set in the dataset of this competition, you can simulate what will happen by re-running your kernels to see if everything is fine with this new dataset version. As the \"private\" test set contains about 3x number of elements of \"public\" test set, two common issues may occur: time limit exceeded or memory limit exceeded.\nGood luck everyone with the \"private\" test set. 🤞 </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 554476,
      "author_name": "ratthachat",
      "author_url": "",
      "post_date": "06/17/2019 13:19:06",
      "content": "<p>I am truly sorry for that to happen. But your public LB is super splendid anyway! Could you please share your method and get a gold discussion medal instead ?</p>",
      "votes": null,
      "replies": [
        {
          "id": 554530,
          "author_name": "sandy1112",
          "author_url": "",
          "post_date": "06/17/2019 15:41:04",
          "content": "<p>or you could even share your Kernel and get a kernel gold.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 554748,
          "author_name": "kexinhe321",
          "author_url": "",
          "post_date": "06/18/2019 01:31:50",
          "content": "<p>Thanks for your interest. We have submitted our technical report to DCASE Challenge, and it will be post on the DCASE website soon. Welcome to read our paper and have discussions.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 556288,
      "author_name": "wuchenxi118",
      "author_url": "",
      "post_date": "06/20/2019 04:34:12",
      "content": "<p>I forgot to submit in the 2nd stage.can i use late submission？</p>",
      "votes": null,
      "replies": [
        {
          "id": 556308,
          "author_name": "sandy1112",
          "author_url": "",
          "post_date": "06/20/2019 05:17:32",
          "content": "<p>if you didn't select it manually, then you selection would be auto-selected based on best public lb scores. Late submission won't count towards final standings</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 556370,
          "author_name": "wuchenxi118",
          "author_url": "",
          "post_date": "06/20/2019 06:57:24",
          "content": "<p>I have selected two version of my submission,but I forgot the 2nd stage test,so I receive Invalidated for stage2 returns,what should  I do now?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 556371,
          "author_name": "wuchenxi118",
          "author_url": "",
          "post_date": "06/20/2019 06:58:04",
          "content": "<p>Thank you for your reply</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "554192": "This is our first experience on kernel-only competition in Kaggle. \n\nWhen we ran our kernel in 2nd stage test, it ran for two hours without any results. Then we found out that our kernel ran out of memory during data preprocessing and it will cause kernel to restart repeatedly. In 1st stage test, we only control time limit but ignore memory restrictions. This is a painful lesson for us. Did anyone meet the same errors?\n\nGood luck to everyone!",
    "554298": "You should use 3 times test-set in 1st stage to make sure there are no problems with your kernel, hope you can get a good result next time.",
    "554314": "I am sorry for you..\n\nI think kaggle team is working on a better version. The instant gratification comp is an example of synchronous kernel submission, where the 2nd stage will run in real time in background, so you will know whether there is any error just after your submission.  So hopefully such painful experiences will not happen again..",
    "554475": "Do we have to run on the new test set by ourselves? I thought Kaggle will re-run it automatically",
    "554476": "I am truly sorry for that to happen. But your public LB is super splendid anyway! Could you please share your method and get a gold discussion medal instead ?",
    "554516": "Kaggle will re-run your 2 selected submissions. But as the new \"private\" test set has recently replaced the \"public\" test set in the dataset of this competition, you can simulate what will happen by re-running your kernels to see if everything is fine with this new dataset version. As the \"private\" test set contains about 3x number of elements of \"public\" test set, two common issues may occur: time limit exceeded or memory limit exceeded.\nGood luck everyone with the \"private\" test set. 🤞",
    "554530": "or you could even share your Kernel and get a kernel gold.",
    "554748": "Thanks for your interest. We have submitted our technical report to DCASE Challenge, and it will be post on the DCASE website soon. Welcome to read our paper and have discussions.",
    "556288": "I forgot to submit in the 2nd stage.can i use late submission？",
    "556308": "if you didn't select it manually, then you selection would be auto-selected based on best public lb scores. Late submission won't count towards final standings",
    "556370": "I have selected two version of my submission,but I forgot the 2nd stage test,so I receive Invalidated for stage2 returns,what should  I do now?",
    "556371": "Thank you for your reply"
  },
  "source": "meta"
}