Hi kagglers, I'm not familiar with kernel competitions yet and I want to clarify something, - when we submit notebook for evaluation, on submission page right after the score is shown we can see the time it took kernel to run (e.g. 1 hour).
\nMy question is the following:
\nDoes this run include public and private data, and hence we can can be sure that the kernel will finish execution in time (since we can see the time it took to run on submission page as explained above).
Or maybe the run on private part will be done later after competition deadline, hence we should accordingly scale execution time (e.g. in this competition public test is only 16% which is about 1/6 or all test samples, hence we have to scale execution time by the factor of 5, 5/6 is the private test).
\nThis is important, since this year test set contains much more data the last year test set
\n(5000x1 minute long soundscapes vs 80x10 minute long soundscapes).
Hi kagglers, I'm not familiar with kernel competitions yet and I want to clarify something, - when we submit notebook for evaluation, on submission page right after the score is shown we can see the time it took kernel to run (e.g. 1 hour).
\nMy question is the following:
\nDoes this run include public and private data, and hence we can can be sure that the kernel will finish execution in time (since we can see the time it took to run on submission page as explained above).
Or maybe the run on private part will be done later after competition deadline, hence we should accordingly scale execution time (e.g. in this competition public test is only 16% which is about 1/6 or all test samples, hence we have to scale execution time by the factor of 5, 5/6 is the private test).
\nThis is important, since this year test set contains much more data the last year test set
\n(5000x1 minute long soundscapes vs 80x10 minute long soundscapes).
I'm also wondering if the submission will be aborted when the private execution time exceeds 9 hours.
", "rawMarkdown": "I'm also wondering if the submission will be aborted when the private execution time exceeds 9 hours.", "votes": null }, { "id": "1768006", "postDate": "04/25/2022 21:39:55", "content": "Yes, it will.
", "rawMarkdown": "Yes, it will.", "votes": null }, { "id": "1768135", "postDate": "04/26/2022 02:44:29", "content": "As you said, private running includes public and private data.
\nSo, If you got score (running accomplished), your submission was successful with both public data and private data in time ( <= 9h).
\nNow, we can see public score only calculated with 1/6 test data.
\nHowever, your private score is already calculated (with 6/6 test data) too (we cannot see now).
Thanks, that's promising, however I would like to get the confirmation from the Kaggle team.
\nAlso, I think I can test this hypothesis by creating dummy test data locally and measuring time it takes my models to run, but I just want to be sure :)
", "rawMarkdown": "Thanks, that's promising, however I would like to get the confirmation from the Kaggle team.\n\nAlso, I think I can test this hypothesis by creating dummy test data locally and measuring time it takes my models to run, but I just want to be sure :)", "votes": null }, { "id": "1769857", "postDate": "04/27/2022 17:17:49", "content": "@sohier is the claim above correct? (about that current submissions include both public and private data, so the private score is hidden and on competition deadline time all scores will be shown on private LB w/o any additional kernel executions)
", "rawMarkdown": "sohier is the claim above correct? (about that current submissions include both public and private data, so the private score is hidden and on competition deadline time all scores will be shown on private LB w/o any additional kernel executions)", "votes": null } ], "comments": [ { "id": 1767997, "author_name": "kotanoda", "author_url": "", "post_date": "04/25/2022 21:20:14", "content": "I'm also wondering if the submission will be aborted when the private execution time exceeds 9 hours.
", "votes": null, "replies": [ { "id": 1768006, "author_name": "sohier", "author_url": "", "post_date": "04/25/2022 21:39:55", "content": "Yes, it will.
", "votes": null, "replies": [] } ] }, { "id": 1768135, "author_name": "kaerunantoka", "author_url": "", "post_date": "04/26/2022 02:44:29", "content": "As you said, private running includes public and private data.
\nSo, If you got score (running accomplished), your submission was successful with both public data and private data in time ( <= 9h).
\nNow, we can see public score only calculated with 1/6 test data.
\nHowever, your private score is already calculated (with 6/6 test data) too (we cannot see now).
Thanks, that's promising, however I would like to get the confirmation from the Kaggle team.
\nAlso, I think I can test this hypothesis by creating dummy test data locally and measuring time it takes my models to run, but I just want to be sure :)
", "votes": null, "replies": [] }, { "id": 1769857, "author_name": "martynoveduard", "author_url": "", "post_date": "04/27/2022 17:17:49", "content": "@sohier is the claim above correct? (about that current submissions include both public and private data, so the private score is hidden and on competition deadline time all scores will be shown on private LB w/o any additional kernel executions)
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "1767935": "Hi kagglers, I'm not familiar with kernel competitions yet and I want to clarify something, - when we submit notebook for evaluation, on submission page right after the score is shown we can see the time it took kernel to run (e.g. 1 hour).\n\nMy question is the following:\nDoes this run include public and private data, and hence we can can be sure that the kernel will finish execution in time (since we can see the time it took to run on submission page as explained above).\n\nOr maybe the run on private part will be done later after competition deadline, hence we should accordingly scale execution time (e.g. in this competition public test is only 16% which is about 1/6 or all test samples, hence we have to scale execution time by the factor of 5, 5/6 is the private test).\n\nThis is important, since this year test set contains much more data the last year test set \n(5000x1 minute long soundscapes vs 80x10 minute long soundscapes).", "1767997": "I'm also wondering if the submission will be aborted when the private execution time exceeds 9 hours.", "1768006": "Yes, it will.", "1768135": "As you said, private running includes public and private data.\n\nSo, If you got score (running accomplished), your submission was successful with both public data and private data in time ( <= 9h).\n\nNow, we can see public score only calculated with 1/6 test data.\nHowever, your private score is already calculated (with 6/6 test data) too (we cannot see now).", "1768279": "Thanks, that's promising, however I would like to get the confirmation from the Kaggle team.\n\nAlso, I think I can test this hypothesis by creating dummy test data locally and measuring time it takes my models to run, but I just want to be sure :)", "1769857": "sohier is the claim above correct? (about that current submissions include both public and private data, so the private score is hidden and on competition deadline time all scores will be shown on private LB w/o any additional kernel executions)" }, "source": "meta" }