Is there a specific reason for allowing only 2 entries/submissions per day? It is due to the competition duration of 5 months most probably. But if possible, can't the number of entries per day be increased to 4-5?
", "messages": [ { "id": 455357, "postDate": "2019-01-13T16:53:19.990Z", "content": "Given the size of test data, I think 2 is a good limit to avoid probing the leaderboard. 1 is even better :)
", "rawMarkdown": "Given the size of test data, I think 2 is a good limit to avoid probing the leaderboard. 1 is even better :)", "votes": 5, "replies": [ { "id": 455374, "postDate": "2019-01-13T17:16:58.057Z", "content": "This probing thing is too real i guess
", "rawMarkdown": "This probing thing is too real i guess" } ] }, { "id": 454826, "postDate": "2019-01-12T09:37:49.367Z", "content": "Is there a specific reason for allowing only 2 entries/submissions per day? It is due to the competition duration of 5 months most probably. But if possible, can't the number of entries per day be increased to 4-5?
", "rawMarkdown": "Is there a specific reason for allowing only 2 entries/submissions per day? It is due to the competition duration of 5 months most probably. But if possible, can't the number of entries per day be increased to 4-5? ", "votes": 3 }, { "id": 455136, "postDate": "2019-01-13T03:48:15.443Z", "content": "They limit to 2 subs/day to prevent private leaderboard probing.
", "rawMarkdown": "They limit to 2 subs/day to prevent private leaderboard probing.", "votes": 3, "replies": [ { "id": 455143, "postDate": "2019-01-13T04:15:48.323Z", "content": "What does that mean?
", "rawMarkdown": "What does that mean?", "votes": -1 }, { "id": 455152, "postDate": "2019-01-13T04:37:02.057Z", "content": "Imagine you have 1000 test samples, and each day you have 10 submissions. Then fixing 999 test samples, and try to increase or decrease the prediction of 1 remaining sample, then submit, you will know the trend of the real target of that sample. \nIf someone knows which part of the test data that is included in the public LB, the probing would be much convenient.
", "rawMarkdown": "Imagine you have 1000 test samples, and each day you have 10 submissions. Then fixing 999 test samples, and try to increase or decrease the prediction of 1 remaining sample, then submit, you will know the trend of the real target of that sample. \nIf someone knows which part of the test data that is included in the public LB, the probing would be much convenient.", "votes": 3 }, { "id": 455191, "postDate": "2019-01-13T07:34:52.357Z", "content": "Ok, that is something I didn't think about. Thanks for informing. 10 subs/day is too much but it would be fine if they could increase them to 3-4 subs/day. They could have chosen a smaller competition time period.
", "rawMarkdown": "Ok, that is something I didn't think about. Thanks for informing. 10 subs/day is too much but it would be fine if they could increase them to 3-4 subs/day. They could have chosen a smaller competition time period.", "votes": -1 }, { "id": 455476, "postDate": "2019-01-14T02:07:13.823Z", "content": "Aside from probing, spamming LB also means to fit the LB. Essentially, the models will have questionable performance once they leave the competition.
", "rawMarkdown": "Aside from probing, spamming LB also means to fit the LB. Essentially, the models will have questionable performance once they leave the competition." }, { "id": 455519, "postDate": "2019-01-14T05:12:33.573Z", "content": "@tclf90 What is fitting the LB? Does making a few bad submissions affect my final ranking?
", "rawMarkdown": "@tclf90 What is fitting the LB? Does making a few bad submissions affect my final ranking?", "votes": -1 }, { "id": 455522, "postDate": "2019-01-14T05:22:26.400Z", "content": "'fitting the LB' means that the LB data effectively becomes part of your training set.\nYour personal ranking is not relevant. \nInstead, it is the competition host who lose here because they are facing huge risks of not \nreceiving the best predictive models at the end.
", "rawMarkdown": "'fitting the LB' means that the LB data effectively becomes part of your training set.\nYour personal ranking is not relevant. \nInstead, it is the competition host who lose here because they are facing huge risks of not \nreceiving the best predictive models at the end.", "votes": 1 } ] }, { "id": 455625, "postDate": "2019-01-14T09:05:47.963Z", "content": "I too feel that they should increase the no of submissions limit
", "rawMarkdown": "I too feel that they should increase the no of submissions limit" }, { "id": 455015, "postDate": "2019-01-12T18:46:23.637Z", "content": "Agree, 2 entries/day is quite inconvenient.
", "rawMarkdown": "Agree, 2 entries/day is quite inconvenient." }, { "id": 455009, "postDate": "2019-01-12T18:36:02.803Z", "rawMarkdown": "", "votes": -1, "isDeleted": true } ], "comments": [ { "id": 455357, "author_name": "Abhishek Thakur", "author_url": "", "post_date": "2019-01-13T16:53:19.990000", "content": "Given the size of test data, I think 2 is a good limit to avoid probing the leaderboard. 1 is even better :)
", "votes": 5, "replies": [ { "id": 455374, "author_name": "Siddharth Yadav", "author_url": "", "post_date": "2019-01-13T17:16:58.057000", "content": "This probing thing is too real i guess
", "votes": 0, "replies": [] } ] }, { "id": 455136, "author_name": "Kha Vo", "author_url": "", "post_date": "2019-01-13T03:48:15.443000", "content": "They limit to 2 subs/day to prevent private leaderboard probing.
", "votes": 3, "replies": [ { "id": 455143, "author_name": "Siddharth Yadav", "author_url": "", "post_date": "2019-01-13T04:15:48.323000", "content": "What does that mean?
", "votes": -1, "replies": [] }, { "id": 455152, "author_name": "Kha Vo", "author_url": "", "post_date": "2019-01-13T04:37:02.057000", "content": "Imagine you have 1000 test samples, and each day you have 10 submissions. Then fixing 999 test samples, and try to increase or decrease the prediction of 1 remaining sample, then submit, you will know the trend of the real target of that sample. \nIf someone knows which part of the test data that is included in the public LB, the probing would be much convenient.
", "votes": 3, "replies": [] }, { "id": 455191, "author_name": "Siddharth Yadav", "author_url": "", "post_date": "2019-01-13T07:34:52.357000", "content": "Ok, that is something I didn't think about. Thanks for informing. 10 subs/day is too much but it would be fine if they could increase them to 3-4 subs/day. They could have chosen a smaller competition time period.
", "votes": -1, "replies": [] }, { "id": 455476, "author_name": "Elliot", "author_url": "", "post_date": "2019-01-14T02:07:13.823000", "content": "Aside from probing, spamming LB also means to fit the LB. Essentially, the models will have questionable performance once they leave the competition.
", "votes": 0, "replies": [] }, { "id": 455519, "author_name": "Siddharth Yadav", "author_url": "", "post_date": "2019-01-14T05:12:33.573000", "content": "@tclf90 What is fitting the LB? Does making a few bad submissions affect my final ranking?
", "votes": -1, "replies": [] }, { "id": 455522, "author_name": "Elliot", "author_url": "", "post_date": "2019-01-14T05:22:26.400000", "content": "'fitting the LB' means that the LB data effectively becomes part of your training set.\nYour personal ranking is not relevant. \nInstead, it is the competition host who lose here because they are facing huge risks of not \nreceiving the best predictive models at the end.
", "votes": 1, "replies": [] } ] }, { "id": 455625, "author_name": "ALOK PRATAP", "author_url": "", "post_date": "2019-01-14T09:05:47.963000", "content": "I too feel that they should increase the no of submissions limit
", "votes": 0, "replies": [] }, { "id": 455015, "author_name": "Andrey Lukyanenko", "author_url": "", "post_date": "2019-01-12T18:46:23.637000", "content": "Agree, 2 entries/day is quite inconvenient.
", "votes": 0, "replies": [] }, { "id": 455009, "author_name": "", "author_url": "", "post_date": "2019-01-12T18:36:02.803000", "content": "", "votes": -1, "replies": [] } ], "raw_markdown_by_id": { "455357": "Given the size of test data, I think 2 is a good limit to avoid probing the leaderboard. 1 is even better :)", "454826": "Is there a specific reason for allowing only 2 entries/submissions per day? It is due to the competition duration of 5 months most probably. But if possible, can't the number of entries per day be increased to 4-5? ", "455136": "They limit to 2 subs/day to prevent private leaderboard probing.", "455625": "I too feel that they should increase the no of submissions limit", "455015": "Agree, 2 entries/day is quite inconvenient.", "455009": "" } }