\n
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1723677%2F9d8dcfc0b7b42bb42391abbb5747b215%2Fscore.png?generation=1609848063118788&alt=media\")
Hi to all! Most of my notebooks have the same public score. But in fact my place in the ranking changed after submitting 5 notebooks. Now the question that I had in many competitions. How to determine which of the notebooks is best if they have the same public score such as 0.783, but still differ. Thanks!
", "messages": [ { "id": "1139207", "postDate": "01/05/2021 08:48:56", "content": "Hi to all! Most of my notebooks have the same public score. But in fact my place in the ranking changed after submitting 5 notebooks. Now the question that I had in many competitions. How to determine which of the notebooks is best if they have the same public score such as 0.783, but still differ. Thanks!
", "rawMarkdown": "Hi to all! Most of my notebooks have the same public score. But in fact my place in the ranking changed after submitting 5 notebooks. Now the question that I had in many competitions. How to determine which of the notebooks is best if they have the same public score such as 0.783, but still differ. Thanks!", "votes": null }, { "id": "1139373", "postDate": "01/05/2021 10:55:46", "content": "Validation score?
", "rawMarkdown": "Validation score?", "votes": null }, { "id": "1139403", "postDate": "01/05/2021 11:15:57", "content": "roll a dice, toss a coin, have your puppey to pick one? Kidding :D, I think this CV-LB relation in this comp is quite high that we can trust our CV, and somehow the LB score, everything is just up to probabilities
", "rawMarkdown": "roll a dice, toss a coin, have your puppey to pick one? Kidding :D, I think this CV-LB relation in this comp is quite high that we can trust our CV, and somehow the LB score, everything is just up to probabilities", "votes": null }, { "id": "1139412", "postDate": "01/05/2021 11:28:57", "content": "I think you are talking about something else here, so others' answers might not be helpful. (I might be wrong though.)
\nIf your ranking goes up when you submit another \"783\" submission, it indeed means your new 783 submission is better than the previous ones. In the leaderboard, scores are always shown in a truncated way, which means your \"783\" submissions differ in 4th decimal or so. They don't have the same public score.
\nSo how to check which one was better and where is your current \"783\" score on LB coming from? Go to the \"My Submissions\" tab above and then choose \"Public Score\" in the \"Sort by\" filter. This will bring up your notebook having the best public score to the top.
\nThanks to the nature of this comp, probably your best validation score also has the best submission score btw. It won't be so hard to make a decision :)
", "rawMarkdown": "I think you are talking about something else here, so others' answers might not be helpful. (I might be wrong though.) \n\nIf your ranking goes up when you submit another \"783\" submission, it indeed means your new 783 submission is better than the previous ones. In the leaderboard, scores are always shown in a truncated way, which means your \"783\" submissions differ in 4th decimal or so. They don't have the same public score.\n\nSo how to check which one was better and where is your current \"783\" score on LB coming from? Go to the \"My Submissions\" tab above and then choose \"Public Score\" in the \"Sort by\" filter. This will bring up your notebook having the best public score to the top.\n\nThanks to the nature of this comp, probably your best validation score also has the best submission score btw. It won't be so hard to make a decision :)", "votes": null }, { "id": "1139413", "postDate": "01/05/2021 11:31:00", "content": "My question was only about the public score. The fact that this competition is a lottery for me I already understood :-). I didn't have time for him. I have already found the answer to my question: on the My Submissions page you can sort the public score :-) :-) :-). Good luck!
", "rawMarkdown": "My question was only about the public score. The fact that this competition is a lottery for me I already understood :-). I didn't have time for him. I have already found the answer to my question: on the My Submissions page you can sort the public score :-) :-) :-). Good luck!", "votes": null }, { "id": "1139418", "postDate": "01/05/2021 11:35:04", "content": "Thanks for the full answer, your explanation is perfect! I already figured out where to look, but I left this discussion, maybe someone else will be interested :). Good luck!
", "rawMarkdown": "Thanks for the full answer, your explanation is perfect! I already figured out where to look, but I left this discussion, maybe someone else will be interested :). Good luck!", "votes": null }, { "id": "1139421", "postDate": "01/05/2021 11:36:31", "content": "got your point now, all the best :D
", "rawMarkdown": "got your point now, all the best :D", "votes": null }, { "id": "1139448", "postDate": "01/05/2021 11:59:00", "content": "Go to your submissions page and sort by score. Note, you cannot go to your notebook page and sort by score. Kaggle has bug sorting notebook by score. It randomly orders notebooks with same first 3 digits.
", "rawMarkdown": "Go to your submissions page and sort by score. Note, you cannot go to your notebook page and sort by score. Kaggle has bug sorting notebook by score. It randomly orders notebooks with same first 3 digits.", "votes": null }, { "id": "1139450", "postDate": "01/05/2021 12:01:10", "content": "For example the following list of public notebooks sorted by score is not the correct order
\n
I do not have a puppy to choose - I am at a disadvantage :D
\nYou have clearly a nice, reasonable choosing puppy, based on your profile pic ^^
Thanks! I did not know about this bug. Good luck!😃
", "rawMarkdown": "Thanks! I did not know about this bug. Good luck!😃", "votes": null }, { "id": "1139477", "postDate": "01/05/2021 12:22:32", "content": "Haha, he is super adorable
", "rawMarkdown": "Haha, he is super adorable", "votes": null }, { "id": "1139632", "postDate": "01/05/2021 14:31:27", "content": "You have to take into account the readability of a notebook. Many years ago I learned coding by reading many great coder's programs (for example @cdeotte 's non-machine learning codes). Sometimes, it is easier to improve a notebook that is more modular and readable than the copy-pasta scribblingus codes. In the last days, I suggest focusing on this one: https://www.kaggle.com/gilfernandes/riiid-self-attention-transformer by @gilfernandes .
", "rawMarkdown": "You have to take into account the readability of a notebook. Many years ago I learned coding by reading many great coder's programs (for example @cdeotte 's non-machine learning codes). Sometimes, it is easier to improve a notebook that is more modular and readable than the copy-pasta scribblingus codes. In the last days, I suggest focusing on this one: https://www.kaggle.com/gilfernandes/riiid-self-attention-transformer by @gilfernandes .", "votes": null }, { "id": "1139920", "postDate": "01/05/2021 17:44:06", "content": "I would choose something CV is proportional to lb
", "rawMarkdown": "I would choose something CV is proportional to lb", "votes": null }, { "id": "1142127", "postDate": "01/07/2021 07:07:19", "content": "Maybe .783XXX
\ndetermined by XXX
", "rawMarkdown": "Maybe .783XXX\n\ndetermined by XXX", "votes": null } ], "comments": [ { "id": 1139373, "author_name": "bacicnikola", "author_url": "", "post_date": "01/05/2021 10:55:46", "content": "Validation score?
", "votes": null, "replies": [] }, { "id": 1139403, "author_name": "shinomoriaoshi", "author_url": "", "post_date": "01/05/2021 11:15:57", "content": "roll a dice, toss a coin, have your puppey to pick one? Kidding :D, I think this CV-LB relation in this comp is quite high that we can trust our CV, and somehow the LB score, everything is just up to probabilities
", "votes": null, "replies": [ { "id": 1139413, "author_name": "aikhmelnytskyy", "author_url": "", "post_date": "01/05/2021 11:31:00", "content": "My question was only about the public score. The fact that this competition is a lottery for me I already understood :-). I didn't have time for him. I have already found the answer to my question: on the My Submissions page you can sort the public score :-) :-) :-). Good luck!
", "votes": null, "replies": [] }, { "id": 1139421, "author_name": "shinomoriaoshi", "author_url": "", "post_date": "01/05/2021 11:36:31", "content": "got your point now, all the best :D
", "votes": null, "replies": [] }, { "id": 1139458, "author_name": "killimi", "author_url": "", "post_date": "01/05/2021 12:07:17", "content": "I do not have a puppy to choose - I am at a disadvantage :D
\nYou have clearly a nice, reasonable choosing puppy, based on your profile pic ^^
Haha, he is super adorable
", "votes": null, "replies": [] } ] }, { "id": 1139412, "author_name": "fatihozturk", "author_url": "", "post_date": "01/05/2021 11:28:57", "content": "I think you are talking about something else here, so others' answers might not be helpful. (I might be wrong though.)
\nIf your ranking goes up when you submit another \"783\" submission, it indeed means your new 783 submission is better than the previous ones. In the leaderboard, scores are always shown in a truncated way, which means your \"783\" submissions differ in 4th decimal or so. They don't have the same public score.
\nSo how to check which one was better and where is your current \"783\" score on LB coming from? Go to the \"My Submissions\" tab above and then choose \"Public Score\" in the \"Sort by\" filter. This will bring up your notebook having the best public score to the top.
\nThanks to the nature of this comp, probably your best validation score also has the best submission score btw. It won't be so hard to make a decision :)
", "votes": null, "replies": [ { "id": 1139418, "author_name": "aikhmelnytskyy", "author_url": "", "post_date": "01/05/2021 11:35:04", "content": "Thanks for the full answer, your explanation is perfect! I already figured out where to look, but I left this discussion, maybe someone else will be interested :). Good luck!
", "votes": null, "replies": [] } ] }, { "id": 1139448, "author_name": "cdeotte", "author_url": "", "post_date": "01/05/2021 11:59:00", "content": "Go to your submissions page and sort by score. Note, you cannot go to your notebook page and sort by score. Kaggle has bug sorting notebook by score. It randomly orders notebooks with same first 3 digits.
", "votes": null, "replies": [ { "id": 1139450, "author_name": "cdeotte", "author_url": "", "post_date": "01/05/2021 12:01:10", "content": "For example the following list of public notebooks sorted by score is not the correct order
\n
Thanks! I did not know about this bug. Good luck!😃
", "votes": null, "replies": [] } ] }, { "id": 1139632, "author_name": "scaomath", "author_url": "", "post_date": "01/05/2021 14:31:27", "content": "You have to take into account the readability of a notebook. Many years ago I learned coding by reading many great coder's programs (for example @cdeotte 's non-machine learning codes). Sometimes, it is easier to improve a notebook that is more modular and readable than the copy-pasta scribblingus codes. In the last days, I suggest focusing on this one: https://www.kaggle.com/gilfernandes/riiid-self-attention-transformer by @gilfernandes .
", "votes": null, "replies": [] }, { "id": 1139920, "author_name": "deepkim", "author_url": "", "post_date": "01/05/2021 17:44:06", "content": "I would choose something CV is proportional to lb
", "votes": null, "replies": [] }, { "id": 1142127, "author_name": "southsakura", "author_url": "", "post_date": "01/07/2021 07:07:19", "content": "Maybe .783XXX
\ndetermined by XXX
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "1139207": "Hi to all! Most of my notebooks have the same public score. But in fact my place in the ranking changed after submitting 5 notebooks. Now the question that I had in many competitions. How to determine which of the notebooks is best if they have the same public score such as 0.783, but still differ. Thanks!", "1139373": "Validation score?", "1139403": "roll a dice, toss a coin, have your puppey to pick one? Kidding :D, I think this CV-LB relation in this comp is quite high that we can trust our CV, and somehow the LB score, everything is just up to probabilities", "1139412": "I think you are talking about something else here, so others' answers might not be helpful. (I might be wrong though.) \n\nIf your ranking goes up when you submit another \"783\" submission, it indeed means your new 783 submission is better than the previous ones. In the leaderboard, scores are always shown in a truncated way, which means your \"783\" submissions differ in 4th decimal or so. They don't have the same public score.\n\nSo how to check which one was better and where is your current \"783\" score on LB coming from? Go to the \"My Submissions\" tab above and then choose \"Public Score\" in the \"Sort by\" filter. This will bring up your notebook having the best public score to the top.\n\nThanks to the nature of this comp, probably your best validation score also has the best submission score btw. It won't be so hard to make a decision :)", "1139413": "My question was only about the public score. The fact that this competition is a lottery for me I already understood :-). I didn't have time for him. I have already found the answer to my question: on the My Submissions page you can sort the public score :-) :-) :-). Good luck!", "1139418": "Thanks for the full answer, your explanation is perfect! I already figured out where to look, but I left this discussion, maybe someone else will be interested :). Good luck!", "1139421": "got your point now, all the best :D", "1139448": "Go to your submissions page and sort by score. Note, you cannot go to your notebook page and sort by score. Kaggle has bug sorting notebook by score. It randomly orders notebooks with same first 3 digits.", "1139450": "For example the following list of public notebooks sorted by score is not the correct order\n", "1139458": "I do not have a puppy to choose - I am at a disadvantage :D\nYou have clearly a nice, reasonable choosing puppy, based on your profile pic ^^", "1139459": "Thanks! I did not know about this bug. Good luck!😃", "1139477": "Haha, he is super adorable", "1139632": "You have to take into account the readability of a notebook. Many years ago I learned coding by reading many great coder's programs (for example @cdeotte 's non-machine learning codes). Sometimes, it is easier to improve a notebook that is more modular and readable than the copy-pasta scribblingus codes. In the last days, I suggest focusing on this one: https://www.kaggle.com/gilfernandes/riiid-self-attention-transformer by @gilfernandes .", "1139920": "I would choose something CV is proportional to lb", "1142127": "Maybe .783XXX\n\ndetermined by XXX" }, "source": "meta" }