Recently a top notch Grandmaster Pavel Ostyakov shared some tricks about winning Kaggle competitions. I found it must a watch, hope you will agree (main tip: stay away from jupyter notebooks). https://www.youtube.com/watch?v=oxikDxBzKUU
\n\nEdit
\n\nFollowing are the timestamps with topics TLDR\n1:20 Speedup convergence (Reduce Learning Rate at Plateaus, Cyclic Learning Rate, Warmup)\n10:39 How to improve training of NN, speedup convergence, Data Augmentation\n19:16 Example of a well organised pipeline\n21:06 7 tips on winning at Kaggle\n24:48 Main problem of competition, goals
", "messages": [ { "id": "487741", "postDate": "03/11/2019 12:13:49", "content": "Recently a top notch Grandmaster Pavel Ostyakov shared some tricks about winning Kaggle competitions. I found it must a watch, hope you will agree (main tip: stay away from jupyter notebooks). https://www.youtube.com/watch?v=oxikDxBzKUU
\n\nEdit
\n\nFollowing are the timestamps with topics TLDR\n1:20 Speedup convergence (Reduce Learning Rate at Plateaus, Cyclic Learning Rate, Warmup)\n10:39 How to improve training of NN, speedup convergence, Data Augmentation\n19:16 Example of a well organised pipeline\n21:06 7 tips on winning at Kaggle\n24:48 Main problem of competition, goals
", "rawMarkdown": "Recently a top notch Grandmaster Pavel Ostyakov shared some tricks about winning Kaggle competitions. I found it must a watch, hope you will agree (main tip: stay away from jupyter notebooks). https://www.youtube.com/watch?v=oxikDxBzKUU\n\n**Edit**\n\nFollowing are the timestamps with topics TLDR\n1:20 Speedup convergence (Reduce Learning Rate at Plateaus, Cyclic Learning Rate, Warmup)\n10:39 How to improve training of NN, speedup convergence, Data Augmentation\n19:16 Example of a well organised pipeline\n21:06 7 tips on winning at Kaggle\n24:48 Main problem of competition, goals", "votes": null }, { "id": "487750", "postDate": "03/11/2019 12:28:58", "content": "Hi @cyberia !
\n\nThanks for sharing this!
\n\nLots of interesting stuff is available on https://kaggledays.com/
", "rawMarkdown": "Hi @cyberia !\n\nThanks for sharing this!\n\nLots of interesting stuff is available on https://kaggledays.com/", "votes": null }, { "id": "487785", "postDate": "03/11/2019 13:16:28", "content": "\n\n\nmain tip: stay away from jupyter notebooks
\n
Well, if this is the main takeaway you get, then it may be worth viewing it again ;)
", "rawMarkdown": "> main tip: stay away from jupyter notebooks\n\nWell, if this is the main takeaway you get, then it may be worth viewing it again ;)", "votes": null }, { "id": "487812", "postDate": "03/11/2019 13:46:29", "content": "JFP, main tip is from extended video description I just wrote it as it is. Of course there are so many things to learn from Pavel's talk. I closely follow your work, it is inspiring and awesome. Ah now I see your game :)))), here is the link to another awesome talk by CPMP at Kaggle Days Paris https://www.youtube.com/watch?v=fH_FiquKhiI\nIts good to hear your talk which includes Gaussian processes and sampling bias. I always appreciate the beauty of gaussian models, myself being from bayesian camp.
", "rawMarkdown": "JFP, main tip is from extended video description I just wrote it as it is. Of course there are so many things to learn from Pavel's talk. I closely follow your work, it is inspiring and awesome. Ah now I see your game :)))), here is the link to another awesome talk by CPMP at Kaggle Days Paris https://www.youtube.com/watch?v=fH_FiquKhiI\nIts good to hear your talk which includes Gaussian processes and sampling bias. I always appreciate the beauty of gaussian models, myself being from bayesian camp.", "votes": null }, { "id": "487858", "postDate": "03/11/2019 14:53:08", "content": "If you think I posted to get ad, you're wrong. I hesitated posting my comment as I knew it could be misinterpreted that way.
\n\nAnyway, my point was that Pavel's talk is way more interesting than just his opinion about Jupyter notebooks, and that you did not give him justice.
", "rawMarkdown": "If you think I posted to get ad, you're wrong. I hesitated posting my comment as I knew it could be misinterpreted that way.\n\nAnyway, my point was that Pavel's talk is way more interesting than just his opinion about Jupyter notebooks, and that you did not give him justice.", "votes": null }, { "id": "488198", "postDate": "03/12/2019 05:00:24", "content": "Thanks for sharing, happy to listen to Grand Masters sharing their wisdom.
", "rawMarkdown": "Thanks for sharing, happy to listen to Grand Masters sharing their wisdom.", "votes": null }, { "id": "488237", "postDate": "03/12/2019 06:34:59", "content": "always a pleasure to see the flesh and bone behind these usernames :) Thanks for posting
", "rawMarkdown": "always a pleasure to see the flesh and bone behind these usernames :) Thanks for posting", "votes": null }, { "id": "490182", "postDate": "03/14/2019 10:55:41", "content": "I watched your talk at kaggle days (https://www.youtube.com/watch?v=fH_FiquKhiI) and I learnt so much from you. Now, I have some idea about how to survive a private LB shakeup ! Thanks CPMP !
", "rawMarkdown": "I watched your talk at kaggle days (https://www.youtube.com/watch?v=fH_FiquKhiI) and I learnt so much from you. Now, I have some idea about how to survive a private LB shakeup ! Thanks CPMP !", "votes": null }, { "id": "491933", "postDate": "03/16/2019 12:05:51", "content": "@nyleve You're welcome. You can see related videos and hands on practise sessions https://www.youtube.com/user/kaggledotcom
", "rawMarkdown": "nyleve You're welcome. You can see related videos and hands on practise sessions https://www.youtube.com/user/kaggledotcom", "votes": null } ], "comments": [ { "id": 487750, "author_name": "vjcalling", "author_url": "", "post_date": "03/11/2019 12:28:58", "content": "Hi @cyberia !
\n\nThanks for sharing this!
\n\nLots of interesting stuff is available on https://kaggledays.com/
", "votes": null, "replies": [] }, { "id": 487785, "author_name": "cpmpml", "author_url": "", "post_date": "03/11/2019 13:16:28", "content": "\n\n\nmain tip: stay away from jupyter notebooks
\n
Well, if this is the main takeaway you get, then it may be worth viewing it again ;)
", "votes": null, "replies": [ { "id": 487812, "author_name": "cyberia", "author_url": "", "post_date": "03/11/2019 13:46:29", "content": "JFP, main tip is from extended video description I just wrote it as it is. Of course there are so many things to learn from Pavel's talk. I closely follow your work, it is inspiring and awesome. Ah now I see your game :)))), here is the link to another awesome talk by CPMP at Kaggle Days Paris https://www.youtube.com/watch?v=fH_FiquKhiI\nIts good to hear your talk which includes Gaussian processes and sampling bias. I always appreciate the beauty of gaussian models, myself being from bayesian camp.
", "votes": null, "replies": [] }, { "id": 487858, "author_name": "cpmpml", "author_url": "", "post_date": "03/11/2019 14:53:08", "content": "If you think I posted to get ad, you're wrong. I hesitated posting my comment as I knew it could be misinterpreted that way.
\n\nAnyway, my point was that Pavel's talk is way more interesting than just his opinion about Jupyter notebooks, and that you did not give him justice.
", "votes": null, "replies": [] }, { "id": 488198, "author_name": "subrahmanyamv", "author_url": "", "post_date": "03/12/2019 05:00:24", "content": "Thanks for sharing, happy to listen to Grand Masters sharing their wisdom.
", "votes": null, "replies": [] }, { "id": 490182, "author_name": "tarunpaparaju", "author_url": "", "post_date": "03/14/2019 10:55:41", "content": "I watched your talk at kaggle days (https://www.youtube.com/watch?v=fH_FiquKhiI) and I learnt so much from you. Now, I have some idea about how to survive a private LB shakeup ! Thanks CPMP !
", "votes": null, "replies": [] } ] }, { "id": 488237, "author_name": "nyleve", "author_url": "", "post_date": "03/12/2019 06:34:59", "content": "always a pleasure to see the flesh and bone behind these usernames :) Thanks for posting
", "votes": null, "replies": [ { "id": 491933, "author_name": "cyberia", "author_url": "", "post_date": "03/16/2019 12:05:51", "content": "@nyleve You're welcome. You can see related videos and hands on practise sessions https://www.youtube.com/user/kaggledotcom
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "487741": "Recently a top notch Grandmaster Pavel Ostyakov shared some tricks about winning Kaggle competitions. I found it must a watch, hope you will agree (main tip: stay away from jupyter notebooks). https://www.youtube.com/watch?v=oxikDxBzKUU\n\n**Edit**\n\nFollowing are the timestamps with topics TLDR\n1:20 Speedup convergence (Reduce Learning Rate at Plateaus, Cyclic Learning Rate, Warmup)\n10:39 How to improve training of NN, speedup convergence, Data Augmentation\n19:16 Example of a well organised pipeline\n21:06 7 tips on winning at Kaggle\n24:48 Main problem of competition, goals", "487750": "Hi @cyberia !\n\nThanks for sharing this!\n\nLots of interesting stuff is available on https://kaggledays.com/", "487785": "> main tip: stay away from jupyter notebooks\n\nWell, if this is the main takeaway you get, then it may be worth viewing it again ;)", "487812": "JFP, main tip is from extended video description I just wrote it as it is. Of course there are so many things to learn from Pavel's talk. I closely follow your work, it is inspiring and awesome. Ah now I see your game :)))), here is the link to another awesome talk by CPMP at Kaggle Days Paris https://www.youtube.com/watch?v=fH_FiquKhiI\nIts good to hear your talk which includes Gaussian processes and sampling bias. I always appreciate the beauty of gaussian models, myself being from bayesian camp.", "487858": "If you think I posted to get ad, you're wrong. I hesitated posting my comment as I knew it could be misinterpreted that way.\n\nAnyway, my point was that Pavel's talk is way more interesting than just his opinion about Jupyter notebooks, and that you did not give him justice.", "488198": "Thanks for sharing, happy to listen to Grand Masters sharing their wisdom.", "488237": "always a pleasure to see the flesh and bone behind these usernames :) Thanks for posting", "490182": "I watched your talk at kaggle days (https://www.youtube.com/watch?v=fH_FiquKhiI) and I learnt so much from you. Now, I have some idea about how to survive a private LB shakeup ! Thanks CPMP !", "491933": "nyleve You're welcome. You can see related videos and hands on practise sessions https://www.youtube.com/user/kaggledotcom" }, "source": "meta" }