Readme.md file to keep track of experiments.\n
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2907842%2Fbe2b82573f548c0c7f3438dec21b1985%2FCapture.png?generation=1597837437757549&alt=media\")
.Experimentation is integral to data science and one must keep track of all experiments. I am sure everyone has their own way.
\nThis is how I do it. Sharing here because I think that this might give some insight to beginners (like me) about how to keep track of experiments and choosing those final submissions.
\n[*These are my results for this competition.]
", "messages": [ { "id": 976973, "postDate": "2020-08-19T07:54:49.657Z", "content": "Experimentation is integral to data science and one must keep track of all experiments. I am sure everyone has their own way.
\nThis is how I do it. Sharing here because I think that this might give some insight to beginners (like me) about how to keep track of experiments and choosing those final submissions.
\n[*These are my results for this competition.]
", "rawMarkdown": "Experimentation is integral to data science and one must keep track of all experiments. I am sure everyone has their own way.\n\nThis is how I do it. Sharing here because I think that this might give some insight to beginners (like me) about how to keep track of experiments and **choosing those final submissions**.\n\n[*These are my results for this competition.]", "votes": 14 }, { "id": 977044, "postDate": "2020-08-19T08:56:05.037Z", "content": "I found a step-change in my ability to run experiments and properly engage with competitions when I started using an experiment tracking software…
\nCan't recommend neptune.ai enough, although its not great for analyzing the results of your experiments, it is great for logging! (I have no affiliation with neptune)
", "rawMarkdown": "I found a step-change in my ability to run experiments and properly engage with competitions when I started using an experiment tracking software...\n\nCan't recommend [neptune.ai](https://neptune.ai/) enough, although its not great for analyzing the results of your experiments, it is great for logging! (I have no affiliation with neptune) ", "votes": 3, "replies": [ { "id": 977183, "postDate": "2020-08-19T10:39:37.733Z", "content": "Thank you for sharing! Will look into it.
", "rawMarkdown": "Thank you for sharing! Will look into it." }, { "id": 978235, "postDate": "2020-08-20T03:40:01.623Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 977022, "postDate": "2020-08-19T08:34:23.803Z", "content": "Indeed tracking experiments is crucial - btw there are many automated tools that can do that for you, see MLflow, mlrun, determined, Weights & Biases and more. I've used as well in the beginning excel sheets but after some point getting too messy. Now I'm more in to use MLflow and W&B. To get an idea check these articles
\n\nPS: If you are interested I have also a (public) tutorial notebook that shows step-by-step the process with W&B.
\nEdit: Just to be clear, I have no affiliation with either MLflow, W&B - just use this tools with a free account :)
", "rawMarkdown": "Indeed tracking experiments is crucial - btw there are many automated tools that can do that for you, see MLflow, mlrun, determined, Weights & Biases and more. I've used as well in the beginning excel sheets but after some point getting too messy. Now I'm more in to use MLflow and W&B. To get an idea check these articles\n- [towardsdatascience - MLflow](https://towardsdatascience.com/tracking-ml-experiments-using-mlflow-7910197091bb)\n- [towardsdatascience - W&B](https://towardsdatascience.com/machine-learning-experiment-tracking-93b796e501b0) \n\nPS: If you are interested I have also a (public) tutorial notebook that shows step-by-step the process with W&B. \n\nEdit: Just to be clear, I have no affiliation with either MLflow, W&B - just use this tools with a free account :) ", "votes": 3, "replies": [ { "id": 977032, "postDate": "2020-08-19T08:48:24.153Z", "content": "I would add that guild and sacred are also worth looking at
", "rawMarkdown": "I would add that [guild](https://guild.ai/) and [sacred](https://github.com/IDSIA/sacred) are also worth looking at", "votes": 3 }, { "id": 977042, "postDate": "2020-08-19T08:54:10.490Z", "content": "Thanks for sharing, I will surely look into these.
", "rawMarkdown": "Thanks for sharing, I will surely look into these.", "votes": 1 }, { "id": 977105, "postDate": "2020-08-19T09:53:49.543Z", "content": "I was looking for something like this. Thanks.!
", "rawMarkdown": "I was looking for something like this. Thanks.!", "votes": 1 } ] }, { "id": 976979, "postDate": "2020-08-19T08:01:00.623Z", "content": "Thanks for sharing. I use spreadsheets too! I track everything though its quite tedious……….I agree that keeping track is key! Especially if you want to mine the value in your OOF for stacking etc,
", "rawMarkdown": "Thanks for sharing. I use spreadsheets too! I track everything though its quite tedious..........I agree that keeping track is key! Especially if you want to mine the value in your OOF for stacking etc,", "votes": 3 }, { "id": 977206, "postDate": "2020-08-19T10:53:33.600Z", "content": "Thanks for sharing :) I use PAPER + PEN
Could you explain more PAPER + PEN or share some articles? :)
\n@coolcoder22
Old school. Whatever works I guess. :)
", "rawMarkdown": "Old school. Whatever works I guess. :)" }, { "id": 977251, "postDate": "2020-08-19T11:28:11.423Z", "content": "@piantic I write all my experiments on paper
", "rawMarkdown": "@piantic I write all my experiments on paper ", "votes": 1 } ] }, { "id": 977126, "postDate": "2020-08-19T09:59:27.923Z", "content": "@manjeshg03 Thanks for sharing and it is a great job.
", "rawMarkdown": "@manjeshg03 Thanks for sharing and it is a great job.", "votes": 1 }, { "id": 977283, "postDate": "2020-08-19T11:46:43.817Z", "content": "Thanks for sharing. I use Github Readme.md file to keep track of experiments.
\n.
I found a step-change in my ability to run experiments and properly engage with competitions when I started using an experiment tracking software…
\nCan't recommend neptune.ai enough, although its not great for analyzing the results of your experiments, it is great for logging! (I have no affiliation with neptune)
", "votes": 3, "replies": [ { "id": 977183, "author_name": "Manjesh Gupta", "author_url": "", "post_date": "2020-08-19T10:39:37.733000", "content": "Thank you for sharing! Will look into it.
", "votes": 0, "replies": [] }, { "id": 978235, "author_name": "", "author_url": "", "post_date": "2020-08-20T03:40:01.623000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 977022, "author_name": "Ioannis M", "author_url": "", "post_date": "2020-08-19T08:34:23.803000", "content": "Indeed tracking experiments is crucial - btw there are many automated tools that can do that for you, see MLflow, mlrun, determined, Weights & Biases and more. I've used as well in the beginning excel sheets but after some point getting too messy. Now I'm more in to use MLflow and W&B. To get an idea check these articles
\n\nPS: If you are interested I have also a (public) tutorial notebook that shows step-by-step the process with W&B.
\nEdit: Just to be clear, I have no affiliation with either MLflow, W&B - just use this tools with a free account :)
", "votes": 3, "replies": [ { "id": 977032, "author_name": "Sam Klein", "author_url": "", "post_date": "2020-08-19T08:48:24.153000", "content": "I would add that guild and sacred are also worth looking at
", "votes": 3, "replies": [] }, { "id": 977042, "author_name": "Manjesh Gupta", "author_url": "", "post_date": "2020-08-19T08:54:10.490000", "content": "Thanks for sharing, I will surely look into these.
", "votes": 1, "replies": [] }, { "id": 977105, "author_name": "Prateek Mishra", "author_url": "", "post_date": "2020-08-19T09:53:49.543000", "content": "I was looking for something like this. Thanks.!
", "votes": 1, "replies": [] } ] }, { "id": 976979, "author_name": "Signal", "author_url": "", "post_date": "2020-08-19T08:01:00.623000", "content": "Thanks for sharing. I use spreadsheets too! I track everything though its quite tedious……….I agree that keeping track is key! Especially if you want to mine the value in your OOF for stacking etc,
", "votes": 3, "replies": [] }, { "id": 977206, "author_name": "Hitesh Gorana", "author_url": "", "post_date": "2020-08-19T10:53:33.600000", "content": "Thanks for sharing :) I use PAPER + PEN
Could you explain more PAPER + PEN or share some articles? :)
\n@coolcoder22
Old school. Whatever works I guess. :)
", "votes": 0, "replies": [] }, { "id": 977251, "author_name": "Hitesh Gorana", "author_url": "", "post_date": "2020-08-19T11:28:11.423000", "content": "@piantic I write all my experiments on paper
", "votes": 1, "replies": [] } ] }, { "id": 977126, "author_name": "Heroseo", "author_url": "", "post_date": "2020-08-19T09:59:27.923000", "content": "@manjeshg03 Thanks for sharing and it is a great job.
", "votes": 1, "replies": [] }, { "id": 977283, "author_name": "Vatsal Parsaniya", "author_url": "", "post_date": "2020-08-19T11:46:43.817000", "content": "Thanks for sharing. I use Github Readme.md file to keep track of experiments.
\n.