![\"\"](\"https://f.easyuploader.app/20210721135737_73795730.JPG\")
Hello everyone, as we know that we are dealing with a problem that can also be solved by using 3D models. And training these models from scratch would be too expensive wrt computation.
\nSo are there any 3D pre-trained models that we can use? I hope you will share them
\n(by pretrained, I mean models that have been trained on free-to-use datasets like Imagenet, or use backbone networks like resnets,efficentnets etc that have been trained on Imagenet dataset)
If you are confused with 3D Conv models, check out this video where a past competition like this was discussed by sentdex https://www.youtube.com/watch?v=ulq9DjCJPDU&list=PLQVvvaa0QuDd5meH8cStO9cMi98tPT12_
", "messages": [ { "id": "1388853", "postDate": "07/15/2021 09:05:33", "content": "Hello everyone, as we know that we are dealing with a problem that can also be solved by using 3D models. And training these models from scratch would be too expensive wrt computation.
\nSo are there any 3D pre-trained models that we can use? I hope you will share them
\n(by pretrained, I mean models that have been trained on free-to-use datasets like Imagenet, or use backbone networks like resnets,efficentnets etc that have been trained on Imagenet dataset)
If you are confused with 3D Conv models, check out this video where a past competition like this was discussed by sentdex https://www.youtube.com/watch?v=ulq9DjCJPDU&list=PLQVvvaa0QuDd5meH8cStO9cMi98tPT12_
", "rawMarkdown": "Hello everyone, as we know that we are dealing with a problem that can also be solved by using 3D models. And training these models from scratch would be too expensive wrt computation.\nSo are there any 3D pre-trained models that we can use? I hope you will share them\n(by pretrained, I mean models that have been trained on free-to-use datasets like Imagenet, or use backbone networks like resnets,efficentnets etc that have been trained on Imagenet dataset)\n\nIf you are confused with 3D Conv models, check out this video where a past competition like this was discussed by sentdex https://www.youtube.com/watch?v=ulq9DjCJPDU&list=PLQVvvaa0QuDd5meH8cStO9cMi98tPT12_", "votes": null }, { "id": "1388898", "postDate": "07/15/2021 09:52:52", "content": "@mrinath, awesome post. It would be awesome to have a 3D pre-trained model indeed. My poor computer can't even handle training models that analyse pictues haha. I am following your topic. Hope someone might be able to help.
", "rawMarkdown": "mrinath, awesome post. It would be awesome to have a 3D pre-trained model indeed. My poor computer can't even handle training models that analyse pictues haha. I am following your topic. Hope someone might be able to help.", "votes": null }, { "id": "1388908", "postDate": "07/15/2021 09:59:54", "content": "@mrinath This is very relatable. I had to drop a lot of interesting projects because of the expense! This is an excellent share. Thanks a lot for this! Hopefully we get some help on this soon.
", "rawMarkdown": "mrinath This is very relatable. I had to drop a lot of interesting projects because of the expense! This is an excellent share. Thanks a lot for this! Hopefully we get some help on this soon.", "votes": null }, { "id": "1388927", "postDate": "07/15/2021 10:09:42", "content": "Same here, lol
", "rawMarkdown": "Same here, lol", "votes": null }, { "id": "1389547", "postDate": "07/15/2021 20:06:15", "content": "Yes, that would be great. I had a look at the MONAI library (an open-source python package for deep learning on medical data, https://docs.monai.io/en/latest/networks.html#nets), but they don't seem to have any pretrained 3D models.
\nI think a reliable 2D/3D model for tumor segmentation would be super helpful. Then it would be possible to cut out the tumors and train on a much smaller and hopefully more meaningful dataset.
That's exactly what I was thinking of.
", "rawMarkdown": "That's exactly what I was thinking of.", "votes": null }, { "id": "1391536", "postDate": "07/17/2021 17:28:53", "content": "Great post! I was actually just reading an article about Andrew Ng's CV course, yesterday, and there was a reference in there just around this, specifically, under the section on \"How to win CV competitions\" - :) --
\nIt recommended using \"an open source implementation and pretrained model to start and then fine-tune the parameters for your particular application.\" However, not familiar to this subject so I am glad to see others posing the same question. where would we find some pre-trained models for CVS? and which ones would be appropriate to use in this case?
\nThanks for sharing the video link, i will check it out.
", "rawMarkdown": "Great post! I was actually just reading an article about Andrew Ng's CV course, yesterday, and there was a reference in there just around this, specifically, under the section on \"How to win CV competitions\" - :) --\n\nIt recommended using \"an open source implementation and pretrained model to start and then fine-tune the parameters for your particular application.\" However, not familiar to this subject so I am glad to see others posing the same question. where would we find some pre-trained models for CVS? and which ones would be appropriate to use in this case?\n\nThanks for sharing the video link, i will check it out.", "votes": null }, { "id": "1392013", "postDate": "07/18/2021 09:42:24", "content": "Take a look at https://github.com/Tencent/MedicalNet, it seems very close to what youโre looking for
", "rawMarkdown": "Take a look at https://github.com/Tencent/MedicalNet, it seems very close to what youโre looking for", "votes": null }, { "id": "1392048", "postDate": "07/18/2021 10:25:18", "content": "Really thanks for this and yes it looks like what we were searching for
", "rawMarkdown": "Really thanks for this and yes it looks like what we were searching for", "votes": null }, { "id": "1395274", "postDate": "07/21/2021 05:14:03", "content": "I think the best way to find good models is to do a search on Paper with Code(PwC).
\nFor example, here is a link to a dataset in the medical field with the search term \"brain\".
\n๐ https://paperswithcode.com/datasets?q=brain&v=lst&o=match&mod=medical&page=1
For each dataset, you can select a model that is well implemented and seems to have high accuracy. The pre-trained weights may be important in our case.
\nFor example, BraTS 2018, which is a previous version of this competition, is also in the list, and if you follow the links from there, you can find, for example, MedicalZooPytorch.
\n๐ https://github.com/black0017/MedicalZooPytorch
MedicalNet, mentioned by @reubenschmidt in the comment below, is also registered with PwC.
\nhttps://paperswithcode.com/paper/med3d-transfer-learning-for-3d-medical-image
If you find something that looks good, we would be happy if you could share it here ๐
", "rawMarkdown": "I think the best way to find good models is to do a search on [Paper with Code](https://paperswithcode.com/sota)(PwC).\n\nFor example, here is a link to a dataset in the medical field with the search term \"brain\".\n๐ https://paperswithcode.com/datasets?q=brain&v=lst&o=match&mod=medical&page=1\n\n\n\nFor each dataset, you can select a model that is well implemented and seems to have high accuracy. The pre-trained weights may be important in our case. \n\nFor example, [BraTS 2018](https://paperswithcode.com/dataset/brats-2018-1), which is a previous version of this competition, is also in the list, and if you follow the links from there, you can find, for example, MedicalZooPytorch.\n๐ https://github.com/black0017/MedicalZooPytorch\n\nMedicalNet, mentioned by @reubenschmidt in the comment below, is also registered with PwC.\nhttps://paperswithcode.com/paper/med3d-transfer-learning-for-3d-medical-image\n\nIf you find something that looks good, we would be happy if you could share it here ๐", "votes": null }, { "id": "1395939", "postDate": "07/21/2021 16:26:32", "content": "thank you @maxwell110. very useful information.
", "rawMarkdown": "thank you @maxwell110. very useful information.", "votes": null }, { "id": "1398259", "postDate": "07/23/2021 23:37:08", "content": "For tensorflow/keras, one can use a pretrained 3d model of efficientnet b0-b7 and other classification models from this repo:
FYI, in my public notebook, I showed how to use them. here, in section C. 3D Model : Pre-trained Weights
", "rawMarkdown": "For `tensorflow/keras`, one can use a pretrained 3d model of efficientnet b0-b7 and other classification models from this repo: \n\n- https://github.com/ZFTurbo/classification_models_3D\n- https://github.com/ZFTurbo/efficientnet_3D\n\nFYI, in my public notebook, I showed how to use them. [here](https://www.kaggle.com/ipythonx/tf-3d-2d-model-for-brain-tumor-classification#C.-3D-Model-:-Pre-trained-Weights), in section C. 3D Model : Pre-trained Weights", "votes": null } ], "comments": [ { "id": 1388898, "author_name": "jonaslneri", "author_url": "", "post_date": "07/15/2021 09:52:52", "content": "@mrinath, awesome post. It would be awesome to have a 3D pre-trained model indeed. My poor computer can't even handle training models that analyse pictues haha. I am following your topic. Hope someone might be able to help.
", "votes": null, "replies": [ { "id": 1388927, "author_name": "mrinath", "author_url": "", "post_date": "07/15/2021 10:09:42", "content": "Same here, lol
", "votes": null, "replies": [] } ] }, { "id": 1388908, "author_name": "adhithia", "author_url": "", "post_date": "07/15/2021 09:59:54", "content": "@mrinath This is very relatable. I had to drop a lot of interesting projects because of the expense! This is an excellent share. Thanks a lot for this! Hopefully we get some help on this soon.
", "votes": null, "replies": [] }, { "id": 1389547, "author_name": "lillik", "author_url": "", "post_date": "07/15/2021 20:06:15", "content": "Yes, that would be great. I had a look at the MONAI library (an open-source python package for deep learning on medical data, https://docs.monai.io/en/latest/networks.html#nets), but they don't seem to have any pretrained 3D models.
\nI think a reliable 2D/3D model for tumor segmentation would be super helpful. Then it would be possible to cut out the tumors and train on a much smaller and hopefully more meaningful dataset.
That's exactly what I was thinking of.
", "votes": null, "replies": [] } ] }, { "id": 1391536, "author_name": "elenaeb", "author_url": "", "post_date": "07/17/2021 17:28:53", "content": "Great post! I was actually just reading an article about Andrew Ng's CV course, yesterday, and there was a reference in there just around this, specifically, under the section on \"How to win CV competitions\" - :) --
\nIt recommended using \"an open source implementation and pretrained model to start and then fine-tune the parameters for your particular application.\" However, not familiar to this subject so I am glad to see others posing the same question. where would we find some pre-trained models for CVS? and which ones would be appropriate to use in this case?
\nThanks for sharing the video link, i will check it out.
", "votes": null, "replies": [] }, { "id": 1392013, "author_name": "reubenschmidt", "author_url": "", "post_date": "07/18/2021 09:42:24", "content": "Take a look at https://github.com/Tencent/MedicalNet, it seems very close to what youโre looking for
", "votes": null, "replies": [ { "id": 1392048, "author_name": "mrinath", "author_url": "", "post_date": "07/18/2021 10:25:18", "content": "Really thanks for this and yes it looks like what we were searching for
", "votes": null, "replies": [] } ] }, { "id": 1395274, "author_name": "maxwell110", "author_url": "", "post_date": "07/21/2021 05:14:03", "content": "I think the best way to find good models is to do a search on Paper with Code(PwC).
\nFor example, here is a link to a dataset in the medical field with the search term \"brain\".
\n๐ https://paperswithcode.com/datasets?q=brain&v=lst&o=match&mod=medical&page=1
For each dataset, you can select a model that is well implemented and seems to have high accuracy. The pre-trained weights may be important in our case.
\nFor example, BraTS 2018, which is a previous version of this competition, is also in the list, and if you follow the links from there, you can find, for example, MedicalZooPytorch.
\n๐ https://github.com/black0017/MedicalZooPytorch
MedicalNet, mentioned by @reubenschmidt in the comment below, is also registered with PwC.
\nhttps://paperswithcode.com/paper/med3d-transfer-learning-for-3d-medical-image
If you find something that looks good, we would be happy if you could share it here ๐
", "votes": null, "replies": [ { "id": 1395939, "author_name": "tharun2001", "author_url": "", "post_date": "07/21/2021 16:26:32", "content": "thank you @maxwell110. very useful information.
", "votes": null, "replies": [] } ] }, { "id": 1398259, "author_name": "ipythonx", "author_url": "", "post_date": "07/23/2021 23:37:08", "content": "For tensorflow/keras, one can use a pretrained 3d model of efficientnet b0-b7 and other classification models from this repo:
FYI, in my public notebook, I showed how to use them. here, in section C. 3D Model : Pre-trained Weights
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "1388853": "Hello everyone, as we know that we are dealing with a problem that can also be solved by using 3D models. And training these models from scratch would be too expensive wrt computation.\nSo are there any 3D pre-trained models that we can use? I hope you will share them\n(by pretrained, I mean models that have been trained on free-to-use datasets like Imagenet, or use backbone networks like resnets,efficentnets etc that have been trained on Imagenet dataset)\n\nIf you are confused with 3D Conv models, check out this video where a past competition like this was discussed by sentdex https://www.youtube.com/watch?v=ulq9DjCJPDU&list=PLQVvvaa0QuDd5meH8cStO9cMi98tPT12_", "1388898": "mrinath, awesome post. It would be awesome to have a 3D pre-trained model indeed. My poor computer can't even handle training models that analyse pictues haha. I am following your topic. Hope someone might be able to help.", "1388908": "mrinath This is very relatable. I had to drop a lot of interesting projects because of the expense! This is an excellent share. Thanks a lot for this! Hopefully we get some help on this soon.", "1388927": "Same here, lol", "1389547": "Yes, that would be great. I had a look at the MONAI library (an open-source python package for deep learning on medical data, [https://docs.monai.io/en/latest/networks.html#nets](https://docs.monai.io/en/latest/networks.html#nets)), but they don't seem to have any pretrained 3D models. \nI think a reliable 2D/3D model for tumor segmentation would be super helpful. Then it would be possible to cut out the tumors and train on a much smaller and hopefully more meaningful dataset.", "1389811": "That's exactly what I was thinking of.", "1391536": "Great post! I was actually just reading an article about Andrew Ng's CV course, yesterday, and there was a reference in there just around this, specifically, under the section on \"How to win CV competitions\" - :) --\n\nIt recommended using \"an open source implementation and pretrained model to start and then fine-tune the parameters for your particular application.\" However, not familiar to this subject so I am glad to see others posing the same question. where would we find some pre-trained models for CVS? and which ones would be appropriate to use in this case?\n\nThanks for sharing the video link, i will check it out.", "1392013": "Take a look at https://github.com/Tencent/MedicalNet, it seems very close to what youโre looking for", "1392048": "Really thanks for this and yes it looks like what we were searching for", "1395274": "I think the best way to find good models is to do a search on [Paper with Code](https://paperswithcode.com/sota)(PwC).\n\nFor example, here is a link to a dataset in the medical field with the search term \"brain\".\n๐ https://paperswithcode.com/datasets?q=brain&v=lst&o=match&mod=medical&page=1\n\n\n\nFor each dataset, you can select a model that is well implemented and seems to have high accuracy. The pre-trained weights may be important in our case. \n\nFor example, [BraTS 2018](https://paperswithcode.com/dataset/brats-2018-1), which is a previous version of this competition, is also in the list, and if you follow the links from there, you can find, for example, MedicalZooPytorch.\n๐ https://github.com/black0017/MedicalZooPytorch\n\nMedicalNet, mentioned by @reubenschmidt in the comment below, is also registered with PwC.\nhttps://paperswithcode.com/paper/med3d-transfer-learning-for-3d-medical-image\n\nIf you find something that looks good, we would be happy if you could share it here ๐", "1395939": "thank you @maxwell110. very useful information.", "1398259": "For `tensorflow/keras`, one can use a pretrained 3d model of efficientnet b0-b7 and other classification models from this repo: \n\n- https://github.com/ZFTurbo/classification_models_3D\n- https://github.com/ZFTurbo/efficientnet_3D\n\nFYI, in my public notebook, I showed how to use them. [here](https://www.kaggle.com/ipythonx/tf-3d-2d-model-for-brain-tumor-classification#C.-3D-Model-:-Pre-trained-Weights), in section C. 3D Model : Pre-trained Weights" }, "source": "meta" }