I am new to Kaggle and trying to make my first submission. It's already been more than three hours and it doesn't seem that the notebook is submitted yet. Is there anything I am doing wrong as the notebook executed in around 20 minutes using the GPU.
", "messages": [ { "id": 1224335, "postDate": "2021-03-02T16:33:51.850Z", "content": "It takes a lot less time now thanks to some brilliant work here: Even Faster HPA Cell Segmentation
", "rawMarkdown": "It takes a lot less time now thanks to some brilliant work here: [Even Faster HPA Cell Segmentation](https://www.kaggle.com/samusram/even-faster-hpa-cell-segmentation)", "votes": 1 }, { "id": 1215523, "postDate": "2021-02-23T17:37:31.643Z", "content": "Time to run in the notebook depends on how many images your processing. Most folks write script to only process a few of the public test images. I like to test more than the batch size I am using just to be sure no errors in my batch code. When the code is pretty stable and only small changes than for this competition I am running 3 images.
\nOnce I save and run that same code only takes a minute or two. Of course, I can set parameters for the full public test to run on a save/run. That takes several hours - 3 to 5.
\nWhen I submit than the private test set of images is run - the private has more images than the public test. That takes around 7 hours to complete.
", "rawMarkdown": "Time to run in the notebook depends on how many images your processing. Most folks write script to only process a few of the public test images. I like to test more than the batch size I am using just to be sure no errors in my batch code. When the code is pretty stable and only small changes than for this competition I am running 3 images.\n\nOnce I save and run that same code only takes a minute or two. Of course, I can set parameters for the full public test to run on a save/run. That takes several hours - 3 to 5.\n\nWhen I submit than the private test set of images is run - the private has more images than the public test. That takes around 7 hours to complete.\n ", "votes": 2, "replies": [ { "id": 1216487, "postDate": "2021-02-24T09:43:15.177Z", "content": "Yeah I suppose that's what is happening as the notebook took around 8 hrs to process the private test set. Thanks 👍
", "rawMarkdown": "Yeah I suppose that's what is happening as the notebook took around 8 hrs to process the private test set. Thanks 👍", "votes": 1 } ] }, { "id": 1215313, "postDate": "2021-02-23T14:16:38.137Z", "content": "I am new to Kaggle and trying to make my first submission. It's already been more than three hours and it doesn't seem that the notebook is submitted yet. Is there anything I am doing wrong as the notebook executed in around 20 minutes using the GPU.
", "rawMarkdown": "I am new to Kaggle and trying to make my first submission. It's already been more than three hours and it doesn't seem that the notebook is submitted yet. Is there anything I am doing wrong as the notebook executed in around 20 minutes using the GPU. ", "votes": 2 }, { "id": 1215345, "postDate": "2021-02-23T14:47:34.700Z", "content": "When you submit, Kaggle executes your notebook code on hidden test set which may be significantly larger than the public test set. Depending on what happens in your notebook (training / inference) that may take a significant amount of time.
", "rawMarkdown": "When you submit, Kaggle executes your notebook code on hidden test set which may be significantly larger than the public test set. Depending on what happens in your notebook (training / inference) that may take a significant amount of time. ", "replies": [ { "id": 1215401, "postDate": "2021-02-23T15:23:05.867Z", "content": "Thanks Darek. Is there anything else I could do to decrease this submission time? Also how much time does it take for you or others to submit?
", "rawMarkdown": "Thanks Darek. Is there anything else I could do to decrease this submission time? Also how much time does it take for you or others to submit?" }, { "id": 1215406, "postDate": "2021-02-23T15:26:55.507Z", "content": "For me it takes 1-2 minutes but I don't do any calculation in the submission template and that will result in a zero private score. But this allows for rapid iteration/feedback:
\nhttps://www.kaggle.com/thedrcat/fastai-quick-submission-template
You can also check out other public kernels to see other approaches.
", "rawMarkdown": "For me it takes 1-2 minutes but I don't do any calculation in the submission template and that will result in a zero private score. But this allows for rapid iteration/feedback: \nhttps://www.kaggle.com/thedrcat/fastai-quick-submission-template\n\nYou can also check out other public kernels to see other approaches. ", "votes": 1 }, { "id": 1215414, "postDate": "2021-02-23T15:31:25.733Z", "content": "Thanks a lot. I will check this out 👍
", "rawMarkdown": "Thanks a lot. I will check this out 👍" } ] } ], "comments": [ { "id": 1224335, "author_name": "Arka Saha", "author_url": "", "post_date": "2021-03-02T16:33:51.850000", "content": "It takes a lot less time now thanks to some brilliant work here: Even Faster HPA Cell Segmentation
", "votes": 1, "replies": [] }, { "id": 1215523, "author_name": "PC Jimmmy", "author_url": "", "post_date": "2021-02-23T17:37:31.643000", "content": "Time to run in the notebook depends on how many images your processing. Most folks write script to only process a few of the public test images. I like to test more than the batch size I am using just to be sure no errors in my batch code. When the code is pretty stable and only small changes than for this competition I am running 3 images.
\nOnce I save and run that same code only takes a minute or two. Of course, I can set parameters for the full public test to run on a save/run. That takes several hours - 3 to 5.
\nWhen I submit than the private test set of images is run - the private has more images than the public test. That takes around 7 hours to complete.
", "votes": 2, "replies": [ { "id": 1216487, "author_name": "Ish", "author_url": "", "post_date": "2021-02-24T09:43:15.177000", "content": "Yeah I suppose that's what is happening as the notebook took around 8 hrs to process the private test set. Thanks 👍
", "votes": 1, "replies": [] } ] }, { "id": 1215345, "author_name": "Darek Kłeczek", "author_url": "", "post_date": "2021-02-23T14:47:34.700000", "content": "When you submit, Kaggle executes your notebook code on hidden test set which may be significantly larger than the public test set. Depending on what happens in your notebook (training / inference) that may take a significant amount of time.
", "votes": 0, "replies": [ { "id": 1215401, "author_name": "Ish", "author_url": "", "post_date": "2021-02-23T15:23:05.867000", "content": "Thanks Darek. Is there anything else I could do to decrease this submission time? Also how much time does it take for you or others to submit?
", "votes": 0, "replies": [] }, { "id": 1215406, "author_name": "Darek Kłeczek", "author_url": "", "post_date": "2021-02-23T15:26:55.507000", "content": "For me it takes 1-2 minutes but I don't do any calculation in the submission template and that will result in a zero private score. But this allows for rapid iteration/feedback:
\nhttps://www.kaggle.com/thedrcat/fastai-quick-submission-template
You can also check out other public kernels to see other approaches.
", "votes": 1, "replies": [] }, { "id": 1215414, "author_name": "Ish", "author_url": "", "post_date": "2021-02-23T15:31:25.733000", "content": "Thanks a lot. I will check this out 👍
", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "1224335": "It takes a lot less time now thanks to some brilliant work here: [Even Faster HPA Cell Segmentation](https://www.kaggle.com/samusram/even-faster-hpa-cell-segmentation)", "1215523": "Time to run in the notebook depends on how many images your processing. Most folks write script to only process a few of the public test images. I like to test more than the batch size I am using just to be sure no errors in my batch code. When the code is pretty stable and only small changes than for this competition I am running 3 images.\n\nOnce I save and run that same code only takes a minute or two. Of course, I can set parameters for the full public test to run on a save/run. That takes several hours - 3 to 5.\n\nWhen I submit than the private test set of images is run - the private has more images than the public test. That takes around 7 hours to complete.\n ", "1215313": "I am new to Kaggle and trying to make my first submission. It's already been more than three hours and it doesn't seem that the notebook is submitted yet. Is there anything I am doing wrong as the notebook executed in around 20 minutes using the GPU. ", "1215345": "When you submit, Kaggle executes your notebook code on hidden test set which may be significantly larger than the public test set. Depending on what happens in your notebook (training / inference) that may take a significant amount of time. " } }