{ "id": 253812, "title": "Score stuck at 0.1 - need some tips", "url": "/competitions/siim-covid19-detection/discussion/253812", "author_name": "RahulBhambri", "post_date": "2021-07-18T18:56:39.732000", "votes": 0, "comment_count": 3, "views": 0, "content": "

Hi,
\nI think I have few good models to make predictions.
\nHowever my submission pipeline is stuck at score of 0.1

\n

Please review my code and suggest for what might be wrong.
\nhttps://www.kaggle.com/rbhambri/covid-competition-submission-notebook

\n

Thanks!

", "messages": [ { "id": 1394612, "postDate": "2021-07-20T13:16:20.867Z", "content": "

Perhaps you should take one of the public notebooks and study it.
\nThere is something wrong with your models.
\nThe copied file sample_submission gives 0.176 at study level - your model is 0.1
\nTimm models trained for 4 give me up to 0.4

", "rawMarkdown": "Perhaps you should take one of the public notebooks and study it.\nThere is something wrong with your models.\nThe copied file sample_submission gives 0.176 at study level - your model is 0.1\nTimm models trained for 4 give me up to 0.4", "votes": 1 }, { "id": 1392517, "postDate": "2021-07-18T19:03:08.710Z", "content": "

Summary:

\n

Step1: I have a 4-class classifier trained at - https://www.kaggle.com/rbhambri/image-clf-chexnet-vanilla-cnn
\n(which i believe has a decent model perf)

\n

Step2: Default submission file submitted - 0.104 score.

\n

2a: In my submission notebook, tried model predictions using above model. Predicted only best class with its proba.
\nScore was 0.104

\n

2b: Model Predicted with all classed and respective proba. Score was 0.104

\n

2c: tried all classes predicted with proba 1
\n(similar to https://www.kaggle.com/c/siim-covid19-detection/discussion/241300)

\n

Looking for tips on why score not increasing…

", "rawMarkdown": "Summary:\n\nStep1: I have a 4-class classifier trained at - https://www.kaggle.com/rbhambri/image-clf-chexnet-vanilla-cnn\n(which i believe has a decent model perf)\n\nStep2: Default submission file submitted - 0.104 score.\n\n2a: In my submission notebook, tried model predictions using above model. Predicted only best class with its proba.\nScore was 0.104\n\n2b: Model Predicted with all classed and respective proba. Score was 0.104\n\n2c: tried all classes predicted with proba 1 \n(similar to https://www.kaggle.com/c/siim-covid19-detection/discussion/241300)\n\n\nLooking for tips on why score not increasing...\n", "replies": [ { "id": 1394131, "postDate": "2021-07-20T07:38:09.857Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 1392506, "postDate": "2021-07-18T18:56:39.733Z", "content": "

Hi,
\nI think I have few good models to make predictions.
\nHowever my submission pipeline is stuck at score of 0.1

\n

Please review my code and suggest for what might be wrong.
\nhttps://www.kaggle.com/rbhambri/covid-competition-submission-notebook

\n

Thanks!

", "rawMarkdown": "Hi,\nI think I have few good models to make predictions.\nHowever my submission pipeline is stuck at score of 0.1\n\nPlease review my code and suggest for what might be wrong.\nhttps://www.kaggle.com/rbhambri/covid-competition-submission-notebook\n\nThanks!\n" } ], "comments": [ { "id": 1394612, "author_name": "Zaakcii Ru", "author_url": "", "post_date": "2021-07-20T13:16:20.867000", "content": "

Perhaps you should take one of the public notebooks and study it.
\nThere is something wrong with your models.
\nThe copied file sample_submission gives 0.176 at study level - your model is 0.1
\nTimm models trained for 4 give me up to 0.4

", "votes": 1, "replies": [] }, { "id": 1392517, "author_name": "RahulBhambri", "author_url": "", "post_date": "2021-07-18T19:03:08.710000", "content": "

Summary:

\n

Step1: I have a 4-class classifier trained at - https://www.kaggle.com/rbhambri/image-clf-chexnet-vanilla-cnn
\n(which i believe has a decent model perf)

\n

Step2: Default submission file submitted - 0.104 score.

\n

2a: In my submission notebook, tried model predictions using above model. Predicted only best class with its proba.
\nScore was 0.104

\n

2b: Model Predicted with all classed and respective proba. Score was 0.104

\n

2c: tried all classes predicted with proba 1
\n(similar to https://www.kaggle.com/c/siim-covid19-detection/discussion/241300)

\n

Looking for tips on why score not increasing…

", "votes": 0, "replies": [ { "id": 1394131, "author_name": "", "author_url": "", "post_date": "2021-07-20T07:38:09.857000", "content": "", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "1394612": "Perhaps you should take one of the public notebooks and study it.\nThere is something wrong with your models.\nThe copied file sample_submission gives 0.176 at study level - your model is 0.1\nTimm models trained for 4 give me up to 0.4", "1392517": "Summary:\n\nStep1: I have a 4-class classifier trained at - https://www.kaggle.com/rbhambri/image-clf-chexnet-vanilla-cnn\n(which i believe has a decent model perf)\n\nStep2: Default submission file submitted - 0.104 score.\n\n2a: In my submission notebook, tried model predictions using above model. Predicted only best class with its proba.\nScore was 0.104\n\n2b: Model Predicted with all classed and respective proba. Score was 0.104\n\n2c: tried all classes predicted with proba 1 \n(similar to https://www.kaggle.com/c/siim-covid19-detection/discussion/241300)\n\n\nLooking for tips on why score not increasing...\n", "1392506": "Hi,\nI think I have few good models to make predictions.\nHowever my submission pipeline is stuck at score of 0.1\n\nPlease review my code and suggest for what might be wrong.\nhttps://www.kaggle.com/rbhambri/covid-competition-submission-notebook\n\nThanks!\n" } }