@datasciencegeek flagged that the original labeling scheme used different terms for cider apple rust depending on whether there that was the only label (cider_apple_rust) or if there were multiple labels (rust frog_leaf_eye_spot).
I've updated the evaluation files and train.csv to replace all occurrences of cider_apple_rust with rust to remove this issue.
@datasciencegeek flagged that the original labeling scheme used different terms for cider apple rust depending on whether there that was the only label (cider_apple_rust) or if there were multiple labels (rust frog_leaf_eye_spot).
I've updated the evaluation files and train.csv to replace all occurrences of cider_apple_rust with rust to remove this issue.
The plant pathology project isn't something that I'm working on, but I happened to see your comment on my home page this morning, and the term \"cider_apple_rust\" raised a red flag in my brain. As a serious home orchardist, I've never heard of such a thing, but cedar apple rust is a very problematic plant disease, and it made me wonder whether the cider was a misspelling error that should be cedar instead? My attempt to google \"cider apple rust\" yielded nothing but results for cedar apple rust.
", "rawMarkdown": "The plant pathology project isn't something that I'm working on, but I happened to see your comment on my home page this morning, and the term \"cider_apple_rust\" raised a red flag in my brain. As a serious home orchardist, I've never heard of such a thing, but cedar apple rust is a very problematic plant disease, and it made me wonder whether the cider was a misspelling error that should be cedar instead? My attempt to google \"cider apple rust\" yielded nothing but results for cedar apple rust.", "votes": null }, { "id": "1264268", "postDate": "04/06/2021 03:28:08", "content": "Could you please check the labels of the testing data as well? Since many participators has met a inconsistency issue between cross-validation score and leader-board socre.
\nI can be sure that my evaluation metric is correct, but there is still a large gap between the CV and LB score.
\nPlease check if there are extra labels excluded from these 6:
\n0: 'powdery_mildew',
\n1: 'scab',
\n2: 'complex',
\n3: 'frog_eye_leaf_spot',
\n4: 'rust'
\n5:'healthy'
I also observe the same thing.
", "rawMarkdown": "I also observe the same thing.", "votes": null } ], "comments": [ { "id": 1252099, "author_name": "jmreuter", "author_url": "", "post_date": "03/25/2021 12:25:27", "content": "The plant pathology project isn't something that I'm working on, but I happened to see your comment on my home page this morning, and the term \"cider_apple_rust\" raised a red flag in my brain. As a serious home orchardist, I've never heard of such a thing, but cedar apple rust is a very problematic plant disease, and it made me wonder whether the cider was a misspelling error that should be cedar instead? My attempt to google \"cider apple rust\" yielded nothing but results for cedar apple rust.
", "votes": null, "replies": [] }, { "id": 1264268, "author_name": "crissallan", "author_url": "", "post_date": "04/06/2021 03:28:08", "content": "Could you please check the labels of the testing data as well? Since many participators has met a inconsistency issue between cross-validation score and leader-board socre.
\nI can be sure that my evaluation metric is correct, but there is still a large gap between the CV and LB score.
\nPlease check if there are extra labels excluded from these 6:
\n0: 'powdery_mildew',
\n1: 'scab',
\n2: 'complex',
\n3: 'frog_eye_leaf_spot',
\n4: 'rust'
\n5:'healthy'
I also observe the same thing.
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "1251482": "datasciencegeek flagged that [the original labeling scheme](https://www.kaggle.com/c/plant-pathology-2021-fgvc8/discussion/228245#1251226) used different terms for cider apple rust depending on whether there that was the only label (`cider_apple_rust`) or if there were multiple labels (`rust frog_leaf_eye_spot`). \n\nI've updated the evaluation files and **train.csv** to replace all occurrences of `cider_apple_rust` with `rust` to remove this issue.", "1252099": "The plant pathology project isn't something that I'm working on, but I happened to see your comment on my home page this morning, and the term \"cider_apple_rust\" raised a red flag in my brain. As a serious home orchardist, I've never heard of such a thing, but cedar apple rust is a very problematic plant disease, and it made me wonder whether the cider was a misspelling error that should be cedar instead? My attempt to google \"cider apple rust\" yielded nothing but results for cedar apple rust.", "1264268": "Could you please check the labels of the testing data as well? Since many participators has met a inconsistency issue between cross-validation score and leader-board socre. \n\nI can be sure that my evaluation metric is correct, but there is still a large gap between the CV and LB score.\n\nPlease check if there are extra labels excluded from these 6:\n0: 'powdery_mildew',\n1: 'scab',\n2: 'complex',\n3: 'frog_eye_leaf_spot',\n4: 'rust'\n5:'healthy'", "1279155": "I also observe the same thing." }, "source": "meta" }