{
  "id": 220103,
  "title": "difference between CV and LB is too high",
  "url": "/competitions/cassava-leaf-disease-classification/discussion/220103",
  "author_name": "",
  "post_date": "2021-02-17T13:22:28.440691200Z",
  "votes": 1,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Hi all, </p>\n<p>I'm quite confused with some results that I'm getting. Maybe some of you might have faced the same. </p>\n<p>With 2020+2019 dataset, eff4+resnext50,  5-fold CV was 0.894 and LB was 0.896. After adding softmix and cutout augmentations, CV shoot to 0.910, but LB was 0.899 only. Had anyone faced the same issue and can we trust CV or go with the public LB?</p>",
  "messages": [
    {
      "id": "1206608",
      "postDate": "02/17/2021 13:22:28",
      "content": "<p>Hi all, </p>\n<p>I'm quite confused with some results that I'm getting. Maybe some of you might have faced the same. </p>\n<p>With 2020+2019 dataset, eff4+resnext50,  5-fold CV was 0.894 and LB was 0.896. After adding softmix and cutout augmentations, CV shoot to 0.910, but LB was 0.899 only. Had anyone faced the same issue and can we trust CV or go with the public LB?</p>",
      "rawMarkdown": "Hi all, \n\nI'm quite confused with some results that I'm getting. Maybe some of you might have faced the same. \n\nWith 2020+2019 dataset, eff4+resnext50,  5-fold CV was 0.894 and LB was 0.896. After adding softmix and cutout augmentations, CV shoot to 0.910, but LB was 0.899 only. Had anyone faced the same issue and can we trust CV or go with the public LB?",
      "votes": null
    },
    {
      "id": "1206747",
      "postDate": "02/17/2021 14:38:11",
      "content": "<p>Is your 0.91 CV 5 fold? <br>\nIt is the same for me, 0.9055 CV and 0.9 lb, but trust CV</p>",
      "rawMarkdown": "Is your 0.91 CV 5 fold? \nIt is the same for me, 0.9055 CV and 0.9 lb, but trust CV",
      "votes": null
    },
    {
      "id": "1206975",
      "postDate": "02/17/2021 16:34:56",
      "content": "<p>cv 0.910? be careful about data-leak</p>",
      "rawMarkdown": "cv 0.910? be careful about data-leak",
      "votes": null
    },
    {
      "id": "1208218",
      "postDate": "02/18/2021 07:58:46",
      "content": "<p>The private data can be the deciding factor. I would say Trusting your CV is the best thing to do.</p>",
      "rawMarkdown": "The private data can be the deciding factor. I would say Trusting your CV is the best thing to do.",
      "votes": null
    },
    {
      "id": "1208262",
      "postDate": "02/18/2021 08:19:37",
      "content": "<p>CV is high because of  duplicate images gone into CV which are present in training as well causing data leak. Can try DBSCAN to remove them</p>",
      "rawMarkdown": "CV is high because of  duplicate images gone into CV which are present in training as well causing data leak. Can try DBSCAN to remove them",
      "votes": null
    },
    {
      "id": "1208719",
      "postDate": "02/18/2021 13:02:55",
      "content": "<p>So much to learn from you man. You earned a follow.</p>",
      "rawMarkdown": "So much to learn from you man. You earned a follow.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1206747,
      "author_name": "yannmajewski",
      "author_url": "",
      "post_date": "02/17/2021 14:38:11",
      "content": "<p>Is your 0.91 CV 5 fold? <br>\nIt is the same for me, 0.9055 CV and 0.9 lb, but trust CV</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1206975,
      "author_name": "deepkim",
      "author_url": "",
      "post_date": "02/17/2021 16:34:56",
      "content": "<p>cv 0.910? be careful about data-leak</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1208218,
      "author_name": "mohneesh7",
      "author_url": "",
      "post_date": "02/18/2021 07:58:46",
      "content": "<p>The private data can be the deciding factor. I would say Trusting your CV is the best thing to do.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1208262,
      "author_name": "vickygoyal",
      "author_url": "",
      "post_date": "02/18/2021 08:19:37",
      "content": "<p>CV is high because of  duplicate images gone into CV which are present in training as well causing data leak. Can try DBSCAN to remove them</p>",
      "votes": null,
      "replies": [
        {
          "id": 1208719,
          "author_name": "mohneesh7",
          "author_url": "",
          "post_date": "02/18/2021 13:02:55",
          "content": "<p>So much to learn from you man. You earned a follow.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1206608": "Hi all, \n\nI'm quite confused with some results that I'm getting. Maybe some of you might have faced the same. \n\nWith 2020+2019 dataset, eff4+resnext50,  5-fold CV was 0.894 and LB was 0.896. After adding softmix and cutout augmentations, CV shoot to 0.910, but LB was 0.899 only. Had anyone faced the same issue and can we trust CV or go with the public LB?",
    "1206747": "Is your 0.91 CV 5 fold? \nIt is the same for me, 0.9055 CV and 0.9 lb, but trust CV",
    "1206975": "cv 0.910? be careful about data-leak",
    "1208218": "The private data can be the deciding factor. I would say Trusting your CV is the best thing to do.",
    "1208262": "CV is high because of  duplicate images gone into CV which are present in training as well causing data leak. Can try DBSCAN to remove them",
    "1208719": "So much to learn from you man. You earned a follow."
  },
  "source": "meta"
}