{
  "id": 167965,
  "title": "Data-Efficient Deep Learning Method for ImageClassification Using Data Augmentation, FocalCosine Loss, and Ensemble",
  "url": "/competitions/siim-isic-melanoma-classification/discussion/167965",
  "author_name": "",
  "post_date": "2020-07-18T14:45:51.438449800Z",
  "votes": 3,
  "comment_count": 4,
  "views": 0,
  "content": "<p><strong>found 1 interesting paper today</strong></p>\n\n<p>Abstract : \nIn general, sufficient data is essential for the better perfor-mance and generalization of deep-learning models. However, lots of lim-itations(cost, resources, etc.) of data collection leads to lack of enoughdata  in  most  of  the  areas.  In  addition,  various  domains  of  each  datasources  and  licenses  also  lead  to  difficulties  in  collection  of  sufficientdata.  This  situation  makes  us  hard  to  utilize  not  only  the  pre-trainedmodel,  but  also  the  external  knowledge.  Therefore,  it  is  important  toleverage small dataset effectively for achieving the better performance.We  applied  some  techniques  in  three  aspects:  data,  loss  function,  andprediction  to  enable  training  from  scratch  with  less  data.  With  thesemethods, we obtain high accuracy by leveraging ImageNet data whichconsist of only 50 images per class. Furthermore, our model is ranked 4thin Visual Inductive Printers for Data-Effective Computer Vision Chal-lenge.</p>\n\n<p><img src=\"https://media-exp1.licdn.com/dms/image/C4D22AQFuJbKRh_Oolw/feedshare-shrink_800/0?e=1597881600&amp;v=beta&amp;t=HbtQHwjUvETwM5CG1lmmXGlONzY_qP5r4oi3vU0UFVE\" alt=\"\"></p>\n\n<p>also check figure 2 of that paper :)</p>\n\n<p>paper link : <a href=\"https://arxiv.org/pdf/2007.07805.pdf\">https://arxiv.org/pdf/2007.07805.pdf</a></p>",
  "messages": [
    {
      "id": "934567",
      "postDate": "07/18/2020 14:45:51",
      "content": "<p><strong>found 1 interesting paper today</strong></p>\n\n<p>Abstract : \nIn general, sufficient data is essential for the better perfor-mance and generalization of deep-learning models. However, lots of lim-itations(cost, resources, etc.) of data collection leads to lack of enoughdata  in  most  of  the  areas.  In  addition,  various  domains  of  each  datasources  and  licenses  also  lead  to  difficulties  in  collection  of  sufficientdata.  This  situation  makes  us  hard  to  utilize  not  only  the  pre-trainedmodel,  but  also  the  external  knowledge.  Therefore,  it  is  important  toleverage small dataset effectively for achieving the better performance.We  applied  some  techniques  in  three  aspects:  data,  loss  function,  andprediction  to  enable  training  from  scratch  with  less  data.  With  thesemethods, we obtain high accuracy by leveraging ImageNet data whichconsist of only 50 images per class. Furthermore, our model is ranked 4thin Visual Inductive Printers for Data-Effective Computer Vision Chal-lenge.</p>\n\n<p><img src=\"https://media-exp1.licdn.com/dms/image/C4D22AQFuJbKRh_Oolw/feedshare-shrink_800/0?e=1597881600&amp;v=beta&amp;t=HbtQHwjUvETwM5CG1lmmXGlONzY_qP5r4oi3vU0UFVE\" alt=\"\"></p>\n\n<p>also check figure 2 of that paper :)</p>\n\n<p>paper link : <a href=\"https://arxiv.org/pdf/2007.07805.pdf\">https://arxiv.org/pdf/2007.07805.pdf</a></p>",
      "rawMarkdown": "**found 1 interesting paper today**\n\nAbstract : \nIn general, sufficient data is essential for the better perfor-mance and generalization of deep-learning models. However, lots of lim-itations(cost, resources, etc.) of data collection leads to lack of enoughdata  in  most  of  the  areas.  In  addition,  various  domains  of  each  datasources  and  licenses  also  lead  to  difficulties  in  collection  of  sufficientdata.  This  situation  makes  us  hard  to  utilize  not  only  the  pre-trainedmodel,  but  also  the  external  knowledge.  Therefore,  it  is  important  toleverage small dataset effectively for achieving the better performance.We  applied  some  techniques  in  three  aspects:  data,  loss  function,  andprediction  to  enable  training  from  scratch  with  less  data.  With  thesemethods, we obtain high accuracy by leveraging ImageNet data whichconsist of only 50 images per class. Furthermore, our model is ranked 4thin Visual Inductive Printers for Data-Effective Computer Vision Chal-lenge.\n\n![](https://media-exp1.licdn.com/dms/image/C4D22AQFuJbKRh_Oolw/feedshare-shrink_800/0?e=1597881600&amp;v=beta&amp;t=HbtQHwjUvETwM5CG1lmmXGlONzY_qP5r4oi3vU0UFVE)\n\nalso check figure 2 of that paper :)\n\npaper link : https://arxiv.org/pdf/2007.07805.pdf",
      "votes": null
    },
    {
      "id": "934617",
      "postDate": "07/18/2020 15:32:44",
      "content": "<p>Is there any snippet for focal cosine loss in tensorflow??</p>",
      "rawMarkdown": "Is there any snippet for focal cosine loss in tensorflow??",
      "votes": null
    },
    {
      "id": "934641",
      "postDate": "07/18/2020 15:52:15",
      "content": "<p><a href=\"/msharuk589\">@msharuk589</a>  sorry, i found pytorch implementation but no tensorflow implementation of cosine focal loss</p>",
      "rawMarkdown": "msharuk589  sorry, i found pytorch implementation but no tensorflow implementation of cosine focal loss",
      "votes": null
    },
    {
      "id": "934671",
      "postDate": "07/18/2020 16:13:43",
      "content": "<p>Could you post that here?Have you experimented on that? <a href=\"/mobassir\">@mobassir</a> </p>",
      "rawMarkdown": "Could you post that here?Have you experimented on that? @mobassir",
      "votes": null
    },
    {
      "id": "934684",
      "postDate": "07/18/2020 16:30:40",
      "content": "<p>no i haven't tried that yet,here is pytorch implementation : <a href=\"https://github.com/byeongjokim/VIPriors-Image-Classification-Challenge/blob/332e04fd3e82b20d312128bad302a9081f5c37ce/timm/loss/cosine.py\">https://github.com/byeongjokim/VIPriors-Image-Classification-Challenge/blob/332e04fd3e82b20d312128bad302a9081f5c37ce/timm/loss/cosine.py</a></p>",
      "rawMarkdown": "no i haven't tried that yet,here is pytorch implementation : https://github.com/byeongjokim/VIPriors-Image-Classification-Challenge/blob/332e04fd3e82b20d312128bad302a9081f5c37ce/timm/loss/cosine.py",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 934617,
      "author_name": "msharuk589",
      "author_url": "",
      "post_date": "07/18/2020 15:32:44",
      "content": "<p>Is there any snippet for focal cosine loss in tensorflow??</p>",
      "votes": null,
      "replies": [
        {
          "id": 934641,
          "author_name": "mobassir",
          "author_url": "",
          "post_date": "07/18/2020 15:52:15",
          "content": "<p><a href=\"/msharuk589\">@msharuk589</a>  sorry, i found pytorch implementation but no tensorflow implementation of cosine focal loss</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 934671,
          "author_name": "msharuk589",
          "author_url": "",
          "post_date": "07/18/2020 16:13:43",
          "content": "<p>Could you post that here?Have you experimented on that? <a href=\"/mobassir\">@mobassir</a> </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 934684,
          "author_name": "mobassir",
          "author_url": "",
          "post_date": "07/18/2020 16:30:40",
          "content": "<p>no i haven't tried that yet,here is pytorch implementation : <a href=\"https://github.com/byeongjokim/VIPriors-Image-Classification-Challenge/blob/332e04fd3e82b20d312128bad302a9081f5c37ce/timm/loss/cosine.py\">https://github.com/byeongjokim/VIPriors-Image-Classification-Challenge/blob/332e04fd3e82b20d312128bad302a9081f5c37ce/timm/loss/cosine.py</a></p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "934567": "**found 1 interesting paper today**\n\nAbstract : \nIn general, sufficient data is essential for the better perfor-mance and generalization of deep-learning models. However, lots of lim-itations(cost, resources, etc.) of data collection leads to lack of enoughdata  in  most  of  the  areas.  In  addition,  various  domains  of  each  datasources  and  licenses  also  lead  to  difficulties  in  collection  of  sufficientdata.  This  situation  makes  us  hard  to  utilize  not  only  the  pre-trainedmodel,  but  also  the  external  knowledge.  Therefore,  it  is  important  toleverage small dataset effectively for achieving the better performance.We  applied  some  techniques  in  three  aspects:  data,  loss  function,  andprediction  to  enable  training  from  scratch  with  less  data.  With  thesemethods, we obtain high accuracy by leveraging ImageNet data whichconsist of only 50 images per class. Furthermore, our model is ranked 4thin Visual Inductive Printers for Data-Effective Computer Vision Chal-lenge.\n\n![](https://media-exp1.licdn.com/dms/image/C4D22AQFuJbKRh_Oolw/feedshare-shrink_800/0?e=1597881600&amp;v=beta&amp;t=HbtQHwjUvETwM5CG1lmmXGlONzY_qP5r4oi3vU0UFVE)\n\nalso check figure 2 of that paper :)\n\npaper link : https://arxiv.org/pdf/2007.07805.pdf",
    "934617": "Is there any snippet for focal cosine loss in tensorflow??",
    "934641": "msharuk589  sorry, i found pytorch implementation but no tensorflow implementation of cosine focal loss",
    "934671": "Could you post that here?Have you experimented on that? @mobassir",
    "934684": "no i haven't tried that yet,here is pytorch implementation : https://github.com/byeongjokim/VIPriors-Image-Classification-Challenge/blob/332e04fd3e82b20d312128bad302a9081f5c37ce/timm/loss/cosine.py"
  },
  "source": "meta"
}