{
  "id": 77282,
  "title": "11th Place Solution",
  "url": "/competitions/human-protein-atlas-image-classification/writeups/ten-epochs-11th-place-solution",
  "author_name": "",
  "post_date": "2019-01-12T10:55:37.510Z",
  "votes": 40,
  "comment_count": 9,
  "views": 0,
  "content": "<p>Congratulations to each of the kagglers, it was a very interesting game, and thanks to each of the selfless kagglers on the discussion.\nIn the meantime, I really appreciate the hard work of each of my teammates, and without their experiments and their GPUs, I don't think we can get the gold medal.</p>\n\n<h2>The following is our experiment:</h2>\n\n<p><strong>[Update]</strong></p>\n\n<p><a href=\"https://github.com/Gary-Deeplearning/Human_Protein\">The code of our solution </a></p>\n\n<h3>The first stage experiments</h3>\n\n<p>&gt; We used the external HPA data in Gray format(512 size)</p>\n\n<p><strong>Models</strong></p>\n\n<ul>\n<li>res18 (batchsize=64)</li>\n<li>res34 (batchsize=32)</li>\n<li>bninception (batchsize=32)</li>\n<li>inceptionv3 (batchsize=32)</li>\n<li>xception (batchsize=24, P40-24G) </li>\n<li>Se-resnext50(batchsize=24, P40-24G)</li>\n</ul>\n\n<p><strong>Data Augumentation</strong></p>\n\n<ul>\n<li><p>train\n&gt;  Add/Multiply/Crop/Affine/Filplr/Filpub/</p></li>\n<li><p>12 TTA</p></li>\n</ul>\n\n<p><strong>Optimizer</strong></p>\n\n<ul>\n<li>NAdam with different LR for different layers </li>\n</ul>\n\n<p><strong>Loss Function</strong></p>\n\n<ul>\n<li>bce</li>\n</ul>\n\n<p><strong>Threshold</strong>\n&gt; We tried the search threshold，but it was not work, so we finally had no idea and chose 0.205 as threshold.</p>\n\n<p><strong>Result</strong></p>\n\n<ul>\n<li>The best score from single model with 5 fold was 0.597(public)</li>\n</ul>\n\n<h3>The second stage experiments</h3>\n\n<p>&gt; we changed the format external HPA data (you can find this in discussion)</p>\n\n<p><strong>Ensemble</strong>\nwe used the first and second stage model to ensemble, and it should get 0.62+ score(public)</p>\n\n<h3>The third stage experiments</h3>\n\n<p>&gt; <a href=\"https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289\">My teammate, shisu's method</a></p>",
  "messages": [
    {
      "id": "454067",
      "postDate": "01/11/2019 05:05:29",
      "content": "<p>Congratulations to each of the kagglers, it was a very interesting game, and thanks to each of the selfless kagglers on the discussion.\nIn the meantime, I really appreciate the hard work of each of my teammates, and without their experiments and their GPUs, I don't think we can get the gold medal.</p>\n\n<h2>The following is our experiment:</h2>\n\n<p><strong>[Update]</strong></p>\n\n<p><a href=\"https://github.com/Gary-Deeplearning/Human_Protein\">The code of our solution </a></p>\n\n<h3>The first stage experiments</h3>\n\n<p>&gt; We used the external HPA data in Gray format(512 size)</p>\n\n<p><strong>Models</strong></p>\n\n<ul>\n<li>res18 (batchsize=64)</li>\n<li>res34 (batchsize=32)</li>\n<li>bninception (batchsize=32)</li>\n<li>inceptionv3 (batchsize=32)</li>\n<li>xception (batchsize=24, P40-24G) </li>\n<li>Se-resnext50(batchsize=24, P40-24G)</li>\n</ul>\n\n<p><strong>Data Augumentation</strong></p>\n\n<ul>\n<li><p>train\n&gt;  Add/Multiply/Crop/Affine/Filplr/Filpub/</p></li>\n<li><p>12 TTA</p></li>\n</ul>\n\n<p><strong>Optimizer</strong></p>\n\n<ul>\n<li>NAdam with different LR for different layers </li>\n</ul>\n\n<p><strong>Loss Function</strong></p>\n\n<ul>\n<li>bce</li>\n</ul>\n\n<p><strong>Threshold</strong>\n&gt; We tried the search threshold，but it was not work, so we finally had no idea and chose 0.205 as threshold.</p>\n\n<p><strong>Result</strong></p>\n\n<ul>\n<li>The best score from single model with 5 fold was 0.597(public)</li>\n</ul>\n\n<h3>The second stage experiments</h3>\n\n<p>&gt; we changed the format external HPA data (you can find this in discussion)</p>\n\n<p><strong>Ensemble</strong>\nwe used the first and second stage model to ensemble, and it should get 0.62+ score(public)</p>\n\n<h3>The third stage experiments</h3>\n\n<p>&gt; <a href=\"https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289\">My teammate, shisu's method</a></p>",
      "rawMarkdown": "Congratulations to each of the kagglers, it was a very interesting game, and thanks to each of the selfless kagglers on the discussion.\nIn the meantime, I really appreciate the hard work of each of my teammates, and without their experiments and their GPUs, I don't think we can get the gold medal.\n\n##The following is our experiment:\n**[Update]**\n\n[The code of our solution ][2]\n\n### The first stage experiments \n&gt; We used the external HPA data in Gray format(512 size)\n\n**Models**\n\n - res18 (batchsize=64)\n - res34 (batchsize=32)\n - bninception (batchsize=32)\n - inceptionv3 (batchsize=32)\n - xception (batchsize=24, P40-24G) \n - Se-resnext50(batchsize=24, P40-24G)\n\n**Data Augumentation**\n\n - train\n&gt;  Add/Multiply/Crop/Affine/Filplr/Filpub/\n\n - 12 TTA\n\n**Optimizer**\n\n - NAdam with different LR for different layers \n\n**Loss Function**\n\n- bce\n\n**Threshold**\n&gt; We tried the search threshold，but it was not work, so we finally had no idea and chose 0.205 as threshold.\n\n**Result**\n\n- The best score from single model with 5 fold was 0.597(public)\n\n### The second stage experiments \n&gt; we changed the format external HPA data (you can find this in discussion)\n\n\n**Ensemble**\nwe used the first and second stage model to ensemble, and it should get 0.62+ score(public)\n\n### The third stage experiments\n&gt; [My teammate, shisu's method][1]\n\n\n  [1]: https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289\n  [2]: https://github.com/Gary-Deeplearning/Human_Protein",
      "votes": null
    },
    {
      "id": "454095",
      "postDate": "01/11/2019 05:56:46",
      "content": "<p>Thanks for sharing. I did the same experiments as your first and second stages. Look forward to sharing your third \nstage experiments.</p>",
      "rawMarkdown": "Thanks for sharing. I did the same experiments as your first and second stages. Look forward to sharing your third \nstage experiments.",
      "votes": null
    },
    {
      "id": "454100",
      "postDate": "01/11/2019 06:08:39",
      "content": "<p>Yep, Thank you. The third stage was funny.</p>",
      "rawMarkdown": "Yep, Thank you. The third stage was funny.",
      "votes": null
    },
    {
      "id": "454111",
      "postDate": "01/11/2019 06:23:43",
      "content": "<p>teammate's solution</p>\n\n<p><a href=\"https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289\">https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289</a></p>",
      "rawMarkdown": "teammate's solution\n\nhttps://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289",
      "votes": null
    },
    {
      "id": "454149",
      "postDate": "01/11/2019 07:09:34",
      "content": "<p>Congratulations and thanks for sharing!</p>",
      "rawMarkdown": "Congratulations and thanks for sharing!",
      "votes": null
    },
    {
      "id": "454206",
      "postDate": "01/11/2019 08:41:15",
      "content": "<p>Congratulations too and you are welcome.</p>",
      "rawMarkdown": "Congratulations too and you are welcome.",
      "votes": null
    },
    {
      "id": "454840",
      "postDate": "01/12/2019 10:57:30",
      "content": "<p>I've uploaded our team's code to github，thanks for all kagglers.</p>",
      "rawMarkdown": "I've uploaded our team's code to github，thanks for all kagglers.",
      "votes": null
    },
    {
      "id": "456525",
      "postDate": "01/16/2019 01:23:49",
      "content": "<p>学弟，你也是东莞理工的？</p>",
      "rawMarkdown": "学弟，你也是东莞理工的？",
      "votes": null
    },
    {
      "id": "456531",
      "postDate": "01/16/2019 01:58:48",
      "content": "<p>Yep</p>",
      "rawMarkdown": "Yep",
      "votes": null
    },
    {
      "id": "457365",
      "postDate": "01/17/2019 09:35:50",
      "content": "<p>hi,thanks for posting in solution could you  please tell me where i can find in download script for external data hpa</p>",
      "rawMarkdown": "hi,thanks for posting in solution could you  please tell me where i can find in download script for external data hpa",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 454095,
      "author_name": "lbyg1994",
      "author_url": "",
      "post_date": "01/11/2019 05:56:46",
      "content": "<p>Thanks for sharing. I did the same experiments as your first and second stages. Look forward to sharing your third \nstage experiments.</p>",
      "votes": null,
      "replies": [
        {
          "id": 454100,
          "author_name": "garybios",
          "author_url": "",
          "post_date": "01/11/2019 06:08:39",
          "content": "<p>Yep, Thank you. The third stage was funny.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 454111,
      "author_name": "shisususu",
      "author_url": "",
      "post_date": "01/11/2019 06:23:43",
      "content": "<p>teammate's solution</p>\n\n<p><a href=\"https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289\">https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 454149,
      "author_name": "sgalib",
      "author_url": "",
      "post_date": "01/11/2019 07:09:34",
      "content": "<p>Congratulations and thanks for sharing!</p>",
      "votes": null,
      "replies": [
        {
          "id": 454206,
          "author_name": "garybios",
          "author_url": "",
          "post_date": "01/11/2019 08:41:15",
          "content": "<p>Congratulations too and you are welcome.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 454840,
      "author_name": "garybios",
      "author_url": "",
      "post_date": "01/12/2019 10:57:30",
      "content": "<p>I've uploaded our team's code to github，thanks for all kagglers.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 456525,
      "author_name": "willor",
      "author_url": "",
      "post_date": "01/16/2019 01:23:49",
      "content": "<p>学弟，你也是东莞理工的？</p>",
      "votes": null,
      "replies": [
        {
          "id": 456531,
          "author_name": "garybios",
          "author_url": "",
          "post_date": "01/16/2019 01:58:48",
          "content": "<p>Yep</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 457365,
      "author_name": "jaideepvalani",
      "author_url": "",
      "post_date": "01/17/2019 09:35:50",
      "content": "<p>hi,thanks for posting in solution could you  please tell me where i can find in download script for external data hpa</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "454067": "Congratulations to each of the kagglers, it was a very interesting game, and thanks to each of the selfless kagglers on the discussion.\nIn the meantime, I really appreciate the hard work of each of my teammates, and without their experiments and their GPUs, I don't think we can get the gold medal.\n\n##The following is our experiment:\n**[Update]**\n\n[The code of our solution ][2]\n\n### The first stage experiments \n&gt; We used the external HPA data in Gray format(512 size)\n\n**Models**\n\n - res18 (batchsize=64)\n - res34 (batchsize=32)\n - bninception (batchsize=32)\n - inceptionv3 (batchsize=32)\n - xception (batchsize=24, P40-24G) \n - Se-resnext50(batchsize=24, P40-24G)\n\n**Data Augumentation**\n\n - train\n&gt;  Add/Multiply/Crop/Affine/Filplr/Filpub/\n\n - 12 TTA\n\n**Optimizer**\n\n - NAdam with different LR for different layers \n\n**Loss Function**\n\n- bce\n\n**Threshold**\n&gt; We tried the search threshold，but it was not work, so we finally had no idea and chose 0.205 as threshold.\n\n**Result**\n\n- The best score from single model with 5 fold was 0.597(public)\n\n### The second stage experiments \n&gt; we changed the format external HPA data (you can find this in discussion)\n\n\n**Ensemble**\nwe used the first and second stage model to ensemble, and it should get 0.62+ score(public)\n\n### The third stage experiments\n&gt; [My teammate, shisu's method][1]\n\n\n  [1]: https://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289\n  [2]: https://github.com/Gary-Deeplearning/Human_Protein",
    "454095": "Thanks for sharing. I did the same experiments as your first and second stages. Look forward to sharing your third \nstage experiments.",
    "454100": "Yep, Thank you. The third stage was funny.",
    "454111": "teammate's solution\n\nhttps://www.kaggle.com/c/human-protein-atlas-image-classification/discussion/77289",
    "454149": "Congratulations and thanks for sharing!",
    "454206": "Congratulations too and you are welcome.",
    "454840": "I've uploaded our team's code to github，thanks for all kagglers.",
    "456525": "学弟，你也是东莞理工的？",
    "456531": "Yep",
    "457365": "hi,thanks for posting in solution could you  please tell me where i can find in download script for external data hpa"
  },
  "source": "meta"
}