{
  "id": 107587,
  "title": "ResNet50 train/validation accuracy not converging",
  "url": "/competitions/recursion-cellular-image-classification/discussion/107587",
  "author_name": "Eva Giannatou",
  "post_date": "2019-09-05T08:57:54.051000",
  "votes": 2,
  "comment_count": 5,
  "views": 0,
  "content": "<p>My code can be found here:\n<a href=\"https://github.com/evagian/Kaggle-Recursion-Cellular-Image-Classification\">https://github.com/evagian/Kaggle-Recursion-Cellular-Image-Classification</a></p>\n\n<p>Your help will be appreciated :)</p>",
  "messages": [
    {
      "id": 619448,
      "postDate": "2019-09-06T07:59:25.880Z",
      "content": "<p>What do you mean by \"not converging?\" Train loss not decreasing, test accuracy not increasing, or train - test gap is increasing?</p>",
      "rawMarkdown": "What do you mean by \"not converging?\" Train loss not decreasing, test accuracy not increasing, or train - test gap is increasing?",
      "votes": 1
    },
    {
      "id": 632595,
      "postDate": "2019-09-23T19:29:57.327Z",
      "content": "<p>You're using resnet50 pretrained on imagenet, but setting layer.trainable=False for all layers.</p>\n\n<p>Imagenet is sadly deficient in cellular photomicrographs (I know I've never photographed one while on safari...).  So any pretrained model will have difficulty recognising the structures it needs to - for example, because the 6 channels have been arbitrarily color coded in your unpack script.  In particular, to provide a useful signal for a siRNA classifier, your model will need to learn about the basic cell structure and disruptions/deformities that appear in this particular dataset.</p>\n\n<p>One other problem: I think you'll need a lot more than 5 epochs to start seeing results.</p>",
      "rawMarkdown": "You're using resnet50 pretrained on imagenet, but setting layer.trainable=False for all layers.\n\nImagenet is sadly deficient in cellular photomicrographs (I know I've never photographed one while on safari...).  So any pretrained model will have difficulty recognising the structures it needs to - for example, because the 6 channels have been arbitrarily color coded in your unpack script.  In particular, to provide a useful signal for a siRNA classifier, your model will need to learn about the basic cell structure and disruptions/deformities that appear in this particular dataset.\n\nOne other problem: I think you'll need a lot more than 5 epochs to start seeing results.",
      "votes": 2,
      "replies": [
        {
          "id": 632627,
          "postDate": "2019-09-23T20:15:41.003Z",
          "content": "<p>Nice comment. I don't think she is following this thread though.</p>",
          "rawMarkdown": "Nice comment. I don't think she is following this thread though.",
          "votes": 1
        }
      ]
    },
    {
      "id": 622993,
      "postDate": "2019-09-10T10:50:44.377Z",
      "content": "<p>Lots of arguable things inside your code (e.g. a glance on your test result image)</p>\n\n<p>Probably, you should check public kernels. </p>",
      "rawMarkdown": "Lots of arguable things inside your code (e.g. a glance on your test result image)\n\nProbably, you should check public kernels. ",
      "votes": 2
    },
    {
      "id": 618506,
      "postDate": "2019-09-05T08:57:54.050Z",
      "content": "<p>My code can be found here:\n<a href=\"https://github.com/evagian/Kaggle-Recursion-Cellular-Image-Classification\">https://github.com/evagian/Kaggle-Recursion-Cellular-Image-Classification</a></p>\n\n<p>Your help will be appreciated :)</p>",
      "rawMarkdown": "My code can be found here:\nhttps://github.com/evagian/Kaggle-Recursion-Cellular-Image-Classification\n\nYour help will be appreciated :)",
      "votes": 2
    },
    {
      "id": 629559,
      "postDate": "2019-09-18T23:00:23.933Z",
      "rawMarkdown": "",
      "votes": -15,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 619448,
      "author_name": "🐢 Jun Koda",
      "author_url": "",
      "post_date": "2019-09-06T07:59:25.880000",
      "content": "<p>What do you mean by \"not converging?\" Train loss not decreasing, test accuracy not increasing, or train - test gap is increasing?</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 632595,
      "author_name": "Snorkle",
      "author_url": "",
      "post_date": "2019-09-23T19:29:57.327000",
      "content": "<p>You're using resnet50 pretrained on imagenet, but setting layer.trainable=False for all layers.</p>\n\n<p>Imagenet is sadly deficient in cellular photomicrographs (I know I've never photographed one while on safari...).  So any pretrained model will have difficulty recognising the structures it needs to - for example, because the 6 channels have been arbitrarily color coded in your unpack script.  In particular, to provide a useful signal for a siRNA classifier, your model will need to learn about the basic cell structure and disruptions/deformities that appear in this particular dataset.</p>\n\n<p>One other problem: I think you'll need a lot more than 5 epochs to start seeing results.</p>",
      "votes": 2,
      "replies": [
        {
          "id": 632627,
          "author_name": "nosound",
          "author_url": "",
          "post_date": "2019-09-23T20:15:41.003000",
          "content": "<p>Nice comment. I don't think she is following this thread though.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 622993,
      "author_name": "DmitryKustikov",
      "author_url": "",
      "post_date": "2019-09-10T10:50:44.377000",
      "content": "<p>Lots of arguable things inside your code (e.g. a glance on your test result image)</p>\n\n<p>Probably, you should check public kernels. </p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 629559,
      "author_name": "",
      "author_url": "",
      "post_date": "2019-09-18T23:00:23.933000",
      "content": "",
      "votes": -15,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "619448": "What do you mean by \"not converging?\" Train loss not decreasing, test accuracy not increasing, or train - test gap is increasing?",
    "632595": "You're using resnet50 pretrained on imagenet, but setting layer.trainable=False for all layers.\n\nImagenet is sadly deficient in cellular photomicrographs (I know I've never photographed one while on safari...).  So any pretrained model will have difficulty recognising the structures it needs to - for example, because the 6 channels have been arbitrarily color coded in your unpack script.  In particular, to provide a useful signal for a siRNA classifier, your model will need to learn about the basic cell structure and disruptions/deformities that appear in this particular dataset.\n\nOne other problem: I think you'll need a lot more than 5 epochs to start seeing results.",
    "622993": "Lots of arguable things inside your code (e.g. a glance on your test result image)\n\nProbably, you should check public kernels. ",
    "618506": "My code can be found here:\nhttps://github.com/evagian/Kaggle-Recursion-Cellular-Image-Classification\n\nYour help will be appreciated :)",
    "629559": ""
  }
}