{
  "id": 214505,
  "title": "Vision Transformer Submission Time too Long",
  "url": "/competitions/cassava-leaf-disease-classification/discussion/214505",
  "author_name": "",
  "post_date": "2021-01-26T22:00:43.497999400Z",
  "votes": 2,
  "comment_count": 5,
  "views": 0,
  "content": "<p>So I have a good VT (.903 LB 5 fold), but it takes so much longer to submit than efficientnet. </p>\n<p>Its vit-keras Large 384 * 384. Anyone else having this issue? </p>",
  "messages": [
    {
      "id": "1171502",
      "postDate": "01/26/2021 22:00:43",
      "content": "<p>So I have a good VT (.903 LB 5 fold), but it takes so much longer to submit than efficientnet. </p>\n<p>Its vit-keras Large 384 * 384. Anyone else having this issue? </p>",
      "rawMarkdown": "So I have a good VT (.903 LB 5 fold), but it takes so much longer to submit than efficientnet. \n\nIts vit-keras Large 384 * 384. Anyone else having this issue?",
      "votes": null
    },
    {
      "id": "1171582",
      "postDate": "01/27/2021 01:02:18",
      "content": "<p>I've been looking for a tensorflow ViT implementation for days, thanks for mentioning vit-keras :)<br>\nHow much time does the vit inference take? And is CV/LB as stable as with efficientnet?</p>",
      "rawMarkdown": "I've been looking for a tensorflow ViT implementation for days, thanks for mentioning vit-keras :)\nHow much time does the vit inference take? And is CV/LB as stable as with efficientnet?",
      "votes": null
    },
    {
      "id": "1171593",
      "postDate": "01/27/2021 01:26:25",
      "content": "<p><a href=\"url\" target=\"_blank\">https://github.com/faustomorales/vit-keras</a></p>",
      "rawMarkdown": "[https://github.com/faustomorales/vit-keras](url)",
      "votes": null
    },
    {
      "id": "1173233",
      "postDate": "01/27/2021 18:37:27",
      "content": "<p>Which EfficientNet are you comparing it to?</p>",
      "rawMarkdown": "Which EfficientNet are you comparing it to?",
      "votes": null
    },
    {
      "id": "1174759",
      "postDate": "01/28/2021 17:20:07",
      "content": "<p>B4 efficientnet seems to submit in like 2 hours or less</p>",
      "rawMarkdown": "B4 efficientnet seems to submit in like 2 hours or less",
      "votes": null
    },
    {
      "id": "1174762",
      "postDate": "01/28/2021 17:20:38",
      "content": "<p>VIT keras works. It just takes longer to inference, which is what I'm trying to figure out rn. I think its like 3x efficientnet b4, so its harder to fit into the GPU budget for the submission</p>",
      "rawMarkdown": "VIT keras works. It just takes longer to inference, which is what I'm trying to figure out rn. I think its like 3x efficientnet b4, so its harder to fit into the GPU budget for the submission",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1171582,
      "author_name": "amiiiney",
      "author_url": "",
      "post_date": "01/27/2021 01:02:18",
      "content": "<p>I've been looking for a tensorflow ViT implementation for days, thanks for mentioning vit-keras :)<br>\nHow much time does the vit inference take? And is CV/LB as stable as with efficientnet?</p>",
      "votes": null,
      "replies": [
        {
          "id": 1171593,
          "author_name": "zhangeng",
          "author_url": "",
          "post_date": "01/27/2021 01:26:25",
          "content": "<p><a href=\"url\" target=\"_blank\">https://github.com/faustomorales/vit-keras</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1174762,
          "author_name": "hooong",
          "author_url": "",
          "post_date": "01/28/2021 17:20:38",
          "content": "<p>VIT keras works. It just takes longer to inference, which is what I'm trying to figure out rn. I think its like 3x efficientnet b4, so its harder to fit into the GPU budget for the submission</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1173233,
      "author_name": "aliabdin1",
      "author_url": "",
      "post_date": "01/27/2021 18:37:27",
      "content": "<p>Which EfficientNet are you comparing it to?</p>",
      "votes": null,
      "replies": [
        {
          "id": 1174759,
          "author_name": "hooong",
          "author_url": "",
          "post_date": "01/28/2021 17:20:07",
          "content": "<p>B4 efficientnet seems to submit in like 2 hours or less</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1171502": "So I have a good VT (.903 LB 5 fold), but it takes so much longer to submit than efficientnet. \n\nIts vit-keras Large 384 * 384. Anyone else having this issue?",
    "1171582": "I've been looking for a tensorflow ViT implementation for days, thanks for mentioning vit-keras :)\nHow much time does the vit inference take? And is CV/LB as stable as with efficientnet?",
    "1171593": "[https://github.com/faustomorales/vit-keras](url)",
    "1173233": "Which EfficientNet are you comparing it to?",
    "1174759": "B4 efficientnet seems to submit in like 2 hours or less",
    "1174762": "VIT keras works. It just takes longer to inference, which is what I'm trying to figure out rn. I think its like 3x efficientnet b4, so its harder to fit into the GPU budget for the submission"
  },
  "source": "meta"
}