{
  "id": 94931,
  "title": "The Stage 2 testset has been updated",
  "url": "/competitions/imet-2019-fgvc6/discussion/94931",
  "author_name": "",
  "post_date": "2019-06-08T08:58:59.792492Z",
  "votes": 16,
  "comment_count": 14,
  "views": 0,
  "content": "<p>You can test whether your kernel can be run successfully. </p>\n\n<p>As for one of our submissions’ result, the stage 2 running time is roughly 5.2 times more than stage 1.\nIn addition, the size of new submission.csv is also 5.2 times larger, thus I guess the distribution of testset is similar as the old one.</p>\n\n<p><img src=\"https://storage.googleapis.com/kaggle-forum-message-attachments/547783/13438/Screen%20Shot%202019-06-08%20at%204.57.14%20PM.png\" alt=\"\"></p>",
  "messages": [
    {
      "id": "547783",
      "postDate": "06/08/2019 08:58:59",
      "content": "<p>You can test whether your kernel can be run successfully. </p>\n\n<p>As for one of our submissions’ result, the stage 2 running time is roughly 5.2 times more than stage 1.\nIn addition, the size of new submission.csv is also 5.2 times larger, thus I guess the distribution of testset is similar as the old one.</p>\n\n<p><img src=\"https://storage.googleapis.com/kaggle-forum-message-attachments/547783/13438/Screen%20Shot%202019-06-08%20at%204.57.14%20PM.png\" alt=\"\"></p>",
      "rawMarkdown": "You can test whether your kernel can be run successfully. \n\nAs for one of our submissions’ result, the stage 2 running time is roughly 5.2 times more than stage 1.\nIn addition, the size of new submission.csv is also 5.2 times larger, thus I guess the distribution of testset is similar as the old one.\n\n![](https://storage.googleapis.com/kaggle-forum-message-attachments/547783/13438/Screen%20Shot%202019-06-08%20at%204.57.14%20PM.png)",
      "votes": null
    },
    {
      "id": "548039",
      "postDate": "06/08/2019 16:57:34",
      "content": "<p>Thanks for letting know.\nOne of my kernel successfully completes its run in 28163.9 seconds.</p>",
      "rawMarkdown": "Thanks for letting know.\nOne of my kernel successfully completes its run in 28163.9 seconds.",
      "votes": null
    },
    {
      "id": "548146",
      "postDate": "06/08/2019 20:59:23",
      "content": "<p>Not enough TTAs for sure :)</p>",
      "rawMarkdown": "Not enough TTAs for sure :)",
      "votes": null
    },
    {
      "id": "548298",
      "postDate": "06/09/2019 06:19:28",
      "content": "<p>In order to save the memory &amp; time, our team uses \"tta by fold\", like for fold 0, infer with the original images, fold 1 with flipped images, ...</p>",
      "rawMarkdown": "In order to save the memory &amp; time, our team uses \"tta by fold\", like for fold 0, infer with the original images, fold 1 with flipped images, ...",
      "votes": null
    },
    {
      "id": "548429",
      "postDate": "06/09/2019 11:26:06",
      "content": "<p>Nice idea. Did you also modify random crop too (if you used) so that it efficiently crops an image with smaller IOU among each fold? How much was the performace degraded compared to tta 5times or 10 times?</p>",
      "rawMarkdown": "Nice idea. Did you also modify random crop too (if you used) so that it efficiently crops an image with smaller IOU among each fold? How much was the performace degraded compared to tta 5times or 10 times?",
      "votes": null
    },
    {
      "id": "548442",
      "postDate": "06/09/2019 11:43:37",
      "content": "<p>We just use traditional 5 crops (4 corners and 1 center).</p>\n\n<p>For one single model, tta by fold is 0.001 lower than tta for each fold.</p>",
      "rawMarkdown": "We just use traditional 5 crops (4 corners and 1 center).\n\nFor one single model, tta by fold is 0.001 lower than tta for each fold.",
      "votes": null
    },
    {
      "id": "548468",
      "postDate": "06/09/2019 12:45:06",
      "content": "<p>yes, we use 10 fold thus \"10 tta by fold\": 2 flips * 5 crops (4 corners and 1 center). For our 10 fold seresnext101, non tta gets 653, 10 tta by fold gets 655, 10 tta for each fold gets 656.</p>",
      "rawMarkdown": "yes, we use 10 fold thus \"10 tta by fold\": 2 flips * 5 crops (4 corners and 1 center). For our 10 fold seresnext101, non tta gets 653, 10 tta by fold gets 655, 10 tta for each fold gets 656.",
      "votes": null
    },
    {
      "id": "548469",
      "postDate": "06/09/2019 12:45:08",
      "content": "<p>yes, we use 2 flips * 5 crops (4 corners and 1 center) for our 10 fold seresnext101\n- non tta gets 653\n- 10 tta by fold gets 655\n- 10 tta for each fold gets 656</p>",
      "rawMarkdown": "yes, we use 2 flips * 5 crops (4 corners and 1 center) for our 10 fold seresnext101\n- non tta gets 653\n- 10 tta by fold gets 655\n- 10 tta for each fold gets 656",
      "votes": null
    },
    {
      "id": "548478",
      "postDate": "06/09/2019 13:01:15",
      "content": "<p>Thank you for the detailed answer. Very informative.\nI've never come up with the idea of TTA by fold and nice to know. The performace degration seems relatively small considering it reduces inference cycles from 10 to 1 (in case of 10 tta).</p>",
      "rawMarkdown": "Thank you for the detailed answer. Very informative.\nI've never come up with the idea of TTA by fold and nice to know. The performace degration seems relatively small considering it reduces inference cycles from 10 to 1 (in case of 10 tta).",
      "votes": null
    },
    {
      "id": "548518",
      "postDate": "06/09/2019 14:11:30",
      "content": "<p>my network has some issues, thus the \"unsuccessful\" messages were sent successfully </p>",
      "rawMarkdown": "my network has some issues, thus the \"unsuccessful\" messages were sent successfully",
      "votes": null
    },
    {
      "id": "548847",
      "postDate": "06/10/2019 02:31:55",
      "content": "<p><a href=\"/yiheng\">@yiheng</a> very nice idea!</p>",
      "rawMarkdown": "yiheng very nice idea!",
      "votes": null
    },
    {
      "id": "548920",
      "postDate": "06/10/2019 05:27:35",
      "content": "<p>what do you mean by \"10 tta by fold gets 655, 10 tta for each fold gets 656.\" could you explain the difference between these two?</p>",
      "rawMarkdown": "what do you mean by \"10 tta by fold gets 655, 10 tta for each fold gets 656.\" could you explain the difference between these two?",
      "votes": null
    },
    {
      "id": "548960",
      "postDate": "06/10/2019 06:28:39",
      "content": "<p>1) fold 0: tta0, fold 1: tta1,...\n2) fold 0: tta0, tta1, ..., tta9   fold 1: tta0, tta1, ..., tta9</p>",
      "rawMarkdown": "1) fold 0: tta0, fold 1: tta1,...\n2) fold 0: tta0, tta1, ..., tta9   fold 1: tta0, tta1, ..., tta9",
      "votes": null
    },
    {
      "id": "548973",
      "postDate": "06/10/2019 06:43:19",
      "content": "<p>I see I didn't know that people do first one. I only knew second one :)</p>",
      "rawMarkdown": "I see I didn't know that people do first one. I only knew second one :)",
      "votes": null
    },
    {
      "id": "548974",
      "postDate": "06/10/2019 06:47:23",
      "content": "<p>Actually, if we have enough inference time, we'll not choose 1) </p>",
      "rawMarkdown": "Actually, if we have enough inference time, we'll not choose 1)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 548039,
      "author_name": "appian",
      "author_url": "",
      "post_date": "06/08/2019 16:57:34",
      "content": "<p>Thanks for letting know.\nOne of my kernel successfully completes its run in 28163.9 seconds.</p>",
      "votes": null,
      "replies": [
        {
          "id": 548146,
          "author_name": "artyomp",
          "author_url": "",
          "post_date": "06/08/2019 20:59:23",
          "content": "<p>Not enough TTAs for sure :)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548298,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/09/2019 06:19:28",
          "content": "<p>In order to save the memory &amp; time, our team uses \"tta by fold\", like for fold 0, infer with the original images, fold 1 with flipped images, ...</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548429,
          "author_name": "appian",
          "author_url": "",
          "post_date": "06/09/2019 11:26:06",
          "content": "<p>Nice idea. Did you also modify random crop too (if you used) so that it efficiently crops an image with smaller IOU among each fold? How much was the performace degraded compared to tta 5times or 10 times?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548442,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/09/2019 11:43:37",
          "content": "<p>We just use traditional 5 crops (4 corners and 1 center).</p>\n\n<p>For one single model, tta by fold is 0.001 lower than tta for each fold.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548468,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/09/2019 12:45:06",
          "content": "<p>yes, we use 10 fold thus \"10 tta by fold\": 2 flips * 5 crops (4 corners and 1 center). For our 10 fold seresnext101, non tta gets 653, 10 tta by fold gets 655, 10 tta for each fold gets 656.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548469,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/09/2019 12:45:08",
          "content": "<p>yes, we use 2 flips * 5 crops (4 corners and 1 center) for our 10 fold seresnext101\n- non tta gets 653\n- 10 tta by fold gets 655\n- 10 tta for each fold gets 656</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548478,
          "author_name": "appian",
          "author_url": "",
          "post_date": "06/09/2019 13:01:15",
          "content": "<p>Thank you for the detailed answer. Very informative.\nI've never come up with the idea of TTA by fold and nice to know. The performace degration seems relatively small considering it reduces inference cycles from 10 to 1 (in case of 10 tta).</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548518,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/09/2019 14:11:30",
          "content": "<p>my network has some issues, thus the \"unsuccessful\" messages were sent successfully </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 548847,
      "author_name": "projdev",
      "author_url": "",
      "post_date": "06/10/2019 02:31:55",
      "content": "<p><a href=\"/yiheng\">@yiheng</a> very nice idea!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 548920,
      "author_name": "chrisyang7",
      "author_url": "",
      "post_date": "06/10/2019 05:27:35",
      "content": "<p>what do you mean by \"10 tta by fold gets 655, 10 tta for each fold gets 656.\" could you explain the difference between these two?</p>",
      "votes": null,
      "replies": [
        {
          "id": 548960,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/10/2019 06:28:39",
          "content": "<p>1) fold 0: tta0, fold 1: tta1,...\n2) fold 0: tta0, tta1, ..., tta9   fold 1: tta0, tta1, ..., tta9</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548973,
          "author_name": "chrisyang7",
          "author_url": "",
          "post_date": "06/10/2019 06:43:19",
          "content": "<p>I see I didn't know that people do first one. I only knew second one :)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 548974,
          "author_name": "yiheng",
          "author_url": "",
          "post_date": "06/10/2019 06:47:23",
          "content": "<p>Actually, if we have enough inference time, we'll not choose 1) </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "547783": "You can test whether your kernel can be run successfully. \n\nAs for one of our submissions’ result, the stage 2 running time is roughly 5.2 times more than stage 1.\nIn addition, the size of new submission.csv is also 5.2 times larger, thus I guess the distribution of testset is similar as the old one.\n\n![](https://storage.googleapis.com/kaggle-forum-message-attachments/547783/13438/Screen%20Shot%202019-06-08%20at%204.57.14%20PM.png)",
    "548039": "Thanks for letting know.\nOne of my kernel successfully completes its run in 28163.9 seconds.",
    "548146": "Not enough TTAs for sure :)",
    "548298": "In order to save the memory &amp; time, our team uses \"tta by fold\", like for fold 0, infer with the original images, fold 1 with flipped images, ...",
    "548429": "Nice idea. Did you also modify random crop too (if you used) so that it efficiently crops an image with smaller IOU among each fold? How much was the performace degraded compared to tta 5times or 10 times?",
    "548442": "We just use traditional 5 crops (4 corners and 1 center).\n\nFor one single model, tta by fold is 0.001 lower than tta for each fold.",
    "548468": "yes, we use 10 fold thus \"10 tta by fold\": 2 flips * 5 crops (4 corners and 1 center). For our 10 fold seresnext101, non tta gets 653, 10 tta by fold gets 655, 10 tta for each fold gets 656.",
    "548469": "yes, we use 2 flips * 5 crops (4 corners and 1 center) for our 10 fold seresnext101\n- non tta gets 653\n- 10 tta by fold gets 655\n- 10 tta for each fold gets 656",
    "548478": "Thank you for the detailed answer. Very informative.\nI've never come up with the idea of TTA by fold and nice to know. The performace degration seems relatively small considering it reduces inference cycles from 10 to 1 (in case of 10 tta).",
    "548518": "my network has some issues, thus the \"unsuccessful\" messages were sent successfully",
    "548847": "yiheng very nice idea!",
    "548920": "what do you mean by \"10 tta by fold gets 655, 10 tta for each fold gets 656.\" could you explain the difference between these two?",
    "548960": "1) fold 0: tta0, fold 1: tta1,...\n2) fold 0: tta0, tta1, ..., tta9   fold 1: tta0, tta1, ..., tta9",
    "548973": "I see I didn't know that people do first one. I only knew second one :)",
    "548974": "Actually, if we have enough inference time, we'll not choose 1)"
  },
  "source": "meta"
}