{
  "id": 303930,
  "title": "any one try multi-fame detection method yet?",
  "url": "/competitions/tensorflow-great-barrier-reef/discussion/303930",
  "author_name": "",
  "post_date": "2022-01-30T06:20:01.540266700Z",
  "votes": 16,
  "comment_count": 6,
  "views": 0,
  "content": "<p>i am not taking about tracking.</p>\n<p>but rather using frame,t-1,t-2 … for object detection (in last frame).<br>\ne.g. you use 3d conv head, multi-frame attention head, etc</p>\n<p>quote from cots dataset paper:<br>\n<a href=\"https://arxiv.org/pdf/2111.14311.pdf\" target=\"_blank\">https://arxiv.org/pdf/2111.14311.pdf</a><br>\n\"The dataset naturally exhibits sequence-based annotations<br>\nas multiple images are taken of the same COTS as the boat<br>\nmoves past it.\"</p>\n<p>Vertigo3 underwater true-flight glider with application to broad scale COTS management in the GBR - Dr Russ Babcock, Dr Brett Kettle<br>\n<a href=\"https://www.youtube.com/watch?v=7GVuZJjroMo&amp;t=1050s\" target=\"_blank\">https://www.youtube.com/watch?v=7GVuZJjroMo&amp;t=1050s</a><br>\n<img src=\"https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png\" alt=\"https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png\"></p>",
  "messages": [
    {
      "id": "1668888",
      "postDate": "01/30/2022 06:20:01",
      "content": "<p>i am not taking about tracking.</p>\n<p>but rather using frame,t-1,t-2 … for object detection (in last frame).<br>\ne.g. you use 3d conv head, multi-frame attention head, etc</p>\n<p>quote from cots dataset paper:<br>\n<a href=\"https://arxiv.org/pdf/2111.14311.pdf\" target=\"_blank\">https://arxiv.org/pdf/2111.14311.pdf</a><br>\n\"The dataset naturally exhibits sequence-based annotations<br>\nas multiple images are taken of the same COTS as the boat<br>\nmoves past it.\"</p>\n<p>Vertigo3 underwater true-flight glider with application to broad scale COTS management in the GBR - Dr Russ Babcock, Dr Brett Kettle<br>\n<a href=\"https://www.youtube.com/watch?v=7GVuZJjroMo&amp;t=1050s\" target=\"_blank\">https://www.youtube.com/watch?v=7GVuZJjroMo&amp;t=1050s</a><br>\n<img src=\"https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png\" alt=\"https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png\"></p>",
      "rawMarkdown": "i am not taking about tracking.\n\nbut rather using frame,t-1,t-2 ... for object detection (in last frame).\ne.g. you use 3d conv head, multi-frame attention head, etc\n\nquote from cots dataset paper:\nhttps://arxiv.org/pdf/2111.14311.pdf\n\"The dataset naturally exhibits sequence-based annotations\nas multiple images are taken of the same COTS as the boat\nmoves past it.\"\n\n\nVertigo3 underwater true-flight glider with application to broad scale COTS management in the GBR - Dr Russ Babcock, Dr Brett Kettle\nhttps://www.youtube.com/watch?v=7GVuZJjroMo&t=1050s\n![https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png](https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png)",
      "votes": null
    },
    {
      "id": "1669237",
      "postDate": "01/30/2022 14:01:16",
      "content": "<p>Dear Mr frog , I have another question<br>\nDo you think gopro wide-camera fisheye and perspective distortion have a result in smaller object around sides?</p>\n<p>like this </p>\n<p><img src=\"https://imgur.com/bNABgvS\" alt=\"perspect\"></p>\n<p><img src=\"https://imgur.com/Xe396jz\" alt=\"anti perspect\"></p>\n<p>will de-fisheye or anti-perspect preprocess or according data augments make improve on detection performace?</p>\n<p>I run over past sompetition find this idea <br>\n<a href=\"https://www.kaggle.com/c/pku-autonomous-driving/discussion/127037\" target=\"_blank\">https://www.kaggle.com/c/pku-autonomous-driving/discussion/127037</a></p>",
      "rawMarkdown": "Dear Mr frog , I have another question\nDo you think gopro wide-camera fisheye and perspective distortion have a result in smaller object around sides?\n\nlike this \n\n![perspect](https://imgur.com/bNABgvS \"\")\n\n![anti perspect](https://imgur.com/Xe396jz \"\")\n\nwill de-fisheye or anti-perspect preprocess or according data augments make improve on detection performace?\n\n\nI run over past sompetition find this idea \nhttps://www.kaggle.com/c/pku-autonomous-driving/discussion/127037",
      "votes": null
    },
    {
      "id": "1670229",
      "postDate": "01/31/2022 10:34:47",
      "content": "<p>i don't think that is required unless you are trying to predict some 3d values, or you are using 3d features in your solution</p>\n<p>(for our case, we need only to predict 2d bbox. you can add perspective or affine augmentation in your training)</p>",
      "rawMarkdown": "i don't think that is required unless you are trying to predict some 3d values, or you are using 3d features in your solution\n\n(for our case, we need only to predict 2d bbox. you can add perspective or affine augmentation in your training)",
      "votes": null
    },
    {
      "id": "1670353",
      "postDate": "01/31/2022 12:56:06",
      "content": "<p>I will keep searching， may fortune come for you, happy spring festival</p>",
      "rawMarkdown": "I will keep searching， may fortune come for you, happy spring festival",
      "votes": null
    },
    {
      "id": "1670369",
      "postDate": "01/31/2022 13:16:21",
      "content": "<p>A shortcut and cheating way to test augmentation:</p>\n<ol>\n<li><p>we use classifier to model distribution like GAN. train a classifier (or object detector) for 3 class : train pos, validation pos, all neg. given a pos input sample, we can measure if it is closer to the train or validation set.</p></li>\n<li><p>let T be the original train set. TA be the train set with augmentation applied. using the trained classifier above, check if TA is closer to the validation set (good augmentation), train set or background set (poor augmentation).</p></li>\n</ol>",
      "rawMarkdown": "A shortcut and cheating way to test augmentation:\n\n1. we use classifier to model distribution like GAN. train a classifier (or object detector) for 3 class : train pos, validation pos, all neg. given a pos input sample, we can measure if it is closer to the train or validation set.\n\n2.  let T be the original train set. TA be the train set with augmentation applied. using the trained classifier above, check if TA is closer to the validation set (good augmentation), train set or background set (poor augmentation).",
      "votes": null
    },
    {
      "id": "1670736",
      "postDate": "01/31/2022 20:22:17",
      "content": "<p><a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> your tracking dataset + <a href=\"https://github.com/open-mmlab/mmtracking\" target=\"_blank\">https://github.com/open-mmlab/mmtracking</a> = magic</p>",
      "rawMarkdown": "hengck23 your tracking dataset + https://github.com/open-mmlab/mmtracking = magic",
      "votes": null
    },
    {
      "id": "1670738",
      "postDate": "01/31/2022 20:24:43",
      "content": "<p>Temporal RoI Align looks the most promising, had little luck getting it set up because I'm trying to focus on TF2.0 right now. But I have plans to revisit </p>",
      "rawMarkdown": "Temporal RoI Align looks the most promising, had little luck getting it set up because I'm trying to focus on TF2.0 right now. But I have plans to revisit",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1669237,
      "author_name": "drzhuzhe",
      "author_url": "",
      "post_date": "01/30/2022 14:01:16",
      "content": "<p>Dear Mr frog , I have another question<br>\nDo you think gopro wide-camera fisheye and perspective distortion have a result in smaller object around sides?</p>\n<p>like this </p>\n<p><img src=\"https://imgur.com/bNABgvS\" alt=\"perspect\"></p>\n<p><img src=\"https://imgur.com/Xe396jz\" alt=\"anti perspect\"></p>\n<p>will de-fisheye or anti-perspect preprocess or according data augments make improve on detection performace?</p>\n<p>I run over past sompetition find this idea <br>\n<a href=\"https://www.kaggle.com/c/pku-autonomous-driving/discussion/127037\" target=\"_blank\">https://www.kaggle.com/c/pku-autonomous-driving/discussion/127037</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 1670229,
          "author_name": "hengck23",
          "author_url": "",
          "post_date": "01/31/2022 10:34:47",
          "content": "<p>i don't think that is required unless you are trying to predict some 3d values, or you are using 3d features in your solution</p>\n<p>(for our case, we need only to predict 2d bbox. you can add perspective or affine augmentation in your training)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1670353,
          "author_name": "drzhuzhe",
          "author_url": "",
          "post_date": "01/31/2022 12:56:06",
          "content": "<p>I will keep searching， may fortune come for you, happy spring festival</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1670369,
          "author_name": "hengck23",
          "author_url": "",
          "post_date": "01/31/2022 13:16:21",
          "content": "<p>A shortcut and cheating way to test augmentation:</p>\n<ol>\n<li><p>we use classifier to model distribution like GAN. train a classifier (or object detector) for 3 class : train pos, validation pos, all neg. given a pos input sample, we can measure if it is closer to the train or validation set.</p></li>\n<li><p>let T be the original train set. TA be the train set with augmentation applied. using the trained classifier above, check if TA is closer to the validation set (good augmentation), train set or background set (poor augmentation).</p></li>\n</ol>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1670736,
      "author_name": "outwrest",
      "author_url": "",
      "post_date": "01/31/2022 20:22:17",
      "content": "<p><a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a> your tracking dataset + <a href=\"https://github.com/open-mmlab/mmtracking\" target=\"_blank\">https://github.com/open-mmlab/mmtracking</a> = magic</p>",
      "votes": null,
      "replies": [
        {
          "id": 1670738,
          "author_name": "outwrest",
          "author_url": "",
          "post_date": "01/31/2022 20:24:43",
          "content": "<p>Temporal RoI Align looks the most promising, had little luck getting it set up because I'm trying to focus on TF2.0 right now. But I have plans to revisit </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1668888": "i am not taking about tracking.\n\nbut rather using frame,t-1,t-2 ... for object detection (in last frame).\ne.g. you use 3d conv head, multi-frame attention head, etc\n\nquote from cots dataset paper:\nhttps://arxiv.org/pdf/2111.14311.pdf\n\"The dataset naturally exhibits sequence-based annotations\nas multiple images are taken of the same COTS as the boat\nmoves past it.\"\n\n\nVertigo3 underwater true-flight glider with application to broad scale COTS management in the GBR - Dr Russ Babcock, Dr Brett Kettle\nhttps://www.youtube.com/watch?v=7GVuZJjroMo&t=1050s\n![https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png](https://i.ibb.co/nkk7jCP/Screenshot-2022-01-30-141729.png)",
    "1669237": "Dear Mr frog , I have another question\nDo you think gopro wide-camera fisheye and perspective distortion have a result in smaller object around sides?\n\nlike this \n\n![perspect](https://imgur.com/bNABgvS \"\")\n\n![anti perspect](https://imgur.com/Xe396jz \"\")\n\nwill de-fisheye or anti-perspect preprocess or according data augments make improve on detection performace?\n\n\nI run over past sompetition find this idea \nhttps://www.kaggle.com/c/pku-autonomous-driving/discussion/127037",
    "1670229": "i don't think that is required unless you are trying to predict some 3d values, or you are using 3d features in your solution\n\n(for our case, we need only to predict 2d bbox. you can add perspective or affine augmentation in your training)",
    "1670353": "I will keep searching， may fortune come for you, happy spring festival",
    "1670369": "A shortcut and cheating way to test augmentation:\n\n1. we use classifier to model distribution like GAN. train a classifier (or object detector) for 3 class : train pos, validation pos, all neg. given a pos input sample, we can measure if it is closer to the train or validation set.\n\n2.  let T be the original train set. TA be the train set with augmentation applied. using the trained classifier above, check if TA is closer to the validation set (good augmentation), train set or background set (poor augmentation).",
    "1670736": "hengck23 your tracking dataset + https://github.com/open-mmlab/mmtracking = magic",
    "1670738": "Temporal RoI Align looks the most promising, had little luck getting it set up because I'm trying to focus on TF2.0 right now. But I have plans to revisit"
  },
  "source": "meta"
}