{
  "id": 328965,
  "title": "1st Place Solution",
  "url": "/competitions/iwildcam2022-fgvc9/discussion/328965",
  "author_name": "Yang Zhang",
  "post_date": "2022-06-03T21:12:41.374000",
  "votes": 4,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Our method is based on filtering detection results of megadetector. No model training or tracking algorithm is involved. We just return the max number of objects among all images in sequence as our final predict.<br>\nBy observation, if we set 0.95 as confidence threshold, we found that we will undercount animals in images with high-density objects and overcount animals in images with low-density objects. So we divided all images in to low-object -density images and high-object-density images and then use different filtering methods to solve them separately. The threshold is 8 predictions in a image</p>\n<p><strong>high-object-density images</strong><br>\nTo count more animals, we set the confidence threshold as 0.0. To remove the duplications we applied NMS method and set IoU=0.2. We also make little modifications to suppress smaller boxes. I cannot upload images but the filtering result is pretty good by observation. With the help of our NMS method, the public score can increase to 0.253</p>\n<p><strong>low-object-density images</strong><br>\nIf we don't take confidence score into consideration, We assume that area with many bounding box overlap has higher tp probability than area without overlapping bounding boxes if set the confidence threshold as 0. After few times of fine-tuning, we found that 0.98(confidence threshold) for boxes without overlaps and 0.8 for boxes with overlap can get best public score. Public score can raise up to 0.249 now. We also applied second round of filtering for images with 1 or 2 object left after first round of filtering. The confidence threshold is 0.98 and now we get our best result 0.247</p>\n<p><strong>Summary</strong><br>\nWe don't try any training methods because ground truth is not provided and if we use the detector's result as training data, the error propagation will happen and new model cannot outperform megadetector if we don't manually filter out FP prediction of megadetector. We attend this competition 1 week before deadline so we don't have enough time to focus on tracking algorithm. If time permits, we will continue the study and focus on tracking objects in image sequence. </p>",
  "messages": [
    {
      "id": 1810753,
      "postDate": "2022-06-03T21:12:41.373Z",
      "content": "<p>Our method is based on filtering detection results of megadetector. No model training or tracking algorithm is involved. We just return the max number of objects among all images in sequence as our final predict.<br>\nBy observation, if we set 0.95 as confidence threshold, we found that we will undercount animals in images with high-density objects and overcount animals in images with low-density objects. So we divided all images in to low-object -density images and high-object-density images and then use different filtering methods to solve them separately. The threshold is 8 predictions in a image</p>\n<p><strong>high-object-density images</strong><br>\nTo count more animals, we set the confidence threshold as 0.0. To remove the duplications we applied NMS method and set IoU=0.2. We also make little modifications to suppress smaller boxes. I cannot upload images but the filtering result is pretty good by observation. With the help of our NMS method, the public score can increase to 0.253</p>\n<p><strong>low-object-density images</strong><br>\nIf we don't take confidence score into consideration, We assume that area with many bounding box overlap has higher tp probability than area without overlapping bounding boxes if set the confidence threshold as 0. After few times of fine-tuning, we found that 0.98(confidence threshold) for boxes without overlaps and 0.8 for boxes with overlap can get best public score. Public score can raise up to 0.249 now. We also applied second round of filtering for images with 1 or 2 object left after first round of filtering. The confidence threshold is 0.98 and now we get our best result 0.247</p>\n<p><strong>Summary</strong><br>\nWe don't try any training methods because ground truth is not provided and if we use the detector's result as training data, the error propagation will happen and new model cannot outperform megadetector if we don't manually filter out FP prediction of megadetector. We attend this competition 1 week before deadline so we don't have enough time to focus on tracking algorithm. If time permits, we will continue the study and focus on tracking objects in image sequence. </p>",
      "rawMarkdown": "Our method is based on filtering detection results of megadetector. No model training or tracking algorithm is involved. We just return the max number of objects among all images in sequence as our final predict.\nBy observation, if we set 0.95 as confidence threshold, we found that we will undercount animals in images with high-density objects and overcount animals in images with low-density objects. So we divided all images in to low-object -density images and high-object-density images and then use different filtering methods to solve them separately. The threshold is 8 predictions in a image\n\n**high-object-density images**\nTo count more animals, we set the confidence threshold as 0.0. To remove the duplications we applied NMS method and set IoU=0.2. We also make little modifications to suppress smaller boxes. I cannot upload images but the filtering result is pretty good by observation. With the help of our NMS method, the public score can increase to 0.253\n\n**low-object-density images**\nIf we don't take confidence score into consideration, We assume that area with many bounding box overlap has higher tp probability than area without overlapping bounding boxes if set the confidence threshold as 0. After few times of fine-tuning, we found that 0.98(confidence threshold) for boxes without overlaps and 0.8 for boxes with overlap can get best public score. Public score can raise up to 0.249 now. We also applied second round of filtering for images with 1 or 2 object left after first round of filtering. The confidence threshold is 0.98 and now we get our best result 0.247\n\n**Summary**\nWe don't try any training methods because ground truth is not provided and if we use the detector's result as training data, the error propagation will happen and new model cannot outperform megadetector if we don't manually filter out FP prediction of megadetector. We attend this competition 1 week before deadline so we don't have enough time to focus on tracking algorithm. If time permits, we will continue the study and focus on tracking objects in image sequence. \n\n",
      "votes": 4
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1810753": "Our method is based on filtering detection results of megadetector. No model training or tracking algorithm is involved. We just return the max number of objects among all images in sequence as our final predict.\nBy observation, if we set 0.95 as confidence threshold, we found that we will undercount animals in images with high-density objects and overcount animals in images with low-density objects. So we divided all images in to low-object -density images and high-object-density images and then use different filtering methods to solve them separately. The threshold is 8 predictions in a image\n\n**high-object-density images**\nTo count more animals, we set the confidence threshold as 0.0. To remove the duplications we applied NMS method and set IoU=0.2. We also make little modifications to suppress smaller boxes. I cannot upload images but the filtering result is pretty good by observation. With the help of our NMS method, the public score can increase to 0.253\n\n**low-object-density images**\nIf we don't take confidence score into consideration, We assume that area with many bounding box overlap has higher tp probability than area without overlapping bounding boxes if set the confidence threshold as 0. After few times of fine-tuning, we found that 0.98(confidence threshold) for boxes without overlaps and 0.8 for boxes with overlap can get best public score. Public score can raise up to 0.249 now. We also applied second round of filtering for images with 1 or 2 object left after first round of filtering. The confidence threshold is 0.98 and now we get our best result 0.247\n\n**Summary**\nWe don't try any training methods because ground truth is not provided and if we use the detector's result as training data, the error propagation will happen and new model cannot outperform megadetector if we don't manually filter out FP prediction of megadetector. We attend this competition 1 week before deadline so we don't have enough time to focus on tracking algorithm. If time permits, we will continue the study and focus on tracking objects in image sequence. \n\n"
  }
}