{
  "id": 310092,
  "title": "Whales feature matching LoFTR - Kornia (Open CV - SURF comparision)",
  "url": "/competitions/happy-whale-and-dolphin/discussion/310092",
  "author_name": "Remek Kinas",
  "post_date": "2022-02-27T13:58:02.831000",
  "votes": 29,
  "comment_count": 14,
  "views": 0,
  "content": "<p>I start with images … since images say more than words …</p>\n<p><img src=\"https://i.ibb.co/kS9wQvs/LoFTR0.jpg\" alt=\"K1\"></p>\n<p><img src=\"https://i.ibb.co/86mGkrX/LoFTR1.jpg\" alt=\"K2\"></p>\n<p><img src=\"https://i.ibb.co/5hTh4Qm/LoFTR2.jpg\" alt=\"K3\"></p>\n<p>Second part with my NN automatic background removal pipeline described here <a href=\"https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309214\" target=\"_blank\">DATASET - dorsal fins for all IDs without background</a>:</p>\n<p><img src=\"https://i.ibb.co/yQzhzb8/Lo-FTR-BR1.jpg\" alt=\"K7\"></p>\n<p><img src=\"https://i.ibb.co/HncZPKW/Lo-FTR-BR2.jpg\" alt=\"K8\"></p>\n<p>I decided to show you my research conducted in this competition connected with feature matching. This topic is implemented together with background removal. </p>\n<p>In notebook Whales feature matching LoFTR - Kornia I presented three things:</p>\n<ul>\n<li>LoFTR - Detector-Free Local Feature Matching with Transformers</li>\n<li>Kornia - absolutely fantastic library for Pytorch - Kornia is a differentiable library that allows classical computer vision to be integrated into deep learning models.</li>\n<li>Feature matching for images with background and without.</li>\n</ul>\n<p>Notebook: <a href=\"https://www.kaggle.com/remekkinas/whales-feature-matching-loftr-kornia\" target=\"_blank\">https://www.kaggle.com/remekkinas/whales-feature-matching-loftr-kornia</a></p>",
  "messages": [
    {
      "id": 1706462,
      "postDate": "2022-02-27T13:58:02.830Z",
      "content": "<p>I start with images … since images say more than words …</p>\n<p><img src=\"https://i.ibb.co/kS9wQvs/LoFTR0.jpg\" alt=\"K1\"></p>\n<p><img src=\"https://i.ibb.co/86mGkrX/LoFTR1.jpg\" alt=\"K2\"></p>\n<p><img src=\"https://i.ibb.co/5hTh4Qm/LoFTR2.jpg\" alt=\"K3\"></p>\n<p>Second part with my NN automatic background removal pipeline described here <a href=\"https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309214\" target=\"_blank\">DATASET - dorsal fins for all IDs without background</a>:</p>\n<p><img src=\"https://i.ibb.co/yQzhzb8/Lo-FTR-BR1.jpg\" alt=\"K7\"></p>\n<p><img src=\"https://i.ibb.co/HncZPKW/Lo-FTR-BR2.jpg\" alt=\"K8\"></p>\n<p>I decided to show you my research conducted in this competition connected with feature matching. This topic is implemented together with background removal. </p>\n<p>In notebook Whales feature matching LoFTR - Kornia I presented three things:</p>\n<ul>\n<li>LoFTR - Detector-Free Local Feature Matching with Transformers</li>\n<li>Kornia - absolutely fantastic library for Pytorch - Kornia is a differentiable library that allows classical computer vision to be integrated into deep learning models.</li>\n<li>Feature matching for images with background and without.</li>\n</ul>\n<p>Notebook: <a href=\"https://www.kaggle.com/remekkinas/whales-feature-matching-loftr-kornia\" target=\"_blank\">https://www.kaggle.com/remekkinas/whales-feature-matching-loftr-kornia</a></p>",
      "rawMarkdown": "I start with images ... since images say more than words ...\n\n![K1](https://i.ibb.co/kS9wQvs/LoFTR0.jpg)\n\n![K2](https://i.ibb.co/86mGkrX/LoFTR1.jpg)\n\n![K3](https://i.ibb.co/5hTh4Qm/LoFTR2.jpg)\n\nSecond part with my NN automatic background removal pipeline described here [DATASET - dorsal fins for all IDs without background](https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309214):\n\n![K7](https://i.ibb.co/yQzhzb8/Lo-FTR-BR1.jpg)\n\n![K8](https://i.ibb.co/HncZPKW/Lo-FTR-BR2.jpg)\n\nI decided to show you my research conducted in this competition connected with feature matching. This topic is implemented together with background removal. \n\nIn notebook Whales feature matching LoFTR - Kornia I presented three things:\n\n- LoFTR - Detector-Free Local Feature Matching with Transformers\n- Kornia - absolutely fantastic library for Pytorch - Kornia is a differentiable library that allows classical computer vision to be integrated into deep learning models.\n- Feature matching for images with background and without.\n\nNotebook: https://www.kaggle.com/remekkinas/whales-feature-matching-loftr-kornia",
      "votes": 29
    },
    {
      "id": 1716686,
      "postDate": "2022-03-09T09:39:31.653Z",
      "content": "<p>Thank you for sharing!!<br>\nLove your works!</p>",
      "rawMarkdown": "Thank you for sharing!!\nLove your works!",
      "votes": 1
    },
    {
      "id": 1711845,
      "postDate": "2022-03-04T11:13:26.183Z",
      "content": "<p>Great work.</p>",
      "rawMarkdown": "Great work.",
      "votes": 1,
      "replies": [
        {
          "id": 1713028,
          "postDate": "2022-03-05T15:43:41.303Z",
          "content": "<p>Thank you very much! The more I am working with this library the more I am sure it will help me :) Looking now for tricky way to use LoFTR to improve score (but a little bit later - now working on new dataset).</p>",
          "rawMarkdown": "Thank you very much! The more I am working with this library the more I am sure it will help me :) Looking now for tricky way to use LoFTR to improve score (but a little bit later - now working on new dataset)."
        }
      ]
    },
    {
      "id": 1710427,
      "postDate": "2022-03-03T03:15:49.760Z",
      "content": "<p><a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a> great analogy of using kornia for this comp, even I have been using this library for my personal projects for a while now, could you share some light on how are you tackling the issue of ocean background removal</p>",
      "rawMarkdown": "@remekkinas great analogy of using kornia for this comp, even I have been using this library for my personal projects for a while now, could you share some light on how are you tackling the issue of ocean background removal",
      "votes": 1,
      "replies": [
        {
          "id": 1713029,
          "postDate": "2022-03-05T15:44:39.223Z",
          "content": "<p>Than you for your comment and feedback.<br>\nBackground removal notebook will be publishet tomorrow. Now finishing working on new dataset.</p>",
          "rawMarkdown": "Than you for your comment and feedback.\nBackground removal notebook will be publishet tomorrow. Now finishing working on new dataset."
        }
      ]
    },
    {
      "id": 1706467,
      "postDate": "2022-02-27T14:01:12.097Z",
      "content": "<p>Thanks for sharing kornia !<br>\nIs the dataset in your notebook  the cropped FIN?</p>",
      "rawMarkdown": "\n\nThanks for sharing kornia !\n\n\nIs the dataset in your notebook  the cropped FIN?\n",
      "votes": 1,
      "replies": [
        {
          "id": 1706559,
          "postDate": "2022-02-27T15:16:34.960Z",
          "content": "<p>Yes. I used notebook created by <a href=\"https://www.kaggle.com/phalanx\" target=\"_blank\">@phalanx</a> . My is not published yet (still working on dataset - it requires more steps on cleaning data - however first models train quite good (without background removal) - CV ~0.79 ).</p>",
          "rawMarkdown": "Yes. I used notebook created by @phalanx . My is not published yet (still working on dataset - it requires more steps on cleaning data - however first models train quite good (without background removal) - CV ~0.79 ).",
          "votes": 1
        },
        {
          "id": 1706619,
          "postDate": "2022-02-27T16:55:36.123Z",
          "content": "<p><a href=\"https://www.kaggle.com/dragonzhang\" target=\"_blank\">@dragonzhang</a> now it is updated - it shows how to filter information from background using pipeline I work on.</p>",
          "rawMarkdown": "@dragonzhang now it is updated - it shows how to filter information from background using pipeline I work on."
        }
      ]
    },
    {
      "id": 1716625,
      "postDate": "2022-03-09T08:13:26.487Z",
      "content": "<p>Thank you for sharing!<br>\nI have a feeling you're about to win a gold medal in this competition ;)</p>",
      "rawMarkdown": "Thank you for sharing!\nI have a feeling you're about to win a gold medal in this competition ;)",
      "votes": 2,
      "replies": [
        {
          "id": 1716665,
          "postDate": "2022-03-09T09:16:32.450Z",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/haqishen\" target=\"_blank\">@haqishen</a> thank you! Some day … some day … This is my dream. You know what it is …. gold on LB and then … anything can happen :) But I enjoy progress and sharing. Trying to reach my second GM in Notebooks :) and then completly switch to competition. </p>\n<p>BTW: you have great score too! Cool to see you in this competition.</p>",
          "rawMarkdown": "Hi @haqishen thank you! Some day ... some day ... This is my dream. You know what it is .... gold on LB and then ... anything can happen :) But I enjoy progress and sharing. Trying to reach my second GM in Notebooks :) and then completly switch to competition. \n\nBTW: you have great score too! Cool to see you in this competition.",
          "votes": 1
        }
      ]
    },
    {
      "id": 1713688,
      "postDate": "2022-03-06T09:07:14.617Z",
      "content": "<p>Today I did SURF and LoFTR comparision …. Two observations:</p>\n<ul>\n<li>SURF and SIFT are not in Kaggle distribution -  algorithm is patented and is excluded in this configuration </li>\n<li>In my opinion SURF works worse then LoFTR on this dataset - it was difficult to find a match above 75% even on very similar fins (belonging to the same individual)</li>\n</ul>\n<p>See comparison:<br>\n<img src=\"https://i.ibb.co/smrJdDf/loftr01.jpg\" alt=\"Lo\"><br>\n<img src=\"https://i.ibb.co/VQ7qhGr/surf01.jpg\" alt=\"su\">  </p>",
      "rawMarkdown": "Today I did SURF and LoFTR comparision .... Two observations:\n- SURF and SIFT are not in Kaggle distribution -  algorithm is patented and is excluded in this configuration \n- In my opinion SURF works worse then LoFTR on this dataset - it was difficult to find a match above 75% even on very similar fins (belonging to the same individual)\n\nSee comparison:\n![Lo](https://i.ibb.co/smrJdDf/loftr01.jpg)\n![su](https://i.ibb.co/VQ7qhGr/surf01.jpg)  ",
      "votes": 2
    },
    {
      "id": 1717585,
      "postDate": "2022-03-10T03:59:32.960Z",
      "rawMarkdown": "",
      "isDeleted": true
    },
    {
      "id": 1706736,
      "postDate": "2022-02-27T18:30:26.757Z",
      "rawMarkdown": "",
      "votes": 1,
      "isDeleted": true,
      "replies": [
        {
          "id": 1706739,
          "postDate": "2022-02-27T18:33:22.970Z",
          "content": "<p>Thank you! I am just coding for … fun. Love doing that :)</p>",
          "rawMarkdown": "Thank you! I am just coding for ... fun. Love doing that :)"
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1716686,
      "author_name": "Haru",
      "author_url": "",
      "post_date": "2022-03-09T09:39:31.653000",
      "content": "<p>Thank you for sharing!!<br>\nLove your works!</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1711845,
      "author_name": "Artem Burenok",
      "author_url": "",
      "post_date": "2022-03-04T11:13:26.183000",
      "content": "<p>Great work.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1713028,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-03-05T15:43:41.303000",
          "content": "<p>Thank you very much! The more I am working with this library the more I am sure it will help me :) Looking now for tricky way to use LoFTR to improve score (but a little bit later - now working on new dataset).</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1710427,
      "author_name": "Harsh",
      "author_url": "",
      "post_date": "2022-03-03T03:15:49.760000",
      "content": "<p><a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a> great analogy of using kornia for this comp, even I have been using this library for my personal projects for a while now, could you share some light on how are you tackling the issue of ocean background removal</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1713029,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-03-05T15:44:39.223000",
          "content": "<p>Than you for your comment and feedback.<br>\nBackground removal notebook will be publishet tomorrow. Now finishing working on new dataset.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1706467,
      "author_name": "dragon zhang",
      "author_url": "",
      "post_date": "2022-02-27T14:01:12.097000",
      "content": "<p>Thanks for sharing kornia !<br>\nIs the dataset in your notebook  the cropped FIN?</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1706559,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-02-27T15:16:34.960000",
          "content": "<p>Yes. I used notebook created by <a href=\"https://www.kaggle.com/phalanx\" target=\"_blank\">@phalanx</a> . My is not published yet (still working on dataset - it requires more steps on cleaning data - however first models train quite good (without background removal) - CV ~0.79 ).</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1706619,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-02-27T16:55:36.123000",
          "content": "<p><a href=\"https://www.kaggle.com/dragonzhang\" target=\"_blank\">@dragonzhang</a> now it is updated - it shows how to filter information from background using pipeline I work on.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1716625,
      "author_name": "Qishen Ha",
      "author_url": "",
      "post_date": "2022-03-09T08:13:26.487000",
      "content": "<p>Thank you for sharing!<br>\nI have a feeling you're about to win a gold medal in this competition ;)</p>",
      "votes": 2,
      "replies": [
        {
          "id": 1716665,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-03-09T09:16:32.450000",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/haqishen\" target=\"_blank\">@haqishen</a> thank you! Some day … some day … This is my dream. You know what it is …. gold on LB and then … anything can happen :) But I enjoy progress and sharing. Trying to reach my second GM in Notebooks :) and then completly switch to competition. </p>\n<p>BTW: you have great score too! Cool to see you in this competition.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1713688,
      "author_name": "Remek Kinas",
      "author_url": "",
      "post_date": "2022-03-06T09:07:14.617000",
      "content": "<p>Today I did SURF and LoFTR comparision …. Two observations:</p>\n<ul>\n<li>SURF and SIFT are not in Kaggle distribution -  algorithm is patented and is excluded in this configuration </li>\n<li>In my opinion SURF works worse then LoFTR on this dataset - it was difficult to find a match above 75% even on very similar fins (belonging to the same individual)</li>\n</ul>\n<p>See comparison:<br>\n<img src=\"https://i.ibb.co/smrJdDf/loftr01.jpg\" alt=\"Lo\"><br>\n<img src=\"https://i.ibb.co/VQ7qhGr/surf01.jpg\" alt=\"su\">  </p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 1717585,
      "author_name": "",
      "author_url": "",
      "post_date": "2022-03-10T03:59:32.960000",
      "content": "",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1706736,
      "author_name": "",
      "author_url": "",
      "post_date": "2022-02-27T18:30:26.757000",
      "content": "",
      "votes": 1,
      "replies": [
        {
          "id": 1706739,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-02-27T18:33:22.970000",
          "content": "<p>Thank you! I am just coding for … fun. Love doing that :)</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1706462": "I start with images ... since images say more than words ...\n\n![K1](https://i.ibb.co/kS9wQvs/LoFTR0.jpg)\n\n![K2](https://i.ibb.co/86mGkrX/LoFTR1.jpg)\n\n![K3](https://i.ibb.co/5hTh4Qm/LoFTR2.jpg)\n\nSecond part with my NN automatic background removal pipeline described here [DATASET - dorsal fins for all IDs without background](https://www.kaggle.com/c/happy-whale-and-dolphin/discussion/309214):\n\n![K7](https://i.ibb.co/yQzhzb8/Lo-FTR-BR1.jpg)\n\n![K8](https://i.ibb.co/HncZPKW/Lo-FTR-BR2.jpg)\n\nI decided to show you my research conducted in this competition connected with feature matching. This topic is implemented together with background removal. \n\nIn notebook Whales feature matching LoFTR - Kornia I presented three things:\n\n- LoFTR - Detector-Free Local Feature Matching with Transformers\n- Kornia - absolutely fantastic library for Pytorch - Kornia is a differentiable library that allows classical computer vision to be integrated into deep learning models.\n- Feature matching for images with background and without.\n\nNotebook: https://www.kaggle.com/remekkinas/whales-feature-matching-loftr-kornia",
    "1716686": "Thank you for sharing!!\nLove your works!",
    "1711845": "Great work.",
    "1710427": "@remekkinas great analogy of using kornia for this comp, even I have been using this library for my personal projects for a while now, could you share some light on how are you tackling the issue of ocean background removal",
    "1706467": "\n\nThanks for sharing kornia !\n\n\nIs the dataset in your notebook  the cropped FIN?\n",
    "1716625": "Thank you for sharing!\nI have a feeling you're about to win a gold medal in this competition ;)",
    "1713688": "Today I did SURF and LoFTR comparision .... Two observations:\n- SURF and SIFT are not in Kaggle distribution -  algorithm is patented and is excluded in this configuration \n- In my opinion SURF works worse then LoFTR on this dataset - it was difficult to find a match above 75% even on very similar fins (belonging to the same individual)\n\nSee comparison:\n![Lo](https://i.ibb.co/smrJdDf/loftr01.jpg)\n![su](https://i.ibb.co/VQ7qhGr/surf01.jpg)  ",
    "1717585": "",
    "1706736": ""
  }
}