{
  "id": 276636,
  "title": "8th place solution",
  "url": "/competitions/landmark-recognition-2021/writeups/rist-kaggle-team-8th-place-solution",
  "author_name": "",
  "post_date": "2021-10-05T15:42:21.578776Z",
  "votes": 17,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Again, thanks to Kaggle and the hosts for hosting an interesting competition. Congratulations to all the winners. Special thanks to all my teammates <a href=\"https://www.kaggle.com/takuok\" target=\"_blank\">@takuok</a> and <a href=\"https://www.kaggle.com/tascj0\" target=\"_blank\">@tascj0</a> . Fortunately, we got the gold medal of Recognition competition, too. We show the details of our models in <a href=\"https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632\" target=\"_blank\">Retrieval solution post</a>.<br>\nHere, we show the unique part of Recognition challenge.</p>\n<h1>Tips in Recognition.</h1>\n<p>We used the same two strategies as the last year's 1st team used. While submitting, we used pre-computed embedding of train4.1m data, penalized these embeddings that are similar to the non-landmark images. These methods are again very robust this year and critical for the gold medal.<br>\nThis approach boost the score for a single model from <strong>public/private 0.37843/0.36045</strong> to <strong>0.45724/0.43252</strong>.<br>\nFinal score is <strong>ensemble of beit, swin, b4, b6, xcit, v2m, b5</strong>. See the details about models in <a href=\"https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632\" target=\"_blank\">Retrieval post</a>.</p>\n<h1>Acknowledge</h1>\n<p>takuoko is a member of Z by HP &amp; NVIDIA Data Science Global Ambassadors.<br>\nSpecial Thanks to Z by HP &amp; NVIDIA for sponsoring me a Z8G4 Workstation with dual RTX6000 GPU and a ZBook with RTX5000 GPU.<br>\nThis competition has the big dataset.<br>\nSo I tried pytorch's DDP parallel training on my dual RTX6000 GPUs and it helped a lot.</p>",
  "messages": [
    {
      "id": "1535237",
      "postDate": "10/05/2021 15:42:21",
      "content": "<p>Again, thanks to Kaggle and the hosts for hosting an interesting competition. Congratulations to all the winners. Special thanks to all my teammates <a href=\"https://www.kaggle.com/takuok\" target=\"_blank\">@takuok</a> and <a href=\"https://www.kaggle.com/tascj0\" target=\"_blank\">@tascj0</a> . Fortunately, we got the gold medal of Recognition competition, too. We show the details of our models in <a href=\"https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632\" target=\"_blank\">Retrieval solution post</a>.<br>\nHere, we show the unique part of Recognition challenge.</p>\n<h1>Tips in Recognition.</h1>\n<p>We used the same two strategies as the last year's 1st team used. While submitting, we used pre-computed embedding of train4.1m data, penalized these embeddings that are similar to the non-landmark images. These methods are again very robust this year and critical for the gold medal.<br>\nThis approach boost the score for a single model from <strong>public/private 0.37843/0.36045</strong> to <strong>0.45724/0.43252</strong>.<br>\nFinal score is <strong>ensemble of beit, swin, b4, b6, xcit, v2m, b5</strong>. See the details about models in <a href=\"https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632\" target=\"_blank\">Retrieval post</a>.</p>\n<h1>Acknowledge</h1>\n<p>takuoko is a member of Z by HP &amp; NVIDIA Data Science Global Ambassadors.<br>\nSpecial Thanks to Z by HP &amp; NVIDIA for sponsoring me a Z8G4 Workstation with dual RTX6000 GPU and a ZBook with RTX5000 GPU.<br>\nThis competition has the big dataset.<br>\nSo I tried pytorch's DDP parallel training on my dual RTX6000 GPUs and it helped a lot.</p>",
      "rawMarkdown": "Again, thanks to Kaggle and the hosts for hosting an interesting competition. Congratulations to all the winners. Special thanks to all my teammates @takuok and @tascj0 . Fortunately, we got the gold medal of Recognition competition, too. We show the details of our models in [Retrieval solution post](https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632).\nHere, we show the unique part of Recognition challenge.\n\n# Tips in Recognition.\n\nWe used the same two strategies as the last year's 1st team used. While submitting, we used pre-computed embedding of train4.1m data, penalized these embeddings that are similar to the non-landmark images. These methods are again very robust this year and critical for the gold medal.\nThis approach boost the score for a single model from **public/private 0.37843/0.36045** to **0.45724/0.43252**.\nFinal score is **ensemble of beit, swin, b4, b6, xcit, v2m, b5**. See the details about models in [Retrieval post](https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632).\n\n# Acknowledge\ntakuoko is a member of Z by HP & NVIDIA Data Science Global Ambassadors.\nSpecial Thanks to Z by HP & NVIDIA for sponsoring me a Z8G4 Workstation with dual RTX6000 GPU and a ZBook with RTX5000 GPU.\nThis competition has the big dataset.\nSo I tried pytorch's DDP parallel training on my dual RTX6000 GPUs and it helped a lot.",
      "votes": null
    },
    {
      "id": "1535855",
      "postDate": "10/06/2021 08:47:56",
      "content": "<p>Congrats and thanks for the write-up. I also used DDP, but on AWS instance with 4xT4 GPU</p>",
      "rawMarkdown": "Congrats and thanks for the write-up. I also used DDP, but on AWS instance with 4xT4 GPU",
      "votes": null
    },
    {
      "id": "1538198",
      "postDate": "10/08/2021 06:48:16",
      "content": "<p><a href=\"https://www.kaggle.com/inoueu1\" target=\"_blank\">@inoueu1</a> Thanks for the tips. Congratulations. </p>",
      "rawMarkdown": "inoueu1 Thanks for the tips. Congratulations.",
      "votes": null
    },
    {
      "id": "1540016",
      "postDate": "10/10/2021 04:45:06",
      "content": "<p>Thanks for sharing.</p>",
      "rawMarkdown": "Thanks for sharing.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1535855,
      "author_name": "narsil",
      "author_url": "",
      "post_date": "10/06/2021 08:47:56",
      "content": "<p>Congrats and thanks for the write-up. I also used DDP, but on AWS instance with 4xT4 GPU</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1538198,
      "author_name": "towhidultonmoy",
      "author_url": "",
      "post_date": "10/08/2021 06:48:16",
      "content": "<p><a href=\"https://www.kaggle.com/inoueu1\" target=\"_blank\">@inoueu1</a> Thanks for the tips. Congratulations. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1540016,
      "author_name": "saleesh",
      "author_url": "",
      "post_date": "10/10/2021 04:45:06",
      "content": "<p>Thanks for sharing.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1535237": "Again, thanks to Kaggle and the hosts for hosting an interesting competition. Congratulations to all the winners. Special thanks to all my teammates @takuok and @tascj0 . Fortunately, we got the gold medal of Recognition competition, too. We show the details of our models in [Retrieval solution post](https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632).\nHere, we show the unique part of Recognition challenge.\n\n# Tips in Recognition.\n\nWe used the same two strategies as the last year's 1st team used. While submitting, we used pre-computed embedding of train4.1m data, penalized these embeddings that are similar to the non-landmark images. These methods are again very robust this year and critical for the gold medal.\nThis approach boost the score for a single model from **public/private 0.37843/0.36045** to **0.45724/0.43252**.\nFinal score is **ensemble of beit, swin, b4, b6, xcit, v2m, b5**. See the details about models in [Retrieval post](https://www.kaggle.com/c/landmark-retrieval-2021/discussion/276632).\n\n# Acknowledge\ntakuoko is a member of Z by HP & NVIDIA Data Science Global Ambassadors.\nSpecial Thanks to Z by HP & NVIDIA for sponsoring me a Z8G4 Workstation with dual RTX6000 GPU and a ZBook with RTX5000 GPU.\nThis competition has the big dataset.\nSo I tried pytorch's DDP parallel training on my dual RTX6000 GPUs and it helped a lot.",
    "1535855": "Congrats and thanks for the write-up. I also used DDP, but on AWS instance with 4xT4 GPU",
    "1538198": "inoueu1 Thanks for the tips. Congratulations.",
    "1540016": "Thanks for sharing."
  },
  "source": "meta"
}