{
  "id": 493948,
  "title": "IMC2024 Starter [LB 0.13]",
  "url": "/competitions/image-matching-challenge-2024/discussion/493948",
  "author_name": "",
  "post_date": "2024-04-15T13:31:28.234670600Z",
  "votes": 13,
  "comment_count": 7,
  "views": 0,
  "content": "<p>Hello, Kagglers!</p>\n<p>I'm sharing the <a href=\"https://www.kaggle.com/code/nartaa/imc2024-starter\" target=\"_blank\">IMC2024 Starter</a>, which gives a consistent leaderboard score of 0.13. This starter provides a solid base to build upon.</p>\n<p>We can explore fine-tuning hyperparameters, modifying the code for additional image processing techniques, and trying different models for feature extraction. These avenues offer opportunities to potentially improve the performance further.</p>\n<p>Let me know if there are issues or if you have any questions.!</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4495635%2F938578d75aaafd80ef0108855535140a%2FIMC.jpg?generation=1713187931007916&amp;alt=media\"></p>",
  "messages": [
    {
      "id": "2753418",
      "postDate": "04/15/2024 13:31:28",
      "content": "<p>Hello, Kagglers!</p>\n<p>I'm sharing the <a href=\"https://www.kaggle.com/code/nartaa/imc2024-starter\" target=\"_blank\">IMC2024 Starter</a>, which gives a consistent leaderboard score of 0.13. This starter provides a solid base to build upon.</p>\n<p>We can explore fine-tuning hyperparameters, modifying the code for additional image processing techniques, and trying different models for feature extraction. These avenues offer opportunities to potentially improve the performance further.</p>\n<p>Let me know if there are issues or if you have any questions.!</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4495635%2F938578d75aaafd80ef0108855535140a%2FIMC.jpg?generation=1713187931007916&amp;alt=media\"></p>",
      "rawMarkdown": "Hello, Kagglers!\n\nI'm sharing the [IMC2024 Starter](https://www.kaggle.com/code/nartaa/imc2024-starter), which gives a consistent leaderboard score of 0.13. This starter provides a solid base to build upon.\n\nWe can explore fine-tuning hyperparameters, modifying the code for additional image processing techniques, and trying different models for feature extraction. These avenues offer opportunities to potentially improve the performance further.\n\nLet me know if there are issues or if you have any questions.!\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4495635%2F938578d75aaafd80ef0108855535140a%2FIMC.jpg?generation=1713187931007916&alt=media)",
      "votes": null
    },
    {
      "id": "2753485",
      "postDate": "04/15/2024 14:06:47",
      "content": "<p>Thanks for sharing! I will have to check this out! This competition was hard last year, this time around it is even more difficult! </p>",
      "rawMarkdown": "Thanks for sharing! I will have to check this out! This competition was hard last year, this time around it is even more difficult!",
      "votes": null
    },
    {
      "id": "2753496",
      "postDate": "04/15/2024 14:22:09",
      "content": "<p>You are very welcome! it's a tricky one for sure.</p>",
      "rawMarkdown": "You are very welcome! it's a tricky one for sure.",
      "votes": null
    },
    {
      "id": "2756672",
      "postDate": "04/17/2024 06:08:25",
      "content": "<p>Thank you very much for your sharing! <br>\nI have a question: is the \"cross-validation score\" that you mentioned derived from <a href=\"https://www.kaggle.com/code/fabiobellavia/imc2024-3d-metric-evaluation-example\" target=\"_blank\">this metric</a>? Because the validation metrics I obtained differ greatly from the leaderboard score.</p>",
      "rawMarkdown": "Thank you very much for your sharing! \nI have a question: is the \"cross-validation score\" that you mentioned derived from [this metric](https://www.kaggle.com/code/fabiobellavia/imc2024-3d-metric-evaluation-example)? Because the validation metrics I obtained differ greatly from the leaderboard score.",
      "votes": null
    },
    {
      "id": "2756825",
      "postDate": "04/17/2024 08:04:30",
      "content": "<p>You are very welcome!</p>\n<blockquote>\n  <p>I have a question: is the \"cross-validation score\" that you mentioned derived from this metric?</p>\n</blockquote>\n<p>Yes, it's the same.</p>\n<p>Randomness is an issue for scoring, but can be fixed by setting thread_num=1 for pycolmap, and you could calibrate the number of images in a dataset for cross validation until you get a similar LB score.</p>\n<p>Could you share the numbers for CV and LB?</p>",
      "rawMarkdown": "You are very welcome!\n\n> I have a question: is the \"cross-validation score\" that you mentioned derived from this metric?\n\nYes, it's the same.\n\nRandomness is an issue for scoring, but can be fixed by setting thread_num=1 for pycolmap, and you could calibrate the number of images in a dataset for cross validation until you get a similar LB score.\n\nCould you share the numbers for CV and LB?",
      "votes": null
    },
    {
      "id": "2757557",
      "postDate": "04/17/2024 15:21:44",
      "content": "<p>Thank you for your suggestion! <br>\nIn early submissions, I got a CV score of 0.39, but only 0.13 on the LB</p>",
      "rawMarkdown": "Thank you for your suggestion! \nIn early submissions, I got a CV score of 0.39, but only 0.13 on the LB",
      "votes": null
    },
    {
      "id": "2758542",
      "postDate": "04/18/2024 07:50:12",
      "content": "<p>Two related errors in first block. By any chance can you provide the requirements.txt file?</p>\n<p>ERROR: Could not open requirements file: [Errno 2] No such file or directory: '/kaggle/input/check-image-orientation/requirements.txt'</p>\n<hr>\n<p>ModuleNotFoundError                       Traceback (most recent call last)<br>\nCell In[3], line 1<br>\n----&gt; 1 from imc24 import *<br>\n      2 sys.path.append(\"/kaggle/input/colmap-db-import\")<br>\n      3 from database import *</p>\n<p>File /kaggle/usr/lib/imc24/imc24.py:40<br>\n     38 from lightglue import LightGlue, ALIKED, match_pair<br>\n     39 from transformers import AutoImageProcessor, AutoModel<br>\n---&gt; 40 from check_orientation.pre_trained_models import create_model<br>\n     42 IMC_PATH = '/kaggle/input/image-matching-challenge-2024'<br>\n     43 DEVICE = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")</p>\n<p>ModuleNotFoundError: No module named 'check_orientation</p>",
      "rawMarkdown": "Two related errors in first block. By any chance can you provide the requirements.txt file?\n\nERROR: Could not open requirements file: [Errno 2] No such file or directory: '/kaggle/input/check-image-orientation/requirements.txt'\n\n---------------------------------------------------------------------------\nModuleNotFoundError                       Traceback (most recent call last)\nCell In[3], line 1\n----> 1 from imc24 import *\n      2 sys.path.append(\"/kaggle/input/colmap-db-import\")\n      3 from database import *\n\nFile /kaggle/usr/lib/imc24/imc24.py:40\n     38 from lightglue import LightGlue, ALIKED, match_pair\n     39 from transformers import AutoImageProcessor, AutoModel\n---> 40 from check_orientation.pre_trained_models import create_model\n     42 IMC_PATH = '/kaggle/input/image-matching-challenge-2024'\n     43 DEVICE = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n\nModuleNotFoundError: No module named 'check_orientation",
      "votes": null
    },
    {
      "id": "2758793",
      "postDate": "04/18/2024 10:56:09",
      "content": "<p>Sure thing, I just updated the code. <br>\nTwo things to keep in mind:</p>\n<ul>\n<li>The image rotation does not work for transparent objects(cup and cylinder).</li>\n<li>If you decide to rotate all the datasets, the official scoring runs out of time.</li>\n</ul>\n<p>So you would have to modify the rotation function to include specific datasets, the dioscuri dataset seems to work well with it.</p>",
      "rawMarkdown": "Sure thing, I just updated the code. \nTwo things to keep in mind:\n- The image rotation does not work for transparent objects(cup and cylinder).\n- If you decide to rotate all the datasets, the official scoring runs out of time.\n\nSo you would have to modify the rotation function to include specific datasets, the dioscuri dataset seems to work well with it.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2753485,
      "author_name": "cody11null",
      "author_url": "",
      "post_date": "04/15/2024 14:06:47",
      "content": "<p>Thanks for sharing! I will have to check this out! This competition was hard last year, this time around it is even more difficult! </p>",
      "votes": null,
      "replies": [
        {
          "id": 2753496,
          "author_name": "nartaa",
          "author_url": "",
          "post_date": "04/15/2024 14:22:09",
          "content": "<p>You are very welcome! it's a tricky one for sure.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2756672,
      "author_name": "sunnyykk",
      "author_url": "",
      "post_date": "04/17/2024 06:08:25",
      "content": "<p>Thank you very much for your sharing! <br>\nI have a question: is the \"cross-validation score\" that you mentioned derived from <a href=\"https://www.kaggle.com/code/fabiobellavia/imc2024-3d-metric-evaluation-example\" target=\"_blank\">this metric</a>? Because the validation metrics I obtained differ greatly from the leaderboard score.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2756825,
          "author_name": "nartaa",
          "author_url": "",
          "post_date": "04/17/2024 08:04:30",
          "content": "<p>You are very welcome!</p>\n<blockquote>\n  <p>I have a question: is the \"cross-validation score\" that you mentioned derived from this metric?</p>\n</blockquote>\n<p>Yes, it's the same.</p>\n<p>Randomness is an issue for scoring, but can be fixed by setting thread_num=1 for pycolmap, and you could calibrate the number of images in a dataset for cross validation until you get a similar LB score.</p>\n<p>Could you share the numbers for CV and LB?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2757557,
              "author_name": "sunnyykk",
              "author_url": "",
              "post_date": "04/17/2024 15:21:44",
              "content": "<p>Thank you for your suggestion! <br>\nIn early submissions, I got a CV score of 0.39, but only 0.13 on the LB</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2758542,
      "author_name": "arixel",
      "author_url": "",
      "post_date": "04/18/2024 07:50:12",
      "content": "<p>Two related errors in first block. By any chance can you provide the requirements.txt file?</p>\n<p>ERROR: Could not open requirements file: [Errno 2] No such file or directory: '/kaggle/input/check-image-orientation/requirements.txt'</p>\n<hr>\n<p>ModuleNotFoundError                       Traceback (most recent call last)<br>\nCell In[3], line 1<br>\n----&gt; 1 from imc24 import *<br>\n      2 sys.path.append(\"/kaggle/input/colmap-db-import\")<br>\n      3 from database import *</p>\n<p>File /kaggle/usr/lib/imc24/imc24.py:40<br>\n     38 from lightglue import LightGlue, ALIKED, match_pair<br>\n     39 from transformers import AutoImageProcessor, AutoModel<br>\n---&gt; 40 from check_orientation.pre_trained_models import create_model<br>\n     42 IMC_PATH = '/kaggle/input/image-matching-challenge-2024'<br>\n     43 DEVICE = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")</p>\n<p>ModuleNotFoundError: No module named 'check_orientation</p>",
      "votes": null,
      "replies": [
        {
          "id": 2758793,
          "author_name": "nartaa",
          "author_url": "",
          "post_date": "04/18/2024 10:56:09",
          "content": "<p>Sure thing, I just updated the code. <br>\nTwo things to keep in mind:</p>\n<ul>\n<li>The image rotation does not work for transparent objects(cup and cylinder).</li>\n<li>If you decide to rotate all the datasets, the official scoring runs out of time.</li>\n</ul>\n<p>So you would have to modify the rotation function to include specific datasets, the dioscuri dataset seems to work well with it.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2753418": "Hello, Kagglers!\n\nI'm sharing the [IMC2024 Starter](https://www.kaggle.com/code/nartaa/imc2024-starter), which gives a consistent leaderboard score of 0.13. This starter provides a solid base to build upon.\n\nWe can explore fine-tuning hyperparameters, modifying the code for additional image processing techniques, and trying different models for feature extraction. These avenues offer opportunities to potentially improve the performance further.\n\nLet me know if there are issues or if you have any questions.!\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4495635%2F938578d75aaafd80ef0108855535140a%2FIMC.jpg?generation=1713187931007916&alt=media)",
    "2753485": "Thanks for sharing! I will have to check this out! This competition was hard last year, this time around it is even more difficult!",
    "2753496": "You are very welcome! it's a tricky one for sure.",
    "2756672": "Thank you very much for your sharing! \nI have a question: is the \"cross-validation score\" that you mentioned derived from [this metric](https://www.kaggle.com/code/fabiobellavia/imc2024-3d-metric-evaluation-example)? Because the validation metrics I obtained differ greatly from the leaderboard score.",
    "2756825": "You are very welcome!\n\n> I have a question: is the \"cross-validation score\" that you mentioned derived from this metric?\n\nYes, it's the same.\n\nRandomness is an issue for scoring, but can be fixed by setting thread_num=1 for pycolmap, and you could calibrate the number of images in a dataset for cross validation until you get a similar LB score.\n\nCould you share the numbers for CV and LB?",
    "2757557": "Thank you for your suggestion! \nIn early submissions, I got a CV score of 0.39, but only 0.13 on the LB",
    "2758542": "Two related errors in first block. By any chance can you provide the requirements.txt file?\n\nERROR: Could not open requirements file: [Errno 2] No such file or directory: '/kaggle/input/check-image-orientation/requirements.txt'\n\n---------------------------------------------------------------------------\nModuleNotFoundError                       Traceback (most recent call last)\nCell In[3], line 1\n----> 1 from imc24 import *\n      2 sys.path.append(\"/kaggle/input/colmap-db-import\")\n      3 from database import *\n\nFile /kaggle/usr/lib/imc24/imc24.py:40\n     38 from lightglue import LightGlue, ALIKED, match_pair\n     39 from transformers import AutoImageProcessor, AutoModel\n---> 40 from check_orientation.pre_trained_models import create_model\n     42 IMC_PATH = '/kaggle/input/image-matching-challenge-2024'\n     43 DEVICE = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n\nModuleNotFoundError: No module named 'check_orientation",
    "2758793": "Sure thing, I just updated the code. \nTwo things to keep in mind:\n- The image rotation does not work for transparent objects(cup and cylinder).\n- If you decide to rotate all the datasets, the official scoring runs out of time.\n\nSo you would have to modify the rotation function to include specific datasets, the dioscuri dataset seems to work well with it."
  },
  "source": "meta"
}