{
  "id": 401775,
  "title": "A few questions about test",
  "url": "/competitions/vesuvius-challenge-ink-detection/discussion/401775",
  "author_name": "",
  "post_date": "2023-04-14T22:57:24.587945Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I have a couple of questions about the test data and process:</p>\n<ol>\n<li>Is mask.png is part of test data or this file exists only for training?</li>\n<li>What a memory restrictions during the testing phase? I have to upload all slices in memory and make some pre-processing before I can make smaller tiles to be submitted to CNN. The post-processing might also require a CPU memory.</li>\n<li>How much memory is available on GPU? I want to understand what is the optimal tile size<br>\nThank you </li>\n</ol>",
  "messages": [
    {
      "id": "2222114",
      "postDate": "04/14/2023 22:57:24",
      "content": "<p>I have a couple of questions about the test data and process:</p>\n<ol>\n<li>Is mask.png is part of test data or this file exists only for training?</li>\n<li>What a memory restrictions during the testing phase? I have to upload all slices in memory and make some pre-processing before I can make smaller tiles to be submitted to CNN. The post-processing might also require a CPU memory.</li>\n<li>How much memory is available on GPU? I want to understand what is the optimal tile size<br>\nThank you </li>\n</ol>",
      "rawMarkdown": "I have a couple of questions about the test data and process:\n1. Is mask.png is part of test data or this file exists only for training?\n2. What a memory restrictions during the testing phase? I have to upload all slices in memory and make some pre-processing before I can make smaller tiles to be submitted to CNN. The post-processing might also require a CPU memory.\n3. How much memory is available on GPU? I want to understand what is the optimal tile size\nThank you",
      "votes": null
    },
    {
      "id": "2222453",
      "postDate": "04/15/2023 09:14:19",
      "content": "<p>Hello,</p>\n<ol>\n<li>Mask file is also available in test data. Labels and IR image are not.<br>\n2-3. CPU/GPU memory (RAM/VRAM) limits depend on the machine you're using. You can select different type when running/submitting your notebook. Check this link for specifications: <a href=\"https://www.kaggle.com/docs/notebooks\" target=\"_blank\">https://www.kaggle.com/docs/notebooks</a></li>\n</ol>",
      "rawMarkdown": "Hello,\n\n1. Mask file is also available in test data. Labels and IR image are not.\n2-3. CPU/GPU memory (RAM/VRAM) limits depend on the machine you're using. You can select different type when running/submitting your notebook. Check this link for specifications: https://www.kaggle.com/docs/notebooks",
      "votes": null
    },
    {
      "id": "2222932",
      "postDate": "04/15/2023 16:49:12",
      "content": "<p>Thank you for your comment</p>",
      "rawMarkdown": "Thank you for your comment",
      "votes": null
    },
    {
      "id": "2228479",
      "postDate": "04/20/2023 15:21:37",
      "content": "<ul>\n<li><p>Yes, the <code>mask.png</code> file is part of the test data as well.</p></li>\n<li><p>Be aware of the memory usage in Kaggle notebooks and make sure it doesn't exceed the limits. Try breaking pre-processing and post-processing steps into smaller chunks if you have issues.</p></li>\n<li><p>Same goes for GPU mem, it also depends on the machine you use.</p></li>\n</ul>\n<blockquote>\n  <p>Check <a href=\"https://www.kaggle.com/docs/notebooks\" target=\"_blank\">this</a> for additional details.</p>\n</blockquote>\n<p>The Devastator.</p>",
      "rawMarkdown": "Yes, the `mask.png` file is part of the test data as well.\n\n- Be aware of the memory usage in Kaggle notebooks and make sure it doesn't exceed the limits. Try breaking pre-processing and post-processing steps into smaller chunks if you have issues.\n \n- Same goes for GPU mem, it also depends on the machine you use.\n\n\n> Check [this](https://www.kaggle.com/docs/notebooks) for additional details.\n\n\nThe Devastator.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2222453,
      "author_name": "danieliusk",
      "author_url": "",
      "post_date": "04/15/2023 09:14:19",
      "content": "<p>Hello,</p>\n<ol>\n<li>Mask file is also available in test data. Labels and IR image are not.<br>\n2-3. CPU/GPU memory (RAM/VRAM) limits depend on the machine you're using. You can select different type when running/submitting your notebook. Check this link for specifications: <a href=\"https://www.kaggle.com/docs/notebooks\" target=\"_blank\">https://www.kaggle.com/docs/notebooks</a></li>\n</ol>",
      "votes": null,
      "replies": [
        {
          "id": 2222932,
          "author_name": "yurikreinin",
          "author_url": "",
          "post_date": "04/15/2023 16:49:12",
          "content": "<p>Thank you for your comment</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2228479,
      "author_name": "thedevastator",
      "author_url": "",
      "post_date": "04/20/2023 15:21:37",
      "content": "<ul>\n<li><p>Yes, the <code>mask.png</code> file is part of the test data as well.</p></li>\n<li><p>Be aware of the memory usage in Kaggle notebooks and make sure it doesn't exceed the limits. Try breaking pre-processing and post-processing steps into smaller chunks if you have issues.</p></li>\n<li><p>Same goes for GPU mem, it also depends on the machine you use.</p></li>\n</ul>\n<blockquote>\n  <p>Check <a href=\"https://www.kaggle.com/docs/notebooks\" target=\"_blank\">this</a> for additional details.</p>\n</blockquote>\n<p>The Devastator.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2222114": "I have a couple of questions about the test data and process:\n1. Is mask.png is part of test data or this file exists only for training?\n2. What a memory restrictions during the testing phase? I have to upload all slices in memory and make some pre-processing before I can make smaller tiles to be submitted to CNN. The post-processing might also require a CPU memory.\n3. How much memory is available on GPU? I want to understand what is the optimal tile size\nThank you",
    "2222453": "Hello,\n\n1. Mask file is also available in test data. Labels and IR image are not.\n2-3. CPU/GPU memory (RAM/VRAM) limits depend on the machine you're using. You can select different type when running/submitting your notebook. Check this link for specifications: https://www.kaggle.com/docs/notebooks",
    "2222932": "Thank you for your comment",
    "2228479": "Yes, the `mask.png` file is part of the test data as well.\n\n- Be aware of the memory usage in Kaggle notebooks and make sure it doesn't exceed the limits. Try breaking pre-processing and post-processing steps into smaller chunks if you have issues.\n \n- Same goes for GPU mem, it also depends on the machine you use.\n\n\n> Check [this](https://www.kaggle.com/docs/notebooks) for additional details.\n\n\nThe Devastator."
  },
  "source": "meta"
}