{
  "id": 558051,
  "title": "Very Awkward Data Visualizations",
  "url": "/competitions/czii-cryo-et-object-identification/discussion/558051",
  "author_name": "",
  "post_date": "2025-01-22T22:09:12.043843Z",
  "votes": 2,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I tried training various 3d Unet based models but found that the DICE score for individual classes and traversky loss almost stayed same after many training epochs, with DICE score very close to 0 for all classes.</p>\n<p>Then I tried to visualize the tomograms of patchsize (128) to see what is consumed by models, I found that there is no clear structure in the tomograms which the models can learn effectively…</p>\n<p>There are 2 awkward cases : </p>\n<ul>\n<li>When I plot pixel histogram , there is very small range of pixel values with very high frequency. <img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Ff4943226494a8c3812830fb923901bd4%2Foutput.png?generation=1737582820260504&amp;alt=media\" alt=\"\"></li>\n<li>When I plot the tomogram in 3d, allowing sampling of voxels from pixels within that high frequency range. <img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Fdf05c3111a46cb47b660debb87e074b4%2Fnewplot1.png?generation=1737582919064444&amp;alt=media\" alt=\"\"></li>\n</ul>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2F20a550c1767c1a3269c1f888c92e2eb0%2Fnewplot.png?generation=1737582951366234&amp;alt=media\" alt=\"\"></p>\n<p>Notice <code>~</code> in title of 3rd image.</p>\n<p>Observation : </p>\n<ul>\n<li>The sampled pixels cover entire tomogram excluding the region surrounding the sphere (in red) (as segmentation ground truth for training)… the sizes of sphere correspond to various classes.</li>\n</ul>\n<p>I have experimented with tomo-algo : <code>denoised</code> and scale : <code>0</code>, without any preprocessing.</p>\n<p>Here I attach my <a href=\"https://api.wandb.ai/links/shri_krishna/420dlwdc\" target=\"_blank\">training report</a> for detailed review. Pls help me understand the scenario and how can I tackle it…</p>\n<p>I see people claiming to easily achive LB ~ <code>0.707</code> …. where am I getting wrong??</p>",
  "messages": [
    {
      "id": "3103006",
      "postDate": "01/22/2025 22:09:12",
      "content": "<p>I tried training various 3d Unet based models but found that the DICE score for individual classes and traversky loss almost stayed same after many training epochs, with DICE score very close to 0 for all classes.</p>\n<p>Then I tried to visualize the tomograms of patchsize (128) to see what is consumed by models, I found that there is no clear structure in the tomograms which the models can learn effectively…</p>\n<p>There are 2 awkward cases : </p>\n<ul>\n<li>When I plot pixel histogram , there is very small range of pixel values with very high frequency. <img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Ff4943226494a8c3812830fb923901bd4%2Foutput.png?generation=1737582820260504&amp;alt=media\" alt=\"\"></li>\n<li>When I plot the tomogram in 3d, allowing sampling of voxels from pixels within that high frequency range. <img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Fdf05c3111a46cb47b660debb87e074b4%2Fnewplot1.png?generation=1737582919064444&amp;alt=media\" alt=\"\"></li>\n</ul>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2F20a550c1767c1a3269c1f888c92e2eb0%2Fnewplot.png?generation=1737582951366234&amp;alt=media\" alt=\"\"></p>\n<p>Notice <code>~</code> in title of 3rd image.</p>\n<p>Observation : </p>\n<ul>\n<li>The sampled pixels cover entire tomogram excluding the region surrounding the sphere (in red) (as segmentation ground truth for training)… the sizes of sphere correspond to various classes.</li>\n</ul>\n<p>I have experimented with tomo-algo : <code>denoised</code> and scale : <code>0</code>, without any preprocessing.</p>\n<p>Here I attach my <a href=\"https://api.wandb.ai/links/shri_krishna/420dlwdc\" target=\"_blank\">training report</a> for detailed review. Pls help me understand the scenario and how can I tackle it…</p>\n<p>I see people claiming to easily achive LB ~ <code>0.707</code> …. where am I getting wrong??</p>",
      "rawMarkdown": "I tried training various 3d Unet based models but found that the DICE score for individual classes and traversky loss almost stayed same after many training epochs, with DICE score very close to 0 for all classes.\n\nThen I tried to visualize the tomograms of patchsize (128) to see what is consumed by models, I found that there is no clear structure in the tomograms which the models can learn effectively...\n\nThere are 2 awkward cases : \n- When I plot pixel histogram , there is very small range of pixel values with very high frequency. ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Ff4943226494a8c3812830fb923901bd4%2Foutput.png?generation=1737582820260504&alt=media)\n- When I plot the tomogram in 3d, allowing sampling of voxels from pixels within that high frequency range. ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Fdf05c3111a46cb47b660debb87e074b4%2Fnewplot1.png?generation=1737582919064444&alt=media)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2F20a550c1767c1a3269c1f888c92e2eb0%2Fnewplot.png?generation=1737582951366234&alt=media)\n\nNotice ```~``` in title of 3rd image.\n\nObservation : \n- The sampled pixels cover entire tomogram excluding the region surrounding the sphere (in red) (as segmentation ground truth for training)... the sizes of sphere correspond to various classes.\n\nI have experimented with tomo-algo : ```denoised``` and scale : ```0```, without any preprocessing.\n\nHere I attach my [training report](https://api.wandb.ai/links/shri_krishna/420dlwdc) for detailed review. Pls help me understand the scenario and how can I tackle it...\n\nI see people claiming to easily achive LB ~ ```0.707``` .... where am I getting wrong??",
      "votes": null
    },
    {
      "id": "3103165",
      "postDate": "01/23/2025 05:51:06",
      "content": "<p>This notebook is a great starting point for 3D Unet.  You might start there, and then try some of the higher scoring notebooks as well:<br>\n<a href=\"https://www.kaggle.com/code/fnands/baseline-unet-train-submit\" target=\"_blank\">https://www.kaggle.com/code/fnands/baseline-unet-train-submit</a></p>\n<p>I would take a look through the notebooks on the code tab.</p>",
      "rawMarkdown": "This notebook is a great starting point for 3D Unet.  You might start there, and then try some of the higher scoring notebooks as well:\n[https://www.kaggle.com/code/fnands/baseline-unet-train-submit](https://www.kaggle.com/code/fnands/baseline-unet-train-submit)\n\nI would take a look through the notebooks on the code tab.",
      "votes": null
    },
    {
      "id": "3109268",
      "postDate": "01/28/2025 17:00:54",
      "content": "<p>Also keep in mind that the LB score of 0.707 is not necessarily easy but there is a public notebook that scored 0.707 that others have copied and submitted.</p>",
      "rawMarkdown": "Also keep in mind that the LB score of 0.707 is not necessarily easy but there is a public notebook that scored 0.707 that others have copied and submitted.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3103165,
      "author_name": "davidlist",
      "author_url": "",
      "post_date": "01/23/2025 05:51:06",
      "content": "<p>This notebook is a great starting point for 3D Unet.  You might start there, and then try some of the higher scoring notebooks as well:<br>\n<a href=\"https://www.kaggle.com/code/fnands/baseline-unet-train-submit\" target=\"_blank\">https://www.kaggle.com/code/fnands/baseline-unet-train-submit</a></p>\n<p>I would take a look through the notebooks on the code tab.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3109268,
      "author_name": "connorjd",
      "author_url": "",
      "post_date": "01/28/2025 17:00:54",
      "content": "<p>Also keep in mind that the LB score of 0.707 is not necessarily easy but there is a public notebook that scored 0.707 that others have copied and submitted.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3103006": "I tried training various 3d Unet based models but found that the DICE score for individual classes and traversky loss almost stayed same after many training epochs, with DICE score very close to 0 for all classes.\n\nThen I tried to visualize the tomograms of patchsize (128) to see what is consumed by models, I found that there is no clear structure in the tomograms which the models can learn effectively...\n\nThere are 2 awkward cases : \n- When I plot pixel histogram , there is very small range of pixel values with very high frequency. ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Ff4943226494a8c3812830fb923901bd4%2Foutput.png?generation=1737582820260504&alt=media)\n- When I plot the tomogram in 3d, allowing sampling of voxels from pixels within that high frequency range. ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2Fdf05c3111a46cb47b660debb87e074b4%2Fnewplot1.png?generation=1737582919064444&alt=media)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F9117256%2F20a550c1767c1a3269c1f888c92e2eb0%2Fnewplot.png?generation=1737582951366234&alt=media)\n\nNotice ```~``` in title of 3rd image.\n\nObservation : \n- The sampled pixels cover entire tomogram excluding the region surrounding the sphere (in red) (as segmentation ground truth for training)... the sizes of sphere correspond to various classes.\n\nI have experimented with tomo-algo : ```denoised``` and scale : ```0```, without any preprocessing.\n\nHere I attach my [training report](https://api.wandb.ai/links/shri_krishna/420dlwdc) for detailed review. Pls help me understand the scenario and how can I tackle it...\n\nI see people claiming to easily achive LB ~ ```0.707``` .... where am I getting wrong??",
    "3103165": "This notebook is a great starting point for 3D Unet.  You might start there, and then try some of the higher scoring notebooks as well:\n[https://www.kaggle.com/code/fnands/baseline-unet-train-submit](https://www.kaggle.com/code/fnands/baseline-unet-train-submit)\n\nI would take a look through the notebooks on the code tab.",
    "3109268": "Also keep in mind that the LB score of 0.707 is not necessarily easy but there is a public notebook that scored 0.707 that others have copied and submitted."
  },
  "source": "meta"
}