{
  "id": 623696,
  "title": "[Info] Keras 3 Multi-Backend 2D and 3D Imaging Library",
  "url": "/competitions/vesuvius-challenge-surface-detection/discussion/623696",
  "author_name": "",
  "post_date": "2025-11-15T21:17:04.397710500Z",
  "votes": 6,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Since earlier this year, I’ve been developing a machine-learning library called <code>medicai</code>, built entirely on <strong>Keras 3</strong> with full multi-backend support (<code>tensorflow</code>, <code>torch</code>, <code>jax</code>). It handles both 2D and 3D inputs. Although the project is still new and actively evolving, the models available in the main branch are already stable and ready to use. You can try them for 2D, 2.5D, and 3D tasks. Notable models include:</p>\n<ul>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/unetr/README.md\" target=\"_blank\">UNETR</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/unetr_plus_plus/README.md\" target=\"_blank\">UNETR++</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/swin/README.md\" target=\"_blank\">SwinUNETR</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/transunet/README.md\" target=\"_blank\">TransUNet</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/segformer/README.md\" target=\"_blank\">SegFormer</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/upernet/README.md\" target=\"_blank\">UPerNet</a></li>\n</ul>\n<p><strong>Repository</strong></p>\n<ul>\n<li><a href=\"https://github.com/innat/medic-ai\" target=\"_blank\">medicai</a></li>\n</ul>\n<p><strong>Tutorials:</strong></p>\n<ul>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection\" target=\"_blank\">3D segmentation cases with Keras built-in training API with JAX backend - TPU</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection-in-pytorch\" target=\"_blank\">3D segmentation cases with pure PyTorch + TFRecord</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-surface-2-5d-detection-in-jax\" target=\"_blank\">2.5D segmentation cases with Jax</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/train-vesuvius-surface-3d-detection-in-lightning\" target=\"_blank\">3D segmentation cases with PyTorch-lightning</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/inference-vesuvius-surface-3d-detection\" target=\"_blank\">3D Inference</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-tif-to-tfrecord\" target=\"_blank\">tif to tfrecord conversion</a></li>\n</ul>",
  "messages": [
    {
      "id": "3328581",
      "postDate": "11/15/2025 21:17:04",
      "content": "<p>Since earlier this year, I’ve been developing a machine-learning library called <code>medicai</code>, built entirely on <strong>Keras 3</strong> with full multi-backend support (<code>tensorflow</code>, <code>torch</code>, <code>jax</code>). It handles both 2D and 3D inputs. Although the project is still new and actively evolving, the models available in the main branch are already stable and ready to use. You can try them for 2D, 2.5D, and 3D tasks. Notable models include:</p>\n<ul>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/unetr/README.md\" target=\"_blank\">UNETR</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/unetr_plus_plus/README.md\" target=\"_blank\">UNETR++</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/swin/README.md\" target=\"_blank\">SwinUNETR</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/transunet/README.md\" target=\"_blank\">TransUNet</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/segformer/README.md\" target=\"_blank\">SegFormer</a></li>\n<li><a href=\"https://github.com/innat/medic-ai/blob/main/medicai/models/upernet/README.md\" target=\"_blank\">UPerNet</a></li>\n</ul>\n<p><strong>Repository</strong></p>\n<ul>\n<li><a href=\"https://github.com/innat/medic-ai\" target=\"_blank\">medicai</a></li>\n</ul>\n<p><strong>Tutorials:</strong></p>\n<ul>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection\" target=\"_blank\">3D segmentation cases with Keras built-in training API with JAX backend - TPU</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection-in-pytorch\" target=\"_blank\">3D segmentation cases with pure PyTorch + TFRecord</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-surface-2-5d-detection-in-jax\" target=\"_blank\">2.5D segmentation cases with Jax</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/train-vesuvius-surface-3d-detection-in-lightning\" target=\"_blank\">3D segmentation cases with PyTorch-lightning</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/inference-vesuvius-surface-3d-detection\" target=\"_blank\">3D Inference</a> - (use this comp dataset)</li>\n<li><a href=\"https://www.kaggle.com/code/ipythonx/vesuvius-tif-to-tfrecord\" target=\"_blank\">tif to tfrecord conversion</a></li>\n</ul>",
      "rawMarkdown": "Since earlier this year, I’ve been developing a machine-learning library called `medicai`, built entirely on **Keras 3** with full multi-backend support (`tensorflow`, `torch`, `jax`). It handles both 2D and 3D inputs. Although the project is still new and actively evolving, the models available in the main branch are already stable and ready to use. You can try them for 2D, 2.5D, and 3D tasks. Notable models include:\n\n- [UNETR](https://github.com/innat/medic-ai/blob/main/medicai/models/unetr/README.md)\n- [UNETR++](https://github.com/innat/medic-ai/blob/main/medicai/models/unetr_plus_plus/README.md)\n- [SwinUNETR](https://github.com/innat/medic-ai/blob/main/medicai/models/swin/README.md)\n- [TransUNet](https://github.com/innat/medic-ai/blob/main/medicai/models/transunet/README.md)\n- [SegFormer](https://github.com/innat/medic-ai/blob/main/medicai/models/segformer/README.md)\n- [UPerNet](https://github.com/innat/medic-ai/blob/main/medicai/models/upernet/README.md)\n\n\n**Repository**\n\n- [medicai](https://github.com/innat/medic-ai)\n\n**Tutorials:**\n\n- [3D segmentation cases with Keras built-in training API with JAX backend - TPU](https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection) - (use this comp dataset)\n- [3D segmentation cases with pure PyTorch + TFRecord](https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection-in-pytorch) - (use this comp dataset)\n- [2.5D segmentation cases with Jax](https://www.kaggle.com/code/ipythonx/vesuvius-surface-2-5d-detection-in-jax) - (use this comp dataset)\n- [3D segmentation cases with PyTorch-lightning](https://www.kaggle.com/code/ipythonx/train-vesuvius-surface-3d-detection-in-lightning) - (use this comp dataset)\n- [3D Inference](https://www.kaggle.com/code/ipythonx/inference-vesuvius-surface-3d-detection) - (use this comp dataset)\n- [tif to tfrecord conversion](https://www.kaggle.com/code/ipythonx/vesuvius-tif-to-tfrecord)",
      "votes": null
    },
    {
      "id": "3351014",
      "postDate": "11/28/2025 04:52:58",
      "content": "<p>amazing work how do you train these ?</p>",
      "rawMarkdown": "amazing work how do you train these ?",
      "votes": null
    },
    {
      "id": "3351121",
      "postDate": "11/28/2025 06:57:07",
      "content": "<p>You can train any model with your preferred library (tf/torch/jax) by setting the keras backend. The tutorials mentioned above are some starter. <a href=\"https://github.com/innat/medic-ai?tab=readme-ov-file#-guides\" target=\"_blank\">Here</a> are more of it.</p>",
      "rawMarkdown": "You can train any model with your preferred library (tf/torch/jax) by setting the keras backend. The tutorials mentioned above are some starter. [Here](https://github.com/innat/medic-ai?tab=readme-ov-file#-guides) are more of it.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3351014,
      "author_name": "theonetheonly",
      "author_url": "",
      "post_date": "11/28/2025 04:52:58",
      "content": "<p>amazing work how do you train these ?</p>",
      "votes": null,
      "replies": [
        {
          "id": 3351121,
          "author_name": "ipythonx",
          "author_url": "",
          "post_date": "11/28/2025 06:57:07",
          "content": "<p>You can train any model with your preferred library (tf/torch/jax) by setting the keras backend. The tutorials mentioned above are some starter. <a href=\"https://github.com/innat/medic-ai?tab=readme-ov-file#-guides\" target=\"_blank\">Here</a> are more of it.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3328581": "Since earlier this year, I’ve been developing a machine-learning library called `medicai`, built entirely on **Keras 3** with full multi-backend support (`tensorflow`, `torch`, `jax`). It handles both 2D and 3D inputs. Although the project is still new and actively evolving, the models available in the main branch are already stable and ready to use. You can try them for 2D, 2.5D, and 3D tasks. Notable models include:\n\n- [UNETR](https://github.com/innat/medic-ai/blob/main/medicai/models/unetr/README.md)\n- [UNETR++](https://github.com/innat/medic-ai/blob/main/medicai/models/unetr_plus_plus/README.md)\n- [SwinUNETR](https://github.com/innat/medic-ai/blob/main/medicai/models/swin/README.md)\n- [TransUNet](https://github.com/innat/medic-ai/blob/main/medicai/models/transunet/README.md)\n- [SegFormer](https://github.com/innat/medic-ai/blob/main/medicai/models/segformer/README.md)\n- [UPerNet](https://github.com/innat/medic-ai/blob/main/medicai/models/upernet/README.md)\n\n\n**Repository**\n\n- [medicai](https://github.com/innat/medic-ai)\n\n**Tutorials:**\n\n- [3D segmentation cases with Keras built-in training API with JAX backend - TPU](https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection) - (use this comp dataset)\n- [3D segmentation cases with pure PyTorch + TFRecord](https://www.kaggle.com/code/ipythonx/vesuvius-surface-detection-in-pytorch) - (use this comp dataset)\n- [2.5D segmentation cases with Jax](https://www.kaggle.com/code/ipythonx/vesuvius-surface-2-5d-detection-in-jax) - (use this comp dataset)\n- [3D segmentation cases with PyTorch-lightning](https://www.kaggle.com/code/ipythonx/train-vesuvius-surface-3d-detection-in-lightning) - (use this comp dataset)\n- [3D Inference](https://www.kaggle.com/code/ipythonx/inference-vesuvius-surface-3d-detection) - (use this comp dataset)\n- [tif to tfrecord conversion](https://www.kaggle.com/code/ipythonx/vesuvius-tif-to-tfrecord)",
    "3351014": "amazing work how do you train these ?",
    "3351121": "You can train any model with your preferred library (tf/torch/jax) by setting the keras backend. The tutorials mentioned above are some starter. [Here](https://github.com/innat/medic-ai?tab=readme-ov-file#-guides) are more of it."
  },
  "source": "meta"
}