{
  "id": 233336,
  "title": "external data source - HuBMAP portal",
  "url": "/competitions/hubmap-kidney-segmentation/discussion/233336",
  "author_name": "Swikwislkdjc",
  "post_date": "2021-04-18T16:29:44.559000",
  "votes": 14,
  "comment_count": 17,
  "views": 0,
  "content": "<p>C(ii) External data source ---HuBMAP website : <a href=\"https://portal.hubmapconsortium.org/search?entity_type[0]=Dataset\" target=\"_blank\">https://portal.hubmapconsortium.org/search?entity_type[0]=Dataset</a></p>\n<p>C(i) To download image, click one HuBMAP ID, then in the opened website, click Files --&gt; ometiff-pyramids --&gt; processedMicroscopy --&gt; click the tiff file, it will download automatically</p>\n<p>The image can be used for hand-labeling or psudo-labeling. </p>\n<hr>\n<p>C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.</p>",
  "messages": [
    {
      "id": 1277344,
      "postDate": "2021-04-18T16:29:44.560Z",
      "content": "<p>C(ii) External data source ---HuBMAP website : <a href=\"https://portal.hubmapconsortium.org/search?entity_type[0]=Dataset\" target=\"_blank\">https://portal.hubmapconsortium.org/search?entity_type[0]=Dataset</a></p>\n<p>C(i) To download image, click one HuBMAP ID, then in the opened website, click Files --&gt; ometiff-pyramids --&gt; processedMicroscopy --&gt; click the tiff file, it will download automatically</p>\n<p>The image can be used for hand-labeling or psudo-labeling. </p>\n<hr>\n<p>C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.</p>",
      "rawMarkdown": "C(ii) External data source ---HuBMAP website : https://portal.hubmapconsortium.org/search?entity_type[0]=Dataset\n\nC(i) To download image, click one HuBMAP ID, then in the opened website, click Files --> ometiff-pyramids --> processedMicroscopy --> click the tiff file, it will download automatically\n\nThe image can be used for hand-labeling or psudo-labeling. \n\n\n--------\nC. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.",
      "votes": 13
    },
    {
      "id": 1290813,
      "postDate": "2021-05-02T12:47:58.357Z",
      "content": "<p>Here is another external dataset, I did not actually use it to come to my current lb score, which is based mostly on manual labelling, so my position will probably drop a lot at the end: <a href=\"https://zenodo.org/record/4299694#.X8YsCs1KiUl\" target=\"_blank\">https://zenodo.org/record/4299694#.X8YsCs1KiUl</a>.</p>",
      "rawMarkdown": "Here is another external dataset, I did not actually use it to come to my current lb score, which is based mostly on manual labelling, so my position will probably drop a lot at the end: https://zenodo.org/record/4299694#.X8YsCs1KiUl.",
      "votes": 7
    },
    {
      "id": 1278183,
      "postDate": "2021-04-19T16:13:25.043Z",
      "content": "<p>Thanks <a href=\"https://www.kaggle.com/lililycai\" target=\"_blank\">@lililycai</a>  are there any masks contained too in this ?</p>",
      "rawMarkdown": "Thanks @lililycai  are there any masks contained too in this ?",
      "votes": 2,
      "replies": [
        {
          "id": 1278322,
          "postDate": "2021-04-19T18:42:01.847Z",
          "content": "<p>there's no masks in this. </p>",
          "rawMarkdown": "there's no masks in this. ",
          "votes": 1
        },
        {
          "id": 1279266,
          "postDate": "2021-04-20T18:43:09.790Z",
          "content": "<p>So you are planning to pseudo label or hand label it?</p>",
          "rawMarkdown": "So you are planning to pseudo label or hand label it?"
        }
      ]
    },
    {
      "id": 1281892,
      "postDate": "2021-04-23T12:07:17.090Z",
      "content": "<p>If it is of interest, this notebook maps the competition and portal external data with an output file that includes the competition dataset information.  <br>\n<a href=\"https://www.kaggle.com/something4kag/hubmap-and-portal-mapping\" target=\"_blank\">https://www.kaggle.com/something4kag/hubmap-and-portal-mapping</a></p>",
      "rawMarkdown": "If it is of interest, this notebook maps the competition and portal external data with an output file that includes the competition dataset information.  \nhttps://www.kaggle.com/something4kag/hubmap-and-portal-mapping"
    },
    {
      "id": 1281484,
      "postDate": "2021-04-23T02:18:49.843Z",
      "content": "<p>any tools to hand label those images?</p>",
      "rawMarkdown": "any tools to hand label those images?"
    },
    {
      "id": 1279877,
      "postDate": "2021-04-21T09:58:40.973Z",
      "content": "<p>Thanks for sharing. Please post your score with this data and without this data. Thanks a lot. </p>",
      "rawMarkdown": "Thanks for sharing. Please post your score with this data and without this data. Thanks a lot. "
    },
    {
      "id": 1280526,
      "postDate": "2021-04-22T04:38:12.190Z",
      "rawMarkdown": "",
      "votes": 1,
      "isDeleted": true,
      "replies": [
        {
          "id": 1280842,
          "postDate": "2021-04-22T12:07:48.150Z",
          "content": "<p>ohh thanx for the dataset ! may i ask  are you using this dataset to reach upto that lb score </p>",
          "rawMarkdown": "ohh thanx for the dataset ! may i ask  are you using this dataset to reach upto that lb score "
        },
        {
          "id": 1280955,
          "postDate": "2021-04-22T14:18:02.403Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 1281225,
          "postDate": "2021-04-22T18:14:23.600Z",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/narainp\" target=\"_blank\">@narainp</a> Thanks for sharing these 2 extensive datasets. Just out of curiousity… is there a reason you are not using this data? And only use the competitioin data?</p>",
          "rawMarkdown": "Hi @narainp Thanks for sharing these 2 extensive datasets. Just out of curiousity... is there a reason you are not using this data? And only use the competitioin data?"
        },
        {
          "id": 1281690,
          "postDate": "2021-04-23T07:28:31.370Z",
          "rawMarkdown": "",
          "votes": 1,
          "isDeleted": true
        },
        {
          "id": 1281715,
          "postDate": "2021-04-23T08:06:19.537Z",
          "content": "<p>Hi, narain! Thanks for your uploads! I really appreaciate it! But I have seen the hubmap website and found that there are 13 pages of the data, and you just uploaded 21 of them, what's the difference between hubmap website and your upload?</p>",
          "rawMarkdown": "Hi, narain! Thanks for your uploads! I really appreaciate it! But I have seen the hubmap website and found that there are 13 pages of the data, and you just uploaded 21 of them, what's the difference between hubmap website and your upload?"
        },
        {
          "id": 1281739,
          "postDate": "2021-04-23T08:58:49.120Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 1281740,
          "postDate": "2021-04-23T09:00:30.793Z",
          "content": "<p>I really hope that the private dataset arent those 2. </p>",
          "rawMarkdown": "I really hope that the private dataset arent those 2. "
        },
        {
          "id": 1281994,
          "postDate": "2021-04-23T13:55:27.307Z",
          "content": "<p>The private dataset has not been published anywhere, the HuBMAP Data Portal included.</p>",
          "rawMarkdown": "The private dataset has not been published anywhere, the HuBMAP Data Portal included.",
          "votes": 2
        }
      ]
    },
    {
      "id": 1284121,
      "postDate": "2021-04-25T15:16:58.890Z",
      "content": "<p>Thanks for sharing. </p>",
      "rawMarkdown": "Thanks for sharing. "
    }
  ],
  "comments": [
    {
      "id": 1290813,
      "author_name": "Gena",
      "author_url": "",
      "post_date": "2021-05-02T12:47:58.357000",
      "content": "<p>Here is another external dataset, I did not actually use it to come to my current lb score, which is based mostly on manual labelling, so my position will probably drop a lot at the end: <a href=\"https://zenodo.org/record/4299694#.X8YsCs1KiUl\" target=\"_blank\">https://zenodo.org/record/4299694#.X8YsCs1KiUl</a>.</p>",
      "votes": 7,
      "replies": []
    },
    {
      "id": 1278183,
      "author_name": "Jaideep",
      "author_url": "",
      "post_date": "2021-04-19T16:13:25.043000",
      "content": "<p>Thanks <a href=\"https://www.kaggle.com/lililycai\" target=\"_blank\">@lililycai</a>  are there any masks contained too in this ?</p>",
      "votes": 2,
      "replies": [
        {
          "id": 1278322,
          "author_name": "Swikwislkdjc",
          "author_url": "",
          "post_date": "2021-04-19T18:42:01.847000",
          "content": "<p>there's no masks in this. </p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1279266,
          "author_name": "victorasso",
          "author_url": "",
          "post_date": "2021-04-20T18:43:09.790000",
          "content": "<p>So you are planning to pseudo label or hand label it?</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1281892,
      "author_name": "something4kag",
      "author_url": "",
      "post_date": "2021-04-23T12:07:17.090000",
      "content": "<p>If it is of interest, this notebook maps the competition and portal external data with an output file that includes the competition dataset information.  <br>\n<a href=\"https://www.kaggle.com/something4kag/hubmap-and-portal-mapping\" target=\"_blank\">https://www.kaggle.com/something4kag/hubmap-and-portal-mapping</a></p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1281484,
      "author_name": "rpsantosa_kaggle",
      "author_url": "",
      "post_date": "2021-04-23T02:18:49.843000",
      "content": "<p>any tools to hand label those images?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1279877,
      "author_name": "Md. Masud Rana",
      "author_url": "",
      "post_date": "2021-04-21T09:58:40.973000",
      "content": "<p>Thanks for sharing. Please post your score with this data and without this data. Thanks a lot. </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1280526,
      "author_name": "",
      "author_url": "",
      "post_date": "2021-04-22T04:38:12.190000",
      "content": "",
      "votes": 1,
      "replies": [
        {
          "id": 1280842,
          "author_name": "Shubham Thapa",
          "author_url": "",
          "post_date": "2021-04-22T12:07:48.150000",
          "content": "<p>ohh thanx for the dataset ! may i ask  are you using this dataset to reach upto that lb score </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1280955,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-04-22T14:18:02.403000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1281225,
          "author_name": "Robin Smits",
          "author_url": "",
          "post_date": "2021-04-22T18:14:23.600000",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/narainp\" target=\"_blank\">@narainp</a> Thanks for sharing these 2 extensive datasets. Just out of curiousity… is there a reason you are not using this data? And only use the competitioin data?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1281690,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-04-23T07:28:31.370000",
          "content": "",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1281715,
          "author_name": "Lucius",
          "author_url": "",
          "post_date": "2021-04-23T08:06:19.537000",
          "content": "<p>Hi, narain! Thanks for your uploads! I really appreaciate it! But I have seen the hubmap website and found that there are 13 pages of the data, and you just uploaded 21 of them, what's the difference between hubmap website and your upload?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1281739,
          "author_name": "",
          "author_url": "",
          "post_date": "2021-04-23T08:58:49.120000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1281740,
          "author_name": "rpsantosa_kaggle",
          "author_url": "",
          "post_date": "2021-04-23T09:00:30.793000",
          "content": "<p>I really hope that the private dataset arent those 2. </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1281994,
          "author_name": "Leah Godwin",
          "author_url": "",
          "post_date": "2021-04-23T13:55:27.307000",
          "content": "<p>The private dataset has not been published anywhere, the HuBMAP Data Portal included.</p>",
          "votes": 2,
          "replies": []
        }
      ]
    },
    {
      "id": 1284121,
      "author_name": "RAY",
      "author_url": "",
      "post_date": "2021-04-25T15:16:58.890000",
      "content": "<p>Thanks for sharing. </p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1277344": "C(ii) External data source ---HuBMAP website : https://portal.hubmapconsortium.org/search?entity_type[0]=Dataset\n\nC(i) To download image, click one HuBMAP ID, then in the opened website, click Files --> ometiff-pyramids --> processedMicroscopy --> click the tiff file, it will download automatically\n\nThe image can be used for hand-labeling or psudo-labeling. \n\n\n--------\nC. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.",
    "1290813": "Here is another external dataset, I did not actually use it to come to my current lb score, which is based mostly on manual labelling, so my position will probably drop a lot at the end: https://zenodo.org/record/4299694#.X8YsCs1KiUl.",
    "1278183": "Thanks @lililycai  are there any masks contained too in this ?",
    "1281892": "If it is of interest, this notebook maps the competition and portal external data with an output file that includes the competition dataset information.  \nhttps://www.kaggle.com/something4kag/hubmap-and-portal-mapping",
    "1281484": "any tools to hand label those images?",
    "1279877": "Thanks for sharing. Please post your score with this data and without this data. Thanks a lot. ",
    "1280526": "",
    "1284121": "Thanks for sharing. "
  }
}