{
  "id": 278875,
  "title": "Same model, different score",
  "url": "/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/278875",
  "author_name": "",
  "post_date": "2021-10-15T18:48:50.591284200Z",
  "votes": null,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I loaded the same model and submitted it, but every time I submit it, the result is different. (Same testset result)</p>\n<p>If anyone has experienced this, please let me know why.</p>",
  "messages": [
    {
      "id": "1546075",
      "postDate": "10/15/2021 18:48:50",
      "content": "<p>I loaded the same model and submitted it, but every time I submit it, the result is different. (Same testset result)</p>\n<p>If anyone has experienced this, please let me know why.</p>",
      "rawMarkdown": "I loaded the same model and submitted it, but every time I submit it, the result is different. (Same testset result)\n\nIf anyone has experienced this, please let me know why.",
      "votes": null
    },
    {
      "id": "1546330",
      "postDate": "10/16/2021 03:12:19",
      "content": "<p>Did you change the random seed?</p>",
      "rawMarkdown": "Did you change the random seed?",
      "votes": null
    },
    {
      "id": "1546524",
      "postDate": "10/16/2021 08:45:11",
      "content": "<p>No, same seed</p>",
      "rawMarkdown": "No, same seed",
      "votes": null
    },
    {
      "id": "1546836",
      "postDate": "10/16/2021 14:58:47",
      "content": "<p>Are you doing ensemble model?<br>\nI'm quite interested to know why there is differences… Hope we can help you :) </p>",
      "rawMarkdown": "Are you doing ensemble model?\nI'm quite interested to know why there is differences... Hope we can help you :)",
      "votes": null
    },
    {
      "id": "1547726",
      "postDate": "10/17/2021 14:19:06",
      "content": "<p>No. single model, use tf with eval mode (since our model has dropout).</p>\n<p>In this reason, we suspected that the public dataset was changing. </p>\n<p>But isn't this right?</p>",
      "rawMarkdown": "No. single model, use tf with eval mode (since our model has dropout).\n\nIn this reason, we suspected that the public dataset was changing. \n\nBut isn't this right?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1546330,
      "author_name": "tharun2001",
      "author_url": "",
      "post_date": "10/16/2021 03:12:19",
      "content": "<p>Did you change the random seed?</p>",
      "votes": null,
      "replies": [
        {
          "id": 1546524,
          "author_name": "justhungryman",
          "author_url": "",
          "post_date": "10/16/2021 08:45:11",
          "content": "<p>No, same seed</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1546836,
          "author_name": "matthirou",
          "author_url": "",
          "post_date": "10/16/2021 14:58:47",
          "content": "<p>Are you doing ensemble model?<br>\nI'm quite interested to know why there is differences… Hope we can help you :) </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1547726,
          "author_name": "justhungryman",
          "author_url": "",
          "post_date": "10/17/2021 14:19:06",
          "content": "<p>No. single model, use tf with eval mode (since our model has dropout).</p>\n<p>In this reason, we suspected that the public dataset was changing. </p>\n<p>But isn't this right?</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1546075": "I loaded the same model and submitted it, but every time I submit it, the result is different. (Same testset result)\n\nIf anyone has experienced this, please let me know why.",
    "1546330": "Did you change the random seed?",
    "1546524": "No, same seed",
    "1546836": "Are you doing ensemble model?\nI'm quite interested to know why there is differences... Hope we can help you :)",
    "1547726": "No. single model, use tf with eval mode (since our model has dropout).\n\nIn this reason, we suspected that the public dataset was changing. \n\nBut isn't this right?"
  },
  "source": "meta"
}