{
  "id": 181255,
  "title": "Scoring error when trying to blending the submission files",
  "url": "/competitions/osic-pulmonary-fibrosis-progression/discussion/181255",
  "author_name": "",
  "post_date": "2020-09-08T06:43:55.089245700Z",
  "votes": 3,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hi folks, I have tried to blend several submissions of different models but it failed. I am sure they can get a score when submitting them separately. Do you guys have some thoughts about it?</p>",
  "messages": [
    {
      "id": "1002469",
      "postDate": "09/08/2020 06:43:55",
      "content": "<p>Hi folks, I have tried to blend several submissions of different models but it failed. I am sure they can get a score when submitting them separately. Do you guys have some thoughts about it?</p>",
      "rawMarkdown": "Hi folks, I have tried to blend several submissions of different models but it failed. I am sure they can get a score when submitting them separately. Do you guys have some thoughts about it?",
      "votes": null
    },
    {
      "id": "1002755",
      "postDate": "09/08/2020 12:03:14",
      "content": "<p>Hi, are you talking about ensembling (bagging)? If yes, how did you do it?<br>\nI think bagging might help but it might also be too heavy because of the time limit.</p>",
      "rawMarkdown": "Hi, are you talking about ensembling (bagging)? If yes, how did you do it?\nI think bagging might help but it might also be too heavy because of the time limit.",
      "votes": null
    },
    {
      "id": "1003469",
      "postDate": "09/09/2020 02:25:23",
      "content": "<p>No, just simple model averaging. And exactly the time limit is the reason why I choose to apply the ensemble process in a separate notebook. </p>",
      "rawMarkdown": "No, just simple model averaging. And exactly the time limit is the reason why I choose to apply the ensemble process in a separate notebook.",
      "votes": null
    },
    {
      "id": "1004035",
      "postDate": "09/09/2020 12:15:44",
      "content": "<blockquote>\n  <p>apply the ensemble process in a separate notebook.</p>\n</blockquote>\n<p>Are you talking about the training phase? Because you still have to predict for each model and then average and I think that the prediction for each model might be long.<br>\nIf I have the time to averaging several models, I'll put the results here.</p>",
      "rawMarkdown": ">apply the ensemble process in a separate notebook.\n\nAre you talking about the training phase? Because you still have to predict for each model and then average and I think that the prediction for each model might be long.\nIf I have the time to averaging several models, I'll put the results here.",
      "votes": null
    },
    {
      "id": "1004039",
      "postDate": "09/09/2020 12:19:47",
      "content": "<p>It sounds like you have two notebooks that create submission files and you are trying to average them in a third notebook. That doesn't work in this contest. You do not have access to the true submission file from the first two notebooks. You can train your models in separate notebooks, but you have to copy the trained models into another notebook and rerun the predict step and average there.</p>",
      "rawMarkdown": "It sounds like you have two notebooks that create submission files and you are trying to average them in a third notebook. That doesn't work in this contest. You do not have access to the true submission file from the first two notebooks. You can train your models in separate notebooks, but you have to copy the trained models into another notebook and rerun the predict step and average there.",
      "votes": null
    },
    {
      "id": "1004058",
      "postDate": "09/09/2020 12:40:00",
      "content": "<p>I get it. Thanks for your comment.</p>",
      "rawMarkdown": "I get it. Thanks for your comment.",
      "votes": null
    },
    {
      "id": "1004094",
      "postDate": "09/09/2020 13:00:03",
      "content": "<p>It explaines why I didn't understand how you could reduce the time by using another notebook. If you succeed doing average modeling in one notebook, I would be please to have your results.</p>",
      "rawMarkdown": "It explaines why I didn't understand how you could reduce the time by using another notebook. If you succeed doing average modeling in one notebook, I would be please to have your results.",
      "votes": null
    },
    {
      "id": "1004109",
      "postDate": "09/09/2020 13:17:33",
      "content": "<p>I don’t manage it. I can only copy my models from another notebooks and then get my predictions and blend them. Directly blending submissions seems impossible.</p>",
      "rawMarkdown": "I don’t manage it. I can only copy my models from another notebooks and then get my predictions and blend them. Directly blending submissions seems impossible.",
      "votes": null
    },
    {
      "id": "1004232",
      "postDate": "09/09/2020 14:51:36",
      "content": "<p>Okay thanks anyway !</p>",
      "rawMarkdown": "Okay thanks anyway !",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1002755,
      "author_name": "yohannwattiez",
      "author_url": "",
      "post_date": "09/08/2020 12:03:14",
      "content": "<p>Hi, are you talking about ensembling (bagging)? If yes, how did you do it?<br>\nI think bagging might help but it might also be too heavy because of the time limit.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1003469,
          "author_name": "vincentrenzw",
          "author_url": "",
          "post_date": "09/09/2020 02:25:23",
          "content": "<p>No, just simple model averaging. And exactly the time limit is the reason why I choose to apply the ensemble process in a separate notebook. </p>",
          "votes": null,
          "replies": [
            {
              "id": 1004039,
              "author_name": "richardepstein",
              "author_url": "",
              "post_date": "09/09/2020 12:19:47",
              "content": "<p>It sounds like you have two notebooks that create submission files and you are trying to average them in a third notebook. That doesn't work in this contest. You do not have access to the true submission file from the first two notebooks. You can train your models in separate notebooks, but you have to copy the trained models into another notebook and rerun the predict step and average there.</p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 1004058,
              "author_name": "vincentrenzw",
              "author_url": "",
              "post_date": "09/09/2020 12:40:00",
              "content": "<p>I get it. Thanks for your comment.</p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 1004094,
              "author_name": "yohannwattiez",
              "author_url": "",
              "post_date": "09/09/2020 13:00:03",
              "content": "<p>It explaines why I didn't understand how you could reduce the time by using another notebook. If you succeed doing average modeling in one notebook, I would be please to have your results.</p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 1004109,
              "author_name": "vincentrenzw",
              "author_url": "",
              "post_date": "09/09/2020 13:17:33",
              "content": "<p>I don’t manage it. I can only copy my models from another notebooks and then get my predictions and blend them. Directly blending submissions seems impossible.</p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 1004232,
              "author_name": "yohannwattiez",
              "author_url": "",
              "post_date": "09/09/2020 14:51:36",
              "content": "<p>Okay thanks anyway !</p>",
              "votes": null,
              "replies": []
            }
          ]
        },
        {
          "id": 1004035,
          "author_name": "yohannwattiez",
          "author_url": "",
          "post_date": "09/09/2020 12:15:44",
          "content": "<blockquote>\n  <p>apply the ensemble process in a separate notebook.</p>\n</blockquote>\n<p>Are you talking about the training phase? Because you still have to predict for each model and then average and I think that the prediction for each model might be long.<br>\nIf I have the time to averaging several models, I'll put the results here.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1002469": "Hi folks, I have tried to blend several submissions of different models but it failed. I am sure they can get a score when submitting them separately. Do you guys have some thoughts about it?",
    "1002755": "Hi, are you talking about ensembling (bagging)? If yes, how did you do it?\nI think bagging might help but it might also be too heavy because of the time limit.",
    "1003469": "No, just simple model averaging. And exactly the time limit is the reason why I choose to apply the ensemble process in a separate notebook.",
    "1004035": ">apply the ensemble process in a separate notebook.\n\nAre you talking about the training phase? Because you still have to predict for each model and then average and I think that the prediction for each model might be long.\nIf I have the time to averaging several models, I'll put the results here.",
    "1004039": "It sounds like you have two notebooks that create submission files and you are trying to average them in a third notebook. That doesn't work in this contest. You do not have access to the true submission file from the first two notebooks. You can train your models in separate notebooks, but you have to copy the trained models into another notebook and rerun the predict step and average there.",
    "1004058": "I get it. Thanks for your comment.",
    "1004094": "It explaines why I didn't understand how you could reduce the time by using another notebook. If you succeed doing average modeling in one notebook, I would be please to have your results.",
    "1004109": "I don’t manage it. I can only copy my models from another notebooks and then get my predictions and blend them. Directly blending submissions seems impossible.",
    "1004232": "Okay thanks anyway !"
  },
  "source": "meta"
}