{
  "id": 486065,
  "title": "Can the public codes be aligned to the scores after reopening the submissions?",
  "url": "/competitions/home-credit-credit-risk-model-stability/discussion/486065",
  "author_name": "",
  "post_date": "2024-03-23T11:20:07.081622800Z",
  "votes": 5,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Hello <a href=\"https://www.kaggle.com/jetakow\" target=\"_blank\">@jetakow</a> </p>\n<p>I think most of the public forum codes including my work elicit the scores before the submissions were reopened. As an example, my baseline inference kernel shows up a score of 0.611 (this was the score before the submissions were disabled). <br>\nConsidering that the yester scores are now superfluous, can we somehow display the new scores against these notebooks, at least for the resubmitted ones? It will be highly useful for reference in my opinion.</p>\n<p>Best regards.</p>",
  "messages": [
    {
      "id": "2712195",
      "postDate": "03/23/2024 11:20:07",
      "content": "<p>Hello <a href=\"https://www.kaggle.com/jetakow\" target=\"_blank\">@jetakow</a> </p>\n<p>I think most of the public forum codes including my work elicit the scores before the submissions were reopened. As an example, my baseline inference kernel shows up a score of 0.611 (this was the score before the submissions were disabled). <br>\nConsidering that the yester scores are now superfluous, can we somehow display the new scores against these notebooks, at least for the resubmitted ones? It will be highly useful for reference in my opinion.</p>\n<p>Best regards.</p>",
      "rawMarkdown": "Hello @jetakow \n\nI think most of the public forum codes including my work elicit the scores before the submissions were reopened. As an example, my baseline inference kernel shows up a score of 0.611 (this was the score before the submissions were disabled). \nConsidering that the yester scores are now superfluous, can we somehow display the new scores against these notebooks, at least for the resubmitted ones? It will be highly useful for reference in my opinion.\n\nBest regards.",
      "votes": null
    },
    {
      "id": "2712204",
      "postDate": "03/23/2024 11:33:08",
      "content": "<p>Yes, scores of older public notebooks are misleading now. Even if we push a new version it will score much worse, so won't affect the old non-reproducible score that is shown under the notebook name.</p>",
      "rawMarkdown": "Yes, scores of older public notebooks are misleading now. Even if we push a new version it will score much worse, so won't affect the old non-reproducible score that is shown under the notebook name.",
      "votes": null
    },
    {
      "id": "2712221",
      "postDate": "03/23/2024 11:46:33",
      "content": "<p><a href=\"https://www.kaggle.com/kononenko\" target=\"_blank\">@kononenko</a> I asked this question for this reason precisely. I think the new scores are almost going to be lower than the old scores, unless one decides to copy and edit the kernel. This will mislead the viewers and participants in the forum as the public scores may not be reflective of the new submissions. </p>",
      "rawMarkdown": "kononenko I asked this question for this reason precisely. I think the new scores are almost going to be lower than the old scores, unless one decides to copy and edit the kernel. This will mislead the viewers and participants in the forum as the public scores may not be reflective of the new submissions.",
      "votes": null
    },
    {
      "id": "2712407",
      "postDate": "03/23/2024 14:42:41",
      "content": "<p>I apologize for the inconvenience, we didn't think of this possibility. I understand that it is counterproductive. I am not sure if it is possible to fix it in the amount of time we have, I will get in touch with Kaggle staff. Thanks for raising this issue. </p>",
      "rawMarkdown": "I apologize for the inconvenience, we didn't think of this possibility. I understand that it is counterproductive. I am not sure if it is possible to fix it in the amount of time we have, I will get in touch with Kaggle staff. Thanks for raising this issue.",
      "votes": null
    },
    {
      "id": "2712499",
      "postDate": "03/23/2024 15:55:28",
      "content": "<p>Thanks for the information <a href=\"https://www.kaggle.com/jetakow\" target=\"_blank\">@jetakow</a>. <br>\nI will then encourage people to kindly make new kernels to explicitly cite activity before and after the submission break. Also, do not filter kernels by public score while looking for code materials.</p>",
      "rawMarkdown": "Thanks for the information @jetakow. \nI will then encourage people to kindly make new kernels to explicitly cite activity before and after the submission break. Also, do not filter kernels by public score while looking for code materials.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2712204,
      "author_name": "kononenko",
      "author_url": "",
      "post_date": "03/23/2024 11:33:08",
      "content": "<p>Yes, scores of older public notebooks are misleading now. Even if we push a new version it will score much worse, so won't affect the old non-reproducible score that is shown under the notebook name.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2712221,
          "author_name": "ravi20076",
          "author_url": "",
          "post_date": "03/23/2024 11:46:33",
          "content": "<p><a href=\"https://www.kaggle.com/kononenko\" target=\"_blank\">@kononenko</a> I asked this question for this reason precisely. I think the new scores are almost going to be lower than the old scores, unless one decides to copy and edit the kernel. This will mislead the viewers and participants in the forum as the public scores may not be reflective of the new submissions. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2712407,
      "author_name": "jetakow",
      "author_url": "",
      "post_date": "03/23/2024 14:42:41",
      "content": "<p>I apologize for the inconvenience, we didn't think of this possibility. I understand that it is counterproductive. I am not sure if it is possible to fix it in the amount of time we have, I will get in touch with Kaggle staff. Thanks for raising this issue. </p>",
      "votes": null,
      "replies": [
        {
          "id": 2712499,
          "author_name": "ravi20076",
          "author_url": "",
          "post_date": "03/23/2024 15:55:28",
          "content": "<p>Thanks for the information <a href=\"https://www.kaggle.com/jetakow\" target=\"_blank\">@jetakow</a>. <br>\nI will then encourage people to kindly make new kernels to explicitly cite activity before and after the submission break. Also, do not filter kernels by public score while looking for code materials.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2712195": "Hello @jetakow \n\nI think most of the public forum codes including my work elicit the scores before the submissions were reopened. As an example, my baseline inference kernel shows up a score of 0.611 (this was the score before the submissions were disabled). \nConsidering that the yester scores are now superfluous, can we somehow display the new scores against these notebooks, at least for the resubmitted ones? It will be highly useful for reference in my opinion.\n\nBest regards.",
    "2712204": "Yes, scores of older public notebooks are misleading now. Even if we push a new version it will score much worse, so won't affect the old non-reproducible score that is shown under the notebook name.",
    "2712221": "kononenko I asked this question for this reason precisely. I think the new scores are almost going to be lower than the old scores, unless one decides to copy and edit the kernel. This will mislead the viewers and participants in the forum as the public scores may not be reflective of the new submissions.",
    "2712407": "I apologize for the inconvenience, we didn't think of this possibility. I understand that it is counterproductive. I am not sure if it is possible to fix it in the amount of time we have, I will get in touch with Kaggle staff. Thanks for raising this issue.",
    "2712499": "Thanks for the information @jetakow. \nI will then encourage people to kindly make new kernels to explicitly cite activity before and after the submission break. Also, do not filter kernels by public score while looking for code materials."
  },
  "source": "meta"
}