{
  "id": 340542,
  "title": "Private Leaderboard and \"Ensemble\" notebook",
  "url": "/competitions/amex-default-prediction/discussion/340542",
  "author_name": "",
  "post_date": "2022-07-29T16:16:14.329069700Z",
  "votes": 4,
  "comment_count": 9,
  "views": 0,
  "content": "<p>I am seeing a lot of notebooks who ensemble multiple submissions files to improve the Public leaderboard.</p>\n<p>But, for the Private leaderboard, all these notebook will need to load the model parameters/weights to make the inference on the new data, right? So, if you dont have the model, you will have to train all of them to make this inference.</p>",
  "messages": [
    {
      "id": "1876183",
      "postDate": "07/29/2022 16:16:14",
      "content": "<p>I am seeing a lot of notebooks who ensemble multiple submissions files to improve the Public leaderboard.</p>\n<p>But, for the Private leaderboard, all these notebook will need to load the model parameters/weights to make the inference on the new data, right? So, if you dont have the model, you will have to train all of them to make this inference.</p>",
      "rawMarkdown": "I am seeing a lot of notebooks who ensemble multiple submissions files to improve the Public leaderboard.\n\nBut, for the Private leaderboard, all these notebook will need to load the model parameters/weights to make the inference on the new data, right? So, if you dont have the model, you will have to train all of them to make this inference.",
      "votes": null
    },
    {
      "id": "1876195",
      "postDate": "07/29/2022 16:23:59",
      "content": "<p>There won't be any new data for the private leaderboard. The private leaderboard is contained in the test_data.csv you've already got, and, consequently, in the submission.csv you've already submitted. Half of test_data.csv is for the public leaderboard, half is for the private leaderboard.</p>",
      "rawMarkdown": "There won't be any new data for the private leaderboard. The private leaderboard is contained in the test_data.csv you've already got, and, consequently, in the submission.csv you've already submitted. Half of test_data.csv is for the public leaderboard, half is for the private leaderboard.",
      "votes": null
    },
    {
      "id": "1876208",
      "postDate": "07/29/2022 16:29:44",
      "content": "<p>Thank you for the quick reply.</p>\n<p>So, the current test_data.csv contains  the public and private data, for the private leaderboard will they get a specific set of rows to evaluate?</p>",
      "rawMarkdown": "Thank you for the quick reply.\n\nSo, the current test_data.csv contains  the public and private data, for the private leaderboard will they get a specific set of rows to evaluate?",
      "votes": null
    },
    {
      "id": "1876217",
      "postDate": "07/29/2022 16:37:06",
      "content": "<p>It <a href=\"https://www.kaggle.com/competitions/amex-default-prediction/discussion/327602\" target=\"_blank\">has been discussed</a> that customers with their last statement in April 2019 belong to the public leaderboard and customers with their last statement in October 2019 belong to the private leaderboard.</p>",
      "rawMarkdown": "It [has been discussed](https://www.kaggle.com/competitions/amex-default-prediction/discussion/327602) that customers with their last statement in April 2019 belong to the public leaderboard and customers with their last statement in October 2019 belong to the private leaderboard.",
      "votes": null
    },
    {
      "id": "1876748",
      "postDate": "07/30/2022 04:15:01",
      "content": "<p>Where it was written as I also read the entire document before participating. It was no where mentioned that separate data for private leader board and public leader board separate</p>",
      "rawMarkdown": "Where it was written as I also read the entire document before participating. It was no where mentioned that separate data for private leader board and public leader board separate",
      "votes": null
    },
    {
      "id": "1877109",
      "postDate": "07/30/2022 11:20:29",
      "content": "<p>Thank you for your reply!👍 <br>\nThat means that only the submission file we submitted is needed?</p>",
      "rawMarkdown": "Thank you for your reply!👍 \nThat means that only the submission file we submitted is needed?",
      "votes": null
    },
    {
      "id": "1877182",
      "postDate": "07/30/2022 11:59:46",
      "content": "<p>I presume the leaderboard is populated with the customers from the statement month of April 2019. Further statements are a part of the private leaderboard. One may submit just 1 submission file for both leaderboards. </p>",
      "rawMarkdown": "I presume the leaderboard is populated with the customers from the statement month of April 2019. Further statements are a part of the private leaderboard. One may submit just 1 submission file for both leaderboards.",
      "votes": null
    },
    {
      "id": "1877204",
      "postDate": "07/30/2022 12:18:07",
      "content": "<p><a href=\"https://www.kaggle.com/chal1ce\" target=\"_blank\">@chal1ce</a> Yes, one submission file is enough.</p>",
      "rawMarkdown": "chal1ce Yes, one submission file is enough.",
      "votes": null
    },
    {
      "id": "1877225",
      "postDate": "07/30/2022 12:35:41",
      "content": "<p>Thanks. 😄</p>",
      "rawMarkdown": "Thanks. 😄",
      "votes": null
    },
    {
      "id": "1877830",
      "postDate": "07/31/2022 03:16:03",
      "content": "<p>On this type of competition the private leaderboard is already contained in the test that we got. So we won't need to re-run our solutions.</p>\n<p>The Devastator.</p>",
      "rawMarkdown": "On this type of competition the private leaderboard is already contained in the test that we got. So we won't need to re-run our solutions.\n\nThe Devastator.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1876195,
      "author_name": "ambrosm",
      "author_url": "",
      "post_date": "07/29/2022 16:23:59",
      "content": "<p>There won't be any new data for the private leaderboard. The private leaderboard is contained in the test_data.csv you've already got, and, consequently, in the submission.csv you've already submitted. Half of test_data.csv is for the public leaderboard, half is for the private leaderboard.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1876208,
          "author_name": "nandodmelo",
          "author_url": "",
          "post_date": "07/29/2022 16:29:44",
          "content": "<p>Thank you for the quick reply.</p>\n<p>So, the current test_data.csv contains  the public and private data, for the private leaderboard will they get a specific set of rows to evaluate?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1876217,
          "author_name": "ambrosm",
          "author_url": "",
          "post_date": "07/29/2022 16:37:06",
          "content": "<p>It <a href=\"https://www.kaggle.com/competitions/amex-default-prediction/discussion/327602\" target=\"_blank\">has been discussed</a> that customers with their last statement in April 2019 belong to the public leaderboard and customers with their last statement in October 2019 belong to the private leaderboard.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1877109,
          "author_name": "",
          "author_url": "",
          "post_date": "07/30/2022 11:20:29",
          "content": "<p>Thank you for your reply!👍 <br>\nThat means that only the submission file we submitted is needed?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1877204,
          "author_name": "ambrosm",
          "author_url": "",
          "post_date": "07/30/2022 12:18:07",
          "content": "<p><a href=\"https://www.kaggle.com/chal1ce\" target=\"_blank\">@chal1ce</a> Yes, one submission file is enough.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1877225,
          "author_name": "",
          "author_url": "",
          "post_date": "07/30/2022 12:35:41",
          "content": "<p>Thanks. 😄</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1876748,
      "author_name": "urbanmonk09",
      "author_url": "",
      "post_date": "07/30/2022 04:15:01",
      "content": "<p>Where it was written as I also read the entire document before participating. It was no where mentioned that separate data for private leader board and public leader board separate</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1877182,
      "author_name": "ravi20076",
      "author_url": "",
      "post_date": "07/30/2022 11:59:46",
      "content": "<p>I presume the leaderboard is populated with the customers from the statement month of April 2019. Further statements are a part of the private leaderboard. One may submit just 1 submission file for both leaderboards. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1877830,
      "author_name": "thedevastator",
      "author_url": "",
      "post_date": "07/31/2022 03:16:03",
      "content": "<p>On this type of competition the private leaderboard is already contained in the test that we got. So we won't need to re-run our solutions.</p>\n<p>The Devastator.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1876183": "I am seeing a lot of notebooks who ensemble multiple submissions files to improve the Public leaderboard.\n\nBut, for the Private leaderboard, all these notebook will need to load the model parameters/weights to make the inference on the new data, right? So, if you dont have the model, you will have to train all of them to make this inference.",
    "1876195": "There won't be any new data for the private leaderboard. The private leaderboard is contained in the test_data.csv you've already got, and, consequently, in the submission.csv you've already submitted. Half of test_data.csv is for the public leaderboard, half is for the private leaderboard.",
    "1876208": "Thank you for the quick reply.\n\nSo, the current test_data.csv contains  the public and private data, for the private leaderboard will they get a specific set of rows to evaluate?",
    "1876217": "It [has been discussed](https://www.kaggle.com/competitions/amex-default-prediction/discussion/327602) that customers with their last statement in April 2019 belong to the public leaderboard and customers with their last statement in October 2019 belong to the private leaderboard.",
    "1876748": "Where it was written as I also read the entire document before participating. It was no where mentioned that separate data for private leader board and public leader board separate",
    "1877109": "Thank you for your reply!👍 \nThat means that only the submission file we submitted is needed?",
    "1877182": "I presume the leaderboard is populated with the customers from the statement month of April 2019. Further statements are a part of the private leaderboard. One may submit just 1 submission file for both leaderboards.",
    "1877204": "chal1ce Yes, one submission file is enough.",
    "1877225": "Thanks. 😄",
    "1877830": "On this type of competition the private leaderboard is already contained in the test that we got. So we won't need to re-run our solutions.\n\nThe Devastator."
  },
  "source": "meta"
}