{
  "id": 178116,
  "title": "Submission scoring error",
  "url": "/competitions/osic-pulmonary-fibrosis-progression/discussion/178116",
  "author_name": "",
  "post_date": "2020-08-28T17:13:48.313105200Z",
  "votes": 2,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hi i  a using output result from my others commited notebooks :</p>\n<p><a href=\"https://www.kaggle.com/servietsky/merge-dicom-csv-and-ct-scans\" target=\"_blank\">https://www.kaggle.com/servietsky/merge-dicom-csv-and-ct-scans</a></p>\n<p><a href=\"https://www.kaggle.com/servietsky/ct-scans-to-dataframe\" target=\"_blank\">https://www.kaggle.com/servietsky/ct-scans-to-dataframe</a></p>\n<p>And i use it for submit my predictions, however i have Submission scoring error, although I have no errors in the local execution.</p>\n<p>As kaggle evaluates the private LB at commit time using new test data that we do not have access to, so the preprocess I did on my old notebooks does not apply to new test dataset for private LB.</p>\n<p>Could this be the cause of the submission error?</p>",
  "messages": [
    {
      "id": "989270",
      "postDate": "08/28/2020 17:13:48",
      "content": "<p>Hi i  a using output result from my others commited notebooks :</p>\n<p><a href=\"https://www.kaggle.com/servietsky/merge-dicom-csv-and-ct-scans\" target=\"_blank\">https://www.kaggle.com/servietsky/merge-dicom-csv-and-ct-scans</a></p>\n<p><a href=\"https://www.kaggle.com/servietsky/ct-scans-to-dataframe\" target=\"_blank\">https://www.kaggle.com/servietsky/ct-scans-to-dataframe</a></p>\n<p>And i use it for submit my predictions, however i have Submission scoring error, although I have no errors in the local execution.</p>\n<p>As kaggle evaluates the private LB at commit time using new test data that we do not have access to, so the preprocess I did on my old notebooks does not apply to new test dataset for private LB.</p>\n<p>Could this be the cause of the submission error?</p>",
      "rawMarkdown": "Hi i  a using output result from my others commited notebooks :\n\nhttps://www.kaggle.com/servietsky/merge-dicom-csv-and-ct-scans\n\nhttps://www.kaggle.com/servietsky/ct-scans-to-dataframe\n\nAnd i use it for submit my predictions, however i have Submission scoring error, although I have no errors in the local execution.\n\nAs kaggle evaluates the private LB at commit time using new test data that we do not have access to, so the preprocess I did on my old notebooks does not apply to new test dataset for private LB.\n\nCould this be the cause of the submission error?",
      "votes": null
    },
    {
      "id": "990975",
      "postDate": "08/30/2020 02:44:10",
      "content": "<p>I've found this</p>\n<blockquote>\n  <p>This is a synchronous rerun code competition. The provided test set is a small representative set of files (copied from the training set) to demonstrate the format of the private test set. When you submit your notebook, Kaggle will rerun your code on the test set, which contains unseen images.</p>\n</blockquote>",
      "rawMarkdown": "I've found this\n\n> This is a synchronous rerun code competition. The provided test set is a small representative set of files (copied from the training set) to demonstrate the format of the private test set. When you submit your notebook, Kaggle will rerun your code on the test set, which contains unseen images.",
      "votes": null
    },
    {
      "id": "991306",
      "postDate": "08/30/2020 09:57:52",
      "content": "<p>Hum… so we have to execute all preprocess and prediction in same notboook ?</p>",
      "rawMarkdown": "Hum... so we have to execute all preprocess and prediction in same notboook ?",
      "votes": null
    },
    {
      "id": "991460",
      "postDate": "08/30/2020 12:28:53",
      "content": "<p>I'm not sure but try putting all your work together. </p>",
      "rawMarkdown": "I'm not sure but try putting all your work together.",
      "votes": null
    },
    {
      "id": "991580",
      "postDate": "08/30/2020 13:59:12",
      "content": "<p>Check your submission file because it's must be '.*csv' and you shouldn't use encoded targets</p>",
      "rawMarkdown": "Check your submission file because it's must be '.*csv' and you shouldn't use encoded targets",
      "votes": null
    },
    {
      "id": "991612",
      "postDate": "08/30/2020 14:31:10",
      "content": "<p>Correct. You have no access to the real output of your notebook. You cannot blend separate notebooks. </p>",
      "rawMarkdown": "Correct. You have no access to the real output of your notebook. You cannot blend separate notebooks.",
      "votes": null
    },
    {
      "id": "992083",
      "postDate": "08/30/2020 22:36:04",
      "content": "<p>haha u think im doing that x), bad faith dont under estimate</p>",
      "rawMarkdown": "haha u think im doing that x), bad faith dont under estimate",
      "votes": null
    },
    {
      "id": "992085",
      "postDate": "08/30/2020 22:41:20",
      "content": "<p>i put only test preprocess in same notebook, in local it took 30 minutes runing for preprocess, predict and create submition but now it is taking more then 4 hours runing for evaluation. </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1904745%2F0d5ba53e3f5fecc7b5a5b5509669984c%2FSans%20titre.png?generation=1598827276767654&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "i put only test preprocess in same notebook, in local it took 30 minutes runing for preprocess, predict and create submition but now it is taking more then 4 hours runing for evaluation. \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1904745%2F0d5ba53e3f5fecc7b5a5b5509669984c%2FSans%20titre.png?generation=1598827276767654&alt=media)",
      "votes": null
    },
    {
      "id": "992086",
      "postDate": "08/30/2020 22:41:34",
      "content": "<p>i checked that, it is CSV file</p>",
      "rawMarkdown": "i checked that, it is CSV file",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 990975,
      "author_name": "hiramcho",
      "author_url": "",
      "post_date": "08/30/2020 02:44:10",
      "content": "<p>I've found this</p>\n<blockquote>\n  <p>This is a synchronous rerun code competition. The provided test set is a small representative set of files (copied from the training set) to demonstrate the format of the private test set. When you submit your notebook, Kaggle will rerun your code on the test set, which contains unseen images.</p>\n</blockquote>",
      "votes": null,
      "replies": [
        {
          "id": 991306,
          "author_name": "servietsky",
          "author_url": "",
          "post_date": "08/30/2020 09:57:52",
          "content": "<p>Hum… so we have to execute all preprocess and prediction in same notboook ?</p>",
          "votes": null,
          "replies": [
            {
              "id": 991612,
              "author_name": "richardepstein",
              "author_url": "",
              "post_date": "08/30/2020 14:31:10",
              "content": "<p>Correct. You have no access to the real output of your notebook. You cannot blend separate notebooks. </p>",
              "votes": null,
              "replies": []
            },
            {
              "id": 992083,
              "author_name": "servietsky",
              "author_url": "",
              "post_date": "08/30/2020 22:36:04",
              "content": "<p>haha u think im doing that x), bad faith dont under estimate</p>",
              "votes": null,
              "replies": []
            }
          ]
        },
        {
          "id": 991460,
          "author_name": "hiramcho",
          "author_url": "",
          "post_date": "08/30/2020 12:28:53",
          "content": "<p>I'm not sure but try putting all your work together. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 992085,
          "author_name": "servietsky",
          "author_url": "",
          "post_date": "08/30/2020 22:41:20",
          "content": "<p>i put only test preprocess in same notebook, in local it took 30 minutes runing for preprocess, predict and create submition but now it is taking more then 4 hours runing for evaluation. </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1904745%2F0d5ba53e3f5fecc7b5a5b5509669984c%2FSans%20titre.png?generation=1598827276767654&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 991580,
      "author_name": "miracl16",
      "author_url": "",
      "post_date": "08/30/2020 13:59:12",
      "content": "<p>Check your submission file because it's must be '.*csv' and you shouldn't use encoded targets</p>",
      "votes": null,
      "replies": [
        {
          "id": 992086,
          "author_name": "servietsky",
          "author_url": "",
          "post_date": "08/30/2020 22:41:34",
          "content": "<p>i checked that, it is CSV file</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "989270": "Hi i  a using output result from my others commited notebooks :\n\nhttps://www.kaggle.com/servietsky/merge-dicom-csv-and-ct-scans\n\nhttps://www.kaggle.com/servietsky/ct-scans-to-dataframe\n\nAnd i use it for submit my predictions, however i have Submission scoring error, although I have no errors in the local execution.\n\nAs kaggle evaluates the private LB at commit time using new test data that we do not have access to, so the preprocess I did on my old notebooks does not apply to new test dataset for private LB.\n\nCould this be the cause of the submission error?",
    "990975": "I've found this\n\n> This is a synchronous rerun code competition. The provided test set is a small representative set of files (copied from the training set) to demonstrate the format of the private test set. When you submit your notebook, Kaggle will rerun your code on the test set, which contains unseen images.",
    "991306": "Hum... so we have to execute all preprocess and prediction in same notboook ?",
    "991460": "I'm not sure but try putting all your work together.",
    "991580": "Check your submission file because it's must be '.*csv' and you shouldn't use encoded targets",
    "991612": "Correct. You have no access to the real output of your notebook. You cannot blend separate notebooks.",
    "992083": "haha u think im doing that x), bad faith dont under estimate",
    "992085": "i put only test preprocess in same notebook, in local it took 30 minutes runing for preprocess, predict and create submition but now it is taking more then 4 hours runing for evaluation. \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1904745%2F0d5ba53e3f5fecc7b5a5b5509669984c%2FSans%20titre.png?generation=1598827276767654&alt=media)",
    "992086": "i checked that, it is CSV file"
  },
  "source": "meta"
}