{
  "id": 168276,
  "title": "Submission Scoring Error",
  "url": "/competitions/osic-pulmonary-fibrosis-progression/discussion/168276",
  "author_name": "",
  "post_date": "2020-07-20T00:54:02.719614500Z",
  "votes": 5,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Submission Scoring Error occurs when you send the CSV file generated by the following code.\nThe numbers generated by this code should all be the same as submission.csv.\nI don't know what's wrong.</p>\n\n<p>```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])</p>\n\n<p>WEEK = -12\nD = 0</p>\n\n<p>test_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())</p>\n\n<p>for j in range(146):</p>\n\n<pre><code>for i in range(5):\n    submission.loc[j*5 + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n    submission.loc[j*5 + D,\"FVC\"] = 2000\n    submission.loc[j*5 + D,\"Confidence\"] = 100\n    D = D + 1\n\nD = 0\nWEEK = WEEK + 1\n</code></pre>\n\n<p>submission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)</p>\n\n<p>```</p>",
  "messages": [
    {
      "id": "936084",
      "postDate": "07/20/2020 00:54:02",
      "content": "<p>Submission Scoring Error occurs when you send the CSV file generated by the following code.\nThe numbers generated by this code should all be the same as submission.csv.\nI don't know what's wrong.</p>\n\n<p>```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])</p>\n\n<p>WEEK = -12\nD = 0</p>\n\n<p>test_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())</p>\n\n<p>for j in range(146):</p>\n\n<pre><code>for i in range(5):\n    submission.loc[j*5 + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n    submission.loc[j*5 + D,\"FVC\"] = 2000\n    submission.loc[j*5 + D,\"Confidence\"] = 100\n    D = D + 1\n\nD = 0\nWEEK = WEEK + 1\n</code></pre>\n\n<p>submission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)</p>\n\n<p>```</p>",
      "rawMarkdown": "Submission Scoring Error occurs when you send the CSV file generated by the following code.\nThe numbers generated by this code should all be the same as submission.csv.\nI don't know what's wrong.\n\n```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])\n\nWEEK = -12\nD = 0\n\ntest_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())\n\nfor j in range(146):\n    \n    for i in range(5):\n        submission.loc[j*5 + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n        submission.loc[j*5 + D,\"FVC\"] = 2000\n        submission.loc[j*5 + D,\"Confidence\"] = 100\n        D = D + 1\n        \n    D = 0\n    WEEK = WEEK + 1\n    \nsubmission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)\n\n```",
      "votes": null
    },
    {
      "id": "936155",
      "postDate": "07/20/2020 02:55:33",
      "content": "<p>I think you are only creating records for 5 patients.  The real test file has many more patients. Make your loop go through all patients in test.csv</p>\n\n<p>Rich</p>",
      "rawMarkdown": "I think you are only creating records for 5 patients.  The real test file has many more patients. Make your loop go through all patients in test.csv\n\nRich",
      "votes": null
    },
    {
      "id": "936218",
      "postDate": "07/20/2020 04:44:39",
      "content": "<p>Thank you for your advice. After the code was corrected as follows, it was successfully submitted.</p>\n\n<p>```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])</p>\n\n<p>WEEK = -12\nD = 0</p>\n\n<p>test_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())\nNUM = len(Patient_list_test)</p>\n\n<p>for j in range(146):</p>\n\n<pre><code>for i in range(NUM):\n    submission.loc[j*NUM + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n    submission.loc[j*NUM + D,\"FVC\"] = 2000\n    submission.loc[j*NUM + D,\"Confidence\"] = 100\n    D = D + 1\n\nD = 0\nWEEK = WEEK + 1\n</code></pre>\n\n<p>submission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)\n```</p>",
      "rawMarkdown": "Thank you for your advice. After the code was corrected as follows, it was successfully submitted.\n\n```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])\n\nWEEK = -12\nD = 0\n\ntest_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())\nNUM = len(Patient_list_test)\n\nfor j in range(146):\n    \n    for i in range(NUM):\n        submission.loc[j*NUM + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n        submission.loc[j*NUM + D,\"FVC\"] = 2000\n        submission.loc[j*NUM + D,\"Confidence\"] = 100\n        D = D + 1\n        \n    D = 0\n    WEEK = WEEK + 1\n    \nsubmission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)\n```",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 936155,
      "author_name": "richardepstein",
      "author_url": "",
      "post_date": "07/20/2020 02:55:33",
      "content": "<p>I think you are only creating records for 5 patients.  The real test file has many more patients. Make your loop go through all patients in test.csv</p>\n\n<p>Rich</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 936218,
      "author_name": "koheist",
      "author_url": "",
      "post_date": "07/20/2020 04:44:39",
      "content": "<p>Thank you for your advice. After the code was corrected as follows, it was successfully submitted.</p>\n\n<p>```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])</p>\n\n<p>WEEK = -12\nD = 0</p>\n\n<p>test_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())\nNUM = len(Patient_list_test)</p>\n\n<p>for j in range(146):</p>\n\n<pre><code>for i in range(NUM):\n    submission.loc[j*NUM + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n    submission.loc[j*NUM + D,\"FVC\"] = 2000\n    submission.loc[j*NUM + D,\"Confidence\"] = 100\n    D = D + 1\n\nD = 0\nWEEK = WEEK + 1\n</code></pre>\n\n<p>submission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)\n```</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "936084": "Submission Scoring Error occurs when you send the CSV file generated by the following code.\nThe numbers generated by this code should all be the same as submission.csv.\nI don't know what's wrong.\n\n```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])\n\nWEEK = -12\nD = 0\n\ntest_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())\n\nfor j in range(146):\n    \n    for i in range(5):\n        submission.loc[j*5 + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n        submission.loc[j*5 + D,\"FVC\"] = 2000\n        submission.loc[j*5 + D,\"Confidence\"] = 100\n        D = D + 1\n        \n    D = 0\n    WEEK = WEEK + 1\n    \nsubmission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)\n\n```",
    "936155": "I think you are only creating records for 5 patients.  The real test file has many more patients. Make your loop go through all patients in test.csv\n\nRich",
    "936218": "Thank you for your advice. After the code was corrected as follows, it was successfully submitted.\n\n```\nsubmission = pd.DataFrame(columns = [\"Patient_Week\", \"FVC\", \"Confidence\"])\n\nWEEK = -12\nD = 0\n\ntest_df = pd.read_csv(\"../input/osic-pulmonary-fibrosis-progression/test.csv\")\nPatient_list_test = list(test_df.Patient.unique())\nNUM = len(Patient_list_test)\n\nfor j in range(146):\n    \n    for i in range(NUM):\n        submission.loc[j*NUM + D,\"Patient_Week\"] = Patient_list_test[D] +\"_\" + str(WEEK)\n        submission.loc[j*NUM + D,\"FVC\"] = 2000\n        submission.loc[j*NUM + D,\"Confidence\"] = 100\n        D = D + 1\n        \n    D = 0\n    WEEK = WEEK + 1\n    \nsubmission[\"FVC\"] = submission[\"FVC\"].astype(\"int\")\nsubmission[\"Confidence\"] = submission[\"Confidence\"].astype(\"int\")\nsubmission.to_csv('submission.csv', index=False)\n```"
  },
  "source": "meta"
}