{
  "id": 254832,
  "title": "Submission ID's in alphabetical order?",
  "url": "/competitions/siim-covid19-detection/discussion/254832",
  "author_name": "",
  "post_date": "2021-07-23T21:13:48.596194600Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi Everyone,</p>\n<p>I tried to submit my kernel and I got \"Submission Scoring Error\". I checked the formatting a couple of times and didn't find any major errors. The only thing I can think of is that they might require the Id column to be in alphabetical order. Now if this is true, is the format:</p>\n<p>1) Alphabetical order of studies<br>\nthen<br>\nalphabetical order of images</p>\n<p>OR</p>\n<p>2) Alphabetical order of the ID's (regardless of whether it's the ID of a study or image)</p>\n<p>OR </p>\n<p>3) Some other format?</p>\n<p>Just to give an example, if they test data consists of : 1a_study, 1b_image, 1c_study, 2d_image, what should the order be in the submission file?</p>\n<p>Any help would be greatly appreciated.</p>",
  "messages": [
    {
      "id": "1398210",
      "postDate": "07/23/2021 21:13:48",
      "content": "<p>Hi Everyone,</p>\n<p>I tried to submit my kernel and I got \"Submission Scoring Error\". I checked the formatting a couple of times and didn't find any major errors. The only thing I can think of is that they might require the Id column to be in alphabetical order. Now if this is true, is the format:</p>\n<p>1) Alphabetical order of studies<br>\nthen<br>\nalphabetical order of images</p>\n<p>OR</p>\n<p>2) Alphabetical order of the ID's (regardless of whether it's the ID of a study or image)</p>\n<p>OR </p>\n<p>3) Some other format?</p>\n<p>Just to give an example, if they test data consists of : 1a_study, 1b_image, 1c_study, 2d_image, what should the order be in the submission file?</p>\n<p>Any help would be greatly appreciated.</p>",
      "rawMarkdown": "Hi Everyone,\n\nI tried to submit my kernel and I got \"Submission Scoring Error\". I checked the formatting a couple of times and didn't find any major errors. The only thing I can think of is that they might require the Id column to be in alphabetical order. Now if this is true, is the format:\n\n1) Alphabetical order of studies\nthen\nalphabetical order of images\n\nOR\n\n2) Alphabetical order of the ID's (regardless of whether it's the ID of a study or image)\n\nOR \n\n3) Some other format?\n\nJust to give an example, if they test data consists of : 1a_study, 1b_image, 1c_study, 2d_image, what should the order be in the submission file?\n\nAny help would be greatly appreciated.",
      "votes": null
    },
    {
      "id": "1398932",
      "postDate": "07/24/2021 16:53:30",
      "content": "<p>I think ID order shoud be as in sample submission</p>",
      "rawMarkdown": "I think ID order shoud be as in sample submission",
      "votes": null
    },
    {
      "id": "1398980",
      "postDate": "07/24/2021 18:09:14",
      "content": "<p>Thanks for the answer. I was actually able to successfully submit after fixing the format. Although my output file was not in the same order as the sample submission. </p>\n<p>I noticed that in the sample submission, the studies are in alphabetical order and I couldn't figure out the orders for the images. Now come to think of it, if the score is calculated by ranking the confidence scores, it seems as though the order of the studies in the csv file shouldn't matter should it?</p>",
      "rawMarkdown": "Thanks for the answer. I was actually able to successfully submit after fixing the format. Although my output file was not in the same order as the sample submission. \n\nI noticed that in the sample submission, the studies are in alphabetical order and I couldn't figure out the orders for the images. Now come to think of it, if the score is calculated by ranking the confidence scores, it seems as though the order of the studies in the csv file shouldn't matter should it?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1398932,
      "author_name": "joven1997",
      "author_url": "",
      "post_date": "07/24/2021 16:53:30",
      "content": "<p>I think ID order shoud be as in sample submission</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1398980,
      "author_name": "diningeachox",
      "author_url": "",
      "post_date": "07/24/2021 18:09:14",
      "content": "<p>Thanks for the answer. I was actually able to successfully submit after fixing the format. Although my output file was not in the same order as the sample submission. </p>\n<p>I noticed that in the sample submission, the studies are in alphabetical order and I couldn't figure out the orders for the images. Now come to think of it, if the score is calculated by ranking the confidence scores, it seems as though the order of the studies in the csv file shouldn't matter should it?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1398210": "Hi Everyone,\n\nI tried to submit my kernel and I got \"Submission Scoring Error\". I checked the formatting a couple of times and didn't find any major errors. The only thing I can think of is that they might require the Id column to be in alphabetical order. Now if this is true, is the format:\n\n1) Alphabetical order of studies\nthen\nalphabetical order of images\n\nOR\n\n2) Alphabetical order of the ID's (regardless of whether it's the ID of a study or image)\n\nOR \n\n3) Some other format?\n\nJust to give an example, if they test data consists of : 1a_study, 1b_image, 1c_study, 2d_image, what should the order be in the submission file?\n\nAny help would be greatly appreciated.",
    "1398932": "I think ID order shoud be as in sample submission",
    "1398980": "Thanks for the answer. I was actually able to successfully submit after fixing the format. Although my output file was not in the same order as the sample submission. \n\nI noticed that in the sample submission, the studies are in alphabetical order and I couldn't figure out the orders for the images. Now come to think of it, if the score is calculated by ranking the confidence scores, it seems as though the order of the studies in the csv file shouldn't matter should it?"
  },
  "source": "meta"
}