{
  "id": 56944,
  "title": "Please provide evaluation code!",
  "url": "/competitions/cvpr-2018-autonomous-driving/discussion/56944",
  "author_name": "",
  "post_date": "2018-05-17T03:30:53.360032600Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Dear competition organisors,</p>\n\n<p>Could you please provide the evaluation code for this competition. \n  Say: with ground truth images and submitted RLE.csv files we will have our score.\n  It has been a very frustrating experience that my offline code generating nice masks whereas my submitted files always rendering errors. And I am not the ONLY one!\n  Hence, I would propose to provide the evaluation code from the organisor side so that we can diagnosis what's the causes with various submission errors.</p>\n\n<p>Many thanks in advance!</p>",
  "messages": [
    {
      "id": "329721",
      "postDate": "05/17/2018 03:30:53",
      "content": "<p>Dear competition organisors,</p>\n\n<p>Could you please provide the evaluation code for this competition. \n  Say: with ground truth images and submitted RLE.csv files we will have our score.\n  It has been a very frustrating experience that my offline code generating nice masks whereas my submitted files always rendering errors. And I am not the ONLY one!\n  Hence, I would propose to provide the evaluation code from the organisor side so that we can diagnosis what's the causes with various submission errors.</p>\n\n<p>Many thanks in advance!</p>",
      "rawMarkdown": "Dear competition organisors,\n\n  Could you please provide the evaluation code for this competition. \n  Say: with ground truth images and submitted RLE.csv files we will have our score.\n  It has been a very frustrating experience that my offline code generating nice masks whereas my submitted files always rendering errors. And I am not the ONLY one!\n  Hence, I would propose to provide the evaluation code from the organisor side so that we can diagnosis what's the causes with various submission errors.\n\n   Many thanks in advance!",
      "votes": null
    },
    {
      "id": "330086",
      "postDate": "05/18/2018 02:35:21",
      "content": "<p>I agree that something should be done. The current submission evaluation system seems very opaque and not helpful at all. The sample submission doesn't help either. </p>",
      "rawMarkdown": "I agree that something should be done. The current submission evaluation system seems very opaque and not helpful at all. The sample submission doesn't help either.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 330086,
      "author_name": "michaelheinzer",
      "author_url": "",
      "post_date": "05/18/2018 02:35:21",
      "content": "<p>I agree that something should be done. The current submission evaluation system seems very opaque and not helpful at all. The sample submission doesn't help either. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "329721": "Dear competition organisors,\n\n  Could you please provide the evaluation code for this competition. \n  Say: with ground truth images and submitted RLE.csv files we will have our score.\n  It has been a very frustrating experience that my offline code generating nice masks whereas my submitted files always rendering errors. And I am not the ONLY one!\n  Hence, I would propose to provide the evaluation code from the organisor side so that we can diagnosis what's the causes with various submission errors.\n\n   Many thanks in advance!",
    "330086": "I agree that something should be done. The current submission evaluation system seems very opaque and not helpful at all. The sample submission doesn't help either."
  },
  "source": "meta"
}