{
  "id": 29357,
  "title": "Performance improvement in evaluation metric",
  "url": "/competitions/dstl-satellite-imagery-feature-detection/discussion/29357",
  "author_name": "",
  "post_date": "2017-02-28T00:00:00.354981900Z",
  "votes": 8,
  "comment_count": 10,
  "views": 0,
  "content": "<p>Hi all,</p>\n\n<p>Just wanted to update you that we've rolled out an evaluation metric that is about 75% faster. Hopefully this will make your experience better with shorter wait time for evaluation. </p>\n\n<p>Note: we're still using NetTopologySuite, so the geometry errors are still going to be there. We just parallelized a lot of code and should significantly shorten the evaluation time.</p>\n\n<p>Kaggle admin</p>",
  "messages": [
    {
      "id": "164171",
      "postDate": "02/28/2017 00:00:00",
      "content": "<p>Hi all,</p>\n\n<p>Just wanted to update you that we've rolled out an evaluation metric that is about 75% faster. Hopefully this will make your experience better with shorter wait time for evaluation. </p>\n\n<p>Note: we're still using NetTopologySuite, so the geometry errors are still going to be there. We just parallelized a lot of code and should significantly shorten the evaluation time.</p>\n\n<p>Kaggle admin</p>",
      "rawMarkdown": "Hi all,\n\nJust wanted to update you that we've rolled out an evaluation metric that is about 75% faster. Hopefully this will make your experience better with shorter wait time for evaluation. \n\nNote: we're still using NetTopologySuite, so the geometry errors are still going to be there. We just parallelized a lot of code and should significantly shorten the evaluation time.\n\nKaggle admin",
      "votes": null
    },
    {
      "id": "164225",
      "postDate": "02/28/2017 06:29:53",
      "content": "<p>That's very good news! Thanks Wendy.</p>",
      "rawMarkdown": "That's very good news! Thanks Wendy.",
      "votes": null
    },
    {
      "id": "165496",
      "postDate": "03/05/2017 22:26:36",
      "content": "<p>Have you ever provided an explanation for the geometry errors? They're very annoying.</p>",
      "rawMarkdown": "Have you ever provided an explanation for the geometry errors? They're very annoying.",
      "votes": null
    },
    {
      "id": "165712",
      "postDate": "03/06/2017 19:45:01",
      "content": "<p>Hi Wendy. \nI made a submission 2 hours ago and it is still showing that it is processing the results. Is there some issue with my submission. Usually it doesn't take more than 3-4 minutes for getting results from submission. Can you look into it? <br>\nIf there is some error,  can you please send the error message? </p>",
      "rawMarkdown": "Hi Wendy. \nI made a submission 2 hours ago and it is still showing that it is processing the results. Is there some issue with my submission. Usually it doesn't take more than 3-4 minutes for getting results from submission. Can you look into it?  \nIf there is some error,  can you please send the error message?",
      "votes": null
    },
    {
      "id": "165827",
      "postDate": "03/07/2017 09:10:44",
      "content": "<p>Wendy, I cannot submit. The message is: You have no more submissions remaining for today. But I only submitted for once today!</p>",
      "rawMarkdown": "Wendy, I cannot submit. The message is: You have no more submissions remaining for today. But I only submitted for once today!",
      "votes": null
    },
    {
      "id": "165844",
      "postDate": "03/07/2017 10:06:32",
      "content": "<p>Hi Wendy,</p>\n\n<p>on the last day of submission, trying to provide our best one, we are hitting the same Topology Exception that we've been facing during the competition. \nThis is really frustrating as it seems to be after the intersection with ground-truth, so not a validity problem from the submission.\nThe other problem is that I received \"Your submission was unsuccessful.\" message. So I retried later and it got through ... twice !\n\"Fortunately\", the second is on topology error but the first one is in the outer space and \"You have 2 submissions remaining today\"\nSo frustrating !! </p>",
      "rawMarkdown": "Hi Wendy,\n\non the last day of submission, trying to provide our best one, we are hitting the same Topology Exception that we've been facing during the competition. \nThis is really frustrating as it seems to be after the intersection with ground-truth, so not a validity problem from the submission.\nThe other problem is that I received \"Your submission was unsuccessful.\" message. So I retried later and it got through ... twice !\n\"Fortunately\", the second is on topology error but the first one is in the outer space and \"You have 2 submissions remaining today\"\nSo frustrating !!",
      "votes": null
    },
    {
      "id": "167753",
      "postDate": "03/15/2017 10:03:25",
      "content": "<p>Is there a shared code about this latest implementation of the evaluation metric?</p>",
      "rawMarkdown": "Is there a shared code about this latest implementation of the evaluation metric?",
      "votes": null
    },
    {
      "id": "168462",
      "postDate": "03/17/2017 05:19:40",
      "content": "<p>Hi Elena, you can find the updated metric code <a href=\"https://gist.github.com/wendykan/2fcbbf95945faa0f2c89895694069010\">here</a>. </p>",
      "rawMarkdown": "Hi Elena, you can find the updated metric code [here][1]. \n\n\n  [1]: https://gist.github.com/wendykan/2fcbbf95945faa0f2c89895694069010",
      "votes": null
    },
    {
      "id": "460039",
      "postDate": "01/22/2019 21:48:19",
      "content": "<p>Hi Wendy,</p>\n\n<p>I have worked on this Kaggle competition and am going to draft a paper in a week. The problem is that I cannot get the score by submitting the results into the leaderboard section. It seems that the evaluation code has been removed because the error is: \"Could not find evaluation metric 'JaccardDSTLParallel'\"\nCould you please resolve this issue or provide the evaluation code?</p>\n\n<p>Thanks a lot.</p>",
      "rawMarkdown": "Hi Wendy,\n\nI have worked on this Kaggle competition and am going to draft a paper in a week. The problem is that I cannot get the score by submitting the results into the leaderboard section. It seems that the evaluation code has been removed because the error is: \"Could not find evaluation metric 'JaccardDSTLParallel'\"\nCould you please resolve this issue or provide the evaluation code?\n\nThanks a lot.",
      "votes": null
    },
    {
      "id": "460053",
      "postDate": "01/22/2019 22:19:46",
      "content": "<p>Hi,</p>\n\n<p>Since the submission section of the website does not work anymore, I am going to get the accuracy using evaluation metric code.\nCould you please explain how I can run that to give the accuracy of the result?</p>\n\n<p>Thanks.</p>",
      "rawMarkdown": "Hi,\n\nSince the submission section of the website does not work anymore, I am going to get the accuracy using evaluation metric code.\nCould you please explain how I can run that to give the accuracy of the result?\n\nThanks.",
      "votes": null
    },
    {
      "id": "834676",
      "postDate": "05/05/2020 17:30:27",
      "content": "<p>I am still receiving the same error. Could you please help if you were able to resolve this issue?</p>",
      "rawMarkdown": "I am still receiving the same error. Could you please help if you were able to resolve this issue?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 164225,
      "author_name": "ironbar",
      "author_url": "",
      "post_date": "02/28/2017 06:29:53",
      "content": "<p>That's very good news! Thanks Wendy.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 165496,
      "author_name": "chatcat",
      "author_url": "",
      "post_date": "03/05/2017 22:26:36",
      "content": "<p>Have you ever provided an explanation for the geometry errors? They're very annoying.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 165712,
      "author_name": "attila007",
      "author_url": "",
      "post_date": "03/06/2017 19:45:01",
      "content": "<p>Hi Wendy. \nI made a submission 2 hours ago and it is still showing that it is processing the results. Is there some issue with my submission. Usually it doesn't take more than 3-4 minutes for getting results from submission. Can you look into it? <br>\nIf there is some error,  can you please send the error message? </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 165827,
      "author_name": "linlimeng",
      "author_url": "",
      "post_date": "03/07/2017 09:10:44",
      "content": "<p>Wendy, I cannot submit. The message is: You have no more submissions remaining for today. But I only submitted for once today!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 165844,
      "author_name": "cogitae",
      "author_url": "",
      "post_date": "03/07/2017 10:06:32",
      "content": "<p>Hi Wendy,</p>\n\n<p>on the last day of submission, trying to provide our best one, we are hitting the same Topology Exception that we've been facing during the competition. \nThis is really frustrating as it seems to be after the intersection with ground-truth, so not a validity problem from the submission.\nThe other problem is that I received \"Your submission was unsuccessful.\" message. So I retried later and it got through ... twice !\n\"Fortunately\", the second is on topology error but the first one is in the outer space and \"You have 2 submissions remaining today\"\nSo frustrating !! </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 167753,
      "author_name": "elenaran",
      "author_url": "",
      "post_date": "03/15/2017 10:03:25",
      "content": "<p>Is there a shared code about this latest implementation of the evaluation metric?</p>",
      "votes": null,
      "replies": [
        {
          "id": 168462,
          "author_name": "wendykan",
          "author_url": "",
          "post_date": "03/17/2017 05:19:40",
          "content": "<p>Hi Elena, you can find the updated metric code <a href=\"https://gist.github.com/wendykan/2fcbbf95945faa0f2c89895694069010\">here</a>. </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 460053,
          "author_name": "rkaviani",
          "author_url": "",
          "post_date": "01/22/2019 22:19:46",
          "content": "<p>Hi,</p>\n\n<p>Since the submission section of the website does not work anymore, I am going to get the accuracy using evaluation metric code.\nCould you please explain how I can run that to give the accuracy of the result?</p>\n\n<p>Thanks.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 460039,
      "author_name": "rkaviani",
      "author_url": "",
      "post_date": "01/22/2019 21:48:19",
      "content": "<p>Hi Wendy,</p>\n\n<p>I have worked on this Kaggle competition and am going to draft a paper in a week. The problem is that I cannot get the score by submitting the results into the leaderboard section. It seems that the evaluation code has been removed because the error is: \"Could not find evaluation metric 'JaccardDSTLParallel'\"\nCould you please resolve this issue or provide the evaluation code?</p>\n\n<p>Thanks a lot.</p>",
      "votes": null,
      "replies": [
        {
          "id": 834676,
          "author_name": "anandmohanyadav",
          "author_url": "",
          "post_date": "05/05/2020 17:30:27",
          "content": "<p>I am still receiving the same error. Could you please help if you were able to resolve this issue?</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "164171": "Hi all,\n\nJust wanted to update you that we've rolled out an evaluation metric that is about 75% faster. Hopefully this will make your experience better with shorter wait time for evaluation. \n\nNote: we're still using NetTopologySuite, so the geometry errors are still going to be there. We just parallelized a lot of code and should significantly shorten the evaluation time.\n\nKaggle admin",
    "164225": "That's very good news! Thanks Wendy.",
    "165496": "Have you ever provided an explanation for the geometry errors? They're very annoying.",
    "165712": "Hi Wendy. \nI made a submission 2 hours ago and it is still showing that it is processing the results. Is there some issue with my submission. Usually it doesn't take more than 3-4 minutes for getting results from submission. Can you look into it?  \nIf there is some error,  can you please send the error message?",
    "165827": "Wendy, I cannot submit. The message is: You have no more submissions remaining for today. But I only submitted for once today!",
    "165844": "Hi Wendy,\n\non the last day of submission, trying to provide our best one, we are hitting the same Topology Exception that we've been facing during the competition. \nThis is really frustrating as it seems to be after the intersection with ground-truth, so not a validity problem from the submission.\nThe other problem is that I received \"Your submission was unsuccessful.\" message. So I retried later and it got through ... twice !\n\"Fortunately\", the second is on topology error but the first one is in the outer space and \"You have 2 submissions remaining today\"\nSo frustrating !!",
    "167753": "Is there a shared code about this latest implementation of the evaluation metric?",
    "168462": "Hi Elena, you can find the updated metric code [here][1]. \n\n\n  [1]: https://gist.github.com/wendykan/2fcbbf95945faa0f2c89895694069010",
    "460039": "Hi Wendy,\n\nI have worked on this Kaggle competition and am going to draft a paper in a week. The problem is that I cannot get the score by submitting the results into the leaderboard section. It seems that the evaluation code has been removed because the error is: \"Could not find evaluation metric 'JaccardDSTLParallel'\"\nCould you please resolve this issue or provide the evaluation code?\n\nThanks a lot.",
    "460053": "Hi,\n\nSince the submission section of the website does not work anymore, I am going to get the accuracy using evaluation metric code.\nCould you please explain how I can run that to give the accuracy of the result?\n\nThanks.",
    "834676": "I am still receiving the same error. Could you please help if you were able to resolve this issue?"
  },
  "source": "meta"
}