{
  "id": 417375,
  "title": "A question regarding the evaluation metric",
  "url": "/competitions/asl-fingerspelling/discussion/417375",
  "author_name": "",
  "post_date": "2023-06-15T12:52:05.985106300Z",
  "votes": 1,
  "comment_count": 7,
  "views": 0,
  "content": "<p>If D (the Levenshtein distance) is larger than N (the total number of characters in the labels), does the normalized total Levenshtein distance truncated at zero or become negative? This can happen when the predicted phrase is much longer than the label.</p>",
  "messages": [
    {
      "id": "2303739",
      "postDate": "06/15/2023 12:52:05",
      "content": "<p>If D (the Levenshtein distance) is larger than N (the total number of characters in the labels), does the normalized total Levenshtein distance truncated at zero or become negative? This can happen when the predicted phrase is much longer than the label.</p>",
      "rawMarkdown": "If D (the Levenshtein distance) is larger than N (the total number of characters in the labels), does the normalized total Levenshtein distance truncated at zero or become negative? This can happen when the predicted phrase is much longer than the label.",
      "votes": null
    },
    {
      "id": "2303740",
      "postDate": "06/15/2023 12:55:53",
      "content": "<p>On the leaderboard, the minimum (displayed) value is 0.</p>",
      "rawMarkdown": "On the leaderboard, the minimum (displayed) value is 0.",
      "votes": null
    },
    {
      "id": "2303767",
      "postDate": "06/15/2023 13:15:00",
      "content": "<p>I know, but it can be the case that only the total AVERAGE score is truncated at zero. I want to know if each score is truncated before the averaging.</p>",
      "rawMarkdown": "I know, but it can be the case that only the total AVERAGE score is truncated at zero. I want to know if each score is truncated before the averaging.",
      "votes": null
    },
    {
      "id": "2303990",
      "postDate": "06/15/2023 15:51:02",
      "content": "<p>It's clipped at zero.</p>",
      "rawMarkdown": "It's clipped at zero.",
      "votes": null
    },
    {
      "id": "2304056",
      "postDate": "06/15/2023 16:35:42",
      "content": "<p>Thank you!</p>",
      "rawMarkdown": "Thank you!",
      "votes": null
    },
    {
      "id": "2304089",
      "postDate": "06/15/2023 17:09:04",
      "content": "<p>In this case D and N are the global sums, so there's only one value to clip.</p>",
      "rawMarkdown": "In this case D and N are the global sums, so there's only one value to clip.",
      "votes": null
    },
    {
      "id": "2304160",
      "postDate": "06/15/2023 18:11:28",
      "content": "<p>It clipped for each string or for all after takes mean?</p>",
      "rawMarkdown": "It clipped for each string or for all after takes mean?",
      "votes": null
    },
    {
      "id": "2304177",
      "postDate": "06/15/2023 18:33:16",
      "content": "<p>D and N are the global sums, so there's only one value to clip.</p>",
      "rawMarkdown": "D and N are the global sums, so there's only one value to clip.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2303740,
      "author_name": "mdecoster",
      "author_url": "",
      "post_date": "06/15/2023 12:55:53",
      "content": "<p>On the leaderboard, the minimum (displayed) value is 0.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2303767,
          "author_name": "shlomoron",
          "author_url": "",
          "post_date": "06/15/2023 13:15:00",
          "content": "<p>I know, but it can be the case that only the total AVERAGE score is truncated at zero. I want to know if each score is truncated before the averaging.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2304089,
              "author_name": "sohier",
              "author_url": "",
              "post_date": "06/15/2023 17:09:04",
              "content": "<p>In this case D and N are the global sums, so there's only one value to clip.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2303990,
      "author_name": "sohier",
      "author_url": "",
      "post_date": "06/15/2023 15:51:02",
      "content": "<p>It's clipped at zero.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2304056,
          "author_name": "shlomoron",
          "author_url": "",
          "post_date": "06/15/2023 16:35:42",
          "content": "<p>Thank you!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2304160,
          "author_name": "kolyaforrat",
          "author_url": "",
          "post_date": "06/15/2023 18:11:28",
          "content": "<p>It clipped for each string or for all after takes mean?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2304177,
              "author_name": "sohier",
              "author_url": "",
              "post_date": "06/15/2023 18:33:16",
              "content": "<p>D and N are the global sums, so there's only one value to clip.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2303739": "If D (the Levenshtein distance) is larger than N (the total number of characters in the labels), does the normalized total Levenshtein distance truncated at zero or become negative? This can happen when the predicted phrase is much longer than the label.",
    "2303740": "On the leaderboard, the minimum (displayed) value is 0.",
    "2303767": "I know, but it can be the case that only the total AVERAGE score is truncated at zero. I want to know if each score is truncated before the averaging.",
    "2303990": "It's clipped at zero.",
    "2304056": "Thank you!",
    "2304089": "In this case D and N are the global sums, so there's only one value to clip.",
    "2304160": "It clipped for each string or for all after takes mean?",
    "2304177": "D and N are the global sums, so there's only one value to clip."
  },
  "source": "meta"
}