{
  "id": 607948,
  "title": "what is the evaluation metrics",
  "url": "/competitions/acm-icaif-25-ai-agentic-retrieval-grand-challenge/discussion/607948",
  "author_name": "",
  "post_date": "2025-09-17T05:44:11.715666600Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>What evaluation metrics do you use to measure the performance of the ranking algorithm?</p>",
  "messages": [
    {
      "id": "3290081",
      "postDate": "09/17/2025 05:44:11",
      "content": "<p>What evaluation metrics do you use to measure the performance of the ranking algorithm?</p>",
      "rawMarkdown": "What evaluation metrics do you use to measure the performance of the ranking algorithm?",
      "votes": null
    },
    {
      "id": "3291081",
      "postDate": "09/19/2025 01:01:28",
      "content": "<p>We use NDCG@5.</p>",
      "rawMarkdown": "We use NDCG@5.",
      "votes": null
    },
    {
      "id": "3300442",
      "postDate": "10/10/2025 12:55:07",
      "content": "<p>Hey <a href=\"https://www.kaggle.com/jihoonkwon\" target=\"_blank\">@jihoonkwon</a> <br>\nthe data overview says leaderboard is on map@5<br>\nbut the discussion here mentions ndcg@5</p>\n<p>any guide on what we should aim at?</p>",
      "rawMarkdown": "Hey @jihoonkwon \nthe data overview says leaderboard is on map@5\nbut the discussion here mentions ndcg@5\n\nany guide on what we should aim at?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3291081,
      "author_name": "jihoonkwon",
      "author_url": "",
      "post_date": "09/19/2025 01:01:28",
      "content": "<p>We use NDCG@5.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3300442,
      "author_name": "jtthachil",
      "author_url": "",
      "post_date": "10/10/2025 12:55:07",
      "content": "<p>Hey <a href=\"https://www.kaggle.com/jihoonkwon\" target=\"_blank\">@jihoonkwon</a> <br>\nthe data overview says leaderboard is on map@5<br>\nbut the discussion here mentions ndcg@5</p>\n<p>any guide on what we should aim at?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3290081": "What evaluation metrics do you use to measure the performance of the ranking algorithm?",
    "3291081": "We use NDCG@5.",
    "3300442": "Hey @jihoonkwon \nthe data overview says leaderboard is on map@5\nbut the discussion here mentions ndcg@5\n\nany guide on what we should aim at?"
  },
  "source": "meta"
}