{
  "id": 154037,
  "title": "submission file",
  "url": "/competitions/trec-covid-information-retrieval/discussion/154037",
  "author_name": "",
  "post_date": "2020-05-27T01:17:06.428610700Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>From the overview, It appears like there is a score of 0,1,2 (relevant, somewhat relevnt  and not relevant) for the documents, but there is only topic-id and doc-id columns and no column for the document score of 0,1,2?  </p>",
  "messages": [
    {
      "id": "862938",
      "postDate": "05/27/2020 01:17:06",
      "content": "<p>From the overview, It appears like there is a score of 0,1,2 (relevant, somewhat relevnt  and not relevant) for the documents, but there is only topic-id and doc-id columns and no column for the document score of 0,1,2?  </p>",
      "rawMarkdown": "From the overview, It appears like there is a score of 0,1,2 (relevant, somewhat relevnt  and not relevant) for the documents, but there is only topic-id and doc-id columns and no column for the document score of 0,1,2?",
      "votes": null
    },
    {
      "id": "862964",
      "postDate": "05/27/2020 01:45:42",
      "content": "<p>Don’t predict the label, but rank the documents in order of predicted relevance. A perfect system would emit all the 2’s, then all the 1’s before any zeroes. </p>",
      "rawMarkdown": "Don’t predict the label, but rank the documents in order of predicted relevance. A perfect system would emit all the 2’s, then all the 1’s before any zeroes.",
      "votes": null
    },
    {
      "id": "862970",
      "postDate": "05/27/2020 01:54:10",
      "content": "<p>Right rank (predict the rank) so just put them in order by 2, 1, 0?  Meaning there is no column to put the 0,1,2?</p>",
      "rawMarkdown": "Right rank (predict the rank) so just put them in order by 2, 1, 0?  Meaning there is no column to put the 0,1,2?",
      "votes": null
    },
    {
      "id": "863662",
      "postDate": "05/27/2020 13:28:15",
      "content": "<p>Correct. For example:\n<code>\nQuery1,&lt;1st most likely relevant doc&gt;\nQuery1,&lt;2nd most likely relevant doc&gt;\n...\nQuery1,&lt;10th most likely relevant doc&gt;\n</code></p>",
      "rawMarkdown": "Correct. For example:\n```\nQuery1,&lt;1st most likely relevant doc&gt;\nQuery1,&lt;2nd most likely relevant doc&gt;\n...\nQuery1,&lt;10th most likely relevant doc&gt;\n```",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 862964,
      "author_name": "iansoboroff",
      "author_url": "",
      "post_date": "05/27/2020 01:45:42",
      "content": "<p>Don’t predict the label, but rank the documents in order of predicted relevance. A perfect system would emit all the 2’s, then all the 1’s before any zeroes. </p>",
      "votes": null,
      "replies": [
        {
          "id": 862970,
          "author_name": "mlconsult",
          "author_url": "",
          "post_date": "05/27/2020 01:54:10",
          "content": "<p>Right rank (predict the rank) so just put them in order by 2, 1, 0?  Meaning there is no column to put the 0,1,2?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 863662,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "05/27/2020 13:28:15",
          "content": "<p>Correct. For example:\n<code>\nQuery1,&lt;1st most likely relevant doc&gt;\nQuery1,&lt;2nd most likely relevant doc&gt;\n...\nQuery1,&lt;10th most likely relevant doc&gt;\n</code></p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "862938": "From the overview, It appears like there is a score of 0,1,2 (relevant, somewhat relevnt  and not relevant) for the documents, but there is only topic-id and doc-id columns and no column for the document score of 0,1,2?",
    "862964": "Don’t predict the label, but rank the documents in order of predicted relevance. A perfect system would emit all the 2’s, then all the 1’s before any zeroes.",
    "862970": "Right rank (predict the rank) so just put them in order by 2, 1, 0?  Meaning there is no column to put the 0,1,2?",
    "863662": "Correct. For example:\n```\nQuery1,&lt;1st most likely relevant doc&gt;\nQuery1,&lt;2nd most likely relevant doc&gt;\n...\nQuery1,&lt;10th most likely relevant doc&gt;\n```"
  },
  "source": "meta"
}