{
  "id": 349710,
  "title": "A question about the evaluation",
  "url": "/competitions/open-problems-multimodal/discussion/349710",
  "author_name": "",
  "post_date": "2022-09-02T12:53:13.702651600Z",
  "votes": 2,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Dear organizer:</p>\n<p>In the evaluation section, it says:</p>\n<p><em>For each <strong>observation</strong> in the Multiome data set, we compute the correlation between the ground-truth gene expressions and the predicted gene expressions. For each <strong>observation</strong> in the CITEseq data set, we compute the correlation between ground-truth surface protein levels and predicted surface protein levels</em></p>\n<p>Here, does each observation represent a cell or a donor?<br>\nCan you provide more information about how the final score is calcualted?</p>\n<p>Thanks!<br>\nZhijian</p>",
  "messages": [
    {
      "id": "1923667",
      "postDate": "09/02/2022 12:53:13",
      "content": "<p>Dear organizer:</p>\n<p>In the evaluation section, it says:</p>\n<p><em>For each <strong>observation</strong> in the Multiome data set, we compute the correlation between the ground-truth gene expressions and the predicted gene expressions. For each <strong>observation</strong> in the CITEseq data set, we compute the correlation between ground-truth surface protein levels and predicted surface protein levels</em></p>\n<p>Here, does each observation represent a cell or a donor?<br>\nCan you provide more information about how the final score is calcualted?</p>\n<p>Thanks!<br>\nZhijian</p>",
      "rawMarkdown": "Dear organizer:\n\nIn the evaluation section, it says:\n\n*For each **observation** in the Multiome data set, we compute the correlation between the ground-truth gene expressions and the predicted gene expressions. For each **observation** in the CITEseq data set, we compute the correlation between ground-truth surface protein levels and predicted surface protein levels*\n\nHere, does each observation represent a cell or a donor?\nCan you provide more information about how the final score is calcualted?\n\nThanks!\nZhijian",
      "votes": null
    },
    {
      "id": "1925993",
      "postDate": "09/04/2022 13:29:57",
      "content": "<p>An additional question. Are the evaluations for CITEseq and Multiome weighted differently? According to <a href=\"https://www.kaggle.com/competitions/open-problems-multimodal/discussion/349583\" target=\"_blank\">this</a>, it seems that CITEseq predictions weigh much more than Multiome's.<br>\nIs it correct? What are the correct weights for CITEseq and Multiome evaluations?</p>",
      "rawMarkdown": "An additional question. Are the evaluations for CITEseq and Multiome weighted differently? According to [this](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/349583), it seems that CITEseq predictions weigh much more than Multiome's.\nIs it correct? What are the correct weights for CITEseq and Multiome evaluations?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1925993,
      "author_name": "sbunzini",
      "author_url": "",
      "post_date": "09/04/2022 13:29:57",
      "content": "<p>An additional question. Are the evaluations for CITEseq and Multiome weighted differently? According to <a href=\"https://www.kaggle.com/competitions/open-problems-multimodal/discussion/349583\" target=\"_blank\">this</a>, it seems that CITEseq predictions weigh much more than Multiome's.<br>\nIs it correct? What are the correct weights for CITEseq and Multiome evaluations?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1923667": "Dear organizer:\n\nIn the evaluation section, it says:\n\n*For each **observation** in the Multiome data set, we compute the correlation between the ground-truth gene expressions and the predicted gene expressions. For each **observation** in the CITEseq data set, we compute the correlation between ground-truth surface protein levels and predicted surface protein levels*\n\nHere, does each observation represent a cell or a donor?\nCan you provide more information about how the final score is calcualted?\n\nThanks!\nZhijian",
    "1925993": "An additional question. Are the evaluations for CITEseq and Multiome weighted differently? According to [this](https://www.kaggle.com/competitions/open-problems-multimodal/discussion/349583), it seems that CITEseq predictions weigh much more than Multiome's.\nIs it correct? What are the correct weights for CITEseq and Multiome evaluations?"
  },
  "source": "meta"
}