{
  "id": 445459,
  "title": "Compounds SB-2343, 5-Iodotubercidin, C-646, JTC-801 not found in the train data?",
  "url": "/competitions/open-problems-single-cell-perturbations/discussion/445459",
  "author_name": "",
  "post_date": "2023-10-07T04:38:27.880302Z",
  "votes": 3,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hello,</p>\n<p>I am trying to figure out which drugs are in the public test set, but couldn't find 'SB-2343' in the train data. It didn't match anything in the 'sm_name' column. I also tried 'VS-5584' which is supposed to be an alias but no match either.</p>\n<p>Same for <code>5-Iodotubercidin</code>, <code>C-646</code>, <code>JTC-801</code>, I tried to google the synonyms but no luck. Would anyone know what is the corresponding sm_name for these compound? Or where can I find the mapping. Thank you!</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1716193%2F01fde2cbe13fb468749a261a1d4e9b13%2FScreenshot%202023-10-07%20003421.png?generation=1696653317666412&amp;alt=media\" alt=\"\"></p>\n<p>Also 'TL-HRAS-61' is also not found, 'TL_HRAS26' in 'sm_name' is a close match, are they supposed to be the same?</p>\n<p><strong>Update: hoho <a href=\"https://www.kaggle.com/awater1223\" target=\"_blank\">@awater1223</a> has the answer in his notebook, please see his answer below.</strong></p>",
  "messages": [
    {
      "id": "2472159",
      "postDate": "10/07/2023 04:38:27",
      "content": "<p>Hello,</p>\n<p>I am trying to figure out which drugs are in the public test set, but couldn't find 'SB-2343' in the train data. It didn't match anything in the 'sm_name' column. I also tried 'VS-5584' which is supposed to be an alias but no match either.</p>\n<p>Same for <code>5-Iodotubercidin</code>, <code>C-646</code>, <code>JTC-801</code>, I tried to google the synonyms but no luck. Would anyone know what is the corresponding sm_name for these compound? Or where can I find the mapping. Thank you!</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1716193%2F01fde2cbe13fb468749a261a1d4e9b13%2FScreenshot%202023-10-07%20003421.png?generation=1696653317666412&amp;alt=media\" alt=\"\"></p>\n<p>Also 'TL-HRAS-61' is also not found, 'TL_HRAS26' in 'sm_name' is a close match, are they supposed to be the same?</p>\n<p><strong>Update: hoho <a href=\"https://www.kaggle.com/awater1223\" target=\"_blank\">@awater1223</a> has the answer in his notebook, please see his answer below.</strong></p>",
      "rawMarkdown": "Hello,\n\nI am trying to figure out which drugs are in the public test set, but couldn't find 'SB-2343' in the train data. It didn't match anything in the 'sm_name' column. I also tried 'VS-5584' which is supposed to be an alias but no match either.\n\nSame for `5-Iodotubercidin`, `C-646`, `JTC-801`, I tried to google the synonyms but no luck. Would anyone know what is the corresponding sm_name for these compound? Or where can I find the mapping. Thank you!\n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1716193%2F01fde2cbe13fb468749a261a1d4e9b13%2FScreenshot%202023-10-07%20003421.png?generation=1696653317666412&alt=media)\n\n\nAlso 'TL-HRAS-61' is also not found, 'TL_HRAS26' in 'sm_name' is a close match, are they supposed to be the same?\n\n\n**Update: hoho @awater1223 has the answer in his notebook, please see his answer below.**",
      "votes": null
    },
    {
      "id": "2472227",
      "postDate": "10/07/2023 06:17:12",
      "content": "<p><a href=\"https://www.kaggle.com/qihuaz\" target=\"_blank\">@qihuaz</a> I have tried this, you can find it in my <a href=\"https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda#Data-split\" target=\"_blank\">notebook</a>.<br>\nThe \"mismatching\" names were labeled, but I don't know what caused these different.</p>",
      "rawMarkdown": "qihuaz I have tried this, you can find it in my [notebook](https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda#Data-split).\nThe \"mismatching\" names were labeled, but I don't know what caused these different.",
      "votes": null
    },
    {
      "id": "2472915",
      "postDate": "10/07/2023 17:57:51",
      "content": "<p>Thank you. You are awesome!</p>",
      "rawMarkdown": "Thank you. You are awesome!",
      "votes": null
    },
    {
      "id": "2474184",
      "postDate": "10/09/2023 04:01:16",
      "content": "<p>Sorry, how are you going to find this out? The competition description says they are random </p>\n<blockquote>\n  <p>Public Test:</p>\n  <p>50 randomly selected compounds in B and myeloid cells<br>\n  Private Test:</p>\n  <p>79 randomly selected compounds in B and myeloid cells</p>\n</blockquote>\n<p>(meaning not match those in the picture)… actually, I thought that the picture is just an example of how the data sets may look like…</p>",
      "rawMarkdown": "Sorry, how are you going to find this out? The competition description says they are random \n>Public Test:\n\n>50 randomly selected compounds in B and myeloid cells\n>Private Test:\n\n>79 randomly selected compounds in B and myeloid cells\n\n(meaning not match those in the picture)... actually, I thought that the picture is just an example of how the data sets may look like...",
      "votes": null
    },
    {
      "id": "2474362",
      "postDate": "10/09/2023 06:43:35",
      "content": "<p>In my understanding, they had already done the \"random selection\" and generated the figure, so it is not just an example.</p>\n<p>I tried to test the data split using the LB score in my <a href=\"https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda\" target=\"_blank\">notebook</a> v5, by masking the private set prediction to 0.<br>\nThe hypothesis is that the LB score should be:</p>\n<ul>\n<li><code>mask private to zero</code> = <code>mask nothing</code></li>\n<li><code>mask public to zero</code> = <code>mask all to zero</code></li>\n</ul>\n<p>I think the results support my opinions?</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1023301%2F785d3c1c923c005f044ad91256ae7d50%2F20231009144252.jpg?generation=1696833803831746&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "In my understanding, they had already done the \"random selection\" and generated the figure, so it is not just an example.\n\nI tried to test the data split using the LB score in my [notebook](https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda) v5, by masking the private set prediction to 0.\nThe hypothesis is that the LB score should be:\n- `mask private to zero` = `mask nothing`\n- `mask public to zero` = `mask all to zero`\n\nI think the results support my opinions?\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1023301%2F785d3c1c923c005f044ad91256ae7d50%2F20231009144252.jpg?generation=1696833803831746&alt=media)",
      "votes": null
    },
    {
      "id": "2474458",
      "postDate": "10/09/2023 08:38:13",
      "content": "<p>Yes, seems to be.. Thank you a lot, its very good to know!</p>",
      "rawMarkdown": "Yes, seems to be.. Thank you a lot, its very good to know!",
      "votes": null
    },
    {
      "id": "2479579",
      "postDate": "10/12/2023 17:51:12",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/awater1223\" target=\"_blank\">@awater1223</a> </p>\n<p>What do you mean by mismatching?<br>\nAre they using different names in train and test datasets?</p>\n<p>Thanks</p>",
      "rawMarkdown": "Hi @awater1223 \n\nWhat do you mean by mismatching?\nAre they using different names in train and test datasets?\n\nThanks",
      "votes": null
    },
    {
      "id": "2479989",
      "postDate": "10/13/2023 03:49:37",
      "content": "<p>Some names in the <strong>data split figure</strong> are not match the names in the data.<br>\nFor example, in the figure there is a <code>forskolin</code>, but it should be labeled as <code>Colforsin</code>, which is <code>LSM-2193</code> in the data.</p>",
      "rawMarkdown": "Some names in the **data split figure** are not match the names in the data.\nFor example, in the figure there is a `forskolin`, but it should be labeled as `Colforsin`, which is `LSM-2193` in the data.",
      "votes": null
    },
    {
      "id": "2481038",
      "postDate": "10/13/2023 17:56:35",
      "content": "<p>Oh, I see. </p>\n<p>thanks </p>",
      "rawMarkdown": "Oh, I see. \n\nthanks",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2472227,
      "author_name": "awater1223",
      "author_url": "",
      "post_date": "10/07/2023 06:17:12",
      "content": "<p><a href=\"https://www.kaggle.com/qihuaz\" target=\"_blank\">@qihuaz</a> I have tried this, you can find it in my <a href=\"https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda#Data-split\" target=\"_blank\">notebook</a>.<br>\nThe \"mismatching\" names were labeled, but I don't know what caused these different.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2472915,
          "author_name": "qihuaz",
          "author_url": "",
          "post_date": "10/07/2023 17:57:51",
          "content": "<p>Thank you. You are awesome!</p>",
          "votes": null,
          "replies": [
            {
              "id": 2479579,
              "author_name": "zhijianli",
              "author_url": "",
              "post_date": "10/12/2023 17:51:12",
              "content": "<p>Hi <a href=\"https://www.kaggle.com/awater1223\" target=\"_blank\">@awater1223</a> </p>\n<p>What do you mean by mismatching?<br>\nAre they using different names in train and test datasets?</p>\n<p>Thanks</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2479989,
                  "author_name": "awater1223",
                  "author_url": "",
                  "post_date": "10/13/2023 03:49:37",
                  "content": "<p>Some names in the <strong>data split figure</strong> are not match the names in the data.<br>\nFor example, in the figure there is a <code>forskolin</code>, but it should be labeled as <code>Colforsin</code>, which is <code>LSM-2193</code> in the data.</p>",
                  "votes": null,
                  "replies": [
                    {
                      "id": 2481038,
                      "author_name": "zhijianli",
                      "author_url": "",
                      "post_date": "10/13/2023 17:56:35",
                      "content": "<p>Oh, I see. </p>\n<p>thanks </p>",
                      "votes": null,
                      "replies": []
                    }
                  ]
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 2474184,
      "author_name": "antoninadolgorukova",
      "author_url": "",
      "post_date": "10/09/2023 04:01:16",
      "content": "<p>Sorry, how are you going to find this out? The competition description says they are random </p>\n<blockquote>\n  <p>Public Test:</p>\n  <p>50 randomly selected compounds in B and myeloid cells<br>\n  Private Test:</p>\n  <p>79 randomly selected compounds in B and myeloid cells</p>\n</blockquote>\n<p>(meaning not match those in the picture)… actually, I thought that the picture is just an example of how the data sets may look like…</p>",
      "votes": null,
      "replies": [
        {
          "id": 2474362,
          "author_name": "awater1223",
          "author_url": "",
          "post_date": "10/09/2023 06:43:35",
          "content": "<p>In my understanding, they had already done the \"random selection\" and generated the figure, so it is not just an example.</p>\n<p>I tried to test the data split using the LB score in my <a href=\"https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda\" target=\"_blank\">notebook</a> v5, by masking the private set prediction to 0.<br>\nThe hypothesis is that the LB score should be:</p>\n<ul>\n<li><code>mask private to zero</code> = <code>mask nothing</code></li>\n<li><code>mask public to zero</code> = <code>mask all to zero</code></li>\n</ul>\n<p>I think the results support my opinions?</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1023301%2F785d3c1c923c005f044ad91256ae7d50%2F20231009144252.jpg?generation=1696833803831746&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": [
            {
              "id": 2474458,
              "author_name": "antoninadolgorukova",
              "author_url": "",
              "post_date": "10/09/2023 08:38:13",
              "content": "<p>Yes, seems to be.. Thank you a lot, its very good to know!</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2472159": "Hello,\n\nI am trying to figure out which drugs are in the public test set, but couldn't find 'SB-2343' in the train data. It didn't match anything in the 'sm_name' column. I also tried 'VS-5584' which is supposed to be an alias but no match either.\n\nSame for `5-Iodotubercidin`, `C-646`, `JTC-801`, I tried to google the synonyms but no luck. Would anyone know what is the corresponding sm_name for these compound? Or where can I find the mapping. Thank you!\n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1716193%2F01fde2cbe13fb468749a261a1d4e9b13%2FScreenshot%202023-10-07%20003421.png?generation=1696653317666412&alt=media)\n\n\nAlso 'TL-HRAS-61' is also not found, 'TL_HRAS26' in 'sm_name' is a close match, are they supposed to be the same?\n\n\n**Update: hoho @awater1223 has the answer in his notebook, please see his answer below.**",
    "2472227": "qihuaz I have tried this, you can find it in my [notebook](https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda#Data-split).\nThe \"mismatching\" names were labeled, but I don't know what caused these different.",
    "2472915": "Thank you. You are awesome!",
    "2474184": "Sorry, how are you going to find this out? The competition description says they are random \n>Public Test:\n\n>50 randomly selected compounds in B and myeloid cells\n>Private Test:\n\n>79 randomly selected compounds in B and myeloid cells\n\n(meaning not match those in the picture)... actually, I thought that the picture is just an example of how the data sets may look like...",
    "2474362": "In my understanding, they had already done the \"random selection\" and generated the figure, so it is not just an example.\n\nI tried to test the data split using the LB score in my [notebook](https://www.kaggle.com/code/awater1223/op2-00-basic-metadata-eda) v5, by masking the private set prediction to 0.\nThe hypothesis is that the LB score should be:\n- `mask private to zero` = `mask nothing`\n- `mask public to zero` = `mask all to zero`\n\nI think the results support my opinions?\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1023301%2F785d3c1c923c005f044ad91256ae7d50%2F20231009144252.jpg?generation=1696833803831746&alt=media)",
    "2474458": "Yes, seems to be.. Thank you a lot, its very good to know!",
    "2479579": "Hi @awater1223 \n\nWhat do you mean by mismatching?\nAre they using different names in train and test datasets?\n\nThanks",
    "2479989": "Some names in the **data split figure** are not match the names in the data.\nFor example, in the figure there is a `forskolin`, but it should be labeled as `Colforsin`, which is `LSM-2193` in the data.",
    "2481038": "Oh, I see. \n\nthanks"
  },
  "source": "meta"
}