{
  "id": 456615,
  "title": "Judges Award Submission + End of competition survey!",
  "url": "/competitions/open-problems-single-cell-perturbations/discussion/456615",
  "author_name": "",
  "post_date": "2023-11-20T22:41:24.739350100Z",
  "votes": 12,
  "comment_count": 22,
  "views": 0,
  "content": "<p>Hi all, we're thrilled to see so much participation as the competition is coming to a close. We can't wait to see everyone's final submissions.</p>\n<p>We are also excited to get to know you better and learn more about how you approached the problem. We would greatly appreciate it if you could take 10 minutes to fill out this end-of-competition survey: <a href=\"https://cellarity.qualtrics.com/jfe/form/SV_8v1Bmtj0fWlNKyq\" target=\"_blank\">https://cellarity.qualtrics.com/jfe/form/SV_8v1Bmtj0fWlNKyq</a></p>\n<p><strong>If you want to be considered for the Judges Award, you must complete the survey.</strong> You may submit to the Judges' Award regardless of your final leaderboard score, but you must have made a submission.</p>\n<p>Now when it comes to the Judges Award submission, please structure your write up according to the sections here: <a href=\"http://www.kaggle.com/competitions/open-problems-single-cell-perturbations/overview/judges-prizes-scoring-rubrics\" target=\"_blank\">www.kaggle.com/competitions/open-problems-single-cell-perturbations/overview/judges-prizes-scoring-rubrics</a></p>\n<p>That is, you should submit either a link to a discussion post or a PDF document with 6 sections:</p>\n<ol>\n<li>Integration of biological knowledge</li>\n<li>Exploration of the problem</li>\n<li>Model design</li>\n<li>Robustness</li>\n<li>Documentation &amp; code style</li>\n<li>Reproducibility</li>\n</ol>\n<p>Your submission will be scored 1-5 on each section, and the winners will be chosen by the Judges from the top submissions. </p>\n<p>Judges Award submissions are due by December 12, 2023 at 11:59 UTC. This should give some time post-competition close to wrap up your thoughts and analysis and aligns with the deadline for Leaderboard Prize winners. Award determinations will be finalized in January 2024 (or sooner if we're fast!). </p>\n<p>If you have any questions, please feel free to leave a comment.</p>\n<p>All the best,<br>\nDaniel</p>",
  "messages": [
    {
      "id": "2532273",
      "postDate": "11/20/2023 22:41:24",
      "content": "<p>Hi all, we're thrilled to see so much participation as the competition is coming to a close. We can't wait to see everyone's final submissions.</p>\n<p>We are also excited to get to know you better and learn more about how you approached the problem. We would greatly appreciate it if you could take 10 minutes to fill out this end-of-competition survey: <a href=\"https://cellarity.qualtrics.com/jfe/form/SV_8v1Bmtj0fWlNKyq\" target=\"_blank\">https://cellarity.qualtrics.com/jfe/form/SV_8v1Bmtj0fWlNKyq</a></p>\n<p><strong>If you want to be considered for the Judges Award, you must complete the survey.</strong> You may submit to the Judges' Award regardless of your final leaderboard score, but you must have made a submission.</p>\n<p>Now when it comes to the Judges Award submission, please structure your write up according to the sections here: <a href=\"http://www.kaggle.com/competitions/open-problems-single-cell-perturbations/overview/judges-prizes-scoring-rubrics\" target=\"_blank\">www.kaggle.com/competitions/open-problems-single-cell-perturbations/overview/judges-prizes-scoring-rubrics</a></p>\n<p>That is, you should submit either a link to a discussion post or a PDF document with 6 sections:</p>\n<ol>\n<li>Integration of biological knowledge</li>\n<li>Exploration of the problem</li>\n<li>Model design</li>\n<li>Robustness</li>\n<li>Documentation &amp; code style</li>\n<li>Reproducibility</li>\n</ol>\n<p>Your submission will be scored 1-5 on each section, and the winners will be chosen by the Judges from the top submissions. </p>\n<p>Judges Award submissions are due by December 12, 2023 at 11:59 UTC. This should give some time post-competition close to wrap up your thoughts and analysis and aligns with the deadline for Leaderboard Prize winners. Award determinations will be finalized in January 2024 (or sooner if we're fast!). </p>\n<p>If you have any questions, please feel free to leave a comment.</p>\n<p>All the best,<br>\nDaniel</p>",
      "rawMarkdown": "Hi all, we're thrilled to see so much participation as the competition is coming to a close. We can't wait to see everyone's final submissions.\n\nWe are also excited to get to know you better and learn more about how you approached the problem. We would greatly appreciate it if you could take 10 minutes to fill out this end-of-competition survey: https://cellarity.qualtrics.com/jfe/form/SV_8v1Bmtj0fWlNKyq\n\n**If you want to be considered for the Judges Award, you must complete the survey.** You may submit to the Judges' Award regardless of your final leaderboard score, but you must have made a submission.\n\nNow when it comes to the Judges Award submission, please structure your write up according to the sections here: www.kaggle.com/competitions/open-problems-single-cell-perturbations/overview/judges-prizes-scoring-rubrics\n\nThat is, you should submit either a link to a discussion post or a PDF document with 6 sections:\n1. Integration of biological knowledge\n2. Exploration of the problem\n3. Model design\n4. Robustness\n5. Documentation & code style\n6. Reproducibility\n\nYour submission will be scored 1-5 on each section, and the winners will be chosen by the Judges from the top submissions. \n\nJudges Award submissions are due by December 12, 2023 at 11:59 UTC. This should give some time post-competition close to wrap up your thoughts and analysis and aligns with the deadline for Leaderboard Prize winners. Award determinations will be finalized in January 2024 (or sooner if we're fast!). \n\nIf you have any questions, please feel free to leave a comment.\n\nAll the best,\nDaniel",
      "votes": null
    },
    {
      "id": "2533018",
      "postDate": "11/21/2023 14:26:12",
      "content": "<p>As a note - you cannot accurately complete the survey until the end of the competition as it asks for your final LB score :)</p>",
      "rawMarkdown": "As a note - you cannot accurately complete the survey until the end of the competition as it asks for your final LB score :)",
      "votes": null
    },
    {
      "id": "2533358",
      "postDate": "11/21/2023 20:25:44",
      "content": "<p>Yup! We didn't anticipate folks would fill it out early, but we wanted to make sure it was clear how to submit for the Judges Award :)</p>",
      "rawMarkdown": "Yup! We didn't anticipate folks would fill it out early, but we wanted to make sure it was clear how to submit for the Judges Award :)",
      "votes": null
    },
    {
      "id": "2541046",
      "postDate": "11/28/2023 07:38:50",
      "content": "<p>Just tell me one thing getting high score that means above 2 is a bad score or good score because in leader board it is showing opposite , high scorer is at the last , low scorer at the fast . If it is 0.5 it is good or if it is 1.9 it is good </p>",
      "rawMarkdown": "Just tell me one thing getting high score that means above 2 is a bad score or good score because in leader board it is showing opposite , high scorer is at the last , low scorer at the fast . If it is 0.5 it is good or if it is 1.9 it is good",
      "votes": null
    },
    {
      "id": "2541692",
      "postDate": "11/28/2023 17:32:40",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/danielburkhardt\" target=\"_blank\">@danielburkhardt</a> Concerning #6 Reproducibility: Is a public Kaggle notebook reproducible enough, or do you really require a dockerfile on GitHub?</p>",
      "rawMarkdown": "Hi @danielburkhardt Concerning #6 Reproducibility: Is a public Kaggle notebook reproducible enough, or do you really require a dockerfile on GitHub?",
      "votes": null
    },
    {
      "id": "2543130",
      "postDate": "11/29/2023 19:46:39",
      "content": "<p>good explan</p>",
      "rawMarkdown": "good explan",
      "votes": null
    },
    {
      "id": "2544520",
      "postDate": "11/30/2023 22:12:15",
      "content": "<p>Of course, I don't know what kind of data other people use. Although my score was low compared to other characteristics, the state of the data I collected was able to explain the effects of compounds on genes from a biological and chemical perspective.<br>\nI think it is intended. I'm sorry I couldn't try the other things I should have tried because I didn't have time. I trust the data that I have filtered and processed for a long time. But unfortunately I didn't have the chance to try it further.</p>",
      "rawMarkdown": "Of course, I don't know what kind of data other people use. Although my score was low compared to other characteristics, the state of the data I collected was able to explain the effects of compounds on genes from a biological and chemical perspective.\nI think it is intended. I'm sorry I couldn't try the other things I should have tried because I didn't have time. I trust the data that I have filtered and processed for a long time. But unfortunately I didn't have the chance to try it further.",
      "votes": null
    },
    {
      "id": "2544546",
      "postDate": "11/30/2023 22:43:41",
      "content": "<p>Good question <a href=\"https://www.kaggle.com/ambrosm\" target=\"_blank\">@ambrosm</a>, I'll let <a href=\"https://www.kaggle.com/robrechtcannoodt\" target=\"_blank\">@robrechtcannoodt</a> chime in on this. If you can train and run your model in a Kaggle notebook without any further configuration of the environment, I think that's fine.</p>",
      "rawMarkdown": "Good question @ambrosm, I'll let @robrechtcannoodt chime in on this. If you can train and run your model in a Kaggle notebook without any further configuration of the environment, I think that's fine.",
      "votes": null
    },
    {
      "id": "2545083",
      "postDate": "12/01/2023 09:28:16",
      "content": "<p>May I ask, for the jury's prize, will the one with top scores on leaderboard only, be elected (the top 100 or 150 solutions on the leaderboard) , or others with leaderboard rank more than 150 can apply for the prize (and have a chance to win)? I have implemented so much trials from a biological wise perspective and I got that the jury's prize was more of an ablation study. I was intending to provide a documentation on the trials, meanwhile, I just now knew that the winners will be selected from the top leaderboard. I would appreciate you clarify this point in further details.</p>",
      "rawMarkdown": "May I ask, for the jury's prize, will the one with top scores on leaderboard only, be elected (the top 100 or 150 solutions on the leaderboard) , or others with leaderboard rank more than 150 can apply for the prize (and have a chance to win)? I have implemented so much trials from a biological wise perspective and I got that the jury's prize was more of an ablation study. I was intending to provide a documentation on the trials, meanwhile, I just now knew that the winners will be selected from the top leaderboard. I would appreciate you clarify this point in further details.",
      "votes": null
    },
    {
      "id": "2545544",
      "postDate": "12/01/2023 14:55:53",
      "content": "<p>Thanks for your question! For a script or notebook to be considered reproducible I'd expect it to have been run with a Docker container for which the image and the Dockerfile is public. Even better would be if the script is wrapped in a Viash component :)</p>",
      "rawMarkdown": "Thanks for your question! For a script or notebook to be considered reproducible I'd expect it to have been run with a Docker container for which the image and the Dockerfile is public. Even better would be if the script is wrapped in a Viash component :)",
      "votes": null
    },
    {
      "id": "2545915",
      "postDate": "12/01/2023 22:23:54",
      "content": "<p>I completed the survey without the link to docs and GitHub code repo, which I thought I would prepare after completing the survey, on the final page.  Can I resubmit the survey once I create the doc and repo?  I hoped that asking these links would be at the first page of the survey to reduce the surprise.</p>",
      "rawMarkdown": "I completed the survey without the link to docs and GitHub code repo, which I thought I would prepare after completing the survey, on the final page.  Can I resubmit the survey once I create the doc and repo?  I hoped that asking these links would be at the first page of the survey to reduce the surprise.",
      "votes": null
    },
    {
      "id": "2546368",
      "postDate": "12/02/2023 10:49:32",
      "content": "<p>Thanks for the clarification. Is it ok if the reproducing notebook/script outperforms the one on Private Leaderboard? Or would you prefer the exact same score on the leaderboard?</p>",
      "rawMarkdown": "Thanks for the clarification. Is it ok if the reproducing notebook/script outperforms the one on Private Leaderboard? Or would you prefer the exact same score on the leaderboard?",
      "votes": null
    },
    {
      "id": "2548619",
      "postDate": "12/04/2023 14:55:43",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/makio323\" target=\"_blank\">@makio323</a>, can you send me a DM with your email address? I can send you a re-take link so you can edit your response.</p>",
      "rawMarkdown": "Hi @makio323, can you send me a DM with your email address? I can send you a re-take link so you can edit your response.",
      "votes": null
    },
    {
      "id": "2548620",
      "postDate": "12/04/2023 14:56:16",
      "content": "<p>Submit your best model! Doesn't need to be the one you submitted on the leaderboard.</p>",
      "rawMarkdown": "Submit your best model! Doesn't need to be the one you submitted on the leaderboard.",
      "votes": null
    },
    {
      "id": "2548625",
      "postDate": "12/04/2023 14:59:46",
      "content": "<p>Great question <a href=\"https://www.kaggle.com/hagarelsayed\" target=\"_blank\">@hagarelsayed</a>. There is no restriction on leaderboard rank, so feel free to submit! </p>\n<p>This point about the top 100 submissions getting reviewed has more to do with our subjective determination about the quality of your Judges' Award write-up. If we get more than 100 submissions, a few of us will be triaging and picking the top 100 quality write-ups for the Judges to score.</p>",
      "rawMarkdown": "Great question @hagarelsayed. There is no restriction on leaderboard rank, so feel free to submit! \n\nThis point about the top 100 submissions getting reviewed has more to do with our subjective determination about the quality of your Judges' Award write-up. If we get more than 100 submissions, a few of us will be triaging and picking the top 100 quality write-ups for the Judges to score.",
      "votes": null
    },
    {
      "id": "2548630",
      "postDate": "12/04/2023 15:04:29",
      "content": "<p><a href=\"mailto:hcy535561@gmail.com\">hcy535561@gmail.com</a></p>",
      "rawMarkdown": "hcy535561@gmail.com",
      "votes": null
    },
    {
      "id": "2548633",
      "postDate": "12/04/2023 15:08:34",
      "content": "<p>Can you send me a new link, too</p>",
      "rawMarkdown": "Can you send me a new link, too",
      "votes": null
    },
    {
      "id": "2548635",
      "postDate": "12/04/2023 15:08:54",
      "content": "<p>My mail is <a href=\"mailto:hcy535561@gmail.com\">hcy535561@gmail.com</a></p>",
      "rawMarkdown": "My mail is hcy535561@gmail.com",
      "votes": null
    },
    {
      "id": "2549870",
      "postDate": "12/05/2023 15:37:19",
      "content": "<p>To make sure our code runs correctly on local machines and VMs with GPUs, and since we cannot download data into such machines according to rules, can we at least download column names in de_train, id_map, and sample_submission in order to create random datasets but with correct column names to perform the tests?</p>",
      "rawMarkdown": "To make sure our code runs correctly on local machines and VMs with GPUs, and since we cannot download data into such machines according to rules, can we at least download column names in de_train, id_map, and sample_submission in order to create random datasets but with correct column names to perform the tests?",
      "votes": null
    },
    {
      "id": "2552549",
      "postDate": "12/07/2023 14:55:20",
      "content": "<p>FYA, I sent you a DM with my email address yesterday.  Please send me the re-take link.</p>",
      "rawMarkdown": "FYA, I sent you a DM with my email address yesterday.  Please send me the re-take link.",
      "votes": null
    },
    {
      "id": "2555469",
      "postDate": "12/09/2023 23:41:24",
      "content": "<p>I haven't received the re-taking link yet, but I can retake the survey and submit it with the doc and code links.  I hope it works for the purpose.</p>",
      "rawMarkdown": "I haven't received the re-taking link yet, but I can retake the survey and submit it with the doc and code links.  I hope it works for the purpose.",
      "votes": null
    },
    {
      "id": "2559126",
      "postDate": "12/12/2023 16:08:52",
      "content": "<p>I don't follow the question, why can't you download data into the machines?</p>",
      "rawMarkdown": "I don't follow the question, why can't you download data into the machines?",
      "votes": null
    },
    {
      "id": "2559196",
      "postDate": "12/12/2023 16:41:34",
      "content": "<p>I was actually skeptical whether we were allowed to download the data on our local machines as I only used Kaggle resources throughout the competition. But it is clear now. Thanks!</p>",
      "rawMarkdown": "I was actually skeptical whether we were allowed to download the data on our local machines as I only used Kaggle resources throughout the competition. But it is clear now. Thanks!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2533018,
      "author_name": "pcjimmmy",
      "author_url": "",
      "post_date": "11/21/2023 14:26:12",
      "content": "<p>As a note - you cannot accurately complete the survey until the end of the competition as it asks for your final LB score :)</p>",
      "votes": null,
      "replies": [
        {
          "id": 2533358,
          "author_name": "danielburkhardt",
          "author_url": "",
          "post_date": "11/21/2023 20:25:44",
          "content": "<p>Yup! We didn't anticipate folks would fill it out early, but we wanted to make sure it was clear how to submit for the Judges Award :)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2541046,
      "author_name": "pathfinder1234",
      "author_url": "",
      "post_date": "11/28/2023 07:38:50",
      "content": "<p>Just tell me one thing getting high score that means above 2 is a bad score or good score because in leader board it is showing opposite , high scorer is at the last , low scorer at the fast . If it is 0.5 it is good or if it is 1.9 it is good </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2541692,
      "author_name": "ambrosm",
      "author_url": "",
      "post_date": "11/28/2023 17:32:40",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/danielburkhardt\" target=\"_blank\">@danielburkhardt</a> Concerning #6 Reproducibility: Is a public Kaggle notebook reproducible enough, or do you really require a dockerfile on GitHub?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2544546,
          "author_name": "danielburkhardt",
          "author_url": "",
          "post_date": "11/30/2023 22:43:41",
          "content": "<p>Good question <a href=\"https://www.kaggle.com/ambrosm\" target=\"_blank\">@ambrosm</a>, I'll let <a href=\"https://www.kaggle.com/robrechtcannoodt\" target=\"_blank\">@robrechtcannoodt</a> chime in on this. If you can train and run your model in a Kaggle notebook without any further configuration of the environment, I think that's fine.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2545544,
          "author_name": "rcannood",
          "author_url": "",
          "post_date": "12/01/2023 14:55:53",
          "content": "<p>Thanks for your question! For a script or notebook to be considered reproducible I'd expect it to have been run with a Docker container for which the image and the Dockerfile is public. Even better would be if the script is wrapped in a Viash component :)</p>",
          "votes": null,
          "replies": [
            {
              "id": 2546368,
              "author_name": "jeannkouagou",
              "author_url": "",
              "post_date": "12/02/2023 10:49:32",
              "content": "<p>Thanks for the clarification. Is it ok if the reproducing notebook/script outperforms the one on Private Leaderboard? Or would you prefer the exact same score on the leaderboard?</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2548620,
                  "author_name": "danielburkhardt",
                  "author_url": "",
                  "post_date": "12/04/2023 14:56:16",
                  "content": "<p>Submit your best model! Doesn't need to be the one you submitted on the leaderboard.</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            },
            {
              "id": 2548630,
              "author_name": "trabzonlu61",
              "author_url": "",
              "post_date": "12/04/2023 15:04:29",
              "content": "<p><a href=\"mailto:hcy535561@gmail.com\">hcy535561@gmail.com</a></p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2543130,
      "author_name": "mcminh",
      "author_url": "",
      "post_date": "11/29/2023 19:46:39",
      "content": "<p>good explan</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2544520,
      "author_name": "trabzonlu61",
      "author_url": "",
      "post_date": "11/30/2023 22:12:15",
      "content": "<p>Of course, I don't know what kind of data other people use. Although my score was low compared to other characteristics, the state of the data I collected was able to explain the effects of compounds on genes from a biological and chemical perspective.<br>\nI think it is intended. I'm sorry I couldn't try the other things I should have tried because I didn't have time. I trust the data that I have filtered and processed for a long time. But unfortunately I didn't have the chance to try it further.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2545083,
      "author_name": "hagarelsayed",
      "author_url": "",
      "post_date": "12/01/2023 09:28:16",
      "content": "<p>May I ask, for the jury's prize, will the one with top scores on leaderboard only, be elected (the top 100 or 150 solutions on the leaderboard) , or others with leaderboard rank more than 150 can apply for the prize (and have a chance to win)? I have implemented so much trials from a biological wise perspective and I got that the jury's prize was more of an ablation study. I was intending to provide a documentation on the trials, meanwhile, I just now knew that the winners will be selected from the top leaderboard. I would appreciate you clarify this point in further details.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2548625,
          "author_name": "danielburkhardt",
          "author_url": "",
          "post_date": "12/04/2023 14:59:46",
          "content": "<p>Great question <a href=\"https://www.kaggle.com/hagarelsayed\" target=\"_blank\">@hagarelsayed</a>. There is no restriction on leaderboard rank, so feel free to submit! </p>\n<p>This point about the top 100 submissions getting reviewed has more to do with our subjective determination about the quality of your Judges' Award write-up. If we get more than 100 submissions, a few of us will be triaging and picking the top 100 quality write-ups for the Judges to score.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2545915,
      "author_name": "makio323",
      "author_url": "",
      "post_date": "12/01/2023 22:23:54",
      "content": "<p>I completed the survey without the link to docs and GitHub code repo, which I thought I would prepare after completing the survey, on the final page.  Can I resubmit the survey once I create the doc and repo?  I hoped that asking these links would be at the first page of the survey to reduce the surprise.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2548619,
          "author_name": "danielburkhardt",
          "author_url": "",
          "post_date": "12/04/2023 14:55:43",
          "content": "<p>Hi <a href=\"https://www.kaggle.com/makio323\" target=\"_blank\">@makio323</a>, can you send me a DM with your email address? I can send you a re-take link so you can edit your response.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2548633,
              "author_name": "trabzonlu61",
              "author_url": "",
              "post_date": "12/04/2023 15:08:34",
              "content": "<p>Can you send me a new link, too</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2548635,
                  "author_name": "trabzonlu61",
                  "author_url": "",
                  "post_date": "12/04/2023 15:08:54",
                  "content": "<p>My mail is <a href=\"mailto:hcy535561@gmail.com\">hcy535561@gmail.com</a></p>",
                  "votes": null,
                  "replies": []
                }
              ]
            },
            {
              "id": 2552549,
              "author_name": "makio323",
              "author_url": "",
              "post_date": "12/07/2023 14:55:20",
              "content": "<p>FYA, I sent you a DM with my email address yesterday.  Please send me the re-take link.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2555469,
                  "author_name": "makio323",
                  "author_url": "",
                  "post_date": "12/09/2023 23:41:24",
                  "content": "<p>I haven't received the re-taking link yet, but I can retake the survey and submit it with the doc and code links.  I hope it works for the purpose.</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 2549870,
      "author_name": "jeannkouagou",
      "author_url": "",
      "post_date": "12/05/2023 15:37:19",
      "content": "<p>To make sure our code runs correctly on local machines and VMs with GPUs, and since we cannot download data into such machines according to rules, can we at least download column names in de_train, id_map, and sample_submission in order to create random datasets but with correct column names to perform the tests?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2559126,
          "author_name": "danielburkhardt",
          "author_url": "",
          "post_date": "12/12/2023 16:08:52",
          "content": "<p>I don't follow the question, why can't you download data into the machines?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2559196,
              "author_name": "jeannkouagou",
              "author_url": "",
              "post_date": "12/12/2023 16:41:34",
              "content": "<p>I was actually skeptical whether we were allowed to download the data on our local machines as I only used Kaggle resources throughout the competition. But it is clear now. Thanks!</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2532273": "Hi all, we're thrilled to see so much participation as the competition is coming to a close. We can't wait to see everyone's final submissions.\n\nWe are also excited to get to know you better and learn more about how you approached the problem. We would greatly appreciate it if you could take 10 minutes to fill out this end-of-competition survey: https://cellarity.qualtrics.com/jfe/form/SV_8v1Bmtj0fWlNKyq\n\n**If you want to be considered for the Judges Award, you must complete the survey.** You may submit to the Judges' Award regardless of your final leaderboard score, but you must have made a submission.\n\nNow when it comes to the Judges Award submission, please structure your write up according to the sections here: www.kaggle.com/competitions/open-problems-single-cell-perturbations/overview/judges-prizes-scoring-rubrics\n\nThat is, you should submit either a link to a discussion post or a PDF document with 6 sections:\n1. Integration of biological knowledge\n2. Exploration of the problem\n3. Model design\n4. Robustness\n5. Documentation & code style\n6. Reproducibility\n\nYour submission will be scored 1-5 on each section, and the winners will be chosen by the Judges from the top submissions. \n\nJudges Award submissions are due by December 12, 2023 at 11:59 UTC. This should give some time post-competition close to wrap up your thoughts and analysis and aligns with the deadline for Leaderboard Prize winners. Award determinations will be finalized in January 2024 (or sooner if we're fast!). \n\nIf you have any questions, please feel free to leave a comment.\n\nAll the best,\nDaniel",
    "2533018": "As a note - you cannot accurately complete the survey until the end of the competition as it asks for your final LB score :)",
    "2533358": "Yup! We didn't anticipate folks would fill it out early, but we wanted to make sure it was clear how to submit for the Judges Award :)",
    "2541046": "Just tell me one thing getting high score that means above 2 is a bad score or good score because in leader board it is showing opposite , high scorer is at the last , low scorer at the fast . If it is 0.5 it is good or if it is 1.9 it is good",
    "2541692": "Hi @danielburkhardt Concerning #6 Reproducibility: Is a public Kaggle notebook reproducible enough, or do you really require a dockerfile on GitHub?",
    "2543130": "good explan",
    "2544520": "Of course, I don't know what kind of data other people use. Although my score was low compared to other characteristics, the state of the data I collected was able to explain the effects of compounds on genes from a biological and chemical perspective.\nI think it is intended. I'm sorry I couldn't try the other things I should have tried because I didn't have time. I trust the data that I have filtered and processed for a long time. But unfortunately I didn't have the chance to try it further.",
    "2544546": "Good question @ambrosm, I'll let @robrechtcannoodt chime in on this. If you can train and run your model in a Kaggle notebook without any further configuration of the environment, I think that's fine.",
    "2545083": "May I ask, for the jury's prize, will the one with top scores on leaderboard only, be elected (the top 100 or 150 solutions on the leaderboard) , or others with leaderboard rank more than 150 can apply for the prize (and have a chance to win)? I have implemented so much trials from a biological wise perspective and I got that the jury's prize was more of an ablation study. I was intending to provide a documentation on the trials, meanwhile, I just now knew that the winners will be selected from the top leaderboard. I would appreciate you clarify this point in further details.",
    "2545544": "Thanks for your question! For a script or notebook to be considered reproducible I'd expect it to have been run with a Docker container for which the image and the Dockerfile is public. Even better would be if the script is wrapped in a Viash component :)",
    "2545915": "I completed the survey without the link to docs and GitHub code repo, which I thought I would prepare after completing the survey, on the final page.  Can I resubmit the survey once I create the doc and repo?  I hoped that asking these links would be at the first page of the survey to reduce the surprise.",
    "2546368": "Thanks for the clarification. Is it ok if the reproducing notebook/script outperforms the one on Private Leaderboard? Or would you prefer the exact same score on the leaderboard?",
    "2548619": "Hi @makio323, can you send me a DM with your email address? I can send you a re-take link so you can edit your response.",
    "2548620": "Submit your best model! Doesn't need to be the one you submitted on the leaderboard.",
    "2548625": "Great question @hagarelsayed. There is no restriction on leaderboard rank, so feel free to submit! \n\nThis point about the top 100 submissions getting reviewed has more to do with our subjective determination about the quality of your Judges' Award write-up. If we get more than 100 submissions, a few of us will be triaging and picking the top 100 quality write-ups for the Judges to score.",
    "2548630": "hcy535561@gmail.com",
    "2548633": "Can you send me a new link, too",
    "2548635": "My mail is hcy535561@gmail.com",
    "2549870": "To make sure our code runs correctly on local machines and VMs with GPUs, and since we cannot download data into such machines according to rules, can we at least download column names in de_train, id_map, and sample_submission in order to create random datasets but with correct column names to perform the tests?",
    "2552549": "FYA, I sent you a DM with my email address yesterday.  Please send me the re-take link.",
    "2555469": "I haven't received the re-taking link yet, but I can retake the survey and submit it with the doc and code links.  I hope it works for the purpose.",
    "2559126": "I don't follow the question, why can't you download data into the machines?",
    "2559196": "I was actually skeptical whether we were allowed to download the data on our local machines as I only used Kaggle resources throughout the competition. But it is clear now. Thanks!"
  },
  "source": "meta"
}