{
  "id": 451853,
  "title": "Modeling with 3D coordinates ",
  "url": "/competitions/stanford-ribonanza-rna-folding/discussion/451853",
  "author_name": "",
  "post_date": "2023-10-30T19:00:10.694023700Z",
  "votes": 25,
  "comment_count": 17,
  "views": 0,
  "content": "<p>A key goal of this competition is to develop models that understand 3D structures of RNA and we think it might also help to use existing 3D structure prediction models to generate 3D coordinates to model the data in Ribonanza. As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data. These can be accessed at:<br>\n<a href=\"https://www.kaggle.com/datasets/shujun717/ribonanza-3d-coords\" target=\"_blank\">https://www.kaggle.com/datasets/shujun717/ribonanza-3d-coords</a></p>\n<p>Each folder is named by <code>sequence_id</code> and <code>unrelaxed_model.pdb</code> has the 3D coordinates predicted by RhoFold. We hope that this will help your modeling efforts! </p>\n<p><a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> has also made a notebook showing how to install RhoFold and visualize 3D structures: <br>\n <a href=\"https://www.kaggle.com/code/rhijudas/interactive-rhofold\" target=\"_blank\">https://www.kaggle.com/code/rhijudas/interactive-rhofold</a></p>\n<p>Video lecture from <a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> on 3D structure prediction and how Ribonanza can help us create an Alphafold moment for RNA:<br>\n<a href=\"https://www.youtube.com/watch?v=R6-MwrGkj7M&amp;t=95s&amp;ab_channel=CASPRNASIG\" target=\"_blank\">https://www.youtube.com/watch?v=R6-MwrGkj7M&amp;t=95s&amp;ab_channel=CASPRNASIG</a><br>\nRhoFold paper:<br>\n<a href=\"https://arxiv.org/abs/2207.01586\" target=\"_blank\">https://arxiv.org/abs/2207.01586</a></p>",
  "messages": [
    {
      "id": "2505739",
      "postDate": "10/30/2023 19:00:10",
      "content": "<p>A key goal of this competition is to develop models that understand 3D structures of RNA and we think it might also help to use existing 3D structure prediction models to generate 3D coordinates to model the data in Ribonanza. As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data. These can be accessed at:<br>\n<a href=\"https://www.kaggle.com/datasets/shujun717/ribonanza-3d-coords\" target=\"_blank\">https://www.kaggle.com/datasets/shujun717/ribonanza-3d-coords</a></p>\n<p>Each folder is named by <code>sequence_id</code> and <code>unrelaxed_model.pdb</code> has the 3D coordinates predicted by RhoFold. We hope that this will help your modeling efforts! </p>\n<p><a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> has also made a notebook showing how to install RhoFold and visualize 3D structures: <br>\n <a href=\"https://www.kaggle.com/code/rhijudas/interactive-rhofold\" target=\"_blank\">https://www.kaggle.com/code/rhijudas/interactive-rhofold</a></p>\n<p>Video lecture from <a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> on 3D structure prediction and how Ribonanza can help us create an Alphafold moment for RNA:<br>\n<a href=\"https://www.youtube.com/watch?v=R6-MwrGkj7M&amp;t=95s&amp;ab_channel=CASPRNASIG\" target=\"_blank\">https://www.youtube.com/watch?v=R6-MwrGkj7M&amp;t=95s&amp;ab_channel=CASPRNASIG</a><br>\nRhoFold paper:<br>\n<a href=\"https://arxiv.org/abs/2207.01586\" target=\"_blank\">https://arxiv.org/abs/2207.01586</a></p>",
      "rawMarkdown": "A key goal of this competition is to develop models that understand 3D structures of RNA and we think it might also help to use existing 3D structure prediction models to generate 3D coordinates to model the data in Ribonanza. As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data. These can be accessed at:\nhttps://www.kaggle.com/datasets/shujun717/ribonanza-3d-coords\n\nEach folder is named by `sequence_id` and `unrelaxed_model.pdb` has the 3D coordinates predicted by RhoFold. We hope that this will help your modeling efforts! \n\n@rhijudas has also made a notebook showing how to install RhoFold and visualize 3D structures: \n https://www.kaggle.com/code/rhijudas/interactive-rhofold\n\nVideo lecture from @rhijudas on 3D structure prediction and how Ribonanza can help us create an Alphafold moment for RNA:\nhttps://www.youtube.com/watch?v=R6-MwrGkj7M&t=95s&ab_channel=CASPRNASIG\nRhoFold paper:\nhttps://arxiv.org/abs/2207.01586",
      "votes": null
    },
    {
      "id": "2505758",
      "postDate": "10/30/2023 19:29:57",
      "content": "<p>Here are some additional packages with downloadable code  that might be of interest:</p>\n<p>• <strong>trRosettaRNA</strong> (<a href=\"https://yanglab.qd.sdu.edu.cn/trRosettaRNA/\" target=\"_blank\">https://yanglab.qd.sdu.edu.cn/trRosettaRNA/</a>) has a nice server (&amp; training sets!) as well as downloadable code. The package has a neural network to predict distograms and other '2D' information about an RNA, which may be useful for comparison to Ribonanza chemical mapping data. These features are then used to build a 3D structure model in a process that is slower and not differentiable.</p>\n<p>• <strong>RhoFold</strong> (previously called E2Efold-3D) is end-to-end from sequence to 3D structure. It used to have a server and github repository, which are apparently under maintenance. You can access the previously public code through the notebook (<a href=\"https://www.kaggle.com/code/rhijudas/interactive-rhofold\" target=\"_blank\">https://www.kaggle.com/code/rhijudas/interactive-rhofold</a>) that <a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> and I set up!</p>\n<p>• <strong>RosettaFold2NA</strong> is another end-to-end differentiable model, and its training that includes not just RNA but also RNA-protein complexes, DNA, and more. It's available here: <a href=\"https://github.com/uw-ipd/RoseTTAFold2NA\" target=\"_blank\">https://github.com/uw-ipd/RoseTTAFold2NA</a>. </p>\n<p>• <strong>OpenComplex</strong> builds on the OpenFold framework and includes RNA. Code is here: <a href=\"https://github.com/baaihealth/OpenComplex\" target=\"_blank\">https://github.com/baaihealth/OpenComplex</a> </p>\n<p>• <strong>DeepFoldRNA</strong> is available for download and for server use here: <a href=\"https://zhanggroup.org/DeepFoldRNA/\" target=\"_blank\">https://zhanggroup.org/DeepFoldRNA/</a>. Similar to trRosettaRNA, it's not quite end-to-end, with an L-BGFS based 3D structure modeling part.</p>\n<p>There are other packages for fast and differentiable folding of 3D RNA structure emerging, too -- please post in this thread as you find them!</p>\n<p>Some additional notes/caveats:</p>\n<p>• None of the above packages natively predict chemical mapping data from their 2D features or 3D models. So using them to learn from Ribonanza data and to make submissions will require some additional development!</p>\n<p>• These packages only output a single structure, whereas many --perhaps most--  of the Ribonanza molecules actually form an ensemble of diverse 3D structures. If using the package output,  modeling may benefit from using dropout at inference time and train time to generate multiple structures. The predicted chemical mapping profiles corresponding to each of these structures could perhaps be averaged for comparison to experimental profiles.</p>\n<p>• Most of the above packages follow the lead of AlphaFold and RosettaFold for proteins -- they rely on the input sequence having many recognizable evolutionary homologs (so-called \"multiple sequence alignments\" or MSA's). These MSA's are <em>not</em> readily available for the majority of Ribonanza molecules, which are either non-natural (much of Eterna) or are not members of previously curated non-coding RNA families. To save time and enforce generality, you may wish to run the models above without the step of generating MSA's -- just input the target sequence as a single sequence MSA.</p>\n<p>• These neural packages did not do as well as expert human modelers in last year's <a href=\"https://doi.org/10.1002/prot.26602\" target=\"_blank\">CASP15 3D structure modeling competition</a>. But perhaps that's due to a data bottleneck that can be resolved with our efforts here in the Ribonanza challenge.</p>\n<p>Looking forward to seeing what you find!</p>",
      "rawMarkdown": "Here are some additional packages with downloadable code  that might be of interest:\n\n• **trRosettaRNA** (https://yanglab.qd.sdu.edu.cn/trRosettaRNA/) has a nice server (& training sets!) as well as downloadable code. The package has a neural network to predict distograms and other '2D' information about an RNA, which may be useful for comparison to Ribonanza chemical mapping data. These features are then used to build a 3D structure model in a process that is slower and not differentiable.\n\n• **RhoFold** (previously called E2Efold-3D) is end-to-end from sequence to 3D structure. It used to have a server and github repository, which are apparently under maintenance. You can access the previously public code through the notebook (https://www.kaggle.com/code/rhijudas/interactive-rhofold) that @shujun717 and I set up!\n\n• **RosettaFold2NA** is another end-to-end differentiable model, and its training that includes not just RNA but also RNA-protein complexes, DNA, and more. It's available here: https://github.com/uw-ipd/RoseTTAFold2NA. \n\n• **OpenComplex** builds on the OpenFold framework and includes RNA. Code is here: https://github.com/baaihealth/OpenComplex \n\n• **DeepFoldRNA** is available for download and for server use here: https://zhanggroup.org/DeepFoldRNA/. Similar to trRosettaRNA, it's not quite end-to-end, with an L-BGFS based 3D structure modeling part.\n\nThere are other packages for fast and differentiable folding of 3D RNA structure emerging, too -- please post in this thread as you find them!\n\nSome additional notes/caveats:\n\n• None of the above packages natively predict chemical mapping data from their 2D features or 3D models. So using them to learn from Ribonanza data and to make submissions will require some additional development!\n\n• These packages only output a single structure, whereas many --perhaps most--  of the Ribonanza molecules actually form an ensemble of diverse 3D structures. If using the package output,  modeling may benefit from using dropout at inference time and train time to generate multiple structures. The predicted chemical mapping profiles corresponding to each of these structures could perhaps be averaged for comparison to experimental profiles.\n\n• Most of the above packages follow the lead of AlphaFold and RosettaFold for proteins -- they rely on the input sequence having many recognizable evolutionary homologs (so-called \"multiple sequence alignments\" or MSA's). These MSA's are *not* readily available for the majority of Ribonanza molecules, which are either non-natural (much of Eterna) or are not members of previously curated non-coding RNA families. To save time and enforce generality, you may wish to run the models above without the step of generating MSA's -- just input the target sequence as a single sequence MSA.\n\n• These neural packages did not do as well as expert human modelers in last year's [CASP15 3D structure modeling competition](https://doi.org/10.1002/prot.26602). But perhaps that's due to a data bottleneck that can be resolved with our efforts here in the Ribonanza challenge.\n\n\nLooking forward to seeing what you find!",
      "votes": null
    },
    {
      "id": "2505760",
      "postDate": "10/30/2023 19:32:31",
      "content": "<p>Could you check the error messages? Thank you.</p>\n<p><a href=\"https://www.kaggle.com/crimson206/interactive-rhofold-errorlog\" target=\"_blank\">https://www.kaggle.com/crimson206/interactive-rhofold-errorlog</a></p>",
      "rawMarkdown": "Could you check the error messages? Thank you.\n\nhttps://www.kaggle.com/crimson206/interactive-rhofold-errorlog",
      "votes": null
    },
    {
      "id": "2505795",
      "postDate": "10/30/2023 20:17:26",
      "content": "<blockquote>\n  <p>As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data.</p>\n</blockquote>\n<p>Hi, thanks for the insightful post. <br>\nIs there a reason you only did 120k sequences? </p>\n<p>Would it be feasible for us to create the coordinates for all sequences, or at least all test sequences? </p>",
      "rawMarkdown": "> As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data.\n\nHi, thanks for the insightful post. \nIs there a reason you only did 120k sequences? \n\nWould it be feasible for us to create the coordinates for all sequences, or at least all test sequences?",
      "votes": null
    },
    {
      "id": "2505971",
      "postDate": "10/31/2023 02:49:11",
      "content": "<p>Thank you. How well do the simulated 3D structures correspond to real structures (seen in experiments)?</p>",
      "rawMarkdown": "Thank you. How well do the simulated 3D structures correspond to real structures (seen in experiments)?",
      "votes": null
    },
    {
      "id": "2506106",
      "postDate": "10/31/2023 05:20:35",
      "content": "<p>Interesting and timely post!  Had been looking at a paper suggested elsewhere in Discussion - <br>\nPhysics-aware Graph Neural Network for Accurate RNA 3D Structure Prediction<br>\n<a href=\"https://arxiv.org/abs/2210.16392\" target=\"_blank\">https://arxiv.org/abs/2210.16392</a><br>\nand code <a href=\"https://github.com/zetayue/Physics-aware-Multiplex-GNN\" target=\"_blank\">https://github.com/zetayue/Physics-aware-Multiplex-GNN</a></p>\n<p>The paper referenced ARES a neural network, the Atomic Rotationally Equivariant Scorer in Geometric deep learning of rna structure (Rhiju Das is one of the authors) <a href=\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9829186/\" target=\"_blank\">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9829186/</a>   and links to code in the references.</p>\n<p>Was considering how feasible these might be here.  If available RNA 3D structures can be leveraged in an easier more efficient way, need less resources than e.g. AlphaFold which has a scaled down version in <br>\n<a href=\"https://colab.research.google.com/github/deepmind/alphafold/blob/main/notebooks/AlphaFold.ipynb\" target=\"_blank\">https://colab.research.google.com/github/deepmind/alphafold/blob/main/notebooks/AlphaFold.ipynb</a></p>\n<p>Thanks for providing RhoFold, hit the not found 404 error previously looking for it.</p>",
      "rawMarkdown": "Interesting and timely post!  Had been looking at a paper suggested elsewhere in Discussion - \nPhysics-aware Graph Neural Network for Accurate RNA 3D Structure Prediction\nhttps://arxiv.org/abs/2210.16392\nand code https://github.com/zetayue/Physics-aware-Multiplex-GNN\n\nThe paper referenced ARES a neural network, the Atomic Rotationally Equivariant Scorer in Geometric deep learning of rna structure (Rhiju Das is one of the authors) https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9829186/   and links to code in the references.\n\nWas considering how feasible these might be here.  If available RNA 3D structures can be leveraged in an easier more efficient way, need less resources than e.g. AlphaFold which has a scaled down version in \nhttps://colab.research.google.com/github/deepmind/alphafold/blob/main/notebooks/AlphaFold.ipynb\n\nThanks for providing RhoFold, hit the not found 404 error previously looking for it.",
      "votes": null
    },
    {
      "id": "2506738",
      "postDate": "10/31/2023 14:09:06",
      "content": "<p>Thanks for flagging. There's a new version of the RhoFold notebook (<a href=\"https://www.kaggle.com/code/rhijudas/interactive-rhofold\" target=\"_blank\">link</a>) that should run all the way through without errors.</p>",
      "rawMarkdown": "Thanks for flagging. There's a new version of the RhoFold notebook ([link](https://www.kaggle.com/code/rhijudas/interactive-rhofold)) that should run all the way through without errors.",
      "votes": null
    },
    {
      "id": "2506883",
      "postDate": "10/31/2023 15:54:20",
      "content": "<p>Just out, new AlphaFold will include RNA 3D modeling, albeit not with human-competitive accuracy: <a href=\"https://deepmind.google/discover/blog/a-glimpse-of-the-next-generation-of-alphafold/\" target=\"_blank\">https://deepmind.google/discover/blog/a-glimpse-of-the-next-generation-of-alphafold/</a> <br>\nCode does not seem to be released yet, though!</p>",
      "rawMarkdown": "Just out, new AlphaFold will include RNA 3D modeling, albeit not with human-competitive accuracy: https://deepmind.google/discover/blog/a-glimpse-of-the-next-generation-of-alphafold/ \nCode does not seem to be released yet, though!",
      "votes": null
    },
    {
      "id": "2508708",
      "postDate": "11/01/2023 22:57:54",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> can you please give your opinion on performance of RHA Fold with and without MSA?</p>",
      "rawMarkdown": "shujun717 can you please give your opinion on performance of RHA Fold with and without MSA?",
      "votes": null
    },
    {
      "id": "2508724",
      "postDate": "11/02/2023 00:03:55",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> I ask you a favor, the dataset is uploaded as a zip within another zip so the PDBS files cannot be accessed when importing the dataset into the notebooks. Could you please upload it with a single zip level? Thank you so much !</p>",
      "rawMarkdown": "shujun717 I ask you a favor, the dataset is uploaded as a zip within another zip so the PDBS files cannot be accessed when importing the dataset into the notebooks. Could you please upload it with a single zip level? Thank you so much !",
      "votes": null
    },
    {
      "id": "2508736",
      "postDate": "11/02/2023 00:29:19",
      "content": "<p>I see. Will fix soon</p>",
      "rawMarkdown": "I see. Will fix soon",
      "votes": null
    },
    {
      "id": "2508738",
      "postDate": "11/02/2023 00:31:01",
      "content": "<p>I have used RhoFold's coordinates in some pre-testing with a very small subset of full training data and RhoFold coordinates provided some signal for modeling </p>",
      "rawMarkdown": "I have used RhoFold's coordinates in some pre-testing with a very small subset of full training data and RhoFold coordinates provided some signal for modeling",
      "votes": null
    },
    {
      "id": "2509518",
      "postDate": "11/02/2023 12:26:06",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a>  <a href=\"https://www.kaggle.com/lauraromar\" target=\"_blank\">@lauraromar</a> <br>\nhave added a notebook <a href=\"https://www.kaggle.com/code/something4kag/ribonanza-3d-coords-prep\" target=\"_blank\">https://www.kaggle.com/code/something4kag/ribonanza-3d-coords-prep</a><br>\nto extract the ribonanza-3d-coords dataset to a new zip with folders per sequence id using shutil<br>\nit also creates and saves a reduced version of train.csv for the sequence ids with PDBs</p>\n<p>there is a follow on notebook <a href=\"https://www.kaggle.com/something4kag/ribonanza-3d-coords-using-prep\" target=\"_blank\">https://www.kaggle.com/something4kag/ribonanza-3d-coords-using-prep</a><br>\nthat shows how to extract the zip in prep and an view example /unrelaxed_model.pdb for a sequence id </p>",
      "rawMarkdown": "shujun717  @lauraromar \nhave added a notebook https://www.kaggle.com/code/something4kag/ribonanza-3d-coords-prep\nto extract the ribonanza-3d-coords dataset to a new zip with folders per sequence id using shutil\nit also creates and saves a reduced version of train.csv for the sequence ids with PDBs\n\n\nthere is a follow on notebook https://www.kaggle.com/something4kag/ribonanza-3d-coords-using-prep\nthat shows how to extract the zip in prep and an view example /unrelaxed_model.pdb for a sequence id",
      "votes": null
    },
    {
      "id": "2509799",
      "postDate": "11/02/2023 14:56:39",
      "content": "<p>Did you create a contact matrix from the PDB files  ?</p>",
      "rawMarkdown": "Did you create a contact matrix from the PDB files  ?",
      "votes": null
    },
    {
      "id": "2510244",
      "postDate": "11/02/2023 20:25:15",
      "content": "<p>Thanks a lot!</p>",
      "rawMarkdown": "Thanks a lot!",
      "votes": null
    },
    {
      "id": "2510388",
      "postDate": "11/03/2023 00:31:44",
      "content": "<p>Yeah something similar to that</p>",
      "rawMarkdown": "Yeah something similar to that",
      "votes": null
    },
    {
      "id": "2511755",
      "postDate": "11/03/2023 23:21:40",
      "content": "<p>Thank you so much !</p>",
      "rawMarkdown": "Thank you so much !",
      "votes": null
    },
    {
      "id": "2532281",
      "postDate": "11/20/2023 22:49:11",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> , <a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> : how accurate can we expect these 3D coordinates to be, given that they come from RhoFold, itself a learned model? </p>",
      "rawMarkdown": "shujun717 , @rhijudas : how accurate can we expect these 3D coordinates to be, given that they come from RhoFold, itself a learned model?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2505758,
      "author_name": "rhijudas",
      "author_url": "",
      "post_date": "10/30/2023 19:29:57",
      "content": "<p>Here are some additional packages with downloadable code  that might be of interest:</p>\n<p>• <strong>trRosettaRNA</strong> (<a href=\"https://yanglab.qd.sdu.edu.cn/trRosettaRNA/\" target=\"_blank\">https://yanglab.qd.sdu.edu.cn/trRosettaRNA/</a>) has a nice server (&amp; training sets!) as well as downloadable code. The package has a neural network to predict distograms and other '2D' information about an RNA, which may be useful for comparison to Ribonanza chemical mapping data. These features are then used to build a 3D structure model in a process that is slower and not differentiable.</p>\n<p>• <strong>RhoFold</strong> (previously called E2Efold-3D) is end-to-end from sequence to 3D structure. It used to have a server and github repository, which are apparently under maintenance. You can access the previously public code through the notebook (<a href=\"https://www.kaggle.com/code/rhijudas/interactive-rhofold\" target=\"_blank\">https://www.kaggle.com/code/rhijudas/interactive-rhofold</a>) that <a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> and I set up!</p>\n<p>• <strong>RosettaFold2NA</strong> is another end-to-end differentiable model, and its training that includes not just RNA but also RNA-protein complexes, DNA, and more. It's available here: <a href=\"https://github.com/uw-ipd/RoseTTAFold2NA\" target=\"_blank\">https://github.com/uw-ipd/RoseTTAFold2NA</a>. </p>\n<p>• <strong>OpenComplex</strong> builds on the OpenFold framework and includes RNA. Code is here: <a href=\"https://github.com/baaihealth/OpenComplex\" target=\"_blank\">https://github.com/baaihealth/OpenComplex</a> </p>\n<p>• <strong>DeepFoldRNA</strong> is available for download and for server use here: <a href=\"https://zhanggroup.org/DeepFoldRNA/\" target=\"_blank\">https://zhanggroup.org/DeepFoldRNA/</a>. Similar to trRosettaRNA, it's not quite end-to-end, with an L-BGFS based 3D structure modeling part.</p>\n<p>There are other packages for fast and differentiable folding of 3D RNA structure emerging, too -- please post in this thread as you find them!</p>\n<p>Some additional notes/caveats:</p>\n<p>• None of the above packages natively predict chemical mapping data from their 2D features or 3D models. So using them to learn from Ribonanza data and to make submissions will require some additional development!</p>\n<p>• These packages only output a single structure, whereas many --perhaps most--  of the Ribonanza molecules actually form an ensemble of diverse 3D structures. If using the package output,  modeling may benefit from using dropout at inference time and train time to generate multiple structures. The predicted chemical mapping profiles corresponding to each of these structures could perhaps be averaged for comparison to experimental profiles.</p>\n<p>• Most of the above packages follow the lead of AlphaFold and RosettaFold for proteins -- they rely on the input sequence having many recognizable evolutionary homologs (so-called \"multiple sequence alignments\" or MSA's). These MSA's are <em>not</em> readily available for the majority of Ribonanza molecules, which are either non-natural (much of Eterna) or are not members of previously curated non-coding RNA families. To save time and enforce generality, you may wish to run the models above without the step of generating MSA's -- just input the target sequence as a single sequence MSA.</p>\n<p>• These neural packages did not do as well as expert human modelers in last year's <a href=\"https://doi.org/10.1002/prot.26602\" target=\"_blank\">CASP15 3D structure modeling competition</a>. But perhaps that's due to a data bottleneck that can be resolved with our efforts here in the Ribonanza challenge.</p>\n<p>Looking forward to seeing what you find!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2505760,
      "author_name": "",
      "author_url": "",
      "post_date": "10/30/2023 19:32:31",
      "content": "<p>Could you check the error messages? Thank you.</p>\n<p><a href=\"https://www.kaggle.com/crimson206/interactive-rhofold-errorlog\" target=\"_blank\">https://www.kaggle.com/crimson206/interactive-rhofold-errorlog</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2506738,
          "author_name": "rhijudas",
          "author_url": "",
          "post_date": "10/31/2023 14:09:06",
          "content": "<p>Thanks for flagging. There's a new version of the RhoFold notebook (<a href=\"https://www.kaggle.com/code/rhijudas/interactive-rhofold\" target=\"_blank\">link</a>) that should run all the way through without errors.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2510244,
              "author_name": "",
              "author_url": "",
              "post_date": "11/02/2023 20:25:15",
              "content": "<p>Thanks a lot!</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2505795,
      "author_name": "fnands",
      "author_url": "",
      "post_date": "10/30/2023 20:17:26",
      "content": "<blockquote>\n  <p>As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data.</p>\n</blockquote>\n<p>Hi, thanks for the insightful post. <br>\nIs there a reason you only did 120k sequences? </p>\n<p>Would it be feasible for us to create the coordinates for all sequences, or at least all test sequences? </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2505971,
      "author_name": "sapr3s",
      "author_url": "",
      "post_date": "10/31/2023 02:49:11",
      "content": "<p>Thank you. How well do the simulated 3D structures correspond to real structures (seen in experiments)?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2506106,
      "author_name": "something4kag",
      "author_url": "",
      "post_date": "10/31/2023 05:20:35",
      "content": "<p>Interesting and timely post!  Had been looking at a paper suggested elsewhere in Discussion - <br>\nPhysics-aware Graph Neural Network for Accurate RNA 3D Structure Prediction<br>\n<a href=\"https://arxiv.org/abs/2210.16392\" target=\"_blank\">https://arxiv.org/abs/2210.16392</a><br>\nand code <a href=\"https://github.com/zetayue/Physics-aware-Multiplex-GNN\" target=\"_blank\">https://github.com/zetayue/Physics-aware-Multiplex-GNN</a></p>\n<p>The paper referenced ARES a neural network, the Atomic Rotationally Equivariant Scorer in Geometric deep learning of rna structure (Rhiju Das is one of the authors) <a href=\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9829186/\" target=\"_blank\">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9829186/</a>   and links to code in the references.</p>\n<p>Was considering how feasible these might be here.  If available RNA 3D structures can be leveraged in an easier more efficient way, need less resources than e.g. AlphaFold which has a scaled down version in <br>\n<a href=\"https://colab.research.google.com/github/deepmind/alphafold/blob/main/notebooks/AlphaFold.ipynb\" target=\"_blank\">https://colab.research.google.com/github/deepmind/alphafold/blob/main/notebooks/AlphaFold.ipynb</a></p>\n<p>Thanks for providing RhoFold, hit the not found 404 error previously looking for it.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2506883,
      "author_name": "rhijudas",
      "author_url": "",
      "post_date": "10/31/2023 15:54:20",
      "content": "<p>Just out, new AlphaFold will include RNA 3D modeling, albeit not with human-competitive accuracy: <a href=\"https://deepmind.google/discover/blog/a-glimpse-of-the-next-generation-of-alphafold/\" target=\"_blank\">https://deepmind.google/discover/blog/a-glimpse-of-the-next-generation-of-alphafold/</a> <br>\nCode does not seem to be released yet, though!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2508708,
      "author_name": "salmanahmedtamu",
      "author_url": "",
      "post_date": "11/01/2023 22:57:54",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> can you please give your opinion on performance of RHA Fold with and without MSA?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2508738,
          "author_name": "shujun717",
          "author_url": "",
          "post_date": "11/02/2023 00:31:01",
          "content": "<p>I have used RhoFold's coordinates in some pre-testing with a very small subset of full training data and RhoFold coordinates provided some signal for modeling </p>",
          "votes": null,
          "replies": [
            {
              "id": 2509799,
              "author_name": "mtinti",
              "author_url": "",
              "post_date": "11/02/2023 14:56:39",
              "content": "<p>Did you create a contact matrix from the PDB files  ?</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2510388,
                  "author_name": "shujun717",
                  "author_url": "",
                  "post_date": "11/03/2023 00:31:44",
                  "content": "<p>Yeah something similar to that</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 2508724,
      "author_name": "lauraromar",
      "author_url": "",
      "post_date": "11/02/2023 00:03:55",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> I ask you a favor, the dataset is uploaded as a zip within another zip so the PDBS files cannot be accessed when importing the dataset into the notebooks. Could you please upload it with a single zip level? Thank you so much !</p>",
      "votes": null,
      "replies": [
        {
          "id": 2508736,
          "author_name": "shujun717",
          "author_url": "",
          "post_date": "11/02/2023 00:29:19",
          "content": "<p>I see. Will fix soon</p>",
          "votes": null,
          "replies": [
            {
              "id": 2509518,
              "author_name": "something4kag",
              "author_url": "",
              "post_date": "11/02/2023 12:26:06",
              "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a>  <a href=\"https://www.kaggle.com/lauraromar\" target=\"_blank\">@lauraromar</a> <br>\nhave added a notebook <a href=\"https://www.kaggle.com/code/something4kag/ribonanza-3d-coords-prep\" target=\"_blank\">https://www.kaggle.com/code/something4kag/ribonanza-3d-coords-prep</a><br>\nto extract the ribonanza-3d-coords dataset to a new zip with folders per sequence id using shutil<br>\nit also creates and saves a reduced version of train.csv for the sequence ids with PDBs</p>\n<p>there is a follow on notebook <a href=\"https://www.kaggle.com/something4kag/ribonanza-3d-coords-using-prep\" target=\"_blank\">https://www.kaggle.com/something4kag/ribonanza-3d-coords-using-prep</a><br>\nthat shows how to extract the zip in prep and an view example /unrelaxed_model.pdb for a sequence id </p>",
              "votes": null,
              "replies": [
                {
                  "id": 2511755,
                  "author_name": "lauraromar",
                  "author_url": "",
                  "post_date": "11/03/2023 23:21:40",
                  "content": "<p>Thank you so much !</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 2532281,
      "author_name": "fnands",
      "author_url": "",
      "post_date": "11/20/2023 22:49:11",
      "content": "<p><a href=\"https://www.kaggle.com/shujun717\" target=\"_blank\">@shujun717</a> , <a href=\"https://www.kaggle.com/rhijudas\" target=\"_blank\">@rhijudas</a> : how accurate can we expect these 3D coordinates to be, given that they come from RhoFold, itself a learned model? </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2505739": "A key goal of this competition is to develop models that understand 3D structures of RNA and we think it might also help to use existing 3D structure prediction models to generate 3D coordinates to model the data in Ribonanza. As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data. These can be accessed at:\nhttps://www.kaggle.com/datasets/shujun717/ribonanza-3d-coords\n\nEach folder is named by `sequence_id` and `unrelaxed_model.pdb` has the 3D coordinates predicted by RhoFold. We hope that this will help your modeling efforts! \n\n@rhijudas has also made a notebook showing how to install RhoFold and visualize 3D structures: \n https://www.kaggle.com/code/rhijudas/interactive-rhofold\n\nVideo lecture from @rhijudas on 3D structure prediction and how Ribonanza can help us create an Alphafold moment for RNA:\nhttps://www.youtube.com/watch?v=R6-MwrGkj7M&t=95s&ab_channel=CASPRNASIG\nRhoFold paper:\nhttps://arxiv.org/abs/2207.01586",
    "2505758": "Here are some additional packages with downloadable code  that might be of interest:\n\n• **trRosettaRNA** (https://yanglab.qd.sdu.edu.cn/trRosettaRNA/) has a nice server (& training sets!) as well as downloadable code. The package has a neural network to predict distograms and other '2D' information about an RNA, which may be useful for comparison to Ribonanza chemical mapping data. These features are then used to build a 3D structure model in a process that is slower and not differentiable.\n\n• **RhoFold** (previously called E2Efold-3D) is end-to-end from sequence to 3D structure. It used to have a server and github repository, which are apparently under maintenance. You can access the previously public code through the notebook (https://www.kaggle.com/code/rhijudas/interactive-rhofold) that @shujun717 and I set up!\n\n• **RosettaFold2NA** is another end-to-end differentiable model, and its training that includes not just RNA but also RNA-protein complexes, DNA, and more. It's available here: https://github.com/uw-ipd/RoseTTAFold2NA. \n\n• **OpenComplex** builds on the OpenFold framework and includes RNA. Code is here: https://github.com/baaihealth/OpenComplex \n\n• **DeepFoldRNA** is available for download and for server use here: https://zhanggroup.org/DeepFoldRNA/. Similar to trRosettaRNA, it's not quite end-to-end, with an L-BGFS based 3D structure modeling part.\n\nThere are other packages for fast and differentiable folding of 3D RNA structure emerging, too -- please post in this thread as you find them!\n\nSome additional notes/caveats:\n\n• None of the above packages natively predict chemical mapping data from their 2D features or 3D models. So using them to learn from Ribonanza data and to make submissions will require some additional development!\n\n• These packages only output a single structure, whereas many --perhaps most--  of the Ribonanza molecules actually form an ensemble of diverse 3D structures. If using the package output,  modeling may benefit from using dropout at inference time and train time to generate multiple structures. The predicted chemical mapping profiles corresponding to each of these structures could perhaps be averaged for comparison to experimental profiles.\n\n• Most of the above packages follow the lead of AlphaFold and RosettaFold for proteins -- they rely on the input sequence having many recognizable evolutionary homologs (so-called \"multiple sequence alignments\" or MSA's). These MSA's are *not* readily available for the majority of Ribonanza molecules, which are either non-natural (much of Eterna) or are not members of previously curated non-coding RNA families. To save time and enforce generality, you may wish to run the models above without the step of generating MSA's -- just input the target sequence as a single sequence MSA.\n\n• These neural packages did not do as well as expert human modelers in last year's [CASP15 3D structure modeling competition](https://doi.org/10.1002/prot.26602). But perhaps that's due to a data bottleneck that can be resolved with our efforts here in the Ribonanza challenge.\n\n\nLooking forward to seeing what you find!",
    "2505760": "Could you check the error messages? Thank you.\n\nhttps://www.kaggle.com/crimson206/interactive-rhofold-errorlog",
    "2505795": "> As a result, we have generated 3D coordinates with RhoFold for a subset (~120k sequences) of the Ribonanza data.\n\nHi, thanks for the insightful post. \nIs there a reason you only did 120k sequences? \n\nWould it be feasible for us to create the coordinates for all sequences, or at least all test sequences?",
    "2505971": "Thank you. How well do the simulated 3D structures correspond to real structures (seen in experiments)?",
    "2506106": "Interesting and timely post!  Had been looking at a paper suggested elsewhere in Discussion - \nPhysics-aware Graph Neural Network for Accurate RNA 3D Structure Prediction\nhttps://arxiv.org/abs/2210.16392\nand code https://github.com/zetayue/Physics-aware-Multiplex-GNN\n\nThe paper referenced ARES a neural network, the Atomic Rotationally Equivariant Scorer in Geometric deep learning of rna structure (Rhiju Das is one of the authors) https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9829186/   and links to code in the references.\n\nWas considering how feasible these might be here.  If available RNA 3D structures can be leveraged in an easier more efficient way, need less resources than e.g. AlphaFold which has a scaled down version in \nhttps://colab.research.google.com/github/deepmind/alphafold/blob/main/notebooks/AlphaFold.ipynb\n\nThanks for providing RhoFold, hit the not found 404 error previously looking for it.",
    "2506738": "Thanks for flagging. There's a new version of the RhoFold notebook ([link](https://www.kaggle.com/code/rhijudas/interactive-rhofold)) that should run all the way through without errors.",
    "2506883": "Just out, new AlphaFold will include RNA 3D modeling, albeit not with human-competitive accuracy: https://deepmind.google/discover/blog/a-glimpse-of-the-next-generation-of-alphafold/ \nCode does not seem to be released yet, though!",
    "2508708": "shujun717 can you please give your opinion on performance of RHA Fold with and without MSA?",
    "2508724": "shujun717 I ask you a favor, the dataset is uploaded as a zip within another zip so the PDBS files cannot be accessed when importing the dataset into the notebooks. Could you please upload it with a single zip level? Thank you so much !",
    "2508736": "I see. Will fix soon",
    "2508738": "I have used RhoFold's coordinates in some pre-testing with a very small subset of full training data and RhoFold coordinates provided some signal for modeling",
    "2509518": "shujun717  @lauraromar \nhave added a notebook https://www.kaggle.com/code/something4kag/ribonanza-3d-coords-prep\nto extract the ribonanza-3d-coords dataset to a new zip with folders per sequence id using shutil\nit also creates and saves a reduced version of train.csv for the sequence ids with PDBs\n\n\nthere is a follow on notebook https://www.kaggle.com/something4kag/ribonanza-3d-coords-using-prep\nthat shows how to extract the zip in prep and an view example /unrelaxed_model.pdb for a sequence id",
    "2509799": "Did you create a contact matrix from the PDB files  ?",
    "2510244": "Thanks a lot!",
    "2510388": "Yeah something similar to that",
    "2511755": "Thank you so much !",
    "2532281": "shujun717 , @rhijudas : how accurate can we expect these 3D coordinates to be, given that they come from RhoFold, itself a learned model?"
  },
  "source": "meta"
}