{
  "id": 460193,
  "title": "Visualizing the leaderboard dynamics",
  "url": "/competitions/stanford-ribonanza-rna-folding/discussion/460193",
  "author_name": "",
  "post_date": "2023-12-08T06:35:39.056294100Z",
  "votes": 33,
  "comment_count": 13,
  "views": 0,
  "content": "<p>Hello all,</p>\n<p>I visualized the leaderboard dynamics and have the below inferences. I split the leaderboard into the below 5 regions highlighting collective behavioral traits-</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5643155283a399e30c9a5bf9ef931e49%2FRNA.jpg?generation=1702016827519889&amp;alt=media\" alt=\"\"></p>\n<table>\n<thead>\n<tr>\n<th>Region</th>\n<th>Sub-region</th>\n<th>Inference/ Comments</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>Region 1</td>\n<td></td>\n<td>* Relatively stable and top solutions, enabling a medal in the competition. Hearty congratulations to these participants</td>\n</tr>\n<tr>\n<td>Region 2</td>\n<td></td>\n<td>* This is an interesting region as it perhaps indicates submissions off public work/ similar ideas with little modification.  <br>* These submissions elicit stickiness across various ranks and scores</td>\n</tr>\n<tr>\n<td>Region 3</td>\n<td>3A</td>\n<td>* These submissions were highly impacted by the churn</td>\n</tr>\n<tr>\n<td>Region 3</td>\n<td>3B</td>\n<td>* These submissions were moderately impacted by the churn</td>\n</tr>\n<tr>\n<td>Region 3</td>\n<td>3C</td>\n<td>* These submissions were impacted by the churn <br> * These participants missed out on medals too</td>\n</tr>\n<tr>\n<td>Region 4</td>\n<td>4A</td>\n<td>* These submissions were positively impacted by the churn <br> * These participants received medals from positions just out of the medal zone</td>\n</tr>\n<tr>\n<td>Region 4</td>\n<td>4B</td>\n<td>* These submissions were highly positively impacted by the churn <br> * These participants received medals from positions far out of the medal zone <br> * Hearty congratulations to these participants</td>\n</tr>\n<tr>\n<td>Region 5</td>\n<td></td>\n<td>* These submissions were also highly positively impacted by the churn <br> * These participants did not receive medals but ascended highly from a moderate public LB position to a good private LB position <br> * Hearty congratulations to these participants as well</td>\n</tr>\n</tbody>\n</table>\n<p><br>Happy learning and best wishes!</p>",
  "messages": [
    {
      "id": "2553322",
      "postDate": "12/08/2023 06:35:39",
      "content": "<p>Hello all,</p>\n<p>I visualized the leaderboard dynamics and have the below inferences. I split the leaderboard into the below 5 regions highlighting collective behavioral traits-</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5643155283a399e30c9a5bf9ef931e49%2FRNA.jpg?generation=1702016827519889&amp;alt=media\" alt=\"\"></p>\n<table>\n<thead>\n<tr>\n<th>Region</th>\n<th>Sub-region</th>\n<th>Inference/ Comments</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>Region 1</td>\n<td></td>\n<td>* Relatively stable and top solutions, enabling a medal in the competition. Hearty congratulations to these participants</td>\n</tr>\n<tr>\n<td>Region 2</td>\n<td></td>\n<td>* This is an interesting region as it perhaps indicates submissions off public work/ similar ideas with little modification.  <br>* These submissions elicit stickiness across various ranks and scores</td>\n</tr>\n<tr>\n<td>Region 3</td>\n<td>3A</td>\n<td>* These submissions were highly impacted by the churn</td>\n</tr>\n<tr>\n<td>Region 3</td>\n<td>3B</td>\n<td>* These submissions were moderately impacted by the churn</td>\n</tr>\n<tr>\n<td>Region 3</td>\n<td>3C</td>\n<td>* These submissions were impacted by the churn <br> * These participants missed out on medals too</td>\n</tr>\n<tr>\n<td>Region 4</td>\n<td>4A</td>\n<td>* These submissions were positively impacted by the churn <br> * These participants received medals from positions just out of the medal zone</td>\n</tr>\n<tr>\n<td>Region 4</td>\n<td>4B</td>\n<td>* These submissions were highly positively impacted by the churn <br> * These participants received medals from positions far out of the medal zone <br> * Hearty congratulations to these participants</td>\n</tr>\n<tr>\n<td>Region 5</td>\n<td></td>\n<td>* These submissions were also highly positively impacted by the churn <br> * These participants did not receive medals but ascended highly from a moderate public LB position to a good private LB position <br> * Hearty congratulations to these participants as well</td>\n</tr>\n</tbody>\n</table>\n<p><br>Happy learning and best wishes!</p>",
      "rawMarkdown": "Hello all,\n\nI visualized the leaderboard dynamics and have the below inferences. I split the leaderboard into the below 5 regions highlighting collective behavioral traits-\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5643155283a399e30c9a5bf9ef931e49%2FRNA.jpg?generation=1702016827519889&alt=media)\n\n| Region | Sub-region| Inference/ Comments |\n| --- | --- |---|\n| Region 1 ||* Relatively stable and top solutions, enabling a medal in the competition. Hearty congratulations to these participants |\n| Region 2 | |* This is an interesting region as it perhaps indicates submissions off public work/ similar ideas with little modification.  <br>* These submissions elicit stickiness across various ranks and scores |\n| Region 3 | 3A|* These submissions were highly impacted by the churn |\n| Region 3 | 3B|* These submissions were moderately impacted by the churn |\n| Region 3 | 3C|* These submissions were impacted by the churn <br> * These participants missed out on medals too|\n| Region 4 | 4A|* These submissions were positively impacted by the churn <br> * These participants received medals from positions just out of the medal zone|\n| Region 4 | 4B|* These submissions were highly positively impacted by the churn <br> * These participants received medals from positions far out of the medal zone <br> * Hearty congratulations to these participants|\n| Region 5 | |* These submissions were also highly positively impacted by the churn <br> * These participants did not receive medals but ascended highly from a moderate public LB position to a good private LB position <br> * Hearty congratulations to these participants as well|\n\n<br>Happy learning and best wishes!",
      "votes": null
    },
    {
      "id": "2553328",
      "postDate": "12/08/2023 06:44:54",
      "content": "<p>Dear <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a> </p>\n<p>The Region 2 look like <a href=\"https://www.kaggle.com/code/carlmcbrideellis/shakeup-scatterplots-boxes-strings-and-things/notebook\" target=\"_blank\">isoscore strings</a></p>\n<p>All the best,<br>\ncarl</p>",
      "rawMarkdown": "Dear @ravi20076 \n\nThe Region 2 look like [isoscore strings](https://www.kaggle.com/code/carlmcbrideellis/shakeup-scatterplots-boxes-strings-and-things/notebook)\n\nAll the best,\ncarl",
      "votes": null
    },
    {
      "id": "2553335",
      "postDate": "12/08/2023 06:54:49",
      "content": "<p>Thanks for sharing your analysis. <br>\nI think its a nice game of overfitting and underfitting.<br>\nThe ranks in   region 3A and 4B are very interesting indeed.  </p>",
      "rawMarkdown": "Thanks for sharing your analysis. \nI think its a nice game of overfitting and underfitting.\nThe ranks in   region 3A and 4B are very interesting indeed.",
      "votes": null
    },
    {
      "id": "2553353",
      "postDate": "12/08/2023 07:17:32",
      "content": "<p>My guess- 3A had good models (probably including bpp) with some variant of absolute positional encoding. 4B had not-so-good models, probably also without bpp, but with relative positional encoding or some variant of CNN that could generalize to longer seqs.</p>",
      "rawMarkdown": "My guess- 3A had good models (probably including bpp) with some variant of absolute positional encoding. 4B had not-so-good models, probably also without bpp, but with relative positional encoding or some variant of CNN that could generalize to longer seqs.",
      "votes": null
    },
    {
      "id": "2553485",
      "postDate": "12/08/2023 09:39:01",
      "content": "<p>Thanks for sharing <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a>. Very nice analysis ✨</p>",
      "rawMarkdown": "Thanks for sharing @ravi20076. Very nice analysis ✨",
      "votes": null
    },
    {
      "id": "2553621",
      "postDate": "12/08/2023 11:58:43",
      "content": "<p>Thanks for sharing <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a>, this is interesting!</p>",
      "rawMarkdown": "Thanks for sharing @ravi20076, this is interesting!",
      "votes": null
    },
    {
      "id": "2554107",
      "postDate": "12/08/2023 19:35:21",
      "content": "<p>Thanks for the analysis.</p>",
      "rawMarkdown": "Thanks for the analysis.",
      "votes": null
    },
    {
      "id": "2554491",
      "postDate": "12/09/2023 06:54:34",
      "content": "<p>Nice analysis sir! Very insightful </p>",
      "rawMarkdown": "Nice analysis sir! Very insightful",
      "votes": null
    },
    {
      "id": "2555425",
      "postDate": "12/09/2023 21:58:40",
      "content": "<p>Specifically, I think it corresponds to the notebooks with scores:</p>\n<p>Public 0.15472 Private 0.26885<br>\nPublic 0.18588 Private 0.23524<br>\nPublic 0.33975 Private 0.33290</p>",
      "rawMarkdown": "Specifically, I think it corresponds to the notebooks with scores:\n\nPublic 0.15472 Private 0.26885\nPublic 0.18588 Private 0.23524\nPublic 0.33975 Private 0.33290",
      "votes": null
    },
    {
      "id": "2555506",
      "postDate": "12/10/2023 01:15:28",
      "content": "<p>Beautiful Visualization! Keep it up Ravi! Was this done in R?</p>",
      "rawMarkdown": "Beautiful Visualization! Keep it up Ravi! Was this done in R?",
      "votes": null
    },
    {
      "id": "2556106",
      "postDate": "12/10/2023 13:19:14",
      "content": "<p>Great analysis <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a> </p>",
      "rawMarkdown": "Great analysis @ravi20076",
      "votes": null
    },
    {
      "id": "2556934",
      "postDate": "12/11/2023 05:01:06",
      "content": "<p>No it was done in excel <a href=\"https://www.kaggle.com/dtrade84\" target=\"_blank\">@dtrade84</a> </p>",
      "rawMarkdown": "No it was done in excel @dtrade84",
      "votes": null
    },
    {
      "id": "2560407",
      "postDate": "12/13/2023 15:41:36",
      "content": "<p>Great analysis! Can you please define the meaning of churn in this context?</p>",
      "rawMarkdown": "Great analysis! Can you please define the meaning of churn in this context?",
      "votes": null
    },
    {
      "id": "2563777",
      "postDate": "12/16/2023 15:21:45",
      "content": "<p><a href=\"https://www.kaggle.com/seanbearden\" target=\"_blank\">@seanbearden</a> this is just a change from public-private scoring.</p>",
      "rawMarkdown": "seanbearden this is just a change from public-private scoring.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2553328,
      "author_name": "carlmcbrideellis",
      "author_url": "",
      "post_date": "12/08/2023 06:44:54",
      "content": "<p>Dear <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a> </p>\n<p>The Region 2 look like <a href=\"https://www.kaggle.com/code/carlmcbrideellis/shakeup-scatterplots-boxes-strings-and-things/notebook\" target=\"_blank\">isoscore strings</a></p>\n<p>All the best,<br>\ncarl</p>",
      "votes": null,
      "replies": [
        {
          "id": 2555425,
          "author_name": "jbomitchell",
          "author_url": "",
          "post_date": "12/09/2023 21:58:40",
          "content": "<p>Specifically, I think it corresponds to the notebooks with scores:</p>\n<p>Public 0.15472 Private 0.26885<br>\nPublic 0.18588 Private 0.23524<br>\nPublic 0.33975 Private 0.33290</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2553335,
      "author_name": "crsuthikshnkumar",
      "author_url": "",
      "post_date": "12/08/2023 06:54:49",
      "content": "<p>Thanks for sharing your analysis. <br>\nI think its a nice game of overfitting and underfitting.<br>\nThe ranks in   region 3A and 4B are very interesting indeed.  </p>",
      "votes": null,
      "replies": [
        {
          "id": 2553353,
          "author_name": "shlomoron",
          "author_url": "",
          "post_date": "12/08/2023 07:17:32",
          "content": "<p>My guess- 3A had good models (probably including bpp) with some variant of absolute positional encoding. 4B had not-so-good models, probably also without bpp, but with relative positional encoding or some variant of CNN that could generalize to longer seqs.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2553485,
      "author_name": "redpen12",
      "author_url": "",
      "post_date": "12/08/2023 09:39:01",
      "content": "<p>Thanks for sharing <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a>. Very nice analysis ✨</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2553621,
      "author_name": "pranshubahadur",
      "author_url": "",
      "post_date": "12/08/2023 11:58:43",
      "content": "<p>Thanks for sharing <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a>, this is interesting!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2554107,
      "author_name": "nikhil9084",
      "author_url": "",
      "post_date": "12/08/2023 19:35:21",
      "content": "<p>Thanks for the analysis.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2554491,
      "author_name": "abhasmalguri",
      "author_url": "",
      "post_date": "12/09/2023 06:54:34",
      "content": "<p>Nice analysis sir! Very insightful </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2555506,
      "author_name": "dtrade84",
      "author_url": "",
      "post_date": "12/10/2023 01:15:28",
      "content": "<p>Beautiful Visualization! Keep it up Ravi! Was this done in R?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2556934,
          "author_name": "ravi20076",
          "author_url": "",
          "post_date": "12/11/2023 05:01:06",
          "content": "<p>No it was done in excel <a href=\"https://www.kaggle.com/dtrade84\" target=\"_blank\">@dtrade84</a> </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2556106,
      "author_name": "dishaagarwal7001",
      "author_url": "",
      "post_date": "12/10/2023 13:19:14",
      "content": "<p>Great analysis <a href=\"https://www.kaggle.com/ravi20076\" target=\"_blank\">@ravi20076</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2560407,
      "author_name": "seanbearden",
      "author_url": "",
      "post_date": "12/13/2023 15:41:36",
      "content": "<p>Great analysis! Can you please define the meaning of churn in this context?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2563777,
          "author_name": "ravi20076",
          "author_url": "",
          "post_date": "12/16/2023 15:21:45",
          "content": "<p><a href=\"https://www.kaggle.com/seanbearden\" target=\"_blank\">@seanbearden</a> this is just a change from public-private scoring.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2553322": "Hello all,\n\nI visualized the leaderboard dynamics and have the below inferences. I split the leaderboard into the below 5 regions highlighting collective behavioral traits-\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5643155283a399e30c9a5bf9ef931e49%2FRNA.jpg?generation=1702016827519889&alt=media)\n\n| Region | Sub-region| Inference/ Comments |\n| --- | --- |---|\n| Region 1 ||* Relatively stable and top solutions, enabling a medal in the competition. Hearty congratulations to these participants |\n| Region 2 | |* This is an interesting region as it perhaps indicates submissions off public work/ similar ideas with little modification.  <br>* These submissions elicit stickiness across various ranks and scores |\n| Region 3 | 3A|* These submissions were highly impacted by the churn |\n| Region 3 | 3B|* These submissions were moderately impacted by the churn |\n| Region 3 | 3C|* These submissions were impacted by the churn <br> * These participants missed out on medals too|\n| Region 4 | 4A|* These submissions were positively impacted by the churn <br> * These participants received medals from positions just out of the medal zone|\n| Region 4 | 4B|* These submissions were highly positively impacted by the churn <br> * These participants received medals from positions far out of the medal zone <br> * Hearty congratulations to these participants|\n| Region 5 | |* These submissions were also highly positively impacted by the churn <br> * These participants did not receive medals but ascended highly from a moderate public LB position to a good private LB position <br> * Hearty congratulations to these participants as well|\n\n<br>Happy learning and best wishes!",
    "2553328": "Dear @ravi20076 \n\nThe Region 2 look like [isoscore strings](https://www.kaggle.com/code/carlmcbrideellis/shakeup-scatterplots-boxes-strings-and-things/notebook)\n\nAll the best,\ncarl",
    "2553335": "Thanks for sharing your analysis. \nI think its a nice game of overfitting and underfitting.\nThe ranks in   region 3A and 4B are very interesting indeed.",
    "2553353": "My guess- 3A had good models (probably including bpp) with some variant of absolute positional encoding. 4B had not-so-good models, probably also without bpp, but with relative positional encoding or some variant of CNN that could generalize to longer seqs.",
    "2553485": "Thanks for sharing @ravi20076. Very nice analysis ✨",
    "2553621": "Thanks for sharing @ravi20076, this is interesting!",
    "2554107": "Thanks for the analysis.",
    "2554491": "Nice analysis sir! Very insightful",
    "2555425": "Specifically, I think it corresponds to the notebooks with scores:\n\nPublic 0.15472 Private 0.26885\nPublic 0.18588 Private 0.23524\nPublic 0.33975 Private 0.33290",
    "2555506": "Beautiful Visualization! Keep it up Ravi! Was this done in R?",
    "2556106": "Great analysis @ravi20076",
    "2556934": "No it was done in excel @dtrade84",
    "2560407": "Great analysis! Can you please define the meaning of churn in this context?",
    "2563777": "seanbearden this is just a change from public-private scoring."
  },
  "source": "meta"
}