{
  "id": 539456,
  "title": "Inferring the churn",
  "url": "/competitions/rsna-2024-lumbar-spine-degenerative-classification/discussion/539456",
  "author_name": "",
  "post_date": "2024-10-09T02:35:46.823255100Z",
  "votes": 14,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hello all,</p>\n<p>This competition has a low-moderate churn overall as indicated in the figure below. Let's delve into the regions of interest - </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5ce2c9744622bb61419fa9412a9f6c80%2Flb.png?generation=1728439994521133&amp;alt=media\" alt=\"\"></p>\n<p><br></p>\n<h2>Regions of interest</h2>\n<table>\n<thead>\n<tr>\n<th>Region Label</th>\n<th>My comments</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>R1</td>\n<td>* Roughly indicates the medal zone that remained stable across the public and private leaderboards <br> * This is a dense region, indicating a good level of stability, but local shifts in ranks have occurred. We will assess this below <br> * Hearty congratulations to these participants!</td>\n</tr>\n<tr>\n<td>R2</td>\n<td>* Roughly indicates the group of participants who fell off the perch from the public leaderboard to the private leaderboard. <br> * Perhaps this could be due to code bugs, overfitting, post-processing that did not work, etc.  <br> * This is a relatively lowly populated and occurs with the participants in the public LB bronze region, indicating some level of stability across the top solutions</td>\n</tr>\n<tr>\n<td>R3</td>\n<td>* Congratulations to these participants for beating the churn and moving up to end up in the medal zone! <br> * This is a small region like R2 and is a strong indicator of overall stability</td>\n</tr>\n<tr>\n<td>R4</td>\n<td>* This indicates some level of shakeups in the non-medal zone - this is slightly different from R2 - shakeup from medal-non-medal region and is represented separately</td>\n</tr>\n</tbody>\n</table>\n<h2>Analysis of medal zone participants</h2>\n<table>\n<thead>\n<tr>\n<th>Medal region</th>\n<th>Last rank</th>\n<th>Submissions (min-mean-max)</th>\n<th>Comments - stability and churn</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>Gold medal</td>\n<td>13</td>\n<td>17 - 73.85 - 154</td>\n<td>* Stable teams = 11 <br> * Teams entering from below = 2</td>\n</tr>\n<tr>\n<td>Silver medal</td>\n<td>95</td>\n<td>6 - 50.53 - 169</td>\n<td>* Stable teams = 66 <br> * Teams entering from below = 14 <br> * Teams entering from above = 2</td>\n</tr>\n<tr>\n<td>Bronze medal</td>\n<td>191</td>\n<td>4 - 46 - 114</td>\n<td>* Stable teams = 51 <br> * Teams entering from below = 32 <br> * Teams entering from above = 13</td>\n</tr>\n</tbody>\n</table>\n<h2>Some other noteworthy measures</h2>\n<table>\n<thead>\n<tr>\n<th>Scenario</th>\n<th>Public LB rank</th>\n<th>Private LB rank</th>\n<th>Additional comments</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>Best single submission rank</td>\n<td>657</td>\n<td>176</td>\n<td>Special congratulations to this participant for submitting just once to secure a bronze medal!</td>\n</tr>\n<tr>\n<td>Best rank with 2 submissions</td>\n<td>501</td>\n<td>161</td>\n<td>Special congratulations to this participant for submitting just 2 times to secure a bronze medal!</td>\n</tr>\n<tr>\n<td>Best riser across the leaderboards</td>\n<td>667</td>\n<td>152</td>\n<td>Special congratulations to this participant for rising so highly across the leaderboards to land a bronze medal too!</td>\n</tr>\n<tr>\n<td>Maximum fall across public-private leaderboards</td>\n<td>359</td>\n<td>1812</td>\n<td></td>\n</tr>\n</tbody>\n</table>\n<h2>Conclusion</h2>\n<p>Wishing you the best for your future, happy learning and best regards!</p>",
  "messages": [
    {
      "id": "3012400",
      "postDate": "10/09/2024 02:35:46",
      "content": "<p>Hello all,</p>\n<p>This competition has a low-moderate churn overall as indicated in the figure below. Let's delve into the regions of interest - </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5ce2c9744622bb61419fa9412a9f6c80%2Flb.png?generation=1728439994521133&amp;alt=media\" alt=\"\"></p>\n<p><br></p>\n<h2>Regions of interest</h2>\n<table>\n<thead>\n<tr>\n<th>Region Label</th>\n<th>My comments</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>R1</td>\n<td>* Roughly indicates the medal zone that remained stable across the public and private leaderboards <br> * This is a dense region, indicating a good level of stability, but local shifts in ranks have occurred. We will assess this below <br> * Hearty congratulations to these participants!</td>\n</tr>\n<tr>\n<td>R2</td>\n<td>* Roughly indicates the group of participants who fell off the perch from the public leaderboard to the private leaderboard. <br> * Perhaps this could be due to code bugs, overfitting, post-processing that did not work, etc.  <br> * This is a relatively lowly populated and occurs with the participants in the public LB bronze region, indicating some level of stability across the top solutions</td>\n</tr>\n<tr>\n<td>R3</td>\n<td>* Congratulations to these participants for beating the churn and moving up to end up in the medal zone! <br> * This is a small region like R2 and is a strong indicator of overall stability</td>\n</tr>\n<tr>\n<td>R4</td>\n<td>* This indicates some level of shakeups in the non-medal zone - this is slightly different from R2 - shakeup from medal-non-medal region and is represented separately</td>\n</tr>\n</tbody>\n</table>\n<h2>Analysis of medal zone participants</h2>\n<table>\n<thead>\n<tr>\n<th>Medal region</th>\n<th>Last rank</th>\n<th>Submissions (min-mean-max)</th>\n<th>Comments - stability and churn</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>Gold medal</td>\n<td>13</td>\n<td>17 - 73.85 - 154</td>\n<td>* Stable teams = 11 <br> * Teams entering from below = 2</td>\n</tr>\n<tr>\n<td>Silver medal</td>\n<td>95</td>\n<td>6 - 50.53 - 169</td>\n<td>* Stable teams = 66 <br> * Teams entering from below = 14 <br> * Teams entering from above = 2</td>\n</tr>\n<tr>\n<td>Bronze medal</td>\n<td>191</td>\n<td>4 - 46 - 114</td>\n<td>* Stable teams = 51 <br> * Teams entering from below = 32 <br> * Teams entering from above = 13</td>\n</tr>\n</tbody>\n</table>\n<h2>Some other noteworthy measures</h2>\n<table>\n<thead>\n<tr>\n<th>Scenario</th>\n<th>Public LB rank</th>\n<th>Private LB rank</th>\n<th>Additional comments</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>Best single submission rank</td>\n<td>657</td>\n<td>176</td>\n<td>Special congratulations to this participant for submitting just once to secure a bronze medal!</td>\n</tr>\n<tr>\n<td>Best rank with 2 submissions</td>\n<td>501</td>\n<td>161</td>\n<td>Special congratulations to this participant for submitting just 2 times to secure a bronze medal!</td>\n</tr>\n<tr>\n<td>Best riser across the leaderboards</td>\n<td>667</td>\n<td>152</td>\n<td>Special congratulations to this participant for rising so highly across the leaderboards to land a bronze medal too!</td>\n</tr>\n<tr>\n<td>Maximum fall across public-private leaderboards</td>\n<td>359</td>\n<td>1812</td>\n<td></td>\n</tr>\n</tbody>\n</table>\n<h2>Conclusion</h2>\n<p>Wishing you the best for your future, happy learning and best regards!</p>",
      "rawMarkdown": "Hello all,\n\nThis competition has a low-moderate churn overall as indicated in the figure below. Let's delve into the regions of interest - \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5ce2c9744622bb61419fa9412a9f6c80%2Flb.png?generation=1728439994521133&alt=media)\n\n<br>\n## Regions of interest\n\n| Region Label | My comments  |\n| --- | --- |\n| R1  | * Roughly indicates the medal zone that remained stable across the public and private leaderboards <br> * This is a dense region, indicating a good level of stability, but local shifts in ranks have occurred. We will assess this below <br> * Hearty congratulations to these participants!  |\n| R2  | * Roughly indicates the group of participants who fell off the perch from the public leaderboard to the private leaderboard. <br> * Perhaps this could be due to code bugs, overfitting, post-processing that did not work, etc.  <br> * This is a relatively lowly populated and occurs with the participants in the public LB bronze region, indicating some level of stability across the top solutions |\n| R3  | * Congratulations to these participants for beating the churn and moving up to end up in the medal zone! <br> * This is a small region like R2 and is a strong indicator of overall stability|\n| R4  | * This indicates some level of shakeups in the non-medal zone - this is slightly different from R2 - shakeup from medal-non-medal region and is represented separately|\n\n\n## Analysis of medal zone participants\n\n| Medal region |Last rank  | Submissions (min-mean-max) | Comments - stability and churn |\n| --- | --- | ---------------- | ---------------------- |\n| Gold medal   | 13 | 17 - 73.85 - 154  |* Stable teams = 11 <br> * Teams entering from below = 2 | \n| Silver medal  | 95 | 6 - 50.53 - 169 |* Stable teams = 66 <br> * Teams entering from below = 14 <br> * Teams entering from above = 2 | \n| Bronze medal  | 191 | 4 - 46 - 114 |* Stable teams = 51 <br> * Teams entering from below = 32 <br> * Teams entering from above = 13 | \n\n\n## Some other noteworthy measures \n\n|Scenario | Public LB rank | Private LB rank | Additional comments\n| --- | --- | ------------ | --------------- |\n| Best single submission rank |  657\t| 176| Special congratulations to this participant for submitting just once to secure a bronze medal! |\n| Best rank with 2 submissions | 501\t| 161| Special congratulations to this participant for submitting just 2 times to secure a bronze medal! |\n| Best riser across the leaderboards | 667 |152| Special congratulations to this participant for rising so highly across the leaderboards to land a bronze medal too! |\n| Maximum fall across public-private leaderboards | 359 | 1812| |\n\n## Conclusion\nWishing you the best for your future, happy learning and best regards!",
      "votes": null
    },
    {
      "id": "3012461",
      "postDate": "10/09/2024 04:25:59",
      "content": "<p>Thanks for sharing the interesting graph making the competition more interesting. <br>\nIs it possible to group by any other criteria such as  country or region ? </p>",
      "rawMarkdown": "Thanks for sharing the interesting graph making the competition more interesting. \nIs it possible to group by any other criteria such as  country or region ?",
      "votes": null
    },
    {
      "id": "3012477",
      "postDate": "10/09/2024 04:56:53",
      "content": "<p>Could be possible using Kaggle meta dataset <a href=\"https://www.kaggle.com/crsuthikshnkumar\" target=\"_blank\">@crsuthikshnkumar</a> </p>",
      "rawMarkdown": "Could be possible using Kaggle meta dataset @crsuthikshnkumar",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3012461,
      "author_name": "crsuthikshnkumar",
      "author_url": "",
      "post_date": "10/09/2024 04:25:59",
      "content": "<p>Thanks for sharing the interesting graph making the competition more interesting. <br>\nIs it possible to group by any other criteria such as  country or region ? </p>",
      "votes": null,
      "replies": [
        {
          "id": 3012477,
          "author_name": "ravi20076",
          "author_url": "",
          "post_date": "10/09/2024 04:56:53",
          "content": "<p>Could be possible using Kaggle meta dataset <a href=\"https://www.kaggle.com/crsuthikshnkumar\" target=\"_blank\">@crsuthikshnkumar</a> </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3012400": "Hello all,\n\nThis competition has a low-moderate churn overall as indicated in the figure below. Let's delve into the regions of interest - \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8273630%2F5ce2c9744622bb61419fa9412a9f6c80%2Flb.png?generation=1728439994521133&alt=media)\n\n<br>\n## Regions of interest\n\n| Region Label | My comments  |\n| --- | --- |\n| R1  | * Roughly indicates the medal zone that remained stable across the public and private leaderboards <br> * This is a dense region, indicating a good level of stability, but local shifts in ranks have occurred. We will assess this below <br> * Hearty congratulations to these participants!  |\n| R2  | * Roughly indicates the group of participants who fell off the perch from the public leaderboard to the private leaderboard. <br> * Perhaps this could be due to code bugs, overfitting, post-processing that did not work, etc.  <br> * This is a relatively lowly populated and occurs with the participants in the public LB bronze region, indicating some level of stability across the top solutions |\n| R3  | * Congratulations to these participants for beating the churn and moving up to end up in the medal zone! <br> * This is a small region like R2 and is a strong indicator of overall stability|\n| R4  | * This indicates some level of shakeups in the non-medal zone - this is slightly different from R2 - shakeup from medal-non-medal region and is represented separately|\n\n\n## Analysis of medal zone participants\n\n| Medal region |Last rank  | Submissions (min-mean-max) | Comments - stability and churn |\n| --- | --- | ---------------- | ---------------------- |\n| Gold medal   | 13 | 17 - 73.85 - 154  |* Stable teams = 11 <br> * Teams entering from below = 2 | \n| Silver medal  | 95 | 6 - 50.53 - 169 |* Stable teams = 66 <br> * Teams entering from below = 14 <br> * Teams entering from above = 2 | \n| Bronze medal  | 191 | 4 - 46 - 114 |* Stable teams = 51 <br> * Teams entering from below = 32 <br> * Teams entering from above = 13 | \n\n\n## Some other noteworthy measures \n\n|Scenario | Public LB rank | Private LB rank | Additional comments\n| --- | --- | ------------ | --------------- |\n| Best single submission rank |  657\t| 176| Special congratulations to this participant for submitting just once to secure a bronze medal! |\n| Best rank with 2 submissions | 501\t| 161| Special congratulations to this participant for submitting just 2 times to secure a bronze medal! |\n| Best riser across the leaderboards | 667 |152| Special congratulations to this participant for rising so highly across the leaderboards to land a bronze medal too! |\n| Maximum fall across public-private leaderboards | 359 | 1812| |\n\n## Conclusion\nWishing you the best for your future, happy learning and best regards!",
    "3012461": "Thanks for sharing the interesting graph making the competition more interesting. \nIs it possible to group by any other criteria such as  country or region ?",
    "3012477": "Could be possible using Kaggle meta dataset @crsuthikshnkumar"
  },
  "source": "meta"
}