{
  "id": 105420,
  "title": "Add diversity with Ordinal Regression",
  "url": "/competitions/aptos2019-blindness-detection/discussion/105420",
  "author_name": "Bibek",
  "post_date": "2019-08-23T02:56:46.706000",
  "votes": 6,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Diversity helps when ensembling!! I believe most of us already have classification + regression models. Mayb only few have Ordinal regression models. For those who don't, this might be worth trying!!</p>\n\n<h2><a href=\"https://github.com/Raschka-research-group/coral-cnn\">Rank-consistent Ordinal Regression for Neural Networks</a></h2>\n\n<p><code>Extraordinary progress has been made towards developing neural network architectures for classification tasks. However, commonly used loss functions such as the multi-category cross entropy loss are inadequate for ranking and ordinal regression problems. Hence, approaches that utilize neural networks for ordinal regression tasks transform ordinal target variables into a series of binary classification tasks but suffer from inconsistencies among the different binary classifiers. Thus, we propose a new framework (Consistent Rank Logits, CORAL) with theoretical guarantees for rank-monotonicity and consistent confidence scores. Through parameter sharing, our framework also benefits from lower training complexity and can easily be implemented to extend conventional convolutional neural network classifiers for ordinal regression tasks. Furthermore, the empirical evaluation of our method on a range of face image datasets for age prediction shows a substantial improvement compared to the current state-of-the-art ordinal regression method.</code></p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F5884e8ca7aff6d96b5e58a9a7d7f7b88%2Fcoral.png?generation=1566528886004408&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": 605962,
      "postDate": "2019-08-23T02:56:46.707Z",
      "content": "<p>Diversity helps when ensembling!! I believe most of us already have classification + regression models. Mayb only few have Ordinal regression models. For those who don't, this might be worth trying!!</p>\n\n<h2><a href=\"https://github.com/Raschka-research-group/coral-cnn\">Rank-consistent Ordinal Regression for Neural Networks</a></h2>\n\n<p><code>Extraordinary progress has been made towards developing neural network architectures for classification tasks. However, commonly used loss functions such as the multi-category cross entropy loss are inadequate for ranking and ordinal regression problems. Hence, approaches that utilize neural networks for ordinal regression tasks transform ordinal target variables into a series of binary classification tasks but suffer from inconsistencies among the different binary classifiers. Thus, we propose a new framework (Consistent Rank Logits, CORAL) with theoretical guarantees for rank-monotonicity and consistent confidence scores. Through parameter sharing, our framework also benefits from lower training complexity and can easily be implemented to extend conventional convolutional neural network classifiers for ordinal regression tasks. Furthermore, the empirical evaluation of our method on a range of face image datasets for age prediction shows a substantial improvement compared to the current state-of-the-art ordinal regression method.</code></p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F5884e8ca7aff6d96b5e58a9a7d7f7b88%2Fcoral.png?generation=1566528886004408&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Diversity helps when ensembling!! I believe most of us already have classification + regression models. Mayb only few have Ordinal regression models. For those who don't, this might be worth trying!!\n\n##[Rank-consistent Ordinal Regression for Neural Networks](https://github.com/Raschka-research-group/coral-cnn)\n`Extraordinary progress has been made towards developing neural network architectures for classification tasks. However, commonly used loss functions such as the multi-category cross entropy loss are inadequate for ranking and ordinal regression problems. Hence, approaches that utilize neural networks for ordinal regression tasks transform ordinal target variables into a series of binary classification tasks but suffer from inconsistencies among the different binary classifiers. Thus, we propose a new framework (Consistent Rank Logits, CORAL) with theoretical guarantees for rank-monotonicity and consistent confidence scores. Through parameter sharing, our framework also benefits from lower training complexity and can easily be implemented to extend conventional convolutional neural network classifiers for ordinal regression tasks. Furthermore, the empirical evaluation of our method on a range of face image datasets for age prediction shows a substantial improvement compared to the current state-of-the-art ordinal regression method.`\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F5884e8ca7aff6d96b5e58a9a7d7f7b88%2Fcoral.png?generation=1566528886004408&amp;alt=media)\n\n",
      "votes": 6
    },
    {
      "id": 607615,
      "postDate": "2019-08-25T15:40:52.977Z",
      "content": "<p>Thank you for sharing this kind of research with the community.\nAppreciate it.</p>",
      "rawMarkdown": "Thank you for sharing this kind of research with the community.\nAppreciate it.",
      "votes": 1,
      "replies": [
        {
          "id": 607865,
          "postDate": "2019-08-26T02:54:20.223Z",
          "content": "<p>Thank u for ur kind words!! Will keep be motivated to share more interesting findings :)</p>",
          "rawMarkdown": "Thank u for ur kind words!! Will keep be motivated to share more interesting findings :)",
          "votes": 2
        }
      ]
    },
    {
      "id": 605969,
      "postDate": "2019-08-23T03:06:35.560Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 607615,
      "author_name": "Prashant Kikani",
      "author_url": "",
      "post_date": "2019-08-25T15:40:52.977000",
      "content": "<p>Thank you for sharing this kind of research with the community.\nAppreciate it.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 607865,
          "author_name": "Bibek",
          "author_url": "",
          "post_date": "2019-08-26T02:54:20.223000",
          "content": "<p>Thank u for ur kind words!! Will keep be motivated to share more interesting findings :)</p>",
          "votes": 2,
          "replies": []
        }
      ]
    },
    {
      "id": 605969,
      "author_name": "",
      "author_url": "",
      "post_date": "2019-08-23T03:06:35.560000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "605962": "Diversity helps when ensembling!! I believe most of us already have classification + regression models. Mayb only few have Ordinal regression models. For those who don't, this might be worth trying!!\n\n##[Rank-consistent Ordinal Regression for Neural Networks](https://github.com/Raschka-research-group/coral-cnn)\n`Extraordinary progress has been made towards developing neural network architectures for classification tasks. However, commonly used loss functions such as the multi-category cross entropy loss are inadequate for ranking and ordinal regression problems. Hence, approaches that utilize neural networks for ordinal regression tasks transform ordinal target variables into a series of binary classification tasks but suffer from inconsistencies among the different binary classifiers. Thus, we propose a new framework (Consistent Rank Logits, CORAL) with theoretical guarantees for rank-monotonicity and consistent confidence scores. Through parameter sharing, our framework also benefits from lower training complexity and can easily be implemented to extend conventional convolutional neural network classifiers for ordinal regression tasks. Furthermore, the empirical evaluation of our method on a range of face image datasets for age prediction shows a substantial improvement compared to the current state-of-the-art ordinal regression method.`\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F5884e8ca7aff6d96b5e58a9a7d7f7b88%2Fcoral.png?generation=1566528886004408&amp;alt=media)\n\n",
    "607615": "Thank you for sharing this kind of research with the community.\nAppreciate it.",
    "605969": ""
  }
}