{
  "id": 12473,
  "title": "GBM Settings",
  "url": "/competitions/inria-bci-challenge/discussion/12473",
  "author_name": "",
  "post_date": "2015-02-11T00:07:53.607Z",
  "votes": null,
  "comment_count": 2,
  "views": 1104,
  "content": "<p>I'm&nbsp;wondering if anyone has&nbsp;comments on&nbsp;reasonable GBM settings? &nbsp;I've been stuck with the &nbsp;same pitiful CV score locally after trying a number of feature extraction techniques.<br><br>Mine are:<br>step size shrinkage: 0.05<br>trees: 500<br>max depth: 3<br>objective: binary:logistic</p>",
  "messages": [
    {
      "id": "63979",
      "postDate": "02/11/2015 00:07:53",
      "content": "<p>I'm&nbsp;wondering if anyone has&nbsp;comments on&nbsp;reasonable GBM settings? &nbsp;I've been stuck with the &nbsp;same pitiful CV score locally after trying a number of feature extraction techniques.<br><br>Mine are:<br>step size shrinkage: 0.05<br>trees: 500<br>max depth: 3<br>objective: binary:logistic</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "63980",
      "postDate": "02/11/2015 00:22:04",
      "content": "<p>I don't think GBM is that great for this competition. You can do much better with much simpler algorithms. My local CV went from about .63 to .75 before I saw change in my LB score, the GBM is seriously overfitting. </p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "63988",
      "postDate": "02/11/2015 01:03:13",
      "content": "<p>Good to know. &nbsp;I'm sure you're right on the overfitting - I haven't had a chance yet to play around with out of bag estimates or min leaf node sizes.<br><br>Thanks for the help. &nbsp;Back to the drawing board..</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 63980,
      "author_name": "devinanzelmo",
      "author_url": "",
      "post_date": "02/11/2015 00:22:04",
      "content": "<p>I don't think GBM is that great for this competition. You can do much better with much simpler algorithms. My local CV went from about .63 to .75 before I saw change in my LB score, the GBM is seriously overfitting. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 63988,
      "author_name": "tantrev",
      "author_url": "",
      "post_date": "02/11/2015 01:03:13",
      "content": "<p>Good to know. &nbsp;I'm sure you're right on the overfitting - I haven't had a chance yet to play around with out of bag estimates or min leaf node sizes.<br><br>Thanks for the help. &nbsp;Back to the drawing board..</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "63979": "",
    "63980": "",
    "63988": ""
  },
  "source": "meta"
}