{
  "id": 542230,
  "title": "Using weight as a feature?",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/542230",
  "author_name": "JordanYHChan",
  "post_date": "2024-10-23T15:32:32.417000",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi Kagglers,</p>\n<p>I was wondering about whether using the scoring <code>weight</code> would be considered valid in this competition as it isn't technically a feature in the data but only used for evaluating the models?</p>\n<p>Let me know if you plan on using it to train your model to tailor your predictions according to its evaluation weighting!</p>",
  "messages": [
    {
      "id": 3026397,
      "postDate": "2024-10-23T18:41:30.567Z",
      "content": "<p>Yes, sure. You can use whatever you like as features. I thought that using weight may be helpful because (presumably) JS is puting higher weight on more liquid instruments, so weight might be a proxy for other characteristics. </p>\n<p>In vanilla lgb, I do not find that weight is very helpful though. If you find otherwise, let us know.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1748051%2F91ed08ef5539cfca4d694e33fb7264f4%2Fweight.PNG?generation=1729708791804516&amp;alt=media\" alt=\"\"></p>\n<p>This is the shapley beeswarm plot for the weight feature. Since most of the data is on the 0 line, it meanse that weight does not play an important role in any of those predictions. The values away from 0 are all similar color (mostly), meaning that the weight impact in those situations is coming from an interaction, not a direct effect (hence weight is prob not that important).</p>",
      "rawMarkdown": "Yes, sure. You can use whatever you like as features. I thought that using weight may be helpful because (presumably) JS is puting higher weight on more liquid instruments, so weight might be a proxy for other characteristics. \n\nIn vanilla lgb, I do not find that weight is very helpful though. If you find otherwise, let us know.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1748051%2F91ed08ef5539cfca4d694e33fb7264f4%2Fweight.PNG?generation=1729708791804516&alt=media)\n\nThis is the shapley beeswarm plot for the weight feature. Since most of the data is on the 0 line, it meanse that weight does not play an important role in any of those predictions. The values away from 0 are all similar color (mostly), meaning that the weight impact in those situations is coming from an interaction, not a direct effect (hence weight is prob not that important).",
      "votes": 3,
      "replies": [
        {
          "id": 3026432,
          "postDate": "2024-10-23T19:30:14.277Z",
          "content": "<p>Ah, thank you for the clarification. I will look into it and see what I find!</p>",
          "rawMarkdown": "Ah, thank you for the clarification. I will look into it and see what I find!"
        }
      ]
    },
    {
      "id": 3026276,
      "postDate": "2024-10-23T15:32:32.417Z",
      "content": "<p>Hi Kagglers,</p>\n<p>I was wondering about whether using the scoring <code>weight</code> would be considered valid in this competition as it isn't technically a feature in the data but only used for evaluating the models?</p>\n<p>Let me know if you plan on using it to train your model to tailor your predictions according to its evaluation weighting!</p>",
      "rawMarkdown": "Hi Kagglers,\n\nI was wondering about whether using the scoring `weight` would be considered valid in this competition as it isn't technically a feature in the data but only used for evaluating the models?\n\nLet me know if you plan on using it to train your model to tailor your predictions according to its evaluation weighting!",
      "votes": 1
    },
    {
      "id": 3026376,
      "postDate": "2024-10-23T18:14:24.970Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 3026397,
      "author_name": "marketneutral",
      "author_url": "",
      "post_date": "2024-10-23T18:41:30.567000",
      "content": "<p>Yes, sure. You can use whatever you like as features. I thought that using weight may be helpful because (presumably) JS is puting higher weight on more liquid instruments, so weight might be a proxy for other characteristics. </p>\n<p>In vanilla lgb, I do not find that weight is very helpful though. If you find otherwise, let us know.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1748051%2F91ed08ef5539cfca4d694e33fb7264f4%2Fweight.PNG?generation=1729708791804516&amp;alt=media\" alt=\"\"></p>\n<p>This is the shapley beeswarm plot for the weight feature. Since most of the data is on the 0 line, it meanse that weight does not play an important role in any of those predictions. The values away from 0 are all similar color (mostly), meaning that the weight impact in those situations is coming from an interaction, not a direct effect (hence weight is prob not that important).</p>",
      "votes": 3,
      "replies": [
        {
          "id": 3026432,
          "author_name": "JordanYHChan",
          "author_url": "",
          "post_date": "2024-10-23T19:30:14.277000",
          "content": "<p>Ah, thank you for the clarification. I will look into it and see what I find!</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3026376,
      "author_name": "",
      "author_url": "",
      "post_date": "2024-10-23T18:14:24.970000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3026397": "Yes, sure. You can use whatever you like as features. I thought that using weight may be helpful because (presumably) JS is puting higher weight on more liquid instruments, so weight might be a proxy for other characteristics. \n\nIn vanilla lgb, I do not find that weight is very helpful though. If you find otherwise, let us know.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1748051%2F91ed08ef5539cfca4d694e33fb7264f4%2Fweight.PNG?generation=1729708791804516&alt=media)\n\nThis is the shapley beeswarm plot for the weight feature. Since most of the data is on the 0 line, it meanse that weight does not play an important role in any of those predictions. The values away from 0 are all similar color (mostly), meaning that the weight impact in those situations is coming from an interaction, not a direct effect (hence weight is prob not that important).",
    "3026276": "Hi Kagglers,\n\nI was wondering about whether using the scoring `weight` would be considered valid in this competition as it isn't technically a feature in the data but only used for evaluating the models?\n\nLet me know if you plan on using it to train your model to tailor your predictions according to its evaluation weighting!",
    "3026376": ""
  }
}