{
  "id": 541955,
  "title": "The availability of the data in future",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/541955",
  "author_name": "",
  "post_date": "2024-10-22T08:04:04.427633800Z",
  "votes": 1,
  "comment_count": 5,
  "views": 0,
  "content": "<p>So, in order to generate/create features based on the responders as example, will they be available at each date_id/time_id ? all of them not just responder_6 ? Same goes for features, for each date_id/time_id will they be available as well ?</p>",
  "messages": [
    {
      "id": "3024976",
      "postDate": "10/22/2024 08:04:04",
      "content": "<p>So, in order to generate/create features based on the responders as example, will they be available at each date_id/time_id ? all of them not just responder_6 ? Same goes for features, for each date_id/time_id will they be available as well ?</p>",
      "rawMarkdown": "So, in order to generate/create features based on the responders as example, will they be available at each date_id/time_id ? all of them not just responder_6 ? Same goes for features, for each date_id/time_id will they be available as well ?",
      "votes": null
    },
    {
      "id": "3026158",
      "postDate": "10/23/2024 13:49:14",
      "content": "<p><a href=\"https://www.kaggle.com/abdelrahmanrabah\" target=\"_blank\">@abdelrahmanrabah</a> If you use the lag files, you can utilize all the information, including the responder, up to the previous day if needed.</p>",
      "rawMarkdown": "abdelrahmanrabah If you use the lag files, you can utilize all the information, including the responder, up to the previous day if needed.",
      "votes": null
    },
    {
      "id": "3026160",
      "postDate": "10/23/2024 13:49:48",
      "content": "<p>However, memory issues need to be considered carefully.</p>",
      "rawMarkdown": "However, memory issues need to be considered carefully.",
      "votes": null
    },
    {
      "id": "3027769",
      "postDate": "10/25/2024 09:02:19",
      "content": "<p>Lets not just consider the lags, for every time_id per date_id, will the features be available same goes for responders ? My point is if I want to generate features like rolling mean, lags as well (ignore the files for now)</p>",
      "rawMarkdown": "Lets not just consider the lags, for every time_id per date_id, will the features be available same goes for responders ? My point is if I want to generate features like rolling mean, lags as well (ignore the files for now)",
      "votes": null
    },
    {
      "id": "3028737",
      "postDate": "10/26/2024 13:12:16",
      "content": "<p>If you do some analysis, you will find out that a lot of date is missing. So it is possible that there is no data for a symbol for the whole day.</p>",
      "rawMarkdown": "If you do some analysis, you will find out that a lot of date is missing. So it is possible that there is no data for a symbol for the whole day.",
      "votes": null
    },
    {
      "id": "3028757",
      "postDate": "10/26/2024 13:34:29",
      "content": "<p>Yeah, I know that point for the symbols, I'm speaking as a general rule of thumb, for the whole features along with time_id/date_id</p>",
      "rawMarkdown": "Yeah, I know that point for the symbols, I'm speaking as a general rule of thumb, for the whole features along with time_id/date_id",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3026158,
      "author_name": "chumajin",
      "author_url": "",
      "post_date": "10/23/2024 13:49:14",
      "content": "<p><a href=\"https://www.kaggle.com/abdelrahmanrabah\" target=\"_blank\">@abdelrahmanrabah</a> If you use the lag files, you can utilize all the information, including the responder, up to the previous day if needed.</p>",
      "votes": null,
      "replies": [
        {
          "id": 3026160,
          "author_name": "chumajin",
          "author_url": "",
          "post_date": "10/23/2024 13:49:48",
          "content": "<p>However, memory issues need to be considered carefully.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 3027769,
          "author_name": "abdelrahmanrabah",
          "author_url": "",
          "post_date": "10/25/2024 09:02:19",
          "content": "<p>Lets not just consider the lags, for every time_id per date_id, will the features be available same goes for responders ? My point is if I want to generate features like rolling mean, lags as well (ignore the files for now)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3028737,
      "author_name": "ruizhy",
      "author_url": "",
      "post_date": "10/26/2024 13:12:16",
      "content": "<p>If you do some analysis, you will find out that a lot of date is missing. So it is possible that there is no data for a symbol for the whole day.</p>",
      "votes": null,
      "replies": [
        {
          "id": 3028757,
          "author_name": "abdelrahmanrabah",
          "author_url": "",
          "post_date": "10/26/2024 13:34:29",
          "content": "<p>Yeah, I know that point for the symbols, I'm speaking as a general rule of thumb, for the whole features along with time_id/date_id</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3024976": "So, in order to generate/create features based on the responders as example, will they be available at each date_id/time_id ? all of them not just responder_6 ? Same goes for features, for each date_id/time_id will they be available as well ?",
    "3026158": "abdelrahmanrabah If you use the lag files, you can utilize all the information, including the responder, up to the previous day if needed.",
    "3026160": "However, memory issues need to be considered carefully.",
    "3027769": "Lets not just consider the lags, for every time_id per date_id, will the features be available same goes for responders ? My point is if I want to generate features like rolling mean, lags as well (ignore the files for now)",
    "3028737": "If you do some analysis, you will find out that a lot of date is missing. So it is possible that there is no data for a symbol for the whole day.",
    "3028757": "Yeah, I know that point for the symbols, I'm speaking as a general rule of thumb, for the whole features along with time_id/date_id"
  },
  "source": "meta"
}