{
  "id": 553818,
  "title": "Main question about lags",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/553818",
  "author_name": "",
  "post_date": "2024-12-28T16:42:38.707616Z",
  "votes": 2,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi everyone,</p>\n<p>I’ve noticed something odd about the lags.parquet file and wanted to ask for clarification. The description says:</p>\n<p>The evaluation API serves the entirety of the lagged responders for a date_id on that date_id's first time_id. In other words, all of the previous date's responders will be served at the first time step of the succeeding date.</p>\n<p>But when I look at the file, it seems like it only contains the last time_id data from the previous date_id, not all the responders from the entire day.</p>\n<p>I also see people using this file differently: some treat it as just the last state of the day, while others assume it should represent all data for the day.</p>\n<p>Is this how it’s supposed to work, or am I missing something? Has anyone seen any comments from the organizers about this?</p>\n<p>Thanks in advance!</p>",
  "messages": [
    {
      "id": "3082826",
      "postDate": "12/28/2024 16:42:38",
      "content": "<p>Hi everyone,</p>\n<p>I’ve noticed something odd about the lags.parquet file and wanted to ask for clarification. The description says:</p>\n<p>The evaluation API serves the entirety of the lagged responders for a date_id on that date_id's first time_id. In other words, all of the previous date's responders will be served at the first time step of the succeeding date.</p>\n<p>But when I look at the file, it seems like it only contains the last time_id data from the previous date_id, not all the responders from the entire day.</p>\n<p>I also see people using this file differently: some treat it as just the last state of the day, while others assume it should represent all data for the day.</p>\n<p>Is this how it’s supposed to work, or am I missing something? Has anyone seen any comments from the organizers about this?</p>\n<p>Thanks in advance!</p>",
      "rawMarkdown": "Hi everyone,\n\nI’ve noticed something odd about the lags.parquet file and wanted to ask for clarification. The description says:\n\nThe evaluation API serves the entirety of the lagged responders for a date_id on that date_id's first time_id. In other words, all of the previous date's responders will be served at the first time step of the succeeding date.\n\nBut when I look at the file, it seems like it only contains the last time_id data from the previous date_id, not all the responders from the entire day.\n\nI also see people using this file differently: some treat it as just the last state of the day, while others assume it should represent all data for the day.\n\nIs this how it’s supposed to work, or am I missing something? Has anyone seen any comments from the organizers about this?\n\nThanks in advance!",
      "votes": null
    },
    {
      "id": "3082843",
      "postDate": "12/28/2024 17:01:36",
      "content": "<p>That is just a sample that could be used for code checks <a href=\"https://www.kaggle.com/lomonosovilya\" target=\"_blank\">@lomonosovilya</a> <br>\nThe actual test data will contain the entire previous day’s target </p>",
      "rawMarkdown": "That is just a sample that could be used for code checks @lomonosovilya \nThe actual test data will contain the entire previous day’s target",
      "votes": null
    },
    {
      "id": "3082846",
      "postDate": "12/28/2024 17:05:24",
      "content": "<p>check</p>\n<p><a href=\"https://www.kaggle.com/code/shiyili/js24-rmf-submission-api-debug-with-synthetic-test\" target=\"_blank\">https://www.kaggle.com/code/shiyili/js24-rmf-submission-api-debug-with-synthetic-test</a></p>\n<p><a href=\"https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api\" target=\"_blank\">https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api</a></p>",
      "rawMarkdown": "check\n\nhttps://www.kaggle.com/code/shiyili/js24-rmf-submission-api-debug-with-synthetic-test\n\nhttps://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3082843,
      "author_name": "ravi20076",
      "author_url": "",
      "post_date": "12/28/2024 17:01:36",
      "content": "<p>That is just a sample that could be used for code checks <a href=\"https://www.kaggle.com/lomonosovilya\" target=\"_blank\">@lomonosovilya</a> <br>\nThe actual test data will contain the entire previous day’s target </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3082846,
      "author_name": "shiyili",
      "author_url": "",
      "post_date": "12/28/2024 17:05:24",
      "content": "<p>check</p>\n<p><a href=\"https://www.kaggle.com/code/shiyili/js24-rmf-submission-api-debug-with-synthetic-test\" target=\"_blank\">https://www.kaggle.com/code/shiyili/js24-rmf-submission-api-debug-with-synthetic-test</a></p>\n<p><a href=\"https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api\" target=\"_blank\">https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3082826": "Hi everyone,\n\nI’ve noticed something odd about the lags.parquet file and wanted to ask for clarification. The description says:\n\nThe evaluation API serves the entirety of the lagged responders for a date_id on that date_id's first time_id. In other words, all of the previous date's responders will be served at the first time step of the succeeding date.\n\nBut when I look at the file, it seems like it only contains the last time_id data from the previous date_id, not all the responders from the entire day.\n\nI also see people using this file differently: some treat it as just the last state of the day, while others assume it should represent all data for the day.\n\nIs this how it’s supposed to work, or am I missing something? Has anyone seen any comments from the organizers about this?\n\nThanks in advance!",
    "3082843": "That is just a sample that could be used for code checks @lomonosovilya \nThe actual test data will contain the entire previous day’s target",
    "3082846": "check\n\nhttps://www.kaggle.com/code/shiyili/js24-rmf-submission-api-debug-with-synthetic-test\n\nhttps://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api"
  },
  "source": "meta"
}