{
  "id": 541171,
  "title": "Easy to understand New time series API",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/541171",
  "author_name": "",
  "post_date": "2024-10-18T02:28:32.813454300Z",
  "votes": 24,
  "comment_count": 4,
  "views": 0,
  "content": "<p>In this competition, unlike previous ones, the time series API has been updated. I struggled to understand it, but I finally started to grasp how to use lag, so I’d like to share my insights.</p>\n<p><a href=\"https://www.kaggle.com/code/chumajin/janestreet-easy-to-understand-new-time-series-api\" target=\"_blank\">https://www.kaggle.com/code/chumajin/janestreet-easy-to-understand-new-time-series-api</a></p>\n<h1>Summary</h1>\n<p>I think there are 3 steps.</p>\n<p>Step 1 The data is split by day using group_by.</p>\n<p>Step 2 The data made by Step1 is split by time_id using group_by, and the lag is generated (for time_id == 0).</p>\n<p>Step 3 After inputting the predicted values, the submission file is generated.</p>\n<p>The following image is the comparing the new time series API and my understanding<br>\n(Detail is in above my public notebook! )</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F2300ce6da43d4e6dbe376b5ed993078d%2FClipboard04.jpg?generation=1729218053439456&amp;alt=media\" alt=\"\"></p>\n<p>It can be understood that the official API code omits the part where the date_id and time_id using a for loop are assigned. By understanding this overall structure, I believe you will be able to participate in the competition in easy.</p>\n<p>Enjoy !</p>",
  "messages": [
    {
      "id": "3020893",
      "postDate": "10/18/2024 02:28:32",
      "content": "<p>In this competition, unlike previous ones, the time series API has been updated. I struggled to understand it, but I finally started to grasp how to use lag, so I’d like to share my insights.</p>\n<p><a href=\"https://www.kaggle.com/code/chumajin/janestreet-easy-to-understand-new-time-series-api\" target=\"_blank\">https://www.kaggle.com/code/chumajin/janestreet-easy-to-understand-new-time-series-api</a></p>\n<h1>Summary</h1>\n<p>I think there are 3 steps.</p>\n<p>Step 1 The data is split by day using group_by.</p>\n<p>Step 2 The data made by Step1 is split by time_id using group_by, and the lag is generated (for time_id == 0).</p>\n<p>Step 3 After inputting the predicted values, the submission file is generated.</p>\n<p>The following image is the comparing the new time series API and my understanding<br>\n(Detail is in above my public notebook! )</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F2300ce6da43d4e6dbe376b5ed993078d%2FClipboard04.jpg?generation=1729218053439456&amp;alt=media\" alt=\"\"></p>\n<p>It can be understood that the official API code omits the part where the date_id and time_id using a for loop are assigned. By understanding this overall structure, I believe you will be able to participate in the competition in easy.</p>\n<p>Enjoy !</p>",
      "rawMarkdown": "In this competition, unlike previous ones, the time series API has been updated. I struggled to understand it, but I finally started to grasp how to use lag, so I’d like to share my insights.\n\nhttps://www.kaggle.com/code/chumajin/janestreet-easy-to-understand-new-time-series-api\n\n# Summary\n\nI think there are 3 steps.\n\nStep 1 The data is split by day using group_by.\n\nStep 2 The data made by Step1 is split by time_id using group_by, and the lag is generated (for time_id == 0).\n\nStep 3 After inputting the predicted values, the submission file is generated.\n\nThe following image is the comparing the new time series API and my understanding\n(Detail is in above my public notebook! )\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F2300ce6da43d4e6dbe376b5ed993078d%2FClipboard04.jpg?generation=1729218053439456&alt=media)\n\nIt can be understood that the official API code omits the part where the date_id and time_id using a for loop are assigned. By understanding this overall structure, I believe you will be able to participate in the competition in easy.\n\nEnjoy !",
      "votes": null
    },
    {
      "id": "3021100",
      "postDate": "10/18/2024 07:35:33",
      "content": "<p>You can also check my work related to the submission API here: <a href=\"https://www.kaggle.com/code/shiyili/js24-rmf-generate-synthetic-test-data\" target=\"_blank\">https://www.kaggle.com/code/shiyili/js24-rmf-generate-synthetic-test-data</a></p>",
      "rawMarkdown": "You can also check my work related to the submission API here: https://www.kaggle.com/code/shiyili/js24-rmf-generate-synthetic-test-data",
      "votes": null
    },
    {
      "id": "3021129",
      "postDate": "10/18/2024 08:02:23",
      "content": "<p><a href=\"https://www.kaggle.com/shiyili\" target=\"_blank\">@shiyili</a> OK. I will check it. Thank you very much!</p>",
      "rawMarkdown": "shiyili OK. I will check it. Thank you very much!",
      "votes": null
    },
    {
      "id": "3054531",
      "postDate": "11/24/2024 19:18:25",
      "content": "<p>Hi,<br>\nThanks for that.<br>\nShall we understand the lag as a previous day close equivalent, or previous day change in the asset price (which ever responder_6 is meant to represent  ?) <br>\nTherefore, to get this info on the train set, it's possible to use the responders values at the last time_id of each date_id of the previous day to get those lags ? i.e for date_id 2, we use the last time_id data of each responders for each symbol present in date_id 1 ?</p>\n<p>Thanks!</p>",
      "rawMarkdown": "Hi,\nThanks for that.\nShall we understand the lag as a previous day close equivalent, or previous day change in the asset price (which ever responder_6 is meant to represent  ?) \nTherefore, to get this info on the train set, it's possible to use the responders values at the last time_id of each date_id of the previous day to get those lags ? i.e for date_id 2, we use the last time_id data of each responders for each symbol present in date_id 1 ?\n\nThanks!",
      "votes": null
    },
    {
      "id": "3078527",
      "postDate": "12/22/2024 12:41:02",
      "content": "<p>dude this is really helpful, insanely good saved my day big thanks</p>",
      "rawMarkdown": "dude this is really helpful, insanely good saved my day big thanks",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3021100,
      "author_name": "shiyili",
      "author_url": "",
      "post_date": "10/18/2024 07:35:33",
      "content": "<p>You can also check my work related to the submission API here: <a href=\"https://www.kaggle.com/code/shiyili/js24-rmf-generate-synthetic-test-data\" target=\"_blank\">https://www.kaggle.com/code/shiyili/js24-rmf-generate-synthetic-test-data</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 3021129,
          "author_name": "chumajin",
          "author_url": "",
          "post_date": "10/18/2024 08:02:23",
          "content": "<p><a href=\"https://www.kaggle.com/shiyili\" target=\"_blank\">@shiyili</a> OK. I will check it. Thank you very much!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 3078527,
          "author_name": "zhangyue199",
          "author_url": "",
          "post_date": "12/22/2024 12:41:02",
          "content": "<p>dude this is really helpful, insanely good saved my day big thanks</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3054531,
      "author_name": "julienfron",
      "author_url": "",
      "post_date": "11/24/2024 19:18:25",
      "content": "<p>Hi,<br>\nThanks for that.<br>\nShall we understand the lag as a previous day close equivalent, or previous day change in the asset price (which ever responder_6 is meant to represent  ?) <br>\nTherefore, to get this info on the train set, it's possible to use the responders values at the last time_id of each date_id of the previous day to get those lags ? i.e for date_id 2, we use the last time_id data of each responders for each symbol present in date_id 1 ?</p>\n<p>Thanks!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3020893": "In this competition, unlike previous ones, the time series API has been updated. I struggled to understand it, but I finally started to grasp how to use lag, so I’d like to share my insights.\n\nhttps://www.kaggle.com/code/chumajin/janestreet-easy-to-understand-new-time-series-api\n\n# Summary\n\nI think there are 3 steps.\n\nStep 1 The data is split by day using group_by.\n\nStep 2 The data made by Step1 is split by time_id using group_by, and the lag is generated (for time_id == 0).\n\nStep 3 After inputting the predicted values, the submission file is generated.\n\nThe following image is the comparing the new time series API and my understanding\n(Detail is in above my public notebook! )\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F2300ce6da43d4e6dbe376b5ed993078d%2FClipboard04.jpg?generation=1729218053439456&alt=media)\n\nIt can be understood that the official API code omits the part where the date_id and time_id using a for loop are assigned. By understanding this overall structure, I believe you will be able to participate in the competition in easy.\n\nEnjoy !",
    "3021100": "You can also check my work related to the submission API here: https://www.kaggle.com/code/shiyili/js24-rmf-generate-synthetic-test-data",
    "3021129": "shiyili OK. I will check it. Thank you very much!",
    "3054531": "Hi,\nThanks for that.\nShall we understand the lag as a previous day close equivalent, or previous day change in the asset price (which ever responder_6 is meant to represent  ?) \nTherefore, to get this info on the train set, it's possible to use the responders values at the last time_id of each date_id of the previous day to get those lags ? i.e for date_id 2, we use the last time_id data of each responders for each symbol present in date_id 1 ?\n\nThanks!",
    "3078527": "dude this is really helpful, insanely good saved my day big thanks"
  },
  "source": "meta"
}