{
  "id": 542550,
  "title": "Does the 1-Minute Constraint Reflect Real-World Requirements?",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/542550",
  "author_name": "",
  "post_date": "2024-10-25T12:59:19.870366Z",
  "votes": 6,
  "comment_count": 10,
  "views": 0,
  "content": "<p>The guidelines say:</p>\n<p>\"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"</p>\n<p>Does this 1-minute rule mirror real-world needs? For example, self-driving cars and other time-sensitive applications need rapid predictions—certainly not models that take 10 minutes. This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering🤕</p>\n<p>TBH I think this competition lack some clarity 💔</p>",
  "messages": [
    {
      "id": "3027934",
      "postDate": "10/25/2024 12:59:19",
      "content": "<p>The guidelines say:</p>\n<p>\"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"</p>\n<p>Does this 1-minute rule mirror real-world needs? For example, self-driving cars and other time-sensitive applications need rapid predictions—certainly not models that take 10 minutes. This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering🤕</p>\n<p>TBH I think this competition lack some clarity 💔</p>",
      "rawMarkdown": "The guidelines say:\n\n\"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"\n\nDoes this 1-minute rule mirror real-world needs? For example, self-driving cars and other time-sensitive applications need rapid predictions—certainly not models that take 10 minutes. This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering🤕\n\nTBH I think this competition lack some clarity 💔",
      "votes": null
    },
    {
      "id": "3027942",
      "postDate": "10/25/2024 13:11:12",
      "content": "<blockquote>\n  <p>This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering</p>\n</blockquote>\n<p>Welcome to the real world.</p>",
      "rawMarkdown": ">This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering\n\n\nWelcome to the real world.",
      "votes": null
    },
    {
      "id": "3027964",
      "postDate": "10/25/2024 13:44:02",
      "content": "<p><a href=\"https://www.kaggle.com/nandodmelo\" target=\"_blank\">@nandodmelo</a> <a href=\"https://www.kaggle.com/aymanallawi\" target=\"_blank\">@aymanallawi</a> can you corroborate the place where 1-minute condition is highlighted? I did not see an instruction regarding this on the overview and data page.</p>\n<p>Did you infer this from the evaluation script?</p>",
      "rawMarkdown": "nandodmelo @aymanallawi can you corroborate the place where 1-minute condition is highlighted? I did not see an instruction regarding this on the overview and data page.\n\nDid you infer this from the evaluation script?",
      "votes": null
    },
    {
      "id": "3027966",
      "postDate": "10/25/2024 13:51:35",
      "content": "<p>In the notebook: Jane Street RMF Demo Submission<br>\nIn the second code cell you can find this comment: \"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"</p>",
      "rawMarkdown": "In the notebook: Jane Street RMF Demo Submission\nIn the second code cell you can find this comment: \"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"",
      "votes": null
    },
    {
      "id": "3028298",
      "postDate": "10/25/2024 20:08:19",
      "content": "<p>Don’t panic. The 1min is likely a typo.</p>\n<p><a href=\"https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/542022#3027305\" target=\"_blank\">https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/542022#3027305</a></p>",
      "rawMarkdown": "Don’t panic. The 1min is likely a typo.\n\nhttps://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/542022#3027305",
      "votes": null
    },
    {
      "id": "3028305",
      "postDate": "10/25/2024 20:27:17",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F15426557%2F4a40c1552acd5c0e6b202abcddf12517%2FScreenshot%202024-10-25%20232620.png?generation=1729888059124016&amp;alt=media\" alt=\"\">I'm sorry but what comment exactly are you trying to refer to?<br>\nI thought that the comment in the pic is the final update(for now at least )</p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F15426557%2F4a40c1552acd5c0e6b202abcddf12517%2FScreenshot%202024-10-25%20232620.png?generation=1729888059124016&alt=media)I'm sorry but what comment exactly are you trying to refer to?\nI thought that the comment in the pic is the final update(for now at least )",
      "votes": null
    },
    {
      "id": "3028312",
      "postDate": "10/25/2024 20:48:12",
      "content": "<p>I thought it was 10 minutes? If its 1 minute it might completely rule out online learning..</p>",
      "rawMarkdown": "I thought it was 10 minutes? If its 1 minute it might completely rule out online learning..",
      "votes": null
    },
    {
      "id": "3028325",
      "postDate": "10/25/2024 21:31:42",
      "content": "<p>In the demo submission, it was written 10min time limit, until someone in the above discussion mentioned that the evaluation script actually hard-coded 60 seconds for the time limit. The question there was whether the 60s was a typo. Sohier couldn't confirm yet so he simply changed the description in the Demo to make sure it aligns with the code. Ryan is the final guy who confirms it whether 1min or 10min. <br>\nSo dont panic yet. Wait for Ryan finally confirms. </p>",
      "rawMarkdown": "In the demo submission, it was written 10min time limit, until someone in the above discussion mentioned that the evaluation script actually hard-coded 60 seconds for the time limit. The question there was whether the 60s was a typo. Sohier couldn't confirm yet so he simply changed the description in the Demo to make sure it aligns with the code. Ryan is the final guy who confirms it whether 1min or 10min. \nSo dont panic yet. Wait for Ryan finally confirms.",
      "votes": null
    },
    {
      "id": "3030219",
      "postDate": "10/28/2024 10:04:27",
      "content": "<p>In all probability, yes? There is a minimum of 849 <code>time_id</code> per day, which if you presume is around a minute per interval, and if I understand it correctly, each <code>predict</code> call yields only 1 <code>time_id</code>, then there are 14 hours in that.</p>",
      "rawMarkdown": "In all probability, yes? There is a minimum of 849 `time_id` per day, which if you presume is around a minute per interval, and if I understand it correctly, each `predict` call yields only 1 `time_id`, then there are 14 hours in that.",
      "votes": null
    },
    {
      "id": "3041224",
      "postDate": "11/10/2024 03:37:40",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17516663%2F99d6db450dc42fade6c0dde72bdf4c2f%2F2024-11-10%20113633.png?generation=1731209856044361&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17516663%2F99d6db450dc42fade6c0dde72bdf4c2f%2F2024-11-10%20113633.png?generation=1731209856044361&alt=media)",
      "votes": null
    },
    {
      "id": "3092911",
      "postDate": "01/10/2025 08:12:11",
      "content": "<p>it's 60s, line 14 of <code>kaggle_evaluation/jane_street_gateway.py</code>: <code>self.set_response_timeout_seconds(60)</code></p>",
      "rawMarkdown": "it's 60s, line 14 of `kaggle_evaluation/jane_street_gateway.py`: `self.set_response_timeout_seconds(60)`",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3027942,
      "author_name": "nandodmelo",
      "author_url": "",
      "post_date": "10/25/2024 13:11:12",
      "content": "<blockquote>\n  <p>This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering</p>\n</blockquote>\n<p>Welcome to the real world.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3027964,
      "author_name": "ravi20076",
      "author_url": "",
      "post_date": "10/25/2024 13:44:02",
      "content": "<p><a href=\"https://www.kaggle.com/nandodmelo\" target=\"_blank\">@nandodmelo</a> <a href=\"https://www.kaggle.com/aymanallawi\" target=\"_blank\">@aymanallawi</a> can you corroborate the place where 1-minute condition is highlighted? I did not see an instruction regarding this on the overview and data page.</p>\n<p>Did you infer this from the evaluation script?</p>",
      "votes": null,
      "replies": [
        {
          "id": 3027966,
          "author_name": "aymanallawi",
          "author_url": "",
          "post_date": "10/25/2024 13:51:35",
          "content": "<p>In the notebook: Jane Street RMF Demo Submission<br>\nIn the second code cell you can find this comment: \"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3028298,
      "author_name": "shiyili",
      "author_url": "",
      "post_date": "10/25/2024 20:08:19",
      "content": "<p>Don’t panic. The 1min is likely a typo.</p>\n<p><a href=\"https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/542022#3027305\" target=\"_blank\">https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/542022#3027305</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 3028305,
          "author_name": "aymanallawi",
          "author_url": "",
          "post_date": "10/25/2024 20:27:17",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F15426557%2F4a40c1552acd5c0e6b202abcddf12517%2FScreenshot%202024-10-25%20232620.png?generation=1729888059124016&amp;alt=media\" alt=\"\">I'm sorry but what comment exactly are you trying to refer to?<br>\nI thought that the comment in the pic is the final update(for now at least )</p>",
          "votes": null,
          "replies": [
            {
              "id": 3028325,
              "author_name": "shiyili",
              "author_url": "",
              "post_date": "10/25/2024 21:31:42",
              "content": "<p>In the demo submission, it was written 10min time limit, until someone in the above discussion mentioned that the evaluation script actually hard-coded 60 seconds for the time limit. The question there was whether the 60s was a typo. Sohier couldn't confirm yet so he simply changed the description in the Demo to make sure it aligns with the code. Ryan is the final guy who confirms it whether 1min or 10min. <br>\nSo dont panic yet. Wait for Ryan finally confirms. </p>",
              "votes": null,
              "replies": []
            }
          ]
        },
        {
          "id": 3041224,
          "author_name": "carrotwait",
          "author_url": "",
          "post_date": "11/10/2024 03:37:40",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17516663%2F99d6db450dc42fade6c0dde72bdf4c2f%2F2024-11-10%20113633.png?generation=1731209856044361&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3028312,
      "author_name": "julianmukaj",
      "author_url": "",
      "post_date": "10/25/2024 20:48:12",
      "content": "<p>I thought it was 10 minutes? If its 1 minute it might completely rule out online learning..</p>",
      "votes": null,
      "replies": [
        {
          "id": 3092911,
          "author_name": "alexmason11",
          "author_url": "",
          "post_date": "01/10/2025 08:12:11",
          "content": "<p>it's 60s, line 14 of <code>kaggle_evaluation/jane_street_gateway.py</code>: <code>self.set_response_timeout_seconds(60)</code></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3030219,
      "author_name": "abstrphil",
      "author_url": "",
      "post_date": "10/28/2024 10:04:27",
      "content": "<p>In all probability, yes? There is a minimum of 849 <code>time_id</code> per day, which if you presume is around a minute per interval, and if I understand it correctly, each <code>predict</code> call yields only 1 <code>time_id</code>, then there are 14 hours in that.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3027934": "The guidelines say:\n\n\"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"\n\nDoes this 1-minute rule mirror real-world needs? For example, self-driving cars and other time-sensitive applications need rapid predictions—certainly not models that take 10 minutes. This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering🤕\n\nTBH I think this competition lack some clarity 💔",
    "3027942": ">This limit might push us to optimize models for practical, quick responses in real-time scenarios which can make it difficult to do enough features engineering\n\n\nWelcome to the real world.",
    "3027964": "nandodmelo @aymanallawi can you corroborate the place where 1-minute condition is highlighted? I did not see an instruction regarding this on the overview and data page.\n\nDid you infer this from the evaluation script?",
    "3027966": "In the notebook: Jane Street RMF Demo Submission\nIn the second code cell you can find this comment: \"Each batch of predictions (except the very first) must be returned within 1 minute of the batch features being provided.\"",
    "3028298": "Don’t panic. The 1min is likely a typo.\n\nhttps://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/discussion/542022#3027305",
    "3028305": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F15426557%2F4a40c1552acd5c0e6b202abcddf12517%2FScreenshot%202024-10-25%20232620.png?generation=1729888059124016&alt=media)I'm sorry but what comment exactly are you trying to refer to?\nI thought that the comment in the pic is the final update(for now at least )",
    "3028312": "I thought it was 10 minutes? If its 1 minute it might completely rule out online learning..",
    "3028325": "In the demo submission, it was written 10min time limit, until someone in the above discussion mentioned that the evaluation script actually hard-coded 60 seconds for the time limit. The question there was whether the 60s was a typo. Sohier couldn't confirm yet so he simply changed the description in the Demo to make sure it aligns with the code. Ryan is the final guy who confirms it whether 1min or 10min. \nSo dont panic yet. Wait for Ryan finally confirms.",
    "3030219": "In all probability, yes? There is a minimum of 849 `time_id` per day, which if you presume is around a minute per interval, and if I understand it correctly, each `predict` call yields only 1 `time_id`, then there are 14 hours in that.",
    "3041224": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F17516663%2F99d6db450dc42fade6c0dde72bdf4c2f%2F2024-11-10%20113633.png?generation=1731209856044361&alt=media)",
    "3092911": "it's 60s, line 14 of `kaggle_evaluation/jane_street_gateway.py`: `self.set_response_timeout_seconds(60)`"
  },
  "source": "meta"
}