{
  "id": 541470,
  "title": "How long do you take to get scores from submissions?",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/541470",
  "author_name": "Yourui Wang",
  "post_date": "2024-10-19T19:56:30.285000",
  "votes": 3,
  "comment_count": 10,
  "views": 0,
  "content": "<p>How long do you take to get scores from submissions?</p>",
  "messages": [
    {
      "id": 3022661,
      "postDate": "2024-10-19T19:56:30.287Z",
      "content": "<p>How long do you take to get scores from submissions?</p>",
      "rawMarkdown": "How long do you take to get scores from submissions?",
      "votes": 3
    },
    {
      "id": 3022697,
      "postDate": "2024-10-19T20:50:19.597Z",
      "content": "<p>It takes ~15 minutes to run the sample submission which predicts 0s for everything</p>",
      "rawMarkdown": "It takes ~15 minutes to run the sample submission which predicts 0s for everything",
      "votes": 1,
      "replies": [
        {
          "id": 3022699,
          "postDate": "2024-10-19T20:52:02.587Z",
          "content": "<p>Thank you. I think mine runs too long because there is no training process just predicting but takes 2h for now still running.</p>",
          "rawMarkdown": "Thank you. I think mine runs too long because there is no training process just predicting but takes 2h for now still running.",
          "votes": 1,
          "replies": [
            {
              "id": 3022703,
              "postDate": "2024-10-19T20:54:24.853Z",
              "content": "<p>Mine timed out after 8h because my feature engineering was too intense, so I removed it and a basic CatBoost model took about 25 mins to run</p>",
              "rawMarkdown": "Mine timed out after 8h because my feature engineering was too intense, so I removed it and a basic CatBoost model took about 25 mins to run"
            },
            {
              "id": 3022704,
              "postDate": "2024-10-19T20:55:32.403Z",
              "content": "<p>That really helps. Thx!</p>",
              "rawMarkdown": "That really helps. Thx!"
            },
            {
              "id": 3022941,
              "postDate": "2024-10-20T05:22:27.187Z",
              "content": "<p>I had my whole notebook ran and saved in just 600 seconds however the scoring took 1 hr. I'm worried about doing prediction on bigger models.</p>",
              "rawMarkdown": "I had my whole notebook ran and saved in just 600 seconds however the scoring took 1 hr. I'm worried about doing prediction on bigger models."
            }
          ]
        },
        {
          "id": 3036638,
          "postDate": "2024-11-04T18:46:00.137Z",
          "content": "<p>My first submission took 2 hours.</p>",
          "rawMarkdown": "My first submission took 2 hours."
        }
      ]
    },
    {
      "id": 3025931,
      "postDate": "2024-10-23T09:24:18.370Z",
      "content": "<p>usually 1-2 hours</p>",
      "rawMarkdown": "usually 1-2 hours"
    },
    {
      "id": 3025923,
      "postDate": "2024-10-23T09:17:39.040Z",
      "content": "<p>already scoring for like 40 minutes…</p>",
      "rawMarkdown": "already scoring for like 40 minutes..."
    },
    {
      "id": 3022956,
      "postDate": "2024-10-20T05:51:58.713Z",
      "content": "<p>This depends on what you submit for a score. I simple single model is taking me an hour to score for now <a href=\"https://www.kaggle.com/yw2735\" target=\"_blank\">@yw2735</a> </p>",
      "rawMarkdown": "This depends on what you submit for a score. I simple single model is taking me an hour to score for now @yw2735 "
    },
    {
      "id": 3024183,
      "postDate": "2024-10-21T12:16:28.570Z",
      "rawMarkdown": "",
      "votes": -4,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 3022697,
      "author_name": "aL_eX",
      "author_url": "",
      "post_date": "2024-10-19T20:50:19.597000",
      "content": "<p>It takes ~15 minutes to run the sample submission which predicts 0s for everything</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3022699,
          "author_name": "Yourui Wang",
          "author_url": "",
          "post_date": "2024-10-19T20:52:02.587000",
          "content": "<p>Thank you. I think mine runs too long because there is no training process just predicting but takes 2h for now still running.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3022703,
              "author_name": "aL_eX",
              "author_url": "",
              "post_date": "2024-10-19T20:54:24.853000",
              "content": "<p>Mine timed out after 8h because my feature engineering was too intense, so I removed it and a basic CatBoost model took about 25 mins to run</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3022704,
              "author_name": "Yourui Wang",
              "author_url": "",
              "post_date": "2024-10-19T20:55:32.403000",
              "content": "<p>That really helps. Thx!</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3022941,
              "author_name": "Jay Shrivastava",
              "author_url": "",
              "post_date": "2024-10-20T05:22:27.187000",
              "content": "<p>I had my whole notebook ran and saved in just 600 seconds however the scoring took 1 hr. I'm worried about doing prediction on bigger models.</p>",
              "votes": 0,
              "replies": []
            }
          ]
        },
        {
          "id": 3036638,
          "author_name": "Dave Gaddes",
          "author_url": "",
          "post_date": "2024-11-04T18:46:00.137000",
          "content": "<p>My first submission took 2 hours.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3025931,
      "author_name": "WJJJJS",
      "author_url": "",
      "post_date": "2024-10-23T09:24:18.370000",
      "content": "<p>usually 1-2 hours</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3025923,
      "author_name": "Abner Teng",
      "author_url": "",
      "post_date": "2024-10-23T09:17:39.040000",
      "content": "<p>already scoring for like 40 minutes…</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3022956,
      "author_name": "Ravi Ramakrishnan",
      "author_url": "",
      "post_date": "2024-10-20T05:51:58.713000",
      "content": "<p>This depends on what you submit for a score. I simple single model is taking me an hour to score for now <a href=\"https://www.kaggle.com/yw2735\" target=\"_blank\">@yw2735</a> </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3024183,
      "author_name": "",
      "author_url": "",
      "post_date": "2024-10-21T12:16:28.570000",
      "content": "",
      "votes": -4,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3022661": "How long do you take to get scores from submissions?",
    "3022697": "It takes ~15 minutes to run the sample submission which predicts 0s for everything",
    "3025931": "usually 1-2 hours",
    "3025923": "already scoring for like 40 minutes...",
    "3022956": "This depends on what you submit for a score. I simple single model is taking me an hour to score for now @yw2735 ",
    "3024183": ""
  }
}