{
  "id": 492683,
  "title": "Variations in submission speed ?",
  "url": "/competitions/birdclef-2024/discussion/492683",
  "author_name": "",
  "post_date": "2024-04-10T15:18:22.898677900Z",
  "votes": 10,
  "comment_count": 5,
  "views": 0,
  "content": "<h2>Is the submission speed delta same as the previous years one ?</h2>\n<p>I have made two different submissions, with the only change being the model weights:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2F5a31f3418c1a75384cc2b307c0805721%2FScreenshot%20from%202024-04-10%2017-11-48.png?generation=1712761963958235&amp;alt=media\"></p>\n<p>However, the first one ran in 1hours while the second has been running for 2h40 (3h displayed on kaggle) and will most likely time out<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fb6e9155dbd2299787e3b73db411557fb%2FScreenshot%20from%202024-04-10%2017-13-09.png?generation=1712762034793763&amp;alt=media\"></p>\n<p>Is this something you guys also experienced ? I don't remember 100% but I was participating in Birdclef2023 and there was similar problems as pointed out by this comment:<br>\n<a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/407532\" target=\"_blank\">https://www.kaggle.com/competitions/birdclef-2023/discussion/407532</a></p>\n<p>The answer to those problems was this:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Ff9da0e817d6eee04ba338cc94a8023ad%2FScreenshot%20from%202024-04-10%2017-16-57.png?generation=1712762223883044&amp;alt=media\"></p>\n<p>Is this still the case ? 😅</p>",
  "messages": [
    {
      "id": "2745366",
      "postDate": "04/10/2024 15:18:22",
      "content": "<h2>Is the submission speed delta same as the previous years one ?</h2>\n<p>I have made two different submissions, with the only change being the model weights:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2F5a31f3418c1a75384cc2b307c0805721%2FScreenshot%20from%202024-04-10%2017-11-48.png?generation=1712761963958235&amp;alt=media\"></p>\n<p>However, the first one ran in 1hours while the second has been running for 2h40 (3h displayed on kaggle) and will most likely time out<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fb6e9155dbd2299787e3b73db411557fb%2FScreenshot%20from%202024-04-10%2017-13-09.png?generation=1712762034793763&amp;alt=media\"></p>\n<p>Is this something you guys also experienced ? I don't remember 100% but I was participating in Birdclef2023 and there was similar problems as pointed out by this comment:<br>\n<a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/407532\" target=\"_blank\">https://www.kaggle.com/competitions/birdclef-2023/discussion/407532</a></p>\n<p>The answer to those problems was this:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Ff9da0e817d6eee04ba338cc94a8023ad%2FScreenshot%20from%202024-04-10%2017-16-57.png?generation=1712762223883044&amp;alt=media\"></p>\n<p>Is this still the case ? 😅</p>",
      "rawMarkdown": "## Is the submission speed delta same as the previous years one ?\nI have made two different submissions, with the only change being the model weights:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2F5a31f3418c1a75384cc2b307c0805721%2FScreenshot%20from%202024-04-10%2017-11-48.png?generation=1712761963958235&alt=media)\n\nHowever, the first one ran in 1hours while the second has been running for 2h40 (3h displayed on kaggle) and will most likely time out\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fb6e9155dbd2299787e3b73db411557fb%2FScreenshot%20from%202024-04-10%2017-13-09.png?generation=1712762034793763&alt=media)\n\n\nIs this something you guys also experienced ? I don't remember 100% but I was participating in Birdclef2023 and there was similar problems as pointed out by this comment:\nhttps://www.kaggle.com/competitions/birdclef-2023/discussion/407532\n\nThe answer to those problems was this:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Ff9da0e817d6eee04ba338cc94a8023ad%2FScreenshot%20from%202024-04-10%2017-16-57.png?generation=1712762223883044&alt=media)\n\nIs this still the case ? 😅",
      "votes": null
    },
    {
      "id": "2745427",
      "postDate": "04/10/2024 16:15:23",
      "content": "<p>I have the same problem this afternoon, It's a kaggle problem.</p>",
      "rawMarkdown": "I have the same problem this afternoon, It's a kaggle problem.",
      "votes": null
    },
    {
      "id": "2745436",
      "postDate": "04/10/2024 16:19:34",
      "content": "<p>oh I see thx, hello <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a>, is this something you guys are aware of ?</p>",
      "rawMarkdown": "oh I see thx, hello @sohier, is this something you guys are aware of ?",
      "votes": null
    },
    {
      "id": "2745485",
      "postDate": "04/10/2024 16:47:29",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fe5be30fc8a59bf30f968d849eb3ee163%2FScreenshot%20from%202024-04-10%2018-46-12.png?generation=1712767592998872&amp;alt=media\"></p>\n<p>I reran the second submission (the last) and it ran in 50mins, while the first took 4hours and still ending up scoring 🙂</p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fe5be30fc8a59bf30f968d849eb3ee163%2FScreenshot%20from%202024-04-10%2018-46-12.png?generation=1712767592998872&alt=media)\n\nI reran the second submission (the last) and it ran in 50mins, while the first took 4hours and still ending up scoring 🙂",
      "votes": null
    },
    {
      "id": "2745816",
      "postDate": "04/10/2024 21:06:30",
      "content": "<p>yeah i also got this issue on competition based on cpu inference. I suspect they are doing inference on different cpu </p>",
      "rawMarkdown": "yeah i also got this issue on competition based on cpu inference. I suspect they are doing inference on different cpu",
      "votes": null
    },
    {
      "id": "2751753",
      "postDate": "04/14/2024 13:47:47",
      "content": "<p>I am facing similar situation. During my test runs with the unlabeled files, predictions on 10 files finishes in approximately 40 secs with a consistent 4 sec per file. However, my submission runs for 2hr 15min and times out. </p>",
      "rawMarkdown": "I am facing similar situation. During my test runs with the unlabeled files, predictions on 10 files finishes in approximately 40 secs with a consistent 4 sec per file. However, my submission runs for 2hr 15min and times out.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2745427,
      "author_name": "aikhmelnytskyy",
      "author_url": "",
      "post_date": "04/10/2024 16:15:23",
      "content": "<p>I have the same problem this afternoon, It's a kaggle problem.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2745436,
          "author_name": "janmpia",
          "author_url": "",
          "post_date": "04/10/2024 16:19:34",
          "content": "<p>oh I see thx, hello <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a>, is this something you guys are aware of ?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2745485,
          "author_name": "janmpia",
          "author_url": "",
          "post_date": "04/10/2024 16:47:29",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fe5be30fc8a59bf30f968d849eb3ee163%2FScreenshot%20from%202024-04-10%2018-46-12.png?generation=1712767592998872&amp;alt=media\"></p>\n<p>I reran the second submission (the last) and it ran in 50mins, while the first took 4hours and still ending up scoring 🙂</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2745816,
      "author_name": "ludovick",
      "author_url": "",
      "post_date": "04/10/2024 21:06:30",
      "content": "<p>yeah i also got this issue on competition based on cpu inference. I suspect they are doing inference on different cpu </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2751753,
      "author_name": "sumaniitm",
      "author_url": "",
      "post_date": "04/14/2024 13:47:47",
      "content": "<p>I am facing similar situation. During my test runs with the unlabeled files, predictions on 10 files finishes in approximately 40 secs with a consistent 4 sec per file. However, my submission runs for 2hr 15min and times out. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2745366": "## Is the submission speed delta same as the previous years one ?\nI have made two different submissions, with the only change being the model weights:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2F5a31f3418c1a75384cc2b307c0805721%2FScreenshot%20from%202024-04-10%2017-11-48.png?generation=1712761963958235&alt=media)\n\nHowever, the first one ran in 1hours while the second has been running for 2h40 (3h displayed on kaggle) and will most likely time out\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fb6e9155dbd2299787e3b73db411557fb%2FScreenshot%20from%202024-04-10%2017-13-09.png?generation=1712762034793763&alt=media)\n\n\nIs this something you guys also experienced ? I don't remember 100% but I was participating in Birdclef2023 and there was similar problems as pointed out by this comment:\nhttps://www.kaggle.com/competitions/birdclef-2023/discussion/407532\n\nThe answer to those problems was this:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Ff9da0e817d6eee04ba338cc94a8023ad%2FScreenshot%20from%202024-04-10%2017-16-57.png?generation=1712762223883044&alt=media)\n\nIs this still the case ? 😅",
    "2745427": "I have the same problem this afternoon, It's a kaggle problem.",
    "2745436": "oh I see thx, hello @sohier, is this something you guys are aware of ?",
    "2745485": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12870466%2Fe5be30fc8a59bf30f968d849eb3ee163%2FScreenshot%20from%202024-04-10%2018-46-12.png?generation=1712767592998872&alt=media)\n\nI reran the second submission (the last) and it ran in 50mins, while the first took 4hours and still ending up scoring 🙂",
    "2745816": "yeah i also got this issue on competition based on cpu inference. I suspect they are doing inference on different cpu",
    "2751753": "I am facing similar situation. During my test runs with the unlabeled files, predictions on 10 files finishes in approximately 40 secs with a consistent 4 sec per file. However, my submission runs for 2hr 15min and times out."
  },
  "source": "meta"
}