{
  "id": 498646,
  "title": "How to up infer speed of cpu ？",
  "url": "/competitions/birdclef-2024/discussion/498646",
  "author_name": "",
  "post_date": "2024-04-29T05:17:06.929336600Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>When increase batchsize from 1 to 2 ,4 ,8，I find infer time can not increase.  Who can help me ?</p>",
  "messages": [
    {
      "id": "2782020",
      "postDate": "04/29/2024 05:17:06",
      "content": "<p>When increase batchsize from 1 to 2 ,4 ,8，I find infer time can not increase.  Who can help me ?</p>",
      "rawMarkdown": "When increase batchsize from 1 to 2 ,4 ,8，I find infer time can not increase.  Who can help me ?",
      "votes": null
    },
    {
      "id": "2783405",
      "postDate": "04/29/2024 18:00:38",
      "content": "<p>look at evaluate_audio_file_segments_batched:<br>\n<a href=\"https://www.kaggle.com/code/richolson/feathered-finale-mels-model-auc-score\" target=\"_blank\">https://www.kaggle.com/code/richolson/feathered-finale-mels-model-auc-score</a></p>\n<p>(it's hidden under \"Function to handle inference\")</p>",
      "rawMarkdown": "look at evaluate_audio_file_segments_batched:\nhttps://www.kaggle.com/code/richolson/feathered-finale-mels-model-auc-score\n\n(it's hidden under \"Function to handle inference\")",
      "votes": null
    },
    {
      "id": "2788469",
      "postDate": "05/02/2024 08:47:19",
      "content": "<p>Are you already using <a href=\"https://www.kaggle.com/competitions/birdclef-2024/discussion/493478\" target=\"_blank\">ONNX</a> or <a href=\"https://www.kaggle.com/competitions/birdclef-2024/discussion/499048\" target=\"_blank\">OpenVino</a> for inference speed up? That would speed it up!</p>",
      "rawMarkdown": "Are you already using [ONNX](https://www.kaggle.com/competitions/birdclef-2024/discussion/493478) or [OpenVino](https://www.kaggle.com/competitions/birdclef-2024/discussion/499048) for inference speed up? That would speed it up!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2783405,
      "author_name": "richolson",
      "author_url": "",
      "post_date": "04/29/2024 18:00:38",
      "content": "<p>look at evaluate_audio_file_segments_batched:<br>\n<a href=\"https://www.kaggle.com/code/richolson/feathered-finale-mels-model-auc-score\" target=\"_blank\">https://www.kaggle.com/code/richolson/feathered-finale-mels-model-auc-score</a></p>\n<p>(it's hidden under \"Function to handle inference\")</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2788469,
      "author_name": "hugodeheer",
      "author_url": "",
      "post_date": "05/02/2024 08:47:19",
      "content": "<p>Are you already using <a href=\"https://www.kaggle.com/competitions/birdclef-2024/discussion/493478\" target=\"_blank\">ONNX</a> or <a href=\"https://www.kaggle.com/competitions/birdclef-2024/discussion/499048\" target=\"_blank\">OpenVino</a> for inference speed up? That would speed it up!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2782020": "When increase batchsize from 1 to 2 ,4 ,8，I find infer time can not increase.  Who can help me ?",
    "2783405": "look at evaluate_audio_file_segments_batched:\nhttps://www.kaggle.com/code/richolson/feathered-finale-mels-model-auc-score\n\n(it's hidden under \"Function to handle inference\")",
    "2788469": "Are you already using [ONNX](https://www.kaggle.com/competitions/birdclef-2024/discussion/493478) or [OpenVino](https://www.kaggle.com/competitions/birdclef-2024/discussion/499048) for inference speed up? That would speed it up!"
  },
  "source": "meta"
}