{
  "id": 321871,
  "title": "What's your cv strategy?",
  "url": "/competitions/birdclef-2022/discussion/321871",
  "author_name": "Zhongkai Shangguan",
  "post_date": "2022-04-29T04:54:43.779000",
  "votes": 5,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I am currently using two cv strategy by <a href=\"https://www.kaggle.com/code/kaerunantoka/birdclef2022-use-2nd-label-f0\" target=\"_blank\">BirdCLEF2022 : use 2nd label f0</a> and <a href=\"https://www.kaggle.com/competitions/birdclef-2022/discussion/314999\" target=\"_blank\">this discussion</a>. However the cv is very different from lb.<br>\nUsing threshold 0.3 and first cv strategy above, i.e.,<br>\n <code>metrics.f1_score(np.array(self.y_true), np.array(self.y_pred) &gt; 0.3, average=\"micro\")</code>, I got 0.78, and with the same threshold and second cv strategy <br>\n<code>comp_metric(np.array(self.y_true), np.array(self.y_pred) &gt; 0.3)</code> my cv is 0.87. <br>\nHowever, the lb is only 0.72 (I use threshold=0.05 as mentioned in <a href=\"https://www.kaggle.com/competitions/birdclef-2022/discussion/318999\" target=\"_blank\">this dicussion</a>, the lower the better, which is consistent with my experiments), which is very different from cv.</p>\n<p>What's your cv strategy and any comments?</p>",
  "messages": [
    {
      "id": 1771292,
      "postDate": "2022-04-29T04:54:43.780Z",
      "content": "<p>I am currently using two cv strategy by <a href=\"https://www.kaggle.com/code/kaerunantoka/birdclef2022-use-2nd-label-f0\" target=\"_blank\">BirdCLEF2022 : use 2nd label f0</a> and <a href=\"https://www.kaggle.com/competitions/birdclef-2022/discussion/314999\" target=\"_blank\">this discussion</a>. However the cv is very different from lb.<br>\nUsing threshold 0.3 and first cv strategy above, i.e.,<br>\n <code>metrics.f1_score(np.array(self.y_true), np.array(self.y_pred) &gt; 0.3, average=\"micro\")</code>, I got 0.78, and with the same threshold and second cv strategy <br>\n<code>comp_metric(np.array(self.y_true), np.array(self.y_pred) &gt; 0.3)</code> my cv is 0.87. <br>\nHowever, the lb is only 0.72 (I use threshold=0.05 as mentioned in <a href=\"https://www.kaggle.com/competitions/birdclef-2022/discussion/318999\" target=\"_blank\">this dicussion</a>, the lower the better, which is consistent with my experiments), which is very different from cv.</p>\n<p>What's your cv strategy and any comments?</p>",
      "rawMarkdown": "I am currently using two cv strategy by [BirdCLEF2022 : use 2nd label f0](https://www.kaggle.com/code/kaerunantoka/birdclef2022-use-2nd-label-f0) and [this discussion](https://www.kaggle.com/competitions/birdclef-2022/discussion/314999). However the cv is very different from lb.\nUsing threshold 0.3 and first cv strategy above, i.e.,\n `metrics.f1_score(np.array(self.y_true), np.array(self.y_pred) > 0.3, average=\"micro\")`, I got 0.78, and with the same threshold and second cv strategy \n`comp_metric(np.array(self.y_true), np.array(self.y_pred) > 0.3)` my cv is 0.87. \nHowever, the lb is only 0.72 (I use threshold=0.05 as mentioned in [this dicussion](https://www.kaggle.com/competitions/birdclef-2022/discussion/318999), the lower the better, which is consistent with my experiments), which is very different from cv.\n\nWhat's your cv strategy and any comments?",
      "votes": 5
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1771292": "I am currently using two cv strategy by [BirdCLEF2022 : use 2nd label f0](https://www.kaggle.com/code/kaerunantoka/birdclef2022-use-2nd-label-f0) and [this discussion](https://www.kaggle.com/competitions/birdclef-2022/discussion/314999). However the cv is very different from lb.\nUsing threshold 0.3 and first cv strategy above, i.e.,\n `metrics.f1_score(np.array(self.y_true), np.array(self.y_pred) > 0.3, average=\"micro\")`, I got 0.78, and with the same threshold and second cv strategy \n`comp_metric(np.array(self.y_true), np.array(self.y_pred) > 0.3)` my cv is 0.87. \nHowever, the lb is only 0.72 (I use threshold=0.05 as mentioned in [this dicussion](https://www.kaggle.com/competitions/birdclef-2022/discussion/318999), the lower the better, which is consistent with my experiments), which is very different from cv.\n\nWhat's your cv strategy and any comments?"
  }
}