{
  "id": 490895,
  "title": "Top Solutions From the Previous Competition (BirdCLEF 2023)",
  "url": "/competitions/birdclef-2024/discussion/490895",
  "author_name": "Sinan Calisir",
  "post_date": "2024-04-03T20:47:16.872000",
  "votes": 38,
  "comment_count": 6,
  "views": 0,
  "content": "<p>Hi everyone,</p>\n<p>Happy to see another BirdCLEF Competition! Here is a list of high scoring solutions from the previous competition that can be helpful to start with!</p>\n<ul>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412808\" target=\"_blank\">1st place solution: Correct Data is All You Need</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412707\" target=\"_blank\">2nd place solution(7 models ensemble)</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412753\" target=\"_blank\">4th Place Solution: Knowledge Distillation is all you need</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412903\" target=\"_blank\">5th place Solution</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412708\" target=\"_blank\">6th place solution: BirdNET embedding + CNN</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412922\" target=\"_blank\">7th place solution</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412871\" target=\"_blank\">8th Place Solution: Implementing Multimodal Data Augmentation Methods with YOLOv8, Recommendation Systems, among others</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412794\" target=\"_blank\">9th Place Solution: 7 CNN Models Ensemble</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412713\" target=\"_blank\">10th place solution with the help of ChatGPT</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412768\" target=\"_blank\">12th place solution: 8 CNN models ensemble with OpenVINO</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412742\" target=\"_blank\">20th place solution: SED + CNN ensemble using onnx</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412996\" target=\"_blank\">24th place solution - pre-training &amp; single model (5 folds ensemble with ONNX)</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412869\" target=\"_blank\">37th place solution - TF CNN + BirdNet emb. cls. &amp; XGB</a></li>\n</ul>",
  "messages": [
    {
      "id": 2733890,
      "postDate": "2024-04-03T20:47:16.873Z",
      "content": "<p>Hi everyone,</p>\n<p>Happy to see another BirdCLEF Competition! Here is a list of high scoring solutions from the previous competition that can be helpful to start with!</p>\n<ul>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412808\" target=\"_blank\">1st place solution: Correct Data is All You Need</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412707\" target=\"_blank\">2nd place solution(7 models ensemble)</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412753\" target=\"_blank\">4th Place Solution: Knowledge Distillation is all you need</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412903\" target=\"_blank\">5th place Solution</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412708\" target=\"_blank\">6th place solution: BirdNET embedding + CNN</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412922\" target=\"_blank\">7th place solution</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412871\" target=\"_blank\">8th Place Solution: Implementing Multimodal Data Augmentation Methods with YOLOv8, Recommendation Systems, among others</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412794\" target=\"_blank\">9th Place Solution: 7 CNN Models Ensemble</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412713\" target=\"_blank\">10th place solution with the help of ChatGPT</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412768\" target=\"_blank\">12th place solution: 8 CNN models ensemble with OpenVINO</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412742\" target=\"_blank\">20th place solution: SED + CNN ensemble using onnx</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412996\" target=\"_blank\">24th place solution - pre-training &amp; single model (5 folds ensemble with ONNX)</a></li>\n<li><a href=\"https://www.kaggle.com/competitions/birdclef-2023/discussion/412869\" target=\"_blank\">37th place solution - TF CNN + BirdNet emb. cls. &amp; XGB</a></li>\n</ul>",
      "rawMarkdown": "Hi everyone,\n\nHappy to see another BirdCLEF Competition! Here is a list of high scoring solutions from the previous competition that can be helpful to start with!\n\n- [1st place solution: Correct Data is All You Need](https://www.kaggle.com/competitions/birdclef-2023/discussion/412808)\n- [2nd place solution(7 models ensemble)](https://www.kaggle.com/competitions/birdclef-2023/discussion/412707)\n- [4th Place Solution: Knowledge Distillation is all you need](https://www.kaggle.com/competitions/birdclef-2023/discussion/412753)\n- [5th place Solution](https://www.kaggle.com/competitions/birdclef-2023/discussion/412903)\n- [6th place solution: BirdNET embedding + CNN](https://www.kaggle.com/competitions/birdclef-2023/discussion/412708)\n- [7th place solution](https://www.kaggle.com/competitions/birdclef-2023/discussion/412922)\n- [8th Place Solution: Implementing Multimodal Data Augmentation Methods with YOLOv8, Recommendation Systems, among others](https://www.kaggle.com/competitions/birdclef-2023/discussion/412871)\n- [9th Place Solution: 7 CNN Models Ensemble](https://www.kaggle.com/competitions/birdclef-2023/discussion/412794)\n- [10th place solution with the help of ChatGPT](https://www.kaggle.com/competitions/birdclef-2023/discussion/412713)\n- [12th place solution: 8 CNN models ensemble with OpenVINO](https://www.kaggle.com/competitions/birdclef-2023/discussion/412768)\n- [20th place solution: SED + CNN ensemble using onnx](https://www.kaggle.com/competitions/birdclef-2023/discussion/412742)\n- [24th place solution - pre-training & single model (5 folds ensemble with ONNX)](https://www.kaggle.com/competitions/birdclef-2023/discussion/412996)\n- [37th place solution - TF CNN + BirdNet emb. cls. & XGB](https://www.kaggle.com/competitions/birdclef-2023/discussion/412869)",
      "votes": 36
    },
    {
      "id": 2771413,
      "postDate": "2024-04-24T08:27:43.760Z",
      "content": "<p>Thanks for collecting this list of past solutions.<br>\nHave you noticed a general trend of what worked back then?</p>",
      "rawMarkdown": "Thanks for collecting this list of past solutions.\nHave you noticed a general trend of what worked back then?",
      "votes": 1,
      "replies": [
        {
          "id": 2771923,
          "postDate": "2024-04-24T13:03:08.610Z",
          "content": "<p>I would say, in the following order:</p>\n<ul>\n<li>Pretraining: Using data from the previous competitions.</li>\n<li>Augmentations: Different type of augmentations both on audio and specs.</li>\n<li>Diverse ensemble: Because of the time limit no crazy ensembles but diversity was important.</li>\n</ul>",
          "rawMarkdown": "I would say, in the following order:\n\n- Pretraining: Using data from the previous competitions.\n- Augmentations: Different type of augmentations both on audio and specs.\n- Diverse ensemble: Because of the time limit no crazy ensembles but diversity was important.",
          "votes": 3,
          "replies": [
            {
              "id": 2772067,
              "postDate": "2024-04-24T14:11:19.423Z",
              "content": "<p>Good insights, thanks.<br>\nIndeed, it seems that pretraining on previous data (while being careful) is one way to boost performance.</p>",
              "rawMarkdown": "Good insights, thanks.\nIndeed, it seems that pretraining on previous data (while being careful) is one way to boost performance.",
              "votes": 3
            },
            {
              "id": 2772072,
              "postDate": "2024-04-24T14:13:39.927Z",
              "content": "<p>It also seems that <a href=\"https://paperswithcode.com/task/sound-event-detection\" target=\"_blank\">SED</a> models with various backbones are a good starting point.</p>",
              "rawMarkdown": "It also seems that [SED](https://paperswithcode.com/task/sound-event-detection) models with various backbones are a good starting point.",
              "votes": 2
            }
          ]
        }
      ]
    },
    {
      "id": 2737595,
      "postDate": "2024-04-05T20:20:05.637Z",
      "content": "<p>Very useful! :D</p>",
      "rawMarkdown": "Very useful! :D",
      "votes": 1
    },
    {
      "id": 2779207,
      "postDate": "2024-04-27T15:23:44.640Z",
      "content": "<p>Thank you. This is All I NEED ! </p>",
      "rawMarkdown": "Thank you. This is All I NEED ! ",
      "votes": 1,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 2771413,
      "author_name": "Yassine Alouini",
      "author_url": "",
      "post_date": "2024-04-24T08:27:43.760000",
      "content": "<p>Thanks for collecting this list of past solutions.<br>\nHave you noticed a general trend of what worked back then?</p>",
      "votes": 1,
      "replies": [
        {
          "id": 2771923,
          "author_name": "Sinan Calisir",
          "author_url": "",
          "post_date": "2024-04-24T13:03:08.610000",
          "content": "<p>I would say, in the following order:</p>\n<ul>\n<li>Pretraining: Using data from the previous competitions.</li>\n<li>Augmentations: Different type of augmentations both on audio and specs.</li>\n<li>Diverse ensemble: Because of the time limit no crazy ensembles but diversity was important.</li>\n</ul>",
          "votes": 3,
          "replies": [
            {
              "id": 2772067,
              "author_name": "Yassine Alouini",
              "author_url": "",
              "post_date": "2024-04-24T14:11:19.423000",
              "content": "<p>Good insights, thanks.<br>\nIndeed, it seems that pretraining on previous data (while being careful) is one way to boost performance.</p>",
              "votes": 3,
              "replies": []
            },
            {
              "id": 2772072,
              "author_name": "Yassine Alouini",
              "author_url": "",
              "post_date": "2024-04-24T14:13:39.927000",
              "content": "<p>It also seems that <a href=\"https://paperswithcode.com/task/sound-event-detection\" target=\"_blank\">SED</a> models with various backbones are a good starting point.</p>",
              "votes": 2,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2737595,
      "author_name": "Khoa Tran",
      "author_url": "",
      "post_date": "2024-04-05T20:20:05.637000",
      "content": "<p>Very useful! :D</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 2779207,
      "author_name": "",
      "author_url": "",
      "post_date": "2024-04-27T15:23:44.640000",
      "content": "<p>Thank you. This is All I NEED ! </p>",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2733890": "Hi everyone,\n\nHappy to see another BirdCLEF Competition! Here is a list of high scoring solutions from the previous competition that can be helpful to start with!\n\n- [1st place solution: Correct Data is All You Need](https://www.kaggle.com/competitions/birdclef-2023/discussion/412808)\n- [2nd place solution(7 models ensemble)](https://www.kaggle.com/competitions/birdclef-2023/discussion/412707)\n- [4th Place Solution: Knowledge Distillation is all you need](https://www.kaggle.com/competitions/birdclef-2023/discussion/412753)\n- [5th place Solution](https://www.kaggle.com/competitions/birdclef-2023/discussion/412903)\n- [6th place solution: BirdNET embedding + CNN](https://www.kaggle.com/competitions/birdclef-2023/discussion/412708)\n- [7th place solution](https://www.kaggle.com/competitions/birdclef-2023/discussion/412922)\n- [8th Place Solution: Implementing Multimodal Data Augmentation Methods with YOLOv8, Recommendation Systems, among others](https://www.kaggle.com/competitions/birdclef-2023/discussion/412871)\n- [9th Place Solution: 7 CNN Models Ensemble](https://www.kaggle.com/competitions/birdclef-2023/discussion/412794)\n- [10th place solution with the help of ChatGPT](https://www.kaggle.com/competitions/birdclef-2023/discussion/412713)\n- [12th place solution: 8 CNN models ensemble with OpenVINO](https://www.kaggle.com/competitions/birdclef-2023/discussion/412768)\n- [20th place solution: SED + CNN ensemble using onnx](https://www.kaggle.com/competitions/birdclef-2023/discussion/412742)\n- [24th place solution - pre-training & single model (5 folds ensemble with ONNX)](https://www.kaggle.com/competitions/birdclef-2023/discussion/412996)\n- [37th place solution - TF CNN + BirdNet emb. cls. & XGB](https://www.kaggle.com/competitions/birdclef-2023/discussion/412869)",
    "2771413": "Thanks for collecting this list of past solutions.\nHave you noticed a general trend of what worked back then?",
    "2737595": "Very useful! :D",
    "2779207": "Thank you. This is All I NEED ! "
  }
}