{
  "id": 230036,
  "title": "Previous works for inspiration",
  "url": "/competitions/birdclef-2021/discussion/230036",
  "author_name": "Loulou",
  "post_date": "2021-04-01T18:16:13.420000",
  "votes": 18,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Hi everyone ! Since this competition seems fairly similar to the <a href=\"https://www.kaggle.com/c/birdsong-recognition/overview\" target=\"_blank\">Cornell Birdcall Identification</a>, I'll just drop here the resources that I had put up together at the time. Feel free to check our solution to this competition in the great post by <a href=\"https://www.kaggle.com/theoviel\" target=\"_blank\">@theoviel</a> <a href=\"https://www.kaggle.com/c/birdsong-recognition/discussion/183199\" target=\"_blank\">here</a>.</p>\n<p>First of all, on Kaggle, you have a lot of interesting notebooks, competitions or datasets to get started : </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/mmoreaux/environmental-sound-classification-50\" target=\"_blank\">https://www.kaggle.com/mmoreaux/environmental-sound-classification-50</a></li>\n<li><a href=\"https://www.kaggle.com/c/freesound-audio-tagging/data\" target=\"_blank\">https://www.kaggle.com/c/freesound-audio-tagging/data</a></li>\n<li><a href=\"https://www.kaggle.com/devilsknight/sound-classification-using-spectrogram-images\" target=\"_blank\">https://www.kaggle.com/devilsknight/sound-classification-using-spectrogram-images</a></li>\n<li><a href=\"https://www.kaggle.com/mychen76/automatic-urban-sound-classification-with-cnn\" target=\"_blank\">https://www.kaggle.com/mychen76/automatic-urban-sound-classification-with-cnn</a></li>\n<li><a href=\"https://www.kaggle.com/ashishpatel26/feature-extraction-from-audio\" target=\"_blank\">https://www.kaggle.com/ashishpatel26/feature-extraction-from-audio</a></li>\n<li><a href=\"https://www.kaggle.com/fizzbuzz/beginner-s-guide-to-audio-data\" target=\"_blank\">https://www.kaggle.com/fizzbuzz/beginner-s-guide-to-audio-data</a></li>\n</ul>\n<p>More generally, on <strong>sound classification using deep learning</strong> : </p>\n<ul>\n<li>a very complete <a href=\"https://www.mdpi.com/2076-3417/10/6/2020/pdf\" target=\"_blank\">review of literature</a></li>\n<li><a href=\"https://medium.com/@mikesmales/sound-classification-using-deep-learning-8bc2aa1990b7\" target=\"_blank\">The basics, on medium</a></li>\n<li>a wide library of available papers <a href=\"https://paperswithcode.com/task/audio-classification\" target=\"_blank\">here</a></li>\n<li><a href=\"https://www.iotforall.com/tensorflow-sound-classification-machine-learning-applications/\" target=\"_blank\">if you like tensorflow\n</a></li>\n<li>… or if you're more of a torch person : <a href=\"https://pytorch.org/tutorials/beginner/audio_classifier_tutorial.html?highlight=audio\" target=\"_blank\">here</a> and <a href=\"https://medium.com/@hasithsura/audio-classification-d37a82d6715\" target=\"_blank\">here</a></li>\n<li>an interesting idea with [Deep Generative Architectures](Deep Generative Architectures)</li>\n</ul>\n<p>More specifically, on <strong>bird sound classification</strong> : </p>\n<ul>\n<li><a href=\"https://towardsdatascience.com/sound-based-bird-classification-965d0ecacb2b\" target=\"_blank\">Women in machine learning and Data Science</a> project (girls rule 🙌 )</li>\n<li>on CEUR you have 2 different works with CNN : <a href=\"http://ceur-ws.org/Vol-1866/paper_143.pdf\" target=\"_blank\">one from 2017</a> and <a href=\"http://ceur-ws.org/Vol-2380/paper_68.pdf\" target=\"_blank\">one from 2019</a></li>\n<li>using more handcrafted features, but still CNN : <a href=\"https://www.sciencedirect.com/science/article/abs/pii/S1574954118302991\" target=\"_blank\">this one on australian birds</a></li>\n<li><a href=\"https://asa.scitation.org/doi/10.1121/1.5004570\" target=\"_blank\">kernel-based machine learning</a></li>\n<li>still CNN, on researchGate, you have <a href=\"https://www.researchgate.net/publication/328836649_Bird_Sound_Recognition_Using_a_Convolutional_Neural_Network\" target=\"_blank\">this one</a> and <a href=\"https://www.researchgate.net/publication/322144806_Large-Scale_Bird_Sound_Classification_using_Convolutional_Neural_Networks\" target=\"_blank\">this one</a></li>\n<li>if you feel allergic to handcrafted features or magic, you have <a href=\"https://arxiv.org/pdf/1807.05812.pdf\" target=\"_blank\">this paper on arxiv\n</a></li>\n<li><a href=\"https://arxiv.org/ftp/arxiv/papers/1803/1803.01107.pdf\" target=\"_blank\">that very innovative one</a> using transfer learning, still on arxiv</li>\n</ul>\n<p>If you have, like me, a special interest to Generative Adversarial Networks &amp; DeepGANs:</p>\n<ul>\n<li><a href=\"https://towardsdatascience.com/synthesizing-audio-with-generative-adversarial-networks-8e0308184edd\" target=\"_blank\">towardsdatascience</a>, of course</li>\n<li>for data augmentation : <a href=\"https://ieeexplore.ieee.org/document/8902819\" target=\"_blank\">environmental sounds classification</a></li>\n<li><a href=\"https://www.sciencedirect.com/science/article/pii/S1568494620300132\" target=\"_blank\">masked CNN</a> (bit out of topic, but didn't know where to put it)</li>\n<li><a href=\"https://medium.com/neuronio/audio-generation-with-gans-428bc2de5a89\" target=\"_blank\">audio generation with GAN</a></li>\n<li><a href=\"https://www.groundai.com/project/unsupervised-feature-learning-for-environmental-sound-classification-using-cycle-consistent-generative-adversarial-network/1\" target=\"_blank\">Unsupervised Feature Learning for Environmental Sound Classification Using Cycle Consistent Generative Adversarial Network</a></li>\n<li>still <a href=\"https://www.researchgate.net/publication/335739623_Data_Augmentation_Using_Generative_Adversarial_Network_for_Environmental_Sound_Classification\" target=\"_blank\">data augmentation with GAN\n</a></li>\n</ul>\n<p>… my conclusion ? Well, CNN seems to be a good place to start (at least, very widely used in the literature). You have sample codes from a lot of papers available online, for example <a href=\"https://github.com/kahst/BirdCLEF2017\" target=\"_blank\">here</a> for the paper <a href=\"http://ceur-ws.org/Vol-1866/paper_143.pdf\" target=\"_blank\">Large-Scale Bird Sound Classification using\nConvolutional Neural Networks</a>. But don't get stuck at reproducing peer-reviewed literature ! Try new things, and happy kaggling !</p>",
  "messages": [
    {
      "id": 1259901,
      "postDate": "2021-04-01T18:16:13.420Z",
      "content": "<p>Hi everyone ! Since this competition seems fairly similar to the <a href=\"https://www.kaggle.com/c/birdsong-recognition/overview\" target=\"_blank\">Cornell Birdcall Identification</a>, I'll just drop here the resources that I had put up together at the time. Feel free to check our solution to this competition in the great post by <a href=\"https://www.kaggle.com/theoviel\" target=\"_blank\">@theoviel</a> <a href=\"https://www.kaggle.com/c/birdsong-recognition/discussion/183199\" target=\"_blank\">here</a>.</p>\n<p>First of all, on Kaggle, you have a lot of interesting notebooks, competitions or datasets to get started : </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/mmoreaux/environmental-sound-classification-50\" target=\"_blank\">https://www.kaggle.com/mmoreaux/environmental-sound-classification-50</a></li>\n<li><a href=\"https://www.kaggle.com/c/freesound-audio-tagging/data\" target=\"_blank\">https://www.kaggle.com/c/freesound-audio-tagging/data</a></li>\n<li><a href=\"https://www.kaggle.com/devilsknight/sound-classification-using-spectrogram-images\" target=\"_blank\">https://www.kaggle.com/devilsknight/sound-classification-using-spectrogram-images</a></li>\n<li><a href=\"https://www.kaggle.com/mychen76/automatic-urban-sound-classification-with-cnn\" target=\"_blank\">https://www.kaggle.com/mychen76/automatic-urban-sound-classification-with-cnn</a></li>\n<li><a href=\"https://www.kaggle.com/ashishpatel26/feature-extraction-from-audio\" target=\"_blank\">https://www.kaggle.com/ashishpatel26/feature-extraction-from-audio</a></li>\n<li><a href=\"https://www.kaggle.com/fizzbuzz/beginner-s-guide-to-audio-data\" target=\"_blank\">https://www.kaggle.com/fizzbuzz/beginner-s-guide-to-audio-data</a></li>\n</ul>\n<p>More generally, on <strong>sound classification using deep learning</strong> : </p>\n<ul>\n<li>a very complete <a href=\"https://www.mdpi.com/2076-3417/10/6/2020/pdf\" target=\"_blank\">review of literature</a></li>\n<li><a href=\"https://medium.com/@mikesmales/sound-classification-using-deep-learning-8bc2aa1990b7\" target=\"_blank\">The basics, on medium</a></li>\n<li>a wide library of available papers <a href=\"https://paperswithcode.com/task/audio-classification\" target=\"_blank\">here</a></li>\n<li><a href=\"https://www.iotforall.com/tensorflow-sound-classification-machine-learning-applications/\" target=\"_blank\">if you like tensorflow\n</a></li>\n<li>… or if you're more of a torch person : <a href=\"https://pytorch.org/tutorials/beginner/audio_classifier_tutorial.html?highlight=audio\" target=\"_blank\">here</a> and <a href=\"https://medium.com/@hasithsura/audio-classification-d37a82d6715\" target=\"_blank\">here</a></li>\n<li>an interesting idea with [Deep Generative Architectures](Deep Generative Architectures)</li>\n</ul>\n<p>More specifically, on <strong>bird sound classification</strong> : </p>\n<ul>\n<li><a href=\"https://towardsdatascience.com/sound-based-bird-classification-965d0ecacb2b\" target=\"_blank\">Women in machine learning and Data Science</a> project (girls rule 🙌 )</li>\n<li>on CEUR you have 2 different works with CNN : <a href=\"http://ceur-ws.org/Vol-1866/paper_143.pdf\" target=\"_blank\">one from 2017</a> and <a href=\"http://ceur-ws.org/Vol-2380/paper_68.pdf\" target=\"_blank\">one from 2019</a></li>\n<li>using more handcrafted features, but still CNN : <a href=\"https://www.sciencedirect.com/science/article/abs/pii/S1574954118302991\" target=\"_blank\">this one on australian birds</a></li>\n<li><a href=\"https://asa.scitation.org/doi/10.1121/1.5004570\" target=\"_blank\">kernel-based machine learning</a></li>\n<li>still CNN, on researchGate, you have <a href=\"https://www.researchgate.net/publication/328836649_Bird_Sound_Recognition_Using_a_Convolutional_Neural_Network\" target=\"_blank\">this one</a> and <a href=\"https://www.researchgate.net/publication/322144806_Large-Scale_Bird_Sound_Classification_using_Convolutional_Neural_Networks\" target=\"_blank\">this one</a></li>\n<li>if you feel allergic to handcrafted features or magic, you have <a href=\"https://arxiv.org/pdf/1807.05812.pdf\" target=\"_blank\">this paper on arxiv\n</a></li>\n<li><a href=\"https://arxiv.org/ftp/arxiv/papers/1803/1803.01107.pdf\" target=\"_blank\">that very innovative one</a> using transfer learning, still on arxiv</li>\n</ul>\n<p>If you have, like me, a special interest to Generative Adversarial Networks &amp; DeepGANs:</p>\n<ul>\n<li><a href=\"https://towardsdatascience.com/synthesizing-audio-with-generative-adversarial-networks-8e0308184edd\" target=\"_blank\">towardsdatascience</a>, of course</li>\n<li>for data augmentation : <a href=\"https://ieeexplore.ieee.org/document/8902819\" target=\"_blank\">environmental sounds classification</a></li>\n<li><a href=\"https://www.sciencedirect.com/science/article/pii/S1568494620300132\" target=\"_blank\">masked CNN</a> (bit out of topic, but didn't know where to put it)</li>\n<li><a href=\"https://medium.com/neuronio/audio-generation-with-gans-428bc2de5a89\" target=\"_blank\">audio generation with GAN</a></li>\n<li><a href=\"https://www.groundai.com/project/unsupervised-feature-learning-for-environmental-sound-classification-using-cycle-consistent-generative-adversarial-network/1\" target=\"_blank\">Unsupervised Feature Learning for Environmental Sound Classification Using Cycle Consistent Generative Adversarial Network</a></li>\n<li>still <a href=\"https://www.researchgate.net/publication/335739623_Data_Augmentation_Using_Generative_Adversarial_Network_for_Environmental_Sound_Classification\" target=\"_blank\">data augmentation with GAN\n</a></li>\n</ul>\n<p>… my conclusion ? Well, CNN seems to be a good place to start (at least, very widely used in the literature). You have sample codes from a lot of papers available online, for example <a href=\"https://github.com/kahst/BirdCLEF2017\" target=\"_blank\">here</a> for the paper <a href=\"http://ceur-ws.org/Vol-1866/paper_143.pdf\" target=\"_blank\">Large-Scale Bird Sound Classification using\nConvolutional Neural Networks</a>. But don't get stuck at reproducing peer-reviewed literature ! Try new things, and happy kaggling !</p>",
      "rawMarkdown": "Hi everyone ! Since this competition seems fairly similar to the [Cornell Birdcall Identification](https://www.kaggle.com/c/birdsong-recognition/overview), I'll just drop here the resources that I had put up together at the time. Feel free to check our solution to this competition in the great post by @theoviel [here](https://www.kaggle.com/c/birdsong-recognition/discussion/183199).\n\nFirst of all, on Kaggle, you have a lot of interesting notebooks, competitions or datasets to get started : \n- https://www.kaggle.com/mmoreaux/environmental-sound-classification-50\n- https://www.kaggle.com/c/freesound-audio-tagging/data\n- https://www.kaggle.com/devilsknight/sound-classification-using-spectrogram-images\n- https://www.kaggle.com/mychen76/automatic-urban-sound-classification-with-cnn\n- https://www.kaggle.com/ashishpatel26/feature-extraction-from-audio\n- https://www.kaggle.com/fizzbuzz/beginner-s-guide-to-audio-data\n\nMore generally, on **sound classification using deep learning** : \n- a very complete [review of literature](https://www.mdpi.com/2076-3417/10/6/2020/pdf)\n- [The basics, on medium](https://medium.com/@mikesmales/sound-classification-using-deep-learning-8bc2aa1990b7)\n- a wide library of available papers [here](https://paperswithcode.com/task/audio-classification)\n- [if you like tensorflow\n](https://www.iotforall.com/tensorflow-sound-classification-machine-learning-applications/)\n- ... or if you're more of a torch person : [here](https://pytorch.org/tutorials/beginner/audio_classifier_tutorial.html?highlight=audio) and [here](https://medium.com/@hasithsura/audio-classification-d37a82d6715)\n- an interesting idea with [Deep Generative Architectures](Deep Generative Architectures)\n\nMore specifically, on **bird sound classification** : \n- [Women in machine learning and Data Science](https://towardsdatascience.com/sound-based-bird-classification-965d0ecacb2b) project (girls rule 🙌 )\n- on CEUR you have 2 different works with CNN : [one from 2017](http://ceur-ws.org/Vol-1866/paper_143.pdf) and [one from 2019](http://ceur-ws.org/Vol-2380/paper_68.pdf)\n- using more handcrafted features, but still CNN : [this one on australian birds](https://www.sciencedirect.com/science/article/abs/pii/S1574954118302991)\n- [kernel-based machine learning](https://asa.scitation.org/doi/10.1121/1.5004570)\n- still CNN, on researchGate, you have [this one](https://www.researchgate.net/publication/328836649_Bird_Sound_Recognition_Using_a_Convolutional_Neural_Network) and [this one](https://www.researchgate.net/publication/322144806_Large-Scale_Bird_Sound_Classification_using_Convolutional_Neural_Networks)\n- if you feel allergic to handcrafted features or magic, you have [this paper on arxiv\n](https://arxiv.org/pdf/1807.05812.pdf)\n- [that very innovative one](https://arxiv.org/ftp/arxiv/papers/1803/1803.01107.pdf) using transfer learning, still on arxiv\n\nIf you have, like me, a special interest to Generative Adversarial Networks &amp; DeepGANs:\n- [towardsdatascience](https://towardsdatascience.com/synthesizing-audio-with-generative-adversarial-networks-8e0308184edd), of course\n- for data augmentation : [environmental sounds classification](https://ieeexplore.ieee.org/document/8902819)\n- [masked CNN](https://www.sciencedirect.com/science/article/pii/S1568494620300132) (bit out of topic, but didn't know where to put it)\n- [audio generation with GAN](https://medium.com/neuronio/audio-generation-with-gans-428bc2de5a89)\n- [Unsupervised Feature Learning for Environmental Sound Classification Using Cycle Consistent Generative Adversarial Network](https://www.groundai.com/project/unsupervised-feature-learning-for-environmental-sound-classification-using-cycle-consistent-generative-adversarial-network/1)\n- still [data augmentation with GAN\n](https://www.researchgate.net/publication/335739623_Data_Augmentation_Using_Generative_Adversarial_Network_for_Environmental_Sound_Classification)\n\n... my conclusion ? Well, CNN seems to be a good place to start (at least, very widely used in the literature). You have sample codes from a lot of papers available online, for example [here](https://github.com/kahst/BirdCLEF2017) for the paper [Large-Scale Bird Sound Classification using\nConvolutional Neural Networks](http://ceur-ws.org/Vol-1866/paper_143.pdf). But don't get stuck at reproducing peer-reviewed literature ! Try new things, and happy kaggling !",
      "votes": 18
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1259901": "Hi everyone ! Since this competition seems fairly similar to the [Cornell Birdcall Identification](https://www.kaggle.com/c/birdsong-recognition/overview), I'll just drop here the resources that I had put up together at the time. Feel free to check our solution to this competition in the great post by @theoviel [here](https://www.kaggle.com/c/birdsong-recognition/discussion/183199).\n\nFirst of all, on Kaggle, you have a lot of interesting notebooks, competitions or datasets to get started : \n- https://www.kaggle.com/mmoreaux/environmental-sound-classification-50\n- https://www.kaggle.com/c/freesound-audio-tagging/data\n- https://www.kaggle.com/devilsknight/sound-classification-using-spectrogram-images\n- https://www.kaggle.com/mychen76/automatic-urban-sound-classification-with-cnn\n- https://www.kaggle.com/ashishpatel26/feature-extraction-from-audio\n- https://www.kaggle.com/fizzbuzz/beginner-s-guide-to-audio-data\n\nMore generally, on **sound classification using deep learning** : \n- a very complete [review of literature](https://www.mdpi.com/2076-3417/10/6/2020/pdf)\n- [The basics, on medium](https://medium.com/@mikesmales/sound-classification-using-deep-learning-8bc2aa1990b7)\n- a wide library of available papers [here](https://paperswithcode.com/task/audio-classification)\n- [if you like tensorflow\n](https://www.iotforall.com/tensorflow-sound-classification-machine-learning-applications/)\n- ... or if you're more of a torch person : [here](https://pytorch.org/tutorials/beginner/audio_classifier_tutorial.html?highlight=audio) and [here](https://medium.com/@hasithsura/audio-classification-d37a82d6715)\n- an interesting idea with [Deep Generative Architectures](Deep Generative Architectures)\n\nMore specifically, on **bird sound classification** : \n- [Women in machine learning and Data Science](https://towardsdatascience.com/sound-based-bird-classification-965d0ecacb2b) project (girls rule 🙌 )\n- on CEUR you have 2 different works with CNN : [one from 2017](http://ceur-ws.org/Vol-1866/paper_143.pdf) and [one from 2019](http://ceur-ws.org/Vol-2380/paper_68.pdf)\n- using more handcrafted features, but still CNN : [this one on australian birds](https://www.sciencedirect.com/science/article/abs/pii/S1574954118302991)\n- [kernel-based machine learning](https://asa.scitation.org/doi/10.1121/1.5004570)\n- still CNN, on researchGate, you have [this one](https://www.researchgate.net/publication/328836649_Bird_Sound_Recognition_Using_a_Convolutional_Neural_Network) and [this one](https://www.researchgate.net/publication/322144806_Large-Scale_Bird_Sound_Classification_using_Convolutional_Neural_Networks)\n- if you feel allergic to handcrafted features or magic, you have [this paper on arxiv\n](https://arxiv.org/pdf/1807.05812.pdf)\n- [that very innovative one](https://arxiv.org/ftp/arxiv/papers/1803/1803.01107.pdf) using transfer learning, still on arxiv\n\nIf you have, like me, a special interest to Generative Adversarial Networks &amp; DeepGANs:\n- [towardsdatascience](https://towardsdatascience.com/synthesizing-audio-with-generative-adversarial-networks-8e0308184edd), of course\n- for data augmentation : [environmental sounds classification](https://ieeexplore.ieee.org/document/8902819)\n- [masked CNN](https://www.sciencedirect.com/science/article/pii/S1568494620300132) (bit out of topic, but didn't know where to put it)\n- [audio generation with GAN](https://medium.com/neuronio/audio-generation-with-gans-428bc2de5a89)\n- [Unsupervised Feature Learning for Environmental Sound Classification Using Cycle Consistent Generative Adversarial Network](https://www.groundai.com/project/unsupervised-feature-learning-for-environmental-sound-classification-using-cycle-consistent-generative-adversarial-network/1)\n- still [data augmentation with GAN\n](https://www.researchgate.net/publication/335739623_Data_Augmentation_Using_Generative_Adversarial_Network_for_Environmental_Sound_Classification)\n\n... my conclusion ? Well, CNN seems to be a good place to start (at least, very widely used in the literature). You have sample codes from a lot of papers available online, for example [here](https://github.com/kahst/BirdCLEF2017) for the paper [Large-Scale Bird Sound Classification using\nConvolutional Neural Networks](http://ceur-ws.org/Vol-1866/paper_143.pdf). But don't get stuck at reproducing peer-reviewed literature ! Try new things, and happy kaggling !"
  }
}