Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.
\nNow, let's not stop here :)
\nShare your approach with the scientific community and submit a working note!
\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.
\nUpdate June 2: Added short intro and BibTeX entries for LifeCLEF and BirdCLEF overview papers
\nUpdate May 19: Added download link for working note templates; added submission instructions
Building accurate knowledge of the identity, the geographic distribution and the evolution of species is essential for a sustainable development of humanity, as well as for biodiversity conservation. However, the burden of the routine identification of plants and animals in the field is strongly penalizing the aggregation of new data and knowledge. Identifying and naming living plants or animals is actually almost impossible for the public and often a difficult task for professionals and naturalists. Bridging this gap is a key challenge towards enabling effective biodiversity monitoring systems. The LifeCLEF evaluation campaign aims at boosting and evaluating the advances in this domain since 2011. (LifeCLEF mission statement)
\nEach year, participants of LifeCLEF publish their research as part of the CLEF workshop proceedings (e.g., http://ceur-ws.org/Vol-2696/). In this year’s edition, we would like you to contribute to this research by publishing your solution as a working note. Why should you do this? Here are a few reasons:
\nWe will provide a template to get you started. If you publish a write-up of your solution, why not publish it as a paper? Each working note should be between 2 and 8 pages long.
\nOn top of that, we will review and rate all submitted working notes; the best paper will be awarded $5,000 in Google Cloud Platform credits.
\nGo to the “Evaluation” subsection to see more details about how we will review.
\nWhat does a working note look like? Here are a few (admittedly very extensive) examples of previous years:
\nOk, what is the timeline for a submission:
\nTemplates
\nYou can find working note templates for Word or LaTeX online in this shared folder: Templates folder
\nBoth templates are valid for a submission, yet, we would advise you to use the LaTeX version (e.g., as import in Overleaf) as it contains more valuable info on how to format your paper.
\nHow to submit?
\nThe CLEF conference uses EasyChair as submission management system. All you need to do to submit a working is:
\nWill my score/rank be good enough for a working note?
\nEveryone can submit a working note, independent of score or rank! We assume that everyone did extensive experiments to come up with a solution that could be valuable for future participants or future researchers in the field of bioacoustics. Even if your efforts are not reflected in your leaderboard rank, your contribution can be valuable to others! You tried something new, explored a new technique (well, maybe even transformers…)? We would like to see your write-up!
\nWill my working note be accepted?
\nEvery submitted working note will go through a light review process and authors will have the chance to update their submissions before the final deadline on July 2nd.
\nA working note is a systematic record of your experiments and does not have to include new approaches or state-of-the-art results. Be sure to submit a comprehensible record that might help others get started. Additional code that accompanies the working note is highly encouraged.
\nAmong all submitted working notes, we will pick the best submission and award the \"Best working note award\" - independent of score and rank, only based on the quality of the write-up.
\nOk, how should I structure my working note?
\nWe would suggest the following contents:
\nWe do not enforce a page limit, but ideally, your working note would be between 4 and 8 pages long.
\nOther requirements
\nPlease make sure to cite the LifeCLEF and BirdCLEF overview papers in your working notes. In return, we will cite your working note in our overview paper. Here are the BibTeX entries for both overviews:
\n@inproceedings{lifeclef2021, \n title={Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction}, \n author={Joly, Alexis and Go\\\"{e}au, Herv\\'{e} and Kahl, Stefan and Picek, Luk\\'{a}\\v{s} and Lorieul, Titouan and Cole, Elijah and Deneu, Benjamin and Servajean, Maximilien and Ruiz De Casta\\~{n}eda, Rafael and Bolon, Isabelle and Glotin, Herv\\'{e} and Planqu\\'{e}, Robert and Vellinga, Willem-Pier and Dorso, Andrew and Klinck, Holger and Denton, Tom and Eggel, Ivan and Bonnet, Pierre and M\\\"{u}ller, Henning},\n booktitle={Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021)},\n year={2021} \n }\n@inproceedings{birdclef2021,\n title={Overview of BirdCLEF 2021: Bird call identification in soundscape recordings},\n author={Kahl, Stefan and Denton, Tom and Klinck, Holger and Glotin, Herv\\'{e} and Go\\\"{e}au, Herv\\'{e} and Vellinga, Willem-Pier and Planqu\\'{e}, Robert and Joly, Alexis},\n booktitle={Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum},\n year={2021}\n}\nLet us know if you have any questions about how to contribute, we will keep this thread updated.
", "messages": [ { "id": 1259698, "postDate": "2021-04-01T15:40:25.810Z", "content": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.
\nNow, let's not stop here :)
\nShare your approach with the scientific community and submit a working note!
\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.
\nUpdate June 2: Added short intro and BibTeX entries for LifeCLEF and BirdCLEF overview papers
\nUpdate May 19: Added download link for working note templates; added submission instructions
Building accurate knowledge of the identity, the geographic distribution and the evolution of species is essential for a sustainable development of humanity, as well as for biodiversity conservation. However, the burden of the routine identification of plants and animals in the field is strongly penalizing the aggregation of new data and knowledge. Identifying and naming living plants or animals is actually almost impossible for the public and often a difficult task for professionals and naturalists. Bridging this gap is a key challenge towards enabling effective biodiversity monitoring systems. The LifeCLEF evaluation campaign aims at boosting and evaluating the advances in this domain since 2011. (LifeCLEF mission statement)
\nEach year, participants of LifeCLEF publish their research as part of the CLEF workshop proceedings (e.g., http://ceur-ws.org/Vol-2696/). In this year’s edition, we would like you to contribute to this research by publishing your solution as a working note. Why should you do this? Here are a few reasons:
\nWe will provide a template to get you started. If you publish a write-up of your solution, why not publish it as a paper? Each working note should be between 2 and 8 pages long.
\nOn top of that, we will review and rate all submitted working notes; the best paper will be awarded $5,000 in Google Cloud Platform credits.
\nGo to the “Evaluation” subsection to see more details about how we will review.
\nWhat does a working note look like? Here are a few (admittedly very extensive) examples of previous years:
\nOk, what is the timeline for a submission:
\nTemplates
\nYou can find working note templates for Word or LaTeX online in this shared folder: Templates folder
\nBoth templates are valid for a submission, yet, we would advise you to use the LaTeX version (e.g., as import in Overleaf) as it contains more valuable info on how to format your paper.
\nHow to submit?
\nThe CLEF conference uses EasyChair as submission management system. All you need to do to submit a working is:
\nWill my score/rank be good enough for a working note?
\nEveryone can submit a working note, independent of score or rank! We assume that everyone did extensive experiments to come up with a solution that could be valuable for future participants or future researchers in the field of bioacoustics. Even if your efforts are not reflected in your leaderboard rank, your contribution can be valuable to others! You tried something new, explored a new technique (well, maybe even transformers…)? We would like to see your write-up!
\nWill my working note be accepted?
\nEvery submitted working note will go through a light review process and authors will have the chance to update their submissions before the final deadline on July 2nd.
\nA working note is a systematic record of your experiments and does not have to include new approaches or state-of-the-art results. Be sure to submit a comprehensible record that might help others get started. Additional code that accompanies the working note is highly encouraged.
\nAmong all submitted working notes, we will pick the best submission and award the \"Best working note award\" - independent of score and rank, only based on the quality of the write-up.
\nOk, how should I structure my working note?
\nWe would suggest the following contents:
\nWe do not enforce a page limit, but ideally, your working note would be between 4 and 8 pages long.
\nOther requirements
\nPlease make sure to cite the LifeCLEF and BirdCLEF overview papers in your working notes. In return, we will cite your working note in our overview paper. Here are the BibTeX entries for both overviews:
\n@inproceedings{lifeclef2021, \n title={Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction}, \n author={Joly, Alexis and Go\\\"{e}au, Herv\\'{e} and Kahl, Stefan and Picek, Luk\\'{a}\\v{s} and Lorieul, Titouan and Cole, Elijah and Deneu, Benjamin and Servajean, Maximilien and Ruiz De Casta\\~{n}eda, Rafael and Bolon, Isabelle and Glotin, Herv\\'{e} and Planqu\\'{e}, Robert and Vellinga, Willem-Pier and Dorso, Andrew and Klinck, Holger and Denton, Tom and Eggel, Ivan and Bonnet, Pierre and M\\\"{u}ller, Henning},\n booktitle={Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021)},\n year={2021} \n }\n@inproceedings{birdclef2021,\n title={Overview of BirdCLEF 2021: Bird call identification in soundscape recordings},\n author={Kahl, Stefan and Denton, Tom and Klinck, Holger and Glotin, Herv\\'{e} and Go\\\"{e}au, Herv\\'{e} and Vellinga, Willem-Pier and Planqu\\'{e}, Robert and Joly, Alexis},\n booktitle={Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum},\n year={2021}\n}\nLet us know if you have any questions about how to contribute, we will keep this thread updated.
", "rawMarkdown": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.\n\nNow, let's not stop here :)\n\nShare your approach with the scientific community and submit a working note!\n\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.\n\n***Update June 2: Added short intro and BibTeX entries for LifeCLEF and BirdCLEF overview papers***\n***Update May 19: Added download link for working note templates; added submission instructions***\n\nBuilding accurate knowledge of the identity, the geographic distribution and the evolution of species is essential for a sustainable development of humanity, as well as for biodiversity conservation. However, the burden of the routine identification of plants and animals in the field is strongly penalizing the aggregation of new data and knowledge. Identifying and naming living plants or animals is actually almost impossible for the public and often a difficult task for professionals and naturalists. Bridging this gap is a key challenge towards enabling effective biodiversity monitoring systems. The LifeCLEF evaluation campaign aims at boosting and evaluating the advances in this domain since 2011. ([LifeCLEF mission statement](https://www.imageclef.org/LifeCLEF2021))\n\nEach year, participants of LifeCLEF publish their research as part of the CLEF workshop proceedings (e.g., [http://ceur-ws.org/Vol-2696/](http://ceur-ws.org/Vol-2696/)). In this year’s edition, we would like you to contribute to this research by publishing your solution as a working note. Why should you do this? Here are a few reasons:\n\n- publish original research and be recognized as a scientist\n- make your solution accessible to a broad audience\n- earn citations and reputation\n- submitting a working note makes you eligible to present at [CLEF 2021](http://clef2021.clef-initiative.eu)\n\nWe will provide a template to get you started. If you publish a write-up of your solution, why not publish it as a paper? Each working note should be between 2 and 8 pages long.\n\n**On top of that, we will review and rate all submitted working notes; the best paper will be awarded $5,000 in Google Cloud Platform credits.**\n\nGo to the “[Evaluation](https://www.kaggle.com/c/birdclef-2021/overview/evaluation)” subsection to see more details about how we will review.\n\nWhat does a working note look like? Here are a few (admittedly very extensive) examples of previous years:\n\n- [Bird Species Recognition via Neural Architecture Search](http://ceur-ws.org/Vol-2696/paper_188.pdf) by Markus Mühling, Jakob Franz, Nikolaus Korfhage, Bernd Freisleben\n- [Bird Species Identification in Soundscapes](http://ceur-ws.org/Vol-2380/paper_86.pdf) by Mario Lasseck\n- [Bird Identification from Timestamped, Geotagged Audio Recordings](http://ceur-ws.org/Vol-2125/paper_181.pdf) by Jan Schlüter\n\nOk, what is the timeline for a submission: \n\n- May 31, 2021 - Final Submission Deadline for competition\n- Friday, June 11th, 2021 - Deadline for the submission of working notes\n- June 14th - June 25th, 2021 - Peer-review period\n- Friday, July 2nd, 2021 - Deadline for the submission of the camera-ready working notes\n\n**Templates**\n\nYou can find working note templates for Word or LaTeX online in this shared folder: [Templates folder](https://drive.google.com/drive/folders/1K5encrAZu08WYdS5lREZ94gOOEvAUJqS?usp=sharing)\n\nBoth templates are valid for a submission, yet, we would advise you to use the LaTeX version (e.g., as import in Overleaf) as it contains more valuable info on how to format your paper.\n\n**How to submit?**\n\nThe CLEF conference uses EasyChair as submission management system. All you need to do to submit a working is:\n\n- go to the [EasyChair webpage](https://easychair.org/conferences/?conf=clef2021)\n- sign in or create an account and sign in with your new account\n- after completing the account creation, click on \"*make a new submission*\"\n- select \"*Multimedia Life Species Identification (LifeCLEF)*\" as track\n- enter author information, title, and abstract\n- select \"*Task 2 - BirdCLEF*\"\n- chose a PDF (make sure to use the official template) and click \"*Submit*\"\n\n**Will my score/rank be good enough for a working note?**\n\nEveryone can submit a working note, independent of score or rank! We assume that everyone did extensive experiments to come up with a solution that could be valuable for future participants or future researchers in the field of bioacoustics. Even if your efforts are not reflected in your leaderboard rank, your contribution can be valuable to others! You tried something new, explored a new technique (well, maybe even transformers...)? We would like to see your write-up!\n\n**Will my working note be accepted?**\n\nEvery submitted working note will go through a light review process and authors will have the chance to update their submissions before the final deadline on July 2nd. \n\nA working note is a systematic record of your experiments and does not have to include new approaches or state-of-the-art results. Be sure to submit a comprehensible record that might help others get started. Additional code that accompanies the working note is highly encouraged.\n\nAmong all submitted working notes, we will pick the best submission and award the \"Best working note award\" - independent of score and rank, only based on the quality of the write-up.\n\n**Ok, how should I structure my working note?**\n\nWe would suggest the following contents:\n\n- introduce the competition and data\n- introduce the related work that your approach is based on\n- outline your experimental setup and your approach\n- provide results (leaderboard and/or local evaluation)\n- discuss your results and add some future ideas to improve\n\nWe do not enforce a page limit, but ideally, your working note would be between 4 and 8 pages long.\n\n**Other requirements**\n\nPlease make sure to cite the LifeCLEF and BirdCLEF overview papers in your working notes. In return, we will cite your working note in our overview paper. Here are the BibTeX entries for both overviews:\n\n```\n@inproceedings{lifeclef2021, \n title={Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction}, \n author={Joly, Alexis and Go\\\"{e}au, Herv\\'{e} and Kahl, Stefan and Picek, Luk\\'{a}\\v{s} and Lorieul, Titouan and Cole, Elijah and Deneu, Benjamin and Servajean, Maximilien and Ruiz De Casta\\~{n}eda, Rafael and Bolon, Isabelle and Glotin, Herv\\'{e} and Planqu\\'{e}, Robert and Vellinga, Willem-Pier and Dorso, Andrew and Klinck, Holger and Denton, Tom and Eggel, Ivan and Bonnet, Pierre and M\\\"{u}ller, Henning},\n booktitle={Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021)},\n year={2021} \n }\n```\n```\n@inproceedings{birdclef2021,\n title={Overview of BirdCLEF 2021: Bird call identification in soundscape recordings},\n author={Kahl, Stefan and Denton, Tom and Klinck, Holger and Glotin, Herv\\'{e} and Go\\\"{e}au, Herv\\'{e} and Vellinga, Willem-Pier and Planqu\\'{e}, Robert and Joly, Alexis},\n booktitle={Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum},\n year={2021}\n}\n\n```\n\nLet us know if you have any questions about how to contribute, we will keep this thread updated.\n", "votes": 46 }, { "id": 1342280, "postDate": "2021-06-09T10:15:08.833Z", "content": "@stefankahl what's the exact deadline for submitting?
", "rawMarkdown": "@stefankahl what's the exact deadline for submitting? ", "votes": 5, "replies": [ { "id": 1343474, "postDate": "2021-06-10T08:21:47.450Z", "content": "Friday, June 11th, 2021, at 11:59 PM UTC
\nPlease let us know if you encounter any difficulties when submitting. Thanks.
", "rawMarkdown": "Friday, June 11th, 2021, at 11:59 PM UTC\n\nPlease let us know if you encounter any difficulties when submitting. Thanks." } ] }, { "id": 1266540, "postDate": "2021-04-07T21:29:42.487Z", "content": "This is great.
\nSome kaggle solutions deserve to be published and cited by academics. I will definitely submit if I end up with a good rank.
", "rawMarkdown": "This is great.\n\nSome kaggle solutions deserve to be published and cited by academics. I will definitely submit if I end up with a good rank.", "votes": 5, "replies": [ { "id": 1266981, "postDate": "2021-04-08T08:13:17.863Z", "content": "That's great news! And even if you don't end up with the rank you were expecting, you most certainly did some interesting experiments and tried different strategies - all of them are worth mentioning to bring the field forward.
", "rawMarkdown": "That's great news! And even if you don't end up with the rank you were expecting, you most certainly did some interesting experiments and tried different strategies - all of them are worth mentioning to bring the field forward. ", "votes": 4 } ] }, { "id": 1260318, "postDate": "2021-04-02T02:42:33.963Z", "content": "What a great initiative! I wish more competitions had a such clear path to publication and recognition like this one.
", "rawMarkdown": "What a great initiative! I wish more competitions had a such clear path to publication and recognition like this one.", "votes": 4 }, { "id": 1346347, "postDate": "2021-06-12T09:54:25.727Z", "content": "Thank you to everyone who submitted a working note. We appreciate your extra effort in sharing your approach. In the next few days, we will assign reviewers and provide feedback on your submission. The final submission (camera-ready) deadline is June 2nd, and we will award the best working note with $5,000 in GCP credits based on the camera-ready version. We will be transparent about the rating, and we will post assigned ratings, working notes and winners in a separate thread.
", "rawMarkdown": "Thank you to everyone who submitted a working note. We appreciate your extra effort in sharing your approach. In the next few days, we will assign reviewers and provide feedback on your submission. The final submission (camera-ready) deadline is June 2nd, and we will award the best working note with $5,000 in GCP credits based on the camera-ready version. We will be transparent about the rating, and we will post assigned ratings, working notes and winners in a separate thread.", "votes": 2, "replies": [ { "id": 1346729, "postDate": "2021-06-12T15:19:26.727Z", "content": "@stefankahl Thank you for the update. I wanted to ask if it is possible to get some confirmation that the submitted working notes are taken in the consideration. I got a confirmation email from EasyChair but just wanted to make sure that our submission doesn't get lost in ~250 other submissions (with some of them not related to BirdCLEF 2021).
", "rawMarkdown": "@stefankahl Thank you for the update. I wanted to ask if it is possible to get some confirmation that the submitted working notes are taken in the consideration. I got a confirmation email from EasyChair but just wanted to make sure that our submission doesn't get lost in ~250 other submissions (with some of them not related to BirdCLEF 2021).", "votes": 1 }, { "id": 1346778, "postDate": "2021-06-12T16:05:17.970Z", "content": "Yes, absolutely, every submission will be reviewed and is eligible to receive the award. As soon as the reviews are in, we'll let you know. Your submission should be 244, is that correct?
", "rawMarkdown": "Yes, absolutely, every submission will be reviewed and is eligible to receive the award. As soon as the reviews are in, we'll let you know. Your submission should be 244, is that correct?", "votes": 1 }, { "id": 1348102, "postDate": "2021-06-13T18:37:13.857Z", "content": "Yes our submission is #244, thank you so much for checking it.
", "rawMarkdown": "Yes our submission is #244, thank you so much for checking it." } ] }, { "id": 1342140, "postDate": "2021-06-09T07:52:28.220Z", "content": "Sure, this is what it should look like:
\nA. Joly, H. Goëau, S. Kahl, L. Picek, T. Lorieul, E. Cole, B. Deneu, M. Servajean, R. Ruiz DeCastañeda, I. Bolon, H. Glotin, R. Planqué, W.-P. Vellinga, A. Dorso, H. Klinck, T. Denton, I. Eggel, P. Bonnet, H. Müller, Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction, in: Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021), 2021.
\nS. Kahl, T. Denton, H. Klinck, H. Glotin, H. Goëau, W.-P. Vellinga, R. Planqué, A. Joly, Overview of BirdCLEF 2021: Bird call identification in soundscape recordings, in: Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, 2021.
", "rawMarkdown": "Sure, this is what it should look like:\n\nA. Joly, H. Goëau, S. Kahl, L. Picek, T. Lorieul, E. Cole, B. Deneu, M. Servajean, R. Ruiz DeCastañeda, I. Bolon, H. Glotin, R. Planqué, W.-P. Vellinga, A. Dorso, H. Klinck, T. Denton, I. Eggel, P. Bonnet, H. Müller, Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction, in: Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021), 2021.\n\nS. Kahl, T. Denton, H. Klinck, H. Glotin, H. Goëau, W.-P. Vellinga, R. Planqué, A. Joly, Overview of BirdCLEF 2021: Bird call identification in soundscape recordings, in: Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, 2021.", "votes": 2 }, { "id": 1377042, "postDate": "2021-07-05T14:38:41.663Z", "content": "@stefankahl
\nLet me ask you a question. The working note we created was submitted to a conference workshop, but do we need to make a presentation in September? Or is the workshop only for reviewing and scoring the working note, not for making a presentation?
CLEF2021 will be an online event and - as far as I know - will be free of charge. Which means anyone can register and participate. We will have a LifeCLEF workshop as part of the main conference, but this workshop consists of only two 90-minute panels. So there won't be enough time for everyone to present. However, we will invite speakers and ask them to present their approach (typically, the best ranked teams get to present). We'll keep you posted. More info on CLEF in general can be found here: http://clef2021.clef-initiative.eu/index.php?page=Pages/organizers.html (unfortunately, the page is not up-to-date but hopefully will be in late August, early September.).
", "rawMarkdown": "CLEF2021 will be an online event and - as far as I know - will be free of charge. Which means anyone can register and participate. We will have a LifeCLEF workshop as part of the main conference, but this workshop consists of only two 90-minute panels. So there won't be enough time for everyone to present. However, we will invite speakers and ask them to present their approach (typically, the best ranked teams get to present). We'll keep you posted. More info on CLEF in general can be found here: http://clef2021.clef-initiative.eu/index.php?page=Pages/organizers.html (unfortunately, the page is not up-to-date but hopefully will be in late August, early September.).", "votes": 3 }, { "id": 1378377, "postDate": "2021-07-06T13:37:23.483Z", "content": "Thank you for your quick reply.
\nYou mean that some of the teams whose working note was accepted will present it, but it is not yet decided which team will present it. (the team with the highest LB score is likely to be chosen).
\nIf I am wrong in my understanding, please let me know.
The problem is a mix of many sub-problems (many teams broke out a separate no-call classifier, for example, or put special work into methods for finding good thresholds, or ID'ing easily-confused species, etc.)… So it's very possible to do really interesting work and provide a high-quality write-up without necessarily getting the highest score on the end-to-end problem.
", "rawMarkdown": "The problem is a mix of many sub-problems (many teams broke out a separate no-call classifier, for example, or put special work into methods for finding good thresholds, or ID'ing easily-confused species, etc.)... So it's very possible to do really interesting work and provide a high-quality write-up without necessarily getting the highest score on the end-to-end problem.", "votes": 2 }, { "id": 1379195, "postDate": "2021-07-07T06:51:45.033Z", "content": "Depending on how much time we have for BirdCLEF (other tasks will present too), we'll ask participants to present. Yet, we won't force anyone to present and will ask the next team in line (depending on rank and or quality of working note) if they want to present. Unfortunately, that's all I can say and know until we have a workshop schedule (which we'll probably have in August).
\nWould you like to present? If so, just let me know and I'll see if I can fit you in.
", "rawMarkdown": "Depending on how much time we have for BirdCLEF (other tasks will present too), we'll ask participants to present. Yet, we won't force anyone to present and will ask the next team in line (depending on rank and or quality of working note) if they want to present. Unfortunately, that's all I can say and know until we have a workshop schedule (which we'll probably have in August). \n\nWould you like to present? If so, just let me know and I'll see if I can fit you in.", "votes": 2 }, { "id": 1379386, "postDate": "2021-07-07T10:17:31.097Z", "content": "Will you publish the quality of working notes?
", "rawMarkdown": "Will you publish the quality of working notes?", "votes": 1 }, { "id": 1379400, "postDate": "2021-07-07T10:37:14.267Z", "content": "Yes, I will post a separate thread and announce the winner of the best working note award in the next few days (once we have all the votes in). I will also put information on all submitted working notes in this new thread as a resource for future participants.
", "rawMarkdown": "Yes, I will post a separate thread and announce the winner of the best working note award in the next few days (once we have all the votes in). I will also put information on all submitted working notes in this new thread as a resource for future participants.", "votes": 1 }, { "id": 1380974, "postDate": "2021-07-08T13:31:01.183Z", "content": "Thanks @stefankahl - one more question: any issues with us posting the paper on arxiv?
", "rawMarkdown": "Thanks @stefankahl - one more question: any issues with us posting the paper on arxiv?" }, { "id": 1381038, "postDate": "2021-07-08T15:03:48.217Z", "content": "@stefankahl , @tomdenton Thank you for your clear answer. I understand.
\nBy the way, I am not planning to make any presentation at this stage….
Posting your paper on arxiv as a preprint should be fine.
", "rawMarkdown": "Posting your paper on arxiv as a preprint should be fine." } ] }, { "id": 1372047, "postDate": "2021-07-01T11:35:41.290Z", "content": "@stefankahl Hi.
\nCan you please guide how to upload CEUR-WS copyright form on Easychair?
\nThanks
If you click on \"Update Submission\" and then \"Update information\" you should see a menu item called \"Attach document\" in the upper right corner. You should be able to attach the source files and copyright form this way. Let me know if you have issues uploading additional files.
", "rawMarkdown": "If you click on \"Update Submission\" and then \"Update information\" you should see a menu item called \"Attach document\" in the upper right corner. You should be able to attach the source files and copyright form this way. Let me know if you have issues uploading additional files." } ] }, { "id": 1343406, "postDate": "2021-06-10T07:30:54.700Z", "content": "This was a great contest. I think I have missed it.
", "rawMarkdown": "This was a great contest. I think I have missed it." }, { "id": 1341803, "postDate": "2021-06-09T02:54:50.453Z", "content": "@stefankahl , could you please provide the the citation for your two overview papers as a plant text. They are not available online, and I'm not sure if the following interpretation of author names as \"Go\\\"{e}au\" -> \"Goeau\" is sufficient. Thanks.
", "rawMarkdown": "@stefankahl , could you please provide the the citation for your two overview papers as a plant text. They are not available online, and I'm not sure if the following interpretation of author names as \"Go\\\"{e}au\" -> \"Goeau\" is sufficient. Thanks." }, { "id": 1335912, "postDate": "2021-06-04T14:03:02.723Z", "content": "FYI I think bibtex entries aren't rendering correctly?
", "rawMarkdown": "FYI I think bibtex entries aren't rendering correctly?", "replies": [ { "id": 1336906, "postDate": "2021-06-05T09:24:45.237Z", "content": "Seems to be the style of the current template. I looked at other submissions using the same format and the entries look the same. Might be a feature and not a bug.
", "rawMarkdown": "Seems to be the style of the current template. I looked at other submissions using the same format and the entries look the same. Might be a feature and not a bug." } ] }, { "id": 1332547, "postDate": "2021-06-02T07:13:43Z", "content": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.
\nNow, let's not stop here :)
\nShare your approach with the scientific community and submit a working note!
\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.
", "rawMarkdown": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.\n\nNow, let's not stop here :)\n\nShare your approach with the scientific community and submit a working note!\n\nAnd don't forget: We will award $5.000 in GCP credits for the best working note." }, { "id": 1312187, "postDate": "2021-05-17T22:19:44.950Z", "content": "Curious where the template for submission notes is? Excited to write-up my experimental approach - particularly with my community ecology bacgkround!
", "rawMarkdown": "Curious where the template for submission notes is? Excited to write-up my experimental approach - particularly with my community ecology bacgkround!", "replies": [ { "id": 1314814, "postDate": "2021-05-19T11:56:58.403Z", "content": "I just added a link to the original post. Thanks for considering submitting!
", "rawMarkdown": "I just added a link to the original post. Thanks for considering submitting!", "votes": 1 } ] }, { "id": 1289058, "postDate": "2021-04-30T15:47:34.980Z", "content": "@stefankahl I had a doubt regarding this….
\nOnly the working note that receives the best note award will be published in CLEF Workshop Proceedings?
\nIf other papers are good enough even if they do not receive the award, will they be published??
All working notes will be peer-reviewed and - if the reviews are positive - published in the proceedings. It's not just the \"best\" working note that will be published.
", "rawMarkdown": "All working notes will be peer-reviewed and - if the reviews are positive - published in the proceedings. It's not just the \"best\" working note that will be published.", "votes": 1 } ] }, { "id": 1297101, "postDate": "2021-05-07T18:28:54.220Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 1342280, "author_name": "Psi", "author_url": "", "post_date": "2021-06-09T10:15:08.833000", "content": "@stefankahl what's the exact deadline for submitting?
", "votes": 5, "replies": [ { "id": 1343474, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-06-10T08:21:47.450000", "content": "Friday, June 11th, 2021, at 11:59 PM UTC
\nPlease let us know if you encounter any difficulties when submitting. Thanks.
", "votes": 0, "replies": [] } ] }, { "id": 1266540, "author_name": "CPMP", "author_url": "", "post_date": "2021-04-07T21:29:42.487000", "content": "This is great.
\nSome kaggle solutions deserve to be published and cited by academics. I will definitely submit if I end up with a good rank.
", "votes": 5, "replies": [ { "id": 1266981, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-04-08T08:13:17.863000", "content": "That's great news! And even if you don't end up with the rank you were expecting, you most certainly did some interesting experiments and tried different strategies - all of them are worth mentioning to bring the field forward.
", "votes": 4, "replies": [] } ] }, { "id": 1260318, "author_name": "Sam Stainsby", "author_url": "", "post_date": "2021-04-02T02:42:33.963000", "content": "What a great initiative! I wish more competitions had a such clear path to publication and recognition like this one.
", "votes": 4, "replies": [] }, { "id": 1346347, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-06-12T09:54:25.727000", "content": "Thank you to everyone who submitted a working note. We appreciate your extra effort in sharing your approach. In the next few days, we will assign reviewers and provide feedback on your submission. The final submission (camera-ready) deadline is June 2nd, and we will award the best working note with $5,000 in GCP credits based on the camera-ready version. We will be transparent about the rating, and we will post assigned ratings, working notes and winners in a separate thread.
", "votes": 2, "replies": [ { "id": 1346729, "author_name": "Iafoss", "author_url": "", "post_date": "2021-06-12T15:19:26.727000", "content": "@stefankahl Thank you for the update. I wanted to ask if it is possible to get some confirmation that the submitted working notes are taken in the consideration. I got a confirmation email from EasyChair but just wanted to make sure that our submission doesn't get lost in ~250 other submissions (with some of them not related to BirdCLEF 2021).
", "votes": 1, "replies": [] }, { "id": 1346778, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-06-12T16:05:17.970000", "content": "Yes, absolutely, every submission will be reviewed and is eligible to receive the award. As soon as the reviews are in, we'll let you know. Your submission should be 244, is that correct?
", "votes": 1, "replies": [] }, { "id": 1348102, "author_name": "Iafoss", "author_url": "", "post_date": "2021-06-13T18:37:13.857000", "content": "Yes our submission is #244, thank you so much for checking it.
", "votes": 0, "replies": [] } ] }, { "id": 1342140, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-06-09T07:52:28.220000", "content": "Sure, this is what it should look like:
\nA. Joly, H. Goëau, S. Kahl, L. Picek, T. Lorieul, E. Cole, B. Deneu, M. Servajean, R. Ruiz DeCastañeda, I. Bolon, H. Glotin, R. Planqué, W.-P. Vellinga, A. Dorso, H. Klinck, T. Denton, I. Eggel, P. Bonnet, H. Müller, Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction, in: Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021), 2021.
\nS. Kahl, T. Denton, H. Klinck, H. Glotin, H. Goëau, W.-P. Vellinga, R. Planqué, A. Joly, Overview of BirdCLEF 2021: Bird call identification in soundscape recordings, in: Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, 2021.
", "votes": 2, "replies": [] }, { "id": 1377042, "author_name": "Naoism", "author_url": "", "post_date": "2021-07-05T14:38:41.663000", "content": "@stefankahl
\nLet me ask you a question. The working note we created was submitted to a conference workshop, but do we need to make a presentation in September? Or is the workshop only for reviewing and scoring the working note, not for making a presentation?
CLEF2021 will be an online event and - as far as I know - will be free of charge. Which means anyone can register and participate. We will have a LifeCLEF workshop as part of the main conference, but this workshop consists of only two 90-minute panels. So there won't be enough time for everyone to present. However, we will invite speakers and ask them to present their approach (typically, the best ranked teams get to present). We'll keep you posted. More info on CLEF in general can be found here: http://clef2021.clef-initiative.eu/index.php?page=Pages/organizers.html (unfortunately, the page is not up-to-date but hopefully will be in late August, early September.).
", "votes": 3, "replies": [] }, { "id": 1378377, "author_name": "Naoism", "author_url": "", "post_date": "2021-07-06T13:37:23.483000", "content": "Thank you for your quick reply.
\nYou mean that some of the teams whose working note was accepted will present it, but it is not yet decided which team will present it. (the team with the highest LB score is likely to be chosen).
\nIf I am wrong in my understanding, please let me know.
The problem is a mix of many sub-problems (many teams broke out a separate no-call classifier, for example, or put special work into methods for finding good thresholds, or ID'ing easily-confused species, etc.)… So it's very possible to do really interesting work and provide a high-quality write-up without necessarily getting the highest score on the end-to-end problem.
", "votes": 2, "replies": [] }, { "id": 1379195, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-07-07T06:51:45.033000", "content": "Depending on how much time we have for BirdCLEF (other tasks will present too), we'll ask participants to present. Yet, we won't force anyone to present and will ask the next team in line (depending on rank and or quality of working note) if they want to present. Unfortunately, that's all I can say and know until we have a workshop schedule (which we'll probably have in August).
\nWould you like to present? If so, just let me know and I'll see if I can fit you in.
", "votes": 2, "replies": [] }, { "id": 1379386, "author_name": "Psi", "author_url": "", "post_date": "2021-07-07T10:17:31.097000", "content": "Will you publish the quality of working notes?
", "votes": 1, "replies": [] }, { "id": 1379400, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-07-07T10:37:14.267000", "content": "Yes, I will post a separate thread and announce the winner of the best working note award in the next few days (once we have all the votes in). I will also put information on all submitted working notes in this new thread as a resource for future participants.
", "votes": 1, "replies": [] }, { "id": 1380974, "author_name": "Psi", "author_url": "", "post_date": "2021-07-08T13:31:01.183000", "content": "Thanks @stefankahl - one more question: any issues with us posting the paper on arxiv?
", "votes": 0, "replies": [] }, { "id": 1381038, "author_name": "Naoism", "author_url": "", "post_date": "2021-07-08T15:03:48.217000", "content": "@stefankahl , @tomdenton Thank you for your clear answer. I understand.
\nBy the way, I am not planning to make any presentation at this stage….
Posting your paper on arxiv as a preprint should be fine.
", "votes": 0, "replies": [] } ] }, { "id": 1372047, "author_name": "Saksham_Aggarwal", "author_url": "", "post_date": "2021-07-01T11:35:41.290000", "content": "@stefankahl Hi.
\nCan you please guide how to upload CEUR-WS copyright form on Easychair?
\nThanks
If you click on \"Update Submission\" and then \"Update information\" you should see a menu item called \"Attach document\" in the upper right corner. You should be able to attach the source files and copyright form this way. Let me know if you have issues uploading additional files.
", "votes": 0, "replies": [] } ] }, { "id": 1343406, "author_name": "Arnab Dey", "author_url": "", "post_date": "2021-06-10T07:30:54.700000", "content": "This was a great contest. I think I have missed it.
", "votes": 0, "replies": [] }, { "id": 1341803, "author_name": "Iafoss", "author_url": "", "post_date": "2021-06-09T02:54:50.453000", "content": "@stefankahl , could you please provide the the citation for your two overview papers as a plant text. They are not available online, and I'm not sure if the following interpretation of author names as \"Go\\\"{e}au\" -> \"Goeau\" is sufficient. Thanks.
", "votes": 0, "replies": [] }, { "id": 1335912, "author_name": "Daniel Furman", "author_url": "", "post_date": "2021-06-04T14:03:02.723000", "content": "FYI I think bibtex entries aren't rendering correctly?
", "votes": 0, "replies": [ { "id": 1336906, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-06-05T09:24:45.237000", "content": "Seems to be the style of the current template. I looked at other submissions using the same format and the entries look the same. Might be a feature and not a bug.
", "votes": 0, "replies": [] } ] }, { "id": 1332547, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-06-02T07:13:43", "content": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.
\nNow, let's not stop here :)
\nShare your approach with the scientific community and submit a working note!
\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.
", "votes": 0, "replies": [] }, { "id": 1312187, "author_name": "Daniel Furman", "author_url": "", "post_date": "2021-05-17T22:19:44.950000", "content": "Curious where the template for submission notes is? Excited to write-up my experimental approach - particularly with my community ecology bacgkround!
", "votes": 0, "replies": [ { "id": 1314814, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-05-19T11:56:58.403000", "content": "I just added a link to the original post. Thanks for considering submitting!
", "votes": 1, "replies": [] } ] }, { "id": 1289058, "author_name": "Nitin Datta", "author_url": "", "post_date": "2021-04-30T15:47:34.980000", "content": "@stefankahl I had a doubt regarding this….
\nOnly the working note that receives the best note award will be published in CLEF Workshop Proceedings?
\nIf other papers are good enough even if they do not receive the award, will they be published??
All working notes will be peer-reviewed and - if the reviews are positive - published in the proceedings. It's not just the \"best\" working note that will be published.
", "votes": 1, "replies": [] } ] }, { "id": 1297101, "author_name": "", "author_url": "", "post_date": "2021-05-07T18:28:54.220000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "1259698": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.\n\nNow, let's not stop here :)\n\nShare your approach with the scientific community and submit a working note!\n\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.\n\n***Update June 2: Added short intro and BibTeX entries for LifeCLEF and BirdCLEF overview papers***\n***Update May 19: Added download link for working note templates; added submission instructions***\n\nBuilding accurate knowledge of the identity, the geographic distribution and the evolution of species is essential for a sustainable development of humanity, as well as for biodiversity conservation. However, the burden of the routine identification of plants and animals in the field is strongly penalizing the aggregation of new data and knowledge. Identifying and naming living plants or animals is actually almost impossible for the public and often a difficult task for professionals and naturalists. Bridging this gap is a key challenge towards enabling effective biodiversity monitoring systems. The LifeCLEF evaluation campaign aims at boosting and evaluating the advances in this domain since 2011. ([LifeCLEF mission statement](https://www.imageclef.org/LifeCLEF2021))\n\nEach year, participants of LifeCLEF publish their research as part of the CLEF workshop proceedings (e.g., [http://ceur-ws.org/Vol-2696/](http://ceur-ws.org/Vol-2696/)). In this year’s edition, we would like you to contribute to this research by publishing your solution as a working note. Why should you do this? Here are a few reasons:\n\n- publish original research and be recognized as a scientist\n- make your solution accessible to a broad audience\n- earn citations and reputation\n- submitting a working note makes you eligible to present at [CLEF 2021](http://clef2021.clef-initiative.eu)\n\nWe will provide a template to get you started. If you publish a write-up of your solution, why not publish it as a paper? Each working note should be between 2 and 8 pages long.\n\n**On top of that, we will review and rate all submitted working notes; the best paper will be awarded $5,000 in Google Cloud Platform credits.**\n\nGo to the “[Evaluation](https://www.kaggle.com/c/birdclef-2021/overview/evaluation)” subsection to see more details about how we will review.\n\nWhat does a working note look like? Here are a few (admittedly very extensive) examples of previous years:\n\n- [Bird Species Recognition via Neural Architecture Search](http://ceur-ws.org/Vol-2696/paper_188.pdf) by Markus Mühling, Jakob Franz, Nikolaus Korfhage, Bernd Freisleben\n- [Bird Species Identification in Soundscapes](http://ceur-ws.org/Vol-2380/paper_86.pdf) by Mario Lasseck\n- [Bird Identification from Timestamped, Geotagged Audio Recordings](http://ceur-ws.org/Vol-2125/paper_181.pdf) by Jan Schlüter\n\nOk, what is the timeline for a submission: \n\n- May 31, 2021 - Final Submission Deadline for competition\n- Friday, June 11th, 2021 - Deadline for the submission of working notes\n- June 14th - June 25th, 2021 - Peer-review period\n- Friday, July 2nd, 2021 - Deadline for the submission of the camera-ready working notes\n\n**Templates**\n\nYou can find working note templates for Word or LaTeX online in this shared folder: [Templates folder](https://drive.google.com/drive/folders/1K5encrAZu08WYdS5lREZ94gOOEvAUJqS?usp=sharing)\n\nBoth templates are valid for a submission, yet, we would advise you to use the LaTeX version (e.g., as import in Overleaf) as it contains more valuable info on how to format your paper.\n\n**How to submit?**\n\nThe CLEF conference uses EasyChair as submission management system. All you need to do to submit a working is:\n\n- go to the [EasyChair webpage](https://easychair.org/conferences/?conf=clef2021)\n- sign in or create an account and sign in with your new account\n- after completing the account creation, click on \"*make a new submission*\"\n- select \"*Multimedia Life Species Identification (LifeCLEF)*\" as track\n- enter author information, title, and abstract\n- select \"*Task 2 - BirdCLEF*\"\n- chose a PDF (make sure to use the official template) and click \"*Submit*\"\n\n**Will my score/rank be good enough for a working note?**\n\nEveryone can submit a working note, independent of score or rank! We assume that everyone did extensive experiments to come up with a solution that could be valuable for future participants or future researchers in the field of bioacoustics. Even if your efforts are not reflected in your leaderboard rank, your contribution can be valuable to others! You tried something new, explored a new technique (well, maybe even transformers...)? We would like to see your write-up!\n\n**Will my working note be accepted?**\n\nEvery submitted working note will go through a light review process and authors will have the chance to update their submissions before the final deadline on July 2nd. \n\nA working note is a systematic record of your experiments and does not have to include new approaches or state-of-the-art results. Be sure to submit a comprehensible record that might help others get started. Additional code that accompanies the working note is highly encouraged.\n\nAmong all submitted working notes, we will pick the best submission and award the \"Best working note award\" - independent of score and rank, only based on the quality of the write-up.\n\n**Ok, how should I structure my working note?**\n\nWe would suggest the following contents:\n\n- introduce the competition and data\n- introduce the related work that your approach is based on\n- outline your experimental setup and your approach\n- provide results (leaderboard and/or local evaluation)\n- discuss your results and add some future ideas to improve\n\nWe do not enforce a page limit, but ideally, your working note would be between 4 and 8 pages long.\n\n**Other requirements**\n\nPlease make sure to cite the LifeCLEF and BirdCLEF overview papers in your working notes. In return, we will cite your working note in our overview paper. Here are the BibTeX entries for both overviews:\n\n```\n@inproceedings{lifeclef2021, \n title={Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction}, \n author={Joly, Alexis and Go\\\"{e}au, Herv\\'{e} and Kahl, Stefan and Picek, Luk\\'{a}\\v{s} and Lorieul, Titouan and Cole, Elijah and Deneu, Benjamin and Servajean, Maximilien and Ruiz De Casta\\~{n}eda, Rafael and Bolon, Isabelle and Glotin, Herv\\'{e} and Planqu\\'{e}, Robert and Vellinga, Willem-Pier and Dorso, Andrew and Klinck, Holger and Denton, Tom and Eggel, Ivan and Bonnet, Pierre and M\\\"{u}ller, Henning},\n booktitle={Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021)},\n year={2021} \n }\n```\n```\n@inproceedings{birdclef2021,\n title={Overview of BirdCLEF 2021: Bird call identification in soundscape recordings},\n author={Kahl, Stefan and Denton, Tom and Klinck, Holger and Glotin, Herv\\'{e} and Go\\\"{e}au, Herv\\'{e} and Vellinga, Willem-Pier and Planqu\\'{e}, Robert and Joly, Alexis},\n booktitle={Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum},\n year={2021}\n}\n\n```\n\nLet us know if you have any questions about how to contribute, we will keep this thread updated.\n", "1342280": "@stefankahl what's the exact deadline for submitting? ", "1266540": "This is great.\n\nSome kaggle solutions deserve to be published and cited by academics. I will definitely submit if I end up with a good rank.", "1260318": "What a great initiative! I wish more competitions had a such clear path to publication and recognition like this one.", "1346347": "Thank you to everyone who submitted a working note. We appreciate your extra effort in sharing your approach. In the next few days, we will assign reviewers and provide feedback on your submission. The final submission (camera-ready) deadline is June 2nd, and we will award the best working note with $5,000 in GCP credits based on the camera-ready version. We will be transparent about the rating, and we will post assigned ratings, working notes and winners in a separate thread.", "1342140": "Sure, this is what it should look like:\n\nA. Joly, H. Goëau, S. Kahl, L. Picek, T. Lorieul, E. Cole, B. Deneu, M. Servajean, R. Ruiz DeCastañeda, I. Bolon, H. Glotin, R. Planqué, W.-P. Vellinga, A. Dorso, H. Klinck, T. Denton, I. Eggel, P. Bonnet, H. Müller, Overview of LifeCLEF 2021: a System-oriented Evaluation of Automated Species Identification and Species Distribution Prediction, in: Proceedings of the Twelfth International Conference of the CLEF Association (CLEF 2021), 2021.\n\nS. Kahl, T. Denton, H. Klinck, H. Glotin, H. Goëau, W.-P. Vellinga, R. Planqué, A. Joly, Overview of BirdCLEF 2021: Bird call identification in soundscape recordings, in: Working Notes of CLEF 2021 - Conference and Labs of the Evaluation Forum, 2021.", "1377042": "@stefankahl \nLet me ask you a question. The working note we created was submitted to a conference workshop, but do we need to make a presentation in September? Or is the workshop only for reviewing and scoring the working note, not for making a presentation?", "1372047": "@stefankahl Hi.\nCan you please guide how to upload CEUR-WS copyright form on Easychair? \nThanks", "1343406": "This was a great contest. I think I have missed it.", "1341803": "@stefankahl , could you please provide the the citation for your two overview papers as a plant text. They are not available online, and I'm not sure if the following interpretation of author names as \"Go\\\"{e}au\" -> \"Goeau\" is sufficient. Thanks.", "1335912": "FYI I think bibtex entries aren't rendering correctly?", "1332547": "Thanks to everyone who participated in this competition! It was really exciting to see all your notebooks and comments in the forum and I think I already spotted a few things that will help us to improve our work in the field of bioacoustics.\n\nNow, let's not stop here :)\n\nShare your approach with the scientific community and submit a working note!\n\nAnd don't forget: We will award $5.000 in GCP credits for the best working note.", "1312187": "Curious where the template for submission notes is? Excited to write-up my experimental approach - particularly with my community ecology bacgkround!", "1289058": "@stefankahl I had a doubt regarding this.... \nOnly the working note that receives the best note award will be published in CLEF Workshop Proceedings?\nIf other papers are good enough even if they do not receive the award, will they be published??", "1297101": "" } }