{ "id": 575983, "title": "Malmo-7B Captions", "url": "/competitions/fungi-clef-2025/discussion/575983", "author_name": "", "post_date": "2025-05-02T02:02:35.487744300Z", "votes": null, "comment_count": 5, "views": 0, "content": "

Hi @picekl

\n

In the data tab of the competition it has been mentioned that for each photo, Malmo-7B captions has been provided and I believe these captions can be invaluable for the work.

\n

I'm not able to find the captions in the dataset. Can you please let me know from where can I get the captions for the fungiclef image dataset?

\n

Thanks.

", "messages": [ { "id": "3191667", "postDate": "05/02/2025 02:02:35", "content": "

Hi @picekl

\n

In the data tab of the competition it has been mentioned that for each photo, Malmo-7B captions has been provided and I believe these captions can be invaluable for the work.

\n

I'm not able to find the captions in the dataset. Can you please let me know from where can I get the captions for the fungiclef image dataset?

\n

Thanks.

", "rawMarkdown": "Hi @picekl \n\nIn the data tab of the competition it has been mentioned that for each photo, Malmo-7B captions has been provided and I believe these captions can be invaluable for the work. \n\nI'm not able to find the captions in the dataset. Can you please let me know from where can I get the captions for the fungiclef image dataset?\n\nThanks.", "votes": null }, { "id": "3192070", "postDate": "05/02/2025 12:34:19", "content": "

I was waiting for the same thing… I tried to use molmo-7b for captioning but it wasn't good… It was hallucinating stuff a lot and not providing useful visual information. Maybe it is too general for fungus

", "rawMarkdown": "I was waiting for the same thing... I tried to use molmo-7b for captioning but it wasn't good... It was hallucinating stuff a lot and not providing useful visual information. Maybe it is too general for fungus", "votes": null }, { "id": "3192230", "postDate": "05/02/2025 15:57:29", "content": "

Yes, domain specific captions will be actually helpful when compared to generic captions. And generic captions might degrade the score rather than boosting in a domain specific task.

", "rawMarkdown": "Yes, domain specific captions will be actually helpful when compared to generic captions. And generic captions might degrade the score rather than boosting in a domain specific task.", "votes": null }, { "id": "3193958", "postDate": "05/05/2025 08:50:34", "content": "

Dear @bodhisattamaiti and @abdrah,

\n

The captions are now available!

\n

Apologies for the delay. I planned to release the data last week, but your feedback made me check the caption quality.
\nAfter reviewing random samples, I found them pretty descriptive. See below.

\n

Thanks for your patience and valuable input!

\n

Best,
\nLukas

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
\"\"The image shows a close-up view of fungi, likely on a leaf or similar surface. The fungi appear as small, dark spots scattered across the surface. These spots are the spores of the fungi, which are the reproductive units. The spores have a round or slightly oval shape and are predominantly black in color….
\"\"The image shows a fascinating example of fungal growth on what appears to be a piece of wood or bark. The main focus is on a cluster of small, round, red structures that are likely the fruiting bodies or spores of the fungus. These red structures are the most prominent feature, standing out vividly against the brown background. They have a smooth, glossy appearance, suggesting they might be wet or have a waxy coating. The red color is quite striking and could indicate that this is a species of Basidiomycota, possibly a polypore or bracket fungus. Surrounding these red structures is a larger …
", "rawMarkdown": "Dear @bodhisattamaiti and @abdrah,\n\nThe captions are now available!\n\nApologies for the delay. I planned to release the data last week, but your feedback made me check the caption quality. \nAfter reviewing random samples, I found them pretty descriptive. See below.\n\nThanks for your patience and valuable input!\n\nBest,\nLukas\n| | |\n| --- | --- |\n| ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1518097%2Fc2ff48682979fd6d77da25dc133235ae%2F0-4100096874.JPG?generation=1746434775385912&alt=media) | The image shows a close-up view of fungi, likely on a leaf or similar surface. The fungi appear as small, dark spots scattered across the surface. These spots are the spores of the fungi, which are the reproductive units. The spores have a round or slightly oval shape and are predominantly black in color.... |\n| ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1518097%2F917056d684ea51b145e0aae7998befef%2F0-4100096719.JPG?generation=1746434904983953&alt=media) | The image shows a fascinating example of fungal growth on what appears to be a piece of wood or bark. The main focus is on a cluster of small, round, red structures that are likely the fruiting bodies or spores of the fungus. These red structures are the most prominent feature, standing out vividly against the brown background. They have a smooth, glossy appearance, suggesting they might be wet or have a waxy coating. The red color is quite striking and could indicate that this is a species of Basidiomycota, possibly a polypore or bracket fungus. Surrounding these red structures is a larger ... |", "votes": null }, { "id": "3194387", "postDate": "05/05/2025 19:59:12", "content": "

Hi @picekl ,

\n

Witch version of malmo did tou used I tried allenai/Molmo-7B-D-0924 (no quantization)
\nwas pretty bad.

\n

And what was your prompt if possible

\n

Thanks

", "rawMarkdown": "Hi @picekl ,\n\nWitch version of malmo did tou used I tried `allenai/Molmo-7B-D-0924` (no quantization)\nwas pretty bad.\n\nAnd what was your prompt if possible\n\nThanks", "votes": null }, { "id": "3194419", "postDate": "05/05/2025 21:27:45", "content": "

Hi @abdrah
\n you can find the details of the caption generation here:
\nhttps://github.com/BohemianVRA/FungiTastic/tree/dev/metadata_extraction/captions
\nHope it helps! 🤗 I think the prompt will be the issue.

", "rawMarkdown": "Hi @abdrah \n you can find the details of the caption generation here:\nhttps://github.com/BohemianVRA/FungiTastic/tree/dev/metadata_extraction/captions \nHope it helps! 🤗 I think the prompt will be the issue.", "votes": null } ], "comments": [ { "id": 3192070, "author_name": "abdrah", "author_url": "", "post_date": "05/02/2025 12:34:19", "content": "

I was waiting for the same thing… I tried to use molmo-7b for captioning but it wasn't good… It was hallucinating stuff a lot and not providing useful visual information. Maybe it is too general for fungus

", "votes": null, "replies": [ { "id": 3192230, "author_name": "bodhisattamaiti", "author_url": "", "post_date": "05/02/2025 15:57:29", "content": "

Yes, domain specific captions will be actually helpful when compared to generic captions. And generic captions might degrade the score rather than boosting in a domain specific task.

", "votes": null, "replies": [] } ] }, { "id": 3193958, "author_name": "picekl", "author_url": "", "post_date": "05/05/2025 08:50:34", "content": "

Dear @bodhisattamaiti and @abdrah,

\n

The captions are now available!

\n

Apologies for the delay. I planned to release the data last week, but your feedback made me check the caption quality.
\nAfter reviewing random samples, I found them pretty descriptive. See below.

\n

Thanks for your patience and valuable input!

\n

Best,
\nLukas

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
\"\"The image shows a close-up view of fungi, likely on a leaf or similar surface. The fungi appear as small, dark spots scattered across the surface. These spots are the spores of the fungi, which are the reproductive units. The spores have a round or slightly oval shape and are predominantly black in color….
\"\"The image shows a fascinating example of fungal growth on what appears to be a piece of wood or bark. The main focus is on a cluster of small, round, red structures that are likely the fruiting bodies or spores of the fungus. These red structures are the most prominent feature, standing out vividly against the brown background. They have a smooth, glossy appearance, suggesting they might be wet or have a waxy coating. The red color is quite striking and could indicate that this is a species of Basidiomycota, possibly a polypore or bracket fungus. Surrounding these red structures is a larger …
", "votes": null, "replies": [ { "id": 3194387, "author_name": "abdrah", "author_url": "", "post_date": "05/05/2025 19:59:12", "content": "

Hi @picekl ,

\n

Witch version of malmo did tou used I tried allenai/Molmo-7B-D-0924 (no quantization)
\nwas pretty bad.

\n

And what was your prompt if possible

\n

Thanks

", "votes": null, "replies": [ { "id": 3194419, "author_name": "klaarka", "author_url": "", "post_date": "05/05/2025 21:27:45", "content": "

Hi @abdrah
\n you can find the details of the caption generation here:
\nhttps://github.com/BohemianVRA/FungiTastic/tree/dev/metadata_extraction/captions
\nHope it helps! 🤗 I think the prompt will be the issue.

", "votes": null, "replies": [] } ] } ] } ], "raw_markdown_by_id": { "3191667": "Hi @picekl \n\nIn the data tab of the competition it has been mentioned that for each photo, Malmo-7B captions has been provided and I believe these captions can be invaluable for the work. \n\nI'm not able to find the captions in the dataset. Can you please let me know from where can I get the captions for the fungiclef image dataset?\n\nThanks.", "3192070": "I was waiting for the same thing... I tried to use molmo-7b for captioning but it wasn't good... It was hallucinating stuff a lot and not providing useful visual information. Maybe it is too general for fungus", "3192230": "Yes, domain specific captions will be actually helpful when compared to generic captions. And generic captions might degrade the score rather than boosting in a domain specific task.", "3193958": "Dear @bodhisattamaiti and @abdrah,\n\nThe captions are now available!\n\nApologies for the delay. I planned to release the data last week, but your feedback made me check the caption quality. \nAfter reviewing random samples, I found them pretty descriptive. See below.\n\nThanks for your patience and valuable input!\n\nBest,\nLukas\n| | |\n| --- | --- |\n| ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1518097%2Fc2ff48682979fd6d77da25dc133235ae%2F0-4100096874.JPG?generation=1746434775385912&alt=media) | The image shows a close-up view of fungi, likely on a leaf or similar surface. The fungi appear as small, dark spots scattered across the surface. These spots are the spores of the fungi, which are the reproductive units. The spores have a round or slightly oval shape and are predominantly black in color.... |\n| ![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1518097%2F917056d684ea51b145e0aae7998befef%2F0-4100096719.JPG?generation=1746434904983953&alt=media) | The image shows a fascinating example of fungal growth on what appears to be a piece of wood or bark. The main focus is on a cluster of small, round, red structures that are likely the fruiting bodies or spores of the fungus. These red structures are the most prominent feature, standing out vividly against the brown background. They have a smooth, glossy appearance, suggesting they might be wet or have a waxy coating. The red color is quite striking and could indicate that this is a species of Basidiomycota, possibly a polypore or bracket fungus. Surrounding these red structures is a larger ... |", "3194387": "Hi @picekl ,\n\nWitch version of malmo did tou used I tried `allenai/Molmo-7B-D-0924` (no quantization)\nwas pretty bad.\n\nAnd what was your prompt if possible\n\nThanks", "3194419": "Hi @abdrah \n you can find the details of the caption generation here:\nhttps://github.com/BohemianVRA/FungiTastic/tree/dev/metadata_extraction/captions \nHope it helps! 🤗 I think the prompt will be the issue." }, "source": "meta" }