{
  "id": 507475,
  "title": "Phase 2 update",
  "url": "/competitions/cvpr-metafood-3d-food-reconstruction-challenge/discussion/507475",
  "author_name": "",
  "post_date": "2024-05-26T01:25:08.171865600Z",
  "votes": null,
  "comment_count": 6,
  "views": 0,
  "content": "<p>Thank you to everyone who participated in the Physically Informed 3D Food Reconstruction competition. We are now entering Phase 2 of the competition, where we will select the top 5 teams to submit their 3D object models. These models will be evaluated based on chamfer distance. The final score will be calculated by averaging the rankings from Phase 1 and Phase 2. In the event of a tie, the Phase 1 score will determine the final ranking.</p>\n<p>For the Phase 2 evaluation (for the top 5 teams), we were unable to find a fair and automatic way to align the pose between the submissions and the ground truth objects. Therefore, we are updating the evaluation procedure, and the winner announcement will be delayed to June 7th. The revised steps are as follows:</p>\n<ol>\n<li>Upload Models: Upload all 20 of your 3D models (.obj files named with the object ID) to a location where we can download them.</li>\n<li>Send Link: Send us the link to your models along with your team ID (or other ways to identify yourself) by May 27th, 11:59 PM AOE. Email: metafood.cvpr@gmail.com. If you encounter any issues, please post on the Kaggle discussion forum.</li>\n<li>Model Verification: We will check your models against your final Phase 1 submission to ensure they are the same models used in Phase 1. We will also visually inspect the models to ensure no team is violating the rules by submitting primitive objects such as spheres.</li>\n<li>Ground Truth Models: We will upload our ground truth 3D models, along with the script used to compute the final chamfer distance, on Kaggle by May 28th, 11:59 PM AOE.</li>\n<li>Align Models: Align the models yourself and prepare a transform matrix for each object you submitted. Your final chamfer distance score will be computed using your submitted models and transform matrices.</li>\n<li>Submit Transform Matrices: Send us your transform matrices by June 4th, 11:59 PM AOE.<br>\nWe will announce the winner on June 7th.</li>\n</ol>\n<p>Thank you for your understanding and cooperation.</p>",
  "messages": [
    {
      "id": "2836515",
      "postDate": "05/26/2024 01:25:08",
      "content": "<p>Thank you to everyone who participated in the Physically Informed 3D Food Reconstruction competition. We are now entering Phase 2 of the competition, where we will select the top 5 teams to submit their 3D object models. These models will be evaluated based on chamfer distance. The final score will be calculated by averaging the rankings from Phase 1 and Phase 2. In the event of a tie, the Phase 1 score will determine the final ranking.</p>\n<p>For the Phase 2 evaluation (for the top 5 teams), we were unable to find a fair and automatic way to align the pose between the submissions and the ground truth objects. Therefore, we are updating the evaluation procedure, and the winner announcement will be delayed to June 7th. The revised steps are as follows:</p>\n<ol>\n<li>Upload Models: Upload all 20 of your 3D models (.obj files named with the object ID) to a location where we can download them.</li>\n<li>Send Link: Send us the link to your models along with your team ID (or other ways to identify yourself) by May 27th, 11:59 PM AOE. Email: metafood.cvpr@gmail.com. If you encounter any issues, please post on the Kaggle discussion forum.</li>\n<li>Model Verification: We will check your models against your final Phase 1 submission to ensure they are the same models used in Phase 1. We will also visually inspect the models to ensure no team is violating the rules by submitting primitive objects such as spheres.</li>\n<li>Ground Truth Models: We will upload our ground truth 3D models, along with the script used to compute the final chamfer distance, on Kaggle by May 28th, 11:59 PM AOE.</li>\n<li>Align Models: Align the models yourself and prepare a transform matrix for each object you submitted. Your final chamfer distance score will be computed using your submitted models and transform matrices.</li>\n<li>Submit Transform Matrices: Send us your transform matrices by June 4th, 11:59 PM AOE.<br>\nWe will announce the winner on June 7th.</li>\n</ol>\n<p>Thank you for your understanding and cooperation.</p>",
      "rawMarkdown": "Thank you to everyone who participated in the Physically Informed 3D Food Reconstruction competition. We are now entering Phase 2 of the competition, where we will select the top 5 teams to submit their 3D object models. These models will be evaluated based on chamfer distance. The final score will be calculated by averaging the rankings from Phase 1 and Phase 2. In the event of a tie, the Phase 1 score will determine the final ranking.\n\nFor the Phase 2 evaluation (for the top 5 teams), we were unable to find a fair and automatic way to align the pose between the submissions and the ground truth objects. Therefore, we are updating the evaluation procedure, and the winner announcement will be delayed to June 7th. The revised steps are as follows:\n\n1. Upload Models: Upload all 20 of your 3D models (.obj files named with the object ID) to a location where we can download them.\n2. Send Link: Send us the link to your models along with your team ID (or other ways to identify yourself) by May 27th, 11:59 PM AOE. Email: metafood.cvpr@gmail.com. If you encounter any issues, please post on the Kaggle discussion forum.\n3. Model Verification: We will check your models against your final Phase 1 submission to ensure they are the same models used in Phase 1. We will also visually inspect the models to ensure no team is violating the rules by submitting primitive objects such as spheres.\n4. Ground Truth Models: We will upload our ground truth 3D models, along with the script used to compute the final chamfer distance, on Kaggle by May 28th, 11:59 PM AOE.\n5. Align Models: Align the models yourself and prepare a transform matrix for each object you submitted. Your final chamfer distance score will be computed using your submitted models and transform matrices.\n6. Submit Transform Matrices: Send us your transform matrices by June 4th, 11:59 PM AOE.\nWe will announce the winner on June 7th.\n\nThank you for your understanding and cooperation.",
      "votes": null
    },
    {
      "id": "2839568",
      "postDate": "05/27/2024 15:28:04",
      "content": "<p>Thank you for your efforts in the competition. I would like to know if the Chamfer distance in the phase 2 is calculated using the sum or the mean?</p>",
      "rawMarkdown": "Thank you for your efforts in the competition. I would like to know if the Chamfer distance in the phase 2 is calculated using the sum or the mean?",
      "votes": null
    },
    {
      "id": "2839713",
      "postDate": "05/27/2024 16:54:18",
      "content": "<p>One more question~ Are the meshes of the 20 objects waterproof, or is the side that is close to the the table missing?</p>",
      "rawMarkdown": "One more question~ Are the meshes of the 20 objects waterproof, or is the side that is close to the the table missing?",
      "votes": null
    },
    {
      "id": "2839789",
      "postDate": "05/27/2024 17:47:37",
      "content": "<p>They are waterproof. They are scanned by a scanner. </p>",
      "rawMarkdown": "They are waterproof. They are scanned by a scanner.",
      "votes": null
    },
    {
      "id": "2839845",
      "postDate": "05/27/2024 18:19:44",
      "content": "<p>Thank you so much for organizing the challenge. We, the VolETA team, tried to submit our results (the 20 3D models) using Kaggle, but unfortunately, we can only upload CSV files. Instead, we send an email to <a href=\"mailto:metafood.cvpr@gmail.com\">metafood.cvpr@gmail.com</a>. Can you please confirm via email that you received the data? looking forward to hearing from you soon!</p>",
      "rawMarkdown": "Thank you so much for organizing the challenge. We, the VolETA team, tried to submit our results (the 20 3D models) using Kaggle, but unfortunately, we can only upload CSV files. Instead, we send an email to <metafood.cvpr@gmail.com>. Can you please confirm via email that you received the data? looking forward to hearing from you soon!",
      "votes": null
    },
    {
      "id": "2839944",
      "postDate": "05/27/2024 19:53:11",
      "content": "<p>Mean will be used when calculating the Chamfer distance for each direction. Final score for a model is the sum of the two chamfer distance under two directions. Reference: (<a href=\"https://pytorch3d.readthedocs.io/en/latest/_modules/pytorch3d/loss/chamfer.html\" target=\"_blank\">https://pytorch3d.readthedocs.io/en/latest/_modules/pytorch3d/loss/chamfer.html</a>)</p>",
      "rawMarkdown": "Mean will be used when calculating the Chamfer distance for each direction. Final score for a model is the sum of the two chamfer distance under two directions. Reference: (https://pytorch3d.readthedocs.io/en/latest/_modules/pytorch3d/loss/chamfer.html)",
      "votes": null
    },
    {
      "id": "2839947",
      "postDate": "05/27/2024 19:58:36",
      "content": "<p>We received your submission. Thank you!</p>",
      "rawMarkdown": "We received your submission. Thank you!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2839568,
      "author_name": "tangyi32",
      "author_url": "",
      "post_date": "05/27/2024 15:28:04",
      "content": "<p>Thank you for your efforts in the competition. I would like to know if the Chamfer distance in the phase 2 is calculated using the sum or the mean?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2839944,
          "author_name": "metafoodcvpr",
          "author_url": "",
          "post_date": "05/27/2024 19:53:11",
          "content": "<p>Mean will be used when calculating the Chamfer distance for each direction. Final score for a model is the sum of the two chamfer distance under two directions. Reference: (<a href=\"https://pytorch3d.readthedocs.io/en/latest/_modules/pytorch3d/loss/chamfer.html\" target=\"_blank\">https://pytorch3d.readthedocs.io/en/latest/_modules/pytorch3d/loss/chamfer.html</a>)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2839713,
      "author_name": "tangyi32",
      "author_url": "",
      "post_date": "05/27/2024 16:54:18",
      "content": "<p>One more question~ Are the meshes of the 20 objects waterproof, or is the side that is close to the the table missing?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2839789,
          "author_name": "metafoodcvpr",
          "author_url": "",
          "post_date": "05/27/2024 17:47:37",
          "content": "<p>They are waterproof. They are scanned by a scanner. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2839845,
      "author_name": "umairharoon",
      "author_url": "",
      "post_date": "05/27/2024 18:19:44",
      "content": "<p>Thank you so much for organizing the challenge. We, the VolETA team, tried to submit our results (the 20 3D models) using Kaggle, but unfortunately, we can only upload CSV files. Instead, we send an email to <a href=\"mailto:metafood.cvpr@gmail.com\">metafood.cvpr@gmail.com</a>. Can you please confirm via email that you received the data? looking forward to hearing from you soon!</p>",
      "votes": null,
      "replies": [
        {
          "id": 2839947,
          "author_name": "metafoodcvpr",
          "author_url": "",
          "post_date": "05/27/2024 19:58:36",
          "content": "<p>We received your submission. Thank you!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2836515": "Thank you to everyone who participated in the Physically Informed 3D Food Reconstruction competition. We are now entering Phase 2 of the competition, where we will select the top 5 teams to submit their 3D object models. These models will be evaluated based on chamfer distance. The final score will be calculated by averaging the rankings from Phase 1 and Phase 2. In the event of a tie, the Phase 1 score will determine the final ranking.\n\nFor the Phase 2 evaluation (for the top 5 teams), we were unable to find a fair and automatic way to align the pose between the submissions and the ground truth objects. Therefore, we are updating the evaluation procedure, and the winner announcement will be delayed to June 7th. The revised steps are as follows:\n\n1. Upload Models: Upload all 20 of your 3D models (.obj files named with the object ID) to a location where we can download them.\n2. Send Link: Send us the link to your models along with your team ID (or other ways to identify yourself) by May 27th, 11:59 PM AOE. Email: metafood.cvpr@gmail.com. If you encounter any issues, please post on the Kaggle discussion forum.\n3. Model Verification: We will check your models against your final Phase 1 submission to ensure they are the same models used in Phase 1. We will also visually inspect the models to ensure no team is violating the rules by submitting primitive objects such as spheres.\n4. Ground Truth Models: We will upload our ground truth 3D models, along with the script used to compute the final chamfer distance, on Kaggle by May 28th, 11:59 PM AOE.\n5. Align Models: Align the models yourself and prepare a transform matrix for each object you submitted. Your final chamfer distance score will be computed using your submitted models and transform matrices.\n6. Submit Transform Matrices: Send us your transform matrices by June 4th, 11:59 PM AOE.\nWe will announce the winner on June 7th.\n\nThank you for your understanding and cooperation.",
    "2839568": "Thank you for your efforts in the competition. I would like to know if the Chamfer distance in the phase 2 is calculated using the sum or the mean?",
    "2839713": "One more question~ Are the meshes of the 20 objects waterproof, or is the side that is close to the the table missing?",
    "2839789": "They are waterproof. They are scanned by a scanner.",
    "2839845": "Thank you so much for organizing the challenge. We, the VolETA team, tried to submit our results (the 20 3D models) using Kaggle, but unfortunately, we can only upload CSV files. Instead, we send an email to <metafood.cvpr@gmail.com>. Can you please confirm via email that you received the data? looking forward to hearing from you soon!",
    "2839944": "Mean will be used when calculating the Chamfer distance for each direction. Final score for a model is the sum of the two chamfer distance under two directions. Reference: (https://pytorch3d.readthedocs.io/en/latest/_modules/pytorch3d/loss/chamfer.html)",
    "2839947": "We received your submission. Thank you!"
  },
  "source": "meta"
}