{
  "id": 275246,
  "title": "The Next G2Net Competition??",
  "url": "/competitions/g2net-gravitational-wave-detection/discussion/275246",
  "author_name": "",
  "post_date": "2021-09-29T14:55:15.108253Z",
  "votes": 13,
  "comment_count": 5,
  "views": 0,
  "content": "<p>if there were the next G2Net Competition, the organizer can consider:</p>\n<ul>\n<li>estimate the GW parameters (not just detection)</li>\n<li>use additional data like radio, IR, UV, etc …</li>\n<li>we want to see real data! not just simulated ones </li>\n</ul>\n<hr>\n<p>some improvement points for this challenge</p>\n<ul>\n<li>the organizer can actually release the simulation parameters (and maybe also the simulation software) in the train data (the parameters can remain hidden in the test data) at the start of the challenge. With the parameters known, one can do multi-task learning, denoising (since ground truth wave is known).</li>\n</ul>\n<p>Actually, there are many experts in kagglers, with more labels (target and auxiliary) for training, I think you can see more magical solution.</p>\n<p>Some kagglers have \"super computers\" and can create more data for training as well.</p>",
  "messages": [
    {
      "id": "1528324",
      "postDate": "09/29/2021 14:55:15",
      "content": "<p>if there were the next G2Net Competition, the organizer can consider:</p>\n<ul>\n<li>estimate the GW parameters (not just detection)</li>\n<li>use additional data like radio, IR, UV, etc …</li>\n<li>we want to see real data! not just simulated ones </li>\n</ul>\n<hr>\n<p>some improvement points for this challenge</p>\n<ul>\n<li>the organizer can actually release the simulation parameters (and maybe also the simulation software) in the train data (the parameters can remain hidden in the test data) at the start of the challenge. With the parameters known, one can do multi-task learning, denoising (since ground truth wave is known).</li>\n</ul>\n<p>Actually, there are many experts in kagglers, with more labels (target and auxiliary) for training, I think you can see more magical solution.</p>\n<p>Some kagglers have \"super computers\" and can create more data for training as well.</p>",
      "rawMarkdown": "if there were the next G2Net Competition, the organizer can consider:\n- estimate the GW parameters (not just detection)\n- use additional data like radio, IR, UV, etc ...\n- we want to see real data! not just simulated ones \n\n----\n\nsome improvement points for this challenge\n- the organizer can actually release the simulation parameters (and maybe also the simulation software) in the train data (the parameters can remain hidden in the test data) at the start of the challenge. With the parameters known, one can do multi-task learning, denoising (since ground truth wave is known).\n\nActually, there are many experts in kagglers, with more labels (target and auxiliary) for training, I think you can see more magical solution.\n\nSome kagglers have \"super computers\" and can create more data for training as well.",
      "votes": null
    },
    {
      "id": "1528366",
      "postDate": "09/29/2021 15:31:14",
      "content": "<p>It'd also be nice for the organizers to stay connected in the community throughout the course of the competition. G2Net seemed active for a month or two, which was actually better than most other hosts who disappear entirely after the first week. If I was running a comp that I paid for, I'd be egging the contestants along until the last second.</p>",
      "rawMarkdown": "It'd also be nice for the organizers to stay connected in the community throughout the course of the competition. G2Net seemed active for a month or two, which was actually better than most other hosts who disappear entirely after the first week. If I was running a comp that I paid for, I'd be egging the contestants along until the last second.",
      "votes": null
    },
    {
      "id": "1528992",
      "postDate": "09/30/2021 04:38:28",
      "content": "<p><a href=\"https://www.kaggle.com/michaeljwill\" target=\"_blank\">@michaeljwill</a> <a href=\"https://www.kaggle.com/bayeswolf\" target=\"_blank\">@bayeswolf</a><br>\nNow, when the competition is over, it would be nice if organizers release the simulation parameters &amp; software used to generate competition data. Some of us would maybe like to continue to play with this nice problem. Doing so with unlimited train data can entirely change the game.</p>",
      "rawMarkdown": "michaeljwill @bayeswolf\nNow, when the competition is over, it would be nice if organizers release the simulation parameters & software used to generate competition data. Some of us would maybe like to continue to play with this nice problem. Doing so with unlimited train data can entirely change the game.",
      "votes": null
    },
    {
      "id": "1537286",
      "postDate": "10/07/2021 10:53:15",
      "content": "<p>Thanks for the feedback <a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a>! It's great to see there's interest in another G2Net competition. This was very much a learning process for us so it's great to hear the communities thoughts. </p>\n<p>I'll try to give a bit of context for why we decided not to provide the parameters or data generation code. I think there were two main reasons:</p>\n<ul>\n<li>We were concerned that if we released the simulation parameters and/or the data generation code the solution for the test data could be brute-forced, thus defeating the point of the challenge. We were also worried about something similar to what happened in the SETI competition happening here.</li>\n<li>Each signal has 15+ parameters associated with it and understanding what these all mean and how they affect the final signal isn't simple. We felt that all of this extra information could make the competition less accessible since understanding it requires a reasonable amount of prior knowledge.</li>\n</ul>\n<p>Hope this gives you a bit of insight into our thought process.</p>\n<p>If we do run another competition, I think we'll certainly consider releasing at least the parameters, if not the complete data generation code as well. Though that would also depend on what the exact challenge was.</p>",
      "rawMarkdown": "Thanks for the feedback @hengck23! It's great to see there's interest in another G2Net competition. This was very much a learning process for us so it's great to hear the communities thoughts. \n\nI'll try to give a bit of context for why we decided not to provide the parameters or data generation code. I think there were two main reasons:\n\n* We were concerned that if we released the simulation parameters and/or the data generation code the solution for the test data could be brute-forced, thus defeating the point of the challenge. We were also worried about something similar to what happened in the SETI competition happening here.\n* Each signal has 15+ parameters associated with it and understanding what these all mean and how they affect the final signal isn't simple. We felt that all of this extra information could make the competition less accessible since understanding it requires a reasonable amount of prior knowledge.\n\nHope this gives you a bit of insight into our thought process.\n\nIf we do run another competition, I think we'll certainly consider releasing at least the parameters, if not the complete data generation code as well. Though that would also depend on what the exact challenge was.",
      "votes": null
    },
    {
      "id": "1537290",
      "postDate": "10/07/2021 10:57:29",
      "content": "<p><a href=\"https://www.kaggle.com/josefslavicek\" target=\"_blank\">@josefslavicek</a> Glad to hear there might be continued interest in the data after the competition. We're certainly considering releasing the simulation parameters (I personally really hope we can) and maybe the generation code. If we do, we'll make sure it's clearly linked and available to everyone.</p>",
      "rawMarkdown": "josefslavicek Glad to hear there might be continued interest in the data after the competition. We're certainly considering releasing the simulation parameters (I personally really hope we can) and maybe the generation code. If we do, we'll make sure it's clearly linked and available to everyone.",
      "votes": null
    },
    {
      "id": "1559908",
      "postDate": "10/27/2021 08:08:04",
      "content": "<p>Hey All,</p>\n<p>Thank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey <a href=\"https://forms.gle/QP9L16niPexozyhu5\" target=\"_blank\">https://forms.gle/QP9L16niPexozyhu5</a>.</p>\n<p>Thank you all,</p>\n<p>Regards,<br>\nChris</p>",
      "rawMarkdown": "Hey All,\n\nThank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey https://forms.gle/QP9L16niPexozyhu5.\n\nThank you all,\n\nRegards,\nChris",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1528366,
      "author_name": "authman",
      "author_url": "",
      "post_date": "09/29/2021 15:31:14",
      "content": "<p>It'd also be nice for the organizers to stay connected in the community throughout the course of the competition. G2Net seemed active for a month or two, which was actually better than most other hosts who disappear entirely after the first week. If I was running a comp that I paid for, I'd be egging the contestants along until the last second.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1528992,
      "author_name": "josefslavicek",
      "author_url": "",
      "post_date": "09/30/2021 04:38:28",
      "content": "<p><a href=\"https://www.kaggle.com/michaeljwill\" target=\"_blank\">@michaeljwill</a> <a href=\"https://www.kaggle.com/bayeswolf\" target=\"_blank\">@bayeswolf</a><br>\nNow, when the competition is over, it would be nice if organizers release the simulation parameters &amp; software used to generate competition data. Some of us would maybe like to continue to play with this nice problem. Doing so with unlimited train data can entirely change the game.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1537290,
          "author_name": "michaeljwill",
          "author_url": "",
          "post_date": "10/07/2021 10:57:29",
          "content": "<p><a href=\"https://www.kaggle.com/josefslavicek\" target=\"_blank\">@josefslavicek</a> Glad to hear there might be continued interest in the data after the competition. We're certainly considering releasing the simulation parameters (I personally really hope we can) and maybe the generation code. If we do, we'll make sure it's clearly linked and available to everyone.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1537286,
      "author_name": "michaeljwill",
      "author_url": "",
      "post_date": "10/07/2021 10:53:15",
      "content": "<p>Thanks for the feedback <a href=\"https://www.kaggle.com/hengck23\" target=\"_blank\">@hengck23</a>! It's great to see there's interest in another G2Net competition. This was very much a learning process for us so it's great to hear the communities thoughts. </p>\n<p>I'll try to give a bit of context for why we decided not to provide the parameters or data generation code. I think there were two main reasons:</p>\n<ul>\n<li>We were concerned that if we released the simulation parameters and/or the data generation code the solution for the test data could be brute-forced, thus defeating the point of the challenge. We were also worried about something similar to what happened in the SETI competition happening here.</li>\n<li>Each signal has 15+ parameters associated with it and understanding what these all mean and how they affect the final signal isn't simple. We felt that all of this extra information could make the competition less accessible since understanding it requires a reasonable amount of prior knowledge.</li>\n</ul>\n<p>Hope this gives you a bit of insight into our thought process.</p>\n<p>If we do run another competition, I think we'll certainly consider releasing at least the parameters, if not the complete data generation code as well. Though that would also depend on what the exact challenge was.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1559908,
      "author_name": "zerafachris",
      "author_url": "",
      "post_date": "10/27/2021 08:08:04",
      "content": "<p>Hey All,</p>\n<p>Thank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey <a href=\"https://forms.gle/QP9L16niPexozyhu5\" target=\"_blank\">https://forms.gle/QP9L16niPexozyhu5</a>.</p>\n<p>Thank you all,</p>\n<p>Regards,<br>\nChris</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1528324": "if there were the next G2Net Competition, the organizer can consider:\n- estimate the GW parameters (not just detection)\n- use additional data like radio, IR, UV, etc ...\n- we want to see real data! not just simulated ones \n\n----\n\nsome improvement points for this challenge\n- the organizer can actually release the simulation parameters (and maybe also the simulation software) in the train data (the parameters can remain hidden in the test data) at the start of the challenge. With the parameters known, one can do multi-task learning, denoising (since ground truth wave is known).\n\nActually, there are many experts in kagglers, with more labels (target and auxiliary) for training, I think you can see more magical solution.\n\nSome kagglers have \"super computers\" and can create more data for training as well.",
    "1528366": "It'd also be nice for the organizers to stay connected in the community throughout the course of the competition. G2Net seemed active for a month or two, which was actually better than most other hosts who disappear entirely after the first week. If I was running a comp that I paid for, I'd be egging the contestants along until the last second.",
    "1528992": "michaeljwill @bayeswolf\nNow, when the competition is over, it would be nice if organizers release the simulation parameters & software used to generate competition data. Some of us would maybe like to continue to play with this nice problem. Doing so with unlimited train data can entirely change the game.",
    "1537286": "Thanks for the feedback @hengck23! It's great to see there's interest in another G2Net competition. This was very much a learning process for us so it's great to hear the communities thoughts. \n\nI'll try to give a bit of context for why we decided not to provide the parameters or data generation code. I think there were two main reasons:\n\n* We were concerned that if we released the simulation parameters and/or the data generation code the solution for the test data could be brute-forced, thus defeating the point of the challenge. We were also worried about something similar to what happened in the SETI competition happening here.\n* Each signal has 15+ parameters associated with it and understanding what these all mean and how they affect the final signal isn't simple. We felt that all of this extra information could make the competition less accessible since understanding it requires a reasonable amount of prior knowledge.\n\nHope this gives you a bit of insight into our thought process.\n\nIf we do run another competition, I think we'll certainly consider releasing at least the parameters, if not the complete data generation code as well. Though that would also depend on what the exact challenge was.",
    "1537290": "josefslavicek Glad to hear there might be continued interest in the data after the competition. We're certainly considering releasing the simulation parameters (I personally really hope we can) and maybe the generation code. If we do, we'll make sure it's clearly linked and available to everyone.",
    "1559908": "Hey All,\n\nThank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey https://forms.gle/QP9L16niPexozyhu5.\n\nThank you all,\n\nRegards,\nChris"
  },
  "source": "meta"
}