{
  "id": 61728,
  "title": "TrackML Accuracy Phase : Final steps",
  "url": "/competitions/trackml-particle-identification/discussion/61728",
  "author_name": "David Rousseau",
  "post_date": "2018-07-22T21:17:08.330000",
  "votes": 5,
  "comment_count": 17,
  "views": 0,
  "content": "<p>As you know from this competition web page, we’re getting close to the final steps of this competition.</p>\n\n<ul>\n<li>August 6, 2018 - Entry deadline. You must accept the competition rules before this date in order to compete.</li>\n<li>August 6, 2018 - Team Merger deadline. This is the last day participants may join or merge teams.</li>\n<li>August 13, 2018 - Final submission deadline.</li>\n</ul>\n\n<p>The temporary private leaderboard will then be exposed, pending internal Kaggle verification which should take a few days.\nThen the leaderboard #1 2 3 will be asked to provide their documented software to be eligible to the leaderboard 25k$ prizes.</p>\n\n<p>But we will also issue a call for all participants who believe they have developed an innovative algorithm (even if just a hack, even if not reaching the highest score)) to also submit their software with a short explanatory document, following guidelines we will provide. </p>\n\n<p>We expect these documents to be submitted by end of August. Then an international jury with both physicists and computer scientists will select by end September the most interesting submissions to attribute the special prizes : a NVidia V100 GPU, and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.</p>\n\n<p>Meanwhile, the second phase of this challenge, the Throughput Phase will open early September till end October (not July as foreseen at some point). This will be an official NIPS 2018 competition. It will be run on Codalab platform. The dataset will be very similar to the one of the first phase. The scoring will combine a similar accuracy score (as for the first phase) with the speed. There will be 15k$ prize from the leaderboard and special prizes from the jury another Nvidia V100 GPU and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.</p>",
  "messages": [
    {
      "id": 369383,
      "postDate": "2018-08-12T21:47:10.973Z",
      "content": "<p>I can't find anywhere to upload my code. According to CPMP's interpretation of the prizes tab, we only have one day to upload our model, so this is a pressing question.\nThe only explanation that makes sense to me is that the \"competition deadline\" from the prizes tab is after the \"submission deadline\" tomorrow, and that the organizers haven't opened model submissions yet.</p>\n\n<p>Please, could some of the organizers clarify where and when to submit the code?</p>",
      "rawMarkdown": "I can't find anywhere to upload my code. According to CPMP's interpretation of the prizes tab, we only have one day to upload our model, so this is a pressing question.\nThe only explanation that makes sense to me is that the \"competition deadline\" from the prizes tab is after the \"submission deadline\" tomorrow, and that the organizers haven't opened model submissions yet.\n\nPlease, could some of the organizers clarify where and when to submit the code?",
      "votes": 5,
      "replies": [
        {
          "id": 369425,
          "postDate": "2018-08-13T03:09:02.660Z",
          "content": "<p><a href=\"/icecuber\">@icecuber</a>, thanks for asking explicitly.  In other competitions where one had to upload code, there was a button for it in the Team page.  Here I don't see any.</p>",
          "rawMarkdown": "@icecuber, thanks for asking explicitly.  In other competitions where one had to upload code, there was a button for it in the Team page.  Here I don't see any."
        },
        {
          "id": 369496,
          "postDate": "2018-08-13T07:49:24.850Z",
          "content": "<p>As stated in the first post above, code and document are expected by the end of August, we will detail this shortly (sorry the Prize tab was ambiguous about it)</p>",
          "rawMarkdown": "As stated in the first post above, code and document are expected by the end of August, we will detail this shortly (sorry the Prize tab was ambiguous about it)",
          "votes": 1
        }
      ]
    },
    {
      "id": 360622,
      "postDate": "2018-07-22T21:17:08.330Z",
      "content": "<p>As you know from this competition web page, we’re getting close to the final steps of this competition.</p>\n\n<ul>\n<li>August 6, 2018 - Entry deadline. You must accept the competition rules before this date in order to compete.</li>\n<li>August 6, 2018 - Team Merger deadline. This is the last day participants may join or merge teams.</li>\n<li>August 13, 2018 - Final submission deadline.</li>\n</ul>\n\n<p>The temporary private leaderboard will then be exposed, pending internal Kaggle verification which should take a few days.\nThen the leaderboard #1 2 3 will be asked to provide their documented software to be eligible to the leaderboard 25k$ prizes.</p>\n\n<p>But we will also issue a call for all participants who believe they have developed an innovative algorithm (even if just a hack, even if not reaching the highest score)) to also submit their software with a short explanatory document, following guidelines we will provide. </p>\n\n<p>We expect these documents to be submitted by end of August. Then an international jury with both physicists and computer scientists will select by end September the most interesting submissions to attribute the special prizes : a NVidia V100 GPU, and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.</p>\n\n<p>Meanwhile, the second phase of this challenge, the Throughput Phase will open early September till end October (not July as foreseen at some point). This will be an official NIPS 2018 competition. It will be run on Codalab platform. The dataset will be very similar to the one of the first phase. The scoring will combine a similar accuracy score (as for the first phase) with the speed. There will be 15k$ prize from the leaderboard and special prizes from the jury another Nvidia V100 GPU and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.</p>",
      "rawMarkdown": "As you know from this competition web page, we’re getting close to the final steps of this competition.\n\n - August 6, 2018 - Entry deadline. You must accept the competition rules before this date in order to compete.\n - August 6, 2018 - Team Merger deadline. This is the last day participants may join or merge teams.\n - August 13, 2018 - Final submission deadline.\n\nThe temporary private leaderboard will then be exposed, pending internal Kaggle verification which should take a few days.\nThen the leaderboard #1 2 3 will be asked to provide their documented software to be eligible to the leaderboard 25k$ prizes.\n\nBut we will also issue a call for all participants who believe they have developed an innovative algorithm (even if just a hack, even if not reaching the highest score)) to also submit their software with a short explanatory document, following guidelines we will provide. \n\nWe expect these documents to be submitted by end of August. Then an international jury with both physicists and computer scientists will select by end September the most interesting submissions to attribute the special prizes : a NVidia V100 GPU, and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.\n\nMeanwhile, the second phase of this challenge, the Throughput Phase will open early September till end October (not July as foreseen at some point). This will be an official NIPS 2018 competition. It will be run on Codalab platform. The dataset will be very similar to the one of the first phase. The scoring will combine a similar accuracy score (as for the first phase) with the speed. There will be 15k$ prize from the leaderboard and special prizes from the jury another Nvidia V100 GPU and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.\n",
      "votes": 5
    },
    {
      "id": 361028,
      "postDate": "2018-07-23T18:14:59.273Z",
      "content": "<p>David,\nHow will the publication of the eventual winners' codes be handled with respect to the subsequent Throughput Phase?\nThe competition rules require putting the code under an open license. I assume this also implies the intent to make the codes publicly available (I sure hope so, since I'm very curious :). Will it be possible to keep the codes closed until the conclusion of the Throughput Phase?</p>",
      "rawMarkdown": "David,\nHow will the publication of the eventual winners' codes be handled with respect to the subsequent Throughput Phase?\nThe competition rules require putting the code under an open license. I assume this also implies the intent to make the codes publicly available (I sure hope so, since I'm very curious :). Will it be possible to keep the codes closed until the conclusion of the Throughput Phase?",
      "votes": 1,
      "replies": [
        {
          "id": 361605,
          "postDate": "2018-07-24T19:22:05.810Z",
          "content": "<p>The two phases are handled as separate competitions. The kaggle rules everyone has signed apply to the first phase. There will be new rules (quite similar in fact) for the second phase. So yes the code (properly documented) of winners of the first phase will be public when the second phase starts. </p>",
          "rawMarkdown": "The two phases are handled as separate competitions. The kaggle rules everyone has signed apply to the first phase. There will be new rules (quite similar in fact) for the second phase. So yes the code (properly documented) of winners of the first phase will be public when the second phase starts. "
        },
        {
          "id": 363054,
          "postDate": "2018-07-27T18:04:59.373Z",
          "content": "<p>Edwin, you are required to provide an open source license for your code to organizers, but you are not required to make your code visible to everybody.</p>",
          "rawMarkdown": "Edwin, you are required to provide an open source license for your code to organizers, but you are not required to make your code visible to everybody."
        },
        {
          "id": 369497,
          "postDate": "2018-08-13T07:52:26.270Z",
          "content": "<p>But if the code is not public, expect organizers to make it visible to everybody at the beginning of the Throughput phase.</p>",
          "rawMarkdown": "But if the code is not public, expect organizers to make it visible to everybody at the beginning of the Throughput phase.",
          "votes": 1
        },
        {
          "id": 369548,
          "postDate": "2018-08-13T10:25:03.890Z",
          "content": "<blockquote>\n  <p>expect organizers to make it visible to everybody</p>\n</blockquote>\n\n<p>This is good, it can lead winners to explain what they did right after the competition, as is usual in Kaggle competitions.  I'll share mine too as a result.</p>",
          "rawMarkdown": "&gt;  expect organizers to make it visible to everybody\n\nThis is good, it can lead winners to explain what they did right after the competition, as is usual in Kaggle competitions.  I'll share mine too as a result."
        }
      ]
    },
    {
      "id": 368474,
      "postDate": "2018-08-10T00:49:07.917Z",
      "content": "<p>David, what time is the deadline? let's consider London</p>",
      "rawMarkdown": "David, what time is the deadline? let's consider London",
      "replies": [
        {
          "id": 368512,
          "postDate": "2018-08-10T03:56:40.730Z",
          "content": "<p>11:59 pm utc Time, this is 1’ before 1AM at London, 2AM in most of Europe, but 5PM for San Francisco, people in America should be careful...</p>",
          "rawMarkdown": "11:59 pm utc Time, this is 1’ before 1AM at London, 2AM in most of Europe, but 5PM for San Francisco, people in America should be careful..."
        }
      ]
    },
    {
      "id": 366613,
      "postDate": "2018-08-06T02:49:12.230Z",
      "content": "<p>Where and when should the code and explanatory document be submitted?</p>",
      "rawMarkdown": "Where and when should the code and explanatory document be submitted?",
      "replies": [
        {
          "id": 367734,
          "postDate": "2018-08-08T12:17:41.170Z",
          "content": "<p>According to the prize page code must be uploaded before competition end, in few days.  </p>",
          "rawMarkdown": "According to the prize page code must be uploaded before competition end, in few days.  ",
          "votes": 1
        },
        {
          "id": 367882,
          "postDate": "2018-08-08T18:33:35.343Z",
          "content": "<p>I know that the code has to be uploaded in a few days, but where should it be uploaded</p>",
          "rawMarkdown": "I know that the code has to be uploaded in a few days, but where should it be uploaded",
          "votes": 2
        },
        {
          "id": 369498,
          "postDate": "2018-08-13T07:52:48.880Z",
          "content": "<p>As stated in the first post above, code and document are expected by the end of August, we will detail this shortly (sorry the Prize tab was ambiguous about it)</p>",
          "rawMarkdown": "As stated in the first post above, code and document are expected by the end of August, we will detail this shortly (sorry the Prize tab was ambiguous about it)"
        }
      ]
    },
    {
      "id": 360651,
      "postDate": "2018-07-23T00:43:46.990Z",
      "content": "<p>Interesting. The efficiency phase is what I think fairer for smart methods. </p>",
      "rawMarkdown": "Interesting. The efficiency phase is what I think fairer for smart methods. ",
      "replies": [
        {
          "id": 369551,
          "postDate": "2018-08-13T10:28:05.620Z",
          "content": "<p>You don't think methods used by people at the top of LB are smart?  I think they are very smart.</p>",
          "rawMarkdown": "You don't think methods used by people at the top of LB are smart?  I think they are very smart.",
          "votes": 2
        }
      ]
    },
    {
      "id": 365116,
      "postDate": "2018-08-01T23:31:31.227Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 369383,
      "author_name": "icecuber",
      "author_url": "",
      "post_date": "2018-08-12T21:47:10.973000",
      "content": "<p>I can't find anywhere to upload my code. According to CPMP's interpretation of the prizes tab, we only have one day to upload our model, so this is a pressing question.\nThe only explanation that makes sense to me is that the \"competition deadline\" from the prizes tab is after the \"submission deadline\" tomorrow, and that the organizers haven't opened model submissions yet.</p>\n\n<p>Please, could some of the organizers clarify where and when to submit the code?</p>",
      "votes": 5,
      "replies": [
        {
          "id": 369425,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2018-08-13T03:09:02.660000",
          "content": "<p><a href=\"/icecuber\">@icecuber</a>, thanks for asking explicitly.  In other competitions where one had to upload code, there was a button for it in the Team page.  Here I don't see any.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 369496,
          "author_name": "David Rousseau",
          "author_url": "",
          "post_date": "2018-08-13T07:49:24.850000",
          "content": "<p>As stated in the first post above, code and document are expected by the end of August, we will detail this shortly (sorry the Prize tab was ambiguous about it)</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 361028,
      "author_name": "Edwin Steiner",
      "author_url": "",
      "post_date": "2018-07-23T18:14:59.273000",
      "content": "<p>David,\nHow will the publication of the eventual winners' codes be handled with respect to the subsequent Throughput Phase?\nThe competition rules require putting the code under an open license. I assume this also implies the intent to make the codes publicly available (I sure hope so, since I'm very curious :). Will it be possible to keep the codes closed until the conclusion of the Throughput Phase?</p>",
      "votes": 1,
      "replies": [
        {
          "id": 361605,
          "author_name": "David Rousseau",
          "author_url": "",
          "post_date": "2018-07-24T19:22:05.810000",
          "content": "<p>The two phases are handled as separate competitions. The kaggle rules everyone has signed apply to the first phase. There will be new rules (quite similar in fact) for the second phase. So yes the code (properly documented) of winners of the first phase will be public when the second phase starts. </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 363054,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2018-07-27T18:04:59.373000",
          "content": "<p>Edwin, you are required to provide an open source license for your code to organizers, but you are not required to make your code visible to everybody.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 369497,
          "author_name": "David Rousseau",
          "author_url": "",
          "post_date": "2018-08-13T07:52:26.270000",
          "content": "<p>But if the code is not public, expect organizers to make it visible to everybody at the beginning of the Throughput phase.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 369548,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2018-08-13T10:25:03.890000",
          "content": "<blockquote>\n  <p>expect organizers to make it visible to everybody</p>\n</blockquote>\n\n<p>This is good, it can lead winners to explain what they did right after the competition, as is usual in Kaggle competitions.  I'll share mine too as a result.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 368474,
      "author_name": "Blonde",
      "author_url": "",
      "post_date": "2018-08-10T00:49:07.917000",
      "content": "<p>David, what time is the deadline? let's consider London</p>",
      "votes": 0,
      "replies": [
        {
          "id": 368512,
          "author_name": "David Rousseau",
          "author_url": "",
          "post_date": "2018-08-10T03:56:40.730000",
          "content": "<p>11:59 pm utc Time, this is 1’ before 1AM at London, 2AM in most of Europe, but 5PM for San Francisco, people in America should be careful...</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 366613,
      "author_name": "bilal2vec",
      "author_url": "",
      "post_date": "2018-08-06T02:49:12.230000",
      "content": "<p>Where and when should the code and explanatory document be submitted?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 367734,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2018-08-08T12:17:41.170000",
          "content": "<p>According to the prize page code must be uploaded before competition end, in few days.  </p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 367882,
          "author_name": "bilal2vec",
          "author_url": "",
          "post_date": "2018-08-08T18:33:35.343000",
          "content": "<p>I know that the code has to be uploaded in a few days, but where should it be uploaded</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 369498,
          "author_name": "David Rousseau",
          "author_url": "",
          "post_date": "2018-08-13T07:52:48.880000",
          "content": "<p>As stated in the first post above, code and document are expected by the end of August, we will detail this shortly (sorry the Prize tab was ambiguous about it)</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 360651,
      "author_name": "Kha Vo",
      "author_url": "",
      "post_date": "2018-07-23T00:43:46.990000",
      "content": "<p>Interesting. The efficiency phase is what I think fairer for smart methods. </p>",
      "votes": 0,
      "replies": [
        {
          "id": 369551,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2018-08-13T10:28:05.620000",
          "content": "<p>You don't think methods used by people at the top of LB are smart?  I think they are very smart.</p>",
          "votes": 2,
          "replies": []
        }
      ]
    },
    {
      "id": 365116,
      "author_name": "",
      "author_url": "",
      "post_date": "2018-08-01T23:31:31.227000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "369383": "I can't find anywhere to upload my code. According to CPMP's interpretation of the prizes tab, we only have one day to upload our model, so this is a pressing question.\nThe only explanation that makes sense to me is that the \"competition deadline\" from the prizes tab is after the \"submission deadline\" tomorrow, and that the organizers haven't opened model submissions yet.\n\nPlease, could some of the organizers clarify where and when to submit the code?",
    "360622": "As you know from this competition web page, we’re getting close to the final steps of this competition.\n\n - August 6, 2018 - Entry deadline. You must accept the competition rules before this date in order to compete.\n - August 6, 2018 - Team Merger deadline. This is the last day participants may join or merge teams.\n - August 13, 2018 - Final submission deadline.\n\nThe temporary private leaderboard will then be exposed, pending internal Kaggle verification which should take a few days.\nThen the leaderboard #1 2 3 will be asked to provide their documented software to be eligible to the leaderboard 25k$ prizes.\n\nBut we will also issue a call for all participants who believe they have developed an innovative algorithm (even if just a hack, even if not reaching the highest score)) to also submit their software with a short explanatory document, following guidelines we will provide. \n\nWe expect these documents to be submitted by end of August. Then an international jury with both physicists and computer scientists will select by end September the most interesting submissions to attribute the special prizes : a NVidia V100 GPU, and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.\n\nMeanwhile, the second phase of this challenge, the Throughput Phase will open early September till end October (not July as foreseen at some point). This will be an official NIPS 2018 competition. It will be run on Codalab platform. The dataset will be very similar to the one of the first phase. The scoring will combine a similar accuracy score (as for the first phase) with the speed. There will be 15k$ prize from the leaderboard and special prizes from the jury another Nvidia V100 GPU and two paid invitations to NIPS 2018 or the spring 2019 CERN workshop.\n",
    "361028": "David,\nHow will the publication of the eventual winners' codes be handled with respect to the subsequent Throughput Phase?\nThe competition rules require putting the code under an open license. I assume this also implies the intent to make the codes publicly available (I sure hope so, since I'm very curious :). Will it be possible to keep the codes closed until the conclusion of the Throughput Phase?",
    "368474": "David, what time is the deadline? let's consider London",
    "366613": "Where and when should the code and explanatory document be submitted?",
    "360651": "Interesting. The efficiency phase is what I think fairer for smart methods. ",
    "365116": ""
  }
}