{
  "id": 412283,
  "title": "Run Time on Private Dataset",
  "url": "/competitions/image-matching-challenge-2023/discussion/412283",
  "author_name": "",
  "post_date": "2023-05-23T04:50:36.222861400Z",
  "votes": 6,
  "comment_count": 6,
  "views": 0,
  "content": "<p>I'm a bit confused about this.. when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?<br>\nBecause I've been worrying about run time on private dataset that it might take <code>(56/44)*(time taken for public score)</code>. Please guide me.</p>",
  "messages": [
    {
      "id": "2270203",
      "postDate": "05/23/2023 04:50:36",
      "content": "<p>I'm a bit confused about this.. when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?<br>\nBecause I've been worrying about run time on private dataset that it might take <code>(56/44)*(time taken for public score)</code>. Please guide me.</p>",
      "rawMarkdown": "I'm a bit confused about this.. when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?\nBecause I've been worrying about run time on private dataset that it might take `(56/44)*(time taken for public score)`. Please guide me.",
      "votes": null
    },
    {
      "id": "2270255",
      "postDate": "05/23/2023 05:25:49",
      "content": "<p>we are just given result for the 44%(public set) of the data is the true answer</p>",
      "rawMarkdown": "we are just given result for the 44%(public set) of the data is the true answer",
      "votes": null
    },
    {
      "id": "2270281",
      "postDate": "05/23/2023 05:34:52",
      "content": "<p>So…<br>\nHow can I estimate the time it will take to evaluate the private set</p>",
      "rawMarkdown": "So...\nHow can I estimate the time it will take to evaluate the private set",
      "votes": null
    },
    {
      "id": "2270400",
      "postDate": "05/23/2023 06:55:19",
      "content": "<blockquote>\n  <p>when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?</p>\n</blockquote>\n<p>Your original post was correct. Every submission runs on both public and private data. If there's a public score, there's a private score -- you just won't see it until the end of the competition.</p>",
      "rawMarkdown": "> when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?\n\nYour original post was correct. Every submission runs on both public and private data. If there's a public score, there's a private score -- you just won't see it until the end of the competition.",
      "votes": null
    },
    {
      "id": "2270482",
      "postDate": "05/23/2023 07:19:28",
      "content": "<p>So the time it took in submission<br>\nThat is it? No rerun, right?</p>",
      "rawMarkdown": "So the time it took in submission\nThat is it? No rerun, right?",
      "votes": null
    },
    {
      "id": "2270644",
      "postDate": "05/23/2023 09:45:21",
      "content": "<p>No rerun. The notebook limit (9h) includes both the public and private sets.</p>",
      "rawMarkdown": "No rerun. The notebook limit (9h) includes both the public and private sets.",
      "votes": null
    },
    {
      "id": "2270652",
      "postDate": "05/23/2023 09:53:01",
      "content": "<p>Thanks a lot, I have been baffled for so long</p>",
      "rawMarkdown": "Thanks a lot, I have been baffled for so long",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2270255,
      "author_name": "distiller",
      "author_url": "",
      "post_date": "05/23/2023 05:25:49",
      "content": "<p>we are just given result for the 44%(public set) of the data is the true answer</p>",
      "votes": null,
      "replies": [
        {
          "id": 2270281,
          "author_name": "bhavesjain",
          "author_url": "",
          "post_date": "05/23/2023 05:34:52",
          "content": "<p>So…<br>\nHow can I estimate the time it will take to evaluate the private set</p>",
          "votes": null,
          "replies": [
            {
              "id": 2270400,
              "author_name": "eduardtrulls",
              "author_url": "",
              "post_date": "05/23/2023 06:55:19",
              "content": "<blockquote>\n  <p>when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?</p>\n</blockquote>\n<p>Your original post was correct. Every submission runs on both public and private data. If there's a public score, there's a private score -- you just won't see it until the end of the competition.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2270482,
                  "author_name": "bhavesjain",
                  "author_url": "",
                  "post_date": "05/23/2023 07:19:28",
                  "content": "<p>So the time it took in submission<br>\nThat is it? No rerun, right?</p>",
                  "votes": null,
                  "replies": [
                    {
                      "id": 2270644,
                      "author_name": "eduardtrulls",
                      "author_url": "",
                      "post_date": "05/23/2023 09:45:21",
                      "content": "<p>No rerun. The notebook limit (9h) includes both the public and private sets.</p>",
                      "votes": null,
                      "replies": [
                        {
                          "id": 2270652,
                          "author_name": "bhavesjain",
                          "author_url": "",
                          "post_date": "05/23/2023 09:53:01",
                          "content": "<p>Thanks a lot, I have been baffled for so long</p>",
                          "votes": null,
                          "replies": []
                        }
                      ]
                    }
                  ]
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2270203": "I'm a bit confused about this.. when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?\nBecause I've been worrying about run time on private dataset that it might take `(56/44)*(time taken for public score)`. Please guide me.",
    "2270255": "we are just given result for the 44%(public set) of the data is the true answer",
    "2270281": "So...\nHow can I estimate the time it will take to evaluate the private set",
    "2270400": "> when we submit a notebook and get a score on public set and it took some hours , does that mean the notebook was run in that particular time on the whole set, but we are just given result for the 44%(public set) of the data?\n\nYour original post was correct. Every submission runs on both public and private data. If there's a public score, there's a private score -- you just won't see it until the end of the competition.",
    "2270482": "So the time it took in submission\nThat is it? No rerun, right?",
    "2270644": "No rerun. The notebook limit (9h) includes both the public and private sets.",
    "2270652": "Thanks a lot, I have been baffled for so long"
  },
  "source": "meta"
}