{
  "id": 109793,
  "title": "Public TestSet Distribution via LB probing",
  "url": "/competitions/understanding_cloud_organization/discussion/109793",
  "author_name": "",
  "post_date": "2019-09-22T11:10:32.252438400Z",
  "votes": 16,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Being inspired from this awesome <a href=\"https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#latest-621119\">post</a>, I decided to extract similar stats regrading the mask distribution in public test-set by probing the public LB.\nHere is what I got:</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F43771b2c3fd35e39047f55b552604852%2FLB_probing.png?generation=1569149948996763&amp;alt=media\" alt=\"\"></p>\n\n<p>Useful Stats::</p>\n\n<p>no. of empty mask = 7055\nno. of non-empty mask = 7737\nno. of non-empty mask for <code>Fish</code> = 1864\nno. of non-empty mask for <code>Flower</code> = 1509\nno. of non-empty mask for <code>Gravel</code> = 1982\nno. of non-empty mask for <code>Sugar</code> = 2382</p>\n\n<p>Above stats were calculated by following Chris <a href=\"https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#619204\">comments</a></p>\n\n<p>Hope this gives you helps you in your experiments and please let me know if my approach/math is wrong\n<code>PS:  The numbers are not exact(but close approximation) as I round off decimals.</code> </p>",
  "messages": [
    {
      "id": "631634",
      "postDate": "09/22/2019 11:10:32",
      "content": "<p>Being inspired from this awesome <a href=\"https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#latest-621119\">post</a>, I decided to extract similar stats regrading the mask distribution in public test-set by probing the public LB.\nHere is what I got:</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F43771b2c3fd35e39047f55b552604852%2FLB_probing.png?generation=1569149948996763&amp;alt=media\" alt=\"\"></p>\n\n<p>Useful Stats::</p>\n\n<p>no. of empty mask = 7055\nno. of non-empty mask = 7737\nno. of non-empty mask for <code>Fish</code> = 1864\nno. of non-empty mask for <code>Flower</code> = 1509\nno. of non-empty mask for <code>Gravel</code> = 1982\nno. of non-empty mask for <code>Sugar</code> = 2382</p>\n\n<p>Above stats were calculated by following Chris <a href=\"https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#619204\">comments</a></p>\n\n<p>Hope this gives you helps you in your experiments and please let me know if my approach/math is wrong\n<code>PS:  The numbers are not exact(but close approximation) as I round off decimals.</code> </p>",
      "rawMarkdown": "Being inspired from this awesome [post](https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#latest-621119), I decided to extract similar stats regrading the mask distribution in public test-set by probing the public LB.\nHere is what I got:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F43771b2c3fd35e39047f55b552604852%2FLB_probing.png?generation=1569149948996763&amp;alt=media)\n\nUseful Stats::\n\nno. of empty mask = 7055\nno. of non-empty mask = 7737\nno. of non-empty mask for `Fish` = 1864\nno. of non-empty mask for `Flower` = 1509\nno. of non-empty mask for `Gravel` = 1982\nno. of non-empty mask for `Sugar` = 2382\n\nAbove stats were calculated by following Chris [comments](https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#619204)\n\nHope this gives you helps you in your experiments and please let me know if my approach/math is wrong\n`PS:  The numbers are not exact(but close approximation) as I round off decimals.`",
      "votes": null
    },
    {
      "id": "631662",
      "postDate": "09/22/2019 12:38:16",
      "content": "<blockquote>\n  <p>no. of empty mask = 7055\n  no. of non-empty mask = 7737\n  no. of non-empty mask for <code>Fish</code> = 1864\n  no. of non-empty mask for <code>Flower</code> = 1509\n  no. of non-empty mask for <code>Gravel</code> = 1982\n  no. of non-empty mask for <code>Sugar</code> = 2382</p>\n</blockquote>\n\n<p>AFAIK the score you got was on 25% of data and these stats assume entire data. </p>",
      "rawMarkdown": "&gt; \n&gt; no. of empty mask = 7055\n&gt; no. of non-empty mask = 7737\n&gt; no. of non-empty mask for `Fish` = 1864\n&gt; no. of non-empty mask for `Flower` = 1509\n&gt; no. of non-empty mask for `Gravel` = 1982\n&gt; no. of non-empty mask for `Sugar` = 2382\n\nAFAIK the score you got was on 25% of data and these stats assume entire data.",
      "votes": null
    },
    {
      "id": "631676",
      "postDate": "09/22/2019 13:07:58",
      "content": "<p>I'm sorry but Could you elaborate on what you mean by <code>25% of data</code>?</p>",
      "rawMarkdown": "I'm sorry but Could you elaborate on what you mean by `25% of data`?",
      "votes": null
    },
    {
      "id": "631730",
      "postDate": "09/22/2019 15:08:28",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2226462%2F6d6fefaa386f6834beb97703e192cfeb%2FScreenshot%20from%202019-09-22%2020-35-20.png?generation=1569164859746444&amp;alt=media\" alt=\"\"></p>\n\n<p>I am talking about this ^   </p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2226462%2F6d6fefaa386f6834beb97703e192cfeb%2FScreenshot%20from%202019-09-22%2020-35-20.png?generation=1569164859746444&amp;alt=media)\n\nI am talking about this ^",
      "votes": null
    },
    {
      "id": "631950",
      "postDate": "09/23/2019 02:14:13",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2Fc24c3f314c28be29bf95c743f84fcbe0%2Flb.png?generation=1569204717940804&amp;alt=media\" alt=\"\"></p>\n\n<p>This is from Steel Competition. The public LB is calculated with 33% of test-data and stats presented by Heng holds for this 33% data.....So I think above stats are valid for 25% of test-data.</p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2Fc24c3f314c28be29bf95c743f84fcbe0%2Flb.png?generation=1569204717940804&amp;alt=media)\n\nThis is from Steel Competition. The public LB is calculated with 33% of test-data and stats presented by Heng holds for this 33% data.....So I think above stats are valid for 25% of test-data.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 631662,
      "author_name": "dhananjay3",
      "author_url": "",
      "post_date": "09/22/2019 12:38:16",
      "content": "<blockquote>\n  <p>no. of empty mask = 7055\n  no. of non-empty mask = 7737\n  no. of non-empty mask for <code>Fish</code> = 1864\n  no. of non-empty mask for <code>Flower</code> = 1509\n  no. of non-empty mask for <code>Gravel</code> = 1982\n  no. of non-empty mask for <code>Sugar</code> = 2382</p>\n</blockquote>\n\n<p>AFAIK the score you got was on 25% of data and these stats assume entire data. </p>",
      "votes": null,
      "replies": [
        {
          "id": 631676,
          "author_name": "bibek777",
          "author_url": "",
          "post_date": "09/22/2019 13:07:58",
          "content": "<p>I'm sorry but Could you elaborate on what you mean by <code>25% of data</code>?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 631730,
          "author_name": "dhananjay3",
          "author_url": "",
          "post_date": "09/22/2019 15:08:28",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2226462%2F6d6fefaa386f6834beb97703e192cfeb%2FScreenshot%20from%202019-09-22%2020-35-20.png?generation=1569164859746444&amp;alt=media\" alt=\"\"></p>\n\n<p>I am talking about this ^   </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 631950,
          "author_name": "bibek777",
          "author_url": "",
          "post_date": "09/23/2019 02:14:13",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2Fc24c3f314c28be29bf95c743f84fcbe0%2Flb.png?generation=1569204717940804&amp;alt=media\" alt=\"\"></p>\n\n<p>This is from Steel Competition. The public LB is calculated with 33% of test-data and stats presented by Heng holds for this 33% data.....So I think above stats are valid for 25% of test-data.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "631634": "Being inspired from this awesome [post](https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#latest-621119), I decided to extract similar stats regrading the mask distribution in public test-set by probing the public LB.\nHere is what I got:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2F43771b2c3fd35e39047f55b552604852%2FLB_probing.png?generation=1569149948996763&amp;alt=media)\n\nUseful Stats::\n\nno. of empty mask = 7055\nno. of non-empty mask = 7737\nno. of non-empty mask for `Fish` = 1864\nno. of non-empty mask for `Flower` = 1509\nno. of non-empty mask for `Gravel` = 1982\nno. of non-empty mask for `Sugar` = 2382\n\nAbove stats were calculated by following Chris [comments](https://www.kaggle.com/c/severstal-steel-defect-detection/discussion/106477#619204)\n\nHope this gives you helps you in your experiments and please let me know if my approach/math is wrong\n`PS:  The numbers are not exact(but close approximation) as I round off decimals.`",
    "631662": "&gt; \n&gt; no. of empty mask = 7055\n&gt; no. of non-empty mask = 7737\n&gt; no. of non-empty mask for `Fish` = 1864\n&gt; no. of non-empty mask for `Flower` = 1509\n&gt; no. of non-empty mask for `Gravel` = 1982\n&gt; no. of non-empty mask for `Sugar` = 2382\n\nAFAIK the score you got was on 25% of data and these stats assume entire data.",
    "631676": "I'm sorry but Could you elaborate on what you mean by `25% of data`?",
    "631730": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2226462%2F6d6fefaa386f6834beb97703e192cfeb%2FScreenshot%20from%202019-09-22%2020-35-20.png?generation=1569164859746444&amp;alt=media)\n\nI am talking about this ^",
    "631950": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F1528571%2Fc24c3f314c28be29bf95c743f84fcbe0%2Flb.png?generation=1569204717940804&amp;alt=media)\n\nThis is from Steel Competition. The public LB is calculated with 33% of test-data and stats presented by Heng holds for this 33% data.....So I think above stats are valid for 25% of test-data."
  },
  "source": "meta"
}