{
  "id": 37968,
  "title": "Crawling Carvana website for more training images ... is it against the rule?",
  "url": "/competitions/carvana-image-masking-challenge/discussion/37968",
  "author_name": "",
  "post_date": "2017-08-12T14:55:11.099478Z",
  "votes": null,
  "comment_count": 6,
  "views": 0,
  "content": "<p>It seems that i can download more images from Carvana website.\nFor example:</p>\n\n<p><img src=\"http://www.brightreviews.com/ckfinder/userfiles/images/carvana_2.jpg\" alt=\"enter image description here\" title=\"\"> \n <img src=\"https://cdnblob.carvana.io/2000029680/post-large/2000029680/edc/grid.jpg\" alt=\"enter image description here\" title=\"\"></p>\n\n<p>If I download them and hand label them for training, is it against the rule?\n If it is ok, maybe we can get more train data if  kagglers can annotate and share data.</p>",
  "messages": [
    {
      "id": "212741",
      "postDate": "08/12/2017 14:55:11",
      "content": "<p>It seems that i can download more images from Carvana website.\nFor example:</p>\n\n<p><img src=\"http://www.brightreviews.com/ckfinder/userfiles/images/carvana_2.jpg\" alt=\"enter image description here\" title=\"\"> \n <img src=\"https://cdnblob.carvana.io/2000029680/post-large/2000029680/edc/grid.jpg\" alt=\"enter image description here\" title=\"\"></p>\n\n<p>If I download them and hand label them for training, is it against the rule?\n If it is ok, maybe we can get more train data if  kagglers can annotate and share data.</p>",
      "rawMarkdown": "It seems that i can download more images from Carvana website.\nFor example:\n\n ![enter image description here][1] \n ![enter image description here][2]\n\n If I download them and hand label them for training, is it against the rule?\n If it is ok, maybe we can get more train data if  kagglers can annotate and share data.\n\n\n  [1]: http://www.brightreviews.com/ckfinder/userfiles/images/carvana_2.jpg\n  [2]: https://cdnblob.carvana.io/2000029680/post-large/2000029680/edc/grid.jpg",
      "votes": null
    },
    {
      "id": "212778",
      "postDate": "08/12/2017 16:49:42",
      "content": "<p>My initial thought is no, but we can have a discussion about going through the official channels to add supplemental data. Scraping data from Carvana's web services is definitely not authorized by Carvana.</p>\n\n<p>I'll defer to Kaggle staff on whether we should introduce additional images that are allowed to be hand labeled, as that does seem like it could be helpful.</p>",
      "rawMarkdown": "My initial thought is no, but we can have a discussion about going through the official channels to add supplemental data. Scraping data from Carvana's web services is definitely not authorized by Carvana.\n\nI'll defer to Kaggle staff on whether we should introduce additional images that are allowed to be hand labeled, as that does seem like it could be helpful.",
      "votes": null
    },
    {
      "id": "213263",
      "postDate": "08/14/2017 09:12:43",
      "content": "<p>In that case the competition becomes not only about creating models but also about spending time or money for labeling that definitely will not \"bring value to the company\" as it is sured to be expected.</p>",
      "rawMarkdown": "In that case the competition becomes not only about creating models but also about spending time or money for labeling that definitely will not \"bring value to the company\" as it is sured to be expected.",
      "votes": null
    },
    {
      "id": "213365",
      "postDate": "08/14/2017 15:52:48",
      "content": "<p>To clarify Kaggle's position here:</p>\n\n<blockquote>\n  <p>Use of external data is permitted, provided the data is freely available. If you are using a source of external data, you must post the source to the official external data forum thread no later than one week prior to the entry deadline.</p>\n</blockquote>\n\n<p>We allow external data on image problems because of the popularity of pre-trained networks. It would not be a violation of competition rules to use an external source, but you would have to post it for everyone to use.</p>\n\n<p>In this specific case, given Brian's comments about scraping being against Carvana's terms of service, you should obviously not pursue the idea.</p>",
      "rawMarkdown": "To clarify Kaggle's position here:\n\n&gt; Use of external data is permitted, provided the data is freely available. If you are using a source of external data, you must post the source to the official external data forum thread no later than one week prior to the entry deadline.\n\nWe allow external data on image problems because of the popularity of pre-trained networks. It would not be a violation of competition rules to use an external source, but you would have to post it for everyone to use.\n\nIn this specific case, given Brian's comments about scraping being against Carvana's terms of service, you should obviously not pursue the idea.",
      "votes": null
    },
    {
      "id": "214069",
      "postDate": "08/15/2017 22:04:06",
      "content": "<p>My friend, we have enough images for hand-labeling among those 100,064\nWhy are you searching for more images?\nI really don't understand you)</p>",
      "rawMarkdown": "My friend, we have enough images for hand-labeling among those 100,064\nWhy are you searching for more images?\nI really don't understand you)",
      "votes": null
    },
    {
      "id": "214078",
      "postDate": "08/15/2017 22:30:52",
      "content": "<p>I'm pretty sure hand labeling <em>any</em> of the images in the test set is against the rules. The test images can be used for unsupervised learning.</p>",
      "rawMarkdown": "I'm pretty sure hand labeling *any* of the images in the test set is against the rules. The test images can be used for unsupervised learning.",
      "votes": null
    },
    {
      "id": "214118",
      "postDate": "08/16/2017 02:13:43",
      "content": "<p>Using hand-labeled data within submission is against the rules.\nUsing hand-labeled data for training is also against the rules?\nIf yes, than OP's question makes sense.\nBTW, looking through CNN-marked images I noticed few errors raised from \"new\" types of exterior parts.\nI mean exterior parts not included in provided train set.</p>",
      "rawMarkdown": "Using hand-labeled data within submission is against the rules.\nUsing hand-labeled data for training is also against the rules?\nIf yes, than OP's question makes sense.\nBTW, looking through CNN-marked images I noticed few errors raised from \"new\" types of exterior parts.\nI mean exterior parts not included in provided train set.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 212778,
      "author_name": "brianshaler",
      "author_url": "",
      "post_date": "08/12/2017 16:49:42",
      "content": "<p>My initial thought is no, but we can have a discussion about going through the official channels to add supplemental data. Scraping data from Carvana's web services is definitely not authorized by Carvana.</p>\n\n<p>I'll defer to Kaggle staff on whether we should introduce additional images that are allowed to be hand labeled, as that does seem like it could be helpful.</p>",
      "votes": null,
      "replies": [
        {
          "id": 213263,
          "author_name": "nizhibitsky",
          "author_url": "",
          "post_date": "08/14/2017 09:12:43",
          "content": "<p>In that case the competition becomes not only about creating models but also about spending time or money for labeling that definitely will not \"bring value to the company\" as it is sured to be expected.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 213365,
          "author_name": "wcukierski",
          "author_url": "",
          "post_date": "08/14/2017 15:52:48",
          "content": "<p>To clarify Kaggle's position here:</p>\n\n<blockquote>\n  <p>Use of external data is permitted, provided the data is freely available. If you are using a source of external data, you must post the source to the official external data forum thread no later than one week prior to the entry deadline.</p>\n</blockquote>\n\n<p>We allow external data on image problems because of the popularity of pre-trained networks. It would not be a violation of competition rules to use an external source, but you would have to post it for everyone to use.</p>\n\n<p>In this specific case, given Brian's comments about scraping being against Carvana's terms of service, you should obviously not pursue the idea.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 214069,
      "author_name": "gadgysaidoff",
      "author_url": "",
      "post_date": "08/15/2017 22:04:06",
      "content": "<p>My friend, we have enough images for hand-labeling among those 100,064\nWhy are you searching for more images?\nI really don't understand you)</p>",
      "votes": null,
      "replies": [
        {
          "id": 214078,
          "author_name": "brianshaler",
          "author_url": "",
          "post_date": "08/15/2017 22:30:52",
          "content": "<p>I'm pretty sure hand labeling <em>any</em> of the images in the test set is against the rules. The test images can be used for unsupervised learning.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 214118,
          "author_name": "gadgysaidoff",
          "author_url": "",
          "post_date": "08/16/2017 02:13:43",
          "content": "<p>Using hand-labeled data within submission is against the rules.\nUsing hand-labeled data for training is also against the rules?\nIf yes, than OP's question makes sense.\nBTW, looking through CNN-marked images I noticed few errors raised from \"new\" types of exterior parts.\nI mean exterior parts not included in provided train set.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "212741": "It seems that i can download more images from Carvana website.\nFor example:\n\n ![enter image description here][1] \n ![enter image description here][2]\n\n If I download them and hand label them for training, is it against the rule?\n If it is ok, maybe we can get more train data if  kagglers can annotate and share data.\n\n\n  [1]: http://www.brightreviews.com/ckfinder/userfiles/images/carvana_2.jpg\n  [2]: https://cdnblob.carvana.io/2000029680/post-large/2000029680/edc/grid.jpg",
    "212778": "My initial thought is no, but we can have a discussion about going through the official channels to add supplemental data. Scraping data from Carvana's web services is definitely not authorized by Carvana.\n\nI'll defer to Kaggle staff on whether we should introduce additional images that are allowed to be hand labeled, as that does seem like it could be helpful.",
    "213263": "In that case the competition becomes not only about creating models but also about spending time or money for labeling that definitely will not \"bring value to the company\" as it is sured to be expected.",
    "213365": "To clarify Kaggle's position here:\n\n&gt; Use of external data is permitted, provided the data is freely available. If you are using a source of external data, you must post the source to the official external data forum thread no later than one week prior to the entry deadline.\n\nWe allow external data on image problems because of the popularity of pre-trained networks. It would not be a violation of competition rules to use an external source, but you would have to post it for everyone to use.\n\nIn this specific case, given Brian's comments about scraping being against Carvana's terms of service, you should obviously not pursue the idea.",
    "214069": "My friend, we have enough images for hand-labeling among those 100,064\nWhy are you searching for more images?\nI really don't understand you)",
    "214078": "I'm pretty sure hand labeling *any* of the images in the test set is against the rules. The test images can be used for unsupervised learning.",
    "214118": "Using hand-labeled data within submission is against the rules.\nUsing hand-labeled data for training is also against the rules?\nIf yes, than OP's question makes sense.\nBTW, looking through CNN-marked images I noticed few errors raised from \"new\" types of exterior parts.\nI mean exterior parts not included in provided train set."
  },
  "source": "meta"
}