{
  "id": 39463,
  "title": "Welcome!",
  "url": "/competitions/cdiscount-image-classification-challenge/discussion/39463",
  "author_name": "inversion",
  "post_date": "2017-09-14T17:21:43.745000",
  "votes": 12,
  "comment_count": 22,
  "views": 0,
  "content": "<p>Welcome to Cdiscount's Image Classification Challenge! Both CDiscount and Kaggle are excited for to host this competition, which provides a challenging data set of over 15 million images representing 9 million products in over 5,000 categories.</p>\n\n<p>This challenge provides the opportunity to work with the BSON file format. Please check out the <a href=\"https://www.kaggle.com/inversion/processing-bson-files\">example kernel,</a> which demonstrates how to read and process the file iteratively. You may also consider getting started on the train_example.bson file, which includes the first 100 records in the training file.</p>\n\n<p>Please feel free to ask your questions in this thread.</p>\n\n<p>Good luck!</p>",
  "messages": [
    {
      "id": 221285,
      "postDate": "2017-09-14T17:21:43.747Z",
      "content": "<p>Welcome to Cdiscount's Image Classification Challenge! Both CDiscount and Kaggle are excited for to host this competition, which provides a challenging data set of over 15 million images representing 9 million products in over 5,000 categories.</p>\n\n<p>This challenge provides the opportunity to work with the BSON file format. Please check out the <a href=\"https://www.kaggle.com/inversion/processing-bson-files\">example kernel,</a> which demonstrates how to read and process the file iteratively. You may also consider getting started on the train_example.bson file, which includes the first 100 records in the training file.</p>\n\n<p>Please feel free to ask your questions in this thread.</p>\n\n<p>Good luck!</p>",
      "rawMarkdown": "Welcome to Cdiscount's Image Classification Challenge! Both CDiscount and Kaggle are excited for to host this competition, which provides a challenging data set of over 15 million images representing 9 million products in over 5,000 categories.\n\nThis challenge provides the opportunity to work with the BSON file format. Please check out the [example kernel,][1] which demonstrates how to read and process the file iteratively. You may also consider getting started on the train_example.bson file, which includes the first 100 records in the training file.\n\nPlease feel free to ask your questions in this thread.\n\nGood luck!\n\n\n  [1]: https://www.kaggle.com/inversion/processing-bson-files",
      "votes": 11
    },
    {
      "id": 225224,
      "postDate": "2017-09-28T14:52:41.500Z",
      "content": "<p>Hi @inversion! Can you say a few words about your similarity benchmark? It's impressive!</p>",
      "rawMarkdown": "Hi @inversion! Can you say a few words about your similarity benchmark? It's impressive!",
      "votes": 1,
      "replies": [
        {
          "id": 225384,
          "postDate": "2017-09-28T21:38:41.727Z",
          "content": "<p>Thanks!! It's mainly brute force. I used a <a href=\"https://en.wikipedia.org/wiki/Perceptual_hashing\">perceptual hashing</a> algorithm to generate a signature for each image, and then predicted categories based on signature distances. It didn't require a GPU, but took ~10 hours on a 64-core CPU.</p>",
          "rawMarkdown": "Thanks!! It's mainly brute force. I used a [perceptual hashing][1] algorithm to generate a signature for each image, and then predicted categories based on signature distances. It didn't require a GPU, but took ~10 hours on a 64-core CPU.\n\n  [1]: https://en.wikipedia.org/wiki/Perceptual_hashing",
          "votes": 6
        },
        {
          "id": 225425,
          "postDate": "2017-09-29T02:40:31.353Z",
          "content": "<p>Thanks!</p>",
          "rawMarkdown": "Thanks!"
        }
      ]
    },
    {
      "id": 242689,
      "postDate": "2017-11-12T11:40:25.667Z",
      "content": "<p>I do not have 60GB+ of space to use in my pc. I do have GPUs and RAM to use though, any ideas on how to get access to the data?</p>",
      "rawMarkdown": "I do not have 60GB+ of space to use in my pc. I do have GPUs and RAM to use though, any ideas on how to get access to the data?"
    },
    {
      "id": 240232,
      "postDate": "2017-11-06T01:47:20.507Z",
      "content": "<p>Hi, how can I access the data from Google Cloud? </p>",
      "rawMarkdown": "Hi, how can I access the data from Google Cloud? ",
      "replies": [
        {
          "id": 243807,
          "postDate": "2017-11-14T23:12:48.853Z",
          "content": "<p>Hi Bella - Sorry for the slow response. I was traveling last week. We don't have the data loaded in Google, other than in the Kernels environment. So, you can either access it through kernels, or create your own google cloud environment and transfer the data over.</p>",
          "rawMarkdown": "Hi Bella - Sorry for the slow response. I was traveling last week. We don't have the data loaded in Google, other than in the Kernels environment. So, you can either access it through kernels, or create your own google cloud environment and transfer the data over."
        }
      ]
    },
    {
      "id": 226883,
      "postDate": "2017-10-03T08:51:12.130Z",
      "content": "<p>Hi,\nI am looking for the hash of the files. </p>",
      "rawMarkdown": "Hi,\nI am looking for the hash of the files. ",
      "replies": [
        {
          "id": 226884,
          "postDate": "2017-10-03T08:54:07.737Z",
          "content": "<p>I found the answer here: <a href=\"https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40052\">https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40052</a></p>",
          "rawMarkdown": "I found the answer here: https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40052"
        }
      ]
    },
    {
      "id": 223238,
      "postDate": "2017-09-21T14:51:32.693Z",
      "content": "<p>Could I get started with only one single NVIDIA 1080TI GPU？</p>",
      "rawMarkdown": "Could I get started with only one single NVIDIA 1080TI GPU？",
      "replies": [
        {
          "id": 223362,
          "postDate": "2017-09-22T03:01:13.420Z",
          "content": "<p>Did you get started? I also only have one single 1080TI gpu.</p>",
          "rawMarkdown": "Did you get started? I also only have one single 1080TI gpu."
        }
      ]
    },
    {
      "id": 222713,
      "postDate": "2017-09-19T18:50:36.643Z",
      "content": "<p>Hi! The number of training examples (images) per class (category) varies a lot in the training set, from over 80000 in the classes with most training examples to just 12 in the class with the least. Can we assume that the testing set has a similar distribution or can a class with just a few images in the training set have thousands of images in the test set?</p>",
      "rawMarkdown": "Hi! The number of training examples (images) per class (category) varies a lot in the training set, from over 80000 in the classes with most training examples to just 12 in the class with the least. Can we assume that the testing set has a similar distribution or can a class with just a few images in the training set have thousands of images in the test set?",
      "replies": [
        {
          "id": 222731,
          "postDate": "2017-09-19T20:00:18.427Z",
          "content": "<p>Then only information we provide on this is that the the category_ids that are present in Private Test split are also all present in the Public Test split. No other assumptions have been provided.</p>",
          "rawMarkdown": "Then only information we provide on this is that the the category_ids that are present in Private Test split are also all present in the Public Test split. No other assumptions have been provided."
        }
      ]
    },
    {
      "id": 222243,
      "postDate": "2017-09-18T06:39:23.693Z",
      "content": "<p>Welcome to kaggle.</p>",
      "rawMarkdown": "Welcome to kaggle."
    },
    {
      "id": 221415,
      "postDate": "2017-09-15T07:19:19.143Z",
      "rawMarkdown": "",
      "isDeleted": true,
      "replies": [
        {
          "id": 221524,
          "postDate": "2017-09-15T15:17:56Z",
          "content": "<p>Once you save a submission file from the kernel, you'll see the option to submit to the leader board.</p>\n\n<p><img src=\"https://i.imgur.com/OUCbJCF.png\" alt=\"enter image description here\" title=\"\"></p>",
          "rawMarkdown": "Once you save a submission file from the kernel, you'll see the option to submit to the leader board.\n\n![enter image description here][1]\n\n\n  [1]: https://i.imgur.com/OUCbJCF.png"
        },
        {
          "id": 221530,
          "postDate": "2017-09-15T15:24:05Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 221531,
          "postDate": "2017-09-15T15:25:51.337Z",
          "content": "<p>Please let me know if you run into any issues and I'll get that information to our engineering team. Thx!</p>",
          "rawMarkdown": "Please let me know if you run into any issues and I'll get that information to our engineering team. Thx!"
        },
        {
          "id": 221542,
          "postDate": "2017-09-15T15:47:05.900Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 221552,
          "postDate": "2017-09-15T16:05:26.653Z",
          "content": "<p>I need to verify if the functionality works with zipped files in kernels. In the mean time, can you try unzipped csv? Thx!</p>",
          "rawMarkdown": "I need to verify if the functionality works with zipped files in kernels. In the mean time, can you try unzipped csv? Thx!"
        },
        {
          "id": 221556,
          "postDate": "2017-09-15T16:21:54.013Z",
          "rawMarkdown": "",
          "votes": 1,
          "isDeleted": true
        },
        {
          "id": 222003,
          "postDate": "2017-09-17T07:32:44.253Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 222082,
          "postDate": "2017-09-17T12:32:49.337Z",
          "content": "<p>Thanks. We're looking into this.</p>",
          "rawMarkdown": "Thanks. We're looking into this."
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 225224,
      "author_name": "Aloisio Dourado",
      "author_url": "",
      "post_date": "2017-09-28T14:52:41.500000",
      "content": "<p>Hi @inversion! Can you say a few words about your similarity benchmark? It's impressive!</p>",
      "votes": 1,
      "replies": [
        {
          "id": 225384,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-09-28T21:38:41.727000",
          "content": "<p>Thanks!! It's mainly brute force. I used a <a href=\"https://en.wikipedia.org/wiki/Perceptual_hashing\">perceptual hashing</a> algorithm to generate a signature for each image, and then predicted categories based on signature distances. It didn't require a GPU, but took ~10 hours on a 64-core CPU.</p>",
          "votes": 6,
          "replies": []
        },
        {
          "id": 225425,
          "author_name": "Aloisio Dourado",
          "author_url": "",
          "post_date": "2017-09-29T02:40:31.353000",
          "content": "<p>Thanks!</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 242689,
      "author_name": "Skinish",
      "author_url": "",
      "post_date": "2017-11-12T11:40:25.667000",
      "content": "<p>I do not have 60GB+ of space to use in my pc. I do have GPUs and RAM to use though, any ideas on how to get access to the data?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 240232,
      "author_name": "Bella Wang",
      "author_url": "",
      "post_date": "2017-11-06T01:47:20.507000",
      "content": "<p>Hi, how can I access the data from Google Cloud? </p>",
      "votes": 0,
      "replies": [
        {
          "id": 243807,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-11-14T23:12:48.853000",
          "content": "<p>Hi Bella - Sorry for the slow response. I was traveling last week. We don't have the data loaded in Google, other than in the Kernels environment. So, you can either access it through kernels, or create your own google cloud environment and transfer the data over.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 226883,
      "author_name": "Beri",
      "author_url": "",
      "post_date": "2017-10-03T08:51:12.130000",
      "content": "<p>Hi,\nI am looking for the hash of the files. </p>",
      "votes": 0,
      "replies": [
        {
          "id": 226884,
          "author_name": "Beri",
          "author_url": "",
          "post_date": "2017-10-03T08:54:07.737000",
          "content": "<p>I found the answer here: <a href=\"https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40052\">https://www.kaggle.com/c/cdiscount-image-classification-challenge/discussion/40052</a></p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 223238,
      "author_name": "Currylee",
      "author_url": "",
      "post_date": "2017-09-21T14:51:32.693000",
      "content": "<p>Could I get started with only one single NVIDIA 1080TI GPU？</p>",
      "votes": 0,
      "replies": [
        {
          "id": 223362,
          "author_name": "Will",
          "author_url": "",
          "post_date": "2017-09-22T03:01:13.420000",
          "content": "<p>Did you get started? I also only have one single 1080TI gpu.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 222713,
      "author_name": "Per Isacson",
      "author_url": "",
      "post_date": "2017-09-19T18:50:36.643000",
      "content": "<p>Hi! The number of training examples (images) per class (category) varies a lot in the training set, from over 80000 in the classes with most training examples to just 12 in the class with the least. Can we assume that the testing set has a similar distribution or can a class with just a few images in the training set have thousands of images in the test set?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 222731,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-09-19T20:00:18.427000",
          "content": "<p>Then only information we provide on this is that the the category_ids that are present in Private Test split are also all present in the Public Test split. No other assumptions have been provided.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 222243,
      "author_name": "Luiz Gustavo Mori",
      "author_url": "",
      "post_date": "2017-09-18T06:39:23.693000",
      "content": "<p>Welcome to kaggle.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 221415,
      "author_name": "",
      "author_url": "",
      "post_date": "2017-09-15T07:19:19.143000",
      "content": "",
      "votes": 0,
      "replies": [
        {
          "id": 221524,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-09-15T15:17:56",
          "content": "<p>Once you save a submission file from the kernel, you'll see the option to submit to the leader board.</p>\n\n<p><img src=\"https://i.imgur.com/OUCbJCF.png\" alt=\"enter image description here\" title=\"\"></p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 221530,
          "author_name": "",
          "author_url": "",
          "post_date": "2017-09-15T15:24:05",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 221531,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-09-15T15:25:51.337000",
          "content": "<p>Please let me know if you run into any issues and I'll get that information to our engineering team. Thx!</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 221542,
          "author_name": "",
          "author_url": "",
          "post_date": "2017-09-15T15:47:05.900000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 221552,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-09-15T16:05:26.653000",
          "content": "<p>I need to verify if the functionality works with zipped files in kernels. In the mean time, can you try unzipped csv? Thx!</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 221556,
          "author_name": "",
          "author_url": "",
          "post_date": "2017-09-15T16:21:54.013000",
          "content": "",
          "votes": 1,
          "replies": []
        },
        {
          "id": 222003,
          "author_name": "",
          "author_url": "",
          "post_date": "2017-09-17T07:32:44.253000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 222082,
          "author_name": "inversion",
          "author_url": "",
          "post_date": "2017-09-17T12:32:49.337000",
          "content": "<p>Thanks. We're looking into this.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "221285": "Welcome to Cdiscount's Image Classification Challenge! Both CDiscount and Kaggle are excited for to host this competition, which provides a challenging data set of over 15 million images representing 9 million products in over 5,000 categories.\n\nThis challenge provides the opportunity to work with the BSON file format. Please check out the [example kernel,][1] which demonstrates how to read and process the file iteratively. You may also consider getting started on the train_example.bson file, which includes the first 100 records in the training file.\n\nPlease feel free to ask your questions in this thread.\n\nGood luck!\n\n\n  [1]: https://www.kaggle.com/inversion/processing-bson-files",
    "225224": "Hi @inversion! Can you say a few words about your similarity benchmark? It's impressive!",
    "242689": "I do not have 60GB+ of space to use in my pc. I do have GPUs and RAM to use though, any ideas on how to get access to the data?",
    "240232": "Hi, how can I access the data from Google Cloud? ",
    "226883": "Hi,\nI am looking for the hash of the files. ",
    "223238": "Could I get started with only one single NVIDIA 1080TI GPU？",
    "222713": "Hi! The number of training examples (images) per class (category) varies a lot in the training set, from over 80000 in the classes with most training examples to just 12 in the class with the least. Can we assume that the testing set has a similar distribution or can a class with just a few images in the training set have thousands of images in the test set?",
    "222243": "Welcome to kaggle.",
    "221415": ""
  }
}