{
  "id": 121832,
  "title": "Ouch that data cap",
  "url": "/competitions/deepfake-detection-challenge/discussion/121832",
  "author_name": "",
  "post_date": "2019-12-15T21:47:38.955027900Z",
  "votes": 2,
  "comment_count": 11,
  "views": 0,
  "content": "<p>I doubt Xfinity is a fan of this competition, they sure noticed the download! The size of this dataset has been the biggest challenge for me so far.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2F4e5527eb136c78149c6dfa8656dd2441%2Fcap.png?generation=1576446338612026&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": "695928",
      "postDate": "12/15/2019 21:47:38",
      "content": "<p>I doubt Xfinity is a fan of this competition, they sure noticed the download! The size of this dataset has been the biggest challenge for me so far.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2F4e5527eb136c78149c6dfa8656dd2441%2Fcap.png?generation=1576446338612026&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "I doubt Xfinity is a fan of this competition, they sure noticed the download! The size of this dataset has been the biggest challenge for me so far.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2F4e5527eb136c78149c6dfa8656dd2441%2Fcap.png?generation=1576446338612026&amp;alt=media)",
      "votes": null
    },
    {
      "id": "695982",
      "postDate": "12/16/2019 00:49:31",
      "content": "<p>That really sucks. Data caps are the worst</p>",
      "rawMarkdown": "That really sucks. Data caps are the worst",
      "votes": null
    },
    {
      "id": "696067",
      "postDate": "12/16/2019 04:41:57",
      "content": "<p>Move to south korea, where you get unlimted 5G and unlimited gigabit internet for like 30$/mo.</p>",
      "rawMarkdown": "Move to south korea, where you get unlimted 5G and unlimited gigabit internet for like 30$/mo.",
      "votes": null
    },
    {
      "id": "696818",
      "postDate": "12/17/2019 05:25:54",
      "content": "<p>You can download and crop the data chunk by chunk. Just save the face images.</p>",
      "rawMarkdown": "You can download and crop the data chunk by chunk. Just save the face images.",
      "votes": null
    },
    {
      "id": "696876",
      "postDate": "12/17/2019 07:20:01",
      "content": "<p>Wait WHAT!? </p>",
      "rawMarkdown": "Wait WHAT!?",
      "votes": null
    },
    {
      "id": "696879",
      "postDate": "12/17/2019 07:21:16",
      "content": "<p>I paid ~400$ to have a fibre net cable connection being laid in my hometown (no one in the neighbourhood had fibre net so they had to put down new cables)! And I get 30MB/s after that 🤕 </p>",
      "rawMarkdown": "I paid ~400$ to have a fibre net cable connection being laid in my hometown (no one in the neighbourhood had fibre net so they had to put down new cables)! And I get 30MB/s after that 🤕",
      "votes": null
    },
    {
      "id": "699857",
      "postDate": "12/21/2019 03:14:49",
      "content": "<p>Whelp... that's why I pay the extra $50 a month for unlimited 😭 </p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3999290%2Fedca02b1067b5c1d42d5a5c7595a94ce%2F2019-12-20_19-13-23.png?generation=1576898072133329&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Whelp... that's why I pay the extra $50 a month for unlimited 😭 \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3999290%2Fedca02b1067b5c1d42d5a5c7595a94ce%2F2019-12-20_19-13-23.png?generation=1576898072133329&amp;alt=media)",
      "votes": null
    },
    {
      "id": "700595",
      "postDate": "12/22/2019 09:15:52",
      "content": "<p>I'd be all over that if they had it in my area. Next best thing is a business plan here, starting at $200 more than the baseline I pay. Living in a rural area I don't have much of an option. </p>\n\n<p>This month is the fastest I've hit the cap so far. Thanks to the holiday I won't be using it for work so it ends up about average. On the plus side I haven't had to run my office heater. The GPUs are working well enough for that.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2Fa98761b7f450901b1e14b7e60af48ad5%2Fusage.png?generation=1577006150350919&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "I'd be all over that if they had it in my area. Next best thing is a business plan here, starting at $200 more than the baseline I pay. Living in a rural area I don't have much of an option. \n\nThis month is the fastest I've hit the cap so far. Thanks to the holiday I won't be using it for work so it ends up about average. On the plus side I haven't had to run my office heater. The GPUs are working well enough for that.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2Fa98761b7f450901b1e14b7e60af48ad5%2Fusage.png?generation=1577006150350919&amp;alt=media)",
      "votes": null
    },
    {
      "id": "700599",
      "postDate": "12/22/2019 09:23:57",
      "content": "<p>Extracting those face images sure is taking a long time! Right now I'm extract faces to frames. A resulting structure of (100, 96, 96, 3) per video. I then serialize and compress the numpy array into a dict of bytes. A Keras generator runs off that dict, decompressing the bytes back into the float32 structure. About 3/4ths the way through the full dataset now, the compressed dict only takes 10GB memory.</p>",
      "rawMarkdown": "Extracting those face images sure is taking a long time! Right now I'm extract faces to frames. A resulting structure of (100, 96, 96, 3) per video. I then serialize and compress the numpy array into a dict of bytes. A Keras generator runs off that dict, decompressing the bytes back into the float32 structure. About 3/4ths the way through the full dataset now, the compressed dict only takes 10GB memory.",
      "votes": null
    },
    {
      "id": "701053",
      "postDate": "12/23/2019 02:56:50",
      "content": "<p>Dang! I didn't know they only offer the \"unlimited\" in certain markets. Now I'm definitely feeling your pain.</p>",
      "rawMarkdown": "Dang! I didn't know they only offer the \"unlimited\" in certain markets. Now I'm definitely feeling your pain.",
      "votes": null
    },
    {
      "id": "701245",
      "postDate": "12/23/2019 09:28:35",
      "content": "<p>I could even get faster service for more a month, but with these data fees it doesn't make sense. I can exceed the cap in a day easily. I'm at 275Mbps down and can get up to 400 here. Just in the last day it has added $10. They will add up to $200 total per month more but I'm not close to that yet. In the end I chose to live here to be out of the city and rural internet has never been a high priority.</p>",
      "rawMarkdown": "I could even get faster service for more a month, but with these data fees it doesn't make sense. I can exceed the cap in a day easily. I'm at 275Mbps down and can get up to 400 here. Just in the last day it has added $10. They will add up to $200 total per month more but I'm not close to that yet. In the end I chose to live here to be out of the city and rural internet has never been a high priority.",
      "votes": null
    },
    {
      "id": "701271",
      "postDate": "12/23/2019 09:56:01",
      "content": "<p>Wow, here in spain I have a fixed price, ± 50€/month 500Mbps without maximum data constraints </p>",
      "rawMarkdown": "Wow, here in spain I have a fixed price, ± 50€/month 500Mbps without maximum data constraints",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 695982,
      "author_name": "ryches",
      "author_url": "",
      "post_date": "12/16/2019 00:49:31",
      "content": "<p>That really sucks. Data caps are the worst</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 696067,
      "author_name": "xhlulu",
      "author_url": "",
      "post_date": "12/16/2019 04:41:57",
      "content": "<p>Move to south korea, where you get unlimted 5G and unlimited gigabit internet for like 30$/mo.</p>",
      "votes": null,
      "replies": [
        {
          "id": 696876,
          "author_name": "init27",
          "author_url": "",
          "post_date": "12/17/2019 07:20:01",
          "content": "<p>Wait WHAT!? </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 696879,
          "author_name": "init27",
          "author_url": "",
          "post_date": "12/17/2019 07:21:16",
          "content": "<p>I paid ~400$ to have a fibre net cable connection being laid in my hometown (no one in the neighbourhood had fibre net so they had to put down new cables)! And I get 30MB/s after that 🤕 </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 696818,
      "author_name": "unkownhihi",
      "author_url": "",
      "post_date": "12/17/2019 05:25:54",
      "content": "<p>You can download and crop the data chunk by chunk. Just save the face images.</p>",
      "votes": null,
      "replies": [
        {
          "id": 700599,
          "author_name": "ldm314",
          "author_url": "",
          "post_date": "12/22/2019 09:23:57",
          "content": "<p>Extracting those face images sure is taking a long time! Right now I'm extract faces to frames. A resulting structure of (100, 96, 96, 3) per video. I then serialize and compress the numpy array into a dict of bytes. A Keras generator runs off that dict, decompressing the bytes back into the float32 structure. About 3/4ths the way through the full dataset now, the compressed dict only takes 10GB memory.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 699857,
      "author_name": "gtgraham",
      "author_url": "",
      "post_date": "12/21/2019 03:14:49",
      "content": "<p>Whelp... that's why I pay the extra $50 a month for unlimited 😭 </p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3999290%2Fedca02b1067b5c1d42d5a5c7595a94ce%2F2019-12-20_19-13-23.png?generation=1576898072133329&amp;alt=media\" alt=\"\"></p>",
      "votes": null,
      "replies": [
        {
          "id": 700595,
          "author_name": "ldm314",
          "author_url": "",
          "post_date": "12/22/2019 09:15:52",
          "content": "<p>I'd be all over that if they had it in my area. Next best thing is a business plan here, starting at $200 more than the baseline I pay. Living in a rural area I don't have much of an option. </p>\n\n<p>This month is the fastest I've hit the cap so far. Thanks to the holiday I won't be using it for work so it ends up about average. On the plus side I haven't had to run my office heater. The GPUs are working well enough for that.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2Fa98761b7f450901b1e14b7e60af48ad5%2Fusage.png?generation=1577006150350919&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 701053,
          "author_name": "gtgraham",
          "author_url": "",
          "post_date": "12/23/2019 02:56:50",
          "content": "<p>Dang! I didn't know they only offer the \"unlimited\" in certain markets. Now I'm definitely feeling your pain.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 701245,
          "author_name": "ldm314",
          "author_url": "",
          "post_date": "12/23/2019 09:28:35",
          "content": "<p>I could even get faster service for more a month, but with these data fees it doesn't make sense. I can exceed the cap in a day easily. I'm at 275Mbps down and can get up to 400 here. Just in the last day it has added $10. They will add up to $200 total per month more but I'm not close to that yet. In the end I chose to live here to be out of the city and rural internet has never been a high priority.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 701271,
      "author_name": "cayala",
      "author_url": "",
      "post_date": "12/23/2019 09:56:01",
      "content": "<p>Wow, here in spain I have a fixed price, ± 50€/month 500Mbps without maximum data constraints </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "695928": "I doubt Xfinity is a fan of this competition, they sure noticed the download! The size of this dataset has been the biggest challenge for me so far.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2F4e5527eb136c78149c6dfa8656dd2441%2Fcap.png?generation=1576446338612026&amp;alt=media)",
    "695982": "That really sucks. Data caps are the worst",
    "696067": "Move to south korea, where you get unlimted 5G and unlimited gigabit internet for like 30$/mo.",
    "696818": "You can download and crop the data chunk by chunk. Just save the face images.",
    "696876": "Wait WHAT!?",
    "696879": "I paid ~400$ to have a fibre net cable connection being laid in my hometown (no one in the neighbourhood had fibre net so they had to put down new cables)! And I get 30MB/s after that 🤕",
    "699857": "Whelp... that's why I pay the extra $50 a month for unlimited 😭 \n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3999290%2Fedca02b1067b5c1d42d5a5c7595a94ce%2F2019-12-20_19-13-23.png?generation=1576898072133329&amp;alt=media)",
    "700595": "I'd be all over that if they had it in my area. Next best thing is a business plan here, starting at $200 more than the baseline I pay. Living in a rural area I don't have much of an option. \n\nThis month is the fastest I've hit the cap so far. Thanks to the holiday I won't be using it for work so it ends up about average. On the plus side I haven't had to run my office heater. The GPUs are working well enough for that.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2219085%2Fa98761b7f450901b1e14b7e60af48ad5%2Fusage.png?generation=1577006150350919&amp;alt=media)",
    "700599": "Extracting those face images sure is taking a long time! Right now I'm extract faces to frames. A resulting structure of (100, 96, 96, 3) per video. I then serialize and compress the numpy array into a dict of bytes. A Keras generator runs off that dict, decompressing the bytes back into the float32 structure. About 3/4ths the way through the full dataset now, the compressed dict only takes 10GB memory.",
    "701053": "Dang! I didn't know they only offer the \"unlimited\" in certain markets. Now I'm definitely feeling your pain.",
    "701245": "I could even get faster service for more a month, but with these data fees it doesn't make sense. I can exceed the cap in a day easily. I'm at 275Mbps down and can get up to 400 here. Just in the last day it has added $10. They will add up to $200 total per month more but I'm not close to that yet. In the end I chose to live here to be out of the city and rural internet has never been a high priority.",
    "701271": "Wow, here in spain I have a fixed price, ± 50€/month 500Mbps without maximum data constraints"
  },
  "source": "meta"
}