I notice that in the DFDC preview dataset, there is an annotation file called \"dataset.json\" indicating whether each video is fake or not.\nBut I can't find the corresponding json file in the full dataset.\nDoes anyone know where it locates?\nThx in advance!
", "messages": [ { "id": "693349", "postDate": "12/12/2019 09:26:06", "content": "I notice that in the DFDC preview dataset, there is an annotation file called \"dataset.json\" indicating whether each video is fake or not.\nBut I can't find the corresponding json file in the full dataset.\nDoes anyone know where it locates?\nThx in advance!
", "rawMarkdown": "I notice that in the [DFDC preview dataset](https://arxiv.org/abs/1910.08854v2), there is an annotation file called \"dataset.json\" indicating whether each video is fake or not.\nBut I can't find the corresponding json file in the full dataset.\nDoes anyone know where it locates?\nThx in advance!", "votes": null }, { "id": "693820", "postDate": "12/12/2019 20:26:55", "content": "Hey,\nThe json file is hidden in the train_sample_videos folder with the name metadata.json. If you list all the files in that folder you'll find there are total of 401 files out of which 400 are video files and 1 is the json file.\nYou can refer to this kernel for more insights about the given data: https://www.kaggle.com/techytushar/frame-size-and-video-length-eda
Thank you for your great work. Nice analysis of the data!\nBTW, do you ever notice the annotation of the full dataset(size of 471G)?\nThx in advance.
", "rawMarkdown": "Thank you for your great work. Nice analysis of the data!\nBTW, do you ever notice the annotation of the full dataset(size of 471G)?\nThx in advance.", "votes": null }, { "id": "694309", "postDate": "12/13/2019 12:19:39", "content": "Each of the dfdc_train_part_xxx folders has a metadata.json file in it.
Thx! That helps a lot!
", "rawMarkdown": "Thx! That helps a lot!", "votes": null }, { "id": "700924", "postDate": "12/22/2019 20:29:58", "content": "We are also having this issue, but we cannot locate the file. Would anyone mind sharing their metadata.json files? Or, does anyone have an idea for why our files are corrupted at download? All three partners have tried on their respective computers. We've tried downloading individual folders directly to our downloads folder as well as the entire data set to a hard drive.
", "rawMarkdown": "We are also having this issue, but we cannot locate the file. Would anyone mind sharing their metadata.json files? Or, does anyone have an idea for why our files are corrupted at download? All three partners have tried on their respective computers. We've tried downloading individual folders directly to our downloads folder as well as the entire data set to a hard drive.", "votes": null }, { "id": "700926", "postDate": "12/22/2019 20:39:19", "content": "Do your data files unzip without errors?
", "rawMarkdown": "Do your data files unzip without errors?", "votes": null }, { "id": "700935", "postDate": "12/22/2019 20:54:41", "content": "The data files do not unzip for me, but they successfully unzip for my partner.
", "rawMarkdown": "The data files do not unzip for me, but they successfully unzip for my partner.", "votes": null }, { "id": "701039", "postDate": "12/23/2019 02:38:27", "content": "Do you download the full 470G dataset or the seperated 50 datasets?\nYou mean when you unzip the dataset, you cannot locate the metadata.json?
", "rawMarkdown": "Do you download the full 470G dataset or the seperated 50 datasets?\nYou mean when you unzip the dataset, you cannot locate the metadata.json?", "votes": null }, { "id": "715840", "postDate": "01/10/2020 21:58:05", "content": "Yes, that is correct. when we unzip the dataset, we cannot locate the metadata.json file
", "rawMarkdown": "Yes, that is correct. when we unzip the dataset, we cannot locate the metadata.json file", "votes": null }, { "id": "715841", "postDate": "01/10/2020 21:58:37", "content": "Therefore, is there anyway someone could please share the metadata.json files through this forum?
", "rawMarkdown": "Therefore, is there anyway someone could please share the metadata.json files through this forum?", "votes": null } ], "comments": [ { "id": 693820, "author_name": "techytushar", "author_url": "", "post_date": "12/12/2019 20:26:55", "content": "Hey,\nThe json file is hidden in the train_sample_videos folder with the name metadata.json. If you list all the files in that folder you'll find there are total of 401 files out of which 400 are video files and 1 is the json file.\nYou can refer to this kernel for more insights about the given data: https://www.kaggle.com/techytushar/frame-size-and-video-length-eda
Thank you for your great work. Nice analysis of the data!\nBTW, do you ever notice the annotation of the full dataset(size of 471G)?\nThx in advance.
", "votes": null, "replies": [] } ] }, { "id": 694309, "author_name": "humananalog", "author_url": "", "post_date": "12/13/2019 12:19:39", "content": "Each of the dfdc_train_part_xxx folders has a metadata.json file in it.
Thx! That helps a lot!
", "votes": null, "replies": [] } ] }, { "id": 700924, "author_name": "ayushisinha", "author_url": "", "post_date": "12/22/2019 20:29:58", "content": "We are also having this issue, but we cannot locate the file. Would anyone mind sharing their metadata.json files? Or, does anyone have an idea for why our files are corrupted at download? All three partners have tried on their respective computers. We've tried downloading individual folders directly to our downloads folder as well as the entire data set to a hard drive.
", "votes": null, "replies": [ { "id": 700926, "author_name": "humananalog", "author_url": "", "post_date": "12/22/2019 20:39:19", "content": "Do your data files unzip without errors?
", "votes": null, "replies": [] }, { "id": 700935, "author_name": "ayushisinha", "author_url": "", "post_date": "12/22/2019 20:54:41", "content": "The data files do not unzip for me, but they successfully unzip for my partner.
", "votes": null, "replies": [] }, { "id": 701039, "author_name": "daddyjin", "author_url": "", "post_date": "12/23/2019 02:38:27", "content": "Do you download the full 470G dataset or the seperated 50 datasets?\nYou mean when you unzip the dataset, you cannot locate the metadata.json?
", "votes": null, "replies": [] }, { "id": 715840, "author_name": "ayushisinha", "author_url": "", "post_date": "01/10/2020 21:58:05", "content": "Yes, that is correct. when we unzip the dataset, we cannot locate the metadata.json file
", "votes": null, "replies": [] }, { "id": 715841, "author_name": "ayushisinha", "author_url": "", "post_date": "01/10/2020 21:58:37", "content": "Therefore, is there anyway someone could please share the metadata.json files through this forum?
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "693349": "I notice that in the [DFDC preview dataset](https://arxiv.org/abs/1910.08854v2), there is an annotation file called \"dataset.json\" indicating whether each video is fake or not.\nBut I can't find the corresponding json file in the full dataset.\nDoes anyone know where it locates?\nThx in advance!", "693820": "Hey,\nThe `json` file is hidden in the `train_sample_videos` folder with the name `metadata.json`. If you list all the files in that folder you'll find there are total of 401 files out of which 400 are video files and 1 is the json file.\nYou can refer to this kernel for more insights about the given data: [https://www.kaggle.com/techytushar/frame-size-and-video-length-eda](https://www.kaggle.com/techytushar/frame-size-and-video-length-eda)", "693946": "Thank you for your great work. Nice analysis of the data!\nBTW, do you ever notice the annotation of the full dataset(size of 471G)?\nThx in advance.", "694309": "Each of the `dfdc_train_part_xxx` folders has a `metadata.json` file in it.", "694320": "Thx! That helps a lot!", "700924": "We are also having this issue, but we cannot locate the file. Would anyone mind sharing their metadata.json files? Or, does anyone have an idea for why our files are corrupted at download? All three partners have tried on their respective computers. We've tried downloading individual folders directly to our downloads folder as well as the entire data set to a hard drive.", "700926": "Do your data files unzip without errors?", "700935": "The data files do not unzip for me, but they successfully unzip for my partner.", "701039": "Do you download the full 470G dataset or the seperated 50 datasets?\nYou mean when you unzip the dataset, you cannot locate the metadata.json?", "715840": "Yes, that is correct. when we unzip the dataset, we cannot locate the metadata.json file", "715841": "Therefore, is there anyway someone could please share the metadata.json files through this forum?" }, "source": "meta" }