{
  "id": 249117,
  "title": "Issue with kaggle api? (SOLVED)",
  "url": "/competitions/google-smartphone-decimeter-challenge/discussion/249117",
  "author_name": "Kumar Shubham",
  "post_date": "2021-06-26T17:09:30.371000",
  "votes": 5,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I was trying to create kaggle dataset using kaggle api. I am getting 400 - Bad Request.</p>\n<pre><code>Data package template written to: /tmp/GSDC-Processed/dataset-metadata.json\n{'title': 'GSDC-Processed', 'id': 'ks2019/GSDC-Processed', 'licenses': [{'name': 'CC0-1.0'}]}\ndataset-metadata.json  meta.json  test.zip  train.zip\nStarting upload for file train.zip\n100%|████████████████████████████████████████| 166M/166M [00:12&lt;00:00, 14.5MB/s]\nUpload successful: train.zip (166MB)\nStarting upload for file test.zip\n100%|██████████████████████████████████████| 89.4M/89.4M [00:09&lt;00:00, 9.98MB/s]\nUpload successful: test.zip (89MB)\nStarting upload for file meta.json\n100%|█████████████████████████████████████████| 93.0/93.0 [00:05&lt;00:00, 15.9B/s]\nUpload successful: meta.json (93B)\n400 - Bad Request\nCPU times: user 673 ms, sys: 247 ms, total: 920 ms\nWall time: 34.7 s\n</code></pre>\n<p>Code I used to create dataset:</p>\n<pre><code>%%time\n\n### Create Kaggle Dataset if not exists \n\nDATASET_NAME = f\"GSDC-Processed\"\n!rm -r /tmp/{DATASET_NAME}\n\nos.makedirs(f'/tmp/{DATASET_NAME}', exist_ok=True)\n\nwith open('../input/kaggle-api-creds/kaggle.json') as f:\n    kaggle_creds = json.load(f)\n\nos.environ['KAGGLE_USERNAME'] = kaggle_creds['username']\nos.environ['KAGGLE_KEY'] = kaggle_creds['key']\n\n!kaggle datasets init -p /tmp/{DATASET_NAME}\n\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json') as f:\n    dataset_meta = json.load(f)\ndataset_meta['id'] = f'ks2019/{DATASET_NAME}'\ndataset_meta['title'] = DATASET_NAME\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json', \"w\") as outfile:\n    json.dump(dataset_meta, outfile)\nprint(dataset_meta)\n\n!cp /tmp/{DATASET_NAME}/dataset-metadata.json /tmp/{DATASET_NAME}/meta.json\n!cp -r train.zip /tmp/{DATASET_NAME}/\n!cp -r test.zip /tmp/{DATASET_NAME}/\n!ls /tmp/{DATASET_NAME}\n\n!kaggle datasets create -u -p /tmp/{DATASET_NAME} \n</code></pre>\n<p>I have been using similar code for many competitions. This was working 20-30 days back. <br>\nSimilar Issue was raised here: <a href=\"https://github.com/Kaggle/kaggle-api/issues/361\" target=\"_blank\">https://github.com/Kaggle/kaggle-api/issues/361</a></p>",
  "messages": [
    {
      "id": 1366337,
      "postDate": "2021-06-26T17:09:30.370Z",
      "content": "<p>I was trying to create kaggle dataset using kaggle api. I am getting 400 - Bad Request.</p>\n<pre><code>Data package template written to: /tmp/GSDC-Processed/dataset-metadata.json\n{'title': 'GSDC-Processed', 'id': 'ks2019/GSDC-Processed', 'licenses': [{'name': 'CC0-1.0'}]}\ndataset-metadata.json  meta.json  test.zip  train.zip\nStarting upload for file train.zip\n100%|████████████████████████████████████████| 166M/166M [00:12&lt;00:00, 14.5MB/s]\nUpload successful: train.zip (166MB)\nStarting upload for file test.zip\n100%|██████████████████████████████████████| 89.4M/89.4M [00:09&lt;00:00, 9.98MB/s]\nUpload successful: test.zip (89MB)\nStarting upload for file meta.json\n100%|█████████████████████████████████████████| 93.0/93.0 [00:05&lt;00:00, 15.9B/s]\nUpload successful: meta.json (93B)\n400 - Bad Request\nCPU times: user 673 ms, sys: 247 ms, total: 920 ms\nWall time: 34.7 s\n</code></pre>\n<p>Code I used to create dataset:</p>\n<pre><code>%%time\n\n### Create Kaggle Dataset if not exists \n\nDATASET_NAME = f\"GSDC-Processed\"\n!rm -r /tmp/{DATASET_NAME}\n\nos.makedirs(f'/tmp/{DATASET_NAME}', exist_ok=True)\n\nwith open('../input/kaggle-api-creds/kaggle.json') as f:\n    kaggle_creds = json.load(f)\n\nos.environ['KAGGLE_USERNAME'] = kaggle_creds['username']\nos.environ['KAGGLE_KEY'] = kaggle_creds['key']\n\n!kaggle datasets init -p /tmp/{DATASET_NAME}\n\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json') as f:\n    dataset_meta = json.load(f)\ndataset_meta['id'] = f'ks2019/{DATASET_NAME}'\ndataset_meta['title'] = DATASET_NAME\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json', \"w\") as outfile:\n    json.dump(dataset_meta, outfile)\nprint(dataset_meta)\n\n!cp /tmp/{DATASET_NAME}/dataset-metadata.json /tmp/{DATASET_NAME}/meta.json\n!cp -r train.zip /tmp/{DATASET_NAME}/\n!cp -r test.zip /tmp/{DATASET_NAME}/\n!ls /tmp/{DATASET_NAME}\n\n!kaggle datasets create -u -p /tmp/{DATASET_NAME} \n</code></pre>\n<p>I have been using similar code for many competitions. This was working 20-30 days back. <br>\nSimilar Issue was raised here: <a href=\"https://github.com/Kaggle/kaggle-api/issues/361\" target=\"_blank\">https://github.com/Kaggle/kaggle-api/issues/361</a></p>",
      "rawMarkdown": "I was trying to create kaggle dataset using kaggle api. I am getting 400 - Bad Request.\n```\nData package template written to: /tmp/GSDC-Processed/dataset-metadata.json\n{'title': 'GSDC-Processed', 'id': 'ks2019/GSDC-Processed', 'licenses': [{'name': 'CC0-1.0'}]}\ndataset-metadata.json  meta.json  test.zip  train.zip\nStarting upload for file train.zip\n100%|████████████████████████████████████████| 166M/166M [00:12<00:00, 14.5MB/s]\nUpload successful: train.zip (166MB)\nStarting upload for file test.zip\n100%|██████████████████████████████████████| 89.4M/89.4M [00:09<00:00, 9.98MB/s]\nUpload successful: test.zip (89MB)\nStarting upload for file meta.json\n100%|█████████████████████████████████████████| 93.0/93.0 [00:05<00:00, 15.9B/s]\nUpload successful: meta.json (93B)\n400 - Bad Request\nCPU times: user 673 ms, sys: 247 ms, total: 920 ms\nWall time: 34.7 s\n```\n\nCode I used to create dataset:\n```\n%%time\n\n### Create Kaggle Dataset if not exists \n\nDATASET_NAME = f\"GSDC-Processed\"\n!rm -r /tmp/{DATASET_NAME}\n\nos.makedirs(f'/tmp/{DATASET_NAME}', exist_ok=True)\n\nwith open('../input/kaggle-api-creds/kaggle.json') as f:\n    kaggle_creds = json.load(f)\n    \nos.environ['KAGGLE_USERNAME'] = kaggle_creds['username']\nos.environ['KAGGLE_KEY'] = kaggle_creds['key']\n\n!kaggle datasets init -p /tmp/{DATASET_NAME}\n\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json') as f:\n    dataset_meta = json.load(f)\ndataset_meta['id'] = f'ks2019/{DATASET_NAME}'\ndataset_meta['title'] = DATASET_NAME\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json', \"w\") as outfile:\n    json.dump(dataset_meta, outfile)\nprint(dataset_meta)\n\n!cp /tmp/{DATASET_NAME}/dataset-metadata.json /tmp/{DATASET_NAME}/meta.json\n!cp -r train.zip /tmp/{DATASET_NAME}/\n!cp -r test.zip /tmp/{DATASET_NAME}/\n!ls /tmp/{DATASET_NAME}\n\n!kaggle datasets create -u -p /tmp/{DATASET_NAME} \n```\nI have been using similar code for many competitions. This was working 20-30 days back. \nSimilar Issue was raised here: https://github.com/Kaggle/kaggle-api/issues/361",
      "votes": 5
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1366337": "I was trying to create kaggle dataset using kaggle api. I am getting 400 - Bad Request.\n```\nData package template written to: /tmp/GSDC-Processed/dataset-metadata.json\n{'title': 'GSDC-Processed', 'id': 'ks2019/GSDC-Processed', 'licenses': [{'name': 'CC0-1.0'}]}\ndataset-metadata.json  meta.json  test.zip  train.zip\nStarting upload for file train.zip\n100%|████████████████████████████████████████| 166M/166M [00:12<00:00, 14.5MB/s]\nUpload successful: train.zip (166MB)\nStarting upload for file test.zip\n100%|██████████████████████████████████████| 89.4M/89.4M [00:09<00:00, 9.98MB/s]\nUpload successful: test.zip (89MB)\nStarting upload for file meta.json\n100%|█████████████████████████████████████████| 93.0/93.0 [00:05<00:00, 15.9B/s]\nUpload successful: meta.json (93B)\n400 - Bad Request\nCPU times: user 673 ms, sys: 247 ms, total: 920 ms\nWall time: 34.7 s\n```\n\nCode I used to create dataset:\n```\n%%time\n\n### Create Kaggle Dataset if not exists \n\nDATASET_NAME = f\"GSDC-Processed\"\n!rm -r /tmp/{DATASET_NAME}\n\nos.makedirs(f'/tmp/{DATASET_NAME}', exist_ok=True)\n\nwith open('../input/kaggle-api-creds/kaggle.json') as f:\n    kaggle_creds = json.load(f)\n    \nos.environ['KAGGLE_USERNAME'] = kaggle_creds['username']\nos.environ['KAGGLE_KEY'] = kaggle_creds['key']\n\n!kaggle datasets init -p /tmp/{DATASET_NAME}\n\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json') as f:\n    dataset_meta = json.load(f)\ndataset_meta['id'] = f'ks2019/{DATASET_NAME}'\ndataset_meta['title'] = DATASET_NAME\nwith open(f'/tmp/{DATASET_NAME}/dataset-metadata.json', \"w\") as outfile:\n    json.dump(dataset_meta, outfile)\nprint(dataset_meta)\n\n!cp /tmp/{DATASET_NAME}/dataset-metadata.json /tmp/{DATASET_NAME}/meta.json\n!cp -r train.zip /tmp/{DATASET_NAME}/\n!cp -r test.zip /tmp/{DATASET_NAME}/\n!ls /tmp/{DATASET_NAME}\n\n!kaggle datasets create -u -p /tmp/{DATASET_NAME} \n```\nI have been using similar code for many competitions. This was working 20-30 days back. \nSimilar Issue was raised here: https://github.com/Kaggle/kaggle-api/issues/361"
  }
}