{
  "id": 377395,
  "title": "How to immpot .jsonl dataset?",
  "url": "/competitions/otto-recommender-system/discussion/377395",
  "author_name": "",
  "post_date": "2023-01-11T02:37:29.188403600Z",
  "votes": null,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hello <br>\nI can know about .json dataset, but I can't know about jsonal dataset. but the OTTO competition give me this type of data. how can I load it to my python code</p>",
  "messages": [
    {
      "id": "2094763",
      "postDate": "01/11/2023 02:37:29",
      "content": "<p>Hello <br>\nI can know about .json dataset, but I can't know about jsonal dataset. but the OTTO competition give me this type of data. how can I load it to my python code</p>",
      "rawMarkdown": "Hello \nI can know about .json dataset, but I can't know about jsonal dataset. but the OTTO competition give me this type of data. how can I load it to my python code",
      "votes": null
    },
    {
      "id": "2094802",
      "postDate": "01/11/2023 03:13:10",
      "content": "<p><code>df = pd.read_json(json_file, lines=True)</code></p>\n<p><a href=\"https://stackoverflow.com/a/20038973\" target=\"_blank\">https://stackoverflow.com/a/20038973</a></p>",
      "rawMarkdown": "`df = pd.read_json(json_file, lines=True)`\n\nhttps://stackoverflow.com/a/20038973",
      "votes": null
    },
    {
      "id": "2095561",
      "postDate": "01/11/2023 13:10:14",
      "content": "<p>Thank you sir</p>",
      "rawMarkdown": "Thank you sir",
      "votes": null
    },
    {
      "id": "2096679",
      "postDate": "01/12/2023 07:55:46",
      "content": "<p>welcome, enjoy your stay and be awesome!</p>",
      "rawMarkdown": "welcome, enjoy your stay and be awesome!",
      "votes": null
    },
    {
      "id": "2098072",
      "postDate": "01/13/2023 07:37:53",
      "content": "<p>Dear BwandoWando, how are you I am facing some problems. whenever I'm going to run </p>\n<p>pd.read_json('train.jsonl', lines=True)</p>\n<p>code to read train data my cloud computer crash. . kaggle notebook as well as google colab  </p>\n<p>what is your suggation to fixed this. </p>\n<p>if i can upgrade my colab to pro can it solve the problem? </p>",
      "rawMarkdown": "Dear BwandoWando, how are you I am facing some problems. whenever I'm going to run \n\npd.read_json('train.jsonl', lines=True)\n\ncode to read train data my cloud computer crash. . kaggle notebook as well as google colab  \n\nwhat is your suggation to fixed this. \n\nif i can upgrade my colab to pro can it solve the problem?",
      "votes": null
    },
    {
      "id": "2098181",
      "postDate": "01/13/2023 09:47:55",
      "content": "<p>Your computer runs out of ram, try to read and process in chunks: pd.read_json(…. ,chunksize=  ,)</p>",
      "rawMarkdown": "Your computer runs out of ram, try to read and process in chunks: pd.read_json(.... ,chunksize=  ,)",
      "votes": null
    },
    {
      "id": "2098298",
      "postDate": "01/13/2023 12:11:09",
      "content": "<p>i use the bellow code: </p>\n<p>df = pd.read_json('/kaggle/input/otto-recommender-system/train.jsonl', lines=True, chunksize=1)<br>\ndf.read()</p>\n<p>am I right?</p>",
      "rawMarkdown": "i use the bellow code: \n\ndf = pd.read_json('/kaggle/input/otto-recommender-system/train.jsonl', lines=True, chunksize=1)\ndf.read()\n\nam I right?",
      "votes": null
    },
    {
      "id": "2098388",
      "postDate": "01/13/2023 13:47:51",
      "content": "<p>check the pandas API docs, you will find all the info you need regarding pandas usage.<br>\n<a href=\"https://pandas.pydata.org/docs/reference/index.html\" target=\"_blank\">https://pandas.pydata.org/docs/reference/index.html</a></p>",
      "rawMarkdown": "check the pandas API docs, you will find all the info you need regarding pandas usage.\nhttps://pandas.pydata.org/docs/reference/index.html",
      "votes": null
    },
    {
      "id": "2098579",
      "postDate": "01/13/2023 17:08:23",
      "content": "<p>thank you very much </p>",
      "rawMarkdown": "thank you very much",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2094802,
      "author_name": "bwandowando",
      "author_url": "",
      "post_date": "01/11/2023 03:13:10",
      "content": "<p><code>df = pd.read_json(json_file, lines=True)</code></p>\n<p><a href=\"https://stackoverflow.com/a/20038973\" target=\"_blank\">https://stackoverflow.com/a/20038973</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2095561,
          "author_name": "chinmoyondal",
          "author_url": "",
          "post_date": "01/11/2023 13:10:14",
          "content": "<p>Thank you sir</p>",
          "votes": null,
          "replies": [
            {
              "id": 2096679,
              "author_name": "bwandowando",
              "author_url": "",
              "post_date": "01/12/2023 07:55:46",
              "content": "<p>welcome, enjoy your stay and be awesome!</p>",
              "votes": null,
              "replies": []
            }
          ]
        },
        {
          "id": 2098072,
          "author_name": "chinmoyondal",
          "author_url": "",
          "post_date": "01/13/2023 07:37:53",
          "content": "<p>Dear BwandoWando, how are you I am facing some problems. whenever I'm going to run </p>\n<p>pd.read_json('train.jsonl', lines=True)</p>\n<p>code to read train data my cloud computer crash. . kaggle notebook as well as google colab  </p>\n<p>what is your suggation to fixed this. </p>\n<p>if i can upgrade my colab to pro can it solve the problem? </p>",
          "votes": null,
          "replies": [
            {
              "id": 2098181,
              "author_name": "buumoo",
              "author_url": "",
              "post_date": "01/13/2023 09:47:55",
              "content": "<p>Your computer runs out of ram, try to read and process in chunks: pd.read_json(…. ,chunksize=  ,)</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2098298,
                  "author_name": "chinmoyondal",
                  "author_url": "",
                  "post_date": "01/13/2023 12:11:09",
                  "content": "<p>i use the bellow code: </p>\n<p>df = pd.read_json('/kaggle/input/otto-recommender-system/train.jsonl', lines=True, chunksize=1)<br>\ndf.read()</p>\n<p>am I right?</p>",
                  "votes": null,
                  "replies": [
                    {
                      "id": 2098388,
                      "author_name": "buumoo",
                      "author_url": "",
                      "post_date": "01/13/2023 13:47:51",
                      "content": "<p>check the pandas API docs, you will find all the info you need regarding pandas usage.<br>\n<a href=\"https://pandas.pydata.org/docs/reference/index.html\" target=\"_blank\">https://pandas.pydata.org/docs/reference/index.html</a></p>",
                      "votes": null,
                      "replies": [
                        {
                          "id": 2098579,
                          "author_name": "chinmoyondal",
                          "author_url": "",
                          "post_date": "01/13/2023 17:08:23",
                          "content": "<p>thank you very much </p>",
                          "votes": null,
                          "replies": []
                        }
                      ]
                    }
                  ]
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2094763": "Hello \nI can know about .json dataset, but I can't know about jsonal dataset. but the OTTO competition give me this type of data. how can I load it to my python code",
    "2094802": "`df = pd.read_json(json_file, lines=True)`\n\nhttps://stackoverflow.com/a/20038973",
    "2095561": "Thank you sir",
    "2096679": "welcome, enjoy your stay and be awesome!",
    "2098072": "Dear BwandoWando, how are you I am facing some problems. whenever I'm going to run \n\npd.read_json('train.jsonl', lines=True)\n\ncode to read train data my cloud computer crash. . kaggle notebook as well as google colab  \n\nwhat is your suggation to fixed this. \n\nif i can upgrade my colab to pro can it solve the problem?",
    "2098181": "Your computer runs out of ram, try to read and process in chunks: pd.read_json(.... ,chunksize=  ,)",
    "2098298": "i use the bellow code: \n\ndf = pd.read_json('/kaggle/input/otto-recommender-system/train.jsonl', lines=True, chunksize=1)\ndf.read()\n\nam I right?",
    "2098388": "check the pandas API docs, you will find all the info you need regarding pandas usage.\nhttps://pandas.pydata.org/docs/reference/index.html",
    "2098579": "thank you very much"
  },
  "source": "meta"
}