{
  "id": 585689,
  "title": "How is everyone dealing with the size of the data?",
  "url": "/competitions/waveform-inversion/discussion/585689",
  "author_name": "",
  "post_date": "2025-06-22T11:43:28.181749300Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>I'm trying to optimize ram and hdd usage so neither of them run out and crash the notebook and my model uses the entire data for training. how are the rest of you dealing with it?</p>",
  "messages": [
    {
      "id": "3230003",
      "postDate": "06/22/2025 11:43:28",
      "content": "<p>I'm trying to optimize ram and hdd usage so neither of them run out and crash the notebook and my model uses the entire data for training. how are the rest of you dealing with it?</p>",
      "rawMarkdown": "I'm trying to optimize ram and hdd usage so neither of them run out and crash the notebook and my model uses the entire data for training. how are the rest of you dealing with it?",
      "votes": null
    },
    {
      "id": "3230200",
      "postDate": "06/22/2025 15:21:29",
      "content": "<p>Have a look at popular public notebooks. They have data loaders that use little RAM.</p>",
      "rawMarkdown": "Have a look at popular public notebooks. They have data loaders that use little RAM.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3230200,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "06/22/2025 15:21:29",
      "content": "<p>Have a look at popular public notebooks. They have data loaders that use little RAM.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3230003": "I'm trying to optimize ram and hdd usage so neither of them run out and crash the notebook and my model uses the entire data for training. how are the rest of you dealing with it?",
    "3230200": "Have a look at popular public notebooks. They have data loaders that use little RAM."
  },
  "source": "meta"
}