{
  "id": 560413,
  "title": "Notebook Out of Disk ",
  "url": "/competitions/czii-cryo-et-object-identification/discussion/560413",
  "author_name": "",
  "post_date": "2025-01-31T06:40:27.764190Z",
  "votes": 2,
  "comment_count": 6,
  "views": 0,
  "content": "<p>\"Your notebook has used or requested more disk storage than available.\"  I always fail to submit at around 30 minutes, what should I do?🥲 My notes would only take 8 minutes to save.</p>",
  "messages": [
    {
      "id": "3111434",
      "postDate": "01/31/2025 06:40:27",
      "content": "<p>\"Your notebook has used or requested more disk storage than available.\"  I always fail to submit at around 30 minutes, what should I do?🥲 My notes would only take 8 minutes to save.</p>",
      "rawMarkdown": "\"Your notebook has used or requested more disk storage than available.\"  I always fail to submit at around 30 minutes, what should I do?🥲 My notes would only take 8 minutes to save.",
      "votes": null
    },
    {
      "id": "3111437",
      "postDate": "01/31/2025 06:47:31",
      "content": "<p>I believe the notebooks have a limit of 20GB.  Is your code doing something that would write out that much data?  The submission.csv file should be nowhere near that large.</p>",
      "rawMarkdown": "I believe the notebooks have a limit of 20GB.  Is your code doing something that would write out that much data?  The submission.csv file should be nowhere near that large.",
      "votes": null
    },
    {
      "id": "3111480",
      "postDate": "01/31/2025 07:47:27",
      "content": "<p>The resulting csv file is just 30KB.However, some files are generated in the middle of the code, but these are deleted at the end.</p>",
      "rawMarkdown": "The resulting csv file is just 30KB.However, some files are generated in the middle of the code, but these are deleted at the end.",
      "votes": null
    },
    {
      "id": "3111488",
      "postDate": "01/31/2025 08:01:20",
      "content": "<p>At the end, or after processing each file.  When you submit to the competition it processes 500 tomograms to generate your score.  If you're generating ~1GB of files for each tomogram and taking ~1 minute for each, that should cause you to fail after ~30 min if you're not deleting the files after processing each one.</p>",
      "rawMarkdown": "At the end, or after processing each file.  When you submit to the competition it processes 500 tomograms to generate your score.  If you're generating ~1GB of files for each tomogram and taking ~1 minute for each, that should cause you to fail after ~30 min if you're not deleting the files after processing each one.",
      "votes": null
    },
    {
      "id": "3111558",
      "postDate": "01/31/2025 09:23:46",
      "content": "<p>thank you very much!🌹 I think I know!</p>",
      "rawMarkdown": "thank you very much!🌹 I think I know!",
      "votes": null
    },
    {
      "id": "3111589",
      "postDate": "01/31/2025 10:08:32",
      "content": "<p>You are keeping in memmory all volumes?</p>",
      "rawMarkdown": "You are keeping in memmory all volumes?",
      "votes": null
    },
    {
      "id": "3111778",
      "postDate": "01/31/2025 15:35:59",
      "content": "<p>The code would have generated intermediate files and intermediate variables, but I deleted them when I was done</p>",
      "rawMarkdown": "The code would have generated intermediate files and intermediate variables, but I deleted them when I was done",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3111437,
      "author_name": "davidlist",
      "author_url": "",
      "post_date": "01/31/2025 06:47:31",
      "content": "<p>I believe the notebooks have a limit of 20GB.  Is your code doing something that would write out that much data?  The submission.csv file should be nowhere near that large.</p>",
      "votes": null,
      "replies": [
        {
          "id": 3111480,
          "author_name": "daijuntao",
          "author_url": "",
          "post_date": "01/31/2025 07:47:27",
          "content": "<p>The resulting csv file is just 30KB.However, some files are generated in the middle of the code, but these are deleted at the end.</p>",
          "votes": null,
          "replies": [
            {
              "id": 3111488,
              "author_name": "davidlist",
              "author_url": "",
              "post_date": "01/31/2025 08:01:20",
              "content": "<p>At the end, or after processing each file.  When you submit to the competition it processes 500 tomograms to generate your score.  If you're generating ~1GB of files for each tomogram and taking ~1 minute for each, that should cause you to fail after ~30 min if you're not deleting the files after processing each one.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 3111558,
                  "author_name": "daijuntao",
                  "author_url": "",
                  "post_date": "01/31/2025 09:23:46",
                  "content": "<p>thank you very much!🌹 I think I know!</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 3111589,
      "author_name": "sacuscreed",
      "author_url": "",
      "post_date": "01/31/2025 10:08:32",
      "content": "<p>You are keeping in memmory all volumes?</p>",
      "votes": null,
      "replies": [
        {
          "id": 3111778,
          "author_name": "daijuntao",
          "author_url": "",
          "post_date": "01/31/2025 15:35:59",
          "content": "<p>The code would have generated intermediate files and intermediate variables, but I deleted them when I was done</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3111434": "\"Your notebook has used or requested more disk storage than available.\"  I always fail to submit at around 30 minutes, what should I do?🥲 My notes would only take 8 minutes to save.",
    "3111437": "I believe the notebooks have a limit of 20GB.  Is your code doing something that would write out that much data?  The submission.csv file should be nowhere near that large.",
    "3111480": "The resulting csv file is just 30KB.However, some files are generated in the middle of the code, but these are deleted at the end.",
    "3111488": "At the end, or after processing each file.  When you submit to the competition it processes 500 tomograms to generate your score.  If you're generating ~1GB of files for each tomogram and taking ~1 minute for each, that should cause you to fail after ~30 min if you're not deleting the files after processing each one.",
    "3111558": "thank you very much!🌹 I think I know!",
    "3111589": "You are keeping in memmory all volumes?",
    "3111778": "The code would have generated intermediate files and intermediate variables, but I deleted them when I was done"
  },
  "source": "meta"
}