![\"Run](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4308072%2Fd67b17f4e62488bee3b80bf9557a35c6%2Frun-in-saturn-cloud.png?generation=1661172886733918&alt=media\")
Hi all!
\nSince we launched the competition, many of you have been asking how to handle computation on the full dataset. We know single-cell data can get quite large, and I’m thrilled to announce that we’ve partnered with Saturn Cloud to provide free compute on their platform for the competition with 100 hours per month on 16GB GPU, 128GB RAM, and 32 CPU instances.
\nTo get started, click the link below!
\n
Saturn Cloud is a data science platform where you can launch high-powered notebooks (Jupyter, RStudio, VS Code, and more) in the cloud, quickly use Dask clusters, GPUs, etc.
\nIf you'd like to participate in the NeurIPS 2022 competition with free compute resources, click on the link below. If you message Saturn Cloud support, and say \"I'm competing in NeurIPS 2022, I'd like more compute\" you will be upgraded to 100 hours per month.
\nThey’ve helped us prepare an environment with several popular single-cell packages pre-installed (scanpy, muon, etc). If you’d like other packages installed, you can easily install with pip, sudo apt-get or ask Saturn Cloud support for help.
Best,
\nDaniel
Hi all!
\nSince we launched the competition, many of you have been asking how to handle computation on the full dataset. We know single-cell data can get quite large, and I’m thrilled to announce that we’ve partnered with Saturn Cloud to provide free compute on their platform for the competition with 100 hours per month on 16GB GPU, 128GB RAM, and 32 CPU instances.
\nTo get started, click the link below!
\n
Saturn Cloud is a data science platform where you can launch high-powered notebooks (Jupyter, RStudio, VS Code, and more) in the cloud, quickly use Dask clusters, GPUs, etc.
\nIf you'd like to participate in the NeurIPS 2022 competition with free compute resources, click on the link below. If you message Saturn Cloud support, and say \"I'm competing in NeurIPS 2022, I'd like more compute\" you will be upgraded to 100 hours per month.
\nThey’ve helped us prepare an environment with several popular single-cell packages pre-installed (scanpy, muon, etc). If you’d like other packages installed, you can easily install with pip, sudo apt-get or ask Saturn Cloud support for help.
Best,
\nDaniel
Thanks for posting this and to Saturn Cloud for making it available. This way of working is new to me so while I don't expect to get anywhere with the competition, it's an interesting learning experience. Fortunately the help is quite good for getting started.
\nThe environment starts with a connection made to a GitHub repository, where I thought this notebook:
\nhttps://github.com/openproblems-bio/neurips_2022_saturn_notebooks/blob/main/notebooks/getting-started-data-loading.ipynb
\ngave the clearest account so far of what the observations actually are, as well as demonstrating better data handling than I had managed alone.
Thanks !
\nHow to submit ? Can we submit from Saturn ? Or need to download submission file and upload to Kaggle ?
You will still need to submit via Kaggle, but it looks like you should be able to do this via the Kaggle API entirely on Saturn without needing to download the data locally.
\nFor more information about how to submit via the API, see https://www.kaggle.com/docs/api
", "rawMarkdown": "You will still need to submit via Kaggle, but it looks like you should be able to do this via the Kaggle API entirely on Saturn without needing to download the data locally.\n\nFor more information about how to submit via the API, see https://www.kaggle.com/docs/api", "votes": 5 }, { "id": 1928916, "postDate": "2022-09-06T17:31:50.650Z", "content": "I tried using Kaggle API from Saturn, but I got the error ConnectionResetError(104, 'Connection reset by peer')), I think this problem is about disabling access internet in Saturn cloud.
Hi @danielburkhardt , I have used saturn cloud with config of 4XLarge - 16 cores - 128 GB RAM - 100Gi Disk. But when loading the multiome input/target kernel restarts. Could the issue of not enough memory. I am attaching the screenshot. Can you pls suggest a way to load the inputs and targets?
\n![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7781767%2F4471ab775dd89f0893fcd1740757d87e%2FSaturnKernalRestart.png?generation=1665828021221098&alt=media\")
me too…any ideas to solve this issue? Thanks!
", "rawMarkdown": "me too...any ideas to solve this issue? Thanks!" }, { "id": 2017246, "postDate": "2022-11-04T16:26:27.540Z", "content": "I believe you are going to have to load the data in either in a sparse matrix format, or in batches. It's too large to fit in memory on most machines.
", "rawMarkdown": "I believe you are going to have to load the data in either in a sparse matrix format, or in batches. It's too large to fit in memory on most machines." } ] }, { "id": 1932060, "postDate": "2022-09-09T08:38:00.117Z", "content": "To download 2.5G data from Saturn - takes 7 hours. Is it only for me ? Can something be don ?
", "rawMarkdown": "To download 2.5G data from Saturn - takes 7 hours. Is it only for me ? Can something be don ? ", "votes": 1, "replies": [ { "id": 1935679, "postDate": "2022-09-12T09:48:32.287Z", "content": "Hi Alex,
\nThe data is readily available on Saturn, no need to download.
\nYou can find the files at '/kaggle/input/open-problems-multimodal/'.
\nBest,
\nCass
Thanks for providing Saturn Cloud access. Wonder if there is any chance for Saturn Cloud to help provide a GPU with >24GPU ram?
", "rawMarkdown": "Thanks for providing Saturn Cloud access. Wonder if there is any chance for Saturn Cloud to help provide a GPU with >24GPU ram?", "votes": 1 }, { "id": 1923463, "postDate": "2022-09-02T08:47:00.327Z", "content": "Thank you for providing us Saturn Cloud quota and telling us how to submit.
\nBut when I try to submit from Saturn Cloud using kaggle API, the transmission failed at the end of transmission showing \"ConnectionResetError: [Errno 104] Connection reset by peer\".
\nSubmission fails even for sample_submission.csv without change.
kaggle c submit open-problems-multimodal -f ../input/open-problems-multimodal/sample_submission.csv -m \"saturn submission test\"
\nDid anyone succeed in submission from Saturn Cloud?
", "rawMarkdown": "Thank you for providing us Saturn Cloud quota and telling us how to submit.\nBut when I try to submit from Saturn Cloud using kaggle API, the transmission failed at the end of transmission showing \"ConnectionResetError: [Errno 104] Connection reset by peer\". \nSubmission fails even for sample_submission.csv without change.\n\n kaggle c submit open-problems-multimodal -f ../input/open-problems-multimodal/sample_submission.csv -m \"saturn submission test\"\n\nDid anyone succeed in submission from Saturn Cloud?", "votes": 1, "replies": [ { "id": 1940603, "postDate": "2022-09-15T13:06:57.283Z", "content": "No, not able to submit directly from saturn
", "rawMarkdown": "No, not able to submit directly from saturn", "votes": 1 } ] }, { "id": 1915783, "postDate": "2022-08-27T11:03:06.950Z", "content": "Good news for poor kaggler like me.
", "rawMarkdown": "Good news for poor kaggler like me.", "votes": 1 }, { "id": 1910790, "postDate": "2022-08-23T17:14:48.703Z", "content": "It's great :)
", "rawMarkdown": "It's great :)", "votes": 1 }, { "id": 1910361, "postDate": "2022-08-23T11:18:50.167Z", "content": "This is awesome, thanks for organizing this!
", "rawMarkdown": "This is awesome, thanks for organizing this!", "votes": 1 }, { "id": 1909378, "postDate": "2022-08-22T15:16:54.703Z", "content": "Amazing, a lot of power
", "rawMarkdown": "Amazing, a lot of power", "votes": 1 }, { "id": 1909307, "postDate": "2022-08-22T13:56:10.503Z", "content": "Thank you !
", "rawMarkdown": "Thank you !", "votes": 1, "replies": [ { "id": 1909351, "postDate": "2022-08-22T14:55:00.570Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 1988183, "postDate": "2022-10-15T05:59:00.097Z", "content": "Problems starting Saturn.
\nIs it only with me ?
\nRetried several times - does not help
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F2262596%2F3071b0c5343a5ac11651a919390ffcc5%2FScreenshot%202022-10-15%20075754.png?generation=1665813516773291&alt=media\")
Can you click on \"Logs\" and see what it says? You might be out of disk space ( in which case you can click \"edit\" and choose a bigger disk.
", "rawMarkdown": "Can you click on \"Logs\" and see what it says? You might be out of disk space ( in which case you can click \"edit\" and choose a bigger disk.", "votes": 2 }, { "id": 1988649, "postDate": "2022-10-15T13:03:52.820Z", "content": "Yeah, I was having the same problem about out of disk space, my solution was to format it and start again with 300 Gb in disk space. but I lost all my previous work.
", "rawMarkdown": "Yeah, I was having the same problem about out of disk space, my solution was to format it and start again with 300 Gb in disk space. but I lost all my previous work.", "votes": 1 }, { "id": 1989037, "postDate": "2022-10-15T17:27:22.210Z", "content": "@BOOBA you shouldn't need to format anything. Just click on edit and expand the volume. Also for anyone reading this - just message the support/chat icon in the lower right corner. We're very responsive. If you post here, we probably won't see it. If you message in-app we can usually address issues very quickly.
", "rawMarkdown": "@BOOBA you shouldn't need to format anything. Just click on edit and expand the volume. Also for anyone reading this - just message the support/chat icon in the lower right corner. We're very responsive. If you post here, we probably won't see it. If you message in-app we can usually address issues very quickly.", "votes": 2 }, { "id": 1989061, "postDate": "2022-10-15T17:39:42.753Z", "content": "Yes, thanks for your services I appreciate it.
", "rawMarkdown": "Yes, thanks for your services I appreciate it.", "votes": 1 } ] }, { "id": 1927965, "postDate": "2022-09-06T05:59:42.997Z", "content": "Connection problem. Is it only for me ?
", "rawMarkdown": "Connection problem. Is it only for me ? ", "votes": 1, "replies": [ { "id": 1931443, "postDate": "2022-09-08T17:08:09.367Z", "content": "Me too, I have a problem when I try to use API (submit step) in Saturn Cloud.
", "rawMarkdown": "Me too, I have a problem when I try to use API (submit step) in Saturn Cloud.", "votes": 1 }, { "id": 1942856, "postDate": "2022-09-17T05:39:07.477Z", "content": "Please try again - we just relaxed some of our network bandwidth restrictions.
", "rawMarkdown": "Please try again - we just relaxed some of our network bandwidth restrictions.", "votes": 2 } ] }, { "id": 2032322, "postDate": "2022-11-16T14:56:25.787Z", "content": "Hi - now that the competition is over, we've enrolled everyone in the free tier.. If you wish to start your previous workspaces, you may need to re-select your instance type. Under the free tier, data is automatically deleted after 30 days of inactivity, but the period restarts if you simply login and spin up a resource.
\nIf you need help getting into your resources, please let us know via support@saturncloud.io, or the in-app chat.
", "rawMarkdown": "Hi - now that the competition is over, we've enrolled everyone [in the free tier.](https://saturncloud.io/plans/hosted/). If you wish to start your previous workspaces, you may need to re-select your instance type. Under the free tier, data is automatically deleted after 30 days of inactivity, but the period restarts if you simply login and spin up a resource.\n\nIf you need help getting into your resources, please let us know via support@saturncloud.io, or the in-app chat." }, { "id": 2025216, "postDate": "2022-11-11T04:24:30.803Z", "content": "Wow great~
", "rawMarkdown": "Wow great~" }, { "id": 2017247, "postDate": "2022-11-04T16:27:05.353Z", "content": "Hi - just a note that we just increased the egress network limit to 80 mb/s. Hopefully that will address issues with connection refused errors submitting to kaggle.
\nWe've also removed some of the larger instances from the free tier. That means if you're coming to Saturn Cloud in order to participate in the competition - you'll need to ask for the neurips upgrade in order to use the larger instances.
", "rawMarkdown": "Hi - just a note that we just increased the egress network limit to 80 mb/s. Hopefully that will address issues with connection refused errors submitting to kaggle.\n\nWe've also removed some of the larger instances from the free tier. That means if you're coming to Saturn Cloud in order to participate in the competition - you'll need to ask for the neurips upgrade in order to use the larger instances." }, { "id": 2010551, "postDate": "2022-10-30T20:52:42.053Z", "content": "thanks! But how can I upload some dataset to Saturn? it seems that it will fail if dataset is too large (for example 500MB)…or how can I download data from other teams? Thanks! Is there any documentation on how to use Kaggle API on Saturn? If I tried pip install kaggle, it simply returned an error: \"OSError: Could not find kaggle.json. Make sure it's located in /home/jovyan/.kaggle. Or use the environment method.\"
", "rawMarkdown": "thanks! But how can I upload some dataset to Saturn? it seems that it will fail if dataset is too large (for example 500MB)...or how can I download data from other teams? Thanks! Is there any documentation on how to use Kaggle API on Saturn? If I tried pip install kaggle, it simply returned an error: \"OSError: Could not find kaggle.json. Make sure it's located in /home/jovyan/.kaggle. Or use the environment method.\"" }, { "id": 1997388, "postDate": "2022-10-20T20:26:36.653Z", "content": "I'm trying to train neural network, and constantly get the error regardless batch size
\nInternalError: Failed copying input tensor from /job:localhost/replica:0/task:0/device:CPU:0 to /job:localhost/replica:0/task:0/device:GPU:0 in order to run _EagerConst: Dst tensor is not initialized.
\nI installed TensorFlow through command \"conda install tensorflow-gpu\"
\nWhat should I do?
@danielburkhardt When I click to setup image from above link gives me Image not found , has the image been removed from Saturn cloud for quick setup ?
", "rawMarkdown": "@danielburkhardt When I click to setup image from above link gives me Image not found , has the image been removed from Saturn cloud for quick setup ?", "replies": [ { "id": 1952248, "postDate": "2022-09-23T14:22:12.970Z", "content": "@hhhuuugggooo can you please help @gauravmalik26
", "rawMarkdown": "@hhhuuugggooo can you please help @gauravmalik26 " }, { "id": 1952359, "postDate": "2022-09-23T15:44:36.150Z", "content": "Go to Saturn Cloud, and if you don't log in directly, you should log in by your Email as you did the first time.
", "rawMarkdown": "Go to [Saturn Cloud](https://saturncloud.io/), and if you don't log in directly, you should log in by your Email as you did the first time. " }, { "id": 1952379, "postDate": "2022-09-23T16:09:36.687Z", "content": "OK seems now when I login again started working thanks :D
", "rawMarkdown": "OK seems now when I login again started working thanks :D " } ] }, { "id": 1942761, "postDate": "2022-09-17T01:40:25.990Z", "content": "Hi - we're looking into the submission problem now. If anyone is running into any issues, please talk to Saturn Cloud support via the little chat icon in the lower right corner of the screen.
", "rawMarkdown": "Hi - we're looking into the submission problem now. If anyone is running into any issues, please talk to Saturn Cloud support via the little chat icon in the lower right corner of the screen.", "replies": [ { "id": 1942858, "postDate": "2022-09-17T05:39:57.380Z", "content": "If you were having issues with submissions, please try again - we just relaxed some of our network bandwidth restrictions.
", "rawMarkdown": "If you were having issues with submissions, please try again - we just relaxed some of our network bandwidth restrictions.", "votes": 1 }, { "id": 1943442, "postDate": "2022-09-17T14:09:57.507Z", "content": "![\"Finally,](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7234856%2Fcc4ade6c73fd244e278345c5eec029b5%2FA.png?generation=1663423770440072&alt=media\")
Wow, this is really cool, thanks for this!
", "rawMarkdown": "Wow, this is really cool, thanks for this!" }, { "id": 1910955, "postDate": "2022-08-23T20:07:08.750Z", "content": "Hello
\nI am participating for the first time in a Kaggle contest and I am missing some benchmarks.
\nA very first question. Do we have to have submissions every day or is it enough to submit only once while respecting the deadlines? I saw that participants have already submitted!
Doru Pospai
", "rawMarkdown": "Hello\nI am participating for the first time in a Kaggle contest and I am missing some benchmarks.\nA very first question. Do we have to have submissions every day or is it enough to submit only once while respecting the deadlines? I saw that participants have already submitted!\n\nDoru Pospai\n", "replies": [ { "id": 1910957, "postDate": "2022-08-23T20:09:11.557Z", "content": "You only need to submit once 😊
", "rawMarkdown": "You only need to submit once 😊", "votes": 2 } ] }, { "id": 1909643, "postDate": "2022-08-22T19:37:15.947Z", "content": "It sounds great to have Jupyter (Kaggle) Notebooks on Saturn Cloud.
", "rawMarkdown": "It sounds great to have Jupyter (Kaggle) Notebooks on Saturn Cloud." }, { "id": 2035118, "postDate": "2022-11-18T16:24:05.567Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2014944, "postDate": "2022-11-03T01:51:07.383Z", "rawMarkdown": "", "isDeleted": true }, { "id": 1910664, "postDate": "2022-08-23T15:29:32.097Z", "content": "thanks let grow together
", "rawMarkdown": "thanks let grow together ", "votes": 1 }, { "id": 1910459, "postDate": "2022-08-23T12:39:16.670Z", "content": "Thank you, this is great to hear about!
", "rawMarkdown": "Thank you, this is great to hear about!", "votes": 1 }, { "id": 1910076, "postDate": "2022-08-23T06:40:23.160Z", "content": "Thank you !!!
", "rawMarkdown": "Thank you !!!", "votes": 1 }, { "id": 1909357, "postDate": "2022-08-22T15:00:38.447Z", "content": "Awesome, thanks!
", "rawMarkdown": "Awesome, thanks!", "votes": 1 }, { "id": 2031377, "postDate": "2022-11-16T03:25:55.583Z", "content": "Thank you, this is great to hear about!
", "rawMarkdown": "Thank you, this is great to hear about!" }, { "id": 2031181, "postDate": "2022-11-15T23:17:33.667Z", "content": "Thank you!
", "rawMarkdown": "Thank you!" }, { "id": 2016467, "postDate": "2022-11-04T03:23:51.563Z", "content": "Thank you.
", "rawMarkdown": "Thank you." }, { "id": 2015345, "postDate": "2022-11-03T08:08:45.907Z", "content": "Thank you!
", "rawMarkdown": "Thank you!" }, { "id": 2008898, "postDate": "2022-10-29T12:34:20.513Z", "content": "Thanks for the nice information!
", "rawMarkdown": "Thanks for the nice information!" }, { "id": 2006604, "postDate": "2022-10-27T17:18:29.287Z", "content": "Thank you!!
", "rawMarkdown": "Thank you!!" }, { "id": 1925863, "postDate": "2022-09-04T11:53:06.090Z", "content": "Thank you !!
", "rawMarkdown": "Thank you !!" }, { "id": 1915776, "postDate": "2022-08-27T10:56:00.607Z", "content": "Thank you!
", "rawMarkdown": "Thank you!" }, { "id": 1915064, "postDate": "2022-08-26T16:27:49.287Z", "content": "Thank you, this is great to hear about!
", "rawMarkdown": "Thank you, this is great to hear about!" }, { "id": 1912169, "postDate": "2022-08-24T14:55:08.877Z", "content": "Wonderful! Thank you!
", "rawMarkdown": "Wonderful! Thank you! " }, { "id": 1911071, "postDate": "2022-08-23T23:36:16.097Z", "content": "This is great! Thank you for this!
", "rawMarkdown": "This is great! Thank you for this! " }, { "id": 1910944, "postDate": "2022-08-23T19:48:12.647Z", "content": "Thank you, cool stuff.
", "rawMarkdown": "Thank you, cool stuff." }, { "id": 1910856, "postDate": "2022-08-23T18:17:48.500Z", "content": "Thanks a lot!
", "rawMarkdown": "Thanks a lot!" } ], "comments": [ { "id": 1930790, "author_name": "Jeff Allen", "author_url": "", "post_date": "2022-09-08T07:40:59.123000", "content": "Thanks for posting this and to Saturn Cloud for making it available. This way of working is new to me so while I don't expect to get anywhere with the competition, it's an interesting learning experience. Fortunately the help is quite good for getting started.
\nThe environment starts with a connection made to a GitHub repository, where I thought this notebook:
\nhttps://github.com/openproblems-bio/neurips_2022_saturn_notebooks/blob/main/notebooks/getting-started-data-loading.ipynb
\ngave the clearest account so far of what the observations actually are, as well as demonstrating better data handling than I had managed alone.
Thanks !
\nHow to submit ? Can we submit from Saturn ? Or need to download submission file and upload to Kaggle ?
You will still need to submit via Kaggle, but it looks like you should be able to do this via the Kaggle API entirely on Saturn without needing to download the data locally.
\nFor more information about how to submit via the API, see https://www.kaggle.com/docs/api
", "votes": 5, "replies": [] }, { "id": 1928916, "author_name": "EL Younes", "author_url": "", "post_date": "2022-09-06T17:31:50.650000", "content": "I tried using Kaggle API from Saturn, but I got the error ConnectionResetError(104, 'Connection reset by peer')), I think this problem is about disabling access internet in Saturn cloud.
Hi @danielburkhardt , I have used saturn cloud with config of 4XLarge - 16 cores - 128 GB RAM - 100Gi Disk. But when loading the multiome input/target kernel restarts. Could the issue of not enough memory. I am attaching the screenshot. Can you pls suggest a way to load the inputs and targets?
\n
me too…any ideas to solve this issue? Thanks!
", "votes": 0, "replies": [] }, { "id": 2017246, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-11-04T16:26:27.540000", "content": "I believe you are going to have to load the data in either in a sparse matrix format, or in batches. It's too large to fit in memory on most machines.
", "votes": 0, "replies": [] } ] }, { "id": 1932060, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-09-09T08:38:00.117000", "content": "To download 2.5G data from Saturn - takes 7 hours. Is it only for me ? Can something be don ?
", "votes": 1, "replies": [ { "id": 1935679, "author_name": "Cass Li", "author_url": "", "post_date": "2022-09-12T09:48:32.287000", "content": "Hi Alex,
\nThe data is readily available on Saturn, no need to download.
\nYou can find the files at '/kaggle/input/open-problems-multimodal/'.
\nBest,
\nCass
Thanks for providing Saturn Cloud access. Wonder if there is any chance for Saturn Cloud to help provide a GPU with >24GPU ram?
", "votes": 1, "replies": [] }, { "id": 1923463, "author_name": "Konomu Abe", "author_url": "", "post_date": "2022-09-02T08:47:00.327000", "content": "Thank you for providing us Saturn Cloud quota and telling us how to submit.
\nBut when I try to submit from Saturn Cloud using kaggle API, the transmission failed at the end of transmission showing \"ConnectionResetError: [Errno 104] Connection reset by peer\".
\nSubmission fails even for sample_submission.csv without change.
kaggle c submit open-problems-multimodal -f ../input/open-problems-multimodal/sample_submission.csv -m \"saturn submission test\"
\nDid anyone succeed in submission from Saturn Cloud?
", "votes": 1, "replies": [ { "id": 1940603, "author_name": "Gaurav Malik", "author_url": "", "post_date": "2022-09-15T13:06:57.283000", "content": "No, not able to submit directly from saturn
", "votes": 1, "replies": [] } ] }, { "id": 1915783, "author_name": "hyd", "author_url": "", "post_date": "2022-08-27T11:03:06.950000", "content": "Good news for poor kaggler like me.
", "votes": 1, "replies": [] }, { "id": 1910790, "author_name": "Reza Karimi", "author_url": "", "post_date": "2022-08-23T17:14:48.703000", "content": "It's great :)
", "votes": 1, "replies": [] }, { "id": 1910361, "author_name": "JD", "author_url": "", "post_date": "2022-08-23T11:18:50.167000", "content": "This is awesome, thanks for organizing this!
", "votes": 1, "replies": [] }, { "id": 1909378, "author_name": "Hiram Coria 🧬", "author_url": "", "post_date": "2022-08-22T15:16:54.703000", "content": "Amazing, a lot of power
", "votes": 1, "replies": [] }, { "id": 1909307, "author_name": "euijin", "author_url": "", "post_date": "2022-08-22T13:56:10.503000", "content": "Thank you !
", "votes": 1, "replies": [ { "id": 1909351, "author_name": "", "author_url": "", "post_date": "2022-08-22T14:55:00.570000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 1988183, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-10-15T05:59:00.097000", "content": "Problems starting Saturn.
\nIs it only with me ?
\nRetried several times - does not help
Can you click on \"Logs\" and see what it says? You might be out of disk space ( in which case you can click \"edit\" and choose a bigger disk.
", "votes": 2, "replies": [] }, { "id": 1988649, "author_name": "EL Younes", "author_url": "", "post_date": "2022-10-15T13:03:52.820000", "content": "Yeah, I was having the same problem about out of disk space, my solution was to format it and start again with 300 Gb in disk space. but I lost all my previous work.
", "votes": 1, "replies": [] }, { "id": 1989037, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-10-15T17:27:22.210000", "content": "@BOOBA you shouldn't need to format anything. Just click on edit and expand the volume. Also for anyone reading this - just message the support/chat icon in the lower right corner. We're very responsive. If you post here, we probably won't see it. If you message in-app we can usually address issues very quickly.
", "votes": 2, "replies": [] }, { "id": 1989061, "author_name": "EL Younes", "author_url": "", "post_date": "2022-10-15T17:39:42.753000", "content": "Yes, thanks for your services I appreciate it.
", "votes": 1, "replies": [] } ] }, { "id": 1927965, "author_name": "Alexander Chervov", "author_url": "", "post_date": "2022-09-06T05:59:42.997000", "content": "Connection problem. Is it only for me ?
", "votes": 1, "replies": [ { "id": 1931443, "author_name": "CHROLLO Hunter", "author_url": "", "post_date": "2022-09-08T17:08:09.367000", "content": "Me too, I have a problem when I try to use API (submit step) in Saturn Cloud.
", "votes": 1, "replies": [] }, { "id": 1942856, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-09-17T05:39:07.477000", "content": "Please try again - we just relaxed some of our network bandwidth restrictions.
", "votes": 2, "replies": [] } ] }, { "id": 2032322, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-11-16T14:56:25.787000", "content": "Hi - now that the competition is over, we've enrolled everyone in the free tier.. If you wish to start your previous workspaces, you may need to re-select your instance type. Under the free tier, data is automatically deleted after 30 days of inactivity, but the period restarts if you simply login and spin up a resource.
\nIf you need help getting into your resources, please let us know via support@saturncloud.io, or the in-app chat.
", "votes": 0, "replies": [] }, { "id": 2025216, "author_name": "BinZhao", "author_url": "", "post_date": "2022-11-11T04:24:30.803000", "content": "Wow great~
", "votes": 0, "replies": [] }, { "id": 2017247, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-11-04T16:27:05.353000", "content": "Hi - just a note that we just increased the egress network limit to 80 mb/s. Hopefully that will address issues with connection refused errors submitting to kaggle.
\nWe've also removed some of the larger instances from the free tier. That means if you're coming to Saturn Cloud in order to participate in the competition - you'll need to ask for the neurips upgrade in order to use the larger instances.
", "votes": 0, "replies": [] }, { "id": 2010551, "author_name": "XuShanKaggle", "author_url": "", "post_date": "2022-10-30T20:52:42.053000", "content": "thanks! But how can I upload some dataset to Saturn? it seems that it will fail if dataset is too large (for example 500MB)…or how can I download data from other teams? Thanks! Is there any documentation on how to use Kaggle API on Saturn? If I tried pip install kaggle, it simply returned an error: \"OSError: Could not find kaggle.json. Make sure it's located in /home/jovyan/.kaggle. Or use the environment method.\"
", "votes": 0, "replies": [] }, { "id": 1997388, "author_name": "Denis Porfirev", "author_url": "", "post_date": "2022-10-20T20:26:36.653000", "content": "I'm trying to train neural network, and constantly get the error regardless batch size
\nInternalError: Failed copying input tensor from /job:localhost/replica:0/task:0/device:CPU:0 to /job:localhost/replica:0/task:0/device:GPU:0 in order to run _EagerConst: Dst tensor is not initialized.
\nI installed TensorFlow through command \"conda install tensorflow-gpu\"
\nWhat should I do?
@danielburkhardt When I click to setup image from above link gives me Image not found , has the image been removed from Saturn cloud for quick setup ?
", "votes": 0, "replies": [ { "id": 1952248, "author_name": "Daniel Burkhardt", "author_url": "", "post_date": "2022-09-23T14:22:12.970000", "content": "@hhhuuugggooo can you please help @gauravmalik26
", "votes": 0, "replies": [] }, { "id": 1952359, "author_name": "EL Younes", "author_url": "", "post_date": "2022-09-23T15:44:36.150000", "content": "Go to Saturn Cloud, and if you don't log in directly, you should log in by your Email as you did the first time.
", "votes": 0, "replies": [] }, { "id": 1952379, "author_name": "Gaurav Rawat", "author_url": "", "post_date": "2022-09-23T16:09:36.687000", "content": "OK seems now when I login again started working thanks :D
", "votes": 0, "replies": [] } ] }, { "id": 1942761, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-09-17T01:40:25.990000", "content": "Hi - we're looking into the submission problem now. If anyone is running into any issues, please talk to Saturn Cloud support via the little chat icon in the lower right corner of the screen.
", "votes": 0, "replies": [ { "id": 1942858, "author_name": "hhhuuugggooo", "author_url": "", "post_date": "2022-09-17T05:39:57.380000", "content": "If you were having issues with submissions, please try again - we just relaxed some of our network bandwidth restrictions.
", "votes": 1, "replies": [] }, { "id": 1943442, "author_name": "EL Younes", "author_url": "", "post_date": "2022-09-17T14:09:57.507000", "content": "
Wow, this is really cool, thanks for this!
", "votes": 0, "replies": [] }, { "id": 1910955, "author_name": "Doru Pospai", "author_url": "", "post_date": "2022-08-23T20:07:08.750000", "content": "Hello
\nI am participating for the first time in a Kaggle contest and I am missing some benchmarks.
\nA very first question. Do we have to have submissions every day or is it enough to submit only once while respecting the deadlines? I saw that participants have already submitted!
Doru Pospai
", "votes": 0, "replies": [ { "id": 1910957, "author_name": "Daniel Burkhardt", "author_url": "", "post_date": "2022-08-23T20:09:11.557000", "content": "You only need to submit once 😊
", "votes": 2, "replies": [] } ] }, { "id": 1909643, "author_name": "Marília Prata", "author_url": "", "post_date": "2022-08-22T19:37:15.947000", "content": "It sounds great to have Jupyter (Kaggle) Notebooks on Saturn Cloud.
", "votes": 0, "replies": [] }, { "id": 2035118, "author_name": "", "author_url": "", "post_date": "2022-11-18T16:24:05.567000", "content": "", "votes": 0, "replies": [] }, { "id": 2014944, "author_name": "", "author_url": "", "post_date": "2022-11-03T01:51:07.383000", "content": "", "votes": 0, "replies": [] }, { "id": 1910664, "author_name": "Bilal Suppal", "author_url": "", "post_date": "2022-08-23T15:29:32.097000", "content": "thanks let grow together
", "votes": 1, "replies": [] }, { "id": 1910459, "author_name": "AshutoshMalgaonkar", "author_url": "", "post_date": "2022-08-23T12:39:16.670000", "content": "Thank you, this is great to hear about!
", "votes": 1, "replies": [] }, { "id": 1910076, "author_name": "AItony", "author_url": "", "post_date": "2022-08-23T06:40:23.160000", "content": "Thank you !!!
", "votes": 1, "replies": [] }, { "id": 1909357, "author_name": "Ahmed Ibrahim", "author_url": "", "post_date": "2022-08-22T15:00:38.447000", "content": "Awesome, thanks!
", "votes": 1, "replies": [] }, { "id": 2031377, "author_name": "", "author_url": "", "post_date": "2022-11-16T03:25:55.583000", "content": "", "votes": 0, "replies": [] }, { "id": 2031181, "author_name": "", "author_url": "", "post_date": "2022-11-15T23:17:33.667000", "content": "", "votes": 0, "replies": [] }, { "id": 2016467, "author_name": "", "author_url": "", "post_date": "2022-11-04T03:23:51.563000", "content": "", "votes": 0, "replies": [] }, { "id": 2015345, "author_name": "", "author_url": "", "post_date": "2022-11-03T08:08:45.907000", "content": "", "votes": 0, "replies": [] }, { "id": 2008898, "author_name": "", "author_url": "", "post_date": "2022-10-29T12:34:20.513000", "content": "", "votes": 0, "replies": [] }, { "id": 2006604, "author_name": "", "author_url": "", "post_date": "2022-10-27T17:18:29.287000", "content": "", "votes": 0, "replies": [] }, { "id": 1925863, "author_name": "", "author_url": "", "post_date": "2022-09-04T11:53:06.090000", "content": "", "votes": 0, "replies": [] }, { "id": 1915776, "author_name": "", "author_url": "", "post_date": "2022-08-27T10:56:00.607000", "content": "", "votes": 0, "replies": [] }, { "id": 1915064, "author_name": "", "author_url": "", "post_date": "2022-08-26T16:27:49.287000", "content": "", "votes": 0, "replies": [] }, { "id": 1912169, "author_name": "", "author_url": "", "post_date": "2022-08-24T14:55:08.877000", "content": "", "votes": 0, "replies": [] }, { "id": 1911071, "author_name": "", "author_url": "", "post_date": "2022-08-23T23:36:16.097000", "content": "", "votes": 0, "replies": [] }, { "id": 1910944, "author_name": "", "author_url": "", "post_date": "2022-08-23T19:48:12.647000", "content": "", "votes": 0, "replies": [] }, { "id": 1910856, "author_name": "", "author_url": "", "post_date": "2022-08-23T18:17:48.500000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "1909222": "Hi all! \n\nSince we launched the competition, many of you have been asking how to handle computation on the full dataset. We know single-cell data can get quite large, and I’m thrilled to announce that we’ve partnered with Saturn Cloud to provide free compute on their platform for the competition with 100 hours per month on 16GB GPU, 128GB RAM, and 32 CPU instances.\n\nTo get started, click the link below!\n\n[](https://app.community.saturnenterprise.io/dash/resources?recipeUrl=https://raw.githubusercontent.com/openproblems-bio/neurips_2022_notebooks/main/.saturn/saturn.json)\n\n\n\nSaturn Cloud is a data science platform where you can launch high-powered notebooks (Jupyter, RStudio, VS Code, and more) in the cloud, quickly use Dask clusters, GPUs, etc. \n\nIf you'd like to participate in the NeurIPS 2022 competition with free compute resources, click on the link below. If you message Saturn Cloud support, and say \"I'm competing in NeurIPS 2022, I'd like more compute\" you will be upgraded to 100 hours per month.\n\nThey’ve helped us prepare an environment with several popular single-cell packages pre-installed (scanpy, muon, etc). If you’d like other packages installed, you can easily install with `pip`, `sudo apt-get` or ask Saturn Cloud support for help.\n\nBest,\nDaniel\n\n \n", "1930790": "Thanks for posting this and to Saturn Cloud for making it available. This way of working is new to me so while I don't expect to get anywhere with the competition, it's an interesting learning experience. Fortunately the help is quite good for getting started.\n\nThe environment starts with a connection made to a GitHub repository, where I thought this notebook:\nhttps://github.com/openproblems-bio/neurips_2022_saturn_notebooks/blob/main/notebooks/getting-started-data-loading.ipynb\ngave the clearest account so far of what the observations actually are, as well as demonstrating better data handling than I had managed alone.", "1910629": "Thanks ! \nHow to submit ? Can we submit from Saturn ? Or need to download submission file and upload to Kaggle ?", "1988408": "Hi @danielburkhardt , I have used saturn cloud with config of 4XLarge - 16 cores - 128 GB RAM - 100Gi Disk. But when loading the multiome input/target kernel restarts. Could the issue of not enough memory. I am attaching the screenshot. Can you pls suggest a way to load the inputs and targets?\n\n", "1932060": "To download 2.5G data from Saturn - takes 7 hours. Is it only for me ? Can something be don ? ", "1931719": "Thanks for providing Saturn Cloud access. Wonder if there is any chance for Saturn Cloud to help provide a GPU with >24GPU ram?", "1923463": "Thank you for providing us Saturn Cloud quota and telling us how to submit.\nBut when I try to submit from Saturn Cloud using kaggle API, the transmission failed at the end of transmission showing \"ConnectionResetError: [Errno 104] Connection reset by peer\". \nSubmission fails even for sample_submission.csv without change.\n\n kaggle c submit open-problems-multimodal -f ../input/open-problems-multimodal/sample_submission.csv -m \"saturn submission test\"\n\nDid anyone succeed in submission from Saturn Cloud?", "1915783": "Good news for poor kaggler like me.", "1910790": "It's great :)", "1910361": "This is awesome, thanks for organizing this!", "1909378": "Amazing, a lot of power", "1909307": "Thank you !", "1988183": "Problems starting Saturn.\nIs it only with me ? \nRetried several times - does not help \n\n\n", "1927965": "Connection problem. Is it only for me ? ", "2032322": "Hi - now that the competition is over, we've enrolled everyone [in the free tier.](https://saturncloud.io/plans/hosted/). If you wish to start your previous workspaces, you may need to re-select your instance type. Under the free tier, data is automatically deleted after 30 days of inactivity, but the period restarts if you simply login and spin up a resource.\n\nIf you need help getting into your resources, please let us know via support@saturncloud.io, or the in-app chat.", "2025216": "Wow great~", "2017247": "Hi - just a note that we just increased the egress network limit to 80 mb/s. Hopefully that will address issues with connection refused errors submitting to kaggle.\n\nWe've also removed some of the larger instances from the free tier. That means if you're coming to Saturn Cloud in order to participate in the competition - you'll need to ask for the neurips upgrade in order to use the larger instances.", "2010551": "thanks! But how can I upload some dataset to Saturn? it seems that it will fail if dataset is too large (for example 500MB)...or how can I download data from other teams? Thanks! Is there any documentation on how to use Kaggle API on Saturn? If I tried pip install kaggle, it simply returned an error: \"OSError: Could not find kaggle.json. Make sure it's located in /home/jovyan/.kaggle. Or use the environment method.\"", "1997388": "I'm trying to train neural network, and constantly get the error regardless batch size\nInternalError: Failed copying input tensor from /job:localhost/replica:0/task:0/device:CPU:0 to /job:localhost/replica:0/task:0/device:GPU:0 in order to run _EagerConst: Dst tensor is not initialized.\nI installed TensorFlow through command \"conda install tensorflow-gpu\"\nWhat should I do?", "1952229": "@danielburkhardt When I click to setup image from above link gives me Image not found , has the image been removed from Saturn cloud for quick setup ?", "1942761": "Hi - we're looking into the submission problem now. If anyone is running into any issues, please talk to Saturn Cloud support via the little chat icon in the lower right corner of the screen.", "1912696": "Wow, this is really cool, thanks for this!", "1910955": "Hello\nI am participating for the first time in a Kaggle contest and I am missing some benchmarks.\nA very first question. Do we have to have submissions every day or is it enough to submit only once while respecting the deadlines? I saw that participants have already submitted!\n\nDoru Pospai\n", "1909643": "It sounds great to have Jupyter (Kaggle) Notebooks on Saturn Cloud.", "2035118": "", "2014944": "", "1910664": "thanks let grow together ", "1910459": "Thank you, this is great to hear about!", "1910076": "Thank you !!!", "1909357": "Awesome, thanks!", "2031377": "Thank you, this is great to hear about!", "2031181": "Thank you!", "2016467": "Thank you.", "2015345": "Thank you!", "2008898": "Thanks for the nice information!", "2006604": "Thank you!!", "1925863": "Thank you !!", "1915776": "Thank you!", "1915064": "Thank you, this is great to hear about!", "1912169": "Wonderful! Thank you! ", "1911071": "This is great! Thank you for this! ", "1910944": "Thank you, cool stuff.", "1910856": "Thanks a lot!" } }