{
  "id": 41285,
  "title": "a question about using google datalab",
  "url": "/competitions/passenger-screening-algorithm-challenge/discussion/41285",
  "author_name": "",
  "post_date": "2017-10-15T23:09:01.450781300Z",
  "votes": null,
  "comment_count": 9,
  "views": 0,
  "content": "<p>I just try to get myself familiar with datalab (for data preprocessing) by following the document, and the best guide I found is the one on the official website (<a href=\"https://cloud.google.com/ml-engine/docs/datalab\">https://cloud.google.com/ml-engine/docs/datalab</a>). I installed the shell, created a new instance of the virtual machine, connected to it, and now I can see the folder (/docs/ and /notebooks/). </p>\n\n<p>However, if I open a notebook and try to run some code within it, nothing happened except a “localhost is not responding due to long-running scripts”. I am not running any heavy task, just a simple “hello, world” printing. </p>\n\n<p>I don’t know if I miss anything here. Any hints or suggestions are very welcome. </p>",
  "messages": [
    {
      "id": "231760",
      "postDate": "10/15/2017 23:09:01",
      "content": "<p>I just try to get myself familiar with datalab (for data preprocessing) by following the document, and the best guide I found is the one on the official website (<a href=\"https://cloud.google.com/ml-engine/docs/datalab\">https://cloud.google.com/ml-engine/docs/datalab</a>). I installed the shell, created a new instance of the virtual machine, connected to it, and now I can see the folder (/docs/ and /notebooks/). </p>\n\n<p>However, if I open a notebook and try to run some code within it, nothing happened except a “localhost is not responding due to long-running scripts”. I am not running any heavy task, just a simple “hello, world” printing. </p>\n\n<p>I don’t know if I miss anything here. Any hints or suggestions are very welcome. </p>",
      "rawMarkdown": "I just try to get myself familiar with datalab (for data preprocessing) by following the document, and the best guide I found is the one on the official website (https://cloud.google.com/ml-engine/docs/datalab). I installed the shell, created a new instance of the virtual machine, connected to it, and now I can see the folder (/docs/ and /notebooks/). \n\nHowever, if I open a notebook and try to run some code within it, nothing happened except a “localhost is not responding due to long-running scripts”. I am not running any heavy task, just a simple “hello, world” printing. \n\nI don’t know if I miss anything here. Any hints or suggestions are very welcome.",
      "votes": null
    },
    {
      "id": "232191",
      "postDate": "10/17/2017 03:38:04",
      "content": "<p>Can anybody share some experience how to read/preprocess these large image dataset? Either on local machine or on cloud? </p>\n\n<p>Thanks in advance!</p>",
      "rawMarkdown": "Can anybody share some experience how to read/preprocess these large image dataset? Either on local machine or on cloud? \n\nThanks in advance!",
      "votes": null
    },
    {
      "id": "232604",
      "postDate": "10/17/2017 20:57:13",
      "content": "<p>Hello! </p>\n\n<p>You may have already read through both of this. But just in case you haven't, I'd suggest <a href=\"https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/37088\">this tutorial</a> and <a href=\"https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/36337\">this discussion thread</a>.</p>",
      "rawMarkdown": "Hello! \n\nYou may have already read through both of this. But just in case you haven't, I'd suggest [this tutorial](https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/37088) and [this discussion thread](https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/36337).",
      "votes": null
    },
    {
      "id": "232674",
      "postDate": "10/18/2017 04:05:41",
      "content": "<p>Hi, Steve, </p>\n\n<p>I am new to the cloud infrastructure, and thank you so much for your reply! Actually they are exactly where I started. As far I as I know, I can copy the data into my own storage and use Datalab, where all the common packages like numpy and pandas can be integrated into a jupyter notebook and we can start data preprocessing from there.</p>\n\n<p>But I encountered problem when I started to use Datalab (described in the original question). For this particular dataset, it seems it is only feasible to do it on cloud. But I am not sure whether I am doing things correctly, and and hope anybody can give me some hints. </p>\n\n<p>Thank you!</p>",
      "rawMarkdown": "Hi, Steve, \n\nI am new to the cloud infrastructure, and thank you so much for your reply! Actually they are exactly where I started. As far I as I know, I can copy the data into my own storage and use Datalab, where all the common packages like numpy and pandas can be integrated into a jupyter notebook and we can start data preprocessing from there.\n\nBut I encountered problem when I started to use Datalab (described in the original question). For this particular dataset, it seems it is only feasible to do it on cloud. But I am not sure whether I am doing things correctly, and and hope anybody can give me some hints. \n\nThank you!",
      "votes": null
    },
    {
      "id": "233601",
      "postDate": "10/20/2017 16:38:29",
      "content": "<p>Hi, </p>\n\n<p>Sorry you're running into these problems! I think I need a bit more information to help you debug. It sounds to me like you have a problem getting Datalab to work that's probably generic to Datalab rather than specific to this competition. I suspect either that the Datalab notebook service isn't starting correctly or that somehow your browser isn't able to reach the endpoint opened up by the VM running Datalab. </p>\n\n<p>Have you gone through the <a href=\"https://cloud.google.com/datalab/docs/\">Datalab Getting Started documentation</a> ? </p>",
      "rawMarkdown": "Hi, \n\nSorry you're running into these problems! I think I need a bit more information to help you debug. It sounds to me like you have a problem getting Datalab to work that's probably generic to Datalab rather than specific to this competition. I suspect either that the Datalab notebook service isn't starting correctly or that somehow your browser isn't able to reach the endpoint opened up by the VM running Datalab. \n\nHave you gone through the [Datalab Getting Started documentation](https://cloud.google.com/datalab/docs/) ?",
      "votes": null
    },
    {
      "id": "234265",
      "postDate": "10/22/2017 20:16:27",
      "content": "<p>Yes, I have gone through the installation and set up a connection to Datalab, and maybe the problem is caused by the communication between the browser and the Datalab notebook service as you suggested. </p>\n\n<p>Unfortunately, I did not find any forum or maillist to discuss the issues with Datalab, so I am kind of getting stuck here.  Do you have any suggestion or any hint for another way to do it? </p>\n\n<p>Thanks a lot!</p>",
      "rawMarkdown": "Yes, I have gone through the installation and set up a connection to Datalab, and maybe the problem is caused by the communication between the browser and the Datalab notebook service as you suggested. \n\nUnfortunately, I did not find any forum or maillist to discuss the issues with Datalab, so I am kind of getting stuck here.  Do you have any suggestion or any hint for another way to do it? \n\nThanks a lot!",
      "votes": null
    },
    {
      "id": "234494",
      "postDate": "10/23/2017 13:43:19",
      "content": "<p>Hello, </p>\n\n<p>Does Datalab work when you follow the instructions in <a href=\"https://cloud.google.com/datalab/docs/quickstarts\">this quickstart</a>? If not, at what stage do you hit problems? </p>",
      "rawMarkdown": "Hello, \n\nDoes Datalab work when you follow the instructions in [this quickstart](https://cloud.google.com/datalab/docs/quickstarts)? If not, at what stage do you hit problems?",
      "votes": null
    },
    {
      "id": "234580",
      "postDate": "10/23/2017 16:17:25",
      "content": "<p>Yes, I finished the steps in the quickstart link you provided. I can open the notebook and view it in my browser. But as I move to this \"Quickstart Using Datalab\" (<a href=\"https://cloud.google.com/ml-engine/docs/datalab\">https://cloud.google.com/ml-engine/docs/datalab</a>), I can't run anything in the cells. Does it has anything to do with my browser setting (I am on IE)?</p>",
      "rawMarkdown": "Yes, I finished the steps in the quickstart link you provided. I can open the notebook and view it in my browser. But as I move to this \"Quickstart Using Datalab\" (https://cloud.google.com/ml-engine/docs/datalab), I can't run anything in the cells. Does it has anything to do with my browser setting (I am on IE)?",
      "votes": null
    },
    {
      "id": "254497",
      "postDate": "12/07/2017 03:19:47",
      "content": "<p>It shouldn't make a difference but can you try chrome/firefox. Also can you send a screenshot of where you are blocked? Also can you see what log (or error) messages are you getting on the console (where you started the datalab from) when you try to run the cells?</p>",
      "rawMarkdown": "It shouldn't make a difference but can you try chrome/firefox. Also can you send a screenshot of where you are blocked? Also can you see what log (or error) messages are you getting on the console (where you started the datalab from) when you try to run the cells?",
      "votes": null
    },
    {
      "id": "254530",
      "postDate": "12/07/2017 05:58:54",
      "content": "<p>It is working now. Thank you!</p>",
      "rawMarkdown": "It is working now. Thank you!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 232191,
      "author_name": "lkforward",
      "author_url": "",
      "post_date": "10/17/2017 03:38:04",
      "content": "<p>Can anybody share some experience how to read/preprocess these large image dataset? Either on local machine or on cloud? </p>\n\n<p>Thanks in advance!</p>",
      "votes": null,
      "replies": [
        {
          "id": 232604,
          "author_name": "stevegreenberg",
          "author_url": "",
          "post_date": "10/17/2017 20:57:13",
          "content": "<p>Hello! </p>\n\n<p>You may have already read through both of this. But just in case you haven't, I'd suggest <a href=\"https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/37088\">this tutorial</a> and <a href=\"https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/36337\">this discussion thread</a>.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 232674,
          "author_name": "lkforward",
          "author_url": "",
          "post_date": "10/18/2017 04:05:41",
          "content": "<p>Hi, Steve, </p>\n\n<p>I am new to the cloud infrastructure, and thank you so much for your reply! Actually they are exactly where I started. As far I as I know, I can copy the data into my own storage and use Datalab, where all the common packages like numpy and pandas can be integrated into a jupyter notebook and we can start data preprocessing from there.</p>\n\n<p>But I encountered problem when I started to use Datalab (described in the original question). For this particular dataset, it seems it is only feasible to do it on cloud. But I am not sure whether I am doing things correctly, and and hope anybody can give me some hints. </p>\n\n<p>Thank you!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 233601,
          "author_name": "stevegreenberg",
          "author_url": "",
          "post_date": "10/20/2017 16:38:29",
          "content": "<p>Hi, </p>\n\n<p>Sorry you're running into these problems! I think I need a bit more information to help you debug. It sounds to me like you have a problem getting Datalab to work that's probably generic to Datalab rather than specific to this competition. I suspect either that the Datalab notebook service isn't starting correctly or that somehow your browser isn't able to reach the endpoint opened up by the VM running Datalab. </p>\n\n<p>Have you gone through the <a href=\"https://cloud.google.com/datalab/docs/\">Datalab Getting Started documentation</a> ? </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 234265,
          "author_name": "lkforward",
          "author_url": "",
          "post_date": "10/22/2017 20:16:27",
          "content": "<p>Yes, I have gone through the installation and set up a connection to Datalab, and maybe the problem is caused by the communication between the browser and the Datalab notebook service as you suggested. </p>\n\n<p>Unfortunately, I did not find any forum or maillist to discuss the issues with Datalab, so I am kind of getting stuck here.  Do you have any suggestion or any hint for another way to do it? </p>\n\n<p>Thanks a lot!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 234494,
          "author_name": "stevegreenberg",
          "author_url": "",
          "post_date": "10/23/2017 13:43:19",
          "content": "<p>Hello, </p>\n\n<p>Does Datalab work when you follow the instructions in <a href=\"https://cloud.google.com/datalab/docs/quickstarts\">this quickstart</a>? If not, at what stage do you hit problems? </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 234580,
          "author_name": "lkforward",
          "author_url": "",
          "post_date": "10/23/2017 16:17:25",
          "content": "<p>Yes, I finished the steps in the quickstart link you provided. I can open the notebook and view it in my browser. But as I move to this \"Quickstart Using Datalab\" (<a href=\"https://cloud.google.com/ml-engine/docs/datalab\">https://cloud.google.com/ml-engine/docs/datalab</a>), I can't run anything in the cells. Does it has anything to do with my browser setting (I am on IE)?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 254497,
          "author_name": "puneith",
          "author_url": "",
          "post_date": "12/07/2017 03:19:47",
          "content": "<p>It shouldn't make a difference but can you try chrome/firefox. Also can you send a screenshot of where you are blocked? Also can you see what log (or error) messages are you getting on the console (where you started the datalab from) when you try to run the cells?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 254530,
          "author_name": "lkforward",
          "author_url": "",
          "post_date": "12/07/2017 05:58:54",
          "content": "<p>It is working now. Thank you!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "231760": "I just try to get myself familiar with datalab (for data preprocessing) by following the document, and the best guide I found is the one on the official website (https://cloud.google.com/ml-engine/docs/datalab). I installed the shell, created a new instance of the virtual machine, connected to it, and now I can see the folder (/docs/ and /notebooks/). \n\nHowever, if I open a notebook and try to run some code within it, nothing happened except a “localhost is not responding due to long-running scripts”. I am not running any heavy task, just a simple “hello, world” printing. \n\nI don’t know if I miss anything here. Any hints or suggestions are very welcome.",
    "232191": "Can anybody share some experience how to read/preprocess these large image dataset? Either on local machine or on cloud? \n\nThanks in advance!",
    "232604": "Hello! \n\nYou may have already read through both of this. But just in case you haven't, I'd suggest [this tutorial](https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/37088) and [this discussion thread](https://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/36337).",
    "232674": "Hi, Steve, \n\nI am new to the cloud infrastructure, and thank you so much for your reply! Actually they are exactly where I started. As far I as I know, I can copy the data into my own storage and use Datalab, where all the common packages like numpy and pandas can be integrated into a jupyter notebook and we can start data preprocessing from there.\n\nBut I encountered problem when I started to use Datalab (described in the original question). For this particular dataset, it seems it is only feasible to do it on cloud. But I am not sure whether I am doing things correctly, and and hope anybody can give me some hints. \n\nThank you!",
    "233601": "Hi, \n\nSorry you're running into these problems! I think I need a bit more information to help you debug. It sounds to me like you have a problem getting Datalab to work that's probably generic to Datalab rather than specific to this competition. I suspect either that the Datalab notebook service isn't starting correctly or that somehow your browser isn't able to reach the endpoint opened up by the VM running Datalab. \n\nHave you gone through the [Datalab Getting Started documentation](https://cloud.google.com/datalab/docs/) ?",
    "234265": "Yes, I have gone through the installation and set up a connection to Datalab, and maybe the problem is caused by the communication between the browser and the Datalab notebook service as you suggested. \n\nUnfortunately, I did not find any forum or maillist to discuss the issues with Datalab, so I am kind of getting stuck here.  Do you have any suggestion or any hint for another way to do it? \n\nThanks a lot!",
    "234494": "Hello, \n\nDoes Datalab work when you follow the instructions in [this quickstart](https://cloud.google.com/datalab/docs/quickstarts)? If not, at what stage do you hit problems?",
    "234580": "Yes, I finished the steps in the quickstart link you provided. I can open the notebook and view it in my browser. But as I move to this \"Quickstart Using Datalab\" (https://cloud.google.com/ml-engine/docs/datalab), I can't run anything in the cells. Does it has anything to do with my browser setting (I am on IE)?",
    "254497": "It shouldn't make a difference but can you try chrome/firefox. Also can you send a screenshot of where you are blocked? Also can you see what log (or error) messages are you getting on the console (where you started the datalab from) when you try to run the cells?",
    "254530": "It is working now. Thank you!"
  },
  "source": "meta"
}