{
  "id": 18277,
  "title": "AWS - AMI vs. EBS",
  "url": "/competitions/second-annual-data-science-bowl/discussion/18277",
  "author_name": "",
  "post_date": "2016-01-06T19:08:26.793Z",
  "votes": null,
  "comment_count": 3,
  "views": 855,
  "content": "<p>Noob question - but trying to find my way around Amazon AWS EC2. In order to store the dataset- is it better / cheaper to attach an EBS volume (Gp2 volume) to your running instance that is sufficiently large, or should / could one launch an Private AMI image? (which seems to be S3)?  I am getting bit lost in the AWS terminology - and would love some tips - also to avoid a massive bill.... Many thanks -WD</p>",
  "messages": [
    {
      "id": "103819",
      "postDate": "01/06/2016 19:08:26",
      "content": "<p>Noob question - but trying to find my way around Amazon AWS EC2. In order to store the dataset- is it better / cheaper to attach an EBS volume (Gp2 volume) to your running instance that is sufficiently large, or should / could one launch an Private AMI image? (which seems to be S3)?  I am getting bit lost in the AWS terminology - and would love some tips - also to avoid a massive bill.... Many thanks -WD</p>",
      "rawMarkdown": "Noob question - but trying to find my way around Amazon AWS EC2. In order to store the dataset- is it better / cheaper to attach an EBS volume (Gp2 volume) to your running instance that is sufficiently large, or should / could one launch an Private AMI image? (which seems to be S3)?  I am getting bit lost in the AWS terminology - and would love some tips - also to avoid a massive bill.... Many thanks -WD",
      "votes": null
    },
    {
      "id": "103823",
      "postDate": "01/06/2016 19:25:56",
      "content": "<p>Go S3: MXnet can read S3. One may need to tune the algorithm for many time, and turn the machine on and off since the GPU price is high when it is on. EBS would disappear when the machine is turned off.</p>",
      "rawMarkdown": "Go S3: MXnet can read S3. One may need to tune the algorithm for many time, and turn the machine on and off since the GPU price is high when it is on. EBS would disappear when the machine is turned off.",
      "votes": null
    },
    {
      "id": "103867",
      "postDate": "01/07/2016 10:45:03",
      "content": "<p>As far as I understand  AWS: <br>\nEBS can be used without disappearing at the end.</p>\n\n<p>When adding the EBS-volume you can mark it for not deleting when machine is turned off.</p>",
      "rawMarkdown": "As far as I understand  AWS:   \r\nEBS can be used without disappearing at the end.\r\n\r\nWhen adding the EBS-volume you can mark it for not deleting when machine is turned off.",
      "votes": null
    },
    {
      "id": "103868",
      "postDate": "01/07/2016 10:55:49",
      "content": "<p>@justfor - is EBS much more expensive? so far - i have just downloaded data at the command prompt in my AWS instance. I guess that goes into EBS storage? (it is persistent at least). I don't know though whether this is financially stupid - and whether there are better practices. </p>",
      "rawMarkdown": "justfor - is EBS much more expensive? so far - i have just downloaded data at the command prompt in my AWS instance. I guess that goes into EBS storage? (it is persistent at least). I don't know though whether this is financially stupid - and whether there are better practices.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 103823,
      "author_name": "phunter",
      "author_url": "",
      "post_date": "01/06/2016 19:25:56",
      "content": "<p>Go S3: MXnet can read S3. One may need to tune the algorithm for many time, and turn the machine on and off since the GPU price is high when it is on. EBS would disappear when the machine is turned off.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 103867,
      "author_name": "justfor",
      "author_url": "",
      "post_date": "01/07/2016 10:45:03",
      "content": "<p>As far as I understand  AWS: <br>\nEBS can be used without disappearing at the end.</p>\n\n<p>When adding the EBS-volume you can mark it for not deleting when machine is turned off.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 103868,
      "author_name": "wouterd1",
      "author_url": "",
      "post_date": "01/07/2016 10:55:49",
      "content": "<p>@justfor - is EBS much more expensive? so far - i have just downloaded data at the command prompt in my AWS instance. I guess that goes into EBS storage? (it is persistent at least). I don't know though whether this is financially stupid - and whether there are better practices. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "103819": "Noob question - but trying to find my way around Amazon AWS EC2. In order to store the dataset- is it better / cheaper to attach an EBS volume (Gp2 volume) to your running instance that is sufficiently large, or should / could one launch an Private AMI image? (which seems to be S3)?  I am getting bit lost in the AWS terminology - and would love some tips - also to avoid a massive bill.... Many thanks -WD",
    "103823": "Go S3: MXnet can read S3. One may need to tune the algorithm for many time, and turn the machine on and off since the GPU price is high when it is on. EBS would disappear when the machine is turned off.",
    "103867": "As far as I understand  AWS:   \r\nEBS can be used without disappearing at the end.\r\n\r\nWhen adding the EBS-volume you can mark it for not deleting when machine is turned off.",
    "103868": "justfor - is EBS much more expensive? so far - i have just downloaded data at the command prompt in my AWS instance. I guess that goes into EBS storage? (it is persistent at least). I don't know though whether this is financially stupid - and whether there are better practices."
  },
  "source": "meta"
}