{
  "id": 9940,
  "title": "Is the data available in an open data format, not matlab?",
  "url": "/competitions/seizure-detection/discussion/9940",
  "author_name": "Ben Rayfield",
  "post_date": "2014-08-03T21:28:12.963000",
  "votes": 0,
  "comment_count": 16,
  "views": 4471,
  "content": "<p>I do not have matlab nor do I want to involve myself in their approval and trial process when I have no intention of using matlab for anything more than to copy the data into a usable format, such as an audio file of n channels for the electrodes, a csv of numbers, a database format, xml, or many other possible open formats for arrays of numbers.</p>",
  "messages": [
    {
      "id": 51832,
      "postDate": "2014-08-10T18:32:17.677Z",
      "content": "<p>clips.tar. I am still unzipping this file. One time i did it before it gave me a big 46gb document file that is junk..I assume as per my understanding it should be three .mat files. kindly correct me if i m wrong.</p>",
      "votes": 1
    },
    {
      "id": 51589,
      "postDate": "2014-08-04T07:36:21.820Z",
      "content": "<p>Hi Lalit,</p>\n<p>You could probably load .mat files in VBA, using a library, .mat API or a workaround (invoking Excel and having that read and save it).</p>\n<p>Else you could write a short Python script to convert the .mat files to .csv files with meta-data intact. Let me know if you can work it out, else I (or another Kaggler) may post such a conversion script here.</p>\n<p>Good luck!&nbsp;</p>",
      "votes": 1
    },
    {
      "id": 51571,
      "postDate": "2014-08-03T22:34:28.560Z",
      "content": "<p>Most languages can read .mat files:</p>\n<p>http://stackoverflow.com/questions/874461/read-mat-files-in-python</p>\n<p>http://cran.r-project.org/web/packages/R.matlab/R.matlab.pdf</p>",
      "votes": 2
    },
    {
      "id": 52072,
      "postDate": "2014-08-15T22:41:21.720Z",
      "content": "<p>Thank you, this was helpful to me. I had the same exact problem and the solution you suggested solved it .&nbsp;</p>"
    },
    {
      "id": 51840,
      "postDate": "2014-08-10T19:22:52.107Z",
      "content": "<p>@Lalit Thank you very much for prompt reply.</p>"
    },
    {
      "id": 51839,
      "postDate": "2014-08-10T19:22:03.833Z",
      "content": "<p>[deleted]</p>"
    },
    {
      "id": 51838,
      "postDate": "2014-08-10T19:21:13.750Z",
      "content": "<p>Yes, that's what I too got. Each file corresponds to EEG of a certain time interval.</p>"
    },
    {
      "id": 51837,
      "postDate": "2014-08-10T19:03:55.617Z",
      "content": "<p>I got Patient_1.. Patient_8 and Dog_1 to Dog_4 . Each folder has multiple .mat files..</p>"
    },
    {
      "id": 51835,
      "postDate": "2014-08-10T19:02:24.123Z",
      "content": "<p>@Lalit Thank you..I got it unzipped using gunzip -c clips.tar.gz | tar xopf -<br><br></p>"
    },
    {
      "id": 51834,
      "postDate": "2014-08-10T19:01:26.627Z",
      "content": "<p>Lenin:</p>\n<p>Extraction of the clips.gz file using WinRAR program gave me a huge no-extension file. After renaming the clips.gz file as clips.tar.gz, the extraction gave me several .mat files. I hope this &quot;trick&quot; helps you.</p>"
    },
    {
      "id": 51818,
      "postDate": "2014-08-10T12:06:48.067Z",
      "content": "<p>Value of<strong> data_length_sec</strong> field is <em>1 second</em> by default as mentioned <a href=\"https://www.kaggle.com/c/seizure-detection/data\">here</a>.</p>"
    },
    {
      "id": 51711,
      "postDate": "2014-08-07T13:01:34.297Z",
      "content": "<p>I loaded the sample clip in R. There are only 4 fields in the R object created viz. data,freq,latency and channels. The field &quot;data_length_sec' is missing. Is anybody using R facing a similar problem ? I am still downloading the training data. Thanks for your help.</p>"
    },
    {
      "id": 51597,
      "postDate": "2014-08-04T12:30:22.057Z",
      "content": "<p>Thanks to William, Trieskelion, and Matt77 for very useful information. &nbsp;(For this Challenge, I am using and learning and enjoying R.)</p>"
    },
    {
      "id": 51580,
      "postDate": "2014-08-04T02:35:07.150Z",
      "content": "<p>The xml data format is very good when not all fields are filled in all records. It is not good when all fields are filled in all records and the records are voluminous, because its overhead of adding tags to separate the fields &amp; records increases the file-size. (This is as per my understanding.)</p>"
    },
    {
      "id": 51576,
      "postDate": "2014-08-04T01:40:23.797Z",
      "content": "<p><span style=\"line-height: 1.4\">I searched for, but did not find, a MatLab-to-VBA adapter for reading .mat files in VBA.</span></p>\n<p>As I understand, MatLab is much faster and neater than spreadsheet programs for data processing tasks.</p>"
    },
    {
      "id": 51569,
      "postDate": "2014-08-03T21:28:12.963Z",
      "content": "<p>I do not have matlab nor do I want to involve myself in their approval and trial process when I have no intention of using matlab for anything more than to copy the data into a usable format, such as an audio file of n channels for the electrodes, a csv of numbers, a database format, xml, or many other possible open formats for arrays of numbers.</p>"
    },
    {
      "id": 51591,
      "postDate": "2014-08-04T08:02:00.920Z",
      "rawMarkdown": "",
      "votes": 1,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 51832,
      "author_name": "lenin",
      "author_url": "",
      "post_date": "2014-08-10T18:32:17.677000",
      "content": "<p>clips.tar. I am still unzipping this file. One time i did it before it gave me a big 46gb document file that is junk..I assume as per my understanding it should be three .mat files. kindly correct me if i m wrong.</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 51589,
      "author_name": "Triskelion",
      "author_url": "",
      "post_date": "2014-08-04T07:36:21.820000",
      "content": "<p>Hi Lalit,</p>\n<p>You could probably load .mat files in VBA, using a library, .mat API or a workaround (invoking Excel and having that read and save it).</p>\n<p>Else you could write a short Python script to convert the .mat files to .csv files with meta-data intact. Let me know if you can work it out, else I (or another Kaggler) may post such a conversion script here.</p>\n<p>Good luck!&nbsp;</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 51571,
      "author_name": "Will Cukierski",
      "author_url": "",
      "post_date": "2014-08-03T22:34:28.560000",
      "content": "<p>Most languages can read .mat files:</p>\n<p>http://stackoverflow.com/questions/874461/read-mat-files-in-python</p>\n<p>http://cran.r-project.org/web/packages/R.matlab/R.matlab.pdf</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 52072,
      "author_name": "Z.Z.",
      "author_url": "",
      "post_date": "2014-08-15T22:41:21.720000",
      "content": "<p>Thank you, this was helpful to me. I had the same exact problem and the solution you suggested solved it .&nbsp;</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51840,
      "author_name": "lenin",
      "author_url": "",
      "post_date": "2014-08-10T19:22:52.107000",
      "content": "<p>@Lalit Thank you very much for prompt reply.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51839,
      "author_name": "Lalit",
      "author_url": "",
      "post_date": "2014-08-10T19:22:03.833000",
      "content": "<p>[deleted]</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51838,
      "author_name": "Lalit",
      "author_url": "",
      "post_date": "2014-08-10T19:21:13.750000",
      "content": "<p>Yes, that's what I too got. Each file corresponds to EEG of a certain time interval.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51837,
      "author_name": "lenin",
      "author_url": "",
      "post_date": "2014-08-10T19:03:55.617000",
      "content": "<p>I got Patient_1.. Patient_8 and Dog_1 to Dog_4 . Each folder has multiple .mat files..</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51835,
      "author_name": "lenin",
      "author_url": "",
      "post_date": "2014-08-10T19:02:24.123000",
      "content": "<p>@Lalit Thank you..I got it unzipped using gunzip -c clips.tar.gz | tar xopf -<br><br></p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51834,
      "author_name": "Lalit",
      "author_url": "",
      "post_date": "2014-08-10T19:01:26.627000",
      "content": "<p>Lenin:</p>\n<p>Extraction of the clips.gz file using WinRAR program gave me a huge no-extension file. After renaming the clips.gz file as clips.tar.gz, the extraction gave me several .mat files. I hope this &quot;trick&quot; helps you.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51818,
      "author_name": "Pranav Kant Gaur",
      "author_url": "",
      "post_date": "2014-08-10T12:06:48.067000",
      "content": "<p>Value of<strong> data_length_sec</strong> field is <em>1 second</em> by default as mentioned <a href=\"https://www.kaggle.com/c/seizure-detection/data\">here</a>.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51711,
      "author_name": "rashmirn",
      "author_url": "",
      "post_date": "2014-08-07T13:01:34.297000",
      "content": "<p>I loaded the sample clip in R. There are only 4 fields in the R object created viz. data,freq,latency and channels. The field &quot;data_length_sec' is missing. Is anybody using R facing a similar problem ? I am still downloading the training data. Thanks for your help.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51597,
      "author_name": "Lalit",
      "author_url": "",
      "post_date": "2014-08-04T12:30:22.057000",
      "content": "<p>Thanks to William, Trieskelion, and Matt77 for very useful information. &nbsp;(For this Challenge, I am using and learning and enjoying R.)</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51580,
      "author_name": "Lalit",
      "author_url": "",
      "post_date": "2014-08-04T02:35:07.150000",
      "content": "<p>The xml data format is very good when not all fields are filled in all records. It is not good when all fields are filled in all records and the records are voluminous, because its overhead of adding tags to separate the fields &amp; records increases the file-size. (This is as per my understanding.)</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51576,
      "author_name": "Lalit",
      "author_url": "",
      "post_date": "2014-08-04T01:40:23.797000",
      "content": "<p><span style=\"line-height: 1.4\">I searched for, but did not find, a MatLab-to-VBA adapter for reading .mat files in VBA.</span></p>\n<p>As I understand, MatLab is much faster and neater than spreadsheet programs for data processing tasks.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 51591,
      "author_name": "",
      "author_url": "",
      "post_date": "2014-08-04T08:02:00.920000",
      "content": "",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "51832": "",
    "51589": "",
    "51571": "",
    "52072": "",
    "51840": "",
    "51839": "",
    "51838": "",
    "51837": "",
    "51835": "",
    "51834": "",
    "51818": "",
    "51711": "",
    "51597": "",
    "51580": "",
    "51576": "",
    "51569": "",
    "51591": ""
  }
}