I had an issue with the data last night. I downloaded the text version of the data but could not unzip it. Unfortunately, I don't have the particular error on hand. It was late and I deleted the unusable file before I thought to report the error to the\r\n group. It had to do with the root directory not being found. Is anyone else having an issue with this?
\r\nMeanwhile I'll try again today to either get an uncorrupted version of the file or at least be able to report the error correctly.
", "messages": [ { "id": "20234", "postDate": "02/09/2013 17:16:39", "content": "I had an issue with the data last night. I downloaded the text version of the data but could not unzip it. Unfortunately, I don't have the particular error on hand. It was late and I deleted the unusable file before I thought to report the error to the\r\n group. It had to do with the root directory not being found. Is anyone else having an issue with this?
\r\nMeanwhile I'll try again today to either get an uncorrupted version of the file or at least be able to report the error correctly.
", "rawMarkdown": "", "votes": null }, { "id": "20235", "postDate": "02/09/2013 17:22:04", "content": "Usually errors like that are the result of a partially downloaded archive file. I attached a 1-day sample. If you you can open this, then I'd wager you just didn't have the full zip file.
\r\nmd5 hash of mjff_text_files.zip should be 79112d0b5de2b88c4ef7366e6f6e8754
", "rawMarkdown": "", "votes": null }, { "id": "20251", "postDate": "02/10/2013 00:48:53", "content": "William,
\r\nI'm having troubles getting the text files as well, working in a Windows 8 environment. If I take your 1-day sample, unzip and extract to a folder, that gives me ~25 or 30 files, most of which are .txt and a few of which are .csv. Some of the .csv files\r\n look okay, but the .txt files all seem to contain something similar to the following:
\r\n" Mac OS X 2 ß ATTR ß ˜ G ˜ G com.apple.quarantine q/0003;510ff7b3;The\\x20Unarchiver;40AF6621-9E91-43AC-AC9E-170E25A935BB "
\r\nAre these files created on a Mac, and somehow being flagged as "quarantined"?
\r\nThanks!
\r\n", "rawMarkdown": "", "votes": null }, { "id": "20253", "postDate": "02/10/2013 01:25:57", "content": "
Hey Bruce, you might need to explicitly tell your computer that these are tar.bz2 files (bz2 is just a compression algorithm and can't archive files like a zip container.) It\r\n should have 19 files, all with the extension .log or .csv. Some unarchiving programs will have to run twice (once to decompress, and again to open the tarball). Let me know if that makes sense and works. It's working for me in Windows 8 using 7zip.\r\n
\r\nWill
\r\n\r\n
\r\n
\r\n
\r\n
\r\n
\r\n
", "rawMarkdown": "", "votes": null }, { "id": "20256", "postDate": "02/10/2013 04:22:50", "content": "
Thanks, Will. No luck yet with the text files, but in the mean time I tried working some with the binary files, and am having better luck with that. Thanks again for your help.
", "rawMarkdown": "", "votes": null }, { "id": "20333", "postDate": "02/11/2013 18:25:50", "content": "There is a problem with the Accel data in Rose. Lots of 0 values with accelerometer readings not changing for 10 seconds or more, causing lots of problems with the deviation and frequency calculations. This is a recurrent feature for all multiple data files.\r\n When I just remove the zero timepoints and derive simple things like mean standard deviation, Rose is >3 standard deviations from the mean of other subjects.
\r\nWhat do others think? Does anyone else think the scale of the device problem is enough to invalidate that entire data set?
", "rawMarkdown": "", "votes": null }, { "id": "20372", "postDate": "02/12/2013 14:37:06", "content": "For ROSE, there is some data at the beginning (Dates in early/mid November which may be a bit incomplete in terms of accelerometer data.) Whatever was recorded during those time periods for ROSE is usable, but might not be complete. There was a software\r\n problem with that particular phone during the first week we tested that phone, but it was fixed and the data toward the end of November and going into December for ROSE is correct. Hope that helps!
\r\n-DAV
", "rawMarkdown": "", "votes": null }, { "id": "20566", "postDate": "02/18/2013 14:10:07", "content": "Dear all,
\r\nI have two questions regarding the data:
\r\n1) in the data description there is written that "proximity" is binary (on-off);
\r\nwhat do the zero and the one correspond to?
\r\nI mean, does the zero correspond to "the phone is near something (like in the pocket)"?
\r\n2) in the data description there is written that there is the ambient light stream (lux), but I cannot find it in the data; is it there?
\r\nThanks very much,
\r\nLuca
", "rawMarkdown": "", "votes": null }, { "id": "20569", "postDate": "02/18/2013 14:41:43", "content": "Thanks for the question. On the first, I am working to get you an answer. On the second, you'll note there are many packets where there is no data for the light sensors. Generally this is because it was in someone's pocket, so there was no data to record\r\n in those situations. That data is there, just in limited amounts.
\r\nThanks!
", "rawMarkdown": "", "votes": null }, { "id": "20570", "postDate": "02/18/2013 15:02:31", "content": "Thank you.
\r\nLuca
", "rawMarkdown": "", "votes": null }, { "id": "20571", "postDate": "02/18/2013 15:25:24", "content": "The answer to your first question.
\r\nA value of one means the proximity sensor is next to something,
\r\ntypically, that will mean the phone is in the pocket. Under normal use circumstances, it is usually
\r\nused to detect when you put the phone up to your ear.
Usually errors like that are the result of a partially downloaded archive file. I attached a 1-day sample. If you you can open this, then I'd wager you just didn't have the full zip file.
\r\nmd5 hash of mjff_text_files.zip should be 79112d0b5de2b88c4ef7366e6f6e8754
", "votes": null, "replies": [] }, { "id": 20251, "author_name": "bcragin", "author_url": "", "post_date": "02/10/2013 00:48:53", "content": "William,
\r\nI'm having troubles getting the text files as well, working in a Windows 8 environment. If I take your 1-day sample, unzip and extract to a folder, that gives me ~25 or 30 files, most of which are .txt and a few of which are .csv. Some of the .csv files\r\n look okay, but the .txt files all seem to contain something similar to the following:
\r\n" Mac OS X 2 ß ATTR ß ˜ G ˜ G com.apple.quarantine q/0003;510ff7b3;The\\x20Unarchiver;40AF6621-9E91-43AC-AC9E-170E25A935BB "
\r\nAre these files created on a Mac, and somehow being flagged as "quarantined"?
\r\nThanks!
\r\n", "votes": null, "replies": [] }, { "id": 20253, "author_name": "wcukierski", "author_url": "", "post_date": "02/10/2013 01:25:57", "content": "
Hey Bruce, you might need to explicitly tell your computer that these are tar.bz2 files (bz2 is just a compression algorithm and can't archive files like a zip container.) It\r\n should have 19 files, all with the extension .log or .csv. Some unarchiving programs will have to run twice (once to decompress, and again to open the tarball). Let me know if that makes sense and works. It's working for me in Windows 8 using 7zip.\r\n
\r\nWill
\r\n\r\n
\r\n
\r\n
\r\n
\r\n
\r\n
", "votes": null, "replies": [] }, { "id": 20256, "author_name": "bcragin", "author_url": "", "post_date": "02/10/2013 04:22:50", "content": "
Thanks, Will. No luck yet with the text files, but in the mean time I tried working some with the binary files, and am having better luck with that. Thanks again for your help.
", "votes": null, "replies": [] }, { "id": 20333, "author_name": "jamesteo0", "author_url": "", "post_date": "02/11/2013 18:25:50", "content": "There is a problem with the Accel data in Rose. Lots of 0 values with accelerometer readings not changing for 10 seconds or more, causing lots of problems with the deviation and frequency calculations. This is a recurrent feature for all multiple data files.\r\n When I just remove the zero timepoints and derive simple things like mean standard deviation, Rose is >3 standard deviations from the mean of other subjects.
\r\nWhat do others think? Does anyone else think the scale of the device problem is enough to invalidate that entire data set?
", "votes": null, "replies": [] }, { "id": 20372, "author_name": "dvannoni", "author_url": "", "post_date": "02/12/2013 14:37:06", "content": "For ROSE, there is some data at the beginning (Dates in early/mid November which may be a bit incomplete in terms of accelerometer data.) Whatever was recorded during those time periods for ROSE is usable, but might not be complete. There was a software\r\n problem with that particular phone during the first week we tested that phone, but it was fixed and the data toward the end of November and going into December for ROSE is correct. Hope that helps!
\r\n-DAV
", "votes": null, "replies": [] }, { "id": 20566, "author_name": "palme84227", "author_url": "", "post_date": "02/18/2013 14:10:07", "content": "Dear all,
\r\nI have two questions regarding the data:
\r\n1) in the data description there is written that "proximity" is binary (on-off);
\r\nwhat do the zero and the one correspond to?
\r\nI mean, does the zero correspond to "the phone is near something (like in the pocket)"?
\r\n2) in the data description there is written that there is the ambient light stream (lux), but I cannot find it in the data; is it there?
\r\nThanks very much,
\r\nLuca
", "votes": null, "replies": [] }, { "id": 20569, "author_name": "dvannoni", "author_url": "", "post_date": "02/18/2013 14:41:43", "content": "Thanks for the question. On the first, I am working to get you an answer. On the second, you'll note there are many packets where there is no data for the light sensors. Generally this is because it was in someone's pocket, so there was no data to record\r\n in those situations. That data is there, just in limited amounts.
\r\nThanks!
", "votes": null, "replies": [] }, { "id": 20570, "author_name": "palme84227", "author_url": "", "post_date": "02/18/2013 15:02:31", "content": "Thank you.
\r\nLuca
", "votes": null, "replies": [] }, { "id": 20571, "author_name": "dvannoni", "author_url": "", "post_date": "02/18/2013 15:25:24", "content": "The answer to your first question.
\r\nA value of one means the proximity sensor is next to something,
\r\ntypically, that will mean the phone is in the pocket. Under normal use circumstances, it is usually
\r\nused to detect when you put the phone up to your ear.