{
  "id": 549382,
  "title": "non-wear_flag values between 0 and 1?",
  "url": "/competitions/child-mind-institute-problematic-internet-use/discussion/549382",
  "author_name": "",
  "post_date": "2024-12-02T06:34:06.530368700Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I did value_counts() on non-wear_flag for some parquet files and there are values between 0 and 1.</p>\n<p>For example, participant id 001f3379's data shows like this and more:</p>\n<hr>\n<p>non-wear_flag<br>\n1.000000    252760<br>\n0.000000    129316<br>\n0.011111        80<br>\n0.755556        80<br>\n0.644444        80<br>\n0.650000        80<br>\n0.655556        80<br>\n0.661111        80<br>\n0.666667        80<br>\n0.672222        80<br>\n0.677778        80<br>\n0.683333        80<br>\n0.688889        80<br>\n0.694444        80<br>\n0.700000        80<br>\n0.705556        80<br>\n0.711111        80</p>\n<hr>\n<p>What does it mean??</p>",
  "messages": [
    {
      "id": "3060834",
      "postDate": "12/02/2024 06:34:06",
      "content": "<p>I did value_counts() on non-wear_flag for some parquet files and there are values between 0 and 1.</p>\n<p>For example, participant id 001f3379's data shows like this and more:</p>\n<hr>\n<p>non-wear_flag<br>\n1.000000    252760<br>\n0.000000    129316<br>\n0.011111        80<br>\n0.755556        80<br>\n0.644444        80<br>\n0.650000        80<br>\n0.655556        80<br>\n0.661111        80<br>\n0.666667        80<br>\n0.672222        80<br>\n0.677778        80<br>\n0.683333        80<br>\n0.688889        80<br>\n0.694444        80<br>\n0.700000        80<br>\n0.705556        80<br>\n0.711111        80</p>\n<hr>\n<p>What does it mean??</p>",
      "rawMarkdown": "I did value_counts() on non-wear_flag for some parquet files and there are values between 0 and 1.\n\nFor example, participant id 001f3379's data shows like this and more:\n\n-------------------------------------------------------------------\nnon-wear_flag\n1.000000    252760\n0.000000    129316\n0.011111        80\n0.755556        80\n0.644444        80\n0.650000        80\n0.655556        80\n0.661111        80\n0.666667        80\n0.672222        80\n0.677778        80\n0.683333        80\n0.688889        80\n0.694444        80\n0.700000        80\n0.705556        80\n0.711111        80\n\n-------------------------------------------------------------------\n\nWhat does it mean??",
      "votes": null
    },
    {
      "id": "3061585",
      "postDate": "12/02/2024 20:29:04",
      "content": "<p>nice find. IIUC the participants wore the Actigraph watches. There is a data dictionary PDF here:</p>\n<p><a href=\"https://cdas.cancer.gov/files/download/m4f2pvh160/dictionary_actigraph_10sec.may17.d051117.pdf\" target=\"_blank\">https://cdas.cancer.gov/files/download/m4f2pvh160/dictionary_actigraph_10sec.may17.d051117.pdf</a></p>\n<p>There is commentary about \"partial epochs\" under the <code>Seconds_with_data</code> field. Perhaps the values between 0 and 1 are partial collections? But it is strange that the values are nearly all between 0.6 to 0.8, where I would expect partial collections to be more uniformly distributed between 0 and 1.</p>",
      "rawMarkdown": "nice find. IIUC the participants wore the Actigraph watches. There is a data dictionary PDF here:\n\nhttps://cdas.cancer.gov/files/download/m4f2pvh160/dictionary_actigraph_10sec.may17.d051117.pdf\n\nThere is commentary about \"partial epochs\" under the `Seconds_with_data` field. Perhaps the values between 0 and 1 are partial collections? But it is strange that the values are nearly all between 0.6 to 0.8, where I would expect partial collections to be more uniformly distributed between 0 and 1.",
      "votes": null
    },
    {
      "id": "3061666",
      "postDate": "12/02/2024 22:49:32",
      "content": "<p>I haven't checked this for the non-wear_flag, but there has been some kind of preprocessing for the actigraph data.<br>\nThere are plenty of examples where the values are interpolated, so probably also happened to the non-wear_flag.</p>",
      "rawMarkdown": "I haven't checked this for the non-wear_flag, but there has been some kind of preprocessing for the actigraph data.\nThere are plenty of examples where the values are interpolated, so probably also happened to the non-wear_flag.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3061585,
      "author_name": "josephmarturano",
      "author_url": "",
      "post_date": "12/02/2024 20:29:04",
      "content": "<p>nice find. IIUC the participants wore the Actigraph watches. There is a data dictionary PDF here:</p>\n<p><a href=\"https://cdas.cancer.gov/files/download/m4f2pvh160/dictionary_actigraph_10sec.may17.d051117.pdf\" target=\"_blank\">https://cdas.cancer.gov/files/download/m4f2pvh160/dictionary_actigraph_10sec.may17.d051117.pdf</a></p>\n<p>There is commentary about \"partial epochs\" under the <code>Seconds_with_data</code> field. Perhaps the values between 0 and 1 are partial collections? But it is strange that the values are nearly all between 0.6 to 0.8, where I would expect partial collections to be more uniformly distributed between 0 and 1.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3061666,
      "author_name": "mariusheuser",
      "author_url": "",
      "post_date": "12/02/2024 22:49:32",
      "content": "<p>I haven't checked this for the non-wear_flag, but there has been some kind of preprocessing for the actigraph data.<br>\nThere are plenty of examples where the values are interpolated, so probably also happened to the non-wear_flag.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3060834": "I did value_counts() on non-wear_flag for some parquet files and there are values between 0 and 1.\n\nFor example, participant id 001f3379's data shows like this and more:\n\n-------------------------------------------------------------------\nnon-wear_flag\n1.000000    252760\n0.000000    129316\n0.011111        80\n0.755556        80\n0.644444        80\n0.650000        80\n0.655556        80\n0.661111        80\n0.666667        80\n0.672222        80\n0.677778        80\n0.683333        80\n0.688889        80\n0.694444        80\n0.700000        80\n0.705556        80\n0.711111        80\n\n-------------------------------------------------------------------\n\nWhat does it mean??",
    "3061585": "nice find. IIUC the participants wore the Actigraph watches. There is a data dictionary PDF here:\n\nhttps://cdas.cancer.gov/files/download/m4f2pvh160/dictionary_actigraph_10sec.may17.d051117.pdf\n\nThere is commentary about \"partial epochs\" under the `Seconds_with_data` field. Perhaps the values between 0 and 1 are partial collections? But it is strange that the values are nearly all between 0.6 to 0.8, where I would expect partial collections to be more uniformly distributed between 0 and 1.",
    "3061666": "I haven't checked this for the non-wear_flag, but there has been some kind of preprocessing for the actigraph data.\nThere are plenty of examples where the values are interpolated, so probably also happened to the non-wear_flag."
  },
  "source": "meta"
}