{
  "id": 393835,
  "title": "Missing Valid and Type columns from tcds_defog train datasets",
  "url": "/competitions/tlvmc-parkinsons-freezing-gait-prediction/discussion/393835",
  "author_name": "Tomasz Bartczak",
  "post_date": "2023-03-10T22:33:33.565000",
  "votes": 4,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Reading [<a href=\"https://www.kaggle.com/competitions/tlvmc-parkinsons-freezing-gait-prediction/data](data\" target=\"_blank\">https://www.kaggle.com/competitions/tlvmc-parkinsons-freezing-gait-prediction/data](data</a> description) <code>Trials from the tdcsfog and defog datasets were videotaped and annotated by expert reviewers</code> and later on in column descriptions:</p>\n<pre><code>Valid There were cases during the video annotation that were hard for the annotator to decide if there was an Akinetic (i.e., essentially no movement) FoG or the subject stopped voluntarily. Only event annotations where the series is marked true should be considered as unambiguous.\nTask Series were only annotated where this value is true. Portions marked false should be considered unannotated.\n</code></pre>\n<p>However the <code>tdcsfog</code> dataset do not containt <code>Valid</code> nor <code>Task</code> column. Could you please clarify in the data page - should we assume all datapoints from <code>tdcsfog</code> are annotated and valid, or not?</p>\n<p>See <a href=\"https://www.kaggle.com/code/kretes/eda-task-valid-columns-in-tdcsfog/notebook?scriptVersionId=121715585\" target=\"_blank\">https://www.kaggle.com/code/kretes/eda-task-valid-columns-in-tdcsfog/notebook?scriptVersionId=121715585</a> for the code to check for those cols</p>",
  "messages": [
    {
      "id": 2176782,
      "postDate": "2023-03-10T22:33:33.567Z",
      "content": "<p>Reading [<a href=\"https://www.kaggle.com/competitions/tlvmc-parkinsons-freezing-gait-prediction/data](data\" target=\"_blank\">https://www.kaggle.com/competitions/tlvmc-parkinsons-freezing-gait-prediction/data](data</a> description) <code>Trials from the tdcsfog and defog datasets were videotaped and annotated by expert reviewers</code> and later on in column descriptions:</p>\n<pre><code>Valid There were cases during the video annotation that were hard for the annotator to decide if there was an Akinetic (i.e., essentially no movement) FoG or the subject stopped voluntarily. Only event annotations where the series is marked true should be considered as unambiguous.\nTask Series were only annotated where this value is true. Portions marked false should be considered unannotated.\n</code></pre>\n<p>However the <code>tdcsfog</code> dataset do not containt <code>Valid</code> nor <code>Task</code> column. Could you please clarify in the data page - should we assume all datapoints from <code>tdcsfog</code> are annotated and valid, or not?</p>\n<p>See <a href=\"https://www.kaggle.com/code/kretes/eda-task-valid-columns-in-tdcsfog/notebook?scriptVersionId=121715585\" target=\"_blank\">https://www.kaggle.com/code/kretes/eda-task-valid-columns-in-tdcsfog/notebook?scriptVersionId=121715585</a> for the code to check for those cols</p>",
      "rawMarkdown": "Reading [https://www.kaggle.com/competitions/tlvmc-parkinsons-freezing-gait-prediction/data](data description) `Trials from the tdcsfog and defog datasets were videotaped and annotated by expert reviewers` and later on in column descriptions:\n```\nValid There were cases during the video annotation that were hard for the annotator to decide if there was an Akinetic (i.e., essentially no movement) FoG or the subject stopped voluntarily. Only event annotations where the series is marked true should be considered as unambiguous.\nTask Series were only annotated where this value is true. Portions marked false should be considered unannotated.\n```\n\nHowever the `tdcsfog` dataset do not containt `Valid` nor `Task` column. Could you please clarify in the data page - should we assume all datapoints from `tdcsfog` are annotated and valid, or not?\n\nSee https://www.kaggle.com/code/kretes/eda-task-valid-columns-in-tdcsfog/notebook?scriptVersionId=121715585 for the code to check for those cols",
      "votes": 4
    },
    {
      "id": 2176792,
      "postDate": "2023-03-10T22:44:34.453Z",
      "content": "<p>Yes, you should consider all <code>tdcsfog</code> series to always be annotated and valid. The <code>Valid</code> and <code>Task</code> labels are only relevant for the <code>defog</code> data. I will clarify on the data page.</p>",
      "rawMarkdown": "Yes, you should consider all `tdcsfog` series to always be annotated and valid. The `Valid` and `Task` labels are only relevant for the `defog` data. I will clarify on the data page.",
      "votes": 2
    },
    {
      "id": 2177817,
      "postDate": "2023-03-11T19:57:20.803Z",
      "content": "<p>Considerable, interesting approach on yours \"Task, Valid columns in tdcsfog\" Bartczak.</p>",
      "rawMarkdown": "Considerable, interesting approach on yours \"Task, Valid columns in tdcsfog\" Bartczak."
    },
    {
      "id": 2176798,
      "postDate": "2023-03-10T23:17:26.663Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 2176792,
      "author_name": "Ryan Holbrook",
      "author_url": "",
      "post_date": "2023-03-10T22:44:34.453000",
      "content": "<p>Yes, you should consider all <code>tdcsfog</code> series to always be annotated and valid. The <code>Valid</code> and <code>Task</code> labels are only relevant for the <code>defog</code> data. I will clarify on the data page.</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 2177817,
      "author_name": "Marília Prata",
      "author_url": "",
      "post_date": "2023-03-11T19:57:20.803000",
      "content": "<p>Considerable, interesting approach on yours \"Task, Valid columns in tdcsfog\" Bartczak.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 2176798,
      "author_name": "",
      "author_url": "",
      "post_date": "2023-03-10T23:17:26.663000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2176782": "Reading [https://www.kaggle.com/competitions/tlvmc-parkinsons-freezing-gait-prediction/data](data description) `Trials from the tdcsfog and defog datasets were videotaped and annotated by expert reviewers` and later on in column descriptions:\n```\nValid There were cases during the video annotation that were hard for the annotator to decide if there was an Akinetic (i.e., essentially no movement) FoG or the subject stopped voluntarily. Only event annotations where the series is marked true should be considered as unambiguous.\nTask Series were only annotated where this value is true. Portions marked false should be considered unannotated.\n```\n\nHowever the `tdcsfog` dataset do not containt `Valid` nor `Task` column. Could you please clarify in the data page - should we assume all datapoints from `tdcsfog` are annotated and valid, or not?\n\nSee https://www.kaggle.com/code/kretes/eda-task-valid-columns-in-tdcsfog/notebook?scriptVersionId=121715585 for the code to check for those cols",
    "2176792": "Yes, you should consider all `tdcsfog` series to always be annotated and valid. The `Valid` and `Task` labels are only relevant for the `defog` data. I will clarify on the data page.",
    "2177817": "Considerable, interesting approach on yours \"Task, Valid columns in tdcsfog\" Bartczak.",
    "2176798": ""
  }
}