{
  "id": 477186,
  "title": "How to make Denoising Effectively? ",
  "url": "/competitions/hms-harmful-brain-activity-classification/discussion/477186",
  "author_name": "",
  "post_date": "2024-02-15T05:01:50.134875900Z",
  "votes": 3,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi, Kagglers! 😀</p>\n<h3>BackGroud</h3>\n<p>EEG signals are easily influenced by external factors</p>\n<p><strong>External factors</strong>: <code>Eye Movement</code>, <code>muscle movement</code></p>\n<h3>Method1: Wavelet Transfomer</h3>\n<p><code>Drawbacks</code>: Potential for data loss &amp; Various types of noise with wide frequency bands</p>\n<p>In Chris's How to Make Spectrogram form EEG Notebook<br>\nDmey: <strong>[cv: 0.77 -&gt; cv: 0.82]</strong><br>\nDb8: <strong>[cv: 0.77 -&gt; cv: 0.80]</strong></p>\n<p><code>Alternative</code>: Limiting the range to 0~20Hz using Butter low-pass filtering, followed by denoising within that range.</p>\n<p>In Chris's WaveNet Starter Notebook<br>\nAfter Butter Low Pass Filtering<br>\nStratifiedGroupKFold: <strong>cv: 0.843</strong><br>\nStratifiedGroupdKFold &amp; db6: <strong>cv: 0.822</strong></p>\n<h3>Method2: Neural Network</h3>\n<p>But also, There are also a lot of method to denoise</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F16438831%2Fa78ff0da73185bd94aab913b4b62209d%2FDenosing.PNG?generation=1707973197689105&amp;alt=media\"></p>\n<p>🎯 <strong>I think if you want to make NN, it seems like good to build just simple CNN</strong></p>\n<p>If you have any idea, feel free to tell me! Thanks for reading  </p>",
  "messages": [
    {
      "id": "2652915",
      "postDate": "02/15/2024 05:01:50",
      "content": "<p>Hi, Kagglers! 😀</p>\n<h3>BackGroud</h3>\n<p>EEG signals are easily influenced by external factors</p>\n<p><strong>External factors</strong>: <code>Eye Movement</code>, <code>muscle movement</code></p>\n<h3>Method1: Wavelet Transfomer</h3>\n<p><code>Drawbacks</code>: Potential for data loss &amp; Various types of noise with wide frequency bands</p>\n<p>In Chris's How to Make Spectrogram form EEG Notebook<br>\nDmey: <strong>[cv: 0.77 -&gt; cv: 0.82]</strong><br>\nDb8: <strong>[cv: 0.77 -&gt; cv: 0.80]</strong></p>\n<p><code>Alternative</code>: Limiting the range to 0~20Hz using Butter low-pass filtering, followed by denoising within that range.</p>\n<p>In Chris's WaveNet Starter Notebook<br>\nAfter Butter Low Pass Filtering<br>\nStratifiedGroupKFold: <strong>cv: 0.843</strong><br>\nStratifiedGroupdKFold &amp; db6: <strong>cv: 0.822</strong></p>\n<h3>Method2: Neural Network</h3>\n<p>But also, There are also a lot of method to denoise</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F16438831%2Fa78ff0da73185bd94aab913b4b62209d%2FDenosing.PNG?generation=1707973197689105&amp;alt=media\"></p>\n<p>🎯 <strong>I think if you want to make NN, it seems like good to build just simple CNN</strong></p>\n<p>If you have any idea, feel free to tell me! Thanks for reading  </p>",
      "rawMarkdown": "Hi, Kagglers! 😀\n\n###BackGroud\nEEG signals are easily influenced by external factors\n\n**External factors**: `Eye Movement`, `muscle movement`\n\n###Method1: Wavelet Transfomer\n`Drawbacks`: Potential for data loss & Various types of noise with wide frequency bands\n\nIn Chris's How to Make Spectrogram form EEG Notebook\nDmey: **[cv: 0.77 -> cv: 0.82]**\nDb8: **[cv: 0.77 -> cv: 0.80]**\n\n`Alternative`: Limiting the range to 0~20Hz using Butter low-pass filtering, followed by denoising within that range.\n\nIn Chris's WaveNet Starter Notebook\nAfter Butter Low Pass Filtering\nStratifiedGroupKFold: **cv: 0.843**\nStratifiedGroupdKFold & db6: **cv: 0.822**\n\n###Method2: Neural Network\nBut also, There are also a lot of method to denoise\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F16438831%2Fa78ff0da73185bd94aab913b4b62209d%2FDenosing.PNG?generation=1707973197689105&alt=media)\n\n🎯 **I think if you want to make NN, it seems like good to build just simple CNN**\n\nIf you have any idea, feel free to tell me! Thanks for reading",
      "votes": null
    },
    {
      "id": "2654118",
      "postDate": "02/15/2024 21:50:04",
      "content": "<p>what do you think of these articles:<br>\nA multi-artifact EEG denoising by frequency-based<br>\ndeep learning <br>\n<a href=\"https://arxiv.org/pdf/2310.17335.pdf\" target=\"_blank\">https://arxiv.org/pdf/2310.17335.pdf</a><br>\nA novel convolutional neural network model to remove<br>\nmuscle artifacts from EEG<br>\n<a href=\"https://arxiv.org/pdf/2010.11709.pdf\" target=\"_blank\">https://arxiv.org/pdf/2010.11709.pdf</a></p>\n<p>They seem to use : <a href=\"https://github.com/ncclabsustech/EEGdenoiseNet\" target=\"_blank\">https://github.com/ncclabsustech/EEGdenoiseNet</a> to dataset to purely just denoise to pure EEGs:<br>\ndo you think there are ways to use this for our use case?</p>",
      "rawMarkdown": "what do you think of these articles:\nA multi-artifact EEG denoising by frequency-based\ndeep learning \nhttps://arxiv.org/pdf/2310.17335.pdf\nA novel convolutional neural network model to remove\nmuscle artifacts from EEG\nhttps://arxiv.org/pdf/2010.11709.pdf\n\nThey seem to use : https://github.com/ncclabsustech/EEGdenoiseNet to dataset to purely just denoise to pure EEGs:\ndo you think there are ways to use this for our use case?",
      "votes": null
    },
    {
      "id": "2654347",
      "postDate": "02/16/2024 04:59:11",
      "content": "<p>First of all, Thanks for sharing good Document! <br>\nIf you want to use EEGdenoiseNet, you need pure EEGs signal. <br>\nBut as you know, in kaggle dataset there's no pure eeg signal. </p>\n<p>So, you have to make <strong>pure eegs with filtering or transforming.</strong></p>\n<p>🎯 But, in my opinion it's better just use filtering and transforming not CNN Models</p>\n<p>🎯 and in my experiement, it was good to use Wavlet after filtering! </p>",
      "rawMarkdown": "First of all, Thanks for sharing good Document! \nIf you want to use EEGdenoiseNet, you need pure EEGs signal. \nBut as you know, in kaggle dataset there's no pure eeg signal. \n\nSo, you have to make **pure eegs with filtering or transforming.**\n\n🎯 But, in my opinion it's better just use filtering and transforming not CNN Models\n\n🎯 and in my experiement, it was good to use Wavlet after filtering!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2654118,
      "author_name": "tashin47",
      "author_url": "",
      "post_date": "02/15/2024 21:50:04",
      "content": "<p>what do you think of these articles:<br>\nA multi-artifact EEG denoising by frequency-based<br>\ndeep learning <br>\n<a href=\"https://arxiv.org/pdf/2310.17335.pdf\" target=\"_blank\">https://arxiv.org/pdf/2310.17335.pdf</a><br>\nA novel convolutional neural network model to remove<br>\nmuscle artifacts from EEG<br>\n<a href=\"https://arxiv.org/pdf/2010.11709.pdf\" target=\"_blank\">https://arxiv.org/pdf/2010.11709.pdf</a></p>\n<p>They seem to use : <a href=\"https://github.com/ncclabsustech/EEGdenoiseNet\" target=\"_blank\">https://github.com/ncclabsustech/EEGdenoiseNet</a> to dataset to purely just denoise to pure EEGs:<br>\ndo you think there are ways to use this for our use case?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2654347,
          "author_name": "seoyunje",
          "author_url": "",
          "post_date": "02/16/2024 04:59:11",
          "content": "<p>First of all, Thanks for sharing good Document! <br>\nIf you want to use EEGdenoiseNet, you need pure EEGs signal. <br>\nBut as you know, in kaggle dataset there's no pure eeg signal. </p>\n<p>So, you have to make <strong>pure eegs with filtering or transforming.</strong></p>\n<p>🎯 But, in my opinion it's better just use filtering and transforming not CNN Models</p>\n<p>🎯 and in my experiement, it was good to use Wavlet after filtering! </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2652915": "Hi, Kagglers! 😀\n\n###BackGroud\nEEG signals are easily influenced by external factors\n\n**External factors**: `Eye Movement`, `muscle movement`\n\n###Method1: Wavelet Transfomer\n`Drawbacks`: Potential for data loss & Various types of noise with wide frequency bands\n\nIn Chris's How to Make Spectrogram form EEG Notebook\nDmey: **[cv: 0.77 -> cv: 0.82]**\nDb8: **[cv: 0.77 -> cv: 0.80]**\n\n`Alternative`: Limiting the range to 0~20Hz using Butter low-pass filtering, followed by denoising within that range.\n\nIn Chris's WaveNet Starter Notebook\nAfter Butter Low Pass Filtering\nStratifiedGroupKFold: **cv: 0.843**\nStratifiedGroupdKFold & db6: **cv: 0.822**\n\n###Method2: Neural Network\nBut also, There are also a lot of method to denoise\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F16438831%2Fa78ff0da73185bd94aab913b4b62209d%2FDenosing.PNG?generation=1707973197689105&alt=media)\n\n🎯 **I think if you want to make NN, it seems like good to build just simple CNN**\n\nIf you have any idea, feel free to tell me! Thanks for reading",
    "2654118": "what do you think of these articles:\nA multi-artifact EEG denoising by frequency-based\ndeep learning \nhttps://arxiv.org/pdf/2310.17335.pdf\nA novel convolutional neural network model to remove\nmuscle artifacts from EEG\nhttps://arxiv.org/pdf/2010.11709.pdf\n\nThey seem to use : https://github.com/ncclabsustech/EEGdenoiseNet to dataset to purely just denoise to pure EEGs:\ndo you think there are ways to use this for our use case?",
    "2654347": "First of all, Thanks for sharing good Document! \nIf you want to use EEGdenoiseNet, you need pure EEGs signal. \nBut as you know, in kaggle dataset there's no pure eeg signal. \n\nSo, you have to make **pure eegs with filtering or transforming.**\n\n🎯 But, in my opinion it's better just use filtering and transforming not CNN Models\n\n🎯 and in my experiement, it was good to use Wavlet after filtering!"
  },
  "source": "meta"
}