{
  "id": 471783,
  "title": "Patients - might have some valuable features to extract",
  "url": "/competitions/hms-harmful-brain-activity-classification/discussion/471783",
  "author_name": "",
  "post_date": "2024-01-29T15:11:12.010871300Z",
  "votes": 28,
  "comment_count": 13,
  "views": 0,
  "content": "<p>Learning some domain knowledge the hard way.  Girlfriend had brain bleeds, needed surgery at Christmas to stop the bleeds and was in the process of recovering.  Recently she started having seizures.  She's scheduled for an EEG in a week.</p>\n<p>What I have learned so far would seem to suggest that the patients_id has some valuable information to extract, perhaps easily usable for those using tabular methods.  Of course, like any good kaggle competion we know nothing about the patients.  We do know the number of patients and the number of rows of data per patient.</p>\n<p>My girlfriend was proscribed a drug for seizure prevention.  They had hoped to get her down to a minimum amount per day before the eeg.  In her case, that's not going to happen as seizures returned on the lower dose, and she's likely to end up with high dose after a consult tomorrow. <br>\nCan we expect to see medication effects with variation,  over the count of data rows per patient?</p>\n<p>For the test she's to arrive with clean hair, with no hair products.  Could we expect to see a difference per patients like her (full head of long great looking hair) vs scans for me (pretty much bald in all probe areas).</p>\n<p>For the test - no caffeine for 12 hours prior.  Around the 12 hour mark is the point were I start to get a lack of caffeine headache.  Can we expect differences per patient based on caffeine or other similar products.</p>\n<p>For the test - suggestion to stay up late the night before the test and try to arrive in a tired state, rather than well rested state.  According to ChatGPT the normal recommendation is to arrive well rested.  Different seizure types can have different directions for this feature.</p>\n<p>Hopefully a second eeg in a few months will show a huge difference in seizure related signals.  Can we expect that some patient scans show the last detectable seizure signal close to full recovery?</p>",
  "messages": [
    {
      "id": "2625753",
      "postDate": "01/29/2024 15:11:12",
      "content": "<p>Learning some domain knowledge the hard way.  Girlfriend had brain bleeds, needed surgery at Christmas to stop the bleeds and was in the process of recovering.  Recently she started having seizures.  She's scheduled for an EEG in a week.</p>\n<p>What I have learned so far would seem to suggest that the patients_id has some valuable information to extract, perhaps easily usable for those using tabular methods.  Of course, like any good kaggle competion we know nothing about the patients.  We do know the number of patients and the number of rows of data per patient.</p>\n<p>My girlfriend was proscribed a drug for seizure prevention.  They had hoped to get her down to a minimum amount per day before the eeg.  In her case, that's not going to happen as seizures returned on the lower dose, and she's likely to end up with high dose after a consult tomorrow. <br>\nCan we expect to see medication effects with variation,  over the count of data rows per patient?</p>\n<p>For the test she's to arrive with clean hair, with no hair products.  Could we expect to see a difference per patients like her (full head of long great looking hair) vs scans for me (pretty much bald in all probe areas).</p>\n<p>For the test - no caffeine for 12 hours prior.  Around the 12 hour mark is the point were I start to get a lack of caffeine headache.  Can we expect differences per patient based on caffeine or other similar products.</p>\n<p>For the test - suggestion to stay up late the night before the test and try to arrive in a tired state, rather than well rested state.  According to ChatGPT the normal recommendation is to arrive well rested.  Different seizure types can have different directions for this feature.</p>\n<p>Hopefully a second eeg in a few months will show a huge difference in seizure related signals.  Can we expect that some patient scans show the last detectable seizure signal close to full recovery?</p>",
      "rawMarkdown": "Learning some domain knowledge the hard way.  Girlfriend had brain bleeds, needed surgery at Christmas to stop the bleeds and was in the process of recovering.  Recently she started having seizures.  She's scheduled for an EEG in a week.\n\nWhat I have learned so far would seem to suggest that the patients_id has some valuable information to extract, perhaps easily usable for those using tabular methods.  Of course, like any good kaggle competion we know nothing about the patients.  We do know the number of patients and the number of rows of data per patient.\n\nMy girlfriend was proscribed a drug for seizure prevention.  They had hoped to get her down to a minimum amount per day before the eeg.  In her case, that's not going to happen as seizures returned on the lower dose, and she's likely to end up with high dose after a consult tomorrow. \nCan we expect to see medication effects with variation,  over the count of data rows per patient?\n\nFor the test she's to arrive with clean hair, with no hair products.  Could we expect to see a difference per patients like her (full head of long great looking hair) vs scans for me (pretty much bald in all probe areas).\n\nFor the test - no caffeine for 12 hours prior.  Around the 12 hour mark is the point were I start to get a lack of caffeine headache.  Can we expect differences per patient based on caffeine or other similar products.\n\nFor the test - suggestion to stay up late the night before the test and try to arrive in a tired state, rather than well rested state.  According to ChatGPT the normal recommendation is to arrive well rested.  Different seizure types can have different directions for this feature.\n\nHopefully a second eeg in a few months will show a huge difference in seizure related signals.  Can we expect that some patient scans show the last detectable seizure signal close to full recovery?",
      "votes": null
    },
    {
      "id": "2625766",
      "postDate": "01/29/2024 15:20:06",
      "content": "<p>Best wishes to your girlfriend, hope your girlfriend gets well soon.</p>",
      "rawMarkdown": "Best wishes to your girlfriend, hope your girlfriend gets well soon.",
      "votes": null
    },
    {
      "id": "2625796",
      "postDate": "01/29/2024 16:04:43",
      "content": "<p>hope your girlfriend gets well soon bro, and may all the efforts put in by the kagglers in every game actually apply and help people</p>",
      "rawMarkdown": "hope your girlfriend gets well soon bro, and may all the efforts put in by the kagglers in every game actually apply and help people",
      "votes": null
    },
    {
      "id": "2625872",
      "postDate": "01/29/2024 17:19:04",
      "content": "<p>I think this small variations ( hair, caffeine, rest…) are already covered by agreement intervals. You can create a feature and calculate the percentual of votes that each brain activity class received. High agreements are expected to be correlated with exams with clear signals. <br>\nOther important thing to mention is that diagnosis with more expert votes are more reliable than diagnosis with fewer expert votes.</p>",
      "rawMarkdown": "I think this small variations ( hair, caffeine, rest...) are already covered by agreement intervals. You can create a feature and calculate the percentual of votes that each brain activity class received. High agreements are expected to be correlated with exams with clear signals. \nOther important thing to mention is that diagnosis with more expert votes are more reliable than diagnosis with fewer expert votes.",
      "votes": null
    },
    {
      "id": "2625947",
      "postDate": "01/29/2024 17:49:32",
      "content": "<p>Thanks - it's amazing how much life can change with one small incident.  Her dog chased after a rabbit on walk, while on a retractable leash.  See did not see him take off and got pulled to the ground with he hit the end of the leash.</p>",
      "rawMarkdown": "Thanks - it's amazing how much life can change with one small incident.  Her dog chased after a rabbit on walk, while on a retractable leash.  See did not see him take off and got pulled to the ground with he hit the end of the leash.",
      "votes": null
    },
    {
      "id": "2625952",
      "postDate": "01/29/2024 17:51:27",
      "content": "<p>Thanks - does make a person appreciate the value of what can be gained by kagglers helping to improve medical diagnosis.</p>",
      "rawMarkdown": "Thanks - does make a person appreciate the value of what can be gained by kagglers helping to improve medical diagnosis.",
      "votes": null
    },
    {
      "id": "2625954",
      "postDate": "01/29/2024 17:53:36",
      "content": "<p>It's sorry to hear that. Life is so uncertain, just like the shake in private leaderboard.</p>",
      "rawMarkdown": "It's sorry to hear that. Life is so uncertain, just like the shake in private leaderboard.",
      "votes": null
    },
    {
      "id": "2625959",
      "postDate": "01/29/2024 17:56:40",
      "content": "<p>Not sure I have seen any shared notebooks were 'within patient' features have been generated that address this - I need to look again.  </p>",
      "rawMarkdown": "Not sure I have seen any shared notebooks were 'within patient' features have been generated that address this - I need to look again.",
      "votes": null
    },
    {
      "id": "2625960",
      "postDate": "01/29/2024 17:57:36",
      "content": "<p>Now that's funny !!!</p>",
      "rawMarkdown": "Now that's funny !!!",
      "votes": null
    },
    {
      "id": "2626548",
      "postDate": "01/30/2024 05:26:56",
      "content": "<p>You are right, and I am trying.</p>",
      "rawMarkdown": "You are right, and I am trying.",
      "votes": null
    },
    {
      "id": "2627532",
      "postDate": "01/30/2024 18:06:03",
      "content": "<p>I've been analyzing the data structure of the competition and a question arose: <br>\n1- Are the patient_ids in the test dataset the same as those in the training dataset? <br>\n   If yes, this could open up a range of possibilities for exploring individual patient characteristics in the modeling phase. <br>\n   On the other hand, if the patient_ids in the test dataset are different from those in the training dataset, it suggests that a 'group fold' type of separation method was applied in data preparation. </p>",
      "rawMarkdown": "I've been analyzing the data structure of the competition and a question arose: \n1- Are the patient_ids in the test dataset the same as those in the training dataset? \n   If yes, this could open up a range of possibilities for exploring individual patient characteristics in the modeling phase. \n   On the other hand, if the patient_ids in the test dataset are different from those in the training dataset, it suggests that a 'group fold' type of separation method was applied in data preparation.",
      "votes": null
    },
    {
      "id": "2628036",
      "postDate": "01/31/2024 04:31:04",
      "content": "<p>Does not appear that any train patients are in test.   </p>\n<p>There are two types of possible ‘within patient’ information.   Multiple target values within a single scan, and multiple eeg ids for the same patient.   I think both are still source of information for models even if no train patients are in test.  </p>\n<p>20 years ago I would have called the first measurement error and the second repeatability.  </p>",
      "rawMarkdown": "Does not appear that any train patients are in test.   \n\nThere are two types of possible ‘within patient’ information.   Multiple target values within a single scan, and multiple eeg ids for the same patient.   I think both are still source of information for models even if no train patients are in test.  \n\n20 years ago I would have called the first measurement error and the second repeatability.",
      "votes": null
    },
    {
      "id": "2629574",
      "postDate": "01/31/2024 21:36:43",
      "content": "<p><a href=\"https://www.kaggle.com/PC\" target=\"_blank\">@PC</a> JIMMY All the best for the lady. I had a similar incident some years ago. Except good doctors, methods and diagnoses a good amount of luck is needed</p>",
      "rawMarkdown": "PC JIMMY All the best for the lady. I had a similar incident some years ago. Except good doctors, methods and diagnoses a good amount of luck is needed",
      "votes": null
    },
    {
      "id": "2668085",
      "postDate": "02/25/2024 14:00:50",
      "content": "<p>Girlfriend update:</p>\n<p>Had a CT Scan a few days ago.  Report shows huge reduction of the amount of blood on the brain.  No seizure's since I first posted this a month ago.</p>\n<p>After getting out of hospital in December she could barely walk.  She's now doing 6 miles or more per day, dragging me along for 3 of them in the afternoon.  </p>\n<p>Still on meds, but expecting a reduction in the amount at this coming weeks doctor visit.  </p>\n<p>I am guessing based on her improvement that there will be no second eeg.  It was an hour long session in hospital so I assume a bit costly.</p>\n<p>Take-aways from this for our competition.</p>\n<ol>\n<li>No question in my mind that a eeg taken before her brain surgery would look vastly different than one taken today, or the one she did have a few weeks ago.  In a discussion post or two the question has been raised if we know the time order of data for a patient.  Very safe assumtion that eeg_id are correctly ordered by sub_eeg_id.  But is there a time order for different spectograms on a single patient that we can identify.</li>\n<li>Surgery would have changed a lot in her eeg.  I took her to hospital as she was a real mess - pretty sure that would show up on eeg.  The day after the surgery, she was very weak, but clearly her brain had changed heading back towards normal.  eeg right after surgery would have to have been different.</li>\n<li>Medications to reduce / eliminate seizures will impact eeg.</li>\n<li>While in hospital before surgery her stress levels were very high - her heart beat rate was almost always 15 or more beats per minute faster than I know her normal resting rate to be.  On my todo list - can the heart beat info tell us something.</li>\n</ol>",
      "rawMarkdown": "Girlfriend update:\n\nHad a CT Scan a few days ago.  Report shows huge reduction of the amount of blood on the brain.  No seizure's since I first posted this a month ago.\n\nAfter getting out of hospital in December she could barely walk.  She's now doing 6 miles or more per day, dragging me along for 3 of them in the afternoon.  \n\nStill on meds, but expecting a reduction in the amount at this coming weeks doctor visit.  \n\nI am guessing based on her improvement that there will be no second eeg.  It was an hour long session in hospital so I assume a bit costly.\n\nTake-aways from this for our competition.\n\n1.  No question in my mind that a eeg taken before her brain surgery would look vastly different than one taken today, or the one she did have a few weeks ago.  In a discussion post or two the question has been raised if we know the time order of data for a patient.  Very safe assumtion that eeg_id are correctly ordered by sub_eeg_id.  But is there a time order for different spectograms on a single patient that we can identify.\n2.  Surgery would have changed a lot in her eeg.  I took her to hospital as she was a real mess - pretty sure that would show up on eeg.  The day after the surgery, she was very weak, but clearly her brain had changed heading back towards normal.  eeg right after surgery would have to have been different.\n3.  Medications to reduce / eliminate seizures will impact eeg.\n4.  While in hospital before surgery her stress levels were very high - her heart beat rate was almost always 15 or more beats per minute faster than I know her normal resting rate to be.  On my todo list - can the heart beat info tell us something.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2625766,
      "author_name": "tonyarobertson",
      "author_url": "",
      "post_date": "01/29/2024 15:20:06",
      "content": "<p>Best wishes to your girlfriend, hope your girlfriend gets well soon.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2625947,
          "author_name": "pcjimmmy",
          "author_url": "",
          "post_date": "01/29/2024 17:49:32",
          "content": "<p>Thanks - it's amazing how much life can change with one small incident.  Her dog chased after a rabbit on walk, while on a retractable leash.  See did not see him take off and got pulled to the ground with he hit the end of the leash.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2625954,
              "author_name": "tonyarobertson",
              "author_url": "",
              "post_date": "01/29/2024 17:53:36",
              "content": "<p>It's sorry to hear that. Life is so uncertain, just like the shake in private leaderboard.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2625960,
                  "author_name": "pcjimmmy",
                  "author_url": "",
                  "post_date": "01/29/2024 17:57:36",
                  "content": "<p>Now that's funny !!!</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "id": 2625796,
      "author_name": "gentlezdh",
      "author_url": "",
      "post_date": "01/29/2024 16:04:43",
      "content": "<p>hope your girlfriend gets well soon bro, and may all the efforts put in by the kagglers in every game actually apply and help people</p>",
      "votes": null,
      "replies": [
        {
          "id": 2625952,
          "author_name": "pcjimmmy",
          "author_url": "",
          "post_date": "01/29/2024 17:51:27",
          "content": "<p>Thanks - does make a person appreciate the value of what can be gained by kagglers helping to improve medical diagnosis.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2629574,
              "author_name": "georgem",
              "author_url": "",
              "post_date": "01/31/2024 21:36:43",
              "content": "<p><a href=\"https://www.kaggle.com/PC\" target=\"_blank\">@PC</a> JIMMY All the best for the lady. I had a similar incident some years ago. Except good doctors, methods and diagnoses a good amount of luck is needed</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2625872,
      "author_name": "serjhenrique",
      "author_url": "",
      "post_date": "01/29/2024 17:19:04",
      "content": "<p>I think this small variations ( hair, caffeine, rest…) are already covered by agreement intervals. You can create a feature and calculate the percentual of votes that each brain activity class received. High agreements are expected to be correlated with exams with clear signals. <br>\nOther important thing to mention is that diagnosis with more expert votes are more reliable than diagnosis with fewer expert votes.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2625959,
          "author_name": "pcjimmmy",
          "author_url": "",
          "post_date": "01/29/2024 17:56:40",
          "content": "<p>Not sure I have seen any shared notebooks were 'within patient' features have been generated that address this - I need to look again.  </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2626548,
      "author_name": "sunyuri",
      "author_url": "",
      "post_date": "01/30/2024 05:26:56",
      "content": "<p>You are right, and I am trying.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2627532,
      "author_name": "rafaelzimmermann1",
      "author_url": "",
      "post_date": "01/30/2024 18:06:03",
      "content": "<p>I've been analyzing the data structure of the competition and a question arose: <br>\n1- Are the patient_ids in the test dataset the same as those in the training dataset? <br>\n   If yes, this could open up a range of possibilities for exploring individual patient characteristics in the modeling phase. <br>\n   On the other hand, if the patient_ids in the test dataset are different from those in the training dataset, it suggests that a 'group fold' type of separation method was applied in data preparation. </p>",
      "votes": null,
      "replies": [
        {
          "id": 2628036,
          "author_name": "pcjimmmy",
          "author_url": "",
          "post_date": "01/31/2024 04:31:04",
          "content": "<p>Does not appear that any train patients are in test.   </p>\n<p>There are two types of possible ‘within patient’ information.   Multiple target values within a single scan, and multiple eeg ids for the same patient.   I think both are still source of information for models even if no train patients are in test.  </p>\n<p>20 years ago I would have called the first measurement error and the second repeatability.  </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2668085,
      "author_name": "pcjimmmy",
      "author_url": "",
      "post_date": "02/25/2024 14:00:50",
      "content": "<p>Girlfriend update:</p>\n<p>Had a CT Scan a few days ago.  Report shows huge reduction of the amount of blood on the brain.  No seizure's since I first posted this a month ago.</p>\n<p>After getting out of hospital in December she could barely walk.  She's now doing 6 miles or more per day, dragging me along for 3 of them in the afternoon.  </p>\n<p>Still on meds, but expecting a reduction in the amount at this coming weeks doctor visit.  </p>\n<p>I am guessing based on her improvement that there will be no second eeg.  It was an hour long session in hospital so I assume a bit costly.</p>\n<p>Take-aways from this for our competition.</p>\n<ol>\n<li>No question in my mind that a eeg taken before her brain surgery would look vastly different than one taken today, or the one she did have a few weeks ago.  In a discussion post or two the question has been raised if we know the time order of data for a patient.  Very safe assumtion that eeg_id are correctly ordered by sub_eeg_id.  But is there a time order for different spectograms on a single patient that we can identify.</li>\n<li>Surgery would have changed a lot in her eeg.  I took her to hospital as she was a real mess - pretty sure that would show up on eeg.  The day after the surgery, she was very weak, but clearly her brain had changed heading back towards normal.  eeg right after surgery would have to have been different.</li>\n<li>Medications to reduce / eliminate seizures will impact eeg.</li>\n<li>While in hospital before surgery her stress levels were very high - her heart beat rate was almost always 15 or more beats per minute faster than I know her normal resting rate to be.  On my todo list - can the heart beat info tell us something.</li>\n</ol>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2625753": "Learning some domain knowledge the hard way.  Girlfriend had brain bleeds, needed surgery at Christmas to stop the bleeds and was in the process of recovering.  Recently she started having seizures.  She's scheduled for an EEG in a week.\n\nWhat I have learned so far would seem to suggest that the patients_id has some valuable information to extract, perhaps easily usable for those using tabular methods.  Of course, like any good kaggle competion we know nothing about the patients.  We do know the number of patients and the number of rows of data per patient.\n\nMy girlfriend was proscribed a drug for seizure prevention.  They had hoped to get her down to a minimum amount per day before the eeg.  In her case, that's not going to happen as seizures returned on the lower dose, and she's likely to end up with high dose after a consult tomorrow. \nCan we expect to see medication effects with variation,  over the count of data rows per patient?\n\nFor the test she's to arrive with clean hair, with no hair products.  Could we expect to see a difference per patients like her (full head of long great looking hair) vs scans for me (pretty much bald in all probe areas).\n\nFor the test - no caffeine for 12 hours prior.  Around the 12 hour mark is the point were I start to get a lack of caffeine headache.  Can we expect differences per patient based on caffeine or other similar products.\n\nFor the test - suggestion to stay up late the night before the test and try to arrive in a tired state, rather than well rested state.  According to ChatGPT the normal recommendation is to arrive well rested.  Different seizure types can have different directions for this feature.\n\nHopefully a second eeg in a few months will show a huge difference in seizure related signals.  Can we expect that some patient scans show the last detectable seizure signal close to full recovery?",
    "2625766": "Best wishes to your girlfriend, hope your girlfriend gets well soon.",
    "2625796": "hope your girlfriend gets well soon bro, and may all the efforts put in by the kagglers in every game actually apply and help people",
    "2625872": "I think this small variations ( hair, caffeine, rest...) are already covered by agreement intervals. You can create a feature and calculate the percentual of votes that each brain activity class received. High agreements are expected to be correlated with exams with clear signals. \nOther important thing to mention is that diagnosis with more expert votes are more reliable than diagnosis with fewer expert votes.",
    "2625947": "Thanks - it's amazing how much life can change with one small incident.  Her dog chased after a rabbit on walk, while on a retractable leash.  See did not see him take off and got pulled to the ground with he hit the end of the leash.",
    "2625952": "Thanks - does make a person appreciate the value of what can be gained by kagglers helping to improve medical diagnosis.",
    "2625954": "It's sorry to hear that. Life is so uncertain, just like the shake in private leaderboard.",
    "2625959": "Not sure I have seen any shared notebooks were 'within patient' features have been generated that address this - I need to look again.",
    "2625960": "Now that's funny !!!",
    "2626548": "You are right, and I am trying.",
    "2627532": "I've been analyzing the data structure of the competition and a question arose: \n1- Are the patient_ids in the test dataset the same as those in the training dataset? \n   If yes, this could open up a range of possibilities for exploring individual patient characteristics in the modeling phase. \n   On the other hand, if the patient_ids in the test dataset are different from those in the training dataset, it suggests that a 'group fold' type of separation method was applied in data preparation.",
    "2628036": "Does not appear that any train patients are in test.   \n\nThere are two types of possible ‘within patient’ information.   Multiple target values within a single scan, and multiple eeg ids for the same patient.   I think both are still source of information for models even if no train patients are in test.  \n\n20 years ago I would have called the first measurement error and the second repeatability.",
    "2629574": "PC JIMMY All the best for the lady. I had a similar incident some years ago. Except good doctors, methods and diagnoses a good amount of luck is needed",
    "2668085": "Girlfriend update:\n\nHad a CT Scan a few days ago.  Report shows huge reduction of the amount of blood on the brain.  No seizure's since I first posted this a month ago.\n\nAfter getting out of hospital in December she could barely walk.  She's now doing 6 miles or more per day, dragging me along for 3 of them in the afternoon.  \n\nStill on meds, but expecting a reduction in the amount at this coming weeks doctor visit.  \n\nI am guessing based on her improvement that there will be no second eeg.  It was an hour long session in hospital so I assume a bit costly.\n\nTake-aways from this for our competition.\n\n1.  No question in my mind that a eeg taken before her brain surgery would look vastly different than one taken today, or the one she did have a few weeks ago.  In a discussion post or two the question has been raised if we know the time order of data for a patient.  Very safe assumtion that eeg_id are correctly ordered by sub_eeg_id.  But is there a time order for different spectograms on a single patient that we can identify.\n2.  Surgery would have changed a lot in her eeg.  I took her to hospital as she was a real mess - pretty sure that would show up on eeg.  The day after the surgery, she was very weak, but clearly her brain had changed heading back towards normal.  eeg right after surgery would have to have been different.\n3.  Medications to reduce / eliminate seizures will impact eeg.\n4.  While in hospital before surgery her stress levels were very high - her heart beat rate was almost always 15 or more beats per minute faster than I know her normal resting rate to be.  On my todo list - can the heart beat info tell us something."
  },
  "source": "meta"
}