{
  "id": 94481,
  "title": "Some physics related features",
  "url": "/competitions/LANL-Earthquake-Prediction/discussion/94481",
  "author_name": "",
  "post_date": "2019-06-04T19:28:29.867453100Z",
  "votes": 6,
  "comment_count": 5,
  "views": 0,
  "content": "<p>I created some features with undergraduate physics:</p>\n\n<p>Elasticity\n```\nF = -kx\na = x.shift(-1) -2*x + x.shift()\nregress  a ~ x</p>\n\n<p><code>\nPhase (hysteresis) diagram slope \n</code>\nv = x.shift(-1) - x\nregress x ~ v</p>\n\n<p><code>\nEnergy decay speed\n</code>\nE = x**2\ndE = E.shift(-1) - E\nregress E bin avg ~ dE bin min, at low energy\nor \nregress log(E bin avg) ~ log(-dE bin min)</p>\n\n<p>```\nBecause x is integer, I used various ema to smooth it. Also I calculated the above quantities at various energy levels.</p>\n\n<p>I think stiffness is related to resonance frequency.\nSo, I also computed the weighted fft frequency of length 1500 slice.</p>",
  "messages": [
    {
      "id": "543760",
      "postDate": "06/04/2019 19:28:29",
      "content": "<p>I created some features with undergraduate physics:</p>\n\n<p>Elasticity\n```\nF = -kx\na = x.shift(-1) -2*x + x.shift()\nregress  a ~ x</p>\n\n<p><code>\nPhase (hysteresis) diagram slope \n</code>\nv = x.shift(-1) - x\nregress x ~ v</p>\n\n<p><code>\nEnergy decay speed\n</code>\nE = x**2\ndE = E.shift(-1) - E\nregress E bin avg ~ dE bin min, at low energy\nor \nregress log(E bin avg) ~ log(-dE bin min)</p>\n\n<p>```\nBecause x is integer, I used various ema to smooth it. Also I calculated the above quantities at various energy levels.</p>\n\n<p>I think stiffness is related to resonance frequency.\nSo, I also computed the weighted fft frequency of length 1500 slice.</p>",
      "rawMarkdown": "I created some features with undergraduate physics:\n\nElasticity\n```\nF = -kx\na = x.shift(-1) -2*x + x.shift()\nregress  a ~ x\n\n```\nPhase (hysteresis) diagram slope \n```\nv = x.shift(-1) - x\nregress x ~ v\n\n```\nEnergy decay speed\n```\nE = x**2\ndE = E.shift(-1) - E\nregress E bin avg ~ dE bin min, at low energy\nor \nregress log(E bin avg) ~ log(-dE bin min)\n\n```\nBecause x is integer, I used various ema to smooth it. Also I calculated the above quantities at various energy levels.\n\nI think stiffness is related to resonance frequency.\nSo, I also computed the weighted fft frequency of length 1500 slice.",
      "votes": null
    },
    {
      "id": "543765",
      "postDate": "06/04/2019 19:46:49",
      "content": "<p>Thanks! Interesting point of view.\nPh.D. in Physics approved! 😉</p>",
      "rawMarkdown": "Thanks! Interesting point of view.\nPh.D. in Physics approved! 😉",
      "votes": null
    },
    {
      "id": "543820",
      "postDate": "06/04/2019 21:18:30",
      "content": "<p>I like these regression type features. Did it helped in your solution?</p>",
      "rawMarkdown": "I like these regression type features. Did it helped in your solution?",
      "votes": null
    },
    {
      "id": "543966",
      "postDate": "06/05/2019 01:45:02",
      "content": "<p>Yes, these are important CV features to me.</p>\n\n<p>However, I was hoping to achieve something like: \nEnergy dissipation per cycle(hence weighted freq) is related to strain\nEnergy = kx*<em>2 instead of x</em>*2\nCritical damping occur when sqrt(k) increase to resonance freq</p>\n\n<p>I hope features with physical meaning could be helpful to actual physicists.</p>",
      "rawMarkdown": "Yes, these are important CV features to me.\n\nHowever, I was hoping to achieve something like: \nEnergy dissipation per cycle(hence weighted freq) is related to strain\nEnergy = kx**2 instead of x**2\nCritical damping occur when sqrt(k) increase to resonance freq\n\nI hope features with physical meaning could be helpful to actual physicists.",
      "votes": null
    },
    {
      "id": "547053",
      "postDate": "06/07/2019 07:43:24",
      "content": "<p>Also Physics Ph.D. approved :).\nAdditional remarks:\n- FFT based features weren't really useful, the spectrum is practically uncorrelated with ttf\n- in the end, all that matters are the peaks or 'bursts' in the signal. Their size (energy) and especially their temporal distribution. It helped not to think of the data as a continuous signal, but as a collection of relevant bursts separated by periods of noise. Maybe calculating your features for individual bursts would be really great?</p>",
      "rawMarkdown": "Also Physics Ph.D. approved :).\nAdditional remarks:\n- FFT based features weren't really useful, the spectrum is practically uncorrelated with ttf\n- in the end, all that matters are the peaks or 'bursts' in the signal. Their size (energy) and especially their temporal distribution. It helped not to think of the data as a continuous signal, but as a collection of relevant bursts separated by periods of noise. Maybe calculating your features for individual bursts would be really great?",
      "votes": null
    },
    {
      "id": "548598",
      "postDate": "06/09/2019 15:58:36",
      "content": "<p>It's sad that there are too few data or even no data at high energy for regression. But I believe lots of physics can be extracted by analyzing those bursts carefully.</p>\n\n<p>Competition aside, computing rolling mean on mfcc and other features can show what is the state of the earth quake. The energy, elasticity, mfcc increase steadily. When they reach resonance state, it seems earthquake can be triggered any time. That's why predicting time since failure is a lot easier. But predicting ttf involves predicting how much time they spent on resonance phase.</p>",
      "rawMarkdown": "It's sad that there are too few data or even no data at high energy for regression. But I believe lots of physics can be extracted by analyzing those bursts carefully.\n\nCompetition aside, computing rolling mean on mfcc and other features can show what is the state of the earth quake. The energy, elasticity, mfcc increase steadily. When they reach resonance state, it seems earthquake can be triggered any time. That's why predicting time since failure is a lot easier. But predicting ttf involves predicting how much time they spent on resonance phase.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 543765,
      "author_name": "stecasasso",
      "author_url": "",
      "post_date": "06/04/2019 19:46:49",
      "content": "<p>Thanks! Interesting point of view.\nPh.D. in Physics approved! 😉</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 543820,
      "author_name": "titericz",
      "author_url": "",
      "post_date": "06/04/2019 21:18:30",
      "content": "<p>I like these regression type features. Did it helped in your solution?</p>",
      "votes": null,
      "replies": [
        {
          "id": 543966,
          "author_name": "frankw",
          "author_url": "",
          "post_date": "06/05/2019 01:45:02",
          "content": "<p>Yes, these are important CV features to me.</p>\n\n<p>However, I was hoping to achieve something like: \nEnergy dissipation per cycle(hence weighted freq) is related to strain\nEnergy = kx*<em>2 instead of x</em>*2\nCritical damping occur when sqrt(k) increase to resonance freq</p>\n\n<p>I hope features with physical meaning could be helpful to actual physicists.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 547053,
      "author_name": "friedchips",
      "author_url": "",
      "post_date": "06/07/2019 07:43:24",
      "content": "<p>Also Physics Ph.D. approved :).\nAdditional remarks:\n- FFT based features weren't really useful, the spectrum is practically uncorrelated with ttf\n- in the end, all that matters are the peaks or 'bursts' in the signal. Their size (energy) and especially their temporal distribution. It helped not to think of the data as a continuous signal, but as a collection of relevant bursts separated by periods of noise. Maybe calculating your features for individual bursts would be really great?</p>",
      "votes": null,
      "replies": [
        {
          "id": 548598,
          "author_name": "frankw",
          "author_url": "",
          "post_date": "06/09/2019 15:58:36",
          "content": "<p>It's sad that there are too few data or even no data at high energy for regression. But I believe lots of physics can be extracted by analyzing those bursts carefully.</p>\n\n<p>Competition aside, computing rolling mean on mfcc and other features can show what is the state of the earth quake. The energy, elasticity, mfcc increase steadily. When they reach resonance state, it seems earthquake can be triggered any time. That's why predicting time since failure is a lot easier. But predicting ttf involves predicting how much time they spent on resonance phase.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "543760": "I created some features with undergraduate physics:\n\nElasticity\n```\nF = -kx\na = x.shift(-1) -2*x + x.shift()\nregress  a ~ x\n\n```\nPhase (hysteresis) diagram slope \n```\nv = x.shift(-1) - x\nregress x ~ v\n\n```\nEnergy decay speed\n```\nE = x**2\ndE = E.shift(-1) - E\nregress E bin avg ~ dE bin min, at low energy\nor \nregress log(E bin avg) ~ log(-dE bin min)\n\n```\nBecause x is integer, I used various ema to smooth it. Also I calculated the above quantities at various energy levels.\n\nI think stiffness is related to resonance frequency.\nSo, I also computed the weighted fft frequency of length 1500 slice.",
    "543765": "Thanks! Interesting point of view.\nPh.D. in Physics approved! 😉",
    "543820": "I like these regression type features. Did it helped in your solution?",
    "543966": "Yes, these are important CV features to me.\n\nHowever, I was hoping to achieve something like: \nEnergy dissipation per cycle(hence weighted freq) is related to strain\nEnergy = kx**2 instead of x**2\nCritical damping occur when sqrt(k) increase to resonance freq\n\nI hope features with physical meaning could be helpful to actual physicists.",
    "547053": "Also Physics Ph.D. approved :).\nAdditional remarks:\n- FFT based features weren't really useful, the spectrum is practically uncorrelated with ttf\n- in the end, all that matters are the peaks or 'bursts' in the signal. Their size (energy) and especially their temporal distribution. It helped not to think of the data as a continuous signal, but as a collection of relevant bursts separated by periods of noise. Maybe calculating your features for individual bursts would be really great?",
    "548598": "It's sad that there are too few data or even no data at high energy for regression. But I believe lots of physics can be extracted by analyzing those bursts carefully.\n\nCompetition aside, computing rolling mean on mfcc and other features can show what is the state of the earth quake. The energy, elasticity, mfcc increase steadily. When they reach resonance state, it seems earthquake can be triggered any time. That's why predicting time since failure is a lot easier. But predicting ttf involves predicting how much time they spent on resonance phase."
  },
  "source": "meta"
}