{
  "id": 240638,
  "title": "Normalization and color encoding of \"on\" and \"off\" times",
  "url": "/competitions/seti-breakthrough-listen/discussion/240638",
  "author_name": "AgentAuers",
  "post_date": "2021-05-20T18:26:30.555000",
  "votes": 10,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Normalization of individual frequency channels (columns) and time steps (rows) removes some of the artifacts in the data. <br>\nAnd by using different colors for the \"on\"- and \"off\"-times the result looks like:</p>\n<p>Example-Id: 003b6e82e852 <br>\n<img src=\"https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_9.png\" alt=\"003b6e82e852 \"></p>\n<p>Example-Id: 004cd81a867c<br>\n<img src=\"https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_11.png\" alt=\"004cd81a867c\"></p>\n<p>Code-Snippet:</p>\n<pre>    x = np.load()\n    x = np.vstack(x).astype(np.float32)\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    ....\n</pre>\n<p>Here are more examples -&gt; <a href=\"https://www.kaggle.com/agentauers/seti21-normalization-of-data\" target=\"_blank\">Link to notebook</a></p>",
  "messages": [
    {
      "id": 1316639,
      "postDate": "2021-05-20T18:26:30.557Z",
      "content": "<p>Normalization of individual frequency channels (columns) and time steps (rows) removes some of the artifacts in the data. <br>\nAnd by using different colors for the \"on\"- and \"off\"-times the result looks like:</p>\n<p>Example-Id: 003b6e82e852 <br>\n<img src=\"https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_9.png\" alt=\"003b6e82e852 \"></p>\n<p>Example-Id: 004cd81a867c<br>\n<img src=\"https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_11.png\" alt=\"004cd81a867c\"></p>\n<p>Code-Snippet:</p>\n<pre>    x = np.load()\n    x = np.vstack(x).astype(np.float32)\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    ....\n</pre>\n<p>Here are more examples -&gt; <a href=\"https://www.kaggle.com/agentauers/seti21-normalization-of-data\" target=\"_blank\">Link to notebook</a></p>",
      "rawMarkdown": "Normalization of individual frequency channels (columns) and time steps (rows) removes some of the artifacts in the data. \nAnd by using different colors for the \"on\"- and \"off\"-times the result looks like:\n\nExample-Id: 003b6e82e852 \n![003b6e82e852 ](https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_9.png)\n\nExample-Id: 004cd81a867c\n![004cd81a867c](https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_11.png)\n\nCode-Snippet:\n<pre>\n    x = np.load(<file>)\n    x = np.vstack(x).astype(np.float32)\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    ....\n</pre>\n\nHere are more examples -> [Link to notebook](https://www.kaggle.com/agentauers/seti21-normalization-of-data)",
      "votes": 10
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1316639": "Normalization of individual frequency channels (columns) and time steps (rows) removes some of the artifacts in the data. \nAnd by using different colors for the \"on\"- and \"off\"-times the result looks like:\n\nExample-Id: 003b6e82e852 \n![003b6e82e852 ](https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_9.png)\n\nExample-Id: 004cd81a867c\n![004cd81a867c](https://www.kaggleusercontent.com/kf/63458327/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..ZsoGGZufwWIWXVV559rn7g.WBwUD7VNzqKdl_KIlOvhpSSJsb9tVOJVpTRsdoSQ9BXfoh7kKA-ss2VB_OWP0g8i9ov7ah1yGYmgl7zLH_UG_u5e8URCfl_M5N5V-aFCYAvvIb1MZx6GMeMtleNxLOlun_f9VpZVJL4wklDChy-3qTl9AVz_aZyBO5Nx30mOemA3fcMUnz0pma3T8Sa0Sa9E3zEqUK8QvKIG_XC9qL5VJExPHg9O_nigqfByYdXsAOkX-K2FZCzpEt4JZUpOTUYGMOFPNADpr89zcm8LEHMXchDDEXr3PNwui67fPNEbmeowR4ZbtkY77QD_l-oYiESJ5UR9SdrkngOnEPpQJv1JnInq93ceV1fg3OMchiAVxNM8rEWpxWeAWSPLs3Irr-eJ3VisMufhUv9bbFLgVUjz2KHSm8efuDT6WWmCMp9V0EeaGA7J_TBSLF1KbDJGjAd9hbcfluCgMZsyCtd9AjpJ0xUPeleUcdoe8G7j0ueTFgd-ULsCZlcUwl1J0R7sMUBX3Qdg85z7AQh84OUNzAa9HWSTIIy1fVCmLm6104EAPHQ6tRMyIPEqHgEJ42OGZIs2OIAcSaE9NXdPeBEZKq6v6PyhZN1R0J8n1xeQuLKkW6veioibc0SDb2LzFqxEOfqvzDqg_X9_313IgI-gYUwYyRGtHNn3PpfKxt6rWZPFtZc.p0NlqN5ZaMEspfCMQ_2ByQ/__results___files/__results___4_11.png)\n\nCode-Snippet:\n<pre>\n    x = np.load(<file>)\n    x = np.vstack(x).astype(np.float32)\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    x = ((x - np.mean(x, axis=0)) / np.std(x, axis=0)).T\n    ....\n</pre>\n\nHere are more examples -> [Link to notebook](https://www.kaggle.com/agentauers/seti21-normalization-of-data)"
  }
}