{
  "id": 243861,
  "title": "Joining up derived, raw and status data",
  "url": "/competitions/google-smartphone-decimeter-challenge/discussion/243861",
  "author_name": "",
  "post_date": "2021-06-04T09:34:23.988496700Z",
  "votes": 4,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I tried to join up the various data sources for analysis, using 'ConstellationType', 'Svid', and 'millisSinceGpsEpoch' (I have converted all UTC into GPS for raw and status), but it seems that merge with very few records.</p>\n<p>On the other hand, I note that for some millisSinceGpsEpoch, the phoneName might not appear in both raw and status. It seems that the raw and status are not provided from all phones concerned.</p>\n<p>Any ideas to join them up?  Thanks!</p>",
  "messages": [
    {
      "id": "1335573",
      "postDate": "06/04/2021 09:34:23",
      "content": "<p>I tried to join up the various data sources for analysis, using 'ConstellationType', 'Svid', and 'millisSinceGpsEpoch' (I have converted all UTC into GPS for raw and status), but it seems that merge with very few records.</p>\n<p>On the other hand, I note that for some millisSinceGpsEpoch, the phoneName might not appear in both raw and status. It seems that the raw and status are not provided from all phones concerned.</p>\n<p>Any ideas to join them up?  Thanks!</p>",
      "rawMarkdown": "I tried to join up the various data sources for analysis, using 'ConstellationType', 'Svid', and 'millisSinceGpsEpoch' (I have converted all UTC into GPS for raw and status), but it seems that merge with very few records.\n\nOn the other hand, I note that for some millisSinceGpsEpoch, the phoneName might not appear in both raw and status. It seems that the raw and status are not provided from all phones concerned.\n\nAny ideas to join them up?  Thanks!",
      "votes": null
    },
    {
      "id": "1339615",
      "postDate": "06/07/2021 10:59:55",
      "content": "<p>did you try to use merge_asof?<br>\n<a href=\"https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.merge_asof.html\" target=\"_blank\">https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.merge_asof.html</a></p>\n<p>It will help merging by the closest timestamp</p>",
      "rawMarkdown": "did you try to use merge_asof?\nhttps://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.merge_asof.html\n\nIt will help merging by the closest timestamp",
      "votes": null
    },
    {
      "id": "1340841",
      "postDate": "06/08/2021 09:48:58",
      "content": "<p>That's good suggestion. Thanks a lot!!!  🙏🙏🙏</p>",
      "rawMarkdown": "That's good suggestion. Thanks a lot!!!  🙏🙏🙏",
      "votes": null
    },
    {
      "id": "1340976",
      "postDate": "06/08/2021 10:57:35",
      "content": "<p>no problem, if you found it hard I will be happy to try and help, I did not find it easy too</p>",
      "rawMarkdown": "no problem, if you found it hard I will be happy to try and help, I did not find it easy too",
      "votes": null
    },
    {
      "id": "1354537",
      "postDate": "06/17/2021 16:37:51",
      "content": "<p>Hi Jason, this notebook may give us some ideas: <a href=\"https://www.kaggle.com/gymf123/tips-notes-from-the-competition-hosts\" target=\"_blank\">https://www.kaggle.com/gymf123/tips-notes-from-the-competition-hosts</a>.</p>",
      "rawMarkdown": "Hi Jason, this notebook may give us some ideas: https://www.kaggle.com/gymf123/tips-notes-from-the-competition-hosts.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1339615,
      "author_name": "avivlevi815",
      "author_url": "",
      "post_date": "06/07/2021 10:59:55",
      "content": "<p>did you try to use merge_asof?<br>\n<a href=\"https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.merge_asof.html\" target=\"_blank\">https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.merge_asof.html</a></p>\n<p>It will help merging by the closest timestamp</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1340841,
      "author_name": "jclchan",
      "author_url": "",
      "post_date": "06/08/2021 09:48:58",
      "content": "<p>That's good suggestion. Thanks a lot!!!  🙏🙏🙏</p>",
      "votes": null,
      "replies": [
        {
          "id": 1340976,
          "author_name": "avivlevi815",
          "author_url": "",
          "post_date": "06/08/2021 10:57:35",
          "content": "<p>no problem, if you found it hard I will be happy to try and help, I did not find it easy too</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1354537,
      "author_name": "gymf123",
      "author_url": "",
      "post_date": "06/17/2021 16:37:51",
      "content": "<p>Hi Jason, this notebook may give us some ideas: <a href=\"https://www.kaggle.com/gymf123/tips-notes-from-the-competition-hosts\" target=\"_blank\">https://www.kaggle.com/gymf123/tips-notes-from-the-competition-hosts</a>.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1335573": "I tried to join up the various data sources for analysis, using 'ConstellationType', 'Svid', and 'millisSinceGpsEpoch' (I have converted all UTC into GPS for raw and status), but it seems that merge with very few records.\n\nOn the other hand, I note that for some millisSinceGpsEpoch, the phoneName might not appear in both raw and status. It seems that the raw and status are not provided from all phones concerned.\n\nAny ideas to join them up?  Thanks!",
    "1339615": "did you try to use merge_asof?\nhttps://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.merge_asof.html\n\nIt will help merging by the closest timestamp",
    "1340841": "That's good suggestion. Thanks a lot!!!  🙏🙏🙏",
    "1340976": "no problem, if you found it hard I will be happy to try and help, I did not find it easy too",
    "1354537": "Hi Jason, this notebook may give us some ideas: https://www.kaggle.com/gymf123/tips-notes-from-the-competition-hosts."
  },
  "source": "meta"
}