I have downloaded the datasets but I must admit that after taking a quick look at the dataset, there is very little documentation on the structure of the data (the data quality issues aside). There is a wiki provided at the GE site but that doesn't provide\r\n anything different from what I can figure out anyways by looking at the data. It would be great if the organizers (or kaggle) can provide a 2-3 page summary of what goes into the dataset, what keys from what files map to what other keys & files and most importantly,\r\n what they mean. Some fields are self explanatory (e.g. scheduled departure) while some others (e.g. ordinal) not so.
\r\nNot sure if figuring out the data is part of the challenge, but such a documentation describing meta-data would definitely abstract out the modelling element and make it easy for kagglers to jump in.
\r\n", "messages": [ { "id": "17408", "postDate": "12/05/2012 15:55:00", "content": "
I have downloaded the datasets but I must admit that after taking a quick look at the dataset, there is very little documentation on the structure of the data (the data quality issues aside). There is a wiki provided at the GE site but that doesn't provide\r\n anything different from what I can figure out anyways by looking at the data. It would be great if the organizers (or kaggle) can provide a 2-3 page summary of what goes into the dataset, what keys from what files map to what other keys & files and most importantly,\r\n what they mean. Some fields are self explanatory (e.g. scheduled departure) while some others (e.g. ordinal) not so.
\r\nNot sure if figuring out the data is part of the challenge, but such a documentation describing meta-data would definitely abstract out the modelling element and make it easy for kagglers to jump in.
\r\n", "rawMarkdown": "", "votes": null }, { "id": "17412", "postDate": "12/05/2012 18:29:13", "content": "
Thanks for the question. It's a fair point that some of the fields aren't as well-described as they could be. We've left most of the wiki pages editable (we'll be watching for abuse and will revert changes and lock them down if necessary), so if you figure\r\n anything out that's not there, please contribute.
\r\n
\r\nHowever, we have tried to be quite clear at least about how the various keys relate.\r\n
\r\n
\r\nI've just clarified the role of ordinal in \r\nthis page, and I think \r\nthis one was already well described. Let us know if you have specific questions.
... except that the "this page lnk" doesn't work. It links to:
\r\nhttps://www.gequest.com/Forums/Thanks%20for%20the%20question.%20It's%20a%20fair%20point%20that%20some%20of%20the%20fields%20aren't%20as%20well-described%20as%20they%20could%20be.%20We've%20left%20most%20of%20the%20wiki%20pages%20editable%20(we'll%20be%20watching%20for%20abuse%20and%20will%20revert%20changes%20and%20lock%20them%20down%20if%20necessary),%20so%20if%20you%20figure%20anything%20out%20that's%20not%20there,%20please%20contribute.%20%20However,%20we%20have%20tried%20to%20be%20quite%20clear%20at%20least%20about%20how%20the%20various%20keys%20relate.%20%20%20I've%20just%20
\r\nwhich is not a page.
", "rawMarkdown": "", "votes": null }, { "id": "17451", "postDate": "12/06/2012 09:04:34", "content": "The ordinal value has a different meaning depending on the data set eg.:
\r\n\r\n\r\nhttps://www.gequest.com/wiki/FlightQuest.Data.Asdi.AsdiFpWaypointCsv
\r\nordinal: An integer representing the order of waypoints in the flight plan
\r\nhttps://www.gequest.com/wiki/FlightQuest.Data.Otherweather.FBWind
\r\nordinal -- determines altitude (differently for each report, as specified in fbwindaltitude.csv)
\r\n
Is that correct?
\r\n", "rawMarkdown": "", "votes": null }, { "id": "17458", "postDate": "12/06/2012 18:21:26", "content": "
Yes. It really just helps specify how things are connected between the different files in a given set. That works differently for each set.
", "rawMarkdown": "", "votes": null } ], "comments": [ { "id": 17412, "author_name": "dchudz", "author_url": "", "post_date": "12/05/2012 18:29:13", "content": "Thanks for the question. It's a fair point that some of the fields aren't as well-described as they could be. We've left most of the wiki pages editable (we'll be watching for abuse and will revert changes and lock them down if necessary), so if you figure\r\n anything out that's not there, please contribute.
\r\n
\r\nHowever, we have tried to be quite clear at least about how the various keys relate.\r\n
\r\n
\r\nI've just clarified the role of ordinal in \r\nthis page, and I think \r\nthis one was already well described. Let us know if you have specific questions.
... except that the "this page lnk" doesn't work. It links to:
\r\nhttps://www.gequest.com/Forums/Thanks%20for%20the%20question.%20It's%20a%20fair%20point%20that%20some%20of%20the%20fields%20aren't%20as%20well-described%20as%20they%20could%20be.%20We've%20left%20most%20of%20the%20wiki%20pages%20editable%20(we'll%20be%20watching%20for%20abuse%20and%20will%20revert%20changes%20and%20lock%20them%20down%20if%20necessary),%20so%20if%20you%20figure%20anything%20out%20that's%20not%20there,%20please%20contribute.%20%20However,%20we%20have%20tried%20to%20be%20quite%20clear%20at%20least%20about%20how%20the%20various%20keys%20relate.%20%20%20I've%20just%20
\r\nwhich is not a page.
", "votes": null, "replies": [] }, { "id": 17451, "author_name": "intaka", "author_url": "", "post_date": "12/06/2012 09:04:34", "content": "The ordinal value has a different meaning depending on the data set eg.:
\r\n\r\n\r\nhttps://www.gequest.com/wiki/FlightQuest.Data.Asdi.AsdiFpWaypointCsv
\r\nordinal: An integer representing the order of waypoints in the flight plan
\r\nhttps://www.gequest.com/wiki/FlightQuest.Data.Otherweather.FBWind
\r\nordinal -- determines altitude (differently for each report, as specified in fbwindaltitude.csv)
\r\n
Is that correct?
\r\n", "votes": null, "replies": [] }, { "id": 17458, "author_name": "dchudz", "author_url": "", "post_date": "12/06/2012 18:21:26", "content": "
Yes. It really just helps specify how things are connected between the different files in a given set. That works differently for each set.
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "17408": "", "17412": "", "17435": "", "17451": "", "17458": "" }, "source": "meta" }