{ "id": 3801, "title": "Public Leaderboard Training Days + Augmented Training Set 2 Update", "url": "/competitions/flight/discussion/3801", "author_name": "", "post_date": "2013-02-10T09:08:20.750Z", "votes": null, "comment_count": 15, "views": 8675, "content": "

The public leaderboard training days can now be downloaded from the \r\ndata page.

\r\n

Part 2 of the Augmented Training Set is currently uploading and should be available in the next 8 hours.

", "messages": [ { "id": "20261", "postDate": "02/10/2013 09:08:20", "content": "

The public leaderboard training days can now be downloaded from the \r\ndata page.

\r\n

Part 2 of the Augmented Training Set is currently uploading and should be available in the next 8 hours.

", "rawMarkdown": "", "votes": null }, { "id": "20265", "postDate": "02/10/2013 14:43:17", "content": "

Ben,

\r\n

Given that the Augmented Training Set is being delivered late by a day we now have less time to finalize our models than the timeline specifies. Will the final model submission date also slip a day to Feb 15th?\r\n

", "rawMarkdown": "", "votes": null }, { "id": "20281", "postDate": "02/10/2013 20:54:47", "content": "

AugmentedTrainingSet2.7z is now on the data page. The .zip format will be up as soon as it finishes uploading (it's over twice the size).

", "rawMarkdown": "", "votes": null }, { "id": "20282", "postDate": "02/10/2013 21:05:17", "content": "

[quote=Russell Martin;20265]

\r\n

Ben,

\r\n

Given that the Augmented Training Set is being delivered late by a day we now have less time to finalize our models than the timeline specifies. Will the final model submission date also slip a day to Feb 15th?

\r\n

[/quote]I've updated the final model submission deadline to 6:00 PM UTC on Feb 15. This is the most I can push it (otherwise it could come after a cutoff time in the final evaluation set).

", "rawMarkdown": "", "votes": null }, { "id": "20285", "postDate": "02/11/2013 00:04:07", "content": "

And the .zip format is now up. I didn't have time to do any quality verification prior to uploading the data beyond checking that the file sizes were approximately correct (this one had a very short turnaround,\r\n and a slight format difference in the form I received it caused a delay), so please use this thread to identify any problems / differences from the other sets that you come across.

", "rawMarkdown": "", "votes": null }, { "id": "20289", "postDate": "02/11/2013 02:08:24", "content": "

Has any one had any data errors pop up when extracting the second augmented 7z archive? I specifically had errors with the following files

\r\n

2013_01_31/ASDI/asdifpwaypoint.csv

\r\n

2013_02_01/ASDI/asdifpwaypoint.csv

\r\n

The md5sum is 572b67ec421b4cbe2b2ab227f65a4f81 and the number of bytes is 3837923612.

\r\n

 

", "rawMarkdown": "", "votes": null }, { "id": "20300", "postDate": "02/11/2013 04:58:24", "content": "

I got the same errors with the .7z file. (The byte count and md5 match also match.)

\r\n

On Mac OS X 10.6.8, the free app "The Unarchiver" was able to unpack all the other files; Stuffit Expander quit without unpacking any of them.

", "rawMarkdown": "", "votes": null }, { "id": "20303", "postDate": "02/11/2013 07:21:56", "content": "

The 7z file is corrupt for me as well. These file specifically:

\r\n

2013_01_31/ASDI/asdifpwaypoint.csv

\r\n

2013_02_01/ASDI/asdifpwaypoint.csv

", "rawMarkdown": "", "votes": null }, { "id": "20304", "postDate": "02/11/2013 07:26:51", "content": "

Could these 2 corrupt files be uploaded somehow?

", "rawMarkdown": "", "votes": null }, { "id": "20327", "postDate": "02/11/2013 17:01:49", "content": "

[quote=Jacques Kvam;20289]

\r\n

Has any one had any data errors pop up when extracting the second augmented 7z archive? I specifically had errors with the following files

\r\n

2013_01_31/ASDI/asdifpwaypoint.csv

\r\n

2013_02_01/ASDI/asdifpwaypoint.csv

\r\n

The md5sum is 572b67ec421b4cbe2b2ab227f65a4f81 and the number of bytes is 3837923612.

\r\n

 

\r\n

[/quote]I've re-uploaded the .7z file as AugmentedTrainingSet2_take2.7z. Does this help?

", "rawMarkdown": "", "votes": null }, { "id": "20342", "postDate": "02/11/2013 19:47:55", "content": "

are the two waypoint files the only changes in the take2 archive?

", "rawMarkdown": "", "votes": null }, { "id": "20347", "postDate": "02/12/2013 02:36:18", "content": "

[quote=David Knox;20342]

\r\n

are the two waypoint files the only changes in the take2 archive?

\r\n

[/quote]No direct changes, simply re-uploaded the file. I think something may have messed up in the first upload that corrupted those two files.

", "rawMarkdown": "", "votes": null }, { "id": "20352", "postDate": "02/12/2013 05:13:28", "content": "

[quote]I've re-uploaded the .7z file as AugmentedTrainingSet2_take2.7z. Does this help?

\r\n

[/quote]Looks good now, thanks.

", "rawMarkdown": "", "votes": null }, { "id": "20355", "postDate": "02/12/2013 06:17:22", "content": "

Yes. I used "diff -rq dir1 dir2" to compare two extended downloads, which shows only these two files are different.

", "rawMarkdown": "", "votes": null }, { "id": "20386", "postDate": "02/12/2013 20:16:26", "content": "

In PublicLeaderboardTrainDays, it seems that the asdiposition received field is NOT UTC and does NOT have  a specified timezone. It is probably PST (UTC-8) since there are positions reported as early as 02:00 AM.

", "rawMarkdown": "", "votes": null }, { "id": "20391", "postDate": "02/12/2013 21:55:40", "content": "

My apologies... The received field is different, PST instead of UTC, but there is a specified timezone.

\r\n

Because it was already corrected to UTC, I assumed UTC and didn't check the timezone. I should know better than assume something like that... I corrected my code.

", "rawMarkdown": "", "votes": null } ], "comments": [ { "id": 20265, "author_name": "nitram", "author_url": "", "post_date": "02/10/2013 14:43:17", "content": "

Ben,

\r\n

Given that the Augmented Training Set is being delivered late by a day we now have less time to finalize our models than the timeline specifies. Will the final model submission date also slip a day to Feb 15th?\r\n

", "votes": null, "replies": [] }, { "id": 20281, "author_name": "benhamner", "author_url": "", "post_date": "02/10/2013 20:54:47", "content": "

AugmentedTrainingSet2.7z is now on the data page. The .zip format will be up as soon as it finishes uploading (it's over twice the size).

", "votes": null, "replies": [] }, { "id": 20282, "author_name": "benhamner", "author_url": "", "post_date": "02/10/2013 21:05:17", "content": "

[quote=Russell Martin;20265]

\r\n

Ben,

\r\n

Given that the Augmented Training Set is being delivered late by a day we now have less time to finalize our models than the timeline specifies. Will the final model submission date also slip a day to Feb 15th?

\r\n

[/quote]I've updated the final model submission deadline to 6:00 PM UTC on Feb 15. This is the most I can push it (otherwise it could come after a cutoff time in the final evaluation set).

", "votes": null, "replies": [] }, { "id": 20285, "author_name": "benhamner", "author_url": "", "post_date": "02/11/2013 00:04:07", "content": "

And the .zip format is now up. I didn't have time to do any quality verification prior to uploading the data beyond checking that the file sizes were approximately correct (this one had a very short turnaround,\r\n and a slight format difference in the form I received it caused a delay), so please use this thread to identify any problems / differences from the other sets that you come across.

", "votes": null, "replies": [] }, { "id": 20289, "author_name": "jwkvam", "author_url": "", "post_date": "02/11/2013 02:08:24", "content": "

Has any one had any data errors pop up when extracting the second augmented 7z archive? I specifically had errors with the following files

\r\n

2013_01_31/ASDI/asdifpwaypoint.csv

\r\n

2013_02_01/ASDI/asdifpwaypoint.csv

\r\n

The md5sum is 572b67ec421b4cbe2b2ab227f65a4f81 and the number of bytes is 3837923612.

\r\n

 

", "votes": null, "replies": [] }, { "id": 20300, "author_name": "budiansky", "author_url": "", "post_date": "02/11/2013 04:58:24", "content": "

I got the same errors with the .7z file. (The byte count and md5 match also match.)

\r\n

On Mac OS X 10.6.8, the free app "The Unarchiver" was able to unpack all the other files; Stuffit Expander quit without unpacking any of them.

", "votes": null, "replies": [] }, { "id": 20303, "author_name": "iamivo", "author_url": "", "post_date": "02/11/2013 07:21:56", "content": "

The 7z file is corrupt for me as well. These file specifically:

\r\n

2013_01_31/ASDI/asdifpwaypoint.csv

\r\n

2013_02_01/ASDI/asdifpwaypoint.csv

", "votes": null, "replies": [] }, { "id": 20304, "author_name": "iamivo", "author_url": "", "post_date": "02/11/2013 07:26:51", "content": "

Could these 2 corrupt files be uploaded somehow?

", "votes": null, "replies": [] }, { "id": 20327, "author_name": "benhamner", "author_url": "", "post_date": "02/11/2013 17:01:49", "content": "

[quote=Jacques Kvam;20289]

\r\n

Has any one had any data errors pop up when extracting the second augmented 7z archive? I specifically had errors with the following files

\r\n

2013_01_31/ASDI/asdifpwaypoint.csv

\r\n

2013_02_01/ASDI/asdifpwaypoint.csv

\r\n

The md5sum is 572b67ec421b4cbe2b2ab227f65a4f81 and the number of bytes is 3837923612.

\r\n

 

\r\n

[/quote]I've re-uploaded the .7z file as AugmentedTrainingSet2_take2.7z. Does this help?

", "votes": null, "replies": [] }, { "id": 20342, "author_name": "davidknox", "author_url": "", "post_date": "02/11/2013 19:47:55", "content": "

are the two waypoint files the only changes in the take2 archive?

", "votes": null, "replies": [] }, { "id": 20347, "author_name": "benhamner", "author_url": "", "post_date": "02/12/2013 02:36:18", "content": "

[quote=David Knox;20342]

\r\n

are the two waypoint files the only changes in the take2 archive?

\r\n

[/quote]No direct changes, simply re-uploaded the file. I think something may have messed up in the first upload that corrupted those two files.

", "votes": null, "replies": [] }, { "id": 20352, "author_name": "jwkvam", "author_url": "", "post_date": "02/12/2013 05:13:28", "content": "

[quote]I've re-uploaded the .7z file as AugmentedTrainingSet2_take2.7z. Does this help?

\r\n

[/quote]Looks good now, thanks.

", "votes": null, "replies": [] }, { "id": 20355, "author_name": "songgc", "author_url": "", "post_date": "02/12/2013 06:17:22", "content": "

Yes. I used "diff -rq dir1 dir2" to compare two extended downloads, which shows only these two files are different.

", "votes": null, "replies": [] }, { "id": 20386, "author_name": "vadnais", "author_url": "", "post_date": "02/12/2013 20:16:26", "content": "

In PublicLeaderboardTrainDays, it seems that the asdiposition received field is NOT UTC and does NOT have  a specified timezone. It is probably PST (UTC-8) since there are positions reported as early as 02:00 AM.

", "votes": null, "replies": [] }, { "id": 20391, "author_name": "vadnais", "author_url": "", "post_date": "02/12/2013 21:55:40", "content": "

My apologies... The received field is different, PST instead of UTC, but there is a specified timezone.

\r\n

Because it was already corrected to UTC, I assumed UTC and didn't check the timezone. I should know better than assume something like that... I corrected my code.

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "20261": "", "20265": "", "20281": "", "20282": "", "20285": "", "20289": "", "20300": "", "20303": "", "20304": "", "20327": "", "20342": "", "20347": "", "20352": "", "20355": "", "20386": "", "20391": "" }, "source": "meta" }