We have uploaded stage 2 files to the competition data section:
\n\nIn addition, the full set of files is also live on Google Cloud Storage. If you had access to the first stage bucket, you should now have access to the second stage bucket @ https://storage.cloud.google.com/kaggle-tsa-stage2
\n\nThe leaderboard is currently in the process of being cleared and scoring is now setup to accept stage 2 submissions. There are no public leaderboard samples in the new test set, so your submission will either error if something is wrong, or 0.0 if it scored. Note that this means you must select your submissions that should count for final scoring. Do not rely on the auto-selection to pick based on public score, as the public score is no longer meaningful!
\n\nGood luck, and feel free to use this thread for any comments/questions related to the second stage.
", "messages": [ { "id": 256425, "postDate": "2017-12-11T22:54:07.657Z", "content": "We have uploaded stage 2 files to the competition data section:
\n\nIn addition, the full set of files is also live on Google Cloud Storage. If you had access to the first stage bucket, you should now have access to the second stage bucket @ https://storage.cloud.google.com/kaggle-tsa-stage2
\n\nThe leaderboard is currently in the process of being cleared and scoring is now setup to accept stage 2 submissions. There are no public leaderboard samples in the new test set, so your submission will either error if something is wrong, or 0.0 if it scored. Note that this means you must select your submissions that should count for final scoring. Do not rely on the auto-selection to pick based on public score, as the public score is no longer meaningful!
\n\nGood luck, and feel free to use this thread for any comments/questions related to the second stage.
", "rawMarkdown": "We have uploaded stage 2 files to the competition data section:\n\n - stage1_solution.csv (you may use this for retraining)\n - stage2_sample_submission.csv\n - stage2_a3daps.tar.gz\n - stage2_aps.tar.gz\n\nIn addition, the full set of files is also live on Google Cloud Storage. If you had access to the first stage bucket, you should now have access to the second stage bucket @ https://storage.cloud.google.com/kaggle-tsa-stage2\n\nThe leaderboard is currently in the process of being cleared and scoring is now setup to accept stage 2 submissions. There are no public leaderboard samples in the new test set, so your submission will either error if something is wrong, or 0.0 if it scored. Note that this means **you must select your submissions that should count for final scoring**. Do not rely on the auto-selection to pick based on public score, as the public score is no longer meaningful!\n\nGood luck, and feel free to use this thread for any comments/questions related to the second stage.", "votes": 3 }, { "id": 256472, "postDate": "2017-12-12T02:49:03.197Z", "rawMarkdown": "", "votes": 1, "replies": [ { "id": 256474, "postDate": "2017-12-12T02:53:11.557Z", "content": "Looking at the other thread it looks like the rules were updated? At one point it was indicating the 15th was the last day to upload a model.
", "rawMarkdown": "Looking at the other thread it looks like the rules were updated? At one point it was indicating the 15th was the last day to upload a model." }, { "id": 256475, "postDate": "2017-12-12T03:04:09.180Z", "rawMarkdown": "" }, { "id": 256479, "postDate": "2017-12-12T03:15:06.903Z", "content": "Yeah, I was confused by the date too. Could I send my hash to an admin?
", "rawMarkdown": "Yeah, I was confused by the date too. Could I send my hash to an admin?", "votes": 1 }, { "id": 256481, "postDate": "2017-12-12T03:24:39.387Z", "content": "Exactly. I found the date posted before:\nModel Upload & First Stage Deadline: 12/15/2017 11:59 PM UTC
", "rawMarkdown": "Exactly. I found the date posted before:\nModel Upload & First Stage Deadline: 12/15/2017 11:59 PM UTC\n" }, { "id": 256482, "postDate": "2017-12-12T03:26:59.060Z", "content": "I'd be happy to upload code/hash somewhere now or preferably tomorrow, if allowed.
", "rawMarkdown": "I'd be happy to upload code/hash somewhere now or preferably tomorrow, if allowed." }, { "id": 256488, "postDate": "2017-12-12T04:01:25.323Z", "content": "52352E453809562A14BF0E8A8DE0696BB24E2F42B4078647369DCF692446433A
\n\nI am ineligible to win a monetary prize, but I provide the above hash for the unlikely situation where I place in a prize position, so I don't get removed from the standings.
\n\n\"if you do not upload a model and finish in a prize position, your team will be removed from the competition standings entirely
", "rawMarkdown": "52352E453809562A14BF0E8A8DE0696BB24E2F42B4078647369DCF692446433A\n\nI am ineligible to win a monetary prize, but I provide the above hash for the unlikely situation where I place in a prize position, so I don't get removed from the standings.\n\n\"if you do not upload a model and finish in a prize position, your team will be removed from the competition standings entirely" }, { "id": 256496, "postDate": "2017-12-12T04:12:52.693Z", "content": "Between the Rules Acceptance Deadline, Team Merge Deadline, Phase 1 Close, Model Upload Deadline, Phase 2 Begin, and Phase 2 Close, there was confusion regarding which dates were which that was brought up in the forums, and it was noted the Timeline tab of the competition page had clearer language.
\n\nYou may submit your sha256 hash to the forums right away to still enter stage 2. However Kaggle does not create the rules of the competition. Should you finish in the Top 8, you should not expect to be eligible for a monetary prize.
", "rawMarkdown": "Between the Rules Acceptance Deadline, Team Merge Deadline, Phase 1 Close, Model Upload Deadline, Phase 2 Begin, and Phase 2 Close, there was confusion regarding which dates were which that was brought up in the forums, and it was noted the Timeline tab of the competition page had clearer language. \n\nYou may submit your sha256 hash to the forums right away to still enter stage 2. However Kaggle does not create the rules of the competition. Should you finish in the Top 8, you should not expect to be eligible for a monetary prize." }, { "id": 256508, "postDate": "2017-12-12T04:47:50.943Z", "content": "FC266718040939076B3F03E44B42CCF05355B01584B6D7662BB75479457584A3
", "rawMarkdown": "FC266718040939076B3F03E44B42CCF05355B01584B6D7662BB75479457584A3" }, { "id": 256513, "postDate": "2017-12-12T05:12:11.353Z", "content": "Thanks Addison! I organized my files a little better so here is my new hash.
\n\n6033351022D8F5A7E3A33DB25E837FA948E6D79F0477383FEAF80101C6941F30
", "rawMarkdown": "Thanks Addison! I organized my files a little better so here is my new hash.\n\n6033351022D8F5A7E3A33DB25E837FA948E6D79F0477383FEAF80101C6941F30" } ] }, { "id": 256465, "postDate": "2017-12-12T02:02:35.227Z", "content": "We are new to 2 stage competitions. Can you clarify a few things
\n\n1)if stage II submissions score 0 or error, why do you encourage people people to submit 5x per day
\n\n2)We are permitted retrain our models for the incremental 100 labels. Does that mean we upload revised model files on December 15?
\n\n3)What is the significance of stage I scores and leaderboard. is this just a feeback loop for people to tune their models and know ehere they stand?
\n\n4)I am a little hazy on selecting two submissions. Do we make two new choices in stage2? Or rather do we submit twice in stage II using the same methodology as the selections we made in stage I. Since our team only uploaded a model based on our #1 submission, can we still make two submissions?
", "rawMarkdown": "We are new to 2 stage competitions. Can you clarify a few things\n\n1)if stage II submissions score 0 or error, why do you encourage people people to submit 5x per day\n\n2)We are permitted retrain our models for the incremental 100 labels. Does that mean we upload revised model files on December 15?\n\n3)What is the significance of stage I scores and leaderboard. is this just a feeback loop for people to tune their models and know ehere they stand?\n\n4)I am a little hazy on selecting two submissions. Do we make two new choices in stage2? Or rather do we submit twice in stage II using the same methodology as the selections we made in stage I. Since our team only uploaded a model based on our #1 submission, can we still make two submissions?", "votes": 1, "replies": [ { "id": 256494, "postDate": "2017-12-12T04:06:14.513Z", "content": "NumericLee,
\n\n1) You do not have to submit 5x per day - 5x per day is the standard limit for our competitions. You're correct, that in this case with a 100% private leaderboard, there is little value to submitting multiple times.
\n\n2) You only need to upload your CSV submission files at this time. When the winners are announced at the conclusion of the competition, we will request final models from those winners.
\n\n3) Correct.
\n\n4) You can certainly make two submissions based on the outlined rules regarding allowable changes to Stage 1 models
", "rawMarkdown": "NumericLee,\n\n1) You do not have to submit 5x per day - 5x per day is the standard limit for our competitions. You're correct, that in this case with a 100% private leaderboard, there is little value to submitting multiple times.\n\n2) You only need to upload your CSV submission files at this time. When the winners are announced at the conclusion of the competition, we will request final models from those winners.\n\n3) Correct.\n\n4) You can certainly make two submissions based on the outlined rules regarding allowable changes to Stage 1 models" } ] }, { "id": 257291, "postDate": "2017-12-13T22:31:23.493Z", "content": "This is really a comment for Kaggle in general. If there is a \"rules change\" where the dates are clarified or changed, can we get a notification sent to the email in our profiles? I was also caught unaware of the deadline. It may have been my mistake but I did see that the text has been updated a few times (via Internet Archive).
", "rawMarkdown": "This is really a comment for Kaggle in general. If there is a \"rules change\" where the dates are clarified or changed, can we get a notification sent to the email in our profiles? I was also caught unaware of the deadline. It may have been my mistake but I did see that the text has been updated a few times (via Internet Archive).", "votes": 2, "replies": [ { "id": 257367, "postDate": "2017-12-14T05:17:13.137Z", "content": "Simon - this is a good recommendation - I'm just brainstorming here (and need to defer to the product team for feasibility), but what about an opt-in feature to receive notifications prior to different competition deadlines (e.g. you could pick a 1-day, 3-day, or 7-day email reminder for the Entry Deadline, Team merge deadline, model upload deadline, etc)? I don't think a \"redline update\" every time something is modified is a feature we can implement right now, however.
\n\nAs for the rules change - the rules point to the competition website as truth. In this case the edits were to provide clarity between unclear rules and a clear Timeline page. I agree, it's not ideal but reconciling the two for clarity was necessary than leaving one unclear.
", "rawMarkdown": "Simon - this is a good recommendation - I'm just brainstorming here (and need to defer to the product team for feasibility), but what about an opt-in feature to receive notifications prior to different competition deadlines (e.g. you could pick a 1-day, 3-day, or 7-day email reminder for the Entry Deadline, Team merge deadline, model upload deadline, etc)? I don't think a \"redline update\" every time something is modified is a feature we can implement right now, however.\n\nAs for the rules change - the rules point to the competition website as truth. In this case the edits were to provide clarity between unclear rules and a clear Timeline page. I agree, it's not ideal but reconciling the two for clarity was necessary than leaving one unclear.", "votes": 1 }, { "id": 257549, "postDate": "2017-12-14T13:08:17.520Z", "content": "Email notifications are a great idea as they may help prevent some of the confusion in the future. I did receive one email, during stage 1, saying I should choose my top submissions - which only added to the confusion as stage 1 results are not relevant to final standings.
\n\nContinuing from discussion below, I feel it's reasonable to say the website is the point of truth. It seems unreasonable to say that one portion of the website is more \"truthier\" than another, and to not notify people of a major update, such as clarifying the dates were incorrect in one portion of the website.
\n\nGiven the confirmed error on the dates, would it not be reasonable for an alternate, acceptable, form of proof should someone be in a top 8 position? May I ask that this is passed on to the TSA please?
", "rawMarkdown": "Email notifications are a great idea as they may help prevent some of the confusion in the future. I did receive one email, during stage 1, saying I should choose my top submissions - which only added to the confusion as stage 1 results are not relevant to final standings.\n\nContinuing from discussion below, I feel it's reasonable to say the website is the point of truth. It seems unreasonable to say that one portion of the website is more \"truthier\" than another, and to not notify people of a major update, such as clarifying the dates were incorrect in one portion of the website. \n\nGiven the confirmed error on the dates, would it not be reasonable for an alternate, acceptable, form of proof should someone be in a top 8 position? May I ask that this is passed on to the TSA please?" } ] }, { "id": 258431, "postDate": "2017-12-16T04:30:39.960Z", "content": "Why the final score did not chose my best score ?\nhttps://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/45816
", "rawMarkdown": "Why the final score did not chose my best score ?\nhttps://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/45816" }, { "id": 257409, "postDate": "2017-12-14T07:32:00.480Z", "content": "I am afraid as not able to download stage2_a3daps.tar.gz data set before deadline as I am having low internet speed at my end. \nAny one recommend me some tips to download the data easily.
", "rawMarkdown": "I am afraid as not able to download stage2_a3daps.tar.gz data set before deadline as I am having low internet speed at my end. \nAny one recommend me some tips to download the data easily.", "replies": [ { "id": 257635, "postDate": "2017-12-14T17:29:55.267Z", "content": "I had much faster download speeds using the google cloud CLI and downloading from the Google Storage Bucket than the zip file on the competition data page.
", "rawMarkdown": "I had much faster download speeds using the google cloud CLI and downloading from the Google Storage Bucket than the zip file on the competition data page. ", "isDeleted": true }, { "id": 257826, "postDate": "2017-12-15T01:10:44.463Z", "content": "Second what Paul said. Adding -m to gsutil cp (i.e., gsutil -m cp -r gs://kaggle-tsa-stage2/stage2/a3daps ./data_dir) will download in parallel, which will cut your download time down to a fraction of what it would be without. Download speeds seem to be (unsurprisingly) much faster from within google cloud compute instances as well.
I just wonder if the ranking in the leaderboard for stage2 is based on the score of prediction or based on the time of submission? Thanks.
", "rawMarkdown": "I just wonder if the ranking in the leaderboard for stage2 is based on the score of prediction or based on the time of submission? Thanks.", "replies": [ { "id": 257312, "postDate": "2017-12-14T01:04:10.897Z", "content": "From looking at the timestamps on the LB it seems like new entries are just being appended. I'm in last place right now.
", "rawMarkdown": "From looking at the timestamps on the LB it seems like new entries are just being appended. I'm in last place right now. ", "isDeleted": true }, { "id": 257368, "postDate": "2017-12-14T05:18:34.017Z", "content": "Correct - the Leaderboard order is based off the order in which the first submission was received.
", "rawMarkdown": "Correct - the Leaderboard order is based off the order in which the first submission was received." } ] }, { "id": 256716, "postDate": "2017-12-12T15:43:06.710Z", "content": "FileNotFoundError: File b'../input/stage1_solution.csv' does not exist\nTrying my stage 1 kernel with new data, i have this error
", "rawMarkdown": " FileNotFoundError: File b'../input/stage1_solution.csv' does not exist\n\nTrying my stage 1 kernel with new data, i have this error" }, { "id": 256692, "postDate": "2017-12-12T15:22:16.330Z", "content": "I wonder how only 28 teams are selected for the stage2 competition? yesterday I saw there are 151 teams, I was one of them, but today it changed to 28 teams. anyone know why?
", "rawMarkdown": "I wonder how only 28 teams are selected for the stage2 competition? yesterday I saw there are 151 teams, I was one of them, but today it changed to 28 teams. anyone know why?", "replies": [ { "id": 256694, "postDate": "2017-12-12T15:24:57.263Z", "content": "I think it's just those people who have already made a stage 2 submission.
", "rawMarkdown": "I think it's just those people who have already made a stage 2 submission. " }, { "id": 256722, "postDate": "2017-12-12T15:51:09.790Z", "content": "but it is too short to submit stage2 within a day, to me I could not finish the model run within a day, furthermore, the rules do not require to submit stage2 by yesterday, I am confused.
", "rawMarkdown": "but it is too short to submit stage2 within a day, to me I could not finish the model run within a day, furthermore, the rules do not require to submit stage2 by yesterday, I am confused." }, { "id": 256725, "postDate": "2017-12-12T15:56:19.850Z", "content": "The 151 teams you saw was when we were still transitioning between Stage 1 and 2. Only teams that have submitted for Stage 2 will appear on the leaderboard with a 0.0 score
", "rawMarkdown": "The 151 teams you saw was when we were still transitioning between Stage 1 and 2. Only teams that have submitted for Stage 2 will appear on the leaderboard with a 0.0 score" }, { "id": 256737, "postDate": "2017-12-12T16:31:16.923Z", "content": "since this is my first time to join Kaggle competition, I am not clear about its process, could you tell what to submit for stage2 in order to compete in the stage2?
", "rawMarkdown": "since this is my first time to join Kaggle competition, I am not clear about its process, could you tell what to submit for stage2 in order to compete in the stage2? " }, { "id": 256739, "postDate": "2017-12-12T16:33:07.593Z", "content": "Wensu,
\n\nOnce you've downloaded the Stage 2 data, you can submit a solution file similar to the file you submitted in stage 1, but based on stage 2 data. See stage2_sample_submission.csv as a template.
", "rawMarkdown": "Wensu,\n\nOnce you've downloaded the Stage 2 data, you can submit a solution file similar to the file you submitted in stage 1, but based on stage 2 data. See stage2_sample_submission.csv as a template." }, { "id": 256742, "postDate": "2017-12-12T16:39:30.963Z", "content": "but I thought the solution file for stage 2 is due by the end of December 15, I have not done my model run yet, how can I submit it plus it is not the due date yet., still confused.
", "rawMarkdown": "but I thought the solution file for stage 2 is due by the end of December 15, I have not done my model run yet, how can I submit it plus it is not the due date yet., still confused." }, { "id": 256743, "postDate": "2017-12-12T16:40:29.177Z", "content": "That is correct. You do not have to submit until the due date, but you will not appear on the leaderboard until you submit.
", "rawMarkdown": "That is correct. You do not have to submit until the due date, but you will not appear on the leaderboard until you submit." }, { "id": 256745, "postDate": "2017-12-12T16:44:55.040Z", "content": "so what you said is I am still able to submit stage2 solution? I thought there is only those 28 teams are qualified for stage2.
", "rawMarkdown": "so what you said is I am still able to submit stage2 solution? I thought there is only those 28 teams are qualified for stage2." }, { "id": 256748, "postDate": "2017-12-12T16:48:35.303Z", "content": "Correct - you can still submit. You will only appear on the leaderboard once you submit.
", "rawMarkdown": "Correct - you can still submit. You will only appear on the leaderboard once you submit." }, { "id": 256793, "postDate": "2017-12-12T18:30:03.657Z", "content": "Thank you very much for your clear explanation and patience to a newbie.
", "rawMarkdown": "Thank you very much for your clear explanation and patience to a newbie." }, { "id": 256795, "postDate": "2017-12-12T18:33:01.983Z", "content": "Certainly! Happy Modeling!
", "rawMarkdown": "Certainly! Happy Modeling!" } ] }, { "id": 256434, "postDate": "2017-12-11T23:23:54.663Z", "rawMarkdown": "", "isDeleted": true, "replies": [ { "id": 256441, "postDate": "2017-12-11T23:47:55.413Z", "content": "Yes, this is allowed and not considered a methodology change.
", "rawMarkdown": "Yes, this is allowed and not considered a methodology change." } ] } ], "comments": [ { "id": 256472, "author_name": "Anthony", "author_url": "", "post_date": "2017-12-12T02:49:03.197000", "content": "", "votes": 1, "replies": [ { "id": 256474, "author_name": "Anthony", "author_url": "", "post_date": "2017-12-12T02:53:11.557000", "content": "Looking at the other thread it looks like the rules were updated? At one point it was indicating the 15th was the last day to upload a model.
", "votes": 0, "replies": [] }, { "id": 256475, "author_name": "Anthony", "author_url": "", "post_date": "2017-12-12T03:04:09.180000", "content": "", "votes": 0, "replies": [] }, { "id": 256479, "author_name": "Jack G", "author_url": "", "post_date": "2017-12-12T03:15:06.903000", "content": "Yeah, I was confused by the date too. Could I send my hash to an admin?
", "votes": 1, "replies": [] }, { "id": 256481, "author_name": "Anthony", "author_url": "", "post_date": "2017-12-12T03:24:39.387000", "content": "Exactly. I found the date posted before:\nModel Upload & First Stage Deadline: 12/15/2017 11:59 PM UTC
", "votes": 0, "replies": [] }, { "id": 256482, "author_name": "Jack G", "author_url": "", "post_date": "2017-12-12T03:26:59.060000", "content": "I'd be happy to upload code/hash somewhere now or preferably tomorrow, if allowed.
", "votes": 0, "replies": [] }, { "id": 256488, "author_name": "Jack G", "author_url": "", "post_date": "2017-12-12T04:01:25.323000", "content": "52352E453809562A14BF0E8A8DE0696BB24E2F42B4078647369DCF692446433A
\n\nI am ineligible to win a monetary prize, but I provide the above hash for the unlikely situation where I place in a prize position, so I don't get removed from the standings.
\n\n\"if you do not upload a model and finish in a prize position, your team will be removed from the competition standings entirely
", "votes": 0, "replies": [] }, { "id": 256496, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T04:12:52.693000", "content": "Between the Rules Acceptance Deadline, Team Merge Deadline, Phase 1 Close, Model Upload Deadline, Phase 2 Begin, and Phase 2 Close, there was confusion regarding which dates were which that was brought up in the forums, and it was noted the Timeline tab of the competition page had clearer language.
\n\nYou may submit your sha256 hash to the forums right away to still enter stage 2. However Kaggle does not create the rules of the competition. Should you finish in the Top 8, you should not expect to be eligible for a monetary prize.
", "votes": 0, "replies": [] }, { "id": 256508, "author_name": "Anthony", "author_url": "", "post_date": "2017-12-12T04:47:50.943000", "content": "FC266718040939076B3F03E44B42CCF05355B01584B6D7662BB75479457584A3
", "votes": 0, "replies": [] }, { "id": 256513, "author_name": "Jack G", "author_url": "", "post_date": "2017-12-12T05:12:11.353000", "content": "Thanks Addison! I organized my files a little better so here is my new hash.
\n\n6033351022D8F5A7E3A33DB25E837FA948E6D79F0477383FEAF80101C6941F30
", "votes": 0, "replies": [] } ] }, { "id": 256465, "author_name": "numericLee", "author_url": "", "post_date": "2017-12-12T02:02:35.227000", "content": "We are new to 2 stage competitions. Can you clarify a few things
\n\n1)if stage II submissions score 0 or error, why do you encourage people people to submit 5x per day
\n\n2)We are permitted retrain our models for the incremental 100 labels. Does that mean we upload revised model files on December 15?
\n\n3)What is the significance of stage I scores and leaderboard. is this just a feeback loop for people to tune their models and know ehere they stand?
\n\n4)I am a little hazy on selecting two submissions. Do we make two new choices in stage2? Or rather do we submit twice in stage II using the same methodology as the selections we made in stage I. Since our team only uploaded a model based on our #1 submission, can we still make two submissions?
", "votes": 1, "replies": [ { "id": 256494, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T04:06:14.513000", "content": "NumericLee,
\n\n1) You do not have to submit 5x per day - 5x per day is the standard limit for our competitions. You're correct, that in this case with a 100% private leaderboard, there is little value to submitting multiple times.
\n\n2) You only need to upload your CSV submission files at this time. When the winners are announced at the conclusion of the competition, we will request final models from those winners.
\n\n3) Correct.
\n\n4) You can certainly make two submissions based on the outlined rules regarding allowable changes to Stage 1 models
", "votes": 0, "replies": [] } ] }, { "id": 257291, "author_name": "simong", "author_url": "", "post_date": "2017-12-13T22:31:23.493000", "content": "This is really a comment for Kaggle in general. If there is a \"rules change\" where the dates are clarified or changed, can we get a notification sent to the email in our profiles? I was also caught unaware of the deadline. It may have been my mistake but I did see that the text has been updated a few times (via Internet Archive).
", "votes": 2, "replies": [ { "id": 257367, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-14T05:17:13.137000", "content": "Simon - this is a good recommendation - I'm just brainstorming here (and need to defer to the product team for feasibility), but what about an opt-in feature to receive notifications prior to different competition deadlines (e.g. you could pick a 1-day, 3-day, or 7-day email reminder for the Entry Deadline, Team merge deadline, model upload deadline, etc)? I don't think a \"redline update\" every time something is modified is a feature we can implement right now, however.
\n\nAs for the rules change - the rules point to the competition website as truth. In this case the edits were to provide clarity between unclear rules and a clear Timeline page. I agree, it's not ideal but reconciling the two for clarity was necessary than leaving one unclear.
", "votes": 1, "replies": [] }, { "id": 257549, "author_name": "Anthony", "author_url": "", "post_date": "2017-12-14T13:08:17.520000", "content": "Email notifications are a great idea as they may help prevent some of the confusion in the future. I did receive one email, during stage 1, saying I should choose my top submissions - which only added to the confusion as stage 1 results are not relevant to final standings.
\n\nContinuing from discussion below, I feel it's reasonable to say the website is the point of truth. It seems unreasonable to say that one portion of the website is more \"truthier\" than another, and to not notify people of a major update, such as clarifying the dates were incorrect in one portion of the website.
\n\nGiven the confirmed error on the dates, would it not be reasonable for an alternate, acceptable, form of proof should someone be in a top 8 position? May I ask that this is passed on to the TSA please?
", "votes": 0, "replies": [] } ] }, { "id": 258431, "author_name": "linbo_casia", "author_url": "", "post_date": "2017-12-16T04:30:39.960000", "content": "Why the final score did not chose my best score ?\nhttps://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/45816
", "votes": 0, "replies": [] }, { "id": 257409, "author_name": "Hamza Zafar", "author_url": "", "post_date": "2017-12-14T07:32:00.480000", "content": "I am afraid as not able to download stage2_a3daps.tar.gz data set before deadline as I am having low internet speed at my end. \nAny one recommend me some tips to download the data easily.
", "votes": 0, "replies": [ { "id": 257635, "author_name": "", "author_url": "", "post_date": "2017-12-14T17:29:55.267000", "content": "I had much faster download speeds using the google cloud CLI and downloading from the Google Storage Bucket than the zip file on the competition data page.
", "votes": 0, "replies": [] }, { "id": 257826, "author_name": "Ryan", "author_url": "", "post_date": "2017-12-15T01:10:44.463000", "content": "Second what Paul said. Adding -m to gsutil cp (i.e., gsutil -m cp -r gs://kaggle-tsa-stage2/stage2/a3daps ./data_dir) will download in parallel, which will cut your download time down to a fraction of what it would be without. Download speeds seem to be (unsurprisingly) much faster from within google cloud compute instances as well.
I just wonder if the ranking in the leaderboard for stage2 is based on the score of prediction or based on the time of submission? Thanks.
", "votes": 0, "replies": [ { "id": 257312, "author_name": "", "author_url": "", "post_date": "2017-12-14T01:04:10.897000", "content": "From looking at the timestamps on the LB it seems like new entries are just being appended. I'm in last place right now.
", "votes": 0, "replies": [] }, { "id": 257368, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-14T05:18:34.017000", "content": "Correct - the Leaderboard order is based off the order in which the first submission was received.
", "votes": 0, "replies": [] } ] }, { "id": 256716, "author_name": "Pierre Sardin", "author_url": "", "post_date": "2017-12-12T15:43:06.710000", "content": "FileNotFoundError: File b'../input/stage1_solution.csv' does not exist\nTrying my stage 1 kernel with new data, i have this error
", "votes": 0, "replies": [] }, { "id": 256692, "author_name": "Wensu", "author_url": "", "post_date": "2017-12-12T15:22:16.330000", "content": "I wonder how only 28 teams are selected for the stage2 competition? yesterday I saw there are 151 teams, I was one of them, but today it changed to 28 teams. anyone know why?
", "votes": 0, "replies": [ { "id": 256694, "author_name": "Rob Rowe", "author_url": "", "post_date": "2017-12-12T15:24:57.263000", "content": "I think it's just those people who have already made a stage 2 submission.
", "votes": 0, "replies": [] }, { "id": 256722, "author_name": "Wensu", "author_url": "", "post_date": "2017-12-12T15:51:09.790000", "content": "but it is too short to submit stage2 within a day, to me I could not finish the model run within a day, furthermore, the rules do not require to submit stage2 by yesterday, I am confused.
", "votes": 0, "replies": [] }, { "id": 256725, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T15:56:19.850000", "content": "The 151 teams you saw was when we were still transitioning between Stage 1 and 2. Only teams that have submitted for Stage 2 will appear on the leaderboard with a 0.0 score
", "votes": 0, "replies": [] }, { "id": 256737, "author_name": "Wensu", "author_url": "", "post_date": "2017-12-12T16:31:16.923000", "content": "since this is my first time to join Kaggle competition, I am not clear about its process, could you tell what to submit for stage2 in order to compete in the stage2?
", "votes": 0, "replies": [] }, { "id": 256739, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T16:33:07.593000", "content": "Wensu,
\n\nOnce you've downloaded the Stage 2 data, you can submit a solution file similar to the file you submitted in stage 1, but based on stage 2 data. See stage2_sample_submission.csv as a template.
", "votes": 0, "replies": [] }, { "id": 256742, "author_name": "Wensu", "author_url": "", "post_date": "2017-12-12T16:39:30.963000", "content": "but I thought the solution file for stage 2 is due by the end of December 15, I have not done my model run yet, how can I submit it plus it is not the due date yet., still confused.
", "votes": 0, "replies": [] }, { "id": 256743, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T16:40:29.177000", "content": "That is correct. You do not have to submit until the due date, but you will not appear on the leaderboard until you submit.
", "votes": 0, "replies": [] }, { "id": 256745, "author_name": "Wensu", "author_url": "", "post_date": "2017-12-12T16:44:55.040000", "content": "so what you said is I am still able to submit stage2 solution? I thought there is only those 28 teams are qualified for stage2.
", "votes": 0, "replies": [] }, { "id": 256748, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T16:48:35.303000", "content": "Correct - you can still submit. You will only appear on the leaderboard once you submit.
", "votes": 0, "replies": [] }, { "id": 256793, "author_name": "Wensu", "author_url": "", "post_date": "2017-12-12T18:30:03.657000", "content": "Thank you very much for your clear explanation and patience to a newbie.
", "votes": 0, "replies": [] }, { "id": 256795, "author_name": "Addison Howard", "author_url": "", "post_date": "2017-12-12T18:33:01.983000", "content": "Certainly! Happy Modeling!
", "votes": 0, "replies": [] } ] }, { "id": 256434, "author_name": "", "author_url": "", "post_date": "2017-12-11T23:23:54.663000", "content": "", "votes": 0, "replies": [ { "id": 256441, "author_name": "Will Cukierski", "author_url": "", "post_date": "2017-12-11T23:47:55.413000", "content": "Yes, this is allowed and not considered a methodology change.
", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "256425": "We have uploaded stage 2 files to the competition data section:\n\n - stage1_solution.csv (you may use this for retraining)\n - stage2_sample_submission.csv\n - stage2_a3daps.tar.gz\n - stage2_aps.tar.gz\n\nIn addition, the full set of files is also live on Google Cloud Storage. If you had access to the first stage bucket, you should now have access to the second stage bucket @ https://storage.cloud.google.com/kaggle-tsa-stage2\n\nThe leaderboard is currently in the process of being cleared and scoring is now setup to accept stage 2 submissions. There are no public leaderboard samples in the new test set, so your submission will either error if something is wrong, or 0.0 if it scored. Note that this means **you must select your submissions that should count for final scoring**. Do not rely on the auto-selection to pick based on public score, as the public score is no longer meaningful!\n\nGood luck, and feel free to use this thread for any comments/questions related to the second stage.", "256472": "", "256465": "We are new to 2 stage competitions. Can you clarify a few things\n\n1)if stage II submissions score 0 or error, why do you encourage people people to submit 5x per day\n\n2)We are permitted retrain our models for the incremental 100 labels. Does that mean we upload revised model files on December 15?\n\n3)What is the significance of stage I scores and leaderboard. is this just a feeback loop for people to tune their models and know ehere they stand?\n\n4)I am a little hazy on selecting two submissions. Do we make two new choices in stage2? Or rather do we submit twice in stage II using the same methodology as the selections we made in stage I. Since our team only uploaded a model based on our #1 submission, can we still make two submissions?", "257291": "This is really a comment for Kaggle in general. If there is a \"rules change\" where the dates are clarified or changed, can we get a notification sent to the email in our profiles? I was also caught unaware of the deadline. It may have been my mistake but I did see that the text has been updated a few times (via Internet Archive).", "258431": "Why the final score did not chose my best score ?\nhttps://www.kaggle.com/c/passenger-screening-algorithm-challenge/discussion/45816", "257409": "I am afraid as not able to download stage2_a3daps.tar.gz data set before deadline as I am having low internet speed at my end. \nAny one recommend me some tips to download the data easily.", "257309": "I just wonder if the ranking in the leaderboard for stage2 is based on the score of prediction or based on the time of submission? Thanks.", "256716": " FileNotFoundError: File b'../input/stage1_solution.csv' does not exist\n\nTrying my stage 1 kernel with new data, i have this error", "256692": "I wonder how only 28 teams are selected for the stage2 competition? yesterday I saw there are 151 teams, I was one of them, but today it changed to 28 teams. anyone know why?", "256434": "" } }