{
  "id": 177474,
  "title": "Submission using submission.csv from training instead of making predictions",
  "url": "/competitions/lyft-motion-prediction-autonomous-vehicles/discussion/177474",
  "author_name": "",
  "post_date": "2020-08-26T04:30:01.180453200Z",
  "votes": 3,
  "comment_count": 6,
  "views": 0,
  "content": "<p></p>\n<p></p>\n<p>Edit: nevermind, it appears there is no private test set, so submitting instantly is fine.</p>",
  "messages": [
    {
      "id": "985871",
      "postDate": "08/26/2020 04:30:01",
      "content": "<p></p>\n<p></p>\n<p>Edit: nevermind, it appears there is no private test set, so submitting instantly is fine.</p>",
      "rawMarkdown": "~~I have submitted a script that creates a submission.csv file by making predictions over the test.zarr data. This works fine when I run the notebook (takes 1-2 hours), but when I submit to the leaderboard, it completes instantly.~~\n\n~~This leads me to believe some portion of the script is failing, and it is defaulting to submitting the old submission file. Are there any differences between the fake test and real test environment we need to account for? Is there anyway to debug the issue? ~~\n\nEdit: nevermind, it appears there is no private test set, so submitting instantly is fine.",
      "votes": null
    },
    {
      "id": "986533",
      "postDate": "08/26/2020 15:20:39",
      "content": "<p><a href=\"https://www.kaggle.com/teddykoker\" target=\"_blank\">@teddykoker</a> I see you climbed up the ladder. Is the issue solved? </p>",
      "rawMarkdown": "teddykoker I see you climbed up the ladder. Is the issue solved?",
      "votes": null
    },
    {
      "id": "986550",
      "postDate": "08/26/2020 15:25:55",
      "content": "<p>Nope, submission still happened in seconds; No actual inference seemed to happen. Are you having the same issue?</p>\n<p>At this point any submission that actually works should get a score ~100 (which is still basically as good as guessing), not ~7000</p>",
      "rawMarkdown": "Nope, submission still happened in seconds; No actual inference seemed to happen. Are you having the same issue?\n\nAt this point any submission that actually works should get a score ~100 (which is still basically as good as guessing), not ~7000",
      "votes": null
    },
    {
      "id": "986562",
      "postDate": "08/26/2020 15:36:21",
      "content": "<p><a href=\"https://www.kaggle.com/teddykoker\" target=\"_blank\">@teddykoker</a> I have the same issue. Just now done with the second submission with the issue. My actual runtime is 9500 sec. But submission runtime is 4.4sec. I was wondering why from yesterday and you kinda reconfirmed. I might know which part of script is not running during submitting. I cant intelligently describe for now. I will get back if I solve it. Could you do the same? </p>",
      "rawMarkdown": "teddykoker I have the same issue. Just now done with the second submission with the issue. My actual runtime is 9500 sec. But submission runtime is 4.4sec. I was wondering why from yesterday and you kinda reconfirmed. I might know which part of script is not running during submitting. I cant intelligently describe for now. I will get back if I solve it. Could you do the same?",
      "votes": null
    },
    {
      "id": "986573",
      "postDate": "08/26/2020 15:47:48",
      "content": "<p>Great, I'll let you know</p>",
      "rawMarkdown": "Great, I'll let you know",
      "votes": null
    },
    {
      "id": "986582",
      "postDate": "08/26/2020 15:55:28",
      "content": "<p>I think submission within a few seconds is ok. In this competition, there is no private test set, so Kaggle is not re-running your script/notebook. (My current result is submitted in a few seconds)</p>",
      "rawMarkdown": "I think submission within a few seconds is ok. In this competition, there is no private test set, so Kaggle is not re-running your script/notebook. (My current result is submitted in a few seconds)",
      "votes": null
    },
    {
      "id": "986592",
      "postDate": "08/26/2020 16:02:13",
      "content": "<p>Ah the test set isn't private! That makes sense now, I'm gonna close this discussion.</p>",
      "rawMarkdown": "Ah the test set isn't private! That makes sense now, I'm gonna close this discussion.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 986533,
      "author_name": "deepakrajpurushothaman",
      "author_url": "",
      "post_date": "08/26/2020 15:20:39",
      "content": "<p><a href=\"https://www.kaggle.com/teddykoker\" target=\"_blank\">@teddykoker</a> I see you climbed up the ladder. Is the issue solved? </p>",
      "votes": null,
      "replies": [
        {
          "id": 986550,
          "author_name": "teddykoker",
          "author_url": "",
          "post_date": "08/26/2020 15:25:55",
          "content": "<p>Nope, submission still happened in seconds; No actual inference seemed to happen. Are you having the same issue?</p>\n<p>At this point any submission that actually works should get a score ~100 (which is still basically as good as guessing), not ~7000</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 986562,
          "author_name": "deepakrajpurushothaman",
          "author_url": "",
          "post_date": "08/26/2020 15:36:21",
          "content": "<p><a href=\"https://www.kaggle.com/teddykoker\" target=\"_blank\">@teddykoker</a> I have the same issue. Just now done with the second submission with the issue. My actual runtime is 9500 sec. But submission runtime is 4.4sec. I was wondering why from yesterday and you kinda reconfirmed. I might know which part of script is not running during submitting. I cant intelligently describe for now. I will get back if I solve it. Could you do the same? </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 986573,
          "author_name": "teddykoker",
          "author_url": "",
          "post_date": "08/26/2020 15:47:48",
          "content": "<p>Great, I'll let you know</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 986582,
          "author_name": "pestipeti",
          "author_url": "",
          "post_date": "08/26/2020 15:55:28",
          "content": "<p>I think submission within a few seconds is ok. In this competition, there is no private test set, so Kaggle is not re-running your script/notebook. (My current result is submitted in a few seconds)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 986592,
          "author_name": "teddykoker",
          "author_url": "",
          "post_date": "08/26/2020 16:02:13",
          "content": "<p>Ah the test set isn't private! That makes sense now, I'm gonna close this discussion.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "985871": "~~I have submitted a script that creates a submission.csv file by making predictions over the test.zarr data. This works fine when I run the notebook (takes 1-2 hours), but when I submit to the leaderboard, it completes instantly.~~\n\n~~This leads me to believe some portion of the script is failing, and it is defaulting to submitting the old submission file. Are there any differences between the fake test and real test environment we need to account for? Is there anyway to debug the issue? ~~\n\nEdit: nevermind, it appears there is no private test set, so submitting instantly is fine.",
    "986533": "teddykoker I see you climbed up the ladder. Is the issue solved?",
    "986550": "Nope, submission still happened in seconds; No actual inference seemed to happen. Are you having the same issue?\n\nAt this point any submission that actually works should get a score ~100 (which is still basically as good as guessing), not ~7000",
    "986562": "teddykoker I have the same issue. Just now done with the second submission with the issue. My actual runtime is 9500 sec. But submission runtime is 4.4sec. I was wondering why from yesterday and you kinda reconfirmed. I might know which part of script is not running during submitting. I cant intelligently describe for now. I will get back if I solve it. Could you do the same?",
    "986573": "Great, I'll let you know",
    "986582": "I think submission within a few seconds is ok. In this competition, there is no private test set, so Kaggle is not re-running your script/notebook. (My current result is submitted in a few seconds)",
    "986592": "Ah the test set isn't private! That makes sense now, I'm gonna close this discussion."
  },
  "source": "meta"
}