{
  "id": 131553,
  "title": "Submission error even though commit works",
  "url": "/competitions/deepfake-detection-challenge/discussion/131553",
  "author_name": "",
  "post_date": "2020-02-20T11:00:05.223690400Z",
  "votes": null,
  "comment_count": 6,
  "views": 0,
  "content": "<p>Hey, does anyone have any tips?</p>\n\n<p>During interactive session / submit everything works, but my submissions constantly get an error. </p>\n\n<p>A \"submission.csv\" gets created that I can submit to the competition, having the structure:</p>\n\n<p>| filename | label |\n| --- | --- |\n| sdasdsad.mp4 | values between 0 and 1 |</p>\n\n<p>Am I missing something? Does it timeout after some time? Should the values be 1 or 0?</p>",
  "messages": [
    {
      "id": "751633",
      "postDate": "02/20/2020 11:00:05",
      "content": "<p>Hey, does anyone have any tips?</p>\n\n<p>During interactive session / submit everything works, but my submissions constantly get an error. </p>\n\n<p>A \"submission.csv\" gets created that I can submit to the competition, having the structure:</p>\n\n<p>| filename | label |\n| --- | --- |\n| sdasdsad.mp4 | values between 0 and 1 |</p>\n\n<p>Am I missing something? Does it timeout after some time? Should the values be 1 or 0?</p>",
      "rawMarkdown": "Hey, does anyone have any tips?\n\nDuring interactive session / submit everything works, but my submissions constantly get an error. \n\nA \"submission.csv\" gets created that I can submit to the competition, having the structure:\n\n| filename | label |\n| --- | --- |\n| sdasdsad.mp4 | values between 0 and 1 |\n\nAm I missing something? Does it timeout after some time? Should the values be 1 or 0?",
      "votes": null
    },
    {
      "id": "751726",
      "postDate": "02/20/2020 12:51:23",
      "content": "<p>The values can be a value from 0 to 1, where \"1\" represents that the model 100% certain the video is fake. What error are you recieving when you submit? For instance, if you're getting a \"timeout\" error then your submission is taking too long, a \"submission csv not found\" means that either a timeout has occured or some error prevents your code from producing the csv in the first place... </p>",
      "rawMarkdown": "The values can be a value from 0 to 1, where \"1\" represents that the model 100% certain the video is fake. What error are you recieving when you submit? For instance, if you're getting a \"timeout\" error then your submission is taking too long, a \"submission csv not found\" means that either a timeout has occured or some error prevents your code from producing the csv in the first place...",
      "votes": null
    },
    {
      "id": "751745",
      "postDate": "02/20/2020 13:20:58",
      "content": "<p>Hey Ryan, thanks for your reply. \nI am getting \"Submission Scoring Error\", and the error overlay saying \"Not further specified\"\nBut until the error occurs it is taking ~1h, that is why I concluded a possible timeout even though nothing timeout-wise is shown...<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3573504%2F039c548b7c3eb07021790c909049d048%2FAnnotation%202020-02-20%20142029.png?generation=1582204851255732&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Hey Ryan, thanks for your reply. \nI am getting \"Submission Scoring Error\", and the error overlay saying \"Not further specified\"\nBut until the error occurs it is taking ~1h, that is why I concluded a possible timeout even though nothing timeout-wise is shown...![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3573504%2F039c548b7c3eb07021790c909049d048%2FAnnotation%202020-02-20%20142029.png?generation=1582204851255732&amp;alt=media)",
      "votes": null
    },
    {
      "id": "751804",
      "postDate": "02/20/2020 14:30:02",
      "content": "<p>According to the docs this error means - Your notebook generated a submission.csv file with incorrect format. Some examples causing this are having the wrong number of rows or columns, empty values, an incorrect datatype for a value, or invalid submission values from what is expected for the privately rerun test set. \nWhen you commit your kernel, does it produce a csv with 401 rows (1 row for heading, 400 for each video in the testing dataset), if not you aren't producing the csv correctly. I would start there - I know there's a few baseline kernels floating around which have example outputs and how they should be formatted so have a look at those too. Once you have confirmed this with your output of your commit, then run the submission. Remember the submission will be run with a lot larger (roughly 4000 videos) dataset so your output csv will be 4000 rows (even though you won't be able to access it). Hope that makes sense!</p>",
      "rawMarkdown": "According to the docs this error means - Your notebook generated a submission.csv file with incorrect format. Some examples causing this are having the wrong number of rows or columns, empty values, an incorrect datatype for a value, or invalid submission values from what is expected for the privately rerun test set. \nWhen you commit your kernel, does it produce a csv with 401 rows (1 row for heading, 400 for each video in the testing dataset), if not you aren't producing the csv correctly. I would start there - I know there's a few baseline kernels floating around which have example outputs and how they should be formatted so have a look at those too. Once you have confirmed this with your output of your commit, then run the submission. Remember the submission will be run with a lot larger (roughly 4000 videos) dataset so your output csv will be 4000 rows (even though you won't be able to access it). Hope that makes sense!",
      "votes": null
    },
    {
      "id": "751805",
      "postDate": "02/20/2020 14:31:51",
      "content": "<p>And just fyi- you have 9 hours of cpu/gpu time to run a submission, so completing in 1 hour is well within the time limits. Make sure you're not hard coding 400 videos somewhere...you should be iterating through all the videos in the test directory! </p>",
      "rawMarkdown": "And just fyi- you have 9 hours of cpu/gpu time to run a submission, so completing in 1 hour is well within the time limits. Make sure you're not hard coding 400 videos somewhere...you should be iterating through all the videos in the test directory!",
      "votes": null
    },
    {
      "id": "751911",
      "postDate": "02/20/2020 16:18:54",
      "content": "<p>Nice, thanks for the starting point!\nI might try using another kernel and just plugging in my model... \nDo you know by chance if the \"evaluating machine\" has the same RAM specifications as the commit/interactive session? So like ~13GB RAM I guess? I almost used up all the RAM in my notebook, so that might be sth. I will try again tomorrow when I can submit again (unfortunately failed submissions count as well :/ )</p>",
      "rawMarkdown": "Nice, thanks for the starting point!\nI might try using another kernel and just plugging in my model... \nDo you know by chance if the \"evaluating machine\" has the same RAM specifications as the commit/interactive session? So like ~13GB RAM I guess? I almost used up all the RAM in my notebook, so that might be sth. I will try again tomorrow when I can submit again (unfortunately failed submissions count as well :/ )",
      "votes": null
    },
    {
      "id": "752376",
      "postDate": "02/21/2020 00:09:11",
      "content": "<p>I assume the specs of the \"evaluating machine\" are the same as the kernel you're using atm goodluck!</p>",
      "rawMarkdown": "I assume the specs of the \"evaluating machine\" are the same as the kernel you're using atm goodluck!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 751726,
      "author_name": "rah123123",
      "author_url": "",
      "post_date": "02/20/2020 12:51:23",
      "content": "<p>The values can be a value from 0 to 1, where \"1\" represents that the model 100% certain the video is fake. What error are you recieving when you submit? For instance, if you're getting a \"timeout\" error then your submission is taking too long, a \"submission csv not found\" means that either a timeout has occured or some error prevents your code from producing the csv in the first place... </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 751745,
      "author_name": "guesejustin",
      "author_url": "",
      "post_date": "02/20/2020 13:20:58",
      "content": "<p>Hey Ryan, thanks for your reply. \nI am getting \"Submission Scoring Error\", and the error overlay saying \"Not further specified\"\nBut until the error occurs it is taking ~1h, that is why I concluded a possible timeout even though nothing timeout-wise is shown...<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3573504%2F039c548b7c3eb07021790c909049d048%2FAnnotation%202020-02-20%20142029.png?generation=1582204851255732&amp;alt=media\" alt=\"\"></p>",
      "votes": null,
      "replies": [
        {
          "id": 751804,
          "author_name": "rah123123",
          "author_url": "",
          "post_date": "02/20/2020 14:30:02",
          "content": "<p>According to the docs this error means - Your notebook generated a submission.csv file with incorrect format. Some examples causing this are having the wrong number of rows or columns, empty values, an incorrect datatype for a value, or invalid submission values from what is expected for the privately rerun test set. \nWhen you commit your kernel, does it produce a csv with 401 rows (1 row for heading, 400 for each video in the testing dataset), if not you aren't producing the csv correctly. I would start there - I know there's a few baseline kernels floating around which have example outputs and how they should be formatted so have a look at those too. Once you have confirmed this with your output of your commit, then run the submission. Remember the submission will be run with a lot larger (roughly 4000 videos) dataset so your output csv will be 4000 rows (even though you won't be able to access it). Hope that makes sense!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 751805,
          "author_name": "rah123123",
          "author_url": "",
          "post_date": "02/20/2020 14:31:51",
          "content": "<p>And just fyi- you have 9 hours of cpu/gpu time to run a submission, so completing in 1 hour is well within the time limits. Make sure you're not hard coding 400 videos somewhere...you should be iterating through all the videos in the test directory! </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 751911,
          "author_name": "guesejustin",
          "author_url": "",
          "post_date": "02/20/2020 16:18:54",
          "content": "<p>Nice, thanks for the starting point!\nI might try using another kernel and just plugging in my model... \nDo you know by chance if the \"evaluating machine\" has the same RAM specifications as the commit/interactive session? So like ~13GB RAM I guess? I almost used up all the RAM in my notebook, so that might be sth. I will try again tomorrow when I can submit again (unfortunately failed submissions count as well :/ )</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 752376,
          "author_name": "rah123123",
          "author_url": "",
          "post_date": "02/21/2020 00:09:11",
          "content": "<p>I assume the specs of the \"evaluating machine\" are the same as the kernel you're using atm goodluck!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "751633": "Hey, does anyone have any tips?\n\nDuring interactive session / submit everything works, but my submissions constantly get an error. \n\nA \"submission.csv\" gets created that I can submit to the competition, having the structure:\n\n| filename | label |\n| --- | --- |\n| sdasdsad.mp4 | values between 0 and 1 |\n\nAm I missing something? Does it timeout after some time? Should the values be 1 or 0?",
    "751726": "The values can be a value from 0 to 1, where \"1\" represents that the model 100% certain the video is fake. What error are you recieving when you submit? For instance, if you're getting a \"timeout\" error then your submission is taking too long, a \"submission csv not found\" means that either a timeout has occured or some error prevents your code from producing the csv in the first place...",
    "751745": "Hey Ryan, thanks for your reply. \nI am getting \"Submission Scoring Error\", and the error overlay saying \"Not further specified\"\nBut until the error occurs it is taking ~1h, that is why I concluded a possible timeout even though nothing timeout-wise is shown...![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3573504%2F039c548b7c3eb07021790c909049d048%2FAnnotation%202020-02-20%20142029.png?generation=1582204851255732&amp;alt=media)",
    "751804": "According to the docs this error means - Your notebook generated a submission.csv file with incorrect format. Some examples causing this are having the wrong number of rows or columns, empty values, an incorrect datatype for a value, or invalid submission values from what is expected for the privately rerun test set. \nWhen you commit your kernel, does it produce a csv with 401 rows (1 row for heading, 400 for each video in the testing dataset), if not you aren't producing the csv correctly. I would start there - I know there's a few baseline kernels floating around which have example outputs and how they should be formatted so have a look at those too. Once you have confirmed this with your output of your commit, then run the submission. Remember the submission will be run with a lot larger (roughly 4000 videos) dataset so your output csv will be 4000 rows (even though you won't be able to access it). Hope that makes sense!",
    "751805": "And just fyi- you have 9 hours of cpu/gpu time to run a submission, so completing in 1 hour is well within the time limits. Make sure you're not hard coding 400 videos somewhere...you should be iterating through all the videos in the test directory!",
    "751911": "Nice, thanks for the starting point!\nI might try using another kernel and just plugging in my model... \nDo you know by chance if the \"evaluating machine\" has the same RAM specifications as the commit/interactive session? So like ~13GB RAM I guess? I almost used up all the RAM in my notebook, so that might be sth. I will try again tomorrow when I can submit again (unfortunately failed submissions count as well :/ )",
    "752376": "I assume the specs of the \"evaluating machine\" are the same as the kernel you're using atm goodluck!"
  },
  "source": "meta"
}