{
  "id": 400203,
  "title": "how to deal with submission scoring error?",
  "url": "/competitions/asl-signs/discussion/400203",
  "author_name": "",
  "post_date": "2023-04-07T07:57:41.422559500Z",
  "votes": null,
  "comment_count": 4,
  "views": 0,
  "content": "<p>hi,<br>\nI'm a kaggle beginner, and I am currently facing a submission scoring error issue.</p>\n<p>My model size is 10MB or less and I have created a submission.zip file with code similar to the submission part of the link below, but I am getting the same error.</p>\n<p><a href=\"https://www.kaggle.com/code/changyongko/end-to-end-pytorch-training-submission\" target=\"_blank\">https://www.kaggle.com/code/changyongko/end-to-end-pytorch-training-submission</a></p>\n<p>What can I do to resolve this issue?</p>",
  "messages": [
    {
      "id": "2212976",
      "postDate": "04/07/2023 07:57:41",
      "content": "<p>hi,<br>\nI'm a kaggle beginner, and I am currently facing a submission scoring error issue.</p>\n<p>My model size is 10MB or less and I have created a submission.zip file with code similar to the submission part of the link below, but I am getting the same error.</p>\n<p><a href=\"https://www.kaggle.com/code/changyongko/end-to-end-pytorch-training-submission\" target=\"_blank\">https://www.kaggle.com/code/changyongko/end-to-end-pytorch-training-submission</a></p>\n<p>What can I do to resolve this issue?</p>",
      "rawMarkdown": "hi,\nI'm a kaggle beginner, and I am currently facing a submission scoring error issue.\n\nMy model size is 10MB or less and I have created a submission.zip file with code similar to the submission part of the link below, but I am getting the same error.\n\nhttps://www.kaggle.com/code/changyongko/end-to-end-pytorch-training-submission\n\nWhat can I do to resolve this issue?",
      "votes": null
    },
    {
      "id": "2213005",
      "postDate": "04/07/2023 08:41:34",
      "content": "<p>Your notebook is private, so I can't take a look. What kind of submission error do you get? Did you try a tflite model locally? Is your version of tflite-runtime 2.9.1? Try to predict the sample with tflite model without importing TensorFlow first.</p>",
      "rawMarkdown": "Your notebook is private, so I can't take a look. What kind of submission error do you get? Did you try a tflite model locally? Is your version of tflite-runtime 2.9.1? Try to predict the sample with tflite model without importing TensorFlow first.",
      "votes": null
    },
    {
      "id": "2214192",
      "postDate": "04/08/2023 08:27:11",
      "content": "<p>Can you elaborate on how to test locally? I'm running a single sample prediction after the model has been trained and it takes less than 100ms (Encounter scoring error). I think maybe I'm not using directly tflite for prediction.</p>",
      "rawMarkdown": "Can you elaborate on how to test locally? I'm running a single sample prediction after the model has been trained and it takes less than 100ms (Encounter scoring error). I think maybe I'm not using directly tflite for prediction.",
      "votes": null
    },
    {
      "id": "2214552",
      "postDate": "04/08/2023 15:11:54",
      "content": "<p>Here's what i got for the scoring error:<br>\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips</p>\n<p>my version of tflite-runtime is 2.11.0. Do i have to match the library version? When i installed tflite-runtime with version 2.9.1, running 'interpreter = tflite.Interpreter(tflite_model_path)' caused the notebook to exit, so I submitted it with version 2.11.0.</p>\n<p>For now, let's test the tflite model without importing Tensorflow as you suggested.<br>\nthanks.</p>",
      "rawMarkdown": "Here's what i got for the scoring error:\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips\n\nmy version of tflite-runtime is 2.11.0. Do i have to match the library version? When i installed tflite-runtime with version 2.9.1, running 'interpreter = tflite.Interpreter(tflite_model_path)' caused the notebook to exit, so I submitted it with version 2.11.0.\n\nFor now, let's test the tflite model without importing Tensorflow as you suggested.\nthanks.",
      "votes": null
    },
    {
      "id": "2216310",
      "postDate": "04/10/2023 01:53:30",
      "content": "<p>could you take a look at my test_submission code?<br>\nIn version 2.9.1, the notebook is turned off when running tflite.Interpreter(tflite_model_path) at the end of the script. On the other hand, in version 2.11.0, it runs fine until the last line of code, but encounter scoring error on submission.</p>",
      "rawMarkdown": "could you take a look at my test_submission code?\nIn version 2.9.1, the notebook is turned off when running tflite.Interpreter(tflite_model_path) at the end of the script. On the other hand, in version 2.11.0, it runs fine until the last line of code, but encounter scoring error on submission.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2213005,
      "author_name": "meowmeowmeowmeowmeow",
      "author_url": "",
      "post_date": "04/07/2023 08:41:34",
      "content": "<p>Your notebook is private, so I can't take a look. What kind of submission error do you get? Did you try a tflite model locally? Is your version of tflite-runtime 2.9.1? Try to predict the sample with tflite model without importing TensorFlow first.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2214192,
          "author_name": "jacksonyou",
          "author_url": "",
          "post_date": "04/08/2023 08:27:11",
          "content": "<p>Can you elaborate on how to test locally? I'm running a single sample prediction after the model has been trained and it takes less than 100ms (Encounter scoring error). I think maybe I'm not using directly tflite for prediction.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2214552,
          "author_name": "changyongko",
          "author_url": "",
          "post_date": "04/08/2023 15:11:54",
          "content": "<p>Here's what i got for the scoring error:<br>\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips</p>\n<p>my version of tflite-runtime is 2.11.0. Do i have to match the library version? When i installed tflite-runtime with version 2.9.1, running 'interpreter = tflite.Interpreter(tflite_model_path)' caused the notebook to exit, so I submitted it with version 2.11.0.</p>\n<p>For now, let's test the tflite model without importing Tensorflow as you suggested.<br>\nthanks.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2216310,
          "author_name": "changyongko",
          "author_url": "",
          "post_date": "04/10/2023 01:53:30",
          "content": "<p>could you take a look at my test_submission code?<br>\nIn version 2.9.1, the notebook is turned off when running tflite.Interpreter(tflite_model_path) at the end of the script. On the other hand, in version 2.11.0, it runs fine until the last line of code, but encounter scoring error on submission.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2212976": "hi,\nI'm a kaggle beginner, and I am currently facing a submission scoring error issue.\n\nMy model size is 10MB or less and I have created a submission.zip file with code similar to the submission part of the link below, but I am getting the same error.\n\nhttps://www.kaggle.com/code/changyongko/end-to-end-pytorch-training-submission\n\nWhat can I do to resolve this issue?",
    "2213005": "Your notebook is private, so I can't take a look. What kind of submission error do you get? Did you try a tflite model locally? Is your version of tflite-runtime 2.9.1? Try to predict the sample with tflite model without importing TensorFlow first.",
    "2214192": "Can you elaborate on how to test locally? I'm running a single sample prediction after the model has been trained and it takes less than 100ms (Encounter scoring error). I think maybe I'm not using directly tflite for prediction.",
    "2214552": "Here's what i got for the scoring error:\nYour notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected. See more debugging tips\n\nmy version of tflite-runtime is 2.11.0. Do i have to match the library version? When i installed tflite-runtime with version 2.9.1, running 'interpreter = tflite.Interpreter(tflite_model_path)' caused the notebook to exit, so I submitted it with version 2.11.0.\n\nFor now, let's test the tflite model without importing Tensorflow as you suggested.\nthanks.",
    "2216310": "could you take a look at my test_submission code?\nIn version 2.9.1, the notebook is turned off when running tflite.Interpreter(tflite_model_path) at the end of the script. On the other hand, in version 2.11.0, it runs fine until the last line of code, but encounter scoring error on submission."
  },
  "source": "meta"
}