{
  "id": 400954,
  "title": "Same training script encountered both submission success and submission error",
  "url": "/competitions/asl-signs/discussion/400954",
  "author_name": "",
  "post_date": "2023-04-11T04:30:42.282409Z",
  "votes": null,
  "comment_count": 5,
  "views": 0,
  "content": "<p>As tittle, I encountered submission error even though I use the same training script.<br>\nThe only difference between different version of script  is USE_VAL setting.<br>\nWhen USE_VAL=True, it succeeded.<br>\nWhen USE_VAL=False, it failed.<br>\nWhy..??</p>",
  "messages": [
    {
      "id": "2217637",
      "postDate": "04/11/2023 04:30:42",
      "content": "<p>As tittle, I encountered submission error even though I use the same training script.<br>\nThe only difference between different version of script  is USE_VAL setting.<br>\nWhen USE_VAL=True, it succeeded.<br>\nWhen USE_VAL=False, it failed.<br>\nWhy..??</p>",
      "rawMarkdown": "As tittle, I encountered submission error even though I use the same training script.\nThe only difference between different version of script  is USE_VAL setting.\nWhen USE_VAL=True, it succeeded.\nWhen USE_VAL=False, it failed.\nWhy..??",
      "votes": null
    },
    {
      "id": "2217931",
      "postDate": "04/11/2023 09:18:08",
      "content": "<p>Verify model prediction is &lt;&lt;&lt;100ms by add data and inference.</p>",
      "rawMarkdown": "Verify model prediction is <<<100ms by add data and inference.",
      "votes": null
    },
    {
      "id": "2217963",
      "postDate": "04/11/2023 09:49:18",
      "content": "<p>Hi! Please refer to the following discussion: <a href=\"https://www.kaggle.com/competitions/asl-signs/discussion/396211\" target=\"_blank\">https://www.kaggle.com/competitions/asl-signs/discussion/396211</a></p>",
      "rawMarkdown": "Hi! Please refer to the following discussion: https://www.kaggle.com/competitions/asl-signs/discussion/396211",
      "votes": null
    },
    {
      "id": "2217982",
      "postDate": "04/11/2023 10:08:46",
      "content": "<p>Thanks for help.<br>\nIs the best solution for this problem  to make model inference speed faster by something?</p>",
      "rawMarkdown": "Thanks for help.\nIs the best solution for this problem  to make model inference speed faster by something?",
      "votes": null
    },
    {
      "id": "2217991",
      "postDate": "04/11/2023 10:18:09",
      "content": "<p>Since the submission time isn't stable, I would suggest using the model which gets through time limit in any case so far. For example, you can submit 4 instead of 5 folds now. And then try to submit 5 folds several times again closer to the end of competition and hope that at least one of those subs will pass.</p>",
      "rawMarkdown": "Since the submission time isn't stable, I would suggest using the model which gets through time limit in any case so far. For example, you can submit 4 instead of 5 folds now. And then try to submit 5 folds several times again closer to the end of competition and hope that at least one of those subs will pass.",
      "votes": null
    },
    {
      "id": "2218317",
      "postDate": "04/11/2023 15:17:38",
      "content": "<p>That’s nice strategy. Thank you.</p>",
      "rawMarkdown": "That’s nice strategy. Thank you.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2217931,
      "author_name": "clearwaterkzk",
      "author_url": "",
      "post_date": "04/11/2023 09:18:08",
      "content": "<p>Verify model prediction is &lt;&lt;&lt;100ms by add data and inference.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2217963,
      "author_name": "vadimtimakin",
      "author_url": "",
      "post_date": "04/11/2023 09:49:18",
      "content": "<p>Hi! Please refer to the following discussion: <a href=\"https://www.kaggle.com/competitions/asl-signs/discussion/396211\" target=\"_blank\">https://www.kaggle.com/competitions/asl-signs/discussion/396211</a></p>",
      "votes": null,
      "replies": [
        {
          "id": 2217982,
          "author_name": "clearwaterkzk",
          "author_url": "",
          "post_date": "04/11/2023 10:08:46",
          "content": "<p>Thanks for help.<br>\nIs the best solution for this problem  to make model inference speed faster by something?</p>",
          "votes": null,
          "replies": [
            {
              "id": 2217991,
              "author_name": "vadimtimakin",
              "author_url": "",
              "post_date": "04/11/2023 10:18:09",
              "content": "<p>Since the submission time isn't stable, I would suggest using the model which gets through time limit in any case so far. For example, you can submit 4 instead of 5 folds now. And then try to submit 5 folds several times again closer to the end of competition and hope that at least one of those subs will pass.</p>",
              "votes": null,
              "replies": [
                {
                  "id": 2218317,
                  "author_name": "clearwaterkzk",
                  "author_url": "",
                  "post_date": "04/11/2023 15:17:38",
                  "content": "<p>That’s nice strategy. Thank you.</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2217637": "As tittle, I encountered submission error even though I use the same training script.\nThe only difference between different version of script  is USE_VAL setting.\nWhen USE_VAL=True, it succeeded.\nWhen USE_VAL=False, it failed.\nWhy..??",
    "2217931": "Verify model prediction is <<<100ms by add data and inference.",
    "2217963": "Hi! Please refer to the following discussion: https://www.kaggle.com/competitions/asl-signs/discussion/396211",
    "2217982": "Thanks for help.\nIs the best solution for this problem  to make model inference speed faster by something?",
    "2217991": "Since the submission time isn't stable, I would suggest using the model which gets through time limit in any case so far. For example, you can submit 4 instead of 5 folds now. And then try to submit 5 folds several times again closer to the end of competition and hope that at least one of those subs will pass.",
    "2218317": "That’s nice strategy. Thank you."
  },
  "source": "meta"
}