{
  "id": 551837,
  "title": "Notebook Threw Exception: I run the notebook with no error. Error only occur on submission. ",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/551837",
  "author_name": "",
  "post_date": "2024-12-15T23:07:10.523984900Z",
  "votes": null,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Anyone please help me with the error. <br>\nI run the notebook with no error. Error only occur on submission. <br>\nLogs also seems ok. It ran only 42.9sec (see attachment).</p>",
  "messages": [
    {
      "id": "3073009",
      "postDate": "12/15/2024 23:07:10",
      "content": "<p>Anyone please help me with the error. <br>\nI run the notebook with no error. Error only occur on submission. <br>\nLogs also seems ok. It ran only 42.9sec (see attachment).</p>",
      "rawMarkdown": "Anyone please help me with the error. \n\nI run the notebook with no error. Error only occur on submission. \nLogs also seems ok. It ran only 42.9sec (see attachment).",
      "votes": null
    },
    {
      "id": "3073552",
      "postDate": "12/16/2024 15:48:32",
      "content": "<p>Hello, when you run your notebook, it only executes on the first test chunk and the first lag chunk. This is why it seems to work correctly at the start. However, the submission can still fail afterward, possibly due to errors that occur in subsequent chunks—such as issues with a groupby operation, a merge involving lag features, or other unforeseen errors.</p>",
      "rawMarkdown": "Hello, when you run your notebook, it only executes on the first test chunk and the first lag chunk. This is why it seems to work correctly at the start. However, the submission can still fail afterward, possibly due to errors that occur in subsequent chunks—such as issues with a groupby operation, a merge involving lag features, or other unforeseen errors.",
      "votes": null
    },
    {
      "id": "3074748",
      "postDate": "12/18/2024 02:51:38",
      "content": "<p>hey, am having the exact same issue. I am trying to add more features in the predict function. Have you figured out yours?</p>",
      "rawMarkdown": "hey, am having the exact same issue. I am trying to add more features in the predict function. Have you figured out yours?",
      "votes": null
    },
    {
      "id": "3076233",
      "postDate": "12/19/2024 19:15:16",
      "content": "<p>I found error in the code, error occurred only on the hidden test set after the first batch. <a href=\"https://www.kaggle.com/moujahidboulaouz\" target=\"_blank\">@moujahidboulaouz</a> response above was correct. Now my problem is timeout😅</p>",
      "rawMarkdown": "I found error in the code, error occurred only on the hidden test set after the first batch. @moujahidboulaouz response above was correct. Now my problem is timeout😅",
      "votes": null
    },
    {
      "id": "3076295",
      "postDate": "12/19/2024 20:49:03",
      "content": "<p>If you're using TensorFlow, consider converting your models to TensorFlow Lite. This transformation can significantly reduce processing time—for example, in my case, it dropped from 6 hours to just 1 hour.</p>",
      "rawMarkdown": "If you're using TensorFlow, consider converting your models to TensorFlow Lite. This transformation can significantly reduce processing time—for example, in my case, it dropped from 6 hours to just 1 hour.",
      "votes": null
    },
    {
      "id": "3078473",
      "postDate": "12/22/2024 11:14:42",
      "content": "<p>I am experiencing the same issue on several of my recent submissions. Submission file has correct format. It doesn't seem to have any timeout issues. Tried to change from T4 to P100, as suggested by some to no avail. I don't know what else to do to rectify this issue! Any other suggestions to look into? Thanks.</p>",
      "rawMarkdown": "I am experiencing the same issue on several of my recent submissions. Submission file has correct format. It doesn't seem to have any timeout issues. Tried to change from T4 to P100, as suggested by some to no avail. I don't know what else to do to rectify this issue! Any other suggestions to look into? Thanks.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3073552,
      "author_name": "moujahidboulaouz",
      "author_url": "",
      "post_date": "12/16/2024 15:48:32",
      "content": "<p>Hello, when you run your notebook, it only executes on the first test chunk and the first lag chunk. This is why it seems to work correctly at the start. However, the submission can still fail afterward, possibly due to errors that occur in subsequent chunks—such as issues with a groupby operation, a merge involving lag features, or other unforeseen errors.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3074748,
      "author_name": "",
      "author_url": "",
      "post_date": "12/18/2024 02:51:38",
      "content": "<p>hey, am having the exact same issue. I am trying to add more features in the predict function. Have you figured out yours?</p>",
      "votes": null,
      "replies": [
        {
          "id": 3076233,
          "author_name": "lealpermalino",
          "author_url": "",
          "post_date": "12/19/2024 19:15:16",
          "content": "<p>I found error in the code, error occurred only on the hidden test set after the first batch. <a href=\"https://www.kaggle.com/moujahidboulaouz\" target=\"_blank\">@moujahidboulaouz</a> response above was correct. Now my problem is timeout😅</p>",
          "votes": null,
          "replies": [
            {
              "id": 3076295,
              "author_name": "moujahidboulaouz",
              "author_url": "",
              "post_date": "12/19/2024 20:49:03",
              "content": "<p>If you're using TensorFlow, consider converting your models to TensorFlow Lite. This transformation can significantly reduce processing time—for example, in my case, it dropped from 6 hours to just 1 hour.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3078473,
      "author_name": "neuralfive",
      "author_url": "",
      "post_date": "12/22/2024 11:14:42",
      "content": "<p>I am experiencing the same issue on several of my recent submissions. Submission file has correct format. It doesn't seem to have any timeout issues. Tried to change from T4 to P100, as suggested by some to no avail. I don't know what else to do to rectify this issue! Any other suggestions to look into? Thanks.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3073009": "Anyone please help me with the error. \n\nI run the notebook with no error. Error only occur on submission. \nLogs also seems ok. It ran only 42.9sec (see attachment).",
    "3073552": "Hello, when you run your notebook, it only executes on the first test chunk and the first lag chunk. This is why it seems to work correctly at the start. However, the submission can still fail afterward, possibly due to errors that occur in subsequent chunks—such as issues with a groupby operation, a merge involving lag features, or other unforeseen errors.",
    "3074748": "hey, am having the exact same issue. I am trying to add more features in the predict function. Have you figured out yours?",
    "3076233": "I found error in the code, error occurred only on the hidden test set after the first batch. @moujahidboulaouz response above was correct. Now my problem is timeout😅",
    "3076295": "If you're using TensorFlow, consider converting your models to TensorFlow Lite. This transformation can significantly reduce processing time—for example, in my case, it dropped from 6 hours to just 1 hour.",
    "3078473": "I am experiencing the same issue on several of my recent submissions. Submission file has correct format. It doesn't seem to have any timeout issues. Tried to change from T4 to P100, as suggested by some to no avail. I don't know what else to do to rectify this issue! Any other suggestions to look into? Thanks."
  },
  "source": "meta"
}