{
  "id": 555129,
  "title": "Some learning rate cause submission to fail",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/555129",
  "author_name": "",
  "post_date": "2025-01-05T13:30:56.673720200Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Has anyone encountered the issue where certain learning rates cause submission failures when attempting online learning? The mock evaluation works fine, so I am unable to debug the problem.</p>\n<p>I suspect it's caused by gradient explosion and have tried various techniques, but nothing seems to work. Currently, I haven't seen anyone mention it in the discussion forum, so I'm here to ask.</p>\n<p>Thanks</p>",
  "messages": [
    {
      "id": "3089035",
      "postDate": "01/05/2025 13:30:56",
      "content": "<p>Has anyone encountered the issue where certain learning rates cause submission failures when attempting online learning? The mock evaluation works fine, so I am unable to debug the problem.</p>\n<p>I suspect it's caused by gradient explosion and have tried various techniques, but nothing seems to work. Currently, I haven't seen anyone mention it in the discussion forum, so I'm here to ask.</p>\n<p>Thanks</p>",
      "rawMarkdown": "Has anyone encountered the issue where certain learning rates cause submission failures when attempting online learning? The mock evaluation works fine, so I am unable to debug the problem.\n\nI suspect it's caused by gradient explosion and have tried various techniques, but nothing seems to work. Currently, I haven't seen anyone mention it in the discussion forum, so I'm here to ask.\n\nThanks",
      "votes": null
    },
    {
      "id": "3089239",
      "postDate": "01/05/2025 17:39:37",
      "content": "<p>yes it is normal</p>",
      "rawMarkdown": "yes it is normal",
      "votes": null
    },
    {
      "id": "3089384",
      "postDate": "01/06/2025 00:27:31",
      "content": "<p>Is there a way to reproduce the error?</p>",
      "rawMarkdown": "Is there a way to reproduce the error?",
      "votes": null
    },
    {
      "id": "3092826",
      "postDate": "01/10/2025 05:35:23",
      "content": "<p>I had the same issue with online learning, clipping the gradients before updating the weights helped</p>",
      "rawMarkdown": "I had the same issue with online learning, clipping the gradients before updating the weights helped",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3089239,
      "author_name": "hongyueli",
      "author_url": "",
      "post_date": "01/05/2025 17:39:37",
      "content": "<p>yes it is normal</p>",
      "votes": null,
      "replies": [
        {
          "id": 3089384,
          "author_name": "zenglihao106",
          "author_url": "",
          "post_date": "01/06/2025 00:27:31",
          "content": "<p>Is there a way to reproduce the error?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3092826,
      "author_name": "jonnyd118118",
      "author_url": "",
      "post_date": "01/10/2025 05:35:23",
      "content": "<p>I had the same issue with online learning, clipping the gradients before updating the weights helped</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3089035": "Has anyone encountered the issue where certain learning rates cause submission failures when attempting online learning? The mock evaluation works fine, so I am unable to debug the problem.\n\nI suspect it's caused by gradient explosion and have tried various techniques, but nothing seems to work. Currently, I haven't seen anyone mention it in the discussion forum, so I'm here to ask.\n\nThanks",
    "3089239": "yes it is normal",
    "3089384": "Is there a way to reproduce the error?",
    "3092826": "I had the same issue with online learning, clipping the gradients before updating the weights helped"
  },
  "source": "meta"
}