{ "id": 584914, "title": "Leaderboard Update - June 16", "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/584914", "author_name": "Ryan Holbrook", "post_date": "2025-06-16T20:25:23.274000", "votes": 1, "comment_count": 13, "views": 0, "content": "

The scores from the latest data update are now posted. This update comprises 18 business days.

", "messages": [ { "id": 3225770, "postDate": "2025-06-16T20:25:23.273Z", "content": "

The scores from the latest data update are now posted. This update comprises 18 business days.

", "rawMarkdown": "The scores from the latest data update are now posted. This update comprises 18 business days.", "votes": 1 }, { "id": 3228864, "postDate": "2025-06-20T15:52:09.283Z", "content": "

Ryan, could you please check why my team's recent two submissions have not been errored in the recent two updates and our team is no longer on the leader board? Our team ranked 148th in January/February and Bronze in March/April in previous submissions. Our team name is AQAW. We spent a huge effort on this project. Please do help out. Thank you for the help.

", "rawMarkdown": "Ryan, could you please check why my team's recent two submissions have not been errored in the recent two updates and our team is no longer on the leader board? Our team ranked 148th in January/February and Bronze in March/April in previous submissions. Our team name is AQAW. We spent a huge effort on this project. Please do help out. Thank you for the help." }, { "id": 3228457, "postDate": "2025-06-20T06:54:20.657Z", "content": "

It seems like my second submission wasn't rerun

", "rawMarkdown": "It seems like my second submission wasn't rerun" }, { "id": 3225778, "postDate": "2025-06-16T20:37:48.907Z", "content": "

It seems notebooks ran twice this time.

", "rawMarkdown": "It seems notebooks ran twice this time.", "replies": [ { "id": 3226278, "postDate": "2025-06-17T13:10:49.357Z", "content": "

Yes, there was a problem with the first rerun (hence the delay in posting scores), so we needed to run it again.

", "rawMarkdown": "Yes, there was a problem with the first rerun (hence the delay in posting scores), so we needed to run it again.", "votes": 2, "replies": [ { "id": 3226312, "postDate": "2025-06-17T13:43:25.117Z", "content": "

Why so many teams unranked in this rerun？

", "rawMarkdown": "Why so many teams unranked in this rerun？" }, { "id": 3227490, "postDate": "2025-06-19T03:51:12.523Z", "content": "

I believe our notebooks didn't finish within the 9 hour run-time as the test sets have been getting larger.

\n

My scores dropped off in the May update so I sent Ryan a direct message to ask and he replied with that reason.

", "rawMarkdown": "I believe our notebooks didn't finish within the 9 hour run-time as the test sets have been getting larger.\n\nMy scores dropped off in the May update so I sent Ryan a direct message to ask and he replied with that reason.", "votes": 2 }, { "id": 3227897, "postDate": "2025-06-19T12:34:49.077Z", "content": "

that is nonsense.

", "rawMarkdown": "that is nonsense. " }, { "id": 3228394, "postDate": "2025-06-20T04:56:34.163Z", "rawMarkdown": "", "isDeleted": true }, { "id": 3228647, "postDate": "2025-06-20T11:59:58.490Z", "content": "

It has always been <= 8 hour runtime limit for the notebooks and has never changed, I don't think its reasonable expectation to assume it will increase in test phase, that has never been mentioned anywhere?

", "rawMarkdown": "It has always been <= 8 hour runtime limit for the notebooks and has never changed, I don't think its reasonable expectation to assume it will increase in test phase, that has never been mentioned anywhere?", "votes": 1 }, { "id": 3228838, "postDate": "2025-06-20T15:18:15.123Z", "rawMarkdown": "", "isDeleted": true }, { "id": 3229555, "postDate": "2025-06-21T17:02:40.587Z", "content": "

The 9 hours is the extended time limit, during training it was 8 hours

\n
\n

The run-time limits for both CPU and GPU notebooks will be extended to 9 hours during the forecasting phase. You must ensure your submission completes within that time.

\n

The extra hour is to help protect against time-out failures due to the extended size of the test set. You are still responsible for ensuring your submission completes within the 9 hour limit, however. See the Data page for details on the extended test set during the forecasting phase.

\n
", "rawMarkdown": "The 9 hours is the extended time limit, during training it was 8 hours\n\n> The run-time limits for both CPU and GPU notebooks will be extended to 9 hours during the forecasting phase. You must ensure your submission completes within that time.\n\n> The extra hour is to help protect against time-out failures due to the extended size of the test set. You are still responsible for ensuring your submission completes within the 9 hour limit, however. See the Data page for details on the extended test set during the forecasting phase." }, { "id": 3229663, "postDate": "2025-06-21T22:49:04.417Z", "content": "

Don’t forget there was also a time limit to actually making your prediction within the API, so if your online training took over 10 minutes then it could also error

", "rawMarkdown": "Don’t forget there was also a time limit to actually making your prediction within the API, so if your online training took over 10 minutes then it could also error " } ] } ] }, { "id": 3248437, "postDate": "2025-07-14T15:17:27.497Z", "rawMarkdown": "", "votes": 1, "isDeleted": true } ], "comments": [ { "id": 3228864, "author_name": "Alinazheng4990", "author_url": "", "post_date": "2025-06-20T15:52:09.283000", "content": "

Ryan, could you please check why my team's recent two submissions have not been errored in the recent two updates and our team is no longer on the leader board? Our team ranked 148th in January/February and Bronze in March/April in previous submissions. Our team name is AQAW. We spent a huge effort on this project. Please do help out. Thank you for the help.

", "votes": 0, "replies": [] }, { "id": 3228457, "author_name": "MightyK", "author_url": "", "post_date": "2025-06-20T06:54:20.657000", "content": "

It seems like my second submission wasn't rerun

", "votes": 0, "replies": [] }, { "id": 3225778, "author_name": "Ahmet Erdem", "author_url": "", "post_date": "2025-06-16T20:37:48.907000", "content": "

It seems notebooks ran twice this time.

", "votes": 0, "replies": [ { "id": 3226278, "author_name": "Ryan Holbrook", "author_url": "", "post_date": "2025-06-17T13:10:49.357000", "content": "

Yes, there was a problem with the first rerun (hence the delay in posting scores), so we needed to run it again.

", "votes": 2, "replies": [ { "id": 3226312, "author_name": "WangJiazhen", "author_url": "", "post_date": "2025-06-17T13:43:25.117000", "content": "

Why so many teams unranked in this rerun？

", "votes": 0, "replies": [] }, { "id": 3227490, "author_name": "Alun Griffith", "author_url": "", "post_date": "2025-06-19T03:51:12.523000", "content": "

I believe our notebooks didn't finish within the 9 hour run-time as the test sets have been getting larger.

\n

My scores dropped off in the May update so I sent Ryan a direct message to ask and he replied with that reason.

", "votes": 2, "replies": [] }, { "id": 3227897, "author_name": "dragon zhang", "author_url": "", "post_date": "2025-06-19T12:34:49.077000", "content": "

that is nonsense.

", "votes": 0, "replies": [] }, { "id": 3228394, "author_name": "", "author_url": "", "post_date": "2025-06-20T04:56:34.163000", "content": "", "votes": 0, "replies": [] }, { "id": 3228647, "author_name": "JM", "author_url": "", "post_date": "2025-06-20T11:59:58.490000", "content": "

It has always been <= 8 hour runtime limit for the notebooks and has never changed, I don't think its reasonable expectation to assume it will increase in test phase, that has never been mentioned anywhere?

", "votes": 1, "replies": [] }, { "id": 3228838, "author_name": "", "author_url": "", "post_date": "2025-06-20T15:18:15.123000", "content": "", "votes": 0, "replies": [] }, { "id": 3229555, "author_name": "Lu Bin Liu", "author_url": "", "post_date": "2025-06-21T17:02:40.587000", "content": "

The 9 hours is the extended time limit, during training it was 8 hours

\n
\n

The run-time limits for both CPU and GPU notebooks will be extended to 9 hours during the forecasting phase. You must ensure your submission completes within that time.

\n

The extra hour is to help protect against time-out failures due to the extended size of the test set. You are still responsible for ensuring your submission completes within the 9 hour limit, however. See the Data page for details on the extended test set during the forecasting phase.

\n
", "votes": 0, "replies": [] }, { "id": 3229663, "author_name": "JM", "author_url": "", "post_date": "2025-06-21T22:49:04.417000", "content": "

Don’t forget there was also a time limit to actually making your prediction within the API, so if your online training took over 10 minutes then it could also error

", "votes": 0, "replies": [] } ] } ] }, { "id": 3248437, "author_name": "", "author_url": "", "post_date": "2025-07-14T15:17:27.497000", "content": "", "votes": 1, "replies": [] } ], "raw_markdown_by_id": { "3225770": "The scores from the latest data update are now posted. This update comprises 18 business days.", "3228864": "Ryan, could you please check why my team's recent two submissions have not been errored in the recent two updates and our team is no longer on the leader board? Our team ranked 148th in January/February and Bronze in March/April in previous submissions. Our team name is AQAW. We spent a huge effort on this project. Please do help out. Thank you for the help.", "3228457": "It seems like my second submission wasn't rerun", "3225778": "It seems notebooks ran twice this time.", "3248437": "" } }