{"cells":[{"metadata":{},"cell_type":"markdown","source":"This is an experimental notebook. I examined how much processing time is allowed for inference.\n\nFrom the Results, 0.55 sec/iter would be the limit.\n\nRelated Discussions\n\n* https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/194377\n* https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/192124\n\n[update] Submission API is anounced to be updated (https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/196210). \nI confirmed that the notebook with time.sleep(0.55) is submitted successfully after this update.\nSo, the limit would not be changed at least for this simple notebook."},{"metadata":{"_uuid":"8f2839f25d086af736a60e9eeb907d3b93b6e0e5","_cell_guid":"b1076dfc-b9ad-4769-8c92-a6c4dae69d19","trusted":true},"cell_type":"code","source":"import time\nimport riiideducation\nenv = riiideducation.make_env()","execution_count":null,"outputs":[]},{"metadata":{"trusted":true},"cell_type":"code","source":"iter_test = env.iter_test()","execution_count":null,"outputs":[]},{"metadata":{"_uuid":"d629ff2d2480ee46fbb7e2d37f6b5fab8052498a","_cell_guid":"79c7e3d0-c299-4dcb-8224-4455121ee9b0","trusted":true},"cell_type":"code","source":"%%time\nfor (test_df, sample_prediction_df) in iter_test:\n    time.sleep(0.55)\n    test_df['answered_correctly'] =  0\n    env.predict(test_df.loc[test_df['content_type_id'] == 0, ['row_id', 'answered_correctly']])","execution_count":null,"outputs":[]},{"metadata":{},"cell_type":"markdown","source":"\n* time.sleep(0.8) Submission error\n* time.sleep(0.6) Submission error\n* time.sleep(0.55) Success\n* time.sleep(0.5) Success\n* time.sleep(0.4) Success\n\n\n"},{"metadata":{},"cell_type":"markdown","source":"There are 9x60x60/0.55=58,909 iterations in private dataset???\n"}],"metadata":{"kernelspec":{"language":"python","display_name":"Python 3","name":"python3"},"language_info":{"pygments_lexer":"ipython3","nbconvert_exporter":"python","version":"3.6.4","file_extension":".py","codemirror_mode":{"name":"ipython","version":3},"name":"python","mimetype":"text/x-python"}},"nbformat":4,"nbformat_minor":4}