{
  "id": 412389,
  "title": "Score Then vs Now (Old API Vs New API)",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/412389",
  "author_name": "",
  "post_date": "2023-05-23T14:47:37.028243800Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I joined the competition quite early, and made a few submissions the best of which was 0.695.</p>\n<p>After a long gap, I started the competition 2 days back. A lot has changed in the competition with a new API and new Data. When I submit the same model(0.695), the current score I get is 0.67. Has anyone experienced the same ? And is there some API/data change  I am missing ?</p>\n<p>Thank you for the help.</p>",
  "messages": [
    {
      "id": "2270973",
      "postDate": "05/23/2023 14:47:37",
      "content": "<p>I joined the competition quite early, and made a few submissions the best of which was 0.695.</p>\n<p>After a long gap, I started the competition 2 days back. A lot has changed in the competition with a new API and new Data. When I submit the same model(0.695), the current score I get is 0.67. Has anyone experienced the same ? And is there some API/data change  I am missing ?</p>\n<p>Thank you for the help.</p>",
      "rawMarkdown": "I joined the competition quite early, and made a few submissions the best of which was 0.695.\n\nAfter a long gap, I started the competition 2 days back. A lot has changed in the competition with a new API and new Data. When I submit the same model(0.695), the current score I get is 0.67. Has anyone experienced the same ? And is there some API/data change  I am missing ?\n\nThank you for the help.",
      "votes": null
    },
    {
      "id": "2271055",
      "postDate": "05/23/2023 15:36:15",
      "content": "<p>There is a bug in the new API. <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/409898#2264279\" target=\"_blank\">link</a></p>\n<p>You can <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/406348#2242295\" target=\"_blank\">use</a> the old version </p>",
      "rawMarkdown": "There is a bug in the new API. [link](https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/409898#2264279)\n\nYou can [use](https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/406348#2242295) the old version",
      "votes": null
    },
    {
      "id": "2271077",
      "postDate": "05/23/2023 15:52:26",
      "content": "<p>thanks a lot, I wasted 2 days successfully</p>",
      "rawMarkdown": "thanks a lot, I wasted 2 days successfully",
      "votes": null
    },
    {
      "id": "2271778",
      "postDate": "05/24/2023 06:21:23",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5307432%2Ff6a7a049d680999249565e3aa12268c2%2FScreenshot%20from%202023-05-24%2011-49-25.png?generation=1684909197217467&amp;alt=media\" alt=\"\"></p>\n<p>But there is no April version for me &amp; i am already pinned to OG version.</p>\n<p>And i am getting Scoring Submission Error.<br>\nCan you help me in figuring it out?</p>\n<pre><code>limits = {'0-4':(1,4), '5-12':(4,14), '13-22':(14,19)}\nt1 = datetime.datetime.now()\nfor (test, sample_submission) in iter_test:\n    print\n    test = test.sort_values(by='index')\n    grp = test.level_group.values[0]\n    session_id = test.session_id.values[0]\n    df = (pl.from_pandas(test))\n    df = feature_engineer(df)\n    a,b = limits[grp]\n\n    df = model_data_1(df, grp)\n    preds = []\n    for q in range(a, b):\n        model = models[q-1]   \n        pred = model.predict_proba(df)[0, 1]\n        mask = sample_submission.session_id.str.contains(f'q{q}')\n        sample_submission.loc[mask,'correct'] = int(pred &gt; threshold[q-1]) \n    env.predict(sample_submission)\n\nt2 = datetime.datetime.now()\nprint('Run in ', t2-t1)\n</code></pre>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5307432%2Ff6a7a049d680999249565e3aa12268c2%2FScreenshot%20from%202023-05-24%2011-49-25.png?generation=1684909197217467&alt=media)\n\nBut there is no April version for me & i am already pinned to OG version.\n\nAnd i am getting Scoring Submission Error.\nCan you help me in figuring it out?\n```\nlimits = {'0-4':(1,4), '5-12':(4,14), '13-22':(14,19)}\nt1 = datetime.datetime.now()\nfor (test, sample_submission) in iter_test:\n    print\n    test = test.sort_values(by='index')\n    grp = test.level_group.values[0]\n    session_id = test.session_id.values[0]\n    df = (pl.from_pandas(test))\n    df = feature_engineer(df)\n    a,b = limits[grp]\n\n    df = model_data_1(df, grp)\n    preds = []\n    for q in range(a, b):\n        model = models[q-1]   \n        pred = model.predict_proba(df)[0, 1]\n        mask = sample_submission.session_id.str.contains(f'q{q}')\n        sample_submission.loc[mask,'correct'] = int(pred > threshold[q-1]) \n    env.predict(sample_submission)\n    \nt2 = datetime.datetime.now()\nprint('Run in ', t2-t1)\n```",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2271055,
      "author_name": "myppka",
      "author_url": "",
      "post_date": "05/23/2023 15:36:15",
      "content": "<p>There is a bug in the new API. <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/409898#2264279\" target=\"_blank\">link</a></p>\n<p>You can <a href=\"https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/406348#2242295\" target=\"_blank\">use</a> the old version </p>",
      "votes": null,
      "replies": [
        {
          "id": 2271077,
          "author_name": "nikhilmishradev",
          "author_url": "",
          "post_date": "05/23/2023 15:52:26",
          "content": "<p>thanks a lot, I wasted 2 days successfully</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2271778,
          "author_name": "navinkumarmnk",
          "author_url": "",
          "post_date": "05/24/2023 06:21:23",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5307432%2Ff6a7a049d680999249565e3aa12268c2%2FScreenshot%20from%202023-05-24%2011-49-25.png?generation=1684909197217467&amp;alt=media\" alt=\"\"></p>\n<p>But there is no April version for me &amp; i am already pinned to OG version.</p>\n<p>And i am getting Scoring Submission Error.<br>\nCan you help me in figuring it out?</p>\n<pre><code>limits = {'0-4':(1,4), '5-12':(4,14), '13-22':(14,19)}\nt1 = datetime.datetime.now()\nfor (test, sample_submission) in iter_test:\n    print\n    test = test.sort_values(by='index')\n    grp = test.level_group.values[0]\n    session_id = test.session_id.values[0]\n    df = (pl.from_pandas(test))\n    df = feature_engineer(df)\n    a,b = limits[grp]\n\n    df = model_data_1(df, grp)\n    preds = []\n    for q in range(a, b):\n        model = models[q-1]   \n        pred = model.predict_proba(df)[0, 1]\n        mask = sample_submission.session_id.str.contains(f'q{q}')\n        sample_submission.loc[mask,'correct'] = int(pred &gt; threshold[q-1]) \n    env.predict(sample_submission)\n\nt2 = datetime.datetime.now()\nprint('Run in ', t2-t1)\n</code></pre>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2270973": "I joined the competition quite early, and made a few submissions the best of which was 0.695.\n\nAfter a long gap, I started the competition 2 days back. A lot has changed in the competition with a new API and new Data. When I submit the same model(0.695), the current score I get is 0.67. Has anyone experienced the same ? And is there some API/data change  I am missing ?\n\nThank you for the help.",
    "2271055": "There is a bug in the new API. [link](https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/409898#2264279)\n\nYou can [use](https://www.kaggle.com/competitions/predict-student-performance-from-game-play/discussion/406348#2242295) the old version",
    "2271077": "thanks a lot, I wasted 2 days successfully",
    "2271778": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5307432%2Ff6a7a049d680999249565e3aa12268c2%2FScreenshot%20from%202023-05-24%2011-49-25.png?generation=1684909197217467&alt=media)\n\nBut there is no April version for me & i am already pinned to OG version.\n\nAnd i am getting Scoring Submission Error.\nCan you help me in figuring it out?\n```\nlimits = {'0-4':(1,4), '5-12':(4,14), '13-22':(14,19)}\nt1 = datetime.datetime.now()\nfor (test, sample_submission) in iter_test:\n    print\n    test = test.sort_values(by='index')\n    grp = test.level_group.values[0]\n    session_id = test.session_id.values[0]\n    df = (pl.from_pandas(test))\n    df = feature_engineer(df)\n    a,b = limits[grp]\n\n    df = model_data_1(df, grp)\n    preds = []\n    for q in range(a, b):\n        model = models[q-1]   \n        pred = model.predict_proba(df)[0, 1]\n        mask = sample_submission.session_id.str.contains(f'q{q}')\n        sample_submission.loc[mask,'correct'] = int(pred > threshold[q-1]) \n    env.predict(sample_submission)\n    \nt2 = datetime.datetime.now()\nprint('Run in ', t2-t1)\n```"
  },
  "source": "meta"
}