{
  "id": 545080,
  "title": "code is working on public test file provided. but failing on hidden test data. ",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/545080",
  "author_name": "",
  "post_date": "2024-11-08T09:05:00.911709200Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>my code is working on public test file provided. but failing on hidden test data. I am converting the polars dataframe to pandas and doing the calculation. is it loosing some data for big test data set? what could be other reason? </p>",
  "messages": [
    {
      "id": "3039684",
      "postDate": "11/08/2024 09:05:00",
      "content": "<p>my code is working on public test file provided. but failing on hidden test data. I am converting the polars dataframe to pandas and doing the calculation. is it loosing some data for big test data set? what could be other reason? </p>",
      "rawMarkdown": "my code is working on public test file provided. but failing on hidden test data. I am converting the polars dataframe to pandas and doing the calculation. is it loosing some data for big test data set? what could be other reason?",
      "votes": null
    },
    {
      "id": "3039707",
      "postDate": "11/08/2024 09:33:20",
      "content": "<p>the test is very limited, really not covering anything. Better try testing as in <a href=\"url\" target=\"_blank\">https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api</a>:</p>\n<p><code>if os.getenv('KAGGLE_IS_COMPETITION_RERUN'):</code><br>\n<code>inference_server.serve()</code><br>\n<code>elif debug_run_example_test:</code><br>\n<code>inference_server.run_local_gateway(</code><br>\n<code>(</code><br>\n<code>'/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/test.parquet',</code><br>\n<code>'/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/lags.parquet',</code><br>\n<code>)</code><br>\n<code>)</code></p>",
      "rawMarkdown": "the test is very limited, really not covering anything. Better try testing as in [https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api](url):\n\n\n`if os.getenv('KAGGLE_IS_COMPETITION_RERUN'):`\n`    inference_server.serve()`\n`elif debug_run_example_test:`\n`    inference_server.run_local_gateway(`\n`        (`\n`            '/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/test.parquet',`\n`            '/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/lags.parquet',`\n`        )`\n`    )`",
      "votes": null
    },
    {
      "id": "3041500",
      "postDate": "11/10/2024 12:59:00",
      "content": "<p>Some things to try</p>\n<ol>\n<li>Try testing your code with an input dataframe that is missing some symbols (e.g. just send it a df with a single row)</li>\n<li>Try testing your code with an input dataframe that has a new symbol_id (e.g. 43)</li>\n<li>Make sure your data types are consistent if you are doing any joins/concats of dataframes. Doing things like filling null values or scaling seems to want to change the column data types and you may be running into strange situations where this occurs</li>\n</ol>",
      "rawMarkdown": "Some things to try\n\n1. Try testing your code with an input dataframe that is missing some symbols (e.g. just send it a df with a single row)\n2. Try testing your code with an input dataframe that has a new symbol_id (e.g. 43)\n3. Make sure your data types are consistent if you are doing any joins/concats of dataframes. Doing things like filling null values or scaling seems to want to change the column data types and you may be running into strange situations where this occurs",
      "votes": null
    },
    {
      "id": "3043083",
      "postDate": "11/12/2024 04:59:36",
      "content": "<p>thanks a lot</p>",
      "rawMarkdown": "thanks a lot",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3039707,
      "author_name": "brtvandenbroeck",
      "author_url": "",
      "post_date": "11/08/2024 09:33:20",
      "content": "<p>the test is very limited, really not covering anything. Better try testing as in <a href=\"url\" target=\"_blank\">https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api</a>:</p>\n<p><code>if os.getenv('KAGGLE_IS_COMPETITION_RERUN'):</code><br>\n<code>inference_server.serve()</code><br>\n<code>elif debug_run_example_test:</code><br>\n<code>inference_server.run_local_gateway(</code><br>\n<code>(</code><br>\n<code>'/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/test.parquet',</code><br>\n<code>'/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/lags.parquet',</code><br>\n<code>)</code><br>\n<code>)</code></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3041500,
      "author_name": "michaeltimbs",
      "author_url": "",
      "post_date": "11/10/2024 12:59:00",
      "content": "<p>Some things to try</p>\n<ol>\n<li>Try testing your code with an input dataframe that is missing some symbols (e.g. just send it a df with a single row)</li>\n<li>Try testing your code with an input dataframe that has a new symbol_id (e.g. 43)</li>\n<li>Make sure your data types are consistent if you are doing any joins/concats of dataframes. Doing things like filling null values or scaling seems to want to change the column data types and you may be running into strange situations where this occurs</li>\n</ol>",
      "votes": null,
      "replies": [
        {
          "id": 3043083,
          "author_name": "abhishekkumarphysics",
          "author_url": "",
          "post_date": "11/12/2024 04:59:36",
          "content": "<p>thanks a lot</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3039684": "my code is working on public test file provided. but failing on hidden test data. I am converting the polars dataframe to pandas and doing the calculation. is it loosing some data for big test data set? what could be other reason?",
    "3039707": "the test is very limited, really not covering anything. Better try testing as in [https://www.kaggle.com/code/chumajin/janestreet-updated-simulator-for-time-series-api](url):\n\n\n`if os.getenv('KAGGLE_IS_COMPETITION_RERUN'):`\n`    inference_server.serve()`\n`elif debug_run_example_test:`\n`    inference_server.run_local_gateway(`\n`        (`\n`            '/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/test.parquet',`\n`            '/kaggle/input/janestreet-updated-simulator-for-time-series-api/debug/lags.parquet',`\n`        )`\n`    )`",
    "3041500": "Some things to try\n\n1. Try testing your code with an input dataframe that is missing some symbols (e.g. just send it a df with a single row)\n2. Try testing your code with an input dataframe that has a new symbol_id (e.g. 43)\n3. Make sure your data types are consistent if you are doing any joins/concats of dataframes. Doing things like filling null values or scaling seems to want to change the column data types and you may be running into strange situations where this occurs",
    "3043083": "thanks a lot"
  },
  "source": "meta"
}