{
  "id": 542037,
  "title": "Purpose of test.parquet in the competition",
  "url": "/competitions/jane-street-real-time-market-data-forecasting/discussion/542037",
  "author_name": "",
  "post_date": "2024-10-22T17:41:31.428745300Z",
  "votes": null,
  "comment_count": 4,
  "views": 0,
  "content": "<p>As per the <a href=\"https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/data\" target=\"_blank\">file information</a>, the <strong>test.parquet</strong> file is a mock test set that won't be used directly for submission. Instead, the actual test set will be provided through the API. Given this, what is the purpose of the <strong>test.parquet</strong> file?</p>\n<p>I also noticed that <strong>test.parquet</strong> does not contain the <code>responder_6</code>, which is the target variable, so it doesn't seem suitable for validating model performance. Could anyone clarify how this file is meant to be used in the context of the competition?</p>\n<p>Many thanks:)</p>",
  "messages": [
    {
      "id": "3025386",
      "postDate": "10/22/2024 17:41:31",
      "content": "<p>As per the <a href=\"https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/data\" target=\"_blank\">file information</a>, the <strong>test.parquet</strong> file is a mock test set that won't be used directly for submission. Instead, the actual test set will be provided through the API. Given this, what is the purpose of the <strong>test.parquet</strong> file?</p>\n<p>I also noticed that <strong>test.parquet</strong> does not contain the <code>responder_6</code>, which is the target variable, so it doesn't seem suitable for validating model performance. Could anyone clarify how this file is meant to be used in the context of the competition?</p>\n<p>Many thanks:)</p>",
      "rawMarkdown": "As per the [file information](https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/data), the **test.parquet** file is a mock test set that won't be used directly for submission. Instead, the actual test set will be provided through the API. Given this, what is the purpose of the **test.parquet** file?\n\nI also noticed that **test.parquet** does not contain the `responder_6`, which is the target variable, so it doesn't seem suitable for validating model performance. Could anyone clarify how this file is meant to be used in the context of the competition?\n\nMany thanks:)",
      "votes": null
    },
    {
      "id": "3025624",
      "postDate": "10/23/2024 02:34:39",
      "content": "<p>I think it is simply just for showing the format of the test dataframe that you get as a variable in the predict function when submitting the code.</p>",
      "rawMarkdown": "I think it is simply just for showing the format of the test dataframe that you get as a variable in the predict function when submitting the code.",
      "votes": null
    },
    {
      "id": "3025754",
      "postDate": "10/23/2024 06:04:19",
      "content": "<p>This is a dummy file for local syntax check <a href=\"https://www.kaggle.com/ccyhui\" target=\"_blank\">@ccyhui</a> </p>",
      "rawMarkdown": "This is a dummy file for local syntax check @ccyhui",
      "votes": null
    },
    {
      "id": "3025809",
      "postDate": "10/23/2024 06:37:16",
      "content": "<p>Used in prediction. But it doesn't have the target columns</p>",
      "rawMarkdown": "Used in prediction. But it doesn't have the target columns",
      "votes": null
    },
    {
      "id": "3025936",
      "postDate": "10/23/2024 09:29:36",
      "content": "<p>the test.parquet is just a mock dataset to show the structure like column names and its type, its data is fake.<br>\nwe should build our own validation data from the train.parquet file.</p>",
      "rawMarkdown": "the test.parquet is just a mock dataset to show the structure like column names and its type, its data is fake.\nwe should build our own validation data from the train.parquet file.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3025624,
      "author_name": "bradywynn",
      "author_url": "",
      "post_date": "10/23/2024 02:34:39",
      "content": "<p>I think it is simply just for showing the format of the test dataframe that you get as a variable in the predict function when submitting the code.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3025754,
      "author_name": "ravi20076",
      "author_url": "",
      "post_date": "10/23/2024 06:04:19",
      "content": "<p>This is a dummy file for local syntax check <a href=\"https://www.kaggle.com/ccyhui\" target=\"_blank\">@ccyhui</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3025809,
      "author_name": "sumit08",
      "author_url": "",
      "post_date": "10/23/2024 06:37:16",
      "content": "<p>Used in prediction. But it doesn't have the target columns</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3025936,
      "author_name": "wjjjjs",
      "author_url": "",
      "post_date": "10/23/2024 09:29:36",
      "content": "<p>the test.parquet is just a mock dataset to show the structure like column names and its type, its data is fake.<br>\nwe should build our own validation data from the train.parquet file.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3025386": "As per the [file information](https://www.kaggle.com/competitions/jane-street-real-time-market-data-forecasting/data), the **test.parquet** file is a mock test set that won't be used directly for submission. Instead, the actual test set will be provided through the API. Given this, what is the purpose of the **test.parquet** file?\n\nI also noticed that **test.parquet** does not contain the `responder_6`, which is the target variable, so it doesn't seem suitable for validating model performance. Could anyone clarify how this file is meant to be used in the context of the competition?\n\nMany thanks:)",
    "3025624": "I think it is simply just for showing the format of the test dataframe that you get as a variable in the predict function when submitting the code.",
    "3025754": "This is a dummy file for local syntax check @ccyhui",
    "3025809": "Used in prediction. But it doesn't have the target columns",
    "3025936": "the test.parquet is just a mock dataset to show the structure like column names and its type, its data is fake.\nwe should build our own validation data from the train.parquet file."
  },
  "source": "meta"
}