{
  "id": 497907,
  "title": "【To the host and Kaggle staff】 Could you share some code that succeeded in submission?",
  "url": "/competitions/uspto-explainable-ai/discussion/497907",
  "author_name": "",
  "post_date": "2024-04-26T07:20:18.709829200Z",
  "votes": 14,
  "comment_count": 7,
  "views": 0,
  "content": "<p>I have been making simple submissions since yesterday, but they all result in a scoring error.<br>\nLooking at the leaderboard, I think no one has succeeded in making a submission.</p>\n<p>Similarly to what is being discussed <a href=\"https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/497841\" target=\"_blank\">here</a>, I tried submitting the sample submission, but it resulted in a scoring error.</p>\n<p>I'm not sure if something strange is happening during the metric calculation, or if we are fundamentally misunderstanding something.</p>\n<p><a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a><br>\nCould the host or Kaggle staff possibly share a simple code that succeeds in submission?<br>\n It would be greatly appreciated.</p>",
  "messages": [
    {
      "id": "2776453",
      "postDate": "04/26/2024 07:20:18",
      "content": "<p>I have been making simple submissions since yesterday, but they all result in a scoring error.<br>\nLooking at the leaderboard, I think no one has succeeded in making a submission.</p>\n<p>Similarly to what is being discussed <a href=\"https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/497841\" target=\"_blank\">here</a>, I tried submitting the sample submission, but it resulted in a scoring error.</p>\n<p>I'm not sure if something strange is happening during the metric calculation, or if we are fundamentally misunderstanding something.</p>\n<p><a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a><br>\nCould the host or Kaggle staff possibly share a simple code that succeeds in submission?<br>\n It would be greatly appreciated.</p>",
      "rawMarkdown": "I have been making simple submissions since yesterday, but they all result in a scoring error.\nLooking at the leaderboard, I think no one has succeeded in making a submission.\n\nSimilarly to what is being discussed [here](https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/497841), I tried submitting the sample submission, but it resulted in a scoring error.\n\nI'm not sure if something strange is happening during the metric calculation, or if we are fundamentally misunderstanding something.\n\n@sohier\nCould the host or Kaggle staff possibly share a simple code that succeeds in submission?\n It would be greatly appreciated.",
      "votes": null
    },
    {
      "id": "2776792",
      "postDate": "04/26/2024 10:41:42",
      "content": "<p>Definitely some bug in the scoring side, it showed \"Submission scoring\" then failed almost immediately. </p>",
      "rawMarkdown": "Definitely some bug in the scoring side, it showed \"Submission scoring\" then failed almost immediately.",
      "votes": null
    },
    {
      "id": "2776848",
      "postDate": "04/26/2024 11:27:34",
      "content": "<p>Facing similar issues. Tried several things but everything ended up showing Submission scoring error.</p>",
      "rawMarkdown": "Facing similar issues. Tried several things but everything ended up showing Submission scoring error.",
      "votes": null
    },
    {
      "id": "2776870",
      "postDate": "04/26/2024 11:38:15",
      "content": "<p>For this competition, scoring will run on difference environment for 1 hour is what <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> answered in other discussion. Maybe because of it, as it is not similar to previous competitions.</p>",
      "rawMarkdown": "For this competition, scoring will run on difference environment for 1 hour is what @sohier answered in other discussion. Maybe because of it, as it is not similar to previous competitions.",
      "votes": null
    },
    {
      "id": "2777320",
      "postDate": "04/26/2024 15:46:42",
      "content": "<p>I'll take a look now.</p>",
      "rawMarkdown": "I'll take a look now.",
      "votes": null
    },
    {
      "id": "2777426",
      "postDate": "04/26/2024 16:42:05",
      "content": "<p><a href=\"https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/498023\" target=\"_blank\">https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/498023</a></p>",
      "rawMarkdown": "https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/498023",
      "votes": null
    },
    {
      "id": "2777563",
      "postDate": "04/26/2024 17:53:56",
      "content": "<p><a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> Thank you for confirming !!</p>",
      "rawMarkdown": "sohier Thank you for confirming !!",
      "votes": null
    },
    {
      "id": "2781832",
      "postDate": "04/29/2024 03:06:41",
      "content": "<p>We may need more clarification on submission formatting or search engine memory optimizations that may be out of our control. Standard query submissions are failing. Also are we supposed to run the following or is the Kaggle environment taking care of the search engine setup and processing for hidden test set?</p>\n<p>train_idx = whoosh_utils.load_index(p + 'train_index')<br>\nsearcher = whoosh_utils.get_searcher(train_idx)<br>\nqp = whoosh_utils.get_query_parser()</p>",
      "rawMarkdown": "We may need more clarification on submission formatting or search engine memory optimizations that may be out of our control. Standard query submissions are failing. Also are we supposed to run the following or is the Kaggle environment taking care of the search engine setup and processing for hidden test set?\n\ntrain_idx = whoosh_utils.load_index(p + 'train_index')\nsearcher = whoosh_utils.get_searcher(train_idx)\nqp = whoosh_utils.get_query_parser()",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2776792,
      "author_name": "suicaokhoailang",
      "author_url": "",
      "post_date": "04/26/2024 10:41:42",
      "content": "<p>Definitely some bug in the scoring side, it showed \"Submission scoring\" then failed almost immediately. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2776848,
      "author_name": "mbmmurad",
      "author_url": "",
      "post_date": "04/26/2024 11:27:34",
      "content": "<p>Facing similar issues. Tried several things but everything ended up showing Submission scoring error.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2776870,
      "author_name": "seshurajup",
      "author_url": "",
      "post_date": "04/26/2024 11:38:15",
      "content": "<p>For this competition, scoring will run on difference environment for 1 hour is what <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> answered in other discussion. Maybe because of it, as it is not similar to previous competitions.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2777320,
      "author_name": "sohier",
      "author_url": "",
      "post_date": "04/26/2024 15:46:42",
      "content": "<p>I'll take a look now.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2777426,
          "author_name": "sohier",
          "author_url": "",
          "post_date": "04/26/2024 16:42:05",
          "content": "<p><a href=\"https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/498023\" target=\"_blank\">https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/498023</a></p>",
          "votes": null,
          "replies": [
            {
              "id": 2777563,
              "author_name": "chumajin",
              "author_url": "",
              "post_date": "04/26/2024 17:53:56",
              "content": "<p><a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> Thank you for confirming !!</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2781832,
      "author_name": "jazivxt",
      "author_url": "",
      "post_date": "04/29/2024 03:06:41",
      "content": "<p>We may need more clarification on submission formatting or search engine memory optimizations that may be out of our control. Standard query submissions are failing. Also are we supposed to run the following or is the Kaggle environment taking care of the search engine setup and processing for hidden test set?</p>\n<p>train_idx = whoosh_utils.load_index(p + 'train_index')<br>\nsearcher = whoosh_utils.get_searcher(train_idx)<br>\nqp = whoosh_utils.get_query_parser()</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2776453": "I have been making simple submissions since yesterday, but they all result in a scoring error.\nLooking at the leaderboard, I think no one has succeeded in making a submission.\n\nSimilarly to what is being discussed [here](https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/497841), I tried submitting the sample submission, but it resulted in a scoring error.\n\nI'm not sure if something strange is happening during the metric calculation, or if we are fundamentally misunderstanding something.\n\n@sohier\nCould the host or Kaggle staff possibly share a simple code that succeeds in submission?\n It would be greatly appreciated.",
    "2776792": "Definitely some bug in the scoring side, it showed \"Submission scoring\" then failed almost immediately.",
    "2776848": "Facing similar issues. Tried several things but everything ended up showing Submission scoring error.",
    "2776870": "For this competition, scoring will run on difference environment for 1 hour is what @sohier answered in other discussion. Maybe because of it, as it is not similar to previous competitions.",
    "2777320": "I'll take a look now.",
    "2777426": "https://www.kaggle.com/competitions/uspto-explainable-ai/discussion/498023",
    "2777563": "sohier Thank you for confirming !!",
    "2781832": "We may need more clarification on submission formatting or search engine memory optimizations that may be out of our control. Standard query submissions are failing. Also are we supposed to run the following or is the Kaggle environment taking care of the search engine setup and processing for hidden test set?\n\ntrain_idx = whoosh_utils.load_index(p + 'train_index')\nsearcher = whoosh_utils.get_searcher(train_idx)\nqp = whoosh_utils.get_query_parser()"
  },
  "source": "meta"
}