{
  "id": 224516,
  "title": "Test is slightly different",
  "url": "/competitions/bms-molecular-translation/discussion/224516",
  "author_name": "nofreewill42",
  "post_date": "2021-03-08T21:53:34.158000",
  "votes": 9,
  "comment_count": 6,
  "views": 0,
  "content": "<p>I found that:<br>\nTrain : horizontal images only<br>\nTest : horizontal and -90° rotated images</p>\n<ol>\n<li>Am I right?</li>\n<li>Are we supposed to be robust on the -90° rotation?<br>\nIf so, I did not find an image that violates that:</li>\n</ol>\n<ul>\n<li>if it is wider -&gt; horizontal</li>\n<li>if it is taller -&gt; rotated (and so just rotate it back 90°)</li>\n</ul>\n<p>Any thoughts, negative examples?</p>",
  "messages": [
    {
      "id": 1231322,
      "postDate": "2021-03-08T21:53:34.160Z",
      "content": "<p>I found that:<br>\nTrain : horizontal images only<br>\nTest : horizontal and -90° rotated images</p>\n<ol>\n<li>Am I right?</li>\n<li>Are we supposed to be robust on the -90° rotation?<br>\nIf so, I did not find an image that violates that:</li>\n</ol>\n<ul>\n<li>if it is wider -&gt; horizontal</li>\n<li>if it is taller -&gt; rotated (and so just rotate it back 90°)</li>\n</ul>\n<p>Any thoughts, negative examples?</p>",
      "rawMarkdown": "I found that:\nTrain : horizontal images only\nTest : horizontal and -90° rotated images\n\n1. Am I right?\n2. Are we supposed to be robust on the -90° rotation?\nIf so, I did not find an image that violates that:\n- if it is wider -> horizontal\n- if it is taller -> rotated (and so just rotate it back 90°)\n\nAny thoughts, negative examples?",
      "votes": 9
    },
    {
      "id": 1231343,
      "postDate": "2021-03-08T22:09:36.513Z",
      "content": "<p>I already found a counter-example <code>888a5efe68d6</code> 243x234 width by height, and despite of being wider than its height, it is rotated.<br>\nI suppose it looked like that because molecules are mostly drawn so that they are taking up space horizontally so that they can be put in books more easily for example?</p>\n<p>I was able to tell that they are rotated 90° and not -90° based on letters B and F. But are all of them so?<br>\nWhat are your findings on the test set?</p>",
      "rawMarkdown": "I already found a counter-example `888a5efe68d6` 243x234 width by height, and despite of being wider than its height, it is rotated.\nI suppose it looked like that because molecules are mostly drawn so that they are taking up space horizontally so that they can be put in books more easily for example?\n\nI was able to tell that they are rotated 90° and not -90° based on letters B and F. But are all of them so?\nWhat are your findings on the test set?",
      "votes": 2,
      "replies": [
        {
          "id": 1231362,
          "postDate": "2021-03-08T22:26:00.493Z",
          "content": "<p>If the rotation can not only be 90° but also -90°, then we cannot tell the orientation of compounds that only contain atoms with point symmetric letters.. and so there are two possible compounds (which are the mirrored copies of each other) in the image that we cannot tell apart and I suppose that mostly the two has different formulae.</p>",
          "rawMarkdown": "If the rotation can not only be 90° but also -90°, then we cannot tell the orientation of compounds that only contain atoms with point symmetric letters.. and so there are two possible compounds (which are the mirrored copies of each other) in the image that we cannot tell apart and I suppose that mostly the two has different formulae."
        },
        {
          "id": 1231365,
          "postDate": "2021-03-08T22:30:12.480Z",
          "content": "<p>It seems to me that the test set only uses one clockwise rotation, never the CCW direction. I was surprised to see you find a counter-example in the test set. According to my script, all the training images have bigger width than height.</p>",
          "rawMarkdown": "It seems to me that the test set only uses one clockwise rotation, never the CCW direction. I was surprised to see you find a counter-example in the test set. According to my script, all the training images have bigger width than height."
        },
        {
          "id": 1231368,
          "postDate": "2021-03-08T22:40:50.697Z",
          "content": "<p>Yeah, it seems that counter-examples are rare… But still, should keep in mind that not 100% true.</p>\n<p>Train a network that tells if a picture is rotated, for example. Which is simple to do with the training data. If that finds a lot of counter-examples in the test set, then it might be worth the extra effort to work on this.</p>\n<ul>\n<li>has letters in it -&gt; piece of cake</li>\n<li>has only \"O\"s in it -&gt; they're egg-shaped, even if just a little</li>\n<li>no letters, but wide/tall -&gt; should be doable</li>\n<li>no letters, roughly as wide as tall -&gt; evil</li>\n</ul>",
          "rawMarkdown": "Yeah, it seems that counter-examples are rare... But still, should keep in mind that not 100% true.\n\nTrain a network that tells if a picture is rotated, for example. Which is simple to do with the training data. If that finds a lot of counter-examples in the test set, then it might be worth the extra effort to work on this.\n\n- has letters in it -> piece of cake\n- has only \"O\"s in it -> they're egg-shaped, even if just a little\n- no letters, but wide/tall -> should be doable\n- no letters, roughly as wide as tall -> evil",
          "votes": 1
        },
        {
          "id": 1233813,
          "postDate": "2021-03-10T17:20:13.557Z",
          "content": "<p>I was just randomly scoping the training data and found <code>a369aef8699e</code>.<br>\nIt seems that the training data also has these very few weird rotations.</p>",
          "rawMarkdown": "I was just randomly scoping the training data and found `a369aef8699e`.\nIt seems that the training data also has these very few weird rotations."
        }
      ]
    },
    {
      "id": 1231347,
      "postDate": "2021-03-08T22:12:26.253Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1231343,
      "author_name": "nofreewill42",
      "author_url": "",
      "post_date": "2021-03-08T22:09:36.513000",
      "content": "<p>I already found a counter-example <code>888a5efe68d6</code> 243x234 width by height, and despite of being wider than its height, it is rotated.<br>\nI suppose it looked like that because molecules are mostly drawn so that they are taking up space horizontally so that they can be put in books more easily for example?</p>\n<p>I was able to tell that they are rotated 90° and not -90° based on letters B and F. But are all of them so?<br>\nWhat are your findings on the test set?</p>",
      "votes": 2,
      "replies": [
        {
          "id": 1231362,
          "author_name": "nofreewill42",
          "author_url": "",
          "post_date": "2021-03-08T22:26:00.493000",
          "content": "<p>If the rotation can not only be 90° but also -90°, then we cannot tell the orientation of compounds that only contain atoms with point symmetric letters.. and so there are two possible compounds (which are the mirrored copies of each other) in the image that we cannot tell apart and I suppose that mostly the two has different formulae.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1231365,
          "author_name": "Matt",
          "author_url": "",
          "post_date": "2021-03-08T22:30:12.480000",
          "content": "<p>It seems to me that the test set only uses one clockwise rotation, never the CCW direction. I was surprised to see you find a counter-example in the test set. According to my script, all the training images have bigger width than height.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1231368,
          "author_name": "nofreewill42",
          "author_url": "",
          "post_date": "2021-03-08T22:40:50.697000",
          "content": "<p>Yeah, it seems that counter-examples are rare… But still, should keep in mind that not 100% true.</p>\n<p>Train a network that tells if a picture is rotated, for example. Which is simple to do with the training data. If that finds a lot of counter-examples in the test set, then it might be worth the extra effort to work on this.</p>\n<ul>\n<li>has letters in it -&gt; piece of cake</li>\n<li>has only \"O\"s in it -&gt; they're egg-shaped, even if just a little</li>\n<li>no letters, but wide/tall -&gt; should be doable</li>\n<li>no letters, roughly as wide as tall -&gt; evil</li>\n</ul>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1233813,
          "author_name": "nofreewill42",
          "author_url": "",
          "post_date": "2021-03-10T17:20:13.557000",
          "content": "<p>I was just randomly scoping the training data and found <code>a369aef8699e</code>.<br>\nIt seems that the training data also has these very few weird rotations.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1231347,
      "author_name": "",
      "author_url": "",
      "post_date": "2021-03-08T22:12:26.253000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1231322": "I found that:\nTrain : horizontal images only\nTest : horizontal and -90° rotated images\n\n1. Am I right?\n2. Are we supposed to be robust on the -90° rotation?\nIf so, I did not find an image that violates that:\n- if it is wider -> horizontal\n- if it is taller -> rotated (and so just rotate it back 90°)\n\nAny thoughts, negative examples?",
    "1231343": "I already found a counter-example `888a5efe68d6` 243x234 width by height, and despite of being wider than its height, it is rotated.\nI suppose it looked like that because molecules are mostly drawn so that they are taking up space horizontally so that they can be put in books more easily for example?\n\nI was able to tell that they are rotated 90° and not -90° based on letters B and F. But are all of them so?\nWhat are your findings on the test set?",
    "1231347": ""
  }
}