{
  "id": 199711,
  "title": "10th place solution (vectornet)",
  "url": "/competitions/lyft-motion-prediction-autonomous-vehicles/discussion/199711",
  "author_name": "bosskong",
  "post_date": "2020-11-27T00:59:55.304000",
  "votes": 40,
  "comment_count": 17,
  "views": 0,
  "content": "<p>Thanks to Kaggle and Lyft for hosting the competition.<br>\n<strong>Rule-base</strong> is only my team name, but not a solution.😀</p>\n<p>In this competition, I tested two papers from waymo &amp; google research:<br>\nvector net:   <a href=\"https://arxiv.org/abs/2005.04259\" target=\"_blank\">https://arxiv.org/abs/2005.04259</a>   (final solution)<br>\ntnt:                <a href=\"https://arxiv.org/abs/2008.08294\" target=\"_blank\">https://arxiv.org/abs/2008.08294</a>  (hard to train, = =!)</p>\n<p>vector net:<br>\nbatch=1024, 1 * 1080 GPU + 8 core CPU, trained for 2 days<br>\n&lt;=800 vectors</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fdc1279adf7cddb1b4ad05a32e108d175%2F149.png?generation=1606437813920943&amp;alt=media\" alt=\"\"></p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fcb42ce425d35ec735107a2f2178e0985%2F12.png?generation=1606437866782123&amp;alt=media\" alt=\"\"></p>\n<p>tnt:<br>\nbatch=128, 1 * 1080 GPU + 8 core CPU, trained for 0.5 day<br>\n&lt;=800 vectors</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fde8650eb8c219883afa0c64f65c51911%2Ftnt1.png?generation=1606438391638966&amp;alt=media\" alt=\"\"></p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2F97dd2340242bbc2ff9a1a8492b882d2e%2Ftnt2.png?generation=1606438403511527&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": 1092552,
      "postDate": "2020-11-27T00:59:55.303Z",
      "content": "<p>Thanks to Kaggle and Lyft for hosting the competition.<br>\n<strong>Rule-base</strong> is only my team name, but not a solution.😀</p>\n<p>In this competition, I tested two papers from waymo &amp; google research:<br>\nvector net:   <a href=\"https://arxiv.org/abs/2005.04259\" target=\"_blank\">https://arxiv.org/abs/2005.04259</a>   (final solution)<br>\ntnt:                <a href=\"https://arxiv.org/abs/2008.08294\" target=\"_blank\">https://arxiv.org/abs/2008.08294</a>  (hard to train, = =!)</p>\n<p>vector net:<br>\nbatch=1024, 1 * 1080 GPU + 8 core CPU, trained for 2 days<br>\n&lt;=800 vectors</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fdc1279adf7cddb1b4ad05a32e108d175%2F149.png?generation=1606437813920943&amp;alt=media\" alt=\"\"></p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fcb42ce425d35ec735107a2f2178e0985%2F12.png?generation=1606437866782123&amp;alt=media\" alt=\"\"></p>\n<p>tnt:<br>\nbatch=128, 1 * 1080 GPU + 8 core CPU, trained for 0.5 day<br>\n&lt;=800 vectors</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fde8650eb8c219883afa0c64f65c51911%2Ftnt1.png?generation=1606438391638966&amp;alt=media\" alt=\"\"></p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2F97dd2340242bbc2ff9a1a8492b882d2e%2Ftnt2.png?generation=1606438403511527&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Thanks to Kaggle and Lyft for hosting the competition.\n**Rule-base** is only my team name, but not a solution.😀\n\nIn this competition, I tested two papers from waymo & google research:\nvector net:   https://arxiv.org/abs/2005.04259   (final solution)\ntnt:                https://arxiv.org/abs/2008.08294  (hard to train, = =!)\n\nvector net:\nbatch=1024, 1 * 1080 GPU + 8 core CPU, trained for 2 days\n<=800 vectors\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fdc1279adf7cddb1b4ad05a32e108d175%2F149.png?generation=1606437813920943&alt=media)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fcb42ce425d35ec735107a2f2178e0985%2F12.png?generation=1606437866782123&alt=media)\n\ntnt:\nbatch=128, 1 * 1080 GPU + 8 core CPU, trained for 0.5 day\n<=800 vectors\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fde8650eb8c219883afa0c64f65c51911%2Ftnt1.png?generation=1606438391638966&alt=media)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2F97dd2340242bbc2ff9a1a8492b882d2e%2Ftnt2.png?generation=1606438403511527&alt=media)",
      "votes": 40
    },
    {
      "id": 1092772,
      "postDate": "2020-11-27T06:41:59.060Z",
      "content": "<p>very good work. so you did not use image data at all?</p>\n<p>do you plan to release any code or kaggle kernel?<br>\ni would love to reimplement your solution. thanks</p>",
      "rawMarkdown": "very good work. so you did not use image data at all?\n\ndo you plan to release any code or kaggle kernel?\ni would love to reimplement your solution. thanks",
      "votes": 5,
      "replies": [
        {
          "id": 1092946,
          "postDate": "2020-11-27T10:20:23.863Z",
          "content": "<p><a href=\"https://www.kaggle.com/bosskong\" target=\"_blank\">@bosskong</a> I will also join the train of people asking for your code. Let us know if you plan to release this. I would like to test it out.</p>",
          "rawMarkdown": "@bosskong I will also join the train of people asking for your code. Let us know if you plan to release this. I would like to test it out.",
          "votes": 1
        },
        {
          "id": 1093165,
          "postDate": "2020-11-27T14:00:59.557Z",
          "content": "<p>not use any image at all</p>",
          "rawMarkdown": "not use any image at all"
        },
        {
          "id": 1204210,
          "postDate": "2021-02-15T23:45:41.463Z",
          "content": "<p>Hello everyone! I wonder if someone else succeeded with implementation of this approach and if we can see the code what performs well</p>",
          "rawMarkdown": "Hello everyone! I wonder if someone else succeeded with implementation of this approach and if we can see the code what performs well"
        }
      ]
    },
    {
      "id": 1221723,
      "postDate": "2021-03-01T08:02:55.267Z",
      "content": "<p>I have created a <strong>YouTube video</strong> explaining the VectorNet method. Check it out if you are lazy to read the paper <br>\n🙌 <a href=\"https://youtu.be/yJFtf-fz3WA\" target=\"_blank\">https://youtu.be/yJFtf-fz3WA</a></p>",
      "rawMarkdown": "I have created a **YouTube video** explaining the VectorNet method. Check it out if you are lazy to read the paper \n🙌 https://youtu.be/yJFtf-fz3WA",
      "votes": 1
    },
    {
      "id": 1092864,
      "postDate": "2020-11-27T08:24:35.787Z",
      "content": "<p>I was expecting a complete set of rules for driving here</p>",
      "rawMarkdown": "I was expecting a complete set of rules for driving here",
      "votes": 1
    },
    {
      "id": 1099697,
      "postDate": "2020-12-02T14:42:28.210Z",
      "content": "<p>Wonderful approach, thank you for sharing it!!! </p>",
      "rawMarkdown": "Wonderful approach, thank you for sharing it!!! "
    },
    {
      "id": 1098866,
      "postDate": "2020-12-01T23:04:36.123Z",
      "content": "<p>Congrats <a href=\"https://www.kaggle.com/bosskong\" target=\"_blank\">@bosskong</a> and thanks for sharing your solution.</p>",
      "rawMarkdown": "Congrats @bosskong and thanks for sharing your solution."
    },
    {
      "id": 1096011,
      "postDate": "2020-11-30T06:35:41.243Z",
      "content": "<p>Thanks for sharing interesting approach! <br>\nI guess the big advantage of not using image is its speed, no rasterization &amp; no heavy CNN is necessary. How was the training speed of your approach? For example how many <code>iter/sec</code> speed is achieved with this approach?</p>",
      "rawMarkdown": "Thanks for sharing interesting approach! \nI guess the big advantage of not using image is its speed, no rasterization & no heavy CNN is necessary. How was the training speed of your approach? For example how many `iter/sec` speed is achieved with this approach?",
      "replies": [
        {
          "id": 1096434,
          "postDate": "2020-11-30T13:46:48.950Z",
          "content": "<p>about 3min per 1000 batch， batch_size = 1024</p>",
          "rawMarkdown": "about 3min per 1000 batch， batch_size = 1024",
          "votes": 1
        },
        {
          "id": 1096620,
          "postDate": "2020-11-30T16:42:04.110Z",
          "content": "<p>oh my goodness, 1024*1000 ~ 1000000 (for calculation) in 3min and train_full dataset contains 220 million the time it takes 220 * 3 = 660 min which is almost 11 hours.<br>\nCan I ask a question please can you make any improvement in this from your current score. or it is the highest score you could achieve  </p>",
          "rawMarkdown": "oh my goodness, 1024*1000 ~ 1000000 (for calculation) in 3min and train_full dataset contains 220 million the time it takes 220 * 3 = 660 min which is almost 11 hours.\nCan I ask a question please can you make any improvement in this from your current score. or it is the highest score you could achieve  ",
          "votes": 1
        },
        {
          "id": 1096964,
          "postDate": "2020-11-30T22:49:42.580Z",
          "content": "<p>I'm not sure. I met gradient exploding problem &amp; gradient vanishing problem at the same time.<br>\nsome layers' gradient explodes easily but others' vanish 😂</p>",
          "rawMarkdown": "I'm not sure. I met gradient exploding problem & gradient vanishing problem at the same time.\nsome layers' gradient explodes easily but others' vanish 😂",
          "votes": 1
        },
        {
          "id": 1097020,
          "postDate": "2020-11-30T23:50:13.603Z",
          "content": "<p>I see, so this is indeed pretty faster than image training (My CNN need 40 GPU days to run train_full 1 epoch) thanks!</p>",
          "rawMarkdown": "I see, so this is indeed pretty faster than image training (My CNN need 40 GPU days to run train_full 1 epoch) thanks!",
          "votes": 1
        }
      ]
    },
    {
      "id": 1092607,
      "postDate": "2020-11-27T03:02:31.503Z",
      "content": "<p>is this were your rasterized image you forwarded to the model or is this just a viisulization</p>",
      "rawMarkdown": "is this were your rasterized image you forwarded to the model or is this just a viisulization",
      "replies": [
        {
          "id": 1092660,
          "postDate": "2020-11-27T04:32:40.507Z",
          "content": "<p>it's my vis tool based on the matplotlib</p>",
          "rawMarkdown": "it's my vis tool based on the matplotlib"
        }
      ]
    },
    {
      "id": 1092763,
      "postDate": "2020-11-27T06:32:04.353Z",
      "rawMarkdown": "",
      "votes": 3,
      "isDeleted": true,
      "replies": [
        {
          "id": 1092938,
          "postDate": "2020-11-27T10:10:19.243Z",
          "content": "<p>Yeah, it would be great to read source code</p>",
          "rawMarkdown": "Yeah, it would be great to read source code",
          "votes": 2
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 1092772,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "2020-11-27T06:41:59.060000",
      "content": "<p>very good work. so you did not use image data at all?</p>\n<p>do you plan to release any code or kaggle kernel?<br>\ni would love to reimplement your solution. thanks</p>",
      "votes": 5,
      "replies": [
        {
          "id": 1092946,
          "author_name": "The Brown Iceman",
          "author_url": "",
          "post_date": "2020-11-27T10:20:23.863000",
          "content": "<p><a href=\"https://www.kaggle.com/bosskong\" target=\"_blank\">@bosskong</a> I will also join the train of people asking for your code. Let us know if you plan to release this. I would like to test it out.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1093165,
          "author_name": "bosskong",
          "author_url": "",
          "post_date": "2020-11-27T14:00:59.557000",
          "content": "<p>not use any image at all</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1204210,
          "author_name": "sdrnr",
          "author_url": "",
          "post_date": "2021-02-15T23:45:41.463000",
          "content": "<p>Hello everyone! I wonder if someone else succeeded with implementation of this approach and if we can see the code what performs well</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1221723,
      "author_name": "Artem.Sanakoev",
      "author_url": "",
      "post_date": "2021-03-01T08:02:55.267000",
      "content": "<p>I have created a <strong>YouTube video</strong> explaining the VectorNet method. Check it out if you are lazy to read the paper <br>\n🙌 <a href=\"https://youtu.be/yJFtf-fz3WA\" target=\"_blank\">https://youtu.be/yJFtf-fz3WA</a></p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1092864,
      "author_name": "Louis Yang",
      "author_url": "",
      "post_date": "2020-11-27T08:24:35.787000",
      "content": "<p>I was expecting a complete set of rules for driving here</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1099697,
      "author_name": "Sergio Manuel Papadakis",
      "author_url": "",
      "post_date": "2020-12-02T14:42:28.210000",
      "content": "<p>Wonderful approach, thank you for sharing it!!! </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1098866,
      "author_name": "YaGana Sheriff-Hussaini",
      "author_url": "",
      "post_date": "2020-12-01T23:04:36.123000",
      "content": "<p>Congrats <a href=\"https://www.kaggle.com/bosskong\" target=\"_blank\">@bosskong</a> and thanks for sharing your solution.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 1096011,
      "author_name": "corochann",
      "author_url": "",
      "post_date": "2020-11-30T06:35:41.243000",
      "content": "<p>Thanks for sharing interesting approach! <br>\nI guess the big advantage of not using image is its speed, no rasterization &amp; no heavy CNN is necessary. How was the training speed of your approach? For example how many <code>iter/sec</code> speed is achieved with this approach?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1096434,
          "author_name": "bosskong",
          "author_url": "",
          "post_date": "2020-11-30T13:46:48.950000",
          "content": "<p>about 3min per 1000 batch， batch_size = 1024</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1096620,
          "author_name": "Mohammed Rizin V K",
          "author_url": "",
          "post_date": "2020-11-30T16:42:04.110000",
          "content": "<p>oh my goodness, 1024*1000 ~ 1000000 (for calculation) in 3min and train_full dataset contains 220 million the time it takes 220 * 3 = 660 min which is almost 11 hours.<br>\nCan I ask a question please can you make any improvement in this from your current score. or it is the highest score you could achieve  </p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1096964,
          "author_name": "bosskong",
          "author_url": "",
          "post_date": "2020-11-30T22:49:42.580000",
          "content": "<p>I'm not sure. I met gradient exploding problem &amp; gradient vanishing problem at the same time.<br>\nsome layers' gradient explodes easily but others' vanish 😂</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1097020,
          "author_name": "corochann",
          "author_url": "",
          "post_date": "2020-11-30T23:50:13.603000",
          "content": "<p>I see, so this is indeed pretty faster than image training (My CNN need 40 GPU days to run train_full 1 epoch) thanks!</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1092607,
      "author_name": "Mohammed Rizin V K",
      "author_url": "",
      "post_date": "2020-11-27T03:02:31.503000",
      "content": "<p>is this were your rasterized image you forwarded to the model or is this just a viisulization</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1092660,
          "author_name": "bosskong",
          "author_url": "",
          "post_date": "2020-11-27T04:32:40.507000",
          "content": "<p>it's my vis tool based on the matplotlib</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1092763,
      "author_name": "",
      "author_url": "",
      "post_date": "2020-11-27T06:32:04.353000",
      "content": "",
      "votes": 3,
      "replies": [
        {
          "id": 1092938,
          "author_name": "Vladislav Tretyak",
          "author_url": "",
          "post_date": "2020-11-27T10:10:19.243000",
          "content": "<p>Yeah, it would be great to read source code</p>",
          "votes": 2,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1092552": "Thanks to Kaggle and Lyft for hosting the competition.\n**Rule-base** is only my team name, but not a solution.😀\n\nIn this competition, I tested two papers from waymo & google research:\nvector net:   https://arxiv.org/abs/2005.04259   (final solution)\ntnt:                https://arxiv.org/abs/2008.08294  (hard to train, = =!)\n\nvector net:\nbatch=1024, 1 * 1080 GPU + 8 core CPU, trained for 2 days\n<=800 vectors\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fdc1279adf7cddb1b4ad05a32e108d175%2F149.png?generation=1606437813920943&alt=media)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fcb42ce425d35ec735107a2f2178e0985%2F12.png?generation=1606437866782123&alt=media)\n\ntnt:\nbatch=128, 1 * 1080 GPU + 8 core CPU, trained for 0.5 day\n<=800 vectors\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2Fde8650eb8c219883afa0c64f65c51911%2Ftnt1.png?generation=1606438391638966&alt=media)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F5513638%2F97dd2340242bbc2ff9a1a8492b882d2e%2Ftnt2.png?generation=1606438403511527&alt=media)",
    "1092772": "very good work. so you did not use image data at all?\n\ndo you plan to release any code or kaggle kernel?\ni would love to reimplement your solution. thanks",
    "1221723": "I have created a **YouTube video** explaining the VectorNet method. Check it out if you are lazy to read the paper \n🙌 https://youtu.be/yJFtf-fz3WA",
    "1092864": "I was expecting a complete set of rules for driving here",
    "1099697": "Wonderful approach, thank you for sharing it!!! ",
    "1098866": "Congrats @bosskong and thanks for sharing your solution.",
    "1096011": "Thanks for sharing interesting approach! \nI guess the big advantage of not using image is its speed, no rasterization & no heavy CNN is necessary. How was the training speed of your approach? For example how many `iter/sec` speed is achieved with this approach?",
    "1092607": "is this were your rasterized image you forwarded to the model or is this just a viisulization",
    "1092763": ""
  }
}