{
  "id": 211730,
  "title": "Why Transformers are so powerful?",
  "url": "/competitions/riiid-test-answer-prediction/discussion/211730",
  "author_name": "",
  "post_date": "2021-01-16T10:53:52.509675900Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Transformers are on the top places in this competition and another competitions. Why they are so powerful?</p>",
  "messages": [
    {
      "id": "1155288",
      "postDate": "01/16/2021 10:53:52",
      "content": "<p>Transformers are on the top places in this competition and another competitions. Why they are so powerful?</p>",
      "rawMarkdown": "Transformers are on the top places in this competition and another competitions. Why they are so powerful?",
      "votes": null
    },
    {
      "id": "1156455",
      "postDate": "01/17/2021 07:03:06",
      "content": "<p><a href=\"https://arxiv.org/abs/1908.11775\" target=\"_blank\">https://arxiv.org/abs/1908.11775</a><br>\nIt is essentially a kernel method on steroids. Mathematically speaking, from the highest perspective, Transformers share the same philosophy with many integral transforms (Fourier, Merlin, etc you name it). These transforms are extremely powerful at extracting information if the problem has a low-dimensional intrinsic structure.</p>",
      "rawMarkdown": "https://arxiv.org/abs/1908.11775\nIt is essentially a kernel method on steroids. Mathematically speaking, from the highest perspective, Transformers share the same philosophy with many integral transforms (Fourier, Merlin, etc you name it). These transforms are extremely powerful at extracting information if the problem has a low-dimensional intrinsic structure.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1156455,
      "author_name": "scaomath",
      "author_url": "",
      "post_date": "01/17/2021 07:03:06",
      "content": "<p><a href=\"https://arxiv.org/abs/1908.11775\" target=\"_blank\">https://arxiv.org/abs/1908.11775</a><br>\nIt is essentially a kernel method on steroids. Mathematically speaking, from the highest perspective, Transformers share the same philosophy with many integral transforms (Fourier, Merlin, etc you name it). These transforms are extremely powerful at extracting information if the problem has a low-dimensional intrinsic structure.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1155288": "Transformers are on the top places in this competition and another competitions. Why they are so powerful?",
    "1156455": "https://arxiv.org/abs/1908.11775\nIt is essentially a kernel method on steroids. Mathematically speaking, from the highest perspective, Transformers share the same philosophy with many integral transforms (Fourier, Merlin, etc you name it). These transforms are extremely powerful at extracting information if the problem has a low-dimensional intrinsic structure."
  },
  "source": "meta"
}