{
  "id": 331725,
  "title": "Understanding NA in the dataset",
  "url": "/competitions/amex-default-prediction/discussion/331725",
  "author_name": "",
  "post_date": "2022-06-18T15:00:14.913243700Z",
  "votes": 66,
  "comment_count": 14,
  "views": 0,
  "content": "<p>I spent couple of hours to understand how NA's have been generated in the dataset. And my oh my there are so much to discover here. I covered most of my work so far in the notebook:</p>\n<p><a href=\"https://www.kaggle.com/raddar/understanding-na-values-in-amex-competition\" target=\"_blank\">https://www.kaggle.com/raddar/understanding-na-values-in-amex-competition</a></p>\n<p>Enjoy!</p>",
  "messages": [
    {
      "id": "1824707",
      "postDate": "06/18/2022 15:00:14",
      "content": "<p>I spent couple of hours to understand how NA's have been generated in the dataset. And my oh my there are so much to discover here. I covered most of my work so far in the notebook:</p>\n<p><a href=\"https://www.kaggle.com/raddar/understanding-na-values-in-amex-competition\" target=\"_blank\">https://www.kaggle.com/raddar/understanding-na-values-in-amex-competition</a></p>\n<p>Enjoy!</p>",
      "rawMarkdown": "I spent couple of hours to understand how NA's have been generated in the dataset. And my oh my there are so much to discover here. I covered most of my work so far in the notebook:\n\nhttps://www.kaggle.com/raddar/understanding-na-values-in-amex-competition\n\nEnjoy!",
      "votes": null
    },
    {
      "id": "1824734",
      "postDate": "06/18/2022 15:23:23",
      "content": "<p>Thank you <a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> for all the good work you are sharing( discussions, notebooks )  , it always helps , keep it up 🙌</p>",
      "rawMarkdown": "Thank you @raddar for all the good work you are sharing( discussions, notebooks )  , it always helps , keep it up 🙌",
      "votes": null
    },
    {
      "id": "1824736",
      "postDate": "06/18/2022 15:24:01",
      "content": "<p>I have mixed feelings)) upvoted - did the same study<br>\nbut sometimes I think to not \"waste\" time in this competition during june and july and just come back in august and take everything from you notebooks and other people sharings.</p>\n<p>mixed feelings… </p>",
      "rawMarkdown": "I have mixed feelings)) upvoted - did the same study\nbut sometimes I think to not \"waste\" time in this competition during june and july and just come back in august and take everything from you notebooks and other people sharings.\n\nmixed feelings...",
      "votes": null
    },
    {
      "id": "1824746",
      "postDate": "06/18/2022 15:32:08",
      "content": "<p>Well. this does happen in most of the competitions, doesn't it :) I think this does less harm than good performing public models, as you do have to figure out yourself how to use the information you get from this kind of work</p>",
      "rawMarkdown": "Well. this does happen in most of the competitions, doesn't it :) I think this does less harm than good performing public models, as you do have to figure out yourself how to use the information you get from this kind of work",
      "votes": null
    },
    {
      "id": "1824752",
      "postDate": "06/18/2022 15:37:44",
      "content": "<p>Interesting work! Your discovery has inspired me a lot.</p>",
      "rawMarkdown": "Interesting work! Your discovery has inspired me a lot.",
      "votes": null
    },
    {
      "id": "1824754",
      "postDate": "06/18/2022 15:38:00",
      "content": "<p>You are totally right to post all such findings - many people (and I'm too) learning a lot from such posts and notebooks. Please continue to do so.</p>",
      "rawMarkdown": "You are totally right to post all such findings - many people (and I'm too) learning a lot from such posts and notebooks. Please continue to do so.",
      "votes": null
    },
    {
      "id": "1824837",
      "postDate": "06/18/2022 16:38:14",
      "content": "<p><a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a>  you are doing  the most. Thanks!</p>",
      "rawMarkdown": "raddar  you are doing  the most. Thanks!",
      "votes": null
    },
    {
      "id": "1824943",
      "postDate": "06/18/2022 19:23:36",
      "content": "<p>nice finding!</p>",
      "rawMarkdown": "nice finding!",
      "votes": null
    },
    {
      "id": "1825617",
      "postDate": "06/19/2022 14:46:54",
      "content": "<p>Thank you for sharing <a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> </p>",
      "rawMarkdown": "Thank you for sharing @raddar",
      "votes": null
    },
    {
      "id": "1826160",
      "postDate": "06/20/2022 05:17:19",
      "content": "<p>Thanks for sharing.</p>",
      "rawMarkdown": "Thanks for sharing.",
      "votes": null
    },
    {
      "id": "1827130",
      "postDate": "06/20/2022 21:11:20",
      "content": "<p>i wonder if you use transformer to learn to predict masked input (on both train and test csv) would help to fill in missing values?</p>",
      "rawMarkdown": "i wonder if you use transformer to learn to predict masked input (on both train and test csv) would help to fill in missing values?",
      "votes": null
    },
    {
      "id": "1827139",
      "postDate": "06/20/2022 21:30:49",
      "content": "<p>I guess it could. most NA patterns looks straightforward to impute</p>",
      "rawMarkdown": "I guess it could. most NA patterns looks straightforward to impute",
      "votes": null
    },
    {
      "id": "1828160",
      "postDate": "06/21/2022 14:12:50",
      "content": "<p>Really needed that, Thanks!</p>",
      "rawMarkdown": "Really needed that, Thanks!",
      "votes": null
    },
    {
      "id": "1828230",
      "postDate": "06/21/2022 15:12:24",
      "content": "<p>Thanks for sharing, always great content to learn from <a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> </p>",
      "rawMarkdown": "Thanks for sharing, always great content to learn from @raddar",
      "votes": null
    },
    {
      "id": "1849989",
      "postDate": "07/10/2022 01:53:26",
      "content": "<p>You are a gentleman and a scholar, thanks for all the contributions to the community.</p>",
      "rawMarkdown": "You are a gentleman and a scholar, thanks for all the contributions to the community.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1824734,
      "author_name": "mhslearner",
      "author_url": "",
      "post_date": "06/18/2022 15:23:23",
      "content": "<p>Thank you <a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> for all the good work you are sharing( discussions, notebooks )  , it always helps , keep it up 🙌</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1824736,
      "author_name": "kyakovlev",
      "author_url": "",
      "post_date": "06/18/2022 15:24:01",
      "content": "<p>I have mixed feelings)) upvoted - did the same study<br>\nbut sometimes I think to not \"waste\" time in this competition during june and july and just come back in august and take everything from you notebooks and other people sharings.</p>\n<p>mixed feelings… </p>",
      "votes": null,
      "replies": [
        {
          "id": 1824746,
          "author_name": "raddar",
          "author_url": "",
          "post_date": "06/18/2022 15:32:08",
          "content": "<p>Well. this does happen in most of the competitions, doesn't it :) I think this does less harm than good performing public models, as you do have to figure out yourself how to use the information you get from this kind of work</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1824754,
          "author_name": "kyakovlev",
          "author_url": "",
          "post_date": "06/18/2022 15:38:00",
          "content": "<p>You are totally right to post all such findings - many people (and I'm too) learning a lot from such posts and notebooks. Please continue to do so.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1824752,
      "author_name": "x2c2y4",
      "author_url": "",
      "post_date": "06/18/2022 15:37:44",
      "content": "<p>Interesting work! Your discovery has inspired me a lot.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1824837,
      "author_name": "wuuthraad",
      "author_url": "",
      "post_date": "06/18/2022 16:38:14",
      "content": "<p><a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a>  you are doing  the most. Thanks!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1824943,
      "author_name": "aliabdin1",
      "author_url": "",
      "post_date": "06/18/2022 19:23:36",
      "content": "<p>nice finding!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1825617,
      "author_name": "arti1117",
      "author_url": "",
      "post_date": "06/19/2022 14:46:54",
      "content": "<p>Thank you for sharing <a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1826160,
      "author_name": "deba87",
      "author_url": "",
      "post_date": "06/20/2022 05:17:19",
      "content": "<p>Thanks for sharing.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1827130,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "06/20/2022 21:11:20",
      "content": "<p>i wonder if you use transformer to learn to predict masked input (on both train and test csv) would help to fill in missing values?</p>",
      "votes": null,
      "replies": [
        {
          "id": 1827139,
          "author_name": "raddar",
          "author_url": "",
          "post_date": "06/20/2022 21:30:49",
          "content": "<p>I guess it could. most NA patterns looks straightforward to impute</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1828160,
      "author_name": "rohit2710",
      "author_url": "",
      "post_date": "06/21/2022 14:12:50",
      "content": "<p>Really needed that, Thanks!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1828230,
      "author_name": "lucafaccin",
      "author_url": "",
      "post_date": "06/21/2022 15:12:24",
      "content": "<p>Thanks for sharing, always great content to learn from <a href=\"https://www.kaggle.com/raddar\" target=\"_blank\">@raddar</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1849989,
      "author_name": "scharlesworth",
      "author_url": "",
      "post_date": "07/10/2022 01:53:26",
      "content": "<p>You are a gentleman and a scholar, thanks for all the contributions to the community.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1824707": "I spent couple of hours to understand how NA's have been generated in the dataset. And my oh my there are so much to discover here. I covered most of my work so far in the notebook:\n\nhttps://www.kaggle.com/raddar/understanding-na-values-in-amex-competition\n\nEnjoy!",
    "1824734": "Thank you @raddar for all the good work you are sharing( discussions, notebooks )  , it always helps , keep it up 🙌",
    "1824736": "I have mixed feelings)) upvoted - did the same study\nbut sometimes I think to not \"waste\" time in this competition during june and july and just come back in august and take everything from you notebooks and other people sharings.\n\nmixed feelings...",
    "1824746": "Well. this does happen in most of the competitions, doesn't it :) I think this does less harm than good performing public models, as you do have to figure out yourself how to use the information you get from this kind of work",
    "1824752": "Interesting work! Your discovery has inspired me a lot.",
    "1824754": "You are totally right to post all such findings - many people (and I'm too) learning a lot from such posts and notebooks. Please continue to do so.",
    "1824837": "raddar  you are doing  the most. Thanks!",
    "1824943": "nice finding!",
    "1825617": "Thank you for sharing @raddar",
    "1826160": "Thanks for sharing.",
    "1827130": "i wonder if you use transformer to learn to predict masked input (on both train and test csv) would help to fill in missing values?",
    "1827139": "I guess it could. most NA patterns looks straightforward to impute",
    "1828160": "Really needed that, Thanks!",
    "1828230": "Thanks for sharing, always great content to learn from @raddar",
    "1849989": "You are a gentleman and a scholar, thanks for all the contributions to the community."
  },
  "source": "meta"
}