well,we are here to help researchers working on climate change area right?\nwe are solving one problem and creating another one,yeah i am talking about emitting carbon dioxide during training models on GPU :(
\n\n![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2034058%2Fb8fe094023160c956b5558bffc9a6984%2Flimit.PNG?generation=1573301382327801&alt=media\")
well,we are here to help researchers working on climate change area right?\nwe are solving one problem and creating another one,yeah i am talking about emitting carbon dioxide during training models on GPU :(
\n\n
Those numbers don't say much, few people are training Transformers with neural architecture search. It would be interesting to see an estimate of yearly CO2 emissions for training AI models in general. I think cryptocurrencies are a way bigger problem in terms of CO2 emissions
", "rawMarkdown": "Those numbers don't say much, few people are training Transformers with neural architecture search. It would be interesting to see an estimate of yearly CO2 emissions for training AI models in general. I think cryptocurrencies are a way bigger problem in terms of CO2 emissions", "votes": 13, "replies": [ { "id": 669078, "postDate": "2019-11-09T13:00:07.597Z", "content": "Agree
", "rawMarkdown": "Agree", "votes": 1 }, { "id": 669080, "postDate": "2019-11-09T13:02:43.603Z", "content": "completely agree with you :(
", "rawMarkdown": "completely agree with you :( " }, { "id": 669396, "postDate": "2019-11-10T01:48:20.513Z", "content": "Yeah the majority of us aren't spending 1 million+ on cloud compute. That's very misleading to a lay person who sees this and think every model we train is that extreme
", "rawMarkdown": "Yeah the majority of us aren't spending 1 million+ on cloud compute. That's very misleading to a lay person who sees this and think every model we train is that extreme", "votes": 1 } ] }, { "id": 675602, "postDate": "2019-11-18T09:59:12.467Z", "content": "OK, training BERT emitted 5 car CO2. So what? Given how much time it is reused it probably saved a lot of model training.
\n\nIt would be more interesting to compare with bitcoin mining IMHO...
", "rawMarkdown": "OK, training BERT emitted 5 car CO2. So what? Given how much time it is reused it probably saved a lot of model training. \n\nIt would be more interesting to compare with bitcoin mining IMHO...", "votes": 7 }, { "id": 1045501, "postDate": "2020-10-10T17:51:27.077Z", "content": "Thanks for the information, never had a taught about it earlier! Each year, Bitcoin generates 22 Megatons of C02. This is of a small county like SriLanka
", "rawMarkdown": "Thanks for the information, never had a taught about it earlier! Each year, Bitcoin generates 22 Megatons of C02. This is of a small county like SriLanka", "votes": 2 }, { "id": 675369, "postDate": "2019-11-18T02:04:20.237Z", "content": "Maybe it's just media people fearing AI take their job, see how they targeting all these NLP model.
", "rawMarkdown": "Maybe it's just media people fearing AI take their job, see how they targeting all these NLP model. ", "votes": 1 }, { "id": 671056, "postDate": "2019-11-12T07:46:22.003Z", "content": "surprised ....but nice article.....
", "rawMarkdown": "surprised ....but nice article.....", "votes": 1, "replies": [ { "id": 671064, "postDate": "2019-11-12T07:57:36.380Z", "content": "yeah @saurav9786
", "rawMarkdown": "yeah @saurav9786 " } ] }, { "id": 670334, "postDate": "2019-11-11T10:52:55.747Z", "content": "This is super interesting, never thought about the environmental impact of AI, they gotta be trained with an energy source somehow!
\n\nAlthough people are not training Transformers daily that may impact the CO2 emissions at the end. Can we trust that data? We are talking about billion dollar companies training networks on the cloud with millions of hours of computing power.
\n\nThe country where it is trained can affect it too, what if they train on renewable source of energy? That would be a cool think to research on the future, trying to train with green energy only!
\n\nI would worry more about cryptocurrencies than AI models though.
", "rawMarkdown": "This is super interesting, never thought about the environmental impact of AI, they gotta be trained with an energy source somehow!\n\nAlthough people are not training Transformers daily that may impact the CO2 emissions at the end. Can we trust that data? We are talking about billion dollar companies training networks on the cloud with millions of hours of computing power.\n\nThe country where it is trained can affect it too, what if they train on renewable source of energy? That would be a cool think to research on the future, trying to train with green energy only!\n\nI would worry more about cryptocurrencies than AI models though.\n\n", "votes": 1, "replies": [ { "id": 670500, "postDate": "2019-11-11T14:16:16.573Z", "content": "yeah i am also worried about cryptocurrencies more than Ai models :(
", "rawMarkdown": "yeah i am also worried about cryptocurrencies more than Ai models :(" } ] }, { "id": 669715, "postDate": "2019-11-10T10:52:30.950Z", "content": "WoW! I never thought about CO2 emissions while training AI!
", "rawMarkdown": "WoW! I never thought about CO2 emissions while training AI!", "votes": 1 }, { "id": 670819, "postDate": "2019-11-11T22:45:54.813Z", "content": "Thanks for the information
", "rawMarkdown": "Thanks for the information", "votes": 2, "replies": [ { "id": 670912, "postDate": "2019-11-12T03:25:05.930Z", "content": "you are welcome
", "rawMarkdown": "you are welcome" } ] }, { "id": 670405, "postDate": "2019-11-11T12:34:43.427Z", "content": "OK, I agree, but this problem seems to be linked to countries where the energy matrix is carbon based. We, as humanity, need to stop using carbon based energy. In this sense, I don't believe this is an AI's problem exclusively tho.
", "rawMarkdown": "OK, I agree, but this problem seems to be linked to countries where the energy matrix is carbon based. We, as humanity, need to stop using carbon based energy. In this sense, I don't believe this is an AI's problem exclusively tho.", "replies": [ { "id": 670496, "postDate": "2019-11-11T14:14:51.523Z", "content": "yeah you are right that AI is not the only one that emitting carbon but it is doing and as deep learning practioners i think we need to work hard on this area to save our planet
", "rawMarkdown": "yeah you are right that AI is not the only one that emitting carbon but it is doing and as deep learning practioners i think we need to work hard on this area to save our planet" }, { "id": 670501, "postDate": "2019-11-11T14:18:49.697Z", "content": "True not AI only, but it's good to see this side of the coin early and try to go green. Would be nice to see a platform like Kaggle trying to move every computation to green energy!
", "rawMarkdown": "True not AI only, but it's good to see this side of the coin early and try to go green. Would be nice to see a platform like Kaggle trying to move every computation to green energy!" }, { "id": 670520, "postDate": "2019-11-11T14:43:50.633Z", "content": "strongly agree with you @amneves
", "rawMarkdown": "strongly agree with you @amneves " } ] }, { "id": 676939, "postDate": "2019-11-19T16:26:25.657Z", "rawMarkdown": "", "votes": -1, "isDeleted": true } ], "comments": [ { "id": 669070, "author_name": "Miguel Pinto", "author_url": "", "post_date": "2019-11-09T12:39:27.400000", "content": "Those numbers don't say much, few people are training Transformers with neural architecture search. It would be interesting to see an estimate of yearly CO2 emissions for training AI models in general. I think cryptocurrencies are a way bigger problem in terms of CO2 emissions
", "votes": 13, "replies": [ { "id": 669078, "author_name": "哈尔的移动城堡", "author_url": "", "post_date": "2019-11-09T13:00:07.597000", "content": "Agree
", "votes": 1, "replies": [] }, { "id": 669080, "author_name": "Mobassir", "author_url": "", "post_date": "2019-11-09T13:02:43.603000", "content": "completely agree with you :(
", "votes": 0, "replies": [] }, { "id": 669396, "author_name": "ryches", "author_url": "", "post_date": "2019-11-10T01:48:20.513000", "content": "Yeah the majority of us aren't spending 1 million+ on cloud compute. That's very misleading to a lay person who sees this and think every model we train is that extreme
", "votes": 1, "replies": [] } ] }, { "id": 675602, "author_name": "CPMP", "author_url": "", "post_date": "2019-11-18T09:59:12.467000", "content": "OK, training BERT emitted 5 car CO2. So what? Given how much time it is reused it probably saved a lot of model training.
\n\nIt would be more interesting to compare with bitcoin mining IMHO...
", "votes": 7, "replies": [] }, { "id": 1045501, "author_name": "Bharadwaj M S", "author_url": "", "post_date": "2020-10-10T17:51:27.077000", "content": "Thanks for the information, never had a taught about it earlier! Each year, Bitcoin generates 22 Megatons of C02. This is of a small county like SriLanka
", "votes": 2, "replies": [] }, { "id": 675369, "author_name": "XC Zhang (Raynard)", "author_url": "", "post_date": "2019-11-18T02:04:20.237000", "content": "Maybe it's just media people fearing AI take their job, see how they targeting all these NLP model.
", "votes": 1, "replies": [] }, { "id": 671056, "author_name": "Saurav Anand", "author_url": "", "post_date": "2019-11-12T07:46:22.003000", "content": "surprised ....but nice article.....
", "votes": 1, "replies": [ { "id": 671064, "author_name": "Mobassir", "author_url": "", "post_date": "2019-11-12T07:57:36.380000", "content": "yeah @saurav9786
", "votes": 0, "replies": [] } ] }, { "id": 670334, "author_name": "André Neves", "author_url": "", "post_date": "2019-11-11T10:52:55.747000", "content": "This is super interesting, never thought about the environmental impact of AI, they gotta be trained with an energy source somehow!
\n\nAlthough people are not training Transformers daily that may impact the CO2 emissions at the end. Can we trust that data? We are talking about billion dollar companies training networks on the cloud with millions of hours of computing power.
\n\nThe country where it is trained can affect it too, what if they train on renewable source of energy? That would be a cool think to research on the future, trying to train with green energy only!
\n\nI would worry more about cryptocurrencies than AI models though.
", "votes": 1, "replies": [ { "id": 670500, "author_name": "Mobassir", "author_url": "", "post_date": "2019-11-11T14:16:16.573000", "content": "yeah i am also worried about cryptocurrencies more than Ai models :(
", "votes": 0, "replies": [] } ] }, { "id": 669715, "author_name": "Alphons Jaimon", "author_url": "", "post_date": "2019-11-10T10:52:30.950000", "content": "WoW! I never thought about CO2 emissions while training AI!
", "votes": 1, "replies": [] }, { "id": 670819, "author_name": "Tarek Hamdi", "author_url": "", "post_date": "2019-11-11T22:45:54.813000", "content": "Thanks for the information
", "votes": 2, "replies": [ { "id": 670912, "author_name": "Mobassir", "author_url": "", "post_date": "2019-11-12T03:25:05.930000", "content": "you are welcome
", "votes": 0, "replies": [] } ] }, { "id": 670405, "author_name": "Michael Araujo", "author_url": "", "post_date": "2019-11-11T12:34:43.427000", "content": "OK, I agree, but this problem seems to be linked to countries where the energy matrix is carbon based. We, as humanity, need to stop using carbon based energy. In this sense, I don't believe this is an AI's problem exclusively tho.
", "votes": 0, "replies": [ { "id": 670496, "author_name": "Mobassir", "author_url": "", "post_date": "2019-11-11T14:14:51.523000", "content": "yeah you are right that AI is not the only one that emitting carbon but it is doing and as deep learning practioners i think we need to work hard on this area to save our planet
", "votes": 0, "replies": [] }, { "id": 670501, "author_name": "André Neves", "author_url": "", "post_date": "2019-11-11T14:18:49.697000", "content": "True not AI only, but it's good to see this side of the coin early and try to go green. Would be nice to see a platform like Kaggle trying to move every computation to green energy!
", "votes": 0, "replies": [] }, { "id": 670520, "author_name": "Mobassir", "author_url": "", "post_date": "2019-11-11T14:43:50.633000", "content": "strongly agree with you @amneves
", "votes": 0, "replies": [] } ] }, { "id": 676939, "author_name": "", "author_url": "", "post_date": "2019-11-19T16:26:25.657000", "content": "", "votes": -1, "replies": [] } ], "raw_markdown_by_id": { "669060": "well,we are here to help researchers working on climate change area right?\nwe are solving one problem and creating another one,yeah i am talking about emitting carbon dioxide during training models on GPU :(\n\n# Deep learning has a terrible carbon footprint\n\n\n\n\n\n[**FULL ARTICLE**](https://www.technologyreview.com/s/613630/training-a-single-ai-model-can-emit-as-much-carbon-as-five-cars-in-their-lifetimes/)", "669070": "Those numbers don't say much, few people are training Transformers with neural architecture search. It would be interesting to see an estimate of yearly CO2 emissions for training AI models in general. I think cryptocurrencies are a way bigger problem in terms of CO2 emissions", "675602": "OK, training BERT emitted 5 car CO2. So what? Given how much time it is reused it probably saved a lot of model training. \n\nIt would be more interesting to compare with bitcoin mining IMHO...", "1045501": "Thanks for the information, never had a taught about it earlier! Each year, Bitcoin generates 22 Megatons of C02. This is of a small county like SriLanka", "675369": "Maybe it's just media people fearing AI take their job, see how they targeting all these NLP model. ", "671056": "surprised ....but nice article.....", "670334": "This is super interesting, never thought about the environmental impact of AI, they gotta be trained with an energy source somehow!\n\nAlthough people are not training Transformers daily that may impact the CO2 emissions at the end. Can we trust that data? We are talking about billion dollar companies training networks on the cloud with millions of hours of computing power.\n\nThe country where it is trained can affect it too, what if they train on renewable source of energy? That would be a cool think to research on the future, trying to train with green energy only!\n\nI would worry more about cryptocurrencies than AI models though.\n\n", "669715": "WoW! I never thought about CO2 emissions while training AI!", "670819": "Thanks for the information", "670405": "OK, I agree, but this problem seems to be linked to countries where the energy matrix is carbon based. We, as humanity, need to stop using carbon based energy. In this sense, I don't believe this is an AI's problem exclusively tho.", "676939": "" } }