The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates). The GRU unit controls the flow of information like the LSTM unit, but without having to use a memory unit. What i found is GRUs train faster and perform better than LSTMs on less training data.\nYou can read this for better understanding, https://arxiv.org/pdf/1412.3555v1.pdf\n@saurabh.rathor092/simple-rnn-vs-gru-vs-lstm-difference-lies-in-more-flexible-control-5f33e07b1e57\">https://medium.com/@saurabh.rathor092/simple-rnn-vs-gru-vs-lstm-difference-lies-in-more-flexible-control-5f33e07b1e57
", "rawMarkdown": "The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates). The GRU unit controls the flow of information like the LSTM unit, but without having to use a memory unit. What i found is GRUs train faster and perform better than LSTMs on less training data.\nYou can read this for better understanding, https://arxiv.org/pdf/1412.3555v1.pdf\nhttps://medium.com/@saurabh.rathor092/simple-rnn-vs-gru-vs-lstm-difference-lies-in-more-flexible-control-5f33e07b1e57", "votes": null }, { "id": "444515", "postDate": "12/24/2018 07:02:22", "content": "CudnnLSTM with no doubt. I checked it multiple times.
", "rawMarkdown": "CudnnLSTM with no doubt. I checked it multiple times.", "votes": null }, { "id": "444668", "postDate": "12/24/2018 14:19:30", "content": "It depends, but the basic rule of thumb is: GRU work better on shorter sequences, LSTM better on longer ones. I would always try both.
", "rawMarkdown": "It depends, but the basic rule of thumb is: GRU work better on shorter sequences, LSTM better on longer ones. I would always try both.", "votes": null } ], "comments": [ { "id": 444203, "author_name": "someadityamandal", "author_url": "", "post_date": "12/23/2018 14:07:25", "content": "The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates). The GRU unit controls the flow of information like the LSTM unit, but without having to use a memory unit. What i found is GRUs train faster and perform better than LSTMs on less training data.\nYou can read this for better understanding, https://arxiv.org/pdf/1412.3555v1.pdf\n@saurabh.rathor092/simple-rnn-vs-gru-vs-lstm-difference-lies-in-more-flexible-control-5f33e07b1e57\">https://medium.com/@saurabh.rathor092/simple-rnn-vs-gru-vs-lstm-difference-lies-in-more-flexible-control-5f33e07b1e57
", "votes": null, "replies": [] }, { "id": 444515, "author_name": "s4sarath", "author_url": "", "post_date": "12/24/2018 07:02:22", "content": "CudnnLSTM with no doubt. I checked it multiple times.
", "votes": null, "replies": [] }, { "id": 444668, "author_name": "mschumacher", "author_url": "", "post_date": "12/24/2018 14:19:30", "content": "It depends, but the basic rule of thumb is: GRU work better on shorter sequences, LSTM better on longer ones. I would always try both.
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "444111": "", "444203": "The key difference between a GRU and an LSTM is that a GRU has two gates (reset and update gates) whereas an LSTM has three gates (namely input, output and forget gates). The GRU unit controls the flow of information like the LSTM unit, but without having to use a memory unit. What i found is GRUs train faster and perform better than LSTMs on less training data.\nYou can read this for better understanding, https://arxiv.org/pdf/1412.3555v1.pdf\nhttps://medium.com/@saurabh.rathor092/simple-rnn-vs-gru-vs-lstm-difference-lies-in-more-flexible-control-5f33e07b1e57", "444515": "CudnnLSTM with no doubt. I checked it multiple times.", "444668": "It depends, but the basic rule of thumb is: GRU work better on shorter sequences, LSTM better on longer ones. I would always try both." }, "source": "meta" }