Looking at the predictions of my models, it seemed they were having a hard time distinguishing between some particular word pairs.
\nI would love to hear thoughts from anyone who knows ASL, the hosts or the community on what are the exact differences in how these word are signed? Some are very similar/close in meaning in English - the lack of context (the \"isolated\" part of ISLR) makes things difficult too.
Word pairs my models are struggling with:
\nLooking at the predictions of my models, it seemed they were having a hard time distinguishing between some particular word pairs.
\nI would love to hear thoughts from anyone who knows ASL, the hosts or the community on what are the exact differences in how these word are signed? Some are very similar/close in meaning in English - the lack of context (the \"isolated\" part of ISLR) makes things difficult too.
Word pairs my models are struggling with:
\nI wonder if you can visualize each class of the sample of train data
", "rawMarkdown": "I wonder if you can visualize each class of the sample of train data", "votes": null }, { "id": "2190235", "postDate": "03/21/2023 06:02:24", "content": "i suggest you search in youtube to see the ASL of those words
", "rawMarkdown": "i suggest you search in youtube to see the ASL of those words", "votes": null }, { "id": "2190471", "postDate": "03/21/2023 08:55:52", "content": "I had tried both visualization and searching in youtube / internet in general. Here is a sample…
\nWake: https://www.youtube.com/results?search_query=asl+for+wake
\nAwake: https://www.youtube.com/results?search_query=asl+for+awake
To my untrained eye - they both look the same. That is why I was asking someone with ASL knowledge if there were nuances between these.
", "rawMarkdown": "I had tried both visualization and searching in youtube / internet in general. Here is a sample...\nWake: https://www.youtube.com/results?search_query=asl+for+wake\nAwake: https://www.youtube.com/results?search_query=asl+for+awake\n\nTo my untrained eye - they both look the same. That is why I was asking someone with ASL knowledge if there were nuances between these.", "votes": null }, { "id": "2190734", "postDate": "03/21/2023 13:03:58", "content": "In one of the previous discussions, an ASL Sign Language Dictionary was suggested. There are video examples of ASL gestures. I hope that would be helpful
", "rawMarkdown": "In one of the previous discussions, an [ASL Sign Language Dictionary](https://www.handspeak.com/word/) was suggested. There are video examples of ASL gestures. I hope that would be helpful", "votes": null }, { "id": "2191237", "postDate": "03/21/2023 20:27:04", "content": "Thanks @meowmeowmeowmeowmeow - this is a really helpful site that I wasn't aware of - appreciate it.
\nLooking at some of the pairs I do realise why the model is confused - as I am too. Like duck and goose can be different, but a variant of the goose sign looks very much like duck to my untrained eye. How do people who know ASL decipher these - is it context?
As a non-native speaker, there was a time when I was wondering how people can distinguish \"there\" vs \"their\". I guess, there is something similar.
\nBy the way, since you took a closer look at the data, could you please share your insides about handedness? Are there any words, that involve two hands?
I only looked at some words which my models were struggling to distinguish. But there are definitely words which involve both hands - an example is \"animal\" (https://www.handspeak.com/word/82) another word which strangely overlaps (not enough to make it to the list above) with a variation of \"have\" https://www.handspeak.com/word/989/ (the \"to possess or own\" meaning)
", "rawMarkdown": "I only looked at some words which my models were struggling to distinguish. But there are definitely words which involve both hands - an example is \"animal\" (https://www.handspeak.com/word/82) another word which strangely overlaps (not enough to make it to the list above) with a variation of \"have\" https://www.handspeak.com/word/989/ (the \"to possess or own\" meaning)", "votes": null }, { "id": "2192162", "postDate": "03/22/2023 13:22:09", "content": "I created an interactive dashboard that will allow you to visualize each class of the train data, with filtering and animation options. The second page of the dashboard will show you the mean frame of each file. Here is the link to the notebook, you only have to run it to get access.
\nHope that helps!
I wonder if you can visualize each class of the sample of train data
", "votes": null, "replies": [ { "id": 2190235, "author_name": "hengck23", "author_url": "", "post_date": "03/21/2023 06:02:24", "content": "i suggest you search in youtube to see the ASL of those words
", "votes": null, "replies": [ { "id": 2190471, "author_name": "alpinestranger", "author_url": "", "post_date": "03/21/2023 08:55:52", "content": "I had tried both visualization and searching in youtube / internet in general. Here is a sample…
\nWake: https://www.youtube.com/results?search_query=asl+for+wake
\nAwake: https://www.youtube.com/results?search_query=asl+for+awake
To my untrained eye - they both look the same. That is why I was asking someone with ASL knowledge if there were nuances between these.
", "votes": null, "replies": [ { "id": 2192162, "author_name": "josephzahar", "author_url": "", "post_date": "03/22/2023 13:22:09", "content": "I created an interactive dashboard that will allow you to visualize each class of the train data, with filtering and animation options. The second page of the dashboard will show you the mean frame of each file. Here is the link to the notebook, you only have to run it to get access.
\nHope that helps!
In one of the previous discussions, an ASL Sign Language Dictionary was suggested. There are video examples of ASL gestures. I hope that would be helpful
", "votes": null, "replies": [ { "id": 2191237, "author_name": "alpinestranger", "author_url": "", "post_date": "03/21/2023 20:27:04", "content": "Thanks @meowmeowmeowmeowmeow - this is a really helpful site that I wasn't aware of - appreciate it.
\nLooking at some of the pairs I do realise why the model is confused - as I am too. Like duck and goose can be different, but a variant of the goose sign looks very much like duck to my untrained eye. How do people who know ASL decipher these - is it context?
As a non-native speaker, there was a time when I was wondering how people can distinguish \"there\" vs \"their\". I guess, there is something similar.
\nBy the way, since you took a closer look at the data, could you please share your insides about handedness? Are there any words, that involve two hands?
I only looked at some words which my models were struggling to distinguish. But there are definitely words which involve both hands - an example is \"animal\" (https://www.handspeak.com/word/82) another word which strangely overlaps (not enough to make it to the list above) with a variation of \"have\" https://www.handspeak.com/word/989/ (the \"to possess or own\" meaning)
", "votes": null, "replies": [] } ] } ] } ] } ], "raw_markdown_by_id": { "2189890": "Looking at the predictions of my models, it seemed they were having a hard time distinguishing between some particular word pairs. \nI would love to hear thoughts from anyone who knows ASL, the hosts or the community on what are the exact differences in how these word are signed? Some are very similar/close in meaning in English - the lack of context (the \"isolated\" part of ISLR) makes things difficult too.\n\nWord pairs my models are struggling with:\n1. wake / awake \n2. lips / mouth\n3. hear / listen\n4. kitty / cat\n5. sleepy / sleep\n6. scissors / cut\n7. give / gift\n8. goose / duck\n9. pencil / pen", "2190201": "I wonder if you can visualize each class of the sample of train data", "2190235": "i suggest you search in youtube to see the ASL of those words", "2190471": "I had tried both visualization and searching in youtube / internet in general. Here is a sample...\nWake: https://www.youtube.com/results?search_query=asl+for+wake\nAwake: https://www.youtube.com/results?search_query=asl+for+awake\n\nTo my untrained eye - they both look the same. That is why I was asking someone with ASL knowledge if there were nuances between these.", "2190734": "In one of the previous discussions, an [ASL Sign Language Dictionary](https://www.handspeak.com/word/) was suggested. There are video examples of ASL gestures. I hope that would be helpful", "2191237": "Thanks @meowmeowmeowmeowmeow - this is a really helpful site that I wasn't aware of - appreciate it.\nLooking at some of the pairs I do realise why the model is confused - as I am too. Like duck and goose can be different, but a variant of the goose sign looks very much like duck to my untrained eye. How do people who know ASL decipher these - is it context?", "2191273": "As a non-native speaker, there was a time when I was wondering how people can distinguish \"there\" vs \"their\". I guess, there is something similar. \nBy the way, since you took a closer look at the data, could you please share your insides about handedness? Are there any words, that involve two hands?", "2191311": "I only looked at some words which my models were struggling to distinguish. But there are definitely words which involve both hands - an example is \"animal\" (https://www.handspeak.com/word/82) another word which strangely overlaps (not enough to make it to the list above) with a variation of \"have\" https://www.handspeak.com/word/989/ (the \"to possess or own\" meaning)", "2192162": "I created an interactive dashboard that will allow you to visualize each class of the train data, with filtering and animation options. The second page of the dashboard will show you the mean frame of each file. Here is the [link](https://www.kaggle.com/code/josephzahar/dynamic-dashboard-landmark-visualization) to the notebook, you only have to run it to get access.\nHope that helps!" }, "source": "meta" }