TWI853391B - Auto organizational menu assistive communication system and method for autism spectrum disorder - Google Patents

Abstract

The present invention provides an automatic organization menu assisted communication system for autistic people, comprising an electronic device, a database and an automatic organization menu interface. The electronic device includes a display module, a voice module and an operation module. The automatic organization menu interface includes a first vocabulary selection unit, a second vocabulary selection unit, the automatic organization unit is configured to arrange and combine the selected first vocabulary option and the selected second vocabulary option into a complete sentence and present it on the display module, and a voice playback unit, which is configured to convert the complete sentence into a voice message and send it through the voice module. The first vocabulary selection unit and the second vocabulary selection unit are presented in the form of vocabulary information, image information or a combination thereof. The first vocabulary option and the second vocabulary option have a part of speech of subject, verb, object or noun. The first vocabulary option and the second vocabulary option have different parts of speech. The first vocabulary option and the second vocabulary option are obtained from a database. The automatic organization menu auxiliary communication system for autistic people of the present invention can help autistic people who lack sentence organization ability to effectively organize correct sentences to communicate with others and express their needs for help, and is applicable to the learning of sentence organization ability.

Description

Automatically organized menu-assisted communication system and method for people with pan-autism

The present invention relates to an assisted communication system and method thereof, and in particular to an automatic organization menu assisted communication system and method thereof for people with pan-autism.

Autism Spectrum Disorder (ASD) is a brain development disorder caused by abnormalities in the brain. It usually makes it difficult for people with ASD to express their thoughts in a verbal or non-verbal way, which in turn causes social and interaction barriers. In particular, children with ASD often have vocabulary difficulties and lack of verbal organization skills, which results in an inability to communicate effectively. Among them, lack of organization skills, inability to systematically narrate events, difficulty following language usage rules leading to cognitive problems, etc. are one of the main reasons why people with ASD have difficulty communicating with others. In addition, when children with pan-autism encounter difficult events or situations, they do not have the appropriate ability to seek help from others, which further leads to difficulties in communicating effectively with others or seeking help.

Generally, the communication problems of moderate autistic people can be solved by using the existing augmentative and alternative communication system (AAC), for example, by selecting individual words in a graphic presentation mode in sequence, and then forming a complete sentence for expression and communication.

However, the method of forming a complete sentence by sequentially selecting individual words presented in graphics requires the user's understanding, cognition and organizational ability of sentence structure. If autistic people lack sufficient understanding of sentence composition, it will be very difficult to use AAC or communication graphic systems, especially in the selection process. Because it is difficult for autistic people to follow pragmatics and grammatical rules, it is difficult for autistic people to piece together correct and complete sentences in the process of arbitrarily selecting image vocabulary, making it difficult for others to understand the true meaning of the autistic people. For example, when autistic people choose a family photo, the meaning may be "I want to go home", "Take me home", "I want to find my family", etc. Therefore, how to assist autistic people to organize correct sentences is crucial for them to express correct ideas.

In view of this, there is a need for an auxiliary communication system that can correctly organize the vocabulary selected by autistic people, especially the user interface that autistic people directly face. By automatically organizing the images or vocabulary selected by autistic people to form complete and correct grammatical sentences, it can help autistic people express their ideas and needs for help and communication.

One aspect of the present invention provides an automatic organization menu assisted communication system for autistic people, comprising: an electronic device, including: a display module; a voice module; and an operation module, which is configured to receive an input information; a database, electrically connected to the electronic device; and an automatic organization menu interface, which is executed by the electronic device, and the automatic organization menu interface includes: a first vocabulary selection unit, which is configured to provide a selection of at least one of the first vocabulary options; a second vocabulary selection unit, which is configured to provide a selection of at least one of the second vocabulary options; an automatic organization unit, which is configured to combine the selected at least one of the first vocabulary options with the selected An arrangement of at least one second vocabulary option is combined into a complete sentence and presented on the display module; and a voice playback unit is configured to convert the complete sentence into a voice message and send it through the voice module; wherein the first vocabulary selection unit and the second vocabulary selection unit are presented in the form of vocabulary information, image information or a combination thereof, wherein the part of speech of at least one first vocabulary option and at least one second vocabulary option is one of subject, verb, object or noun, respectively, and wherein the part of speech of at least one first vocabulary option and at least one second vocabulary option is different, wherein at least one first vocabulary option and at least one second vocabulary option are obtained from a database.

As described above, the automatic organization menu assisted communication system for patients with pan-autism, wherein the automatic organization menu interface further includes: a third vocabulary selection unit, which is configured to provide a selection of at least one of the third vocabulary options; and a fourth vocabulary selection unit, which is configured to provide a selection of at least one of the fourth vocabulary options; wherein the automatic organization unit is further configured to select one of the at least one first vocabulary option, one of the at least one second vocabulary option, one of the at least one third vocabulary option, and one of the at least one fourth vocabulary option. An arrangement is combined into a complete sentence and presented on a display module, wherein the third vocabulary selection unit and the fourth vocabulary selection unit are presented in the form of vocabulary information, image information or a combination thereof, wherein at least one third vocabulary option and at least one fourth vocabulary option are respectively one of a subject, a verb, an object or a noun, and wherein the parts of speech of at least one first vocabulary option, at least one second vocabulary option, at least one third vocabulary option and at least one fourth vocabulary option are different from each other, wherein at least one third vocabulary option and at least one fourth vocabulary option are obtained from a database.

As described above, the automatic organization menu assisted communication system for autistic people, wherein the automatic organization menu interface further includes: a scoring unit, which is configured to generate a correct vocabulary order based on the complete sentences arranged and combined by the automatic organization unit, and generate a selected vocabulary order based on at least one of the selected first vocabulary options, one of the selected second vocabulary options, one of the selected third vocabulary options, and one of the selected fourth vocabulary options, and generate a scoring result by comparing the correct vocabulary order with the selected vocabulary order.

As described above, the automatic organization menu-assisted communication system for pan-autistic people, wherein the scoring unit is further configured to generate a scoring result based on a predetermined time.

As described above, the automatic organization menu-assisted communication system for patients with pan-autism, wherein the scoring results and the order of the selected words are stored in the database.

As described above, the automatic organization menu assisted communication system for pan-autistic patients, wherein the electronic device also includes a communication module configured to transmit complete sentence communications to the outside world.

Another aspect of the present invention provides an automatic menu-assisted communication method for autistic people. Using the automatic menu-assisted communication system for autistic people as described above, the automatic menu-assisted communication method for autistic people includes the following steps: providing a selection of at least one of the first vocabulary options; providing a selection of at least one of the second vocabulary options; arranging and combining the selected at least one of the first vocabulary options and the selected at least one of the second vocabulary options into a complete sentence, and presenting the sentence. On the display module; convert the complete sentence into a voice message and send it through the voice module; wherein the steps of providing a selection of at least one first vocabulary option and providing a selection of at least one second vocabulary option are presented in the form of vocabulary information, image information or a combination thereof, wherein the part of speech of at least one first vocabulary option and at least one second vocabulary option is one of subject, verb, object or noun, respectively, and wherein the part of speech of at least one first vocabulary option and at least one second vocabulary option is different.

The automatic organization menu assisted communication method for autistic people as described above also includes the following steps: providing a selection of at least one of the third vocabulary options; providing a selection of at least one of the fourth vocabulary options; arranging and combining at least one of the selected first vocabulary options, one of the selected second vocabulary options, one of the selected third vocabulary options, and one of the selected fourth vocabulary options into a complete sentence, and presenting it on a display module; converting the complete sentence into a voice message, and sending it through a voice module; wherein providing a selection of at least one of the first vocabulary options One, providing a step of selecting one of at least one second vocabulary option, providing a step of selecting one of at least one third vocabulary option, and providing a step of selecting one of at least one fourth vocabulary option, presented in the form of vocabulary information, image information, or a combination thereof, wherein the parts of speech of at least one first vocabulary option, at least one second vocabulary option, at least one third vocabulary option, and at least one fourth vocabulary option are respectively one of subject, verb, object, or noun, and wherein the parts of speech of at least one first vocabulary option, at least one second vocabulary option, at least one third vocabulary option, and at least one fourth vocabulary option are different from each other.

The automatic organization menu-assisted communication method for autistic people as described above also includes the following steps: generating a correct vocabulary order based on a complete sentence; generating a selected vocabulary order based on at least one of the selected first vocabulary options, one of the selected second vocabulary options, one of the selected third vocabulary options, and one of the selected fourth vocabulary options; comparing the correct vocabulary order with the selected vocabulary order to generate a scoring result; storing the scoring result and the selected vocabulary order in a database.

As mentioned above, the automatic organization menu-assisted communication method for patients with pan-autism also includes the following steps: transmitting complete sentence communications to the outside world.

With the automatic organization menu assisted communication system for people with pan-autism of the present invention, through the first vocabulary selection unit, the second vocabulary selection unit or more vocabulary selection units provided by the automatic organization menu interface, the user can arbitrarily and without following any order, freely and quickly select the vocabulary information or its image information of the desired expression, and through the automatic organization unit, the vocabulary options selected by the user in any order are arranged and combined into a complete sentence that conforms to grammar. The complete sentence rearranged and assembled according to the words selected by the user provides visual feedback to the user through the display module, and provides auditory feedback to the user through the voice module. In addition to being able to correctly and effectively express the complete sentence that the user wants to express according to the selected words or images to others, achieving the purpose of communication, interaction or help, the visual and auditory feedback can also further provide the user with the correct sentence structure and correct pronunciation, achieving the effect of learning sentence organization, improving the cognition of language usage rules, improving communication consistency, and helping users understand and complete tasks.

10: Automatically organize menus to assist communication system

100: Electronic devices

110: Display module

120: Voice module

130: Operation module

200: Database

300: Automatically organize menu interface

310: First vocabulary selection unit

311:First vocabulary option

320: Second vocabulary selection unit

322: Second vocabulary option

330: Third vocabulary selection unit

333: Third vocabulary option

340: Fourth vocabulary selection unit

344:Fourth vocabulary option

350: Automatic organization unit

355: Complete sentence

360: Voice playback unit

400: Automatically organize menu interface

S510~S580: Steps

FIG. 1 is a schematic block diagram of an automatic menu-assisted communication system according to an embodiment of the present invention; FIG. 2 is a schematic diagram of an automatic menu-assisted communication system according to an embodiment of the present invention; FIG. 3 is a schematic diagram of an automatic menu-assisted communication system according to an embodiment of the present invention; Fig. 4 shows a schematic diagram of an automatic menu organization interface of an automatic menu organization assisted communication system in an embodiment of the present invention; Fig. 5 shows a step flow chart of an automatic menu organization assisted communication method in an embodiment of the present invention; Fig. 6 shows a step flow chart of an automatic menu organization assisted communication method in an embodiment of the present invention.

In order to explain the technical content and structural features of the present invention in detail, the following is a further explanation in combination with the implementation method and the accompanying drawings.

The present invention proposes an automatic organization menu assisted communication system for people with pan-autism. By providing multiple vocabulary selection units, the vocabulary selection units are built through a database and classified into specific parts of speech required to form a complete sentence, so that users can arbitrarily select image vocabulary according to the content and ideas they want to express, and still form correct and complete sentences. The system also provides users with visual and auditory feedback to enhance learning, cognition, communication, and help-seeking effects.

FIG1 is a schematic block diagram of an automatic organization menu assisted communication system 10 in an embodiment of the present invention. The automatic organization menu assisted communication system 10 includes an electronic device 100, a database 200, and an automatic organization menu interface (not shown in FIG1 ). The electronic device 100 includes a display module 110, a voice module 120, and an operation module 130. The electronic device 100 is an electronic device for user operation and interaction, which can be a computer, a mobile phone, a tablet, a wearable electronic device, etc. The display module 110 provides visual information to the user of the electronic device 100, which can be a screen, a television, a projector, a holographic projection, a wearable electronic device, etc. The voice module 120 provides the user of the electronic device 100 with voice information, which can be a speaker, stereo, receiver, microphone, earphone, etc. The operation module 130 receives the input information of the user into the electronic device 100 to operate the electronic device 100, which can be a touch screen, mouse, keyboard, body sensing detection, eye detection, voice detection, etc. The database 200 is electrically connected to the electronic device 100. The database 200 can be connected to the electronic device 100 by wire or wireless, and can also be stored in the storage media such as the multimedia storage device, hard disk, memory, memory card, etc. of the electronic device 100.

FIG2 is a schematic diagram of an automatic organization menu interface 300 of the automatic organization menu assisted communication system 10 in an embodiment of the present invention. The automatic organization menu interface 300 is executed by the electronic device 100. The automatic organization menu interface 300 includes a first vocabulary selection unit 310, which is configured to provide at least one first vocabulary option 311 in the first vocabulary selection unit 310, so that the user can select one of the at least one first vocabulary option 311. The automatic organization menu interface 300 also includes a second vocabulary selection unit 320, which is configured to provide at least one second vocabulary option 322 in the second vocabulary selection unit 320, so that the user can select one of the at least one second vocabulary option 322. It should be noted that the order of selecting at least one first vocabulary option 311 and selecting at least one second vocabulary option 322 is not limited to the first and second, and the selection order can be arbitrary. The automatic organization menu interface 300 further includes an automatic organization unit 350, which is configured to arrange and combine one of the selected at least one first vocabulary option 311 and one of the selected at least one second vocabulary option 322 into a complete sentence 355 according to their parts of speech and grammatical rules of the sentence, and present it on the display module 110 to provide visual feedback to the user, so that the user can read the rearranged and grammatically correct complete sentence 355. The automatic organization menu interface 300 further includes a voice playback unit 360, which is configured to convert the complete sentence 355 into a voice message through, for example, a text-to-speech assistant, Text to Speech, etc., and send it through the voice module 120 to provide the user with auditory feedback, so that the user can hear the correct pronunciation of the grammatically correct complete sentence 355. Among them, the first vocabulary selection unit 310 and the second vocabulary selection unit 320 are presented in the form of vocabulary information, image information or a combination thereof, so that the vocabulary in the automatic organization menu interface 300 can be presented to the user in the form of text, image or text combined with image, so that the user can more easily and correctly understand the meaning represented by the text and image. The first vocabulary option 311 and the second vocabulary option 322 have a part of speech of subject, verb, object or noun, respectively, and the first vocabulary option 311 and the second vocabulary option 322 have different parts of speech, so that the user can choose from different parts of speech classifications in the process of free and random selection, so that the user can learn to distinguish the parts of speech of different vocabulary and understand the structure of correct sentences, and at the same time can achieve the vocabulary required to construct a correct complete sentence 355. It should be noted that the parts of speech of the first vocabulary option 311 and the second vocabulary option 322 described are respectively one of subject, verb, object or noun, and the vocabulary options are not limited to words with that part of speech. For example, when its part of speech is subject, it can include questions, imperatives or other forms. For example, when its part of speech is object, it can be any form of object or accusative case. Among them, the first vocabulary option 311 and the second vocabulary option 322 are obtained from the database 200. By aggregating and classifying the vocabulary information and image information of different situations, conditions, and requirements that are pre-collected and built in the database 200, the first vocabulary option 311 and the second vocabulary option 322 can provide corresponding vocabulary options according to different needs or situations. It should be noted that the automatic organization menu interface 300 in the figure is only an example, and the different spatial configurations and quantity configurations of its various elements are all within the scope of the concept of the present invention.

FIG3 shows a schematic diagram of an automatic organization menu interface 400 of the automatic organization menu assisted communication system 10 in an embodiment of the present invention. The configuration of the automatic organization menu interface 400 is substantially the same as that of the automatic organization menu interface 300, except that the automatic organization menu interface 400 further includes a third vocabulary selection unit 330 and a fourth vocabulary selection unit 340. The third vocabulary selection unit 330 is configured to provide a selection of at least one of the third vocabulary options 333, and the fourth vocabulary selection unit 340 is configured to provide a selection of at least one of the fourth vocabulary options 344. Among them, the first vocabulary option 311 to the fourth vocabulary option 344 have different parts of speech, so the first vocabulary option 311 to the fourth vocabulary option 344 can be a subject, a verb, an object, and a noun, respectively.

FIG4 shows a schematic diagram of an automatic organization menu interface 400 of the automatic organization menu assisted communication system 10 in an embodiment of the present invention. Compared with the embodiment of FIG3 , the first vocabulary option 311 to the fourth vocabulary option 344 of the embodiment shown in FIG4 are based on vocabulary information and image information that may be used by actual users (e.g., children with pan-autism in school) in communication and help-seeking scenarios. When a user of a child with pan-autism uses the automatic organization menu assisted communication system 10 of an embodiment of the present invention, he can freely select the words or images that he wants to express in the first word selection unit 310 to the fourth word selection unit 340 in the automatic organization menu interface 400, without being restricted to any predetermined order or order that conforms to the correct grammatical structure. In one embodiment, the part of speech of the first word option 311 is subject, the part of speech of the second word option 322 is verb, the part of speech of the third word option 333 is object, and the part of speech of the fourth word option 344 is noun. It should be noted that the parts of speech of the first vocabulary option 311 and the second vocabulary option 322 described are respectively one of subject, verb, object or noun, and the vocabulary options are not limited to words with only that part of speech. For example, when the part of speech of the first vocabulary option 311 is subject, it can include questions, imperative sentences or other aspects. For example, when the subject is "I", it can also be "please take me", "please help me", "please follow me", "please ask you..." and other aspects. After the user selects words from the first word option 311 to the fourth word option 344 in any order, for example, selecting "nearest" in the third word selection unit 330, and then selecting "toilet" in the fourth word selection unit 340, "go" in the second word selection unit 320, and "please take me" in the first word selection unit 310, the automatic organization unit 350 can rearrange the words selected by the user into a complete sentence 355, namely "please take me to the nearest toilet", and present it on the automatic organization menu interface 400. In addition, the complete sentence 355 "Please take me to the nearest toilet" can be played as a voice message through the voice module 120 by the voice playback unit 360, so that the user can obtain feedback in voice and text respectively, so as to learn the correct sentence organization structure. At the same time, through the playback of the voice message, the caregivers or other people of the pan-autistic child can hear the relevant information that the pan-autistic child wants to express and the help that may be needed, thereby achieving the effect of expressing ideas, communicating, seeking help, and talking with others.

In one embodiment, the automatic organization menu interface 300 and the automatic organization menu interface 400 further include a scoring unit configured to generate a correct vocabulary order based on the complete sentences 355 arranged by the automatic organization unit 350, and to generate a selected vocabulary order based on the selected first vocabulary option 311, the selected second vocabulary option 322, the selected third vocabulary option 333, and the selected fourth vocabulary option 344, and to generate a scoring result by comparing the correct vocabulary order with the selected vocabulary order. For example, in the embodiment of FIG. 4 , when the user selects vocabulary options in the order of “nearest,” “toilet,” “go,” and “please take me,” the selected vocabulary order can be defined as “3421,” and the complete sentence 355 arranged and combined based on the automatic organization unit 350 is “please take me to the nearest toilet,” and the correct vocabulary order can be defined as “1234.” At this time, the selected vocabulary order and the correct vocabulary order are compared to produce a scoring result of “no score.” For example, when the user selects vocabulary options in the order of "please take me", "go", "nearest", and "toilet", the selected vocabulary order can be defined as "1234", and a scoring result of "score" can be generated. The scoring unit can be displayed or not displayed on the display module 110.

In one embodiment, the scoring unit is further configured to generate a scoring result based on a predetermined time, and to score the user's selection performance by setting a time limit. For example, the predetermined time is set to 20 seconds. When the user does not take action in selecting a vocabulary option for more than 20 seconds, a scoring result of "no score" is generated.

In one embodiment, the scoring results and the order of selected words are stored in the database 200. By storing the user's scoring results and the order of selected words selected by the user in the database 200, the user's primary caregiver, family, teacher, medical practitioners, etc. can obtain the user's learning status, language organization ability status, and the content information and statistical information of the user's desired expression, communication, and help.

In one embodiment, the electronic device 100 further includes a communication module, which is configured to communicate the complete sentence 355 to the outside world, such as to the electronic device of the user's primary caregiver, family, teacher, and medical practitioner, so that the user's primary caregiver, family, teacher, and medical practitioner can immediately know the user's message and request for help, and respond immediately. The communication module can be a wired network, Ethernet, wireless network, Bluetooth transmission, wireless radio frequency identification, etc. In one embodiment, the communication module is also configured to communicate the scoring results to the outside world.

FIG5 shows a flowchart of the steps of the automatic menu-assisted communication method in an embodiment of the present invention. The present invention provides an automatic menu-assisted communication method, using the automatic menu-assisted communication system 10 as described above, and the automatic menu-assisted communication method includes the following steps: (S510) providing a user with a selection of one of the first vocabulary options 311; (S520) providing a user with a selection of one of the second vocabulary options 322; (S530) providing a user with a selection of one of the third vocabulary options 333; (S540) providing a user with a selection of one of the third vocabulary options 334; (S551) providing a user with a selection of one of the third vocabulary options 335; (S552) providing a user with a selection of one of the third vocabulary options 336; (S553) providing a user with a selection of one of the third vocabulary options 337; (S554) providing a user with a selection of one of the third vocabulary options 338; (S555) providing a user with a selection of one of the third vocabulary options 339; (S556) providing a user with a selection of one of the third vocabulary options 331; (S557) providing a user with a selection of one of the third vocabulary options 332; (S558) providing a user with a selection of one of the third vocabulary options 333; (S559) providing a user with a selection of one of the first vocabulary options 311; (S560) providing a user with a selection of one of the first vocabulary options 311; (S561) providing a user with a selection of one of the first vocabulary options 311; (S562) providing a user with a selection of one of the second vocabulary options 322; (S563) providing a user with a selection of one of the third vocabulary options 333; (S564) providing a user with a selection of one of the third vocabulary options 334; (S565) providing a user with a selection of one of (S550) arranging and combining the selected first vocabulary options 311, the selected second vocabulary options 322, the selected third vocabulary options 333, and the selected fourth vocabulary options 344 into a complete sentence, and presenting it on the display module 110; and (S560) converting the complete sentence 355 into a voice message, and sending it through the voice module 120. Among them, the steps of providing one of the first vocabulary options 311, providing one of the second vocabulary options 322, providing one of the third vocabulary options 333, and providing one of the fourth vocabulary options 344 are presented in the form of vocabulary information, image information, or a combination thereof. Among them, the parts of speech of the first vocabulary option 311, the second vocabulary option 322, the third vocabulary option 333 and the fourth vocabulary option 344 are respectively one of subject, verb, object or noun, and the parts of speech of the first vocabulary option 311, the second vocabulary option 322, the third vocabulary option 333 and the fourth vocabulary option 344 are different from each other. When the user selects the first vocabulary option 311, the second vocabulary option 322, the third vocabulary option 333, and the fourth vocabulary option 344 in any order, the first vocabulary option 311 to the fourth vocabulary option 344 can be arranged and combined into a complete sentence 355 with correct grammar and structure, and presented visually and auditorily, respectively, to achieve the effect of learning sentence organization structure, communication, and requesting assistance. It should be noted that the step flow chart does not limit the order of the steps. The disclosed steps can be operated in different orders. For example, the user can first select one of the fourth vocabulary options 344 and then select one of the second vocabulary options 322. The order of selecting the first vocabulary option 311 to the fourth vocabulary option 344 can be arbitrary.

FIG. 6 is a flowchart showing the steps of the method for automatically organizing menu-assisted communication in an embodiment of the present invention. In one embodiment, the automatic organization menu assisted communication method further includes the following steps: (S570) generating a correct vocabulary order based on the complete sentence 355; (S571) generating a selected vocabulary order based on one of the selected first vocabulary options 311, one of the selected second vocabulary options 322, one of the selected third vocabulary options 333, and one of the selected fourth vocabulary options 344; (S572) comparing the correct vocabulary order with the selected vocabulary order to generate a scoring result; (S573) storing the scoring result and the selected vocabulary order in the database 200; and (S580) communicating the complete sentence 355 to the outside world. In this way, the order of the user's selected vocabulary options can be compared with the correct sentence order to obtain a scoring result indicating the correctness of the user's selected vocabulary organization sentence, and the scoring result and the user's selected vocabulary status can be stored in the database 200 for the user's related caregivers, family members, teachers, and medical practitioners to understand and analyze the user's learning status, sentence organization ability, etc. In addition, by transmitting the complete sentence 355 composed of the user's selected vocabulary to the outside world, the user's related caregivers, family members, teachers, and medical practitioners can instantly obtain the user's desired message, communication content, or request for help.

The automatic organization menu assisted communication system 10 and the automatic organization menu assisted communication method of the present invention can help users who lack the ability to understand and organize sentences, especially children with pan-autism, to reorganize the fragmented words selected by the user into a complete and correct sentence by providing an automatic organization menu interface 300, 400 with graphical vocabulary options that are not restricted by the selection order, thereby helping the user to convey the content that he or she wants to express in order to communicate, and helping the user to express the need for help. In addition, by presenting organized correct sentences through visual text and auditory voice, users can also be given feedback through visual text stimulation and auditory voice stimulation to assist users in learning and understanding the organization of sentences, thereby enhancing users' communication consistency and language systematic organization ability, and helping users learn new vocabulary and background knowledge and build learning confidence. Furthermore, the scoring results obtained by comparing the user's selected vocabulary through the scoring unit can also assist the user's caregivers, family members, teachers, and medical personnel to collect, count, and understand the user's language organization ability and learning status. By conveying complete sentences to the outside world, the user's caregivers, family members, teachers, and medical personnel can immediately know the content and help needs of the user, especially children with pan-autism, so as to improve communication and respond to any unexpected situations in real time.

The present invention has been disclosed in the above text with preferred embodiments, but those familiar with the art should understand that the embodiments are only used to describe the present invention and should not be interpreted as limiting the scope of the present invention. It should be noted that all changes and substitutions equivalent to the embodiments should be included in the scope of the present invention, and the scope of the attached claims should be interpreted in the broadest sense to include all modifications, similar arrangements and processes, etc.

300: Automatically organize menu interface

310: First vocabulary selection unit

311:First vocabulary option

320: Second vocabulary selection unit

322: Second vocabulary option

350: Automatic organization unit

355: Complete sentence

360: Voice playback unit

Claims (10)

An automatic organization menu assisted communication system for autistic people, comprising: an electronic device, including: a display module; a voice module; and an operation module, which is configured to receive an input information; a database, electrically connected to the electronic device; and an automatic organization menu interface, executed by the electronic device, the automatic organization menu interface comprising: a first vocabulary selection unit, which A second vocabulary selection unit configured to provide a selection of at least one of the first vocabulary options; a second vocabulary selection unit configured to provide a selection of at least one of the second vocabulary options; an automatic organization unit configured to arrange and combine the selected one of the at least one first vocabulary options and the selected one of the at least one second vocabulary options into a complete sentence, and present the complete sentence on the display module wherein the selection order of the at least one first vocabulary option and the at least one second vocabulary option can be any order; and a voice playback unit configured to convert the complete sentence into a voice message and send it through the voice module; wherein the first vocabulary selection unit and the second vocabulary selection unit are presented in the form of a combination of vocabulary information and image information, wherein the part of speech of the at least one first vocabulary option and the at least one second vocabulary option is one of subject, verb, object or noun, respectively, and wherein the part of speech of the at least one first vocabulary option and the at least one second vocabulary option are different, wherein the at least one first vocabulary option and the at least one second vocabulary option are obtained from the database. An automatically organized menu-assisted communication system for autistic people as described in claim 1, wherein the automatically organized menu interface further includes: a third vocabulary selection unit configured to provide a selection of at least one of the third vocabulary options; and a fourth vocabulary selection unit configured to provide a selection of at least one of the fourth vocabulary options; wherein the automatically organized unit is further configured to arrange and combine the selected one of the at least one first vocabulary options, the selected one of the at least one second vocabulary options, the selected one of the at least one third vocabulary options, and the selected one of the at least one fourth vocabulary options into the complete sentence, and present the complete sentence on the display module, wherein the selected one of the at least one first vocabulary options , one of the selected at least one second vocabulary options, one of the selected at least one third vocabulary options, and one of the selected at least one fourth vocabulary options can be selected in any order, wherein the third vocabulary selection unit and the fourth vocabulary selection unit are presented in a combination of vocabulary information and image information, wherein the at least one third vocabulary option and the at least one fourth vocabulary option are respectively one of a subject, a verb, an object, or a noun, and wherein the at least one first vocabulary option, the at least one second vocabulary option, the at least one third vocabulary option, and the at least one fourth vocabulary option have different parts of speech, wherein the at least one third vocabulary option and the at least one fourth vocabulary option are obtained from the database. The automatic organization menu assisted communication system for autistic people as described in claim 2, wherein the automatic organization menu interface further includes: a scoring unit, which is configured to generate a correct vocabulary order based on the complete sentence arranged and combined by the automatic organization unit, and generate a selected vocabulary order based on one of the at least one first vocabulary options selected, one of the at least one second vocabulary options selected, one of the at least one third vocabulary options selected, and one of the at least one fourth vocabulary options selected, and generate a scoring result by comparing the correct vocabulary order with the selected vocabulary order. An automatically organized menu-assisted communication system for autistic people as described in claim 3, wherein the scoring unit is further configured to generate the scoring result based on a predetermined time. An automatically organized menu-assisted communication system for people with pan-autism as described in claim 3, wherein the scoring result and the selected vocabulary sequence are stored in the database. The automatic organization menu assisted communication system for autistic people as described in claim 1, wherein the electronic device also includes a communication module configured to transmit the complete sentence communication to the outside world. A method for automatically organizing menu-assisted communication for autistic people, using the automatic organizing menu-assisted communication system for autistic people as described in claim 1, the method for automatically organizing menu-assisted communication for autistic people comprising the following steps: providing a selection of one of the at least one first vocabulary options; providing a selection of one of the at least one second vocabulary options; arranging and combining the selected one of the at least one first vocabulary options and the selected one of the at least one second vocabulary options into the complete sentence, and presenting the complete sentence on the display module, wherein the selected one of the at least one first vocabulary options The selection order of one of the at least one second vocabulary options selected can be any order; the complete sentence is converted into the voice message and sent through the voice module; wherein the steps of providing the selection of one of the at least one first vocabulary options and providing the selection of one of the at least one second vocabulary options are presented in the form of a combination of vocabulary information and image information, wherein the parts of speech of the at least one first vocabulary option and the at least one second vocabulary option are respectively one of subject, verb, object or noun, and wherein the parts of speech of the at least one first vocabulary option and the at least one second vocabulary option are different. The automatic menu-assisted communication method for autistic patients as described in claim 7 further comprises the following steps: providing a selection of one of the at least one third vocabulary options; providing a selection of one of the at least one fourth vocabulary options; selecting one of the at least one first vocabulary options, one of the at least one second vocabulary options, one of the at least one third vocabulary options, and selecting The at least one fourth vocabulary option selected is arranged and combined into the complete sentence, and the complete sentence is presented on the display module, wherein the selection order of the at least one first vocabulary option selected, the at least one second vocabulary option selected, the at least one third vocabulary option selected, and the at least one fourth vocabulary option selected is The order can be any; convert the complete sentence into the voice message and send it through the voice module; Wherein, providing the steps of selecting one of the at least one first vocabulary options, providing the steps of selecting one of the at least one second vocabulary options, providing the steps of selecting one of the at least one third vocabulary options and providing the steps of selecting one of the at least one fourth vocabulary options, in order to combine vocabulary information with image information. The at least one first vocabulary option, the at least one second vocabulary option, the at least one third vocabulary option, and the at least one fourth vocabulary option are presented in a form, wherein the parts of speech of the at least one first vocabulary option, the at least one second vocabulary option, the at least one third vocabulary option, and the at least one fourth vocabulary option are respectively one of subject, verb, object, or noun, and wherein the parts of speech of the at least one first vocabulary option, the at least one second vocabulary option, the at least one third vocabulary option, and the at least one fourth vocabulary option are different from each other. The automatic organization menu-assisted communication method for autistic people as described in claim 7 further comprises the following steps: generating the correct vocabulary order based on the complete sentence; generating the selected vocabulary order based on one of the at least one first vocabulary options selected, one of the at least one second vocabulary options selected, one of the at least one third vocabulary options selected, and one of the at least one fourth vocabulary options selected; comparing the correct vocabulary order with the selected vocabulary order to generate the scoring result; storing the scoring result and the selected vocabulary order in the database. The automatic organization menu-assisted communication method for patients with pan-autism as described in claim 7 also includes the following step: transmitting the complete sentence communication to the outside world.