CN107093428A - A kind of Piano Teaching servicing unit suitable for child with hearing impairment - Google Patents
A kind of Piano Teaching servicing unit suitable for child with hearing impairment Download PDFInfo
- Publication number
- CN107093428A CN107093428A CN201710191966.1A CN201710191966A CN107093428A CN 107093428 A CN107093428 A CN 107093428A CN 201710191966 A CN201710191966 A CN 201710191966A CN 107093428 A CN107093428 A CN 107093428A
- Authority
- CN
- China
- Prior art keywords
- module
- voice
- child
- hearing
- speech synthesis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/3833—Hand-held transceivers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Educational Technology (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Educational Administration (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
本发明涉及教学教具领域,公开了一种适用于听力障碍学生的钢琴教学辅助装置,包括:语音识别模块、A/D转换模块、语音文字转换模块、处理器模块、摄像头模块、存储模块、键盘模块、显示器模块、无线通信模块、D/A转换模块、语音合成模块和扬声器模块;所述语音识别模块通过A/D转换模块与语音文字转换模块连接,语音文字转换模块通过D/A转换模块与语音合成模块连接,语音合成模块与扬声器模块连接,语音文字转换模块、摄像头模块、存储模块、键盘模块、显示器模块和无线通信模块分别与处理器模块连接,这种适用于听力障碍学生的钢琴教学辅助装置,能实现听力障碍学生和钢琴老师的双向沟通,沟通效果好,具有广泛应用的市场前景。
The invention relates to the field of teaching aids, and discloses a piano teaching auxiliary device suitable for hearing-impaired students, comprising: a voice recognition module, an A/D conversion module, a voice-to-text conversion module, a processor module, a camera module, a storage module, and a keyboard Module, display module, wireless communication module, D/A conversion module, speech synthesis module and loudspeaker module; Described speech recognition module is connected with voice-to-text conversion module by A/D conversion module, and voice-to-text conversion module passes D/A conversion module It is connected with the speech synthesis module, the speech synthesis module is connected with the speaker module, the speech-to-text conversion module, the camera module, the storage module, the keyboard module, the display module and the wireless communication module are respectively connected with the processor module, this piano suitable for hearing-impaired students The teaching aid device can realize the two-way communication between the hearing-impaired students and the piano teacher, the communication effect is good, and it has a market prospect of wide application.
Description
技术领域technical field
本发明涉及教学教具领域,特别涉及一种适用于听力障碍学生的钢琴教学辅助装置。The invention relates to the field of teaching aids, in particular to a piano teaching auxiliary device suitable for hearing-impaired students.
背景技术Background technique
公知的,听力障碍是指听觉系统中的传音、感音以及对声音的综合分析的各级神经中枢发生器质性或功能性异常,而导致听力出现不同程度的减退,习惯称为耳聋。只有听力严重减退才称为聋,其表现为患者双耳均不能听到任何言语,而听力损失未达到此严重程度者,则称为听力减退。As we all know, hearing impairment refers to the occurrence of organic or functional abnormalities in the nerve centers at all levels of sound transmission, sensory sound and comprehensive analysis of sound in the auditory system, resulting in varying degrees of hearing loss, which is commonly called deafness. Only severe hearing loss is called deafness, which is characterized by the inability to hear any speech in both ears of the patient, and those whose hearing loss does not reach this severity are called hearing loss.
虽然国家建立了专门为听力障碍学生进行教育的学校,但是在听力障碍学生进行音乐知识学习时,并没有针对性的教具来辅助老师授课,尤其是在对钢琴有爱好的听力障碍学生,钢琴的操作和使用无法正常传授给听力障碍学生,急需一种钢琴教学辅助装置来帮助老师与听力障碍的学生进行钢琴知识的学习交流。Although the country has established schools specially for the education of hearing-impaired students, there are no targeted teaching aids to assist teachers in teaching when hearing-impaired students learn music knowledge, especially for hearing-impaired students who are interested in piano. Operation and use cannot be normally taught to hearing-impaired students, and there is an urgent need for a piano teaching aid to help teachers and hearing-impaired students learn and communicate piano knowledge.
发明内容Contents of the invention
本发明提供一种适用于听力障碍学生的钢琴教学辅助装置,可以解决现有技术中的上述问题。The invention provides a piano teaching auxiliary device suitable for hearing-impaired students, which can solve the above-mentioned problems in the prior art.
本发明提供了一种适用于听力障碍学生的钢琴教学辅助装置,包括:语音识别模块、A/D转换模块、语音文字转换模块、处理器模块、摄像头模块、存储模块、键盘模块、显示器模块、无线通信模块、D/A转换模块、语音合成模块和扬声器模块;所述语音识别模块通过A/D转换模块与语音文字转换模块连接,语音文字转换模块通过D/A转换模块与语音合成模块连接,语音合成模块与扬声器模块连接,语音文字转换模块、摄像头模块、存储模块、键盘模块、显示器模块和无线通信模块分别与处理器模块连接。The invention provides a piano teaching auxiliary device suitable for hearing-impaired students, comprising: a voice recognition module, an A/D conversion module, a voice-to-text conversion module, a processor module, a camera module, a storage module, a keyboard module, a display module, Wireless communication module, D/A conversion module, speech synthesis module and loudspeaker module; Described speech recognition module is connected with speech-to-text conversion module by A/D conversion module, and speech-to-text conversion module is connected with speech synthesis module by D/A conversion module The speech synthesis module is connected with the speaker module, and the speech-to-text conversion module, camera module, storage module, keyboard module, display module and wireless communication module are respectively connected with the processor module.
进一步地,所述语音合成模块包括SYN6658中文语音合成芯片和功率放大模块,SYN6658中文语音合成芯片与功率放大模块连接,SYN6658中文语音合成芯片与D/A转换模块连接,功率放大模块与扬声器模块连接。Further, the speech synthesis module includes a SYN6658 Chinese speech synthesis chip and a power amplification module, the SYN6658 Chinese speech synthesis chip is connected to the power amplification module, the SYN6658 Chinese speech synthesis chip is connected to the D/A conversion module, and the power amplification module is connected to the speaker module .
进一步地,所述语音识别模块采用LD3320语音识别芯片。Further, the speech recognition module adopts LD3320 speech recognition chip.
进一步地,所述存储模块采用32Mbit SPI-Flash存储器。Further, the storage module adopts 32Mbit SPI-Flash memory.
进一步地,所述显示器模块为触摸屏显示模块。Further, the display module is a touch screen display module.
与现有技术相比,本发明的有益效果在于:Compared with prior art, the beneficial effect of the present invention is:
本发明通过语音识别模块、摄像头、语音合成模块、语音文字转换模块、显示器和无线通信模块能实现听力障碍学生和钢琴老师的双向沟通,沟通效果好,具有广泛应用的市场前景。The invention can realize the two-way communication between the hearing-impaired students and the piano teacher through the speech recognition module, camera, speech synthesis module, speech-to-text conversion module, display and wireless communication module, the communication effect is good, and the market prospect of wide application is obtained.
附图说明Description of drawings
图1为本发明提供的一种适用于听力障碍学生的钢琴教学辅助装置的原理框图。Fig. 1 is a functional block diagram of a piano teaching auxiliary device suitable for hearing-impaired students provided by the present invention.
具体实施方式detailed description
下面结合附图,对本发明的一个具体实施方式进行详细描述,但应当理解本发明的保护范围并不受具体实施方式的限制。A specific embodiment of the present invention will be described in detail below in conjunction with the accompanying drawings, but it should be understood that the protection scope of the present invention is not limited by the specific embodiment.
如图1所示,本发明实施例提供的一种适用于听力障碍学生的钢琴教学辅助装置,包括:语音识别模块、A/D转换模块、语音文字转换模块、处理器模块、摄像头模块、存储模块、键盘模块、显示器模块、无线通信模块、D/A转换模块、语音合成模块和扬声器模块;所述语音识别模块通过A/D转换模块与语音文字转换模块连接,语音文字转换模块通过D/A转换模块与语音合成模块连接,语音合成模块与扬声器模块连接,语音文字转换模块、摄像头模块、存储模块、键盘模块、显示器模块和无线通信模块分别与处理器模块连接。As shown in Figure 1, a kind of piano teaching auxiliary device that is applicable to the hearing-impaired student that the embodiment of the present invention provides, comprises: voice recognition module, A/D conversion module, voice-to-text conversion module, processor module, camera module, storage Module, keyboard module, display module, wireless communication module, D/A conversion module, speech synthesis module and loudspeaker module; Described speech recognition module is connected with voice-to-text conversion module by A/D conversion module, and voice-to-text conversion module passes D/ The A conversion module is connected with the speech synthesis module, the speech synthesis module is connected with the loudspeaker module, and the speech-to-text conversion module, the camera module, the storage module, the keyboard module, the display module and the wireless communication module are respectively connected with the processor module.
使用方法:此装置类似智能手机,处理器模块可为手机的CPU,通过麦克风接收老师的讲解声音,通过语音识别模块将老师的讲解声音转换为声音模拟信号,声音模拟信号经过A/D转换模块转换为声音数字信号,声音数字信号经过语音文字转换模块转换为文字数字信号,文字数字信号经处理器模块处理后通过显示器模块在显示屏上显示,听力障碍的学生通过显示屏可以看到老师讲解的内容,同时,通过摄像头获取老师的演示图像,通过摄像头模块转换为图像数字信号,图像数字信号经过处理器模块处理后通过无线通信模块中的无线发射模块发射出去,再通过无线通信模块中的无线接收模块接收后,经过处理模块处理后通过显示器模块和显示器显示出来,听力障碍的学生可以一边观看老师的演示动作,一边阅读老师的讲解内容,实现老师与学生的讲解沟通。How to use: This device is similar to a smart phone. The processor module can be the CPU of the mobile phone. It receives the teacher's explanation sound through the microphone, and converts the teacher's explanation sound into a sound analog signal through the voice recognition module. The sound analog signal passes through the A/D conversion module. It is converted into a sound digital signal, and the sound digital signal is converted into an alphanumeric signal by a voice-to-text conversion module. After being processed by a processor module, the alphanumeric signal is displayed on the display screen through a display module. Students with hearing impairment can see the teacher's explanation through the display screen. At the same time, the teacher's demonstration image is obtained through the camera, and converted into an image digital signal through the camera module. After the image digital signal is processed by the processor module, it is transmitted through the wireless transmission module in the wireless communication module, and then transmitted through the wireless communication module. After being received by the wireless receiving module, it is processed by the processing module and displayed on the display module and the display. The hearing-impaired students can watch the teacher's demonstration action while reading the teacher's explanation content, so as to realize the explanation and communication between the teacher and the students.
学生有问题需要请教老师时,通过键盘输入文字,通过键盘模块将文字转换为文字数字信号,文字数字信号经过处理器模块处理后,通过语音文字转换模块转换为语音数字信号,语音数字信号通过D/A转换模块转换为语音模拟信号,语音模拟信号通过语音合成模块合成后通过播放器模块和播放器进行播放,老师可以听到听力障碍学生的问题,实现学生与老师的问题沟通。When students have questions and need to consult the teacher, they input text through the keyboard, and convert the text into alphanumeric signals through the keyboard module. The /A conversion module converts it into a voice analog signal, and the voice analog signal is synthesized by the speech synthesis module and then played through the player module and the player. The teacher can hear the problems of the hearing-impaired students and realize the communication between the students and the teacher.
根据教学距离的远近,距离远时,老师和学生各持一个辅助装置进行交流,距离近时,学生持一个即可实现与老师交流。According to the distance of the teaching, when the distance is long, the teacher and the students each hold an auxiliary device to communicate, and when the distance is short, the students can communicate with the teacher by holding one.
本发明可以实现老师与听力障碍学生的沟通,使得老师可以用正常语音与听力障碍的学生进行钢琴学习交流。The invention can realize the communication between the teacher and the hearing-impaired students, so that the teacher can use normal voice to communicate with the hearing-impaired students in piano learning.
进一步地,所述语音合成模块包括SYN6658中文语音合成芯片和功率放大模块,SYN6658中文语音合成芯片与功率放大模块连接,SYN6658中文语音合成芯片与D/A转换模块连接,功率放大模块与扬声器模块连接。Further, the speech synthesis module includes a SYN6658 Chinese speech synthesis chip and a power amplification module, the SYN6658 Chinese speech synthesis chip is connected to the power amplification module, the SYN6658 Chinese speech synthesis chip is connected to the D/A conversion module, and the power amplification module is connected to the speaker module .
SYN6658中文语音合成芯片可以实现文本智能分析处理能力和多音字处理和中文姓氏处理能力,具有清晰、自然、准确的中文语音合成效果。The SYN6658 Chinese speech synthesis chip can realize text intelligent analysis and processing capabilities, polyphonic word processing and Chinese surname processing capabilities, and has clear, natural and accurate Chinese speech synthesis effects.
进一步地,所述语音识别模块采用LD3320语音识别芯片。Further, the speech recognition module adopts LD3320 speech recognition chip.
LD3320语音识别芯片的内部集成了快速稳定的优化算法,不需要用户事先训练和录音而完成非特定人语音识别,识别准确率高。The LD3320 voice recognition chip integrates a fast and stable optimization algorithm, which can complete the non-specific voice recognition without the user's prior training and recording, and the recognition accuracy is high.
进一步地,所述存储模块采用64Mbit SPI-Flash存储器。Further, the storage module adopts 64Mbit SPI-Flash memory.
64Mbit SPI-Flash存储器,存储容量大,数据运行速度快。64Mbit SPI-Flash memory, large storage capacity, fast data operation.
进一步地,所述显示器模块为触摸屏显示模块。Further, the display module is a touch screen display module.
触摸屏显示模块方便了文字的输入,使得显示屏可以做大,外形美观。The touch screen display module facilitates the input of characters, makes the display screen larger and has a beautiful appearance.
以上公开的仅为本发明的几个具体实施例,但是,本发明实施例并非局限于此,任何本领域的技术人员能思之的变化都应落入本发明的保护范围。The above disclosures are only a few specific embodiments of the present invention, however, the embodiments of the present invention are not limited thereto, and any changes conceivable by those skilled in the art shall fall within the protection scope of the present invention.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710191966.1A CN107093428A (en) | 2017-03-28 | 2017-03-28 | A kind of Piano Teaching servicing unit suitable for child with hearing impairment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710191966.1A CN107093428A (en) | 2017-03-28 | 2017-03-28 | A kind of Piano Teaching servicing unit suitable for child with hearing impairment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107093428A true CN107093428A (en) | 2017-08-25 |
Family
ID=59648960
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710191966.1A Pending CN107093428A (en) | 2017-03-28 | 2017-03-28 | A kind of Piano Teaching servicing unit suitable for child with hearing impairment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107093428A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109166384A (en) * | 2018-10-25 | 2019-01-08 | 吉林师范大学 | A kind of modern education interactive teaching and learning feedback system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5995590A (en) * | 1998-03-05 | 1999-11-30 | International Business Machines Corporation | Method and apparatus for a communication device for use by a hearing impaired/mute or deaf person or in silent environments |
CN201955956U (en) * | 2011-01-12 | 2011-08-31 | 无锡工艺职业技术学院 | Mutual converter for sentence and voice for deaf mute to be communicated with outside |
CN204288578U (en) * | 2014-12-24 | 2015-04-22 | 哈尔滨学院 | A kind of novel music teaching multimedia playing apparatus |
CN204360609U (en) * | 2015-01-26 | 2015-05-27 | 熊才平 | A kind of strange land synchronization video interactive network tutoring system |
CN106686223A (en) * | 2016-12-19 | 2017-05-17 | 中国科学院计算技术研究所 | Auxiliary dialogue system, method and smart phone for deaf-mute and normal people |
-
2017
- 2017-03-28 CN CN201710191966.1A patent/CN107093428A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5995590A (en) * | 1998-03-05 | 1999-11-30 | International Business Machines Corporation | Method and apparatus for a communication device for use by a hearing impaired/mute or deaf person or in silent environments |
CN201955956U (en) * | 2011-01-12 | 2011-08-31 | 无锡工艺职业技术学院 | Mutual converter for sentence and voice for deaf mute to be communicated with outside |
CN204288578U (en) * | 2014-12-24 | 2015-04-22 | 哈尔滨学院 | A kind of novel music teaching multimedia playing apparatus |
CN204360609U (en) * | 2015-01-26 | 2015-05-27 | 熊才平 | A kind of strange land synchronization video interactive network tutoring system |
CN106686223A (en) * | 2016-12-19 | 2017-05-17 | 中国科学院计算技术研究所 | Auxiliary dialogue system, method and smart phone for deaf-mute and normal people |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109166384A (en) * | 2018-10-25 | 2019-01-08 | 吉林师范大学 | A kind of modern education interactive teaching and learning feedback system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN201993924U (en) | Reading material learning machine | |
CN106373444B (en) | A kind of Multifunctional English classroom with English teaching aid | |
CN101105894A (en) | Multifunctional language learning machine | |
CN108806373A (en) | A kind of college English Teaching oral English teaching classroom interactions instructional terminal | |
CN205810147U (en) | Portable english interactive learning device | |
CN110148320A (en) | A kind of intelligent interaction type tutoring system for English teaching | |
CN202422458U (en) | Self-help learning machine for foreign Chinese teaching | |
JP2002258729A (en) | Foreign language learning system, information processing terminal for the same and server | |
Xu | The Priority of Listening Comprehension over Speaking in the Language Acquisition Process. | |
CN112086094B (en) | Method for correcting pronunciation, terminal equipment and computer readable storage medium | |
CN203562105U (en) | English listening training device | |
CN107093428A (en) | A kind of Piano Teaching servicing unit suitable for child with hearing impairment | |
CN107862918A (en) | A kind of English teaching platform | |
CN105513612A (en) | Audio processing method and device for language vocabulary | |
CN109872602A (en) | A music teaching device | |
CN203801995U (en) | Special table for English teaching with translation displaying function | |
CN105575195A (en) | English text scanning reading multifunctional device | |
CN203849888U (en) | Portable English oral practice teaching aid | |
CN201965928U (en) | MP3 player with word translation function | |
CN207925131U (en) | Read aloud equipment | |
JP2005031604A (en) | English learning system | |
CN108376485A (en) | A kind of multi-functional Practice on Listening & Speaking device of college English Teaching | |
CN201867997U (en) | Pronunciation training device for language study | |
CN202422459U (en) | Phonetic classroom equipment with automatic phonetic comparison function | |
CN203562106U (en) | text english reader |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170825 |
|
RJ01 | Rejection of invention patent application after publication |