[go: up one dir, main page]

WO2014005409A1 - Audio-visual integration handicapped helping device - Google Patents

Audio-visual integration handicapped helping device Download PDF

Info

Publication number
WO2014005409A1
WO2014005409A1 PCT/CN2012/087030 CN2012087030W WO2014005409A1 WO 2014005409 A1 WO2014005409 A1 WO 2014005409A1 CN 2012087030 W CN2012087030 W CN 2012087030W WO 2014005409 A1 WO2014005409 A1 WO 2014005409A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
module
microprocessor
processing control
control module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2012/087030
Other languages
French (fr)
Chinese (zh)
Inventor
陈明霞
王茂森
符涛涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NANTONG ZHAOYANG INTELLIGENT TECHNOLOGY Co Ltd
Original Assignee
NANTONG ZHAOYANG INTELLIGENT TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NANTONG ZHAOYANG INTELLIGENT TECHNOLOGY Co Ltd filed Critical NANTONG ZHAOYANG INTELLIGENT TECHNOLOGY Co Ltd
Publication of WO2014005409A1 publication Critical patent/WO2014005409A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/86Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/93Sonar systems specially adapted for specific applications for anti-collision purposes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2201/00Characteristics of apparatus not provided for in the preceding codes
    • A61H2201/50Control means thereof
    • A61H2201/5058Sensors or detectors
    • A61H2201/5092Optical sensor

Definitions

  • the present invention relates to the field of electronic information technology, and in particular, to an audio-visual integrated disability device. Background technique
  • a blind Klein guide is currently available on the market for blind people, and the guide is based on the difference frequency principle.
  • the characteristic information of the surrounding objects that the difference frequency signal can reflect is still very limited.
  • a biological sonar detecting device and a detecting method thereof are disclosed in the Chinese Patent Publication No. CN201010574072.9, and the patent consists of three simple sonar transceiver processing modules A, B and C, wherein A The B module transmits the bionic sonar signal and collects the echo signal, and does not introduce the image acquisition module. At the same time, the C module does not introduce the speech synthesis technology, so that it cannot be used for the majority of blind people.
  • An audio-visual integrated disability device which comprises an audio-visual integrated dual sensor module, a processing control module and an audio output module, and the audio-visual integration
  • An output end of the dual sensor module is connected to an input end of the processing control module, and an output end of the processing control module is connected to an input end of the audio output module
  • the audiovisual integrated dual sensor module includes a bionic sonar transceiver Module and image acquisition module
  • the image acquisition module includes an image sensor, a conditioning circuit, and an analog-to-digital conversion unit, and an output end of the image sensor is connected to an input end of the conditioning circuit, and an output end of the conditioning circuit and an input of the analog-to-digital conversion unit Connected to the end, the output end of the analog-to-digital conversion unit is connected to the input end of the processing control module;
  • the audio output module includes an audio driving and conditioning circuit, a left channel player, and a right channel player, and outputs of the audio driving and conditioning circuit are respectively associated with an input end of the left channel player and the right The inputs of the channel player are connected.
  • the processing control module is composed of a single microprocessor or a connected dual microprocessor, a plurality of microprocessors, and the microprocessor can be from a DSP, an ARM, an FPGA, a single board, a single chip microcomputer, an intel or an AMD, etc. Select from the processor.
  • the microprocessor based on the dual microprocessor and multi-microprocessor processing control module may be of the same type or may be shaped.
  • two DSP modules can form a homo-type dual-microprocessor processing control module
  • an FPGA module and a DSP module can form a hetero-type dual-microprocessor processing control module
  • two FPGA modules and one DSP module can constitute a hetero-type multi-microprocessor.
  • Process control module may be of the same type or may be shaped.
  • two DSP modules can form a homo-type dual-microprocessor processing control module
  • an FPGA module and a DSP module can form a hetero-type dual-microprocessor processing control module
  • two FPGA modules and one DSP module can constitute a hetero-type multi-microprocessor.
  • Process control module may be of the same type or may be shaped.
  • two DSP modules can form a homo-type dual-microprocessor processing control module
  • an FPGA module and a DSP module can form a hetero-type dual-micro
  • the audio-visual integrated dual-sensor module not only includes the emission and acquisition of the bionic sonar signal, but also introduces the image acquisition module, which can be more accurate.
  • the front detection target is detected, identified and located.
  • the processing control module introduces image recognition processing technology, which enables high-speed processing and control.
  • the audio output module not only includes the original signal projection technology but also introduces speech synthesis technology.
  • the patent utilizes the existing technology, and combines user requirements and engineering practice to design a set of audio-visual integration disabled with complete functions, high integration, compact structure, easy to carry, good real-time, easy to maintain and easy to use. Device. 5. This patent is easy to upgrade, maintain, re-develop and extend functionality.
  • FIG. 1 is a schematic structural view of the present invention.
  • FIG. 2 is a schematic view of a specific embodiment.
  • an audio-visual integrated disability device of a special-type dual-microprocessor processing control module composed of an FPGA module and a DSP module is taken as an example.
  • Integrated disability device which includes an audio-visual integrated dual sensor module D, processing control The output module of the audio-visual integrated dual-sensor module D and the input end of the processing control module E are connected to each other, and the output end of the processing control module E and the audio output module F The inputs are connected.
  • the audio-visual integrated dual-sensor module D includes a bionic sonar transceiver module and an image acquisition module.
  • the bionic sonar transceiver module is used to transmit sonar signals to indoor and outdoor detection targets, and to collect echo information in real time.
  • the wave source is designed by direct digital frequency synthesis (DDS), by reading The value in the waveform memory is taken to generate a digital signal of a certain frequency, which is then converted into an analog signal by the DAC.
  • the DAC uses TI's chip TLV5638 with a bit width of 12bits.
  • the ultrasonic transducer captures the analog signal
  • the conditioning circuit adjusts the captured analog signal voltage to the convertible voltage range of the analog-to-digital converter, and implements two-channel analog-to-digital conversion using TI's chip THS1206.
  • the image acquisition module is configured to collect image information of indoor and outdoor detection targets, including an image sensor, a conditioning circuit, and an analog-to-digital conversion unit.
  • the image sensor output is an analog quantity, and the analog voltage collected by the image sensor is adjusted to the mode by the conditioning circuit.
  • the digital converter can be converted to a voltage range, and the analog-to-digital converter uses TI's chip TVP5150.
  • the special-shaped dual-microprocessor processing control module E includes an FPGA module and a DSP module, the FPGA module is responsible for audio transmission and reception, and the DSP module is responsible for algorithm processing and image acquisition.
  • the FPGA uses Alter's chip EP2C8Q208, which has 127 ports for 10 ports and 36 M4k memory spaces for internal use.
  • the FPGA module is connected to the bionic sonar transceiver module, and its function is to detect the presence or absence of a target in front, and to perform simple processing on the acquired front target information.
  • the DSP module uses TI's chip TMS320DM642. The main function of this module is algorithm processing, including processing of ultrasonic echo signals and image processing of image data.
  • processing control module E adopts the structure including the FPGA module and the DSP module
  • one of the following two specific implementation schemes may be selected:
  • the specific implementation scheme 1 includes a bionic sonar transceiver module transmitting a sonar signal to the front and collecting an echo, and the collected echo analog signal is transmitted to the FPGA module through the conditioning circuit and the analog-to-digital conversion unit; the image acquisition module collects image information.
  • the collected analog signal is transmitted to the FPGA module through the conditioning circuit and the analog-to-digital conversion unit; the FPGA module realizes high-speed data transmission through the EDMA and the DSP module.
  • Embodiment 2 includes a bionic sonar transceiver module transmitting a sonar signal to the front, collecting an echo, and the collected echo analog signal is transmitted to the FPGA module through the conditioning circuit and the analog-to-digital conversion unit; The image acquisition information is collected by the acquisition module, and the collected analog signal is transmitted to the DSP module through the conditioning circuit and the analog-to-digital conversion unit; the FPGA module realizes high-speed data transmission through the EDMA and the DSP module.
  • the audio output module F includes an audio driving and conditioning circuit, a left channel player and a right channel player, and the output of the audio driving and conditioning circuit processes the information processed by the processing control module respectively The left channel player and right channel player output to two headphones.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Rehabilitation Therapy (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Pain & Pain Management (AREA)
  • Epidemiology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Acoustics & Sound (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Description

一种视听一体化助残装置 技术领域  Audio-visual integrated disability device

[0001] 本发明涉及电子信息技术领域, 具体涉及一种视听一体化助残装置。 背景技术  [0001] The present invention relates to the field of electronic information technology, and in particular, to an audio-visual integrated disability device. Background technique

[0002] 世界卫生组织估计全世界有盲人 4000万到 4500万。 我国曾在上世纪 80 年代进行过视力残疾状况调查。 结果显示, 我国有视力残疾患者近 1300万, 其 中盲约 550万, 低视力约 750万。 2006年统计中国有 6000多万残障者, 其中聋 哑人占 2700万以上, 比例最高。 我国每年会出现新盲人大约 45万, 低视力 135 万, 即约每分钟就会出现 1个盲人, 3个低视力患者。 如果不采取有力措施, 到 2020年我国视力残疾人数将为目前的 4倍, 即将达到 5000余万。 如果可以为这 些盲人提供些便利, 则他们的生活会随之改变很多。  [0002] The World Health Organization estimates that there are between 40 million and 45 million blind people worldwide. Our country had conducted a survey of visual disability in the 1980s. The results show that there are nearly 13 million patients with visual disability in China, of which about 5.5 million are blind and about 7.5 million are low vision. In 2006, there were more than 60 million disabled people in China, of which more than 27 million were deaf and dumb. In China, there are about 450,000 new blind people and 1.35 million low vision each year. That is, one blind person and three low vision patients will appear every minute. If we do not take effective measures, by 2020, the number of visually handicapped persons in China will be four times that of the current one, and will soon reach more than 50 million. If they can provide convenience for these blind people, their lives will change a lot.

[0003] 针对盲人目前市场上有一套凯氏导盲仪, 该导盲仪是基于差频原理而实 现的。但是, 相比于蝙蝠和海豚的生物声纳回波信号来说, 差频信号所能反应的 周边物体的特征信息还是很有限。其他也有很多类似的导盲仪, 可以用来探测前 方目标的距离,但是具体到前方为何物导盲仪则无法给出具体答案。 同时该导盲 仪训练时间较长。  [0003] A blind Klein guide is currently available on the market for blind people, and the guide is based on the difference frequency principle. However, compared to the biological sonar echo signals of bats and dolphins, the characteristic information of the surrounding objects that the difference frequency signal can reflect is still very limited. There are also many similar blind guides that can be used to detect the distance of the front target, but the specific guide to the blind guide cannot give a specific answer. At the same time, the guide blinder has a longer training time.

[0004] 现有中国专利公开的专利号为 CN201010574072.9的一种生物声纳探测装 置及其探测方法,该专利由 A, B和 C三个单纯的声纳收发处理模块组成,其中, A、 B模块是发射仿生声纳信号并采集回波信号, 并没有引入图像采集模块; 同 时 C模块也没有引入语音合成技术, 从而不能更好的为广大盲人使用。  [0004] A biological sonar detecting device and a detecting method thereof are disclosed in the Chinese Patent Publication No. CN201010574072.9, and the patent consists of three simple sonar transceiver processing modules A, B and C, wherein A The B module transmits the bionic sonar signal and collects the echo signal, and does not introduce the image acquisition module. At the same time, the C module does not introduce the speech synthesis technology, so that it cannot be used for the majority of blind people.

[0005] 本发明的目的是提供一种视听一体化助残装置, 它能为盲人提供前方目 标更详细的信息。 [0005] It is an object of the present invention to provide an audiovisual integrated disability device that provides blind people with more detailed information on the front end.

[0006] 为了解决背景技术所存在的问题, 本发明是采用以下技术方案: 一种视 听一体化助残装置, 它包括视听一体化双传感器模块、处理控制模块和音频输出 模块,所述视听一体化双传感器模块的输出端与所述处理控制模块的输入端相互 连接, 所述处理控制模块的输出端与所述音频输出模块的输入端相连; 所述视听一体化双传感器模块包括仿生声纳收发模块和图像采集模块; 所述图像采集模块包括图像传感器、调理电路和模数转换单元, 所述图像传感器 的输出端与所述调理电路的输入端相连,所述调理电路的输出端与所述模数转换 单元的输入端相连,所述模数转换单元的的输出端与所述处理控制模块的输入端 相连; In order to solve the problems in the background art, the present invention adopts the following technical solutions: An audio-visual integrated disability device, which comprises an audio-visual integrated dual sensor module, a processing control module and an audio output module, and the audio-visual integration An output end of the dual sensor module is connected to an input end of the processing control module, and an output end of the processing control module is connected to an input end of the audio output module; the audiovisual integrated dual sensor module includes a bionic sonar transceiver Module and image acquisition module; The image acquisition module includes an image sensor, a conditioning circuit, and an analog-to-digital conversion unit, and an output end of the image sensor is connected to an input end of the conditioning circuit, and an output end of the conditioning circuit and an input of the analog-to-digital conversion unit Connected to the end, the output end of the analog-to-digital conversion unit is connected to the input end of the processing control module;

所述音频输出模块包括音频驱动和调理电路、左声道播放器和右声道播放器, 所 述音频驱动和调理电路的输出端分别与所述左声道播放器的输入端和所述右声 道播放器的输入端相连。 The audio output module includes an audio driving and conditioning circuit, a left channel player, and a right channel player, and outputs of the audio driving and conditioning circuit are respectively associated with an input end of the left channel player and the right The inputs of the channel player are connected.

[0007] 作为改进, 所述处理控制模块由单微处理器或相连双微处理器、 多微处 理器构成, 微处理器可从 DSP、 ARM, FPGA、 单板机、 单片机、 intel或 AMD 等处理器中选取。  [0007] As an improvement, the processing control module is composed of a single microprocessor or a connected dual microprocessor, a plurality of microprocessors, and the microprocessor can be from a DSP, an ARM, an FPGA, a single board, a single chip microcomputer, an intel or an AMD, etc. Select from the processor.

[0008] 作为改进, 所述基于双微处理器、 多微处理器处理控制模块的微处理器 可以同型也可以异型。 例如, 两个 DSP模块可以构成同型双微处理器处理控制 模块,一个 FPGA模块和一个 DSP模块可以构成异型双微处理器处理控制模块, 两个 FPGA模块和一个 DSP模块可以构成异型多微处理器处理控制模块。  [0008] As an improvement, the microprocessor based on the dual microprocessor and multi-microprocessor processing control module may be of the same type or may be shaped. For example, two DSP modules can form a homo-type dual-microprocessor processing control module, an FPGA module and a DSP module can form a hetero-type dual-microprocessor processing control module, and two FPGA modules and one DSP module can constitute a hetero-type multi-microprocessor. Process control module.

[0009] 本发明与现有技术相比, 其有益效果为: 1、 视听一体化双传感器模块中 不仅包括仿生声纳信号的发射和采集, 同时也引入了图像采集模块, 可以较精确 的对前方探测目标进行探测、 识别和定位。 2、 处理控制模块引入了图像识别处 理技术, 可以实现高速处理和控制。 3、 音频输出模块不仅包含了原信号投影技 术还引入了语音合成技术。 4、 该专利利用了现有技术, 结合用户需求和工程实 际, 设计了一套功能齐全、 集成度高、 结构紧凑、 便于携带、 实时性好、 便于维 护和使用方便的一套视听一体化助残装置。 5、 该专利便于升级、 维护、 二次开 发和功能扩展。 Compared with the prior art, the invention has the following beneficial effects: 1. The audio-visual integrated dual-sensor module not only includes the emission and acquisition of the bionic sonar signal, but also introduces the image acquisition module, which can be more accurate. The front detection target is detected, identified and located. 2. The processing control module introduces image recognition processing technology, which enables high-speed processing and control. 3. The audio output module not only includes the original signal projection technology but also introduces speech synthesis technology. 4. The patent utilizes the existing technology, and combines user requirements and engineering practice to design a set of audio-visual integration disabled with complete functions, high integration, compact structure, easy to carry, good real-time, easy to maintain and easy to use. Device. 5. This patent is easy to upgrade, maintain, re-develop and extend functionality.

附图说明 DRAWINGS

[0010] 图 1为本发明的结构示意图。  1 is a schematic structural view of the present invention.

[0011] 图 2为本具体实施方式的示意图。 2 is a schematic view of a specific embodiment.

具体实施方式 detailed description

[0012] 本具体实施方式以一个 FPGA模块和一个 DSP模块构成的异型双微处理 器处理控制模块的视听一体化助残装置为例, 参照图 1、 图 2, 具体采用以下技 术方案: 一种视听一体化助残装置, 它包括视听一体化双传感器模块 D、 处理控 制模块 E和音频输出模块 F, 所述视听一体化双传感器模块 D的输出端与所述 处理控制模块 E的输入端相互连接, 所述处理控制模块 E的输出端与所述音频 输出模块 F的输入端相连。 [0012] In the specific embodiment, an audio-visual integrated disability device of a special-type dual-microprocessor processing control module composed of an FPGA module and a DSP module is taken as an example. Referring to FIG. 1 and FIG. 2, the following technical solutions are specifically adopted: Integrated disability device, which includes an audio-visual integrated dual sensor module D, processing control The output module of the audio-visual integrated dual-sensor module D and the input end of the processing control module E are connected to each other, and the output end of the processing control module E and the audio output module F The inputs are connected.

[0013] 参照图 1、 图 2, 所述视听一体化双传感器模块 D包括仿生声纳收发模块 和图像采集模块。其中,仿生声纳收发模块用于向室内外探测目标发射声纳信号, 并实时采集回波信息,对于仿生声纳信号的发射, 波源的设计采用直接数字式频 率合成技术 (DDS), 通过读取波形存储器中的值来生成某个频率的数字信号, 再 由 DAC来转化为模拟信号。 DAC采用 TI公司的芯片 TLV5638, 位宽为 12bits。 超声波换能器捕捉模拟信号,调理电路将捕捉到的模拟信号电压调整到模数转换 器可转换的电压范围之内, 采用 TI公司的芯片 THS1206实现双通道模数转换。 图像采集模块用于采集室内外探测目标的图像信息,包括括图像传感器, 调理电 路和模数转换单元, 该图像传感器输出为模拟量, 经过调理电路将图像传感器采 集到的模拟量电压调整到模数转换器可以转换的电压范围内,该模数转换器采用 的是 TI公司的芯片 TVP5150。  [0013] Referring to FIG. 1 and FIG. 2, the audio-visual integrated dual-sensor module D includes a bionic sonar transceiver module and an image acquisition module. Among them, the bionic sonar transceiver module is used to transmit sonar signals to indoor and outdoor detection targets, and to collect echo information in real time. For the emission of bionic sonar signals, the wave source is designed by direct digital frequency synthesis (DDS), by reading The value in the waveform memory is taken to generate a digital signal of a certain frequency, which is then converted into an analog signal by the DAC. The DAC uses TI's chip TLV5638 with a bit width of 12bits. The ultrasonic transducer captures the analog signal, and the conditioning circuit adjusts the captured analog signal voltage to the convertible voltage range of the analog-to-digital converter, and implements two-channel analog-to-digital conversion using TI's chip THS1206. The image acquisition module is configured to collect image information of indoor and outdoor detection targets, including an image sensor, a conditioning circuit, and an analog-to-digital conversion unit. The image sensor output is an analog quantity, and the analog voltage collected by the image sensor is adjusted to the mode by the conditioning circuit. The digital converter can be converted to a voltage range, and the analog-to-digital converter uses TI's chip TVP5150.

[0014] 参照图 2, 所述异型双微处理器处理控制模块 E包括 FPGA模块和 DSP 模块, FPGA模块负责听觉收发、 控制, DSP模块负责算法的处理和图像采集。 FPGA采用 altera公司的芯片 EP2C8Q208, 该芯片可用 10口有 127个, 内部有 36个 M4k存储空间。 在本实施案例中 FPGA模块是与仿生声纳收发模块相连, 其功能是探测前方有无目标,对采集的前方目标信息进行简单处理。 DSP模块是 采用 TI公司的芯片 TMS320DM642, 该模块主要功能是做算法处理, 包括对超 声波回波信号的处理和对图像数据进行图像处理。  Referring to FIG. 2, the special-shaped dual-microprocessor processing control module E includes an FPGA module and a DSP module, the FPGA module is responsible for audio transmission and reception, and the DSP module is responsible for algorithm processing and image acquisition. The FPGA uses Alter's chip EP2C8Q208, which has 127 ports for 10 ports and 36 M4k memory spaces for internal use. In this embodiment, the FPGA module is connected to the bionic sonar transceiver module, and its function is to detect the presence or absence of a target in front, and to perform simple processing on the acquired front target information. The DSP module uses TI's chip TMS320DM642. The main function of this module is algorithm processing, including processing of ultrasonic echo signals and image processing of image data.

[0015] 其中, 当所述处理控制模块 E采用包括 FPGA模块和 DSP模块结构时, 可以选用以下两种具体实施方案之一:  [0015] Wherein, when the processing control module E adopts the structure including the FPGA module and the DSP module, one of the following two specific implementation schemes may be selected:

具体实施方案一, 包括仿生声纳收发模块向前方发射声纳信号, 采集回波, 所采 集的回波模拟信号经过调理电路和模数转换单元传输到 FPGA模块;图像采集模 块采集图像信息, 所采集的模拟信号经过调理电路和模数转换单元后传输到 FPGA模块; FPGA模块通过 EDMA与 DSP模块实现高速数据传输。 The specific implementation scheme 1 includes a bionic sonar transceiver module transmitting a sonar signal to the front and collecting an echo, and the collected echo analog signal is transmitted to the FPGA module through the conditioning circuit and the analog-to-digital conversion unit; the image acquisition module collects image information. The collected analog signal is transmitted to the FPGA module through the conditioning circuit and the analog-to-digital conversion unit; the FPGA module realizes high-speed data transmission through the EDMA and the DSP module.

[0016] 具体实施方案二, 包括仿生声纳收发模块向前方发射声纳信号, 采集回 波,所采集的回波模拟信号经过调理电路和模数转换单元传输到 FPGA模块; 图 像采集模块采集图像信息,所采集的模拟信号经过调理电路和模数转换单元后传 输到 DSP模块; FPGA模块通过 EDMA与 DSP模块实现高速数据传输。 [0016] Embodiment 2 includes a bionic sonar transceiver module transmitting a sonar signal to the front, collecting an echo, and the collected echo analog signal is transmitted to the FPGA module through the conditioning circuit and the analog-to-digital conversion unit; The image acquisition information is collected by the acquisition module, and the collected analog signal is transmitted to the DSP module through the conditioning circuit and the analog-to-digital conversion unit; the FPGA module realizes high-speed data transmission through the EDMA and the DSP module.

[0017] 所述音频输出模块 F包括音频驱动和调理电路、 左声道播放器和右声道 播放器,所述音频驱动和调理电路的输出端将处理控制模块处理的信息经处理后 分别由左声道播放器和右声道播放器输出至两个耳机。 [0017] The audio output module F includes an audio driving and conditioning circuit, a left channel player and a right channel player, and the output of the audio driving and conditioning circuit processes the information processed by the processing control module respectively The left channel player and right channel player output to two headphones.

[0018] 最后说明的是, 以上实施例仅用以说明本发明的技术方案而非限制, 本 领域普通技术人员对本发明的技术方案所做的其他修改或者等同替换,只要不脱 离本发明技术方案的精神和范围, 均应涵盖在本发明的权利要求范围当中。  [0018] Finally, the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting, and other modifications or equivalents to the technical solutions of the present invention will be made by those skilled in the art without departing from the technical solutions of the present invention. The spirit and scope of the invention are intended to be included within the scope of the appended claims.

Claims

权利要求书 Claim 1. 一种视听一体化助残装置, 其特征在于, 它包括视听一体化双传感器模块、 处理控制模块和音频输出模块,所述视听一体化双传感器模块的输出端与所述处 理控制模块的输入端相互连接,所述处理控制模块的输出端与所述音频输出模块 的输入端相连;  An audio-visual integrated disability device, comprising: an audio-visual integrated dual-sensor module, a processing control module, and an audio output module, wherein an output of the audio-visual integrated dual-sensor module and an input of the processing control module The terminals are connected to each other, and an output end of the processing control module is connected to an input end of the audio output module; 所述视听一体化双传感器模块包括仿生声纳收发模块和图像采集模块; 所述图像采集模块包括图像传感器、调理电路和模数转换单元, 所述图像传感器 的输出端与所述调理电路的输入端相连,所述调理电路的输出端与所述模数转换 单元的输入端相连,所述模数转换单元的的输出端与所述处理控制模块的输入端 相连; The audio-visual integrated dual-sensor module includes a bionic sonar transceiver module and an image acquisition module; the image acquisition module includes an image sensor, a conditioning circuit, and an analog-to-digital conversion unit, and an output end of the image sensor and an input of the conditioning circuit Connected to the end, the output end of the conditioning circuit is connected to the input end of the analog-to-digital conversion unit, and the output end of the analog-to-digital conversion unit is connected to the input end of the processing control module; 所述音频输出模块包括音频驱动和调理电路、左声道播放器和右声道播放器, 所 述音频驱动和调理电路的输出端分别与所述左声道播放器的输入端和所述右声 道播放器的输入端相连。 The audio output module includes an audio driving and conditioning circuit, a left channel player, and a right channel player, and outputs of the audio driving and conditioning circuit are respectively associated with an input end of the left channel player and the right The inputs of the channel player are connected. 2. 根据权利要求 1所述的一种视听一体化助残装置, 其特征在于, 所述处理控 制模块用单微处理器、 双微处理器或多微处理器构成。  2. An audio-visual integrated disability device according to claim 1, wherein the processing control module is constituted by a single microprocessor, a dual microprocessor or a multi-microprocessor. 3. 根据权利要求 2所述的一种视听一体化助残装置, 其特征在于, 所述单微处 理器采用 DSP、 ARM, FPGA、 单板机、 单片机、 intel或 AMD微处理器。 3. The audio-visual integrated disability device according to claim 2, wherein the single microprocessor uses a DSP, an ARM, an FPGA, a single board machine, a single chip microcomputer, an intel or an AMD microprocessor. 4. 根据权利要求 2所述的一种视听一体化助残装置, 其特征在于, 所述双微处 理器从 DSP、 ARM, FPGA、 单板机、 单片机、 intel或 AMD处理器中选取, 这 两个相连微处理器可以同型也可以异型, 这两个处理器分担视、 听信息处理。4. The audio-visual integrated disability device according to claim 2, wherein the dual microprocessor is selected from a DSP, an ARM, an FPGA, a single board, a single chip microcomputer, an intel or an AMD processor, A connected microprocessor can be of the same type or a different type, and the two processors share the processing of viewing and listening information. 5. 根据权利要求 4所述的一种视听一体化助残装置, 其特征在于, 所述双微处 理器为两个 DSP模块构成同型处理控制模块, 或一个 FPGA模块和一个 DSP模 块构成异型处理控制模块。 5 . The audio-visual integrated disability device according to claim 4 , wherein the dual microprocessor forms a homogenous processing control module for two DSP modules, or an FPGA module and a DSP module form a special-shaped processing control Module. 6. 根据权利要求 2所述的一种视听一体化助残装置, 其特征在于, 所述多处理 器为从 DSP、 ARM, FPGA, 单板机、 单片机、 intel或 AMD处理器中选取三个 以上微处理器, 这三个相连微处理器可以同型也可以异型, 分担多通道视、 听信 息处理。  The audio-visual integrated disability device according to claim 2, wherein the multi-processor is three or more selected from a DSP, an ARM, an FPGA, a single-board computer, a single-chip microcomputer, an intel or an AMD processor. Microprocessor, these three connected microprocessors can be identical or heterogeneous, sharing multi-channel video and audio information processing.
PCT/CN2012/087030 2012-07-04 2012-12-20 Audio-visual integration handicapped helping device Ceased WO2014005409A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2012102295893A CN102716003A (en) 2012-07-04 2012-07-04 Audio-visual integration handicapped helping device
CN201210229589.3 2012-07-04

Publications (1)

Publication Number Publication Date
WO2014005409A1 true WO2014005409A1 (en) 2014-01-09

Family

ID=46941967

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/087030 Ceased WO2014005409A1 (en) 2012-07-04 2012-12-20 Audio-visual integration handicapped helping device

Country Status (2)

Country Link
CN (1) CN102716003A (en)
WO (1) WO2014005409A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102716003A (en) * 2012-07-04 2012-10-10 南通朝阳智能科技有限公司 Audio-visual integration handicapped helping device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6011754A (en) * 1996-04-25 2000-01-04 Interval Research Corp. Personal object detector with enhanced stereo imaging capability
CN101505710A (en) * 2006-08-15 2009-08-12 皇家飞利浦电子股份有限公司 Assistance system for visually handicapped persons
CN102135619A (en) * 2010-12-06 2011-07-27 王茂森 Biosonar sounding device and method
US20110316694A1 (en) * 2010-06-24 2011-12-29 Hong Andrew L Overhang warning device
CN102716003A (en) * 2012-07-04 2012-10-10 南通朝阳智能科技有限公司 Audio-visual integration handicapped helping device
CN202715021U (en) * 2012-07-04 2013-02-06 南通朝阳智能科技有限公司 Audio-visual integration device helping the disabled

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004024853A (en) * 2002-05-08 2004-01-29 Yamanashi Tlo:Kk Device for supporting walking
US8120521B2 (en) * 2003-10-28 2012-02-21 Preco Electronics, Inc. Radar echolocater with audio output
CN101368828A (en) * 2008-10-15 2009-02-18 同济大学 Navigation method and system for the blind based on computer vision
CN101797197B (en) * 2009-11-23 2012-07-04 常州超媒体与感知技术研究所有限公司 Portable blindman independent navigation system
CN102293709B (en) * 2011-06-10 2013-02-27 深圳典邦科技有限公司 Visible blindman guiding method and intelligent blindman guiding device thereof
CN102389362A (en) * 2011-07-28 2012-03-28 张华昱 Image ultrasonic blind guiding system device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6011754A (en) * 1996-04-25 2000-01-04 Interval Research Corp. Personal object detector with enhanced stereo imaging capability
CN101505710A (en) * 2006-08-15 2009-08-12 皇家飞利浦电子股份有限公司 Assistance system for visually handicapped persons
US20110316694A1 (en) * 2010-06-24 2011-12-29 Hong Andrew L Overhang warning device
CN102135619A (en) * 2010-12-06 2011-07-27 王茂森 Biosonar sounding device and method
CN102716003A (en) * 2012-07-04 2012-10-10 南通朝阳智能科技有限公司 Audio-visual integration handicapped helping device
CN202715021U (en) * 2012-07-04 2013-02-06 南通朝阳智能科技有限公司 Audio-visual integration device helping the disabled

Also Published As

Publication number Publication date
CN102716003A (en) 2012-10-10

Similar Documents

Publication Publication Date Title
CN204390737U (en) A kind of home voice disposal system
CN104306018B (en) There is the monitoring of tire sound, fetal movement detection and the wearable foetus teaching abdomen belt system of fetal movement track inducing function
WO2006059299A3 (en) Position sensing using loudspeakers as microphones
CN201278205Y (en) Alarming device for preventing myopia
Brimijoin et al. Auditory and visual orienting responses in listeners with and without hearing-impairment
US20100278012A1 (en) Human echolocation system
US9675322B2 (en) Enhanced ultrasound device and methods of using same
CN201939498U (en) Portable wireless electrocardio, cardiac sound and breath sound collecting terminal device
CN105455842A (en) Intelligent auscultation system
WO2019100915A1 (en) Electroencephalogram controlled video input and auditory display blind guiding apparatus and method
CN104138275A (en) Electronic Bluetooth stethoscope
HK1231623A1 (en) A robot voice direction-finding rotation system and method
CN106723736A (en) Intelligent crutches for autonomous person-finding based on phase transformation weighted generalized cross-correlation algorithm
CN102499638A (en) Living body detection system based on vision, hearing, smell and touch
CN102940507A (en) Micro color ultrasound
Wu et al. Advanced acoustic footstep-based person identification dataset and method using multimodal feature fusion
WO2014005409A1 (en) Audio-visual integration handicapped helping device
US10466785B2 (en) Display system for physiological information and diagnostic method
CN203988121U (en) Electronics bluetooth stethoscope
CN210278193U (en) Comprehensive rehabilitation treatment system based on motion capture and biofeedback
CN204181639U (en) A kind of Multifunctional smart stethoscope showing, store and transmit electrocardiosignal
Satat et al. Identi-wheez—a Device for in-Home Diagnosis of Asthma
CN205028242U (en) Utilize information interaction system of brain wave and eyeball state
CN105997134A (en) Multichannel lung sound signal collection system and method
CN202715021U (en) Audio-visual integration device helping the disabled

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12880345

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 13/03/2015)

122 Ep: pct application non-entry in european phase

Ref document number: 12880345

Country of ref document: EP

Kind code of ref document: A1