TWI557595B - Control system of human-computer interaction techniques for family - Google Patents

Description

Family human-computer interaction control system

The invention relates to a human-computer interaction system, in particular to a home-type human-computer interaction control system for controlling household electrical appliances.

With the increasing maturity of sensor applications in human-computer interaction control technology, more and more sensors are being used in many image or information acquisition devices, including Microsoft's Kinect and Nintendo developed for the Xbox360 game console. The wii developed by the company has made great repercussions in the market. This new type of game console uses sensors to simulate three-dimensional space, giving people an unprecedented gaming experience. However, the sensor is limited to a single direction in the direction sensing. The coverage of a single sensor is limited, and it is impossible to completely read out all the information. At present, the human-computer interaction control technology is mainly applied to entertainment and single-machine control. There are few applications in daily life.

It is an object of the present invention to provide a home-based human-computer interaction control system that can easily manipulate home appliances.

A home-based human-computer interaction control system includes at least three camera devices, a signal processing module, and a home appliance, wherein the at least three camera devices are disposed in a periphery of a predetermined space, and the at least three camera devices are in a The projection positions of the horizontal plane are not on the same straight line, and the capture range of each of the at least three camera devices is covered The at least three ingesting devices are configured to capture an image of a user's limb motion corresponding to a control command, and the signal processing module is electrically connected to the camera device for receiving the And processing the image to generate a control command signal corresponding to the limb motion, the home appliance having a signal receiver for receiving a carry control command transmitted from the signal processing module Controlling the command signal and controlling the home appliance to execute the control command.

Compared with the prior art, the home-based human-computer interaction control system of the embodiment uses at least three camera devices to capture images of objects in the space, and can capture images of the object at any angle, that is, at least three camera devices can The image of the limb movement when the user faces in all directions is captured, so that the user can use the home-based human-machine interaction control system to control the household electrical appliance when facing the various directions, so that the home-style human-machine The application of interactive control systems is more extensive.

100‧‧‧Family human-computer interaction control system

200‧‧‧Users

10‧‧‧ camera

20‧‧‧Signal Processing Module

30‧‧‧Home Appliances

40‧‧‧ display

FIG. 1 is a schematic diagram of an embodiment of a home-based human-computer interaction control system.

As shown in FIG. 1 , an embodiment of the present invention provides a home-based human-computer interaction control system 100 including three camera devices 10 , a signal processing module 20 , a plurality of home appliances 30 , and a display 40 .

In this embodiment, the three camera devices 10 are disposed in a periphery in a predetermined space, and the projection positions of the three camera devices 10 in a horizontal plane are not in the same straight line, and the capturing range of each camera device 10 is All the objects in the space are covered, for example, the three camera devices 10 are disposed in three corners of a rectangular parallelepiped room near the ceiling, and the capturing range of each camera device 10 is the space in the entire rectangular parallelepiped room. The imaging device 10 is configured to capture an image of the motion of the user 200 and capture the captured image. The information is converted into an electrical signal and sent out. Different body motion information of the user 200 corresponds to different control commands. In this embodiment, since the three imaging devices 10 are respectively disposed in a periphery in a predetermined space, and the projection positions of the three imaging devices 10 in a horizontal plane are not in the same straight line at a projection position in a horizontal plane, regardless of the user Which direction 200 is facing, one or more of the three camera devices 10 can capture the user's limb movements. Of course, the number of the imaging devices 10 may be greater than three. For example, the number of the imaging devices 10 is four, which are respectively disposed in four corners of the rectangular parallelepiped room near the ceiling, and are not limited to the embodiment.

In this embodiment, the imaging device 10 may be a two-dimensional camera that captures a two-dimensional image, a stereo camera that captures a three-dimensional image, or a three-dimensional somatosensory camera such as Microsoft Corporation's Kinect.

The signal processing module 20 is electrically connected to the three imaging devices 10. In the embodiment, the signal processing module 20 is disposed in one of the imaging devices 10. The signal processing module 20 is configured to analyze, process, and recognize an image information signal that is acquired by the camera device 10 and includes a motion of the user 200, and obtains a user 200's intention to control, generates a corresponding manipulation command signal, and issues a signal. The control command signal is sent to the corresponding household electrical appliance 30. In this embodiment, the signal processing module 20 transmits the control command signal to the corresponding home appliance 30 by using a wireless transmission mode, and the wireless transmission mode may be Bluetooth transmission or wifi transmission, etc., and the signal processing mode is required at this time. The group 20 and the household electrical appliance 30 include a Bluetooth module or a wifi module. Of course, the control command signal may also be transmitted by means of signal line transmission, and is not limited to this implementation.

The plurality of household electrical appliances 30 include general household appliances such as an air conditioner, a washing machine, a television, and a water heater, and only one of the air conditioners is depicted in FIG. Each household appliance 30 Receiving a control command signal sent by the signal processing module 20 and executing the command carried by the control command signal, and automatically masking a control command that is not related thereto, for example, if the control command is to turn on the air conditioner, the air conditioner receives and The instructions are executed while other household appliances 30 automatically mask the instructions.

Each of the household electrical appliances 30 has a signal receiver (not shown) for receiving a control command signal carrying the control command transmitted from the signal processing module 20, and controlling the corresponding home appliance 30 to execute the command. The person 200 controls the home appliance 30 in this way.

The display 40 is electrically connected to the plurality of imaging devices 10 for displaying images of the user 200 captured by the imaging device 10, and the images may be captured by one or more of the imaging devices 10 The two-dimensional static or moving image of the user 200 may also be a three-dimensional static or moving image of the user 200 captured by one or more of the imaging devices 10, thereby displaying the motion image of the user 200 on the display 40. .

As shown in FIG. 1 , the display 40 can also display an image of the household electrical appliance 30 so that the user 200 can clearly see the direction of the indication of the physical movement of the user, thereby achieving the purpose of accurately controlling the household electrical appliance 30 .

The method for using the home-based human-computer interaction control system 100 of the present embodiment is as follows: the user 200 makes a limb motion corresponding to the control command, such as raising the palm; the plurality of camera devices 10 capture the image of the user 200 and capture the image The image information is transmitted to the signal processing module in the form of an electrical signal; the signal processing module 20 performs limb motion recognition analysis and processing according to the electrical signal including the image information, and obtains a corresponding flat palm The control command of the limb motion, such as turning off the signal of the air conditioner, and transmitting the control command signal to the home appliance by means of wireless transmission or signal line transmission The air conditioner in the device 30 turns the air conditioner off.

It can be understood that the correspondence between the type of the limb motion of the user 200 and the control command may be preset by the manufacturer of the home-based human-computer interaction control system 100, or may be customized by the user 200, such as by the camera. 10: Ingesting the limb movement of the user 200, and then selecting a certain control command on the display of a certain household electrical appliance 30 to perform corresponding operation, the custom limb motion of the user 200 can be corresponding to the control instruction of the household electrical appliance 30, such as uptake. The action of swinging the arm corresponds to raising the temperature of the air conditioner.

The display 40 can be a display screen of a computer, a television, a mobile phone, a personal digital assistant, or the like, or a projection display screen provided with a projection device.

Compared with the prior art, the home-based human-computer interaction control system 100 of the present embodiment uses at least three imaging devices 10 to capture images of objects in the space, and can capture images of the object at any angle, that is, at least three cameras. The device 10 can capture an image of the limb movement of the user 200 in various directions, so that the user 200 can use the home-based human-machine interaction control system 100 to control the household electrical appliance 30 when facing each direction. The application range of the home-based human-computer interaction control system 100 is made wider.

In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. However, the above description is only the preferred embodiment of the present invention, and equivalent modifications or variations made by those skilled in the art will be covered by the following claims.

100‧‧‧Family human-computer interaction control system

200‧‧‧Users

10‧‧‧ camera

20‧‧‧Signal Processing Module

30‧‧‧Home Appliances

40‧‧‧ display

Claims (6)

A home-based human-computer interaction control system includes at least three camera devices, a signal processing module, and a plurality of home appliances, wherein the at least three camera devices are disposed in a periphery of a predetermined space, and the at least three camera devices are The projection positions of a horizontal plane are not on the same straight line, the extraction range of each of the at least three imaging devices covers the entire predetermined space, and the at least three ingestion devices are used for ingesting the user corresponding to the control instruction An image of the limb motion, the signal processing module being electrically connected to the camera device, configured to receive the image and process the image to generate a control corresponding to the motion of the limb a command signal, the plurality of home appliances each having a signal receiver for receiving a control command signal carrying a control command transmitted from the signal processing module, and controlling the plurality of home appliances to execute the control command, each home appliance The device receives the control command signal sent by the signal processing module and executes the instruction carried by the control command signal, Automatic mask control instruction it is not related. The home-based human-computer interaction control system of claim 1, wherein the control command signal transmission mode between the signal processing module and the household electrical appliance is a wireless transmission mode. The home-based human-machine interaction control system of claim 2, wherein the wireless transmission mode is Bluetooth transmission or wifi transmission. The home-based human-computer interaction control system of claim 1, wherein the correspondence between the control command and the limb motion is stored in the household electrical appliance. The home-based human-computer interaction control system of claim 1, wherein the correspondence between the control instruction and the limb motion is customized by the user. The home-based human-computer interaction control system of claim 1, wherein the home-based human-computer interaction control system further comprises a display for displaying a shadow of the user captured by the camera device. image.