CN108600057A - A kind of method and system perceiving control household electrical appliance based on WiFi - Google Patents

Abstract

The present invention is applicable to the field of wireless communication technology identification, and provides a method and system for controlling household appliances based on WiFi perception, including: S1, establishing a connection between a handheld terminal and a household appliance supporting a WiFi function and a WiFi module of a routing device; S2, The handheld terminal receives the WiFi signal to collect gesture action data information; S3, judges that the collected gesture action data information is matched with the preset gesture action in the database; S4, generates a control command according to the physical address information of the matched preset gesture action and sends it to The router; the S5 device sends the instruction to the corresponding household appliance to execute the control instruction according to the address information of the received control instruction. At the same time, it combines the latest machine learning algorithm for analysis and judgment, so as to quickly and accurately identify the user's gestures and interact with the home intelligent central control.

Description

A method and system for controlling household appliances based on WiFi perception

technical field

The invention belongs to the field of wireless communication technology identification, and in particular relates to a method and system for controlling household appliances based on WiFi perception.

Background technique

Since humans invented machines, there has been an abstract concept of human-computer interaction experience.

In today's social background where automation and intelligence are booming, human-machine experience is becoming more and more important; there are many types of terminal control products on the market today, such as through video recognition, because these products need to be visually recognized at the terminal The processing and operation of the algorithm requires relatively high computing performance of the terminal, so the purchase cost is slightly higher, and because of the large amount of computing, the battery life is low. There is also a sensor-type product that uses a microcontroller to collect data from an acceleration sensor to analyze the user's actions, and transmits the user's control intentions through a wireless data transmission technology. This type of product has low cost, single function, and It cannot satisfy the diversified consumption and entertainment concepts of today's users. Our secondary development of machine learning algorithms based on WiFi devices enables ordinary home routers and our handheld terminal products to form an intelligent interactive scene with self-adaptive environment and self-discrimination learning functions through the invisible WiFi network in the home environment . The user holds the terminal product and makes relevant actions to make the intelligent machine learning algorithm in the device analyze and judge, and finally analyze the user's specific control intention, and then transmit the data to the corresponding control execution device through the wireless network, and finally The process of controlling household electronic and electrical equipment and realizing intelligent interaction. Its core principle is to use machine learning algorithms to calculate and analyze the channel status information of WiFi devices, and judge the indoor environmental status through the analysis results, as well as the behaviors and actions made by people holding devices to achieve the core perception control function of the product. Secondly, our product can also act as a WiFi router and repeater in another occasion, and of course it can also expand the WiFi media center to download network media resources offline and serve as a home audio-visual entertainment center.

Contents of the invention

The purpose of the present invention is to provide a method and system for controlling household appliances based on WiFi perception, aiming to solve the above technical problems.

The present invention is achieved in this way, a method for controlling household appliances based on WiFi awareness, the method includes the following steps:

S1. Establish a connection between the handheld terminal and the household appliances supporting the WiFi function and the WiFi module of the routing device;

S2. The hand-held terminal receives the WiFi signal to collect gesture action data information;

S3, judging that the collected gesture action data information is matched with the preset gesture action in the database, if the match is successful, then perform the next step, if the match is unsuccessful, delete the gesture action;

S4. Generate a control instruction according to the physical address information of the matched preset gesture action and send it to the router;

The S5 device sends the instruction to the corresponding household appliance to execute the control instruction according to the address information of the received control instruction.

A further technical solution of the present invention is: before the step S1, it also includes the steps of:

S0. Input the MAC address of the household appliance into the handheld mid-terminal to save in the database and set the corresponding gesture command.

A further technical solution of the present invention is: in the step S3, a one-to-one mapping and binding is performed for preset gesture actions and control purposes in the database.

A further technical solution of the present invention is: the handheld terminal is powered by a rechargeable lithium battery, and the charging interface uses a Micro USB interface +5V for charging.

A further technical solution of the present invention is: the state change of the WiFi signal between the handheld terminal and the routing device is detected and judged by an intelligent recognition algorithm to interact with the smart home control center.

A further technical solution of the present invention is: the gesture includes shaking up and down in the vertical direction, shaking left and right in the horizontal direction, shaking back and forth in the horizontal direction, and shaking at a 45° inclination in the vertical direction.

Another object of the present invention is to provide a system for controlling household appliances based on WiFi awareness, the system includes:

The handheld terminal is used to receive WiFi signals, recognize gesture actions according to the changes of WiFi signals, generate corresponding action commands according to the gesture actions, and send the commands to the routing device;

Routing device, used to generate WiFi signal and send the signal in the form of broadcast, receive the return signal, and send its instruction signal to the corresponding household appliance according to the address of the return signal;

Household appliances, household appliances that support the WiFi function, are used to receive the corresponding instructions sent by the routing device according to the address, and the control center executes the corresponding instruction actions according to the instruction information.

The beneficial effect of the present invention is that it integrates a family remote interactive remote control device and a multifunctional intelligent router into one body, and is small in size, and is simple and quick to configure through the mobile phone WeChat, and creatively uses the channel state information of the WiFi signal as the basis for analysis and judgment . At the same time, it combines the latest machine learning algorithm for analysis and judgment, so as to quickly and accurately identify the user's gestures and interact with the home intelligent central control.

Description of drawings

Fig. 1 is a method for controlling household appliances based on WiFi awareness provided by an embodiment of the present invention.

Fig. 2 is a flow chart of product usage provided by the embodiment of the present invention.

Fig. 3 is a working principle diagram of the product provided by the embodiment of the present invention.

Fig. 4 is an application scenario diagram of a product provided by an embodiment of the present invention.

FIG. 5 is a first schematic diagram of gesture direction provided by an embodiment of the present invention.

Fig. 6 is a second schematic diagram of gesture directions provided by an embodiment of the present invention.

Detailed ways

Figure 1 shows a flow chart of a method for controlling a household appliance based on WiFi awareness provided by the present invention, which is described in detail as follows:

Step S0, input the MAC address of the household appliance into the handheld terminal to save in the database and set the corresponding gesture command; also establish a connection between the handheld terminal and the routing device, and set the corresponding relationship between the gesture and the household appliance in the connected handheld terminal , establish the gesture and motion command signals together in establishing the mapping relationship.

Step S1, establish a connection between the handheld terminal and the household appliances supporting the WiFi function and the WiFi module of the routing device; establish a connection between the household appliances supporting the WiFi function and the routing device at home, and when establishing a connection, you can use the method of automatically obtaining an IP connection or specifying an IP The address and the MAC (abbreviation for Media Access Control or Medium Access Control) address are correspondingly bound and connected. Household appliances include TVs, air conditioners, refrigerators, and washing machines, etc., and handheld terminals and routing devices also establish WiFi signal connections at the same time.

Step S2, the hand-held terminal receives the WiFi signal to collect gesture action data information; in the established connection system, perform various gesture actions on the hand-held focus, the hand-held terminal collects various gesture actions according to the received signal changes, and collects action output.

Step S3, judging that the collected gesture action data information is matched with the preset gesture action in the database, if the match is successful, then execute the next step, if the match is unsuccessful, delete the gesture action; in the database, it is a preset gesture action One-to-one mapping and binding between actions and control purposes. .

Step S4, generate a control instruction according to the physical address information of the matched preset gesture action and send it to the router; extract the MAC address information corresponding to the matched gesture action and the corresponding instruction, and map the MAC address in front of the raised instruction, In this way, it is sent to the routing device, and the routing device can extract the corresponding address for subsequent actions, and the routing device sends the instruction according to the resolved address.

Step S5, the device sends the command to the corresponding household appliance to execute the control command according to the address information of the received control command; according to the received control command information, the home appliance hub recognizes it, executes the recognized command, and completes the control process.

The handheld terminal is powered by a rechargeable lithium battery, and the charging interface uses a Micro USB interface +5V for charging.

The WiFi signal state change between the handheld terminal and the routing device is detected and judged by the intelligent recognition algorithm to interact with the smart home control center.

The gestures include shaking up and down in the vertical direction, shaking left and right in the horizontal direction, shaking back and forth in the horizontal direction, and shaking at an angle of 45° in the vertical direction, as shown in FIGS. 5 and 6 .

Another object of the present invention is to provide a system for controlling household appliances based on WiFi awareness, the system includes:

The handheld terminal is used to receive WiFi signals, recognize gesture actions according to the changes of WiFi signals, generate corresponding action commands according to the gesture actions, and send the commands to the routing device;

Routing device, used to generate WiFi signal and send the signal in the form of broadcast, receive the return signal, and send its instruction signal to the corresponding household appliance according to the address of the return signal;

Household appliances, household appliances that support the WiFi function, are used to receive the corresponding instructions sent by the routing device according to the address, and the control center executes the corresponding instruction actions according to the instruction information.

The handheld device uses the status change of the WiFi signal between the handheld device and the router to detect and judge the actions of the human hand through an intelligent recognition algorithm, and then interact with the smart home control center through human gestures.

The WiFi signal is a commonly used WiFi signal in the home, that is, a WiFi signal connected between the smart handheld terminal and the home router.

The smart handheld device is powered by a lithium battery, has a charging and discharging function, and adopts a 5V Micro USB interface, which is compatible with commonly used mobile phone chargers.

The gesture action requires the user to perform simple presets according to the instructions guide combined with the WeChat client. When the action matches the preset action, the device recognition will be triggered, and then interact with the intelligent control platform.

According to the setup guide, the gestures will map and bind gesture actions and control purposes, that is, select different gestures to correspond to different operation purposes. The product has built-in several gestures and provides user-defined gesture setting methods.

The several gestures include: shaking up and down, shaking left and right, shaking back and forth, and secondly, different shaking times can be set to correspond to different gestures.

Provides intelligent network distribution function for equipment, which greatly facilitates the network distribution process for users. Enter the distribution network mode through the device button, scan the QR code through the mobile phone WeChat to enter the distribution network page, and then enter the WiFi password to complete the device connection.

The product has built-in relevant emergency plan measures, such as detecting whether the device is well connected to the router and network server; otherwise, the relevant emergency recovery measures are activated. Detect whether the wireless status environment of the device is compatible with the preset conditions of the product; if not, notify the user to make adjustments through relevant methods. Detect whether the wireless channel state information of the device interferes seriously with the surrounding electromagnetic environment, and if so, initiate relevant adjustment measures to improve.

Handheld terminal, as described in the product application scenario, its main functions are:

s1. The function of interacting with the home control platform. Realize intelligent interactive experience. As shown in Figure 4, home appliances are connected to the home control platform through WiFi, and our smart terminal is also connected to the control platform. At this time, when the device configuration is completed, the intelligent algorithm in the device can judge the user according to the change of the WiFi signal. After the gesture is analyzed, the device will send this information to the control platform, and the control platform will operate the corresponding control action according to the gesture mapping relationship preset by the user. For example, if the device is shaken twice, the TV will switch channels.

s2. The configuration of the device and the corresponding presets of gestures are all operated on the WeChat terminal of the mobile phone. The user scans the QR code of the device to enter the official account, and then configures the configuration of the network configuration and gesture settings through the corresponding user guidance.

As shown in Figure 2, it is a flow chart for the use of the product:

s3. The device is powered on, and then press the network distribution button on the device, and the device enters the network distribution mode at this time.

s4. Scan the QR code to enter the official account through the WeChat terminal of the mobile phone, and then perform relevant configurations with the help of user guidance.

s5. If the process is followed, the device has connected to the WiFi network at this time, and will communicate with the server in the cloud.

s6. At this time, the device is connected to the server, and the device will configure the relevant database by registering with the server, and at the same time map with the mobile client. At this time, the user can realize the effect of operating the device by operating on the mobile WeChat client. .

s7. When the device is first started, it will perform an initialization operation according to the on-site environment, and then after the initialization is completed, the device will obtain a series of technical parameters related to the root environment.

s8. After the device initialization is completed, the user performs a corresponding preset action on the handheld device, and the device can operate the corresponding home device according to the user's gesture action.

As shown in Figure 3, it is an illustration of the general working principle of the product:

s9. This product is specially customized based on the open source operating system OpenWrt, and the key information of the WiFi physical layer is obtained by modifying the driver of the wireless network card.

s10, then the user layer program opens the drive device file, and then receives data to the application layer, and the application layer verifies the received data. If there is an error in the data verification, the data will be discarded and received again.

s11. Then the original CSI data will be converted according to the relevant algorithm, and converted into a 3*3*56 CSI matrix of gain and phase.

s12. Then correct and filter the data at the matrix level. These data are then put into the data queue.

s13. After the amount of data in the data queue reaches a certain level, the detection program is started for detection.

s14. The detection program is divided into an initialization phase and a real-time detection phase.

s15. The real-time detection phase of the detection program and the foreground data receiving program are called by multiple threads, and the detection effect is more real-time.

The user holds the device and makes relevant gestures. At this time, the device can detect and analyze the specific actions made by the user when holding the device.

The detection device transmits the detected user gestures to the home appliance control center, and then the control center implements control actions.

The product is a small Linux computer with WiFi function powered by a built-in rechargeable lithium battery. The core chip is MT7688, which runs a customized OpenWrt operating system. Among them, our algorithm program is built into the device, which can accurately capture the user's gestures and send the detected actions to the control center in time.

The product will recommend several gestures with the best recognition effect. If you use these gestures, the recognition effect will be very good. If you use other gestures, the effect will be average. Among them, if there are several built-in gestures, the matching degree will be relatively high.

Machine learning algorithm is used to analyze the channel state information based on time series of WiFi. Since the influence of different actions on the channel state information of WiFi signal is different when the hand-held device performs different actions, based on this principle, we can detect WiFi The different changing rules of the channel state information are used to judge which gestures the user has made specifically. Among them, if it is judged that it matches a preset gesture, the recognized gesture command is sent to the control center. Then proceed to the next step of the control process.

It has the function of communicating with handheld devices, and has the function of communicating and controlling with household appliances. Based on ordinary home routers, related data transmission and expansion of electrical control functions are carried out here. This product is not within the scope of the description of this invention. The intelligent perception device is only responsible for gesture recognition, and the recognition result is sent to the control center, which then controls the actual electrical equipment.

Provide the power supply of the equipment, the product has passed the relevant safety certification, has the ability to charge and discharge multiple times, and is integrated inside the equipment.

Equipped with wireless network card hardware to connect to WiFi hotspots, combined with the underlying driver of the program algorithm, to obtain important business information.

Through the open source OpenWrt operating system, the development of application layer logic is carried out. The core chip is MediaTek MT7688. Both the driver layer and the application layer of the operating system have been developed. Our business logic is in the application layer, with the functions of pattern recognition and network communication. The capture of user gestures is judged by analyzing the data transmitted from the kernel driver.

The several gestures are: shaking up and down in the vertical direction; shaking left and right in the horizontal direction; shaking back and forth in the horizontal direction; shaking at a 45° tilt in the vertical direction. The gestures it supports are not limited to these types, and other gestures can also be recognized normally. Among them, the specific operation effects of these gestures provide the user with the freedom to customize the settings. The specific settings are set through the setting wizard of the WeChat client.

It can adapt and learn by itself according to the situation of the WiFi channel and the environment. It can play a good role in different application environments.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.

Claims (7)

1. A method for controlling household appliances based on WiFi awareness, characterized in that the method comprises the following steps: S1. Establish a connection between the handheld terminal and the household appliances supporting the WiFi function and the WiFi module of the routing device; S2. The hand-held terminal receives the WiFi signal to collect gesture action data information; S3, judging that the collected gesture action data information is matched with the preset gesture action in the database, if the matching is successful, the next step is executed, and if the matching is unsuccessful, the gesture action is deleted; S4. Generate a control instruction according to the physical address information of the matched preset gesture action and send it to the router; The S5 device sends the instruction to the corresponding household appliance to execute the control instruction according to the address information of the received control instruction. 2. The method for controlling household appliances based on WiFi perception according to claim 1, characterized in that, before the step S1, the step further comprises: S0. Input the MAC address of the household appliance into the handheld mid-terminal to save in the database and set the corresponding gesture command. 3. The method for controlling household appliances based on WiFi perception according to claim 2, characterized in that, in the step S3, a one-to-one mapping and binding is performed for preset gesture actions and control purposes in the database. 4. The method for controlling household appliances based on WiFi perception according to claim 3, characterized in that, the handheld terminal is powered by a rechargeable lithium battery, and the charging interface uses a Micro USB interface +5V for charging. 5. The method for controlling household appliances based on WiFi perception according to claim 5, characterized in that the state changes of WiFi signals between the handheld terminal and the routing device are detected and judged by an intelligent recognition algorithm to interact with the smart home control center. 6 . The method for controlling household appliances based on WiFi perception according to claim 5 , wherein the gestures include shaking up and down in the vertical direction, shaking left and right in the horizontal direction, shaking back and forth in the horizontal direction, and shaking at an angle of 45° in the vertical direction. 7. A system for controlling household appliances based on WiFi perception, characterized in that the system includes: The handheld terminal is used to receive WiFi signals, recognize gesture actions according to the changes of WiFi signals, generate corresponding action commands according to the gesture actions, and send the commands to the routing device; Routing device, used to generate WiFi signal and send the signal in the form of broadcast, receive the return signal, and send its command signal to the corresponding household appliance according to the address of the return signal; Household appliances, household appliances that support the WiFi function, are used to receive the corresponding instructions sent by the routing device according to the address, and the control center executes the corresponding instruction actions according to the instruction information.