CN106569409A - Graph capturing based household equipment control system, device and method - Google Patents
Graph capturing based household equipment control system, device and method Download PDFInfo
- Publication number
- CN106569409A CN106569409A CN201610893153.2A CN201610893153A CN106569409A CN 106569409 A CN106569409 A CN 106569409A CN 201610893153 A CN201610893153 A CN 201610893153A CN 106569409 A CN106569409 A CN 106569409A
- Authority
- CN
- China
- Prior art keywords
- equipment
- control
- home equipment
- controlled
- controlled home
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Theoretical Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention provides a graph capturing based household equipment control system which comprises a graph capturing device, a graph interface generating device and a processor. The invention also provides a graph capturing based household equipment control device which comprises the graph capturing device, a controller and a signal transmitting-receiving device. The invention further provides a graph capturing based household equipment control method. Remote video monitoring and image identification technologies are used to identify controlled equipment within a monitoring range automatically, an enhanced virtual reality manner is used to display the controlled device in a monitoring frame, and the equipment can be controlled. The problems that an intelligent household mobile phone cannot be used to see real execution conditions of the equipment onsite, is not visual and is low in experience at present are solved.
Description
Technical field
The present invention relates to Smart Home technical field, the side of particularly a kind of home equipment control captured based on figure
Method, using monitoring remote video and image recognition technology, automatic identification is carried out to the controlled plant in monitoring range, and can be passed through
The mode for strengthening virtual reality is presented on monitored picture and can control.
Background technology
Smart home concept is increasingly popularized at present, but the Consumer's Experience of smart home product is not high, particularly electronics
Equipment（Such as smart mobile phone etc.）Controlling interface and its inconvenient factor of manipulation affect always the further genralrlization of smart home.
With current augmented reality（AR）/ virtual reality（VR）The continuous development of technology, if can be by this with more recreation experience
Control mode is dissolved in intelligent domestic system, and the household for opening up brand-new is used into innovation mode.With regard to the long-range of smart home
For control, the manipulation on such as smart mobile phone at present, and can not be very straight mainly in units of one-to-one DeviceMode
Watch the real equipment implementation status at scene.Checking if desired just must individually transfer the shooting dress of for example indoor arrangement
Put, this mode is neither directly perceived, and experience sense is also bad, comparatively compare solidification single.The present invention will design a kind of more real
When, directly perceived, experience mode more preferably smart home control mode.
The content of the invention
The technical problem that the present invention first has to solve is to propose a kind of base for technical problem present in prior art
In figure capture home equipment control system, including：Figure acquisition equipment, is configured to real-time monitoring and regards in its monitoring
The working condition of at least one controlled home equipment in open country, wherein the controlled home equipment is the networking being remotely controllable
Equipment；Graphical interfaces generating means, are configured to recognize what figure acquisition equipment was captured when control instruction is received
The identification information of controlled home equipment and presentation is visualized in current Graphics；In the controlled home equipment position corresponding position life
Into simulated controlling interface；And processor, it is configured to be superimposed to the simulated controlling interface corresponding controlled
In order to touch-control at the figure of home equipment.
In addition, the home equipment control system may also include client and remote server, user can pass through the client
Figure acquisition equipment described in the remote opening of end, working as by controlled plant described in the figure acquisition equipment energy real-time video monitoring
Front working condition, meanwhile, the figure acquisition equipment has recognition capability, and can capture in monitoring range described controlled sets
Standby information, and the dummy model and relevant parameter of the controlled plant are directly displayed on monitored picture.Further, user is in institute
State directly the dummy model of the controlled plant can be controlled on monitored picture, and the parameter to the controlled plant is entered
Row is arranged.
Further, the figure acquisition equipment has recognition capability, is carried out by the image on ground in monitoring range
Fuzzy technology and identification, can distinguish different device types, such as air-conditioning, TV, curtain, light fixture, and the result to recognizing
Compare with the data of server storage, obtain default virtual device models and relevant parameter, and then virtually set described
Standby model and relevant parameter are displayed in an intuitive fashion on the monitored picture, the exhibition in the way of a kind of augmented reality
Show.
Further, the controlled plant connects such as the Internet by wired or/and wireless mode, and accesses long-range clothes
Business device, the device model of controlled plant described in the remote server storage, the device model includes virtual 3d model, equipment
Information, equipment state, controllable parameter etc..
Another technical problem to be solved by this invention is to provide a kind of home control equipment captured based on figure, bag
Include：Figure acquisition equipment, is configured to real-time monitoring at least one receiving in the monitoring visual field of the figure acquisition equipment
Control home equipment working condition, wherein the controlled home equipment be remotely controllable can networked devices；Controller, quilt
It is configured to that the current Graphics that figure acquisition equipment is captured are divided into into multiple blocks when control instruction is received, it is determined that often
Controlled home equipment in one block；The corresponding identification information of the controlled home equipment is generated according to the determination；And letter
Number R-T unit, be configured can for needed for sensing the alignment angle of the controlled home equipment of control and reception or transmitting data.
Further, the home control equipment is installed in embedded metope, and such as its profile can be that installation by adhering exists
Switch panel in body of wall.
Further, when the remotely control is included in the figure acquisition equipment alignment controlled home equipment：It is logical
Cross the signal receiving/transmission device arranged on the figure acquisition equipment and carry out emission control instruction, the wherein signal receiving/transmission device has and figure
Shape acquisition equipment identical alignment angle；Or, by mobile data network come emission control instruction.
The technical problem that the present invention can also be solved is to provide a kind of home equipment control method captured based on figure, its
It is characterised by including：The work shape of real-time monitoring several controlled home equipments in the monitoring visual field of the figure acquisition equipment
State, wherein the controlled home equipment be remotely controllable can networked devices；Recognize when control instruction is received and caught
The identification information of controlled home equipment described in the current Graphics for obtaining simultaneously is visualized presentation；What is recognized in the figure receives
Control home equipment generates simulated controlling interface at position；The simulated controlling interface is superimposed to into the controlled family of correspondence presentation
Occupy at the figure of equipment in order to touch-control.
The invention has the beneficial effects as follows：The present invention utilizes monitoring remote video and image recognition technology, in monitoring range
Controlled plant carry out automatic identification, and can strengthening virtual reality by way of be presented on monitored picture and can control.Solution
Certainly current smart home mobile phone can not very can be visually seen the real equipment implementation status at scene, and neither intuitively, experience sense is bad
Problem.
Description of the drawings
Fig. 1 is the frame diagram of the control system of the present invention.
Fig. 2 is the schematic diagram of the control device of the present invention.
Specific embodiment
Technical scheme is further described in detail with reference to embodiments, in each embodiment of the invention
The feature of appearance, key element and component etc. will be presented by way of example, but be not the restrictions to technical solution of the present invention.
In addition, these features for occurring in text and accompanying drawing in each of the lower, key element and component are with multiple, and in order to represent it is convenient and
Different symbol or numeral are marked, but represents the part of same or similar construction or function.
The process illustrated in the accompanying drawing appended by this specification is by including hardware（Such as circuit, special logic chip list
Unit etc.）, firmware（Run such as on fexible unit or special purpose machinery）Or the process logic execution of the combination of both.Although
Describe to process based on the following some order operations, but it is understood that the operation of some descriptions can be performed in different order.In addition,
Certain operations can be executed in parallel rather than be sequentially performed.
In addition, in specification and claims appended by the present invention, using term " coupling " and " coupling " and its can spread out
New word.It is to be understood by the skilled artisans that these terms are not intended as mutual synonym." coupling " is used for instruction each other can be direct
Physical contact or electrical contact or can not direct physical contact or electrical contact two or more elements co-operate each other or
Interact." connection " is used to represent the foundation of the communication between two or more elements coupled to each other.
The example of the present invention can trigger control process by manipulating electronic equipment, and the example of electronic equipment can be appointed
The digital equipment of what form, terminology used in this article " electronic equipment " is generally referred to can be in response to wireless network
The request of data link or data pair simultaneously subsequently with other electronic equipments or signal transducer, transceiver sets up data pair
Or any logic circuit shaken hands.
In one embodiment, electronic equipment can also use the home equipment of other input/output passages and user
Exchange data information.The example of other input/output passages is included in audio cable input and outgoing route（For example audio frequency connects
Mouthful）On analogue signal；Photographing unit, two-dimensional code reader or other camera input equipments combined with image dissector；Can
To generate the display output device of computer-readable image；Sensor, such as accelerometer, gyroscope or proximity detector
（Such as pass through position sensor）, can be using the motion of electronic equipment, direction or position come to electronic equipment input information；
Black light（Such as infrared light）Detector and/or emitter, supersonic detector and/or emitter etc..For example,
Electronic equipment can be mobile phone, kneetop computer or the personal digital assistant that user is held（PDA）Equipment etc..
With reference to Fig. 1, in terms of one total, the home equipment control system captured based on figure can pass through user's handss
Communication coupling between the electronic equipment held and home equipment realizes that the data that in addition some needs are called are storable in such as cloud
In service platform 12.In general, can be by without line number between cloud service platform 12 and controlled home equipment or electronic equipment 11
According to network（Such as Wi-Fi）Transmission data content, for example, transmit data using routing device 13.For example, electronic equipment 11 can
To be the remote control of any household indoor electric appliance equipment, remote control can pass through black light（Such as infrared light）Mode launch control
Signal processed, it is also possible to by other radio frequencies（RF）Mode is sending control instruction.In addition, remote control can be used for receive from
The response of home equipment, meanwhile, these responses can by any way be prompted to user, for example, more compact visualized operation
Interface, the mode such as audio frequency the tinkle of bells or vibration.
One or more integrated circuits（Such as traditional microprocessor or controller）Can be used to realize data processing
Operation.In various embodiments, processor may be in response to program code（Such as client software）To perform various steps, and
Can keep it is multiple while or multithreading perform process step.The some or all journey performed within any given time
Sequence code can be resided in the data processing circuit and/or in the storage medium of attachment.In the embodiment shown in Fig. 2
In, said system generally may include：
（1）Figure acquisition equipment 14, be configured to real-time monitoring in the figure acquisition equipment 14 monitoring visual field in several
The working condition of controlled home equipment, wherein the controlled home equipment be remotely controllable can networked devices.For example, scheme
Shape acquisition equipment 14 can at least be disposed with the optical modules such as camera assembly, such as microcam, lightweight camera for shooting
Domestic environment figure, or video can be shot.
In certain embodiments, figure acquisition equipment 14 there also is provided the miscellaneous part with the camera assembly coupling, for example,
Shooting adjusting part can be disposed with, for the shooting angle of camera assembly being adjusted according to user's manipulation or visual field model can be shot
Enclose.In addition, the figure acquisition equipment 14 there also is provided figure adjusting part, for adjusting in captured domestic environment figure
Hold, such as pattern distortion adjustment, shading value, setting contrast.
（2）Graphical interfaces generating means 112, the control for being configured to be produced in the control input for receiving such as user refers to
The identification information of controlled home equipment described in captured current Graphics is recognized when making and presentation is visualized；And at this
Simulated controlling interface is generated at the controlled home equipment position recognized in figure.
For example, Fig. 2 shows the figure 1 that the end of electronic equipment 11 visualization in user is presented, and user expects to monitor the figure
The domestic environment within the vision showed in shape.In this case, indoor environment contains such as lamp 2, window 3 and air conditioner 4,
The equipment presented in the figure is controlled home equipment, can receive control instruction by wireless network.
The simulated controlling interface 100 for user's manipulation is produced by the graphical interfaces generating means 112, in figure 1
In identify multiple controlling interface contents 101,102,103 and 104, the controlled home equipment that each is occurred in figure 1
Identify, so as to produce an additional controlling interface content, in the graphical interfaces of the electronic equipment 11 for being used to present to user
On, controlling interface content can produce the effect incorporated in figure 1 for example, by depth signal is increased, thus, captured figure
Shape 1 is arranged as a background color figure.
（3）Processor 111, is configured to that the simulated controlling interface 100 is superimposed to the controlled household of correspondence presentation
In order to touch-control at the figure 1 of equipment.Thus, during controlled home equipment in user's touch-control figure 1, can directly touch institute's phase
Hope the position of the home equipment of control, such as lamp 2, so as to intuitively control lamp 2.
In one embodiment, the graphical interfaces generating means 112 are additionally configured at least recognize the monitoring visual field
The gabarit of interior figure 1 at least recognizes the controlling feature of the controlled home equipment presented in the figure.For example, figure circle
Face generating means 112 can recognize the view parameter of above-mentioned camera assembly according to the content of shooting of figure 1, or, the shooting
Adjusting part can be configured to detect the field-of-view angle that the camera assembly is aligned every time when shooting.Thus, shooting every time
Figure 1 in, each controlled home equipment can be determined according to the view parameter（Such as air conditioner 4）Three-dimensional gabarit, for
For the controlled home equipment of different visual angles, it is special that the simulation process to home equipment model is simplified by the view parameter
Effectively.
In some implementations, the shooting process of monitoring is successional, when such as user input determines the instruction of control,
Graphical interfaces generating means 112 can be configured to mould of the content of multiple figures 1 that basis is continuously shot to controlled home equipment
Type is identified.For first, graphical interfaces generating means 112 sense such as regular geometric shape that may be present in figure 1
Shape object or the object with transition activities, such as curtain 301, in general, above-mentioned model is storable in storage medium 114
Or in cloud service platform 12, in certain embodiments, can at least identify a home equipment（Such as lamp 2）Partial shape it is special
Point or acting characteristic（For example light）So that it is determined which kind of home equipment the model belongs to, thus, in terms of some Optimal improvements,
The processor 111 is additionally configured to be adjusted the controlled home equipment that each determines the configuration of parameter, is such as knowing
The possible regulation parameter of the lamp is configured in the case of not going out lamp 2, the interior perhaps control key of configuration can be in above-mentioned controlling interface
Synchronously present in content.
In one embodiment, the remotely control is included in the figure acquisition equipment and is directed at the controlled home equipment
When：
（1）Instructed come emission control by the signal receiving/transmission device 113 arranged on the figure acquisition equipment 14, wherein the signal is received
Transmitting apparatus 113 have and the identical alignment angle of figure acquisition equipment 14.According to previous embodiment, figure acquisition equipment 14 can have
There are other parts in addition to camera assembly, for example, adjusting part scalable shooting visual angle is shot, thus, optimal in order to realize
Signal launch angle, the location arrangements by signal receiving/transmission device 113 are Chong Die with camera assembly, when user focuses on a certain household
During equipment, directly emission control instruction can be directed at by figure acquisition equipment 14.
（2）By mobile data network come emission control instruction.In some implementations, home equipment can direct communication link
To the end of electronic equipment 11, for example user out of doors when, for the home equipment application that some are fixed, realizing the same of the touch-control
When directly for example, by 4G-LTE technologies send control operator to required control home equipment, such as air conditioner 4.
In another embodiment, such home control can be also arranged in the domestic environment that for example figure 1 is presented
Equipment, thus, each home equipment Model Identification, household control can be completed between home equipment by way of direct interaction
Control equipment may include：
（1）Figure acquisition equipment 14, be configured to real-time monitoring in the figure acquisition equipment 14 monitoring visual field in several
The working condition of controlled home equipment, wherein the controlled home equipment be remotely controllable can networked devices；
（2）The controller of the figure acquisition equipment 14 is coupled, is configured to current by what is captured when control instruction is received
Graphical demarcation is multiple blocks, determines the controlled home equipment in each block；Determine the generation controlled household according to described
The corresponding identification information of equipment.
For example, directly multiple basic blocks can be divided into when 1 content of figure is calculated, so as to being in each block
Existing content carries out independent identification.In some implementations, such as decorative environment of indoor arrangement can directly be deleted by controller, root
Can determine whether to there is home equipment according to the content in block, in addition, the locus stored when installing also dependent on home equipment
To determine region of the home equipment in the visual field of figure 1, thus, controlling interface content, example can directly be produced in the controller end
As shown in Figure 2 in interface 100, lamp 2 can simultaneously be presented in controlling interface content 103 in 104, and air conditioner 4 can be on control circle
Present in face content 101, for window 3, due to the figure that there are multiple windows, therefore for controllable window 3, can lead to
The installation site in storage medium 114 is stored in when crossing installation window 3 to identify to combine；And
（3）The signal receiving/transmission device 113 of the controller is coupled, the alignment of the controlled home equipment of control needed for being configured to sense
Visual angle simultaneously receives or launches data.For example, because the home equipment of user's desired control may not exist in captured figure 1
In the visual field, therefore when user expects to adjust a home equipment（Such as television set）When, signal receiving/transmission device 113 can receive from
The request signal of this home equipment, and guide user to move visual angle to focusing on visual angle.
In certain embodiments, the home control equipment is installed in embedded metope.Controlled can set for example shown in Fig. 1
The light fixture 16 put, curtain 17, air conditioner 18 or television set 19, in these home equipments, some are can be embedded in arranging graphic to catch
Obtain device 14.
Further, since the seriality of supervisory control action, thus the control operation and operational feedback of user be also it is successional, because
This, for control feedback can be performed directly by other home equipments.In an example, user desire to control curtain
301 is drop-down, then can be realized by the position of touch-control curtain 301.And in the case, if ambient room light is not enough,
The controller is configured to increase prompt identifier on above-mentioned interface 100, thus, can when electronic equipment 11 is passed to
Presentation user's information on interface 100, meanwhile, in order to give the effect of user monitoring operation, such as in drop-down curtain 301
Afterwards, controller can turn off the conductive path of figure adjusting part, and in order to user such as lamp 2 is more intuitively adjusted, while by
Prompting is given on interface 100 in, user can select which kind of lamp 2 opened according to prompting.
In another example, indoor environment can be obtained and fed back by other home equipments outside the visual field of figure 1
User.For example, air conditioner 4 after unlatching to air adjustment for a period of time after, regulation parameter can be for example, by room thermostat 5
Obtain, such as temperature/humidity, then room thermostat 5 can transmit feedback signal to electronic equipment 11 or figure by routing device 13
Shape acquisition equipment 14, makes user know that regulation is completed.
In addition, being based on above-described embodiment, the home equipment control method captured based on figure may include：
The working condition of S100, real-time monitoring several controlled home equipments in the monitoring visual field of the figure acquisition equipment,
Wherein described controlled home equipment be remotely controllable can networked devices；
S200, recognize when control instruction is received the identification information of controlled home equipment described in captured current Graphics simultaneously
Visualized presentation；
Simulated controlling interface is generated at S300, the controlled home equipment position recognized in the figure；And
S400, by the simulated controlling interface be superimposed to correspondence presentation controlled home equipment figure in order to touch-control.
In some variations, also include at least recognizing in the figure 1 in the monitoring visual field in described method S200
The gabarit of such as home equipment at least recognizes the controlling feature of the controlled home equipment presented in the figure 1.
In one embodiment, the remotely control is included in the figure acquisition equipment and is directed at the controlled home equipment
When：Instructed come emission control by the signal receiving/transmission device arranged on the figure acquisition equipment, wherein signal receiving/transmission device tool
Have and figure acquisition equipment identical alignment angle；By mobile data network come emission control instruction.
Above-described specific embodiment has been described in detail to technical scheme and beneficial effect, Ying Li
Solution is to the foregoing is only presently most preferred embodiment of the invention, is not limited to the present invention, all principle models in the present invention
Interior done any modification, supplement and equivalent etc. are enclosed, be should be included within the scope of the present invention.
Claims (10)
1. it is a kind of based on figure capture home equipment control system, it is characterised in that include：
Figure acquisition equipment, is configured to the work of at least one controlled home equipment of the real-time monitoring in its monitoring visual field
Make state, wherein the controlled home equipment is the networked devices being remotely controllable；
Graphical interfaces generating means, be configured to when control instruction is received recognize figure acquisition equipment captured work as
The identification information of controlled home equipment and presentation is visualized in front figure；Generate in the controlled home equipment position corresponding position
Simulated controlling interface；And
Processor, is configured to sentence in the figure that the simulated controlling interface is superimposed to corresponding controlled home equipment
It is easy to touch-control.
2. system according to claim 1, it is characterised in that the graphical interfaces generating means are additionally configured at least know
The gabarit of the figure in not described monitoring visual field at least recognizes that the control of the controlled home equipment presented in the figure is special
Levy.
3. system according to claim 1, it is characterised in that the remotely control is included in the figure acquisition equipment pair
During the accurate controlled home equipment：
Instructed come emission control by the signal receiving/transmission device arranged on the figure acquisition equipment, wherein signal receiving/transmission device tool
Have and figure acquisition equipment identical alignment angle；
Or, by mobile data network come emission control instruction.
4. system according to claim 1, it is characterised in that the home equipment control system also includes client and remote
Journey server, described client passes through network connection to remote server, and remote server accesses figure by routing device
Acquisition equipment.
5. it is a kind of based on figure capture home control equipment, it is characterised in that include：
Figure acquisition equipment, is configured to real-time monitoring at least one receiving in the monitoring visual field of the figure acquisition equipment
Control home equipment working condition, wherein the controlled home equipment be remotely controllable can networked devices；
Controller, is configured to when control instruction is received to divide into the current Graphics that figure acquisition equipment is captured many
Individual block, determines the controlled home equipment in each block；Determine that generating the controlled home equipment marks accordingly according to described
Knowledge information；And
Signal receiving/transmission device, be configured can for sensing needed for control controlled home equipment alignment angle and reception or transmitting number
According to.
6. home control equipment according to claim 5, it is characterised in that the home control equipment is peace in embedded metope
Dress.
7. home control equipment according to claim 5, it is characterised in that the remotely control is included in the figure and catches
When obtaining the device alignment controlled home equipment：
Instructed come emission control by the signal receiving/transmission device arranged on the figure acquisition equipment, wherein signal receiving/transmission device tool
Have and figure acquisition equipment identical alignment angle；
Or, by mobile data network come emission control instruction.
8. it is a kind of based on figure capture home equipment control method, it is characterised in that include：
The working condition of real-time monitoring several controlled home equipments in the monitoring visual field of the figure acquisition equipment, wherein institute
State controlled home equipment be remotely controllable can networked devices；
The identification information of controlled home equipment described in captured current Graphics and in addition is recognized when control instruction is received
Visualization is presented；
Simulated controlling interface is generated at the controlled home equipment position recognized in the figure；And
The simulated controlling interface is superimposed at the figure of the controlled home equipment of correspondence presentation in order to touch-control.
9. method according to claim 8, it is characterised in that also including the figure at least recognized in the monitoring visual field
Gabarit at least recognizes the controlling feature of the controlled home equipment presented in the figure.
10. method according to claim 8, it is characterised in that the remotely control is included in the figure acquisition equipment
When being directed at the controlled home equipment：
Instructed come emission control by the signal receiving/transmission device arranged on the figure acquisition equipment, wherein signal receiving/transmission device tool
Have and figure acquisition equipment identical alignment angle；
Or, by mobile data network come emission control instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610893153.2A CN106569409A (en) | 2016-10-13 | 2016-10-13 | Graph capturing based household equipment control system, device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610893153.2A CN106569409A (en) | 2016-10-13 | 2016-10-13 | Graph capturing based household equipment control system, device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106569409A true CN106569409A (en) | 2017-04-19 |
Family
ID=58531759
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610893153.2A Pending CN106569409A (en) | 2016-10-13 | 2016-10-13 | Graph capturing based household equipment control system, device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106569409A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107132769A (en) * | 2017-04-21 | 2017-09-05 | 北京小米移动软件有限公司 | Smart device control method and device |
| CN107817701A (en) * | 2017-09-20 | 2018-03-20 | 珠海格力电器股份有限公司 | Equipment control method and device, computer readable storage medium and terminal |
| CN108063825A (en) * | 2017-12-26 | 2018-05-22 | 三星电子（中国）研发中心 | A kind of remote assistance method |
| CN109426165A (en) * | 2017-08-29 | 2019-03-05 | 珠海格力电器股份有限公司 | Control method and equipment of intelligent household appliance |
| CN110336719A (en) * | 2019-06-03 | 2019-10-15 | 武汉工程大学 | A remote smart home control method for real-time video home environment device identification and interaction |
| WO2022028537A1 (en) * | 2020-08-05 | 2022-02-10 | 华为技术有限公司 | Device recognition method and related apparatus |
| CN114079691A (en) * | 2020-08-05 | 2022-02-22 | 华为技术有限公司 | Equipment identification method and related device |
| CN119941236A (en) * | 2025-04-03 | 2025-05-06 | 中科北纬(北京)科技有限公司 | A wearable device capable of object recognition based on virtual reality |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110115816A1 (en) * | 2009-11-16 | 2011-05-19 | Alliance For Sustainable Energy, Llc. | Augmented reality building operations tool |
| CN102413182A (en) * | 2011-11-17 | 2012-04-11 | 南京天溯自动化控制系统有限公司 | Intelligent household equipment remote monitoring device and method |
| CN102754038A (en) * | 2010-02-09 | 2012-10-24 | Somfy两合公司 | Control device operating method for home automation facility |
| CN103869761A (en) * | 2012-12-14 | 2014-06-18 | 海尔集团公司 | Household appliance control method and control system |
| CN104536397A (en) * | 2014-12-09 | 2015-04-22 | 中国电子科技集团公司第十五研究所 | 3D virtual smart home interaction method |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN105549403A (en) * | 2015-12-23 | 2016-05-04 | 南京物联传感技术有限公司 | Visual scene control method based on camera |
| WO2016106227A1 (en) * | 2014-12-22 | 2016-06-30 | Trane International Inc. | Systems and methods for provisioning components of an hvac system |
| CN105739315A (en) * | 2016-02-02 | 2016-07-06 | 杭州鸿雁电器有限公司 | Indoor user electric appliance equipment control method and device |
| CN105843054A (en) * | 2016-03-22 | 2016-08-10 | 美的集团股份有限公司 | Method for controlling household devices, intelligent household system and mobile device |
-
2016
- 2016-10-13 CN CN201610893153.2A patent/CN106569409A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110115816A1 (en) * | 2009-11-16 | 2011-05-19 | Alliance For Sustainable Energy, Llc. | Augmented reality building operations tool |
| CN102754038A (en) * | 2010-02-09 | 2012-10-24 | Somfy两合公司 | Control device operating method for home automation facility |
| CN102413182A (en) * | 2011-11-17 | 2012-04-11 | 南京天溯自动化控制系统有限公司 | Intelligent household equipment remote monitoring device and method |
| CN103869761A (en) * | 2012-12-14 | 2014-06-18 | 海尔集团公司 | Household appliance control method and control system |
| CN104977904A (en) * | 2014-04-04 | 2015-10-14 | 浙江大学 | Visible and controllable intelligent household control system and control method thereof |
| CN104536397A (en) * | 2014-12-09 | 2015-04-22 | 中国电子科技集团公司第十五研究所 | 3D virtual smart home interaction method |
| WO2016106227A1 (en) * | 2014-12-22 | 2016-06-30 | Trane International Inc. | Systems and methods for provisioning components of an hvac system |
| CN105549403A (en) * | 2015-12-23 | 2016-05-04 | 南京物联传感技术有限公司 | Visual scene control method based on camera |
| CN105739315A (en) * | 2016-02-02 | 2016-07-06 | 杭州鸿雁电器有限公司 | Indoor user electric appliance equipment control method and device |
| CN105843054A (en) * | 2016-03-22 | 2016-08-10 | 美的集团股份有限公司 | Method for controlling household devices, intelligent household system and mobile device |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107132769A (en) * | 2017-04-21 | 2017-09-05 | 北京小米移动软件有限公司 | Smart device control method and device |
| CN109426165A (en) * | 2017-08-29 | 2019-03-05 | 珠海格力电器股份有限公司 | Control method and equipment of intelligent household appliance |
| CN107817701A (en) * | 2017-09-20 | 2018-03-20 | 珠海格力电器股份有限公司 | Equipment control method and device, computer readable storage medium and terminal |
| CN107817701B (en) * | 2017-09-20 | 2020-09-29 | 珠海格力电器股份有限公司 | Equipment control method and device, computer readable storage medium and terminal |
| CN108063825A (en) * | 2017-12-26 | 2018-05-22 | 三星电子（中国）研发中心 | A kind of remote assistance method |
| CN108063825B (en) * | 2017-12-26 | 2020-11-20 | 三星电子（中国）研发中心 | A remote assistance method |
| CN110336719A (en) * | 2019-06-03 | 2019-10-15 | 武汉工程大学 | A remote smart home control method for real-time video home environment device identification and interaction |
| CN110336719B (en) * | 2019-06-03 | 2021-10-12 | 武汉工程大学 | Remote intelligent home control method for real-time video home environment equipment identification interaction |
| WO2022028537A1 (en) * | 2020-08-05 | 2022-02-10 | 华为技术有限公司 | Device recognition method and related apparatus |
| CN114079691A (en) * | 2020-08-05 | 2022-02-22 | 华为技术有限公司 | Equipment identification method and related device |
| CN114079691B (en) * | 2020-08-05 | 2022-11-04 | 华为技术有限公司 | A device identification method and related device |
| CN119941236A (en) * | 2025-04-03 | 2025-05-06 | 中科北纬(北京)科技有限公司 | A wearable device capable of object recognition based on virtual reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106569409A (en) | Graph capturing based household equipment control system, device and method | |
| CN104597759B (en) | Appliance control method and system and intelligent household management system based on Internet video | |
| CN109088803B (en) | An AR remote control device, smart home remote control system and method | |
| JP4491495B2 (en) | User interface system based on pointing device | |
| CN107703872B (en) | Terminal control method and device of household appliance and terminal | |
| JP2009134718A5 (en) | ||
| KR102121785B1 (en) | Air-conditioner controlling direction of the wind using artificial intelligence by instructed position and method of controlling thereof | |
| CA3013523C (en) | Home automation system | |
| US20160065828A1 (en) | Method for controlling electronic device using ip camera having function of wireless remote controller | |
| Vanitha et al. | Monitoring and controlling of mobile robot via internet through raspberry Pi board | |
| CN105843054A (en) | Method for controlling household devices, intelligent household system and mobile device | |
| CN106094540A (en) | Electrical equipment control method, device and system | |
| CN106648297A (en) | Intelligent device control method and device based on VR device | |
| CN107290972A (en) | Apparatus control method and device | |
| CN106406132A (en) | Equipment control method and equipment control system | |
| CN109857129A (en) | A method, device, mobile terminal and storage medium for controlling electronic equipment | |
| CN107817701B (en) | Equipment control method and device, computer readable storage medium and terminal | |
| CN112413827A (en) | Intelligent air conditioner and information display method and device thereof | |
| CN108803371A (en) | A kind of control method and device of electrical equipment | |
| CN208723929U (en) | An AR remote control | |
| CN108131790A (en) | Control method and device of air conditioner, storage medium and processor | |
| CN209514548U (en) | AR search device, item search system based on AR search device | |
| TWI706656B (en) | Visualized household appliance control system and method | |
| CN118689305A (en) | A smart home interaction method based on augmented reality technology | |
| CN105261200A (en) | Remote controller and control method and device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170419 |