CN108880932B - Interface display method, terminal device and computer readable storage medium - Google Patents
Interface display method, terminal device and computer readable storage medium Download PDFInfo
- Publication number
- CN108880932B CN108880932B CN201810543762.4A CN201810543762A CN108880932B CN 108880932 B CN108880932 B CN 108880932B CN 201810543762 A CN201810543762 A CN 201810543762A CN 108880932 B CN108880932 B CN 108880932B
- Authority
- CN
- China
- Prior art keywords
- parameter information
- household equipment
- display
- image information
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0677—Localisation of faults
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Environmental & Geological Engineering (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an interface display method, a terminal device and a computer readable storage medium, wherein the interface display method for the terminal device with a camera device comprises the following steps: acquiring image information acquired by a camera device; determining parameter information corresponding to the household equipment in the image information; a display position corresponding to the home appliance is determined in the image information, and the parameter information is displayed at the display position. The scheme of the invention solves the problem that the parameter information of the household equipment cannot be displayed in real time according to the image information of the household equipment, can realize the real-time display of the parameter information of the household equipment at the display position corresponding to the household equipment in the image information, has more visual and concrete parameter information display of the household equipment, is more convenient and faster for a user to use, is convenient for the user to further know the principle of the household equipment and timely judge the fault part of the household equipment through the parameter information when the household equipment is in fault so as to quickly report and repair.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to an interface display method, a terminal device, and a computer-readable storage medium.
Background
In the use process of household equipment such as an air conditioner, a display interface is generally required to display the working state of the household equipment.
In the prior art, after a user controls a household device to work, on a state display interface of the household device, only working stages (such as heating, cooling and target temperature of an air conditioner) of the household device are often displayed to feed back the user, so that the user can adjust the household device to a proper working state as required.
However, the inventors of the present application have found that the above-mentioned techniques have at least the following technical problems:
the user can only obtain the rough running state of the household equipment through the display interface, and when the household equipment breaks down, the user cannot judge the fault part of the household equipment through the display interface.
Disclosure of Invention
The embodiment of the application provides an interface display method, so that the problem that parameter information of household equipment cannot be displayed in real time according to image information of the household equipment in the prior art is solved, the parameter information of the household equipment is displayed at a display position corresponding to the household equipment in real time in the image information, and a user can conveniently and accurately judge the running state of the household equipment and eliminate the fault of the household equipment.
An embodiment of a first aspect of the present application provides an interface display method, for a terminal device having an image pickup apparatus, including: acquiring image information acquired by a camera device; determining parameter information corresponding to the household equipment in the image information; a display position corresponding to the home appliance is determined in the image information, and the parameter information is displayed at the display position.
In the scheme, the terminal equipment acquires image information through the camera device, determines the position information of the household equipment through the image information and displays the parameter information of the household equipment at the position information, so that the parameter information of the household equipment displayed by the corresponding household equipment is displayed in the image information of the terminal equipment in real time, a user can conveniently and quickly know the working state of the household equipment, and the user can quickly adjust the state of the household equipment according to the working state of the household equipment.
Specifically, the interface display method is used for a terminal device with a camera device, the terminal device collects image information through the camera device, the terminal device determines a household device in the image information according to the image information, and further determines parameter information of the household device, wherein the parameter information can be obtained by directly querying the household device or querying a device (such as a remote controller of the household device) associated with the household device. The terminal device then determines a display position of the parameter information of the home device in the image information and displays the parameter information at the display position to display the parameter information of the home device in the image information corresponding to the display position of the home device after the terminal device obtains the image information.
Further, it can be understood that the display position corresponds to the home device, when the angle or position of the camera device changes, the position of the home device in the image information changes, so that the display position of the parameter information can be adjusted in real time according to the change of the position of the home device when the image information changes, when a plurality of home devices are provided, the user can easily determine the parameter information corresponding to each home device, and the use is more convenient. Meanwhile, the parameter information corresponds to the working state of the household equipment, when the working state of the household equipment is changed, the parameter information also correspondingly changes, at the moment, the parameter information can be updated in real time while the display position of the parameter information is updated in real time in the image information, a user can know the working state of the whole household equipment and the working states of all parts of the household equipment in real time according to the parameter information, and at the moment, the method can be realized as follows: firstly, the user can deeply understand the working principle, the internal structure and the like of the household equipment by corresponding the parameter information with the working state; secondly, when the household equipment breaks down, the user can quickly determine the fault position of the household equipment according to the change of the parameter information, so that the user can quickly and accurately report the fault position.
In the above embodiment, preferably, before determining the parameter information corresponding to the home appliance in the image information, the method further includes: displaying image information in a display area of a terminal device; and determining the augmented reality display graph of the household equipment in the image information.
In the scheme, after the terminal equipment acquires the image information through the camera device, the image information is displayed in the display area of the terminal equipment, then the household equipment in the image information is determined according to the image information, then the augmented reality display graph of the household equipment is determined, and the augmented reality display graph of the household equipment is displayed in the image information of the display area, so that the display of the household equipment in the image information is more visual, a user can observe each part inside the household equipment according to the augmented reality display graph of the household equipment, the user can have deeper understanding on the household equipment, further, the parameter information corresponds to each part of the household equipment respectively, and the display of each part of the household equipment is more visual.
In any of the above embodiments, preferably, when the home appliance operates, the interface display method further includes: and displaying the running state of the household equipment in the augmented reality display graph.
According to the scheme, after the augmented reality display graph of the household equipment is determined, the running state of the household equipment is displayed in the augmented reality display graph, at the moment, a user can know the working state of the household equipment through the augmented reality display graph of the household equipment, and image information is displayed more visually; when the meaning that the user represented to the parameter information is not enough known, the user only needs to show the figure through the augmented reality and can know the operating condition of domestic appliance, and the user uses conveniently.
In any of the above embodiments, preferably, determining parameter information corresponding to the home device in the image information specifically includes: analyzing pixel information in the image information; comparing the pixel information with preset pixel information stored in a preset database, and determining the household equipment corresponding to the pixel information; and acquiring the running state of the household equipment, and determining the parameter information according to the running state.
According to the scheme, after the terminal device acquires the image information, the pixel information in the image information is analyzed, the pixel information is compared with the preset pixel information in the preset database, so that the household device corresponding to the pixel information is determined through the preset pixel information, it can be understood that when part or all of the pixel information is matched with the preset pixel information, the household device corresponding to the preset pixel information is determined to be included in the image information, and the characteristics of the household device included in the preset pixel information include but are not limited to the outline of the household device and the color characteristics of the household device.
In any of the above embodiments, preferably, the displaying the parameter information in the image information corresponding to the display position of the home appliance specifically includes: determining the display position of the household equipment in the image information; determining a display direction and a display distance of the parameter information corresponding to the display position of the household equipment; and displaying the parameter information at the display position in the display direction and the display distance.
In the scheme, after parameter information of the household equipment is determined, the display position of the household equipment in the image information is determined according to the position of the household equipment in the image information, then the display direction and the display distance of the parameter information corresponding to the display position are determined, then the parameter information is displayed at the display position according to the display direction and the display distance, so that the parameter information can be displayed corresponding to the position and the direction of the household equipment in the image information, the parameter information displayed in the image information can be attached to the household equipment in the image information, when a plurality of household equipment are arranged in the image information, a user can more easily correspond the household equipment to the parameter information, and the possibility that the user confuses the parameter information with the household equipment is reduced. Further, when the augmented reality display graph of the household device is displayed on the terminal device, the parameter information can also correspond to each part of the household device, and therefore a user can know the corresponding relation between the parameter information of the household device and each part of the household terminal and the parameter information conveniently.
In any of the above embodiments, preferably, the displaying the parameter information in the image information corresponding to the display position of the home appliance specifically includes: determining the display position of the household equipment in the image information; determining a display sequence of the parameter information according to the display position of the household equipment; the parameter information is displayed at the display position in the display order.
In the scheme, after the parameter information is determined, the display position of the household equipment in the image information is determined firstly, then the display sequence of the parameter information is determined according to the display position (for example, the parameter information is displayed sequentially from left to right or from top to bottom), the parameter information is displayed at the display position in the display sequence, and the parameter information is displayed in the display sequence, so that the parameter information can be displayed according to the shape of the household equipment (for example, the parameter information is displayed sequentially from top to bottom when the height of the household equipment is higher, and the parameter information is displayed sequentially from left to right when the household equipment is transversely arranged), the display position (for example, the parameter information is displayed sequentially from top to bottom along the edge or from left to right when the display position is positioned at the edge of the image information), and the position relation between different household equipment (for example, the distance between two household equipment is smaller, and the parameter information of the two household equipment uses different display sequences to reduce the display sequence Few users confuse parameter information of two home appliances). Further, when the augmented reality display graph of the household device is displayed on the terminal device, the parameter information is displayed at the display position in the display sequence so that the parameter information corresponds to each part of the household device, and a user can know the corresponding relation between the parameter information of the household device and each part of the household terminal and the parameter information conveniently.
In any of the above embodiments, preferably, the method further includes: receiving an adjusting instruction of the parameter information; determining a change value of the parameter information according to the adjusting instruction; the variation value of the parameter information is displayed at the display position.
In the scheme, when a user needs to adjust the working state of the household equipment, the working state of the household equipment is adjusted through the terminal equipment. The terminal equipment receives the adjusting instruction of the parameter information, then determines the change value of the parameter information according to the adjusting instruction and displays the change value of the parameter information at the display position, so that the change of the parameter information of the household equipment can be intuitively known when a user adjusts the household equipment, and the user can conveniently and accurately adjust the working state of the household equipment.
In any of the above embodiments, preferably, the parameter information specifically includes: device parameters of the household device; and/or environmental parameters of the environment in which the household appliance is located.
In the scheme, when the parameter information comprises the equipment parameters (such as the working time and the performance index of the household equipment) of the household equipment, a user can know the working state of the household equipment in time according to the parameter information; when the parameter information includes the environmental parameter of domestic equipment place environment, the user can know the environmental parameter of domestic equipment place environment through parameter information to in the user adjusts domestic equipment's operating condition according to environmental parameter, promote user's comfort level.
The technical solution of the second aspect of the present invention provides a terminal device, which includes a memory, a processor, and a computer program that is stored in the memory and can be run on the processor, and when the processor executes the computer program, the interface display method in any embodiment of the first aspect is implemented.
In this scheme, when the computer program on the memory of the terminal device is executed by the processor of the terminal device, the interface display method in any embodiment of the first aspect can be implemented, and the parameter information of the home device can be displayed at the display position corresponding to the home device in real time in the image information.
An aspect of the third aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the interface display method in any embodiment of the first aspect.
In this scheme, when the computer program is executed by the processor, the interface display method in any embodiment of the first aspect can be implemented, and parameter information of the home appliance can be displayed at a display position corresponding to the home appliance in real time in the image information, the parameter information of the home appliance is displayed visually and specifically, the user can use the method more conveniently, the user can further know the principle of the home appliance and can judge a fault position of the home appliance in time through the parameter information when the home appliance breaks down, and therefore the user can report the fault position quickly.
One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
1. the household equipment is determined according to the image information, and the parameter information of the household equipment is determined at the same time, so that the problem that the parameter information of the household equipment cannot be displayed in real time according to the image information of the household equipment is effectively solved, the parameter information of the household equipment is displayed at the display position corresponding to the household equipment in real time in the image information, the parameter information display of the household equipment is visual and specific, the use is more convenient for a user, the user can further know the principle of the household equipment and can timely judge the fault position of the household equipment through the parameter information when the household equipment breaks down, and the fault position can be reported and repaired quickly.
2. Because the augmented reality display graph of the household equipment is displayed in the image information, the problem that a user cannot visually know the internal structure of the household equipment in the prior art is effectively solved, the display of the household equipment in the image information is more visual, and the user can observe each part inside the household equipment according to the augmented reality display graph of the household equipment.
3. Through the running state that shows domestic appliance in the augmented reality shows the figure, solved prior art user can only confirm domestic appliance's operating condition's through the parameter that shows problem, image information shows more directly perceived, and the user only needs to show the figure through the augmented reality and can know domestic appliance's operating condition, makes the user use more convenient.
4. The household equipment in the image information is determined by comparing the pixel information with the preset pixel information stored in the preset database, the problem that the household equipment cannot be determined directly through the image information in the prior art is solved, the household equipment in the image information can be automatically determined, the parameter information is determined according to the running state of the household equipment, a user only needs to acquire the image information through the terminal equipment, and the user can use the household equipment conveniently.
5. The parameter information is displayed at the display position according to the display direction and the display distance, so that the problem that a user easily confuses the household terminal and the parameter information in the prior art is solved, the user can more easily correspond the household equipment and the parameter information when the image information comprises a plurality of household equipment, and the possibility that the user confuses the parameter information and the household equipment is reduced.
6. The parameter information is displayed at the display position according to the display sequence, so that the problem that the parameter information occupies unreasonable space in the prior art is solved, and the parameter information is displayed according to the display sequence, so that the parameter information can be reasonably arranged according to factors such as the shape of household equipment, and the parameter information can be more reasonably displayed.
7. The problem that the household equipment is not accurately adjusted by a user in the prior art is solved by receiving the adjusting instruction and displaying the change value of the parameter information corresponding to the adjusting instruction, the change value of the parameter information is determined according to the adjusting instruction and is displayed at the display position, so that the change of the parameter information of the household equipment can be intuitively known when the user adjusts the household equipment, and the user can conveniently and accurately adjust the working state of the household equipment.
8. Through setting up the environmental parameter of the equipment parameter of domestic appliance and/or domestic appliance place environment in parameter information, solved prior art user and can only know the problem of domestic appliance's different working phase, can in time know domestic appliance's operating condition and the environmental parameter of domestic appliance place environment according to parameter information to the user adjusts domestic appliance's operating condition according to environmental parameter, promotes user's comfort level.
Drawings
Fig. 1 is a schematic flow chart of an interface display method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of an interface display method according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of an interface display method according to an aspect of the first embodiment of the present invention;
Fig. 4 is a schematic flowchart of an interface display method according to an aspect of the first embodiment of the present invention;
fig. 5 is a schematic structural diagram of a terminal device according to a second aspect of the embodiment of the present invention.
Detailed Description
According to the method and the device, the augmented reality display graph and the parameter information of the household equipment corresponding to the image information are displayed, a user can determine the state of the household equipment according to the parameter information and the augmented reality display graph, and the display is more visual and is convenient for rapidly determining the fault part when the household equipment breaks down.
For a better understanding of the above technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
In order to better understand the technical solution, the technical solution will be described in detail with reference to the drawings and the specific embodiments.
Example one
As shown in fig. 1, the present embodiment provides an interface display method for a terminal device (for example, a smartphone) having an image pickup apparatus, including: step S102, acquiring image information acquired by a camera device; step S104, determining parameter information (such as the storage amount of refrigerant of the air conditioner, the rotating speed of a fan, the power of a compressor and the like) corresponding to the household equipment (such as the air conditioner) in the image information; and step S106, determining a display position corresponding to the household equipment in the image information, and displaying parameter information at the display position, wherein the parameter information comprises equipment parameters of the household equipment.
In the scheme, the terminal equipment acquires image information through the camera device, determines the position information of the household equipment through the image information and displays the parameter information of the household equipment at the position information, so that the parameter information of the household equipment displayed by the corresponding household equipment is displayed in the image information of the terminal equipment in real time, a user can conveniently and quickly know the working state of the household equipment, and the user can quickly adjust the state of the household equipment according to the working state of the household equipment.
Specifically, in step S102, the terminal device acquires image information through the camera device, and in step S104, the terminal device determines the home device in the image information according to the image information, and further determines parameter information of the home device, where the parameter information may be obtained by directly querying the home device or by querying a device (such as a remote controller of the home device) associated with the home device. And step S106, the terminal device determines the display position of the parameter information of the household device in the image information and displays the parameter information at the display position so as to display the parameter information of the household device corresponding to the display position of the household device in the image information after the terminal device obtains the image information.
Further, it can be understood that the display position corresponds to the home appliance, when the angle or position of the camera device changes, the position of the home appliance in the image information changes, and thus the display position changes, so that the display position of the parameter information can be adjusted in real time according to the change of the position of the home appliance when the image information changes, and when a plurality of home appliances are provided, the user can easily determine the parameter information corresponding to each home appliance, and the use is more convenient. Meanwhile, the parameter information corresponds to the working state of the household equipment, when the working state of the household equipment is changed, the parameter information also correspondingly changes, at the moment, the parameter information can be updated in real time while the display position of the parameter information is updated in real time in the image information, a user can know the working state of the whole household equipment and the working states of all parts of the household equipment in real time according to the parameter information, and at the moment, the method can be realized as follows: firstly, the user can deeply understand the working principle, the internal structure and the like of the household equipment by corresponding the parameter information with the working state; secondly, when the household equipment breaks down, the user can quickly determine the fault position of the household equipment according to the change of the parameter information, so that the user can quickly and accurately report the fault position.
As shown in fig. 2, a further preferred design interface display method includes: step S202, acquiring image information acquired by a camera device; step S204, displaying image information in a display area (for example, a display screen of a smart phone) of the terminal equipment; step S206, determining an augmented reality display graph of the household equipment in the image information; step S208, displaying the running state of the household equipment in the augmented reality display graph; step S210, determining parameter information corresponding to household equipment (such as an air conditioner) in the image information; step S212, determining a display position corresponding to the household equipment in the image information, and displaying parameter information at the display position, wherein the parameter information comprises equipment parameters of the household equipment.
In the scheme, step S202 acquires image information acquired by a camera device, then step S204 displays the image information in a display area of a terminal device, step S206 determines a home device in the image information according to the image information, and determines an augmented reality display graph of the home device, step S208 displays the augmented reality display graph of the home device in the image information of the display area, so that the display of the home device in the image information is more visual, a user can observe each part inside the home device according to the augmented reality display graph of the home device, so that the user can have deeper understanding on the home device, further, parameter information corresponds to each part of the home device, and the display of each part of the home device is more visual. Step S210, displaying the running state of the household equipment in the augmented reality display graph (for example, displaying a blue line at an air outlet of the air conditioner augmented display graph to show that the air conditioner is producing cold air, and displaying a red line at the air outlet of the air conditioner augmented display graph to show that the air conditioner is producing hot air), wherein at the moment, a user can know the working state of the household equipment through the augmented reality display graph of the household equipment, and the image information display is more visual; when the meaning that the user represented to the parameter information is not enough known, the user only needs to show the figure through the augmented reality and can know the operating condition of domestic appliance, and the user uses conveniently.
Further preferably, the determining parameter information corresponding to the home appliance in the image information includes: analyzing pixel information in the image information; comparing the pixel information with preset pixel information stored in a preset database, and determining the household equipment corresponding to the pixel information; and acquiring the running state of the household equipment, and determining the parameter information according to the running state.
According to the scheme, after the terminal device acquires the image information, the pixel information in the image information is analyzed, and the pixel information is compared with the preset pixel information in the preset database, so that the household device corresponding to the pixel information is determined through the preset pixel information.
It is further preferable to design that the display parameter information in the image information corresponds to a display position of the home appliance, and specifically includes: determining the display position of the household equipment in the image information; determining a display direction and a display distance of the parameter information corresponding to the display position of the household equipment; and displaying the parameter information at the display position in the display direction and the display distance.
In the scheme, after parameter information of the household equipment is determined, the display position of the household equipment in the image information is determined according to the position of the household equipment in the image information, then the display direction and the display distance of the parameter information corresponding to the display position are determined, then the parameter information is displayed at the display position according to the display direction and the display distance, so that the parameter information can be displayed corresponding to the position and the direction of the household equipment in the image information, the parameter information displayed in the image information can be attached to the household equipment in the image information, when a plurality of household equipment are arranged in the image information, a user can more easily correspond the household equipment to the parameter information, and the possibility that the user confuses the parameter information with the household equipment is reduced.
It is further preferable to design that the display parameter information in the image information corresponds to a display position of the home appliance, and specifically includes: determining the display position of the household equipment in the image information; determining a display sequence of the parameter information according to the display position of the household equipment; the parameter information is displayed at the display position in the display order.
In the scheme, after the parameter information is determined, the display position of the household equipment in the image information is determined firstly, then the display sequence of the parameter information is determined according to the display position (for example, the parameter information is displayed sequentially from left to right or from top to bottom), the parameter information is displayed at the display position in the display sequence, and the parameter information is displayed in the display sequence, so that the parameter information can be displayed according to the shape of the household equipment (for example, the parameter information is displayed sequentially from top to bottom when the height of the household equipment is higher, and the parameter information is displayed sequentially from left to right when the household equipment is transversely arranged), the display position (for example, the parameter information is displayed sequentially from top to bottom along the edge or from left to right when the display position is positioned at the edge of the image information), and the position relation between different household equipment (for example, the distance between two household equipment is smaller, and the parameter information of the two household equipment uses different display sequences to reduce the display sequence Few users confuse parameter information of two home appliances).
As shown in fig. 3, a further preferred design interface display method includes: step S302, acquiring image information acquired by a camera device; step S304, determining parameter information corresponding to household equipment (such as an air conditioner) in the image information; step S306, a display position corresponding to the home appliance is determined in the image information, and the parameter information is displayed at the display position. Step S308, receiving an adjusting instruction of the parameter information; step S310, determining a change value of the parameter information according to the adjusting instruction; step S312, displaying the variation value of the parameter information at the display position, wherein the parameter information includes the device parameter of the home device and the environment parameter of the environment where the home device is located.
In the scheme, in step S302, a terminal device (e.g., a tablet computer) acquires image information through a camera device, and in step S304, the terminal device determines a home device in the image information according to the image information, and further determines parameter information of the home device, where the parameter information may be obtained by directly querying the home device or by querying a device (e.g., a remote controller of the home device) associated with the home device. In step S306, the terminal device determines a display position of the parameter information of the home device in the image information and displays the parameter information at the display position, so as to display the parameter information of the home device in the image information corresponding to the display position of the home device after the terminal device obtains the image information. When a user needs to adjust the working state of the household equipment, the working state of the household equipment is adjusted through the terminal equipment. Step S308, the terminal device receives an adjustment instruction of the parameter information (for example, turning on and off the air conditioner and adjusting the temperature, humidity, wind direction, and wind power), step S310, determines a variation value of the parameter information according to the adjustment instruction, and step S312, displays the variation value of the parameter information at the display position, so that a user can visually know the variation of the parameter information of the home device when adjusting the home device, thereby facilitating the user to accurately adjust the working state of the home device.
Wherein, parameter information includes the environmental parameter of the equipment parameter (for example domestic appliance's operating time, performance index etc.) and domestic appliance place environment of domestic appliance, and the user can in time know domestic appliance's operating condition and can know the environmental parameter of domestic appliance place environment through parameter information according to parameter information to the user adjusts domestic appliance's operating condition according to environmental parameter, promotes user's comfort level.
As shown in fig. 4, in another embodiment of this embodiment, an interface display method for a terminal device (e.g., a smartphone) having an image capturing apparatus includes: step S402, acquiring image information acquired by a camera device; step S404, displaying image information in a display area (for example, a display screen of a smart phone) of the terminal device; step S406, analyzing pixel information in the image information; step S408, comparing the pixel information with preset pixel information stored in a preset database, and determining household equipment (such as an air conditioner, a humidifier and an illuminating lamp) corresponding to the pixel information; step S410, acquiring the running state of the household equipment, and determining parameter information according to the running state; step S412, determining the display position of the household equipment in the image information; step S414, determining the display direction and the display distance of the parameter information corresponding to the display position of the household equipment; step S416, displaying parameter information at the display position according to the display direction and the display distance; step S418, determining an augmented reality display graph of the household equipment in the image information; step S420, displaying the running state of the household equipment in the augmented reality display graph; step S422, receiving an adjusting instruction of the parameter information; step S424, determining the change value of the parameter information according to the adjusting instruction; in step S426, the change value of the parameter information is displayed at the display position.
In the scheme, the terminal equipment acquires image information through the camera device, determines the position information of the household equipment through the image information and displays the parameter information of the household equipment at the position information, so that the parameter information of the household equipment displayed by the corresponding household equipment is displayed in the image information of the terminal equipment in real time, a user can conveniently and quickly know the working state of the household equipment, and the user can quickly adjust the state of the household equipment according to the working state of the household equipment.
Specifically, in step S402, the terminal device captures image information by the camera, in step S404, displaying the image information in a display area of the terminal device (e.g., a display screen of a smart phone), step S406, analyzing pixel information in the image information, so as to determine the home appliance in the image information according to the pixel information, step S408, comparing the pixel information with the preset pixel information stored in the preset database, and determining the home appliance corresponding to the pixel information, it can be understood that, when part or all of the pixel information is matched with the preset pixel information, determining that the image information includes the home devices corresponding to the preset pixel information, wherein the characteristics of the home devices included in the preset pixel information include, but are not limited to, the outlines of the home devices and color characteristics of the home devices (for example, area ratios and shapes of different color portions of the air conditioner housing); step S410, acquiring the running state of the household equipment, and determining parameter information according to the running state (for example, the parameter information corresponding to the air conditioner comprises the storage amount of the refrigerant of the air conditioner, the rotating speed of a fan of the air conditioner, the working time of the air conditioner, the air outlet state of the air conditioner, the indoor temperature and the outdoor temperature, the parameter information corresponding to the humidifier comprises the working power of the humidifier, the humidifying efficiency of a humidifying component of the humidifier, the indoor humidity and the outdoor humidity, and the parameter information corresponding to the illuminating lamp comprises the brightness level, the indoor brightness and the outdoor brightness of the illuminating lamp).
In step S412, the display position of the home appliance in the image information is determined, that is, the display position of the parameter information corresponding to the home appliance is determined. Step S414, determining the display direction and the display distance of the parameter information corresponding to the display position of the household equipment, and step S416, displaying the parameter information at the display position according to the display direction and the display distance, so that the parameter information displayed in the image information can be matched with the household equipment in the image information, and when a plurality of household equipment are arranged in the image information, a user can more easily correspond the household equipment with the parameter information, and the possibility that the user confuses the parameter information with the household equipment is reduced. Step S418, determining the augmented reality display graph of the home device in the image information, so as to display the augmented reality display graph of the home device in the image information of the display area, so that the display of the home device in the image information is more intuitive, and a user can conveniently determine the type of the home device in the image information. Further, when the augmented reality display graph of the household device is displayed on the terminal device, the parameter information can also correspond to each part of the household device, and therefore a user can know the corresponding relation between the parameter information of the household device and each part of the household terminal and the parameter information conveniently. Step S420, displaying the running state of the household equipment in the augmented reality display graph, wherein the user can know the working state of the household equipment through the augmented reality display graph of the household equipment, and the image information is displayed more visually; when the meaning that the user represented to the parameter information is not enough known, the user only needs to show the figure through the augmented reality and can know the operating condition of domestic appliance, and the user uses conveniently.
When a user needs to adjust the working state of the household equipment, the working state of the household equipment is adjusted through the terminal equipment. Step S422, the terminal device receives an adjustment instruction of the parameter information, step S424, determines a variation value of the parameter information according to the adjustment instruction, and step S426, displays the variation value of the parameter information at the display position, so that a user can directly know the variation of the parameter information of the home device when adjusting the home device, thereby facilitating the user to accurately adjust the working state of the home device.
The technical scheme in the embodiment of the application at least has the following technical effects or advantages:
1. the household equipment is determined according to the image information, and the parameter information of the household equipment is determined at the same time, so that the problem that the parameter information of the household equipment cannot be displayed in real time according to the image information of the household equipment is effectively solved, the parameter information of the household equipment is displayed at the display position corresponding to the household equipment in real time in the image information, the parameter information display of the household equipment is visual and specific, the use is more convenient for a user, the user can further know the principle of the household equipment and can timely judge the fault position of the household equipment through the parameter information when the household equipment breaks down, and the fault position can be reported and repaired quickly.
2. Because the augmented reality display graph of the household equipment is displayed in the image information, the problem that a user cannot visually know the internal structure of the household equipment in the prior art is effectively solved, the display of the household equipment in the image information is more visual, and the user can observe each part inside the household equipment according to the augmented reality display graph of the household equipment.
3. Through the running state that shows domestic appliance in the augmented reality shows the figure, solved prior art user can only confirm domestic appliance's operating condition's through the parameter that shows problem, image information shows more directly perceived, and the user only needs to show the figure through the augmented reality and can know domestic appliance's operating condition, makes the user use more convenient.
4. The household equipment in the image information is determined by comparing the pixel information with the preset pixel information stored in the preset database, the problem that the household equipment cannot be determined directly through the image information in the prior art is solved, the household equipment in the image information can be automatically determined, the parameter information is determined according to the running state of the household equipment, a user only needs to acquire the image information through the terminal equipment, and the user can use the household equipment conveniently.
5. The parameter information is displayed at the display position according to the display direction and the display distance, so that the problem that a user easily confuses the household terminal and the parameter information in the prior art is solved, the user can more easily correspond the household equipment and the parameter information when the image information comprises a plurality of household equipment, and the possibility that the user confuses the parameter information and the household equipment is reduced.
6. The parameter information is displayed at the display position according to the display sequence, so that the problem that the parameter information in the prior art occupies unreasonable space is solved, and the parameter information is displayed according to the display sequence, so that the parameter information can be reasonably displayed according to factors such as the shape of household equipment, and the parameter information can be more reasonably displayed.
7. The problem that the household equipment is inaccurately adjusted by a user in the prior art is solved by receiving the adjusting instruction and displaying the change value of the parameter information corresponding to the adjusting instruction, the change value of the parameter information is determined according to the adjusting instruction, and the change value of the parameter information is displayed at the display position, so that the change of the parameter information of the household equipment can be intuitively known when the user adjusts the household equipment, and the user can accurately adjust the working state of the household equipment conveniently.
8. Through setting up the environmental parameter of domestic equipment's equipment parameter and/or domestic equipment place environment in parameter information, solved prior art user and can only know domestic equipment's different working stages's problem, can in time know domestic equipment's operating condition and domestic equipment place environment's environmental parameter according to parameter information to the user adjusts domestic equipment's operating condition according to environmental parameter, promotes user's comfort level.
Based on the same inventive concept, the embodiment of the invention also provides the terminal device corresponding to the method in the first embodiment, see the second embodiment.
Example two
As shown in fig. 5, the present embodiment provides a terminal device 500, which includes a memory 502, a processor 504, and a computer program stored in the memory 502 and executable on the processor 504, and when the processor 504 executes the computer program, the interface display method according to any one of the embodiments is implemented.
In this embodiment, when the computer program on the memory 502 of the terminal device 500 is executed by the processor 504 of the terminal device 500, the interface display method according to any one of the first embodiment can be implemented, and parameter information of the home device can be displayed at a display position corresponding to the home device in real time in image information, and the parameter information display of the home device is more intuitive and concrete, so that the user can use the interface display method more conveniently, and the user can further know the principle of the home device and can judge a fault position of the home device in time through the parameter information when the home device fails, so as to report the fault position quickly.
Based on the same inventive concept, the embodiment of the present invention further provides a computer-readable storage medium corresponding to the method in the first embodiment, which is shown in the third embodiment.
EXAMPLE III
The present embodiment provides a computer-readable storage medium on which a computer program is stored, the computer program implementing the interface display method of any one of the first to third embodiments when executed by a processor.
In this scheme, when the computer program is executed by the processor, the interface display method according to any one of the first embodiment can be implemented, and parameter information of the home appliance can be displayed at a display position corresponding to the home appliance in real time in the image information, the parameter information of the home appliance is displayed visually and specifically, so that the user can use the method more conveniently, the user can further understand the principle of the home appliance and can judge the fault position of the home appliance in time through the parameter information when the home appliance is in fault, and the fault position can be reported quickly.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the invention without departing from the invention
The spirit and scope of which should be assessed. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. An interface display method for a terminal device having an image pickup device, comprising:
acquiring image information acquired by the camera device;
determining parameter information corresponding to the household equipment in the image information;
determining a display position corresponding to the home appliance in the image information, and displaying the parameter information at the display position;
the parameter information specifically includes:
a device parameter of the household device; and/or
Environmental parameters of an environment in which the household appliance is located;
The determining of the parameter information corresponding to the home device in the image information specifically includes:
analyzing pixel information in the image information;
comparing the pixel information with preset pixel information stored in a preset database, and determining the household equipment corresponding to the pixel information;
acquiring the running state of the household equipment, and determining parameter information according to the running state;
the user can determine the working state of the whole household equipment and the working state of at least one part of the household equipment according to the parameter information;
the parameter information specifically comprises the storage capacity of the air conditioner refrigerant, the rotating speed of the fan and the power of the compressor.
2. The interface display method according to claim 1, further comprising, before the determining parameter information corresponding to a home appliance in the image information:
displaying the image information in a display area of the terminal device;
determining an augmented reality display graphic of the home device in the image information.
3. The interface display method according to claim 2, wherein, when the home appliance is operated, the interface display method further comprises:
And displaying the running state of the household equipment in the augmented reality display graph.
4. The interface display method according to claim 1, wherein the displaying the parameter information in the image information corresponding to the display position of the home device specifically includes:
determining a display position of the household equipment in the image information;
determining a display direction and a display distance of the parameter information corresponding to a display position of the household equipment;
and displaying the parameter information at the display position according to the display direction and the display distance.
5. The interface display method according to claim 1, wherein the displaying the parameter information in the image information corresponding to the display position of the home device specifically includes:
determining a display position of the household equipment in the image information;
determining the display sequence of the parameter information according to the display position of the household equipment;
and displaying the parameter information at the display position in the display sequence.
6. The interface display method according to any one of claims 1 to 5, further comprising:
receiving an adjusting instruction of the parameter information;
Determining a change value of the parameter information according to the adjusting instruction;
and displaying the change value of the parameter information at the display position.
7. A terminal device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the interface display method according to any one of claims 1 to 6 when executing the computer program.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the interface display method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810543762.4A CN108880932B (en) | 2018-05-31 | 2018-05-31 | Interface display method, terminal device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810543762.4A CN108880932B (en) | 2018-05-31 | 2018-05-31 | Interface display method, terminal device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108880932A CN108880932A (en) | 2018-11-23 |
| CN108880932B true CN108880932B (en) | 2022-06-03 |
Family
ID=64336811
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810543762.4A Active CN108880932B (en) | 2018-05-31 | 2018-05-31 | Interface display method, terminal device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108880932B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117238454B (en) * | 2023-11-14 | 2024-03-15 | 深圳英美达医疗技术有限公司 | Medical image processing methods, devices and computer equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012150244A1 (en) * | 2011-05-05 | 2012-11-08 | BSH Bosch und Siemens Hausgeräte GmbH | System for providing information to customers in a sales room for domestic appliances in an enhanced manner, corresponding method, and computer program product |
| WO2017166775A1 (en) * | 2016-04-01 | 2017-10-05 | 乐视控股（北京）有限公司 | Method of ensuring security, device and smart terminal |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5226120A (en) * | 1990-05-21 | 1993-07-06 | Synoptics Communications, Inc. | Apparatus and method of monitoring the status of a local area network |
| CN101321255A (en) * | 2008-07-11 | 2008-12-10 | 中国网络通信集团公司 | Video information display method and set-top box |
| CN102037437B (en) * | 2009-03-23 | 2014-04-16 | 松下电器产业株式会社 | Information processing device, information processing method, recording medium, and integrated circuit |
| JP2012109742A (en) * | 2010-11-16 | 2012-06-07 | Sony Corp | Information providing device and information providing method and communication system |
| US10529134B2 (en) * | 2013-02-01 | 2020-01-07 | Sony Corporation | Information processing device, client device, information processing method, and program |
| CN105608157A (en) * | 2015-12-18 | 2016-05-25 | 联想(北京)有限公司 | Electronic device and control method therefor |
| CN106331643A (en) * | 2016-09-05 | 2017-01-11 | 北京凯文盛业建筑技术有限公司 | Display method and display device |
| CN106369755B (en) * | 2016-09-18 | 2019-09-10 | 珠海格力电器股份有限公司 | Air conditioner control method and device of terminal and intelligent terminal |
| CN106502118A (en) * | 2016-12-21 | 2017-03-15 | 惠州Tcl移动通信有限公司 | A kind of intelligent home furnishing control method and system based on AR photographic head |
| CN106679324A (en) * | 2016-12-27 | 2017-05-17 | 青岛海尔股份有限公司 | Display control method of refrigerator operating information and refrigerator |
| CN206637942U (en) * | 2017-03-21 | 2017-11-14 | 合肥华凌股份有限公司 | Refrigerator image capturing system and refrigerator |
| CN107168085B (en) * | 2017-06-28 | 2021-09-24 | 杭州登虹科技有限公司 | Intelligent household equipment remote control method, device, medium and computing equipment |
-
2018
- 2018-05-31 CN CN201810543762.4A patent/CN108880932B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012150244A1 (en) * | 2011-05-05 | 2012-11-08 | BSH Bosch und Siemens Hausgeräte GmbH | System for providing information to customers in a sales room for domestic appliances in an enhanced manner, corresponding method, and computer program product |
| WO2017166775A1 (en) * | 2016-04-01 | 2017-10-05 | 乐视控股（北京）有限公司 | Method of ensuring security, device and smart terminal |
Non-Patent Citations (1)
| Title |
|---|
| "基于Android的智能家居控制系统的设计与实现";李晨，;《中国优秀硕士学位论文全文数据库 (信息科技辑)》;20160415;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108880932A (en) | 2018-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12165618B2 (en) | Apparatus and method for obtaining and displaying appliance photographic image and supplemental data | |
| CN108489020B (en) | Air conditioner control method, terminal, air conditioner and computer readable storage medium | |
| CN104936334B (en) | Lamp light control method and device | |
| CN104729011B (en) | Air conditioner controller and air conditioner control method | |
| CN109269030B (en) | Remote controller, air conditioner, control method and device thereof, and storage medium | |
| CN104964395B (en) | Control method, device and equipment of air conditioner | |
| CN107742232A (en) | Electric appliance type selection method, device and terminal | |
| CN106152380A (en) | Chiller controller and the control method of chiller | |
| CN111651862B (en) | Air conditioner, method and device for determining installation position of air conditioner, storage medium and mobile terminal | |
| CN110554615A (en) | method and device for centralized control and management of intelligent household equipment | |
| CN103277873B (en) | A kind of control method and device | |
| CN112732380A (en) | Visual display method and device for smart home, storage medium and electronic device | |
| EP2733431A2 (en) | Air conditioning system | |
| US20160010889A1 (en) | Air conditioner and operation state display device | |
| CN105180360B (en) | Method for information display, information display device and air conditioner | |
| CN108880932B (en) | Interface display method, terminal device and computer readable storage medium | |
| CN109711564A (en) | Air conditioner fault display method and device, storage medium and terminal | |
| CN111043707A (en) | Compressor reverse rotation detection method and air conditioner | |
| CN104566814B (en) | Air-conditioner panel display control method and system, air-conditioner | |
| US20150067529A1 (en) | Control method for information apparatus and computer-readable recording medium | |
| CN112283892A (en) | Visualization method for temperature of air conditioner, air conditioner and storage medium | |
| CN111105287A (en) | Air conditioner intelligent recommendation method, module and system based on big data | |
| CN101110011A (en) | Device for rearranging push-button icon on household electrical appliance display screen and method thereof | |
| CN109426165B (en) | Control method and equipment of intelligent household appliance | |
| CN109595753A (en) | The control method and computer readable storage medium of a kind of air conditioner, air conditioner |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |