CN109145010B - Information query method and device, storage medium and wearable device - Google Patents

Abstract

The embodiments of the present application disclose an information query method, device, storage medium and wearable device. The method includes obtaining a product image, obtaining product ingredient information based on the product image; determining the group of people who are not suitable for use based on the product ingredient information; and displaying the group of people who are not suitable for use and the ingredient information that leads to the result of not suitable for use through the display component of the wearable device. By adopting the technical solution of the present application, when a user wearing a wearable device pays attention to a certain product, the group of people who are not suitable for use corresponding to the product can be automatically queried, and the group of people who are not suitable for use and which ingredients are not suitable can be displayed through the lens, thereby meeting the actual needs of users, improving the efficiency of human-computer interaction, and enriching the functions of wearable devices.

Description

Information query method, device, storage medium and wearable device

technical field

The embodiments of the present application relate to smart wearable devices, and in particular, to an information query method, device, storage medium, and wearable device.

Background technique

With the progress of society and the development of science and technology, the size of various components is getting smaller and smaller, so that they can be integrated into wearable devices, and further, provide many conveniences for users' life and work.

Wearable devices on the market today can often be like smartphones, with an independent operating system that can run applications. Wearable devices can liberate the hands of the user, which brings great convenience to the user's life and work. However, the wearable devices in the related art have relatively single functions, which cannot match the user requirements in practical applications. Therefore, the function of the wearable device in the related art needs to be optimized.

SUMMARY OF THE INVENTION

The embodiments of the present application provide an information query method, device, storage medium, and wearable device, which can optimize the functions of the wearable device in related technologies.

In a first aspect, an embodiment of the present application provides an information query method, which is applied to a wearable device, and the method includes:

Obtain a product image, and obtain product component information according to the product image;

Determine unsuitable groups of people according to the product composition information;

The display part of the wearable device displays unsuitable user groups and component information that causes unsuitable use results.

In a second aspect, an embodiment of the present application further provides an information query device, the device comprising:

a component information acquisition module, configured to acquire a commodity image, and acquire commodity component information according to the commodity image;

a crowd determination module, configured to determine an unsuitable user crowd according to the commodity component information;

The information display module is used to display the information of the unsuitable users and the component information that leads to the unsuitable use result through the display part of the wearable device.

In a third aspect, the embodiments of the present application further provide a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the information query method described in the embodiments of the present application.

In a fourth aspect, an embodiment of the present application also provides a wearable device, including a memory, a processor, and a computer program stored on the memory and running on the processor, and the processor executes the computer program to realize the implementation of the present application The information query method described in the example.

An embodiment of the present application provides an information query solution, including acquiring a commodity image, acquiring commodity component information according to the commodity image; determining unsuitable users according to the commodity component information; displaying the unsuitable users through a display component of a wearable device and information on ingredients leading to unsuitable results. By adopting the technical solution of the present application, when a user wearing a wearable device pays attention to a certain commodity, the inappropriate user group corresponding to the commodity can be automatically inquired, and the inappropriate user group and which ingredients are displayed through the lens, so as to satisfy the user's requirements. The actual needs have enriched the functions of wearable devices.

Description of drawings

1 is a flowchart of an information query method provided by an embodiment of the present application;

2 is a schematic diagram of using an enhanced display module to display translated commodity components according to an embodiment of the present application;

3 is a flowchart of another information query method provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an information query apparatus provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a wearable device according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of another wearable device provided by an embodiment of the present application;

FIG. 7 is a schematic solid diagram of a wearable device according to an embodiment of the present application.

Detailed ways

The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all the structures related to the present application.

Before discussing the exemplary embodiments in greater detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowchart depicts the steps as a sequential process, many of the steps may be performed in parallel, concurrently, or concurrently. Furthermore, the order of the steps can be rearranged. The process may be terminated when its operation is complete, but may also have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

It should be noted that the wearable device may include electronic devices worn on the user's head, such as smart glasses and smart helmets. Taking smart glasses as an example, the structure of the wearable device is briefly introduced. Smart glasses include a frame and lenses. The spectacle frame body includes temples and a frame. A camera is provided on the spectacle frame body, for example, a camera is provided on the spectacle frame, or a camera is arranged in the area where the temple and the spectacle frame intersect. Optionally, a breathing light may be provided on the inner side of the temple, the breathing light may be an LED light, and may flash according to the heartbeat frequency of the wearer of the smart glasses. A touch area (such as a touch panel) and a bone conduction area are also arranged on the temple. Wherein, the touch area is arranged on the outer side of the temple, and a touch detection module is arranged in the touch area to detect the user's touch operation. For example, a touch sensor module is used to detect a user's touch operation, and the touch sensor module is at a low level in an initial state and is at a high level when there is a touch operation. In the scenario where the user wears smart glasses, the side of the temple near the face is defined as the inner side, and the side opposite to the inner side that is far from the face is defined as the outer side. A bone conduction zone is set on the temple near the ear. Among them, bone conduction components such as bone conduction speakers or bone conduction sensors are arranged in the bone conduction area. Optionally, a heart rate sensor is set at a position where the temple is close to the temple of the face, so as to obtain the heart rate information of the user wearing the smart glasses. Setting a smart microphone on the frame can intelligently identify the noise level of the current environment and automatically adjust the performance of the microphone based on the ambient noise. There are also distance sensors and gyroscopes on the frame. Optionally, an electro-oculogram (abbreviated as EOG) sensor is also provided on the frame and the nose pad, which is used to collect the user's eye state. In addition, a micro-processing area is also provided on the temple, and the processor is arranged in the micro-processing area, which is respectively connected with the above-mentioned touch detection module, bone conduction earphone, heart rate sensor, smart microphone, distance sensor, gyroscope, EOG sensor and other devices. The electrical connection is used for receiving the data to be processed, performing data operation, data processing and outputting control instructions to the corresponding device. It should be noted that the smart glasses can download multimedia resources from the cloud through the Internet for playback, and can also obtain multimedia resources from the terminal device by establishing a communication connection with the terminal device, which is not limited in this application.

1 is a flowchart of an information query method provided by an embodiment of the present application. The method may be executed by an information query apparatus, wherein the apparatus may be implemented by software and/or hardware, and may generally be integrated in a wearable device. As shown in Figure 1, the method includes:

Step 110: Obtain a product image, and obtain product component information according to the product image.

It should be noted that the product image can be obtained through the camera on the wearable device. Optionally, when an image acquisition event is detected to be triggered, the operation of acquiring the image of the product is performed. There are many trigger conditions for triggering the image acquisition event, which are not specifically limited in this embodiment of the present application. For example, the trigger condition may be detecting that the information query function is turned on, detecting that a preset period has been reached, detecting that the distance from a preset commodity is less than a preset distance threshold, or detecting that the user's gaze in a certain direction exceeds a preset time threshold, etc.

Exemplarily, after the information query function is enabled, the camera may be controlled to capture the image of the product. For another example, after the information query function is turned on, the camera may be controlled to photograph the product concerned by the user according to a preset period, so as to obtain the product image. For another example, the distance between the user and the commodity can be detected by a distance sensor on the wearable device, and if the distance is less than a preset distance threshold, the camera is controlled to capture an image of the commodity. Optionally, a camera may be used to detect the distance between the user and the commodity, and if the distance is less than a preset distance threshold, the camera is controlled to capture an image of the commodity. For another example, the state of the eye may be detected by an electro-oculogram sensor, and if it is detected that the time for which the eye is gazing in a certain direction exceeds a preset time threshold, the camera is controlled to capture an image. Optionally, another camera (arranged at any position on the wearable device frame where the human eye can be photographed) can also be used to capture the human eye image, and the installation position of the camera is different from that of the camera that captures the image of the product. Correspondingly, the gaze action is detected by recognizing the human eye image. For example, image recognition is performed on an image of the human eye, and the relative position data of the pupil in the eye is determined by an image processing algorithm, thereby calculating the position of the gaze point observed by the user. After 2 seconds, a frame of human eye image is acquired again, and the gaze point is determined according to the human eye image. If the position of the fixation point has not changed, the counter is incremented by 1. By analogy, after 2 seconds, a frame of human eye image is acquired again, and the gaze point is re-determined based on the human eye image. Using a similar method, if the position of the gaze point does not change for three consecutive times, the camera is controlled to capture an image.

Exemplarily, an image captured by a camera is acquired, and it is determined whether the image contains commodity information, and if so, the text information contained in the commodity image is identified, and text representing commodity components in the text information is extracted as commodity component information.

Step 120: Determine unsuitable users according to the commodity component information.

In the embodiments of the present application, groups that may cause adverse reactions due to the product components may be determined according to the product component information. Optionally, a knowledge base can be preset in the wearable device, and the knowledge base stores raw materials used for preparing food or medicine and groups that may cause adverse reactions due to the raw materials, and the knowledge base can be automatically connected to the Internet. renew. After obtaining the product composition information, the knowledge base is queried based on the product composition information, the group of people who are not suitable for using the product is determined based on the query result, and the composition information, the unsuitable people and the adverse reactions after use are obtained and sent to the wearable device. Show cache modules.

Optionally, after obtaining the product component information, you can also inquire online about the unsuitable user population corresponding to the product component, and obtain the component information, the unsuitable user population and the adverse reaction after use and send it to the display cache module of the wearable device.

Exemplarily, by querying the local knowledge base of the wearable device or the Internet, it is possible to determine the first group of people who are not suitable for using a single component in the commodity component information, and the first group of people is regarded as the unsuitable people for use. Optionally, each component included in the commodity component information can also be combined to obtain a component combination, and a knowledge base or the Internet can be queried based on the component combination to determine the second group of people who are not suitable to use the component combination; The first group of people is compared, and a subgroup of the second group of people that does not belong to the first group of people is screened out, and the subgroup is added to the first group of people as inappropriate for use.

Step 130: Display the information on the unsuitable users and the component information that leads to the unsuitable use result through the display component of the wearable device.

Exemplarily, the micro-projection component reads the unsuitable people and the component information that leads to the unsuitable use result from the display cache module, and displays the unsuitable people and the corresponding component information on the lens by means of projection.

Optionally, some wearable devices have lenses, and the lenses are used as display screens. The display cache module can read information about unsuitable users and components that cause unsuitable use results, and refresh them on the lenses according to the set refresh rate. to display.

In the technical solution of this embodiment, the product image is obtained, and the product component information is obtained according to the product image; the unsuitable user group is determined according to the product component information; Using the component information of the results, the operations of opening the search engine, inputting search terms and filtering the search results are processed by the wearable device in the background, which simplifies the human-computer interaction process. By adopting the technical solution of the present application, when a user wearing a wearable device pays attention to a certain commodity, the inappropriate user group corresponding to the commodity can be automatically inquired, and the inappropriate user group and which ingredients are displayed through the lens, so as to satisfy the user's requirements. To meet the actual needs, improve the efficiency of human-computer interaction, and enrich the functions of wearable devices.

In some embodiments, after identifying the text information contained in the product image, the method further includes: judging whether the text information belongs to a preset language type; if not, outputting translation prompt information; detecting a translation request input by the user, The commodity component information is translated based on the preset language type, and the translated commodity component information is displayed through the lens. The advantage of this setting is that if the user needs to buy food or medicine for others when he is on a business trip or travel abroad, and is unable to judge whether the product is suitable for purchase due to unfamiliar language, he can use the information query function to query the text on the product. Automatic translation prevents users from using other translation applications (APPs) to translate the text on the goods, matches the actual needs of users, and further enriches the functions of wearable devices.

In other embodiments, displaying the translated commodity component information through the lens may include: acquiring a preset augmented reality model, and generating component augmented reality information based on the augmented reality model and the translated commodity component information, and displaying through the lens The ingredient augmented reality information. FIG. 2 is a schematic diagram of using an enhanced display module to display translated commodity components according to an embodiment of the present application. The wearable device calls the augmented reality model according to the preset priority, as shown in Figure 2, the augmented reality model is a blackboard. Display the translated product ingredient information and the corresponding graphics on the blackboard one by one according to the preset time interval. After a preset time period of displaying the product ingredient information, the blackboard eraser will appear to erase the product ingredient information, and the next product ingredient information and the corresponding graphics will be displayed. The corresponding graphics can use a small display area to visually display the translated product component information, so as to avoid the situation that the user's observation of the surrounding environment is affected by the display of the translated product component information. For example, the product ingredient currently displayed on the blackboard is peanuts, and the Chinese translation and pictures of peanuts are displayed. After t seconds, the blackboard eraser and fingers in the augmented reality model are called to simulate the effect of hand-wiping the blackboard. Information. After erasing, the Chinese translation and picture of the next product ingredient, Hawthorn, are displayed on the blackboard. After t seconds, the blackboard eraser and fingers in the augmented reality model are called to erase the information corresponding to the hawthorn through the blackboard eraser, and so on, one by one. Display the Chinese translation and pictures corresponding to each product component (if there is no corresponding picture, the molecular formula or only the Chinese translation can be displayed).

In other embodiments, after determining an unsuitable user group according to the commodity component information, the method further includes acquiring a preset object type; when the object type matches the unsuitable user group, executing the wearable device The display part of the operation displays information on the unsuitable population and the ingredient information that leads to the unsuitable use result. For example, the preset object type preset by the user is pregnant women, indicating that the product he wants to buy cannot be unsuitable for pregnant women. It can be purchased without performing an operation of displaying, through the display part of the wearable device, information on the unsuitable user group and the ingredient information leading to the unsuitable use result. The advantage of this setting is to display the unsuitable user groups that match the preset object type, and reduce the impact on the user's field of vision for observing the external environment due to the display through the lens.

FIG. 3 is a flowchart of another information query method provided by an embodiment of the present application. As shown in FIG. 3 , the method includes:

Step 301 , detecting an image acquisition event trigger, and acquiring a product image captured by a camera.

Step 302 : Identify text information contained in the product image, and extract text representing product components in the text information as product component information.

Step 303 , determine whether the text information belongs to the preset language type, if not, go to step 304 , otherwise go to step 306 .

It should be noted that, when the wearable device detects an activation event, it prompts the user to set a preset language type. Wherein, when the wearable device detects that the user inputs the registration information, it determines that an activation event is detected.

Step 304 , output translation prompt information.

For example, the wearable device outputs translation prompt information through the bone conduction speaker, and drives the touch detection module on the touch area to detect the translation request input by the user. It should be noted that the touch detection module will enter a low-power state if it does not detect a user operation within a set period of time, and can switch from a low-power state to a normal state when it detects a drive command or user operation of the wearable device. working status.

Step 305: Detecting the translation request input by the user, translating the commodity component information based on the preset language type, and displaying the translated commodity component information through the lens.

Exemplarily, after detecting the translation request, the wearable device translates the commodity component information into text corresponding to the preset language type, and can display the translated commodity component information correspondingly in the order of the pre-translation commodity component information through the lens. . Optionally, a preset augmented reality model may also be used to edit the translated commodity component information to obtain component augmented reality information, and the component augmented reality information may be displayed through a lens.

Step 306: Determine the first group of people who are not suitable to use a single component in the commodity component information.

Step 307: Combining each component included in the commodity component information to obtain a component combination, determining a second group of people who are not suitable to use the component combination, and taking the first and second groups of people as inappropriate people .

Step 308: Acquire a preset object type, and determine whether the object type matches the unsuitable user group. If yes, go to step 309; otherwise, go to step 314.

Step 309 , displaying the information on the unsuitable users and the component information that causes the unsuitable use result through the display component of the wearable device.

Step 310: Obtain the current location of the user wearing the wearable device.

Exemplarily, the current location of the user wearing the wearable device is determined based on a positioning module preset on the wearable device. For example, the current location of the user wearing the wearable device can be determined through GPS. Optionally, the user may also be prompted to input the name of the current store and the name of a nearby building or road by voice, and match the electronic map based on the voice information input by the user, thereby determining the current location of the user wearing the wearable device.

Step 311 , predicting a target commodity suitable for a preset object type based on the commodity image.

The wearable device determines the product type pre-purchased by the user according to the product image, and searches for the target product that does not contain the target product that is not suitable for the preset object type. For example, the wearable device obtains the ingredient information contained in the current product, and determines that if ingredient A is used by a group of preset object types, it will cause adverse reactions. The wearable device searches for its substitute product based on the current product, and the substitute product does not contain ingredient A, and records the substitute product in the search result as the target product.

Step 312: Query a reference store selling the target product within a preset range based on the current location, and display the reference store through a lens.

It should be noted that the preset range may be a circumference range with the current position as the center and the preset radius. The preset radius may be a system default value or a value set by the user according to the actual situation.

Exemplarily, the wearable device accesses a server of a platform website with store review data, obtains a reference store that sells the target product within a preset range, and displays information such as the name and address of the reference store through the lens.

Step 313 , when detecting the going request input by the user, take the reference store corresponding to the going request as the target store, and display the navigation information from the current location to the target store.

It should be noted that there are many ways for the user to input the request to go, which can be a click, a sliding operation, an air gesture, a voice, or a preset head or eye action, etc. This application implements Examples are not specifically limited. For example, if the user's click operation or sliding operation on the touch area is detected after the relevant information of the reference store is displayed, it is determined that a user input request to go to is detected. For another example, if the preset gesture is detected through the camera, it can also be determined that a user input request to go is detected. For another example, if it is detected that the number of times the user blinks exceeds a preset blink threshold, it may be determined that a user input request to go is detected.

If there are at least two reference stores, you can sort the reference stores in descending order according to the distance from the current location, and display the sorted reference stores. When a request to go to the user input is detected, the reference store ranked first can be used as the target store, a route from the current location to the target store can be planned, and the route can be displayed.

Optionally, the target store may also be determined according to a request for going to the user input. For example, after the reference stores are sorted in the above manner and the reference stores sorted in descending order are displayed, if it is detected that the user inputs two click operations, the second reference store in the ranking will be used as the target store. Similarly, if it is detected that the user nods twice, the second-ranked reference store will be used as the target store. It is also possible to predefine the correspondence between the preset gestures and the order of stores. When a preset gesture is detected, the order of the stores corresponding to the preset gesture is determined, and the reference store corresponding to the order is used as the target store.

Step 314: Output affirmative prompt information to prompt the user that the purchase can be made.

The technical solution of this embodiment is to obtain the current position of the user wearing the wearable device when the current product is not suitable for the use of the preset object type stored in the wearable device, and predict the use of the preset object type suitable for the current product based on the current product. Target commodity; based on the current location, query the reference store that sells the target commodity within the preset range, and display the reference store through the lens. Navigation information from the current location to the target store. By adopting the above technical solution, the unsuitable user group corresponding to the current product is automatically inquired, and the unsuitable user group and which components are unsuitable are displayed through the lens. In addition, the target product that the user pre-purchased is predicted based on the current product, and the nearby reference stores where the target product can be purchased is automatically searched in advance, so that when it is detected that the user enters a request to go to the target store, it can plan the route from the current location to the target store. The route simplifies the human-computer interaction steps, can better meet the actual use needs of users, and enrich the functions of wearable devices.

FIG. 4 is a schematic structural diagram of an information query apparatus provided by an embodiment of the present application. The apparatus may be implemented by software and/or hardware, and may be integrated into a wearable device for executing the information query method provided by the embodiments of the present application. As shown in Figure 4, the device includes:

A component information acquisition module 410, configured to acquire a commodity image, and acquire commodity component information according to the commodity image;

a crowd determination module 420, configured to determine an unsuitable user crowd according to the commodity component information;

The information display module 430 is used to display the information of the unsuitable users and the component information that leads to the unsuitable use result through the display part of the wearable device.

The embodiment of the present application provides an information query device, which can automatically query the unsuitable user group corresponding to the product when a user wearing a wearable device pays attention to a certain product, and display the unsuitable user group and which components are unsuitable through the lens, Meet the actual needs of users, improve the efficiency of human-computer interaction, and enrich the functions of wearable devices.

Optionally, the component information acquisition module 410 is specifically used for:

Detects the trigger of the image acquisition event, and acquires the image of the product captured by the camera;

Character information contained in the product image is recognized, and characters representing product components in the text information are extracted as product component information.

Optionally, also include:

a translation module, configured to determine whether the text information belongs to a preset language type after identifying the text information contained in the product image;

If not, output translation prompt information;

The translation request input by the user is detected, the commodity component information is translated based on the preset language type, and the translated commodity component information is displayed through the lens.

Optionally, the translation module is further configured to: acquire a preset augmented reality model, generate component augmented reality information based on the augmented reality model and the translated commodity component information, and display the component augmented reality information through a lens.

Optionally, the crowd determination module 420 is specifically used for:

Determine the first group of people who are inappropriate to use the single ingredient in the product ingredient information;

Combining each component included in the commodity component information to obtain a component combination, and determining a second group of people who are not suitable for using the component combination;

The first group of people and the second group of people are regarded as inappropriate groups of people.

Optionally, also include:

an object matching module, configured to obtain a preset object type after determining the unsuitable user group according to the commodity component information;

When the object type is matched with the unsuitable user group, an operation of displaying the unsuitable user group and the component information causing the unsuitable use result through the display part of the wearable device is performed.

Optionally, also include:

a navigation module, configured to acquire the current position of the wearable device user if the preset object type belongs to the inappropriate user group after determining the inappropriate user group according to the commodity component information;

Predicting a target commodity suitable for use by a preset object type based on the commodity image;

Querying a reference store selling the target product within a preset range based on the current location, and displaying the reference store through a lens;

When a going request input by the user is detected, the reference store corresponding to the going request is taken as the target store, and the navigation information from the current position to the target store is displayed.

Embodiments of the present application also provide a storage medium containing computer-executable instructions, where the computer-executable instructions are used to execute an information query method when executed by a computer processor, and the method includes:

Obtain a product image, and obtain product component information according to the product image;

Determine unsuitable groups of people according to the product composition information;

The display part of the wearable device displays the information of the unsuitable users and the ingredients that lead to the unsuitable use results.

storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a second, different computer system connected to the first computer system through a network such as the Internet. The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network). The storage medium may store program instructions (eg, embodied as a computer program) executable by one or more processors.

Of course, a storage medium containing computer-executable instructions provided by the embodiments of the present application, the computer-executable instructions of which are not limited to the information query operations as described above, and can also execute any of the information query methods provided by any embodiment of the present application. related operations.

The embodiment of the present application provides a wearable device, the wearable device has an operating system in the wearable device, and the information query apparatus provided by the embodiment of the present application can be integrated in the wearable device. FIG. 5 is a schematic structural diagram of a wearable device according to an embodiment of the present application. As shown in FIG. 5 , the wearable device includes a memory 510 and a processor 520 . The memory 510 is used to store computer programs and the like; the processor 520 reads and executes the computer programs stored in the memory 510 . The processor 520 implements the following steps when executing the computer program: acquiring a commodity image, and acquiring commodity component information according to the commodity image; determining an unsuitable user group according to the commodity component information; displaying the wearable device Parts display information on unsuitable users and ingredients that lead to unsuitable results.

The memories and processors listed in the above examples are all components of the wearable device, and the wearable device may also include other components. FIG. 6 is a schematic structural diagram of another wearable device provided by an embodiment of the present application, and FIG. 7 is a schematic entity diagram of a wearable device provided by an embodiment of the present application. As shown in FIG. 6 and FIG. 7 , the wearable device may include: a memory 601 , a processor (Central Processing Unit, CPU) 602 (hereinafter referred to as CPU), a display component 603 , a touch panel 604 , a heart rate detection module 605 , and a distance sensor 606 , camera 607 , bone conduction speaker 608 , microphone 609 , breathing light 610 and positioning module 612 . These components communicate via one or more communication buses or signal lines 611 (hereinafter also referred to as internal transmission lines).

It should be understood that the wearable device shown is merely an example, and that the wearable device may have more or fewer components than those shown in the figures, may combine two or more components, or may have Different part configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The wearable device integrated with the information query device provided by this embodiment will be described in detail below. The wearable device takes smart glasses as an example.

Memory 601, which can be accessed by CPU 602, which can include high-speed random access memory, and can also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other volatile Solid state storage device.

The display part 603 can be used to display image data and a control interface of the operating system. The display part 603 is embedded in the frame of the smart glasses, and an internal transmission line 611 is arranged inside the frame, and the internal transmission line 611 is connected with the display part 603 .

The touch panel 604 is arranged on the outer side of at least one smart glasses temple, and is used for acquiring touch data. The touch panel 604 is connected with the CPU 602 through the internal transmission line 611 . Wherein, the touch panel 604 can detect the user's finger sliding and clicking operations, and correspondingly transmit the detected data to the processor 602 for processing to generate corresponding control instructions, exemplarily, can be left-shift instructions, right-shift instructions , Move up command, Move down command, etc. Exemplarily, the display part 603 can display the virtual image data transmitted by the processor 602, and the virtual image data can be correspondingly changed according to the user operation detected by the touch panel 604. After the left-shift instruction or the right-shift instruction, the previous or next virtual image picture is correspondingly switched; when the display component 603 displays the video playback information, the left-shift instruction can be the playback of the content to be played, and the right-shift instruction can be played Fast-forwarding of content; when the display component 603 displays editable text content, the left-shift instruction, right-shift instruction, up-shift instruction, and down-shift instruction can be displacement operations on the cursor, that is, the position of the cursor can be adjusted according to the user's The touch operation of the touchpad is performed to move; when the content displayed by the display component 603 is a game animation picture, the left-shift instruction, right-shift instruction, up-shift instruction, and down-shift instruction can be used to control objects in the game, such as airplanes. In the game, the flight direction of the aircraft can be controlled by the left, right, up, and down commands respectively; when the display unit 603 can display video images of different channels, the left, right, The up and down instructions can be used to switch between different channels, wherein the up and down instructions can be to switch to a preset channel (such as a common channel used by the user); when the display component 603 displays a static picture, the left Shift, right, up, and down commands can be used to switch between different pictures. The left shift command can be used to switch to the previous picture, and the right shift command can be used to switch to the next picture. The move instruction can be to switch to the previous atlas, and the down move instruction can be to switch to the next atlas. The touch panel 604 can also be used to control the display switch of the display unit 603. Exemplarily, when the touch area of the touch panel 604 is pressed for a long time, the display unit 603 is powered on to display an image interface, and when the touch area of the touch panel 604 is long pressed again, The display part 603 is powered off. When the display part 603 is powered on, the brightness or resolution of the image displayed in the display part 603 can be adjusted by sliding up and down on the touch panel 604 .

The heart rate detection module 605 is used to measure the user's heart rate data, the heart rate refers to the number of heartbeats per minute, and the heart rate detection module 605 is arranged on the inner side of the temple. Specifically, the heart rate detection module 605 can use dry electrodes to obtain human body electrocardiogram data by means of electrical pulse measurement, and determine the heart rate according to the amplitude peak value in the electrocardiogram data; the heart rate detection module 605 can also be performed by using The photoelectric method for measuring heart rate is composed of light emission and light receiver. Correspondingly, the heart rate detection module 605 is arranged at the bottom of the temple, at the earlobe of the human auricle. After the heart rate detection module 605 collects the heart rate data, it can correspondingly send it to the processor 602 for data processing to obtain the wearer's current heart rate value. In one embodiment, after the processor 602 determines the user's heart rate value, it can The heart rate value is displayed in the display part 603 in real time, and the optional processor 602 can trigger an alarm correspondingly when it is determined that the heart rate value is low (eg, less than 50) or high (eg, greater than 100), and at the same time the heart rate value And/or the generated alarm information is sent to the server through the communication module.

The distance sensor 606 can be arranged on the mirror frame. The distance sensor 606 is used to sense the distance between the face and the mirror frame. The distance sensor 606 can be realized by using the principle of infrared sensing. Specifically, the distance sensor 606 sends the collected distance data to the processor 602, and the processor 602 controls the brightness of the display part 603 according to the distance data. Exemplarily, when it is determined that the distance collected by the distance sensor 606 is less than 5 centimeters, the corresponding control display part 603 of the processor 602 is in a lit state, and when it is determined that the distance sensor detects that an object is approaching, the corresponding control display Part 604 is closed.

The breathing light 610 can be set at the edge of the mirror frame. When the display unit 603 closes the display screen, the breathing light 610 can be lit according to the control of the processor 602 to show a gradual bright and dark effect.

The camera 607 can be a front camera module that collects image data in front of the user, and a rear camera module that collects user eyeball information, or a combination of the two. Specifically, when the camera 607 collects the front image, it sends the collected image to the processor 602 for identification and processing, and triggers a corresponding trigger event according to the identification result. Exemplarily, when the user wears the wearable device at home, by recognizing the collected front image, if a furniture item is recognized, a corresponding query is made to see if there is a corresponding control event, and if so, the control event is correspondingly determined. The corresponding control interface is displayed in the display part 603, and the user can control the corresponding furniture item through the touch panel 604, wherein the furniture item and the smart glasses are connected via Bluetooth or wireless ad hoc network; When the device is installed, the target recognition mode can be turned on accordingly, and the target recognition mode can be used to identify a specific person. The camera 607 sends the collected image to the processor 602 for face recognition processing. If the preset preset face is recognized, Then the corresponding sound can be broadcast through the speaker integrated in the smart glasses, and the target recognition mode can also be used to recognize different plants. For example, the processor 602 records the current image collected by the camera 607 according to the touch operation of the touch panel 604 and communicates The module is sent to the server for identification, and the server identifies the plants in the collected images and feeds back the relevant plant names, introduces them to the smart glasses, and displays the feedback data in the display part 603 . The camera 607 can also be used to collect images of the user's eyes, such as eyeballs, and generate different control instructions by recognizing the rotation of the eyeballs. For example, the upward movement of the eyeball generates an upward movement control command, and the downward movement of the eyeball generates a downward movement. The control command, the left movement control command is generated by turning the eyeball to the left, and the right movement control command is generated by turning the eyeball to the right, which is qualified, the display part 603 can display the virtual image data transmitted by the processor 602, and the virtual image data can be corresponding The movement of the user's eyeball detected by the camera 607 changes according to the control command generated by the change. Specifically, it may be to perform screen switching. When the left-shift control command or the right-shift control command is detected, the previous or next virtual image screen is correspondingly switched. When the display part 603 displays the video playback information, the left-shift control instruction can be the playback of the playback content, and the right-shift control instruction can be the fast-forward of the playback content; when the display part 603 displays the editable text content , the left-shift control instruction, right-shift control instruction, up-shift control instruction, and down-shift control instruction can be displacement operations on the cursor, that is, the position of the cursor can be moved according to the user's touch operation on the touchpad; when the display component 603 When the displayed content is a game animation screen, the left-shift control command, right-shift control command, up-shift control command, and down-shift control command can be used to control the objects in the game. For example, in an airplane game, the left-shift control command can be used to control the command, right-shift control command, up-shift control command, and down-shift control command respectively control the flight direction of the aircraft; when the display unit 603 can display video images of different channels, the left-shift control command, right-shift control command, and upward-shift control command The instruction and the down-shift control instruction can switch between different channels, wherein the up-shift control instruction and the down-shift control instruction can be to switch to a preset channel (such as a common channel used by the user); when the display part 603 displays a static picture, the Left-shift control instruction, right-shift control instruction, up-shift control instruction, and down-shift control instruction can switch between different pictures. To the next picture, the up-shift control instruction may be to switch to the previous atlas, and the down-shift control instruction may be to switch to the next atlas.

The bone conduction speaker 608 is arranged on the inner wall side of at least one temple, and is used for converting the received audio signal sent by the processor 602 into a vibration signal. The bone conduction speaker 608 transmits the sound to the inner ear of the human body through the skull, converts the audio electrical signal into a vibration signal and transmits it to the cochlea of the skull, and is then perceived by the auditory nerve. By using the bone conduction speaker 608 as a sounding device, the thickness of the hardware structure is reduced, the weight is lighter, and there is no electromagnetic radiation and will not be affected by electromagnetic radiation, and has the advantages of anti-noise, waterproof, and liberation of both ears.

The microphone 609, which can be arranged on the lower frame of the mirror frame, is used to collect external (user, environment) sounds and transmit them to the processor 602 for processing. Exemplarily, the microphone 609 collects the voice made by the user and performs voiceprint recognition through the processor 602. If it is recognized as the voiceprint of the authenticated user, the subsequent voice control can be received accordingly. Specifically, the user can send a voice, The microphone 609 sends the collected speech to the processor 602 for recognition to generate corresponding control instructions according to the recognition result, such as "start up", "shut down", "increase the display brightness", "reduce the display brightness", and the processor 602 will follow up according to the The generated control instruction executes the corresponding control process.

The positioning module 612, which can be arranged on the frame of the temple, is used to obtain the current position of the user wearing the smart glasses and transmit it to the processor 602 for processing.

The wearable device provided by the embodiment of the present application can automatically query the inappropriate user group corresponding to the commodity when the user wearing the wearable device pays attention to a certain commodity, and display the inappropriate user group and which components are not suitable through the lens. The actual needs of users, improve the efficiency of human-computer interaction, and enrich the functions of wearable devices.

The information query device, storage medium, and wearable device provided in the above embodiments can execute the information query method provided by any embodiment of the present application, and have corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in the foregoing embodiments, reference may be made to the information query method provided by any embodiment of the present application.

Note that the above are only preferred embodiments of the present application and applied technical principles. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application. The scope is determined by the scope of the appended claims.

Claims (9)

1. an information query method, is characterized in that, is applied to wearable device, comprises: Obtain a product image, and obtain product component information according to the product image; Determine unsuitable groups of people according to the product composition information; Obtain a preset object type, and determine whether the object type matches the inappropriate user group; If so, display the information on the unsuitable user group and the component information leading to the unsuitable use result through the display component of the wearable device; Get the current location of the user wearing the wearable device; Predicting a target commodity suitable for use by a preset object type based on the commodity image; Querying a reference store selling the target product within a preset range based on the current location, and displaying the reference store through a lens; When a going request input by the user is detected, the reference store corresponding to the going request is taken as the target store, and the navigation information from the current position to the target store is displayed. 2. The method according to claim 1, wherein acquiring a commodity image, and acquiring commodity component information according to the commodity image, comprises: Detects the trigger of the image acquisition event, and acquires the image of the product captured by the camera; Character information contained in the product image is recognized, and characters representing product components in the text information are extracted as product component information. 3. The method according to claim 2, wherein after identifying the text information contained in the commodity image, the method further comprises: Determine whether the text information belongs to a preset language type; If not, output translation prompt information; The translation request input by the user is detected, the commodity component information is translated based on the preset language type, and the translated commodity component information is displayed through the lens. 4. The method according to claim 3, characterized in that, displaying the translated commodity component information through a lens, comprising: A preset augmented reality model is acquired, and component augmented reality information is generated based on the augmented reality model and the translated commodity component information, and the component augmented reality information is displayed through a lens. 5. The method according to claim 1, wherein determining an unsuitable user group according to the commodity component information, comprising: Determine the first group of people who are inappropriate to use the single ingredient in the product ingredient information; Combining each component included in the commodity component information to obtain a component combination, and determining a second group of people who are not suitable for using the component combination; The first group of people and the second group of people are regarded as inappropriate groups of people. 6. The method of any one of claims 1-5, wherein the wearable device comprises smart glasses. 7. An information inquiry device, characterized in that, comprising: a component information acquisition module, configured to acquire a commodity image, and acquire commodity component information according to the commodity image; a crowd determination module, configured to determine an unsuitable user crowd according to the commodity composition information; an information display module, used for obtaining a preset object type, and judging whether the object type matches an unsuitable user group; If so, display the information on the unsuitable people and the ingredients that lead to the unsuitable results through the display part of the wearable device; Get the current location of the user wearing the wearable device; Predicting a target commodity suitable for use by a preset object type based on the commodity image; Querying a reference store selling the target product within a preset range based on the current location, and displaying the reference store through a lens; When a going request input by the user is detected, the reference store corresponding to the going request is taken as the target store, and the navigation information from the current position to the target store is displayed. 8 . A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the information query method according to any one of claims 1 to 6 is implemented. 9. A wearable device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements the computer program as claimed in claims 1 to 6 when the processor executes the computer program. Any one of the information query methods.

Images