WO2025060915A1 - Information exchange method and apparatus - Google Patents

Abstract

An information exchange method and apparatus, which are applicable to a locker storage process implemented on the basis of a mini program. The method comprises: after a locker storage process is initiated, calling an optical character recognition camera plugin provided by a mini program platform, so as to acquire in real time an image frame to be recognized and a recognition character string (S101); rendering said image frame into a real-time video (S102), and then displaying the real-time video in a camera screen display box (S103), such that a user knows a real-time scanning range, thereby improving the experience; further determining a recommended locker opening code on the basis of the recognition character string (S104); when the recommended locker opening code has been successfully recognized, displaying the recommended locker opening code to the user (S105); and when it is detected that the user has triggered the recommended locker opening code, sending the recommended locker opening code to a food locker server, so as to control a food locker to open a target locker compartment and to open the target locker compartment when a received pickup code is the recommended locker opening code (S106). By calling an optical character recognition camera plugin, automatic analysis is performed to obtain a locker opening code, thereby simplifying a storage process, and optical character recognition can also be implemented at a terminal, thereby shortening data transmission time.

Description

Information interaction method and device

This application claims the priority of the Chinese patent application filed with the China Patent Office on September 21, 2023, with application number 202311229275.8, and invention name “A method and device for information interaction”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present invention relates to the technical field of logistics management, and in particular to an information interaction method and device for logistics distribution information management.

Background Art

In the logistics and distribution scenario, the emergence of delivery cabinets solves the problem of the last 50 meters of logistics and distribution services. When the delivery personnel deposit the items to be delivered into the delivery cabinet, they manually enter the last four digits of the user's mobile phone number as the cabinet opening code to complete the storage operation. In this process, the delivery personnel need to wake up the digital input panel and then manually enter the valid digits of the mobile phone number into the digital input panel digit by digit, which increases the time and complexity of the delivery personnel's operation process. At the same time, if the delivery personnel enter the wrong cabinet opening code, the customer will not be able to take out the items normally.

Application Contents

In view of this, an embodiment of the present invention provides an information interaction method and device to automatically analyze the label receipt to obtain the locker opening code, thereby simplifying the deposit process.

In a first aspect, an information interaction method is provided, the method comprising:

After the mini-program-based cabinet storage process is started, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time, and the image information to be recognized includes the image frame to be recognized and the corresponding recognition string; the corresponding real-time video is determined according to the image frame to be recognized; the real-time video is displayed in the camera screen display box; the recommended cabinet opening code is determined according to the recognition string; in response to the recognition of the recommended cabinet opening code, the recommended cabinet opening code is displayed; in response to the recommended cabinet opening code confirmation control being triggered, the recommended cabinet opening code is sent to enable the cabinet server to control the cabinet to open the target cabinet and open the target cabinet when the pickup code received is the recommended cabinet opening code.

In a second aspect, an information interaction device is provided, the device comprising:

A calling module, used to call the optical character recognition camera plug-in provided by the mini-program platform to obtain the image information to be recognized in real time after the storage process based on the mini-program is started, wherein the image information to be recognized includes the image frame to be recognized and the corresponding recognition string;

A first determination module, used to determine the corresponding real-time video according to the image frame to be identified;

A first display module, used for displaying the real-time video in a camera screen display frame;

A second determination module, configured to determine a recommended cabinet opening code according to the identification character string;

A second display module, configured to display the recommended cabinet opening code in response to identifying the recommended cabinet opening code;

The sending module is used to send the recommended cabinet opening code so that the food storage cabinet server controls the food storage cabinet to open the target cabinet compartment and opens the target cabinet compartment when the pickup code received is the recommended cabinet opening code.

According to a third aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method described in the first aspect above.

According to a fourth aspect, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method described in the first aspect is implemented.

The embodiment of the present invention is applicable to the storage process based on the applet. After the storage process is started, the optical character recognition camera plug-in provided by the applet platform is called to obtain the image frame to be recognized and the recognition string corresponding to the image frame to be recognized in real time, and then the image frame to be recognized obtained in real time is drawn and rendered into a real-time video, and the real-time video is displayed in the camera screen display frame, so that the user can know the real-time scanning range and improve the user experience. At the same time, the recommended cabinet opening code is determined according to the recognition string. When the recommended cabinet opening code is successfully recognized, the recommended cabinet opening code is displayed. When it is detected that the user triggers the recommended cabinet opening code, the recommended cabinet opening code is sent to the food storage cabinet server to control the food storage cabinet to open the target cabinet compartment, and the target cabinet compartment is opened when the pickup code is received as the recommended cabinet opening code. The embodiment of the present invention can automatically analyze the cabinet opening code from the image frame to be recognized by using optical character recognition, thereby simplifying the food storage process. By calling the optical character recognition camera plug-in provided by the mini program platform, optical character recognition can be implemented in the terminal, saving data transmission time.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

FIG1 is a flow chart of an information interaction method according to an embodiment of the present invention;

2 is a flow chart of a method for calling an optical character recognition camera plug-in provided by a mini-program platform to obtain image information to be recognized in real time according to an embodiment of the present invention;

FIG3 is a schematic diagram of a first stored meal page according to an embodiment of the present invention;

4 is a schematic diagram of the first meal storage page after the recommended locker opening code confirmation control is triggered according to an embodiment of the present invention;

5 is a flow chart of a method for calling an optical character recognition camera plug-in provided by a mini-program platform to obtain image information to be recognized in real time according to an embodiment of the present invention;

FIG6 is a schematic diagram of a second stored meal page according to an embodiment of the present invention;

FIG7 is a schematic diagram of a camera page according to an embodiment of the present invention;

FIG8 is a schematic diagram of a second meal storage page after the recommended locker opening code is identified and obtained according to an embodiment of the present invention;

FIG9 is a flow chart of an information interaction method according to an embodiment of the present invention;

FIG10 is a flow chart of an information interaction method according to an embodiment of the present invention;

FIG11 is a schematic diagram of an information interaction system according to an embodiment of the present invention;

FIG12 is a schematic diagram of an information interaction device according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of an electronic device according to an embodiment of the present invention.

DETAILED DESCRIPTION

The present application is described below based on embodiments, but the present application is not limited to these embodiments. In the detailed description of the present application below, some specific details are described in detail. For those skilled in the art, the present application can be fully understood without the description of these details. In order to avoid confusing the essence of the present application, the known methods, processes, procedures, components and circuits are not described in detail. In addition, it should be understood by those of ordinary skill in the art that the drawings provided herein are for illustrative purposes and the drawings are not necessarily drawn to scale. Unless the context clearly requires, the words "including", "comprising" and the like in the entire application document should be interpreted as including rather than exclusive or exhaustive meanings; that is, the meaning of "including but not limited to". In the description of the present application, it should be understood that the terms "first", "second" and the like are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present application, unless otherwise specified, the meaning of "multiple" is two or more. In various embodiments of the present invention, for the protection of user privacy, the user information and terminal information obtained are obtained under the premise of user authorization and knowledge, and the user information obtained will only be applied to the methods described in various embodiments of the present invention.

In the following description, the example of storing meals in take-out cabinets is used for explanation. It should be understood that the embodiments of the present invention are not limited to the application scenarios and can be applied to any other platform with storage needs, such as express delivery platforms equipped with express cabinets for storage, logistics distribution platforms equipped with logistics transfer devices, etc.

FIG1 is a flow chart of an information interaction method according to an embodiment of the present invention. As shown in FIG1 , the information interaction method includes the following steps:

In step S101, after the storage process based on the mini-program is started, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time, and the image information to be recognized includes the image frame to be recognized and the corresponding recognition string.

Among them, the mini program is an application that can be used without downloading and installing. Users can open the corresponding application by scanning or searching. The mini program is available at any time and does not need to be installed or uninstalled, which embodies the concept of "use it and go", so that users do not have to worry about whether installing too many applications takes up too much terminal memory. The mini program platform can provide a variety of plug-ins for mini programs running on the mini program platform, such as optical character recognition (OCR) camera plug-ins, program code generation plug-ins, and one-way video plug-ins. The mini program of this embodiment is a logistics management mini program that includes a cabinet code intelligent recognition service. The logistics management mini program is configured to use the optical character recognition camera plug-in provided by the mini program platform to obtain the image information to be recognized. Optical character recognition refers to the process of analyzing and identifying image files containing text materials to obtain text information. In other words, character recognition of image files using OCR technology can return corresponding characters. The optical character recognition camera plug-in uses the computing resources of the terminal running the mini-program platform to determine the image information to be recognized. There is no need to upload the image frames to be recognized collected by the terminal to the server for OCR recognition and then return the recognition results to the terminal, which saves data transmission time and makes the OCR recognition process faster.

In a possible implementation, before calling the optical character recognition camera plug-in provided by the mini-program platform to obtain the image information to be recognized in real time, it is necessary to determine the stored meal page to be jumped to based on the computing resources of the terminal. The stored meal page includes a first stored meal page and a second stored meal page. Different stored meal pages use different amounts of computing resources when calling the optical character recognition camera plug-in. Specifically, after receiving a request to start the stored meal process, the computing resources of the terminal running the mini-program platform are detected. Based on the available computing resources of the terminal, determine the page to be jumped to. Specifically, in response to detecting that the computing resources are greater than a predetermined computing resource threshold, jump to the first stored meal page, and the first stored meal page is provided with a camera screen display box and a recommended cabinet opening code display control. In response to detecting that the computing resources are not greater than a predetermined computing resource threshold, jump to the second stored meal page, and the second stored meal page is provided with a camera jump control.

In response to receiving a locker process start request, the target interface information is determined, and then the target interface is called according to the target interface information to use the optical character recognition camera plug-in. Among them, the target interface is the interface corresponding to the optical character recognition camera plug-in, and the target interface information at least includes a target interface identifier and a target interface call credential. Exemplarily, the target interface identifier can be printedTextOCR, and the target interface call credential is a uniform resource locator (Uniform Resource Locator, URL) parameter, such as access_token or cloudbase_access_token, access_token can be obtained through the getAccessToken interface, and cloudbase_access_token can be obtained through the getOpenData interface. After successfully calling the optical character recognition camera plug-in through the target interface, the optical character recognition camera plug-in controls the camera component of the terminal to collect the image frame to be recognized in real time, and performs OCR recognition on the image frame to be recognized to obtain the recognition string corresponding to each image frame to be recognized. The obtained image frame to be recognized and the corresponding recognition string are returned to the logistics management applet.

In step S102, the corresponding real-time video is determined according to the image frame to be identified.

When acquiring the image frame to be recognized, the user needs to be guided to aim at a specific area, such as the customer information area or the recipient's mobile phone number area in the receipt, so that the image frame to be recognized containing the cabinet opening code can be collected. The cabinet opening code is generally all or part of the digits of the customer's mobile phone number, such as the last 4 digits of the mobile phone number. However, since the current camera component of the terminal has been occupied by the optical character recognition camera plug-in, and the optical character recognition camera plug-in only returns the image frame to be recognized, if the image frame to be recognized is directly displayed to prompt the user of the current shooting range, when the image frame to be recognized is constantly switched, the user will feel that the picture is stuck and the visual experience is poor. Therefore, it is necessary to draw and render it into a real-time video based on the image frame to be recognized and display it to the user, so that the user feels that the camera is being turned on for scanning.

For example, the Web Graphics Library (WebGL) technology can be used to render the image frame to be recognized into a real-time video stream. WebGL is a drawing technology standard that combines JavaScript and OpenGL, with the goal of opening the underlying drawing capabilities to the web application layer. The WebGL technology standard eliminates the trouble of developing dedicated rendering plug-ins for web pages and can be used to create images or videos with complex 3D structures.

In step S103, the real-time video is displayed in the camera screen display frame.

In step S104, a recommended locker opening code is determined according to the recognition character string.

Specifically, the recommended counter opening code is screened out from the recognition string according to a preset regular matching formula, and the preset regular matching formula may be a regular matching formula group, including multiple regular matching formulas. The preset regular matching formula is determined according to the actual situation, that is, according to the actual printed content of the receipt used by the food delivery platform. For example, the recommended counter opening code may be all or part of the digits of the customer's mobile phone number.

Exemplarily, if the receipt shows all the digits of the customer's mobile phone number, and the recommended counter code is also all the digits of the mobile phone number, the preset regular matching group can include the first regular matching, that is, /^1(?:3\d|4[4-9]|5[0-35-9]|6[67]|7[013-8]|8\d|9\d)\d{8}$/, where ^ indicates the beginning of the matching string, \d indicates the matching number, $ indicates the end of the matching string, n[a-b] indicates that the nth character can be any number between a-b, and \S indicates the matching space character. The first regular matching is used to find the customer's mobile phone number from the recognition string, and the result obtained by this formula is the recommended counter code. If the receipt shows all the digits of the customer's mobile phone number, and the recommended locker code is part of the mobile phone number, such as the last 4 digits of the mobile phone number, the preset regular matching group includes a second regular matching formula in addition to the first regular matching formula, that is, replace(/(\d{7}(\d{4})/,'\S{7}$1'). This formula means that the mobile phone number (including the first 7 digits and the last 4 digits of the mobile phone number) is replaced with the first 7 digits blank, and only the last 4 digits are displayed. The second regular matching formula The formula is used to extract the last 4 digits from the customer's mobile phone number as the recommended locker code. If the mobile phone number on the receipt is partially hidden to protect user privacy, such as "131****0000", the preset regular matching group can also be /^1(?:3\d|4[*]|5[*]|6[*]|7[*]|8\d|9\d)\d{8}$/ and replace(/(\d{7}(\d{4})/,'\S{7}$1').

The above steps S102-S103 and step S104 can be performed simultaneously in any order. That is to say, after the optical character recognition camera plug-in returns the image frame to be recognized and the corresponding recognition string, the image frame to be recognized and the recognition string are processed separately. While the real-time video is generated and displayed based on the image frame to be recognized, the recognition string is also regularly matched to determine the recommended cabinet opening code.

In step S105, in response to identifying the recommended locker opening code, the recommended locker opening code is displayed.

In step S106, in response to the recommended locker opening code confirmation control being triggered, the recommended locker opening code is sent to enable the food storage cabinet server to control the food storage cabinet to open the target cabinet compartment and to open the target cabinet compartment when the pickup code received is the recommended locker opening code. The recommended locker opening code confirmation control is used to send the recommended locker opening code to the food storage cabinet server after being triggered.

In a possible implementation, the recommended cabinet opening code confirmation control may include multiple recommended cabinet opening code confirmation sub-controls, and different cabinet opening code confirmation sub-controls correspond to different cabinet specifications, such as "large cabinet", "medium cabinet" or "small cabinet". Triggering the recommended cabinet opening code confirmation sub-controls corresponding to different specifications can select a cabinet compartment identifier suitable for the size of the food while sending the recommended cabinet opening code. Specifically, the recommended cabinet opening code is sent to the food storage cabinet server, and the recommended cabinet opening code should carry the cabinet compartment identifier. After the food storage cabinet server verifies the recommended cabinet opening code according to the order information, it determines the target cabinet compartment of the appropriate size from the free cabinet compartments according to the cabinet compartment identifier, and then sends an opening instruction carrying the cabinet compartment number to the food storage cabinet to control the food storage cabinet to open the target cabinet compartment. The delivery personnel puts the items to be stored into the target cabinet compartment and closes the target cabinet compartment.

In a possible implementation, the food storage cabinet server, in response to receiving a pickup locker opening request, obtains a pickup locker opening code associated with the pickup locker opening request. In response to detecting that the food storage cabinet pointed to by the pickup locker opening request has a recommended locker opening code that is the same as the pickup locker opening code associated with the pickup locker opening request, the food storage cabinet server sends a locker opening instruction to control the food storage cabinet to open the compartment associated with the same recommended locker opening code. Specifically, after receiving the pickup locker opening request sent by the customer terminal or the food storage cabinet, the food storage cabinet server determines the food storage cabinet pointed to by the pickup locker opening request, and then searches for the recommended locker opening code that is the same as the pickup locker opening code associated with the pickup locker opening request from the multiple recommended locker opening codes corresponding to the food storage cabinet. In response to the existence of the recommended locker opening code that is the same as the pickup locker opening code, the locker opening instruction is sent to the pointed food storage cabinet, and the locker opening instruction is associated with the target locker compartment identifier corresponding to the recommended locker opening code. After receiving the locker opening instruction, the food storage cabinet opens the target locker compartment associated with the recommended locker opening code.

The following is a detailed description of the above steps S101-S105. For step S101, there are many ways to start the storage process of the logistics management applet. For example, click the jump control of the storage page, successfully load the storage page, or receive the storage instruction. Rendering and displaying real-time video requires high rendering capabilities of the terminal. Therefore, for terminals with different performance, the calling conditions and usage time of the optical character recognition camera plug-in are different. In specific implementation, different meal storage page layouts can be set to achieve personalized processing for terminals with different performance. Under the premise of ensuring the recommended cabinet opening code recognition function, according to the terminal performance, a smoother user experience can be provided to users as much as possible.

In a possible implementation, for a terminal with abundant computing resources and high rendering capability, the stored meal page layout is the first stored meal page. In this case, step S101 is specifically the method shown in FIG.

FIG2 is a flow chart of a method for calling an optical character recognition camera plug-in provided by a mini-program platform to obtain image information to be recognized in real time according to an embodiment of the present invention. As shown in FIG2 , based on the fact that the stored meal page is the first stored meal page, the method for calling an optical character recognition camera plug-in provided by a mini-program platform to obtain image information to be recognized in real time includes the following steps:

In step S201, the computing resources of the terminal running the mini-program platform are detected.

The terminal running the mini program platform is the terminal held by the delivery personnel. Computing resources refer to the computing power and memory of the terminal itself, or the available computing power and available memory allocated by the terminal to the logistics management mini program.

In step S202, in response to detecting that the computing resources are greater than a predetermined computing resource threshold, the process jumps to a first stored meal page, where the first stored meal page is provided with a camera image display frame and a recommended locker code display control.

The predetermined computing resource threshold is not less than the minimum computing resource required to simultaneously realize the recognition of the recommended cabinet opening code and the drawing and rendering of the real-time video.

Fig. 3 is a schematic diagram of the first meal storage page of an embodiment of the present invention. As shown in Fig. 3, the first meal storage page 30 includes a recommended locker opening code identification container 31, a question answering control 35, a locker opening mode switching control 36, a main page switching container 37 and a navigation switching control 38.

Among them, the recommended cabinet code recognition container 31 is used to display prompt information and recommended cabinet code recognition related controls. The prompt information is used to prompt the user to scan a specific area to obtain a valid image frame to be identified. The specific area refers to the customer information area in the takeaway receipt, and the valid image frame to be identified is an image frame containing the customer's mobile phone number. The prompt information can specifically be "Please scan the customer information on the receipt to store the meal" or "Please aim at the customer's mobile phone number", etc. The recommended cabinet code recognition related controls include a camera screen display frame 32, a recommended cabinet code display control 33, and a recommended cabinet code confirmation control 34. The camera screen display frame 32 is used to display real-time video so that the user knows the current scanning range, so as to determine the correct scanning direction according to the prompt information and the current scanning range. The recommended cabinet code display control 33 is used to display the recommended cabinet code obtained by identification. Optionally, the recommended cabinet code display control 33 is an editable control. After the cabinet opening code display control 33 is triggered, the displayed recommended cabinet opening code can be edited and modified. That is to say, when the cabinet opening code display control 33 displays the recommended cabinet opening code, if the user finds that the recognized recommended cabinet opening code is wrong through manual verification, the recommended cabinet opening code display control 33 can be changed to an editable state by clicking on it, so as to edit and modify the recommended cabinet opening code. Furthermore, the recommended cabinet opening code display control 33 may include a predetermined number of recommended cabinet opening code display sub-controls, the number of recommended cabinet opening code display sub-controls is the same as the number of recommended cabinet opening codes, and each recommended cabinet opening code display sub-control displays a recommended cabinet opening code. If any recommended cabinet opening code is recognized incorrectly, click the corresponding recommended cabinet opening code display sub-control to modify it. The recommended cabinet opening code confirmation control 34 is used to send the recommended cabinet opening code to the food storage cabinet server after being triggered so that the food storage cabinet server controls the food storage cabinet to open the target cabinet. Optionally, the recommended cabinet opening code confirmation control 34 can also be used to determine the cabinet specifications. Specifically, the recommended cabinet opening code confirmation control 34 can include multiple recommended cabinet opening code confirmation sub-controls, and different cabinet opening code confirmation sub-controls correspond to different cabinet specifications, such as "large cabinet", "medium cabinet" or "small cabinet", etc. Clicking the recommended cabinet opening code confirmation sub-control corresponding to different specifications can associate the cabinet compartment identifier corresponding to the recommended cabinet opening code confirmation sub-control when sending the recommended cabinet opening code.

The question answering control 35 is used to display the most common user questions and to display question answering information when triggered. For example, the question answering control 35 is used to display "How to find the last 4 digits of a customer's mobile phone number?" and to display question answering information when triggered to guide the user to successfully find a specific area containing the customer's mobile phone number.

The locker opening mode switching control 36 is used to switch the locker opening code mode. The current default locker opening mode is to call the optical character recognition plug-in to identify and determine the recommended locker opening code. In addition, the locker opening mode also includes receiving the mobile phone code input by the user. After the locker opening mode switching control 36 is triggered, the current locker opening mode is switched from the mode of calling the optical character recognition plug-in to identify and determine the recommended locker opening code to the mode of receiving the mobile phone number input by the user as the locker opening code.

The main page switching container 37 is used to switch the main page. Specifically, the main page may include a stored meal page, a stored meal record display page, and a user personal information page. The main page switching container 37 may include a corresponding switching control for each page, such as a stored meal page switching control, a stored meal record display page switching control, and a user personal information page switching control. When the page switching control is triggered, it jumps to the main page corresponding to the page switching control. The page shown in FIG3 is the first stored meal page displayed after the stored meal page switching control is triggered.

The navigation switch control 38 is used to display the delivery address, and when triggered, requests the navigation service and jumps to the corresponding navigation interface.

In step S203, in response to the completion of loading of the first stored meal page, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time.

The following is a flowchart of a method for calling an optical character recognition camera plug-in provided by the mini-program platform to obtain image information to be recognized in real time, as shown in FIG2, and a schematic diagram of the first stored meal page shown in FIG3. Since this embodiment is designed for terminals with relatively rich computing resources and high rendering capabilities, the calling condition of the optical character recognition camera plug-in is to successfully load the first stored meal page. Successfully loading the first stored meal page indicates that the optical character recognition camera plug-in starts to be automatically called, and no other operations are required by the user. The process is simple and the user experience is good. After the first stored meal page 30 is successfully loaded, the optical character recognition camera plug-in starts to be called to obtain the image information to be recognized, and a real-time video is drawn according to the image frame to be recognized in the image information to be recognized, and the real-time video is displayed in the camera screen display frame 32 shown in FIG3. At the same time, the recommended locker code is determined according to the recognition string in the image information to be recognized. In response to identifying the recommended locker code, the recommended locker code display control 33 in the first stored meal page 30 displays the recommended locker code. It is worth noting that when the recommended locker opening code is displayed in the recommended locker opening code display control 33, the camera screen display frame 32 still displays the real-time video. Therefore, when using the first stored meal page, the time for calling the optical character recognition camera plug-in is the time from the successful loading of the first stored meal page to the time from leaving the first stored meal page, such as jumping to the stored meal record display page after the stored meal record display page switch control in the main page switch container 37 is triggered, or the time for calling the optical character recognition camera plug-in is the time from the successful loading of the first stored meal page to the time when the locker opening mode switch control 36 is triggered and the calling of the optical character recognition camera plug-in is stopped. During the time of calling the optical character recognition camera plug-in, it is necessary to continuously draw the image frames to be recognized returned by the optical character recognition camera plug-in into real-time video, and perform regular matching on the recognition string to determine the recommended locker opening code, which has high requirements on terminal performance and computing resources. Therefore, the method shown in Figure 3 is suitable for terminals with sufficient available computing resources.

Furthermore, to ensure the accuracy of the recommended locker code, the recommended locker code can be confirmed twice. Specifically, in response to the recommended locker code confirmation control 34 in FIG. 3 being triggered, the recommended locker code secondary confirmation control is displayed on the first meal storage page 30.

FIG4 is a schematic diagram of the first meal storage page after the recommended locker code confirmation control of the embodiment of the present invention is triggered. As shown in FIG4, after the recommended locker code confirmation control 24 is triggered, the recommended locker code secondary confirmation container 41 is displayed in the first meal storage page 30. Among them, the recommended locker code secondary confirmation container 41 can be displayed in the form of a pop-up window, that is, a recommended locker code secondary confirmation pop-up window. The recommended locker code secondary confirmation container 41 includes a secondary confirmation prompt information display control 42, a secondary confirmation recommended locker code display control 43, a recommended locker code modification control 44 and a recommended locker code secondary confirmation control 45.

The secondary confirmation prompt information display control 42 is used to display prompt information for prompting the user to manually check the recommended cabinet opening code displayed in the secondary confirmation recommended cabinet opening code display control 43. For example, the prompt information may be "Please confirm that the customer's last digit input is correct" and/or "Intelligent recognition may be wrong, please check carefully." Furthermore, the accuracy of the currently displayed recommended cabinet opening code can also be calculated, and the corresponding prompt information content can be determined according to the accuracy level. If the accuracy level is low, the corresponding prompt information content can be "The accuracy of the cabinet opening code obtained by the current intelligent recognition is low, please check carefully." Different prompt information can also be set for different accuracy levels. The prompt information is displayed in red color to prompt the user. For example, when the accuracy level is low, the prompt information is displayed in red color, and when the accuracy level is high, the prompt information is displayed in green color.

The secondary confirmation recommended locker code display control 43 is used to display the recommended locker code. The recommended locker code modification control 44 is used to change the editing state of the secondary confirmation recommended locker code display control 43 to an editable state after being triggered, or to jump to the recommended locker code modification container or page after being triggered. The user-modified recommended locker code is obtained.

The recommended cabinet opening code secondary confirmation control 45 is used for secondary confirmation of the recommended cabinet opening code. After being triggered, the recommended cabinet opening code is sent to the food storage cabinet server so that the food storage cabinet server controls the food storage cabinet to open the target cabinet.

In a possible implementation, for terminals with scarce computing resources and average rendering capabilities, the stored meal page layout is a second stored meal page. In this case, step S101 is specifically the method shown in FIG5 .

FIG5 is a flow chart of a method for calling an optical character recognition camera plug-in provided by a mini-program platform to obtain image information to be recognized in real time according to an embodiment of the present invention. As shown in FIG5 , the method for calling an optical character recognition camera plug-in provided by a mini-program platform to obtain image information to be recognized in real time includes the following steps:

In step S501, the computing resources of the terminal running the mini-program platform are detected.

In step S502, in response to detecting that the computing resources are not greater than a predetermined computing resource threshold, the page jumps to a second stored meal page, where the second stored meal page is provided with a camera jump control and a recommended locker code display control.

Fig. 6 is a schematic diagram of the second meal storage page of an embodiment of the present invention. As shown in Fig. 6, the second meal storage page 60 includes a locker code receiving container 61, a question answering control 64, a first camera jump control 65, a main page switching container 66 and a navigation switching control 67.

Among them, the cabinet opening code receiving container 61 is used to display prompt information and recommended cabinet opening code receiving related controls. The prompt information is used to prompt the user to enter the cabinet opening code. For example, the prompt information can be "Please enter the last 4 digits of the customer's mobile phone number to store meals." Recommended cabinet opening code receiving related controls include a cabinet opening code receiving control 62 and a second camera jump control 63. The cabinet opening code receiving control 62 is used to receive the cabinet opening code entered by the user. The second camera jump control 63 is used to jump to the camera page after being triggered to call the optical character recognition camera plug-in provided by the mini program platform to obtain the image information to be recognized in real time. The second camera jump control 63 is located below the cabinet opening code receiving control 62 so that when the user wants to enter the cabinet opening code, the user is prompted to use the optical character recognition method to automatically obtain the recommended cabinet opening code.

The question answering control 64 is used to display the most common user questions and to display question answering information after being triggered. The specific usage is the same as the question answering control 26 shown in FIG. 2 , and will not be described in detail here.

The first camera jump control 65 is used in the same manner as the second camera jump control 63. The first camera jump control 65 is located at the center of the second stored meal page 60, making it easier for the user to see and click the control.

The main page switching container 66 is used to switch the main page. The specific usage is the same as that of the main page switching container 27 shown in FIG. 2 , and will not be described in detail here.

The navigation switch control 67 is used to display the delivery address. The specific usage is the same as the navigation switch control 28 shown in Figure 2, which will not be repeated here.

In step S503, in response to the camera jump control being triggered, the control jumps to the camera page, where a camera image display frame is provided.

In step S504, in response to the completion of loading the camera page, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time.

Fig. 7 is a schematic diagram of a camera page according to an embodiment of the present invention. As shown in Fig. 7, the camera page 70 includes a prompt information display control 71, a camera image display frame 72 and a second stored meal page return control 73.

The prompt information display control 71 is used to display information prompting the user to scan a specific area to obtain a valid image frame to be identified. The prompt information may specifically be "Please scan the [customer information] on the receipt" or the like.

The camera screen display frame 72 is used to display real-time video so that the user can know the current scanning range and determine the correct scanning direction according to the prompt information and the current scanning range.

The second stored meal page return control 73 is used to jump from the camera page 70 to the second stored meal page 60. Specifically, when the scanning time is too long but the recommended locker opening code is not recognized, the user can choose to trigger the second stored meal page return control 73 to return to the second stored meal page to rescan or manually enter the locker opening code.

While the camera screen display frame 72 displays real-time video, the terminal determines the recommended locker opening code based on the recognition character string, and in response to identifying the recommended locker opening code, returns from the camera page 70 to the second stored meal page 60, and displays the recommended locker opening code in the recommended locker opening code display control in the second stored meal page 60.

FIG8 is a schematic diagram of the second meal storage page after the recommended locker opening code is identified in an embodiment of the present invention. As shown in FIG8, when the recommended locker opening code is identified when the camera page is displayed, when the camera page is redirected to the second meal storage page 60, the second meal storage page 60 displays the recommended locker opening code confirmation container 81. Among them, the recommended locker opening code confirmation container 81 can be displayed in the form of a pop-up window, that is, the recommended locker opening code display pop-up window. The recommended locker opening code confirmation container 81 includes a confirmation prompt information control 82, a recommended locker opening code display control 83, a recommended locker opening code modification control 84 and a recommended locker opening code confirmation control 85.

The confirmation prompt information control 82 is used to display prompt information prompting the user to manually check the recommended locker opening code displayed in the confirmation recommended locker opening code display control 83. The specific usage is the same as the usage of the secondary confirmation prompt information display control 42 shown in Figure 4, which will not be repeated here.

The recommended locker opening code display control 83 is used to display the recommended locker opening code obtained by identification.

The recommended locker opening code modification control 84 is used to modify the recommended locker opening code displayed by the recommended locker opening code display control 83. The specific usage is the same as that of the recommended locker opening code modification control 44 shown in FIG.

The recommended locker opening code confirmation control 85 is used to send the recommended locker opening code to the food storage cabinet server after being triggered so that the food storage cabinet server controls the food storage cabinet to open the target cabinet. The specific usage is the same as the usage of the recommended locker opening code confirmation control 34 shown in Figure 3, which will not be repeated here.

Furthermore, in order to ensure the accuracy of the recommended cabinet opening code, the recommended cabinet opening code obtained by identification can also be reconfirmed. Specifically, when the recommended cabinet opening code confirmation control 85 in FIG8 is triggered, the recommended cabinet opening code secondary confirmation container 41 shown in FIG4 is displayed on the second meal storage page 60. The secondary confirmation method is the same as the method of using the recommended cabinet opening code secondary confirmation container 41 shown in FIG4. Since the present embodiment is designed for terminals with relatively scarce computing resources and general rendering capabilities, the calling condition of the optical character recognition camera plug-in is that the camera jump control in the second meal storage page is triggered. After the recommended cabinet opening code is identified, that is, after returning from the camera page to the second meal storage page, there is no need to call the optical character recognition camera plug-in, nor is it necessary to draw real-time video and identify the recommended cabinet opening code. Therefore, when using the second meal storage page for character recognition, the time for calling the optical character recognition camera plug-in is the time from when the camera jump control in the second meal storage page is triggered to when the second meal storage page is returned. The calling time is short. When recognition is needed, click the camera jump control to start recognition and draw real-time video. After the recommended cabinet opening code is recognized, character recognition and real-time video drawing are stopped. The requirements for terminal performance and computing resources are low. Therefore, the method shown in Figure 5 is suitable for terminals with limited available computing resources.

The method of the embodiment of the present invention is applicable to the storage process based on the applet. After the storage process is started, the optical character recognition camera plug-in provided by the applet platform is called to obtain the image frame to be recognized and the recognition string corresponding to the image frame to be recognized in real time, and then the image frame to be recognized obtained in real time is drawn and rendered into a real-time video, and the real-time video is displayed in the camera screen display frame, so that the user can know the real-time scanning range and improve the user experience. At the same time, the recommended cabinet opening code is determined according to the recognition string. When the recommended cabinet opening code is successfully recognized, the recommended cabinet opening code is displayed. When it is detected that the user triggers the recommended cabinet opening code, the recommended cabinet opening code is sent to the food storage cabinet server to control the food storage cabinet to open the target cabinet, and the target cabinet is opened when the pickup code is received as the recommended cabinet opening code. The embodiment of the present invention can automatically analyze the cabinet opening code from the image frame to be recognized by using optical character recognition, thereby simplifying the meal storage process. By calling the optical character recognition camera plug-in provided by the applet platform, character recognition can be realized in the terminal without interacting with the server, saving data transmission time and improving recognition speed.

FIG9 is a flow chart of an information interaction method according to an embodiment of the present invention. As shown in FIG9 , the method comprises the following steps:

In step S901, in response to the completion of loading of the first stored meal page, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain image information to be recognized in real time, and the image information to be recognized includes the image frame to be recognized and the corresponding recognition string.

Among them, the layout of the first stored meal page and the controls included are shown in Figure 3, which will not be repeated here.

In step S902, the corresponding real-time video is determined according to the image frame to be identified, and the real-time video is displayed in the camera image display frame in the first stored meal page.

In step S903, a recommended locker opening code is determined according to the recognition character string.

In step S904, in response to identifying the recommended locker opening code, the recommended locker opening code is displayed.

In step S905, in response to the recommended cabinet opening code confirmation control being triggered, a recommended cabinet opening code secondary confirmation container, that is, a recommended cabinet opening code secondary confirmation pop-up window is displayed, and the recommended cabinet opening code secondary confirmation container includes the recommended cabinet opening code secondary confirmation control.

Among them, the layout of the first meal storage page including the recommended cabinet opening code and the secondary confirmation container is shown in Figure 4, which will not be repeated here.

In step S906, in response to the recommended locker opening code secondary confirmation control being triggered, the recommended locker opening code is sent to the food storage cabinet server so that the food storage cabinet server controls the food storage cabinet to open the target cabinet. When the logistics management applet is started for the first time, the computing resources of the terminal running the applet platform can also be detected. If it is detected that the computing resources are greater than the predetermined computing resource threshold, the meal storage page is determined to be the first meal storage page. Thereafter, when the logistics management applet is started again on the same terminal, the default meal storage page is the first meal storage page.

The method of the embodiment of the present invention is applicable to a terminal with sufficient available computing resources. After the first stored meal page is loaded successfully, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image frame to be recognized and the recognition string corresponding to the image frame to be recognized in real time, and then the image frame to be recognized obtained in real time is drawn and rendered into a real-time video, and the real-time video is displayed in the camera screen display frame, so that the user can know the real-time scanning range and improve the user experience. At the same time, the recommended cabinet opening code is determined according to the recognition string. When the recommended cabinet opening code is successfully recognized, the recommended cabinet opening code is displayed on the first stored meal page. When it is detected that the user triggers the recommended cabinet opening code, the recommended cabinet opening code is sent to the cabinet server to control the cabinet to open the target cabinet, and the target cabinet is opened when the pickup code is received as the recommended cabinet opening code. The embodiment of the present invention successfully loads the first stored meal page, which means that the optical character recognition camera plug-in is automatically called, and no other operations are required by the user. The process is simple and the user experience is good. By using optical character recognition, the cabinet opening code can be automatically analyzed from the image frame to be recognized, simplifying the meal storage process. By calling the optical character recognition camera plug-in provided by the mini-program platform, character recognition can be realized in the terminal without interacting with the server, saving data transmission time and improving recognition speed.

FIG10 is a flow chart of an information interaction method according to an embodiment of the present invention. As shown in FIG10 , the method includes the following steps:

In step S1001, in response to the camera jump control in the second stored meal page being triggered, the page jumps to the camera page, which is provided with a camera image display frame. The layout of the second stored meal page and the controls included are shown in FIG6 , which will not be described in detail here.

In step S1002, in response to the completion of loading the camera page, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time. The layout of the camera page and the controls included are shown in FIG7 , which will not be described in detail here.

In step S1003, the corresponding real-time video is determined according to the image frame to be identified, and the real-time video is displayed in the camera screen display box in the camera page.

In step S1004, a recommended locker opening code is determined according to the recognition character string.

In step S1005, in response to identifying the recommended locker opening code, the camera page returns to the second stored meal page.

Among them, after returning to the second stored meal page from the camera page, the layout of the second stored meal page and the controls included are shown in Figure 8, which will not be repeated here.

In step S1006, the recommended locker opening code is displayed in the recommended locker opening code confirmation container, which at least includes a recommended locker opening code display control and a recommended locker opening code confirmation control. That is, the recommended locker opening code is displayed in the recommended locker opening code display pop-up window.

In step S1007, in response to the recommended cabinet opening code confirmation control being triggered, a recommended cabinet opening code secondary confirmation container is displayed, and the recommended cabinet opening code secondary confirmation container includes the recommended cabinet opening code secondary confirmation control.

The recommended locker opening code confirmation container is the same as the recommended locker opening code secondary confirmation container 41 shown in FIG. 4 , and will not be described in detail herein.

In step S1008, in response to the recommended locker opening code secondary confirmation control being triggered, the recommended locker opening code is sent to the food locker server so that the food locker server controls the food locker to open the target compartment.

When the logistics management applet is started for the first time, the computing resources of the terminal running the applet platform can also be detected. If it is detected that the computing resources are not greater than the predetermined computing resource threshold, the stored meal page is determined to be the second stored meal page. Thereafter, when the logistics management applet is started again on the same terminal, the default stored meal page is the second stored meal page.

The method of the embodiment of the present invention is applicable to terminals with scarce available computing resources. After the camera jump control in the second meal storage page is triggered, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image frame to be recognized and the recognition string corresponding to the image frame to be recognized in real time, and then the image frame to be recognized obtained in real time is drawn and rendered into a real-time video, and the real-time video is displayed in the camera screen display box in the camera page, so that the user can know the real-time scanning range and improve the user experience. At the same time, the recommended cabinet opening code is determined according to the recognition string. When the recommended cabinet opening code is successfully recognized, the recommended cabinet opening code is displayed on the second meal storage page. When it is detected that the user triggers the recommended cabinet opening code, the recommended cabinet opening code is sent to the meal storage cabinet server to control the meal storage cabinet to open the target cabinet, and the target cabinet is opened when the pickup code is received as the recommended cabinet opening code. In the embodiment of the present invention, when recognition is required, the camera jump control is clicked to start recognition and draw real-time video, and character recognition and real-time video drawing are stopped after the recommended cabinet opening code is recognized. The requirements for terminal performance and computing resources are low, and it can be applied to more terminals. By using optical character recognition, the cabinet opening code can be automatically analyzed from the image frame to be recognized, simplifying the meal storage process. By calling the optical character recognition camera plug-in provided by the mini-program platform, character recognition can be realized on the terminal without interacting with the server, saving data transmission time and improving recognition speed.

Fig. 11 is a schematic diagram of an information interaction system according to an embodiment of the present invention. As shown in Fig. 11, the information interaction system includes: a delivery terminal 1101 (hereinafter referred to as terminal), a food storage cabinet server 1102 and a food storage cabinet 1103. In addition, a pickup terminal 1104 may also be included.

In this embodiment, the delivery terminal 1101 is used to determine the recommended cabinet opening code and request the cabinet opening to store food from the food storage cabinet server 1102. The food storage cabinet 1103 is used to open the cabinet after receiving the cabinet opening instruction, and send a cabinet opening request to the food storage cabinet server 1102 after receiving the cabinet opening code input by the customer. The pickup terminal 1104 can also be used to receive the cabinet opening code input by the customer or automatically identify the cabinet opening code from the order information, and send a cabinet opening request to the food storage cabinet server 1102. The delivery terminal 1101 and the pickup terminal 1104 are general terminals that can run the client application or applet of the food delivery platform. For example, the terminal can be a terminal device such as a mobile phone, a computer or a tablet computer. In some embodiments, the delivery terminal 1101 or the pickup terminal 1104 can also be a dedicated terminal with an application program solidified in a dedicated integrated circuit. Among them, the open platform enables third-party developers to develop their own applet based on the open platform by providing an application programming interface (Application Programming Interface, API) to third-party developers. The mini program can be a program developed on the basis of the application in the platform and used to perform corresponding operations. Among them, the delivery terminal 1101 is the terminal device of the delivery resource for the platform to perform the delivery task. The delivery resource can be personnel or various unmanned equipment, such as delivery unmanned vehicles, delivery robots, delivery drones, etc. The pickup terminal 1104 is a terminal device used or held by platform consumers.

The food storage cabinet server 1102 completes the order processing by interacting with the delivery terminal 1101, the food storage cabinet 1103 and/or the pickup terminal 1104. During the food storage stage, the delivery terminal 1101 completes the recommended cabinet opening code recognition through human-computer interaction. Specifically, after the storage process based on the mini program is started, the delivery terminal 1101 calls the optical character recognition camera plug-in provided by the mini program platform to obtain the image information to be recognized in real time. The image information to be recognized includes the image frame to be recognized. and the corresponding identification string, and then determine the corresponding real-time video according to the image frame to be identified, and display the real-time video in the camera screen display frame. At the same time, determine the recommended cabinet opening code according to the identification string, and display the recommended cabinet opening code in response to identifying the recommended cabinet opening code. After determining the recommended cabinet opening code, the distribution terminal 1101 connects to the food storage cabinet server 1102 through the Internet to complete the cabinet storage task. Specifically, the distribution terminal 1101 sends the recommended cabinet opening code to the food storage cabinet server 1102, wherein the recommended cabinet opening code is also associated with the order identifier and the cabinet compartment identifier representing the cabinet compartment size. After receiving the cabinet opening code, the food storage cabinet server 1102 searches for the order information according to the order identifier, and searches for all the digits of the customer's mobile phone number and/or part of the last four digits of the mobile phone number from the order information. Compare the recommended cabinet opening code with all the digits of the mobile phone number and/or part of the last four digits of the mobile phone number. If the comparison result is a match, determine the target cabinet compartment that meets the cabinet size requirements from the specifications of the food storage cabinet, and establish a mapping relationship between the target cabinet compartment identifier and the order information. The food storage cabinet server 1102 sends a food storage cabinet opening instruction associated with the target cabinet identifier to the food storage cabinet 1103. After receiving the food storage cabinet opening instruction, the food storage cabinet 1103 opens the target cabinet corresponding to the target cabinet identifier to complete the food storage. After the food storage cabinet 1103 detects that the target cabinet is closed, it sends a food storage success feedback message to the food storage cabinet server 1102. After receiving the food storage success feedback message, the food storage cabinet server 1102 changes the order information status to waiting for food pickup, and sends a food pickup notification to the pickup terminal 1104. In the meal pickup phase, the meal storage cabinet server 1102, in response to receiving the pickup cabinet opening request sent by the meal storage cabinet 1103 or the pickup terminal 1104, determines the meal storage cabinet pointed to by the pickup cabinet opening request, and then searches for the recommended cabinet opening code that is the same as the pickup cabinet opening code from the recommended cabinet opening codes corresponding to the meal storage cabinet. If there is a recommended cabinet opening code that is the same as the pickup cabinet opening code, the cabinet corresponding to the recommended cabinet opening code is determined as the target cabinet, or the pickup cabinet opening code associated with the pickup cabinet opening request is compared with all the digits of the customer's mobile phone number and/or part of the last four digits of the mobile phone number in the order information corresponding to each cabinet. If the comparison result indicates that the pickup cabinet opening code is the same as all the digits of the mobile phone number and/or part of the last four digits of the mobile phone number, the cabinet corresponding to the order information is determined to be the target cabinet. The meal storage cabinet server 1102 sends a meal pickup cabinet opening instruction to the meal storage cabinet 1103, and the meal pickup cabinet opening instruction is associated with the target cabinet identifier. After receiving the order to open the cabinet for meal pickup, the food storage cabinet 1103 controls the target cabinet corresponding to the target cabinet identifier to open the cabinet so that the customer can pick up the meal. After detecting that the target cabinet is closed, the food storage cabinet 1103 sends a feedback message of successful meal pickup to the food storage cabinet server 1102. The food storage cabinet server 1102 updates the order status to completed.

FIG12 is a schematic diagram of an information interaction device according to an embodiment of the present invention. As shown in FIG12 , the device comprises:

The calling module 1201 is used to call the optical character recognition camera plug-in provided by the mini-program platform to obtain the image information to be recognized in real time after the storage process based on the mini-program is started, and the image information to be recognized includes the image frame to be recognized and the corresponding recognition string;

A first determination module 1202 is used to determine a corresponding real-time video according to the image frame to be identified;

The first display module 1203 is used to display real-time video in the camera screen display frame;

The second determination module 1204 is used to determine the recommended locker opening code according to the recognition character string;

The second display module 1205 is used to display the recommended locker opening code in response to identifying the recommended locker opening code;

The sending module 1206 is used for sending the recommended locker opening code in response to the recommended locker opening code confirmation control being triggered so that the food storage cabinet server controls the food storage cabinet to open the first cabinet compartment and to open the first cabinet compartment when the pickup code received is the recommended locker opening code.

The device of the embodiment of the present invention is suitable for the cabinet storage process implemented based on the mini program. After the cabinet storage process is started, the optical character recognition camera plug-in provided by the mini program platform is called to obtain the image frame to be recognized and the recognition string corresponding to the image frame to be recognized in real time, and then the image frame to be recognized obtained in real time is drawn and rendered into a real-time video, and the real-time video is displayed in the camera screen display frame, so that the user can know the real-time scanning range and improve the user experience. At the same time, the recommended cabinet opening code is determined according to the recognition string. When the recommended cabinet opening code is successfully recognized, the recommended cabinet opening code is displayed to control the food storage cabinet to open the target cabinet, and open the target cabinet when the pickup code is received as the recommended cabinet opening code. The embodiment of the present invention can automatically analyze the cabinet opening code from the image frame to be recognized by using optical character recognition, thereby simplifying the meal storage process. By calling the optical character recognition camera plug-in provided by the mini program platform, character recognition can be realized in the terminal without interacting with the server, saving data transmission time and improving recognition speed.

FIG13 is a schematic diagram of an electronic device of an embodiment of the present invention. In this embodiment, the electronic device 1300 includes a server, a terminal, etc. As shown in FIG13 , the electronic device 1300 includes at least one processor 1301; and a memory 1302 connected to the at least one processor 1301 in communication; and a communication component 1303 connected to the scanning device in communication, and the communication component 1303 receives and sends data under the control of the processor 1301; wherein the memory 1302 stores instructions that can be executed by at least one processor 1301, and the instructions are executed by at least one processor 1301 to implement the above-mentioned information interaction method.

Specifically, the electronic device includes: one or more processors 1301 and a memory 1302, and FIG13 takes a processor 1301 as an example. The processor 1301 and the memory 1302 can be connected via a bus or other means, and FIG13 takes the connection via a bus as an example. The memory 1302, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The processor 1301 executes various functional applications and data processing of the device by running the non-volatile software programs, instructions and modules stored in the memory 1302, that is, realizing the above-mentioned information interaction method.

The memory 1302 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store a list of options, etc. In addition, the memory 1302 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 1302 may optionally include a memory remotely arranged relative to the processor 1301, and these remote memories may be connected to an external device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

One or more modules are stored in the memory 1302, and when executed by one or more processors 1301, the information interaction method in any of the above method embodiments is executed.

The above-mentioned product can execute the method provided in the embodiment of the present application, and has the functional modules and beneficial effects corresponding to the execution method. For technical details not fully described in this embodiment, please refer to the method provided in the embodiment of the present application.

The embodiment of the present invention is applicable to the storage process based on the applet. After the storage process is started, the optical character recognition camera plug-in provided by the applet platform is called to obtain the image frame to be recognized and the recognition string corresponding to the image frame to be recognized in real time, and then the image frame to be recognized obtained in real time is drawn and rendered into a real-time video, and the real-time video is displayed in the camera screen display frame, so that the user can know the real-time scanning range and improve the user experience. At the same time, the recommended cabinet opening code is determined according to the recognition string. When the recommended cabinet opening code is successfully recognized, the recommended cabinet opening code is displayed. When it is detected that the user triggers the recommended cabinet opening code, the recommended cabinet opening code is sent to the food storage cabinet server to control the food storage cabinet to open the target cabinet, and the target cabinet is opened when the pickup code is received as the recommended cabinet opening code. The embodiment of the present invention can automatically analyze the cabinet opening code from the image frame to be recognized by using optical character recognition, thereby simplifying the food storage process. By calling the optical character recognition camera plug-in provided by the applet platform, character recognition can be realized in the terminal without interacting with the server, saving data transmission time and improving recognition speed.

Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, which is used for a computer to execute some or all of the above-mentioned method embodiments. That is, it can be understood by those skilled in the art that all or part of the steps in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code. The above is only a preferred embodiment of the present application, and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims (17)

An information interaction method, wherein the method comprises: After the mini-program based storage process is started, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time, wherein the image information to be recognized includes the image frame to be recognized and the corresponding recognition string; Determine the corresponding real-time video according to the image frame to be identified; Display the real-time video in the camera screen display frame; Determine a recommended locker opening code according to the identification character string; In response to identifying the recommended locker opening code, displaying the recommended locker opening code; In response to the recommended locker opening code confirmation control being triggered, sending the recommended locker opening code to enable the food storage cabinet server to control the food storage cabinet to open the target locker compartment and to open the target locker compartment when receiving a pickup code that is the recommended locker opening code; The optical character recognition camera plug-in uses the computing resources of the terminal running the mini-program platform to determine the image information to be recognized. The method according to claim 1, wherein before calling the optical character recognition camera plug-in provided by the mini-program platform, the method further comprises: A request to start the meal storage process is received; Detect the computing resources of the terminal running the mini-program platform. The method according to claim 2, wherein before calling the optical character recognition camera plug-in provided by the mini-program platform, the method further comprises: In response to detecting that the computing resources are greater than a predetermined computing resource threshold, the program jumps to a first stored meal page, wherein the first stored meal page is provided with a camera image display frame and a recommended locker opening code display control, wherein the recommended locker opening code display control is used to display the recommended locker opening code. The method according to claim 2, wherein before calling the optical character recognition camera plug-in provided by the mini-program platform, the method further comprises: In response to detecting that the computing resource is not greater than a predetermined computing resource threshold, jumping to a second stored meal page, where the second stored meal page is provided with a camera jump control. The method according to claim 3, wherein the calling of the optical character recognition camera plug-in provided by the mini-program platform to obtain the image information to be recognized in real time specifically comprises: In response to the completion of loading of the first stored meal page, the optical character recognition camera plug-in provided by the mini-program platform is called to obtain the image information to be recognized in real time. The method according to claim 4, wherein the calling of the optical character recognition camera plug-in provided by the mini-program platform to obtain the image information to be recognized in real time is specifically: In response to the camera jump control in the second stored meal page being triggered, it jumps to the camera page, and the camera page is provided with the camera screen display box; in response to the camera page loading is completed, the optical character recognition camera plug-in provided by the mini program platform is called to obtain the image information to be recognized in real time. The method according to claim 1, wherein determining the recommended locker opening code according to the identification character string comprises: The recommended locker opening code is filtered out from the identification character string according to a preset regular matching formula. According to the method of claim 7, wherein the step of selecting the recommended locker opening code from the identification string according to a preset regular matching formula comprises: According to a preset regular matching formula, all digits of the customer's mobile phone number are filtered out from the identification string; all digits of the mobile phone number or part of the digits of the mobile phone number are determined as the recommended locker opening code. The method according to claim 5, wherein, in response to identifying the recommended locker opening code, displaying the recommended locker opening code comprises: In response to identifying the recommended locker opening code, the recommended locker opening code display control in the first meal storage page displays the recommended locker opening code. The method according to claim 6, wherein, in response to identifying the recommended locker opening code, displaying the recommended locker opening code comprises: In response to identifying the recommended locker opening code, returning from the camera page to the second stored meal page; The recommended locker opening code is displayed in a pop-up window on the second meal storage page. The method according to claim 9, wherein in response to the recommended locker opening code confirmation control being triggered, sending the recommended locker opening code so that the food storage cabinet server controls the food storage cabinet to open the target cabinet compartment and opens the target cabinet compartment when receiving the pickup code as the recommended locker opening code, comprises: In response to the recommended locker code confirmation control in the first meal storage page being triggered, a recommended locker code secondary confirmation pop-up window is displayed; In response to the recommended locker opening code secondary confirmation control in the recommended locker opening code secondary confirmation pop-up window being triggered, the recommended locker opening code is sent to enable the food storage cabinet server to control the food storage cabinet to open the target cabinet compartment and open the target cabinet compartment when the pickup code received is the recommended locker opening code. The method according to claim 1, wherein the method further comprises: In response to the recommended locker opening code modification control being triggered, the recommended locker opening code modified by the user is received and displayed. The method according to claim 1, wherein the calling of the optical character recognition camera plug-in provided by the mini-program platform is specifically: In response to receiving the cabinet deposit process start request, determining target interface information, the target interface information at least including a target interface identifier and a target interface call credential; The target interface is called according to the target interface information to use the optical character recognition camera plug-in. The method according to claim 1, wherein the step of opening the target cabinet when the pickup code received is the recommended cabinet opening code comprises: In response to receiving a pickup locker opening request, the food storage locker server obtains a pickup locker opening code associated with the pickup locker opening request; in response to detecting that the food storage locker pointed to by the pickup locker opening request has a recommended locker opening code that is the same as the pickup locker opening code associated with the pickup locker opening request, the food storage locker server sends an opening instruction to control the food storage locker to open a compartment associated with the same recommended locker opening code. An information interaction device, wherein the device comprises: A calling module, used to call the optical character recognition camera plug-in provided by the mini-program platform to obtain the image information to be recognized in real time after the storage process based on the mini-program is started, wherein the image information to be recognized includes the image frame to be recognized and the corresponding recognition string; A first determination module, used to determine the corresponding real-time video according to the image frame to be identified; A first display module, used for displaying the real-time video in a camera screen display frame; A second determination module, configured to determine a recommended cabinet opening code according to the identification character string; A second display module, configured to display the recommended cabinet opening code in response to identifying the recommended cabinet opening code; A sending module, used for sending the recommended cabinet opening code so that the food storage cabinet server controls the food storage cabinet to open the target cabinet compartment and opens the target cabinet compartment when receiving a pickup code that is the recommended cabinet opening code; The optical character recognition camera plug-in uses the computing resources of the terminal running the mini-program platform to determine the image information to be recognized. An electronic device comprises a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to any one of claims 1 to 14. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 14 is implemented.