CN116994380A

CN116994380A - Information interaction method and device

Info

Publication number: CN116994380A
Application number: CN202311229275.8A
Authority: CN
Inventors: 曹树建; 施杰; 刘思; 樊继强
Original assignee: Zhejiang Koubei Network Technology Co Ltd
Current assignee: Zhejiang Koubei Network Technology Co Ltd
Priority date: 2023-09-21
Filing date: 2023-09-21
Publication date: 2023-11-03
Anticipated expiration: 2043-09-21
Also published as: CN116994380B; CN118097858A

Abstract

The embodiment of the invention discloses an information interaction method and device. The embodiment of the invention is suitable for a cabinet storing process realized based on the small program. And after the process of the storage cabinet is started, calling an optical character recognition camera plug-in provided by the applet platform to acquire the image frame to be recognized and the recognition character string in real time. The image frames to be identified are drawn into real-time video and then displayed in a camera picture display frame, so that a user can know the real-time scanning range, and experience is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code to a user after the recommended cabinet opening code is successfully identified, detecting that the user triggers the recommended cabinet opening code, and sending the recommended cabinet opening code to a meal storage cabinet server so as to control the meal storage cabinet to open a target cabinet and open the target cabinet when receiving the taking code as the recommended cabinet opening code. By calling the optical character recognition camera plug-in, the cabinet opening code is obtained through automatic analysis, the storage flow is simplified, meanwhile, the optical character recognition can be realized at the terminal, and the data transmission time is saved.

Description

Information interaction method and device

Technical Field

The invention relates to the technical field of logistics management, in particular to an information interaction method and device for logistics distribution information management.

Background

In a logistics distribution scene, the distribution cabinet solves the logistics distribution service problem of the last 50 meters. When the distribution personnel store the objects to be distributed in the distribution cabinet, the storage operation is completed by manually inputting the mobile phone number of the user and then taking the four mobile phones as the cabinet opening code. In the process, the distribution personnel is required to wake up the digital input panel, and then the effective digits of the mobile phone number are manually input into the digital input panel bit by bit, so that the time and complexity of the operation flow of the distribution personnel are increased, and meanwhile, if the distribution personnel input an incorrect cabinet opening code, the customer cannot normally take out the articles.

Disclosure of Invention

In view of the above, the embodiment of the invention provides an information interaction method and an information interaction device, which are used for automatically analyzing and obtaining a cabinet opening code according to a label ticket, so that the storage flow is simplified.

In a first aspect, there is provided an information interaction method, the method including:

after a cabinet storing process based on an applet is started, an optical character recognition camera plug-in provided by an applet platform is called to acquire image information to be recognized in real time, wherein the image information to be recognized comprises image frames to be recognized and corresponding recognition character strings;

determining a corresponding real-time video according to the image frame to be identified;

Displaying the real-time video on a camera picture display frame;

determining a recommended cabinet opening code according to the identification character string;

in response to identifying the recommended cabinet opening code, displaying the recommended cabinet opening code;

and responding to the triggering of the recommended cabinet opening code confirmation control, sending the recommended cabinet opening code to enable the server of the dinner cabinet to control the dinner cabinet to open the target cabinet and opening the target cabinet when receiving the fetching code as the recommended cabinet opening code.

In a second aspect, there is provided an information interaction device, the device comprising:

the calling module is used for calling an optical character recognition camera plug-in provided by the applet platform to acquire image information to be recognized in real time after the applet-based cabinet process is started, wherein the image information to be recognized comprises image frames to be recognized and corresponding recognition character strings;

the first determining module is used for determining a corresponding real-time video according to the image frame to be identified;

the first display module is used for displaying the real-time video on a camera picture display frame;

the second determining module is used for determining a recommended cabinet opening code according to the identification character string;

the second display module is used for responding to the identification of the recommended cabinet opening code and displaying the recommended cabinet opening code;

The sending module is used for sending the recommended cabinet opening code so that the server of the dinner cabinet can control the dinner cabinet to open the target cabinet and open the target cabinet when receiving the picking code which is the recommended cabinet opening code.

In a third aspect, there is provided an electronic device comprising a memory for storing one or more computer program instructions, and a processor, wherein the one or more computer program instructions are executable by the processor to implement the method as described in the first aspect above.

In a fourth aspect, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement a method as described in the first aspect above.

The embodiment of the invention is suitable for a cabinet storing process realized based on the small program. After the process of the storage cabinet is started, the optical character recognition camera plug-in provided by the applet platform is called to acquire the image frame to be recognized and the recognition character string corresponding to the image frame to be recognized in real time, then the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame, so that a user can know the real-time scanning range, and the experience of the user is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code after the recommended cabinet opening code is successfully identified, detecting that a user triggers the recommended cabinet opening code, sending the recommended cabinet opening code to a server of the meal storage cabinet to control the meal storage cabinet to open the target cabinet, and opening the target cabinet when receiving the taking code as the recommended cabinet opening code. According to the embodiment of the invention, the cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, so that the optical character recognition can be realized at the terminal, and the data transmission time is saved.

Drawings

The above and other objects, features and advantages of the present invention will become more apparent from the following description of embodiments of the present invention with reference to the accompanying drawings, in which:

FIG. 1 is a flow chart of an information interaction method according to an embodiment of the present invention;

FIG. 2 is a flowchart of a method for calling an optical character recognition camera plug-in provided by an applet platform to obtain image information to be recognized in real time according to an embodiment of the invention;

FIG. 3 is a schematic diagram of a first page of memory according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a first meal page after a recommended cabinet code confirmation control is triggered according to an embodiment of the present invention;

FIG. 5 is a flowchart of a method for calling an optical character recognition camera plug-in provided by an applet platform to obtain image information to be recognized in real time according to an embodiment of the invention;

FIG. 6 is a schematic diagram of a second memory page according to an embodiment of the present invention;

FIG. 7 is a diagram of a camera page according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a second page of a meal after a recommended cabinet code is obtained by identification according to an embodiment of the present invention;

FIG. 9 is a flowchart of an information interaction method according to an embodiment of the present invention;

FIG. 10 is a flowchart of an information interaction method according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of an information interaction system according to an embodiment of the present invention;

FIG. 12 is a schematic diagram of an information interaction device according to an embodiment of the present application;

fig. 13 is a schematic diagram of an electronic device according to an embodiment of the application.

Detailed Description

The present application is described below based on examples, but the present application is not limited to only these examples. In the following detailed description of the present application, certain specific details are set forth in detail. The present application will be fully understood by those skilled in the art without the details described herein. Well-known methods, procedures, flows, components and circuits have not been described in detail so as not to obscure the nature of the application.

Moreover, those of ordinary skill in the art will appreciate that the drawings are provided herein for illustrative purposes and that the drawings are not necessarily drawn to scale.

Unless the context clearly requires otherwise, the words "comprise," "comprising," and the like throughout the application are to be construed as including but not being exclusive or exhaustive; that is, it is the meaning of "including but not limited to".

In the description of the present application, it should be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Furthermore, in the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

In the embodiments of the present invention, for protecting the privacy rights of the user, the acquired user information and terminal information are acquired under the precondition of user authorization and knowledge, and the acquired user information is only applied to the method described in the embodiments of the present invention.

In the following description, take out cabinet meal storage as an example for illustration, it should be understood that the embodiment of the present invention is not limited to application scenarios, and may be applied to any other platform with a requirement for storing things, such as an express delivery platform configured with express cabinet meal storage, a logistics distribution platform configured with a logistics transfer device, and the like.

Fig. 1 is a flowchart of an information interaction method according to an embodiment of the present invention. As shown in fig. 1, the information interaction method includes the following steps:

in step S101, after the applet-based cabinet procedure is started, an optical character recognition camera plug-in provided by the applet platform is invoked to obtain image information to be recognized in real time, where the image information to be recognized includes an image frame to be recognized and a corresponding recognition character string.

The applet is an application which can be used without downloading and installing, and a user can open the corresponding application by sweeping or searching. The applet is available at any time, and the applet does not need to be installed or uninstalled, so that the concept of 'run out and walk away' is reflected, and a user does not need to care whether to install too many applications or not to occupy too much terminal memory. The applet platform may provide a variety of plug-ins for use by applets running based on the applet platform, such as an optical character recognition (Optical Character Recognition, OCR) camera plug-in, a program code generation plug-in, a unidirectional video plug-in, and the like. The applet in this embodiment is a logistics management applet including a cabinet code intelligent identification service. The logistics management applet is configured to acquire image information to be identified using an optical character recognition camera plug-in provided by the applet platform. Optical character recognition refers to a process of analyzing and recognizing an image file containing text data to acquire text information. That is, character recognition of the image file using OCR techniques may return the corresponding character. The optical character recognition camera plug-in determines the image information to be recognized by using the computing resource of the terminal running the applet platform, does not need to upload the image frame to be recognized acquired by the terminal to a server for OCR recognition, and returns a recognition result to the terminal, so that the data transmission time is saved, and the OCR recognition process is faster.

In one possible implementation manner, before the optical character recognition camera plug-in provided by the applet platform is invoked to acquire the image information to be recognized in real time, a to-be-skipped meal storage page needs to be determined according to the computing resources of the terminal, wherein the meal storage page comprises a first meal storage page and a second meal storage page, and the computing resources used by different meal storage pages when the optical character recognition camera plug-in is invoked are different. Specifically, after receiving a request for starting a meal storage flow, detecting computing resources of a terminal running the applet platform. And determining the page to be jumped according to the available computing resource quantity of the terminal. Specifically, in response to detecting that the computing resource is greater than a predetermined computing resource threshold, jumping to a first meal storage page, wherein the first meal storage page is provided with a camera picture display frame and a recommended cabinet code display control. And in response to detecting that the computing resource is not greater than a predetermined computing resource threshold, jumping to a second meal page, the second meal page being provided with a camera jump control.

And in response to receiving the cabinet flow starting request, determining target interface information, and then calling a target interface according to the target interface information to use the optical character recognition camera plug-in. The object interface is a corresponding interface of the optical character recognition camera plug-in, and the object interface information at least comprises an object interface identifier and an object interface call certificate. Illustratively, the target interface identification may be printdextcor, the target interface call credential may be a uniform resource locator (Uniform Resource Locator, URL) parameter, such as an access_token or a cloudase_access_token, which may be obtained through a getAccessToken interface, and a cloudase_access_token which may be obtained through a getOpenData interface. After the optical character recognition camera plug-in is successfully invoked through the target interface, the camera shooting component of the optical character recognition camera plug-in control terminal acquires image frames to be recognized in real time, and performs OCR recognition on the image frames to be recognized to obtain recognition character strings corresponding to each image frame to be recognized. And returning the obtained image frames to be identified and the corresponding identification character strings to the logistics management applet.

In step S102, a corresponding real-time video is determined according to the image frame to be identified.

When acquiring the image frame to be identified, the user needs to be guided to aim at a specific area, such as a customer information area or a receiver mobile phone number area in the ticket, so that the image frame to be identified containing the cabinet opening code can be acquired, wherein the cabinet opening code is generally all or part of digital digits of the customer mobile phone number, such as the last 4 digits of the mobile phone number. However, as the current camera component of the terminal is occupied by the optical character recognition camera plug-in, and the optical character recognition camera plug-in only returns to the image frame to be recognized, if the image frame to be recognized is directly displayed to prompt the user of the current shooting range, the user can feel that the picture is blocked when the image frame to be recognized is continuously switched, and the visual experience is poor. Therefore, it is necessary to render a real-time video based on the image frame to be recognized, draw it and display it to the user, so that the user feels that the camera is being turned on to scan.

For example, the image frame rendering to be identified may be rendered into a real-time video stream using web graphics library (Web Graphics Library, webGL) technology. WebGL is a drawing technology standard that combines javascript and OpenGL together in order to open the underlying drawing capabilities to the web application layer. The WebGL technical standard eliminates the trouble of developing a web-specific rendering plug-in, and can be used to create images or videos with complex 3D structures.

In step S103, the real-time video is displayed in a camera screen display frame.

In step S104, a recommended cabinet code is determined according to the identification string.

Specifically, the recommended cabinet opening code is selected from the identification character strings according to a preset regular matching formula, wherein the preset regular matching formula can be a regular matching formula group and comprises a plurality of regular matching formulas. The preset regular matching formula is determined according to actual conditions, namely, the actual printing content of the tickets used by the takeaway platform. For example, the recommended cabinet code may be all or part of the digits of the customer's cell phone number.

For example, if all digits of the customer' S phone number are displayed on the ticket, and the recommended opening code is also all digits of the phone number, then the set of preset regular matches may include a first regular match, i.e./1 (. The first regular matching formula is used for searching the mobile phone number of the customer from the identification character string, and the result obtained through the formula is the recommended cabinet opening code. If all digits of the customer ' S phone number are displayed on the ticket, and the recommended cabinet opening code is a part of the digits of the phone number, such as the last 4 digits of the phone number, then the preset regular matching formula set includes a second regular matching formula, that is, a replace (/ [ d {7} {4 }/, '/S {7} $1 ').) in addition to the first regular matching formula, the formula indicates that the phone number (including the first 7 digits and the last 4 digits of the phone number) is replaced with the first 7 digits blank, and only the last 4 digits are displayed.

The steps S102-S103 and S104 may be performed simultaneously, in which the order is not sequential, that is, after the optical character recognition camera plug-in returns the image frame to be recognized and the corresponding recognition character string, the image frame to be recognized and the recognition character string are processed respectively, and the recognition character string is also subjected to regular matching to determine the recommended cabinet opening code while the real-time video is made and displayed according to the image frame to be recognized.

In step S105, the recommended cabinet code is displayed in response to the recommended cabinet code being identified.

In step S106, in response to the recommended opening code confirmation control being triggered, the recommended opening code is sent to enable the server to control the storage cabinet to open the target cabinet and to open the target cabinet when the pickup code is received as the recommended opening code.

And after the recommended cabinet opening code confirmation control is triggered, sending a recommended cabinet opening code to the server of the dinner cabinet.

In one possible implementation, the recommended cabinet code confirmation control may include a plurality of recommended cabinet code confirmation sub-controls, with different cabinet code confirmation sub-controls corresponding to different cabinet specifications, such as "big cabinet", "middle cabinet", or "small cabinet", etc. The recommended cabinet opening code confirmation sub-control corresponding to different specifications is triggered to select cabinet body cabinet identification suitable for the size of the meal while sending the recommended cabinet opening code. Specifically, a recommended cabinet opening code is sent to a cabinet server, the recommended cabinet opening code should carry a cabinet body cabinet identification, after the cabinet server verifies the recommended cabinet opening code according to order information, a target cabinet with proper size is determined from idle cabinets according to the cabinet body cabinet identification, and then a cabinet opening instruction carrying the cabinet number is sent to the cabinet to control the cabinet to open the target cabinet. And closing the target cabinet after the distribution personnel put the articles to be stored into the target cabinet.

In one possible implementation manner, the server of the dinner box responds to the receiving of the request for taking and opening the dinner box, and obtains the code for taking and opening the dinner box associated with the request for taking and opening the dinner box. And the server responds to the detection that the file cabinet pointed by the file cabinet taking and opening request and the file cabinet taking and opening code associated with the file cabinet taking and opening request are the same recommended file cabinet opening code, and sends an opening instruction to control the file cabinet to open the grid openings associated with the same recommended file cabinet opening code. Specifically, after receiving a request for taking and opening a meal from a customer terminal or a meal storage cabinet, the meal storage cabinet server determines a meal storage cabinet pointed by the request for taking and opening a meal storage cabinet, searches a plurality of recommended opening codes corresponding to the meal storage cabinet for a recommended opening code which is the same as the code for taking and opening the meal storage cabinet and is associated with the request for taking and opening the meal storage cabinet, and sends a cabinet opening instruction to the pointed meal storage cabinet in response to the recommended opening code which is the same as the code for taking and opening the meal storage cabinet, wherein the cabinet opening instruction is associated with a target cabinet identification corresponding to the recommended opening code. And after the dinner cabinet receives the cabinet opening instruction, opening a target cabinet grid associated with the recommended cabinet opening code.

The following is a detailed description of the above steps S101 to S105.

For step S101, there may be various ways to start the flow of the logistics management applet. Such as clicking on a meal page jump control, successfully loading a meal page, or receiving a meal instruction, etc. Because in steps S102-S104, the recommended cabinet code is identified and the real-time video is required to be drawn, rendered and displayed, and the rendering capability requirement on the terminal is high. Therefore, aiming at terminals with different performances, the calling conditions and the service time of the optical character recognition camera plug-in are different, and when the terminal is specifically implemented, the personalized processing of the terminals with different performances can be realized by setting different meal storage page layouts, so that smoother use experience is provided for users as much as possible according to the performances of the terminals on the premise of ensuring the recognition function of the recommended cabinet opening code.

In one possible implementation, the memory page layout is the first memory page for terminals with relatively rich computing resources and relatively high rendering capabilities. Step S101 is specifically the method shown in fig. 2.

Fig. 2 is a flowchart of a method for calling an optical character recognition camera plug-in provided by an applet platform to obtain image information to be recognized in real time according to an embodiment of the invention. As shown in fig. 2, when the memory page is the first memory page, the method for calling the optical character recognition camera plug-in provided by the applet platform to acquire the image information to be recognized in real time includes the following steps:

in step S201, computing resources of a terminal running the applet platform are detected.

The terminal running the applet platform is a terminal held by a distribution person. The computing resource refers to the computing power and the memory of the terminal itself or the available computing power and the available memory of the logistics management applet divided for the terminal.

In step S202, in response to detecting that the computing resource is greater than a predetermined computing resource threshold, jumping to a first meal page, where the first meal page is provided with a camera screen display frame and a recommended cabinet code display control.

The preset computing resource threshold is not smaller than the minimum computing resource required by identifying the recommended cabinet code and drawing the real-time video.

Fig. 3 is a schematic diagram of a first memory page according to an embodiment of the present invention. As shown in fig. 3, the first storage page 30 includes a recommended opening code identification container 31, a query and answer control 35, an opening mode switching control 36, a main page switching container 37, and a navigation switching control 38.

The recommended opening code identification container 31 is used for displaying prompt information and recommended opening code identification related controls. The prompt information is used for prompting a user to scan a specific area to acquire a valid image frame to be identified. The specific area is a customer information area in the take-out ticket, and the effective image frame to be identified is an image frame containing a customer mobile phone number. The prompt information can be specifically "check-in please scan the ticket customer information" or "please aim at the customer mobile phone number", etc. The recommended cabinet code identification related controls include a camera picture display frame 32, a recommended cabinet code display control 33, and a recommended cabinet code confirmation control 34. The camera screen display box 32 is used to display real-time video to make the user aware of the current scanning range, thereby determining the correct scanning direction based on the prompt information and the current scanning range. The recommended cabinet opening code display control 33 is used for displaying the identified recommended cabinet opening code, and optionally, the recommended cabinet opening code display control 33 is an editable control. After the cabinet opening code display control 33 is triggered, the displayed recommended cabinet opening code can be edited and modified, that is, after the cabinet opening code display control 33 displays the recommended cabinet opening code, if the user finds that the identified recommended cabinet opening code is wrong through manual checking, the user can change the recommended cabinet opening code into an editable state by clicking the recommended cabinet opening code display control 33, so that the recommended cabinet opening code is edited and modified. Further, the recommended opening code display control 33 may include a predetermined number of recommended opening code display sub-controls, where the number of recommended opening code display sub-controls is the same as the number of recommended opening codes, and each recommended opening code display sub-control displays a recommended opening code. And (3) identifying the wrong recommended cabinet opening code, and clicking the corresponding recommended cabinet opening code display child control to modify. The recommended opening code confirmation control 34 is configured to send the recommended opening code to the chest server after being triggered to cause the chest server to control the chest to open the target grid. Optionally, the recommended cabinet opening code confirmation control 34 may also be used to determine a cabinet specification, and specifically, the recommended cabinet opening code confirmation control 34 may include a plurality of recommended cabinet opening code confirmation sub-controls, where different cabinet opening code confirmation sub-controls correspond to different cabinet specifications, such as "big cabinet", "middle cabinet" or "small cabinet", and so on. Clicking the recommended cabinet opening code confirmation sub-control corresponding to different specifications can correlate cabinet body cabinet identification corresponding to the recommended cabinet opening code confirmation sub-control when the recommended cabinet opening code is sent.

The query solution control 35 is used to display the most common user queries and to display the query solution information upon being triggered. For example, the query solution control 35 is used to display "how to find the last 4 digits of the customer's phone number? And displaying the query and answer information after being triggered to guide the user to find the specific area containing the mobile phone number of the customer smoothly.

The switch-cabinet mode switching control 36 is used to switch the switch-cabinet mode. The current default opening mode determines a recommended opening code for invoking the optical character recognition plug-in to recognize. Besides, the cabinet opening mode further comprises the step of receiving the mobile phone number input by the user as a cabinet opening code. After the switch control 36 is triggered, the mode of identifying and determining the recommended switch code by calling the optical character recognition plug-in unit in the current switch mode is switched to the mode of receiving the mobile phone number input by the user as the switch code.

The main page switching container 37 is used for switching the main page. Specifically, the main page may include a meal storing page, a meal storing record display page, and a user personal information page. The main page switching container 37 may include a switching control corresponding to each page, such as a meal storage page switching control, a meal storage record display page switching control, and a user personal information page switching control, where the page switching control is triggered, i.e. jumps to the main page corresponding to the page switching control. The page shown in fig. 3 is the first page to be presented after the page switch control is triggered.

The navigation switch control 38 is used to display the shipping address and, after being triggered, requests navigation services and jumps to the corresponding navigation interface.

In step S203, in response to the loading of the first memory page being completed, an optical character recognition camera plug-in provided by the applet platform is invoked to acquire the image information to be recognized in real time.

The following description is made with reference to a flowchart of a method for calling an optical character recognition camera plug-in provided by the applet platform to obtain image information to be recognized in real time, as shown in fig. 2, and a schematic diagram of a first memory page shown in fig. 3. Because the embodiment is designed aiming at the terminal with rich computing resources and higher rendering capability, the calling condition of the optical character recognition camera plug-in is that the first memory page is successfully loaded. The first meal storage page is successfully loaded, namely the character is characterized to start to automatically call the optical character recognition camera plug-in, other operations are not needed by a user, the flow is simple, and the user experience is good.

After the first memory page 30 is loaded successfully, the optical character recognition camera plug-in is started to acquire the image information to be recognized, a real-time video is drawn according to the image frame to be recognized in the image information to be recognized, and the real-time video is displayed in a camera picture display frame 32 shown in fig. 3. And simultaneously, determining a recommended cabinet opening code according to the identification character string in the image information to be identified. In response to identifying the recommended opening code, a recommended opening code display control 33 in the first meal page 30 displays the recommended opening code.

It should be noted that, when the recommended opening code is displayed in the recommended opening code display control 33, the camera screen display frame 32 still displays real-time video, so when the first storing page is used, the time for calling the optical character recognition camera plug-in is the time from the successful loading of the first storing page to the leaving of the first storing page, for example, the time for calling the optical character recognition camera plug-in is the time from the successful loading of the first storing page to the triggering of the opening mode switching control 36 after the triggering of the storing record display page switching control in the main page switching container 37 to the storing record display page, or the time for calling the optical character recognition camera plug-in stops calling the optical character recognition camera plug-in. In the time of calling the optical character recognition camera plug-in, the image frames to be recognized returned by the optical character recognition camera plug-in are required to be continuously drawn into real-time videos, and the recognition character strings are subjected to regular matching to determine recommended cabinet opening codes, so that requirements on terminal performance and computing resources are high. Thus, the method shown in fig. 3 is applicable to terminals where available computing resources are sufficient.

Further, in order to ensure the accuracy of the recommended cabinet opening code, the recommended cabinet opening code obtained through recognition can be confirmed for the second time. Specifically, in response to the recommended switch confirmation control 34 of FIG. 3 being triggered, a recommended switch secondary confirmation control is displayed on the first meal page 30.

Fig. 4 is a schematic diagram of a first meal storage page after a recommended cabinet code confirmation control is triggered according to an embodiment of the present invention. As shown in fig. 4, after the recommended opening code confirmation control 24 is triggered, the recommended opening code secondary confirmation container 41 is displayed in the first meal storage page 30. The recommended cabinet opening code secondary confirmation container 41 may be displayed in a popup window form, that is, the recommended cabinet opening code secondary confirmation popup window is recommended. The recommended cabinet code secondary confirmation container 41 includes a secondary confirmation prompt information display control 42, a secondary confirmation recommended cabinet code display control 43, a recommended cabinet code modification control 44, and a recommended cabinet code secondary confirmation control 45.

The secondary confirmation prompt information display control 42 is used for displaying prompt information for prompting the user to manually check the recommended cabinet opening code displayed in the secondary confirmation recommended cabinet opening code display control 43, for example, the prompt information may be "please confirm that the tail number of the customer is input without error" and/or "intelligent recognition has a probability of error, please carefully check". Further, the accuracy of the currently displayed recommended cabinet opening code can be calculated, the corresponding prompt information content is determined according to the level of the accuracy, and if the level of the accuracy is lower, the corresponding prompt information content can be "the cabinet opening code obtained by current intelligent recognition is lower in accuracy, please carefully check. The user can be prompted by setting different prompt information display colors for different accuracy rates, for example, when the accuracy rate is low, the prompt information display color is red, and when the accuracy rate is high, the prompt information display color is green.

The secondary confirmation recommendation switch code display control 43 is used for displaying the recommendation switch code.

The recommended opening code modification control 44 is used to modify the edit status of the secondary confirmation recommended opening code display control 43 to an editable status after being triggered, or to jump to a recommended opening code modification container or page after being triggered. So as to obtain the recommended cabinet opening code modified by the user.

The recommended opening code secondary confirmation control 45 is used for secondarily confirming the recommended opening code, and sends the recommended opening code to the server after being triggered so that the server controls the server to open the target cabinet.

In one possible implementation, the memory page is laid out as a second memory page for terminals where computing resources are relatively scarce and rendering capabilities are general. Step S101 is specifically the method shown in fig. 5.

Fig. 5 is a flowchart of a method for calling an optical character recognition camera plug-in provided by the applet platform to obtain image information to be recognized in real time according to an embodiment of the invention. As shown in fig. 5, the method for calling the optical character recognition camera plug-in provided by the applet platform to acquire the image information to be recognized in real time includes the following steps:

in step S501, computing resources of a terminal running the applet platform are detected.

In step S502, in response to detecting that the computing resource is not greater than a predetermined computing resource threshold, jumping to a second meal page, the second meal page being provided with a camera jump control and a recommended cabinet code display control.

Fig. 6 is a schematic diagram of a second memory page according to an embodiment of the present invention. As shown in fig. 6, the second storage page 60 includes a cabinet code receiving container 61, a query and answer control 64, a first camera jump control 65, a main page switching container 66, and a navigation switching control 67.

The cabinet code receiving container 61 is used for displaying prompt information and recommending cabinet code receiving related controls. The prompt information is used for prompting the user to input a cabinet opening code, for example, the prompt information can be "4 bits after the customer mobile phone number is input for storing the meal". The recommended cabinet code reception related controls include a cabinet code reception control 62 and a second camera jump control 63. The cabinet code receiving control 62 is used for receiving a cabinet code input by a user. The second camera jump control 63 is used for jumping to a camera page after being triggered to call an optical character recognition camera plug-in provided by the applet platform to acquire image information to be recognized in real time. A second camera jump control 63 is located below the cabinet code receiving control 62 to prompt the user to use an optical character recognition method to automatically obtain a recommended cabinet code when the user wants to enter the cabinet code.

The query solution control 64 is used to display the most common user queries and to display the query solution information upon being triggered. The specific usage is the same as the query solution control 26 shown in fig. 2 and will not be described in detail here.

The first camera jump control 65 is used the same as the second camera jump control 63. The first camera jump control 65 is located in the center of the second memory page 60 to make it easier for the user to see and click on the control.

A main page switching container 66 for switching the main page. The specific usage is the same as that of the main page switching container 27 shown in fig. 2, and will not be described here again.

The navigation switch control 67 is used for displaying the delivery address, and the specific usage is the same as the navigation switch control 28 shown in fig. 2, and will not be described herein.

In step S503, in response to the camera jump control being triggered, jumping to a camera page, the camera page being provided with the camera picture display frame.

In step S504, in response to the camera page loading being completed, an optical character recognition camera plug-in provided by the applet platform is invoked to acquire image information to be recognized in real time.

Fig. 7 is a schematic diagram of a camera page according to an embodiment of the invention. As shown in fig. 7, the camera page 70 includes a prompt display control 71, a camera screen display frame 72, and a second meal page return control 73.

The prompt information display control 71 is used for displaying information prompting a user to scan a specific area to acquire a valid image frame to be identified. The prompt information may specifically be "please scan the ticket (customer information)", etc.

The camera screen display box 72 is used to display real-time video to make the user aware of the current scan range and thereby determine the correct scan direction based on the prompt and the current scan range.

The second meal page return control 73 is used to jump from the camera page 70 to the second meal page 60. Specifically, when the scan time is too long but the recommended opening code is not identified, the user may choose to trigger the second page return control 73 to return the second page for rescanning or manually enter the opening code.

While the camera screen display frame 72 displays real-time video, the terminal determines a recommended opening code based on the identification string, returns the second meal page 60 from the camera page 70 in response to identifying the recommended opening code, and displays the recommended opening code in the recommended opening code display control in the second meal page 60.

Fig. 8 is a schematic diagram of a second meal storage page after a recommended cabinet opening code is obtained through identification according to an embodiment of the present invention. As shown in fig. 8, when the recommended opening code is identified and then the camera page is re-jumped to the second meal storage page 60, the second meal storage page 60 displays the recommended opening code confirmation container 81. The recommended opening code confirmation container 81 may be displayed in a popup window form, that is, the recommended opening code displays the popup window. The recommended cabinet code confirmation container 81 includes a confirmation prompt information control 82, a recommended cabinet code display control 83, a recommended cabinet code modification control 84, and a recommended cabinet code confirmation control 85.

The confirm prompt control 82 is used for displaying prompt information for prompting the user to manually check the recommended cabinet opening code displayed in the confirm recommended cabinet opening code display control 83. The specific usage is the same as the usage of the secondary confirmation prompt message display control 42 shown in fig. 4, and will not be described here again.

The recommended cabinet opening code display control 83 is used for displaying the recommended cabinet opening code obtained through recognition.

The recommended opening code modification control 84 is used for modifying the recommended opening code displayed by the recommended opening code display control 83. The specific usage is the same as the usage of the recommended switch code modification control 44 shown in fig. 4, and will not be described in detail herein.

The recommended opening code confirmation control 85 is configured to send the recommended opening code to the server after being triggered, so that the server controls the server to open the target cell. The specific usage is the same as the usage of the recommended switch confirmation control 34 shown in fig. 3, and will not be described again here.

Further, in order to ensure the accuracy of the recommended cabinet opening code, the recommended cabinet opening code obtained through recognition can be confirmed for the second time. Specifically, when the recommended opening code confirmation control 85 in fig. 8 is triggered, the recommended opening code secondary confirmation container 41 shown in fig. 4 is displayed on the second meal storage page 60. The secondary confirmation method is the same as the recommended cabinet code secondary confirmation container 41 shown in fig. 4.

Because the embodiment is designed aiming at a terminal with relatively short computing resources and general rendering capability, the call condition of the optical character recognition camera plug-in is that the camera jump control in the second memory page is triggered. After the recommended cabinet opening code is identified, namely the recommended cabinet opening code is returned to the second meal storage page from the camera page, the optical character recognition camera plug-in is not required to be called, and the real-time video and the recommended cabinet opening code are not required to be drawn. Thus, when character recognition is performed using the second memory page, the time to invoke the optical character recognition camera plug-in is the time when the camera jump control in the second memory page is triggered to return to the second memory page. The calling time is short, when the recognition needs to be carried out, the camera jump control is clicked to start the recognition and the drawing of the real-time video, the character recognition and the drawing of the real-time video are stopped after the recognition obtains the recommended cabinet opening code, and the requirements on the terminal performance and the computing resources are low. Thus, the method shown in fig. 5 is applicable to terminals where available computing resources are scarce.

The method provided by the embodiment of the invention is suitable for a cabinet storing process realized based on the small program. After the process of the storage cabinet is started, the optical character recognition camera plug-in provided by the applet platform is called to acquire the image frame to be recognized and the recognition character string corresponding to the image frame to be recognized in real time, then the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame, so that a user can know the real-time scanning range, and the experience of the user is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code after the recommended cabinet opening code is successfully identified, detecting that a user triggers the recommended cabinet opening code, sending the recommended cabinet opening code to a server of the meal storage cabinet to control the meal storage cabinet to open the target cabinet, and opening the target cabinet when receiving the taking code as the recommended cabinet opening code. According to the embodiment of the invention, the cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, character recognition can be realized at the terminal without interaction with a server, so that data transmission time is saved, and recognition speed is improved.

Fig. 9 is a flowchart of an information interaction method according to an embodiment of the present invention. As shown in fig. 9, the information interaction method includes the following steps:

in step S901, in response to the loading of the first memory page being completed, an optical character recognition camera plug-in provided by the applet platform is invoked to obtain image information to be recognized in real time, where the image information to be recognized includes an image frame to be recognized and a corresponding recognition character string.

The layout of the first page and the controls included in the first page are shown in fig. 3, which are not described herein.

In step S902, a corresponding real-time video is determined according to the image frame to be identified, and the real-time video is displayed in a camera picture display frame in the first meal page.

In step S903, a recommended cabinet code is determined according to the identification string.

In step S904, the recommended cabinet code is displayed in response to identifying the recommended cabinet code.

In step S905, in response to the recommended cabinet opening code confirmation control being triggered, a recommended cabinet opening code secondary confirmation container, that is, a recommended cabinet opening code secondary confirmation popup window, is displayed, where the recommended cabinet opening code secondary confirmation container includes the recommended cabinet opening code secondary confirmation control.

The layout of the first storage page including the recommended cabinet opening code secondary confirmation container is shown in fig. 4, and will not be described herein.

In step S906, the recommended switch code is sent to the chest server in response to the recommended switch code secondary confirmation control being triggered, so that the chest server controls the chest to open the target chest.

When the logistics management applet is started for the first time, the computing resource of the terminal running the applet platform can be detected, and if the computing resource is detected to be larger than a preset computing resource threshold value, the meal storage page is determined to be a first meal storage page. And after that, when the logistics management applet is started again on the same terminal, the default meal storage page is the first meal storage page.

The method provided by the embodiment of the invention is suitable for the terminal with sufficient available computing resources. After the first meal storage page is loaded successfully, an optical character recognition camera plug-in provided by the applet platform is called to acquire an image frame to be recognized and a recognition character string corresponding to the image frame to be recognized in real time, the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame, so that a user can know a real-time scanning range, and the experience of the user is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code on the first meal storage page after the recommended cabinet opening code is successfully identified, detecting that a user triggers the recommended cabinet opening code, sending the recommended cabinet opening code to a meal storage cabinet server so as to control the meal storage cabinet to open a target cabinet, and opening the target cabinet when receiving the taking code as the recommended cabinet opening code. The embodiment of the invention successfully loads the first meal storage page, namely characterizes that the optical character recognition camera plug-in is automatically invoked, does not need other operations by a user, and has simple flow and good user experience. The cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, character recognition can be realized at the terminal without interaction with a server, so that data transmission time is saved, and recognition speed is improved.

Fig. 10 is a flowchart of an information interaction method according to an embodiment of the present invention. As shown in fig. 10, the information interaction method includes the following steps:

in step S1001, in response to the camera skip control in the second memory page being triggered, skip to a camera page, where the camera page is provided with the camera screen display frame.

The layout of the second page is shown in fig. 6, and the controls included in the layout are not described herein.

In step S1002, in response to the completion of the loading of the camera page, an optical character recognition camera plug-in provided by the applet platform is invoked to acquire image information to be recognized in real time.

The layout of the camera page and the controls included in the layout are shown in fig. 7, and are not described herein.

In step S1003, a corresponding real-time video is determined according to the image frame to be identified, and the real-time video is displayed in a camera picture display frame in a camera page.

In step S1004, a recommended cabinet code is determined according to the identification string.

In step S1005, the second meal page is returned from the camera page in response to identifying the recommended cabinet code.

After the second meal page is returned from the camera page, the layout of the second meal page and the included controls are shown in fig. 8, which are not described herein.

In step S1006, the recommended opening code is displayed on the recommended opening code confirmation container, where the recommended opening code confirmation container includes at least a recommended opening code display control and a recommended opening code confirmation control. And displaying the recommended cabinet opening code on the recommended cabinet opening code display popup window.

In step S1007, in response to the recommended cabinet code confirmation control being triggered, a recommended cabinet code secondary confirmation container is displayed, the recommended cabinet code secondary confirmation container including the recommended cabinet code secondary confirmation control.

The recommended opening code confirmation container is the same as the recommended opening code secondary confirmation container 41 shown in fig. 4, and will not be described here again.

In step S1008, the recommended switch code is sent to the chest server in response to the recommended switch code secondary confirmation control being triggered to cause the chest server to control the chest to open the target grid.

And when the logistics management applet is started for the first time, detecting the computing resource of the terminal running the applet platform, and if the computing resource is detected not to be larger than a preset computing resource threshold value, determining that the meal storage page is a second meal storage page. And after that, when the logistics management applet is started again on the same terminal, the default meal storage page is a second meal storage page.

The method provided by the embodiment of the invention is suitable for the terminal with the shortage of available computing resources. After the camera jump control in the second meal storage page is triggered, an optical character recognition camera plug-in provided by the applet platform is called to acquire an image frame to be recognized and a recognition character string corresponding to the image frame to be recognized in real time, then the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame in the camera page, so that a user can know a real-time scanning range, and the experience of the user is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code on the second meal storage page after the recommended cabinet opening code is successfully identified, detecting that a user triggers the recommended cabinet opening code, sending the recommended cabinet opening code to a meal storage cabinet server so as to control the meal storage cabinet to open the target cabinet, and opening the target cabinet when receiving the taking code as the recommended cabinet opening code. The embodiment of the invention clicks the camera jump control to start to identify and draw the real-time video when the identification is needed, and stops character identification and real-time video drawing after the identification obtains the recommended cabinet opening code, has lower requirements on terminal performance and computing resources, and can be suitable for more terminals. The cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, character recognition can be realized at the terminal without interaction with a server, so that data transmission time is saved, and recognition speed is improved.

Fig. 11 is a schematic diagram of an information interaction system according to an embodiment of the present invention. As shown in fig. 11, the information interaction system includes: a dispensing terminal 1101 (terminal for short above), a chest server 1102, and a chest 1103. In addition, a pick-up terminal 1104 may be included.

In this embodiment, the dispensing terminal 1101 is configured to determine a recommended cabinet code and request a cabinet to the cabinet server 1102 to store the meal. The server 1103 is configured to receive a cabinet opening instruction, and send a cabinet opening request to the server 1102 after receiving a cabinet opening code input by a customer. The pick-up terminal 1104 may also be used to receive pick-up and unpacking codes entered by customers or to automatically identify pick-up and unpacking codes from order information and send pick-up and unpacking requests to the file server 1102. The delivery terminal 1101 and the pickup terminal 1104 are general-purpose terminals capable of running a takeout platform client application or applet, and for example, the terminals may be terminal devices such as a mobile phone, a computer, or a tablet computer. In some embodiments, dispensing terminal 1101 or pick-up terminal 1104 may also be application specific terminals having applications that are cured in application specific integrated circuits. Wherein the open platform allows third party developers to develop their own applets based on the open platform by providing application programming interfaces (Application Programming Interface, APIs) to the third party developers. The applet may be in particular a program developed on the basis of an application within the platform and adapted to perform the corresponding operations. Wherein the delivery terminal 1101 is a terminal device of a delivery resource for a platform to perform a delivery task. The distribution resource can be a person, or can be various unmanned equipment, such as a distribution unmanned vehicle, a distribution robot, a distribution unmanned aerial vehicle and the like. The pick-up terminal 1104 is a terminal device used or held by the platform consumer.

The order processing is completed by the order server 1102 by interacting with the dispensing terminal 1101, the order server 1103 and/or the pick-up terminal 1104.

During the dining phase, the dispensing terminal 1101 completes the identification of the recommended cabinet opening code through man-machine interaction. Specifically, after the applet-based cabinet process is started, the dispensing terminal 1101 invokes an optical character recognition camera plug-in provided by the applet platform to obtain image information to be recognized in real time, where the image information to be recognized includes an image frame to be recognized and a corresponding recognition character string, then determines a corresponding real-time video according to the image frame to be recognized, and displays the real-time video in a camera frame display. And simultaneously, determining a recommended cabinet opening code according to the identification character string, and displaying the recommended cabinet opening code in response to the identification of the recommended cabinet opening code. After determining the recommended cabinet code, the dispensing terminal 1101 connects to the cabinet server 1102 via the Internet to complete the cabinet task. Specifically, the dispensing terminal 1101 sends a recommended cabinet code to the storage server 1102, wherein the recommended cabinet code also associates an order identifier and a cabinet identifier that characterizes the size of the cabinet. After receiving the cabinet opening code, the server 1102 searches the order information according to the order identification, and searches all digital digits of the mobile phone number of the customer and/or part of digital digits of the last four digits of the mobile phone number from the order information. Comparing the recommended cabinet opening code with all digital digits of the mobile phone number and/or part of digital digits of the last four digits of the mobile phone number, if the comparison result is matching, determining a target cabinet according with the cabinet size requirement from the idle specification of the dinner cabinet, and establishing a mapping relation between the target cabinet identification and order information. The holding chest server 1102 sends a holding chest order to the holding chest 1103 that correlates the target chest identity. After receiving the meal storing and opening instruction, the meal storing cabinet 1103 opens the target cabinet corresponding to the target cabinet identification so as to finish meal storing. After detecting that the target bin is closed, the pantry 1103 sends a successful meal deposit feedback message to the pantry server 1102. After receiving the meal deposit success feedback information, the meal deposit cabinet server 1102 changes the order information state to be meal to be taken, and sends a meal taking notification to the taking terminal 1104.

In the meal taking stage, after receiving a meal taking and opening request sent by a meal taking terminal 1104 or a meal taking cabinet 1103, the meal taking cabinet server 1102 determines a meal taking cabinet pointed by the meal taking and opening request, searches a recommended opening code which is the same as the meal taking and opening code from the recommended opening code corresponding to the meal taking cabinet, if the recommended opening code which is the same as the meal taking and opening code exists, determines a cabinet cell corresponding to the recommended opening code as a target cabinet cell, or compares all digital positions of a customer mobile phone number and/or part digital positions of four digits after the mobile phone number in order information corresponding to the meal taking and opening code and each cabinet cell, and if a comparison result table shows that the meal taking and opening code is the same as all digital positions of the mobile phone number and/or part digital positions of four digits after the mobile phone number, determines the cabinet cell corresponding to the order information as the target cabinet cell. The holding chest server 1102 sends a get-to-chest instruction to the holding chest 1103, the get-to-chest instruction associating a target chest identity. After the meal taking and opening instruction is received by the meal storage cabinet 1103, the corresponding target cabinet lattice identification is controlled to open so that the customer takes the meal. After detecting that the target bin is closed, the pantry 1103 sends feedback information of successful meal taking to the pantry server 1102. The locker server 1102 updates the order status to completed.

The system provided by the embodiment of the invention is suitable for a cabinet storing and taking process realized based on the small program. After the process of the storage cabinet is started, the optical character recognition camera plug-in provided by the applet platform is called to acquire the image frame to be recognized and the recognition character string corresponding to the image frame to be recognized in real time, then the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame, so that a user can know the real-time scanning range, and the experience of the user is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code after the recommended cabinet opening code is successfully identified, detecting that a user triggers the recommended cabinet opening code, sending the recommended cabinet opening code to a server of the meal storage cabinet to control the meal storage cabinet to open the target cabinet, and opening the target cabinet when receiving the taking code as the recommended cabinet opening code. After receiving the cabinet taking request, the server compares the cabinet taking and opening code associated with the cabinet taking request with the recommended cabinet opening code, and if the comparison result represents that the comparison result is matched, the server controls the cabinet opening of the dinner storage cabinet so that the user can successfully take dinner. According to the embodiment of the invention, the cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, so that the optical character recognition can be realized at the terminal, and the data transmission time is saved.

Fig. 12 is a schematic diagram of an information interaction device according to an embodiment of the present invention. As shown in fig. 12, the information interaction device includes:

the calling module 1201 is configured to call an optical character recognition camera plug-in provided by the applet platform to obtain image information to be recognized in real time after a cabinet process based on the applet is started, where the image information to be recognized includes an image frame to be recognized and a corresponding recognition character string;

a first determining module 1202, configured to determine a corresponding real-time video according to the image frame to be identified;

a first display module 1203 configured to display the real-time video on a camera screen display frame;

a second determining module 1204, configured to determine a recommended cabinet opening code according to the identification string;

a second display module 1205 for displaying the recommended cabinet code in response to identifying the recommended cabinet code;

and the sending module 1206 is configured to send the recommended opening code to enable the server to control the server to open the first compartment in response to the recommended opening code confirmation control being triggered, and open the first compartment to push when receiving the picking code as the recommended opening code.

The device provided by the embodiment of the invention is suitable for a cabinet storing process realized based on the small program. After the process of the storage cabinet is started, the optical character recognition camera plug-in provided by the applet platform is called to acquire the image frame to be recognized and the recognition character string corresponding to the image frame to be recognized in real time, then the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame, so that a user can know the real-time scanning range, and the experience of the user is improved. And determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code after the recommended cabinet opening code is successfully identified, controlling the storage cabinet to open the target cabinet, and opening the target cabinet when receiving the picking code as the recommended cabinet opening code. According to the embodiment of the invention, the cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, character recognition can be realized at the terminal without interaction with a server, so that data transmission time is saved, and recognition speed is improved.

Fig. 13 is a schematic diagram of an electronic device according to an embodiment of the invention. In the present embodiment, the electronic apparatus 1300 includes a server, a terminal, and the like. As shown in fig. 13, the electronic device 1300: at least one processor 1301; and a memory 1302 communicatively coupled to the at least one processor 1301; and a communication component 1303 communicatively connected to the scanning apparatus, the communication component 1303 receiving and transmitting data under the control of the processor 1301; the memory 1302 stores instructions executable by the at least one processor 1301, and the instructions are executed by the at least one processor 1301 to implement the information interaction method described above.

Specifically, the electronic device includes: one or more processors 1301, and a memory 1302, one processor 1301 being illustrated in fig. 13. The processor 1301, memory 1302 may be connected by a bus or other means, for example in fig. 13. The memory 1302, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Processor 1301 executes various functional applications of the device and data processing, i.e., implements the information interaction method described above, by running non-volatile software programs, instructions, and modules stored in memory 1302.

Memory 1302 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store a list of options, etc. In addition, memory 1302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 1302 may optionally include memory located remotely from processor 1301, which may be connected to an external device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

One or more modules are stored in the memory 1302 that, when executed by the one or more processors 1301, perform the information interaction method of any of the method embodiments described above.

The product may perform the method provided by the embodiment of the present application, and has the corresponding functional module and beneficial effect of the performing method, and technical details not described in detail in the embodiment of the present application may be referred to the method provided by the embodiment of the present application.

The embodiment of the invention is suitable for a cabinet storing process realized based on the small program. After the process of the storage cabinet is started, the optical character recognition camera plug-in provided by the applet platform is called to acquire the image frame to be recognized and the recognition character string corresponding to the image frame to be recognized in real time, then the image frame to be recognized acquired in real time is drawn and rendered into a real-time video, and the real-time video is displayed in a camera picture display frame, so that a user can know the real-time scanning range, and the experience of the user is improved. And simultaneously determining a recommended cabinet opening code according to the identification character string, displaying the recommended cabinet opening code after the recommended cabinet opening code is successfully identified, detecting that a user triggers the recommended cabinet opening code, sending the recommended cabinet opening code to a server of the meal storage cabinet to control the meal storage cabinet to open the target cabinet, and opening the target cabinet when receiving the taking code as the recommended cabinet opening code. According to the embodiment of the invention, the cabinet opening code can be automatically obtained from the image frame to be identified by using optical character identification, so that the meal storage flow is simplified. The optical character recognition camera plug-in provided by the applet platform is called, character recognition can be realized at the terminal without interaction with a server, so that data transmission time is saved, and recognition speed is improved.

Another embodiment of the present application is directed to a non-volatile storage medium storing a computer readable program for causing a computer to perform some or all of the method embodiments described above.

That is, it will be understood by those skilled in the art that all or part of the steps in implementing the methods of the embodiments described above may be implemented by a program stored in a storage medium, where the program includes several instructions for causing a device (which may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps in the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The above description is only of the preferred embodiments of the present application and is not intended to limit the present application, and various modifications and variations may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. An information interaction method, characterized in that the method comprises:

displaying the real-time video on a camera picture display frame;

responding to the fact that a recommended opening code confirmation control is triggered, sending the recommended opening code to enable a server of the meal storage cabinet to control the meal storage cabinet to open a target cabinet, and opening the target cabinet when receiving a piece taking code which is the recommended opening code;

wherein the optical character recognition camera plug-in determines the image information to be recognized using computing resources of a terminal running the applet platform.

2. The method of claim 1, wherein prior to invoking the optical character recognition camera plug-in provided by the applet platform, the method further comprises:

Receiving a request for starting a meal storing process;

and detecting the computing resources of the terminal running the applet platform.

3. The method of claim 2, wherein prior to invoking the optical character recognition camera plug-in provided by the applet platform, the method further comprises:

and in response to detecting that the computing resource is greater than a preset computing resource threshold, jumping to a first meal storage page, wherein the first meal storage page is provided with a camera picture display frame and a recommended cabinet opening code display control, and the recommended cabinet opening code display control is used for displaying the recommended cabinet opening code.

4. The method of claim 2, wherein prior to invoking the optical character recognition camera plug-in provided by the applet platform, the method further comprises:

and in response to detecting that the computing resource is not greater than a predetermined computing resource threshold, jumping to a second meal page, the second meal page being provided with a camera jump control.

5. A method according to claim 3, wherein the invoking the optical character recognition camera plug-in provided by the applet platform to obtain the image information to be recognized in real time is specifically:

and calling an optical character recognition camera plug-in provided by the applet platform to acquire image information to be recognized in real time in response to the completion of loading the first meal page.

6. The method according to claim 4, wherein the invoking the optical character recognition camera plug-in provided by the applet platform is performed to obtain the image information to be recognized in real time, specifically:

responding to the triggering of a camera jump control in the second meal storage page, and jumping to a camera page, wherein the camera page is provided with the camera picture display frame;

and calling an optical character recognition camera plug-in provided by the applet platform to acquire image information to be recognized in real time in response to the completion of the loading of the camera page.

7. The method of claim 1, wherein said determining a recommended cabinet code from said identification string comprises:

and screening the recommended cabinet opening code from the identification character string according to a preset regular matching formula.

8. The method of claim 7, wherein the screening the recommended cabinet code from the identification string according to a preset regular matching formula comprises:

screening all digital digits of the mobile phone number of the customer from the identification character string according to a preset regular matching formula;

and determining all digital bits of the mobile phone number or part of digital bits of the mobile phone number as the recommended cabinet opening code.

9. The method of claim 5, wherein the displaying the recommended cabinet code in response to identifying the recommended cabinet code comprises:

and in response to the identification of the recommended cabinet opening code, displaying the recommended cabinet opening code on a recommended cabinet opening code display control in the first meal storage page.

10. The method of claim 6, wherein the displaying the recommended cabinet code in response to identifying the recommended cabinet code comprises:

returning the second meal-storing page from the camera page in response to identifying the recommended cabinet opening code;

and displaying the recommended cabinet opening code in the second meal storage page through a recommended cabinet opening code display popup window.

11. The method of claim 9, wherein the sending the recommended switch to cause a chest server to control a chest to open a target chest and to open the target chest when a pick is received as the recommended switch in response to a recommended switch confirmation control being triggered comprises:

responding to the triggering of a recommended cabinet opening code confirmation control in the first meal storage page, and displaying a recommended cabinet opening code secondary confirmation popup window;

and responding to the fact that a recommended cabinet opening code secondary confirmation control in the recommended cabinet opening code secondary confirmation popup window is triggered, sending the recommended cabinet opening code so that the server of the meal storage cabinet controls the meal storage cabinet to open a target cabinet and opening the target cabinet when receiving a picking code which is the recommended cabinet opening code.

12. The method according to claim 1, wherein the method further comprises:

and responding to the triggering of the recommended cabinet opening code modification control, and receiving and displaying the recommended cabinet opening code modified by the user.

13. The method according to claim 1, wherein the calling applet platform provides an optical character recognition camera plug-in specifically:

in response to receiving a cabinet flow starting request, determining target interface information, wherein the target interface information at least comprises a target interface identifier and a target interface call certificate;

and calling a target interface according to the target interface information so as to use the optical character recognition camera plug-in.

14. The method of claim 1, wherein the opening the target bin upon receiving the pick-up code as the recommended bin-opening code comprises:

the server of the meal storage cabinet responds to receiving a request for taking and opening a cabinet, and obtains a code for taking and opening the cabinet associated with the request for taking and opening the cabinet;

and the server responds to the detection that the file cabinet pointed by the file cabinet taking and opening request and the file cabinet taking and opening code associated with the file cabinet taking and opening request are the same recommended file cabinet opening code, and sends an opening instruction to control the file cabinet to open the grid openings associated with the same recommended file cabinet opening code.

15. An information interaction device, the device comprising:

the sending module is used for sending the recommended opening code so that the server of the meal storage cabinet controls the meal storage cabinet to open a target cabinet and opens the target cabinet when receiving the taking code as the recommended opening code;

16. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method of any of claims 1-14.

17. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when executed by a processor, implements the method according to any of claims 1-14.