CN112839263B - Prompt message playing method and device - Google Patents

Abstract

The embodiment of the application discloses a method and a device for playing prompt information. One embodiment of the method comprises the following steps: acquiring at least one piece of biological characteristic information of an access object in a scene to be identified; determining whether the at least one biometric information has a setup prompt; if the at least one piece of biological characteristic information has the setting prompt information, playing the prompt information; and if the at least one piece of biological characteristic information is not provided with the prompt information, playing the prompt information corresponding to the scene to be identified. According to the embodiment, the playing prompt messages can be distinguished for the access objects with different identities, and the playing of the personalized prompt messages is realized.

Description

Prompt message playing method and device

Technical Field

The embodiment of the application relates to the technical field of computers, in particular to a method and a device for playing prompt information.

Background

Along with the development of science and technology, intelligent equipment such as intelligent cat eye and intelligent visual doorbell appear in the market, and this intelligent cat eye and intelligent visual doorbell are the house security protection product of a replacement tradition cat eye. The intelligent peephole has the functions of liquid crystal visualization, automatic video shooting, sensing monitoring, intelligent alarming and the like.

Currently, the above-listed smart devices can play voice information when a person arrives at a visit, wherein the same voice information is usually played for different visitors.

Disclosure of Invention

The embodiment of the application provides a method and a device for playing prompt information.

In a first aspect, an embodiment of the present application provides a method for playing a prompt message, where the method is applied to an intelligent device, and the method includes: acquiring at least one piece of biological characteristic information of an access object in a scene to be identified; determining whether the at least one biometric information has a setup prompt; if the at least one piece of biological characteristic information has the setting prompt information, playing the prompt information; and if the at least one piece of biological characteristic information is not provided with the prompt information, playing the prompt information corresponding to the scene to be identified.

In some embodiments, obtaining at least one biometric information of an access object present in a scene to be identified comprises: obtaining a visited image of a visited object in the scene to be identified; and carrying out face recognition or portrait recognition on the visited image locally to acquire the first biological characteristic information of the visited object.

In some embodiments, obtaining at least one biometric information of an access object present in a scene to be identified comprises: obtaining a visited image of a visited object in the scene to be identified; the visited image is sent to a server, so that the server carries out face recognition or portrait recognition on the visited image, and first biological characteristic information of an access object displayed in the visited image is obtained; and receiving the first biological characteristic information returned by the server.

In some embodiments, the first biometric information comprises at least one of the following: face feature information, iris feature information, and portrait feature information.

In some embodiments, obtaining at least one biometric information of an access object present in a scene to be identified comprises: second biometric information of the access object which is present in the scene to be identified is obtained, the second biometric information comprising iris feature information or/and fingerprint feature information.

In some embodiments, determining whether the at least one biometric information has a setup prompt includes:

identifying whether the at least one biometric information has a corresponding attribute tag;

if the at least one biometric information has an attribute tag, performing the following determination: inquiring whether the attribute mark is associated with prompt information; if the attribute mark has associated prompt information, judging that the at least one piece of biological characteristic information has set prompt information; if the attribute mark does not have associated prompt information, judging that the at least one piece of biological characteristic information does not have prompt information;

if the at least one piece of biometric information has no attribute flag, it is determined that the at least one piece of biometric information has no hint information set.

In some embodiments, the attribute tags include at least one of the following: identity type tags, identity tags, scene tags.

In some embodiments, if the at least one biometric information has a setup hint information, playing the hint information includes: if the at least one piece of biological characteristic information has the set prompt information, determining the quantity of the prompt information; when the number of the prompt messages is one, playing the prompt messages; when the number of the prompt messages is more than two, any one of the following is executed: sequentially playing the prompt messages according to the preset priority of the prompt messages; according to the preset priority of the prompt information, only the prompt information with the highest priority is played; one of the prompt messages is randomly played.

In some embodiments, after identifying whether the at least one biometric information has a corresponding attribute tag, the method further comprises: transmitting feedback information including at least the at least one biometric information to a user terminal used by a user to cause the user to perform information setting related to the attribute flag on the at least one biometric information based on the feedback information; and in response to receiving an information setting result related to the information setting, updating a local cue information playing setting based on the information setting result, wherein the information setting result at least comprises an attribute mark corresponding to the at least one piece of biological characteristic information and/or cue information associated with the attribute mark.

In a second aspect, an embodiment of the present application provides a playing device for a prompt message, where the playing device is applied to an intelligent device, and the playing device includes: an acquisition module configured to acquire at least one biometric information of an access object present in a scene to be identified; a query module configured to determine whether the at least one biometric information has setup prompt information; the first playing module is configured to play the prompt information if the at least one piece of biological characteristic information has the set prompt information; and the second playing module is configured to play the prompt information corresponding to the scene to be identified if the prompt information is not set in the at least one piece of biological characteristic information.

In a third aspect, an embodiment of the present application provides a computer readable medium, on which a computer program is stored, where the program when executed by a processor implements a method for playing a hint information as described in any implementation manner of the first aspect.

In a fourth aspect, an embodiment of the present application provides a processor, where the processor is configured to execute a program, where the program executes a method for playing a hint information as described in any implementation manner of the first aspect.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: one or more processors; a storage device having one or more programs stored thereon; the information playing device is used for playing the prompt information; the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a method of playing hint information as described in any implementation of the first aspect.

According to the method and the device for playing the prompt information, the at least one piece of biological characteristic information of the access object in the scene to be identified is obtained, and then whether the at least one piece of biological characteristic information is provided with the prompt information is determined, so that the prompt information is played when the at least one piece of biological characteristic information is determined to be provided with the prompt information, or the prompt information corresponding to the scene to be identified is played when the at least one piece of biological characteristic information is determined to be not provided with the prompt information. The proposal provided by the embodiment of the application can distinguish the playing prompt messages for the access objects with different identities, thereby realizing the playing of the personalized prompt messages.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is apparent that the drawings in the following description are only some examples or embodiments of the present application, and it is possible for those of ordinary skill in the art to obtain other drawings from the provided drawings without inventive effort, and to apply the present application to other similar situations from the provided drawings. Unless otherwise apparent from the context of the language or otherwise specified, like reference numerals in the figures refer to like structures or operations.

FIG. 1 is an exemplary system architecture diagram in which some embodiments of the present application may be applied;

FIG. 2 is a flowchart of an embodiment of a method for playing a hint information of the present application;

FIG. 3 is a flowchart of one embodiment of step 201 in the embodiment shown in FIG. 2 of the method for playing a hint information according to the present application;

FIG. 4 is a flowchart of another embodiment of step 201 in the embodiment shown in FIG. 2 of the method for playing a hint information according to the present application;

FIG. 5 is a flowchart of a method for playing a hint information according to another embodiment of step 201 in the embodiment shown in FIG. 2;

FIG. 6 is a flowchart of one embodiment of step 202 in the embodiment of FIG. 2 of the method for playing alert information according to the present application;

FIG. 7 is a flowchart of an embodiment of the method for playing a hint information according to the present application after step 601 is performed in the embodiment shown in FIG. 6;

FIG. 8 is a flowchart of one embodiment of step 203 in the embodiment of FIG. 2 of the method for playing alert information according to the present application;

FIG. 9 is a schematic structural diagram of an embodiment of a playing device for prompting messages according to the present application;

FIG. 10 is a schematic structural diagram of an embodiment of an acquisition module in the embodiment shown in FIG. 9 of the prompt message playing device of the present application;

FIG. 11 is a schematic structural diagram of another embodiment of an acquisition module in the embodiment shown in FIG. 9 of the prompt message playing device of the present application;

FIG. 12 is a schematic structural diagram of another embodiment of the acquisition module in the embodiment shown in FIG. 9 of the prompt message playing device of the present application;

FIG. 13 is a schematic structural diagram of an embodiment of a query module in the embodiment shown in FIG. 9 of the prompt message playing device of the present application;

FIG. 14 is a schematic structural diagram of an embodiment of a first playing module in the embodiment shown in FIG. 9 of the prompt message playing device of the present application;

FIG. 15 is a schematic structural diagram of another embodiment of the prompt message playing device in the embodiment shown in FIG. 13;

fig. 16 is a schematic diagram of an electronic device suitable for use in implementing some embodiments of the application.

Detailed Description

The application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. The described embodiments are only some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

For convenience of description, only a portion related to the present application is shown in the drawings. Embodiments of the application and features of the embodiments may be combined with each other without conflict.

It is to be understood that the terms "system," "apparatus," "unit," and/or "module" as used herein are one means for distinguishing between different components, elements, parts, portions, or assemblies at different levels. However, if other words can achieve the same purpose, the word can be replaced by other expressions.

As used in the specification and in the claims, the terms "a," "an," "the," and/or "the" are not specific to a singular, but may include a plurality, unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that the steps and elements are explicitly identified, and they do not constitute an exclusive list, as other steps or elements may be included in a method or apparatus. The inclusion of an element defined by the phrase "comprising one … …" does not exclude the presence of additional identical elements in a process, method, article, or apparatus that comprises an element.

Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" means two or more than two.

The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature.

A flowchart is used in the present application to describe the operations performed by a system according to embodiments of the present application. It should be appreciated that the preceding or following operations are not necessarily performed in order precisely. Rather, the steps may be processed in reverse order or simultaneously. Also, other operations may be added to or removed from these processes.

FIG. 1 illustrates an exemplary system architecture 100 of some embodiments of a method of playing a hint or a device of playing a hint to which the present application may be applied.

As shown in fig. 1, the system architecture 100 may include terminal devices 101, 102, networks 104, 105, and a server 106. The network 104 is the medium used to provide communication links between the terminal devices 101, 102 and the server 106. The network 105 serves as a medium for providing a communication link between the terminal device 101 and the terminal device 102. The networks 104, 105 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

A user may interact with the server 106 via the network 104 using the terminal devices 101, 102 to receive or send messages. In addition, the user may also interact with terminal device 101 through network 105 using terminal device 102 to receive or send messages. Various client applications, such as security monitoring software, face recognition software, image processing software, etc., may be installed on the terminal devices 101, 102.

The terminal devices 101 and 102 may be hardware or software. When the terminal devices 101, 102 are hardware, various electronic devices may be used, including but not limited to smart phones, tablet computers, wearable devices, vehicle devices, portable computers, desktop computers, smart cat eyes, smart doorbell, gateway, and other electronic devices. When the terminal devices 101, 102 are software, they can be installed in the above-listed electronic devices. Which may be implemented as multiple software or software modules (e.g., to provide distributed services), or as a single software or software module. The embodiment of the application does not limit the specific type of the electronic equipment.

Specifically, the terminal device 101 may be an intelligent device having an information playback apparatus, which may be a display screen, a speaker, or the like. The intelligent device can obtain at least one kind of biological characteristic information of the access object in different scenes (such as scenes of returning home, going out, staying for a long time before a door, prying the intelligent device and the like) and perform corresponding prompt information playing operation based on the at least one kind of biological characteristic information.

The terminal device 102 may be a user terminal used by a user, and a device management class application for managing the terminal device 101 may be installed on the user terminal. The user may set different hint information for the terminal device 101, for example, using the device management class application, so that the terminal device 101 plays based on a certain play rule.

The server 106 may be a server providing various services, such as a background server providing support for the terminal devices 101, 102. The background server may process the request information in response to receiving the request information sent by the terminal device 101, and return the processing result to the terminal device 101 after obtaining the processing result; alternatively, the background server may respond to receiving information sent by the terminal device 101 and then forward the information to the terminal device 102; still alternatively, the backend server may respond to receiving the information sent by the terminal device 102, and then download the information to the local via the terminal device 101 for updating, or the backend server directly forwards the information to the terminal device 101 for updating.

The server 106 may be hardware or software. When the server 106 is hardware, it may be implemented as a distributed server cluster composed of a plurality of servers, or as a single server. When the server 106 is software, it may be implemented as a plurality of software or software modules (e.g., to provide distributed services), or as a single software or software module. The present application is not particularly limited herein.

It should be noted that, the method for playing the prompt message provided in the embodiment of the present application is generally executed by the terminal device 101, and accordingly, the device for playing the prompt message is generally set in the terminal device 101.

It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

Example 1

Fig. 2 shows a flow 200 of an embodiment of a method for playing a reminder of the present application, which may be applied to a smart device (e.g., the terminal device 101 shown in fig. 1).

Referring to fig. 2, a flow 200 of the method for playing the prompt message includes the following steps:

Step 201, at least one biometric information of an access object present in a scene to be identified is acquired.

In this step 201, the biometric information may specifically include at least one of facial feature information, iris feature information, portrait feature information, fingerprint feature information, and voice feature information.

Further, the scene to be identified may be, for example, a reasonable range in which the biometric information of the access object can be acquired or a range of capabilities of a reasonable device. For example, in an exemplary embodiment, the acquired biometric information is fingerprint feature information of the access object, and then the scene to be identified may be an identification range capable of acquiring the fingerprint feature information of the access object, and may be specifically a fingerprint identifiable range of the fingerprint identifier. For another example, in still another exemplary embodiment, the acquired biometric information is feature information of a face image of the access object, and then the scene to be identified may be a shooting range of a device capable of acquiring the face image of the access object, and may be specifically a photographable range of a camera.

Alternatively, the scene to be identified may also be a scene divided according to different behaviors of the person, which may include, for example, but not limited to, going home, going out, staying out of the door for a long time, prying the smart device, and so forth.

Step 202, determining whether the at least one biometric information has a setup prompt.

In step 202, the prompt information may be any one of text information, voice information, and video information. For example, in an exemplary embodiment, the hint information may be embodied as voice information that is used to hint or indicate the access object.

Step 203, if the at least one biometric information has a setup prompt, playing the prompt.

In step 203, playing the prompt information means that the prompt information is presented to the access object, so that the access object can receive the prompt information. Because the prompt information can be different types of information, the playing modes of different prompt information are different. For example, in an exemplary embodiment, if the prompt information is text information, the prompt information may be played by displaying the text information on the display, or by converting the text information into voice information and playing the voice information by a speaker. For another example, in an exemplary embodiment, if the prompt is voice information, playing the prompt may be performed by playing the voice information through a speaker. For another example, in an exemplary embodiment, if the prompt is video information synthesized by audio and video, playing the prompt may be performed by simultaneously playing the video information through a display and a speaker. For another example, in an exemplary embodiment, if the prompt is video information not synthesized with audio, playing the prompt may be performed by playing the video information through a display.

And 204, if the at least one piece of biological characteristic information is not provided with prompt information, playing the prompt information corresponding to the scene to be identified.

In this step 204, the difference between the playing of the prompt information corresponding to the scene to be identified and the playing of the prompt information in the above step 203 is that: the prompt information played in the step 204 is prompt information which is not set corresponding to the biometric information, and the function of the prompt information is to default to play when the acquired biometric information is not set with prompt information. It should be understood that the played hint information herein may also include not playing any hint information, i.e. the hint information at this time is empty.

Further, the playing manner of the prompt message in the step 204 may be the same as that of the step 203, which is not described herein.

It should be noted that, one or more of the above described scenes may be preset in the intelligent device, and the intelligent device may also store the prompt information corresponding to the scene, where the prompt information may be set by default in the system, or may be set by a user to which the intelligent device belongs through a user terminal (such as the terminal device 102 shown in fig. 1), which is not specifically limited herein. When it is determined that the at least one piece of biometric information is not provided with the prompt information, the intelligent device can search the prompt information corresponding to the scene to be identified locally and play the searched prompt information.

According to the method for playing the prompt information, whether the prompt information related to the biological characteristic information is set is determined by acquiring the biological characteristic information of the access object, if the biological characteristic information is set, the prompt information corresponding to the access object is considered, and the prompt information is played, so that the effect of distinguishing the prompt information for the access objects with different identities is achieved, and the personalized prompt information can be played.

Fig. 3 shows a flow chart 300 of one embodiment of step 201 in the embodiment of fig. 2 of the method for playing a hint information of the present application.

Referring to fig. 3, in some optional implementations of the present embodiment, the step 201 of obtaining at least one biometric information of an access object appearing in a scene to be identified may include the steps of:

step 301, a visited image of a visited object appearing in a scene to be identified is acquired.

In this step 301, the visit image is an image whose image content includes at least a visit object. The visited image may be a single frame picture, or may be a sequence of consecutive pictures of a plurality of frames, or may be a segment of a continuous or separately truncated video image. The image content of the visited image contains the visited object, so that various useful information in the visited image can be extracted as biological characteristic information through an image processing method, and the characteristic identification of the visited object is indirectly realized. It should be noted that, the method for extracting biological features is a well-known technique widely studied and applied at present, and will not be described here. It should be understood that the present application can use existing or future developed methods for extracting biological characteristics, and the present application is not limited to any particular method for extracting biological characteristics.

Wherein the smart device may comprise a camera device (e.g. a camera) through which the smart device may obtain the visited image. Optionally, the intelligent device may also be connected with an external camera device, and the intelligent device may acquire the visited image through the external camera device.

Step 302, performing face recognition or portrait recognition on the visited image locally to acquire first biometric information of the visited object.

In this step 302, the first biometric information may include at least one of facial feature information, iris feature information, and portrait feature information.

After the intelligent device acquires the visited image, the intelligent device can locally identify the visited image, acquire the wanted biological characteristic information from the visited image and take the wanted biological characteristic information as first biological characteristic information. Since the specific feature types of the biometric information are very many and the biometric information is not necessarily obtained by image recognition, the biometric information obtained by the visited image recognition is taken as the first biometric information.

The process 300 in this embodiment provides one implementation manner of the step 201, which highlights that the intelligent device independently completes the acquisition of the first biometric information of the access object, and compared with the method of acquiring the first biometric information of the access object by interacting with other devices, the method can avoid that the first biometric information cannot be acquired due to the occurrence of abnormal situations such as network abnormality or overload of the other devices, so that the quick acquisition of the first biometric information can be realized.

Fig. 4 shows a flowchart 400 of another embodiment of the method for playing a hint information according to the present application in step 201 in the embodiment shown in fig. 2.

Referring to fig. 4, in some optional implementations of the present embodiment, the step 201 of obtaining at least one biometric information of an access object appearing in a scene to be identified may include the steps of:

step 401, obtaining a visited image of a visited object appearing in a scene to be identified.

In this step 401, the same as step 301 in the embodiment shown in fig. 3 is omitted.

Step 402, the visited image is sent to a server, so that the server performs face recognition or portrait recognition on the visited image, and obtains first biometric information of the visited object displayed in the visited image.

In this step 402, unlike the embodiment shown in fig. 3, the following steps are adopted: the operation of recognizing the face or the person on the visited image is performed on the server side (e.g., the server 106 shown in fig. 1). In this way, compared with the case that all processes for acquiring the first biological characteristic information of the access object are executed on the intelligent device side, the working pressure of the intelligent device can be effectively reduced.

Step 403, receiving the first biometric information returned by the server.

In step 403, the smart device may receive the first biometric information returned by the server.

The process 400 provided in this embodiment is different from the process 300 of the embodiment shown in fig. 3 described above in that: the process 400 implements the above step 201 through interactive execution of at least two devices, and uses the powerful computing capability of the server to identify some visited image types that cannot be processed locally, so as to improve the smoothness of process execution. For example, the visited image is a video or multi-frame image, and if the visited image is locally identified in the intelligent device, huge local computing resources are consumed or the local computing capability is exceeded.

Fig. 5 shows a flowchart 500 of a further embodiment of the method for playing a hint information according to the present application in step 201 in the embodiment shown in fig. 2.

Referring to fig. 5, in some optional implementations of the present embodiment, the step 201 of obtaining at least one biometric information of an access object appearing in a scene to be identified may include the steps of:

step 501, obtaining second biometric information of an access object appearing in a scene to be identified, wherein the second biometric information comprises at least one of fingerprint feature information and sound feature information.

In this step 501, the second biometric information is the biometric information of the access object directly acquired, and is obtained without being processed. Therefore, unlike the first biometric information acquisition method in the embodiment shown in fig. 3 and 4, the second biometric information acquisition method is simpler and faster than the first biometric information acquisition method.

For example, if the second biometric information is fingerprint information, the smart device may directly acquire the fingerprint information of the access object through the fingerprint identifier. The fingerprint identifier may be a sub device included in the intelligent device, or may be an external device of the intelligent device, which is not specifically limited herein. If the second biometric information is voice feature information, the smart device may acquire the voice feature information of the access object through the sound pickup. The pickup may be a sub-device included in the intelligent device, or may be an external device of the intelligent device, which is not specifically limited herein. It follows that the second biometric information is obtained more easily and quickly than the first biometric information.

In some embodiments, this embodiment may also be implemented in combination with the embodiments shown in fig. 3 or fig. 4 described above. For example, in the embodiment shown in fig. 3 or fig. 4, when the acquisition of the first biometric information according to the visited image fails, the second biometric information of the visited object may be acquired again, and whether the prompt information is set is confirmed according to the second biometric information, so that accuracy of determining whether the prompt information is set according to the biometric information may be improved.

Compared with the first biological characteristic information acquisition mode in the embodiment shown in fig. 3 and fig. 4, the accuracy and the effectiveness of the second biological characteristic information acquisition are remarkably realized, and the operation resource is not required to be consumed.

Fig. 6 shows a flowchart 600 of one embodiment of the method for playing alert information according to the present application in step 202 in the embodiment shown in fig. 2.

Referring to fig. 6, in some optional implementations of the present embodiment, the determining whether the at least one biometric information has the setting hint information in step 202 may include the following steps:

step 601, it is identified whether at least one biometric information has a corresponding attribute flag.

In this step 601, the attribute tags are tags or labels for biometric information. In particular, the attribute tags may include, but are not limited to, at least one of an identity type tag, an identity tag, a scene tag. For example, the identity type tag may be a tag of "classmates", "friends", "family", "express", "take-away", etc., the identity tag may be a specific identity tag of "Zhang San", "Liqu", "Wangwu", "dad", "mom", etc., and the scene tag may be a tag of "get home", "go out", etc. That is, the attribute flag is a classification basis for classifying or grouping the biometric information.

Note that, considering that the attribute flag is identified based on the acquired biometric information in this step 601, an identification method of the attribute flag is described below in connection with the acquisition of the biometric information.

In some embodiments, when the biometric information is obtained by using the scheme of the embodiment shown in fig. 3, the biometric information is obtained locally in the smart device, and the smart device may perform attribute tag identification alone; in addition, the intelligent device can also perform attribute tag identification in an interactive manner with the server, for example, the intelligent device sends the acquired biological feature information to the server, the server performs attribute tag identification on the biological feature information and returns an attribute tag identification result, and then the intelligent device can receive the attribute tag identification result and determine whether the biological feature information has a corresponding attribute tag based on the attribute tag identification result.

Taking the example that the intelligent device alone performs attribute marking identification, the intelligent device may locally store a first correspondence table for characterizing a correspondence between biometric information and the attribute marking. The intelligent device may search the first correspondence table for target biometric information that matches the at least one biometric information, and if so, the intelligent device may determine an attribute flag corresponding to the target biometric information as an attribute flag corresponding to the at least one biometric information. If not, the intelligent device can determine that the at least one piece of biometric information does not have the corresponding attribute mark. It should be appreciated that matching may refer to the same or similar reaching a similarity threshold, which may be, for example, 85%, 90%, 95%, 98%, etc., without limitation.

In some embodiments, when the biometric information is obtained by adopting the scheme of the embodiment shown in fig. 4, the biometric information is obtained by interaction between the smart device and the server, and if the smart device only receives the biometric information returned by the server, the smart device can perform attribute tag identification alone; or, the intelligent device can also perform attribute tag identification in an interactive manner with the server, that is, before the server feeds the acquired biological feature information back to the intelligent device, the server performs attribute tag identification on the acquired biological feature information, then returns the biological feature information and an attribute tag identification result to the intelligent device, and finally, the intelligent device determines whether the biological feature information has a corresponding attribute tag or not based on the attribute tag identification result.

The above listed attribute tag identification schemes are a list of several possible implementations depending on the manner in which biometric information is obtained, and are only for reference implementations.

Step 602, if at least one biometric information has an attribute flag, performing the following determination operations: inquiring whether the attribute mark is associated with prompt information; if the attribute mark has the associated prompt information, judging that at least one piece of biological characteristic information has the set prompt information; if the attribute flag does not correlate with the prompt information, it is determined that the at least one biometric information is not provided with the prompt information.

In step 602, since the attribute tag is a tag for the biometric information, if the attribute tag is provided with associated prompt information, the prompt information is indirectly associated with the biometric information, and when the set prompt information is played, the effect of differentially playing the prompt information for the access objects with different identities is achieved.

One or more attribute marks can be set in one biological characteristic information, one attribute mark can be associated with one or more prompt information, and when a plurality of prompt information is associated, priority can be set for the plurality of prompt information. For example, when the biometric information a has the attribute marks "Zhang san" and "take away" respectively, and the attribute mark "Zhang san" is provided with the prompt message 1, and the attribute mark "take away" is provided with the prompt message 2, then the prompt message 1 and the prompt message 2 may be respectively set with priority at this time, so that effective playing of the prompt message may be ensured, and the situation that the prompt message cannot be played after the biometric information a is identified is avoided. In practice, the priority of the prompt information corresponding to the identity tag is generally higher than the priority of the prompt information corresponding to the identity type tag.

As an example, the smart device may locally store a second correspondence table for characterizing a correspondence between the attribute markers and the prompt information, and the smart device may search the attribute markers corresponding to the at least one biometric information in the second correspondence table. If the attribute is found, the intelligent device can determine that the attribute is marked with corresponding prompt information. If not, the intelligent device can determine that the attribute mark does not have corresponding prompt information. It should be noted that the second correspondence table and the first correspondence table may be the same table or may be different tables, which is not specifically limited herein.

Step 603, if at least one piece of biometric information has no attribute flag, determining that at least one piece of biometric information has no hint information set.

In this step 603, if the biometric information has no attribute flag, it may be that the biometric information first appears. In this case, the corresponding processing scheme will be described in the following examples.

According to the method and the device, whether the prompt information is set or not is inquired through attribute mark recognition, the attribute mark information is utilized to classify the biological characteristic information, and meanwhile, the prompt information associated with the attribute mark is set, so that indirect association of the prompt information and the biological characteristic information is realized, and the effect of distinguishing and playing the prompt information for access objects with different identities is further realized.

Fig. 7 shows a flowchart 700 of an embodiment of the method for playing a hint information according to the present application after step 601 is performed in the embodiment shown in fig. 6.

Referring to fig. 7, in some optional implementations of the present embodiment, after the identifying whether the at least one biometric information has the corresponding attribute flag, the method may further include the following steps:

step 701 of transmitting feedback information including at least one type of biometric information to a user terminal used by a user, so that the user performs information setting related to an attribute flag on the at least one type of biometric information based on the feedback information.

In step 701, the intelligent device may directly communicate with the user terminal, or may indirectly communicate with the user terminal through a server. For example, the smart device may send the feedback information directly to the user terminal via a network (e.g., network 105 shown in fig. 1), or may send the feedback information to a server and then forward the feedback information to the user terminal by the server. After receiving the feedback information, the user terminal can prompt the user to perform corresponding information setting operation.

Wherein when some or all of the at least one biometric information is derived from a visited image of the visiting subject, the feedback information may further include the visited image. In addition, when the at least one biometric information has a corresponding attribute flag, the feedback information may further include the attribute flag.

It should be noted that, the user performs information setting related to the attribute flag on the above-mentioned at least one biometric information based on the feedback information, which includes, but is not limited to, at least one of the following operations: confirming whether the attribute mark of the biological characteristic information in the feedback information is correct or not, and then carrying out attribute mark modification or adding a new attribute mark on the biological characteristic information; adding or modifying associated prompt information to the attribute mark of the biological characteristic information; and uploading biological characteristic information locally, and setting attribute marks or/and prompt information and the like on the biological characteristic information.

In response to receiving the information setting result related to the information setting, updating the local cue information playing setting based on the information setting result, wherein the information setting result at least comprises an attribute flag corresponding to at least one type of biometric information and/or cue information associated with the attribute flag, step 702.

In step 702, the information setting result may be directly sent to the smart device by the user terminal. Or, the information setting result may be that the user terminal firstly sends the information setting result to the server and then the information setting result is forwarded to the intelligent device by the server.

Fig. 8 shows a flow 800 of one embodiment of step 203 in the embodiment of fig. 2 of the method for playing alert information according to the present application.

Referring to fig. 8, in some alternative implementations of the present embodiment, step 203, if at least one biometric information has a setup prompt, playing the prompt may include the following steps:

step 801, if at least one biological feature information has a set prompt message, determining the number of prompt messages;

step 802, playing the prompt message when the number of the prompt messages is one;

step 803, when the number of the prompt messages is more than two, executing any one of the following: sequentially playing the prompt messages according to the preset priority of the prompt messages; according to the preset priority of the prompt information, only the prompt information with the highest priority is played; one of the prompt messages is randomly played.

In step 801, it is known from the description of the embodiment shown in fig. 6, the number of the prompt messages determined according to the biometric information may not be unique. For example, when multiple access objects exist in the scene to be identified at the same time, more than one piece of acquired biometric information may be obtained, if each piece of biometric information has a set prompt message, the number of playable prompt messages is finally determined to be not unique, and at this time, the playable prompt messages may be played according to the manners of step 802 and step 803, so that effective playing of the prompt messages is achieved.

Example 2

Fig. 9 is a schematic structural diagram of an embodiment of a playing device 9 for prompting information provided by the present application.

The present embodiment provides a device for playing the hint information based on the same inventive concept as the method for playing the hint information in embodiment 1.

Referring to fig. 9, as an implementation of the method shown in some embodiments above, the playing device 9 of the prompt information may be specifically applied to various intelligent devices, where, as shown in fig. 9, the playing device 9 of the prompt information includes an obtaining module 91, a query module 92, a first playing module 93 and a second playing module 94, where the obtaining module 91 is configured to obtain at least one biometric information of an access object appearing in a scene to be identified; the query module 92 is configured to determine whether the at least one biometric information has setup prompt information; the first playing module 93 is configured to play the prompt if the at least one biometric information has the setup prompt; the second playing module 94 is configured to play the cue information corresponding to the scene to be identified if the cue information is not set by the at least one biometric information.

In this embodiment, the specific processes of the obtaining module 91, the querying module 92, the first playing module 93 and the second playing module 94 and the technical effects thereof may refer to the related descriptions of the embodiments of step 201, step 202, step 203 and step 204 in the corresponding embodiment of fig. 2, and are not repeated herein.

Fig. 10 is a schematic structural diagram of an embodiment of the acquisition module 91 in the embodiment shown in fig. 9 of the playing device 9 for prompting information according to the present application.

Referring to fig. 10, in some alternative implementations of the present embodiment, the acquiring module 91 includes: an image acquisition unit 1011 configured to acquire a visited image of an access object appearing in a scene to be recognized; the first feature acquiring unit 1012 is configured to locally perform face recognition or portrait recognition on the visited image, and acquire first biometric information of the visited object.

Fig. 11 is a schematic structural diagram of an obtaining module 91 in another embodiment of the playing device 9 for prompting information according to the present application in the embodiment shown in fig. 9.

Referring to fig. 11, in some alternative implementations of the present embodiment, the acquiring module 91 includes: an image acquisition unit 1011 configured to acquire a visited image of an access object appearing in a scene to be recognized; a first sending unit 111 configured to send the visited image to a server, so that the server performs face recognition or portrait recognition on the visited image, and obtains first biometric information of the visited object displayed in the visited image; the receiving unit 112 is configured to receive the first biometric information returned by the server.

Fig. 12 is a schematic structural diagram of another embodiment of the acquisition module 91 in the embodiment shown in fig. 9 of the playing device 9 for prompting information according to the present application.

Referring to fig. 12, in some alternative implementations of the present embodiment, the acquiring module 91 includes: a second feature acquisition unit 121 configured to acquire second biometric information of an access object appearing in a scene to be identified, the second biometric information including iris feature information or/and fingerprint feature information.

Fig. 13 is a schematic structural diagram of an embodiment of the query module 92 in the embodiment shown in fig. 9 of the playing device 9 for prompting information according to the present application.

Referring to fig. 13, in some alternative implementations of the present embodiment, the query module 92 includes: an identifying unit 131 configured to identify whether the at least one biometric information has a corresponding attribute flag; a first judging unit 132 configured to, if the at least one biometric information has an attribute flag; the following determination is performed: inquiring whether the attribute mark is associated with prompt information; if the attribute mark has associated prompt information, judging that the at least one piece of biological characteristic information has set prompt information; if the attribute mark does not have associated prompt information, judging that the at least one piece of biological characteristic information does not have prompt information; the second judging unit 133 is configured to judge that the at least one piece of biometric information is not provided with the hint information if the at least one piece of biometric information does not have the attribute flag.

Fig. 14 is a schematic structural diagram of an embodiment of the first playing module 93 of the playing device 9 for prompting messages according to the present application in the embodiment shown in fig. 9.

Referring to fig. 14, in some alternative implementations of the present embodiment, the first playing module 93 includes: a quantity recognition unit 141 configured to determine the quantity of the hint information if the at least one piece of biometric information has a setup hint information; a first play execution unit 142 configured to play the cue information when the number of cue information is one; the second play execution unit 143 is configured to execute any one of the following when the number of cue information is two or more: sequentially playing the prompt messages according to the preset priority of the prompt messages; according to the preset priority of the prompt information, only the prompt information with the highest priority is played; one of the prompt messages is randomly played.

Fig. 15 is a schematic structural diagram of another embodiment of the playing device 9 for prompting information according to the present application in the embodiment shown in fig. 13.

Referring to fig. 15, in some alternative implementations of the present embodiment, the playing device 9 of the prompt information further includes: a second transmitting unit 151 configured to transmit feedback information including at least the at least one type of biometric information to a user terminal used by a user after recognizing whether the at least one type of biometric information has a corresponding attribute flag, so that the user performs information setting on the at least one type of biometric information with respect to the attribute flag based on the feedback information; the setting updating unit 152 is configured to update the local cue information playing setting based on the information setting result in response to receiving the information setting result related to the information setting, wherein the information setting result at least includes an attribute flag corresponding to the at least one biometric information and/or cue information associated with the attribute flag.

It should be noted that, the playing device of the prompt message may be a chip, a component or a module, the playing device of the prompt message may include a processor and a memory, the acquiring module, the querying module, the first playing module, the second playing module and the like are all stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.

The processor may include a core, and the core may call the memory to retrieve the corresponding program unit. The kernel can be provided with one or more kernels, and the aim of distinguishing and playing prompt information for access objects with different identities is fulfilled by adjusting kernel parameters.

The memory may include volatile memory, random Access Memory (RAM), and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM), among other forms in computer readable media, the memory including at least one memory chip.

According to the prompt information playing device provided by the embodiment of the application, whether the prompt information related to the biological characteristic information is set is determined by acquiring the biological characteristic information of the access object, if the biological characteristic information is provided with the set prompt information, the access object is considered to have preset prompt information and plays the prompt information, so that the effect of distinguishing and playing the prompt information for the access objects with different identities is realized.

Example 3

Fig. 16 is a schematic diagram of an electronic device suitable for implementing some embodiments of the present application.

The electronic device shown in fig. 16 is merely an example, and should not impose any limitation on the functionality and scope of use of embodiments of the present application.

Referring to fig. 16, the electronic device 16 may include a processor 161, a memory 162, a communication interface 163, an input unit 164, an output unit 165, and a communication bus 166. Wherein the processor 161 and the memory 162 are connected to each other by a communication bus 166. A communication interface 163, an input unit 164 and an output unit 165 are also connected to the communication bus 166.

The communication interface 163 may be an interface of a communication module, such as an interface of a GSM module or a WIFI module. If the electronic device 16 of the present embodiment is the terminal device 101 shown in fig. 1, the communication interface 163 may be used to obtain the information setting result transmitted by the terminal device 102 or the server 106 shown in fig. 1, and the communication interface 163 may also be used to transmit biometric information to the terminal device 102 or the server 106.

In an embodiment of the present application, the processor 161 may be a central processing unit (Central Processing Unit, CPU), application-specific integrated circuit (ASIC), digital Signal Processor (DSP), application-specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA), or other programmable logic device, etc.

In one possible implementation, the memory 162 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, and application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to the use process of the computer, such as biometric information data, attribute flag association setting data, hint information setting data, audio data, and the like.

In addition, memory 162 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device or other volatile solid-state storage device.

The processor 161 may call a program stored in the memory 162, and in particular, the processor 161 may execute the method for playing the hint information shown in any of the embodiments of fig. 2 to 8.

The memory 162 is used to store one or more programs, and the programs may include program codes including computer operation instructions, and in the embodiment of the present application, at least the programs for implementing the following functions are stored in the memory 162: acquiring at least one piece of biological characteristic information of an access object in a scene to be identified; determining whether at least one piece of biological characteristic information has setting prompt information; if at least one biological characteristic information has the setting prompt information, the prompt information is played; and if at least one piece of biological characteristic information is not provided with the prompt information, playing the prompt information corresponding to the scene to be identified.

The present application may further include an input unit 164, and the input unit 164 may include at least one of a touch sensing unit sensing a touch event on the touch display panel, a fingerprint recognizer, a keyboard, a camera, a pickup, and the like.

The output unit 165 may include: at least one of a display, a speaker, etc. The display may include a display panel, such as a touch display panel, and the speaker may include a horn, a sound box, and the like. In one possible scenario, the display panel may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), etc., and the speaker may be used to play voice information, such as play cue information, etc.

Of course, the structure of the electronic device 16 shown in fig. 16 is not limited to the electronic device in the embodiment of the present application, and the electronic device may include more or fewer components than shown in fig. 16 or may combine some components in practical applications.

The embodiment of the application provides a computer readable medium, on which a computer program is stored, wherein the program, when being executed by a processor, realizes the playing method of the prompt message described in the above method embodiments.

The embodiment of the application provides a processor which is used for running a program, wherein the playing method of prompt information described in the above method embodiments is realized when the program runs.

The present application also provides a computer program product which, when executed on a data processing apparatus, causes the data processing apparatus to implement the method of playing cue information described in the above method embodiments.

The electronic device, the processor, the computer readable medium or the computer program product provided in the above embodiments of the present application may be used to perform the corresponding methods provided above, and therefore, the advantages achieved by the electronic device, the processor, the computer readable medium or the computer program product may refer to the advantages in the corresponding methods provided above, and are not repeated herein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

Computer-readable media include both permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The above description is only illustrative of the preferred embodiments of the present application and the technical principles applied, and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. The scope of the application is not limited to the specific combination of the above technical features, but also covers other technical features formed by any combination of the above technical features or their equivalents without departing from the inventive concept. Such as the above-mentioned features and the technical features disclosed in the present application (but not limited to) having similar functions are replaced with each other.

Claims (8)

1. The playing method of the prompt message is applied to intelligent equipment and is characterized by comprising the following steps:

acquiring at least one piece of biological characteristic information of an access object in a scene to be identified, wherein the biological characteristic information comprises face characteristic information, iris characteristic information, portrait characteristic information, fingerprint characteristic information and sound characteristic information;

determining whether the at least one piece of biometric information has a set hint;

if the at least one piece of biological characteristic information has the set prompt information, the prompt information is displayed to the access object;

If the at least one piece of biological characteristic information is not provided with prompt information, the prompt information corresponding to the scene to be identified is displayed to the access object; the scene to be identified is divided according to different behaviors of people, and the scene comprises a home returning scene, an outgoing scene, a long-time stay outside a door and a prying intelligent device;

and if the at least one piece of biological characteristic information has the set prompt information, displaying the prompt information to the access object, wherein the method comprises the following steps:

if the at least one piece of biological characteristic information is provided with the prompt information, determining the quantity of the prompt information;

when the number of the prompt messages is one, the prompt messages are displayed to the access object;

when the number of the prompt messages is more than two, executing any one of the following steps:

sequentially displaying the prompt information to an access object according to the preset priority of the prompt information;

according to the preset priority of the prompt information, only the prompt information with the highest priority is displayed to an access object;

randomly displaying one of the prompt messages to the access object.

2. The method for playing hint information according to claim 1, wherein the acquiring at least one biometric information of an access object that appears in a scene to be identified includes:

Obtaining a visited image of a visited object in the scene to be identified;

and carrying out face recognition or portrait recognition on the visited image locally to acquire the first biological characteristic information of the visited object.

3. The method for playing hint information according to claim 1, wherein the acquiring at least one biometric information of an access object that appears in a scene to be identified includes:

obtaining a visited image of a visited object in the scene to be identified;

the visited image is sent to a server, so that the server carries out face recognition or portrait recognition on the visited image, and first biological characteristic information of an access object displayed in the visited image is obtained;

and receiving the first biological characteristic information returned by the server.

4. The method for playing a hint message according to claim 1, wherein determining whether the at least one piece of biometric information has a setup hint message includes:

identifying whether the at least one biometric information has a corresponding attribute tag;

if the at least one biometric information has an attribute tag, performing the following determination: inquiring whether the attribute mark is associated with prompt information or not; if the attribute mark has associated prompt information, judging that the at least one piece of biological characteristic information has set prompt information; if the attribute mark does not have associated prompt information, judging that the at least one piece of biological characteristic information does not have prompt information;

And if the at least one piece of biological characteristic information does not have the attribute mark, judging that the at least one piece of biological characteristic information is not provided with prompt information.

5. The method for playing a hint message of claim 4, wherein the attribute tag includes at least one of: identity type tags, identity tags, scene tags.

6. The method for playing alert information according to claim 1, wherein after the identifying whether the at least one biometric information has a corresponding attribute flag, the method further comprises:

transmitting feedback information including at least the at least one biometric information to a user terminal used by a user to cause the user to perform information setting related to an attribute flag on the at least one biometric information based on the feedback information;

and in response to receiving an information setting result related to the information setting, updating a local prompt information playing setting based on the information setting result, wherein the information setting result at least comprises an attribute mark corresponding to the at least one biological characteristic information and/or prompt information associated with the attribute mark.

7. A play device of prompt information is applied to intelligent equipment and comprises:

an acquisition module configured to acquire at least one biometric information of an access object present in a scene to be identified;

a query module configured to determine whether the at least one biometric information has setup prompt information;

the first playing module is configured to display the prompt information to an access object if the at least one piece of biological characteristic information has the setting prompt information;

the second playing module is configured to display the prompt information corresponding to the scene to be identified to the access object if the prompt information is not set in the at least one piece of biological characteristic information; the scene to be identified is divided according to different behaviors of people, and the scene comprises a home returning scene, an outgoing scene, a long-time stay outside a door and a prying intelligent device;

the first playing module comprises:

a quantity recognition unit configured to determine the quantity of the hint information if the at least one piece of biometric information has a setup hint information;

the first playing execution unit is configured to display the prompt information to an access object when the number of the prompt information is one;

The second playing execution unit is configured to execute any one of the following when the number of the prompt messages is more than two: sequentially displaying the prompt information to an access object according to the preset priority of the prompt information; according to the preset priority of the prompt information, only the prompt information with the highest priority is displayed to an access object; randomly displaying one of the prompt messages to the access object.

8. An electronic device, comprising:

one or more processors;

a storage device having one or more programs stored thereon;

the information playing device is used for playing the prompt information;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a method of playing alert information as claimed in any one of claims 1 to 6.