CN107071143B

CN107071143B - Image management method and device

Info

Publication number: CN107071143B
Application number: CN201710031673.7A
Authority: CN
Inventors: 刘君
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2017-01-17
Filing date: 2017-01-17
Publication date: 2020-04-21
Anticipated expiration: 2037-01-17
Also published as: CN107071143A

Abstract

The embodiment of the invention discloses a method and a device for managing terminal images, wherein the method comprises the following steps: determining a main image group from an image set obtained by terminal classification, wherein the main image group comprises one or more main images; performing characteristic analysis on each main image in the main image groups to determine the image characteristics of the main image groups; inquiring contact person identification information associated with the image features of the main image group; inquiring to obtain contact person communication information according to the contact person identification information; and establishing an incidence relation between the image set and the communication information of the contact person. By adopting the method and the device, the terminal image can be managed based on the contact information.

Description

Image management method and device

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to a method and an apparatus for managing an image, and a terminal.

Background

With the development of electronic technology and the progress of computer application, various terminals satisfying the functions of shooting, surfing the internet and communication have been greatly popularized. People can basically use terminals such as smart phones, tablet computers and intelligent wearable devices to obtain various images through shooting and the like, particularly to obtain images of people including friends and relatives.

The management functions of the current terminal on the acquired images generally include folder management, sorting by time, deletion, sharing and the like on the images.

Disclosure of Invention

The embodiment of the invention provides a terminal image management method and device and a terminal, which can effectively manage images of the terminal.

In a first aspect, an embodiment of the present invention provides a method for managing a terminal image, including:

determining a main image group from an image set obtained by terminal classification, wherein the main image group comprises one or more main images;

performing characteristic analysis on each main image in the main image groups to determine the image characteristics of the main image groups;

inquiring contact person identification information associated with the image features of the main image group;

inquiring to obtain contact person communication information according to the contact person identification information;

and establishing an incidence relation between the image set and the communication information of the contact person.

In a second aspect, an embodiment of the present invention further provides an interaction method for terminal images, including:

and responding to a triggering operation of an image set obtained by classifying in a terminal, and initiating communication processing according to contact person communication information associated with the image set, wherein the contact person communication information associated with the image set is determined according to contact person identification information obtained by image set inquiry, and the contact person identification information is determined according to image feature inquiry of each main image of a main image group in the image set.

Correspondingly, an embodiment of the present invention further provides a device for managing terminal images, including:

the device comprises a grouping determination module, a grouping determination module and a grouping determination module, wherein the grouping determination module is used for determining a main image group from an image set obtained by classifying a terminal, and the main image group comprises one or more main images;

the characteristic determining module is used for performing characteristic analysis on each main image in the main image groups to determine the image characteristics of the main image groups;

the first query module is used for querying contact person identification information associated with the image features of the main image group;

the second query module is used for querying and obtaining the contact person communication information according to the contact person identification information;

and the establishing module is used for establishing the incidence relation between the image set and the contact person communication information.

Correspondingly, the embodiment of the invention also provides an interactive device of the terminal image, which comprises:

and the processing module is used for responding to triggering operation of an image set obtained by classification in the terminal and initiating communication processing according to contact person communication information associated with the image set, wherein the contact person communication information associated with the image set is determined according to contact person identification information obtained by image set inquiry, and the contact person identification information is determined according to image feature inquiry of each main image of the main image group in the image set.

Accordingly, an embodiment of the present invention further provides a terminal, where the terminal includes a processor, and the processor is configured to execute the method according to the first aspect or the method according to the second aspect.

Drawings

FIG. 1 is a schematic diagram of a user interface for filling in contact information, in accordance with an embodiment of the present invention;

FIG. 2 is a schematic diagram of an interface for displaying communication information in an image folder according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of an interface for displaying communication tags under an image folder according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a user interface for prompting a user for operation according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of user interface switching according to an embodiment of the present invention;

FIG. 6 is a diagram illustrating an exemplary trigger operation associated with initiating a communication, in accordance with an embodiment of the present invention;

fig. 7 is a flowchart illustrating a method for managing terminal images according to an embodiment of the present invention;

fig. 8 is a flowchart illustrating another method for managing terminal images according to an embodiment of the present invention;

fig. 9 is a flowchart illustrating a method for classifying a terminal image according to an embodiment of the present invention;

fig. 10 is a flowchart illustrating an interaction method of terminal images according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a terminal image management device according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of an interactive device for terminal images according to an embodiment of the present invention;

fig. 13 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of another terminal according to an embodiment of the present invention.

Detailed Description

In the embodiment of the invention, the terminal can store images of friends or other people, and the images can be pictures shot by the terminal, or pictures downloaded by the terminal from a computer, the internet, a server for managing the images of the people or other intelligent terminals. The terminal can be a smart phone, and also can be a tablet personal computer, a smart wearable device and other smart terminals which can store and manage images and record contact information.

For the images stored in the terminal, all the images can be classified to obtain a plurality of image sets. During classification, specifically, according to the image characteristics of the persons in the images, the similarity of the persons in two or more images is calculated, the two or more images with the similarity higher than a preset similarity threshold value are classified into one type, the images are respectively recorded in one image set, and a folder is established and stored in the terminal to obtain the image sets through classification.

In one embodiment, when the classification is performed, the person image recognition may be performed on the images stored in the terminal, and if a single person image including only one person is recognized, the image feature recognition may be performed on the single person image stored in the terminal, and at least two single person images with image features having a similarity greater than a preset threshold are classified into one image set. In one embodiment, the face similarity between the images of the regions where the human objects are located in any two single human object images can be calculated directly based on the facial image features of the human objects, and the single human object images are classified based on the face similarity and a preset similarity threshold.

If it is recognized that a plurality of character images including a plurality of characters, for example, a plurality of character images M including a plurality of characters, for example, the character A, B, C, respectively, are included in one multi-character image M, the image M including a plurality of characters may be divided into image sets corresponding to a, B, or C based on the number of images of the characters a, B, or C existing in other images stored in the terminal. For example, if there are many photos of person a in the user D terminal, M is classified into the video set corresponding to person a. In addition, if the user of the terminal is known as C, no matter how many photos of the person C are stored in the terminal of the user C, the image M is not classified into the image set of the person C, but is classified into the person a or the person B with a larger number of photos.

In one embodiment, for a multi-character image including multiple characters, each character in the multi-character image may be respectively used as an initial character, similarity calculation between the initial character and characters in other images in the terminal is performed, images with similarity greater than a similarity threshold value in the other images are used as similar images of the initial character, the number of similar images of each initial character is determined, and according to the determined number, the multi-character image is classified into an image set corresponding to the similar image with the largest number. For example, if there are 20 similar images corresponding to the initial person a in the above M, which are more than B and C, the person a is classified into the main image sets corresponding to the 20 similar images, the main image sets are determined from one or more image sets to which the respective similar images belong, for example, if 15 of the 20 similar images are in one image set, the image set is taken as the main image set, and M is finally classified into the image sets corresponding to the 15 similar images.

Through the classification, a plurality of image sets can be obtained in the terminal, and corresponding folders can be established in the terminal to store the image sets. The classification and the storage of the image sets by the folder can be realized by calling corresponding program instructions through a processor of the terminal.

In one embodiment, for a video set, one or more primary videos may be first determined from the video set, resulting in a primary video group. The main image or the representative image called the image set is an image with the most abundant image features such as a face of a person in the image set, and the target person in the image set can be represented to the maximum extent based on the image features obtained by the main images, and the contact information of the target person can be searched and inquired from the internet or a specific person database, specifically, the contact identification information associated with the image features of the main image group can be inquired by using the image features corresponding to the main images as inquiry keywords. The inquired contact person identification information is mainly identification information such as Chinese names or English names.

After the contact identification information is inquired, the contact communication information corresponding to the contact identification information is further found in an address book of the terminal, and in one embodiment, communication information such as a mobile phone number, a fixed phone number, a mailbox address, an instant messaging application account number and the like related to the contact name can be searched in the address book based on the name information of the contact.

And after the contact person communication information is obtained through inquiry, establishing the association relation between the image set and the contact person communication information. If the contact communication information is not inquired, a user interface can be output, so that the user fills the communication information of the corresponding target person on the user interface, for example, the interface shown in fig. 1, a user interface 102 for recording the contact information is displayed in a certain display area on the right side of the folder icon 101 where the image set of zhang san is located, and the user can fill the contact communication information including name, telephone, mailbox and other contact communication information such as social account on the user interface 102. And recording the filled communication information into a terminal address book, and at least establishing an association relation between the image set and the communication information of the target character recorded into the terminal address book, so that communication information such as a mobile phone number, a landline number, a mailbox address or an instant messaging application account corresponding to the image set can be found based on the association relation when some related operations on the image set are detected subsequently, and communication processing such as dialing a call, sending a mail or initiating instant messaging to the target character corresponding to the image set is performed.

After the association relationship between the image set and the contact person communication information is established, in an embodiment, the contact person communication information and the folder corresponding to the image set may be displayed to the user together, as shown in fig. 2, a folder icon 201 where the image set of zhang san is located and a display interface 202 displaying the associated contact person communication information are displayed, and the associated contact person communication information such as a telephone number and a mailbox may be displayed in a list form on the display interface 202.

In another embodiment, an identifier for indicating that an association relationship with contact information has been established may also be displayed on only a folder icon of a file corresponding to a picture or an image set, as shown in fig. 3, a folder icon 301 of an image set of zhang san is displayed, and an identifier 302 indicating that the image set corresponding to the folder has been associated with contact communication information is displayed on the upper right corner of the folder icon 301. Of course, any information about the association or the contact communication information may not be displayed.

The user can press (or perform other operations) the folder icon of the file where the image set is located, and then directly trigger and execute communication processing modes such as dialing a telephone of a target person in the image set. Alternatively, the communication process and other functions may be displayed to the user through the user interface, for example, when the folder icon corresponding to the image set is clicked, there are two processing modes, i.e., a processing mode of opening the folder and making a call, at this time, a user interface including file opening-making a call (and/or sending an email, initiating a chat) appears, so that the user can select to open the file or directly make a call (and/or sending an email, initiating an instant communication, etc.). As shown in fig. 4, which is a schematic diagram of a user interface according to an embodiment of the present invention, before clicking, a folder icon 401 storing files of a video set is normally displayed as in the conventional manner, a thumbnail of a main character is displayed on the folder icon, and after clicking (or other user operations), a user interface 402 for prompting a user about operations that can be performed is displayed beside the folder icon 401, so that the user can select a subsequent processing manner. Of course, the user interface 402 may be located elsewhere on the folder icon 401, or even overlaid on the icon 401. If the user clicks and selects the option of opening a file on the user interface 402, the folder corresponding to the icon 401 is directly opened in the existing manner, and images such as pictures or videos in the image set under the folder are displayed to the user. If the user clicks and selects the call dialing option, as shown in fig. 5, then a communication process is performed based on the contact communication information associated with the image set under the icon 401, for example, a telephone number in the contact communication information is directly dialed, a telephone communication is initiated, and the interface for dialing a call is switched to as shown in fig. 5.

In an embodiment, the communication processing may also be initiated directly according to the contact communication information associated with the image set based on a specified operation of the user, such as a long-press operation or a double-click operation. As shown in fig. 6, after the user presses the folder icon 601 of the image set of zhang san for a long time, the user directly dials the phone number in the contact communication information to initiate the phone communication.

The embodiment of the invention not only can automatically establish the incidence relation between the image set and the corresponding contact information, but also can receive the manual updating operation of the user. In the process of managing the image set or making a call, etc., the user can manually correct the association relationship (for example, modify the name corresponding to the image set) or supplement new contact communication information (for example, supplement an instant communication application account), and the finally edited result can be correspondingly synchronized into the corresponding database for inquiring the contact identification information and/or the database for inquiring the contact communication information.

In addition, in the case where one image M relates to a plurality of persons, for example, including the person A, B, C, there are cases where different names may correspond to different terminals of different users, for example, according to the above description about the multi-person image, the user D corresponds to the name of the person a, and the user E corresponds to the name of the person B. In the embodiment of the present invention, after the user D and the user E upload names to the cloud database, the cloud database collects images including a plurality of people and names (contact identifiers) corresponding to the people, that is, the image M is classified into images corresponding to the names in the cloud database. When a subsequent related query request for querying the identification information of the contact person is sent by another user terminal (for example, the user C), the similarity may be calculated according to the image characteristics of the main image packet and the image including the multiple persons, and a corresponding name may be obtained through querying according to the similarity and a preset similarity threshold. In the embodiment of the present invention, the number of corresponding persons in all images of the other users (user C end) is further considered to query and obtain corresponding contact identification information, for example, if there are many images of the person a at the C end, the name of the person a is queried and finally fed back to the user C end.

Please refer to fig. 7, which is a flowchart illustrating a method for managing a terminal image according to an embodiment of the present invention, where the method according to the embodiment of the present invention may be applied to a terminal, and the terminal may be a smart phone, a tablet computer, a smart wearable device, and the like. Specifically, the method comprises the following steps.

S701: and determining a main image group from an image set obtained by classifying the terminal, wherein the main image group comprises one or more main images. The terminal can store a large number of images such as pictures, each image in the image set at least comprises an image area of a person, and each image can only comprise one person or can comprise a plurality of persons. In an embodiment of the present invention, the image set is obtained by classifying images according to persons, and in an embodiment, each image in the image set should include a target person, and the image similarity of an area where the target person is located between the images is higher than a preset similarity threshold.

The main images in the main image group are selected from the image set according to the definition of the images in the image set, the image characteristics (especially facial characteristics) of the region where the person is located in the images, or the size of the region where the target person is located. Each main image in the main image groups is used as a representative image of the image set, so that subsequent retrieval is facilitated to obtain contact person identification information such as names and the like corresponding to the image set, and the main image groups at least comprise one main image.

S702: and performing characteristic analysis on each main image in the main image groups to determine the image characteristics of the main image groups. The image characteristics of each main image in the main image groups can be identified based on an image identification technology, and a characteristic combination is obtained according to the image characteristics of each main image, so that the image characteristics capable of representing the target person in the image set can be obtained to the maximum extent, the subsequent inquiry of the contact person identification information of the target person based on the image characteristics is facilitated, and the accurate contact person identification information such as the name of the target person in the image set is obtained.

S703: and inquiring the contact person identification information associated with the image characteristics of the main image group. The contact identification information associated with the image feature can be queried through the internet or a specific cloud database. The specific cloud database is pre-established data comprising a large amount of contact person identification information such as images, names and the like, similarity calculation is carried out on the image characteristics of the main image groups and the image characteristics of each image in the database, and the contact person identification information corresponding to the image with the highest similarity in the internet or the specific database is used as a query result. The contact identification information may be, in addition to information such as a real name, other code numbers related to the name, such as an english name corresponding to the name, or a nickname commonly used by the person.

S704: and inquiring to obtain the communication information of the contact person according to the identification information of the contact person. After obtaining the contact person identification information such as name, comparing the contact person identification information with the contact person name stored in the address book in the terminal, and if the contact person name which is the same as or similar to the name of the contact person identification information exists in the address book, obtaining the contact person communication information in the address book entry corresponding to the contact person name, wherein the contact person communication information can be a telephone number, an email address, an instant messaging application account number or the like.

S705: and establishing an incidence relation between the image set and the communication information of the contact person. The purpose of establishing the association relationship is that the user can view or directly use the corresponding contact person communication information when performing some specific operations aiming at the image set. For example, when the user presses the folder icon where the image set is located for a long time, a user interface can be popped up to display information such as a telephone number in the contact person communication information, or the user can directly dial the telephone number in the contact person communication information after pressing for a long time.

Of course, besides establishing the association relationship between the image set and the contact person communication information, the contact person identification information may also establish the association relationship with the image set, so that the user can intuitively determine the information such as the name of the target person corresponding to the image set.

The method of the embodiment of the invention can establish the incidence relation between the image set and the contact information stored in the terminal, quickly realize the management of the image set based on the contact information, and can facilitate the switching between the image set and the contact information for a user based on the incidence relation.

Referring to fig. 8, a flowchart of another method for managing a terminal image according to an embodiment of the present invention is shown, where the method according to the embodiment of the present invention may be applied to a terminal, and the terminal may be a smart phone, a tablet computer, a smart wearable device, or the like. Specifically, the method comprises the following steps.

S801: and determining a main image group from an image set obtained by classifying the terminal, wherein the main image group comprises one or more main images. Determining a main image packet from the image set according to a preset screening rule; the screening rule is preset according to image features in the image, wherein the image features comprise: facial features and/or body conformation features. In one embodiment, the target person region image may be determined from the images of the image set respectively; determining a main image according to the image characteristics of the target character area image according to a preset screening rule; a primary image packet is determined from the plurality of primary images. In one embodiment, the target images preliminarily screened from the image set may be images with a definition higher than a predetermined definition threshold and an image area of the target person in the image larger than a preset area threshold, and then the image of the target person area is determined from the preliminarily screened target images.

The image may include only one person or a plurality of persons. In the embodiment of the present invention, it is preferable to select the image including only one person as the main image. In one embodiment, when there is a single character image including only one character in the image set, the image area in which the character in the single character image is located is determined as the target character area image.

The image in which the region where the person is located in some images of the image set is clear and large and includes a plurality of persons can also be used as the main image. When the image set has a multi-person image comprising a plurality of persons, taking each person of the multi-person image as an initial person respectively; and respectively carrying out image similarity calculation on the initial person and persons in other images in the image set, and taking an image area where the initial person with the similarity larger than a preset similarity threshold is located as a target person area image of the multi-person image. In one embodiment, for the multi-person image, a person may be determined as a target person from the multi-person image, for example, the image set is actually created for an image of a target person, and the image set includes a single-person image or a multi-person image of the target person, and at this time, an image area where the target person is located needs to be determined from the multi-person image. Therefore, the similarity between the image of each initial person and the persons in the other images in the image set, especially the similarity between the image of each initial person and the single person photograph, may be calculated, and when the image set further includes a large number of other images, the final similarity calculated for each initial person may be an average similarity calculated based on all the similarity values calculated for the corresponding initial person. When the similarity between some non-target persons in the multi-person image and the person images in other images in the image set is calculated, because the similarity between the non-target persons and the person images in other images, particularly the similarity between a single person image including only the target person is definitely very low and even 0, the average value of the similarities corresponding to the non-target persons is low, and thus the image of the area where the initial persons are located is not taken as the target person area image of the multi-person image. The similarity referred to in the present application mainly refers to the similarity of human images in a video.

S802: and performing characteristic analysis on each main image in the main image groups to determine the image characteristics of the main image groups. The feature analysis may be to perform image recognition and analysis on each target person region image in the main image of the main image sub-group again after determining the main image sub-group, so as to obtain the image features of the target person. Further processing may be performed to obtain the image features representing the target person image in the main image group based on the image analysis and recognition already performed in S801. This processing may include, for example, a deduplication process resulting in no duplicate picture features for the primary picture packet.

S803: and inquiring the contact person identification information associated with the image characteristics of the main image group. The contact identification information includes: the contact name information, the query of the contact identification information associated with the image features of the main image group, includes: searching the contact name information of the person represented by the image characteristic by taking the image characteristic of the main image as key information in the Internet; or inquiring the contact name information of the person represented by the image characteristics in a preset contact database by taking the image characteristics of the main image as key information, wherein the image characteristics and the contact name information are stored in the contact database in an associated manner.

In addition, if the contact person identification information cannot be inquired, the user can be prompted to enter the first contact person information, generally, people in some images stored in the terminal by the user are all people known by the user, and therefore, a user interface can be provided for the user, so that the user can conveniently input the contact person identification information such as names and the like. After the user inputs the name, some or all of the main images in the main image group and the name input by the user may be stored in the cloud database in an associated manner, so that other subsequent users can query the contact identification information such as the name based on the image features or images of the corresponding main image group.

After the contact identification information is obtained by searching in the internet or the like or the contact identification information input by the user is received, the following S804 may be further performed. If no contact person identification information is obtained, sending out a prompt that the related information cannot be inquired, and finishing the processing.

S804: inquiring to obtain contact person communication information according to the contact person identification information; the contact person communication information comprises: any one or more of contact telephone number information, mailbox address information and instant messaging application account information, wherein the contact person communication information is obtained by inquiring according to the contact person identification information, and the method comprises the following steps: and inquiring the contact person communication information in an address book of the terminal for storing the contact person information according to the contact person name information.

If the user stores the contact person communication information such as the telephone number and the mail address of the corresponding contact person name in the address book of the terminal, the user can obtain the contact person communication information by inquiring according to the name information of the contact person identification information and the contact person name information in the address book in the step S804. If the corresponding contact name is not stored, the user can be prompted to enter the contact communication information of the contact name, for example, a user interface is displayed, and the user inputs the contact communication information such as a telephone number, a mailbox address, an instant messaging application account number and the like, so that the contact communication information can be obtained.

After the contact communication information is obtained, S805 described below may be directly performed. Meanwhile, if the contact person communication information is input by the user, the contact person identification information and the contact person communication information input by the user can be used as an item of the terminal address book and input into the terminal address book.

S805: and establishing an incidence relation between the image set and the communication information of the contact person.

S806: judging whether a trigger operation on a folder icon of a file where the image set is located is detected; the judgment process is mainly to detect whether there are some specific user operations. If the determination result is yes, S807 described below is executed, otherwise, no processing is executed.

Wherein the S806 may include: generating an interactive interface associated with the folder icon of the file where the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected. The interactive interface may be generated on a folder icon of a file where the image set is located, and a user may directly issue a corresponding user operation on the interactive interface, which may be as shown in fig. 1 in one embodiment. Of course, the interactive interface is in a non-display or non-generation state at the beginning, and the interactive interface is generated or displayed for the user to send out the operation only when the special operation sent by the user for the folder icon of the file where the image set is located is detected, for example, when the long-time pressing operation or the double-click operation is detected.

Or, the S806 specifically includes: detecting whether the specified operation of the folder icon of the file where the image set is located exists or not; if the specified operation exists, determining that the triggering operation of the folder icon of the file where the image set is located is detected; the specifying operation may specifically include: the long press operation and the at least two times of interval time are any one of click operation and drag operation within a preset time threshold. That is, the user performs the following S807 as it is, only by performing the designation operation on the folder icon of the file in which the video set is located.

S807: and triggering communication processing based on the contact person communication information according to the incidence relation. In the embodiment of the invention, the contact processing refers to processing such as dialing a telephone number in the contact communication information, opening a mail to be sent to a mail address in the contact communication information and the like. In other embodiments, only the display process of the contact communication information and the like may be performed according to the triggering operation of S806.

S808: and receiving modification operation aiming at the incidence relation between the image set and the contact person communication information. The user can modify the contact person communication information in the image set according to the requirement, such as modifying a telephone number, supplementing an instant messaging application account number and the like. The user can specifically modify the corresponding contact information in the terminal address book, or configure a user interface for the user, the user directly performs the modification operation on the user interface, and the terminal modifies the corresponding information in the terminal address book based on the modification operation and the information on the user interface.

S809: and deleting the association relation according to the modification operation, and establishing the association relation between the image set and the contact person communication information appointed by the modification operation.

The method of the embodiment of the invention can establish the incidence relation between the image set and the contact information stored in the terminal, quickly realize the management of the image set based on the contact information, and facilitate the switching between the image set and the contact information for the user based on the incidence relation. In the embodiment of the present invention, a classification of an image including a plurality of persons and a determination manner as a main image are also defined, so that an image including a plurality of persons can also be efficiently classified and used as a main image.

Referring to fig. 9, a flowchart of a method for classifying a terminal image according to an embodiment of the present invention is shown.

S901: and analyzing and identifying the images stored in the terminal. The analysis and recognition in S901 are mainly used to recognize a single character image including only one character and a multi-character image including a plurality of characters in the images stored in the terminal. The following S902 is performed for a single character image including only one character, and the following S903 to S905 are performed for a multi-character image including a plurality of characters.

S902: if the terminal stores the single-person image only comprising one person, image feature recognition is carried out on the single-person image, and at least two single-person images with the image feature similarity larger than a preset threshold value are classified into one image set.

S903: when a multi-character image including a plurality of characters is stored in the terminal, each character in the multi-character image is respectively used as an initial character.

S904: and performing image similarity calculation on the initial person and persons in other images in the terminal, and taking the images with the similarity greater than a similarity threshold value in the other images as similar images of the initial person.

S905: and determining the number of the similar images of each initial figure, and classifying the images of the multiple persons into an image set corresponding to the similar image with the largest number.

That is, for a plurality of persons included in the video, the number of images of each person in other videos of the terminal is determined, and the person with the largest number is used as a classification basis for the multi-person video.

The embodiment of the invention can effectively classify the images stored in the terminal, particularly intelligently classify the images of a plurality of people, and meet the automatic and intelligent requirements of users on image classification.

Referring to fig. 10, a flowchart of an interaction method for terminal images according to an embodiment of the present invention is shown, where in an embodiment, the method includes the following steps.

S1001: and receiving a trigger operation of the image set obtained by classification in the terminal. The trigger operation may be a user operation received by the touch screen.

S1002: and responding to the triggering operation of the image set obtained by classifying in the terminal, and initiating communication processing according to the contact person communication information associated with the image set.

And the contact person communication information associated with the image set is determined according to contact person identification information obtained by the image set query, and the contact person identification information is determined according to the image feature query of each main image of the main image group in the image set. The contact person identification information mainly comprises information such as names of contact persons, and the contact person communication information comprises information such as telephone numbers, mailbox addresses and social account numbers of the contact persons.

In one embodiment, the S1002 may include: judging whether a trigger operation on a folder icon of a file where the image set is located is detected; if the judgment result is yes, triggering communication processing based on the contact person communication information according to the incidence relation.

In an embodiment, the determining whether the trigger operation on the folder icon of the file where the image set is located is detected may specifically include: generating an interactive interface associated with the folder icon of the file where the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.

The trigger operation may be a long-time pressing operation, and the at least two time intervals are any one of a clicking operation and a dragging operation within a preset time threshold. The communication processing comprises the contact person communication information

It should be noted that, in the embodiment of the present invention, the description of corresponding contents in the embodiments corresponding to fig. 1 to 9 may be referred to for a process of determining contact communication information for an image set, a process of initiating communication processing according to a trigger operation of a user, and the like, and details are not repeated herein.

The following describes the management device of terminal images and the terminal in detail according to the embodiment of the present invention.

Fig. 11 is a schematic structural diagram of a terminal image management device according to an embodiment of the present invention, which can be installed in a terminal such as a smart phone, a tablet computer, a smart wearable device, and the like.

A grouping determination module 1101, configured to determine a primary image group from an image set obtained by classifying a terminal, where the primary image group includes one or more primary images; a feature determining module 1102, configured to perform feature analysis on each primary image in the primary image groups, and determine image features of the primary image groups; a first query module 1103, configured to query contact identification information associated with the image feature of the primary image group; the second query module 1104 is configured to query the contact communication information according to the contact identification information; an establishing module 1105, configured to establish an association relationship between the image set and the contact communication information.

In one embodiment, the apparatus of the embodiment of the present invention may further include: a determining module 1106, configured to determine whether a trigger operation on a folder icon of a file in which the image set is located is detected; a processing module 1107, configured to trigger, when the determination result of the determining module 1106 is yes, communication processing based on the contact communication information according to the association relationship.

In an embodiment, the determining module 1106 is specifically configured to generate an interactive interface associated with a folder icon of a file in which the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.

In an embodiment, the determining module 1106 is specifically configured to detect whether there is a specified operation on a folder icon of a file where the image set is located; if the specified operation exists, determining that the triggering operation of the folder icon of the file where the image set is located is detected; the specifying operation includes: the long press operation and the at least two times of interval time are any one of click operation and drag operation within a preset time threshold.

In an embodiment, the grouping determining module 1101 is specifically configured to determine a primary image grouping from the image set according to a preset filtering rule; the screening rule is preset according to image features in the image, wherein the image features comprise: facial features, and/or body conformation features.

In an embodiment, the grouping determination module 1101 is specifically configured to determine target person region images from the images of the image set respectively; determining a main image according to the image characteristics of the target character area image according to a preset screening rule; a primary image packet is determined from the primary image.

In one embodiment, the grouping determination module 1101 is specifically configured to determine, as the target person region image, an image region in which a person in the single person image is located when there is a single person image including only one person in the image set.

In one embodiment, the grouping determination module 1101 is specifically configured to, when a multi-character image including a plurality of characters exists in the image set, respectively take each character of the multi-character image as an initial character; and respectively carrying out image similarity calculation on the initial person and persons in other images in the image set, and taking an image area where the initial person with the similarity larger than a preset similarity threshold is located as a target person area image of the multi-person image.

The grouping determination module 1101 may specifically have the above functions at the same time, and the above functions are switched according to specific requirements of a user to obtain a primary video grouping more suitable for performing a search query based on video features.

In one embodiment, the apparatus of the embodiment of the present invention may further include: the single person classification module 1108 is configured to, if a single person image including only one person is stored in the terminal, perform image feature recognition on the single person image, and classify at least two single person images, of which the similarity of the image features is greater than a preset threshold, into an image set.

In one embodiment, the apparatus of the embodiment of the present invention may further include: a classification module 1109, configured to, when a multi-character image including a plurality of characters is stored in the terminal, take each character in the multi-character image as an initial character, respectively; respectively carrying out image similarity calculation on the initial figure and the figures in other images in the terminal, and taking the images with the similarity larger than a similarity threshold value in the other images as similar images of the initial figure; and determining the number of the similar images of each initial figure, and classifying the images of the multiple persons into an image set corresponding to the similar image with the largest number.

The device may include both the single person classification module 1108 and the classification module 1109, so as to select one of them to execute the corresponding steps according to the user's requirements, and of course, may also include only one of the single person classification module 1108 and the classification module 1109.

In one embodiment, the contact identification information includes: contact name information;

the first query module 1103 is specifically configured to query, in the internet, contact name information of a person represented by the image feature of the main image, by using the image feature as key information; or inquiring the contact name information of the person represented by the image characteristics in a preset contact database by taking the image characteristics of the main image as key information, wherein the image characteristics and the contact name information are stored in the contact database in an associated manner.

In one embodiment, the contact communication information includes: the second query module 1104 is specifically configured to query the contact address information in an address book of the terminal storing contact information according to the contact name information.

In one embodiment, the apparatus of the embodiment of the present invention may further include: an editing module 510, configured to receive a modification operation for an association relationship between the image set and the contact communication information; and deleting the association relation according to the modification operation, and establishing the association relation between the image set and the contact person communication information appointed by the modification operation.

For specific implementation of each module of the apparatus according to the embodiment of the present invention, reference may be made to the description of related steps and functions in each of the foregoing embodiments, which are not described herein again.

Referring to fig. 12, a schematic structural diagram of an interactive device for terminal images according to an embodiment of the present invention is shown, and in an embodiment, the device includes a receiving module 1201 and a processing module 1202. The receiving module 1201 is configured to receive a trigger operation on an image set obtained by classification in a terminal, and the processing module 1202 is configured to initiate a communication process according to contact person communication information associated with the image set in response to the trigger operation on the image set obtained by classification in the terminal, where the contact person communication information associated with the image set is determined according to contact person identification information obtained by querying the image set, and the contact person identification information is determined according to image feature queries of each primary image grouped by the primary images in the image set.

In an embodiment, the processing module 1202 is specifically configured to generate an interactive interface associated with a folder icon of a file in which the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.

In an embodiment, the processing module 1202 may be further configured to detect whether there is a specified operation on a folder icon of a file where the image set is located; if the specified operation exists, determining that the triggering operation of the folder icon of the file where the image set is located is detected; the specifying operation includes: the long press operation and the at least two times of interval time are any one of click operation and drag operation within a preset time threshold.

In addition, the specific implementation of the processing module 1202 of the apparatus according to the embodiment of the present invention may refer to the description of relevant contents in the foregoing embodiments. And will not be described in detail herein.

Referring to fig. 13, it is a schematic structural diagram of a terminal according to an embodiment of the present invention, where the terminal includes structures such as a power supply, a circuit board, and a speaker, and in an embodiment of the present invention, the terminal further includes: user interface 1301, processor 1302, network interface 1303, and memory 1304.

The user interface 1301 includes modules such as a touch screen for receiving user operations and displaying corresponding interfaces and information to a user, and the network interface 1303 is mainly used for communicating with the internet or a corresponding server, so as to send a request for querying corresponding contact information and receive corresponding queried data.

The memory 1304 may include volatile memory (volatile memory), such as random-access memory (RAM); the memory 1304 may also include a non-volatile memory (non-volatile memory), such as a flash memory (flash memory), a Hard Disk Drive (HDD) or a solid-state drive (SSD); the memory 1304 may also comprise a combination of memories of the kind described above.

The processor 1302 may be a Central Processing Unit (CPU). The processor 1302 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.

Optionally, the memory 1304 is also used for storing program instructions. The processor 1302 may call the program instruction to implement the method for managing terminal images as shown in the embodiments corresponding to fig. 7, 8, and 9 of the present application.

The processor 1302 invokes a program instruction stored in the memory 1304 to determine a primary image packet from an image set obtained by classifying a terminal, where the primary image packet includes one or more primary images; performing characteristic analysis on each main image in the main image groups to determine the image characteristics of the main image groups; inquiring contact person identification information associated with the image features of the main image group; inquiring to obtain contact person communication information according to the contact person identification information; and establishing an incidence relation between the image set and the communication information of the contact person.

In an embodiment, the processor 1302 is further configured to determine whether a trigger operation on a folder icon of a file where the image set is located is detected; if the judgment result is yes, triggering communication processing based on the contact person communication information according to the incidence relation.

In an embodiment, the processor 1302 is specifically configured to generate an interactive interface associated with a folder icon of a file in which the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.

In an embodiment, the processor 1302 is specifically configured to detect whether there is a specified operation on a folder icon of a file where the image set is located; if the specified operation exists, determining that the triggering operation of the folder icon of the file where the image set is located is detected; the specifying operation includes: the long press operation and the at least two times of interval time are any one of click operation and drag operation within a preset time threshold.

In an embodiment, the processor 1302 is specifically configured to determine a primary image packet from the image set according to a preset filtering rule; the screening rule is preset according to image features in the image, wherein the image features comprise: facial features, and/or body conformation features.

In an embodiment, the processor 1302 is specifically configured to determine a target person region image from the images of the image set respectively; according to a preset screening rule, taking the images of which the number of the image features of the target person region images is larger than a preset number threshold value as main images; a primary image packet is determined from the plurality of primary images.

In one embodiment, the processor 1302 is specifically configured to determine an image area in which a person in the single person image is located as the target person area image when a single person image including only one person exists in the image set.

In an embodiment, the processor 1302 is specifically configured to, when a multi-character image including a plurality of characters exists in the image set, respectively take each character of the multi-character image as an initial character; and respectively carrying out image similarity calculation on the initial person and persons in other images in the image set, and taking an image area where the initial person with the similarity larger than a preset similarity threshold is located as a target person area image of the multi-person image.

In one embodiment, the processor 1302 is further configured to, if a single person image including only one person is stored in the terminal, perform image feature recognition on the single person image, and classify at least two single person images with image features having a similarity greater than a preset threshold into an image set.

In one embodiment, the processor 1302 is further configured to, when a multi-character image including a plurality of characters is stored in the terminal, respectively take each character in the multi-character image as a target character area image; calculating the similarity of the target person and persons in other images in the terminal, and taking the images with the similarity larger than a similarity threshold value in the other images as similar images of the target person; and determining the number of the similar images of each target figure, and classifying the images of the multiple persons into an image set corresponding to the similar images with the largest number.

In one embodiment, the contact identification information includes: the processor 1302 is specifically configured to query, in the internet, the contact name information of the person represented by the image feature with the image feature of the main image as key information; or inquiring the contact name information of the person represented by the image characteristics in a preset contact database by taking the image characteristics of the main image as key information, wherein the image characteristics and the contact name information are stored in the contact database in an associated manner.

In one embodiment, the contact communication information includes: the processor 1302 is specifically configured to query the contact communication information in an address book of the terminal storing contact information according to the contact name information.

In one embodiment, the processor 1302 is further configured to receive a modification operation for the association relationship between the image set and the contact communication information; and deleting the association relation according to the modification operation, and establishing the association relation between the image set and the contact person communication information appointed by the modification operation.

For specific implementation of the corresponding functions of the processor 1302 according to the embodiments of the present invention, reference may be made to the specific description of the relevant steps or functions in the foregoing embodiments, which is not repeated herein.

Referring to fig. 14 again, it is a schematic structural diagram of another terminal according to an embodiment of the present invention, where the terminal according to the embodiment of the present invention includes structures such as a power supply, a circuit board, and a speaker, and in the embodiment of the present invention, the terminal further includes: a user interface 1401, a processor 1402, a communication interface 1403, and a memory 1404.

The user interface 1401 includes a touch screen and other modules for receiving user operations and displaying corresponding interfaces and information to a user, and the communication interface 1403 is mainly used for initiating telephone communication, or sending e-mail, sending network data and other communication-related processes, so as to send a request for querying corresponding contact information and receive corresponding queried data.

The memory 1404 may include volatile memory (RAM); the memory 1404 may also include a non-volatile memory (non-volatile memory), such as a flash memory (HDD), or SSD; the memory 1404 may also comprise a combination of memories of the kind described above.

The processor 1402 may be a CPU. The processor 1402 may further include a hardware chip. The hardware chip may be an ASIC, PLD, or a combination thereof. The PLD may be a CPLD, an FPGA, or any combination thereof.

Optionally, the memory 1404 is also used for storing program instructions. The processor 1402 may call the program instruction to implement the method for interacting terminal images as shown in the embodiment corresponding to fig. 10 in this application.

The processor 1402 is configured to initiate, in response to a trigger operation on an image set obtained by classifying in a terminal, a communication process according to contact person communication information associated with the image set, where the contact person communication information associated with the image set is determined according to contact person identification information obtained by querying the image set, and the contact person identification information is determined according to image feature queries of each main image of a main image group in the image set.

In an embodiment, the processor 1402 is specifically configured to determine whether a trigger operation on a folder icon of a file where the image set is located is detected; if the judgment result is yes, triggering communication processing based on the contact person communication information according to the incidence relation.

In an embodiment, the processor 1402 is specifically configured to generate an interactive interface associated with a folder icon of a file in which the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.

In an embodiment, the processor 1402 is specifically configured to detect whether there is a specified operation on a folder icon of a file where the image set is located; if the specified operation exists, determining that the triggering operation of the folder icon of the file where the image set is located is detected; the specifying operation includes: the long press operation and the at least two times of interval time are any one of click operation and drag operation within a preset time threshold.

It should be noted that, in the embodiment of the present invention, for the process of determining the communication information of the contact for the image set, the process of initiating the communication processing by the processor 1402 according to the trigger operation of the user and the like may refer to the description of corresponding contents in the embodiments corresponding to fig. 1 to fig. 9, and details are not repeated herein.

Claims

1. A management method for terminal images is characterized by comprising the following steps:

querying contact identification information associated with the image features of the master image packet, wherein the contact identification information includes contact name information, using the image characteristics of the main image as key information to inquire the contact name information of the character represented by the image characteristics, if one image comprises a plurality of character images, when different character images in the plurality of character images in the image correspond to different name information at different user terminals, providing name information in a cloud database according to different user terminals, collecting different character images included in the images and corresponding name information corresponding to different user terminals, when receiving a query request of a certain user terminal, respectively calculating similarity in the cloud database according to the image characteristics of the main image groups and the images comprising a plurality of characters, and inquiring to obtain corresponding names according to the similarity and a preset similarity threshold;

2. The method of claim 1, wherein determining the primary image packet from the image set classified by the terminal comprises:

determining target character area images from the images of the image set respectively;

determining a main image according to the image characteristics of the target character area image according to a preset screening rule;

a primary image packet is determined from the primary image.

3. The method of claim 2, wherein said determining the target person region image from the images of the set of images, respectively, comprises:

when the image set has a multi-person image comprising a plurality of persons, taking each person of the multi-person image as an initial person respectively;

and respectively carrying out image similarity calculation on the initial person and persons in other images in the image set, and taking an image area where the initial person with the similarity larger than a preset similarity threshold is located as a target person area image of the multi-person image.

4. The method of claim 1, further comprising:

when a multi-person image comprising a plurality of persons is stored in the terminal, taking each person in the multi-person image as an initial person;

respectively carrying out image similarity calculation on the initial figure and the figures in other images in the terminal, and taking the images with the similarity larger than a similarity threshold value in the other images as similar images of the initial figure;

and determining the number of the similar images of each initial figure, and classifying the images of the multiple persons into an image set corresponding to the similar image with the largest number.

5. The method of claim 1, wherein the contact identification information comprises: the contact name information, the query of the contact identification information associated with the image features of the main image group, includes:

and inquiring the contact name information of the person represented by the image characteristic in a preset contact database by taking the image characteristic of the main image as key information, wherein the image characteristic and the contact name information are stored in the contact database in an associated manner.

6. The method of any of claims 1-5, wherein the contact communication information comprises: any one or more of contact telephone number information, mailbox address information and instant messaging application account information, wherein the contact person communication information is obtained by inquiring according to the contact person identification information, and the method comprises the following steps:

and inquiring the contact person communication information in an address book of the terminal for storing the contact person information according to the contact person name information.

7. An interaction method for terminal images is characterized by comprising the following steps:

initiating communication processing according to contact person communication information associated with an image set in response to a triggering operation of the image set obtained by classifying in a terminal, wherein the contact person communication information associated with the image set is determined according to contact person identification information obtained by inquiring the image set, the contact person identification information is determined according to image feature inquiry of each main image of a main image group in the image set, the contact person identification information comprises contact person name information, the contact person name information of a person represented by the image feature is inquired by taking the image feature of the main image as key information, if one image comprises a plurality of person images, and when different person images in the plurality of person images in the image correspond to different name information at different user terminals, name information is provided in a cloud database according to the different user terminals, and when an inquiry request of a certain user terminal is received, respectively calculating similarity according to the image characteristics of the main image group and the images comprising a plurality of characters in the cloud database, and inquiring to obtain corresponding names according to the similarity and a preset similarity threshold.

8. The method of claim 7, wherein the initiating a communication process according to the communication information of the contact persons associated with the image set in response to the triggering operation of the image set classified in the terminal comprises:

judging whether a trigger operation on a folder icon of a file where the image set is located is detected;

if the judgment result is yes, triggering communication processing based on the contact person communication information according to the incidence relation.

9. The method of claim 8, wherein the determining whether the trigger operation for the folder icon of the file in which the image set is located is detected comprises:

generating an interactive interface associated with the folder icon of the file where the image set is located;

and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.

10. The method of claim 9, wherein the determining whether the trigger operation for the folder icon of the file in which the image set is located is detected comprises:

detecting whether the specified operation of the folder icon of the file where the image set is located exists or not;

if the specified operation exists, determining that the triggering operation of the folder icon of the file where the image set is located is detected;

the specifying operation includes: the long press operation and the at least two times of interval time are any one of click operation and drag operation within a preset time threshold.

11. A management device for terminal images is characterized by comprising:

a first query module for querying contact identification information associated with the image features of the primary image packet, wherein the contact person identification information comprises contact person name information, the contact person name information of the person represented by the image characteristic is inquired by taking the image characteristic of the main image as key information, if one image comprises a plurality of person images, when different character images in the plurality of character images in the image correspond to different name information at different user terminals, providing name information in a cloud database according to different user terminals, collecting different character images included in the images and corresponding name information corresponding to different user terminals, when receiving a query request of a certain user terminal, respectively calculating similarity in the cloud database according to the image characteristics of the main image groups and the images comprising a plurality of characters, and inquiring to obtain corresponding names according to the similarity and a preset similarity threshold;

12. The apparatus of claim 11,

the grouping determination module is specifically configured to determine target character region images from the images of the image set respectively; determining a main image according to the image characteristics of the target character area image according to a preset screening rule; a primary image packet is determined from the primary image.

13. The apparatus of claim 12,

the grouping determination module is specifically configured to, when a multi-character image including a plurality of characters exists in the image set, take each character of the multi-character image as an initial character respectively; and respectively carrying out image similarity calculation on the initial person and persons in other images in the image set, and taking an image area where the initial person with the similarity larger than a preset similarity threshold is located as a target person area image of the multi-person image.

14. The apparatus of claim 12, further comprising:

the classification module is used for taking each person in the multi-person image as an initial person when the multi-person image comprising a plurality of persons is stored in the terminal; respectively carrying out image similarity calculation on the initial figure and the figures in other images in the terminal, and taking the images with the similarity larger than a similarity threshold value in the other images as similar images of the initial figure; and determining the number of the similar images of each initial figure, and classifying the images of the multiple persons into an image set corresponding to the similar image with the largest number.

15. The apparatus of claim 11, wherein the contact communication information comprises: the second query module is specifically used for querying the contact person communication information in an address book of the terminal storage contact person information according to the contact person name information.

16. An interactive device for terminal images, comprising:

a processing module, configured to initiate communication processing according to contact person communication information associated with an image set obtained by classifying in a terminal in response to a trigger operation on the image set, where the contact person communication information associated with the image set is determined according to contact person identification information obtained by querying the image set, and the contact person identification information is determined by querying image features of each main image of a main image group in the image set, where the contact person identification information includes contact person name information, and contact person name information of a person represented by the image feature is queried using the image feature of the main image as key information, and if an image includes multiple person images, name information is provided in a cloud database according to different user terminals when different person images in the multiple person images correspond to different name information at different user terminals, and when an inquiry request of a certain user terminal is received, respectively calculating similarity according to the image characteristics of the main image group and the images comprising a plurality of characters in the cloud database, and inquiring to obtain corresponding names according to the similarity and a preset similarity threshold.

17. The apparatus of claim 16,

the processing module is specifically used for generating an interactive interface associated with the folder icon of the file where the image set is located; and if the user operation on the interactive interface is detected, determining that the trigger operation on the folder icon of the file where the image set is located is detected.