CN109147009B - Method and device for personalized operation based on image, and equipment/terminal/server - Google Patents
Method and device for personalized operation based on image, and equipment/terminal/server Download PDFInfo
- Publication number
- CN109147009B CN109147009B CN201810915916.8A CN201810915916A CN109147009B CN 109147009 B CN109147009 B CN 109147009B CN 201810915916 A CN201810915916 A CN 201810915916A CN 109147009 B CN109147009 B CN 109147009B
- Authority
- CN
- China
- Prior art keywords
- image
- segmentation
- characteristic information
- image elements
- elements
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the application provides a method and a device for personalized operation based on images, and equipment/a terminal/a server, wherein the specific implementation mode of the method comprises the following steps: performing element segmentation on the obtained image according to a segmentation rule to obtain element characteristic information in the image; processing the element characteristic information to obtain an image element corresponding to the element characteristic information; and obtaining an image element corresponding to the instruction according to the received user instruction, and performing personalized operation according to the image element. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a method and an apparatus for image-based personalization operation, and a device/terminal/server.
Background
With the development of intelligent terminals and internet technologies, image shooting or downloading is performed by using the intelligent terminals, so that personalized operations such as searching, commodity customization and the like by using images become one of common operations of users. The user can conveniently realize various personalized operations without manual input, and the object of the personalized operation is an image shot or downloaded by the user, so that the personalized requirements of the user are fully met.
However, at present, the personalization operation using the images photographed or downloaded by the user is limited to the images themselves. Although the user can beautify and edit the image by using various application software, the user cannot perform personalized operation on elements such as sky, people and patterns in the image. In order to perform personalized operations on elements in an image, a user must perform complex operations on the image using specialized image processing tools, which requires the user to have specialized skills in image processing tools and image processing.
Therefore, how to better implement the personalized operation based on the image becomes a technical problem to be solved urgently in the prior art.
Disclosure of Invention
The embodiment of the application provides a method and a device for personalized operation based on images and equipment/terminal/server, and solves the problems in the prior art wholly or partially.
According to an aspect of an embodiment of the present application, there is provided a method of image-based personalization, the method including: performing element segmentation on the obtained image according to a segmentation rule to obtain element characteristic information in the image; processing the element characteristic information to obtain an image element corresponding to the element characteristic information; and obtaining an image element corresponding to the instruction according to the received user instruction, and performing personalized operation according to the image element.
According to another aspect of the embodiments of the present application, there is also provided an apparatus for image-based personalization, the apparatus including: the image segmentation module is configured to perform element segmentation on the obtained image according to a segmentation rule to obtain element feature information in the image; the element obtaining module is configured to process the element characteristic information to obtain an image element corresponding to the element characteristic information; and the operation performing module is configured to obtain the image elements corresponding to the instructions according to the received user instructions and perform personalized operation according to the image elements.
According to another aspect of the embodiments of the present application, there is also provided a device/terminal/server, including: one or more processors; and a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement operations corresponding to the method for image-based personalization operation as described above.
According to still another aspect of embodiments of the present application, there is also provided a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements operations corresponding to the method of image-based personalization operation as described above.
According to the technical scheme provided by the embodiment of the application, the obtained image is subjected to element segmentation according to a segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to carry out personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
Drawings
FIG. 1 is a flow chart illustrating steps of a method for image-based personalization according to a first embodiment of the present disclosure;
FIG. 2 is a flowchart of the steps of one implementation of step S101 of a method of image-based personalization according to a second embodiment of the present application;
fig. 3 is a flowchart of steps of one implementation of step S102 of a method for image-based personalization according to a third embodiment of the present application;
FIG. 4 is a flowchart of the steps of one implementation of step S103 of a method for image-based personalization in accordance with a fourth embodiment of the present application;
FIG. 5 is a flowchart of steps of another method for image-based personalization according to an embodiment five of the present application;
FIG. 6 is a block diagram of an implementation of an apparatus for image-based personalization according to a sixth embodiment of the present application;
fig. 7 is a block diagram of an implementation of an image segmentation module of an apparatus for image-based personalization according to a seventh embodiment of the present application;
FIG. 8 is a block diagram of an implementation of an element obtaining module of an apparatus for image-based personalization according to an eighth embodiment of the present application;
FIG. 9 is a block diagram of an implementation of an operation performing module of an apparatus for image-based personalization according to a ninth embodiment of the present application;
FIG. 10 is a block diagram of another implementation of an apparatus for image-based personalization according to an example embodiment of the present application;
fig. 11 is a block diagram of an apparatus/terminal/server according to an eleventh embodiment of the present application.
Detailed Description
The following detailed description of embodiments of the present application will be made in conjunction with the accompanying drawings (like numerals indicate like elements throughout the several views) and embodiments. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application.
It will be understood by those within the art that the terms "first", "second", etc. in the embodiments of the present application are used only for distinguishing between different steps, devices or modules, etc., and do not denote any particular technical or logical order therebetween.
Example one
Referring to fig. 1, a flowchart illustrating steps of a method for image-based personalization according to an embodiment of the present application is shown.
It should be noted that steps S101 to S103 described in this application do not represent the execution order.
The method for personalized operation based on images comprises the following steps:
step S101: and performing element segmentation on the obtained image according to a segmentation rule to obtain element characteristic information in the image.
Specifically, the segmentation rule in the embodiment of the present application may be preset, or the preset segmentation rule may be adjusted. The server can issue the segmentation rule to the client and update the segmentation rule periodically. The client may also request the server to send the splitting rule or periodically update the splitting rule. The user adjusts the segmentation rule according to the input instruction so that the elements segmented according to the segmentation rule can meet the user requirements, and the system can also adjust the segmentation rule according to the collected user behavior information or the file information recording the user behavior data so that the elements segmented according to the segmentation rule can meet the user historical behaviors.
The segmentation rule comprises the following steps: character segmentation, color segmentation, block segmentation, recognition segmentation, character segmentation, symbol segmentation, pattern segmentation, scene segmentation and article segmentation.
For example, the character segmentation rule is adopted to separate the characters in the image, so as to obtain the character element characteristic information in the image.
For another example, a color segmentation rule is adopted to separate color regions in the image, so as to obtain the element characteristic information of the color regions in the image.
For another example, the block segmentation rule is adopted to separate the blocks input by the user instruction, so as to obtain the block feature information in the image.
For another example, the recognition object input by the user instruction is separated by using a recognition and segmentation rule, so as to obtain object element characteristic information in the image.
For another example, the characters, symbols or patterns input by the user instruction are separated by adopting a character or symbol or pattern segmentation rule, so as to obtain character or symbol or pattern characteristic information in the image.
For another example, a scene segmentation rule is adopted to separate the coffee shop scene in the image, so as to obtain the coffee shop element characteristic information in the image.
For another example, the article corresponding to the user instruction is separated by using an article segmentation rule, so that article element characteristic information in the image is obtained.
And S102, processing the element characteristic information to obtain an image element corresponding to the element characteristic information.
The processing of the element feature information in the embodiment of the application includes assembling the element features and generating image elements conforming to personalized operation.
Step S103: and obtaining an image element corresponding to the instruction according to the received user instruction, and performing personalized operation according to the image element.
In a specific implementation of the present application, the generated multiple image elements may be clicked according to a user instruction, and the determined image element is selected.
In another specific implementation of the present application, the generated plurality of image elements are filtered according to a user instruction, and the determined image elements are filtered.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablet computers, mobile terminals, etc.
Example two
The present embodiment includes the above steps S101 to S103. Referring to fig. 2, step S101 of the method includes:
and step S1011, matching the segmentation rule and the obtained image to obtain a segmentation condition for segmenting the image.
Because the segmentation rule and the image may be unmatched, the segmentation rule and the image need to be matched to obtain the segmentation condition meeting the image content.
The segmentation condition is at least one of an image processing condition and an element utilization condition required by meeting the segmentation.
The image processing conditions are conditions meeting the requirements of image segmentation, and include conditions required by image segmentation such as whether the contour is closed and whether the color is saturated.
The element utilization conditions are conditions required by the utilization of the cut image elements, and include conditions required by the utilization of the image elements such as whether characters and characters can be edited and whether images are clear.
For example, the segmentation rule is human segmentation and recognition segmentation, the image is a group photo, and the recognition human A in the photo only exposes the face, so that the segmentation condition is determined as that the face of the human A is segmented.
For another example, if the segmentation rule is character segmentation and symbol segmentation, and the image is a test paper, the segmentation condition is determined to be character recognition and converted into editable characters.
In the specific implementation of the present application, the segmentation condition may also be adjusted according to a user instruction, so that the segmentation condition better meets the user requirement.
And step S1012, performing element segmentation on the image according to the segmentation condition to obtain element feature information in the image.
According to the embodiment of the application, element segmentation is carried out on the image through segmentation conditions, so that image element characteristic information meeting the image segmentation requirement and the element utilization requirement in the image is obtained.
Specifically, the element feature information includes: at least one of description information, composition information, combination information, and feature information.
For example, the image element is the face of the person a, and includes the size, color, resolution, brightness, facial features, whether a blocking object exists, and the like of the face.
For example, the image element is a cafe, and includes a specific location, a business name, a scene item combination, a size, a color, a resolution, a brightness, and the like.
Therefore, the image can be segmented through the segmentation conditions to obtain the element characteristic information in the image, so that the image can be segmented from the perspective of elements to obtain the image elements meeting the follow-up personalized operation.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablets, mobile terminals, etc.
EXAMPLE III
The present embodiment includes the above steps S101 to S103. Referring to fig. 3, step S102 of the method includes:
and S1021, performing various combinations on the element characteristic information to obtain image elements under various combinations.
Specifically, the element feature information includes at least one of description information, composition information, combination information, and feature information of the image element.
In the embodiment of the application, various combinations are performed by using the element feature information, and various image elements under the combination can be obtained.
For example, a cafe and a face image element in gray scale are obtained, for example, a face with facial features and occlusion is obtained, and for example, a name of a business in the cafe and a clear face are obtained.
And step S1022, screening the image elements to obtain the image elements meeting the personalized operation requirements.
The image elements meeting the requirements of personalized operation are obtained by screening the multiple image elements obtained by combination. Therefore, the screened image elements are determined according to whether the individualized operation requirements are met.
For example, if the whereabouts of a certain person need to be searched, the cafe surveillance videos can be searched according to the filtered merchant names of the cafes and the clear image elements of the faces.
For example, if a person's coffee flower needs to be customized, the image elements with five sense organs of the face can be input into the coffee machine for operation.
Therefore, the image elements under various combinations are obtained according to the element feature combinations, and then various image elements are screened according to the personalized operation requirements, so that the image elements meeting the personalized operation requirements are obtained, the operation is simple and convenient, the combination mode is flexible, and the requirements of the personalized operation of the user can be met.
Therefore, the image element segmentation is carried out on the obtained image according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to carry out personalized operation. The image element segmentation method and device can segment the image elements in the image and conduct personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablet computers, mobile terminals, etc.
Example four
The present embodiment includes the above steps S101 to S103. Referring to fig. 4, step S103 of the method includes:
and step S1031, selecting or screening the image elements according to the user instruction to obtain the image elements corresponding to the user instruction.
Specifically, the user may select the corresponding image element by clicking the image element through a user instruction, or may input a filtering condition to filter the corresponding image element from the image elements.
Step S1032 activates the personalization operation that can be performed on the image element, and performs the personalization operation according to the image element.
According to the embodiment of the application, the corresponding personalized operation is realized by utilizing the image element through activating the corresponding personalized operation.
The personalized operation comprises searching, personalized customization and other operations.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and device can segment the image elements in the image and conduct personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of this embodiment may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablet computers, mobile terminals, etc.
EXAMPLE five
The present embodiment includes the above steps S101 to S103. Referring to fig. 5, step S103 of the method further includes, before:
and step S104, processing the image elements to obtain the image elements which meet the personalized operation or meet the requirements of the user.
The processing of the image elements in the embodiment of the application includes: beautify image elements, edit image elements, add filters, adjust color or brightness, add text, add animation effects, and so on. Therefore, the image element can be processed again, and personalized operation can be better realized.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablets, mobile terminals, etc.
EXAMPLE six
Referring to fig. 6, a block diagram of an apparatus for image-based personalization according to a sixth embodiment of the present application is shown.
The device for personalized operation based on images of the embodiment comprises:
the image segmentation module 601 is configured to perform element segmentation on the obtained image according to a segmentation rule to obtain element feature information in the image.
An element obtaining module 602, configured to process the element feature information, so as to obtain an image element corresponding to the element feature information.
The operation performing module 603 is configured to obtain an image element corresponding to the instruction according to the received user instruction, and perform personalized operation according to the image element.
Specifically, the segmentation rule in the embodiment of the present application may be preset, or the preset segmentation rule may be adjusted. The server can issue the segmentation rule to the client and update the segmentation rule periodically. The client may also request the server to send the splitting rule or periodically update the splitting rule. The user adjusts the segmentation rule according to the input instruction so that the elements segmented according to the segmentation rule can meet the user requirements, and the system can also adjust the segmentation rule according to the collected user behavior information or the file information recording the user behavior data so that the elements segmented according to the segmentation rule can meet the user historical behaviors.
The segmentation rule comprises the following steps: character segmentation, color segmentation, block segmentation, identification segmentation, character segmentation, symbol segmentation, pattern segmentation, scene segmentation and article segmentation.
For example, the character segmentation rule is adopted to separate the characters in the image, so as to obtain the character element characteristic information in the image.
For another example, a color segmentation rule is adopted to separate color regions in the image, so as to obtain the element characteristic information of the color regions in the image.
For another example, the block segmentation rule is adopted to separate the blocks input by the user instruction, so as to obtain the block feature information in the image.
For another example, the recognition object input by the user instruction is separated by using a recognition segmentation rule, so as to obtain the object element characteristic information in the image.
For another example, the characters, symbols or patterns input by the user instruction are separated by adopting a character, symbol or pattern segmentation rule, so that character, symbol or pattern feature information in the image is obtained.
For another example, a scene segmentation rule is adopted to separate the coffee shop scene in the image, so as to obtain the coffee shop element feature information in the image.
For another example, the article corresponding to the user instruction is separated by using an article segmentation rule, so that article element characteristic information in the image is obtained.
The processing of the element feature information in the embodiment of the application includes assembling the element features and generating image elements conforming to personalized operation.
In a specific implementation of the present application, the user can click among the generated image elements according to a user instruction, and select a certain image element.
In another specific implementation of the present application, the generated plurality of image elements are filtered according to a user instruction, and the determined image elements are filtered.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of this embodiment may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablet computers, mobile terminals, etc.
EXAMPLE seven
The embodiment includes the image segmentation module 601, the element obtaining module 602, and the operation performing module 603. Referring to fig. 7, the image segmentation module 601 of the apparatus includes:
the condition obtaining unit 6011 is configured to perform matching processing on a preset segmentation rule and an obtained image, and obtain a segmentation condition for segmenting the image.
A feature obtaining unit 6012 configured to perform element segmentation on the image according to the segmentation condition to obtain element feature information in the image.
Because the segmentation rule and the image may be unmatched, the segmentation rule and the image need to be matched to obtain the segmentation condition meeting the image content.
The segmentation condition is at least one of an image processing condition and an element utilization condition required by meeting the segmentation.
The image processing conditions are conditions meeting the requirements of image segmentation, and include conditions required by image segmentation such as whether the contour is closed and whether the color is saturated.
The element utilization conditions are conditions required by the utilization of the cut image elements, and include conditions required by the utilization of the image elements such as whether characters and characters can be edited and whether images are clear.
For example, the segmentation rule is human segmentation and recognition segmentation, the image is a group photo, and the recognition human A in the photo only exposes the face, so that the segmentation condition is determined as that the face of the human A is segmented.
For another example, if the segmentation rule is character segmentation and symbol segmentation, and the image is a test paper, the segmentation condition is determined to be character recognition and converted into editable characters.
In the specific implementation of the present application, the segmentation condition may also be adjusted according to a user instruction, so that the segmentation condition better meets the user requirement.
According to the embodiment of the application, element segmentation is carried out on the image through segmentation conditions, so that image element characteristic information meeting the image segmentation requirement and the element utilization requirement in the image is obtained.
Specifically, the element feature information includes: at least one of description information, composition information, combination information, and feature information.
For example, the image element is the face of the person a, and includes the size, color, resolution, brightness, facial features, whether a blocking object exists, and the like of the face.
For example, the image element is a cafe, and includes a specific location, a business name, a scene item combination, a size, a color, a resolution, a brightness, and the like.
Therefore, the image can be segmented through the segmentation conditions to obtain the element characteristic information in the image, so that the image can be segmented from the perspective of elements to obtain the image elements meeting the follow-up personalized operation.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and device can segment the image elements in the image and conduct personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablets, mobile terminals, etc.
Example eight
The embodiment includes the image segmentation module 601, the element obtaining module 602, and the operation proceeding module 603. Referring to fig. 8, the element obtaining module 602 of the apparatus includes:
a combination element unit 6021 configured to perform various combinations of the element feature information to obtain image elements in each combination.
And the element screening unit 6022 is configured to screen the image elements to obtain image elements meeting the requirement of personalized operation.
Specifically, the element feature information includes at least one of description information, composition information, combination information, and feature information of the image element.
The embodiment of the application utilizes the element characteristic information to carry out various combinations, and can obtain various image elements under the combination.
For example, a cafe and a face image element in gray scale are obtained, for example, a face with facial features and occlusion is obtained, and for example, a name of a business in the cafe and a clear face are obtained.
The image elements meeting the requirements of personalized operation are obtained by screening the multiple image elements obtained by combination. Therefore, the screened image elements are determined according to whether the individualized operation requirements are met.
For example, if the whereabouts of a certain person need to be searched, the cafe surveillance videos can be searched according to the filtered merchant names of the cafes and the clear image elements of the faces.
For example, if a person's coffee flower needs to be customized, the image element with facial features can be input into the coffee machine for operation.
Therefore, the image elements under various combinations are obtained according to the element feature combinations, and then various image elements are screened according to the personalized operation requirements, so that the image elements meeting the personalized operation requirements are obtained, the operation is simple and convenient, the combination mode is flexible, and the requirements of the personalized operation of the user can be met.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablets, mobile terminals, etc.
Example nine
The embodiment includes the image segmentation module 601, the element obtaining module 602, and the operation proceeding module 603. Referring to fig. 9, the operation performing module 603 of the apparatus includes:
an instruction receiving unit 6031, configured to select or filter the image element according to a user instruction, and obtain an image element corresponding to the user instruction.
An operation implementation unit 6032 configured to activate a personalization operation that can be performed on the image element, the personalization operation being performed according to the image element.
Specifically, the user may select the corresponding image element by clicking the image element through a user instruction, or may input a filtering condition to filter the corresponding image element from the image elements.
According to the embodiment of the application, the corresponding personalized operation is realized by utilizing the image element through activating the corresponding personalized operation.
The personalized operation comprises searching, personalized customization and other operations.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablets, mobile terminals, etc.
Example ten
The embodiment includes the image segmentation module 601, the element obtaining module 602, and the operation performing module 603. Referring to fig. 10, the apparatus further comprises:
the element processing module 604 is configured to process the image elements to obtain image elements meeting personalized operations or meeting user requirements.
The processing of the image elements in the embodiment of the application includes: beautify image elements, edit image elements, add filters, adjust color or brightness, add text, add animation effects, and so on. Therefore, the image element can be processed again, and personalized operation can be better realized.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
The method of image-based personalization of the present embodiments may be performed by any suitable device having the capability of image-based personalization, including but not limited to: various device terminals or servers including, but not limited to, PCs, tablets, mobile terminals, etc.
EXAMPLE eleven
Referring to fig. 11, a block diagram of a device/terminal/server according to an eleventh embodiment of the present application is shown, and the specific embodiment of the present application does not limit a specific implementation of the device/terminal/server.
As shown in fig. 11, the device/terminal/server may include: one or more processors (processors) 1102, and a storage device (memory) 1104.
Wherein:
the processor 1102 is configured to execute the program 1106, which may specifically execute relevant steps in the above method embodiment of the image-based personalization operation.
In particular, the program 1106 may include program code including computer operating instructions.
The processor 1102 may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement an embodiment of the present Application. The one or more processors comprised by the device/terminal/server may be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.
Storage 1104 for storing one or more programs 1106. The storage 1104 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.
The program 1106 may specifically be configured to cause the processor 1102 to perform the following operations: performing element segmentation on the obtained image according to a segmentation rule to obtain element characteristic information in the image; processing the element characteristic information to obtain an image element corresponding to the element characteristic information; and obtaining an image element corresponding to the instruction according to the received user instruction, and performing personalized operation according to the image element.
In an optional implementation, the program 1106 is further configured to perform matching processing on the segmentation rule and the obtained image, so as to obtain a segmentation condition for segmenting the image; and carrying out element segmentation on the image according to the segmentation condition to obtain element characteristic information in the image.
In an alternative embodiment, the program 1106 is further configured to perform various combinations on the element feature information, so as to obtain image elements in various combinations; and screening the image elements to obtain the image elements meeting the personalized operation requirements.
In an optional implementation manner, the program 1106 is further configured to select or filter the image elements according to a user instruction, and obtain an image element corresponding to the user instruction; and activating the personalized operation which can be carried out on the image element, and carrying out the personalized operation according to the image element.
In an alternative embodiment, the program 1106 is further configured to process the image element to obtain an image element that meets the personalized operation or meets the user requirement.
Therefore, the image element segmentation method and the device have the advantages that the obtained image is subjected to element segmentation according to the segmentation rule, the segmented element characteristic information is processed, and the image element corresponding to the instruction is obtained according to the received user instruction to perform personalized operation. The image element segmentation method and the image segmentation device can segment the image elements in the image and perform personalized operation on the image elements. The method and the device for processing the image elements facilitate the user to flexibly perform personalized operation on the image elements in the shot or downloaded image, so that the objects of the personalized operation are richer, and the user operation personalization can be better realized.
According to the method and the device for searching the news contents, the news contents browsed by the user through other application programs are obtained, searching is conducted in a news library according to the news contents, and if the same news contents do not exist in the news library, the news contents are added to the news library. The method and the device for browsing the news content can lead the news content browsed by the user through other application programs into the installed news APP or the browser, and therefore the news content can be obtained only by inquiring browsing traces of the installed APP or the browser when the user wants to browse the news content again.
It should be noted that, according to the implementation requirement, each component/step described in the embodiment of the present application may be divided into more components/steps, and two or more components/steps or partial operations of the components/steps may also be combined into a new component/step to achieve the purpose of the embodiment of the present application.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section, and/or installed from a removable medium. The computer program, when executed by a Central Processing Unit (CPU), performs the above-described functions defined in the method of the present application. It should be noted that the computer readable medium described herein can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present application may be implemented by software or hardware. The described units may also be provided in a processor, which may be described as: a processor includes a receiving unit, an analyzing unit, an information selecting unit, and a generating unit. Where the names of these elements do not in some cases constitute a limitation on the elements themselves, for example, a receiving element may also be described as an "element that receives a user's web browsing request".
As another aspect, the present application also provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the method as described in any of the embodiments above.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the apparatus described in the above embodiments; or may be separate and not assembled into the device. The computer readable medium carrying one or more programs which, when executed by the apparatus, cause the apparatus to: performing element segmentation on the obtained image according to a segmentation rule to obtain element characteristic information in the image; processing the element characteristic information to obtain an image element corresponding to the element characteristic information; and obtaining an image element corresponding to the instruction according to the received user instruction, and performing personalized operation according to the image element.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (10)
1. A method for image-based personalization, the method comprising:
performing element segmentation on the obtained image according to a segmentation rule to obtain element characteristic information in the image, wherein the element characteristic information comprises the following steps: matching a preset segmentation rule and the obtained image to obtain a segmentation condition for segmenting the image, and performing element segmentation on the image according to the segmentation condition to obtain element characteristic information in the image;
processing the element characteristic information to obtain an image element corresponding to the element characteristic information;
and obtaining an image element corresponding to the instruction according to the received user instruction, and performing personalized operation according to the image element.
2. The method according to claim 1, wherein the processing the element feature information to obtain an image element corresponding to the element feature information comprises:
carrying out various combinations on the element characteristic information to obtain image elements under the combinations;
and screening the image elements to obtain the image elements meeting the personalized operation requirements.
3. The method according to claim 1, wherein the obtaining, according to the received user instruction, an image element corresponding to the instruction, and performing a personalization operation according to the image element comprises:
selecting or screening the image elements according to a user instruction to obtain the image elements corresponding to the user instruction;
and activating the personalized operation which can be carried out on the image element, and carrying out the personalized operation according to the image element.
4. The method according to claim 1, wherein before obtaining the image element corresponding to the instruction according to the received user instruction and performing the personalization operation according to the image element, the method further comprises:
and processing the image elements to obtain the image elements which meet the personalized operation or meet the requirements of the user.
5. An apparatus for image-based personalization, the apparatus comprising:
the image segmentation module is configured to perform element segmentation on the obtained image according to a segmentation rule to obtain element feature information in the image, and includes: the image segmentation device comprises a condition obtaining unit, a segmentation processing unit and a segmentation processing unit, wherein the condition obtaining unit is used for matching a preset segmentation rule and an obtained image to obtain a segmentation condition for segmenting the image; the characteristic obtaining unit is configured to perform element segmentation on the image according to the segmentation condition to obtain element characteristic information in the image;
the element obtaining module is configured to process the element characteristic information to obtain an image element corresponding to the element characteristic information;
and the operation performing module is configured to obtain the image elements corresponding to the instruction according to the received user instruction and perform personalized operation according to the image elements.
6. The apparatus of claim 5, wherein the element obtaining module comprises:
the combination element unit is configured and used for carrying out various combinations on the element characteristic information to obtain image elements under the combinations;
and the element screening unit is configured to screen the image elements to obtain the image elements meeting the personalized operation requirements.
7. The apparatus of claim 5, wherein the operation performing module comprises:
the instruction receiving unit is configured to select or screen the image elements according to a user instruction to obtain the image elements corresponding to the user instruction;
and the operation implementation unit is configured to activate the personalized operation which can be performed by the image element, and perform the personalized operation according to the image element.
8. The apparatus of claim 5, further comprising:
and the element processing module is configured to process the image elements to obtain the image elements which meet personalized operation or meet user requirements.
9. A device/terminal/server comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-4.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-4.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810915916.8A CN109147009B (en) | 2018-08-13 | 2018-08-13 | Method and device for personalized operation based on image, and equipment/terminal/server |
| PCT/IB2018/056491 WO2020035724A1 (en) | 2018-08-13 | 2018-08-27 | Method, apparatus and device/terminal/server for image-based personalized operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810915916.8A CN109147009B (en) | 2018-08-13 | 2018-08-13 | Method and device for personalized operation based on image, and equipment/terminal/server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109147009A CN109147009A (en) | 2019-01-04 |
| CN109147009B true CN109147009B (en) | 2023-04-07 |
Family
ID=64792675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810915916.8A Active CN109147009B (en) | 2018-08-13 | 2018-08-13 | Method and device for personalized operation based on image, and equipment/terminal/server |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109147009B (en) |
| WO (1) | WO2020035724A1 (en) |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8326809B2 (en) * | 2008-10-27 | 2012-12-04 | Sas Institute Inc. | Systems and methods for defining and processing text segmentation rules |
| JP5549504B2 (en) * | 2010-09-27 | 2014-07-16 | ブラザー工業株式会社 | Image processing program and image processing apparatus |
| US8553981B2 (en) * | 2011-05-17 | 2013-10-08 | Microsoft Corporation | Gesture-based visual search |
| WO2014117384A1 (en) * | 2013-02-01 | 2014-08-07 | Intel Corporation | Techniques for image-based search using touch controls |
| US9182952B2 (en) * | 2013-06-04 | 2015-11-10 | Qualcomm Incorporated | Automated graph-based programming |
| US10515110B2 (en) * | 2013-11-12 | 2019-12-24 | Pinterest, Inc. | Image based search |
| US10664515B2 (en) * | 2015-05-29 | 2020-05-26 | Microsoft Technology Licensing, Llc | Task-focused search by image |
| CN107527055B (en) * | 2017-08-04 | 2018-12-11 | 佛山市国方商标服务有限公司 | Image divides card processing method, device and image search method, device and system |
| CN108388389B (en) * | 2018-01-31 | 2021-09-07 | 努比亚技术有限公司 | Interactive interface control method, mobile terminal and computer storage medium |
-
2018
- 2018-08-13 CN CN201810915916.8A patent/CN109147009B/en active Active
- 2018-08-27 WO PCT/IB2018/056491 patent/WO2020035724A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN109147009A (en) | 2019-01-04 |
| WO2020035724A1 (en) | 2020-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210216830A1 (en) | Content tagging | |
| CN104239408B (en) | The data access of content based on the image recorded by mobile device | |
| CN106326391B (en) | Multimedia resource recommendation method and device | |
| CN111460285B (en) | Information processing method, apparatus, electronic device and storage medium | |
| CN108228792B (en) | Picture retrieval method, electronic device and storage medium | |
| US9411839B2 (en) | Index configuration for searchable data in network | |
| WO2017080007A1 (en) | Intelligent analysis and processing system of identification code and processing method therefor | |
| WO2015191132A1 (en) | Automatically organizing images | |
| CN107368550B (en) | Information acquisition method, device, medium, electronic device, server and system | |
| CN101103332A (en) | Method and system for interworking plurality of applications | |
| CN106020504B (en) | Information output method and device | |
| CN108449642A (en) | A kind of screening display methods, device and the terminal device of video comments | |
| CN108475283A (en) | Text Text summarization for searching for multiple video flowings | |
| JP6396897B2 (en) | Search for events by attendees | |
| CN116097322A (en) | Computer automatic interactive activity recognition based on key point detection | |
| CN109862100A (en) | Method and apparatus for pushed information | |
| CN113589991A (en) | Text input method and device, electronic equipment and storage medium | |
| CN105808642B (en) | Recommendation method and device | |
| CN108932640B (en) | Method and device for processing orders | |
| US10706312B2 (en) | Automated filtering of item comments | |
| CN109147009B (en) | Method and device for personalized operation based on image, and equipment/terminal/server | |
| US20230229302A1 (en) | Methods and Systems for Positioning Animated Images Within a Dynamic Keyboard Interface | |
| CN108268488A (en) | The recognition methods of webpage master map and device | |
| CN111310086A (en) | Page jump method and device and electronic equipment | |
| CN115269494A (en) | Data archiving method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |