CN111798525A

CN111798525A - Image data processing method, device, equipment and storage medium, and color chart recommendation method, device and equipment

Info

Publication number: CN111798525A
Application number: CN201910276906.9A
Authority: CN
Inventors: 刘金林; 任健强
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2019-04-08
Filing date: 2019-04-08
Publication date: 2020-10-20

Abstract

The embodiment of the application provides an image data processing method, a color card recommending device, equipment and a storage medium. In the image data processing method provided by the embodiment of the application, at least one original theme color is obtained from an image to be processed, and color difference information on the image to be processed is determined based on the at least one original theme color; and then, updating the color of the image to be processed based on the color difference information and at least one target theme color. In the color updating mode, the color difference information of the image to be processed is fully considered, and the color conversion of the image to be processed is facilitated while the pattern structure, the texture structure and/or the pattern structure and the like on the image to be processed are reserved.

Description

Image data processing method, device, equipment and storage medium, and color chart recommendation method, device and equipment

Technical Field

The present application relates to the field of image processing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for image data processing and color chart recommendation.

Background

With the development of computer technology, people can automatically design various pictures, such as posters, commodity display drawings, magazine covers and the like, by using computer equipment.

However, in the prior art, the computer device usually relies on the color specified by the user to design the color of the picture, and the color of the picture cannot be quickly changed while the original pattern and texture of the image are kept. Therefore, a new solution is yet to be proposed.

Disclosure of Invention

Aspects of the present disclosure provide an image data processing method, an image data processing apparatus, a color chart recommendation method, a color chart recommendation apparatus, and a storage medium, which are used to quickly change colors of an image while retaining texture of the image.

An embodiment of the present application provides an image data processing method, including: extracting at least one original theme color on an image to be processed; determining color difference information on the image to be processed according to the at least one original theme color; and updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

The embodiment of the application further provides a color chip recommendation method, which includes: acquiring HSV color vectors corresponding to theme colors on a primary color card; adjusting the color component H in the HSV color vector according to the set adjustment amount of the color component H; generating a new theme color according to the HSV color vector adjusted by the color component H; outputting a new color card containing the new theme color.

An embodiment of the present application further provides an image data processing apparatus, including: the theme color extraction module is used for extracting at least one original theme color on the image to be processed; the color difference determining module is used for determining color difference information on the image to be processed according to the at least one original theme color; and the color transformation module is used for updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

An embodiment of the present application further provides an image data processing apparatus, including: a memory and a processor; wherein the memory is configured to store one or more computer instructions; the processor to execute the one or more computer instructions to: extracting at least one original theme color on an image to be processed; determining color difference information on the image to be processed according to the at least one original theme color; and updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

Embodiments of the present application also provide a computer-readable storage medium storing a computer program, which when executed can implement the image data processing method performed by the image data processing apparatus provided in the embodiments of the present application.

The embodiment of the present application further provides a color chip recommending device, including: the input module is used for acquiring HSV color vectors corresponding to theme colors on the primary color card; the color transformation module is used for adjusting the color component H in the HSV color vector according to the set adjustment quantity of the color component H; generating a new theme color according to the HSV color vector adjusted by the color component H; and the output module is used for outputting the new color card containing the new theme color.

The embodiment of the present application further provides a color chip recommendation device, including: a memory and a processor; wherein the memory is configured to store one or more computer instructions; the processor to execute the one or more computer instructions to: acquiring HSV color vectors corresponding to theme colors on a primary color card; adjusting the color component H in the HSV color vector according to the set adjustment amount of the color component H; generating a new theme color according to the HSV color vector adjusted by the color component H; outputting a new color card containing the new theme color.

The embodiment of the present application further provides a computer-readable storage medium storing a computer program, and the computer program can implement the color chart recommendation method executed by the color chart recommendation device provided by the embodiment of the present application when being executed.

An embodiment of the present application further provides an image data processing method, including: acquiring an image to be processed; determining color difference information of the image to be processed according to the first theme color on the image to be processed; the first theme color comprises a color with a frequency meeting a preset condition on the image to be processed; acquiring a second theme color; and updating the color of the image to be processed according to the color difference information and the second theme color.

In the image data processing method provided by the embodiment of the application, at least one original theme color is obtained from an image to be processed, and color difference information on the image to be processed is determined based on the at least one original theme color; and then, updating the color of the image to be processed based on the color difference information and at least one target theme color. In the color updating mode, the color difference information of the image to be processed is fully considered, and the color conversion of the image to be processed is facilitated while the pattern structure, the texture structure and/or the pattern structure and the like on the image to be processed are reserved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:

fig. 1 is a schematic flowchart of an image data processing method according to an exemplary embodiment of the present application;

FIG. 2a is a schematic flowchart of an image data processing method according to another exemplary embodiment of the present application;

FIG. 2b is a schematic representation of the original theme color extracted from the image to be processed;

FIG. 2c is a schematic diagram of transforming an original theme color to obtain a plurality of target theme colors;

FIG. 2d is a schematic diagram of color migration performed on a pixel point on an image to be processed according to a target theme color to obtain a new image;

FIG. 3 is a schematic flow chart diagram illustrating an image data processing method according to another exemplary embodiment of the present application;

fig. 4 is a schematic flowchart of a color chart recommendation method according to an exemplary embodiment of the present application;

FIG. 5 is a schematic diagram of an image data processing apparatus according to an exemplary embodiment of the present application;

fig. 6 is a schematic structural diagram of an image data processing apparatus according to another exemplary embodiment of the present application;

FIG. 7 is a schematic diagram of an image data processing apparatus according to an exemplary embodiment of the present application;

fig. 8 is a schematic structural diagram of an image data processing apparatus according to another exemplary embodiment of the present application;

fig. 9 is a schematic structural diagram of a color chart recommendation device according to an exemplary embodiment of the present application;

fig. 10 illustrates a schematic structural diagram of a color chart recommendation device according to an exemplary embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In some embodiments of the present application, a solution is provided, and the following describes in detail technical solutions provided by embodiments of the present application with reference to the accompanying drawings.

Fig. 1 is a schematic flowchart of an image data processing method according to an exemplary embodiment of the present application, as shown in fig. 1, the method includes:

step 101, extracting at least one original theme color on an image to be processed.

And 102, determining color difference information on the image to be processed according to the at least one original theme color.

And 103, updating the color of the image to be processed according to the color difference information and the specified at least one target theme color.

In this embodiment, the image to be processed may be an image input by a user, or an image transmitted by another device or application. The image to be processed exhibits a certain graphical structure which may be represented by a pattern, texture and/or pattern on the image to be processed. In general, an image structure appears on an image to be processed as a difference in color between different image areas, which may be referred to as a color difference. The human eye can acquire information such as a pattern structure on the image to be processed through chromatic aberration.

The theme color, also called dominant color, refers to a color that appears on an image with a frequency greater than or equal to a set frequency threshold. For example, the theme color is used to represent a color on an image.

The frequency of the color appearing on the image can be counted by adopting the number of pixel points corresponding to the color. For example, if the number of pixels corresponding to a color represented by the color vector (255,110,180) on an image is 150, the frequency of the color appearing on the image can be considered to be 150.

The frequency threshold value can be determined according to actual requirements. For example, after counting the frequency distribution of each color on the image, if the user wants to select a larger number of theme colors from the image, a lower frequency threshold may be set according to the frequency distribution interval of the colors; otherwise, a higher frequency threshold may be set according to the frequency distribution interval of the color. For another example, after counting the frequency distribution of each color on the image, the user may select a set number of colors from high to low according to the frequency as the theme colors.

The original theme color refers to a theme color on the image to be processed. The original theme colors are superposed according to different proportions, and various colors on the image to be processed can be obtained. For the sake of understanding, the process of extracting the original theme color from the image to be processed can be visually described as extracting a color palette approximately from the image to be processed, and obtaining the colors on the image to be processed by superimposing the colors in the color palette on each other.

Wherein, the obtained colors are different if the superposition proportion of the original theme colors is different. Based on this, in this embodiment, the color difference of different image areas on the image to be processed can be determined according to the superposition proportion of the at least one original subject color at different image areas of the image to be processed, and thus the color difference information of the image to be processed can be determined.

After determining the color difference information of the image to be processed, the color of the image to be processed may be updated according to the color difference information and the specified at least one target theme color. The color difference information hides the pattern, texture and/or pattern structure of the image to be processed. The color difference information is used as a basis for color transformation of the image to be processed, the graphic structure of the image to be processed can be fully considered in the color transformation process, and the defect of image distortion caused by the change of the graphic structure of the image to be processed in the color transformation process is avoided. Wherein, the target theme color is different from or not identical to the original theme color. And superposing the target theme colors according to the proportion to obtain a new color. Based on the color difference information on the image to be processed and the specified at least one target theme color, the color of the image to be processed can be transformed while the graphic structure of the image to be processed is maintained.

In the embodiment, at least one original theme color is obtained from an image to be processed, and color difference information on the image to be processed is determined based on the at least one original theme color; and then, updating the color of the image to be processed based on the color difference information and at least one target theme color. In the color updating mode, the color difference information of the image to be processed is fully considered, and the color conversion of the image to be processed is facilitated while the pattern structure, the texture structure and/or the pattern structure and the like on the image to be processed are reserved.

In the above and following embodiments of the present application, the target theme color may be a theme color specified by a user, or may be a new theme color automatically generated from an original theme color, which will be described in detail below.

In some exemplary embodiments, a user may provide a color chip containing one or more colors according to visual needs or design needs. Based on the above, when the color of the image to be processed is transformed, at least one target theme color can be obtained from the color card appointed by the user, and the color of the image to be processed is transformed according to the at least one target theme color and the color difference information on the image to be processed, so as to obtain the image with the color meeting the visual requirement or the design requirement of the user. Alternatively, the number of target theme colors and the number of original theme colors may be the same.

In other exemplary embodiments, at least one original theme color extracted from the image to be processed may be color-transformed to obtain at least one target theme color. Next, a generation process of the target theme color will be described by taking any one of the at least one original theme color as an example.

For any one of the at least one original theme color, the original theme color may be transformed to an HSV (Hue, Saturation, Value) color space to obtain an original theme color of the HSV color pattern. For example, when the original subject color is an RGB (Red, Green, Blue) color pattern, the original subject color may be transformed from an RGB color space into an HSV color space.

Then, the value of the color component H in the original theme color of the HSV color mode can be adjusted according to the adjustment amount of the color component H corresponding to the original theme color. The HSV color model is a hexagonal pyramid model, the color component H is measured by an angle, and the value of the color component H can be adjusted by rotating the color component H clockwise or anticlockwise. The adjustment amount of the color component H corresponding to the original theme color can be represented by an angle value and an adjustment direction of the color component H to be adjusted. For example, the adjustment amount of a typical color component H can be expressed as: clockwise by 5 deg. or counterclockwise by 3 deg., which will not be described in detail.

And then, converting the original theme color of the adjusted HSV color mode from the HSV color space to the RGB color space, thereby finishing the color conversion of the original theme color and obtaining the target theme color. Optionally, in this embodiment, after color transformation, the original theme color and the target theme color have a one-to-one correspondence relationship, and one original theme color can obtain one target theme color after color transformation.

It should be noted that, in some exemplary embodiments, when performing color transformation on at least one original theme color, the adjustment amount of the color component H corresponding to different original theme colors may be the same. Further, a color difference between at least one original theme color and a color difference between at least one target theme color may be maintained to be uniform. Therefore, when the color transformation is carried out on the image to be processed according to the target theme color, the color harmony degree of the image to be processed can be prevented from being damaged. For example, after 5 original theme colors are extracted from the image to be processed, the 5 original theme colors can be respectively transformed into HSV color spaces, so as to obtain the original theme colors of 5 HSV color modes. And then, according to the same adjustment quantity of the color component H, carrying out color transformation on the 5 original theme colors by the value of the color component H in the original theme colors of the 5 HSV color modes. For example, the color component H in the original subject color of the color mode in 5 is rotated by 8.5 ° clockwise or 9 ° counterclockwise, respectively, and will not be described again.

In the above and following embodiments of the present application, optionally, one way of updating the color of the image to be processed according to the color difference information on the image to be processed and the specified at least one target theme color includes: performing color transfer (color transfer) on the image to be processed according to the at least one target theme color; and matching the color difference of the image to be processed after the color transfer with the color difference information extracted from the image to be processed before the color transfer. That is, the image to be processed before color migration and the image to be processed after color migration have the same color difference.

The color migration refers to a process of learning the color of the target theme color of the image to be processed to transform the color matching of the image to be processed on the premise of not changing the graphic information expressed by the image to be processed. In other words, the image to be processed before color migration and the image to be processed after color migration have different color arrangements but the same graphic structure.

An alternative embodiment of color migration for an image to be processed according to the at least one target theme color will be further described with reference to the drawings.

Fig. 2a is a schematic flowchart of an image data processing method according to another exemplary embodiment of the present application, and as shown in fig. 2a, the method includes:

step 201, at least one original theme color on the image to be processed is extracted.

Step 202, calculating the weight of the at least one original theme color in the color of the pixel point aiming at any pixel point on the image to be processed, and obtaining the weight coefficient of the theme color corresponding to the pixel point.

Step 203, performing color transformation on the at least one original theme color to obtain the at least one target theme color.

And 204, carrying out weighted summation on the weight coefficient of the theme color corresponding to each of different pixel points on the image to be processed and the at least one target theme color.

Step 205, determining new color vectors corresponding to different pixel points on the image to be processed according to the result of the weighted summation.

In step 201, optionally, in some exemplary embodiments, a k-means clustering algorithm may be employed to identify and extract the original theme colors on the image to be processed. In the method, the pixel points on the image to be processed can be divided into k (k is a positive integer) categories, so that the color difference between the color of the pixel point in each category and the color of the central pixel point of the category is minimum, and the color corresponding to the central pixel point of the category is used as the theme color corresponding to the category.

Optionally, in other exemplary embodiments, a color histogram corresponding to the image to be processed may be obtained; wherein the color histogram shows the frequency of occurrence of each color on the image to be processed. Then, the colors in the color histogram may be divided into several color regions according to the size of the color value represented by the horizontal axis in the color histogram, a frequency peak in each color region is selected, and the selected frequency peak is used as a representative color in the color region. And further, according to the representative colors in the color areas, the theme color corresponding to the image to be processed can be obtained.

Of course, besides the k-means clustering algorithm and the algorithm for extracting the local peak of the color histogram, the Median cut method (media cut) or the octree algorithm may be adopted to extract the original subject color from the image to be processed, which is not described herein again.

Fig. 2b shows an example of the image to be processed and the original theme colors extracted from the image to be processed, and as shown in fig. 2b, 11 original theme colors can be extracted from a commercial poster.

In step 202, optionally, one way of calculating, for any pixel point on the image to be processed, the weight of the at least one original subject color in the color of the pixel point may include: and respectively calculating the distance between the color vector of the pixel point and the color vector of each of the at least one original subject color, and taking the normalized value of the distance as the weight of each of the at least one original subject color in the color of the pixel point. The following description will be made with reference to specific examples.

For example, the at least one original theme color extracted from the image to be processed includes a first original theme color, a second original theme color, and a third original theme color. For any pixel point on the image to be processed, the distance between the color vector of the pixel point and the color vector of the first original theme color can be respectively calculated to obtain a first distance S1; calculating the distance between the color vector of the pixel point and the color vector of the second original theme color to obtain a second distance S2; and calculating the distance between the color vector of the pixel point and the color vector of the third original theme color to obtain a third distance S3. Subsequently, normalization processing is performed on S1, S2, and S3, and a1 ═ S1/(S1+ S2+ S3), a2 ═ S2/(S1+ S2+ S3), and a3 ═ S3/(S1+ S2+ S3) are obtained. Wherein, a1, a2, a3 are the weights of the first original theme color, the second original theme color and the third original theme color in the color of the pixel respectively, and the weight coefficients of the theme colors corresponding to the pixel can be labeled as a1, a2, a 3.

Optionally, for convenience of description, the color vector of any pixel point on the image to be processed may be labeled as C0; marking the color vectors of at least one original theme color extracted in the last step as C1, C2 and C3 … Cn, respectively, marking the weight coefficients of the theme color corresponding to the pixel point as a1, a2 and a3 … an, wherein n is a positive integer greater than or equal to 1, and obtaining:

c0 ═ a1 ═ C1+ a2 ═ C2+ a3 · C3.. + an × Cn equation 1

In step 203, for convenience of description, at least one target theme color obtained by color-transforming at least one of the original theme colors C1, C1, and C3 … Cn is labeled as: c1 ', C2', C3 '… Cn'.

Fig. 2c shows several groups of target subject colors obtained by color transformation of the original subject colors extracted in fig. 2 b. Wherein, the adjustment quantity of the color component H corresponding to each group of target theme colors is different.

In step 204 and step 205, taking any pixel point on the image to be processed as an example, optionally, after at least one target theme color is determined, a weighted summation may be performed according to the weight coefficient of the theme color corresponding to the pixel point and the at least one target theme color, so as to obtain a new color vector C0' of the pixel point, specifically referring to the following formula:

c0 ' ═ a1 × C1 ' + a2 × C2 ' + a3 × C3 '. + an × Cn ' formula 2

The target subject color Cn ' is obtained by performing color conversion on the original subject color Cn, and a one-to-one correspondence relationship exists between the target subject color Cn ' and the original subject color Cn, so that the target subject color Cn ' and the original subject color Cn have the same weight an. Based on the formula 2, color migration can be performed on each pixel point on the image to be processed, so that overall color transformation of the image to be processed is realized.

In the above embodiment of color migration by weighted summation, when the weight coefficients of the theme colors are labeled as the sequence { a1, a2, a3 … an }, the target theme colors may be labeled as the sequence { C1 ', C2', C3 '… Cn' }.

In some other embodiments, when the weighted sum is performed according to the weight coefficient of the theme color corresponding to the pixel and at least one target theme color, the sequence of the target theme colors may be different from { C1 ', C2 ', C3 ' … Cn ' }, in other words, the weights an of the target theme color Cn ' and the original theme color Cn corresponding thereto may be different. For example, the sequence of target theme colors may be { Cn ', Cn-1 ' … C1 ' }, or may also be { Cn ', C1 ', C3 ' … C2 ' }, which is not listed here.

It should be noted that, for different pixel points on the image to be processed, the corresponding target subject color sequences should be the same, so as to avoid the distortion of the graphic structure of the image to be processed caused by color transformation. For example, when color migration is performed on a first pixel point on the image to be processed, weighted summation is performed on the subject color weight coefficient corresponding to the first pixel point and the sequence of the target subject color { Cn ', Cn-1' … C1 '}, then when color migration is performed on a second pixel point on the image to be processed, weighted summation should be performed on the subject color weight coefficient corresponding to the second pixel point and the sequence of the target subject color { Cn', Cn-1 '… C1' }, and so on other pixel points on the image to be processed, which is not described herein again.

Fig. 2d illustrates a new image obtained by color migration of pixel points on the image to be processed according to the target theme color, where, as shown in fig. 2d, the color distribution of the new image corresponding to each group of target theme colors is different, but the patterns and the graphic structures are consistent.

In this embodiment, at least one original theme color is obtained from an image to be processed, and the weight of the at least one original theme color in the color of the image to be processed is determined; and then, carrying out color transformation on the at least one original theme color to obtain at least one target theme color, and carrying out color migration on the image to be processed based on the weight and the at least one target theme color. In the color updating mode, the weight of the target subject color and the original subject color in the color of the image to be processed is kept unchanged, and further, before and after the color conversion of the image to be processed, the color difference between different pixel points is kept consistent, so that the color conversion of the image to be processed is facilitated, and simultaneously, the graphic structures such as patterns, textures and/or patterns on the image to be processed are kept.

The image data processing method described in each of the above embodiments is applicable to various application scenarios.

In a typical application scenario, a user may enter a merchandise promotional poster as a pending image. When the color conversion is performed on the commodity sales promotion poster, the original theme color can be extracted from the commodity sales promotion poster, and the color difference information on the commodity sales promotion poster can be calculated according to the original theme color. And then, carrying out color conversion on the original theme color to obtain a target theme color, and replacing the color on the commodity promotion poster according to the color difference information and the target theme color on the commodity promotion poster to obtain the commodity promotion poster with different color styles. According to the method, the original theme colors can be subjected to color transformation for multiple times to obtain multiple groups of target theme colors, and multiple commodity sales promotion posters with different color styles are respectively generated according to the color difference information on the commodity sales promotion posters and each group of target theme colors for the user to select. Of course, besides the merchandise promotion poster, the color transformation can be performed for other types of images, and the description is omitted.

In another typical application scenario, the color transformation method provided by the embodiment of the present application may be used to perform color transformation on a video. In this application scenario, a user may enter a video to be processed. When performing color conversion on a video, the video may be subjected to frame division in advance to obtain each frame image included in the video, and then the image data processing method provided in the foregoing embodiment is performed on each frame image, so as to finally implement color conversion on the video, which is not described again.

Fig. 3 is a schematic flowchart of an image data processing method according to another exemplary embodiment of the present application, and as shown in fig. 3, the method includes:

301, acquiring an image to be processed, wherein the image to be processed comprises a first theme color; the first theme color comprises a color with the frequency meeting a preset condition on the image to be processed.

Step 302, determining color difference information of the image to be processed according to the first theme color.

And step 303, acquiring a second theme color.

And step 304, updating the color of the image to be processed according to the color difference information and the second theme color.

In some exemplary embodiments, the image to be processed may be an image input by a user. For example, when a user performs color conversion on a commercial poster by using the image data processing method provided by the present embodiment, the commercial poster may be input as an image to be processed.

In other exemplary embodiments, the image to be processed may be an image transmitted by other devices or applications. For example, application a, after completing poster design, may send the poster to application B; next, the application B may perform color transformation on the poster according to the method provided in the present embodiment.

The image to be processed comprises colors with the occurrence frequency meeting the preset condition. Based on the description of the foregoing embodiments, a color that appears frequently on an image to be processed and satisfies a preset condition may be referred to as a theme color on the image to be processed. The present embodiment is described as a first theme color for convenience of description. It should be understood that the "first" is used to limit the theme colors included in the image to be processed, and is only used to distinguish the theme colors from the second theme colors on the image to be processed, and the "first" and the "second" herein do not mean any order of the theme colors.

As described in the foregoing embodiment, one alternative way in which the frequency of color appearance satisfies the preset condition may be: the frequency of the color appearing on the image to be processed is larger than or equal to the set frequency threshold. The frequency of the color appearing on the image can be counted by adopting the number of pixel points corresponding to the color; the frequency threshold may be determined according to actual requirements, and is not described herein again.

The color difference information is used for describing color differences among different image areas on the image to be processed, and the color differences among the different image areas represent pattern, texture and/or pattern structure information of the image to be processed. In this embodiment, after the to-be-processed image is acquired, the color difference of different image areas on the to-be-processed image can be determined according to the distribution condition of the first theme color on the to-be-processed image, and the color difference information of the to-be-processed image is determined according to the color difference.

In some optional embodiments, the weight of the first theme color in the color of each pixel point on the image to be processed may be calculated, a theme color weight coefficient corresponding to each pixel point on the image to be processed is obtained, and the theme color weight coefficient is used as the color difference information of the image to be processed.

The second theme color may be a theme color specified by the user, or may be a new theme color obtained by performing color transformation according to the first theme color, which is not limited in this embodiment. For example, in some exemplary embodiments, the user may provide a designated color chip including one or more colors as the second theme color according to visual needs or design needs. In other exemplary embodiments, the first theme color may be color-converted to obtain the second theme color based on the color conversion method described in the foregoing embodiments, which is not limited in this embodiment.

It should be understood that in some embodiments, the first theme color includes a plurality of colors. In this case, the second theme color should include the same number of colors as the first theme color. Based on the color gradation, the same or similar color gradation can be obtained before and after the color conversion of the image to be processed.

After the color difference information of the second theme color and the image to be processed is obtained, next, the color of the image to be processed can be updated according to the color difference information and the second theme color. In some exemplary embodiments, one way of updating the color of the image to be processed according to the color difference information and the second theme color may include: according to the second theme color, carrying out color migration on the image to be processed; and matching the color difference of the image to be processed after the color transfer with the color difference information.

In the foregoing steps, a theme color weight coefficient corresponding to each pixel point on the image to be processed may be obtained, and the theme color weight coefficient is used as color difference information of the image to be processed. Based on this, when performing color migration on the image to be processed according to the second theme color, an optional implementation may include: and carrying out weighted summation on the theme color weight coefficients corresponding to different pixel points on the image to be processed and the second theme color, and taking the weighted summation result as new color vectors corresponding to different pixel points on the image to be processed. Based on the method, the color updating of the pixel points on the image to be processed is realized.

In the embodiment, after the image to be processed is obtained, color difference information on the image to be processed is determined according to a first theme color on the image to be processed; and then, updating the color of the image to be processed based on the color difference information and the acquired second theme color. In the color updating mode, the color difference information of the image to be processed is fully considered, and the color conversion of the image to be processed is facilitated while the pattern structure, the texture structure and/or the pattern structure and the like on the image to be processed are reserved.

In addition to the image data processing method provided in the foregoing embodiment, the present application also provides a color chart recommendation method, as shown in fig. 4, the color chart recommendation method includes:

step 401, obtaining HSV color vectors corresponding to the theme colors on the primary color card.

Step 402, adjusting the color component H in the HSV color vector according to the set adjustment amount of the color component H.

And step 403, generating a new theme color according to the HSV color vector after the color component H is adjusted.

Step 404, outputting a new color card containing the new theme color.

In this embodiment, the theme color on the primary color card may be provided by the user or extracted from the original picture, which is not limited in this embodiment.

When the primary color card comprises a plurality of theme colors, the HSV color vector corresponding to each theme color can be respectively obtained, and the color component H in the HSV color vector corresponding to each theme color is respectively adjusted according to the set adjustment amount of the color component H. And then, respectively generating new theme colors according to each HSV color vector after the color component H is adjusted. Based on the new theme color, the new color card can be output, so that the intelligent color card recommendation service for automatically recommending the new color card to the user according to the primary color card is realized.

Alternatively, the adjustment amount of the color component H may be the same for HSV color vectors corresponding to different theme colors. For example, for an HSV color vector corresponding to each theme color, the color component H in the HSV color vector corresponding to each theme color may be rotated clockwise by an angle α, or rotated counterclockwise by an angle β, respectively, which is not described herein again. Based on this embodiment, the color difference between the theme colors on the primary color card and the color difference between the theme colors on the new color card can be kept consistent, which is beneficial for recommending the new color card similar to the color harmony of the primary color card to the user.

It should be noted that the execution subjects of the steps of the methods provided in the above embodiments may be the same device, or different devices may be used as the execution subjects of the methods. For example, the execution subjects of step 201 to step 204 may be device a; for another example, the execution subject of

steps

201 and 202 may be device a, and the execution subject of step 203 may be device B; and so on.

In addition, in some of the flows described in the above embodiments and the drawings, a plurality of operations are included in a specific order, but it should be clearly understood that the operations may be executed out of the order presented herein or in parallel, and the sequence numbers of the operations, such as 201, 202, etc., are merely used for distinguishing different operations, and the sequence numbers do not represent any execution order per se. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

Fig. 5 is a schematic structural diagram of an image data processing apparatus according to an exemplary embodiment of the present application, as shown in fig. 5, the apparatus includes: a theme color extraction module 501, a color difference determination module 502 and a color transformation module 503.

The theme color extracting module 501 is configured to extract at least one original theme color on an image to be processed; a color difference determining module 502, configured to determine color difference information on the image to be processed according to the at least one original theme color; and a color transformation module 503, configured to update the color of the image to be processed according to the color difference information and the specified at least one target theme color.

Further optionally, the apparatus further comprises: a target theme color acquisition module 504 configured to: acquiring the at least one target theme color from a color card designated by a user; or, performing color transformation on the at least one original theme color to obtain the at least one target theme color.

Further optionally, when performing color transformation on the at least one original theme color, the target theme color obtaining module 504 is specifically configured to: for any original theme color in the at least one original theme color, transforming the original theme color to an HSV color space to obtain the original theme color of an HSV color mode; adjusting the value of the color component H in the original theme color of the HSV color mode according to the adjustment amount of the color component H corresponding to the original theme color; transforming the original theme color of the adjusted HSV color pattern from an HSV color space to an RGB color space.

Further optionally, in the at least one original theme color, adjustment amounts of the color components H corresponding to different original theme colors are the same.

Further optionally, when determining the color difference information on the image to be processed according to the at least one original theme color, the color difference determining module 502 is specifically configured to: calculating the weight of the at least one original theme color in the color of the pixel point aiming at any pixel point on the image to be processed to obtain a theme color weight coefficient corresponding to the pixel point; and determining color difference information on the image to be processed according to the theme color weight coefficients corresponding to different pixel points on the image to be processed.

Further optionally, for any pixel point on the image to be processed, the color difference determining module 502 is specifically configured to, when calculating the weight of the at least one original theme color in the color of the pixel point to obtain a theme color weight coefficient corresponding to the pixel point: respectively calculating the distance between the color vector of the pixel point and the respective color vector of the at least one original theme color; and taking the normalized value of the distance as the weight of the at least one original subject color in the color of the pixel point.

Further optionally, when the color of the image to be processed is updated according to the color difference information and the specified at least one target theme color, the color transformation module 503 is specifically configured to: carrying out color migration on the image to be processed according to the at least one target theme color; and matching the color difference of the image to be processed after color migration with the color difference information.

Further optionally, the color transformation module 503 performs color migration on the image to be processed according to the at least one target theme color; when the color difference of the image to be processed after the color migration is matched with the color difference information, the method is specifically configured to: weighting and summing the weight coefficient of the theme color corresponding to each of different pixel points on the image to be processed and the appointed at least one target theme color; and determining new color vectors corresponding to different pixel points on the image to be processed according to the weighted summation result.

In this embodiment, the image data processing apparatus may obtain at least one original theme color from the image to be processed, and determine color difference information on the image to be processed based on the at least one original theme color; and then, updating the color of the image to be processed based on the color difference information and at least one target theme color. In the color updating mode, the color difference information of the image to be processed is fully considered, and the color conversion of the image to be processed is facilitated while the pattern structure, the texture structure and/or the pattern structure and the like on the image to be processed are reserved.

Fig. 6 is a schematic structural diagram of an image data processing apparatus according to another exemplary embodiment of the present application, as shown in fig. 6, the apparatus includes: an image acquisition module 601, a color difference determination module 602, a theme color acquisition module 603, and a color transformation module 604.

The image obtaining module 601 is configured to obtain an image to be processed, where the image to be processed includes a first theme color, and the first theme color includes a color appearing on the image to be processed frequently and meeting a preset condition; a color difference determining module 602, configured to determine color difference information of the image to be processed according to the first theme color; a theme color obtaining module 603, configured to obtain a second theme color; a color transformation module 604, configured to update the color of the image to be processed according to the color difference information and the second theme color.

Further optionally, when the color of the image to be processed is updated according to the color difference information and the second theme color, the color transformation module 604 is specifically configured to: according to the second theme color, carrying out color migration on the image to be processed; and matching the color difference of the image to be processed after color migration with the color difference information.

Fig. 7 is a schematic structural diagram of an image data processing apparatus provided in an exemplary embodiment of the present application, and as shown in fig. 7, the image data processing apparatus includes: a memory 701 and a processor 702.

A memory 701 for storing a computer program and may be configured to store other various data to support operations on the image data processing apparatus. Examples of such data include instructions for any application or method operating on the image data processing device, contact data, phonebook data, messages, pictures, videos, and so forth.

A processor 702, coupled to the memory 701, for executing the computer program in the memory 701 for: extracting at least one original theme color on an image to be processed; determining color difference information on the image to be processed according to the at least one original theme color; and updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

Further optionally, the processor 702 is further configured to: acquiring the at least one target theme color from a color card designated by a user; or, performing color transformation on the at least one original theme color to obtain the at least one target theme color.

Further optionally, when performing color transformation on the at least one original theme color, the processor 702 is specifically configured to: for any original theme color in the at least one original theme color, transforming the original theme color to an HSV color space to obtain the original theme color of an HSV color mode; adjusting the value of the color component H in the original theme color of the HSV color mode according to the adjustment amount of the color component H corresponding to the original theme color; transforming the original theme color of the adjusted HSV color pattern from an HSV color space to an RGB color space.

Further optionally, when determining the color difference information on the image to be processed according to the at least one original theme color, the processor 702 is specifically configured to: calculating the weight of the at least one original theme color in the color of the pixel point aiming at any pixel point on the image to be processed to obtain a theme color weight coefficient corresponding to the pixel point; and determining color difference information on the image to be processed according to the theme color weight coefficients corresponding to different pixel points on the image to be processed.

Further optionally, for any pixel point on the image to be processed, when the processor 702 calculates the weight of the at least one original theme color in the color of the pixel point to obtain the theme color weight coefficient corresponding to the pixel point, specifically configured to: respectively calculating the distance between the color vector of the pixel point and the respective color vector of the at least one original theme color; and taking the normalized value of the distance as the weight of the at least one original subject color in the color of the pixel point.

Further optionally, when the color of the image to be processed is updated according to the color difference information and the specified at least one target theme color, the processor 702 is specifically configured to: carrying out color migration on the image to be processed according to the at least one target theme color; and matching the color difference of the image to be processed after color migration with the color difference information.

Further optionally, the processor 702 performs color migration on the image to be processed according to the at least one target theme color; when the color difference of the image to be processed after the color migration is matched with the color difference information, the method is specifically configured to: weighting and summing the weight coefficient of the theme color corresponding to each of different pixel points on the image to be processed and the appointed at least one target theme color; and determining new color vectors corresponding to different pixel points on the image to be processed according to the weighted summation result.

Further, as shown in fig. 7, the image data processing apparatus further includes: communication components 703, display 704, power components 705, and the like. Only a part of the components is schematically shown in fig. 7, and it is not meant that the image data processing apparatus includes only the components shown in fig. 7.

In this embodiment, the image data processing device may obtain at least one original theme color from the image to be processed, and determine color difference information on the image to be processed based on the at least one original theme color; and then, updating the color of the image to be processed based on the color difference information and at least one target theme color. In the color updating mode, the color difference information of the image to be processed is fully considered, and the color conversion of the image to be processed is facilitated while the pattern structure, the texture structure and/or the pattern structure and the like on the image to be processed are reserved.

Accordingly, the present application also provides a computer readable storage medium storing a computer program, and the computer program can implement the steps that can be executed by the image data processing device in the method embodiments.

Fig. 8 is a schematic structural diagram of an image data processing apparatus according to another exemplary embodiment of the present application, and as shown in fig. 8, the image data processing apparatus includes: a memory 801 and a processor 802.

A memory 801 for storing a computer program and may be configured to store other various data to support operations on the image data processing apparatus. Examples of such data include instructions for any application or method operating on the image data processing device, contact data, phonebook data, messages, pictures, videos, and so forth.

A processor 802, coupled to the memory 801, for executing computer programs in the memory 801 for: acquiring an image to be processed, wherein the image to be processed comprises a first theme color, and the first theme color comprises a color of which the occurrence frequency of the image to be processed meets a preset condition; determining color difference information of the image to be processed according to the first theme color; acquiring a second theme color; and updating the color of the image to be processed according to the color difference information and the second theme color.

Further optionally, when the color of the image to be processed is updated according to the color difference information and the second theme color, the processor 802 is specifically configured to: according to the second theme color, carrying out color migration on the image to be processed; and matching the color difference of the image to be processed after color migration with the color difference information.

Further, as shown in fig. 8, the image data processing apparatus further includes: communication component 803, display 804, power component 805, and the like. Only a part of the components is schematically shown in fig. 8, and it is not meant that the image data processing apparatus includes only the components shown in fig. 8.

Fig. 9 is a schematic structural diagram of a color chart recommendation device according to an exemplary embodiment of the present application, and as shown in fig. 9, the device includes: an input module 901, a color transformation module 902 and an output module 903.

The input module 901 is configured to obtain HSV color vectors corresponding to theme colors on the primary color card; a color transformation module 902, configured to adjust a color component H in the HSV color vector according to a set adjustment amount of the color component H; generating a new theme color according to the HSV color vector adjusted by the color component H; and an output module 903, configured to output a new color card including the new theme color.

In this embodiment, the color chart recommending device may obtain HSV color vectors corresponding to the theme colors on the primary color chart, and adjust the color components H in the HSV color vectors corresponding to the theme colors according to the set adjustment amount of the color components H. And then, generating a new theme color according to the HSV color vector after the color component H is adjusted. Based on the new theme color, the new color card can be output, so that the intelligent color card recommendation service for automatically recommending the new color card to the user according to the primary color card is realized.

Fig. 10 illustrates a schematic structural diagram of a color chart recommendation device according to an exemplary embodiment of the present application, and as shown in fig. 10, the color chart recommendation device includes: a memory 1001 and a processor 1002.

A memory 1001 for storing a computer program and may be configured to store other various data to support operations on the color chip recommendation device. Examples of such data include instructions for any application or method operating on the color chip recommendation device, contact data, phone book data, messages, pictures, videos, and the like.

A processor 1002, coupled to the memory 1001, for executing the computer programs in the memory 1001 to: acquiring HSV color vectors corresponding to theme colors on a primary color card; adjusting the color component H in the HSV color vector according to the set adjustment amount of the color component H; and generating a new theme color according to the HSV color vector after the adjustment of the color component H, and outputting a new color card containing the new theme color.

Further, as shown in fig. 10, the color chart recommendation device further includes: communication components 1003, power components 1004, display 1005, audio components 1006, and the like. Only some of the components are schematically shown in fig. 10, and it is not meant that the color chart recommendation apparatus includes only the components shown in fig. 10.

In this embodiment, the color chart recommendation device may obtain HSV color vectors corresponding to the theme colors on the primary color chart, and adjust the color components H in the HSV color vectors corresponding to the theme colors according to the set adjustment amount of the color components H. And then, generating a new theme color according to the HSV color vector after the color component H is adjusted. Based on the new theme color, the new color card can be output, so that the intelligent color card recommendation service for automatically recommending the new color card to the user according to the primary color card is realized.

Accordingly, the present application further provides a computer-readable storage medium storing a computer program, where the computer program is capable of implementing the steps that can be executed by the color chart recommendation device in the foregoing method embodiments when executed.

The memories of fig. 7, 8 and 10 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The communication components of fig. 7, 8, and 10 described above are configured to facilitate communication between the device in which the communication component is located and other devices in a wired or wireless manner. The device in which the communication component is located may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may be implemented based on Near Field Communication (NFC) technology, Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

The displays in fig. 7, 8 and 10 described above include screens, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

The power supply modules of fig. 7, 8 and 10 provide power to various components of the device in which the power supply module is located. The power components may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device in which the power component is located.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. An image data processing method characterized by comprising:

extracting at least one original theme color on an image to be processed;

determining color difference information on the image to be processed according to the at least one original theme color;

and updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

2. The method of claim 1, further comprising:

acquiring the at least one target theme color from a color card designated by a user; alternatively, the first and second electrodes may be,

and carrying out color transformation on the at least one original theme color to obtain the at least one target theme color.

3. The method of claim 1, color transforming the at least one original theme color, comprising:

for any original theme color in the at least one original theme color, transforming the original theme color to an HSV color space to obtain the original theme color of an HSV color mode;

adjusting the value of the color component H in the original theme color of the HSV color mode according to the adjustment amount of the color component H corresponding to the original theme color;

transforming the original theme color of the adjusted HSV color pattern from an HSV color space to an RGB color space.

4. The method according to claim 3, wherein the adjustment amount of the color component H corresponding to different original theme colors is the same in the at least one original theme color.

5. The method of claim 1, wherein determining color difference information on the image to be processed based on the at least one original theme color comprises:

calculating the weight of the at least one original theme color in the color of the pixel point aiming at any pixel point on the image to be processed to obtain a theme color weight coefficient corresponding to the pixel point;

and determining color difference information on the image to be processed according to the theme color weight coefficients corresponding to different pixel points on the image to be processed.

6. The method according to claim 5, wherein calculating, for any pixel point on the image to be processed, a weight of the at least one original theme color in the color of the pixel point to obtain a theme color weight coefficient corresponding to the pixel point comprises:

respectively calculating the distance between the color vector of the pixel point and the respective color vector of the at least one original theme color;

and taking the normalized value of the distance as the weight of the at least one original subject color in the color of the pixel point.

7. The method according to claim 5 or 6, wherein updating the color of the image to be processed according to the color difference information and the specified at least one target subject color comprises:

carrying out color migration on the image to be processed according to the at least one target theme color; and matching the color difference of the image to be processed after color migration with the color difference information.

8. The method according to claim 7, wherein the image to be processed is color-shifted according to the at least one target theme color; wherein, the matching of the color difference of the image to be processed after color migration and the color difference information comprises:

weighting and summing the weight coefficient of the theme color corresponding to each of different pixel points on the image to be processed and the appointed at least one target theme color;

and determining new color vectors corresponding to different pixel points on the image to be processed according to the weighted summation result.

9. A method for color chip recommendation, comprising:

acquiring HSV color vectors corresponding to theme colors on a primary color card;

adjusting the color component H in the HSV color vector according to the set adjustment amount of the color component H;

generating a new theme color according to the HSV color vector adjusted by the color component H;

outputting a new color card containing the new theme color.

10. An image data processing apparatus characterized by comprising:

the theme color extraction module is used for extracting at least one original theme color on the image to be processed;

the color difference determining module is used for determining color difference information on the image to be processed according to the at least one original theme color;

and the color transformation module is used for updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

11. An image data processing apparatus characterized by comprising:

a memory and a processor;

wherein the memory is configured to store one or more computer instructions;

the processor to execute the one or more computer instructions to: extracting at least one original theme color on an image to be processed; determining color difference information on the image to be processed according to the at least one original theme color; and updating the color of the image to be processed according to the color difference information and at least one specified target theme color.

12. A computer-readable storage medium storing a computer program, wherein the computer program is capable of implementing the image data processing method according to any one of claims 1 to 8 when executed.

13. A color chip recommendation device, comprising:

the input module is used for acquiring HSV color vectors corresponding to theme colors on the primary color card;

the color transformation module is used for adjusting the color component H in the HSV color vector according to the set adjustment quantity of the color component H; generating a new theme color according to the HSV color vector adjusted by the color component H;

and the output module is used for outputting the new color card containing the new theme color.

14. A color chip recommendation device, comprising:

a memory and a processor;

wherein the memory is configured to store one or more computer instructions;

the processor to execute the one or more computer instructions to: acquiring HSV color vectors corresponding to theme colors on a primary color card; adjusting the color component H in the HSV color vector according to the set adjustment amount of the color component H; generating a new theme color according to the HSV color vector adjusted by the color component H; outputting a new color card containing the new theme color.

15. A computer-readable storage medium storing a computer program, wherein the computer program is capable of implementing the color chart recommendation method according to claim 9 when executed.

16. An image data processing method characterized by comprising:

acquiring an image to be processed, wherein the image to be processed comprises a first theme color, and the first theme color comprises a color of which the occurrence frequency of the image to be processed meets a preset condition;

determining color difference information of the image to be processed according to the first theme color;

acquiring a second theme color;

and updating the color of the image to be processed according to the color difference information and the second theme color.

17. The method according to claim 16, wherein updating the color of the image to be processed according to the color difference information and the second theme color comprises:

according to the second theme color, carrying out color migration on the image to be processed; and matching the color difference of the image to be processed after color migration with the color difference information.