WO2023005421A1 - Work cover display method, device, medium and electronic apparatus - Google Patents
Work cover display method, device, medium and electronic apparatus Download PDFInfo
- Publication number
- WO2023005421A1 WO2023005421A1 PCT/CN2022/096850 CN2022096850W WO2023005421A1 WO 2023005421 A1 WO2023005421 A1 WO 2023005421A1 CN 2022096850 W CN2022096850 W CN 2022096850W WO 2023005421 A1 WO2023005421 A1 WO 2023005421A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- images
- cover image
- work
- dynamic
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000003068 static effect Effects 0.000 claims abstract description 50
- 230000005856 abnormality Effects 0.000 claims abstract description 31
- 230000004044 response Effects 0.000 claims abstract description 7
- 230000002159 abnormal effect Effects 0.000 claims description 29
- 238000001514 detection method Methods 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 12
- 238000007781 pre-processing Methods 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 abstract description 11
- 239000002699 waste material Substances 0.000 abstract description 9
- 230000016776 visual perception Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000011895 specific detection Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/44—Browsing; Visualisation therefor
Definitions
- the embodiments of the present disclosure relate to the field of computer technology, and in particular, to a method for displaying a work cover, a device for displaying a work cover, and a computer-readable storage medium and electronic equipment for realizing the method for displaying a work cover.
- video works such as short videos are becoming more and more popular.
- a corresponding video cover can be set for the video works to attract the users to click to play the video.
- the video cover may adopt a dynamic cover image, which can provide richer information, thereby increasing the probability of the user clicking to play the video.
- the video cover adopts a dynamic cover image
- the video cover display effect is a static image, but it is actually a dynamic image, resulting in a certain waste of data traffic;
- the images of the adjacent frames that make up the dynamic cover image differ too much, it will cause jumping and flashing, resulting in poor visual effect of the video cover display, especially when displaying the user's video works collection, the overall coordination of the displayed page is poor, It affects the visual perception, thereby reducing the probability of users clicking to play the video.
- embodiments of the present disclosure provide a method for displaying a work cover, a device for displaying a work cover, and a computer-readable storage medium and electronic equipment for realizing the method for displaying a work cover, which can improve The probability that a user clicks to play a video.
- an embodiment of the present disclosure provides a method for displaying a work cover, including:
- the multimedia work including a dynamic cover image
- the dynamic cover image is replaced with a static cover image, and the multimedia work including the replaced static cover image is returned.
- the step of detecting whether there is an abnormal display of the dynamic cover image includes:
- N is a natural number greater than 1
- the attribute parameter values are related to the pixels of the images
- the step of determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images includes:
- the step of calculating the pixel difference of each corresponding pixel in two adjacent frames of images includes:
- the method also includes:
- the pixel value of each pixel in the first three-channel image and the second three-channel image is normalized to a preset value range.
- the step of detecting whether there is an abnormal display of the dynamic cover image includes:
- N is a natural number greater than 1
- the step of detecting whether there is an abnormal display of the dynamic cover image includes:
- the detecting whether the dynamic cover image is displayed abnormally includes:
- the dynamic cover image is replaced with a static cover image, and a multimedia work including the static cover image is returned, including:
- the remaining multimedia works are all but one of the multiple multimedia works.
- an embodiment of the present disclosure provides a work cover display device, including:
- the request receiving module is used to receive the acquisition request of the multimedia work
- a work acquisition module configured to acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image
- An abnormality detection module configured to detect whether there is an abnormality in the display of the dynamic cover image
- the replacement display module is configured to replace the dynamic cover image with a static cover image when the abnormality detection module detects that the dynamic cover image is displayed abnormally, and return the multimedia work including the replaced static cover image.
- an embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method for displaying a work cover described in any of the above-mentioned embodiments are implemented.
- an electronic device including:
- the processor is configured to execute the steps of the work cover display method described in any one of the above embodiments by executing the computer program.
- the work cover display method, device, medium, and electronic device provided by the embodiments of the present disclosure receive an acquisition request of a multimedia work, respond to the acquisition request to acquire a multimedia work, the multimedia work includes a dynamic cover image, and detect whether the dynamic cover image is There is a display abnormality, and if it is detected that the dynamic cover image has a display abnormality, the dynamic cover image is replaced with a static cover image, and the multimedia work including the replaced static cover image is returned. In this way, the display abnormality of the dynamic cover image of the multimedia work can be detected.
- the dynamic cover image When the dynamic cover image has an abnormal display, the dynamic cover image can be replaced with a static cover image, so that the waste of data traffic can be reduced when the dynamic cover image displays abnormally;
- this method can also solve the flickering phenomenon of the dynamic cover image, so that the cover display of multimedia works such as videos has a better visual effect.
- the overall coordination of the displayed page is better and the visual perception is good. , which can increase the probability of the user clicking to play the video.
- FIG. 1 is a flowchart of a method for displaying a work cover in an embodiment of the present disclosure
- FIG. 2 is a flow chart of a method for displaying a work cover according to another embodiment of the present disclosure
- Fig. 3 is a flow chart of a method for displaying a work cover according to another embodiment of the present disclosure
- FIG. 4 is a flowchart of a method for displaying a work cover according to yet another embodiment of the present disclosure
- FIG. 5 is a schematic diagram of a display device for a work cover in an embodiment of the present disclosure
- FIG. 6 is a schematic diagram of an electronic device implementing a method for displaying a work cover according to an embodiment of the present disclosure.
- At least one (item) means one or more, and “multiple” means two or more.
- “And/or” is used to describe the association relationship of associated objects, which means that there can be three kinds of relationships, for example, “A and/or B” can mean: only A exists, only B exists, and A and B exist at the same time. Among them, A and B can be singular or plural.
- the character “/” generally indicates that the contextual objects are an “or” relationship.
- At least one of the following” or similar expressions refer to any combination of these items, including any combination of single or plural items.
- At least one item (piece) of a, b or c can mean: a, b, c, "a and b", “a and c", “b and c", or "a and b and c ", where a, b, c can be single or multiple.
- Fig. 1 is a flowchart of a method for displaying a work cover according to an example embodiment of the present disclosure.
- the method for displaying a work cover may be executed by a server or a client.
- the execution by the server is taken as an example for illustration, and the method may specifically include the following steps:
- Step S101 Receive a request for acquiring a multimedia work.
- the server may be a client such as a video server corresponding to a video application program installed on a smart phone.
- a multimedia work may be, for example but not limited to, an audio work or a video work.
- a video work such as a short video work is used as an example for illustration.
- the short video works can be published and uploaded to the video server through the video application, and other users can Start the video application on your smartphone to obtain short video works uploaded by yourself or others from the video server for viewing.
- the user clicks to open the video application in the display interface of the video application, for example, clicks on a user's nickname to trigger a request to generate a short video work.
- the request may include user identification such as nickname or ID wait.
- the acquisition request is sent to the video server by the video application, that is, the video server receives the acquisition request.
- Step S102 Acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image.
- the video server responds to the acquisition request of the short video works, and obtains one or more short video works of the corresponding user from the video server, for example, based on the user identifier, one short video work or multiple short video works of the corresponding user are acquired.
- a collection of video works, each short video work can include a dynamic cover image, and the dynamic cover image is composed of multiple frames of images extracted from the short video work.
- Step S103 Detect whether the dynamic cover image is displayed abnormally.
- the video server After the video server obtains the short video work, it detects the dynamic cover image of the short video work to determine whether there is any abnormality in the display of the dynamic cover image.
- the abnormal display is actually a dynamic image but the display effect is static, or there is a phenomenon of flickering , that is, the difference between the images of the adjacent frames constituting the dynamic cover image is too large, and the visual effect of the display is poor.
- Step S104 If it is detected that the dynamic cover image is displayed abnormally, replace the dynamic cover image with a static cover image, and return the multimedia work including the replaced static cover image.
- the video server detects that the dynamic cover image of the short video work is displayed abnormally, it replaces the dynamic cover image with a static cover image, that is, replaces the short video work, and returns the replaced short video work to the video application program displayed in .
- the static cover image may be a static cover image custom-set by the user for a short video work previously made by the user, but it is not limited thereto.
- the above-mentioned work cover display method can realize the display abnormality detection of the dynamic cover image of a multimedia work.
- the short video works can be displayed in the video application, so when the dynamic cover image displays abnormally, the short video works returned include a static cover image instead of a dynamic cover image composed of multiple frames of images, which can reduce the waste of data traffic; in addition,
- the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, and makes the cover display of multimedia works such as videos have better visual effects.
- the client displays the user's video works collection at the same time, the overall coordination of the display page is displayed. It has good performance and good visual perception, which can increase the probability of users clicking to play videos to a certain extent.
- the step of detecting whether the dynamic cover image is displayed abnormally in step S103 may specifically include the following steps:
- Step S201 Obtain N consecutive frames of images belonging to the dynamic cover image, where N is a natural number greater than 1.
- N is 5, but not limited thereto.
- five consecutive frames of images constituting the dynamic cover image can be acquired, such as image 1, image 2, image 3, image 4 and image 5 arranged in sequence.
- Step S202 Determine the attribute parameter values of any two adjacent frames of images in the continuous N frames of images, and obtain (N-1) attribute parameter values of two adjacent frames of images in total, and the attribute parameter values are related to the pixels of the images .
- the attribute parameter values of image 1 and image 2 are 1, and the image
- the attribute parameter value 2 of image 2 and image 3, the attribute parameter value 3 of image 3 and image 4, and the attribute parameter value 4 of image 4 and image 5, that is, a total of 4 attribute parameter values of two adjacent frames of images are obtained.
- Step S203 When the attribute parameter values of each of the two adjacent frames of images are greater than or equal to the attribute parameter threshold, it is determined that the dynamic cover image has a display abnormality.
- the attribute parameter value 1, the attribute parameter value 2, the attribute parameter value 3 and the attribute parameter value 4 are all greater than or equal to the attribute parameter threshold value X, it is determined that the dynamic cover image is displayed abnormally, and then returns to step S104.
- the above method for displaying the cover of a work detects the attribute parameter values of two adjacent frames of images in the dynamic cover image, and can more accurately detect the display abnormality of the dynamic cover image of a multimedia work.
- the dynamic cover image When there is an abnormal display, directly replace the dynamic cover image with a static cover image, and then return the replaced short video work to the video application for display, so that when the dynamic cover image displays abnormally, the returned short video work includes a frame of static cover image Instead of a dynamic cover image composed of multiple frames of images, it can reduce the waste of data traffic; in addition, the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image and makes the cover of multimedia works such as videos display visual effects Better, when the client side displays the user's video works collection at the same time, the overall coordination of the displayed page is better, the visual perception is good, and the probability of the user clicking to play the video can be increased to a certain extent.
- step S202 the step of determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images , which may specifically include the following steps:
- Step S301 Calculate the pixel difference value of each corresponding pixel in two adjacent frames of images.
- each frame of images contains the same number of pixels, for example, image 1 and image 2 both contain 10,000 pixels, here only By way of example, not limitation.
- the pixel difference value of each corresponding pixel in image 1 and image 2 is calculated, for example, pixel A in image 1 corresponds to a pixel in image 2
- the pixel difference value P P1-P2.
- the same method is used to determine the pixel difference values of other pixels in image 1 and image 2 until, for example, 10,000 pixel difference values are determined.
- Other two adjacent frames of images, such as image 2 and image 3, image 3 and image 4, and image 4 and image 5 also determine the pixel difference in the same calculation method, which will not be described in detail here.
- Step S302 Determine the number of target pixel points in two adjacent frames of images, where the target pixel points are pixels with a pixel difference greater than a preset pixel threshold in the two adjacent frames of images.
- the preset pixel threshold can be set as required, without limitation. Specifically, as an example, determine the difference between, for example, 10,000 pixels in image 1 and image 2 by the above method, and then select the pixel whose pixel difference is greater than the preset pixel threshold, that is, the target pixel, and finally count the number of target pixels, For example, there are 9000 target pixels.
- Step S303 Calculate the ratio of the number of target pixels to the total number of pixels in any one of the two adjacent frames of images, and use the ratio as the attribute parameter value.
- the attribute parameter value is 1.
- step S303 skip to step S203 to determine whether the dynamic cover image is displayed abnormally.
- the method for displaying the cover of the work can accurately detect the display abnormality of the dynamic cover picture of the multimedia work through the pixel difference between two adjacent frames of images in the dynamic cover picture to determine the value of the attribute parameter and then detect it.
- the display of the dynamic cover image is abnormal, directly replace the dynamic cover image with the static cover image, and then return the replaced short video works to the video application for display.
- the returned short video works include a A frame static cover image instead of a dynamic cover image composed of multiple frames can reduce the waste of data traffic; in addition, the client displays the replaced short video work, which solves the flickering phenomenon of the dynamic cover image, making multimedia works such as video
- the visual effect of the cover display is better.
- the client displays the user's video collection at the same time, the overall coordination of the displayed page is better, and the visual perception is good, which can increase the probability of the user clicking to play the video to a certain extent.
- the step of calculating the pixel difference value of each corresponding pixel point in the above-mentioned step S301 in two adjacent frames of images Specifically, the following steps may be included:
- Step S401 Preprocess two adjacent frames of images into corresponding first three-channel images and second three-channel images.
- the first three-channel image and the second three-channel image are red, green and blue (RGB) three-channel images.
- RGB red, green and blue
- two adjacent frames of image 1 and image 2 are preprocessed into RGB three-channel image 1 and RGB three-channel image 2 respectively.
- Step S402 Calculate the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image.
- pixel point A in image 1 that is, RGB three-channel image 1
- pixel point A' in image 2 that is, RGB three-channel image 2
- R1 is the red component at pixel A in RGB three-channel image 1
- R2 is the red component at pixel A' in RGB three-channel image 2
- G1 is the green component at pixel A in RGB three-channel image 1
- G2 is the green component at pixel A' in RGB three-channel image 2
- B1 is the blue component at pixel A in RGB three-channel image 1
- B2 is the blue component at pixel A' in RGB three-channel image 2 color components.
- Other pixels in the RGB three-channel image 1 and the RGB three-channel image 2 also determine the red component difference, the green component difference and the blue component difference in this way.
- Step S403 Calculate the sum of the absolute values of the red component difference, the green component difference and the blue component difference, and use the sum as the pixel difference.
- step S403 the above step S302 to step S303 can be executed.
- the above-mentioned work cover display method provided by the embodiment of the present disclosure converts two adjacent frame images in the dynamic cover image into a three-channel image, and then based on the red component difference, green component difference and blue component difference of corresponding pixels Determine the pixel difference, and then determine the attribute parameter value before detection, which can more accurately detect the abnormal display of the dynamic cover image of the multimedia work.
- the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, and makes the cover display of multimedia works such as videos have a better visual effect.
- the client displays the user's video work collection at the same time, The overall coordination of the display page is good, and the visual perception is good, which can increase the probability of users clicking to play the video to a certain extent.
- the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image are calculated.
- the method may further include: normalizing the pixel value of each pixel in the first three-channel image and the second three-channel image to a preset value range.
- the preset numerical range is, for example, 0-1.
- the pixel values of each pixel in the first three-channel image such as RGB three-channel image 1 and the second three-channel image such as RGB three-channel image 2, such as the red, green and blue component values are normalized to 0 ⁇ 1, then return to step S402, that is, calculate the red component difference and green component of each corresponding pixel in the first three-channel image such as RGB three-channel image 1 and the second three-channel image such as RGB three-channel image 2 Difference and Blue Component Difference.
- two adjacent frames of images in the dynamic cover image are converted into a three-channel image, and then the pixel value of each pixel in the three-channel image is normalized to a preset value range, and then based on the corresponding pixel
- the red component difference, the green component difference and the blue component difference determine the pixel difference, and then determine the attribute parameter value before detection, which can more accurately detect the abnormal display of the dynamic cover image of the multimedia work, and at the same time, can improve the detection Efficiency, to achieve a certain degree of balance in terms of detection efficiency and accuracy.
- the dynamic cover image When an abnormal display of the dynamic cover image is detected, the dynamic cover image is directly replaced with a static cover image, and then the replaced short video work is returned to the video application for display, so the short video work returned when the dynamic cover image displays abnormally
- Including a static cover image instead of a dynamic cover image composed of multiple frames can reduce the waste of data traffic; in addition, the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, making multimedia works such as The cover display of the video has a better visual effect.
- the client displays the user's video collection at the same time, the overall coordination of the displayed page is better and the visual perception is good, which can increase the probability of the user clicking to play the video to a certain extent.
- the step of detecting whether the dynamic cover image has abnormal display in step S103 may specifically include the following steps: acquiring consecutive N frames of images belonging to the dynamic cover image, N is a natural number greater than 1; determine the similarity of any adjacent two frames of images in the continuous N frames of images, and obtain (N-1) the similarity of adjacent two frames of images; in each of the adjacent two frames of images When the similarity of the frame images is greater than or equal to the preset similarity threshold, it is determined that the dynamic cover image has an abnormal display.
- the dynamic cover image includes, for example, five consecutive frames of images such as image 1, image 2, image 3, image 4, and image 5, and the similarity between two adjacent frames of images can be determined.
- the two adjacent frames can be determined based on an image similarity algorithm.
- the similarity of frame images may include but not limited to the SIFT (Scale Invariant Feature Transform) algorithm, which can be understood with reference to the prior art, and will not be repeated here.
- SIFT Scale Invariant Feature Transform
- the final calculation results in the similarity 1 between image 1 and image 2, the similarity 2 between image 2 and image 3, the similarity 3 between image 3 and image 4, and the similarity 4 between image 4 and image 5, that is, a total of 4 The similarity between two adjacent frames of images.
- the similarity 1, similarity 2, similarity 3 and similarity 4 are all greater than or equal to the preset similarity threshold Y, it is determined that the dynamic cover image is displayed abnormally, and then returns to step S104.
- the preset similarity threshold can be set as required, and there is no limit to this.
- the step of detecting whether the dynamic cover image is abnormally displayed in step S103 may specifically include the following steps: acquiring multiple frames of images belonging to the dynamic cover image; judging Whether each frame of images in the multiple frames of images is the same; if each frame of images in the multiple frames of images is the same, it is determined that there is an abnormal display of the dynamic cover image.
- the dynamic cover image includes, for example, 5 frames of images such as image 1, image 2, image 3, image 4, and image 5, and it is determined whether each frame of images in image 1, image 2, image 3, image 4, and image 5 is the same, For example, the determination is made based on image content, and when the image 1, image 2, image 3, image 4, and image 5 are all the same, it is determined that the dynamic cover image has a display abnormality. Then return to step S104.
- the method may also include the steps of:
- Step 1) Detect whether the dynamic cover images of each of the multiple multimedia works are displayed abnormally.
- the two short video works will be Determined as the target short video works, the dynamic cover images of the 2 target short video works are replaced with static cover images, and the replaced 2 target short video works and the remaining 8 other short video works are returned to the client such as a video application displayed in the program.
- the above method for displaying the cover of a work provided by the embodiment of the present disclosure can realize the abnormal display detection of the dynamic cover images of multiple short video works at the same time.
- the dynamic cover images display abnormally, directly replace the dynamic cover images with static cover images, Then return the replaced short video works and other short video works, that is, the collection of video works to be displayed in the video application, so that when the dynamic cover image displays abnormally, the returned short video works include a frame of static cover image instead of multiple frames of images.
- the dynamic cover image can reduce the waste of data traffic; in addition, the client displays the user's video collection at the same time, and the displayed cover of the replaced short video works has a better visual effect, which solves the flickering phenomenon of the dynamic cover image and displays
- the overall coordination of the page of the video collection is good, and the visual perception is good, which can increase the probability of users clicking to play the video to a certain extent.
- the embodiment of the present disclosure also provides a work cover display device, as shown in Figure 5, the work cover display device may include a request receiving module 501, a work acquisition module 502, an abnormality detection module 503 and a replacement display module 504:
- the request receiving module 501 is used for receiving a request for acquiring a multimedia work.
- the work acquisition module 502 is configured to acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image.
- the anomaly detection module 503 is used to detect whether the dynamic cover image has display anomalies.
- the replacement display module 504 is configured to replace the dynamic cover image with a static cover image when the abnormality detection module detects that the dynamic cover image is displayed abnormally, and return the multimedia work including the replaced static cover image.
- the work cover display device can realize the display abnormality detection of the dynamic cover image of the multimedia work.
- the dynamic cover image has a display abnormality, it directly replaces the dynamic cover image with the static cover image, and then returns the replaced one.
- the short video works are displayed in the video application, so when the dynamic cover image displays abnormally, the returned short video work includes a static cover image instead of a dynamic cover image composed of multiple frames, which can reduce the waste of data traffic; in addition, the customer
- the terminal displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, and makes the cover display of multimedia works such as videos have a better visual effect.
- the client displays the user's video works collection at the same time, it shows the overall coordination of the page Better, the visual perception is good, and to a certain extent, it can increase the probability of users clicking to play the video.
- the anomaly detection module 503 detects whether there is an abnormal display of the dynamic cover image, including: acquiring consecutive N frames of images belonging to the dynamic cover image, where N is greater than 1 A natural number; determine the attribute parameter values of any adjacent two frame images in the continuous N frame images, and obtain (N-1) attribute parameter values of adjacent two frame images, and the attribute parameter values are related to the pixels of the image ; When the attribute parameter values of each of the two adjacent frames of images are greater than or equal to the attribute parameter threshold, it is determined that the dynamic cover image has an abnormal display.
- the anomaly detection module 503 determines attribute parameter values of any two adjacent frames of images in the continuous N frames of images, including: calculating each corresponding The pixel difference value of the pixel point; determine the number of target pixel points in two adjacent frames of images, and the target pixel point is a pixel point with a pixel difference value greater than a preset pixel threshold in two adjacent frame images; calculate the target pixel point The ratio of the number of pixels to the total number of pixels in any image in two adjacent frames of images is used as the attribute parameter value.
- the anomaly detection module 503 calculates the pixel difference of each corresponding pixel in two adjacent frames of images, including: preprocessing the two adjacent frames of images into corresponding The first three-channel image and the second three-channel image; calculate the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image; calculate The sum of the absolute values of the red component difference, the green component difference and the blue component difference is used as the pixel difference.
- the device may further include a normalization processing module, which is used to calculate, in the abnormality detection module 503, each of the first three-channel image and the second three-channel image Before the red component difference, green component difference and blue component difference of corresponding pixels, the pixel value of each pixel in the first three-channel image and the second three-channel image is normalized to the preset Set the value range.
- a normalization processing module which is used to calculate, in the abnormality detection module 503, each of the first three-channel image and the second three-channel image Before the red component difference, green component difference and blue component difference of corresponding pixels, the pixel value of each pixel in the first three-channel image and the second three-channel image is normalized to the preset Set the value range.
- the anomaly detection module 503 detects whether there is an abnormal display of the dynamic cover image, including: acquiring consecutive N frames of images belonging to the dynamic cover image, where N is greater than A natural number of 1; determine the similarity of any adjacent two frames of images in the continuous N frames of images, and obtain (N-1) the similarity of adjacent two frames of images; in each of the adjacent two frames of images When the similarities are greater than or equal to the preset similarity threshold, it is determined that the dynamic cover image is displayed abnormally.
- the anomaly detection module 503 detects whether the dynamic cover image has display anomalies, including: acquiring multiple frames of images belonging to the dynamic cover image; Whether each frame image in the frame images is the same; when each frame image in the multiple frame images is the same, it is determined that the dynamic cover image has a display abnormality.
- the anomaly detection module 503 is further configured to: detect whether the dynamic cover images of each of the multiple multimedia works are displayed abnormally;
- the replacement display module 504 is also used to replace the dynamic cover image of the abnormally displayed target multimedia work detected by the abnormality detection module 503 with a static cover image, and return the target multimedia work including the replaced static cover image and the remaining multimedia works, so
- the remaining multimedia works are multimedia works other than the target multimedia work among the plurality of multimedia works.
- modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory.
- the features and functions of two or more modules or units described above may be embodied in one module or unit.
- the features and functions of one module or unit described above can be further divided to be embodied by a plurality of modules or units.
- Components shown as modules or units may or may not be physical units, may be located in one place, or may be distributed over multiple network elements. Part or all of the modules can be selected according to actual needs to realize the purpose of the disclosed scheme. It can be understood and implemented by those skilled in the art without creative effort.
- the embodiments of the present disclosure also provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method for displaying a work cover described in any one of the above-mentioned embodiments are implemented.
- the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read-only memory
- CD-ROM compact disk read-only memory
- optical storage devices magnetic storage devices, or any suitable combination of the foregoing.
- the computer readable storage medium may include a data signal carrying readable program code in baseband or as part of a carrier wave traveling as a data signal. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- a readable storage medium may also be any readable medium other than a readable storage medium that can send, propagate or transport a program for use by or in conjunction with an instruction execution system, apparatus or device.
- the program code contained on the readable storage medium may be transmitted by any suitable medium, including but not limited to wireless, cable, optical cable, RF, etc., or any suitable combination of the above.
- An embodiment of the present disclosure also provides an electronic device, including a processor and a memory, where the memory is used to store a computer program.
- the processor is configured to execute the steps of the work cover display method in any one of the above embodiments by executing the computer program.
- FIG. 6 An electronic device 600 according to this embodiment of the present invention is described below with reference to FIG. 6 .
- the electronic device 600 shown in FIG. 6 is only an example, and should not limit the functions and scope of use of this embodiment of the present invention.
- electronic device 600 takes the form of a general-purpose computing device.
- Components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640, and the like.
- the storage unit stores program codes, and the program codes can be executed by the processing unit 610, so that the processing unit 610 executes the various exemplary implementations according to the present invention described in the above-mentioned part of the work cover display method in this specification. way steps.
- the processing unit 610 may execute the steps of the method for displaying a work cover as shown in FIG. 1 .
- the storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 6201 and/or a cache storage unit 6202 , and may further include a read-only storage unit (ROM) 6203 .
- RAM random access storage unit
- ROM read-only storage unit
- the storage unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include the implementation of the network environment.
- program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include the implementation of the network environment.
- Bus 630 may represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local area using any of a variety of bus structures. bus.
- the electronic device 600 can also communicate with one or more external devices 700 (such as keyboards, pointing devices, Bluetooth devices, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device 600, and/or communicate with Any device (eg, router, modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 650 .
- the electronic device 600 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and/or a public network such as the Internet) through the network adapter 660 .
- the network adapter 660 can communicate with other modules of the electronic device 600 through the bus 630 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.
- the example implementations described here can be implemented by software, or can be implemented by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of software products, and the software products can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the above method for displaying a work cover according to an embodiment of the present disclosure.
- a computing device which may be a personal computer, a server, or a network device, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A work cover display method, device, medium and electronic apparatus, the method comprising: receiving a multimedia work acquisition request (S101); in response to the acquisition request, acquiring a multimedia work, the multimedia work comprising a dynamic cover image (S102); detecting whether the dynamic cover image has any display abnormalities (S103); if it is detected that the dynamic cover image has a display abnormality, replacing the dynamic cover image with a static cover image, and returning the multimedia work comprising the replaced static cover image (S104). The above method can reduce the waste of data traffic when a dynamic cover image has a display abnormality, and further resolves the flickering of a dynamic cover image, thus improving the visual effect when displaying a multimedia work such as a video cover.
Description
本申请要求于2021年07月30日提交国家知识产权局、申请号为202110875204.X、申请名称为“作品封面显示方法、装置、介质和电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110875204.X and the title of "work cover display method, device, medium and electronic equipment" submitted to the State Intellectual Property Office on July 30, 2021, the entire content of which Incorporated in this application by reference.
本公开实施例涉及计算机技术领域,尤其涉及一种作品封面显示方法,作品封面显示装置,以及实现作品封面显示方法的计算机可读存储介质和电子设备。The embodiments of the present disclosure relate to the field of computer technology, and in particular, to a method for displaying a work cover, a device for displaying a work cover, and a computer-readable storage medium and electronic equipment for realizing the method for displaying a work cover.
随着移动互联网的发展,视频作品如短视频越来越盛行。为了使用户尽可能对视频作品感兴趣,从而从中选择视频作品进行点击播放,通常可对视频作品设置相应的视频封面以吸引用户点击播放视频。With the development of the mobile Internet, video works such as short videos are becoming more and more popular. In order to make the user interested in the video works as much as possible, so as to select the video works and click to play, usually a corresponding video cover can be set for the video works to attract the users to click to play the video.
相关技术中,视频封面可采用动态封面图,其可以提供更为丰富的信息,从而增加了用户点击播放视频的概率。In related technologies, the video cover may adopt a dynamic cover image, which can provide richer information, thereby increasing the probability of the user clicking to play the video.
但是,视频封面采用动态封面图时存在一些显示异常问题,例如构成动态封面图的多帧图像相同,则视频封面显示效果是静态图像,但实际是动态图像,造成一定的数据流量的浪费;另外,构成动态封面图的相邻帧的图像如果差异过大,会造成跳闪现象,导致视频封面显示视觉效果较差,尤其当展示用户的视频作品集合时,显示页面的整体协调性较差,影响视觉观感,从而降低了用户点击播放视频的概率。However, when the video cover adopts a dynamic cover image, there are some abnormal display problems. For example, if multiple frames of images constituting the dynamic cover image are the same, the video cover display effect is a static image, but it is actually a dynamic image, resulting in a certain waste of data traffic; , if the images of the adjacent frames that make up the dynamic cover image differ too much, it will cause jumping and flashing, resulting in poor visual effect of the video cover display, especially when displaying the user's video works collection, the overall coordination of the displayed page is poor, It affects the visual perception, thereby reducing the probability of users clicking to play the video.
发明内容Contents of the invention
为了解决上述技术问题或者至少部分地解决上述技术问题,本公开实施例提供了一种作品封面显示方法,作品封面显示装置,以及实现作品封面显示方法的计算机可读存储介质和电子设备,能够提高用户点击播放视频的概率。In order to solve the above technical problems or at least partially solve the above technical problems, embodiments of the present disclosure provide a method for displaying a work cover, a device for displaying a work cover, and a computer-readable storage medium and electronic equipment for realizing the method for displaying a work cover, which can improve The probability that a user clicks to play a video.
第一方面,本公开实施例提供了一种作品封面显示方法,包括:In a first aspect, an embodiment of the present disclosure provides a method for displaying a work cover, including:
接收多媒体作品的获取请求;receive requests for access to multimedia works;
响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图;Acquiring a multimedia work in response to the acquisition request, the multimedia work including a dynamic cover image;
检测所述动态封面图是否存在显示异常;Detecting whether the dynamic cover image is displayed abnormally;
若检测到所述动态封面图存在显示异常,则将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。If it is detected that the dynamic cover image is displayed abnormally, the dynamic cover image is replaced with a static cover image, and the multimedia work including the replaced static cover image is returned.
可选的,在本公开的一些实施例中,所述检测所述动态封面图是否存在显示异常的步骤,包括:Optionally, in some embodiments of the present disclosure, the step of detecting whether there is an abnormal display of the dynamic cover image includes:
获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;Obtain consecutive N frames of images belonging to the dynamic cover image, where N is a natural number greater than 1;
确定所述连续N帧图像中任意相邻两帧图像的属性参数值,所述属性参数值与图像的像素相关;Determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images, the attribute parameter values are related to the pixels of the images;
在每个所述相邻两帧图像的属性参数值均大于或等于属性参数阈值时,确定所述动态封面图存在显示异常。When the attribute parameter values of each of the two adjacent frames of images are greater than or equal to the attribute parameter threshold, it is determined that the dynamic cover image has a display abnormality.
可选的,在本公开的一些实施例中,所述确定所述连续N帧图像中任意相邻两帧图像 的属性参数值的步骤,包括:Optionally, in some embodiments of the present disclosure, the step of determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images includes:
计算相邻两帧图像中每个对应像素点的像素差值;Calculate the pixel difference value of each corresponding pixel in two adjacent frames of images;
确定相邻两帧图像中目标像素点的数量,所述目标像素点是相邻两帧图像中像素差值大于预设像素阈值的像素点;Determining the number of target pixels in two adjacent frames of images, where the target pixels are pixels with a pixel difference greater than a preset pixel threshold in two adjacent frames of images;
计算所述目标像素点的数量与相邻两帧图像中任一图像的像素点总数的比值,将所述比值作为所述属性参数值。Calculate the ratio of the number of target pixels to the total number of pixels in any image in two adjacent frames of images, and use the ratio as the attribute parameter value.
可选的,在本公开的一些实施例中,所述计算相邻两帧图像中每个对应像素点的像素差值的步骤,包括:Optionally, in some embodiments of the present disclosure, the step of calculating the pixel difference of each corresponding pixel in two adjacent frames of images includes:
将相邻两帧图像分别预处理为对应的第一三通道图像和第二三通道图像;Preprocessing the adjacent two frames of images into corresponding first three-channel images and second three-channel images;
计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值;calculating the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image;
计算所述红色分量差值、绿色分量差值和蓝色分量差值各自绝对值的和值,并将该和值作为所述像素差值。calculating the sum of the absolute values of the red component difference, the green component difference and the blue component difference, and using the sum as the pixel difference.
可选的,在本公开的一些实施例中,所述计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值的步骤之前,所述方法还包括:Optionally, in some embodiments of the present disclosure, the calculating red component difference, green component difference and blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image Before the step of value, the method also includes:
将所述第一三通道图像和第二三通道图像中每个像素点的像素值归一化处理至预设数值范围。The pixel value of each pixel in the first three-channel image and the second three-channel image is normalized to a preset value range.
可选的,在本公开的一些实施例中,所述检测所述动态封面图是否存在显示异常的步骤,包括:Optionally, in some embodiments of the present disclosure, the step of detecting whether there is an abnormal display of the dynamic cover image includes:
获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;Obtain consecutive N frames of images belonging to the dynamic cover image, where N is a natural number greater than 1;
确定所述连续N帧图像中任意相邻两帧图像的相似度;Determine the similarity between any two adjacent frames of images in the continuous N frames of images;
在每个所述相邻两帧图像的相似度均大于或等于预设相似度阈值时,确定所述动态封面图存在显示异常。When the similarity between each of the two adjacent frames of images is greater than or equal to a preset similarity threshold, it is determined that the dynamic cover image has an abnormal display.
可选的,在本公开的一些实施例中,所述检测所述动态封面图是否存在显示异常的步骤,包括:Optionally, in some embodiments of the present disclosure, the step of detecting whether there is an abnormal display of the dynamic cover image includes:
获取归属于所述动态封面图的多帧图像;Acquiring multiple frames of images belonging to the dynamic cover image;
判断所述多帧图像中每帧图像是否相同;judging whether each frame of images in the multiple frames of images is the same;
在所述多帧图像中每帧图像均相同时,确定所述动态封面图存在显示异常。When each frame of images in the multiple frames of images is the same, it is determined that the dynamic cover image has a display abnormality.
可选的,在本公开的一些实施例中,所述多媒体作品有多个,所述检测所述动态封面图是否存在显示异常,包括:Optionally, in some embodiments of the present disclosure, there are multiple multimedia works, and the detecting whether the dynamic cover image is displayed abnormally includes:
检测多个所述多媒体作品各自的动态封面图是否存在显示异常;Detecting whether the dynamic cover images of the multiple multimedia works are displayed abnormally;
若检测到所述动态封面图存在显示异常,则将所述动态封面图替换为静态封面图,并返回包括所述静态封面图的多媒体作品,包括:If it is detected that the dynamic cover image is abnormally displayed, the dynamic cover image is replaced with a static cover image, and a multimedia work including the static cover image is returned, including:
将存在显示异常的目标多媒体作品的动态封面图替换为静态封面图,并返回包括替换后的静态封面图的目标多媒体作品以及剩余多媒体作品,所述剩余多媒体作品是多个所述多媒体作品中除所述目标多媒体作品之外的多媒体作品。Replace the dynamic cover image of the target multimedia work with an abnormal display with a static cover image, and return the target multimedia work including the replaced static cover image and the remaining multimedia works, the remaining multimedia works are all but one of the multiple multimedia works. A multimedia work other than the target multimedia work.
第二方面,本公开实施例提供了一种作品封面显示装置,包括:In the second aspect, an embodiment of the present disclosure provides a work cover display device, including:
请求接收模块,用于接收多媒体作品的获取请求;The request receiving module is used to receive the acquisition request of the multimedia work;
作品获取模块,用于响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图;A work acquisition module, configured to acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image;
异常检测模块,用于检测所述动态封面图是否存在显示异常;An abnormality detection module, configured to detect whether there is an abnormality in the display of the dynamic cover image;
替换展示模块,用于在所述异常检测模块检测到所述动态封面图存在显示异常时,将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。The replacement display module is configured to replace the dynamic cover image with a static cover image when the abnormality detection module detects that the dynamic cover image is displayed abnormally, and return the multimedia work including the replaced static cover image.
第三方面,本公开实施例提供一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述任一实施例所述作品封面显示方法的步骤。In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method for displaying a work cover described in any of the above-mentioned embodiments are implemented.
第四方面,本公开实施例提供一种电子设备,包括:In a fourth aspect, an embodiment of the present disclosure provides an electronic device, including:
处理器;以及processor; and
存储器,用于存储计算机程序;memory for storing computer programs;
其中,所述处理器配置为经由执行所述计算机程序来执行上述任一实施例所述作品封面显示方法的步骤。Wherein, the processor is configured to execute the steps of the work cover display method described in any one of the above embodiments by executing the computer program.
本公开实施例提供的技术方案与现有技术相比具有如下优点:Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have the following advantages:
本公开实施例提供的作品封面显示方法、装置、介质和电子设备,接收多媒体作品的获取请求,响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图,检测所述动态封面图是否存在显示异常,若检测到所述动态封面图存在显示异常,则将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。这样可以通过对多媒体作品的动态封面图的显示异常进行检测,当动态封面图存在显示异常时,将动态封面图替换为静态封面图,如此在动态封面图显示异常时可以减少数据流量的浪费;另外,该方法还能够解决动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当同时展示用户的视频作品集合时,显示页面的整体协调性较好,视觉观感好,能够增加用户点击播放视频的概率。The work cover display method, device, medium, and electronic device provided by the embodiments of the present disclosure receive an acquisition request of a multimedia work, respond to the acquisition request to acquire a multimedia work, the multimedia work includes a dynamic cover image, and detect whether the dynamic cover image is There is a display abnormality, and if it is detected that the dynamic cover image has a display abnormality, the dynamic cover image is replaced with a static cover image, and the multimedia work including the replaced static cover image is returned. In this way, the display abnormality of the dynamic cover image of the multimedia work can be detected. When the dynamic cover image has an abnormal display, the dynamic cover image can be replaced with a static cover image, so that the waste of data traffic can be reduced when the dynamic cover image displays abnormally; In addition, this method can also solve the flickering phenomenon of the dynamic cover image, so that the cover display of multimedia works such as videos has a better visual effect. When displaying the user's video works collection at the same time, the overall coordination of the displayed page is better and the visual perception is good. , which can increase the probability of the user clicking to play the video.
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.
为了更清楚地说明本公开实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.
图1为本公开实施例作品封面显示方法流程图;FIG. 1 is a flowchart of a method for displaying a work cover in an embodiment of the present disclosure;
图2为本公开另一实施例作品封面显示方法流程图;FIG. 2 is a flow chart of a method for displaying a work cover according to another embodiment of the present disclosure;
图3为本公开又一实施例作品封面显示方法流程图;Fig. 3 is a flow chart of a method for displaying a work cover according to another embodiment of the present disclosure;
图4为本公开再一实施例作品封面显示方法流程图;FIG. 4 is a flowchart of a method for displaying a work cover according to yet another embodiment of the present disclosure;
图5为本公开实施例作品封面显示装置示意图;FIG. 5 is a schematic diagram of a display device for a work cover in an embodiment of the present disclosure;
图6为本公开实施例实现作品封面显示方法的电子设备示意图。FIG. 6 is a schematic diagram of an electronic device implementing a method for displaying a work cover according to an embodiment of the present disclosure.
为了能够更清楚地理解本公开的上述目的、特征和优点,下面将对本公开的方案进行进一步描述。需要说明的是,在不冲突的情况下,本公开的实施例及实施例中的特征可以相互组合。In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.
在下面的描述中阐述了很多具体细节以便于充分理解本公开,但本公开还可以采用其他不同于在此描述的方式来实施;显然,说明书中的实施例只是本公开的一部分实施例,而不是全部的实施例。In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.
应当理解,在下文中,“至少一个(项)”是指一个或者多个,“多个”是指两个或两个以上。“和/或”用于描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:只存在A,只存在B以及同时存在A和B三种情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达,是指这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,“a和b”,“a和c”,“b和c”,或“a和b和c”,其中a,b,c可以是单个,也可以是多个。It should be understood that hereinafter, "at least one (item)" means one or more, and "multiple" means two or more. "And/or" is used to describe the association relationship of associated objects, which means that there can be three kinds of relationships, for example, "A and/or B" can mean: only A exists, only B exists, and A and B exist at the same time. Among them, A and B can be singular or plural. The character "/" generally indicates that the contextual objects are an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one item (piece) of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c ", where a, b, c can be single or multiple.
图1为本公开示例实施例示出的作品封面显示方法流程图,该作品封面显示方法可以由服务器执行,也可以由客户端执行。本实施例中以由服务器执行为例进行说明,该方法具体可以包括以下步骤:Fig. 1 is a flowchart of a method for displaying a work cover according to an example embodiment of the present disclosure. The method for displaying a work cover may be executed by a server or a client. In this embodiment, the execution by the server is taken as an example for illustration, and the method may specifically include the following steps:
步骤S101:接收多媒体作品的获取请求。Step S101: Receive a request for acquiring a multimedia work.
示例性的,服务器可以是客户端如智能手机上安装的例如视频应用程序对应的视频服务器。多媒体作品例如可以是但不限于音频作品或者视频作品,本实施例中以视频作品如短视频作品为例说明。Exemplarily, the server may be a client such as a video server corresponding to a video application program installed on a smart phone. A multimedia work may be, for example but not limited to, an audio work or a video work. In this embodiment, a video work such as a short video work is used as an example for illustration.
用户可以通过智能手机拍摄制作短视频作品,自定义设置短视频作品的封面图如静态封面图或者动态封面图,之后该制作的短视频作品可以通过视频应用程序发布上传至视频服务器,其他用户可以在自己的智能手机上开启视频应用程序从而从视频服务器获取自己或他人上传的短视频作品进行观看。Users can shoot and make short video works with their smartphones, and customize the cover image of the short video works, such as static cover images or dynamic cover images. After that, the short video works can be published and uploaded to the video server through the video application, and other users can Start the video application on your smartphone to obtain short video works uploaded by yourself or others from the video server for viewing.
具体的,作为一个示例,用户在点击开启视频应用程序之后,在视频应用程序的显示界面中例如点击一个用户的昵称等触发生成短视频作品的获取请求,获取请求可以包含用户标识如昵称或ID等。该获取请求由视频应用程序发送至视频服务器,即视频服务器接收获取请求。Specifically, as an example, after the user clicks to open the video application, in the display interface of the video application, for example, clicks on a user's nickname to trigger a request to generate a short video work. The request may include user identification such as nickname or ID wait. The acquisition request is sent to the video server by the video application, that is, the video server receives the acquisition request.
步骤S102:响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图。Step S102: Acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image.
具体的,视频服务器响应短视频作品的获取请求,从视频服务器中获取对应的用户的一个或多个短视频作品,例如基于用户标识获取对应的用户的一个短视频作品或多个短视频作品即视频作品集合,每个短视频作品可以包括动态封面图,动态封面图是从短视频作品中抽取的多帧图像构成的。Specifically, the video server responds to the acquisition request of the short video works, and obtains one or more short video works of the corresponding user from the video server, for example, based on the user identifier, one short video work or multiple short video works of the corresponding user are acquired. A collection of video works, each short video work can include a dynamic cover image, and the dynamic cover image is composed of multiple frames of images extracted from the short video work.
步骤S103:检测所述动态封面图是否存在显示异常。Step S103: Detect whether the dynamic cover image is displayed abnormally.
具体的,视频服务器获取短视频作品之后,对于短视频作品的动态封面图进行检测,判断动态封面图是否存在显示异常,显示异常例如实际是动态图但显示效果是静态的,或者出现跳闪现象,即构成动态封面图的相邻帧的图像差异过大,显示视觉效果较差。Specifically, after the video server obtains the short video work, it detects the dynamic cover image of the short video work to determine whether there is any abnormality in the display of the dynamic cover image. For example, the abnormal display is actually a dynamic image but the display effect is static, or there is a phenomenon of flickering , that is, the difference between the images of the adjacent frames constituting the dynamic cover image is too large, and the visual effect of the display is poor.
步骤S104:若检测到所述动态封面图存在显示异常,则将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。Step S104: If it is detected that the dynamic cover image is displayed abnormally, replace the dynamic cover image with a static cover image, and return the multimedia work including the replaced static cover image.
具体的,视频服务器检测确定短视频作品的动态封面图存在显示异常时,将所述动态封面图替换为静态封面图,也即替换了短视频作品,返回替换后的短视频作品至视频应用程序中显示。其中,该静态封面图可以是用户之前为其制作的短视频作品自定义设置的静态封面图,但也不限于此。Specifically, when the video server detects that the dynamic cover image of the short video work is displayed abnormally, it replaces the dynamic cover image with a static cover image, that is, replaces the short video work, and returns the replaced short video work to the video application program displayed in . Wherein, the static cover image may be a static cover image custom-set by the user for a short video work previously made by the user, but it is not limited thereto.
本公开实施例提供的上述作品封面显示方法,可以实现对多媒体作品的动态封面图的显示异常检测,当动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端显示替换后的短视频作品,解决了动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当客户端同时展示用户的视频作品集合时,显示页面的整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。The above-mentioned work cover display method provided by the embodiment of the present disclosure can realize the display abnormality detection of the dynamic cover image of a multimedia work. When the dynamic cover image has an abnormal display, directly replace the dynamic cover image with a static cover image, and then return to the replaced one. The short video works can be displayed in the video application, so when the dynamic cover image displays abnormally, the short video works returned include a static cover image instead of a dynamic cover image composed of multiple frames of images, which can reduce the waste of data traffic; in addition, The client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, and makes the cover display of multimedia works such as videos have better visual effects. When the client displays the user's video works collection at the same time, the overall coordination of the display page is displayed. It has good performance and good visual perception, which can increase the probability of users clicking to play videos to a certain extent.
可选的,在本公开的一些实施例中,参考图2中所示,步骤S103中检测所述动态封面图是否存在显示异常的步骤,具体可以包括以下步骤:Optionally, in some embodiments of the present disclosure, referring to FIG. 2 , the step of detecting whether the dynamic cover image is displayed abnormally in step S103 may specifically include the following steps:
步骤S201:获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数。Step S201: Obtain N consecutive frames of images belonging to the dynamic cover image, where N is a natural number greater than 1.
示例性的,例如N的取值是5,但不限于此。此时则可以获取构成动态封面图的连续5帧图像,如依序排列的图像1、图像2、图像3、图像4和图像5。Exemplarily, for example, the value of N is 5, but not limited thereto. At this time, five consecutive frames of images constituting the dynamic cover image can be acquired, such as image 1, image 2, image 3, image 4 and image 5 arranged in sequence.
步骤S202:确定所述连续N帧图像中任意相邻两帧图像的属性参数值,共得到(N-1)个相邻两帧图像的属性参数值,所述属性参数值与图像的像素相关。Step S202: Determine the attribute parameter values of any two adjacent frames of images in the continuous N frames of images, and obtain (N-1) attribute parameter values of two adjacent frames of images in total, and the attribute parameter values are related to the pixels of the images .
示例性的,确定连续5帧图像如图像1、图像2、图像3、图像4和图像5之后,确定相邻两帧图像的属性参数值,例如图像1和图像2的属性参数值1,图像2和图像3的属性参数值2,图像3和图像4的属性参数值3,以及图像4和图像5的属性参数值4,即共得到4个相邻两帧图像的属性参数值。Exemplarily, after determining five consecutive frames of images such as image 1, image 2, image 3, image 4, and image 5, determine the attribute parameter values of two adjacent frames of images, for example, the attribute parameter values of image 1 and image 2 are 1, and the image The attribute parameter value 2 of image 2 and image 3, the attribute parameter value 3 of image 3 and image 4, and the attribute parameter value 4 of image 4 and image 5, that is, a total of 4 attribute parameter values of two adjacent frames of images are obtained.
步骤S203:在每个所述相邻两帧图像的属性参数值均大于或等于属性参数阈值时,确定所述动态封面图存在显示异常。Step S203: When the attribute parameter values of each of the two adjacent frames of images are greater than or equal to the attribute parameter threshold, it is determined that the dynamic cover image has a display abnormality.
示例性的,在例如上述属性参数值1、属性参数值2、属性参数值3和属性参数值4均大于或等于属性参数阈值X时,确定动态封面图存在显示异常,然后返回执行步骤S104。Exemplarily, when the attribute parameter value 1, the attribute parameter value 2, the attribute parameter value 3 and the attribute parameter value 4 are all greater than or equal to the attribute parameter threshold value X, it is determined that the dynamic cover image is displayed abnormally, and then returns to step S104.
本公开实施例提供的上述作品封面显示方法,通过动态封面图中相邻两帧图像的属性参数值进行检测,可以较为准确地检测多媒体作品的动态封面图的显示异常,当检测到动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端显示替换后的短视频作品,解决了动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当客户端同时展示用户的视频作品集合时,显示页面的整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。The above method for displaying the cover of a work provided by the embodiment of the present disclosure detects the attribute parameter values of two adjacent frames of images in the dynamic cover image, and can more accurately detect the display abnormality of the dynamic cover image of a multimedia work. When the dynamic cover image is detected When there is an abnormal display, directly replace the dynamic cover image with a static cover image, and then return the replaced short video work to the video application for display, so that when the dynamic cover image displays abnormally, the returned short video work includes a frame of static cover image Instead of a dynamic cover image composed of multiple frames of images, it can reduce the waste of data traffic; in addition, the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image and makes the cover of multimedia works such as videos display visual effects Better, when the client side displays the user's video works collection at the same time, the overall coordination of the displayed page is better, the visual perception is good, and the probability of the user clicking to play the video can be increased to a certain extent.
可选的,在上述实施例的基础上,本公开的一些实施例中,如图3中所示,步骤S202 中确定所述连续N帧图像中任意相邻两帧图像的属性参数值的步骤,具体可以包括以下步骤:Optionally, on the basis of the above-mentioned embodiments, in some embodiments of the present disclosure, as shown in FIG. 3 , in step S202, the step of determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images , which may specifically include the following steps:
步骤S301:计算相邻两帧图像中每个对应像素点的像素差值。Step S301: Calculate the pixel difference value of each corresponding pixel in two adjacent frames of images.
可以理解的是,由于构成动态封面图的连续N帧图像均来自于短视频作品,因此每帧图像包含相同数量的像素点,例如图像1和图像2均包括10000个像素点,此处仅为举例说明,并不限于此。It is understandable that since the N consecutive frames of images constituting the dynamic cover image all come from short video works, each frame of images contains the same number of pixels, for example, image 1 and image 2 both contain 10,000 pixels, here only By way of example, not limitation.
在本实施例中,针对相邻两帧图像如图像1和图像2,计算图像1和图像2中每个对应像素点的像素差值,例如图像1中的像素点A对应图像2中的像素点A’,确定像素点A的像素值是P1,而像素点A’的像素值是P2,则像素差值P=P1-P2。图像1和图像2中其他像素点也是同样的方法确定像素差值,直至确定例如10000个像素差值。其他相邻两帧图像如图像2和图像3,图像3和图像4,以及图像4和图像5也是同样的计算方式确定像素差值,此处不再详述。In this embodiment, for two adjacent frames of images such as image 1 and image 2, the pixel difference value of each corresponding pixel in image 1 and image 2 is calculated, for example, pixel A in image 1 corresponds to a pixel in image 2 For point A', it is determined that the pixel value of pixel point A is P1, and the pixel value of pixel point A' is P2, then the pixel difference value P=P1-P2. The same method is used to determine the pixel difference values of other pixels in image 1 and image 2 until, for example, 10,000 pixel difference values are determined. Other two adjacent frames of images, such as image 2 and image 3, image 3 and image 4, and image 4 and image 5, also determine the pixel difference in the same calculation method, which will not be described in detail here.
步骤S302:确定相邻两帧图像中目标像素点的数量,所述目标像素点是相邻两帧图像中像素差值大于预设像素阈值的像素点。Step S302: Determine the number of target pixel points in two adjacent frames of images, where the target pixel points are pixels with a pixel difference greater than a preset pixel threshold in the two adjacent frames of images.
示例性的,预设像素阈值可以根据需要设置,对此不作限制。具体的,作为示例,通过上述方式确定例如图像1和图像2中10000个像素差值,然后从中选择像素差值大于预设像素阈值的像素点即目标像素点,最后统计目标像素点的数量,例如有9000个目标像素点。Exemplarily, the preset pixel threshold can be set as required, without limitation. Specifically, as an example, determine the difference between, for example, 10,000 pixels in image 1 and image 2 by the above method, and then select the pixel whose pixel difference is greater than the preset pixel threshold, that is, the target pixel, and finally count the number of target pixels, For example, there are 9000 target pixels.
步骤S303:计算所述目标像素点的数量与相邻两帧图像中任一图像的像素点总数的比值,将所述比值作为所述属性参数值。Step S303: Calculate the ratio of the number of target pixels to the total number of pixels in any one of the two adjacent frames of images, and use the ratio as the attribute parameter value.
具体的,计算目标像素点的数量如9000与相邻两帧图像中任一图像的像素点总数如10000的比值,即9000/10000=90%,该比值90%即为图像1和图像2的属性参数值1。其他相邻两帧图像的属性参数值的计算也是上述同样的过程。步骤S303之后即可跳转执行步骤S203,以判断动态封面图是否存在显示异常。Specifically, calculate the ratio of the number of target pixels, such as 9000, to the total number of pixels in any image in two adjacent frames of images, such as 10000, that is, 9000/10000=90%, and the ratio of 90% is the ratio of image 1 and image 2 The attribute parameter value is 1. The calculation of the attribute parameter values of other two adjacent frames of images is also the same process as above. After step S303, skip to step S203 to determine whether the dynamic cover image is displayed abnormally.
本公开实施例提供的上述作品封面显示方法,通过动态封面图中相邻两帧图像的像素差值确定属性参数值再进行检测,可以准确地检测多媒体作品的动态封面图的显示异常,当检测到动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端显示替换后的短视频作品,解决了动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当客户端同时展示用户的视频作品集合时,显示页面的整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。The method for displaying the cover of the work provided by the embodiment of the present disclosure can accurately detect the display abnormality of the dynamic cover picture of the multimedia work through the pixel difference between two adjacent frames of images in the dynamic cover picture to determine the value of the attribute parameter and then detect it. When the display of the dynamic cover image is abnormal, directly replace the dynamic cover image with the static cover image, and then return the replaced short video works to the video application for display. In this way, when the dynamic cover image displays abnormally, the returned short video works include a A frame static cover image instead of a dynamic cover image composed of multiple frames can reduce the waste of data traffic; in addition, the client displays the replaced short video work, which solves the flickering phenomenon of the dynamic cover image, making multimedia works such as video The visual effect of the cover display is better. When the client displays the user's video collection at the same time, the overall coordination of the displayed page is better, and the visual perception is good, which can increase the probability of the user clicking to play the video to a certain extent.
可选的,在上述实施例的基础上,本公开的一些实施例中,如图4中所示,上述步骤S301中计算相邻两帧图像中每个对应像素点的像素差值的步骤,具体可以包括以下步骤:Optionally, on the basis of the above-mentioned embodiments, in some embodiments of the present disclosure, as shown in FIG. 4 , the step of calculating the pixel difference value of each corresponding pixel point in the above-mentioned step S301 in two adjacent frames of images, Specifically, the following steps may be included:
步骤S401:将相邻两帧图像分别预处理为对应的第一三通道图像和第二三通道图像。Step S401: Preprocess two adjacent frames of images into corresponding first three-channel images and second three-channel images.
示例性的,第一三通道图像和第二三通道图像即红绿蓝(RGB)三通道图像。例如将相邻两帧图像1和图像2分别预处理为RGB三通道图像1和RGB三通道图像2。Exemplarily, the first three-channel image and the second three-channel image are red, green and blue (RGB) three-channel images. For example, two adjacent frames of image 1 and image 2 are preprocessed into RGB three-channel image 1 and RGB three-channel image 2 respectively.
步骤S402:计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值。Step S402: Calculate the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image.
示例性的,例如图像1即RGB三通道图像1中的像素点A对应图像2即RGB三通道图像2中的像素点A’,计算RGB三通道图像1和RGB三通道图像2中对应像素点(A和A’)的红色分量差值R、绿色分量差值G和蓝色分量差值B,R=R1-R2,G=G1-G2,B=B1-B2。Exemplarily, for example, pixel point A in image 1, that is, RGB three-channel image 1, corresponds to pixel point A' in image 2, that is, RGB three-channel image 2, and the corresponding pixel points in RGB three-channel image 1 and RGB three-channel image 2 are calculated (A and A') red component difference R, green component difference G and blue component difference B, R=R1-R2, G=G1-G2, B=B1-B2.
其中,R1是RGB三通道图像1中像素点A处的红色分量,R2是RGB三通道图像2中像素点A’处的红色分量,G1是RGB三通道图像1中像素点A处的绿色分量,G2是RGB三通道图像2中像素点A’处的绿色分量,B1是RGB三通道图像1中像素点A处的蓝色分量,B2是RGB三通道图像2中像素点A’处的蓝色分量。RGB三通道图像1与RGB三通道图像2中的其他像素点也依此方式确定红色分量差值、绿色分量差值和蓝色分量差值。Among them, R1 is the red component at pixel A in RGB three-channel image 1, R2 is the red component at pixel A' in RGB three-channel image 2, and G1 is the green component at pixel A in RGB three-channel image 1 , G2 is the green component at pixel A' in RGB three-channel image 2, B1 is the blue component at pixel A in RGB three-channel image 1, and B2 is the blue component at pixel A' in RGB three-channel image 2 color components. Other pixels in the RGB three-channel image 1 and the RGB three-channel image 2 also determine the red component difference, the green component difference and the blue component difference in this way.
步骤S403:计算所述红色分量差值、绿色分量差值和蓝色分量差值各自绝对值的和值,并将该和值作为所述像素差值。Step S403: Calculate the sum of the absolute values of the red component difference, the green component difference and the blue component difference, and use the sum as the pixel difference.
示例性的,计算得到RGB三通道图像1和RGB三通道图像2中对应像素点(A和A’)的红色分量差值R、绿色分量差值G和蓝色分量差值B之后,计算红色分量差值R、绿色分量差值G和蓝色分量差值B各自绝对值的和值H,H=|R|+|G|+|B|,将该和值H作为图像1和图像2中对应像素点如(A和A’)的像素差值,针对图像1和图像2中多个对应像素点,均会得到一个像素差值,例如上述的10000个像素差值。其他相邻两帧图像如图像2和图像3等的像素差值也可以基于此方式确定。步骤S403之后即可跳转执行上述步骤S302至步骤S303。Exemplarily, after calculating the red component difference R, the green component difference G and the blue component difference B of the corresponding pixels (A and A') in the RGB three-channel image 1 and the RGB three-channel image 2, calculate the red The sum H of the absolute values of the component difference R, the green component difference G and the blue component difference B, H=|R|+|G|+|B|, and the sum H is used as image 1 and image 2 For the pixel difference values of corresponding pixels in (A and A'), for multiple corresponding pixel points in image 1 and image 2, one pixel difference value will be obtained, for example, the above-mentioned 10000 pixel difference values. The pixel difference values of other two adjacent frames of images such as image 2 and image 3 can also be determined based on this method. After step S403, the above step S302 to step S303 can be executed.
本公开实施例提供的上述作品封面显示方法,通过将动态封面图中相邻两帧图像转换为三通道图像,然后基于对应像素点的红色分量差值、绿色分量差值和蓝色分量差值确定像素差值,进而确定属性参数值再进行检测,可以更准确地检测多媒体作品的动态封面图的显示异常,当检测到动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端显示替换后的短视频作品,解决了动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当客户端同时展示用户的视频作品集合时,显示页面的整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。The above-mentioned work cover display method provided by the embodiment of the present disclosure converts two adjacent frame images in the dynamic cover image into a three-channel image, and then based on the red component difference, green component difference and blue component difference of corresponding pixels Determine the pixel difference, and then determine the attribute parameter value before detection, which can more accurately detect the abnormal display of the dynamic cover image of the multimedia work. When the dynamic cover image is detected to have an abnormal display, directly replace the dynamic cover image with the static cover image , and then return the replaced short video work to the video application for display, so that when the dynamic cover image displays abnormally, the returned short video work includes a static cover image instead of a dynamic cover image composed of multiple frames of images, which can reduce data traffic In addition, the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, and makes the cover display of multimedia works such as videos have a better visual effect. When the client displays the user's video work collection at the same time, The overall coordination of the display page is good, and the visual perception is good, which can increase the probability of users clicking to play the video to a certain extent.
可选的,在本公开的一些实施例中,所述步骤S402中计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值之前,所述方法还可以包括:将所述第一三通道图像和第二三通道图像中每个像素点的像素值归一化处理至预设数值范围。Optionally, in some embodiments of the present disclosure, in the step S402, the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image are calculated. Before the color component difference, the method may further include: normalizing the pixel value of each pixel in the first three-channel image and the second three-channel image to a preset value range.
具体的,预设数值范围例如是0~1。本实施例中预先将第一三通道图像如RGB三通道图像1和第二三通道图像如RGB三通道图像2中每个像素点的像素值如红绿蓝分量值归一化处理至0~1的范围内,然后返回执行步骤S402,即计算第一三通道图像如RGB三通道图像1和第二三通道图像如RGB三通道图像2中每个对应像素点的红色分量差值、绿色分 量差值和蓝色分量差值。Specifically, the preset numerical range is, for example, 0-1. In this embodiment, the pixel values of each pixel in the first three-channel image such as RGB three-channel image 1 and the second three-channel image such as RGB three-channel image 2, such as the red, green and blue component values, are normalized to 0~ 1, then return to step S402, that is, calculate the red component difference and green component of each corresponding pixel in the first three-channel image such as RGB three-channel image 1 and the second three-channel image such as RGB three-channel image 2 Difference and Blue Component Difference.
本实施例中,通过将动态封面图中相邻两帧图像转换为三通道图像,然后将三通道图像中每个像素点的像素值归一化处理至预设数值范围,之后基于对应像素点的红色分量差值、绿色分量差值和蓝色分量差值确定像素差值,进而确定属性参数值再进行检测,可以更准确地检测多媒体作品的动态封面图的显示异常,同时,可以提高检测效率,在检测效率和准确性方面达到一定程度的兼顾平衡。当检测到动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端显示替换后的短视频作品,解决了动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当客户端同时展示用户的视频作品集合时,显示页面的整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。In this embodiment, two adjacent frames of images in the dynamic cover image are converted into a three-channel image, and then the pixel value of each pixel in the three-channel image is normalized to a preset value range, and then based on the corresponding pixel The red component difference, the green component difference and the blue component difference determine the pixel difference, and then determine the attribute parameter value before detection, which can more accurately detect the abnormal display of the dynamic cover image of the multimedia work, and at the same time, can improve the detection Efficiency, to achieve a certain degree of balance in terms of detection efficiency and accuracy. When an abnormal display of the dynamic cover image is detected, the dynamic cover image is directly replaced with a static cover image, and then the replaced short video work is returned to the video application for display, so the short video work returned when the dynamic cover image displays abnormally Including a static cover image instead of a dynamic cover image composed of multiple frames can reduce the waste of data traffic; in addition, the client displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, making multimedia works such as The cover display of the video has a better visual effect. When the client displays the user's video collection at the same time, the overall coordination of the displayed page is better and the visual perception is good, which can increase the probability of the user clicking to play the video to a certain extent.
可选的,在本公开的另一些实施例中,步骤S103中检测所述动态封面图是否存在显示异常的步骤,具体可包括以下步骤:获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;确定所述连续N帧图像中任意相邻两帧图像的相似度,共得到(N-1)个相邻两帧图像的相似度;在每个所述相邻两帧图像的相似度均大于或等于预设相似度阈值时,确定所述动态封面图存在显示异常。Optionally, in other embodiments of the present disclosure, the step of detecting whether the dynamic cover image has abnormal display in step S103 may specifically include the following steps: acquiring consecutive N frames of images belonging to the dynamic cover image, N is a natural number greater than 1; determine the similarity of any adjacent two frames of images in the continuous N frames of images, and obtain (N-1) the similarity of adjacent two frames of images; in each of the adjacent two frames of images When the similarity of the frame images is greater than or equal to the preset similarity threshold, it is determined that the dynamic cover image has an abnormal display.
示例性的,动态封面图例如包括连续5帧图像如图像1、图像2、图像3、图像4和图像5,确定相邻两帧图像的相似度,具体可以基于图像相似度算法确定相邻两帧图像的相似度。图像相似度算法可以包括但不限于SIFT(Scale Invariant Feature Transform)算法,具体可以参考现有技术理解,此处不再赘述。Exemplarily, the dynamic cover image includes, for example, five consecutive frames of images such as image 1, image 2, image 3, image 4, and image 5, and the similarity between two adjacent frames of images can be determined. Specifically, the two adjacent frames can be determined based on an image similarity algorithm. The similarity of frame images. The image similarity algorithm may include but not limited to the SIFT (Scale Invariant Feature Transform) algorithm, which can be understood with reference to the prior art, and will not be repeated here.
例如最终计算得到图像1和图像2的相似度1,图像2和图像3的相似度2,图像3和图像4的相似度3,以及图像4和图像5的相似度4,即共得到4个相邻两帧图像的相似度。在相似度1、相似度2、相似度3和相似度4均大于或等于预设相似度阈值Y时,确定动态封面图存在显示异常,然后返回执行步骤S104。其中预设相似度阈值可以根据需要设置,对此不作限制。For example, the final calculation results in the similarity 1 between image 1 and image 2, the similarity 2 between image 2 and image 3, the similarity 3 between image 3 and image 4, and the similarity 4 between image 4 and image 5, that is, a total of 4 The similarity between two adjacent frames of images. When the similarity 1, similarity 2, similarity 3 and similarity 4 are all greater than or equal to the preset similarity threshold Y, it is determined that the dynamic cover image is displayed abnormally, and then returns to step S104. The preset similarity threshold can be set as required, and there is no limit to this.
可选的,在本公开的又一些实施例中,步骤S103中检测所述动态封面图是否存在显示异常的步骤,具体可包括以下步骤:获取归属于所述动态封面图的多帧图像;判断所述多帧图像中每帧图像是否相同;在所述多帧图像中每帧图像均相同时,确定所述动态封面图存在显示异常。Optionally, in some other embodiments of the present disclosure, the step of detecting whether the dynamic cover image is abnormally displayed in step S103 may specifically include the following steps: acquiring multiple frames of images belonging to the dynamic cover image; judging Whether each frame of images in the multiple frames of images is the same; if each frame of images in the multiple frames of images is the same, it is determined that there is an abnormal display of the dynamic cover image.
示例性的,动态封面图例如包括5帧图像如图像1、图像2、图像3、图像4和图像5,判断图像1、图像2、图像3、图像4和图像5中每帧图像是否相同,例如基于图像内容进行判断,在图像1、图像2、图像3、图像4和图像5均相同时,确定动态封面图存在显示异常。然后返回执行步骤S104。Exemplarily, the dynamic cover image includes, for example, 5 frames of images such as image 1, image 2, image 3, image 4, and image 5, and it is determined whether each frame of images in image 1, image 2, image 3, image 4, and image 5 is the same, For example, the determination is made based on image content, and when the image 1, image 2, image 3, image 4, and image 5 are all the same, it is determined that the dynamic cover image has a display abnormality. Then return to step S104.
可选的,在本公开的一些实施例中,所述多媒体作品可以有多个,例如多个视频作品,但不限于此。所述方法还可以包括以下步骤:Optionally, in some embodiments of the present disclosure, there may be multiple multimedia works, such as multiple video works, but it is not limited thereto. The method may also include the steps of:
步骤1):检测多个所述多媒体作品各自的动态封面图是否存在显示异常。Step 1): Detect whether the dynamic cover images of each of the multiple multimedia works are displayed abnormally.
可以理解的是,本实施中可以同时对一个用户的多个短视频作品的动态封面图是否存在显示异常进行检测,具体检测方式可以参考前述实施例中的详细描述,此处不再赘述。It can be understood that in this implementation, it is possible to simultaneously detect whether the dynamic cover images of multiple short video works of a user have display abnormalities. The specific detection method can refer to the detailed description in the foregoing embodiments, and will not be repeated here.
步骤2):将存在显示异常的目标多媒体作品的动态封面图替换为静态封面图,并返回包括替换后的静态封面图的目标多媒体作品以及剩余多媒体作品,所述剩余多媒体作品是多个所述多媒体作品中除所述目标多媒体作品之外的多媒体作品。Step 2): Replace the dynamic cover image of the target multimedia work with an abnormal display with a static cover image, and return the target multimedia work including the replaced static cover image and the remaining multimedia works, the remaining multimedia works are multiple described A multimedia work other than the target multimedia work in the multimedia work.
具体的,在同时对多个短视频作品如10个短视频作品的动态封面图进行显示异常检测时,例如确定2个短视频作品的动态封面图存在显示异常,则将这2个短视频作品确定为目标短视频作品,2个目标短视频作品的动态封面图被替换为静态封面图,返回替换后的2个目标短视频作品以及剩余8个其余短视频作品至所述客户端如视频应用程序中显示。Specifically, when performing display abnormality detection on the dynamic cover images of multiple short video works such as 10 short video works at the same time, for example, if it is determined that the dynamic cover images of 2 short video works have abnormal display, the two short video works will be Determined as the target short video works, the dynamic cover images of the 2 target short video works are replaced with static cover images, and the replaced 2 target short video works and the remaining 8 other short video works are returned to the client such as a video application displayed in the program.
本公开实施例提供的上述作品封面显示方法,可以实现同时对多个短视频作品的动态封面图的显示异常检测,当动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品以及其余短视频作品即视频作品集合至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端同时展示用户的视频作品集合,显示的替换后的短视频作品的封面显示视觉效果较好,解决了动态封面图的跳闪现象,显示视频作品集合的页面的整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。The above method for displaying the cover of a work provided by the embodiment of the present disclosure can realize the abnormal display detection of the dynamic cover images of multiple short video works at the same time. When the dynamic cover images display abnormally, directly replace the dynamic cover images with static cover images, Then return the replaced short video works and other short video works, that is, the collection of video works to be displayed in the video application, so that when the dynamic cover image displays abnormally, the returned short video works include a frame of static cover image instead of multiple frames of images. The dynamic cover image can reduce the waste of data traffic; in addition, the client displays the user's video collection at the same time, and the displayed cover of the replaced short video works has a better visual effect, which solves the flickering phenomenon of the dynamic cover image and displays The overall coordination of the page of the video collection is good, and the visual perception is good, which can increase the probability of users clicking to play the video to a certain extent.
需要说明的是,尽管在附图中以特定顺序描述了本公开中方法的各个步骤,但是,这并非要求或者暗示必须按照该特定顺序来执行这些步骤,或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的,可以省略某些步骤,将多个步骤合并为一个步骤执行,以及/或者将一个步骤分解为多个步骤执行等。另外,也易于理解的是,这些步骤可以是例如在多个模块/进程/线程中同步或异步执行。It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be performed in this specific order, or that all shown steps must be performed to achieve achieve the desired result. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, etc. In addition, it is easy to understand that these steps may be executed synchronously or asynchronously in multiple modules/processes/threads, for example.
基于同一发明构思,本公开实施例还提供了一种作品封面显示装置,如图5所示作品封面显示装置可包括请求接收模块501、作品获取模块502、异常检测模块503和替换展示模块504:Based on the same inventive concept, the embodiment of the present disclosure also provides a work cover display device, as shown in Figure 5, the work cover display device may include a request receiving module 501, a work acquisition module 502, an abnormality detection module 503 and a replacement display module 504:
其中,请求接收模块501用于接收多媒体作品的获取请求。Wherein, the request receiving module 501 is used for receiving a request for acquiring a multimedia work.
作品获取模块502用于响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图。The work acquisition module 502 is configured to acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image.
异常检测模块503用于检测所述动态封面图是否存在显示异常。The anomaly detection module 503 is used to detect whether the dynamic cover image has display anomalies.
替换展示模块504用于在所述异常检测模块检测到所述动态封面图存在显示异常时,将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。The replacement display module 504 is configured to replace the dynamic cover image with a static cover image when the abnormality detection module detects that the dynamic cover image is displayed abnormally, and return the multimedia work including the replaced static cover image.
本公开实施例提供的作品封面显示装置,可以实现对多媒体作品的动态封面图的显示异常检测,当动态封面图存在显示异常时,直接将动态封面图替换为静态封面图,之后返回替换后的短视频作品至视频应用程序中显示,如此在动态封面图显示异常时返回的短视频作品包括一帧静态封面图而不是多帧图像构成的动态封面图,可以减少数据流量的浪费;另外,客户端显示替换后的短视频作品,解决了动态封面图的跳闪现象,使得多媒体作品如视频的封面显示视觉效果较好,当客户端同时展示用户的视频作品集合时,显示页面的 整体协调性较好,视觉观感好,在一定程度上可增加用户点击播放视频的概率。The work cover display device provided by the embodiment of the present disclosure can realize the display abnormality detection of the dynamic cover image of the multimedia work. When the dynamic cover image has a display abnormality, it directly replaces the dynamic cover image with the static cover image, and then returns the replaced one. The short video works are displayed in the video application, so when the dynamic cover image displays abnormally, the returned short video work includes a static cover image instead of a dynamic cover image composed of multiple frames, which can reduce the waste of data traffic; in addition, the customer The terminal displays the replaced short video works, which solves the flickering phenomenon of the dynamic cover image, and makes the cover display of multimedia works such as videos have a better visual effect. When the client displays the user's video works collection at the same time, it shows the overall coordination of the page Better, the visual perception is good, and to a certain extent, it can increase the probability of users clicking to play the video.
可选的,在本公开的一些实施例中,所述异常检测模块503检测所述动态封面图是否存在显示异常,包括:获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;确定所述连续N帧图像中任意相邻两帧图像的属性参数值,共得到(N-1)个相邻两帧图像的属性参数值,所述属性参数值与图像的像素相关;在每个所述相邻两帧图像的属性参数值均大于或等于属性参数阈值时,确定所述动态封面图存在显示异常。Optionally, in some embodiments of the present disclosure, the anomaly detection module 503 detects whether there is an abnormal display of the dynamic cover image, including: acquiring consecutive N frames of images belonging to the dynamic cover image, where N is greater than 1 A natural number; determine the attribute parameter values of any adjacent two frame images in the continuous N frame images, and obtain (N-1) attribute parameter values of adjacent two frame images, and the attribute parameter values are related to the pixels of the image ; When the attribute parameter values of each of the two adjacent frames of images are greater than or equal to the attribute parameter threshold, it is determined that the dynamic cover image has an abnormal display.
可选的,在本公开的一些实施例中,所述异常检测模块503确定所述连续N帧图像中任意相邻两帧图像的属性参数值,包括:计算相邻两帧图像中每个对应像素点的像素差值;确定相邻两帧图像中目标像素点的数量,所述目标像素点是相邻两帧图像中像素差值大于预设像素阈值的像素点;计算所述目标像素点的数量与相邻两帧图像中任一图像的像素点总数的比值,将所述比值作为所述属性参数值。Optionally, in some embodiments of the present disclosure, the anomaly detection module 503 determines attribute parameter values of any two adjacent frames of images in the continuous N frames of images, including: calculating each corresponding The pixel difference value of the pixel point; determine the number of target pixel points in two adjacent frames of images, and the target pixel point is a pixel point with a pixel difference value greater than a preset pixel threshold in two adjacent frame images; calculate the target pixel point The ratio of the number of pixels to the total number of pixels in any image in two adjacent frames of images is used as the attribute parameter value.
可选的,在本公开的一些实施例中,所述异常检测模块503计算相邻两帧图像中每个对应像素点的像素差值,包括:将相邻两帧图像分别预处理为对应的第一三通道图像和第二三通道图像;计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值;计算所述红色分量差值、绿色分量差值和蓝色分量差值各自绝对值的和值,并将该和值作为所述像素差值。Optionally, in some embodiments of the present disclosure, the anomaly detection module 503 calculates the pixel difference of each corresponding pixel in two adjacent frames of images, including: preprocessing the two adjacent frames of images into corresponding The first three-channel image and the second three-channel image; calculate the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image; calculate The sum of the absolute values of the red component difference, the green component difference and the blue component difference is used as the pixel difference.
可选的,在本公开的一些实施例中,所述装置还可包括归一化处理模块,用于在所述异常检测模块503计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值之前,将所述第一三通道图像和第二三通道图像中每个像素点的像素值归一化处理至预设数值范围。Optionally, in some embodiments of the present disclosure, the device may further include a normalization processing module, which is used to calculate, in the abnormality detection module 503, each of the first three-channel image and the second three-channel image Before the red component difference, green component difference and blue component difference of corresponding pixels, the pixel value of each pixel in the first three-channel image and the second three-channel image is normalized to the preset Set the value range.
可选的,在本公开的另一些实施例中,所述异常检测模块503检测所述动态封面图是否存在显示异常,包括:获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;确定所述连续N帧图像中任意相邻两帧图像的相似度,共得到(N-1)个相邻两帧图像的相似度;在每个所述相邻两帧图像的相似度均大于或等于预设相似度阈值时,确定所述动态封面图存在显示异常。Optionally, in other embodiments of the present disclosure, the anomaly detection module 503 detects whether there is an abnormal display of the dynamic cover image, including: acquiring consecutive N frames of images belonging to the dynamic cover image, where N is greater than A natural number of 1; determine the similarity of any adjacent two frames of images in the continuous N frames of images, and obtain (N-1) the similarity of adjacent two frames of images; in each of the adjacent two frames of images When the similarities are greater than or equal to the preset similarity threshold, it is determined that the dynamic cover image is displayed abnormally.
可选的,在本公开的又一些实施例中,所述异常检测模块503检测所述动态封面图是否存在显示异常,包括:获取归属于所述动态封面图的多帧图像;判断所述多帧图像中每帧图像是否相同;在所述多帧图像中每帧图像均相同时,确定所述动态封面图存在显示异常。Optionally, in some other embodiments of the present disclosure, the anomaly detection module 503 detects whether the dynamic cover image has display anomalies, including: acquiring multiple frames of images belonging to the dynamic cover image; Whether each frame image in the frame images is the same; when each frame image in the multiple frame images is the same, it is determined that the dynamic cover image has a display abnormality.
可选的,在本公开的一些实施例中,所述多媒体作品有多个,所述异常检测模块503还用于:检测多个所述多媒体作品各自的动态封面图是否存在显示异常;所述替换展示模块504还用于将异常检测模块503检测的存在显示异常的目标多媒体作品的动态封面图替换为静态封面图,并返回包括替换后的静态封面图的目标多媒体作品以及剩余多媒体作品,所述剩余多媒体作品是多个所述多媒体作品中除所述目标多媒体作品之外的多媒体作品。Optionally, in some embodiments of the present disclosure, there are multiple multimedia works, and the anomaly detection module 503 is further configured to: detect whether the dynamic cover images of each of the multiple multimedia works are displayed abnormally; The replacement display module 504 is also used to replace the dynamic cover image of the abnormally displayed target multimedia work detected by the abnormality detection module 503 with a static cover image, and return the target multimedia work including the replaced static cover image and the remaining multimedia works, so The remaining multimedia works are multimedia works other than the target multimedia work among the plurality of multimedia works.
关于上述实施例中的装置,其中各个模块执行操作的具体方式以及带来的相应技术效果已经在有关该方法的实施例中进行了对应的详细描述,此处将不做详细阐述说明。With regard to the apparatus in the above embodiments, the specific manner in which each module performs operations and the corresponding technical effects brought about have been described in detail in the embodiments related to the method, and will not be described in detail here.
应当注意,尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元, 但是这种划分并非强制性的。实际上,根据本公开的实施方式,上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之,上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。作为模块或单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现木公开方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. Actually, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided to be embodied by a plurality of modules or units. Components shown as modules or units may or may not be physical units, may be located in one place, or may be distributed over multiple network elements. Part or all of the modules can be selected according to actual needs to realize the purpose of the disclosed scheme. It can be understood and implemented by those skilled in the art without creative effort.
本公开实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述任一项实施例所述作品封面显示方法的步骤。The embodiments of the present disclosure also provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method for displaying a work cover described in any one of the above-mentioned embodiments are implemented.
示例性的,该可读存储介质例如可以为但不限于电、磁、光、电磁、红外线、或半导体的***、装置或器件,或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。Exemplarily, the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
所述计算机可读存储介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了可读程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。可读存储介质还可以是可读存储介质以外的任何可读介质,该可读介质可以发送、传播或者传输用于由指令执行***、装置或者器件使用或者与其结合使用的程序。可读存储介质上包含的程序代码可以用任何适当的介质传输,包括但不限于无线、有线、光缆、RF等等,或者上述的任意合适的组合。The computer readable storage medium may include a data signal carrying readable program code in baseband or as part of a carrier wave traveling as a data signal. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium other than a readable storage medium that can send, propagate or transport a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the readable storage medium may be transmitted by any suitable medium, including but not limited to wireless, cable, optical cable, RF, etc., or any suitable combination of the above.
本公开实施例还提供一种电子设备,包括处理器以及存储器,存储器用于存储计算机程序。其中,所述处理器配置为经由执行所述计算机程序来执行上述任一项实施例中所述作品封面显示方法的步骤。An embodiment of the present disclosure also provides an electronic device, including a processor and a memory, where the memory is used to store a computer program. Wherein, the processor is configured to execute the steps of the work cover display method in any one of the above embodiments by executing the computer program.
下面参照图6来描述根据本发明的这种实施方式的电子设备600。图6显示的电子设备600仅仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。An electronic device 600 according to this embodiment of the present invention is described below with reference to FIG. 6 . The electronic device 600 shown in FIG. 6 is only an example, and should not limit the functions and scope of use of this embodiment of the present invention.
如图6所示,电子设备600以通用计算设备的形式表现。电子设备600的组件可以包括但不限于:至少一个处理单元610、至少一个存储单元620、连接不同***组件(包括存储单元620和处理单元610)的总线630、显示单元640等。As shown in FIG. 6, electronic device 600 takes the form of a general-purpose computing device. Components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640, and the like.
其中,所述存储单元存储有程序代码,所述程序代码可以被所述处理单元610执行,使得所述处理单元610执行本说明书上述作品封面显示方法部分中描述的根据本发明各种示例性实施方式的步骤。例如,所述处理单元610可以执行如图1中所示作品封面显示方法的步骤。Wherein, the storage unit stores program codes, and the program codes can be executed by the processing unit 610, so that the processing unit 610 executes the various exemplary implementations according to the present invention described in the above-mentioned part of the work cover display method in this specification. way steps. For example, the processing unit 610 may execute the steps of the method for displaying a work cover as shown in FIG. 1 .
所述存储单元620可以包括易失性存储单元形式的可读介质,例如随机存取存储单元(RAM)6201和/或高速缓存存储单元6202,还可以进一步包括只读存储单元(ROM)6203。The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 6201 and/or a cache storage unit 6202 , and may further include a read-only storage unit (ROM) 6203 .
所述存储单元620还可以包括具有一组(至少一个)程序模块6205的程序/实用工具6204,这样的程序模块6205包括但不限于:操作***、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。The storage unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include the implementation of the network environment.
总线630可以为表示几类总线结构中的一种或多种,包括存储单元总线或者存储单元 控制器、***总线、图形加速端口、处理单元或者使用多种总线结构中的任意总线结构的局域总线。 Bus 630 may represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local area using any of a variety of bus structures. bus.
电子设备600也可以与一个或多个外部设备700(例如键盘、指向设备、蓝牙设备等)通信,还可与一个或者多个使得用户能与该电子设备600交互的设备通信,和/或与使得该电子设备600能与一个或多个其它计算设备进行通信的任何设备(例如路由器、调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口650进行。并且,电子设备600还可以通过网络适配器660与一个或者多个网络(例如局域网(LAN),广域网(WAN)和/或公共网络,例如因特网)通信。网络适配器660可以通过总线630与电子设备600的其它模块通信。应当明白,尽管图中未示出,可以结合电子设备600使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID***、磁带驱动器以及数据备份存储***等。The electronic device 600 can also communicate with one or more external devices 700 (such as keyboards, pointing devices, Bluetooth devices, etc.), and can also communicate with one or more devices that enable the user to interact with the electronic device 600, and/or communicate with Any device (eg, router, modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 650 . Moreover, the electronic device 600 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and/or a public network such as the Internet) through the network adapter 660 . The network adapter 660 can communicate with other modules of the electronic device 600 through the bus 630 . It should be appreciated that although not shown, other hardware and/or software modules may be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.
通过以上的实施方式的描述,本领域的技术人员易于理解,这里描述的示例实施方式可以通过软件实现,也可以通过软件结合必要的硬件的方式来实现。因此,根据本公开实施方式的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中或网络上,包括若干指令以使得一台计算设备(可以是个人计算机、服务器、或者网络设备等)执行根据本公开实施方式的上述作品封面显示方法。Through the description of the above implementations, those skilled in the art can easily understand that the example implementations described here can be implemented by software, or can be implemented by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of software products, and the software products can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the above method for displaying a work cover according to an embodiment of the present disclosure.
需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relative terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these No such actual relationship or order exists between entities or operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.
以上所述仅是本公开的具体实施方式,使本领域技术人员能够理解或实现本公开。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本公开的精神或范围的情况下,在其它实施例中实现。因此,本公开将不会被限制于本文所述的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above descriptions are only specific implementation manners of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (11)
- 一种作品封面显示方法,其特征在于,包括:A method for displaying a work cover, characterized by comprising:接收多媒体作品的获取请求;receive requests for access to multimedia works;响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图;Acquiring a multimedia work in response to the acquisition request, the multimedia work including a dynamic cover image;检测所述动态封面图是否存在显示异常;Detecting whether the dynamic cover image is displayed abnormally;若检测到所述动态封面图存在显示异常,则将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。If it is detected that the dynamic cover image is displayed abnormally, the dynamic cover image is replaced with a static cover image, and the multimedia work including the replaced static cover image is returned.
- 根据权利要求1所述的作品封面显示方法,其特征在于,所述检测所述动态封面图是否存在显示异常的步骤,包括:The method for displaying the cover of a work according to claim 1, wherein the step of detecting whether there is an abnormal display of the dynamic cover image includes:获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;Obtain consecutive N frames of images belonging to the dynamic cover image, where N is a natural number greater than 1;确定所述连续N帧图像中任意相邻两帧图像的属性参数值,所述属性参数值与图像的像素相关;Determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images, the attribute parameter values are related to the pixels of the images;在每个所述相邻两帧图像的属性参数值均大于或等于属性参数阈值时,确定所述动态封面图存在显示异常。When the attribute parameter values of each of the two adjacent frames of images are greater than or equal to the attribute parameter threshold, it is determined that the dynamic cover image has a display abnormality.
- 根据权利要求2所述的作品封面显示方法,其特征在于,所述确定所述连续N帧图像中任意相邻两帧图像的属性参数值的步骤,包括:The method for displaying the cover of a work according to claim 2, wherein the step of determining the attribute parameter values of any two adjacent frames of images in the continuous N frames of images comprises:计算相邻两帧图像中每个对应像素点的像素差值;Calculate the pixel difference value of each corresponding pixel in two adjacent frames of images;确定相邻两帧图像中目标像素点的数量,所述目标像素点是相邻两帧图像中像素差值大于预设像素阈值的像素点;Determining the number of target pixels in two adjacent frames of images, where the target pixels are pixels with a pixel difference greater than a preset pixel threshold in two adjacent frames of images;计算所述目标像素点的数量与相邻两帧图像中任一图像的像素点总数的比值,将所述比值作为所述属性参数值。Calculate the ratio of the number of target pixels to the total number of pixels in any image in two adjacent frames of images, and use the ratio as the attribute parameter value.
- 根据权利要求3所述的作品封面显示方法,其特征在于,所述计算相邻两帧图像中每个对应像素点的像素差值的步骤,包括:The method for displaying the cover of a work according to claim 3, wherein the step of calculating the pixel difference of each corresponding pixel in two adjacent frames of images comprises:将相邻两帧图像分别预处理为对应的第一三通道图像和第二三通道图像;Preprocessing the adjacent two frames of images into corresponding first three-channel images and second three-channel images;计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值;calculating the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image;计算所述红色分量差值、绿色分量差值和蓝色分量差值各自绝对值的和值,并将该和值作为所述像素差值。calculating the sum of the absolute values of the red component difference, the green component difference and the blue component difference, and using the sum as the pixel difference.
- 根据权利要求4所述的作品封面显示方法,其特征在于,所述计算所述第一三通道图像和第二三通道图像中每个对应像素点的红色分量差值、绿色分量差值和蓝色分量差值的步骤之前,所述方法还包括:The method for displaying the cover of a work according to claim 4, wherein said calculating the red component difference, the green component difference and the blue component difference of each corresponding pixel in the first three-channel image and the second three-channel image Before the step of color component difference, the method also includes:将所述第一三通道图像和第二三通道图像中每个像素点的像素值归一化处理至预设数值范围。The pixel value of each pixel in the first three-channel image and the second three-channel image is normalized to a preset value range.
- 根据权利要求1所述的作品封面显示方法,其特征在于,所述检测所述动态封面图是否存在显示异常的步骤,包括:The method for displaying the cover of a work according to claim 1, wherein the step of detecting whether there is an abnormal display of the dynamic cover image includes:获取归属于所述动态封面图的连续N帧图像,N是大于1的自然数;Obtain consecutive N frames of images belonging to the dynamic cover image, where N is a natural number greater than 1;确定所述连续N帧图像中任意相邻两帧图像的相似度;Determine the similarity between any two adjacent frames of images in the continuous N frames of images;在每个所述相邻两帧图像的相似度均大于或等于预设相似度阈值时,确定所述动态封面图存在显示异常。When the similarity between each of the two adjacent frames of images is greater than or equal to a preset similarity threshold, it is determined that the dynamic cover image has an abnormal display.
- 根据权利要求1所述的作品封面显示方法,其特征在于,所述检测所述动态封面图是否存在显示异常的步骤,包括:The method for displaying the cover of a work according to claim 1, wherein the step of detecting whether there is an abnormal display of the dynamic cover image includes:获取归属于所述动态封面图的多帧图像;Acquiring multiple frames of images belonging to the dynamic cover image;判断所述多帧图像中每帧图像是否相同;judging whether each frame of images in the multiple frames of images is the same;在所述多帧图像中每帧图像均相同时,确定所述动态封面图存在显示异常。When each frame of images in the multiple frames of images is the same, it is determined that the dynamic cover image has a display abnormality.
- 根据权利要求1~7任一项所述的作品封面显示方法,其特征在于,所述多媒体作品有多个,所述检测所述动态封面图是否存在显示异常,包括:The method for displaying the cover of a work according to any one of claims 1 to 7, characterized in that there are multiple multimedia works, and the detection of whether the dynamic cover image is displayed abnormally includes:检测多个所述多媒体作品各自的动态封面图是否存在显示异常;Detecting whether the dynamic cover images of the multiple multimedia works are displayed abnormally;若检测到所述动态封面图存在显示异常,则将所述动态封面图替换为静态封面图,并返回包括所述静态封面图的多媒体作品,包括:If it is detected that the dynamic cover image is abnormally displayed, the dynamic cover image is replaced with a static cover image, and a multimedia work including the static cover image is returned, including:将存在显示异常的目标多媒体作品的动态封面图替换为静态封面图,并返回包括替换后的静态封面图的目标多媒体作品以及剩余多媒体作品,所述剩余多媒体作品是多个所述多媒体作品中除所述目标多媒体作品之外的多媒体作品。Replace the dynamic cover image of the target multimedia work with an abnormal display with a static cover image, and return the target multimedia work including the replaced static cover image and the remaining multimedia works, the remaining multimedia works are all but one of the multiple multimedia works. A multimedia work other than the target multimedia work.
- 一种作品封面显示装置,其特征在于,包括:A work cover display device, characterized in that it includes:请求接收模块,用于接收多媒体作品的获取请求;The request receiving module is used to receive the acquisition request of the multimedia work;作品获取模块,用于响应所述获取请求获取多媒体作品,所述多媒体作品包括动态封面图;A work acquisition module, configured to acquire a multimedia work in response to the acquisition request, and the multimedia work includes a dynamic cover image;异常检测模块,用于检测所述动态封面图是否存在显示异常;An abnormality detection module, configured to detect whether there is an abnormality in the display of the dynamic cover image;替换展示模块,用于在所述异常检测模块检测到所述动态封面图存在显示异常时,将所述动态封面图替换为静态封面图,并返回包括替换后的静态封面图的多媒体作品。The replacement display module is configured to replace the dynamic cover image with a static cover image when the abnormality detection module detects that the dynamic cover image is displayed abnormally, and return the multimedia work including the replaced static cover image.
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该计算机程序被处理器执行时实现权利要求1~8任一项所述作品封面显示方法的步骤。A computer-readable storage medium, on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the method for displaying the cover of a work described in any one of claims 1-8 are realized.
- 一种电子设备,其特征在于,包括:An electronic device, characterized in that it comprises:处理器;以及processor; and存储器,用于存储计算机程序;memory for storing computer programs;其中,所述处理器配置为经由执行所述计算机程序来执行权利要求1~8任一项所述作品封面显示方法的步骤。Wherein, the processor is configured to execute the steps of the work cover display method according to any one of claims 1-8 by executing the computer program.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110875204.X | 2021-07-30 | ||
CN202110875204.XA CN113535993A (en) | 2021-07-30 | 2021-07-30 | Work cover display method, device, medium and electronic equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023005421A1 true WO2023005421A1 (en) | 2023-02-02 |
Family
ID=78089989
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/096850 WO2023005421A1 (en) | 2021-07-30 | 2022-06-02 | Work cover display method, device, medium and electronic apparatus |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113535993A (en) |
WO (1) | WO2023005421A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113535993A (en) * | 2021-07-30 | 2021-10-22 | 北京字跳网络技术有限公司 | Work cover display method, device, medium and electronic equipment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110071977A1 (en) * | 2009-09-18 | 2011-03-24 | Apple Inc. | Segmented graphical representations for recommending elements |
CN105159639A (en) * | 2015-08-21 | 2015-12-16 | 小米科技有限责任公司 | Audio cover displaying method and apparatus |
CN106998477A (en) * | 2017-04-05 | 2017-08-01 | 腾讯科技(深圳)有限公司 | The front cover display methods and device of live video |
CN113160083A (en) * | 2021-04-19 | 2021-07-23 | 广州欢网科技有限责任公司 | Media asset video cover map optimization method, device, equipment and storage medium |
CN113535993A (en) * | 2021-07-30 | 2021-10-22 | 北京字跳网络技术有限公司 | Work cover display method, device, medium and electronic equipment |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030142955A1 (en) * | 1997-09-12 | 2003-07-31 | Aki Hashizume | Apparatus for correcting an abnormality of video signal of a video system, its method, and recording medium storing the method |
CN103281559A (en) * | 2013-05-31 | 2013-09-04 | 于京 | Method and system for detecting quality of video |
CN105100886B (en) * | 2014-04-22 | 2019-03-15 | 腾讯科技(北京)有限公司 | Distribution control method and device, the server and system of network media information |
CN106375755B (en) * | 2016-08-31 | 2018-12-28 | 福建省天奕网络科技有限公司 | A kind of video data Caton detection method and system |
CA2965925C (en) * | 2016-09-06 | 2020-04-14 | Remote Media, Llc | System, method, and application for exchanging content in a social network environment |
CN108062507B (en) * | 2016-11-08 | 2024-02-27 | 中兴通讯股份有限公司 | Video processing method and device |
JP2020010300A (en) * | 2018-07-12 | 2020-01-16 | キヤノン株式会社 | Video generating device and control method therefor and program |
CN111246272A (en) * | 2020-01-17 | 2020-06-05 | 北京达佳互联信息技术有限公司 | Method and device for displaying video cover picture |
-
2021
- 2021-07-30 CN CN202110875204.XA patent/CN113535993A/en active Pending
-
2022
- 2022-06-02 WO PCT/CN2022/096850 patent/WO2023005421A1/en unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110071977A1 (en) * | 2009-09-18 | 2011-03-24 | Apple Inc. | Segmented graphical representations for recommending elements |
CN105159639A (en) * | 2015-08-21 | 2015-12-16 | 小米科技有限责任公司 | Audio cover displaying method and apparatus |
CN106998477A (en) * | 2017-04-05 | 2017-08-01 | 腾讯科技(深圳)有限公司 | The front cover display methods and device of live video |
CN113160083A (en) * | 2021-04-19 | 2021-07-23 | 广州欢网科技有限责任公司 | Media asset video cover map optimization method, device, equipment and storage medium |
CN113535993A (en) * | 2021-07-30 | 2021-10-22 | 北京字跳网络技术有限公司 | Work cover display method, device, medium and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
CN113535993A (en) | 2021-10-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11425454B2 (en) | Dynamic video overlays | |
CN109993627B (en) | Recommendation method, recommendation model training device and storage medium | |
CN112765478B (en) | Method, apparatus, device, medium and program product for recommending content | |
CN114882321A (en) | Deep learning model training method, target object detection method and device | |
WO2023005421A1 (en) | Work cover display method, device, medium and electronic apparatus | |
CN112035320A (en) | Service monitoring method and device, electronic equipment and readable storage medium | |
WO2023273017A1 (en) | Method for identifying clarity of well logging image, apparatus, medium, and electronic device | |
US9208596B2 (en) | Intelligent merging of visualizations | |
CN108932703B (en) | Picture processing method, picture processing device and terminal equipment | |
CN114168793A (en) | Anchor display method, device, equipment and storage medium | |
CN113837194A (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
US20190332859A1 (en) | Method for identifying main picture in web page | |
CN112784861B (en) | Similarity determination method, device, electronic equipment and storage medium | |
CN108932704B (en) | Picture processing method, picture processing device and terminal equipment | |
CN116468479A (en) | Method for determining page quality evaluation dimension, and page quality evaluation method and device | |
CN115168732A (en) | Resource recommendation method, device, equipment and storage medium | |
CN114510185A (en) | Virtual object recommendation method, medium, device and computing equipment | |
CN113313642A (en) | Image denoising method and device, storage medium and electronic equipment | |
CN110992903B (en) | Display screen backlight brightness adjusting method and device, computer equipment and medium | |
CN113515701A (en) | Information recommendation method and device | |
CN111680628A (en) | Text box fusion method, device, equipment and storage medium | |
CN111984839A (en) | Method and apparatus for rendering a user representation | |
CN114428578B (en) | Method and device for dynamically selecting page elements in frame mode | |
WO2024020858A1 (en) | Surface construction method and apparatus, electronic device and medium | |
CN113988893B (en) | Commodity information processing method, device, equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22848031 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |