CN109089157A - Method of cutting out, display equipment and the device of video pictures - Google Patents

Method of cutting out, display equipment and the device of video pictures Download PDF

Info

Publication number
CN109089157A
CN109089157A CN201810623302.2A CN201810623302A CN109089157A CN 109089157 A CN109089157 A CN 109089157A CN 201810623302 A CN201810623302 A CN 201810623302A CN 109089157 A CN109089157 A CN 109089157A
Authority
CN
China
Prior art keywords
picture
cut
fisrt feature
display
crop box
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810623302.2A
Other languages
Chinese (zh)
Other versions
CN109089157B (en
Inventor
王云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huaduo Network Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201810623302.2A priority Critical patent/CN109089157B/en
Publication of CN109089157A publication Critical patent/CN109089157A/en
Application granted granted Critical
Publication of CN109089157B publication Critical patent/CN109089157B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application provides method of cutting out, display equipment and the device of video pictures, the method comprise the steps that acquiring picture to be cut.Fisrt feature is identified in the picture to be cut.The crop box that the picture to be cut is determined according to the fisrt feature, wherein the fisrt feature is contained in the crop box.Picture after being cut using the crop box to the picture wait cut, and the picture after the cutting is shown in display equipment.By the above-mentioned means, the application can effectively promote video viewing experience.

Description

Method of cutting out, display equipment and the device of video pictures
Technical field
This application involves technical field of video processing, more particularly to the method for cutting out of video pictures, display equipment and Device.
Background technique
Quick universal with smart machine with the development of internet technology, people can easily pass through smart machine very much Video chat is carried out, or watches video program online, such as the online live streaming of viewing.
Present invention is fixed, rough slave original video by the discovery that studies for a long period of time, existing method for processing video frequency Middle section cut, without consider picture content.And in fact, the weight of visual focus or original video in original video Point content, it is not necessarily placed in the middle, it is possible to cause focus or intermediate portions, such as the upper part of the body of other side to be reduced, And can only see the lower part of the body, the picture after cutting substantially loses the meaning of viewing, very influence viewing experience.
Summary of the invention
The application is mainly solving the technical problems that provide the method for cutting out of video pictures, display equipment and device, energy It is enough effectively to promote video viewing experience.
In order to solve the above technical problems, the application provides a kind of method of cutting out of video pictures, comprising:
Acquire picture to be cut.
Fisrt feature is identified in the picture to be cut.
The crop box that the picture to be cut is determined according to the fisrt feature, wherein the fisrt feature is contained in institute It states in crop box.
Picture after being cut using the crop box to the picture wait cut, and after the cutting Picture be shown in display equipment on.
In order to solve the above technical problems, the application also provides a kind of display equipment, including acquisition module, identification module, really Cover half block cuts module and display module.Wherein acquisition module is for acquiring picture to be cut.Identification module is used in institute It states in picture to be cut and identifies fisrt feature.Determining module is used to determine the picture to be cut according to the fisrt feature Crop box, wherein the fisrt feature is contained in the crop box.Module is cut to be used for using the crop box to described Picture to be cut is cut.Display module is used to show the picture after cutting.
In order to solve the above technical problems, the application also provides a kind of display equipment, including processor and telecommunication circuit, it is described Processor is connect with the telecommunication circuit.Wherein, the processor is for acquiring picture to be cut by the telecommunication circuit. The processor is for identifying fisrt feature in the picture to be cut.The processor is used for according to the fisrt feature The crop box for determining the picture to be cut, wherein the fisrt feature is contained in the crop box.The processor is used In being cut to the picture wait cut using the crop box with the picture after being cut.
In order to solve the above-mentioned technical problem, the application also provides a kind of device with store function, is stored with program number According to described program data can be performed to realize a kind of such as above-mentioned method of cutting out of video pictures provided by the present application.
Compared with prior art, the beneficial effect of the application is: being known by treating the fisrt feature in cutting picture Not, and according to fisrt feature determine that the crop box of picture to be cut utilizes crop box so that fisrt feature is included in crop box The picture retained in crop box after cutting picture is cut, so that the picture shown in the second display equipment includes the first spy Sign guarantees that spectators can see to complete display fisrt feature, is so able to solve the video pictures collected under different angle When, fisrt feature equally can be completely shown when recognizing fisrt feature, avoid fisrt feature from showing not congruent problem, have Effect promotes video viewing experience.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of the application interactive system embodiment;
Fig. 2 is the flow diagram of the method for cutting out embodiment of the application video pictures;
Fig. 3 is the cutting process schematic diagram of the method for cutting out embodiment of the application video pictures;
Fig. 4 is the structural schematic diagram that the application shows equipment first embodiment;
Fig. 5 is the structural schematic diagram that the application shows equipment second embodiment;
Fig. 6 is the structural schematic diagram for the Installation practice that the application has store function.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiment is only a part of the embodiment of the application, instead of all the embodiments.It is based on Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall in the protection scope of this application.
Refering to fig. 1, the application interactive system embodiment, including the first display equipment 11 and multiple second display equipment 12, Wherein the first display equipment 11 is used to for the video pictures of shooting being respectively sent to multiple second display equipment 12, e.g. in real time In the video pictures real-time Transmission of recording to multiple second display equipment 12.Such as first display equipment 11 pass through included camera shooting dress It sets or external photographic device carries out shooting video pictures.Multiple second display equipment 12 receive the first display equipment 11 respectively The video pictures of transmission, such as can be real-time reception first and show the video pictures that equipment 11 is sent in real time.In the present embodiment In, first display equipment 11 can be computer, mobile phone, tablet computer, smart television or the picture pick-up device with display screen, such as Camera, video camera etc., the second display equipment 12 can be computer, TV, mobile phone, tablet computer etc..First display 11 He of equipment Second display equipment 12 can be congener equipment and be also possible to different types of equipment.
Such as using online live streaming as a concrete scene, the first display equipment 11 is the using terminal of main broadcaster, Duo Ge Two display equipment 12 are the terminals that spectators use.It is carried out in a manner of being broadcast live online mutually between main broadcaster and user server It moves, such as the live streaming APP (main broadcaster's version) installed in the first display equipment 11, what is installed in the second display equipment 12 is same live streaming APP (spectators' version), certain main broadcaster's version and spectators' version or identical version, are also possible to distinguishing version, such as in page Face layout is upper and functionally has differences.During live streaming, the first display equipment 11 by included photographic device (such as from With camera) or external photographic device (such as external camera) shooting main broadcaster video pictures be sent to sight in real time Crowd, then the video pictures that the second display equipment 12 of spectators could acquire or obtain in real time main broadcaster carry out being shown in the second display In equipment 12, the real-time live broadcast of main broadcaster can be so watched with spectators, and carry out real-time interactive.Certainly, in other implementations In example, interactive system also may be constructed between multiple second displays equipment 12, such as belong to the real-time video of non-live scene and chat Its scene, then video pictures are issued from one second display equipment 12, other the second display equipment 12 receive and the Two display equipment 12 carry out cutting processing.Can also be that single second display equipment 12 voluntarily shoots video pictures, at the same this Two display equipment 12 carry out specific aim cutting processing for video pictures.Such as carry out the cutting side of following the application video pictures Method processing as described in the examples.
Refering to fig. 1-3, the method for cutting out embodiment of the application video pictures includes:
S11: picture to be cut is acquired.
In the present embodiment, the second display equipment 12 acquires picture to be cut, and on the one hand can be acquisition main broadcaster and passes through The video pictures that first display equipment 11 is sent, are on the other hand also possible to the second display equipment 12 and pass through included photographic device Or the video pictures of external photographic device acquisition.In the concrete application scene being broadcast live online, the second display equipment 12 is real-time What is obtained is the video pictures that the first display equipment 11 is sent.
In the present embodiment, for the first display equipment 11, the first display equipment 11 can also pass through photographic device In real time acquire picture to be cut and carry out following S12-S15 and etc. processing, in order to facilitate making for the first display equipment 11 User watches, such as the first display equipment 11 of main broadcaster can also utilize the cutting side of the application video pictures with real-time display Method of cutting out in method embodiment cut after picture.But the first display equipment 11 is sent to the view of the second display equipment 12 Frequency picture is still picture to be cut, and is not the picture after the first display equipment 11 is cut.Even if next content, It is mostly illustrated with the second display equipment 12, but it should be recognized that the method for cutting out embodiment of the application video pictures In method of cutting out can equally be well applied to the first display equipment 11.
S12: fisrt feature 12a is identified in picture to be cut.
Second display equipment 12 identifies fisrt feature 12a in video pictures to be cut collected.In this embodiment, The sample of fisrt feature 12a, which can be, to be preset in the second display equipment 12, is carried out by identification fisrt feature 12a and sample It matches to achieve the purpose that identification or the second display equipment 12 are carried out repeatedly by the sample to similar fisrt feature 12a Training, can accurately be identified to fisrt feature 12a.Such as fisrt feature 12a includes face characteristic.It can also be into one Step includes other features such as eye feature, expressive features, hand-characteristic, hair feature etc. of people, be can also be in scene Feature, such as vase feature, a certain scene characteristic etc..Fisrt feature 12a can be single feature, be also possible to multiple features Set.Such as have the available fisrt feature 12a of option in the APP in the second display equipment 12, it can only select a spy Levy such as face characteristic, the also multiple features of simultaneous selection, such as simultaneous selection face characteristic and hand-characteristic.
In this application, the second display equipment 12 identifies that fisrt feature 12a can be real-time tracking formula and be identified;It can also It is identified with compartment, executes identification maneuver according to certain time interval to carry out fisrt feature 12a identification.
S13: the crop box 12b of picture to be cut is determined according to fisrt feature 12a, wherein fisrt feature 12a is contained in In crop box 12b.
Second display equipment 12 is after recognizing fisrt feature 12a, in order to guarantee that fisrt feature 12a is not cut, because This needs to determine crop box 12b according to fisrt feature 12a, after enabling to fisrt feature 12a to appear in crop box 12b cutting In picture, also guarantee that spectators can completely see the fisrt feature 12a of video pictures.Optionally, fisrt feature 12a's is several What central point is overlapped with the geometric center point of crop box 12b, further such that fisrt feature 12a is located at the vision of crop box 12b Middle part.
In the present embodiment, according to be real-time tracking formula identification fisrt feature 12a, then crop box 12b is also real When be adjusted correspondingly.According to be compartment identification, then the crop box 12b determined after primary identification, is persistently to make With an interval time section.
Optionally, it S131: is further determined jointly wait cut according to fisrt feature 12a and the display condition of display equipment Picture crop box 12b, wherein fisrt feature 12a is contained in crop box 12b.
In this embodiment, according to fisrt feature 12a in combination with the display condition of the second display equipment 12, it is ensured that cut out Picture after cutting has good display effect when being shown in the second display equipment 12, meet user viewing requirement and aesthetic need It asks, promotes viewing experience.By taking the second display equipment 12 as an example, the display condition of the second display equipment 12 is, for example, to show to differentiate The combination of one or more of rate, the display scale of screen, colour gamut, screen refresh frequency and display mode etc..Display Mode is, for example, transverse screen display, vertical screen display, tiltedly screen display or split screen display available etc..
Such as it determines and cuts jointly according to resolution ratio, the screen display proportion of the display equipment 12 of fisrt feature 12a and second Shape, size, Aspect Ratio of frame 12b etc. enable the picture after cutting preferably to be adapted to the screen of the second display equipment 12 The display scale and display resolution of curtain, for example the ratio of picture to be cut is 18:9, and resolution ratio is 2160*1080P, second The display resolution for showing equipment 12 is 1280*720P, display scale 16:9, and current to be shown displayed across, then according to the It is special comprising first in crop box 12b after the display condition of the display equipment 12 of one feature 12a and second determines crop box 12b jointly 12a, and the ratio 16:9 of crop box are levied, and laterally to cut, the picture automatic adaptation second obtained is cut using crop box 12b Picture after showing equipment 12, namely cutting is 1280*720P, and display scale 16:9, display direction is to be shown displayed across.
In the case where split screen display available, according to the size in fisrt feature 12a and split screen display available region, display scale, divide Shield display mode (such as with transverse screen display or vertical screen display etc. in split screen region) and determine crop box 12b jointly, so that cutting Picture afterwards is better shown in split screen display available region.
S14: the picture after being cut using the picture that crop box 12b treats cutting, and the picture after cutting Face is shown in the second display equipment 12.
Picture after determining crop box 12b, after being cut using video pictures of the crop box 12b to acquisition Face, the picture after cutting can adapt to show equipment 12 in second, ensure that the aesthetic feeling of picture after cutting, while guaranteeing spectators The experience that spectators watch video pictures is improved when can watch fisrt feature 12a.
In the concrete application scene being broadcast live online, due to may be simultaneously present multiple in the live page of a main broadcaster Spectators watch and interact.For main broadcaster, the position that main broadcaster sits exists and does not have face camera, without the feelings such as placed in the middle Condition.Existing processing method is fixedly to be cut in the middle part of video, leads to spectators sometimes and can only see one side of something of main broadcaster Face can't see main broadcaster completely.Therefore the present embodiment passes through the fisrt feature 12a for treating and cutting in picture and is identified, And the crop box 12b of picture to be cut is determined according to fisrt feature 12a, so that fisrt feature 12a is included in crop box 12b, In order to can in the second display equipment 12 real-time display fisrt feature 12a, see the with allowing the viewer to complete display One feature 12a is so able to solve when collecting the video pictures under different angle, can equally recognize fisrt feature Fisrt feature 12a is completely shown when 12a, avoids fisrt feature 12a from showing not congruent problem, and utilize 12b pairs of the crop box Picture to be cut is cut.
For the audience, the second display equipment 12 used in different spectators may be different, and display condition is deposited In many differences, for example, some spectators the second display equipment 12 display scale be 16:9 display screen, and some spectators Second display equipment 12 display scale be 18:9 display screen, some spectators be with transverse screen viewing main broadcaster video draw Face, and some spectators are the video pictures of vertical screen viewing main broadcaster, most common technological means is in currently existing technology: according to the The display scale (length-width ratio) of two display equipment 12, is cut from video source to be cut according to identical length-width ratio, and And that fixes cuts from the middle section of video pictures to be cut, although not needing to mend in the up and down or left and right of video in this way Black surround is filled, but the top and the bottom of corresponding video pictures to be cut or left-right parts can directly be cut off, and will lead to spectators Effective live streaming picture can not be watched or pith can not be watched.The present embodiment is further according to fisrt feature 12a The crop box 12b for determining picture to be cut jointly with the display condition of the second display equipment 12, can make the picture after cutting The second current display equipment 12 can be adapted to automatically, it so can be for the second display equipment 12 under different service conditions It carries out specific aim cutting and display and effectively promotes viewing experience so that display effect is more preferable.
Refering to Fig. 3, in the present embodiment, fisrt feature 12a includes face characteristic.There is applied field for what is be broadcast live online Scape, when spectators viewing main broadcaster is broadcast live program, it is desirable to be able to and main broadcaster carries out face-to-face, main broadcaster shows equipment 11 by first The video pictures (picture to be cut) of live streaming are sent, the second display equipment 12 of each spectators receives the video pictures of the live streaming, The face characteristic of main broadcaster is identified, when recognizing the face characteristic of main broadcaster, crop box is determined according to the face characteristic of main broadcaster 12b, or crop box 12b is determined according to the display condition of face characteristic and the second display equipment 12, the face of main broadcaster is special at this time Sign is included in crop box 12b, and the second display equipment 12 cuts the video pictures using crop box 12b, is retained and is cut out The picture in frame 12b is cut as the picture after cutting and is shown in the second display equipment 12 of spectators, is so to ensure that For second display equipment 12 when recognizing face characteristic, spectators can see the spy in the second display equipment 12 of oneself Sign avoids the video pictures after cutting caused by existing video processing technique from can't see caused by face or face's missing etc. The problems such as viewing experience is poor.In the present embodiment, by by face recognition application in online live video cutting in, can be fine Ground solves the problems such as part and parcel picture brought by existing fixed tailoring technique is lost.
In the present embodiment, face characteristic is being identified in picture wait cut, such as can be using opencv based on module Matched recognizer, naturally it is also possible to use the recognizer based on human face characteristic point, or based on whole picture facial image Recognizer, the recognizer of the algorithm or entrance illumination estimation model that are either identified based on neural network.It can also be with It is the combination of above-mentioned a variety of recognizers.
Refering to Fig. 2 and Fig. 3, further, the step of identification fisrt feature 12a, includes: in picture to be cut
S121: identifying fisrt feature 12a in picture to be cut, and output fisrt feature extracts frame 12c, fisrt feature 12a is contained in fisrt feature and extracts in frame 12c.
Specifically, the second display equipment 12 exports fisrt feature when recognizing such as face characteristic in picture wait cut Frame 12c, such as rectangle frame or oval frame etc. are extracted, fisrt feature extracts frame 12c and surrounds face characteristic, such as just completely Face characteristic is surrounded, so that face characteristic is contained in fisrt feature and extracts in frame 12c, with the model of preferably locating human face's feature It encloses.
The crop box 12b of picture to be cut is determined according to the display condition of the display equipment 12 of fisrt feature 12a and second The step of include:
S132: the display condition for extracting the display equipment 12 of frame 12c and second according to fisrt feature is jointly determining to be cut The crop box 12b of picture, wherein fisrt feature is extracted frame 12c and is contained in crop box 12b.
Specifically, fisrt feature 12a is included in fisrt feature and extracts in frame 12c, and fisrt feature 12a is included in crop box In 12b, the second display equipment 12 cuts video pictures using crop box 12b, retains the picture in crop box 12b.Pass through first Feature extraction frame 12c can better ensure that fisrt feature 12a is contained in crop box 12b, and dual guarantee second shows equipment Picture after 12 cutting can completely show fisrt feature 12a.
In the present embodiment, the display condition of the second display equipment 12 may include display scale and display mode, display Mode includes transverse screen display and vertical screen display.Certainly such as front, display condition can also be other parameters or content, Huo Zheyu Other parameters are combined.
Since spectators watch live streaming using the second different display equipment 12 with different display modes, it is therefore desirable in conjunction with The display condition and fisrt feature 12a of second display equipment 12 are cut out to determine that crop box 12b treats the picture of cutting jointly It cuts, to better adapt to different the second display equipment 12 and display mode.
For example, when the display mode of the second display equipment 12 is transverse screen display, since transverse screen display leads to longitudinal length Shorter, fisrt feature 12a is easy to from longitudinal spilling, therefore in order to guarantee that fisrt feature 12a can more fully be shown in In two display equipment 12, the second display equipment 12 will cut the picture up and down of fisrt feature 12a, at least guarantee that first is special It is at least placed in the middle up and down in crop box 12b to levy 12a, thus guarantee that fisrt feature 12a is placed in the middle in the case where longitudinal length is shorter, To guarantee completely to show fisrt feature 12a in picture after cutting.Further, fisrt feature 12a is also controlled in crop box 12b Between two parties.
Similarly, when the display mode of the second display equipment 12 is vertical screen display, since vertical screen display leads to longitudinal length It is longer, and lateral length is shorter, it is easy to cause fisrt feature 12a from lateral spilling, it is therefore desirable to pay attention to lateral cutting, be This second display equipment 12 is in order to guarantee that fisrt feature 12a when vertical screen display from lateral spilling, is not determining crop box 12b When, need to guarantee fisrt feature 12a at least center ofthe in crop box 12b.Further, fisrt feature 12a is in crop box It is also placed in the middle up and down in 12b.
Refering to Fig. 2 and Fig. 3, optionally, method further comprises:
S15: if fisrt feature 12a can not be recognized in picture to be cut, using last 12b couples of crop box Picture to be cut is cut.
In the concrete application scene being broadcast live online, when main broadcaster leads to the transmission of the first display equipment 11 because turning round or moving For video pictures to be cut in the second display equipment 12 of spectators, the second display equipment 12 can not recognize fisrt feature 12a, example Such as face characteristic, video pictures are cut with last crop box 12b then the second display equipment 12 is understood.In this implementation In example, last crop box 12b refers to identify less than fisrt feature 12a as time point, and closest primary cutting is made Crop box 12b.In other embodiments, second display equipment 12 identification less than fisrt feature 12a when, can also with One is chosen in preceding crop box 12b to cut picture.
In conclusion the present embodiment is recognizing fisrt feature by identifying fisrt feature 12a in picture wait cut The crop box of picture to be cut is determined in the case where 12a according to the display condition of the display equipment 12 of fisrt feature 12a and second 12b, fisrt feature 12a will be included in crop box 12b, in order to be able to which the display picture in the second display equipment 12 can Real-time display fisrt feature 12a is so able to solve when collecting the video pictures under different angle or second shows equipment In the case that 12 display conditions are different, equally fisrt feature more can be completely shown when recognizing fisrt feature 12a 12a is avoided fisrt feature 12a from showing not congruent problem, and is cut using the picture that crop box 12b treats cutting, is cut out Picture after cutting can adapt to the second current display equipment 12 automatically, so can be for second under different service conditions Show that equipment 12 carries out specific aim cutting and display, so that display effect is more preferable.
Refering to Fig. 3 and Fig. 4, the application shows that equipment first embodiment is the method for cutting out embodiment of the application video pictures In display equipment a kind of embodiment, the application show equipment first embodiment include acquisition module 121, identification module 122, really Cover half block 123 cuts module 124 and display module 125.Wherein acquisition module 121 is for acquiring picture to be cut.Identification Module 122 is used to identify fisrt feature 12a in picture to be cut.Determining module 123 is used to be determined according to fisrt feature 12a The crop box 12b of picture to be cut, wherein fisrt feature 12a is contained in crop box 12b.Module 124 is cut for utilizing The picture that crop box 12b treats cutting is cut.Display module 125 is used to show the picture after cutting.
Optionally, determining module 123 is further used for being determined according to the display condition of fisrt feature 12a and display equipment The crop box 12b of picture to be cut, wherein fisrt feature 12a is contained in crop box 12b.
Optionally, identification module 122 is further used for identifying fisrt feature 12a, output in picture to be cut Fisrt feature extracts frame 12c.Wherein fisrt feature 12a is contained in fisrt feature and extracts in frame 12c.
Optionally, determining module 123 is further used for extracting frame 12c according to fisrt feature and shows the display item of equipment Part determines the crop box 12b of picture to be cut, and wherein fisrt feature is extracted frame 12c and is contained in crop box 12b.
Optionally, the display condition for showing equipment includes display scale and display mode, and display mode includes that transverse screen is aobvious Show and vertical screen display.
Optionally, when the display mode for showing equipment is transverse screen display, fisrt feature is at least upper and lower in crop box Between two parties.
Optionally, when the display mode for showing equipment is vertical screen display, fisrt feature at least controls in crop box Between two parties.
Optionally, fisrt feature 12a is face characteristic.
Optionally, when identification module 122 can not recognize fisrt feature 12a in the picture wait cut, determining module Last crop box is determined as crop box 12b by 123.
In the present embodiment, the function of each functional module and extension can be with specific reference to the cuttings of the application video pictures The description of embodiment of the method, details are not described herein.
In addition, the application shows that each module of equipment first embodiment can integrate in a processing module, it can also be with It is that each module physically exists alone, can also be integrated in two or more in module, above-mentioned module can both use The form of hardware can also be realized in the form of software functional units to realize.
Refering to Fig. 3 and Fig. 5, the application shows that equipment second embodiment is the method for cutting out embodiment of the application video pictures In the another of display equipment embody, the application shows that equipment second embodiment includes processor 131 and telecommunication circuit 132, Processor 131 is connect with telecommunication circuit 132.
Wherein, processor 131 is used to acquire picture to be cut by telecommunication circuit 132.Processor 131 is used for be cut Fisrt feature 12a is identified in the picture cut.Processor 131 is used to determine the cutting of picture to be cut according to fisrt feature 12a Frame 12b, wherein fisrt feature 12a is contained in crop box 12b.Processor 131 is used to treat the picture of cutting using crop box 12b Face cut after picture.
Optionally, processor is further used for being determined according to the display condition of fisrt feature 12a and display equipment to be cut The crop box 12b for the picture cut.
Optionally, processor 131 is further used for after identifying fisrt feature 12a in the picture wait cut, output the One feature extraction frame 12c, fisrt feature 12a are contained in fisrt feature and extract in frame 12c.Processor 131 is further used for basis Fisrt feature extracts frame 12c and shows that the display condition of equipment determines the crop box 12b of picture to be cut, wherein fisrt feature Frame 12c is extracted to be contained in crop box 12b.
Optionally, fisrt feature 12a includes face characteristic.
Optionally, the display condition for showing equipment includes display scale and display mode, and display mode includes that transverse screen is aobvious Show and vertical screen display.
Optionally, when show equipment display mode be transverse screen display when, fisrt feature 12a in crop box 12b extremely It is few placed in the middle up and down.
Optionally, when show equipment display mode be vertical screen display when, fisrt feature 12a in crop box 12b extremely Few center ofthe.
Optionally, processor 131 is used to that can not recognize fisrt feature 12a in picture to be cut be to use The picture that last crop box 12b treats cutting is cut.
In the present embodiment, processor 131 controls the operation of Resource Server, and processor 131 can also be known as CPU (Central Processing Unit, central processing unit).Processor 131 may be a kind of IC chip, have letter Number processing capacity.Processor 131 can also be general processor, digital signal processor (DSP), specific integrated circuit (ASIC), ready-made programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components.General processor can be microprocessor or the processor 131 is also possible to any conventional processor Deng.
The application shows that the function of various pieces in equipment second embodiment specifically refers to the sanction of the application video pictures Description in shear method embodiment, details are not described herein.
Refering to Fig. 6, the application is stored with the device 14 with store function in the Installation practice of store function Program data, described program data can be performed to realize that the method for cutting out such as the application video pictures is as described in the examples Method.
Involved method in the method for cutting out embodiment of the application video pictures, when realizing with SFU software functional unit Form exist and when sold or used as an independent product, can store in device 14, such as one computer-readable It takes in storage medium.Based on this understanding, the technical solution of the application substantially in other words contributes to the prior art The all or part of part or the technical solution can be embodied in the form of software products, which deposits It stores up in one storage medium, including some instructions are used so that a computer equipment (can be personal computer, service Device or the network equipment etc.) or processor (processor) execute the whole or portion of each embodiment the method for the present invention Step by step.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), with Machine accesses various Jie that can store program code such as memory (RAM, Random Access Memory), magnetic or disk Matter.
The foregoing is merely presently filed embodiments, are not intended to limit the scope of the patents of the application, all to utilize this Equivalent structure or equivalent flow shift made by application specification and accompanying drawing content, it is relevant to be applied directly or indirectly in other Technical field similarly includes in the scope of patent protection of the application.

Claims (10)

1. a kind of method of cutting out of video pictures characterized by comprising
Acquire picture to be cut;
Fisrt feature is identified in the picture to be cut;
The crop box that the picture to be cut is determined according to the fisrt feature, wherein the fisrt feature is contained in the sanction It cuts in frame;
Picture after being cut using the crop box to the picture wait cut, and will be after the cutting Picture is shown in display equipment.
2. method of cutting out according to claim 1, it is characterised in that: it is described determined according to the fisrt feature it is described to be cut The crop box for the picture cut, wherein the step that the fisrt feature is contained in the crop box includes:
Determine the crop box of the picture to be cut jointly according to the display condition of the fisrt feature and the display equipment, Wherein the fisrt feature is contained in the crop box.
3. method of cutting out according to claim 2, it is characterised in that: described to identify first in the picture to be cut The step of feature includes:
Identify that fisrt feature, output fisrt feature extract frame in the picture to be cut, the fisrt feature is contained in institute Fisrt feature is stated to extract in frame;
The crop box for determining the picture to be cut jointly according to the display condition of the fisrt feature and display equipment The step of include:
Frame is extracted according to the fisrt feature and shows that the display condition of equipment determines the cutting of the picture to be cut jointly Frame is contained in the crop box wherein the fisrt feature extracts frame.
4. method of cutting out according to claim 2 or 3, it is characterised in that: the display condition of the display equipment includes aobvious Show that ratio and display mode, the display mode include transverse screen display and vertical screen display.
5. method of cutting out according to claim 4, it is characterised in that: when the display mode of the display equipment is aobvious for transverse screen When showing, the fisrt feature is at least placed in the middle up and down in the crop box;And/or
When the display mode of the display equipment is vertical screen display, at least left and right occupies the fisrt feature in the crop box In.
6. method of cutting out according to claim 1, it is characterised in that: the fisrt feature is face characteristic.
7. method of cutting out according to claim 1, which is characterized in that the method further includes:
If the fisrt feature can not be recognized in the picture to be cut, using last crop box to it is described to The picture of cutting is cut.
8. a kind of display equipment characterized by comprising
Acquisition module, for acquiring picture to be cut;
Identification module, for identifying fisrt feature in the picture to be cut;
Determining module, for determining the crop box of the picture to be cut according to the fisrt feature, wherein described first is special Sign is contained in the crop box;
Module is cut, for the picture after being cut using the crop box to the picture wait cut;
Display module, for showing the picture after the cutting.
9. a kind of display equipment, which is characterized in that including processor and telecommunication circuit, the processor and the telecommunication circuit connect It connects;
Wherein, the processor is for acquiring picture to be cut by the telecommunication circuit;The processor is used for described Fisrt feature is identified in picture to be cut;The processor is used to determine the picture to be cut according to the fisrt feature Crop box, wherein the fisrt feature is contained in the crop box;The processor is used for using the crop box to institute The picture wait cut is stated to be cut with the picture after being cut.
10. a kind of device with store function, which is characterized in that be stored with program data, described program data can be held Row is to realize the method according to claim 1 to 7.
CN201810623302.2A 2018-06-15 2018-06-15 Video picture cutting method, display device and device Active CN109089157B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810623302.2A CN109089157B (en) 2018-06-15 2018-06-15 Video picture cutting method, display device and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810623302.2A CN109089157B (en) 2018-06-15 2018-06-15 Video picture cutting method, display device and device

Publications (2)

Publication Number Publication Date
CN109089157A true CN109089157A (en) 2018-12-25
CN109089157B CN109089157B (en) 2021-12-07

Family

ID=64839696

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810623302.2A Active CN109089157B (en) 2018-06-15 2018-06-15 Video picture cutting method, display device and device

Country Status (1)

Country Link
CN (1) CN109089157B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109819306A (en) * 2018-12-29 2019-05-28 华为技术有限公司 Media file clipping method, electronic device and server
CN110189378A (en) * 2019-05-23 2019-08-30 北京奇艺世纪科技有限公司 A kind of method for processing video frequency, device and electronic equipment
CN110839174A (en) * 2019-12-02 2020-02-25 广州酷狗计算机科技有限公司 Image processing method and device, computer equipment and storage medium
CN111031178A (en) * 2019-12-19 2020-04-17 维沃移动通信有限公司 Video stream clipping method and electronic equipment
CN111047508A (en) * 2019-12-16 2020-04-21 北京奇艺世纪科技有限公司 Image processing method, image processing device, computer equipment and storage medium
CN111614910A (en) * 2020-04-07 2020-09-01 北京达佳互联信息技术有限公司 File generation method and device, electronic equipment and storage medium
CN111953919A (en) * 2019-05-17 2020-11-17 成都鼎桥通信技术有限公司 Video recording method and device of handheld terminal in video single call
WO2020248668A1 (en) * 2019-06-10 2020-12-17 海信视像科技股份有限公司 Display and image processing method
CN112165635A (en) * 2020-10-12 2021-01-01 北京达佳互联信息技术有限公司 Video conversion method, device, system and storage medium
CN113592874A (en) * 2020-04-30 2021-11-02 杭州海康威视数字技术股份有限公司 Image display method and device and computer equipment
CN114666649A (en) * 2022-03-31 2022-06-24 北京奇艺世纪科技有限公司 Subtitle cut video identification method and device, electronic equipment and storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1642226A (en) * 2004-01-14 2005-07-20 松下电器产业株式会社 Video signal display unit
US20090102973A1 (en) * 2004-01-09 2009-04-23 Harris Scott C Video split device
JP2011123280A (en) * 2009-12-10 2011-06-23 Nippon Telegr & Teleph Corp <Ntt> Image dividing and reproducing method, image dividing and reproducing device, and program
CN102625147A (en) * 2012-02-29 2012-08-01 中山大学 Self-adapting display method for mobile video equipment
US20140313389A1 (en) * 2013-04-18 2014-10-23 Samsung Electronics Co., Ltd. Method for generating split screen image and electronic device thereof
CN104333695A (en) * 2014-11-19 2015-02-04 北京奇虎科技有限公司 Method and device for processing split-screen shooting, and client
CN104361329A (en) * 2014-11-25 2015-02-18 成都品果科技有限公司 Photo cropping method and system based on face recognition
CN105264904A (en) * 2013-06-19 2016-01-20 Lg电子株式会社 Signal transmitting and receiving device and method of controlling said device
CN106105246A (en) * 2016-06-24 2016-11-09 北京小米移动软件有限公司 Live display packing, Apparatus and system
CN106201200A (en) * 2016-07-06 2016-12-07 深圳市金立通信设备有限公司 A kind of multi-screen display method and terminal
WO2016198846A1 (en) * 2015-06-08 2016-12-15 Forbidden Technologies Plc Highlight editor
CN106296760A (en) * 2015-05-21 2017-01-04 腾讯科技(深圳)有限公司 The method of cutting out of picture and device
CN106454407A (en) * 2016-10-25 2017-02-22 广州华多网络科技有限公司 Video live broadcast method and device
CN106713975A (en) * 2016-12-08 2017-05-24 广州华多网络科技有限公司 Live broadcast processing method and apparatus

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090102973A1 (en) * 2004-01-09 2009-04-23 Harris Scott C Video split device
CN1642226A (en) * 2004-01-14 2005-07-20 松下电器产业株式会社 Video signal display unit
JP2011123280A (en) * 2009-12-10 2011-06-23 Nippon Telegr & Teleph Corp <Ntt> Image dividing and reproducing method, image dividing and reproducing device, and program
CN102625147A (en) * 2012-02-29 2012-08-01 中山大学 Self-adapting display method for mobile video equipment
US20140313389A1 (en) * 2013-04-18 2014-10-23 Samsung Electronics Co., Ltd. Method for generating split screen image and electronic device thereof
CN105264904A (en) * 2013-06-19 2016-01-20 Lg电子株式会社 Signal transmitting and receiving device and method of controlling said device
CN104333695A (en) * 2014-11-19 2015-02-04 北京奇虎科技有限公司 Method and device for processing split-screen shooting, and client
CN104361329A (en) * 2014-11-25 2015-02-18 成都品果科技有限公司 Photo cropping method and system based on face recognition
CN106296760A (en) * 2015-05-21 2017-01-04 腾讯科技(深圳)有限公司 The method of cutting out of picture and device
WO2016198846A1 (en) * 2015-06-08 2016-12-15 Forbidden Technologies Plc Highlight editor
CN106105246A (en) * 2016-06-24 2016-11-09 北京小米移动软件有限公司 Live display packing, Apparatus and system
CN106201200A (en) * 2016-07-06 2016-12-07 深圳市金立通信设备有限公司 A kind of multi-screen display method and terminal
CN106454407A (en) * 2016-10-25 2017-02-22 广州华多网络科技有限公司 Video live broadcast method and device
CN106713975A (en) * 2016-12-08 2017-05-24 广州华多网络科技有限公司 Live broadcast processing method and apparatus

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LIMOR MARTIN: "Learning-Based Object Identification and Segmentation Using Dual-Energy CT Images for Security", 《IEEE TRANSACTIONS ON IMAGE PROCESSING》 *
陈圣奇: "高清流媒体三分屏直播技术的研究与实现", 《中国优秀博硕士学位论文全文数据库(硕士)》 *

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109819306A (en) * 2018-12-29 2019-05-28 华为技术有限公司 Media file clipping method, electronic device and server
CN111953919A (en) * 2019-05-17 2020-11-17 成都鼎桥通信技术有限公司 Video recording method and device of handheld terminal in video single call
CN111953919B (en) * 2019-05-17 2022-11-04 成都鼎桥通信技术有限公司 Video recording method and device of handheld terminal in video single call
CN110189378A (en) * 2019-05-23 2019-08-30 北京奇艺世纪科技有限公司 A kind of method for processing video frequency, device and electronic equipment
WO2020248668A1 (en) * 2019-06-10 2020-12-17 海信视像科技股份有限公司 Display and image processing method
US11856322B2 (en) 2019-06-10 2023-12-26 Hisense Visual Technology Co., Ltd. Display apparatus for image processing and image processing method
CN113330736A (en) * 2019-06-10 2021-08-31 海信视像科技股份有限公司 Display and image processing method
CN113330736B (en) * 2019-06-10 2023-02-07 海信视像科技股份有限公司 Display and image processing method
CN110839174A (en) * 2019-12-02 2020-02-25 广州酷狗计算机科技有限公司 Image processing method and device, computer equipment and storage medium
CN111047508A (en) * 2019-12-16 2020-04-21 北京奇艺世纪科技有限公司 Image processing method, image processing device, computer equipment and storage medium
CN111047508B (en) * 2019-12-16 2024-04-26 北京奇艺世纪科技有限公司 Image processing method, device, computer equipment and storage medium
CN111031178A (en) * 2019-12-19 2020-04-17 维沃移动通信有限公司 Video stream clipping method and electronic equipment
CN111614910B (en) * 2020-04-07 2022-05-13 北京达佳互联信息技术有限公司 File generation method and device, electronic equipment and storage medium
CN111614910A (en) * 2020-04-07 2020-09-01 北京达佳互联信息技术有限公司 File generation method and device, electronic equipment and storage medium
WO2021218926A1 (en) * 2020-04-30 2021-11-04 杭州海康威视数字技术股份有限公司 Image display method and apparatus, and computer device
CN113592874A (en) * 2020-04-30 2021-11-02 杭州海康威视数字技术股份有限公司 Image display method and device and computer equipment
CN112165635A (en) * 2020-10-12 2021-01-01 北京达佳互联信息技术有限公司 Video conversion method, device, system and storage medium
CN114666649A (en) * 2022-03-31 2022-06-24 北京奇艺世纪科技有限公司 Subtitle cut video identification method and device, electronic equipment and storage medium
CN114666649B (en) * 2022-03-31 2024-03-01 北京奇艺世纪科技有限公司 Identification method and device of subtitle cut video, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN109089157B (en) 2021-12-07

Similar Documents

Publication Publication Date Title
CN109089157A (en) Method of cutting out, display equipment and the device of video pictures
CN106789991B (en) Multi-person interactive network live broadcast method and system based on virtual scene
CN105939481A (en) Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method
CN105163139B (en) Information-pushing method, Information Push Server and smart television
CN105898583B (en) Image recommendation method and electronic equipment
KR20190020779A (en) Ingestion Value Processing System and Ingestion Value Processing Device
WO2015056742A1 (en) Device for measuring visual efficacy
US8457402B2 (en) Method for rating areas in video frames
CN106791389B (en) Image processing method, image processing device and terminal
US20130120544A1 (en) Method and device for providing supplementary content in 3d communication system
DE102018105289A1 (en) INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM
CN109194952B (en) Head-mounted eye movement tracking device and eye movement tracking method thereof
CN104639984A (en) Network set top box and working method thereof
US20140040948A1 (en) Information distribution device, information reception device, system, program, and method
KR20130070035A (en) Apparatus and method of view point diversification using three dimensional graphic data of broadcasting objects
JP7385385B2 (en) Image distribution system and image distribution method
KR101705988B1 (en) Virtual reality apparatus
CN114722230B (en) Auxiliary judgment system using angle big data matching
CN108010038B (en) Live-broadcast dress decorating method and device based on self-adaptive threshold segmentation
KR101251049B1 (en) Stereoscopic 3d image system
CN111193964A (en) Method and device for controlling video content in real time according to physiological signals
CN115209193A (en) Display processing equipment and method and display system
KR20160095440A (en) Method and system of bidding for advertising on video content
Kumar et al. Retargeting 4K video for mobile access using visual attention and temporal stabilization
Kumar et al. Retargeting UHD 4k video for smartphones

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20181225

Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

Contract record no.: X2021440000030

Denomination of invention: Clipping method, display device and device of video picture

License type: Common License

Record date: 20210125

EE01 Entry into force of recordation of patent licensing contract
GR01 Patent grant
GR01 Patent grant