CN112702561A - Video picture moving method and device and electronic equipment - Google Patents

Video picture moving method and device and electronic equipment Download PDF

Info

Publication number
CN112702561A
CN112702561A CN201911006730.1A CN201911006730A CN112702561A CN 112702561 A CN112702561 A CN 112702561A CN 201911006730 A CN201911006730 A CN 201911006730A CN 112702561 A CN112702561 A CN 112702561A
Authority
CN
China
Prior art keywords
video
picture
target
display
video picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911006730.1A
Other languages
Chinese (zh)
Other versions
CN112702561B (en
Inventor
王厚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201911006730.1A priority Critical patent/CN112702561B/en
Publication of CN112702561A publication Critical patent/CN112702561A/en
Application granted granted Critical
Publication of CN112702561B publication Critical patent/CN112702561B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The embodiment of the invention provides a video picture moving method and device and electronic equipment. The method is applied to electronic equipment, video pictures corresponding to a plurality of video channels are displayed on a common video display layer of an output interface of the electronic equipment, and the method comprises the following steps: determining a target video picture to be moved in video pictures corresponding to the plurality of video channels; switching the display layer to which the target video picture belongs from the common video display layer to a picture superposition layer; moving the target video picture in the picture overlaying layer according to a moving track specified by a user; and the playing state of the target video picture in the moving process is the same as the playing state before moving. Compared with the prior art, the scheme provided by the embodiment of the invention can realize that the moved video picture can continuously display the picture content of the corresponding monitoring video in the moving process of the video picture, thereby avoiding the occurrence of a monitoring blind area and improving the monitoring effect.

Description

Video picture moving method and device and electronic equipment
Technical Field
The present invention relates to the field of video monitoring technologies, and in particular, to a method and an apparatus for moving a video frame, and an electronic device.
Background
Currently, in order to monitor a monitored area more comprehensively from multiple angles, a plurality of video capture devices are installed in the monitored area, so as to fully cover the whole space of the monitored area. In order to simultaneously display all the monitoring video pictures of the monitored area, the video pictures acquired by a plurality of video acquisition devices of the monitored area are simultaneously displayed in the output interface of the same display device.
Furthermore, in the process of viewing each video picture of the monitored area, the user can switch the display positions of different video pictures by moving the video pictures, so that the video pictures focused on can be switched to the remarkable position of the output interface, and the user can view the video pictures conveniently.
In the related art, each video frame is displayed on the common video display layer of the output interface, and further, in the process of switching the display positions of different video frames, the frame movement is also performed in the common video display layer of the output interface.
However, since the common video display layer cannot support the video image overlay display, when the moved video image is overlaid with other video images in the moving process of the video image, the moved video image will have a black screen phenomenon, and the image content of the monitoring video cannot be continuously displayed. Therefore, in the moving process of the video picture, the user cannot observe the picture content of the monitoring video corresponding to the moved video picture, so that a monitoring blind area occurs, and the monitoring effect is reduced.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for moving a video frame, an electronic device, and a computer storage medium, so as to achieve that a moved video frame will continuously display the frame content of a corresponding monitoring video in the process of moving the video frame, avoid a monitoring blind area, and improve a monitoring effect.
The specific technical scheme is as follows:
in a first aspect, an embodiment of the present invention provides a method for moving a video picture, where the method is applied to an electronic device, and a video picture corresponding to a plurality of video channels is displayed on a common video display layer of an output interface of the electronic device, and the method includes:
determining a target video picture to be moved in video pictures corresponding to the plurality of video channels;
switching the display layer to which the target video picture belongs from the common video display layer to a picture superposition layer; wherein, the picture superposition layer is: a video display layer capable of being superimposed on the normal video display layer;
moving the target video picture in the picture overlaying layer according to a moving track specified by a user; and the playing state of the target video picture in the moving process is the same as the playing state before moving.
Optionally, in a specific implementation manner, the method further includes:
when the movement is finished, determining a first position coordinate of a preset feature point in the target video picture in a coordinate system corresponding to the output interface;
and determining a target display mode met by the target video picture in a plurality of preset display modes based on the first position coordinate, and displaying the target video picture in the common video display layer or the picture superposition layer according to the target display mode.
Optionally, in a specific implementation manner, the target video picture is a video picture corresponding to a multi-channel, and the multi-channel corresponds to multiple video code streams;
the step of switching the display layer to which the target video picture belongs from the common video display layer to a picture overlay layer includes:
and switching the display layer to which the sub video picture corresponding to each track video code stream in the target video picture belongs from the common video display layer to the picture superposition layer.
Optionally, in a specific implementation manner, the step of moving the target video picture according to a movement track specified by a user includes:
determining an updating sequence of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture based on the moving direction of the moving track specified by the user;
and sequentially increasing or decreasing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the numerical value corresponding to the moving distance according to the updating sequence.
Optionally, in a specific implementation manner, before the step of moving the target video picture in the picture overlay layer according to a movement trajectory specified by a user, the method further includes:
and reducing the target video picture according to a preset proportion.
Optionally, in a specific implementation manner, the preset display manner includes: a reduction display mode and an exchange display mode;
the step of displaying the target video picture according to the target display mode includes:
when the target display mode is the restoration display mode, switching the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer, and restoring the target video picture at the initial position of the target video picture in the common video display layer;
when the target display mode is the exchange display mode, switching the display layer to which the target video picture belongs from the picture superposition layer to the common video display layer, and updating the output position attribute of the video picture to be exchanged in the common video display layer; displaying the target video picture at the display position of the video picture to be exchanged in the common video display layer, and displaying the video picture to be exchanged at the initial display position of the target video picture in the common video display layer;
wherein the video pictures to be exchanged are determined in other video pictures based on the first position coordinates; the other video pictures are: and video pictures except the target video picture in the video pictures corresponding to the multiple display channels.
Optionally, in a specific implementation manner, the step of determining, in a preset display manner based on the first position coordinate, a target display manner that is satisfied by the target video frame includes:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, determining the reduction display mode in the preset display mode as the target display mode met by the target video picture.
Optionally, in a specific implementation manner, the preset display manner further includes: a suspension display mode;
the step of displaying the target video picture according to the target display mode includes:
and when the target display mode is the suspension display mode, displaying the target video picture at a display position corresponding to the first position coordinate in the picture overlaying layer.
Optionally, in a specific implementation manner, the step of determining, in a preset display manner based on the first position coordinate, a target display manner that is satisfied by the target video frame includes:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, calculating the coordinate distance between the first position coordinate and the second position coordinate, and determining the numerical relationship between the coordinate distance and a preset threshold value; wherein the second position coordinate is: when the target video picture is at the initial position, the position coordinates of the preset feature points in a coordinate system corresponding to the output interface are set;
when the numerical relationship is as follows: determining the reduction display mode in the preset display modes as a target display mode met by the target video picture if the coordinate distance is not greater than the preset threshold;
when the numerical relationship is as follows: and determining the suspension display mode in a preset display mode as a target display mode met by the target video picture when the coordinate distance is larger than the preset threshold value.
In a second aspect, an embodiment of the present invention provides a video image moving apparatus, where the apparatus is applied to an electronic device, and a video image corresponding to a plurality of video channels is displayed on a high-definition video common video display layer of an output interface of the electronic device, where the apparatus includes:
the picture determining module is used for determining a target video picture to be moved in the video pictures corresponding to the plurality of video channels;
the display layer switching module is used for switching the display layer to which the target video picture belongs from the common video display layer to a picture superposition layer; wherein, the picture superposition layer is: a video display layer capable of being superimposed on the normal video display layer;
the picture moving module is used for moving the target video picture in the picture overlaying layer according to a moving track specified by a user; and the playing state of the target video picture in the moving process is the same as the playing state before moving.
Optionally, in a specific implementation manner, the apparatus further includes:
the coordinate determination module is used for determining a first position coordinate of a preset feature point in the target video picture in a coordinate system corresponding to the output interface when the movement is finished;
the mode determining module is used for determining a target display mode met by the target video picture in a plurality of preset display modes based on the first position coordinate;
and the picture display module is used for displaying the target video picture in the common video display layer or the picture superposition layer according to the target display mode.
Optionally, in a specific implementation manner, the target video picture is a video picture corresponding to a multi-channel, and the multi-channel corresponds to multiple video code streams;
the display layer switching module is specifically configured to switch the display layer to which the sub-video picture corresponding to each track video code stream in the target video picture belongs from the common video display layer to the picture overlaying layer.
Optionally, in a specific implementation manner, the picture moving module is specifically configured to:
determining an updating sequence of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture based on the moving direction of the moving track specified by the user; and sequentially increasing or decreasing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the numerical value corresponding to the moving distance according to the updating sequence.
Optionally, in a specific implementation manner, the apparatus further includes:
and the picture reducing module is used for reducing the target video picture according to a preset proportion before moving the target video picture in the picture overlaying layer according to a moving track specified by a user.
Optionally, in a specific implementation manner, the preset display manner includes: a reduction display mode and an exchange display mode;
the picture display module comprises:
the first display sub-module is used for switching the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer when the target display mode is the restoration display mode, and restoring the target video picture at the initial position of the target video picture in the common video display layer;
the second display submodule is used for switching the display layer to which the target video picture belongs from the picture superposition layer to the common video display layer and updating the output position attribute of the video picture to be exchanged in the common video display layer when the target display mode is the exchange display mode; displaying the target video picture at the display position of the video picture to be exchanged in the common video display layer, and displaying the video picture to be exchanged at the initial display position of the target video picture in the common video display layer;
wherein the video pictures to be exchanged are determined in other video pictures based on the first position coordinates; the other video pictures are: and video pictures except the target video picture in the video pictures corresponding to the multiple display channels.
Optionally, in a specific implementation manner, the manner determining module is specifically configured to:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, determining the reduction display mode in the preset display mode as the target display mode met by the target video picture.
Optionally, in a specific implementation manner, the preset display manner further includes: a suspension display mode;
the screen display module further comprises:
and the third display sub-module is used for displaying the target video picture at a display position corresponding to the first position coordinate in the picture overlaying layer when the target display mode is the suspension display mode.
Optionally, in a specific implementation manner, the manner determining module is specifically configured to:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, calculating the coordinate distance between the first position coordinate and the second position coordinate, and determining the numerical relationship between the coordinate distance and a preset threshold value; wherein the second position coordinate is: when the target video picture is at the initial position, the position coordinates of the preset feature points in a coordinate system corresponding to the output interface are set;
when the numerical relationship is as follows: determining the reduction display mode in the preset display modes as a target display mode met by the target video picture if the coordinate distance is not greater than the preset threshold;
when the numerical relationship is as follows: and determining the suspension display mode in a preset display mode as a target display mode met by the target video picture when the coordinate distance is larger than the preset threshold value.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;
a memory for storing a computer program;
and a processor, configured to implement the steps of any video frame moving method provided by the first aspect when executing the program stored in the memory.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when executed by a processor, the computer program implements the steps of any one of the video picture moving methods provided in the first aspect.
As can be seen from the above, by applying the scheme provided by the embodiment of the present invention, a picture overlay layer may be set on a common video display layer of an output interface of an electronic device in advance. Therefore, when the common video display layer of the output interface of the electronic equipment displays the video pictures corresponding to the plurality of video channels and determines the target video picture to be moved in the video pictures corresponding to the plurality of video channels, the electronic equipment can switch the display layer to which the target video picture belongs from the common video display layer to the picture overlaying layer, and further, the electronic equipment can move the target video picture in the picture overlaying layer according to the movement track specified by the user. In the moving process of the target video picture, the display layer to which the target video picture belongs is a picture superposition layer, and the video pictures displayed by the two display layers are not influenced with each other, so that the target video picture can still be continuously displayed when the target video picture is superposed with other video pictures displayed on the common video display layer in the moving process of the target video picture. Based on the scheme provided by the embodiment of the invention, the moved video picture can continuously display the picture content of the corresponding monitoring video in the moving process of the video picture, thereby avoiding the occurrence of a monitoring blind area and improving the monitoring effect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a video frame moving method according to an embodiment of the present invention;
FIG. 2 is a diagram of an example of a video frame corresponding to a 3-track channel;
fig. 3(a) is a schematic diagram illustrating an example in which a video frame corresponding to a plurality of video channels is displayed on a general video display layer of an output interface of an electronic device;
fig. 3(b) is a schematic diagram of another example in which a video frame corresponding to a plurality of video channels is displayed on a common video display layer of an output interface of an electronic device;
fig. 4(a) is a schematic diagram illustrating an example that when a target video frame is a video frame corresponding to a normal display channel, the electronic device switches a display layer to which the target video frame belongs from a VHD layer to a PIP layer;
FIG. 4(b) is a diagram illustrating an example that when the target video frame is a video frame corresponding to a multi-track channel, the electronic device switches the display layer to which the target video frame belongs from the VHD layer to the PIP layer;
FIG. 5 is a diagram illustrating an example of reducing a target video frame according to a predetermined scale;
FIG. 6 is a flowchart illustrating an embodiment of step S103 in FIG. 1;
FIG. 7 is a flowchart illustrating another video frame moving method according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating an example of an electronic device switching a display layer to which a target video frame belongs from a PIP layer to a VHD layer when the target video frame is a video frame corresponding to a multi-track channel;
FIG. 9(a) is a diagram illustrating an example of a switching display mode, a target video frame and a determined video frame to be exchanged for the switching display mode;
fig. 9(b) is a schematic diagram of an example of switching a display mode, in which an electronic device switches a display layer to which a target video picture belongs from a picture overlaying layer to a normal video display layer;
fig. 9(c) is a diagram illustrating an example of switching display modes, in which an electronic device switches an output position attribute of a video picture to be exchanged in a VHD layer;
FIG. 9(d) is a diagram illustrating an output location attribute of a video frame to be exchanged in a VHD layer switched by an electronic device in another example of a switching display mode;
FIG. 9(e) is a diagram illustrating a display result of switching display modes;
FIG. 10 is a diagram illustrating a result displayed in a floating display mode;
FIG. 11 is a flowchart illustrating an embodiment of step S105 in FIG. 7;
fig. 12 is a schematic structural diagram of a mobile device for displaying video frames according to an embodiment of the present invention;
fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the related art, each video frame is displayed on the common video display layer of the output interface, and further, in the process of switching the display positions of different video frames, the frame movement is also performed in the common video display layer of the output interface. However, since the common video display layer cannot support the video image overlay display, when the moved video image is overlaid with other video images in the moving process of the video image, the moved video image will have a black screen phenomenon, and the image content of the monitoring video cannot be continuously displayed. Therefore, in the moving process of the video picture, the user cannot observe the picture content of the monitoring video corresponding to the moved video picture, so that a monitoring blind area occurs, and the monitoring effect is reduced. In order to solve the above technical problem, an embodiment of the present invention provides a method for moving a video frame.
First, a moving method of a video frame according to an embodiment of the present invention is described below.
Fig. 1 is a flowchart illustrating a video frame moving method according to an embodiment of the present invention. The method is applied to any electronic device that needs to perform video frame movement, such as a notebook computer, a desktop computer, a tablet computer, a mobile phone, and the like, and the embodiment of the present invention is not particularly limited, and will be referred to as an electronic device hereinafter.
The video pictures corresponding to a plurality of display channels can be displayed on a common video display layer of an output interface of the electronic equipment, each display channel corresponds to at least one track video code stream, and further, the video picture corresponding to each display channel is composed of the video pictures corresponding to at least one track video code stream.
When the video pictures corresponding to the display channel are composed of the video pictures respectively corresponding to the multi-track video code streams, the display channel may be called a multi-track channel. That is, at least one multi-stream channel is included in the plurality of display channels. When a multi-track channel can obtain N tracks of video streams, the multi-track channel can be referred to as an N track channel. Wherein N > 1.
The following describes the multi-flow channel, specifically:
a multi-lane channel is a physical channel, e.g., a transmission line. Furthermore, the multi-track video code stream can be obtained through the physical channel, and the video image processing is performed on the obtained multi-track video code stream in the physical channel, and the video picture corresponding to any multi-track channel is as follows: and seamlessly splicing the sub-video pictures respectively corresponding to the multi-track video code streams acquired by the multi-track channel to obtain pictures.
For example, as shown in fig. 2, a video picture corresponding to a 3-track stream channel is shown, in fig. 2, the whole video picture is divided into 3 parts by two lines, where each part is a video picture corresponding to a track video stream, and obviously, the video picture is obtained by seamlessly splicing video pictures corresponding to video streams of three tracks respectively. Note that in fig. 2, two lines are intentionally added to illustrate the video frame of the multi-channel, but in practical applications, the two lines do not exist.
Compared with a common display channel corresponding to only one track of video code stream, an MFI (Multi Frame Indicator) information structure body is added in the packaging information and the bare stream information corresponding to the multi-track channel, and the MFI information structure body is used for indicating the track number of the video code stream corresponding to the multi-track channel, the start mark and the receiving mark of the video code stream, the splicing information between the video pictures corresponding to the video code streams of each track and the like.
The sub-video picture corresponding to each track video code stream in the video pictures corresponding to the multiple convection channels may be referred to as each track picture, and correspondingly, the sub-video picture corresponding to the nth track video code stream in the video pictures corresponding to the multiple convection channels may be referred to as the nth track picture.
In addition, for a video picture corresponding to a multi-track channel, the resolution of the video picture is the sum of the resolutions of the video pictures respectively corresponding to the video streams of the multiple tracks constituting the video picture. Based on this, when a video picture with a larger resolution is needed in practical application, the method can be realized through a multi-track channel. And with the increase of the track number of the video code stream corresponding to the multi-track channel, the resolution of the video picture corresponding to the multi-track channel can be infinitely increased.
Moreover, for the video pictures corresponding to the multi-track channel, the size of the sub-video pictures corresponding to each track video code stream in the video pictures can be the same or different.
Further, a coordinate system corresponding to the output interface may be preset for the output interface of the electronic device, and then a preset feature point is set in each displayed video frame, and the position of the display frame in the output interface is represented according to the position coordinates of the preset feature point in the set coordinate system.
And the data relation between the size of each video picture and the size of the output interface can be determined according to the set coordinate system, and the displayed multiple video pictures are displayed in the output interface in a seamless and non-overlapping mode and cover the whole output interface.
The common video display layer and the picture overlaying layer completely cover the display layer of the electronic equipment, so that the coordinate system corresponding to the set output interface can also be the coordinate system corresponding to the common video display layer and the picture overlaying layer, namely the output interface, the common video display layer and the picture overlaying layer adopt a unified coordinate system together.
As shown in fig. 3(a), an example is a schematic diagram in which a video frame corresponding to a plurality of video channels is displayed on a general video display layer of an output interface of an electronic device. Where the respective numbers represent the number of each video picture displayed. Specifically, the method comprises the following steps: the width and height of the output interface are screen w and screen h, respectively, taking the 1 st video picture as an example, the width and height of the video picture are VochnW and VochnH, respectively, and in the coordinate system corresponding to the preset output interface, the coordinate of the top left vertex of the 1 st video picture is (VochnX, VochnY).
Further, on the basis of the example shown in fig. 3(a), when the 1 st video picture in the video pictures corresponding to the multiple video channels displayed on the ordinary video display layer of the output interface of the electronic device is a video picture corresponding to the multiple video channels, a schematic diagram of the video pictures corresponding to the multiple video channels displayed on the ordinary video display layer of the output interface of the electronic device is shown in fig. 3 (b). The sub video pictures corresponding to each track video code stream can be called as each track picture, and in the 1 st video picture, the width and height of the nth track picture are VochnW [ N ] and VochnH, respectively, and in the coordinate system corresponding to the preset output interface, the coordinates of the top left vertex of the nth track picture are (VochnX [ N ], VochnY).
As shown in fig. 1, a method for moving a video frame according to an embodiment of the present invention includes the following steps:
s101: determining a target video picture to be moved in video pictures corresponding to a plurality of video channels;
when moving a video image, the electronic device needs to determine a target video image to be moved in video images corresponding to a plurality of video channels displayed on a common video display layer of an output interface.
The electronic device can determine the target video picture to be moved in various ways. The embodiment of the present invention is not particularly limited.
For example, when a specified operation for a video screen among the displayed plurality of video screens is detected, the electronic apparatus may determine the video screen as a target video screen. The designated operation may be any kind of operation, for example, a drag operation, a double-click operation, a long-press operation, and the like.
In addition, the video pictures other than the target video picture in the video pictures corresponding to the multiple video channels can be called other video pictures.
Optionally, in a specific implementation manner, the common Video display Layer may be a VHD (Video High Definition Layer) Layer.
S102: switching a display layer to which a target video picture belongs from a common video display layer to a picture superposition layer;
wherein, the picture superposition layer is: a video display layer capable of being superimposed on the normal video display layer;
furthermore, after the target video picture is determined, since the initial display layer to which the target video picture belongs is the ordinary video display layer, in order to realize that the target video picture can be continuously displayed in the moving process of the target video picture, the electronic device can switch the display layer to which the target video picture belongs from the ordinary video display layer to the picture overlaying layer.
The image superposition layer is a video display layer which can be superposed on the common video display layer, so that superposition of an image displayed by the common video display layer and an image displayed by the image superposition layer can be realized.
Optionally, In a specific implementation manner, the Picture stacking layer may be a PIP (Picture In Picture) layer.
And on the high-definition electronic equipment realized by the PIP layer, the PIP layer video image and the VHD layer video image are superposed. On the PIP layer or the VHD layer alone, the superposition of the displayed video pictures cannot be realized, and by configuring the display priority of the PIP layer or the VHD layer, the superposition of the pictures displayed by the VHD layer and the pictures displayed by the PIP layer can be realized. That is, in the embodiment of the present invention, two video frames that have an overlapping area and can be displayed in an overlapping manner are respectively displayed on different video display layers.
The display priority of the video display layer is higher than that of the VHD layer, dynamic binding can be realized, and the function of displaying pictures is superposed on the PIP layer on the basis of displaying pictures on the VHD layer.
Optionally, in a specific implementation manner, when the target video picture is a video picture corresponding to a multi-track channel, the multi-track channel corresponds to a multi-track video code stream; the method for the electronic device to execute step S102 may include the following steps:
and switching the display layer to which the sub video picture corresponding to each track video code stream in the target video picture belongs from the common video display layer to the picture superposition layer.
For example, if the electronic device has a VHD layer and a PIP layer, in the example shown in fig. 4(a), when the target video picture is a video picture corresponding to a normal display channel, the electronic device switches the schematic diagram of the display layer to which the target video picture belongs;
accordingly, the electronic device has a VHD layer and a PIP layer, and as shown in fig. 4(b), when the target video picture is a video picture corresponding to a multi-track channel, the electronic device switches the schematic diagram of the display layer to which the target video picture belongs.
In fig. 4(a) and 4(b), a VDEC (Video decoder module) supports an input Video protocol, and outputs image data of a Video picture after decoding a Video stream.
For example, an H264 code stream is input, the H264 code stream is decoded, and YUV image data obtained after decoding is output. YUV is a general color coding method, Y represents brightness (Luma), and U and V represent Chroma (Chroma) and concentration (Chroma), respectively.
The VPSS (Video Process Sub-System) performs uniform preprocessing, such as denoising and de-interlacing, on an input image, then performs scaling, sharpening, and the like on each channel, and finally outputs images with different resolutions.
Wherein, VPSS [1], VPSS [2], VPSS [3], … … and VPSS [ N ] in FIG. 4(b) can be N VPSS modules or N channel interfaces of 1 VPSS module.
S103: moving a target video picture in the picture overlaying layer according to a moving track specified by a user;
and the playing state of the target video picture in the moving process is the same as the playing state before moving.
Furthermore, after the display layer to which the target video picture belongs is switched from the common video display layer to the picture overlaying layer, the electronic equipment can move the target video picture in the picture overlaying layer according to the movement track specified by the user.
The video pictures displayed by the common video display layer and the picture overlaying layer are not influenced with each other, so that the target video picture can still be continuously displayed when the target video picture is overlaid with other video pictures displayed on the common video display layer in the moving process of the target video picture. That is, the playing state of the target video picture during the movement is the same as the playing state before the movement. Also, the size of the target video picture may remain unchanged during the movement.
In addition, the electronic device may perform the step S103 in various ways, and the embodiment of the present invention is not limited in detail.
For example, a user may drag the target video screen with a finger, a stylus pen, or a mouse, and when the electronic device detects the drag operation, the electronic device may move the target video screen in the screen overlay layer along a drag trajectory of the detected drag operation.
As can be seen from the above, by applying the scheme provided by the embodiment of the present invention, a picture overlay layer may be set on a common video display layer of an output interface of an electronic device in advance. Therefore, when the common video display layer of the output interface of the electronic equipment displays the video pictures corresponding to the plurality of video channels and determines the target video picture to be moved in the video pictures corresponding to the plurality of video channels, the electronic equipment can switch the display layer to which the target video picture belongs from the common video display layer to the picture overlaying layer, and further, the electronic equipment can move the target video picture in the picture overlaying layer according to the movement track specified by the user. In the moving process of the target video picture, the display layer to which the target video picture belongs is a picture superposition layer, and the video pictures displayed by the two display layers are not influenced with each other, so that the target video picture can still be continuously displayed when the target video picture is superposed with other video pictures displayed on the common video display layer in the moving process of the target video picture. Based on the scheme provided by the embodiment of the invention, the moved video picture can continuously display the picture content of the corresponding monitoring video in the moving process of the video picture, thereby avoiding the occurrence of a monitoring blind area and improving the monitoring effect.
It can be understood that, when the size of the target video frame is larger, during the moving process of the target video frame, the target video frame may cover a larger portion of the other video frames or completely cover one or more of the other video frames, thereby affecting the viewing effect of the user corresponding to the other video frames.
For example, as shown in fig. 3(a), the size of the 1 st video frame is much larger than the sizes of the other video frames, when the target video frame is the 1 st video frame, the 1 st video frame easily covers a larger portion of the content in the other video frames or completely covers one or more of the other video frames during the movement of the 1 st video frame.
Based on this, optionally, in a specific implementation manner, in step S103, before moving the target video picture in the picture overlay layer according to the movement track specified by the user, the method for moving the video picture provided in the embodiment of the present invention may further include the following step 11:
step 11: and reducing the target video picture according to a preset proportion.
The preset ratio may be set according to the actual application requirement, and the embodiment of the present invention is not particularly limited.
For example, in addition to the example shown in fig. 3(b), when the target video frame is the 1 st video frame, the width and length of the 1 st video frame may be reduced to 1/3 according to the size relationship between the 1 st video frame and other video frames, respectively, so as to obtain the schematic diagram shown in fig. 5.
Further, in FIG. 5, the coordinates of the top left vertex of each of the 1 st video pictures are (X [ N ], Y), and the width and height of each of the track pictures are W [ N ] and H, respectively. Wherein:
W[1]+W[2]+…+W[N]=VochnW/3=(VochnW[1]+VochnW[2]+…+VochnW[N])/3
H=VochnH/3
X[1]=VochnX+VochnW/3,
X[2]=X[1]+W[1],
……
X[N]=X[N-1]+W[N-1],
Y=VochnY+VochnH/3,
and, when W [1] ═ W [2] ═ … ═ W [ N ], W [1] ═ W [2] ═ … ═ W [ N ] ═ VochnW/3/N.
The execution sequence of step S102 and step S11 may be: firstly, executing the step S102, namely, firstly, switching a display layer to which a target video picture belongs from a common video display layer to a picture superposition layer, and then reducing the target video picture according to a preset proportion when executing the step 11; the following steps can be also included: the step 11 is executed first, and in the step S102, the target video picture is reduced according to the preset ratio, and then the display layer to which the target video picture belongs is switched from the ordinary video display layer to the picture overlaying layer. The embodiment of the present invention is not particularly limited.
Optionally, in a specific implementation manner, when the target video picture is a video picture corresponding to a multi-track channel, as shown in fig. 6, the electronic device executes the step S103, and the manner of moving the target video picture according to the moving track specified by the user may include the following steps:
s601: determining an updating sequence of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture based on the moving direction of the moving track specified by the user;
s602: and sequentially increasing or decreasing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the numerical value corresponding to the moving distance according to the updating sequence.
The moving of the target video picture is realized by changing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream, that is, the moving process of the target video picture is the process of gradually changing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream.
Further, since the video pictures corresponding to the multi-track channel are obtained by seamlessly splicing the sub-video pictures respectively corresponding to the video streams of the multi-track channel, when the video pictures corresponding to the multi-track channel are moved, the change sequence of the attribute values of the output position attributes of the video pictures respectively corresponding to the video streams of each track needs to be considered.
In order to avoid the situation that the sub-video pictures respectively corresponding to the multi-track video code streams are overlapped with the sub-video pictures which are not moved in the moving process, the updating sequence of each sub-video picture can be sequentially determined according to the direction opposite to the moving direction, and then each sub-video picture is sequentially moved towards the moving direction, or all the sub-video pictures are simultaneously moved towards the moving direction.
Based on this, in this specific implementation manner, the electronic device may determine a moving direction of a moving track specified by a user, and further determine, based on the moving direction of the moving track specified by the user, an update sequence of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture. Therefore, the electronic equipment can sequentially increase or decrease the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the value corresponding to the moving distance according to the updating sequence.
And determining that the attribute value of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture is sequentially increased or decreased by the numerical value corresponding to the moving distance according to the relationship between the moving direction and the direction of the coordinate axis in the coordinate system corresponding to the preset output interface.
The moving distance may be a relative offset of the movement of the finger, the stylus pen, or the mouse cursor when the user drags the target video screen with the finger, the stylus pen, or the mouse.
For example, in the example shown in fig. 5, when the target video picture is the 1 st video picture, and the relative offset amounts of the mouse cursor movement are offset x and offset y, the attribute values of the output position attribute of each track picture in the updated target video picture during the movement are respectively:
X[1]=VochnX+VochnW/3+offsetX,
X[2]=X[1]+W[1]+offsetX,
……
X[N]=X[N-1]+W[N-1]+offsetX,
Y=VochnY+VochnH/3+offsetY。
wherein, the size and the size of each track picture in the target video picture are kept unchanged in the moving process.
And, when offset x >0, i.e. the 1 st video frame moves to the right, the output position attribute of each track frame in the 1 st video frame is updated in the following sequence: the N-th track picture, the N-1-th track picture, … …, and the 1-th track picture, that is, the attribute value of the output position attribute of the N-th track picture is updated first, then the attribute value of the output position attribute of the N-1-th track picture is updated, and so on, and finally the attribute value of the output position attribute of the 1-th track picture is updated. Therefore, the situation that when the attribute value of the output position attribute of the 1 st rail picture is updated first, the 2 nd rail picture does not move away, the 1 st rail picture and the 2 nd rail picture are overlapped, and the attribute value of the output position attribute fails to be updated can be avoided.
Similarly, when the offset x is less than 0, i.e. the 1 st video frame moves to the left, the output position attribute of each track in the 1 st video frame is updated in the following sequence: the track 1 picture, the track 2 picture, … …, and the track N picture, that is, the attribute value of the output position attribute of the track 1 picture is updated first, then the attribute value of the output position attribute of the track 2 picture is updated, and so on, and finally the attribute value of the output position attribute of the track N picture is updated. Therefore, the situation that the attribute value of the output position attribute fails to be updated due to the fact that the N-1 th rail picture is not moved away when the attribute value of the output position attribute of the N-th rail picture is updated first and the N-1 th rail picture is overlapped can be avoided.
Of course, the attribute values of the output position attributes of the 1 st to nth track pictures may be updated simultaneously, so that the 1 st to nth track pictures are moved simultaneously.
It is understood that after the movement of the target video frame is completed, the target video frame may continue to be displayed in the output interface of the electronic device. Based on this, optionally, in a specific implementation manner, as shown in fig. 7, the video moving method provided in the embodiment of the present invention may further include the following steps:
s104: when the movement is finished, determining a first position coordinate of a preset feature point in a target video picture in a coordinate system corresponding to an output interface;
s105: and determining a target display mode met by the target video picture in a plurality of preset display modes based on the first position coordinates, and displaying the target video picture in a common video display layer or a picture superposition layer according to the target display mode.
When the movement of the video picture is finished, the electronic equipment can determine a first position coordinate of a preset feature point in the target video picture in a coordinate system corresponding to the output interface; furthermore, the electronic equipment determines a target display mode which is met by the target video picture in a plurality of preset display modes based on the first position coordinate. Therefore, the electronic equipment can display the target video picture in the common video display layer or the picture superposition layer according to the target display mode.
The electronic device may perform the step S105 in multiple ways, and determine the target display way satisfied by the target video picture in multiple preset display ways based on the first position coordinate, which is not limited in this embodiment of the present invention. For clarity, the manner in which the electronic device executes the step S105 to determine the target display mode satisfied by the target video frame in the plurality of preset display modes based on the first position coordinate will be described in the following.
The preset feature point in the target video picture can be any point in the target video picture, and the position of the target video picture when the movement is finished is represented by a first position coordinate of the preset feature point in a coordinate system corresponding to the output interface.
For example, as shown in fig. 9(a), if the center point of the 1 st video frame is a preset feature point, the first position coordinate (CX, CY) of the center point of the 1 st video frame may be specifically determined as follows:
CX=X[1]+(W[1]+W[2]+…+W[N])/2,
CY=Y+H/2。
preferably, in an embodiment, the preset display mode may include: a reduction display mode and an exchange display mode;
the method for displaying the target video picture according to the target display method when the electronic device executes the step S105 may include the following steps 21-22:
step 21: when the target display mode is a reduction display mode, switching the display layer to which the target video picture belongs from the picture superposition layer to the common video display layer, updating the output position attribute of the video picture to be exchanged in the common video display layer, and reducing the target video picture at the initial position of the target video picture in the common video display layer;
when the target display mode determined based on the first position coordinates is the restoration display mode, the target video picture needs to be restored to the initial position when the target video picture is not moved for display, that is, the display position of the target video picture is not changed after the movement is completed, and the target video picture restored to be displayed at the initial position is displayed on a common video display layer of the electronic device.
Based on this, when the target display mode is the restoration display mode, the electronic device switches the display layer to which the target video picture belongs from the picture overlaying layer to the ordinary video display layer, updates the output position attribute of the video picture to be exchanged in the ordinary video display layer, and further restores the target video picture at the initial position of the target video picture in the ordinary video display layer.
For example, as shown in fig. 5, the target video frame is the 1 st video frame, and when the target display mode is the reduction display mode, as shown in fig. 8, the electronic device first switches the display layer to which each track frame belongs in the 1 st video frame from the frame overlaying layer to the normal video display layer, and then reduces the 1 st video frame at the initial position of the 1 st video frame in the normal video display layer, so as to obtain the display result shown in fig. 3 (b).
Step 22: when the target display mode is the switching display mode, switching the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer, updating the output position attribute of the video picture to be switched in the common video display layer, displaying the target video picture at the display position of the video picture to be switched in the common video display layer, and displaying the video picture to be switched at the initial display position of the target video picture in the common video display layer;
the video pictures to be exchanged are determined in other video pictures based on the first position coordinates; the other video pictures are: and video pictures except the target video picture in the video pictures corresponding to the plurality of display channels.
When the target display mode determined based on the first position coordinates is the exchange display mode, the target video picture needs to exchange a display position with the video picture to be exchanged, that is, the target video picture is displayed at the display position of the video picture to be exchanged, the video picture to be exchanged is displayed at an initial position when the target video picture is not moved, and after the display position exchange is completed, the video picture to be exchanged and the target video picture are both displayed on a common video display layer of the electronic device.
Based on this, when the target display mode is the exchange display mode, the electronic device switches the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer, updates the output position attribute of the video picture to be exchanged in the common video display layer, displays the target video picture at the display position of the video picture to be exchanged in the common video display layer, and displays the video picture to be exchanged at the initial display position of the target video picture in the common video display layer.
The video pictures to be exchanged are determined in other video pictures based on the first position coordinates, and the electronic device may determine the video pictures to be exchanged while determining the first position coordinates, or may determine the video pictures to be exchanged after determining that the target display mode is the exchange display mode, which is reasonable.
For example, the electronic device has a VHD layer and a PIP layer, then in the example shown in fig. 9(a), the target video picture is the 1 st video picture, and when the target display mode is the swap display mode, the video picture to be swapped is the 4 th video picture, as shown in fig. 9(b), the electronic device first switches the display layer to which each track picture belongs in the 1 st video picture from the PIP layer to the VHD layer, and, as shown in fig. 9(c) or fig. 9(d), updates the output position attribute of the 4 th video picture in the VHD layer. Further, the 4 th video picture is displayed at the initial position of the 1 st video picture in the VHD layer, and the 1 st video picture is displayed at the display position of the 4 th video picture in the VHD layer, resulting in the display result as shown in fig. 9 (e).
When the 4 th video picture is a video picture corresponding to the common display channel, as shown in fig. 9(c), the output position attribute of the 4 th video picture in the VHD layer is updated; when the 4 th video picture is a video picture corresponding to the multi-track channel, as shown in fig. 9(d), the output position attribute of the 4 th video picture in the VHD layer is updated.
Preferably, in an embodiment, the preset display mode may further include a floating display mode on the basis of the restoration display mode and the exchange display mode, and the step S105 of executing by the electronic device the mode of displaying the target video picture according to the target display mode may include the following step 23:
step 23: and when the target display mode is a suspension display mode, displaying the target video picture at a display position corresponding to the first position coordinate in the picture overlaying layer.
When the target display mode determined based on the first position coordinate is the floating display mode, the target video picture can be displayed at the display position corresponding to the determined first position coordinate, that is, after the movement is completed, the target video picture stays at the position to which the target video picture is moved to be displayed, and because the position to which the target video picture is moved has an overlapping area with other video pictures, in order to ensure the normal display of the target video picture and other video pictures, the target video picture stays at the position to which the target video picture is moved to be displayed, and the target video picture is displayed on a picture overlaying layer of the electronic device.
Therefore, when the target display mode is the suspension display mode, the electronic equipment does not need to switch the display layer to which the target video picture belongs, and directly displays the target video picture at the display position corresponding to the first position coordinate in the picture overlaying layer.
For example, as shown in fig. 10, the target video picture is the 1 st video picture, and when the target display mode is the floating display mode, as shown in fig. 10, the electronic device does not need to switch the display layer to which each track picture belongs in the 1 st video picture, and directly displays the 1 st video picture at the display position corresponding to the first position coordinate in the picture overlaying layer, obviously, there is an overlapping area between the displayed 1 st video picture and other video pictures at this time.
Next, an example of the manner in which the electronic device determines the target display mode satisfied by the target video frame in the plurality of preset display modes based on the first position coordinates in the step S105 is described.
Optionally, in a specific implementation manner, when the preset display manner includes a restore display manner and an exchange display manner, the electronic device executes the manner of determining, in the preset display manner and based on the first position coordinate in step S105, the target display manner that is met by the target video frame, and the method may include the following steps 31 to 33:
step 31: judging whether the first position coordinate is positioned in a display area of any one of other video pictures; if yes, go to step 32, otherwise, go to step 33;
step 32: determining an exchange display mode in the preset display modes as a target display mode met by a target video picture;
step 33: and determining a reduction display mode in the preset display modes as a target display mode met by the target video picture.
In this specific implementation manner, the electronic device first determines whether the first position coordinate is located in a display area of any one of the other video frames. Furthermore, when the judgment result is yes, the electronic device may determine an exchange display mode in the preset display modes as a target display mode satisfied by the target video picture, and determine the video picture in which the first position coordinate is located as a video picture to be exchanged; correspondingly, when the judgment result is negative, the electronic device may determine the reduction display mode in the preset display modes as the target display mode satisfied by the target video picture.
For example, as shown in fig. 9(a), if the target video frame is the 1 st video frame and the preset feature point of the 1 st video frame is the center point of the 1 st video frame, it may be determined that the first position coordinate of the preset feature point of the 1 st video frame is located in the display area of the 4 th video frame, and then the exchange display mode in the preset display modes may be determined as the target display mode satisfied by the target video frame, and it may be further determined that the video frame to be exchanged is the 4 th video frame.
Optionally, in a specific implementation manner, when the preset display manner includes a restore display manner, an exchange display manner, and a floating display manner, as shown in fig. 11, the electronic device executes the manner that, in the step S105, the target display manner satisfied by the target video picture is determined in the preset display manner based on the first position coordinate, and may include the following steps:
s1101: judging whether the first position coordinate is positioned in a display area of any one of other video pictures; if yes, executing step S1102, otherwise, executing step S1103;
s1102: determining an exchange display mode in the preset display modes as a target display mode met by a target video picture;
s1103: calculating the coordinate distance between the first position coordinate and the second position coordinate, and determining the numerical relationship between the coordinate distance and a preset threshold value; when the numerical relationship is: if the coordinate distance is not greater than the preset threshold, executing step S1104; when the numerical relationship is: if the coordinate distance is greater than the preset threshold, go to step S1105
Wherein the second position coordinate is: when the target video picture is at the initial position, presetting the position coordinates of the feature points in a coordinate system corresponding to the output interface;
s1104: determining a reduction display mode in the preset display modes as a target display mode met by a target video picture;
s1105: and determining the suspension display mode in the preset display modes as the target display mode met by the target video picture.
In this specific implementation manner, the electronic device first determines whether the first position coordinate is located in a display area of any one of the other video frames. Furthermore, when the determination result is yes, the electronic device may determine an exchange display mode in the preset display modes as a target display mode satisfied by the target video picture, and determine the video picture in which the first position coordinate is located as the video picture to be exchanged.
Correspondingly, when the judgment result is negative, the electronic device may first obtain the position coordinates of the preset feature point in the coordinate system corresponding to the output interface when the target video picture is at the initial position, and use the position coordinates as the second position coordinates. Furthermore, the electronic device can calculate the coordinate distance between the first position coordinate and the second position coordinate, and determine the numerical relationship between the coordinate distance and the preset threshold value.
Therefore, the electronic equipment can determine the target display mode met by the target video picture in the preset display mode based on the numerical relation between the coordinate distance and the preset threshold value.
Wherein, when the numerical relation is: the coordinate distance is not greater than the preset threshold value, which can indicate that the moving distance of the target video picture is small, so that the electronic device can determine the reduction display mode in the preset display modes as the target display mode satisfied by the target video picture.
Accordingly, when the numerical relationship is: the coordinate distance is greater than the preset threshold value, which indicates that the moving distance of the target video picture is greater, so that the electronic device can determine the floating display mode in the preset display mode as the target display mode satisfied by the target video picture.
Optionally, in a specific implementation manner, when the preset display manner includes a restore display manner, an exchange display manner, and a floating display manner, as shown in fig. 11, the determining, by the electronic device, a manner of the target display manner that is satisfied by the target video picture in the preset display manner based on the first position coordinate in step S105 may include the following steps 41 to 43:
step 41: calculating a first coordinate distance between the first position coordinate and the second position coordinate, and a second coordinate distance between the first position coordinate and the position coordinate of the preset feature point in each other video picture;
step 42: determining the second coordinate distance with the minimum value in the calculated second coordinate distances as a third coordinate distance;
step 43: and determining a first numerical relation between the first coordinate distance and a first preset numerical value and a second numerical relation between the third coordinate distance and a second preset numerical value, and determining a target display mode met by the target video picture based on the first numerical relation and the second numerical relation.
In this specific implementation manner, the electronic device may first obtain a position coordinate of the preset feature point in a coordinate system corresponding to the output interface when the target video frame is at the initial position, and use the coordinate position as a second position coordinate; and the electronic equipment can also obtain the position coordinates of the preset feature points in each other video picture.
In this way, the electronic equipment can calculate the first coordinate distance between the first position coordinate and the second coordinate distance between the first position coordinate and the position coordinate of the preset feature point in each other video picture; and determining the second coordinate distance with the minimum value in the calculated second coordinate distances as a third coordinate distance.
Furthermore, the electronic device may further determine a first numerical relationship between the first coordinate distance and a first preset numerical value, and a second numerical relationship between the third coordinate distance and a second preset numerical value, and determine a target display mode satisfied by the target video frame based on the first numerical relationship and the second numerical relationship.
Preferably, in an embodiment, the determining, in the step S43, the manner of the target display mode satisfied by the target video picture based on the first numerical relationship and the second numerical relationship may include the following steps 431 and 433:
step 431: when the first value relationship is: the first coordinate distance is not greater than a first preset value, and the second value relationship is as follows: when the third coordinate distance is larger than a preset numerical value, determining a reduction display mode in the preset display modes as a target display mode met by the target video picture;
step 432: when the first value relationship is: the first coordinate distance is greater than a first preset value, and the second value relationship is as follows: when the third coordinate distance is not greater than a second preset threshold value, determining an exchange display mode in the preset display modes as a target display mode met by the target video picture;
and determining other video pictures corresponding to the third coordinate distance as video pictures to be exchanged.
Step 433: otherwise, determining the suspension display mode in the preset display modes as the target display mode met by the target video picture.
Corresponding to the video picture moving method provided by the embodiment of the invention, the embodiment of the invention also provides a video picture moving device.
Fig. 12 is a schematic structural diagram of a mobile device for video frames according to an embodiment of the present invention. The device is applied to the electronic equipment, and video pictures corresponding to a plurality of video channels are displayed on a high-definition video common video display layer of an output interface of the electronic equipment, and the device comprises:
a picture determining module 1210, configured to determine a target video picture to be moved in video pictures corresponding to the multiple video channels;
a display layer switching module 1220, configured to switch the display layer to which the target video picture belongs from the ordinary video display layer to a picture overlay layer; wherein, the picture superposition layer is: a video display layer capable of being superimposed on the normal video display layer;
the picture moving module 1230 is configured to move the target video picture in the picture overlay layer according to a movement track specified by a user; and the playing state of the target video picture in the moving process is the same as the playing state before moving.
As can be seen from the above, by applying the scheme provided by the embodiment of the present invention, a picture overlay layer may be set on a common video display layer of an output interface of an electronic device in advance. Therefore, when the common video display layer of the output interface of the electronic equipment displays the video pictures corresponding to the plurality of video channels and determines the target video picture to be moved in the video pictures corresponding to the plurality of video channels, the electronic equipment can switch the display layer to which the target video picture belongs from the common video display layer to the picture overlaying layer, and further, the electronic equipment can move the target video picture in the picture overlaying layer according to the movement track specified by the user. In the moving process of the target video picture, the display layer to which the target video picture belongs is a picture superposition layer, and the video pictures displayed by the two display layers are not influenced with each other, so that the target video picture can still be continuously displayed when the target video picture is superposed with other video pictures displayed on the common video display layer in the moving process of the target video picture. Based on the scheme provided by the embodiment of the invention, the moved video picture can continuously display the picture content of the corresponding monitoring video in the moving process of the video picture, thereby avoiding the occurrence of a monitoring blind area and improving the monitoring effect.
Optionally, in a specific implementation manner, the apparatus further includes:
the coordinate determination module is used for determining a first position coordinate of a preset feature point in the target video picture in a coordinate system corresponding to the output interface when the movement is finished;
the mode determining module is used for determining a target display mode met by the target video picture in a plurality of preset display modes based on the first position coordinate;
and the picture display module is used for displaying the target video picture in the common video display layer or the picture superposition layer according to the target display mode.
Optionally, in a specific implementation manner, the target video picture is a video picture corresponding to a multi-channel, and the multi-channel corresponds to multiple video code streams;
the display layer switching module 1220 is specifically configured to switch the display layer to which the sub video picture corresponding to each track video code stream in the target video picture belongs from the common video display layer to the picture overlaying layer.
Optionally, in a specific implementation manner, the picture moving module 1230 is specifically configured to:
determining an updating sequence of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture based on the moving direction of the moving track specified by the user; and sequentially increasing or decreasing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the numerical value corresponding to the moving distance according to the updating sequence.
Optionally, in a specific implementation manner, the apparatus further includes:
and the picture reducing module is used for reducing the target video picture according to a preset proportion before moving the target video picture in the picture overlaying layer according to a moving track specified by a user.
Optionally, in a specific implementation manner, the preset display manner includes: a reduction display mode and an exchange display mode;
the picture display module comprises:
the first display sub-module is used for switching the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer when the target display mode is the restoration display mode, and restoring the target video picture at the initial position of the target video picture in the common video display layer;
the second display submodule is used for switching the display layer to which the target video picture belongs from the picture superposition layer to the common video display layer and updating the output position attribute of the video picture to be exchanged in the common video display layer when the target display mode is the exchange display mode; displaying the target video picture at the display position of the video picture to be exchanged in the common video display layer, and displaying the video picture to be exchanged at the initial display position of the target video picture in the common video display layer;
wherein the video pictures to be exchanged are determined in other video pictures based on the first position coordinates; the other video pictures are: and video pictures except the target video picture in the video pictures corresponding to the multiple display channels.
Optionally, in a specific implementation manner, the manner determining module is specifically configured to:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, determining the reduction display mode in the preset display mode as the target display mode met by the target video picture.
Optionally, in a specific implementation manner, the preset display manner further includes: a suspension display mode;
the screen display module further comprises:
and the third display sub-module is used for displaying the target video picture at a display position corresponding to the first position coordinate in the picture overlaying layer when the target display mode is the suspension display mode.
Optionally, in a specific implementation manner, the manner determining module is specifically configured to:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, calculating the coordinate distance between the first position coordinate and the second position coordinate, and determining the numerical relationship between the coordinate distance and a preset threshold value; wherein the second position coordinate is: when the target video picture is at the initial position, the position coordinates of the preset feature points in a coordinate system corresponding to the output interface are set;
when the numerical relationship is as follows: determining the reduction display mode in the preset display modes as a target display mode met by the target video picture if the coordinate distance is not greater than the preset threshold;
when the numerical relationship is as follows: and determining the suspension display mode in a preset display mode as a target display mode met by the target video picture when the coordinate distance is larger than the preset threshold value.
Corresponding to the video frame moving method provided by the above embodiment of the present invention, an embodiment of the present invention further provides an electronic device, as shown in fig. 13, including a processor 1301, a communication interface 1302, a memory 1303 and a communication bus 1304, where the processor 1301, the communication interface 1302 and the memory 1303 complete mutual communication via the communication bus 1304,
a memory 1303 for storing a computer program;
the processor 1301 is configured to implement the steps of any video image moving method provided in the embodiment of the present invention when executing the program stored in the memory 1303.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
Corresponding to the video frame moving method provided in the foregoing embodiments of the present invention, an embodiment of the present invention further provides a computer-readable storage medium, and when being executed by a processor, the computer program implements the steps of any one of the video frame moving methods provided in the foregoing embodiments of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (20)

1. A method for moving video pictures is applied to electronic equipment, and video pictures corresponding to a plurality of video channels are displayed on a common video display layer of an output interface of the electronic equipment, and the method comprises the following steps:
determining a target video picture to be moved in video pictures corresponding to the plurality of video channels;
switching the display layer to which the target video picture belongs from the common video display layer to a picture superposition layer; wherein, the picture superposition layer is: a video display layer capable of being superimposed on the normal video display layer;
moving the target video picture in the picture overlaying layer according to a moving track specified by a user; and the playing state of the target video picture in the moving process is the same as the playing state before moving.
2. The method of claim 1, further comprising:
when the movement is finished, determining a first position coordinate of a preset feature point in the target video picture in a coordinate system corresponding to the output interface;
and determining a target display mode met by the target video picture in a plurality of preset display modes based on the first position coordinate, and displaying the target video picture in the common video display layer or the picture superposition layer according to the target display mode.
3. The method of claim 2, wherein the target video picture is a video picture corresponding to a multi-channel video stream, and the multi-channel video stream corresponds to multiple video streams;
the step of switching the display layer to which the target video picture belongs from the common video display layer to a picture overlay layer includes:
and switching the display layer to which the sub video picture corresponding to each track video code stream in the target video picture belongs from the common video display layer to the picture superposition layer.
4. The method according to claim 3, wherein the step of moving the target video frame according to the movement track specified by the user comprises:
determining an updating sequence of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture based on the moving direction of the moving track specified by the user;
and sequentially increasing or decreasing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the numerical value corresponding to the moving distance according to the updating sequence.
5. The method of claim 1, wherein prior to the step of moving the target video picture in the picture overlay in accordance with a user-specified movement trajectory, the method further comprises:
and reducing the target video picture according to a preset proportion.
6. The method according to any one of claims 1 to 5, wherein the preset display mode comprises: a reduction display mode and an exchange display mode;
the step of displaying the target video picture according to the target display mode includes:
when the target display mode is the restoration display mode, switching the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer, and restoring the target video picture at the initial position of the target video picture in the common video display layer;
when the target display mode is the exchange display mode, switching the display layer to which the target video picture belongs from the picture superposition layer to the common video display layer, and updating the output position attribute of the video picture to be exchanged in the common video display layer; displaying the target video picture at the display position of the video picture to be exchanged in the common video display layer, and displaying the video picture to be exchanged at the initial display position of the target video picture in the common video display layer;
wherein the video pictures to be exchanged are determined in other video pictures based on the first position coordinates; the other video pictures are: and video pictures except the target video picture in the video pictures corresponding to the multiple display channels.
7. The method according to claim 6, wherein the step of determining the target display mode satisfied by the target video picture in a preset display mode based on the first position coordinates comprises:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, determining the reduction display mode in the preset display mode as the target display mode met by the target video picture.
8. The method of claim 6, wherein the preset display mode further comprises: a suspension display mode;
the step of displaying the target video picture according to the target display mode includes:
and when the target display mode is the suspension display mode, displaying the target video picture at a display position corresponding to the first position coordinate in the picture overlaying layer.
9. The method according to claim 8, wherein the step of determining the target display mode satisfied by the target video picture in a preset display mode based on the first position coordinates comprises:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, calculating the coordinate distance between the first position coordinate and the second position coordinate, and determining the numerical relationship between the coordinate distance and a preset threshold value; wherein the second position coordinate is: when the target video picture is at the initial position, the position coordinates of the preset feature points in a coordinate system corresponding to the output interface are set;
when the numerical relationship is as follows: determining the reduction display mode in the preset display modes as a target display mode met by the target video picture if the coordinate distance is not greater than the preset threshold;
when the numerical relationship is as follows: and determining the suspension display mode in a preset display mode as a target display mode met by the target video picture when the coordinate distance is larger than the preset threshold value.
10. A mobile device of video pictures is characterized in that the device is applied to electronic equipment, and video pictures corresponding to a plurality of video channels are displayed on a high-definition video common video display layer of an output interface of the electronic equipment, and the device comprises:
the picture determining module is used for determining a target video picture to be moved in the video pictures corresponding to the plurality of video channels;
the display layer switching module is used for switching the display layer to which the target video picture belongs from the common video display layer to a picture superposition layer; wherein, the picture superposition layer is: a video display layer capable of being superimposed on the normal video display layer;
the picture moving module is used for moving the target video picture in the picture overlaying layer according to a moving track specified by a user; and the playing state of the target video picture in the moving process is the same as the playing state before moving.
11. The apparatus of claim 10, further comprising:
the coordinate determination module is used for determining a first position coordinate of a preset feature point in the target video picture in a coordinate system corresponding to the output interface when the movement is finished;
the mode determining module is used for determining a target display mode met by the target video picture in a plurality of preset display modes based on the first position coordinate;
and the picture display module is used for displaying the target video picture in the common video display layer or the picture superposition layer according to the target display mode.
12. The apparatus of claim 11, wherein the target video frame is a video frame corresponding to a multi-channel video stream, and the multi-channel video stream corresponds to multiple video streams;
the display layer switching module is specifically configured to switch the display layer to which the sub-video picture corresponding to each track video code stream in the target video picture belongs from the common video display layer to the picture overlaying layer.
13. The apparatus according to claim 12, wherein the frame moving module is specifically configured to:
determining an updating sequence of the output position attribute of the sub-video picture corresponding to each track video code stream in the target video picture based on the moving direction of the moving track specified by the user; and sequentially increasing or decreasing the attribute value of the output position attribute of the sub video picture corresponding to each track video code stream in the target video picture by the numerical value corresponding to the moving distance according to the updating sequence.
14. The apparatus of claim 10, further comprising:
and the picture reducing module is used for reducing the target video picture according to a preset proportion before moving the target video picture in the picture overlaying layer according to a moving track specified by a user.
15. The apparatus according to any one of claims 10-14, wherein the preset display mode comprises: a reduction display mode and an exchange display mode;
the picture display module comprises:
the first display sub-module is used for switching the display layer to which the target video picture belongs from the picture overlaying layer to the common video display layer when the target display mode is the restoration display mode, and restoring the target video picture at the initial position of the target video picture in the common video display layer;
the second display submodule is used for switching the display layer to which the target video picture belongs from the picture superposition layer to the common video display layer and updating the output position attribute of the video picture to be exchanged in the common video display layer when the target display mode is the exchange display mode; displaying the target video picture at the display position of the video picture to be exchanged in the common video display layer, and displaying the video picture to be exchanged at the initial display position of the target video picture in the common video display layer;
wherein the video pictures to be exchanged are determined in other video pictures based on the first position coordinates; the other video pictures are: and video pictures except the target video picture in the video pictures corresponding to the multiple display channels.
16. The apparatus of claim 15, wherein the means for determining is specifically configured to:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, determining the reduction display mode in the preset display mode as the target display mode met by the target video picture.
17. The apparatus of claim 15, wherein the preset display mode further comprises: a suspension display mode;
the screen display module further comprises:
and the third display sub-module is used for displaying the target video picture at a display position corresponding to the first position coordinate in the picture overlaying layer when the target display mode is the suspension display mode.
18. The apparatus of claim 17, wherein the means for determining is specifically configured to:
judging whether the first position coordinate is positioned in a display area of any one of the other video pictures;
if so, determining the exchange display mode in the preset display modes as a target display mode met by the target video picture;
otherwise, calculating the coordinate distance between the first position coordinate and the second position coordinate, and determining the numerical relationship between the coordinate distance and a preset threshold value; wherein the second position coordinate is: when the target video picture is at the initial position, the position coordinates of the preset feature points in a coordinate system corresponding to the output interface are set;
when the numerical relationship is as follows: determining the reduction display mode in the preset display modes as a target display mode met by the target video picture if the coordinate distance is not greater than the preset threshold;
when the numerical relationship is as follows: and determining the suspension display mode in a preset display mode as a target display mode met by the target video picture when the coordinate distance is larger than the preset threshold value.
19. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 1-9 when executing a program stored in the memory.
20. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of the claims 1-9.
CN201911006730.1A 2019-10-22 2019-10-22 Video picture moving method and device and electronic equipment Active CN112702561B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911006730.1A CN112702561B (en) 2019-10-22 2019-10-22 Video picture moving method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911006730.1A CN112702561B (en) 2019-10-22 2019-10-22 Video picture moving method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN112702561A true CN112702561A (en) 2021-04-23
CN112702561B CN112702561B (en) 2023-05-05

Family

ID=75504592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911006730.1A Active CN112702561B (en) 2019-10-22 2019-10-22 Video picture moving method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112702561B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113891141A (en) * 2021-10-25 2022-01-04 北京字节跳动网络技术有限公司 Video processing method, device and equipment
CN115426452A (en) * 2022-08-22 2022-12-02 杭州萤石软件有限公司 Channel picture exchange method, device, equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102542933A (en) * 2012-01-16 2012-07-04 深圳市创维群欣安防科技有限公司 Windowing controller based on large screen liquid crystal splicing display
CN102695037A (en) * 2011-03-25 2012-09-26 无锡维森智能传感技术有限公司 Method for switching and expression of vehicle-mounted multi-view camera picture
CN103491341A (en) * 2013-07-17 2014-01-01 北京汉邦高科数字技术股份有限公司 Method for displaying network hard disk video
CN103517126A (en) * 2012-06-19 2014-01-15 华为技术有限公司 Mosaic video display method, display control device and terminal
US20140365892A1 (en) * 2013-06-08 2014-12-11 Tencent Technology (Shenzhen) Company Limited Method, apparatus and computer readable storage medium for displaying video preview picture
CN105763851A (en) * 2016-04-05 2016-07-13 赣州市金电电子设备有限公司 Forest fire prevention video monitoring and early warning system based on electronic government affair network platform
CN106534733A (en) * 2015-09-09 2017-03-22 杭州海康威视数字技术股份有限公司 Video window displaying method and apparatus
CN108632547A (en) * 2017-03-15 2018-10-09 武汉玉航科技有限公司 A kind of multi-channel video preprocess method
CN109963188A (en) * 2017-12-22 2019-07-02 杭州海康威视数字技术股份有限公司 Switching method, device, electronic equipment and the storage medium of video pictures

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102695037A (en) * 2011-03-25 2012-09-26 无锡维森智能传感技术有限公司 Method for switching and expression of vehicle-mounted multi-view camera picture
CN102542933A (en) * 2012-01-16 2012-07-04 深圳市创维群欣安防科技有限公司 Windowing controller based on large screen liquid crystal splicing display
CN103517126A (en) * 2012-06-19 2014-01-15 华为技术有限公司 Mosaic video display method, display control device and terminal
US20140365892A1 (en) * 2013-06-08 2014-12-11 Tencent Technology (Shenzhen) Company Limited Method, apparatus and computer readable storage medium for displaying video preview picture
CN103491341A (en) * 2013-07-17 2014-01-01 北京汉邦高科数字技术股份有限公司 Method for displaying network hard disk video
CN106534733A (en) * 2015-09-09 2017-03-22 杭州海康威视数字技术股份有限公司 Video window displaying method and apparatus
CN105763851A (en) * 2016-04-05 2016-07-13 赣州市金电电子设备有限公司 Forest fire prevention video monitoring and early warning system based on electronic government affair network platform
CN108632547A (en) * 2017-03-15 2018-10-09 武汉玉航科技有限公司 A kind of multi-channel video preprocess method
CN109963188A (en) * 2017-12-22 2019-07-02 杭州海康威视数字技术股份有限公司 Switching method, device, electronic equipment and the storage medium of video pictures

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113891141A (en) * 2021-10-25 2022-01-04 北京字节跳动网络技术有限公司 Video processing method, device and equipment
CN113891141B (en) * 2021-10-25 2024-01-26 抖音视界有限公司 Video processing method, device and equipment
CN115426452A (en) * 2022-08-22 2022-12-02 杭州萤石软件有限公司 Channel picture exchange method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN112702561B (en) 2023-05-05

Similar Documents

Publication Publication Date Title
CN104822088B (en) Video image zooming method and apparatus
JP5654340B2 (en) Aspect ratio suggestions for resizable video windows
US9323432B2 (en) Method and apparatus for adjusting size of displayed objects
US10838607B2 (en) Managing objects in panorama display to navigate spreadsheet
US10241660B2 (en) Display control apparatus, method for controlling the same, and storage medium
US20150074567A1 (en) Method, system for updating dynamic map-type graphic interface and electronic device using the same
US20120013645A1 (en) Display and method of displaying icon image
CN111641797B (en) Video call interface display control method and device, storage medium and equipment
CN105549934A (en) Display interface control method and system
CN112702561B (en) Video picture moving method and device and electronic equipment
WO2021243788A1 (en) Screenshot method and apparatus
US20150020023A1 (en) Information cross-reference inputting method based on a mobile terminal and the mobile terminal
EP2859447A1 (en) Virtual surface allocation
JPWO2018198703A1 (en) Display device
JP2009003851A (en) Information apparatus with touch panel, and icon selecting method and program used for the same
US20150116352A1 (en) Groups control method, system for a dynamic map-type graphic interface and electronic device using the same
CN107533448A (en) Image output control method, image Output Control Program and display device
JP6494358B2 (en) Playback control device and playback control method
CN106131628B (en) A kind of method of video image processing and device
CN101764968B (en) Anisometric zooming method of video images without perceptive distortion of important content
CN109582269B (en) Physical splicing screen display method and device and terminal equipment
CN109753333B (en) Interface layout method, device, equipment and medium
JP2005293292A (en) Information processing device and cursor control program
CN112711459B (en) Multimedia data processing method, device, equipment and computer readable storage medium
JP2020507174A (en) How to navigate the panel of displayed content

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant