CN112866817B - Video playback method, device, electronic device and storage medium - Google Patents

Video playback method, device, electronic device and storage medium Download PDF

Info

Publication number
CN112866817B
CN112866817B CN202110011889.3A CN202110011889A CN112866817B CN 112866817 B CN112866817 B CN 112866817B CN 202110011889 A CN202110011889 A CN 202110011889A CN 112866817 B CN112866817 B CN 112866817B
Authority
CN
China
Prior art keywords
video
picture
image
time
interesting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110011889.3A
Other languages
Chinese (zh)
Other versions
CN112866817A (en
Inventor
张晓慧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202110011889.3A priority Critical patent/CN112866817B/en
Publication of CN112866817A publication Critical patent/CN112866817A/en
Application granted granted Critical
Publication of CN112866817B publication Critical patent/CN112866817B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4825End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The application relates to a video playback method, a video playback device, an electronic device and a storage medium, wherein the method comprises the following steps: obtaining an interesting image from a video; carrying out target identification on the interested image to obtain the characteristic information of the interested image; acquiring a query condition, querying a picture of an interested image in a video according to the query condition and the characteristic information of the interested image, and determining a first picture in which the interested image appears for the first time and a second picture in which the interested image appears for the last time under the query condition; and adding a first video clip containing the first picture and a second video clip containing the second picture into the video playback list, and playing back the video clips in the video playback list. By the method and the device, the problem that the behavior track of the target in the video is difficult to acquire in the related technology is solved, and the technical effect that the behavior track of the target of interest in the video can be acquired quickly is achieved.

Description

Video playback method, device, electronic device and storage medium
Technical Field
The present application relates to the field of video monitoring technologies, and in particular, to a video playback method, an apparatus, an electronic apparatus, and a storage medium.
Background
The monitoring system generally comprises: a plurality of network cameras and a network hard disk video recorder. Each video file shot by the IPC corresponds to one video channel, and one video channel can be called as one video. NVRs have the ability to store and playback video files.
With the maturity of image analysis algorithms and the improvement of chip computing power, the application of video intelligent analysis in the field of video monitoring is more and more extensive, and the intelligent analysis in the monitoring field can be divided into two categories, namely front-end intelligence and back-end intelligence, according to the position of algorithm operation. The front-end intelligence mainly runs on the network camera, and the rear-end intelligence mainly runs on the intelligent server, the intelligent NVR and other equipment.
Meanwhile, with the wide application of intelligent detection in the monitoring field, when people use an intelligent detection system, besides the accuracy of pursuing detection results, different detection results can be automatically associated, and the extraction of data desired by users from massive intelligent detection results by taking application scenes as targets is also a potential quality continuously pursued by people.
At present, the existing intelligent video analysis usually collects video image information of each physical area through collection equipment such as a network camera and the like, transmits video image data to a server, stores and analyzes the data transmitted by the collection equipment through the server, displays the original data collected by the collection equipment and the data in the analyzed video through a client, and the videos displayed in the client under each channel are usually sorted according to the channel and time, if a certain person stays in a certain shooting area for a long time, and because of a large number of people in the area, the blocking is easy to occur; meanwhile, if a user wants to check behavior track information of targets in different shooting areas, all channels are often required to be selected for one-time retrieval or a single channel is often required to be retrieved for multiple times, the user needs to search, track and judge the activities of target objects in events, and manually click videos corresponding to the events one by one to play back or sequentially play back all event videos, so that only event videos containing only targets specified by the user cannot be played back.
At present, an effective solution is not provided aiming at the problem that the behavior track of the target in the video is difficult to obtain in the related technology.
Disclosure of Invention
The embodiment of the application provides a video playback method, a video playback device, an electronic device and a storage medium, and aims to at least solve the problem that the behavior track of a target in a video is difficult to acquire in the related art.
In a first aspect, an embodiment of the present application provides a video playback method, including: obtaining an interesting image from a video; carrying out target identification on the interested image to obtain the characteristic information of the interested image; acquiring a query condition, querying a picture of the interesting image in a video according to the query condition and the characteristic information of the interesting image, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time under the query condition; and adding a first video clip containing the first picture and a second video clip containing the second picture into a video playback list, and playing back the video clips in the video playback list.
In some of these embodiments, obtaining the image of interest from the video comprises: capturing a video frame containing the region of interest from a video of a current channel; framing the region of interest in the video frame to obtain a coordinate point of the framed region; and extracting the interested image from the video frame according to the coordinate point of the framing area.
In some of these embodiments, the query condition includes at least one of: shooting areas and shooting time, wherein the shooting areas comprise current channels; inquiring the picture of the interesting image in the video according to the inquiry condition and the characteristic information of the interesting image, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time under the inquiry condition comprises the following steps: configuring a time interval for video playback; under the condition that the time interval is zero, according to the query condition and the feature information of the interesting image, querying a picture of the interesting image from the video of the current channel, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time under the current channel; under the condition that the time interval is not zero, according to the query condition and the characteristic information of the interesting image, inquiring the picture of the interesting image from the video of each channel corresponding to the shooting area according to the time interval, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time in each channel corresponding to the shooting area.
In some of these embodiments, joining a first video clip containing the first picture and a second video clip containing the second picture to a video playback list comprises: in the case that the time interval is zero, extracting a first video clip containing the first picture and a second video clip containing the second picture from the video of the current channel, and adding the first video clip and the second video clip to the video playback list; and under the condition that the time interval is not zero, extracting a first video clip containing the first picture and a second video clip containing the second picture from the video of each channel corresponding to the shooting area, and adding the first video clip and the second video clip into the video playback list.
In some of these embodiments, playing back the video segments in the video playback list comprises: sequencing each channel according to the time information that the interested image appears under each channel for the first time to obtain a channel sequence; sequentially playing back the video segments in the video playback list according to the time interval and the channel sequence; or according to the time interval and the shooting time, playing back the video segments corresponding to the shooting time in the video playback list.
In some embodiments, after playing back the video segments in the video playback list, the method further comprises: and adding the channel switching process in the video clip playback process into a behavior track list, and displaying the channel switching process.
In some embodiments, the first video segment includes a video of the video within a preset time range before and after the first picture; the second video clip comprises videos in a preset time range before and after the first picture in the videos.
In a second aspect, an embodiment of the present application provides a video playback apparatus, including: the acquisition module is used for acquiring an interested image from a video; the identification module is used for carrying out target identification on the interested image to obtain the characteristic information of the interested image; the query module is used for acquiring a query condition, querying a picture of the interested image in a video according to the query condition and the characteristic information of the interested image, and determining a first picture of the interested image appearing for the first time and a second picture of the interested image appearing for the last time under the query condition; and the playback module is used for adding a first video clip containing the first picture and a second video clip containing the second picture into a video playback list and playing back the video clips in the video playback list.
In a third aspect, an embodiment of the present application provides an electronic apparatus, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the video playback method according to the first aspect is implemented.
In a fourth aspect, embodiments of the present application provide a storage medium, on which a computer program is stored, which when executed by a processor, implements the video playback method as described in the first aspect above.
Compared with the related art, the video playback method, the video playback device, the electronic device and the storage medium solve the problem that the behavior track of the target in the video is difficult to obtain in the related art, and achieve the technical effect that the behavior track of the target of interest in the video can be obtained quickly.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flow chart of a video playback method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a monitoring system according to an embodiment of the present application;
FIG. 3 is a schematic interface diagram of a monitoring system client in the related art;
FIG. 4 is a schematic interface diagram of a monitoring system client according to an embodiment of the application;
FIG. 5 is a flow chart of a video playback method according to a preferred embodiment of the present application;
fig. 6 is a block diagram of a video playback apparatus according to an embodiment of the present application;
fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by one of ordinary skill in the art that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The use of the terms "including," "comprising," "having," and any variations thereof herein, is meant to cover a non-exclusive inclusion; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but rather can include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The present embodiment provides a video playback method, and fig. 1 is a flowchart of a video playback method according to an embodiment of the present application, where as shown in fig. 1, the flowchart includes the following steps:
step S101, obtaining interested images from the video.
And step S102, carrying out target identification on the interested image to obtain the characteristic information of the interested image.
Step S103, acquiring query conditions, querying pictures of the interested images in the video according to the query conditions and the feature information of the interested images, and determining a first picture of the interested images appearing for the first time and a second picture of the interested images appearing for the last time under the query conditions.
Step S104, adding a first video clip containing a first picture and a second video clip containing a second picture into the video playback list, and playing back the video clips in the video playback list.
In some of these embodiments, obtaining the image of interest from the video includes the steps of:
step 1, capturing a video frame containing an interested area from a video of a current channel.
And 2, framing the region of interest in the video frame to obtain a coordinate point of the framed region.
And 3, extracting an interested image from the video frame according to the coordinate point of the framed area.
In this embodiment, a user can start real-time monitoring on a current channel, watch a video picture corresponding to a certain shooting area under the current channel, capture a frame of video frame in the current monitoring picture through video freezing when a certain target, a certain object or other interested area appears in the video to attract the attention of the user and the user wants to view a behavior track of the interested area in a certain range of area observed within a certain time, and cover the video frame on an active video picture, and frame the interested area in the video frame in a rectangular or polygonal form through a mouse, and extract an interested image from the video frame according to a coordinate point of the framed area.
After the interesting image is obtained, the interesting image can be analyzed and processed through a target recognition algorithm, the characteristic data of the interesting image is extracted, and the characteristic information of the interesting image and the small image of the interesting image are obtained, wherein the small image of the interesting image can be displayed to a user to enable the user to compare whether the small image corresponds to a subsequent video clip or not.
In some of these embodiments, the query condition includes at least one of: shooting area and shooting time; wherein the shooting area comprises a current channel; the method comprises the steps of inquiring pictures of the interested images in the video according to the inquiry condition and the characteristic information of the interested images, and determining a first picture of the interested images appearing for the first time and a second picture of the interested images appearing for the last time under the inquiry condition, wherein the steps of:
step 1, configuring the time interval of video playback.
And 2, under the condition that the time interval is zero, inquiring the picture of the current interested image from the video of the current channel according to the inquiry condition and the characteristic information of the interested image, and determining a first picture of the first interested image and a second picture of the last interested image in the current channel.
And 3, under the condition that the time interval is not zero, according to the query condition and the characteristic information of the interested image, querying the picture of the interested image from the video of each channel corresponding to the shooting area according to the time interval, and determining a first picture of the interested image appearing for the first time and a second picture of the interested image appearing for the last time in each channel corresponding to the shooting area.
In this embodiment, the first video segment includes videos in a preset time range before and after the first picture in the video; the second video segment includes videos in a preset time range before and after the first picture in the video, where the preset time range may be 10S, and may also be other values.
After configuring the time interval of video playback, a picture with an image of interest can be queried from the video of each channel corresponding to the shooting area according to the query condition and the feature information of the image of interest, a picture with an image of interest can be queried from the video of the current channel under the condition that the time interval is zero or the time interval is not configured, and a picture with an image of interest can be queried from the video of each channel corresponding to the shooting area according to the time interval under the condition that the time interval is not zero.
In some of these embodiments, joining a first video clip containing a first picture and a second video clip containing a second picture to a video playback list comprises: under the condition that the time interval is zero, extracting a first video clip containing a first picture and a second video clip containing a second picture from the video of the current channel, and adding the first video clip and the second video clip into a video playback list; in a case where the time interval is not zero, a first video clip containing a first picture and a second video clip containing a second picture are extracted from the video of each channel corresponding to the shooting region, and the first video clip and the second video clip are added to the video playback list.
In this embodiment, playing back the video segments in the video playback list may include: sequencing each channel according to the time information that the interested image appears under each channel for the first time to obtain a channel sequence; sequentially playing back the video clips in the video playback list according to the time interval and the channel sequence; or according to the time interval and the shooting time, playing back the video segments corresponding to the shooting time in the video playback list.
In this embodiment, after each video segment is obtained, each video segment may be added to the video playback list, the play thread requests each video segment in sequence, and if an area is switched by an image of interest in the video segment in the playback process of the video segment, channels of the video segment may also be switched, and a channel switching process in the playback process of the video segment may be added to the behavior trajectory list, and the channel switching process is displayed, so that the behavior trajectory of the target to be detected is obtained based on the channel switching process.
The video playback method in the related art is often that when a target in a video draws attention of a user or a target appearing in the video is an object focused by the user, and the user searches historical activity data of the target according to the target appearing in the current video, the operation can be performed through a user interface, fig. 3 is an interface schematic diagram of a monitoring system client in the related art, the user can lock the target by using a mouse frame and search the target, as shown in fig. 3, a picture area is a picture output after the mouse frame selection area is processed by a server, a search condition area comprises information such as a search event and a channel, after the user selects a search condition, the picture is searched, and a snapshot event of the target under each channel under the current search condition is displayed in a search result display area.
Generally, the retrieval results are sorted according to channels and time, and if the target stays in a certain shooting area for a long time and the number of people in the shooting area is large, the target is easily blocked; for a single target face, multiple times of detection and image snapshot can be carried out in a short time, and multiple times of search can be carried out when historical target retrieval is carried out. If a user wants to check the approximate activity conditions of the targets in different shooting areas, all channels can be selected for one-time retrieval, the detection results of different channels can be checked, or a single channel can be used for multiple times of retrieval, however, the scheme has the defect that the activity tracks of the same target in different shooting areas are inconvenient to check, track and compare.
In this embodiment, the video playback method described above may be implemented by a monitoring system, and fig. 2 is a schematic structural diagram of the monitoring system according to an embodiment of the present application, and as shown in fig. 2, the monitoring system may include: the system comprises a front-end device 20, a server 21 and a client 22, wherein the front-end device 20 may include a video source collecting device such as a network camera, and is configured to collect video image data of each physical area and transmit the video image data to the server 21; the server 21 is used for storing and analyzing data transmitted by the front-end device 20; for the front-end device 20 with the intelligent analysis function, the front-end device 20 may send the collected original data and the analyzed and processed data to the server 21 together, and execute the video playback method according to the above embodiment; for the front-end device 20 without intelligent analysis, the server 21 may analyze and store the data, and execute the video playback method as in the above embodiment; the client 22 is used for displaying the original data of the video image and the data in the analyzed video.
Fig. 4 is a schematic interface diagram of a monitoring system client according to an embodiment of the present application, and as shown in fig. 4, when a play button is clicked and a time interval of video playback is configured, a video playback area may play back video segments under multiple channels, and in a playback process, when a channel is switched, a channel switching process may be displayed in a behavior track list on the right side. When a plurality of detection events of the same target in a certain channel exist, the event video of the target in the channel can be played back through time value configuration, and corresponding playing information is recorded in a behavior track list on the right side.
Through the steps from S101 to S104, through configuring the query condition and the time interval, the picture with the interesting image in each channel is returned according to the query condition, the first picture with the interesting image appearing for the first time and the second picture with the interesting image appearing for the last time under the query condition are determined, the first video clip containing the first picture and the second video clip containing the second picture are added into the video playback list, the video clips in the corresponding channels can be played in sequence through shooting time information or according to the sequence of the channels, the channel switching process is recorded into the behavior track list and displayed to the user, the user can directly position the video clip corresponding to the record to play back by double clicking a certain record in the behavior track list, the problem that the behavior track of the target in the video is difficult to obtain in the related technology is solved, and the technical effect of quickly obtaining the behavior track of the interesting target in the video is realized.
Fig. 5 is a flow chart of a video playback method according to a preferred embodiment of the present application, as shown in fig. 6, which in some embodiments includes:
in step S501, monitoring of the imaging area corresponding to the current channel is started.
And step S502, judging that the target to be detected appears in the shooting area corresponding to the current channel.
In step S503, the video freezing acquires a video frame.
Step S504, the user frames the interested area in the video frame to obtain the interested image.
And step S505, carrying out target identification on the interested image, and acquiring the characteristic information of the interested image.
Step S506, obtaining the query condition and the time interval of video playback, obtaining the video segment according to the query condition, and adding the video segment into the video playback list.
In step S507, it is determined whether the video playback list is empty.
And step S508, under the condition that the video playback list is not empty, selecting the video segments in the video playback list for playback.
The video playback method proposed in this embodiment has already been described in detail in the foregoing embodiments, and is not described here again.
This embodiment further provides a video playback apparatus, which is used to implement the foregoing embodiments and preferred embodiments, and the description that has been made is omitted. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware or a combination of software and hardware is also possible and contemplated.
Fig. 6 is a block diagram of a video playback apparatus according to an embodiment of the present application, and as shown in fig. 6, the apparatus includes: an obtaining module 60, configured to obtain an image of interest from the video; the identification module 61 is configured to perform target identification on the interested image to obtain feature information of the interested image; the query module 62 is configured to obtain a query condition, query a picture of an image of interest in a video according to the query condition and feature information of the image of interest, and determine a first picture in which the image of interest appears for the first time and a second picture in which the image of interest appears for the last time under the query condition; and a playback module 63, configured to add a first video segment containing the first picture and a second video segment containing the second picture to the video playback list, and play back the video segments in the video playback list.
In some of these embodiments, the obtaining module 60 is further configured to capture a video frame containing the region of interest from the video of the current channel; framing an interested area in a video frame to obtain a coordinate point of the framed area; and extracting an interesting image from the video frame according to the coordinate points of the framing area.
In some of these embodiments, the query condition includes at least one of: shooting areas and shooting time, wherein the shooting areas comprise current channels; the query module 62 is further configured for configuring a time interval for video playback; under the condition that the time interval is zero, according to the query condition and the characteristic information of the interested image, querying a picture of the interested image from the video of the current channel, and determining a first picture of the interested image appearing for the first time and a second picture of the interested image appearing for the last time under the current channel; under the condition that the time interval is not zero, according to the query condition and the characteristic information of the interested image, querying the picture of the interested image from the video of each channel corresponding to the shooting area according to the time interval, and determining a first picture of the interested image appearing for the first time and a second picture of the interested image appearing for the last time in each channel corresponding to the shooting area.
In some of these embodiments, the playback module 63 is further configured to, in a case where the time interval is zero, extract a first video segment containing a first picture and a second video segment containing a second picture from the video of the current channel, and add the first video segment and the second video segment to the video playback list; in a case where the time interval is not zero, a first video clip containing a first picture and a second video clip containing a second picture are extracted from the video of each channel corresponding to the shooting region, and the first video clip and the second video clip are added to the video playback list.
In some of these embodiments, the playback module 63 is further configured to sort each channel according to the time information that the image of interest first appears under each channel, resulting in a channel order; sequentially playing back the video clips in the video playback list according to the time intervals and the channel sequence; or according to the time interval and the shooting time, playing back the video segments corresponding to the shooting time in the video playback list.
In some embodiments, the playback module 63 is further configured to add a channel switching process during playback of the video segment to the behavior track list and to expose the channel switching process.
In some embodiments, the first video segment includes a video within a preset time range before and after the first picture in the video; the second video segment comprises videos in a preset time range before and after the first picture in the videos.
The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the above modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
Fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application, and as shown in fig. 7, the electronic device includes a memory 704 and a processor 702, where the memory 704 stores a computer program, and the processor 702 is configured to execute the computer program to perform the steps in any one of the method embodiments.
Specifically, the processor 702 may include a Central Processing Unit (CPU), or A Specific Integrated Circuit (ASIC), or may be configured to implement one or more Integrated circuits of the embodiments of the present Application.
Memory 704 may include, among other things, mass storage 704 for data or instructions. By way of example, and not limitation, the memory 704 may include a Hard Disk Drive (Hard Disk Drive, abbreviated HDD), a floppy Disk Drive, a Solid State Drive (SSD), flash memory, an optical disc, a magneto-optical disc, tape, or a Universal Serial Bus (USB) Drive, or a combination of two or more of these. Memory 704 may include removable or non-removable (or fixed) media, where appropriate. The memory 704 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 704 is a Non-Volatile (Non-Volatile) memory. In particular embodiments, memory 704 includes Read-Only Memory (ROM) and Random Access Memory (RAM). The ROM may be mask-programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or FLASH Memory (FLASH), or a combination of two or more of these, where appropriate. The RAM may be a Static Random-Access Memory (SRAM) or a Dynamic Random-Access Memory (DRAM), where the DRAM may be a Fast Page Mode Dynamic Random-Access Memory 704 (fpram), an Extended Data Out Dynamic Random Access Memory (EDODRAM), a Synchronous Dynamic Random Access Memory (SDRAM), and the like.
The memory 704 may be used to store or cache various data files for processing and/or communication purposes, as well as possibly computer program instructions for execution by the processor 702.
The processor 702 implements any of the video playback methods in the above embodiments by reading and executing computer program instructions stored in the memory 704.
Optionally, the electronic apparatus may further include a transmission device 706 and an input/output device 708, where the transmission device 706 is connected to the processor 702, and the input/output device 708 is connected to the processor 702.
Alternatively, in this embodiment, the processor 702 may be configured to execute the following steps by a computer program:
s1, obtaining an interesting image from a video.
And S2, carrying out target identification on the interested image to obtain the characteristic information of the interested image.
And S3, acquiring a query condition, querying a picture of the image of interest in the video according to the query condition and the characteristic information of the image of interest, and determining a first picture in which the image of interest appears for the first time and a second picture in which the image of interest appears for the last time under the query condition.
And S4, adding the first video clip containing the first picture and the second video clip containing the second picture into a video playback list, and playing back the video clips in the video playback list.
It should be noted that, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiment and optional implementation manners, and details of this embodiment are not described herein again.
In addition, in combination with the video playback method in the foregoing embodiment, the embodiment of the present application may be implemented by providing a storage medium. The storage medium has a computer program stored thereon; the computer program, when executed by a processor, implements any of the video playback methods in the above embodiments.
It should be understood by those skilled in the art that various features of the above embodiments can be combined arbitrarily, and for the sake of brevity, all possible combinations of the features in the above embodiments are not described, but should be considered as within the scope of the present disclosure as long as there is no contradiction between the combinations of the features.
The above examples only express several embodiments of the present application, and the description thereof is more specific and detailed, but not to be construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, and these are all within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims (10)

1. A video playback method, comprising:
obtaining an interesting image from a video;
carrying out target identification on the interested image to obtain the characteristic information of the interested image;
acquiring a query condition, querying a picture of the interested image in a video according to the query condition and the characteristic information of the interested image, and determining a first picture of the interested image appearing for the first time and a second picture of the interested image appearing for the last time under the query condition;
adding a first video clip containing the first picture and a second video clip containing the second picture into a video playback list, and playing back the video clips in the video playback list;
the query condition includes at least one of: shooting area and shooting time, wherein the shooting area comprises a current channel; inquiring pictures of the interesting images in the video according to the inquiry condition and the characteristic information of the interesting images, and determining a first picture of the interesting images appearing for the first time and a second picture of the interesting images appearing for the last time under the inquiry condition comprises the following steps:
configuring a time interval for video playback;
under the condition that the time interval is zero, inquiring a picture of the interesting image from the video of the current channel according to the inquiry condition and the characteristic information of the interesting image, and determining a first picture of the interesting image appearing in the current channel for the first time and a second picture of the interesting image appearing in the last time;
under the condition that the time interval is not zero, according to the query condition and the characteristic information of the interesting image, inquiring the picture of the interesting image from the video of each channel corresponding to the shooting area according to the time interval, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time in each channel corresponding to the shooting area.
2. The video playback method of claim 1, wherein obtaining the image of interest from the video comprises:
capturing a video frame containing the region of interest from a video of a current channel;
framing the region of interest in the video frame to obtain coordinate points of the framed region;
and extracting the interested image from the video frame according to the coordinate point of the framing area.
3. The video playback method of claim 1, wherein adding a first video clip containing the first picture and a second video clip containing the second picture to a video playback list comprises:
in the case that the time interval is zero, extracting a first video clip containing the first picture and a second video clip containing the second picture from the video of the current channel, and adding the first video clip and the second video clip into the video playback list;
and under the condition that the time interval is not zero, extracting a first video clip containing the first picture and a second video clip containing the second picture from the video of each channel corresponding to the shooting area, and adding the first video clip and the second video clip into the video playback list.
4. The video playback method according to claim 1, wherein playing back the video segments in the video playback list comprises:
sequencing each channel according to the time information that the image of interest appears under each channel for the first time to obtain a channel sequence;
and sequentially playing back the video segments in the video playback list according to the time interval and the channel sequence.
5. The video playback method according to claim 1, wherein playing back the video segments in the video playback list comprises:
and according to the time interval and the shooting time, playing back the video clips corresponding to the shooting time in the video playback list.
6. The video playback method according to claim 4 or 5, wherein after playing back the video segments in the video playback list, the method further comprises:
and adding the channel switching process in the video clip playback process into a behavior track list, and displaying the channel switching process.
7. The video playback method according to claim 1,
the first video clip comprises videos in the videos within a preset time range before and after the first picture; the second video clip comprises videos in a preset time range before and after the first picture in the videos.
8. A video playback apparatus, comprising:
the acquisition module is used for acquiring an interested image from a video;
the identification module is used for carrying out target identification on the interested image to obtain the characteristic information of the interested image;
the query module is used for acquiring a query condition, querying a picture of the interesting image in a video according to the query condition and the characteristic information of the interesting image, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time under the query condition;
the playback module is used for adding a first video clip containing the first picture and a second video clip containing the second picture into a video playback list and playing back the video clips in the video playback list;
the query module is configured to obtain the query condition, where the query condition includes at least one of: shooting areas and shooting time, wherein the shooting areas comprise current channels; inquiring pictures of the interesting images in the video according to the inquiry condition and the characteristic information of the interesting images, and determining a first picture of the interesting images appearing for the first time and a second picture of the interesting images appearing for the last time under the inquiry condition comprises the following steps:
configuring a time interval for video playback;
under the condition that the time interval is zero, according to the query condition and the feature information of the interesting image, querying a picture of the interesting image from the video of the current channel, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time under the current channel;
under the condition that the time interval is not zero, according to the query condition and the characteristic information of the interesting image, inquiring the picture of the interesting image from the video of each channel corresponding to the shooting area according to the time interval, and determining a first picture of the interesting image appearing for the first time and a second picture of the interesting image appearing for the last time in each channel corresponding to the shooting area.
9. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to run the computer program to perform the video playback method of any of claims 1 to 7.
10. A storage medium having stored thereon a computer program, wherein the computer program is arranged to perform the video playback method of any of claims 1 to 7 when executed.
CN202110011889.3A 2021-01-06 2021-01-06 Video playback method, device, electronic device and storage medium Active CN112866817B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110011889.3A CN112866817B (en) 2021-01-06 2021-01-06 Video playback method, device, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110011889.3A CN112866817B (en) 2021-01-06 2021-01-06 Video playback method, device, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN112866817A CN112866817A (en) 2021-05-28
CN112866817B true CN112866817B (en) 2022-10-14

Family

ID=76004080

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110011889.3A Active CN112866817B (en) 2021-01-06 2021-01-06 Video playback method, device, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN112866817B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114786064A (en) * 2022-03-14 2022-07-22 深圳市景阳信息技术有限公司 Method and device for playing back video, electronic equipment and storage medium
CN115348477A (en) * 2022-04-28 2022-11-15 武汉众智数字技术有限公司 Method and system for quickly retrieving videos based on time axis
CN115514887A (en) * 2022-09-07 2022-12-23 影石创新科技股份有限公司 Control method and device for video acquisition, computer equipment and storage medium

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8457466B1 (en) * 2008-09-29 2013-06-04 Videomining Corporation Videore: method and system for storing videos from multiple cameras for behavior re-mining
CN101840422A (en) * 2010-04-09 2010-09-22 江苏东大金智建筑智能化***工程有限公司 Intelligent video retrieval system and method based on target characteristic and alarm behavior
US8854474B2 (en) * 2011-03-08 2014-10-07 Nice Systems Ltd. System and method for quick object verification
CN102129474B (en) * 2011-04-20 2015-02-11 浙江宇视科技有限公司 Method, device and system for retrieving video data
CN103379307A (en) * 2012-04-13 2013-10-30 何磊 Video track tracking monitoring and retrieval playback system based on wireless positioning
CN103020260A (en) * 2012-12-24 2013-04-03 中国科学院半导体研究所 Video query method
CN103079061B (en) * 2013-01-30 2016-07-13 浙江宇视科技有限公司 A kind of video tracking processes device and video link processes device
CN106446002A (en) * 2016-08-01 2017-02-22 三峡大学 Moving target-based video retrieval method for track in map
CN108174132B (en) * 2016-12-07 2020-12-11 杭州海康威视数字技术股份有限公司 Video file playback method and device
CN107480236B (en) * 2017-08-08 2021-03-26 深圳创维数字技术有限公司 Information query method, device, equipment and medium
CN108921876A (en) * 2018-07-10 2018-11-30 北京旷视科技有限公司 Method for processing video frequency, device and system and storage medium
CN110147471A (en) * 2019-04-04 2019-08-20 平安科技(深圳)有限公司 Trace tracking method, device, computer equipment and storage medium based on video
CN112019928B (en) * 2019-05-30 2022-05-06 杭州海康威视数字技术股份有限公司 Video playback method and device and electronic equipment

Also Published As

Publication number Publication date
CN112866817A (en) 2021-05-28

Similar Documents

Publication Publication Date Title
CN112866817B (en) Video playback method, device, electronic device and storage medium
JP5438436B2 (en) Image search device
WO2016119368A1 (en) Target tracking method and device
US20210357678A1 (en) Information processing method and apparatus, and storage medium
JP5506324B2 (en) Similar image search system and similar image search method
CN111222373B (en) Personnel behavior analysis method and device and electronic equipment
KR20110132884A (en) Apparatus for intelligent video information retrieval supporting multi channel video indexing and retrieval, and method thereof
CN111046235A (en) Method, system, equipment and medium for searching acoustic image archive based on face recognition
CN111615003A (en) Video playing control method, device, equipment and storage medium
CN111241872A (en) Video image shielding method and device
JP2020047069A (en) Information processing system, and method and program for controlling information processing system
KR20170098139A (en) Apparatus and method for summarizing image
KR20140023660A (en) Apparatus, method and computer readable recording medium for analyzing a video using the image captured from the video
JPWO2018163398A1 (en) Similar image search system
TWI678928B (en) Video file processing method, video file processing device and monitoring system
CN108540817B (en) Video data processing method, device, server and computer readable storage medium
JP6214762B2 (en) Image search system, search screen display method
WO2021196551A1 (en) Image retrieval method and apparatus, computer device, and storage medium
CN110876090B (en) Video abstract playback method and device, electronic equipment and readable storage medium
CN111147778B (en) Track recording method and device based on digital video recorder and storage medium
CN111104915B (en) Method, device, equipment and medium for peer analysis
KR101170676B1 (en) Face searching system and method based on face recognition
CN112818172B (en) Video retrieval method, electronic device and storage medium
CN110876029B (en) Video abstract playback method and device, electronic equipment and readable storage medium
CN110929095A (en) Video abstract playback method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant