CN113836350B - Video retrieval method, system, device, storage medium and electronic equipment - Google Patents
Video retrieval method, system, device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113836350B CN113836350B CN202111115020.XA CN202111115020A CN113836350B CN 113836350 B CN113836350 B CN 113836350B CN 202111115020 A CN202111115020 A CN 202111115020A CN 113836350 B CN113836350 B CN 113836350B
- Authority
- CN
- China
- Prior art keywords
- time
- search
- video
- condition
- target video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 82
- 239000012634 fragment Substances 0.000 claims abstract description 40
- 238000012545 processing Methods 0.000 claims description 36
- 230000004044 response Effects 0.000 claims description 29
- 230000000153 supplemental effect Effects 0.000 claims description 9
- 238000012216 screening Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 5
- 238000012163 sequencing technique Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 19
- 230000008569 process Effects 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 8
- 230000002159 abnormal effect Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000006698 induction Effects 0.000 description 3
- 230000010365 information processing Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000013011 mating Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/73—Querying
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
According to the video searching method, system, device, storage medium and electronic equipment, the client sends the searching request comprising the time searching condition and the type searching condition to the network equipment, the network equipment searches from two dimensions through the time searching condition and the type searching condition after receiving the searching request, a large amount of unnecessary video contents of the client can be rapidly eliminated, target video fragments required by the client can be accurately and rapidly searched, and compared with each video in a certain time period, the searching time is greatly shortened, and the searching accuracy and efficiency are improved.
Description
Technical Field
The present invention relates to the field of video, and in particular, to a method, a system, an apparatus, a storage medium, and an electronic device for retrieving recorded video.
Background
With the development of society and the progress of science, the living standard of people is remarkably improved. Meanwhile, the demand of people for security systems is also increasing. As an important ring in security systems, cameras are also becoming increasingly popular. As video cameras are widely used for a long time, the number of recorded videos is enormous.
In a massive video, there may be a lot of information that users do not care about, if users view massive video one by one, they need to spend a lot of time, so that the searching efficiency for video is low, and the above problem becomes a difficult problem for those skilled in the art.
Disclosure of Invention
The present application is directed to a method, a system, an apparatus, a storage medium, and an electronic device for retrieving recorded video, so as to at least partially improve the above-mentioned problems.
In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:
in a first aspect, an embodiment of the present application provides a video retrieving method, applied to a network device, where the method includes:
receiving a search request sent by a client;
wherein the search request includes a time search condition and a type search condition;
searching target video clips matched with the time search condition and the type search condition in a first database according to the search request;
the first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types;
If the video in the first database comprises at least a period of target video fragments of which the node and the event type simultaneously meet the time retrieval condition and the type retrieval condition, determining all the target video fragments as a first retrieval result;
and feeding back the first search result to the client.
In a second aspect, an embodiment of the present application provides a video retrieving method, applied to a client, where the method includes:
the client sends a search request to network equipment;
the search request comprises a time search condition and a type search condition, and the search request is used for indicating the network equipment to search a target video fragment matched with the time search condition and the type search condition in a first database and generating a first search result corresponding to the search request;
the client receives a first retrieval result fed back by the network equipment; the first search result comprises a no-target video fragment response message or at least one section of target video fragment.
In a third aspect, an embodiment of the present application provides a video retrieving method, applied to an acquisition end, where the method includes:
The acquisition end receives a search request sent by network equipment; wherein the search request includes a time search condition and a type search condition;
searching target video clips corresponding to the time search condition and the type search condition in a second database corresponding to the acquisition end, and generating a second search result;
the second search result comprises at least one section of target video clip or no-target video clip response message;
and feeding back the second search result to the network equipment.
In a fourth aspect, an embodiment of the present application provides a video retrieval system, where the system includes a client and a network device, where the client is communicatively connected to the network device;
the client is used for sending a search request to the network equipment;
the search request comprises a time search condition and a type search condition, and is used for generating a first search result corresponding to the search request by the network equipment;
the network equipment is used for receiving a search request sent by the client;
the network equipment is used for searching target video clips matched with the time retrieval conditions and the type retrieval conditions in a first database according to the retrieval request;
The first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types;
the network device is further configured to determine all target video segments as a first search result if the video recorded in the first database includes at least one target video segment in which a time search condition and the type of event search condition are satisfied simultaneously by a time node and an event type;
the network device is further configured to feed back the first search result to the client;
the client is further configured to receive the first search result fed back by the network device.
In a fifth aspect, an embodiment of the present application provides a video retrieving apparatus, applied to a client, where the apparatus includes:
the first information sending unit is used for sending the search request to the network equipment by the client;
the search request comprises a time search condition and a type search condition, and is used for generating a first search result corresponding to the search request by the network equipment;
the first information receiving unit is used for receiving a first search result fed back by the network equipment by the client;
The first search result comprises a response message without target video clips or at least one section of target video clips.
In one possible implementation, the recorded video retrieval device further includes a first processing unit;
the first processing unit is used for ordering the at least one section of target video clips according to the acquisition time carried by the target video clips by the client to obtain an ordering result; and displaying the target video segments according to the sequencing result.
In a sixth aspect, an embodiment of the present application provides a video retrieving apparatus, applied to a network device, where the apparatus includes:
the second receiving and transmitting unit is used for receiving a search request sent by the client;
the search request comprises a time search condition and a type search condition, and is used for generating a first search result corresponding to the search request by the network equipment;
the second processing unit is used for searching target video clips matched with the time retrieval conditions and the type retrieval conditions in the first database according to the retrieval request;
the first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types;
The second processing unit is further configured to determine, if the video recorded in the first database includes target video segments that at least some time node and event type satisfy the time search condition and the type search condition simultaneously, all the target video segments as a first search result;
the second transceiver unit is further configured to feed back the first search result to the client.
In one possible implementation manner, the video includes an upload deadline, where the upload deadline is an up-to-date upload time of the video; the time retrieval condition comprises an end time, and the end time is the tail end of the time retrieval condition;
the second processing unit is further configured to search, if the uploading deadline of the video is later than the ending time, for a target video segment that matches the time search condition and the type search condition in the first database according to the search request; if the first database comprises target video clips, determining all the target video clips as a first retrieval result; and if the first database does not contain the target video fragment, determining that the response message without the target video fragment is the first retrieval result.
In one possible implementation manner, the video includes an upload deadline, where the upload deadline is an up-to-date upload time of the video; the time retrieval condition comprises a starting time, wherein the starting time is the head end of the time retrieval condition;
the second processing unit is further configured to send the search request to an acquisition end if the upload deadline is earlier than the start time;
the second receiving and transmitting unit is also used for receiving a second search result fed back by the acquisition end; the second search result comprises at least one section of target video clip or no-target video clip response message;
the second processing unit is further configured to determine the second search result as the first search result.
In one possible implementation, the video includes an upload deadline, and the time retrieval condition includes a start time and an end time;
the second processing unit is further configured to send an upload instruction to the acquisition end if the upload deadline is later than the start time and earlier than the end time;
the second transceiver unit is further configured to receive the supplementary video data uploaded by the acquisition unit, and store the supplementary video data in the first database; wherein the acquisition time of the supplemental video data covers the end time;
The second processing unit is further configured to search for a target video segment that matches the time search condition and the type search condition in the first database after uploading the supplemental video data according to the search request.
In a possible implementation manner, the second processing unit is further configured to screen out preselected video segments that meet the time search condition from video recorded in the first database; and screening target video fragments meeting the type retrieval conditions from all the preselected video fragments.
In a seventh aspect, an embodiment of the present application provides a video retrieving apparatus, applied to an acquisition end, where the apparatus includes:
the third information receiving and transmitting unit is used for receiving a search request sent by the network equipment by the acquisition end; wherein the search request includes a time search condition and a type search condition;
the third processing unit is used for searching the target video clips corresponding to the time searching condition and the type searching condition in a second database corresponding to the acquisition end, and generating a second searching result; the second search result comprises at least one section of target video clip or no-target video clip response message;
And the third information receiving and transmitting unit is used for feeding back the second search result to the network equipment.
In one possible implementation, the time retrieval condition includes an end time, the end time being an end of the time retrieval condition;
the third information receiving and transmitting unit is further configured to upload supplementary video data to the network device when receiving an upload instruction sent by the network device, so that the network device is instructed to search a target video segment matched with the time search condition and the type search condition in a first database after uploading the supplementary video data;
wherein the acquisition time of the supplemental video data covers the end time.
In an eighth aspect, embodiments of the present application provide a storage medium having stored thereon a computer program which, when executed by a processor, implements the method described above.
In a ninth aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory for storing one or more programs; the above-described method is implemented when the one or more programs are executed by the processor.
Compared with the prior art, the video searching method, the system, the device, the storage medium and the electronic equipment provided by the embodiment of the application send the searching request comprising the time searching condition and the type searching condition to the network equipment through the client, and the network equipment searches from two dimensions through the time searching condition and the type searching condition after receiving the searching request, so that a large amount of unnecessary video contents of the client can be rapidly removed, a target video fragment required by the client can be accurately and rapidly searched, and compared with one-to-one searching of each video in a certain time period, the searching time is greatly shortened, and the searching accuracy and efficiency are improved.
In order to make the above objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered limiting in scope, and that other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1a is a communication schematic diagram of a video retrieval system according to an embodiment of the present application;
fig. 1b is a schematic diagram of a architecture corresponding to a single gateway provided in an embodiment of the present application;
fig. 1c is a schematic architecture diagram of a trigger device and an execution device provided in an embodiment of the present application under different gateways;
fig. 1d is a schematic architecture diagram of a triggering device and an executing device provided in an embodiment of the present application in different areas in spatial positions;
fig. 1e is a hardware block diagram of a camera gateway according to an embodiment of the present application;
fig. 1f is a main system flowchart of a video acquisition system according to an embodiment of the present application;
FIG. 1g is a main system flow chart of another video acquisition system according to an embodiment of the present application;
fig. 2 is a flow chart of a video retrieving method according to an embodiment of the present application;
FIG. 3 is a schematic flow chart of a video retrieval method according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of a video retrieval method according to an embodiment of the present application;
FIG. 5 is a flowchart of a method for retrieving recorded video according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of sub-steps of S209 provided in the embodiment of the present application;
FIG. 7 is a flowchart of a method for retrieving recorded video according to an embodiment of the present disclosure;
Fig. 8 is a signaling schematic diagram of a video retrieving method according to an embodiment of the present application;
fig. 9 is a schematic unit diagram of a video retrieving device according to an embodiment of the present application;
FIG. 10 is a schematic diagram of a video search device according to an embodiment of the present disclosure;
FIG. 11 is a schematic diagram of a video search device according to an embodiment of the present disclosure;
fig. 12 is a block diagram of a hardware structure of an electronic device according to an embodiment of the present application.
In the figure: 1100-an electronic device; 1110-a processor; 1120-storage medium; 1121—an operating system; 1122-data; 1123-an application; 1130-memory; 1140-input-output interface; 1150-a wired or wireless network interface; 1160-power supply; 401-a first information transmitting unit; 402-a first information receiving unit; 403-a first processing unit; 501-a second transceiver unit; 502-a second processing unit; 601-a third processing unit; 602-a third information transceiving unit.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, as provided in the accompanying drawings, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only to distinguish the description, and are not to be construed as indicating or implying relative importance.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the description of the present application, it should be noted that, the terms "upper," "lower," "inner," "outer," and the like indicate an orientation or a positional relationship based on the orientation or the positional relationship shown in the drawings, or an orientation or a positional relationship conventionally put in use of the product of the application, merely for convenience of description and simplification of the description, and do not indicate or imply that the apparatus or element to be referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present application.
In the description of the present application, it should also be noted that, unless explicitly specified and limited otherwise, the terms "disposed," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the terms in this application will be understood by those of ordinary skill in the art in a specific context.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.
Along with the improvement of people's security consciousness, the disadvantage of simple camera video early warning system in the aspect of comprehensive information processing gradually exposes. The pure video early warning system of the video camera can not meet the security requirements of people.
Therefore, the development of the camera gateway with the video monitoring function and capable of being used as various sensors and home controller hubs has great significance in comprehensive information processing. Therefore, the video monitoring system not only can utilize the function of video monitoring, but also can be combined with various sensors and controller equipment to configure more applications, so that the application flexibility is expanded, and the system richness is improved. The security system which is built by taking the camera as the center can present the information monitored by various sensors to the user in a more friendly mode in video information processing, and the security system can accurately and technically inform the user when an early warning event occurs, so that the user can conveniently check dangerous cases.
Based on this, the embodiment of the application provides a video acquisition system. As shown in fig. 1a, the video acquisition system includes an acquisition end, a network device, and a client. The acquisition end can combine the monitoring state of various sensors in a certain time period in the process of acquiring the video, and different labels can be added to the video content in the time period. The acquisition end can transmit the video after the label is added to the network equipment for storage or local storage. The network device can respond to the query request transmitted by the client and feed the corresponding video back to the client so as to be convenient for the client to check. The network device in the embodiment of the present application may be a server or a local gateway.
Referring to fig. 1b to 1d, fig. 1b to 1d are different architectures of the video capturing system respectively. Fig. 1b is a schematic diagram of a architecture corresponding to a single gateway, and as shown in fig. 1b, the video acquisition system includes a trigger device, an execution device, a router, a cloud end and a client end. The triggering device comprises a door magnet 1, a human body 1, a controller 1 and the like. The door magnet 1 is a sensor for sensing opening and closing of doors and windows and consists of a magnet and a main body part of the sensing magnet. The door magnet 1 is alternatively a door magnet system using geomagnetic principle. The human body 1 is a sensor for detecting human body induction and outputting whether a human signal exists. The human body 1 is, for example, a PIR infrared detection sensor or a radar induction sensor. The controller 1 is a wireless control device, and its state can be used as a condition for triggering recording of abnormal video, for example, when a lamp is turned on, and when a power overload condition occurs. It will be appreciated that the controller 1 may learn whether a lamp on condition has occurred or whether a power overload condition has occurred.
The execution device is equivalent to the acquisition end shown in fig. 1 a. The executing device may be a camera gateway, i.e. a camera with gateway functionality. The execution device is mainly divided into two parts, wherein the first part is an audio-video related camera part, the second part is a gateway part, and the gateway part is a control center of a sensor and a controller. The hardware block diagram of the camera gateway is shown in fig. 1e, the camera is connected with a router to a local wifi network or an external network through a wifi module, and is connected with Zigbee sub-equipment (door magnet, human body, controller and other equipment in the system block diagram) through a Zigbee module. The SD card is used to store local history video (optional mating).
The router is used to connect the gateway to a local area network or an external local area network. The cloud end is a cloud end server and is used for message pushing and cloud end video storage. A client (App end); for example, a mobile phone application program, which is used for identifying video colors generated by abnormal events. Displaying real-time video, video recording, abnormal video, video recording identification with color, and the like.
Fig. 1b shows that the triggering device and the executing device are in the same gateway, and the information of the triggering device can be directly sent to the executing device.
Referring to fig. 1c, fig. 1c shows that the trigger device and the execution device are under different gateways, but under the same local area network. The information of the trigger device needs to be transferred to the execution device side through the router.
Referring to fig. 1d, fig. 1d shows that the trigger device and the execution device are located in different areas in spatial positions, and the information of the trigger device needs to be synchronized to the execution device through the cloud.
With continued reference to fig. 1f, fig. 1f is a main system flow chart of a video acquisition system when the marker event configuration information is stored in the camera gateway. As shown in fig. 1f, first, a user may perform a time-of-interest configuration at a client (APP) to obtain tag event configuration information. Then, local streaming is performed, and the client issues configuration information to the camera gateway (execution subject). After the event is triggered, the triggering device reports the event information to the camera gateway, and the camera gateway compares the event information with the marked event configuration information to judge whether the event triggering device is the marked event device or not, namely, whether the triggered event is the marked event or not. If yes, the event is clouded, the camera gateway sends the event information to the cloud, the cloud pushes the event information to the client (App), the client performs color marking on the display segment corresponding to the marked event in the video, and different event types can be marked by adopting preset colors respectively. When a user views the marked video, the video stream is pulled directly from the time point of starting the marking, and the video when the event is triggered is viewed.
It can be appreciated that the camera gateway can perform cloud storage and local storage on the acquired video.
With continued reference to fig. 1g, fig. 1g is a main system flowchart corresponding to the video acquisition system when the marking event configuration information is stored in the client (App). As shown in fig. 1g, when an event is triggered, the trigger device reports event information to the camera gateway, the camera gateway reports the event information to the cloud, after the cloud is pushed to the client (App), the client (App) compares the event information with preset marked event configuration information, and if the event is a preset attention event, that is, if the trigger device of the event is the marking device, the color marking set by the user is performed on the corresponding video clip. When the user views the marked video, the video stream is directly pulled from the time point to view the video when the event is triggered. When the user needs to increase the time dimension to screen the video, the user can select the interested marked video after selecting the time, so as to watch the interested video.
In the video acquisition system provided by the embodiment of the application, the scheme based on the preset event can facilitate the user to set the abnormal reminding event in the video camera (the door magnetic sensor senses that the door is opened, the human body sensor detects that someone moves, the light controller detects that the lamp is opened, and the like). And the event marking can be carried out on the video strip by adopting different colors for different triggering events, for example, the door magnetic door opening sensing mark is yellow, the human body detects that the movement mark of a person is green, and the like. When the configured abnormal reminding event occurs, the video camera stores video copies before and after the event triggering time point in the local (SD card, NAS service and the like) and cloud, and marks the event triggering position by corresponding preset colors on the app. When the user needs to view the video clips at the corresponding event, the user can directly view the preset video clips marked with the corresponding color or the video marked with the moment on the app.
The scheme based on the preset event is that an abnormal reminding event is set in the camera, corresponding time is marked, and the user can conveniently check the abnormal reminding event. But still the user is required to actively search the interested fragments from the marked videos, and the interested videos cannot be quickly positioned only by time screening.
In order to overcome the above problems, the embodiments of the present application provide a video retrieving method, which may be but not limited to be applied to the client in the foregoing, and the specific flow is as shown in fig. 2, and the video retrieving method includes:
s102, the client sends the search request to the network equipment.
The search request comprises a time search condition and a type search condition, and the search request is used for indicating the network equipment to search a target video fragment matched with the time search condition and the type search condition in a first database and generating a first search result corresponding to the search request.
The time search condition refers to a search condition of a time dimension, and specifically may be a user-defined time range, which is used for searching for a corresponding video clip from the video according to the search condition of the selected time dimension. Specifically, the time retrieval condition may include a start time and an end time, for example, the start time is 2021, 5, 1, 00 points, and the end time is 2021, 6, 1, 00 points. It will be appreciated that the time dimension is retrieved by defining a time range for the target video clip by the start time and the end time. It can be understood that the video is a video stored in the first database or a video collected by the collecting end, and the video includes video segments marked according to time nodes and event types. The target video clip is a video clip that the user needs to view.
The type search condition refers to a search condition of an event type dimension, and may include event types corresponding to various scenes, specifically may be a target event type selected by a user in a user-defined manner. Specifically, the target event types may include: a door open event, a light on event, a person passing event, a smoke concentration exceeding event, etc. In the process of collecting video, the collecting terminal can add a corresponding label for the current video according to the current event type, wherein the label carries the current event type, and the current event type can be one or more of the event types.
It is assumed that, in the time search condition, the start time is 2021, 5, 1, 00 points, the end time is 2021, 6, 1, 00 points, and the target event type in the type search condition is a door opening event. Namely, the label is video recorded video of the door opening event within 00 points from 1.00 points in 2021, 5 and 1.00 points in 2021, 6 and 1.00 points in 2021, and is a target video clip required to be acquired by the client.
S103, the client receives a first search result fed back by the network equipment.
The first search result comprises a response message without target video clips or at least one section of target video clips.
Under the condition that no target video clip meeting the search request exists, the first search result fed back to the client by the network equipment is a no-target video clip response message; and under the condition that at least one target video segment meeting the search request exists, the network equipment packages all the target video segments into a first search result, and feeds back the first search result to the client.
According to the video searching method, after the network equipment receives the searching request, the network equipment searches from two dimensions through the time searching condition and the type searching condition, so that a large number of unnecessary video contents of the client can be rapidly eliminated, target video clips required by the client can be accurately and rapidly searched, and compared with the method for viewing each video in a certain time period one by one, the viewing time is greatly shortened, and the accuracy and the efficiency of searching are improved.
In a case that the first search result includes at least one target video segment, and each target video segment carries a corresponding acquisition time, with respect to how to improve convenience for viewing of a user, the embodiment of the present application further provides a possible implementation manner, please refer to fig. 3, and the video recording video search method further includes:
S104, the client orders at least one section of target video segments according to the acquisition time carried by the target video segments to obtain an ordering result.
For example, the first search result received by the client includes three segments of target video segments, where the collection time carried by the three segments is 2021, 5, 8, 00, and 2021, 5, 10, 00. The client can sequence the three target video clips according to the collection time carried by the target video clips, namely, the target video clips corresponding to 00 points of 2021, 5 month, 8 days, 00 points of 2021, 5 month, 9 days, 00 points of 2021 and 00 points of 2021, 5 month, 10 days, 00 points of 2021 are sequentially arranged, so that the user can conveniently watch the target video clips, and know the sequence of events.
And S105, displaying the target video clips according to the sequencing result.
With continued reference to the above example, the target video clips corresponding to 00 points 00 minutes at 5 month and 8 days in 2021, 00 points 00 minutes at 5 month and 9 days in 2021, and 00 points 00 minutes at 5 month and 10 days in 2021 are sequentially arranged, so that the user can conveniently watch, and know the sequence of events.
On the basis of fig. 2, regarding how to obtain the retrieval request, the embodiment of the present application further provides a possible implementation manner, please continue to refer to fig. 3, and the video retrieval method further includes:
S101, the client generates a search request according to the time search condition and the type search condition.
It may be understood that the time search condition and the type search condition may be input by the user on a certain page or different pages of the client, or may be transmitted to the client by another terminal, which is not limited herein.
In order to overcome the foregoing problems, the embodiments of the present application further provide a video searching method, which may be but not limited to be applied to the foregoing network device, and the specific flow is as shown in fig. 4, where the video searching method includes:
s201, receiving a search request sent by a client.
Wherein the search request includes a time search condition and a type search condition.
Possibly, the time retrieval condition comprises a start time and an end time of a target video segment, and the type retrieval condition comprises a target event type of the target video segment.
Regarding the time search condition and the type search condition in the search request, reference is made to the explanation corresponding to S102 above, and no detailed description is given here.
S209, searching target video clips matched with the time search condition and the type search condition in the first database according to the search request.
The first database comprises collected video, and the video comprises video clips marked according to time nodes and event types.
Optionally, the network device searches whether the first database stores the video satisfying both the time search condition and the type search condition, if so, the video is a target video segment, at this time, S210 is executed, and the network device determines all the target video segments as the first search result. If not, it indicates that there is no target video clip, at this time, S211 is executed, and the network device determines the response message without the target video clip as the first search result.
S210, if the video recorded in the first database comprises target video fragments of which at least a time node and a time type simultaneously meet the time search condition and the type search condition, determining all the target video fragments as a first search result.
Optionally, the first database is a database corresponding to the network device, and is used for storing video data received by the network device. After receiving the search request, the network device searches the video in the first database from two dimensions through a time search condition and a type search condition, so that a large number of unnecessary video contents of the client can be rapidly removed, and target video clips required by the client can be accurately and rapidly searched. In contrast to transmitting all videos within a certain time period, for example, all videos within the interval from 00:00 from 2021 month 1 to 00:00 from 2021 month 1, 6, 1, and 1, to the client, the video retrieval method provided in the embodiments of the present application only needs to transmit video of the type of the target event type as the target video within the interval from 00:00 from 2021 month 1 to 00:00 from 2021 month 1, 6, and 1, to the client. The number of data transmission is greatly reduced, the occupation of transmission bandwidth is reduced, meanwhile, a user is not required to check each video in a certain time period one by one, the checking time is greatly shortened, and the accuracy and the efficiency of retrieval are improved.
S212, feeding back the first search result to the client.
The user can review the first search result at the client to view the content of the target video clip of interest.
On the basis of fig. 4, it is assumed that the video includes an upload deadline, which is the latest upload time of the video; the time search condition comprises an end time and a start time, wherein the end time is the tail end of the time search condition, and the start time is the head end of the time search condition. With reference to fig. 5, the video retrieval method further includes:
s202, determining whether the video uploading deadline is later than the ending time. If not, executing S203; if yes, S209 is executed.
For example, the end time is 6 months 1 day 00 points, the video upload time is 6 months 2 days 00 points, and the video upload deadline is later than the end time. If the video uploading time is 5 months 30 days 00 points, the video uploading deadline is earlier than the ending time, and at this time, the video from 5 months 30 days 00 points to 6 months 1 days 00 points may still be stored in a local database at the acquisition end, and not uploaded to the network device.
When the transmission operation is performed on the video, the acquisition end often uploads all videos acquired by the time point to the network device.
By judging whether the video uploading deadline (the latest uploading time) is later than the ending time, the acquisition end can know whether the target video clip is possibly stored. And under the condition that the network equipment judges that the video uploading deadline is later than the ending time, the acquisition end does not store the target video fragments and uploads the target video fragments to the network equipment, S209 is executed, and the network equipment judges whether the target video fragments are stored in the first database or not, so that all the target video fragments can be completely acquired, and omission is avoided. Otherwise, the capturing end may also store the target video clip, and if further verification is required, S203 is executed.
S203, determining whether the uploading deadline is earlier than the starting time. If yes, executing S204; if not, S207 is performed.
If the upload deadline is earlier than the start time, for example, the start time is 2021, 5, 1, 00, and the upload deadline is 2021, 4, 30, 00, all the target video clips indicating the client needs are stored in the local memory of the acquisition end, and are not uploaded to the network device, at this time, in order to quickly respond to the client needs, the network device executes S204, and sends the search request to the acquisition end. The acquisition end searches in the corresponding local memory according to the search request, and feeds back a second search result obtained by searching to the network equipment, and then feeds back the second search result to the client end by the network equipment.
In one possible implementation, if the upload deadline is earlier than the start time, the network device may request that the capturing end upload all the videos and then retrieve them by the network device. Compared with the searching by the acquisition end, only the second searching result is transmitted, and more time is spent on uploading all videos to the network equipment, so that the response efficiency of the client is reduced, and the client experience is influenced.
If the upload deadline is later than the start time, for example, the start time is 2021, 5, 1, 00, the end time is 2021, 6, 1, 00, the upload deadline is 2021, 5, 25, 00, the indication that there may be some target video clips stored in the local memory of the capturing end and not uploaded to the network device, at this time, in order to respond to the client requirement quickly, S207 is executed, and the network device sends an upload instruction to the capturing end. So that the acquisition end uploads all video recorded videos from 00 minutes from 2021, 5, 25, 00 minutes to 2021, 6, 1, 00 minutes to network equipment.
S204, sending the search request to the acquisition end.
Therefore, the acquisition end searches in the corresponding local memory according to the search request, and the obtained second search result is fed back to the network equipment. The second search result comprises at least one target video segment or no target video segment response message.
The explanation of the second search result refers to the first search result, and will not be described herein.
S205, receiving a second search result fed back by the acquisition end.
S206, determining the second search result as the first search result.
Optionally, after the second search result is determined as the first search result, the network device feeds back the first search result to the client, i.e. performs S212.
S207, sending an uploading instruction to the acquisition end.
Optionally, the uploading instruction is used for driving the acquisition end to upload the video to the network device.
S208, receiving the supplementary video data uploaded by the acquisition end, and storing the supplementary video data into a first database.
The acquisition time of the supplementary video data covers the end time.
With continued reference to the above example, the upload deadline is 5 months 31 days 00 minutes, the end time is 6 months 1 day 00 minutes, and the acquisition time of the supplementary video data can be up to 6 months 8 days 00 minutes or only up to 6 months 2 days 00 minutes.
After S208, the network device will execute S209 to search the first database for a target video clip matching the time search condition and the type search condition according to the search request. Specifically, searching a target video segment matched with the time search condition and the type search condition in a first database after uploading the supplementary video data according to the search request.
In one possible implementation, the uploading instruction may carry an ending time, and the acquisition time of the supplemental video data is from the uploading ending time to the ending time, that is, from 00 points on day 5, 31, to 00 points on day 6, 1, and 00 points on day 1. Therefore, under the condition of ensuring the integrity of the target video clip, the transmission quantity of the current data is reduced, the transmission time is shortened, and the network equipment can search as early as possible, so that a first search result fed back is obtained.
S210, if the video recorded in the first database comprises target video fragments of which at least a time node and a time type simultaneously meet the time search condition and the type search condition, determining all the target video fragments as a first search result.
S211, if the first database does not contain the target video clip, determining that the response message without the target video clip is the first retrieval result.
Optionally, the no-target video clip response message indicates that the acquisition end fails to acquire the video which simultaneously satisfies the time search condition and the type search condition.
And S212, the network equipment feeds back the first retrieval result to the client.
On the basis of fig. 4, for the content in S209, the embodiment of the present application further provides a possible implementation manner, as shown in fig. 6, S209 includes S209-1 and S209-2.
S209-1, screening preselected video clips meeting the time retrieval condition from the video recorded in the first database.
For example, the time search condition is 2021, 5, 1, 00 points 00 to 2021, 6, 1, 00 points 00. Video clips collected within 00 minutes from 00 minutes at 1.5.1.2021 to 00 minutes at 1.6.1.2021 are required to be determined as preselected video clips.
S209-2, screening out target video fragments meeting the type retrieval condition from all the preselected video fragments.
And taking the preselected video segment with the type being the target event type as a target video segment. Namely, the video clips which are collected from 00 points from 1.00.00.5.1.2021 to 00.00.00.6.1.2021 and are of the type of the target event are taken as target video clips. And transmitting the target video clip to the client. The number of data transmission is greatly reduced, the occupation of transmission bandwidth is reduced, meanwhile, a user is not required to check each video in a certain time period one by one, the checking time is greatly shortened, and the accuracy and the efficiency of retrieval are improved.
In order to overcome the foregoing problems, the embodiment of the present application further provides a video searching method, which may be but not limited to be applied to the foregoing collection end, and the specific flow is as shown in fig. 7, where the video searching method includes:
S301, an acquisition end receives a search request sent by network equipment; wherein the search request includes a time search condition and a type search condition.
S302, searching target video clips corresponding to the time search condition and the type search condition in a second database corresponding to the acquisition end, and generating a second search result.
Optionally, the time search condition includes a start time and an end time of the target video segment, the type search condition includes a target event type of the target video segment, the second database is a database corresponding to the acquisition end, that is, the aforementioned local memory, and the second search result includes at least one segment of response message of the target video segment or the non-target video segment.
It should be noted that, the second search result is a result obtained by the acquisition end after searching according to the search request.
As described above, only uploading the second search result to the network device and uploading all video data from the start time to the end time to the network device take a shorter time and consume fewer resources.
S303, feeding back a second search result to the network equipment.
Optionally, as in S206 described above, the network device second search result is determined as the first search result. The network device can quickly feed back the first search result to the client.
With continued reference to fig. 7, assume that the time search condition includes an end time, which is the end of the time search condition. Regarding how to guarantee the integrity of the target video segment, the embodiment of the application also provides a possible implementation manner, and the video retrieval method further includes:
and S304, uploading the supplementary video data to the network equipment under the condition of receiving an uploading instruction sent by the network equipment so as to instruct the network equipment to search a target video fragment matched with the time retrieval condition and the type retrieval condition in a first database after uploading the supplementary video data.
The acquisition time of the supplementary video data covers the end time.
Specifically, please refer to the explanation in S207 and S208 above, by uploading the supplementary video data, all video from the start time to the end time are completely stored in the first database, so as to ensure that all target video clips can be retrieved and avoid omission.
In summary, the embodiment of the present application provides a video retrieving method, first, a client sends a retrieving request including a time retrieving condition and a type retrieving condition to a network device, and after the network device receives the retrieving request, the network device retrieves from two dimensions through the time retrieving condition and the type retrieving condition, so that a large amount of unnecessary video content of the client can be rapidly removed, a target video segment required by the client can be accurately and rapidly retrieved, and compared with one-to-one viewing of each video in a certain time period, viewing time is greatly shortened, and accuracy and efficiency of retrieval are improved. And secondly, comparing the uploading deadline with the starting time and the deadline, and improving the response efficiency of searching and the customer experience while guaranteeing the integrity of the searching result of the target video clip.
The application also provides an application scene, and the video retrieval method is applied to the application scene as follows: when the user finds that the object is lost in the home, the destination of the lost object can be quickly determined through the video searching method.
Specifically, the user deduces the approximate time period for the occurrence of the object loss, for example, from 2021, 8, 31, to 2021, 9, 5. The approximate time period, from day 31 in 8 of 2021 to day 5 in 9 of 2021, may be determined as the time search condition. Object loss requires a person to move an object or open a door or window. When detecting human movement, the human body induction sensor uploads a human body movement signal, the event type of video collected during human body movement is set as a human body movement event, when detecting door and window opening and closing signals, the door and window opening and closing signal is uploaded, and the event type of video collected during door and window opening and closing is set as a door and window opening and closing event. In the search, the door and window opening and closing event and the human body movement event can be determined as type search conditions.
The client generates a search request through the type search condition and the time search condition, and the client transmits the search request to the network device. The network device executes the above-mentioned S201 to S209 to quickly acquire the video clip when the human body moves or the window is opened within the period of 2021, 8, 31, and 2021, 9, 5, so that the destination of the lost object can be quickly determined.
As shown in fig. 8, the embodiment of the application further provides a signaling schematic diagram of a video retrieving method.
In order to overcome the foregoing problems, the embodiments of the present application further provide a video retrieval system, where the video retrieval system is shown in fig. 1a to 1f, and the video retrieval system includes a client and a network device, and in one possible implementation, the video retrieval system further includes an acquisition end. The network equipment is respectively in communication connection with the client and the acquisition end.
The client is used for sending the retrieval request to the network device.
The search request comprises a time search condition and a type search condition, and the search request is used for generating a first search result corresponding to the search request by the network equipment.
Optionally, the time retrieval condition includes a start time and an end time of the target video clip, and the type retrieval condition includes a target event type of the target video clip.
The network device is used for receiving the retrieval request sent by the client.
The network device is used for searching the target video clips matched with the time searching condition and the type searching condition in the first database according to the searching request.
The first database comprises collected video, and the video comprises video clips marked according to time nodes and event types.
The network device is further configured to determine all target video segments as the first search result if the video recorded in the first database includes target video segments that satisfy both the time search condition and the type search condition at least for a period of time.
The first database is a database corresponding to the network equipment.
The client receives a first search result fed back by the network equipment.
It should be noted that, the video retrieving system provided in this embodiment includes a network device, a client, and an acquisition end, where the network device, the client, and the acquisition end may execute the method flows shown in the corresponding method flow embodiments, so as to achieve the corresponding technical effects. For a brief description, reference is made to the corresponding parts of the above embodiments, where this embodiment is not mentioned.
Referring to fig. 9, fig. 9 is a schematic diagram illustrating an embodiment of a video retrieving apparatus, which is optionally applied to the client described above.
The video search device comprises: a first information transmitting unit 401 and a first information receiving unit 402;
a first information sending unit 401, configured to send a search request to a network device by a client.
The search request comprises a time search condition and a type search condition, and the search request is used for indicating the network equipment to search a target video fragment matched with the time search condition and the type search condition in a first database and generating a first search result corresponding to the search request.
Optionally, the time retrieval condition includes a start time and an end time of the target video clip, and the type retrieval condition includes a target event type of the target video clip. Alternatively, the first information transmission unit 401 may perform S102 described above.
The first information receiving unit 402 is configured to receive, by the client, a first search result fed back by the network device.
The first search result comprises a response message without target video clips or at least one section of target video clips. Alternatively, the first information receiving unit 402 may perform S103 described above.
In a possible implementation manner, the recorded video retrieving device further includes a first processing unit 403;
the first processing unit 403 is configured to sort at least one segment of the target video segments according to the collection time carried by the target video segments by the client, so as to obtain a sorting result; and displaying the target video clips according to the sequencing result. Alternatively, the first processing unit 403 may execute S104 and S105 described above.
It should be noted that, the video retrieving device provided in this embodiment may execute the method flow shown in the method flow embodiment applied to the client to achieve the corresponding technical effects. For a brief description, reference is made to the corresponding parts of the above embodiments, where this embodiment is not mentioned.
Referring to fig. 10, fig. 10 is a schematic diagram showing an embodiment of a video retrieving apparatus, which is optionally applied to the network device described above.
The video search device comprises: a second transceiver unit 501 and a second processing unit 502.
A second transceiver 501, configured to receive a search request sent by a client.
The search request comprises a time search condition and a type search condition, and the search request is used for generating a first search result corresponding to the search request by the network equipment.
Optionally, the time retrieval condition includes a start time and an end time of the target video clip, and the type retrieval condition includes a target event type of the target video clip. Alternatively, the second transceiving unit 501 may perform S201 described above.
A second processing unit 502, configured to search, in the first database according to the search request, for a target video clip that matches the time search condition and the type search condition; the first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types; the network device is used for determining all target video fragments as a first search result under the condition that at least one target video fragment which simultaneously meets the time search condition and the type search condition is stored in the first database. Alternatively, the second processing unit 502 may perform S209 and S210 described above.
The second transceiver unit 501 is further configured to feed back the first search result to the client.
The first database is a database corresponding to the network equipment. Alternatively, the second transceiving unit 501 may perform S212 described above.
In one possible implementation, the recorded video includes an upload deadline, which is a latest upload time of the recorded video; the time search condition comprises an ending time, and the ending time is the end of the time search condition;
the second processing unit 502 is further configured to search, if the uploading deadline of the video is later than the ending time, for a target video segment that matches the time search condition and the type search condition in the first database according to the search request; if the first database comprises the target video clips, determining all the target video clips as a first retrieval result; and if the first database does not contain the target video fragment, determining the response message without the target video fragment as a first retrieval result.
In one possible implementation, the recorded video includes an upload deadline, which is a latest upload time of the recorded video; the time retrieval condition comprises a starting time, wherein the starting time is the head end of the time retrieval condition;
The second processing unit 502 is further configured to send a search request to the acquisition end if the upload deadline is earlier than the start time;
the second transceiver 501 is further configured to receive a second search result fed back by the acquisition end; the second search result comprises at least one section of target video clip or no-target video clip response message;
the second processing unit 502 is further configured to determine the second search result as the first search result.
In one possible implementation, the recorded video includes an upload deadline, and the time retrieval condition includes a start time and an end time;
the second processing unit 502 is further configured to send an upload instruction to the acquisition end if the upload deadline is later than the start time and earlier than the end time;
the second transceiver 501 is further configured to receive the supplementary video data uploaded by the acquisition end, and store the supplementary video data in the first database; the acquisition time of the supplementary video data covers the end time;
the second processing unit 502 is further configured to search, according to the search request, for a target video clip matching the time search condition and the type search condition in the first database after uploading the supplementary video data.
In a possible implementation manner, the second processing unit 502 is further configured to screen out preselected video segments that meet the time search condition from the video recorded in the first database; and screening target video fragments meeting the type retrieval conditions from all the preselected video fragments.
It should be noted that, the video retrieving apparatus provided in this embodiment may execute the method flow shown in the method flow embodiment of the network device to achieve the corresponding technical effects. For a brief description, reference is made to the corresponding parts of the above embodiments, where this embodiment is not mentioned.
Referring to fig. 11, fig. 11 is a schematic diagram illustrating an embodiment of a video retrieving apparatus, which is optionally applied to the above-mentioned acquisition end.
The video search device comprises: a third processing unit 601 and a third information transceiving unit 602.
A third information transceiver 602, configured to receive, by the acquisition end, a search request sent by the network device; wherein the search request includes a time search condition and a type search condition. Alternatively, the third information transceiving unit 602 may perform S301 described above.
A third processing unit 601, configured to search, in a second database corresponding to the acquisition end, a target video segment corresponding to a time search condition and a type search condition, and generate a second search result; the second search result comprises at least one section of target video clip or no-target video clip response message. Alternatively, the third processing unit 601 may perform S302 described above.
And a third information transceiving unit 602, configured to feed back the second search result to the network device. Alternatively, the third information transceiving unit 602 may perform S303 described above.
In one possible implementation, the time retrieval condition includes an end time, which is the end of the time retrieval condition.
The third information transceiver 602 is further configured to upload supplemental video data to the network device when receiving an upload instruction sent by the network device, so as to instruct the network device to search a target video clip matching with the time search condition and the type search condition in a first database after uploading the supplemental video data; the acquisition time of the supplementary video data covers the end time. Alternatively, the third information transceiving unit 602 may perform S304 described above.
It should be noted that, the video retrieving device provided in this embodiment may execute the method flow shown in the method flow embodiment applied to the collection end, so as to achieve the corresponding technical effect. For a brief description, reference is made to the corresponding parts of the above embodiments, where this embodiment is not mentioned.
The embodiment of the application provides an electronic device, which may be the client, the network device or the acquisition end. The electronic device comprises a processor and a memory, wherein at least one instruction, at least one section of program, code set or instruction set is stored in the memory, and the at least one instruction, the at least one section of program, the code set or instruction set is loaded and executed by the processor to realize the video searching method provided by the embodiment of the method.
The memory may be used to store software programs and modules that the processor executes to perform various functional applications and data processing by executing the software programs and modules stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide access to the memory by the processor.
Fig. 12 is a hardware block diagram of an electronic device to which the video retrieving method according to the embodiment of the present invention is applied. As shown in fig. 12, the electronic device 1100 may vary considerably in configuration or performance and may include one or more processors (ProcessingUnits, CPU) 1110 (the processor 1110 may include, but is not limited to, a microprocessor MCU or a processing device such as a programmable logic device FPGA), a memory 1130 for storing data, one or more storage mediums 1120 (e.g., one or more mass storage devices) for storing applications 1123 or data 1122. Wherein the memory 1130 and the storage medium 1120 may be transitory or persistent storage. The program stored on the storage medium 1120 may include one or more modules, each of which may include a series of instruction operations in the electronic device. Still further, the processor 1110 may be configured to communicate with a storage medium 1120 to execute a series of instruction operations in the storage medium 1120 on the electronic device 1100. The electronic device 1100 may also include one or more power supplies 1160, one or more wired or wireless network interfaces 1150, one or more input output interfaces 1140, and/or one or more operating systems 1121, such as WindowsServerTM, macOSXTM, unixTM, linuxTM, freeBSDTM, and the like.
The input-output interface 1140 may be used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the electronic device 1100. In one example, the input/output interface 1140 includes a network adapter (NetworkInterfaceController, NIC) that can connect to other network devices through a base station to communicate with the internet. In one example, the input-output interface 1140 may be a radio frequency (RadioFrequency, RF) module for communicating wirelessly with the internet.
It will be appreciated by those of ordinary skill in the art that the configuration shown in fig. 12 is merely illustrative and is not intended to be limiting. For example, the electronic device 1100 may also include more or fewer components than shown in fig. 12, or have a different configuration than shown in fig. 12.
The embodiment of the invention also provides a storage medium which is a computer readable storage medium, and a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the processes of the video searching method embodiment can be realized, and the same technical effects can be achieved, so that repetition is avoided, and the description is omitted here. Wherein, the computer readable storage medium is Read-only memory (ROM), random Access Memory (RAM), magnetic disk or optical disk, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, an electronic device, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.
Claims (13)
1. A method for retrieving recorded video, applied to a network device, the method comprising:
receiving a search request sent by a client; the time search condition comprises a start time and an end time, wherein the start time is the head end of the time search condition, and the end time is the tail end of the time search condition;
if the uploading deadline is earlier than the starting time, the search request is sent to an acquisition end; the uploading deadline is the latest uploading time of the video;
receiving a second search result fed back by the acquisition end, determining the second search result as a first search result, and feeding back the first search result to the client; the second search result comprises at least one section of target video clip or no-target video clip response message;
If the uploading deadline is later than the ending time, searching a target video segment matched with the time searching condition and the type searching condition in a first database according to the searching request; the first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types;
if the video in the first database comprises a target video segment of which at least a period of time node and event type simultaneously meet the time retrieval condition and the type retrieval condition, determining the target video segment as a first retrieval result, and feeding back the first retrieval result to the client.
2. The video-on-video retrieval method of claim 1, wherein after receiving the retrieval request sent by the client, the method further comprises:
if the uploading deadline of the video is later than the ending time, searching a target video fragment matched with the time retrieval condition and the type retrieval condition in the first database according to the retrieval request;
if the first database comprises target video clips, determining all the target video clips as a first retrieval result;
And if the first database does not contain the target video fragment, determining that the response message without the target video fragment is the first retrieval result.
3. The video-on-video retrieval method of claim 1, wherein the method further comprises:
if the uploading deadline is later than the starting time and earlier than the ending time, an uploading instruction is sent to the acquisition end;
receiving the supplemental video data uploaded by the acquisition end, and storing the supplemental video data into the first database; wherein the acquisition time of the supplemental video data covers the end time;
searching the target video clips matched with the time search condition and the type search condition in a first database according to the search request, wherein the method comprises the following steps:
and searching target video clips matched with the time search condition and the type search condition in a first database after uploading the supplementary video data according to the search request.
4. The method for retrieving recorded video according to claim 1, wherein said step of searching for a target video clip matching said time retrieval condition and said type retrieval condition in a first database according to said retrieval request comprises:
Screening preselected video clips meeting the time retrieval condition from video recorded videos stored in the first database;
and screening target video fragments meeting the type retrieval conditions from all the preselected video fragments.
5. A video retrieval method, applied to a client, comprising:
the client sends a search request to network equipment; the search request comprises a time search condition and a type search condition, and the search request is used for indicating the network equipment to search a target video fragment matched with the time search condition and the type search condition in a first database and generating a first search result corresponding to the search request;
the client receives a first retrieval result fed back by the network equipment; the first search result comprises a response message without target video clips or at least one section of target video clips;
the network device sends the search request to the acquisition end when determining that the uploading deadline is earlier than the starting time, and sends a second search result fed back by the acquisition end to the first search result, wherein the uploading deadline is the latest uploading time of the video, and the second search result comprises at least one section of target video clip or no target video clip response message.
6. The video retrieval method according to claim 5, wherein after the client receives the first retrieval result fed back by the network device, the method further comprises:
the client orders at least one section of target video clips according to the acquisition time carried by the target video clips to obtain an ordering result;
and displaying the target video segments according to the sequencing result.
7. A video retrieval method, characterized in that it is applied to an acquisition end, the method comprising:
the acquisition end receives a search request sent by network equipment; wherein the search request includes a time search condition and a type search condition;
searching target video clips corresponding to the time search condition and the type search condition in a second database corresponding to the acquisition end, and generating a second search result; the second search result comprises at least one section of target video clip or no-target video clip response message;
feeding back the second search result to the network equipment;
the time retrieval condition comprises an end time, and the end time is the tail end of the time retrieval condition; the method further comprises the steps of:
Under the condition that an uploading instruction sent by the network equipment is received, uploading supplementary video data to the network equipment so as to instruct the network equipment to search a target video segment matched with the time retrieval condition and the type retrieval condition in a first database after uploading the supplementary video data;
the uploading instruction carries the ending time, and the acquisition time of the supplementary video data is from the uploading ending time to the ending time.
8. The video retrieval system is characterized by comprising a client and network equipment, wherein the client is in communication connection with the network equipment;
the client is used for sending a search request to the network equipment; the time search condition comprises a start time and an end time, wherein the start time is the head end of the time search condition, and the end time is the tail end of the time search condition;
the network equipment is used for receiving a search request sent by the client;
the network device is used for sending the search request to the acquisition end when the uploading deadline is earlier than the starting time; receiving a second search result fed back by the acquisition end; determining the second search result as a first search result, and feeding back the first search result to the client; the uploading deadline is the latest uploading time of the video, and the second search result comprises at least one section of target video fragment or no target video fragment response message; the network equipment is used for searching target video clips matched with the time retrieval conditions and the type retrieval conditions in a first database according to the retrieval request when the uploading deadline is later than the ending time; the first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types;
The network device is further configured to determine all target video segments as a first search result if the video recorded in the first database includes at least one target video segment in which a time search condition and the type of event search condition are satisfied simultaneously by a time node and an event type;
the network device is further configured to feed back the first search result to the client.
9. A video retrieval device for use with a client, said device comprising:
the first information sending unit is used for sending the search request to the network equipment by the client;
the search request comprises a time search condition and a type search condition, and the search request is used for indicating the network equipment to search a target video fragment matched with the time search condition and the type search condition in a first database and generating a first search result corresponding to the search request;
the first information receiving unit is used for receiving a first search result fed back by the network equipment by the client;
the first search result comprises a response message without target video clips or at least one section of target video clips;
The network device sends the search request to the acquisition end when determining that the uploading deadline is earlier than the starting time, and sends a second search result fed back by the acquisition end to the first search result, wherein the uploading deadline is the latest uploading time of the video, and the second search result comprises at least one section of target video clip or no target video clip response message.
10. A video retrieval apparatus for use with a network device, said apparatus comprising:
the second receiving and transmitting unit is used for receiving a search request sent by the client;
the network equipment is used for generating a first search result corresponding to the search request, wherein the search request comprises a time search condition and a type search condition, the time search condition comprises a start time and an end time, the start time is the head end of the time search condition, and the end time is the tail end of the time search condition;
the second processing unit is used for sending the search request to the acquisition end if the uploading deadline is earlier than the starting time;
The uploading deadline is the latest uploading time of the video;
the second receiving and transmitting unit is also used for receiving a second search result fed back by the acquisition end; the second search result comprises at least one section of target video clip or no-target video clip response message;
the second processing unit is further configured to determine the second search result as the first search result;
the second processing unit is further configured to search, if the upload deadline is later than the end time, for a target video segment that matches the time search condition and the type search condition in a first database according to the search request;
the first database comprises collected video, wherein the video comprises video clips marked according to time nodes and event types;
the second processing unit is further configured to determine, if the video recorded in the first database includes target video segments that at least some time node and event type satisfy the time search condition and the type search condition simultaneously, all the target video segments as a first search result;
the second transceiver unit is further configured to feed back the first search result to the client.
11. A video retrieval device for use at an acquisition end, said device comprising:
the third information receiving and transmitting unit is used for receiving a search request sent by the network equipment by the acquisition end; wherein the search request includes a time search condition and a type search condition;
the third processing unit is used for searching the target video clips corresponding to the time searching condition and the type searching condition in a second database corresponding to the acquisition end, and generating a second searching result; the second search result comprises at least one section of target video clip or no-target video clip response message;
the third information receiving and transmitting unit is used for feeding back the second search result to the network equipment;
the time retrieval condition comprises an end time, and the end time is the tail end of the time retrieval condition;
the third information receiving and transmitting unit is further configured to upload supplementary video data to the network device when receiving an upload instruction sent by the network device, so that the network device is instructed to search a target video segment matched with the time search condition and the type search condition in a first database after uploading the supplementary video data; the uploading instruction carries the ending time, and the acquisition time of the supplementary video data is from the uploading ending time to the ending time.
12. A computer readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the method according to any of claims 1-7.
13. An electronic device, comprising: a processor and a memory for storing one or more programs; the method of any of claims 1-7 is implemented when the one or more programs are executed by the processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111115020.XA CN113836350B (en) | 2021-09-23 | 2021-09-23 | Video retrieval method, system, device, storage medium and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111115020.XA CN113836350B (en) | 2021-09-23 | 2021-09-23 | Video retrieval method, system, device, storage medium and electronic equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113836350A CN113836350A (en) | 2021-12-24 |
CN113836350B true CN113836350B (en) | 2024-02-27 |
Family
ID=78969381
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111115020.XA Active CN113836350B (en) | 2021-09-23 | 2021-09-23 | Video retrieval method, system, device, storage medium and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113836350B (en) |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101599089A (en) * | 2009-07-17 | 2009-12-09 | 中国科学技术大学 | The automatic search of update information on content of video service website and extraction system and method |
CN103248853A (en) * | 2012-02-10 | 2013-08-14 | 华为技术有限公司 | Method, equipment and system for achieving video retrieval |
CN104573037A (en) * | 2015-01-16 | 2015-04-29 | 北京中电兴发科技有限公司 | Method and system for quickly querying supervision video through multiple color time shaft |
CN105159934A (en) * | 2015-08-03 | 2015-12-16 | 浙江宇视科技有限公司 | Real-time vehicle-passing data discretization uploading method and apparatus |
CN105608939A (en) * | 2016-01-20 | 2016-05-25 | 深圳市巨龙科教高技术股份有限公司 | Teaching resource file obtaining method and apparatus, and interactive teaching system |
CN106131653A (en) * | 2016-06-30 | 2016-11-16 | 乐视控股(北京)有限公司 | Control method for playing back, device and terminal |
CN106534336A (en) * | 2016-11-29 | 2017-03-22 | 武汉斗鱼网络科技有限公司 | Realization system and method for video subscription dynamic states |
US9652534B1 (en) * | 2014-03-26 | 2017-05-16 | Amazon Technologies, Inc. | Video-based search engine |
CN108038165A (en) * | 2017-12-06 | 2018-05-15 | 东软集团股份有限公司 | A kind of information search method, searcher, terminal device and server apparatus |
CN108932245A (en) * | 2017-05-24 | 2018-12-04 | 合网络技术(北京)有限公司 | Video searching method and device |
CN109213898A (en) * | 2018-07-18 | 2019-01-15 | 北京世纪东方通讯设备有限公司 | The video retrieval method and device of video monitoring system |
CN109376268A (en) * | 2018-11-27 | 2019-02-22 | 北京微播视界科技有限公司 | Video classification methods, device, electronic equipment and computer readable storage medium |
CN109977268A (en) * | 2019-02-26 | 2019-07-05 | 南京邮电大学 | A kind of video information search method |
CN110191364A (en) * | 2019-05-31 | 2019-08-30 | 武汉瓯越网视有限公司 | Video data moving method, storage medium, equipment and system |
CN110929097A (en) * | 2019-11-19 | 2020-03-27 | 浙江大华技术股份有限公司 | Video recording display method, device and storage medium |
CN112269899A (en) * | 2020-10-20 | 2021-01-26 | 西安工程大学 | Video retrieval method based on deep learning |
WO2021082668A1 (en) * | 2019-10-30 | 2021-05-06 | 深圳Tcl数字技术有限公司 | Bullet screen editing method, smart terminal, and storage medium |
CN112825081A (en) * | 2019-11-20 | 2021-05-21 | 云丁网络技术(北京)有限公司 | Video information processing method and device, electronic equipment, processor and readable medium |
CN113094552A (en) * | 2021-03-19 | 2021-07-09 | 北京达佳互联信息技术有限公司 | Video template searching method and device, server and readable storage medium |
-
2021
- 2021-09-23 CN CN202111115020.XA patent/CN113836350B/en active Active
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101599089A (en) * | 2009-07-17 | 2009-12-09 | 中国科学技术大学 | The automatic search of update information on content of video service website and extraction system and method |
CN103248853A (en) * | 2012-02-10 | 2013-08-14 | 华为技术有限公司 | Method, equipment and system for achieving video retrieval |
US9652534B1 (en) * | 2014-03-26 | 2017-05-16 | Amazon Technologies, Inc. | Video-based search engine |
CN104573037A (en) * | 2015-01-16 | 2015-04-29 | 北京中电兴发科技有限公司 | Method and system for quickly querying supervision video through multiple color time shaft |
CN105159934A (en) * | 2015-08-03 | 2015-12-16 | 浙江宇视科技有限公司 | Real-time vehicle-passing data discretization uploading method and apparatus |
CN105608939A (en) * | 2016-01-20 | 2016-05-25 | 深圳市巨龙科教高技术股份有限公司 | Teaching resource file obtaining method and apparatus, and interactive teaching system |
CN106131653A (en) * | 2016-06-30 | 2016-11-16 | 乐视控股(北京)有限公司 | Control method for playing back, device and terminal |
CN106534336A (en) * | 2016-11-29 | 2017-03-22 | 武汉斗鱼网络科技有限公司 | Realization system and method for video subscription dynamic states |
CN108932245A (en) * | 2017-05-24 | 2018-12-04 | 合网络技术(北京)有限公司 | Video searching method and device |
CN108038165A (en) * | 2017-12-06 | 2018-05-15 | 东软集团股份有限公司 | A kind of information search method, searcher, terminal device and server apparatus |
CN109213898A (en) * | 2018-07-18 | 2019-01-15 | 北京世纪东方通讯设备有限公司 | The video retrieval method and device of video monitoring system |
CN109376268A (en) * | 2018-11-27 | 2019-02-22 | 北京微播视界科技有限公司 | Video classification methods, device, electronic equipment and computer readable storage medium |
CN109977268A (en) * | 2019-02-26 | 2019-07-05 | 南京邮电大学 | A kind of video information search method |
CN110191364A (en) * | 2019-05-31 | 2019-08-30 | 武汉瓯越网视有限公司 | Video data moving method, storage medium, equipment and system |
WO2021082668A1 (en) * | 2019-10-30 | 2021-05-06 | 深圳Tcl数字技术有限公司 | Bullet screen editing method, smart terminal, and storage medium |
CN110929097A (en) * | 2019-11-19 | 2020-03-27 | 浙江大华技术股份有限公司 | Video recording display method, device and storage medium |
CN112825081A (en) * | 2019-11-20 | 2021-05-21 | 云丁网络技术(北京)有限公司 | Video information processing method and device, electronic equipment, processor and readable medium |
CN112269899A (en) * | 2020-10-20 | 2021-01-26 | 西安工程大学 | Video retrieval method based on deep learning |
CN113094552A (en) * | 2021-03-19 | 2021-07-09 | 北京达佳互联信息技术有限公司 | Video template searching method and device, server and readable storage medium |
Non-Patent Citations (1)
Title |
---|
浅谈高速公路监控***中的数字视频技术;周武;《广东科技》;20070710;157-159 * |
Also Published As
Publication number | Publication date |
---|---|
CN113836350A (en) | 2021-12-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109804367B (en) | Distributed video storage and search using edge computation | |
CN107005679B (en) | Intelligent target identification device, system and method based on cloud service | |
US11483692B2 (en) | System, method and computer-readable storage medium realizing Internet of Things for smart city based on street lamps and lamp posts | |
US11587417B2 (en) | Object tracking using disparate monitoring systems | |
US11594123B2 (en) | Method for using a drone to test monitoring system sensors | |
US11120676B2 (en) | Intrusion detection methods and devices | |
US20210271855A1 (en) | Face detection system | |
US20140052365A1 (en) | Bus stop and system capable of providing detailed bus schedules | |
US11270219B2 (en) | Data collection device, data collection system, and data collection method for calculating probability of event for collection of data | |
US20230164236A1 (en) | Ranking Internet of Things (IoT) Data Based on IoT Analytics Services | |
CN113836350B (en) | Video retrieval method, system, device, storage medium and electronic equipment | |
WO2019076954A1 (en) | Intrusion detection methods and devices | |
CN113591885A (en) | Target detection model training method, device and computer storage medium | |
US20210274133A1 (en) | Pre-generating video event notifications | |
CN202602813U (en) | Pet monitoring and searching device | |
CN110581978B (en) | Method for starting information acquisition device | |
CN113411530A (en) | Information acquisition device | |
JP6742739B2 (en) | Control device, control method, and program | |
US20220030333A1 (en) | Drone gateway device to collect the sensor data | |
Varshini et al. | Exploring the Potential of Arduino Nano for Enhancing Women's Safety through Smart Sandals | |
CN117011331A (en) | Target tracking method, device and storage medium | |
CN117218569A (en) | Automatic early warning system based on case | |
CN117896669A (en) | Personnel anti-lost method and system based on digital map, electronic equipment and medium | |
CN106355224A (en) | RFID (radio frequency identification)-triggering-based laboratory equipment circulation information acquisition and determination system | |
JP2013251819A (en) | Terminal device, server apparatus, operation history collection system, operation history collection method and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |