CN111050103A - Video distributed storage and centralized management system - Google Patents
Video distributed storage and centralized management system Download PDFInfo
- Publication number
- CN111050103A CN111050103A CN201911278817.4A CN201911278817A CN111050103A CN 111050103 A CN111050103 A CN 111050103A CN 201911278817 A CN201911278817 A CN 201911278817A CN 111050103 A CN111050103 A CN 111050103A
- Authority
- CN
- China
- Prior art keywords
- video
- local
- monitoring
- monitoring center
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1013—Network architectures, gateways, control or user entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Abstract
The invention discloses a video distributed storage and centralized management system, which comprises: distributed storage, centralized management architecture; IPSAN (STorageAreaNet) network architecture based on iSCSI technology; the streaming server acts as the core device of the storage solution. The invention also discloses an access control strategy and an implementation method based on dynamic threshold optimization, which ensure the safety of the acquired information. The invention optimizes the multi-node video storage management architecture, and the storage is relatively centralized and easy to maintain; the storage is more specialized, the reliability of the storage is improved, and the expansibility of the storage is improved.
Description
Technical Field
The invention relates to the field of security monitoring, in particular to a video distributed storage and centralized management system.
Background
In the existing monitoring system, a connection mode that an alarm sensor is directly connected with a monitoring system host is generally adopted, and when some monitoring systems need to be provided with hundreds or even thousands of alarm points, the problems of complex construction and high cost can be caused by adopting the connection mode.
The DVR or network video server is adopted at the front end of the camera monitoring, and the data is stored on the storage device at the background mainly at the far end through the background PC or server software.
The above storage schemes all have many disadvantages, especially when there are many monitoring points and the required storage amount is large, these possible disadvantages include: difficult to maintain due to storage scatter; the low professional degree of storage causes low reliability of storage, and further causes low reliability of the whole system; the utilization rate of storage is not high; the storage expansibility is not good.
Disclosure of Invention
The purpose of the invention is as follows: the invention aims to provide a video distributed storage and centralized management system.
The technical scheme is as follows: the invention discloses a video distributed storage and centralized management system, which comprises:
the monitoring front end is used for monitoring videos, temporarily storing audio and video data when a network is not smooth, and uploading the audio and video data to a superior monitoring center at regular time for storage; sending a request to a local monitoring center, and uploading or downloading playback audio and video data;
the local monitoring center is used for locally storing the audio and video data acquired by the monitoring front end in a distributed manner or returning the locally stored audio and video data to the monitoring front end after responding to the request sent by the monitoring front end; sending a request to a superior monitoring center based on the iSCSI technology, uploading monitoring data of a local monitoring center to the superior monitoring center at regular time, or requesting to download playback audio and video data;
and the superior monitoring center is used for storing audio and video data uploaded by all the local monitoring centers or returning the audio and video data to the local monitoring centers after responding to the data requests sent by the local monitoring centers.
Furthermore, the monitoring front end mainly comprises a video camera and a local PC terminal, and the video camera is connected with the local PC terminal and is used for collecting local video data; the local PC terminal stores local video data.
Further, the at least one local monitoring center comprises an automation device centralized controller and a switch; the switch is used for connecting the video cameras of a plurality of monitoring front ends and connecting the automation equipment centralized controller, the automation equipment centralized controller is used for responding and shunting the video requests, one automation equipment centralized controller can be connected with a plurality of video cameras and used for controlling local video streams of the video cameras, uploading local video data to a superior monitoring center or requesting a local PC terminal to play back the video.
Furthermore, the superior monitoring center comprises a network video server for data storage and a control management module for performing request and response processing of video stream data; and the control management module is used for carrying out information interaction with the centralized controller of the automation equipment, and is used for controlling and automatically distributing the requests of different video streams based on an access control strategy optimized by a dynamic threshold value.
Preferably, the network video server comprises a VE4000 series server with a hard disk, and the hard disk is used for temporarily storing audio and video data when the network is not smooth and storing important data at the monitoring front end.
Further, the access control policy based on dynamic threshold optimization is: and applying the popularity distribution to a migration model, and determining the session distribution threshold of various videos on each streaming media server according to the popularity distribution based on a session migration strategy of dynamic threshold distribution.
Furthermore, the upper monitoring center adopts an IPSAN network architecture of iSCSI technology, transmits SCSI commands through an IP network and is used for remote real-time management of local video streams.
Preferably, the IPSAN network architecture of the iSCSI technology is a SAN storage network in a conventional IP ethernet architecture for connecting an upper monitoring center and a local monitoring center.
Has the advantages that: the invention discloses a video distributed storage and centralized management system, which realizes video distributed storage through IPSAN based on iSCSI technology. The invention optimizes the multi-node video storage management, and the storage is relatively centralized and easy to maintain; the professional degree of storage is improved, so that the reliability of storage is improved, and the expansibility of storage is improved.
Drawings
Fig. 1 is a schematic flow chart of a video distributed storage and centralized management system provided in an embodiment of the present invention;
FIG. 2 is a schematic diagram of a system architecture provided in an embodiment of the present invention;
FIG. 3 is a system deployment diagram of an embodiment of the present invention;
FIG. 4 is a block diagram of an IPSAN network topology based on iSCSI technology according to an embodiment of the present invention.
Detailed description of the invention
The technical scheme of the invention is further explained by combining the attached drawings.
Referring to fig. 1, a schematic flowchart of a video distributed storage and centralized management system based on iSCSI technology according to an embodiment of the present invention is shown, and a system structure is shown in fig. 2. The system adopts a hierarchical system architecture, the architecture is based on iSCSI technology, a superior monitoring center and a local monitoring center are connected through an IP network, the superior monitoring center adopts SAN connected by optical fiber, and transmits data with the local monitoring center through the IP network, the superior monitoring center and the local monitoring center can be expanded at any time according to needs, and data transmission can be realized between a monitoring terminal and monitoring centers of different levels on a TCP/IP network.
The monitoring front end is used for monitoring videos, temporarily storing audio and video data when a network is not smooth, or storing the condition of important data of a client in the process of business expansion installation or electric charge payment transaction at the front end, and uploading the important data to a superior monitoring center at regular time for storage; and sending a request to a local monitoring center, and uploading or downloading playback audio and video data. The monitoring front end mainly comprises a video camera and a local PC terminal, wherein the video camera is connected with the local PC terminal and is used for collecting local video data; the local PC terminal stores local video data.
At least one local monitoring center, as shown in fig. 3, including an automation device centralized controller, a switch; the switch is used for connecting the plurality of video cameras, connecting the switch with the automatic equipment centralized controller and locally storing the audio and video data acquired by the monitoring front end in a distributed manner or returning the locally stored audio and video data to the monitoring front end after responding to a request sent by the monitoring front end; and sending a request to a superior monitoring center based on the ISCSI technology, uploading the monitoring data of the local monitoring center to the superior monitoring center at regular time, or requesting to download playback audio and video data. The local monitoring center can be set according to the geographical position or the administrative membership and mainly comprises a digital matrix, a streaming media server, iSCSI storage equipment, VSTARRecorder software and the like; the audio and video data are mainly stored in a local monitoring center, which is a concept of distributed storage.
And the superior monitoring center is used for storing audio and video data uploaded by all the local monitoring centers or returning the audio and video data to the local monitoring centers after responding to the data requests sent by the local monitoring centers. The upper monitoring center usually has only one, and comprises a network video server for data storage and a control management module for performing request and response processing of video stream data; and the control management module is used for carrying out information interaction with the centralized controller of the automation equipment, and is used for controlling and automatically distributing the requests of different video streams based on an access control strategy optimized by a dynamic threshold value. The upper monitoring center mainly comprises a digital matrix, an authentication server, VSTARClerk software and the like, wherein a VE4000 series network video server can be provided with a hard disk, and the hard disk is mainly used for temporarily storing audio and video data when a network is not smooth or storing some important data at the front end.
As shown in fig. 4, the iSCSI technology is a new Internet protocol developed by IETF based on storage network, and the principle of the iSCSI technology is to transmit SCSI commands through IP network, so that data transmission on the network is facilitated and remote storage management can be realized. iSCSI enables standard SCSI commands to be transferred between host systems (initiators) and storage devices (targets) over TCP/IP networks, and the iSCSI protocol supports the transfer of standard SCSI commands between systems. The connections between the systems are made through a standard IP network infrastructure.
The working principle of iSCSI is as follows: when a request is sent by the end user or application (initiator), the operating system will generate an appropriate SCSI command and data request, which is encapsulated and encrypted when encryption is required. These commands, together with the header of the TCP/IP protocol, can be transmitted over the ethernet. After receiving the data packet, the receiving end (target) unpacks the data packet in the opposite direction to analyze the SCSI command and the data request, and the SCSI command is sent to the SCSI storage device driver.
Compared with the traditional last-minute migration, the access control strategy based on dynamic threshold optimization mostly only uses load information for migration strategy calculation, but when the popularity fluctuates dynamically, an indirect and single method cannot make accurate strategy adjustment. Therefore, popularity distribution is applied to a migration model, based on a session migration strategy of dynamic threshold distribution, session distribution thresholds of various videos on each server are determined according to the popularity distribution, and blindness of requesting for receiving people and session migration is avoided through guidance of the distribution thresholds. And for the request of the new video, if the total number of the sessions of the same type of videos does not exceed the distribution threshold, the session is preferentially accessed according to the minimum load in the server with the session number lower than the distribution threshold, otherwise, the session distribution threshold is re-established after the video distribution has fluctuated.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting the same, and although the present invention is described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: modifications and equivalents may be made to the embodiments of the invention without departing from the spirit and scope of the invention, which is to be covered by the claims.
Claims (9)
1. A video distributed storage and centralized management system, the system comprising:
the monitoring front end is used for monitoring videos, temporarily storing audio and video data when a network is not smooth, and uploading the audio and video data to a superior monitoring center at regular time for storage; sending a request to a local monitoring center, and uploading or downloading playback audio and video data;
the local monitoring center is used for locally storing the audio and video data acquired by the monitoring front end in a distributed manner or returning the locally stored audio and video data to the monitoring front end after responding to the request sent by the monitoring front end; sending a request to a superior monitoring center based on the iSCSI technology, uploading monitoring data of a local monitoring center to the superior monitoring center at regular time, or requesting to download playback audio and video data;
and the superior monitoring center is used for storing audio and video data uploaded by all the local monitoring centers or returning the audio and video data to the local monitoring centers after responding to the data requests sent by the local monitoring centers.
2. The video distributed storage and centralized management system of claim 1, wherein: the monitoring front end comprises a video camera and a local PC terminal, and the video camera is connected with the local PC terminal and used for collecting local video data; the local PC terminal stores local video data.
3. The video distributed storage and centralized management system of claim 2, wherein: the at least one local monitoring center comprises an automation equipment centralized controller and a switch; the switch is used for connecting a plurality of video cameras and connecting an automation equipment centralized controller, the automation equipment centralized controller is used for responding and shunting video requests, one automation equipment centralized controller can be connected with a plurality of video cameras and used for controlling local video streams of the video cameras, uploading local video data to an upper monitoring center or requesting a local PC terminal to play back videos.
4. The video distributed storage and centralized management system of claim 1, wherein: the superior monitoring center comprises a network video server for data storage and a control management module for performing request and response processing of video stream data; and the control management module is used for carrying out information interaction with the centralized controller of the automation equipment, and is used for controlling and automatically distributing the requests of different video streams based on an access control strategy optimized by a dynamic threshold value.
5. The video distributed storage and centralized management system of claim 4, wherein: the network video server comprises a VE4000 series server which can be provided with a hard disk, wherein the hard disk is used for temporarily storing audio and video data when the network is not smooth and storing important data at the front end of the monitoring.
6. The distributed video storage and centralized management system according to claim 1, wherein the upper monitoring center employs an IPSAN network architecture of iSCSI technology, and transmits SCSI commands through an IP network for remote real-time management of local video streams.
7. The video distributed storage and centralized management system of claim 6, wherein: the IPSAN network architecture of the iSCSI technology is a SAN storage network which is constructed on the traditional IP Ethernet and is used for connecting an upper monitoring center and a local monitoring center.
8. The video distributed storage and centralized management system of claim 1, wherein: the local monitoring center comprises an intelligent equipment centralized controller which is used for connecting and controlling a plurality of monitoring front ends of the local monitoring center.
9. The video distributed storage and centralized management system according to claim 4, wherein the access control policy based on dynamic threshold optimization is: and applying the popularity distribution to a migration model, and determining the session distribution threshold of various videos on each streaming media server according to the popularity distribution based on a session migration strategy of dynamic threshold distribution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911278817.4A CN111050103A (en) | 2019-12-13 | 2019-12-13 | Video distributed storage and centralized management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911278817.4A CN111050103A (en) | 2019-12-13 | 2019-12-13 | Video distributed storage and centralized management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111050103A true CN111050103A (en) | 2020-04-21 |
Family
ID=70236054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911278817.4A Pending CN111050103A (en) | 2019-12-13 | 2019-12-13 | Video distributed storage and centralized management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111050103A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114697682A (en) * | 2020-12-29 | 2022-07-01 | 阿里巴巴集团控股有限公司 | Video processing method and system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102404551A (en) * | 2010-09-16 | 2012-04-04 | 江苏中科智能工程有限公司 | Digital video monitoring system special for rail transit |
| CN202206413U (en) * | 2011-06-23 | 2012-04-25 | 北京飞杰信息技术有限公司 | iSCSI storage node and architecture |
| CN102510390A (en) * | 2011-09-28 | 2012-06-20 | 北京飞杰信息技术有限公司 | Method and device for instructing data migration by hard disk temperature self-detection |
| US20120254535A1 (en) * | 2010-12-13 | 2012-10-04 | International Business Machines Corporation | Instant data restoration |
| CN102843284A (en) * | 2011-06-23 | 2012-12-26 | 北京飞杰信息技术有限公司 | iSCSI storage node, framework and read-write method |
| US20140012825A1 (en) * | 2010-03-12 | 2014-01-09 | Cleversafe, Inc. | Dispersed storage network for managing data deletion |
| CN104113735A (en) * | 2014-07-30 | 2014-10-22 | 武汉烽火众智数字技术有限责任公司 | Distributed video monitoring storing system and method thereof |
| CN106354436A (en) * | 2016-09-20 | 2017-01-25 | 郑州云海信息技术有限公司 | Storage system based on distributed IPSAN |
| CN108040220A (en) * | 2017-11-16 | 2018-05-15 | 杭州好园科技有限公司 | Wisdom garden video monitoring system |
-
2019
- 2019-12-13 CN CN201911278817.4A patent/CN111050103A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140012825A1 (en) * | 2010-03-12 | 2014-01-09 | Cleversafe, Inc. | Dispersed storage network for managing data deletion |
| CN102404551A (en) * | 2010-09-16 | 2012-04-04 | 江苏中科智能工程有限公司 | Digital video monitoring system special for rail transit |
| US20120254535A1 (en) * | 2010-12-13 | 2012-10-04 | International Business Machines Corporation | Instant data restoration |
| CN202206413U (en) * | 2011-06-23 | 2012-04-25 | 北京飞杰信息技术有限公司 | iSCSI storage node and architecture |
| CN102843284A (en) * | 2011-06-23 | 2012-12-26 | 北京飞杰信息技术有限公司 | iSCSI storage node, framework and read-write method |
| CN102510390A (en) * | 2011-09-28 | 2012-06-20 | 北京飞杰信息技术有限公司 | Method and device for instructing data migration by hard disk temperature self-detection |
| CN104113735A (en) * | 2014-07-30 | 2014-10-22 | 武汉烽火众智数字技术有限责任公司 | Distributed video monitoring storing system and method thereof |
| CN106354436A (en) * | 2016-09-20 | 2017-01-25 | 郑州云海信息技术有限公司 | Storage system based on distributed IPSAN |
| CN108040220A (en) * | 2017-11-16 | 2018-05-15 | 杭州好园科技有限公司 | Wisdom garden video monitoring system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114697682A (en) * | 2020-12-29 | 2022-07-01 | 阿里巴巴集团控股有限公司 | Video processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016169308A1 (en) | Method and system for cloud-based storage of video, and method and system for previewing cloud-stored video | |
| US20020194324A1 (en) | System for global and local data resource management for service guarantees | |
| CN1316337C (en) | Method and device for simulating iSCSI facility on logic roll administrator | |
| US20080010647A1 (en) | Network storage device | |
| KR100967700B1 (en) | VOD service system based on Peer to Peer Communication | |
| CN112954385B (en) | Self-adaptive shunt decision method based on control theory and data driving | |
| US20080077650A1 (en) | Method and apparatus for transferring data between a home networked device and a storage system | |
| US7543072B1 (en) | Method and system capable of performing a data stream over multiple TCP connections or concurrent interleave of multiple data streams over multiple TCP connections | |
| US20110055895A1 (en) | Shared scalable server to control confidential sensory event traffic among recordation terminals, analysis engines, and a storage farm coupled via a non-proprietary communication channel | |
| WO2023274304A1 (en) | Distributed routing determining method, electronic device, and storage medium | |
| CN111050103A (en) | Video distributed storage and centralized management system | |
| US20050188123A1 (en) | System and method for insertion of markers into a data stream | |
| US20040006627A1 (en) | Content delivery system | |
| CN110913371B (en) | Vehicle remote monitoring method and device, intelligent vehicle, electronic equipment and storage medium | |
| CN109600436A (en) | A kind of distribution iscsi service implementing method, system and relevant apparatus | |
| JP4729549B2 (en) | Load control method, apparatus and program | |
| CN109302578A (en) | A kind of method and system logging in conference terminal and video conference | |
| US7966403B2 (en) | Performance profiling for improved data throughput | |
| CN101112062B (en) | Methods for controlling the admission of media content into a network | |
| US20090216886A1 (en) | Method of multi-path accessing remote logic device under linux system | |
| CN113726817B (en) | Streaming media data transmission method, device and medium | |
| US20060120291A1 (en) | System structure for increasing the performance of data transmission on the internet | |
| CN113014941A (en) | Open streaming media on-demand method, device, server and access platform | |
| CN112788348A (en) | On-demand method, device, equipment, system and storage medium | |
| EP1858230A1 (en) | Network storage device with separated control and storage data interfaces |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200421 |
|
| RJ01 | Rejection of invention patent application after publication |