CN113163162B

CN113163162B - Service providing method based on video cloud and video cloud system

Info

Publication number: CN113163162B
Application number: CN202110256233.8A
Authority: CN
Inventors: 刘腾飞; 鲁静; 欧阳国灵; 马守强; 何煦
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-03-09
Filing date: 2021-03-09
Publication date: 2023-07-18
Anticipated expiration: 2041-03-09
Also published as: CN113163162A

Abstract

The disclosure provides a service providing method based on a video cloud and a video cloud system. The service providing method based on the video cloud comprises the following steps: collecting video data through a plurality of video devices; receiving video data through a plurality of edge devices, wherein the plurality of edge devices are connected with the plurality of video devices by adopting a unified protocol; providing video data to a cloud server and/or a side server associated with the plurality of edge devices through the plurality of edge devices; receiving a service subscription request sent from a service request end; analyzing and processing the video data through the cloud server and/or the side end server, and generating a service corresponding to the service subscription request based on the analysis and processing result data; and providing the service corresponding to the service subscription request to the service request terminal. The video cloud system and the service providing method have flexible cloud edge coordination capability, support lossy service, and improve privacy and safety.

Description

Service providing method based on video cloud and video cloud system

Technical Field

The present disclosure relates to the field of cloud technology, and more particularly, to a video cloud-based service providing method, a video cloud system, a video cloud-based service providing apparatus, a computer-readable storage medium, and a computer program product.

Background

Cloud technology (Cloud technology) refers to a hosting technology for integrating hardware, software, network and other series resources in a wide area network or a local area network to realize calculation, storage, processing and sharing of data. The network that provides the resources is called a "cloud", where the resources are infinitely expandable to the user, and are available at any time, available on demand, expandable at any time, and pay-per-use. Among the various applications of cloud technology, the internet of things (The Internet of Things, IOT for short) is certainly a development direction in which attention is paid. The internet of things refers to collecting any object or process needing to be monitored, connected and interacted in real time through various devices and technologies such as various information sensors, radio frequency identification technologies, global positioning systems, infrared sensors and laser scanners, collecting various needed information such as sound, light, heat, electricity, mechanics, chemistry, biology and positions, and realizing ubiquitous connection of objects and people through various possible network access, and realizing intelligent sensing, identification and management of objects and processes. The internet of things is an information carrier based on the internet, a traditional telecommunication network and the like, and enables all common physical objects which can be independently addressed to form an interconnection network.

The video cloud is a cloud technical scheme based on the concept of cloud technology, and the video is used as a cloud terminal to present processing results. The existing commercial video cloud system has different forms from low-end products to high-end products, but most products are only closed systems with single functions aiming at a specific application scene, and the functions are inconvenient to expand, difficult to manage and low in intelligent degree. Some high-end intelligent video cloud systems also have the defects of inconvenient expansion of functions and software and hardware equipment, non-common data structures and interfaces, high development and maintenance cost and the like, and generally have strong dependence on cloud service capability, so that functions such as video service, algorithm service and the like cannot be provided under severe network conditions.

Disclosure of Invention

In order to solve the above-described problems, the present disclosure provides a video cloud-based service providing method, a video cloud system, a video cloud-based service providing apparatus, a computer-readable storage medium, and a computer program product.

According to an aspect of the embodiments of the present disclosure, there is provided a service providing method based on a video cloud, including: collecting video data by a plurality of video devices, the plurality of video devices being located at different locations and associated with different edge devices; receiving the video data through a plurality of edge devices, wherein the plurality of edge devices are connected with the plurality of video devices by adopting a unified protocol, and respectively managing the video devices associated with the plurality of edge devices; providing, by the plurality of edge devices, the video data to a cloud server and/or a side server associated with the plurality of edge devices; receiving a service subscription request sent from a service request end, wherein the service subscription request is used for subscribing to a service related to the video data; analyzing and processing the video data through the cloud server and/or the side server, and generating a service corresponding to the service subscription request based on the result data of the analysis and processing; and providing the service corresponding to the service subscription request to the service request terminal.

According to an example of an embodiment of the present disclosure, the video cloud-based service providing method further includes: receiving a service subscription request sent from the service request terminal through a management platform; logically integrating device parameter data and video data from the plurality of video devices and the plurality of edge devices through the management platform; and publishing the logically integrated device parameter data and video data through the management platform to provide a unified data access service, wherein the device parameter data comprises one or more of a device name, a device number, a device type, a device port, a device network Interconnection Protocol (IP) address, a device manufacturer and a device geographic location.

According to an example of an embodiment of the present disclosure, logically integrating the device parameter data and the video data of the plurality of video devices and the plurality of edge devices includes: receiving device parameter data and video data of the plurality of video devices and the plurality of edge devices via a web services plug-in; extracting metadata from the device parameter data and the video data, and selecting field information from the metadata to generate a code block; and packaging the code blocks to generate logically integrated device parameter data and video data.

According to an example of an embodiment of the present disclosure, the video cloud-based service providing method further includes: and receiving and managing state information and relation information of the plurality of video devices and the plurality of edge devices through the management platform, wherein the state information indicates the current states of the plurality of video devices and the plurality of edge devices, and the relation information indicates binding relations between the plurality of video devices and the plurality of edge devices and between the plurality of edge devices and video services.

According to an example of an embodiment of the present disclosure, the video cloud-based service providing method further includes: and querying, modifying, adding and deleting one or more operations of the device parameter data, the video data, the state information and the relation information of the plurality of video devices and the plurality of edge devices through the management platform.

According to an example of an embodiment of the present disclosure, wherein the cloud server and the edge server include an algorithm service module and a rule engine module, and wherein analyzing the video data and generating a service corresponding to the service subscription request based on result data of the analyzing includes: analyzing the video data by using the algorithm service module to obtain result data, and uploading the result data to the rule engine module; and generating a coordinated control command based on the result data by using the rule engine module, wherein the coordinated control command is used for providing services corresponding to the service subscription request.

According to an example of an embodiment of the present disclosure, the edge server includes at least a portion of an algorithm or rule in an algorithm service module or rule engine module in the cloud server; and providing service through the side end server under the condition that the cloud end server is unavailable.

According to an example of an embodiment of the present disclosure, the video cloud-based service providing method further includes: uploading firmware or updating the firmware to a cloud firmware center through a management platform; and/or issuing firmware or firmware updates to the plurality of edge devices via the management platform.

According to an example of an embodiment of the present disclosure, the edge device is a video gateway, and the service request end is a client or a web application associated with at least one of an access control system, an anti-theft system, a lighting system, an elevator system, an air conditioning system.

According to an example of an embodiment of the present disclosure, the video cloud-based service providing method further includes: performing asymmetric encryption when the plurality of edge devices access the cloud server; and carrying out symmetric encryption when the plurality of edge devices exchange data with the cloud server.

According to an example of an embodiment of the disclosure, performing asymmetric encryption when the plurality of edge devices access the cloud server includes: obtaining a private key for the one or more edge devices and a public key required for accessing the cloud server from the cloud server; the plurality of edge devices register and log in to the cloud server by utilizing the private key and the public key, and acquire a symmetric key for data exchange from the cloud server.

According to another aspect of the disclosed embodiments, there is provided a video cloud system including: a plurality of video devices configured to collect video data, the plurality of video devices being located at different locations and associated with different edge devices; a plurality of edge devices configured to acquire the video data from the video devices, the plurality of edge devices and the plurality of video devices being connected by a unified protocol, and respectively managing the video devices associated therewith; the cloud server and at least one side server associated with the plurality of edge devices are configured to receive the video data from the plurality of edge devices and receive a service subscription request sent from the service request end, wherein the service subscription request is used for subscribing to a service related to the video data, the cloud server and/or the side server are further configured to analyze the video data, generate a service corresponding to the service subscription request based on the result data of the analysis processing, and provide the service corresponding to the service subscription request to the service request end.

According to an example of an embodiment of the present disclosure, the video cloud system further comprises a management platform configured to: receiving a service subscription request sent from the service request terminal; logically integrating device parameter data and video data from the plurality of video devices and the plurality of edge devices; and publishing the logically integrated device parameter data and video data to provide a unified data access service, wherein the device parameter data comprises one or more of a device name, a device number, a device type, a device port, a device network Interconnection Protocol (IP) address, a device manufacturer, and a device geographical location.

According to an example of an embodiment of the present disclosure, the management platform is further configured to: receiving device parameter data and video data of the plurality of video devices and the plurality of edge devices via a web services plug-in; extracting metadata from the device parameter data and the video data, and selecting field information from the metadata to generate a code block; and packaging the code blocks to generate logically integrated device parameter data and video data.

According to an example of an embodiment of the present disclosure, the management platform is further configured to: and receiving and managing state information of the plurality of video devices and the plurality of edge devices and relation information, wherein the state information indicates current states of the plurality of video devices and the plurality of edge devices, and the relation information indicates binding relations between the plurality of video devices and the plurality of edge devices and between the plurality of edge devices and video services.

According to an example of an embodiment of the present disclosure, the management platform is further configured to: and querying, modifying, adding and deleting the device parameter data, the video data, the state information and the relation information of the plurality of video devices and the plurality of edge devices.

According to an example of an embodiment of the disclosure, wherein the cloud server and the edge server comprise an algorithm service module and a rule engine module, and wherein the algorithm service module is configured to analyze the video data to obtain result data and upload the result data to the rule engine module; the rules engine module is configured to generate a coordinated control command for providing a service corresponding to the service subscription request based on the result data.

According to an example of an embodiment of the present disclosure, the video cloud system further includes a cloud firmware center, and the management platform is further configured to upload firmware or update firmware to the cloud firmware center; and/or issuing firmware or firmware updates to the plurality of edge devices.

According to an example of an embodiment of the present disclosure, the video cloud system further comprises a security module configured to: performing asymmetric encryption when the plurality of edge devices access the cloud server; and carrying out symmetric encryption when the plurality of edge devices exchange data with the cloud server.

According to an example of an embodiment of the present disclosure, the security module is further configured to: when the plurality of edge devices are accessed to the cloud server, private keys for the one or more edge devices and public keys required for accessing the cloud server are obtained from the cloud server; and registering and logging the plurality of edge devices into the cloud server by utilizing the private key and the public key, and acquiring a symmetric key for data exchange from the cloud server.

According to another aspect of the embodiments of the present disclosure, there is provided a service providing apparatus based on a video cloud, including: one or more processors; and one or more memories, wherein the memories have stored therein computer readable code, which when executed by the one or more processors, causes the one or more processors to perform the method of any of the above aspects.

According to another aspect of the disclosed embodiments, there is provided a computer readable storage medium having stored thereon computer readable instructions which, when executed by a processor, cause the processor to perform the method of any of the above aspects.

According to another aspect of the disclosed embodiments, there is provided a computer program product comprising computer readable instructions which, when executed by a processor, cause the processor to perform the method of any of the above aspects.

By using the video cloud-based service providing method, the video cloud system, the video cloud-based service providing device, the computer-readable storage medium and the computer program product according to the above aspects of the present disclosure, data sharing between devices in the video cloud system can be realized, and an application system subscribed to the video cloud system is controlled in an associated manner; the management platform is used for uniformly managing and scheduling a plurality of video devices and a plurality of edge devices in the video cloud system, uniformly maintaining and managing data of the video devices and the edge devices, and providing one-stop data access service; in addition, through the arrangement of the functional modules of the cloud end and the side end, efficient cloud-edge coordination can be realized, lossy services under the conditions of severe network environment or cloud server faults and the like are supported, and firmware cloud hosting and distribution can be provided through a cloud firmware center; in addition, the security of the edge equipment accessing the cloud server and the security of the edge equipment exchanging data with the cloud server are ensured by setting a perfect security mechanism.

Drawings

The above and other objects, features and advantages of the presently disclosed embodiments will become more apparent from the more detailed description of the presently disclosed embodiments when taken in conjunction with the accompanying drawings. The accompanying drawings are included to provide a further understanding of embodiments of the disclosure, and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure, without limitation to the disclosure. In the drawings, like reference numerals generally refer to like parts or steps.

FIG. 1 shows a schematic representation of a system according to one example a general framework of video clouds of (a);

fig. 2 illustrates a basic architecture of a video cloud system according to an embodiment of the present disclosure;

FIG. 3 illustrates a flow chart of a video cloud-based service providing method according to an embodiment of the present disclosure;

FIG. 4 illustrates a schematic diagram of an example coordinated control according to an embodiment of the disclosure;

FIG. 5 illustrates a schematic diagram of an example management scheduling flow for video devices and edge devices in accordance with an embodiment of the present disclosure;

FIG. 6 illustrates a schematic diagram of data logic integration of an example management platform in accordance with an embodiment of the present disclosure;

FIG. 7 illustrates a functional architecture diagram of an example cloud and edge according to an embodiment of the present disclosure;

FIG. 8 illustrates an example cloud-edge collaboration services framework in accordance with an embodiment of the disclosure;

FIG. 9 illustrates a schematic diagram of an example firmware hosting and distribution according to an embodiment of the present disclosure;

FIG. 10 illustrates a security mechanism schematic of an example video cloud system according to an embodiment of the disclosure;

FIG. 11 illustrates a schematic diagram of a video cloud system according to an embodiment of the present disclosure;

fig. 12 shows a schematic diagram of an architecture of an exemplary computing device, according to an embodiment of the present disclosure.

Detailed Description

The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure. It will be apparent that the described embodiments are merely embodiments of a portion, but not all, of the present disclosure. All other embodiments, which can be made by one of ordinary skill in the art without the need for inventive faculty, are intended to be within the scope of the present disclosure, based on the embodiments in this disclosure.

The video cloud is a video network platform service based on cloud computing business model application, and is applied to various fields such as video monitoring, video conference systems and the like. On a cloud platform, applications may run on a cloud server. The edge equipment and the cloud server encode the acquired audio and video data, transmit the encoded audio and video data to the terminal in real time through a network, and display and output the encoded audio and video data after the terminal decodes the encoded audio and video data in real time. The terminal can operate at the same time, and the operation control information is transmitted to an application running on the cloud server in real time through a network so as to control the application.

In the present disclosure, the cloud server may be an independent physical server, or may be a server cluster or a distributed system formed by a plurality of physical servers, and in the present disclosure, the cloud server may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, and basic cloud computing services such as big data and artificial intelligence platforms; the terminal may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, etc. The terminal and the server may be directly or indirectly connected through wired or wireless communication, which is not particularly limited by the present disclosure. In this disclosure, edge devices refer to devices located near a side of a data source such as a video device, e.g., a video gateway, a local server, etc.

Fig. 1 illustrates a general framework of a video cloud 100 according to one example. As shown in fig. 1, in a video cloud 100, a video device 110 such as a web camera (IPC), a Network Video Recorder (NVR), etc. in an internal local area network collects video data, and transmits the collected video data to a cloud server 130 of the video cloud via a video gateway 120, and the cloud server 130 transmits the video data to a client 140 after performing operations such as transcoding, data stream protocol conversion, etc. The existing video cloud systems are various, but as mentioned above, most of the existing video cloud systems have the defects of inconvenient expansion of functions and software and hardware devices, non-universal data structures and interfaces, high development and maintenance costs and the like, and generally have difficulty in ensuring the service quality under severe network conditions.

The present disclosure provides a video cloud-based service providing method, which may be carried on a video cloud system. Fig. 2 illustrates a basic architecture of a video cloud system 200 according to an embodiment of the present disclosure. As shown in fig. 2, in the video cloud system 200, at the bottom layer is a video device 210 for capturing video data, where the video device 210 may include, for example, a network video camera (IPC) 211, a Network Video Recorder (NVR) 212, or any other video device with a video capturing function; in the middle layer is an edge device 220, as described above, where an edge device may refer to a device located near the side of the data source such as a video device, e.g., a video gateway 221 or any other edge device 222, etc.; at the top level is the cloud server 230, where the cloud server 230 may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDNs, and basic cloud computing services such as big data and artificial intelligence platforms, as described above, which embodiments of the present disclosure are not limited in particular.

In the video cloud system 200, video devices 210 such as IPC 211 and NVR 212 collect video data. The video gateway 221 in the edge device 220 may be connected to the video device 210 through an open network video interface forum (Open Network Video Interface Forum, ONVIF) protocol, a software development kit (Software Development Kit, SDK) protocol, or the like, and may perform unified management on a plurality of video devices 210. In addition, the video gateway 221 may also have functions of event reporting, code stream distribution, etc., where event reporting refers to reporting specific events related to the video device 210, the video gateway 221, etc. to the cloud server 230, and specific events may refer to events such as adding, deleting, and failing of the video device and/or the video gateway, etc.; the code stream distribution means that the video gateway 221 may obtain video data collected by the video device 210 and push the video data to the cloud server 230 or other edge devices 222 except the video gateway 221, for example, a side end server. After receiving the video data, the cloud server 230 may perform operations such as transcoding, data stream protocol conversion, etc. on the received video data, so as to provide video services such as live video, video recording, etc. to video applications such as clients, web applications, etc. that are installed on the cloud server 230.

Next, a video cloud-based service providing method according to an embodiment of the present disclosure is described with reference to fig. 3. Fig. 3 shows a flowchart of a video cloud-based service providing method 300 according to an embodiment of the present disclosure. As shown in fig. 3, in step S310, video data is acquired by a plurality of video devices. The video device may be the IPC, NVR or other video device with video capturing function, which is not particularly limited by the embodiments of the present disclosure. The plurality of video devices may be in different geographic locations and may be associated with different edge devices, e.g., may be directly connected to the edge devices, or may be associated with different edge devices through protocols such as ONVIF or SDK, etc.

In step S320, video data collected by a plurality of video devices is received by a plurality of edge devices. Here, the edge device may refer to a device located near a data source such as a video device, for example, a video gateway or any other edge device, etc., to which the embodiments of the present disclosure are not limited in particular. As described above, a plurality of edge devices and a plurality of video devices may be connected using a unified protocol such as one vif or SDK, and in the present disclosure, one edge device may be connected to one or more video devices, and one video device may be connected to a plurality of edge devices at the same time, which is not particularly limited by the embodiments of the present disclosure. Each of the plurality of edge devices may manage a video device associated therewith, e.g., may manage configuration information, log information, etc. of the video device associated therewith, and may report events related to the video device, the edge device, or both.

In step S330, the acquired video data is provided to the cloud server and/or a side server associated with the plurality of edge devices by the plurality of edge devices. In the present disclosure, the side where the edge device is located is referred to as a side, and in addition to the cloud server, a server may be disposed at the side, which is referred to as a side server or a local server. One or more edge servers may be arranged, which may be associated with a plurality of edge devices, e.g. may be communicatively connected, either wired or wireless, to the plurality of edge devices. In one example, the edge device itself may also be used as a side server. In general, the edge server, the plurality of edge devices, and the plurality of video devices may be located in the same local area network, but the embodiments of the present disclosure are not limited thereto, and the edge server, the plurality of edge devices, and the plurality of video devices may be located in different local area networks, respectively, or in other network environments.

In this step, the plurality of edge devices may push video data acquired from the video device only to the cloud server, or only to the edge server, or may push to both the cloud server and the edge server at the same time to enable video services or other services to be provided at the cloud and edge at the same time, as will be described in detail below.

In step S340, a service subscription request issued from a service request terminal is received. The service request end may be, for example, a client associated with an application system or a web application, where the application system may refer to, for example, an intelligent home system such as a lighting system, an elevator system, an air conditioning system, an audio-visual system, a household appliance, or an intelligent security system such as an access control system, a monitoring system, an anti-theft system, or may also be a video device such as NVR and IPC, or any other application system that may utilize video cloud for linkage and control, which is not specifically limited by the embodiments of the disclosure. In the embodiment of the disclosure, an application system desiring to acquire cloud services of a video cloud system may send a service subscription request to the video cloud system through a service request end thereof, where the service subscription request is used for subscribing to services related to video data acquired by each video device.

For example, a service request end (e.g., a client) of the access control system may issue a service subscription request to the video cloud system to subscribe to an access control service generated by the video cloud system based on video data collected by each video device, for example, to control a gate of the access control system. As another example, a service request end (e.g., client) of the lighting system may issue a service subscription request to the video cloud system to subscribe to lighting control services generated by the video cloud system based on video data collected by respective video devices, for example, to control light fixture switches in the lighting system.

The management platform is provided in the video cloud system of the embodiment of the disclosure, and communication connection can be established between the service request end and the cloud server and/or the side server through the management platform. The management interface of the management platform may be provided in the form of a web application or a client, for example, and may be hosted on the cloud server and/or the edge server, or may exist independently of the cloud server and the edge server. For example, the cloud server and/or the edge server may receive a service subscription request from the service requestor through the management platform and establish a communication connection with the service requestor in response to the service subscription request, so that the service requestor may subscribe to the video cloud system, or in other words, so that the service requestor may exist as an application of the video cloud system, thereby enabling use of services provided by the video cloud system. The management platform provided by embodiments of the present disclosure may have many more functions, as will be described in further detail below.

After receiving the video data provided by the edge device, the cloud server and/or the edge server may perform analysis processing on the video data in step S350, generate a service corresponding to the service subscription request based on the result data of the analysis processing, and provide the service corresponding to the service subscription request to the service request end in step S360, for example, for performing coordinated control on an application system associated with the service request end. According to an example of an embodiment of the disclosure, the cloud server and/or the edge server may include an algorithm service module and a rule engine module, where the algorithm service module is configured to analyze video data to obtain result data, and upload the result data to the rule engine module; the rules engine module is configured to generate a coordinated control command for providing a service corresponding to the service subscription request based on the received result data.

Step S350 and step S360 are described in further detail below in conjunction with fig. 4. Fig. 4 shows a schematic diagram of an example coordinated control according to an embodiment of the present disclosure. For simplicity, in fig. 4, only the algorithm service module 432 and the rule engine module 433 are shown at the cloud, but this is merely by way of example and not limitation, and in the embodiment of the present disclosure, the algorithm service module and the rule engine module may be located at the edge where the edge device 420 is located, for example, at an edge server.

In order to provide corresponding services to the application system 410 subscribed to the video cloud system, such as an entrance guard system, a lighting system, an air conditioning system, a monitoring system, etc., the edge device 420 acquires video data from the video device 410', such as IPC, NVR, etc. The video device 410' herein may be a video device that is self-contained in the application system 410, for example, IPC that is self-contained in the application system 410, or may be any other video device in a video cloud system. The edge device 420 pushes the video data to the cloud server 430 to provide to the video service module 431 for live video or video recording.

The video service module 431 may provide the video data acquired in real time for live video or the history video data recorded by video recording to the algorithm service module 432 for analysis processing. For example, the algorithm service module 431 may analyze the video data using image processing or Artificial Intelligence (AI) reasoning based on deep learning or the like, e.g., may analyze the video data frame by frame, or extract key frames in the video data for analysis, or the like. The algorithm service module 431 uploads the result data of the analysis to the rule engine module 433.

The rule engine module 433 may logically analyze the received result data and generate a coordinated control command according to a predetermined logic rule, for example, a coordinated control command for controlling a gate of the access control system, a lamp switch of the lighting system, etc., to perform coordinated control on the application system 410. In one example, when a video device 410 'such as IPC, NVR, etc. subscribes itself to the video cloud system, the rules engine module 433 may also generate coordinated control commands to the video device 410', e.g., to control camera opening, closing, changing direction, etc.

As can be seen from the above description, in the embodiment of the disclosure, the application system 410 does not need to have a video device, but can operate the application system 410 by subscribing to the video cloud system according to the embodiment of the disclosure, and using video data acquired by any other video device in the video cloud system, so as to realize data sharing in the video cloud system, and break the data islanding phenomenon of the conventional video analysis system. Most of traditional video analysis systems adopt a vertical architecture, are independently constructed based on specific project customization requirements, have low openness, and cannot share data with other systems, so that the data island phenomenon is caused. Taking the face recognition access control system as an example, the existing access control system is usually an independent system, the whole access control system is required to be operated by a camera, a face recognition algorithm and a corresponding control module, and meanwhile, data generated by the access control system can only be used in the system and cannot be shared with other systems.

In the embodiment of the disclosure, the data islanding phenomenon is solved. For example, the access control system of the video cloud system based on the embodiment of the disclosure does not need to have video equipment such as a camera, and the like, but can subscribe to the service of the video cloud system, and the video cloud system can generate a linkage control command for the access control system by utilizing video data acquired by other video equipment in the system so as to be used for controlling a gate of the access control system; alternatively, in another aspect, an access control system with video devices such as cameras may share video data collected by the video cloud system for use by other application systems within the video cloud system, such as an elevator system, lighting system, and the like.

Therefore, the service providing method based on the video cloud overcomes the data island phenomenon of the traditional system and can realize multi-system linkage in the video cloud system. Meanwhile, as the application system subscribed to the service of the video cloud system or the associated application thereof exists as the application of the video cloud system, data leakage can be avoided, and the safety of the data is ensured. Moreover, once the video cloud system according to the embodiment of the disclosure generates the result data based on the video data acquired from any video device, the result data can be reported to the rule engine in real time so as to quickly generate and distribute linkage control commands for different application systems, thereby realizing quick control over different application systems.

In addition, the video cloud-based service providing method 300 according to the embodiment of the present disclosure can achieve compatibility with different types of video devices. In practical applications, video devices in a video cloud system often come from different vendors, and thus may have different message types, different message encoding structures, and so on, so that unified access and management for each video device is difficult. The video cloud system according to the embodiment of the disclosure provides a universal video device access model, and can unify the standards of messages from different types of video devices. For example, messages from different types of video devices may be unified according to a standard message format as shown in table 1 below. In table 1, examples of variables included in the standard message format are listed, and variable types such as String type, integer type (intelger), long type (Long) and the like are defined for these variables, respectively. For example, the device unique identifier wId may be a character string type, the message sequence number variable Seq may be a long integer type, the Random number variable Random may be an integer type, or the like.

Table 1 standard message format examples

Variable(s)	Type(s)	Descriptor for a computer
			wId	String	Device unique identification
subwId	String	Child device unique identification
			msgType	String	Message type
Seq	Long	Message sequence number
			Random	Integer	Random number
TimeStamp	Long	Time stamp
			DataPoint	Integer	Function code
Value	String	Message custom content

By standardizing the messages from different types of video devices by using the standard message format shown in table 1, for example, the messages can be interconnected and shared with different types of video devices, so that the compatibility of different types of video devices is realized, and in the video cloud system of the embodiment of the disclosure, the message interface from the bottom layer (for example, the layer where the video device is located, as shown in fig. 2) to the upper layer (for example, the middle layer where the edge device is located or the top layer where the cloud server is located, as shown in fig. 2) is unified and transparent, so that the efficiency of message communication between different devices in the video cloud system is improved.

In addition, as mentioned in step S340 of the video cloud-based service providing method 300 according to an embodiment of the present disclosure, a communication connection between the service request end and the cloud server and/or the edge server may be established using the management platform. The management platform according to the embodiment of the disclosure can also realize unified management and scheduling of a plurality of video devices and a plurality of edge devices in the video cloud system. Fig. 5 illustrates a schematic diagram of an example management scheduling flow 500 for video devices and edge devices in accordance with an embodiment of the present disclosure.

As described above, the management interface of the management platform may be provided in the form of a web application or a client, for example, and may be mounted on the cloud server and/or the side server, or may exist independently of the cloud server and the side server. Typically, video devices such as NVR, IPC, etc. are located within a local area network, need to be accessed into the video cloud system through associated edge devices such as video gateways, and often the video devices and edge devices within the video cloud system come from different systems associated with the video cloud system (e.g., different application systems subscribed to the video cloud system, etc., hereinafter referred to as associated systems), different edge devices within different associated systems may interface with different video traffic, such as video surveillance, face recognition access, etc.

In order to perform unified scheduling management on these video devices and edge devices in the video cloud system, first, as shown in fig. 5, in step S510, the video devices and edge devices may be registered on a management platform, for example, by way of import via a web service (WebService) plug-in, so as to import device parameter data of the video devices and edge devices, and relationship information between each video device and a corresponding edge device, and between the edge device and video service. The WebService plugin is a platform-independent application program based on a programmable webpage, and can realize distributed interaction operation. The relationship information may indicate, for example, a binding relationship between the video device and the corresponding edge device, and a binding relationship between the edge device and the video service. The device parameter data and the relationship information imported through the management platform can be synchronized to the cloud storage device of the cloud server for storage, and can be displayed on the management platform for browsing and inquiring. Here, the cloud storage device may be, for example, a part of the cloud server, or may be a separate storage device communicatively connected to the cloud server, which is not particularly limited by the embodiment of the disclosure.

Then, in step S520, the edge device accesses the video cloud service. Here, the video cloud service refers to a service that can be provided through a management platform and a cloud server and/or a side server. For example, the edge device may access to a cloud server and/or a side server of the video cloud system through the management platform to establish a communication connection with the cloud server and/or the side server, so as to be capable of receiving a service provided by the cloud server and/or the side server, or may be referred to as that the edge device accesses to the video cloud service. The video cloud service shown in fig. 5 may not represent an actual module or interface, but may be used to represent a communication connection between an edge device and a video cloud system, which is shown here for ease of illustration. After the edge device accesses the video cloud service, its relationship information may be obtained from the cloud server, e.g., the edge device may learn which video devices it binds with. Thus, in step S530, the state information of the edge device and the state information of the video device associated therewith may be synchronized into the cloud storage device of the cloud server via the management platform, and may be displayed on the management platform for browsing and querying. The status information may, for example, indicate a current status of the edge device and the video device associated therewith, e.g., a normal running status, a failed shutdown status, etc.

After the relationship information and the state information of the video device and the edge device are clarified, in step S540, control information for the video device and the edge device may be sent out through the management platform to control the edge device and the video device, so as to implement scheduling for the edge device and the video device. For example, a control message may be issued on the management platform to unbind a set of associated edge devices and video devices to disconnect the set of edge devices and video devices.

In addition, according to an example of an embodiment of the present disclosure, operations such as querying, changing, adding, deleting, etc. may be performed on device parameter data, state information, relationship information, etc. of a plurality of video devices and a plurality of edge devices through a management platform. For example, a certain video device or an edge device may be added or deleted from the video cloud system through the management platform, current state information or relationship information of the certain video device or the edge device may be queried, device parameter data of the certain video device or the edge device may be acquired, and so on. Therefore, unified scheduling management of a plurality of video devices and edge devices in the video cloud system can be achieved through the management platform.

In addition, the management platform according to the embodiment of the disclosure can also uniformly maintain and manage the data of the video equipment and the edge equipment, and provide one-stop data access service. Here, the data of the video device and the edge device includes its device parameter data, video data stored thereon, and the like, which may be collectively referred to herein as source data of the management platform. Wherein the device parameter data may include, for example, one or more of a device name, a device number, a device type, a device port, a device network Interconnect Protocol (IP) address, a device manufacturer, a device geographic location, and the like; the video data is collected by the video device and may be stored on the video device or transmitted to an edge device associated with the video device for storage.

Fig. 6 illustrates a schematic diagram of data logic integration of an example management platform 600 according to an embodiment of the disclosure. As described above, the video devices and edge devices within the video cloud system may be from different systems associated with the video cloud system, such as association system 610_1, association system 610_2 through association system 610—n, which makes the source data typically multi-source heterogeneous data that are different in source and structure from each other. In order to uniformly manage the multi-source heterogeneous data, the management platform needs to logically integrate the multi-source heterogeneous data.

Specifically, as shown in fig. 6, source data from a plurality of video devices and a plurality of edge devices in the association systems 610_1 through 610—n may be imported into the management platform 600 through the first network service plug-in 620, as previously described with reference to fig. 5. The management platform 600 may logically integrate source data from multiple video devices and multiple edge devices after it has received it. According to an example of an embodiment of the present disclosure, the management platform 600 may include a metadata extraction module 631, a code generation module 632, and a data publishing module 633. The metadata extraction module 631 is configured to extract metadata from source data from a plurality of video devices and a plurality of edge devices and provide to the code generation module 632. Metadata is, for example, data characterizing the valid characteristics of the source data, such as table structure and field information of the source data. The code generation module 632 is configured to select predetermined field information from metadata to generate a code block, and provide the code block to the data issue module 633. The data publishing module 633 packages and publishes the code blocks onto the management platform 600, or more specifically, onto the web server where the management platform 600 is located, and can synchronize onto the cloud server through the management platform. Thus, upon receiving a data access request sent by the business system 650, for example, via the second web service plug-in 640, the management platform 600 may provide logically integrated source data, i.e., packaged code blocks, to the business system 650 via the second web service plug-in 640.

Here, the service system 650 may be any system that requests data access from the management platform 600, which is not particularly limited by the embodiments of the present disclosure. The business system 650 may, for example, request access to device parameter data of the video device or edge device from the management platform 600, or request access to video data stored on the video device or edge device, or the like.

The management platform 600 according to the embodiments of the present disclosure can effectively integrate multi-source heterogeneous source data and provide a unified data access service with little modification to the association systems 610_1 to 610—n from which the source data is derived. The business system 650, or any other user, may browse, query, access logically integrated source data from multiple video devices and edge devices, such as device parameter data and video data stored thereon, and the like, via the management platform. Furthermore, the management platform according to embodiments of the present disclosure does not require that the source data be physically centralized, i.e., it is not necessary that the source data must be collectively stored on the management platform or a cloud server associated with the management platform. For example, upon request from the business system 650, the management platform 600 may extract the source data through an interface such as a first web service plug-in, logically integrate the source data, and then provide the source data to the business system 650 through an interface such as a second web service plug-in without the source data being stored on the management platform or on a cloud server. Therefore, the management platform according to the embodiment of the disclosure can keep the distribution status quo of multi-source heterogeneous data, and simple and efficient management of source data is realized.

The service providing method based on the video cloud according to the embodiment of the disclosure can also realize cooperative processing of the cloud end and the edge (called cloud edge cooperation), and can provide services even under severe network conditions or cloud server faults and the like (can be called as lossy conditions), namely support of lossy services. Specifically, as described in steps S330 and S350, the edge device may push the acquired video data to the cloud server and the edge server simultaneously, and may have both an algorithm service module and a rule engine module on the cloud server and the edge server. Fig. 7 shows a functional structural diagram of an example cloud and edge according to an embodiment of the present disclosure.

As shown in fig. 7, at the cloud, or more specifically, on the cloud server, a cloud video service module 711, a cloud algorithm service module 712, and a cloud rules engine module 713 may be included. It should be appreciated that the cloud server may be comprised of multiple servers that are physically separated, and that the cloud video service module 711, cloud algorithm service module 712, and cloud rules engine module 713 may also be distributed across different servers. In addition, a management platform 714 (as shown in fig. 7) may be further installed on the cloud server, or the management platform 714 may be implemented independently of the cloud server that provides the cloud video service module 711, the cloud algorithm service module 712, and the cloud rule engine module 713. The management platform 714 may be similar to the management platform described above with reference to fig. 5 and 6, and will not be described again here. Hereinafter, for simplicity of description, the management platform 714 is described separately from the cloud server, but this does not limit that the management platform 714 must be independent of the cloud server, but should include a scheme in which the management platform 714 may be independent of the cloud server or may be mounted on the cloud server.

The cloud video service module 711 may provide functions such as live video, video recording, etc. According to an example of an embodiment of the present disclosure, cloud algorithm service module 712 may perform: sample analysis, such as analysis processing of a large number of video frames in video data, as described in step S350 above; model training, for example, machine learning model training with massive video data as training sample data to provide models with different functions; model distribution, for example, distributing the trained models to other modules such as cloud rules engine module 713, edge algorithm service module 722, edge rules engine module 723, or the like, or edge servers, or the like; and provide an algorithm marketplace, i.e., various types of algorithm code modules may be provided to other modules, such as a cloud rules engine module 713, a side algorithm service module 722, a side rules engine module 723, or the like, or a side server, or the like. According to an example of the embodiment of the present disclosure, the cloud rule engine module 713 may logically analyze the result data obtained by the cloud algorithm service module 712, and generate a coordinated control command according to a predetermined logic rule, so as to provide a service corresponding to a service subscription request to a service request end associated with an application system, so as to implement coordinated control of an application system subscribed to the video cloud system, as described in step S350 above.

On the edge, or more specifically on the edge server, there may be an edge video service module 721, an edge algorithm service module 722, and an edge rules engine module 723, with edge devices such as a video gateway 724 also located on the edge. Similar to the cloud video service module 711, the edge video service module 721 can provide functions such as live video, video recording, etc. using video data acquired through the video gateway 724. The edge algorithm service module 722 may perform image processing, AI reasoning, etc. on the video data to obtain result data, as described in step S350 above and similar in part to the cloud algorithm service module. Similar to the cloud rule engine module 713, the edge rule engine module 723 may also perform logic analysis on the result data obtained by the edge algorithm service module 722 and generate a coordinated control command according to a predetermined logic rule for providing a service corresponding to a service subscription request to a service request end associated with an application system, so as to implement coordinated control of an application system subscribed to the video cloud system, as described in the above step S350.

Under the conditions that the application system cannot be stably connected to the cloud server or the cloud server fails and the like due to a severe network environment, the cloud server can not provide services for the application system subscribed to the video cloud system so as to effectively control the application system in a linkage manner. In this case, since the video cloud system according to the embodiment of the present disclosure is also provided with the algorithm service module and the rule engine module on the side server, it is possible to perform algorithm analysis and logic analysis on video data acquired through the video gateway on the side server side to generate a linkage control command, and then provide the linkage control command to the application system via, for example, a management platform (for example, in the case where the management platform is mounted on the side server) or other communication connection (for example, a communication connection established between the application system subscribed to the video cloud system and the side server) to realize linkage control of the application system subscribed to the video cloud system. That is, in the case where a cloud server is unavailable due to a bad network condition or a failure of the cloud server, the video cloud system according to the embodiment of the disclosure may provide services to an application system subscribed to the video cloud system through the edge server, that is, may support lossy services.

Various functional modules of the cloud end and the edge end of the video cloud system according to the embodiment of the present disclosure are shown in fig. 7, it should be noted that the functional modules shown in fig. 7 are merely examples, and the functional modules may be freely built and removed according to actual application scenarios and requirements, which is not particularly limited in the embodiment of the present disclosure.

In the traditional video monitoring field, video equipment such as a camera, an algorithm module and a control module are usually deployed in the same local area network, however, as mentioned above, such a closed system may cause a data islanding phenomenon, and there is often a need to import video data acquired in the local area network onto a public network for playing, which in turn causes higher bandwidth cost and potential safety hazard, and the video cloud-based service providing method according to the embodiment of the present disclosure effectively solves these problems. Specifically, as can be seen from the above description, the cloud end and the edge end can both include an algorithm service module and a rule engine module, and can both perform algorithm analysis on video data, generate a coordinated control command based on the result data of the algorithm analysis, and provide coordinated control services for an application system subscribed to the video cloud system, so that flexible cloud-edge coordination capability is realized.

Fig. 8 further illustrates an example cloud-edge collaboration services framework in accordance with an embodiment of the disclosure. As shown in fig. 8, the video gateway at the edge may push video data it obtains from video devices such as IPC, NVR, etc. to the video service module at the edge and/or cloud, and then provide to the algorithm service module and the rule engine module at the edge and/or cloud, respectively. According to examples of embodiments of the present disclosure, the edge algorithm service module or edge rule engine module may include at least a portion of an algorithm or rule in the cloud algorithm service module or rule engine module. In other words, the algorithm trained in the cloud algorithm service module or the cloud rule engine module or the rule for linkage control can be partially or completely deployed to the side, so that the video data can be analyzed and processed at the side, the linkage control service is provided for the associated application system, the cloud pressure is greatly reduced, and quick response can be ensured. Meanwhile, the cloud edge cooperative service framework enables services to be provided through the edge server even under the condition that the cloud server is unavailable due to severe network conditions or cloud server faults and the like, so that lossy services can be supported.

In addition, the cloud edge collaborative service framework according to the embodiment of the disclosure also has flexible edge routing capability. The side and the cloud end can flexibly communicate messages, i.e. have a message channel capable of carrying out data exchange, and the message channel is located between the cloud end server and the side server, or more specifically, as shown in fig. 8, can be located between a video gateway, a storage service module or a rule engine module on the side and the cloud video background. At the edge, video data obtained through the video gateway, live video data or video recording data obtained by the video service module, logic analysis processes and results obtained by the rule engine module and the like can be stored in the storage service module, and when the cloud end has a demand, the live video data or video recording data is further pushed to the cloud end server. For example, video data acquired by a video gateway of the side or video data stored by a storage service module of the side can be pushed to the cloud for playing through a message channel between the cloud and the side, so that the bandwidth cost of the side can be greatly reduced, the stability of a system is improved, potential safety hazards possibly brought by playing video data on a public network are avoided by cloud playing, and the safety and privacy of the video data are ensured.

In addition, such cloud-edge co-arrangement according to embodiments of the present disclosure can also provide firmware cloud-hosting and edge-distribution functionality. Fig. 9 illustrates a schematic diagram of example firmware hosting and distribution according to an embodiment of the present disclosure. As shown in fig. 9, the video cloud system according to embodiments of the present disclosure may further include a cloud firmware center, which may store and manage various application firmware versions, and may issue firmware or firmware updates to edge devices located at the edge.

Specifically, for example, the firmware may be uploaded or updated to the cloud firmware center through the management platform as described above with reference to fig. 5 and 6, for example, a user may perform a firmware upload operation through the management platform via a network interface such as WebService service plug-in, and may encrypt the upload process. On the other hand, the user may query the cloud firmware center on the management platform, and if the required firmware or firmware update is queried, the firmware or firmware update may be issued (e.g. downloaded) to the edge device through the management platform, and the result such as the installation status information may be reported to the management platform. Similarly, the down-feed or report process may also be performed via a network interface such as a WebService service plug-in. The firmware cloud hosting and distributing function according to the embodiment of the disclosure can rapidly achieve operations such as firmware updating, function iteration, vulnerability repairing and the like, and stability, flexibility and safety of the video cloud system according to the embodiment of the disclosure are further enhanced.

The video cloud-based service providing method according to the embodiment of the present disclosure further provides a security authentication method for a video cloud system, so as to ensure security when an edge device accesses a cloud server and data exchange is performed between the edge device and the cloud server. According to an example of an embodiment of the present disclosure, asymmetric encryption may be employed when a plurality of edge devices access a cloud server, and symmetric encryption may be employed when a plurality of edge devices exchange data with a cloud server.

Fig. 10 illustrates a security mechanism schematic of an example video cloud system according to an embodiment of the disclosure. As shown in fig. 10, an edge device such as a video gateway may access a cloud server through registration and login, and an asymmetric encryption technology, for example, an SM2 asymmetric encryption technology in a cryptographic algorithm, or any other asymmetric encryption technology may be adopted in the whole access process; after the access is successful, the edge device and the cloud server can use a symmetric encryption technology to exchange data, such as an SM4 symmetric key technology in a national encryption algorithm, or any other symmetric encryption technology. It should be noted that, although the video gateway and the cloud server are described herein by taking asymmetric encryption during the access process and symmetric encryption during the data exchange process as examples, the embodiments of the present disclosure are not limited thereto, and any other encryption technique may be used during the access process or the data exchange process. The following describes an example in which a video gateway is used as an edge device.

First, in the registration stage 1010, the video gateway may apply for a Serial Number (SN) on the video cloud open platform, and obtain a private key for the video gateway (i.e., a gateway private key), and a public key required when the video gateway accesses the cloud server (i.e., a cloud public key). Here, the video cloud open platform may be, for example, the management platform described above with reference to fig. 5 and 6, or other clients, web applications, etc. for providing video cloud services. Before sending a registration request to a cloud server, the video gateway firstly uses a gateway private key to sign self information such as equipment parameter information of the gateway, then uses a cloud public key to encrypt signature information, SN and other information, and sends the encrypted signature information, SN and the like to the cloud server together with the registration request. The cloud server can firstly analyze the encrypted signature information and the SN by adopting a cloud private key, and then analyze the signature information by adopting a gateway public key, so that the registration request is identified to be sent by the video gateway through the signature information, and the registration to the video gateway is carried out. The encryption process of the gateway private key and the cloud public key can ensure that the registration request of the video gateway can only be analyzed by the cloud server.

After the registration is successful, the cloud server may return a registration response to indicate that the video gateway registration was successful. Meanwhile, the cloud server can encrypt signaling channel information (such as a signaling channel domain name) between the cloud server and the video gateway through the gateway public key and then return the encrypted signaling channel information to the video gateway, and the video gateway can analyze the encrypted signaling channel information by adopting the gateway private key. The encryption process of the gateway public key and the gateway private key can ensure that the signaling channel information returned by the cloud server can only be analyzed by the video gateway.

Then, in a login phase 1020, the video gateway may log into the cloud server and negotiate a signaling channel symmetric key with the cloud server for data exchange. Specifically, the video gateway may first sign its own information such as device parameter information of the gateway using a gateway private key, then encrypt the signature information, the device unique identifier, and information such as a vector for generating a symmetric key using a cloud public key, and send the encrypted information to the cloud server together with the login request. The cloud server can firstly analyze the encrypted signature information, the unique device identifier, the symmetric key vector and the like by adopting a cloud private key, and then analyze the signature information by adopting a gateway public key, so that the login request is identified to be sent by the video gateway through the signature information. The encryption process can ensure that the login request of the video gateway can only be analyzed by the cloud server.

After the login is successful, the cloud server can return a login response to indicate that the video gateway is successful in login. Meanwhile, the cloud server can encrypt a symmetric key, a Token (Token), effective time and the like adopted by a signaling channel between the cloud server and the video gateway through a gateway public key and then return the encrypted symmetric key, token, effective time and the like to the video gateway. The video gateway can analyze the encrypted information by adopting a gateway private key, so as to obtain a symmetric key of a signaling channel, token, effective time and the like. The Token may be used for identity authentication of the video gateway accessing the cloud server, so that frequent login operation is not required, and the valid time may include valid time of the Token or valid time of the symmetric key, and the like. The encryption process of the gateway public key and the gateway private key can ensure that the symmetric key, token, effective time and the like returned by the cloud server can only be analyzed by the video gateway.

After registration and login are completed, in data exchange stage 1030, the video gateway may use the symmetric key obtained in login stage 1020 to perform operations such as data reporting, video data pushing, and video equipment maintenance. For example, after the video gateway obtains the video data collected by the video device, the video gateway may encrypt the video data with a symmetric key and then transmit the encrypted video data to the cloud server, and the cloud server may analyze the received video data with the symmetric key. On the other hand, the cloud server may also perform operations such as data issuing by using the symmetric key, for example, the cloud server may send a control message encrypted by using the symmetric key to the video gateway, and then the video gateway may analyze the received control message by using the symmetric key and execute corresponding control processing. In addition, as described above, there may be a valid time for the symmetric key, token, etc. between the video gateway and the cloud server, and if the valid time is exceeded, the current symmetric key and Token cannot be reused, and need to be obtained by logging in to the cloud server again, so as to ensure the security of data exchange.

According to the security authentication method of the embodiment of the disclosure, security of the edge device when the edge device is accessed to the cloud server and data exchange is performed between the edge device and the cloud server can be ensured, so that security of the service providing method based on the video cloud according to the embodiment of the disclosure is further improved.

By using the service providing method based on the video cloud, which is disclosed by the embodiment of the invention, the data sharing among devices in the video cloud system can be realized, and the application system subscribed to the video cloud system can be subjected to association control; the management platform is used for uniformly managing and scheduling a plurality of video devices and a plurality of edge devices in the video cloud system, uniformly maintaining and managing data of the video devices and the edge devices, and providing one-stop data access service; in addition, through the arrangement of the functional modules of the cloud end and the side end, efficient cloud-edge coordination can be realized, lossy services under the conditions of severe network environment or cloud server faults and the like are supported, and firmware cloud hosting and distribution can be provided through a cloud firmware center; in addition, the security of the edge equipment accessing the cloud server and the security of the edge equipment exchanging data with the cloud server are ensured by setting a perfect security mechanism.

A video cloud system according to an embodiment of the present disclosure is described below with reference to fig. 11. Fig. 11 shows a schematic structural diagram of a video cloud system 1100 according to an embodiment of the present disclosure. As shown in fig. 11, the video cloud system may include a plurality of video devices 1110, a plurality of edge devices 1120, a cloud server 1130, and/or a side server 1140, and optionally a management platform 1150. In addition to these 5 units, the video cloud system 1100 may include other components, however, since these components are not related to the contents of the embodiments of the present disclosure, illustration and description thereof are omitted herein.

The plurality of video devices 1110 are configured to collect video data. The video device may be the IPC, NVR or other video device with video capturing function, which is not particularly limited by the embodiments of the present disclosure. The plurality of video devices may be in different geographic locations and may be associated with different edge devices, e.g., may be directly connected to the edge devices, or may be associated with different edge devices through protocols such as ONVIF or SDK, etc.

The plurality of edge devices 1120 are configured to acquire the acquired video data from the plurality of video devices 1110. Here, the edge device may refer to a device located near a data source such as a video device, for example, a video gateway or any other edge device, etc., to which the embodiments of the present disclosure are not limited in particular. As described above, a plurality of edge devices and a plurality of video devices may be connected using a unified protocol such as one vif or SDK, and in the present disclosure, one edge device may be connected to one or more video devices, and one video device may be connected to a plurality of edge devices at the same time, which is not particularly limited by the embodiments of the present disclosure. Each of the plurality of edge devices may manage a video device associated therewith, e.g., may manage configuration information, log information, etc. of the video device associated therewith, and may report events related to the video device, the edge device, or both.

The video cloud system 1100 includes a cloud server 1130, where the cloud server 1130 may be an independent physical server, or may be a server cluster or a distributed system formed by a plurality of physical servers, and in this disclosure, the cloud server 1130 may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, and basic cloud computing services such as big data and artificial intelligence platforms. In this disclosure, the side on which the edge device is located is referred to as a side, and in addition to the cloud server 1130, the video cloud system 1100 may further include a server located at the side, referred to as a side server or a local server 1140. One or more edge servers 1140 may be arranged, one or more edge servers 1140 may be associated with a plurality of edge devices 1120, for example, may be communicatively connected, either wired or wireless, to a plurality of edge devices 1120. In one example, edge device 1120 itself may also be used as a side-end server. In general, the edge server 1140, the plurality of edge devices 1120, and the plurality of video devices 1110 may be located in the same local area network, but the embodiments of the present disclosure are not limited thereto, and the edge server 1140, the plurality of edge devices 1120, and the plurality of video devices 1110 may be located in different local area networks, respectively, or in other network environments.

The plurality of edge devices 1120 may push video data acquired from the video device 1110 to only the cloud server 1130, or to only the edge server 1140, or may push to both the cloud server 1130 and the edge server 1140 at the same time to enable video services or other services to be provided at both the cloud and edge as will be described in detail below.

Optionally, video cloud system 1100 according to embodiments of the present disclosure may also include management platform 1150. For example, service subscription requests may be received from service requests via management platform 1150. The service request end may be, for example, a client associated with an application system or a web application, where the application system may refer to, for example, an intelligent home system such as a lighting system, an elevator system, an air conditioning system, an audio-visual system, a household appliance, or an intelligent security system such as an access control system, a monitoring system, an anti-theft system, or may also be a video device such as NVR and IPC, or any other application system that may utilize video cloud for linkage and control, which is not specifically limited by the embodiments of the disclosure. In the embodiment of the disclosure, an application system desiring to acquire cloud services of a video cloud system may send a service subscription request to the video cloud system through a service request end thereof, where the service subscription request is used for subscribing to services related to video data acquired by each video device.

In video cloud system 1100 of embodiments of the present disclosure, a communication connection may be established between a service request end and cloud server 1130 and/or edge server 1140 through management platform 1150. The management interface of management platform 1150 may be provided, for example, in the form of a web application or client, and may be hosted on cloud server 1130 and/or on edge server 1140, or may exist independently of cloud server 1130 and edge server 1140. For example, cloud server 1130 and/or edge server 1140 may receive a service subscription request from a service requestor through management platform 1150 and establish a communication connection with the service requestor in response to the service subscription request such that the service requestor may subscribe to video cloud system 1100, or in other words such that the service requestor may exist as an application of video cloud system 1100, thereby enabling use of services provided by video cloud system 1100. Management platform 1150 provided by embodiments of the present disclosure may have many more functions, as will be described in further detail below.

The cloud server 1130 and/or the edge server 1140 may analyze the video data after receiving the video data provided by the edge device 1120, generate a service corresponding to the service subscription request based on the result data of the analysis, and provide the service corresponding to the service subscription request to the service requester, for example, for controlling an application system associated with the service requester in a coordinated manner. According to an example of an embodiment of the present disclosure, the cloud server 1130 and/or the edge server 1140 may include an algorithm service module and a rule engine module, where the algorithm service module is configured to analyze video data to obtain result data, and upload the result data to the rule engine module; the rules engine module is configured to generate a coordinated control command for providing a service corresponding to the service subscription request based on the received result data.

In order to provide corresponding services to application systems subscribed to the video cloud system 1100, such as an access control system, a lighting system, an air conditioning system, a monitoring system, and the like, the edge device 1120 acquires video data from the video device 1110, such as IPC, NVR, and the like. Video device 1110 may be an application-built-in video device, such as an application-built-in camera, or may be any other video device in video cloud system 1100. The edge device 1120 pushes the video data to the cloud server 1130 to provide to the video service module for live video or video recording.

The video service module of the video cloud system 1100 may provide video data acquired in real time for live video or historical video data recorded by video recordings to an algorithm service module for analysis processing. For example, the algorithm service module may utilize image processing or Artificial Intelligence (AI) reasoning based on deep learning or the like to analyze the video data, such as frame-by-frame analysis of the video data, or extraction of key frames in the video data for analysis, or the like. And the algorithm service module uploads the result data obtained by analysis to the rule engine module. The rule engine module can logically analyze the received result data, and generate linkage control commands according to a preset logic rule, for example, linkage control commands for controlling a gate of an access control system, a lamp switch of a lighting system, and the like, so as to perform linkage control on the application system. In one example, when a video device 1110 such as IPC, NVR, etc. subscribes itself to the video cloud system 1100, the rules engine module may also generate coordinated control commands to the video device 1110, e.g., to control camera opening, closing, changing direction, etc.

As can be seen from the above description, in the embodiments of the present disclosure, the application system does not need to have a video device, but can operate the application system by subscribing to the video cloud system 1100 according to the embodiments of the present disclosure, using video data acquired by any other video device in the video cloud system 1100, so as to realize data sharing in the video cloud system, and break the data islanding phenomenon of the conventional video analysis system. Most of traditional video analysis systems adopt a vertical architecture, are independently constructed based on specific project customization requirements, have low openness, and cannot share data with other systems, so that the data island phenomenon is caused. Taking the face recognition access control system as an example, the existing access control system is usually an independent system, the whole access control system is required to be operated by a camera, a face recognition algorithm and a corresponding control module, and meanwhile, data generated by the access control system can only be used in the system and cannot be shared with other systems.

In the embodiment of the disclosure, the data islanding phenomenon is solved. For example, the access control system of the video cloud system 1100 according to the embodiments of the present disclosure may subscribe to the service of the video cloud system 1100 even without a video device such as a camera, and the video cloud system 1100 may generate a coordinated control command for the access control system by using video data collected by other video devices in the system, so as to control a gate of the access control system; alternatively, in another aspect, an access control system with video devices such as cameras may share video data collected by the video cloud system for use by other application systems within the video cloud system, such as an elevator system, lighting system, and the like.

Therefore, the video cloud system 1100 according to the embodiment of the present disclosure overcomes the data islanding phenomenon existing in the conventional system, and can implement multi-system linkage in the video cloud system 1100. Meanwhile, since the application system subscribing to the service of the video cloud system 1100 or the associated application thereof exists as an application of the video cloud system, data leakage can be avoided, and data security is ensured. Moreover, once the video cloud system 1100 according to the embodiment of the present disclosure generates the result data based on the video data acquired from any video device, the result data may be reported to the rule engine in real time, so as to quickly generate and distribute the coordinated control commands for different application systems, thereby implementing quick control over different application systems.

Furthermore, 1100 in accordance with embodiments of the present disclosure enables compatibility with different types of video devices. In practical applications, video devices in a video cloud system often come from different vendors, and thus may have different message types, different message encoding structures, and so on, so that unified access and management for each video device is difficult. The video cloud system according to the embodiment of the disclosure provides a universal video device access model, and can unify the standards of messages from different types of video devices. For example, messages from different types of video devices may be unified according to a standard message format as shown in table 1 above. In table 1, examples of variables included in the standard message format are listed, and variable types such as String type, integer type (intelger), long type (Long) and the like are defined for these variables, respectively. For example, the device unique identifier wId may be a character string type, the message sequence number variable Seq may be a long integer type, the Random number variable Random may be an integer type, or the like.

By standardizing the messages from different types of video devices using, for example, the standard message formats shown in table 1, the messages can be interconnected and shared with different types of video devices, so that the compatibility of different types of video devices is realized, and in the video cloud system 1100 of the embodiment of the disclosure, the message interface from the bottom layer (for example, the layer where the video device is located, as shown in fig. 2) to the upper layer (for example, the middle layer where the edge device is located or the top layer where the cloud server is located, as shown in fig. 2) is unified and transparent, so that the efficiency of message communication between different devices in the video cloud system is improved.

In addition, management platform 1150 of video cloud system 1100 according to embodiments of the present disclosure may also enable unified management and scheduling of multiple video devices and multiple edge devices within the video cloud system. Since the function of the management platform 1150 is similar to the details of the management platform described above with reference to fig. 5 and 6, a repetitive description of a part of the contents is omitted hereinafter for simplicity.

As described above, management platform 1150 may be provided in the form of, for example, a web application or client, and may be hosted on cloud server 1130. Typically, video devices 1110 such as NVR, IPC, etc. are located within a local area network, access to the video cloud system 1100 is required through associated edge devices 1120 such as video gateways, and the video devices 1110 and edge devices 1120 within the video cloud system 1100 often come from different systems associated with the video cloud system (e.g., different application systems subscribed to the video cloud system, etc., hereinafter referred to as associated systems), and different edge devices within different associated systems may interface with different video traffic, such as video surveillance, face recognition access control, etc.

In addition, according to examples of embodiments of the present disclosure, operations such as querying, modifying, adding, deleting, etc., of device parameter data, status information, relationship information, etc., of a plurality of video devices and a plurality of edge devices may be performed through the management platform 1150. For example, a certain video device or an edge device may be added or deleted from the video cloud system 1100 through the management platform 1150, current state information or relationship information of the certain video device or the edge device may be queried, device parameter data of the certain video device or the edge device may be acquired, and so on. Therefore, unified scheduling management of a plurality of video devices and edge devices in the video cloud system can be achieved through the management platform.

In addition, the management platform 1150 according to the embodiments of the present disclosure may also uniformly maintain and manage data of video devices and edge devices, providing a one-stop data access service. Here, the data of the video device and the edge device includes its device parameter data, video data stored thereon, and the like, which may be collectively referred to herein as source data of the management platform. Wherein the device parameter data may include, for example, one or more of a device name, a device number, a device type, a device port, a device network Interconnect Protocol (IP) address, a device manufacturer, a device geographic location, and the like; the video data is collected by the video device and may be stored on the video device or transmitted to an edge device associated with the video device for storage.

The management platform 1150 according to the embodiments of the present disclosure can effectively integrate multi-source heterogeneous source data and provide a unified data access service with less modification to the associated system from which the source data is derived. A business system or any other user may browse, query, access logically integrated source data from multiple video devices and edge devices, such as device parameter data and video data stored thereon, and the like, via a management platform. Furthermore, the management platform according to embodiments of the present disclosure does not require that the source data be physically centralized, i.e., it is not necessary that the source data must be collectively stored on the management platform or a cloud server associated with the management platform. For example, when the service system makes a request, the management platform may extract the source data through an interface such as the first network service plug-in, and after logically integrating the source data, the source data is provided to the service system through an interface such as the second network service plug-in, without the need for the source data to be stored on the management platform or the cloud server. Thus, the management platform 1150 according to the embodiments of the present disclosure can maintain the distribution status quo of multi-source heterogeneous data, and achieve simple and efficient management of source data.

The video cloud system 1100 according to the embodiment of the present disclosure may also implement a cooperative process of the cloud and the edge (referred to as cloud edge cooperation), and may provide services, that is, support lossy services, even in the case of a severe network condition or a failure of a cloud server. Specifically, as described above, the edge device 1110 may push the acquired video data to both the cloud server 1130 and the edge server 1140, and may have both an algorithm service module and a rules engine module on the cloud server 1130 and the edge server 1140, as described above in detail with reference to fig. 7.

In the traditional video monitoring field, video devices such as cameras, algorithm modules and control modules are typically deployed in the same local area network, however, as mentioned above, such a closed system may cause a data islanding phenomenon, and there is often a need to import video data acquired in the local area network onto a public network for playing, which in turn results in higher bandwidth costs and potential safety hazards, and the video cloud system 1100 according to the embodiment of the disclosure effectively solves these problems. Specifically, as can be seen from the above description, the cloud end and the edge end can both include an algorithm service module and a rule engine module, and can both perform algorithm analysis on the video data, and generate a coordinated control command based on the result data of the algorithm analysis, so as to provide coordinated control service for the application system subscribed to the video cloud system 1100, which realizes flexible cloud-edge coordination capability.

As described in detail above with reference to fig. 8, the video gateway at the headend may push video data it obtains from video devices such as IPC, NVR, etc. to the video service module at the headend and/or the cloud and then provide to the algorithm service module and the rules engine module at the headend and/or the cloud, respectively. According to examples of embodiments of the present disclosure, the edge algorithm service module or edge rule engine module may include at least a portion of an algorithm or rule in the cloud algorithm service module or rule engine module. In other words, the algorithm trained in the cloud algorithm service module or the cloud rule engine module or the rule for linkage control can be partially or completely deployed to the side, so that the video data can be analyzed and processed at the side, the linkage control service is provided for the associated application system, the cloud pressure is greatly reduced, and quick response can be ensured. Meanwhile, the cloud edge cooperative service framework enables services to be provided through the edge server even under the condition that the cloud server is unavailable due to severe network conditions or cloud server faults and the like, so that lossy services can be supported.

In addition, such cloud-edge co-arrangement according to embodiments of the present disclosure can also provide firmware cloud hosting and edge distribution functionality, as described in detail above with reference to fig. 9, video cloud system 1100 according to embodiments of the present disclosure can also include a cloud firmware center that can store and manage various application firmware versions, and can issue firmware or firmware updates to edge devices located at the edges.

Specifically, for example, firmware may be uploaded or updated to a cloud firmware center through management platform 1150, for example, a user may perform a firmware upload operation through the management platform via a network interface such as WebService service plug-in, and may encrypt the upload process. On the other hand, a user may query the cloud firmware center on the management platform 1150, and if a desired firmware or firmware update is queried, the firmware or firmware update may be issued (e.g., downloaded) to the edge device 1120 through the management platform 1150, and the results, such as installation status information, may be reported to the management platform 1150. Similarly, the down-feed or report process may also be performed via a network interface such as a WebService service plug-in. The firmware cloud hosting and distribution function according to the embodiment of the present disclosure can quickly implement operations such as firmware update, function iteration, bug fix, and the like, so that stability, flexibility, and security of the video cloud system 1100 according to the embodiment of the present disclosure are further enhanced.

The video cloud system according to the embodiments of the present disclosure further has a security module to ensure security when the edge device 1120 accesses the cloud server 1130 and when the edge device 1120 exchanges data with the cloud server 1130. According to an example of an embodiment of the present disclosure, the security module is configured to employ asymmetric encryption when a plurality of edge devices access the cloud server and symmetric encryption when the plurality of edge devices exchange data with the cloud server, as described in detail above with reference to fig. 10. The security module for the video cloud system 1100 according to the example of the embodiment of the present disclosure can ensure security when the edge device accesses the cloud server and performs data exchange with the cloud server, so as to further improve security of the service providing method based on the video cloud according to the embodiment of the present disclosure.

By utilizing the video cloud system according to the embodiment of the disclosure, data sharing among devices in the video cloud system can be realized, and the application system subscribed to the video cloud system is subjected to association control; the management platform is used for uniformly managing and scheduling a plurality of video devices and a plurality of edge devices in the video cloud system, uniformly maintaining and managing data of the video devices and the edge devices, and providing one-stop data access service; in addition, through the arrangement of the functional modules of the cloud end and the side end, efficient cloud-edge coordination can be realized, lossy services under the conditions of severe network environment or cloud server faults and the like are supported, and firmware cloud hosting and distribution can be provided through a cloud firmware center; in addition, the security of the edge equipment accessing the cloud server and the security of the edge equipment exchanging data with the cloud server are ensured by setting a perfect security mechanism.

Further, devices (e.g., video cloud-based service providing devices, etc.) according to embodiments of the present disclosure may also be implemented by way of the architecture of the exemplary computing device shown in fig. 12. Fig. 12 shows a schematic diagram of an architecture of an exemplary computing device, according to an embodiment of the present disclosure. As shown in fig. 12, computing device 1200 may include a bus 1210, one or more CPUs 1220, a Read Only Memory (ROM) 1230, a Random Access Memory (RAM) 1240, a communication port 1250 connected to a network, an input/output component 1260, a hard disk 1270, and the like. A storage device in computing device 1200, such as ROM 1230 or hard disk 1270, may store various data or files for computer processing and/or communication and program instructions for execution by the CPU. Computing device 1200 may also include a user interface 1280. Of course, the architecture shown in FIG. 12 is merely exemplary, and one or more components of the computing device shown in FIG. 12 may be omitted as may be practical in implementing different devices.

Embodiments of the present disclosure may also be implemented as a computer-readable storage medium. Computer readable storage media according to embodiments of the present disclosure have computer readable instructions stored thereon. The video cloud-based service providing method according to the embodiments of the present disclosure described with reference to the above drawings may be performed when computer readable instructions are executed by a processor. Computer-readable storage media include, but are not limited to, volatile memory and/or nonvolatile memory, for example. Volatile memory can include, for example, random Access Memory (RAM) and/or cache memory (cache) and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like.

According to an embodiment of the present disclosure, there is also provided a computer program product or a computer program comprising computer readable instructions stored in a computer readable storage medium. The processor of the computer device may read the computer-readable instructions from the computer-readable storage medium, and execute the computer-readable instructions, so that the computer device performs the video cloud-based service providing method described in the above embodiments.

Those skilled in the art will appreciate that various modifications and improvements can be made to the disclosure. For example, the various devices or components described above may be implemented in hardware, or may be implemented in software, firmware, or a combination of some or all of the three.

Furthermore, as shown in the present disclosure and claims, unless the context clearly indicates otherwise, the words "a," "an," "the," and/or "the" are not specific to the singular, but may include the plural. The terms "first," "second," and the like, as used in this disclosure, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. Likewise, the word "comprising" or "comprises", and the like, means that elements or items preceding the word are included in the element or item listed after the word and equivalents thereof, but does not exclude other elements or items. The terms "connected" or "connected," and the like, are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

Further, a flowchart is used in this disclosure to describe the operations performed by the system according to embodiments of the present disclosure. It should be understood that the preceding or following operations are not necessarily performed in order precisely. Rather, the various steps may be processed in reverse order or simultaneously. Also, other operations may be added to the processes or a step or steps may be removed from the processes.

Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

While the present disclosure has been described in detail above, it will be apparent to those skilled in the art that the present disclosure is not limited to the embodiments described in the present specification. The present disclosure may be embodied as modifications and variations without departing from the spirit and scope of the disclosure, which is defined by the appended claims. Accordingly, the description herein is for the purpose of illustration and is not intended to be in any limiting sense with respect to the present disclosure.

Claims

1. A video cloud-based service providing method, comprising:

collecting video data by a plurality of video devices, the plurality of video devices being located at different locations and associated with different edge devices;

receiving the video data through a plurality of edge devices, wherein the plurality of edge devices are connected with the plurality of video devices by adopting a unified protocol, and respectively managing the video devices associated with the plurality of edge devices;

providing, by the plurality of edge devices, the video data to a cloud server and/or a side server associated with the plurality of edge devices;

receiving a service subscription request sent from a service request end through a management platform, wherein the service subscription request is used for subscribing to a service related to the video data, and the service request end comprises a client end or a webpage application associated with an application system desiring to acquire cloud services of the video cloud;

receiving, by the management platform, device parameter data and video data of the plurality of video devices and the plurality of edge devices via a web service plug-in; extracting metadata from the device parameter data and the video data, and selecting field information from the metadata to generate a code block; packaging the code blocks to generate logically integrated device parameter data and video data;

The device parameter data and the video data which are logically integrated are issued through the management platform so as to provide unified data access service;

generating, by the cloud server and/or the edge server, a coordinated control command based on result data of analysis processing of video data from other video devices in a case where the application system does not include a video device, for providing a service corresponding to the service subscription request, thereby performing coordinated control on the application system, and enabling the cloud server and/or the edge server to have, in a case where the application system includes a video device, the ability to perform analysis processing of video data from the video device of the application system, for generating another coordinated control command, thereby performing coordinated control on another application system, wherein the edge server includes at least a part of algorithms or rules in the cloud server for performing analysis processing on the video data and generating algorithms or rules of the service, such that in a case where the server is not available, services are provided by the edge server; and

providing a service corresponding to the service subscription request to the service requesting end,

Wherein the method further comprises:

the plurality of edge devices acquire private keys for the plurality of edge devices and public keys required for accessing the cloud server from the cloud server;

the plurality of edge devices register and log in to the cloud server by utilizing the private key and the public key, and acquire a symmetric key for data exchange from the cloud server; and

and carrying out symmetric encryption when the plurality of edge devices exchange data with the cloud server.

2. The service providing method according to claim 1,

wherein the device parameter data includes one or more of a device name, a device number, a device type, a device port, a device Internet Protocol (IP) address, a device manufacturer, and a device geographic location.

3. The service providing method according to claim 1, further comprising:

receiving and managing status information and relationship information of the plurality of video devices and the plurality of edge devices through the management platform _，

Wherein the state information indicates current states of the plurality of video devices and the plurality of edge devices, and the relationship information indicates binding relationships between the plurality of video devices and the plurality of edge devices, and between the plurality of edge devices and video traffic.

4. The service providing method according to claim 1, further comprising: and querying, modifying, adding and deleting one or more operations of the device parameter data, the video data, the state information and the relation information of the plurality of video devices and the plurality of edge devices through the management platform.

5. The service providing method according to claim 1, wherein the cloud server and the edge server include an algorithm service module and a rule engine module, and wherein analyzing the video data and generating a service corresponding to the service subscription request based on result data of the analyzing includes:

analyzing the video data by using the algorithm service module to obtain result data, and uploading the result data to the rule engine module; and

and generating a coordinated control command based on the result data by using the rule engine module, wherein the coordinated control command is used for providing services corresponding to the service subscription request.

6. The service providing method according to claim 5, wherein,

the edge server includes at least a portion of algorithms or rules in an algorithm service module or rules engine module in the cloud server.

7. The service providing method according to claim 1, further comprising:

uploading firmware or updating the firmware to a cloud firmware center through a management platform; and/or

And issuing firmware or firmware update to the plurality of edge devices through the management platform.

8. The service providing method of claim 1, wherein the edge device is a video gateway and the service request terminal is a client or web application associated with at least one of an access control system, an anti-theft system, a lighting system, an elevator system, an air conditioning system.

9. A video cloud system, comprising:

a plurality of video devices configured to collect video data, the plurality of video devices being located at different locations and associated with different edge devices;

a plurality of edge devices configured to acquire the video data from the video devices, the plurality of edge devices and the plurality of video devices being connected by a unified protocol, and respectively managing the video devices associated therewith; and

a cloud server and at least one edge server associated with the plurality of edge devices, configured to receive the video data from the plurality of edge devices and to receive a service subscription request from a service request end, wherein the service subscription request is for subscribing to a service related to the video data, the service request end comprises a client or a web application associated with an application system desiring to acquire cloud services of the video cloud system,

A management platform configured to: receiving the service subscription request sent from the service request end; receiving device parameter data and video data of the plurality of video devices and the plurality of edge devices via a web service plug-in, extracting metadata from the device parameter data and the video data, selecting field information from the metadata to generate code blocks, and packaging the code blocks to generate logically integrated device parameter data and video data; and distributing the logically integrated device parameter data and video data to provide a unified data access service;

wherein the cloud server and/or the edge server are/is further configured to generate, in a case where the application system does not include a video device, a coordinated control command based on result data of analysis processing of video data from other video devices for providing a service corresponding to the service subscription request, thereby performing coordinated control on the application system, and to have, in a case where the application system includes a video device, the capability of performing analysis processing of video data acquired from a video device of the application system for generating another coordinated control command, thereby performing coordinated control on another application system, wherein the edge server includes at least a part of an algorithm or rule in the cloud server for performing analysis processing of the video data and generating the service, such that in a case where the cloud server is not available, a service is provided by the edge server,

The cloud server is used for acquiring private keys for the plurality of edge devices and public keys required by accessing the cloud server;

10. The video cloud system of claim 9,

11. A video cloud-based service providing apparatus, comprising:

one or more processors; and

one or more memories having stored therein computer readable code which, when executed by the one or more processors, causes the one or more processors to perform the method of any of claims 1 to 8.

12. A computer readable storage medium comprising computer readable instructions which, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 8.