CN112468832A - Billion-level pixel panoramic video live broadcast method, device, medium and equipment - Google Patents

Billion-level pixel panoramic video live broadcast method, device, medium and equipment Download PDF

Info

Publication number
CN112468832A
CN112468832A CN202011140082.1A CN202011140082A CN112468832A CN 112468832 A CN112468832 A CN 112468832A CN 202011140082 A CN202011140082 A CN 202011140082A CN 112468832 A CN112468832 A CN 112468832A
Authority
CN
China
Prior art keywords
image
client
request
video stream
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011140082.1A
Other languages
Chinese (zh)
Inventor
温建伟
袁潮
方璐
季梦奇
王丹
赵月峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Zhuohe Technology Co ltd
Original Assignee
Beijing Zhuohe Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhuohe Technology Co Ltd filed Critical Beijing Zhuohe Technology Co Ltd
Priority to CN202011140082.1A priority Critical patent/CN112468832A/en
Publication of CN112468832A publication Critical patent/CN112468832A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics

Abstract

The invention provides a billion-level pixel panoramic video live broadcast method, a device, a medium and equipment, wherein the billion-level pixel panoramic video live broadcast method comprises the following steps: acquiring a plurality of hundred million pixel image groups of different visual angles through a plurality of camera arrays, wherein the hundred million pixel image groups comprise a wide visual field image and a narrow visual field image; splicing wide view field images in the hundred million-level pixel image groups into a panoramic video image; generating a virtual 3D model based on the panoramic video image; transmitting the virtual 3D model to a client; receiving a request of a client, wherein the request comprises an angle and an area selected by the client in the 3D model; and sending the video stream corresponding to the request to the client. The method provided by the invention can realize online interactive live broadcast of more than one billion-level pixel videos, support the rotation of the visual angle of the image to observe scenes at different angles, and also can zoom the image being watched and keep high definition resolution.

Description

Billion-level pixel panoramic video live broadcast method, device, medium and equipment
Technical Field
The invention relates to the field of images, in particular to a billion-level panoramic video live broadcast method, device, medium and equipment.
Background
With the rise of network live broadcast, the live broadcast requirement for dynamic large scenes is increasingly enhanced. For example, for some important engineering construction, people usually want to watch the whole engineering construction process by monitoring video cloud monitoring workers, and people can know the engineering construction process by watching a real-time live broadcast mode at home; for example, in the real estate industry, people buy new houses in advance and want to know building construction or decoration conditions. However, the existing surveillance video shooting is carried out through a low-resolution camera with a fixed visual angle, people can only see the general appearance of a building, and some details or specific visual angles cannot be freely observed. The method is limited by the video imaging quality of the existing camera, the method is difficult to achieve the aim that high-definition details and a wide view field are combined for a building with a dynamic large scene on a spatial scale, the 'cloud live broadcast' cannot amplify a part to see the high-definition details, and the narrow view field causes that a desired specific view angle cannot be observed at will, so that a certain observation shielding dead angle is generated; on a time scale, due to the limitation of imaging delay and corresponding imaging frame rate, real-time live video cannot deliver dynamic large-scene billion-pixel-level high-definition data streams. The present live video is mostly the rough outline of distant view or the clear local of close-range, consequently, in high definition control or the live field of panoramic imaging, how can let people can freely enlarge the scene detail in the live video and still keep high-definition and how freely rotate the different angles that the picture looked over the stereoscopic scene become the problem that the live video field is waited for to solve.
Disclosure of Invention
In order to solve the above-described problems, the present invention provides a billion-level pixel panoramic video live broadcasting method, apparatus, medium, and device, including:
according to a first aspect herein, there is provided a billion-level pixel panoramic video live method comprising:
acquiring a plurality of hundred million pixel image groups of different visual angles through a plurality of camera arrays, wherein the hundred million pixel image groups comprise a wide visual field image and a narrow visual field image;
splicing wide view field images in the hundred million-level pixel image groups into a panoramic video image;
generating a virtual 3D model based on the panoramic video image;
transmitting the virtual 3D model to a client;
receiving a request of a client, wherein the request comprises an angle and an area selected by the client in the 3D model;
and sending the video stream corresponding to the request to the client.
The billion-level pixel panoramic video live broadcast method further comprises the following steps:
mapping the wide field of view image and narrow field of view image to the 3D model;
the billion-level pixel panoramic video live broadcast method further comprises the following steps:
detecting the similarity between continuous frames of a video stream in a Structural Similarity Index (SSIM) mode, wherein when the similarity is greater than a threshold value, the video stream is a reusable video stream;
the reusable video stream is stored in a database of the multi-level server.
The billion-level pixel panoramic video live broadcast method further comprises the following steps:
inquiring the database to determine whether a reusable video corresponding to the request exists;
the sending of the video stream corresponding to the request to the client comprises the steps of sending the reusable video stream to the client when the reusable video stream corresponding to the request exists, and splicing and cutting a plurality of wide view field images or a plurality of narrow view field images corresponding to the request when the reusable video stream corresponding to the request does not exist, so as to generate a video stream and send the video stream to the client.
The splicing and cutting of the multiple wide view field images or the multiple narrow view field images corresponding to the request, generation of a video stream and sending of the video stream to the client side comprises the following steps:
determining an image corresponding to the request according to the mapping relation between the wide view field image and the narrow view field image and the 3D model;
determining the corresponding image to be a wide view field image or a narrow view field image according to the requested video resolution;
splicing the wide view field image or the narrow view field image;
according to the requested area, cutting the spliced image;
and generating a video stream based on the cut image, and sending the video stream to the client.
According to another aspect herein, there is provided a billion-level pixel panoramic video live device comprising:
the image acquisition module is used for acquiring a plurality of hundred million pixel image groups with different visual angles through a plurality of camera arrays, wherein the hundred million pixel image groups comprise wide visual field images and narrow visual field images;
the image splicing module is used for splicing wide view field images in the hundred million-level pixel image groups into a panoramic video image;
a 3D model generation module for generating a virtual 3D model based on the panoramic video image;
a transmission module for transmitting the virtual 3D model to a client;
the request receiving module is used for receiving a request of a client, wherein the request comprises an angle and an area selected by the client on the 3D model;
and the live broadcast module is used for sending the graphics or video stream corresponding to the request to the client.
The 3D model generation module is further configured to map the wide field of view image and the narrow field of view image to the 3D model.
Billion-level pixel panoramic video live broadcast device, still include:
the multiplexing module is used for detecting the similarity between the continuous frames of the video stream in a Structural Similarity Index (SSIM) mode, and when the similarity is larger than a threshold value, the video is a reusable video;
and the storage module is used for storing the reusable video in a database of the multi-level server.
According to another aspect herein, there is provided a computer readable storage medium having stored thereon a computer program which, when executed, implements the steps of a billion-order pixel panoramic video live method.
According to another aspect herein, there is provided a computer apparatus comprising a processor, a memory and a computer program stored on the memory, the processor when executing the computer program implementing the steps of a billion-level pixel panoramic video live method.
The method can realize online interactive live broadcast of more than one billion-level pixel videos, support the rotation of the visual angle of the image to observe scenes at different angles, and also can zoom the image being watched and keep high-definition resolution.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention. In the drawings, like reference numerals are used to indicate like elements. The drawings in the following description are directed to some, but not all embodiments of the invention. For a person skilled in the art, other figures can be derived from these figures without inventive effort.
FIG. 1 is a flow diagram illustrating a billion-level pixel panoramic video live method in accordance with one illustrative embodiment.
FIG. 2 is a block diagram illustrating a billion-level pixel panoramic video live device in accordance with one illustrative embodiment.
FIG. 3 is a block diagram illustrating a billion-level pixel panoramic video live device in accordance with one illustrative embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
In the conventional technology, the resolution of live video is usually 1080P or 4K, and good resolution cannot be provided for watching pictures in a large scene. The camera needs to shoot at a far position in order to observe the whole appearance of a large scene, so that the shot image can only see the approximate outline of an object, and if some local detail is required to be enlarged, information is lost, and the picture is blurred.
In the prior art, live broadcasting is divided into two modes, namely a single-lens single-view picture and a multi-lens multi-angle picture. A single lens can only see one specific angle, resulting in other angles not being visible. And the live broadcast picture is a plurality of split pictures with a plurality of lenses and a plurality of angles.
In order to conduct high-definition video live broadcast of a large scene, a billion-level pixel panoramic video live broadcast method is provided.
FIG. 1 is a flow diagram illustrating a billion-level pixel panoramic video live method in accordance with one embodiment. Referring to fig. 1, a giga-level pixel panoramic video live broadcasting method includes:
step S11, acquiring, by a plurality of camera arrays, a plurality of hundred million pixel image groups of different viewing angles, where the hundred million pixel image groups include a wide view field image and a narrow view field image.
And step S12, splicing the wide-field images in the multi-hundred million-level pixel image group into a panoramic video image.
Step S13, generating a virtual 3D model based on the panoramic video image.
Step S14, transmitting the virtual 3D model to a client.
And step S14, receiving a request of a client, wherein the request comprises an angle and an area selected by the client on the 3D model.
And step S15, sending the graphics or video stream corresponding to the request to the client.
In step S11, a plurality of images of giga-level pixels at different viewing angles are acquired by a camera array of a plurality of giga-level pixels.
Each camera array of hundred million level pixels comprises more than one wide view field camera, which can be a wide view field low resolution short focus camera, and is used for acquiring wide view field images; the system also comprises a plurality of narrow view field cameras which can be narrow view field high-resolution long-focus cameras and are used for acquiring high-definition narrow view field images. The images taken by the camera array of each hundred million pixels are thus a set of images comprising more than one wide field of view image and a plurality of narrow field of view images. The camera position and shooting angle in each camera array with hundred million-level pixels are calibrated, which area of the wide view field image corresponding to each local high-definition narrow view field image can be calculated according to calibration parameters and pixel values of the images, the coordinates of each image are calibrated, and the high-definition narrow view field images can be mapped to the wide view field image according to the calibrated coordinates.
Meanwhile, the shooting positions and the shooting angles of the camera arrays of the hundred million-level pixels are calibrated according to parameters tested in advance, so that images shot by the camera arrays of the hundred million-level pixels respectively have certain overlapping areas but are images with different visual angles, the overlapping areas are known, the shot images can be directly calculated through a preset algorithm and fixed parameters, the images are spliced, the overlapping areas are removed, smoothing is carried out, seams among the images are eliminated, and the cost of computing resources is greatly saved while the complete spliced images are obtained.
A camera array of many hundred million pixels can take images of scenes from a larger viewing angle, even 360 degrees panoramic images.
In step S12, the image group acquired by each camera array includes a wide view field image, and the wide view field images acquired by the plurality of camera arrays are stitched and cropped according to the pre-calibrated parameters, so as to obtain a panoramic video image.
In step S13, a virtual 3D model may be further generated from the panoramic video image.
In one embodiment, the billion-level pixel panoramic video live broadcasting method further comprises: the wide field of view image and the narrow field of view image are mapped onto the virtual 3D model. When the client rotates or scales the 3D model, the mapping image at the corresponding position can be obtained, the mapping image comprises a wide view field image and a narrow view field image, the mapped wide view field image or the mapped narrow view field image is selected according to the requested area and resolution, and the spliced and cut wide view field image or the mapped narrow view field image is provided for the client. The client can also zoom the image in the display device, and the server only needs to select the corresponding mapping image for cutting and splicing according to the area and resolution requested by the client.
And step S14, receiving a request of the client, wherein the request comprises the angle and the area selected by the client on the 3D model. After receiving the virtual 3D model, the client may rotate and scale the 3D model, and select an angle and a position in which the client is interested, for example, a target position and an area are selected on the model, and a request of the client is generated, and the request is sent to the server. For example, if the client selects a large area on the model, which indicates that the client wants to see a large-range image, the client only needs to cut and splice the corresponding wide-field image and provide the cut and spliced wide-field image to the client, and if the client selects a small-area, which indicates that the client wants to see local high-definition details, the client cuts and splices the corresponding narrow-field image and provides the cut and spliced narrow-field image to the client.
And step S15, sending the video stream corresponding to the request to the client. And taking the spliced images as frames, forming a video stream according to the time stamp, and sending the video stream to the client.
In one embodiment, the billion-level pixel panoramic video live broadcasting method further comprises: after a video stream is generated, detecting the similarity between continuous frames of the video stream in a Structural Similarity Index (SSIM) mode, and when the similarity is larger than a threshold value, determining the video stream as a reusable video stream;
the reusable video stream is stored in a database of the multi-level server. If the video stream is the reusable video stream, the reusable video stream is stored in a database of the multi-level server, and when other clients request the same video, the stored video stream can be sent to the clients, so that the response time delay of the request is reduced, and the resource overhead caused by repeated calculation is saved.
In one embodiment, after a request of a client is received, a database is inquired, and whether a reusable video stream corresponding to the request exists or not is judged;
sending the video stream corresponding to the request to the client comprises the steps of sending the reusable video stream to the client when the reusable video stream corresponding to the request exists, and splicing and cutting a plurality of wide view field images or a plurality of narrow view field images corresponding to the request when the reusable video stream corresponding to the request does not exist, so as to generate the video stream and send the video stream to the client.
The method is different from the traditional live broadcast method that the video stream is generated only once, all the clients watch the same video stream, but different video streams are generated according to the selection of different clients, pictures played by each client can be different, the generated reusable video streams can be stored in the server, the same request of different clients can be reused as far as possible, and the system time delay and the resource overhead are greatly reduced.
Through the above description, the billion-level pixel panoramic video live broadcast method provided by the text can realize online interactive live broadcast of billions or more pixel videos, support the rotation of the view angle of the picture to observe scenes at different angles, and also can zoom the picture being watched and maintain high-definition resolution. And realizing the semi-transmission of the video stream through the multiplexing of the video stream.
FIG. 2 is a block diagram illustrating a billion-level pixel panoramic video live device in accordance with one illustrative embodiment. Referring to fig. 2, the giga-level pixel panoramic video live broadcasting device includes: the system comprises an image acquisition module 201, an image splicing module 202, a 3D model generation module 203, a transmission module 204, a request receiving module 205 and a live broadcast module 206.
The image acquisition module 201 is configured to acquire a plurality of hundred million pixel image sets of different viewing angles by a plurality of camera arrays, the hundred million pixel image sets including a wide field of view image and a narrow field of view image.
The image stitching module 202 is configured to stitch the wide field of view images in the plurality of groups of hundred million-level pixel images into a panoramic video image.
The 3D model generation module 203 is configured for generating a virtual 3D model based on the panoramic video image.
The transmission module 204 is configured for transmitting the virtual 3D model to a client.
The request receiving module 205 is configured to receive a request from a client, where the request includes an angle and a region selected by the client on the 3D model.
The live module 206 is configured to send a graphics or video stream corresponding to the request to the client.
The 3D model generation module 203 is also used to map the wide field of view image and the narrow field of view image to the 3D model.
FIG. 3 is a block diagram illustrating a billion-level pixel panoramic video live device in accordance with one illustrative embodiment. Referring to fig. 3, the giga-level pixel panoramic video live broadcasting apparatus further includes: a multiplexing module 301 and a storage module 302.
The multiplexing module 301 is configured to detect a similarity between consecutive frames of a video stream by using a structural similarity index SSIM, and when the similarity is greater than a threshold, the video is a reusable video.
The storage module 302 is configured to store the reusable video in a database of the multi-level server.
The above-described aspects may be implemented individually or in various combinations, and such variations are within the scope of the present invention.
As will be appreciated by one skilled in the art, the embodiments herein may be provided as a method, apparatus (device), or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, including, but not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer, and the like. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein.
In this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims (10)

1. A billion-level pixel panoramic video live broadcast method is characterized by comprising the following steps:
acquiring a plurality of hundred million pixel image groups of different visual angles through a plurality of camera arrays, wherein the hundred million pixel image groups comprise a wide visual field image and a narrow visual field image;
splicing wide view field images in the hundred million-level pixel image groups into a panoramic video image;
generating a virtual 3D model based on the panoramic video image;
transmitting the virtual 3D model to a client;
receiving a request of a client, wherein the request comprises an angle and an area selected by the client in the 3D model;
and sending the video stream corresponding to the request to the client.
2. A billion-level pixel panoramic video live method of claim 1, further comprising:
mapping the wide field of view image and narrow field of view image to the 3D model;
3. a billion-level pixel panoramic video live method of claim 1, further comprising:
detecting the similarity between continuous frames of a video stream in a Structural Similarity Index (SSIM) mode, wherein when the similarity is greater than a threshold value, the video stream is a reusable video stream;
the reusable video stream is stored in a database of the multi-level server.
4. A method of billion level pixel panoramic video live broadcast of claim 3 further comprising:
inquiring the database to determine whether a reusable video corresponding to the request exists;
the sending of the video stream corresponding to the request to the client comprises the steps of sending the reusable video stream to the client when the reusable video stream corresponding to the request exists, and splicing and cutting a plurality of wide view field images or a plurality of narrow view field images corresponding to the request when the reusable video stream corresponding to the request does not exist, so as to generate a video stream and send the video stream to the client.
5. The billion-level pixel panoramic video live broadcasting method of claim 4, wherein the splicing and cutting the plurality of wide-field images or the plurality of narrow-field images corresponding to the request to generate a video stream and sending the video stream to a client comprises:
determining an image corresponding to the request according to the mapping relation between the wide view field image and the narrow view field image and the 3D model;
determining the corresponding image to be a wide view field image or a narrow view field image according to the requested video resolution;
splicing the wide view field image or the narrow view field image;
according to the requested area, cutting the spliced image;
and generating a video stream based on the cut image, and sending the video stream to the client.
6. A billion-level pixel panoramic video live broadcast device, comprising:
the image acquisition module is used for acquiring a plurality of hundred million pixel image groups with different visual angles through a plurality of camera arrays, wherein the hundred million pixel image groups comprise wide visual field images and narrow visual field images;
the image splicing module is used for splicing wide view field images in the hundred million-level pixel image groups into a panoramic video image;
a 3D model generation module for generating a virtual 3D model based on the panoramic video image;
a transmission module for transmitting the virtual 3D model to a client;
the request receiving module is used for receiving a request of a client, wherein the request comprises an angle and an area selected by the client on the 3D model;
and the live broadcast module is used for sending the graphics or video stream corresponding to the request to the client.
7. The giga-level pixel panoramic video live broadcast apparatus of claim 6, wherein the 3D model generation module is further configured to map the wide field of view image and the narrow field of view image to the 3D model.
8. A giga-pel panoramic video live broadcast apparatus as claimed in claim 6, further comprising:
the multiplexing module is used for detecting the similarity between the continuous frames of the video stream in a Structural Similarity Index (SSIM) mode, and when the similarity is larger than a threshold value, the video is a reusable video;
and the storage module is used for storing the reusable video in a database of the multi-level server.
9. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed, implements the steps of the method according to any one of claims 1-5.
10. A computer arrangement comprising a processor, a memory and a computer program stored on the memory, characterized in that the steps of the method according to any of claims 1-5 are implemented when the computer program is executed by the processor.
CN202011140082.1A 2020-10-22 2020-10-22 Billion-level pixel panoramic video live broadcast method, device, medium and equipment Pending CN112468832A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011140082.1A CN112468832A (en) 2020-10-22 2020-10-22 Billion-level pixel panoramic video live broadcast method, device, medium and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011140082.1A CN112468832A (en) 2020-10-22 2020-10-22 Billion-level pixel panoramic video live broadcast method, device, medium and equipment

Publications (1)

Publication Number Publication Date
CN112468832A true CN112468832A (en) 2021-03-09

Family

ID=74834144

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011140082.1A Pending CN112468832A (en) 2020-10-22 2020-10-22 Billion-level pixel panoramic video live broadcast method, device, medium and equipment

Country Status (1)

Country Link
CN (1) CN112468832A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113873285A (en) * 2021-10-14 2021-12-31 中国科学院软件研究所 Naked eye 3D live broadcast method, device and system based on Hongmon distributed capability
CN114125291A (en) * 2021-11-23 2022-03-01 北京拙河科技有限公司 Multi-focal-segment-camera-based image imaging method and device and electronic equipment
CN114170567A (en) * 2021-12-01 2022-03-11 北京拙河科技有限公司 Light field camera AI analysis system and method for monitoring hundred million level pixels of area
CN114222063A (en) * 2021-12-16 2022-03-22 北京拙河科技有限公司 Method and device for processing pictures and video data of hundred million-level pixels
WO2023115685A1 (en) * 2021-12-24 2023-06-29 威艾特科技(深圳)有限公司 Omnidirectional camera-based monitoring method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3018902A1 (en) * 2014-11-07 2016-05-11 Canon Kabushiki Kaisha Monitoring camera system
CN107079141A (en) * 2014-09-22 2017-08-18 三星电子株式会社 Image mosaic for 3 D video
CN108886601A (en) * 2016-01-20 2018-11-23 杰拉德·迪尔克·施密茨 Holographic video capture and telepresence system
CN109040601A (en) * 2018-09-05 2018-12-18 清华-伯克利深圳学院筹备办公室 A kind of multiple dimensioned non-structured 1,000,000,000 pixel VR panoramic shooting system
CN109167924A (en) * 2018-10-24 2019-01-08 清华-伯克利深圳学院筹备办公室 Video imaging method, system, equipment and storage medium based on Hybrid camera
CN110569927A (en) * 2019-09-19 2019-12-13 浙江大搜车软件技术有限公司 Method, terminal and computer equipment for scanning and extracting panoramic image of mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107079141A (en) * 2014-09-22 2017-08-18 三星电子株式会社 Image mosaic for 3 D video
EP3018902A1 (en) * 2014-11-07 2016-05-11 Canon Kabushiki Kaisha Monitoring camera system
CN108886601A (en) * 2016-01-20 2018-11-23 杰拉德·迪尔克·施密茨 Holographic video capture and telepresence system
CN109040601A (en) * 2018-09-05 2018-12-18 清华-伯克利深圳学院筹备办公室 A kind of multiple dimensioned non-structured 1,000,000,000 pixel VR panoramic shooting system
CN109167924A (en) * 2018-10-24 2019-01-08 清华-伯克利深圳学院筹备办公室 Video imaging method, system, equipment and storage medium based on Hybrid camera
CN110569927A (en) * 2019-09-19 2019-12-13 浙江大搜车软件技术有限公司 Method, terminal and computer equipment for scanning and extracting panoramic image of mobile terminal

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113873285A (en) * 2021-10-14 2021-12-31 中国科学院软件研究所 Naked eye 3D live broadcast method, device and system based on Hongmon distributed capability
CN114125291A (en) * 2021-11-23 2022-03-01 北京拙河科技有限公司 Multi-focal-segment-camera-based image imaging method and device and electronic equipment
CN114125291B (en) * 2021-11-23 2023-12-05 北京拙河科技有限公司 Image imaging method and device based on multi-focal-length camera and electronic equipment
CN114170567A (en) * 2021-12-01 2022-03-11 北京拙河科技有限公司 Light field camera AI analysis system and method for monitoring hundred million level pixels of area
CN114170567B (en) * 2021-12-01 2022-07-12 北京拙河科技有限公司 Light field camera AI analysis system and method for monitoring hundred million level pixels of area
CN114222063A (en) * 2021-12-16 2022-03-22 北京拙河科技有限公司 Method and device for processing pictures and video data of hundred million-level pixels
CN114222063B (en) * 2021-12-16 2022-11-08 北京拙河科技有限公司 Method and device for processing picture and video data of hundred million-level pixels
WO2023115685A1 (en) * 2021-12-24 2023-06-29 威艾特科技(深圳)有限公司 Omnidirectional camera-based monitoring method and system

Similar Documents

Publication Publication Date Title
CN112468832A (en) Billion-level pixel panoramic video live broadcast method, device, medium and equipment
US20210329222A1 (en) System and method for creating a navigable, three-dimensional virtual reality environment having ultra-wide field of view
CN111193937B (en) Live video data processing method, device, equipment and medium
CN105915937B (en) Panoramic video playing method and device
US8208048B2 (en) Method for high dynamic range imaging
US20190289055A1 (en) Method and system for interactive transmission of panoramic video
US11539983B2 (en) Virtual reality video transmission method, client device and server
CN111225228B (en) Video live broadcast method, device, equipment and medium
WO2012166593A2 (en) System and method for creating a navigable, panoramic three-dimensional virtual reality environment having ultra-wide field of view
CN106296589B (en) Panoramic image processing method and device
JP2020031421A (en) Method and camera system combining views from plurality of cameras
CN104822045A (en) Method for realizing distributed linkage display of observing pictures through preset positions, and device thereof
CN107592549B (en) Panoramic video playing and photographing system based on two-way communication
CN105898139A (en) Panoramic video production method and device and panoramic video play method and device
CN105635675A (en) Panorama playing method and device
CN109389550B (en) Data processing method, device and computing equipment
CN108391116B (en) Whole body scanning device and method based on 3D imaging technology
KR20200064998A (en) Playback apparatus and method, and generating apparatus and method
CN113891111B (en) Live broadcasting method, device, medium and equipment of billion pixel video
CN114449303A (en) Live broadcast picture generation method and device, storage medium and electronic device
CN108391048A (en) Data creation method with functions and panoramic shooting system
CN109272453B (en) Modeling device and positioning method based on 3D camera
US11272209B2 (en) Methods and apparatus for determining adjustment parameter during encoding of spherical multimedia content
CN113810609A (en) Video transmission method, server, user terminal and video transmission system
US20190130651A1 (en) Generating virtual reality and augmented reality content for a live event

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20211103

Address after: 518000 409, Yuanhua complex building, 51 Liyuan Road, merchants street, Nanshan District, Shenzhen, Guangdong

Applicant after: Shenzhen zhuohe Technology Co.,Ltd.

Address before: 100083 no.2501-1, 25th floor, block D, Tsinghua Tongfang science and technology building, No.1 courtyard, Wangzhuang Road, Haidian District, Beijing

Applicant before: Beijing Zhuohe Technology Co.,Ltd.