WO2019100631A1 - Video playing method, apparatus and system, and storage medium - Google Patents

Video playing method, apparatus and system, and storage medium Download PDF

Info

Publication number
WO2019100631A1
WO2019100631A1 PCT/CN2018/080939 CN2018080939W WO2019100631A1 WO 2019100631 A1 WO2019100631 A1 WO 2019100631A1 CN 2018080939 W CN2018080939 W CN 2018080939W WO 2019100631 A1 WO2019100631 A1 WO 2019100631A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
terminal
view
display terminal
display
Prior art date
Application number
PCT/CN2018/080939
Other languages
French (fr)
Chinese (zh)
Inventor
易营
周茂林
刘成刚
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2019100631A1 publication Critical patent/WO2019100631A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe

Definitions

  • the present invention relates to the field of communications, and in particular to a video playing method, apparatus, system, and storage medium.
  • Panoramic video is a kind of video that is shot 360° with 3D cameras. Users can shoot. Viewing dynamic video from any angle of view from 360° to 360° provides users with an immersive virtual reality feel.
  • one play terminal only corresponds to one display terminal, that is to say, the playback of the panoramic video limits the use of a single user, and it is difficult to meet the differentiated viewing requirements among multiple users.
  • the playback of the panoramic video limits the use of a single user, and it is difficult to meet the differentiated viewing requirements among multiple users.
  • the embodiment of the invention provides a video playing method, device, system and storage medium, so as to at least solve the problem that the related technologies cannot be realized under the condition of playing a single program source, so that multiple users can independently select a viewing angle to view the panoramic video.
  • the problem is to at least solve the problem that the related technologies cannot be realized under the condition of playing a single program source, so that multiple users can independently select a viewing angle to view the panoramic video.
  • a video playing method which includes: acquiring viewing angle information reported by a display terminal connected to a playback terminal, wherein the number of the display terminals is two or more, and the viewing angle information is The viewing area information of the terminal when viewing the video is displayed; the video area corresponding to the viewing angle information is obtained by the video; and the obtained video area is returned to the display terminal for video playback.
  • the obtaining the video area corresponding to the view information of the video comprises: summarizing view angle information reported by the display terminal, and obtaining a view angle combination; and sending a first request message to a server configured to store the video, where The first request message is used to request to acquire a video area of a video corresponding to the view aggregation; and acquire a video area of the video corresponding to the view angle set returned by the server according to the first request message.
  • the video area that receives the video that is returned by the server according to the first request message and that corresponds to the view aggregation includes one of: acquiring the server and returning according to the first request message. Obtaining a video code stream of the corresponding video in a view; acquiring video data of the video corresponding to the view angle set returned by the server according to the first request.
  • the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to segment and/or recombine the two or more video code streams to obtain the view angles.
  • the ability of the video stream of the corresponding video is configured to segment and/or recombine the two or more video code streams to obtain the view angles.
  • acquiring the video area corresponding to the view information of the video includes: summarizing view angle information reported by the display terminal to obtain a view angle, and sending a second request message to a server configured to store the video. Obtaining a video code stream of the video; acquiring a video code stream of the video corresponding to the view angle union in the video code stream.
  • returning the obtained video area to the display terminal for video playback includes: determining that the display terminal supports code stream decoding And returning the obtained video code stream of the video corresponding to the view angle set to the display terminal for video playback; and when determining that the display terminal does not support code stream decoding, the video corresponding to the view angle is combined
  • the video code stream is parsed to obtain video data; the video data is returned to the display terminal for video playback.
  • the method further includes: when determining that the display terminal accesses the network where the play terminal is located, The display terminal sends a connection request, wherein the connection request is used to request connection between the play terminal and the display terminal; and receives a connection response returned by the display terminal after determining to connect with the play terminal, where
  • the connection type carries the terminal type of the display terminal and the code stream decoding capability.
  • the obtaining the view information reported by the display terminal connected to the play terminal includes: acquiring the first view information reported by the first display terminal connected to the play terminal, where the first view information and the second display terminal are reported in advance The second view terminal is the same, the second display terminal is connected to the play terminal; and acquiring the video area corresponding to the first view information of the video comprises: acquiring and transmitting the second display terminal to the second display terminal The video area corresponding to the two-view information; the video area that is returned to the display terminal for video playback includes: sending the acquired video area corresponding to the second view information to the first display terminal for video Play.
  • a video playing method including: reporting perspective information to a connected playing terminal, wherein the number of display terminals connected to the playing terminal is two or more, the viewing angle The information is view information when the video is viewed; the video area corresponding to the view information returned by the play terminal is received; and the video is played according to the video area.
  • receiving the video area corresponding to the view information returned by the play terminal includes one of: receiving video data of a video corresponding to the view information returned by the play terminal; receiving the play terminal to return And a video code stream of the video corresponding to the view information, and parsing a video code stream of the video corresponding to the view information to obtain video data.
  • the method before the reporting of the view information to the connected play terminal, the method further includes: after accessing the network where the play terminal is located, receiving, by the play terminal, requesting to connect a connection request; returning a connection response to the playback terminal after determining to connect with the play terminal, wherein the connection response carries a terminal type and a code stream decoding capability.
  • the reporting the view information to the connected play terminal includes: reporting the first view information to the connected play terminal, where the first view information is the same as the second view information reported by the second display terminal in advance.
  • the second display terminal is connected to the play terminal; receiving the video area corresponding to the view information returned by the play terminal includes: receiving, by the play terminal, the second view that is sent to the second display terminal.
  • the video area corresponding to the information; performing video playback according to the video area includes: performing video playback according to a video area corresponding to the second view information.
  • a first video playing device comprising: a first acquiring module, configured to acquire viewing angle information reported by a display terminal connected to the playing terminal, wherein the number of the display terminals is two And the view information is the view information when the display terminal is watching the video; the second obtaining module is configured to acquire the video area corresponding to the view information, and the return module is configured to be the obtained The video area is returned to the display terminal for video playback.
  • the second obtaining module includes: a first summarizing unit configured to summarize view angle information reported by the display terminal to obtain a view angle combination; and a sending unit configured to send the first to a server configured to store the video a request message, wherein the first request message is used to request to acquire a video area of a video corresponding to the view aggregation; the first obtaining unit is configured to acquire, according to the first request message, the server returns The view angles combine the video regions of the corresponding video.
  • the second obtaining module includes: a second summarizing unit, configured to summarize view angle information reported by the display terminal to obtain a view angle, and send a second request to a server configured to store the video a message to obtain a video code stream of the video; and a second acquiring unit, configured to acquire a video code stream of the video corresponding to the view angle union in the video code stream.
  • a second summarizing unit configured to summarize view angle information reported by the display terminal to obtain a view angle, and send a second request to a server configured to store the video a message to obtain a video code stream of the video
  • a second acquiring unit configured to acquire a video code stream of the video corresponding to the view angle union in the video code stream.
  • a second video playback apparatus including: a reporting module, configured to report perspective information to a connected playback terminal, wherein the number of display terminals connected to the playback terminal is two And the view module is configured to receive the video region corresponding to the view information returned by the play terminal, and the play module is configured to perform video according to the video region. Play.
  • the receiving module includes: a first receiving unit configured to receive video data of a video corresponding to the view information returned by the playing terminal; or a second receiving unit configured to receive the playing terminal Returning a video code stream of the video corresponding to the view information; and analyzing means configured to parse the video code stream of the video corresponding to the view information to obtain video data.
  • a video playing system including: a server configured to store a video code stream; a playback terminal connected to the server, the play terminal including the foregoing A video playback device; a display terminal, connected to the playback terminal, the number of the display terminals being two or more, the display terminal comprising the second video playback device according to any one of the above.
  • a storage medium comprising a stored program, wherein the program is executed to perform the method of any of the above.
  • a processor for running a program wherein the program is executed to perform the method of any of the above.
  • an electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to run the computer program to perform any of the above The steps in the method embodiments.
  • a single playback terminal can connect a plurality of display terminals, and each display terminal can request a video area of a viewing angle that is required for playback, the multi-bit is realized under the condition of playing a single program source. Users can independently select the viewing angle to view the panoramic video, thus solving the problem that the related technologies cannot realize the panoramic video selection under the condition of playing the single program source, so that multiple users can independently select the viewing angle to achieve the effect of improving the user experience. .
  • FIG. 1 is a block diagram showing the hardware structure of a mobile terminal of a video playing method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a first video playing method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a second video playing method according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a method for sharing a home panoramic video according to an embodiment of the present invention
  • FIG. 5 is a flow diagram of automatic discovery in accordance with an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a view angle combination determination according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of perspective sharing tracking according to an embodiment of the present invention.
  • FIG. 8 is a first schematic diagram of video transmission of a panoramic video sharing device according to an embodiment of the present invention.
  • FIG. 9 is a second schematic diagram of video transmission of a panoramic video sharing device according to an embodiment of the present invention.
  • FIG. 10 is a third schematic diagram of video transmission of a panoramic video sharing device according to an embodiment of the present invention.
  • FIG. 11 is a block diagram showing the structure of a first video playback apparatus according to an embodiment of the present invention.
  • FIG. 12 is a structural block diagram of a second video playback apparatus according to an embodiment of the present invention.
  • FIG. 13 is a structural block diagram of a sharing device of a home panoramic video according to an embodiment of the present invention.
  • FIG. 1 is a hardware structural block diagram of a mobile terminal of a video playing method according to an embodiment of the present invention.
  • mobile terminal 10 may include one or more (only one shown in FIG. 1) processor 102 (processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA.
  • FIG. 1 is merely illustrative and does not limit the structure of the above electronic device.
  • the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
  • the memory 104 can be configured as a software program and a module for storing application software, such as program instructions/modules corresponding to the video playing method in the embodiment of the present invention, and the processor 102 executes each by executing a software program and a module stored in the memory 104.
  • a functional application and data processing, that is, the above method is implemented.
  • Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory.
  • memory 104 may further include memory remotely located relative to processor 102, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Transmission device 106 is arranged to receive or transmit data via a network.
  • the above-described network specific example may include a wireless network provided by a communication provider of the mobile terminal 10.
  • the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet.
  • the transmission device 106 can be a Radio Frequency (RF) module configured to communicate with the Internet wirelessly.
  • NIC Network Interface Controller
  • RF Radio Frequency
  • FIG. 2 is a flowchart of a first video playback method according to an embodiment of the present invention. As shown in FIG. 2, the process includes the following steps. :
  • step S202 the viewing angle information reported by the display terminal connected to the playing terminal is obtained, where the number of the display terminals is two or more, and the viewing angle information is the viewing angle information when the display terminal is watching the video;
  • Step S204 acquiring a video area corresponding to the viewing angle information of the video.
  • Step S206 returning the acquired video area to the display terminal for video playback.
  • the above operation may be performed on the above-mentioned playback terminal.
  • the viewing angle information reported by the plurality of display terminals connected to the playing terminal may be relatively independent, that is, the viewing angle information reported by each display terminal may be different from each other, or partially display the viewing angle information reported by the terminal.
  • each display terminal can request a video area of the viewing angle that it wishes to view.
  • a single playback terminal can connect a plurality of display terminals, and each display terminal can request a video area of a viewing angle that he or she wishes to view, it is realized that under the condition of playing a single program source, Users can independently select the viewing angle to view the panoramic video, thus solving the problem that the related technology can not realize the viewing of the panoramic video under the condition of playing the single program source, so that multiple users can independently select the viewing angle to achieve the user experience. effect.
  • the obtaining the video area corresponding to the view information of the video includes: displaying the view information reported by the terminal, and obtaining the view set; and sending the first request message to the server configured to store the video, where The first request message is used to request to acquire a video area of the video corresponding to the view angle union; and obtain a video area of the video corresponding to the view angle union returned by the server according to the first request message.
  • the overlapping portions of the view information reported by the two or more display terminals may be removed, and only one overlap portion may be reserved, which will be described in the following specific embodiments.
  • the video area that receives the video corresponding to the view angle set returned by the server according to the first request message includes one of the following: the video corresponding to the view angle set returned by the server according to the first request message.
  • the server supports the video requesting by the angle of view. Therefore, when responding, the server may return a video code stream of the video corresponding to the view angle combination (subsequent completion of decoding by the play terminal, or decoding by the display terminal) ), the decoded video data of the video corresponding to the view angle union may also be returned (ie, the decoding operation of the video code stream is completed by the server).
  • the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to divide and/or recombine two or more video code streams to obtain a view and a view set.
  • the server is configured to store the panoramic video, and the panoramic video may be divided into multiple streams at a predetermined angle in the server (one stream may represent an angle of the panoramic video), and does not exist in the server.
  • the server may divide and/or recombine the multiple code streams stored in advance at a predetermined angle to obtain a code stream corresponding to the view angle set requested by the playback terminal.
  • the obtaining the video area corresponding to the view information by the video includes: displaying the view information reported by the terminal to obtain a view aggregation, and sending the second request message to the server configured to store the video.
  • the view angle information reported by two or more display terminals is aggregated to obtain a view angle union, and the order of the two operations of obtaining the video code stream of the video from the server is not limited, and the angle of view may be obtained first.
  • the playback terminal obtains the code stream of the complete video from the server side, and the playback terminal intercepts the video stream of the video corresponding to the view angle from the acquired code stream of the complete video, that is, In this embodiment, the server may no longer support requesting video by view, or may not enable the function.
  • returning the acquired video area to the display terminal for video playback includes: determining that the display terminal supports the code stream decoding And returning the obtained video code stream of the video corresponding to the view angle set to the display terminal for video playback; and when determining that the display terminal does not support the code stream decoding, parsing the video code stream of the video corresponding to the view angle combination, and obtaining Video data; returning the above video data to the display terminal for video playback.
  • the description is made separately for whether the display terminal supports the code stream decoding.
  • the playback terminal performs decoding, and then decodes. The subsequent data is returned to the display terminal. If the display terminal supports the code stream decoding, the display terminal can decode the code stream by itself, thereby reducing the decoding pressure of the playback terminal. In this embodiment, the display terminal may report the capability information of the code stream decoding to the playback terminal in advance.
  • the display terminal does not support the code stream decoding, which may include the following situations: Case 1) Display terminal It does not have the decoding function itself; Case 2) The display terminal supports the decoding format and the format of the code stream to be decoded is inconsistent (for example, the display terminal can only decode the panoramic video showing the spherical projection type, and the code stream to be decoded is the cylindrical projection type. Panoramic video).
  • the method before the obtaining the viewing angle information reported by the display terminal connected to the playing terminal, the method further includes: sending a connection request to the display terminal when determining that the display terminal accesses the network where the playing terminal is located, The connection request is used to request to connect the play terminal and the display terminal; and receive the connection response returned by the display terminal after determining the connection with the play terminal, wherein the connection response carries the terminal type of the display terminal and the code stream decoding capability.
  • the playing terminal can learn the terminal type of the display terminal and the code stream decoding capability, thereby selecting the sharing mode according to the terminal type of the display terminal, and determining to send the decoded video data to the display terminal according to the code stream decoding capability. Still send the video stream directly.
  • the viewing terminal sharing tracking can be performed between the display terminals.
  • obtaining the viewing angle information reported by the display terminal connected to the playing terminal includes: acquiring the first display terminal connected to the playing terminal.
  • the first view information is the same as the second view information that is previously reported by the second display terminal, and the second display terminal is connected to the play terminal; and the video area corresponding to the first view information is obtained by: Acquiring the video area corresponding to the second view information sent to the second display terminal; and returning the obtained video area to the display terminal for video playback comprises: sending the acquired video area corresponding to the second view information to the first The display terminal plays video.
  • the first display terminal shares the viewing angle information of the second display terminal, and the viewing angle of the first display terminal may change according to the change of the viewing angle of the second display terminal. It should be noted that, in the first display terminal, whether the perspective sharing tracking function needs to be turned on is turned on, and if it is turned on, a viewing terminal connected to the playing terminal is selected for sharing. If not, the first display terminal according to the user. View the video from the perspective.
  • the above embodiment is mainly described from the side of the playback terminal.
  • FIG. 3 is a flowchart of a second video playback method according to an embodiment of the present invention. As shown in FIG. 3, the process includes the following steps. step:
  • step S302 the viewing angle information is reported to the connected playing terminal, where the number of the display terminals connected to the playing terminal is two or more, and the viewing angle information is the viewing angle information when the video is viewed;
  • Step S304 receiving a video area corresponding to the view information returned by the play terminal
  • Step S306 performing video playback according to the video area.
  • the above operation may be performed by the display terminal, and the perspective information is the perspective information of the display terminal when watching the video.
  • a playback terminal can be connected to multiple display terminals, and the viewing angle information reported by different display terminals to the playback terminal can be relatively independent.
  • a single playback terminal can connect a plurality of display terminals, and each display terminal can request a video area of a viewing angle that he or she wishes to view, it is realized that under the condition of playing a single program source, Users can independently select the viewing angle to view the panoramic video, thus solving the problem that the related technology can not realize the viewing of the panoramic video under the condition of playing the single program source, so that multiple users can independently select the viewing angle to achieve the user experience. effect.
  • receiving the video area corresponding to the view information returned by the play terminal includes one of: receiving video data of the video corresponding to the view information returned by the play terminal; receiving the return of the play terminal
  • the video code stream of the video corresponding to the view information is parsed to obtain a video data stream of the video corresponding to the view information.
  • the display terminal may receive the decoded video data from the playing terminal; when the display terminal supports the code stream decoding function, the display terminal A video stream from the playback terminal can be received and then the video stream can be decoded to obtain video data.
  • the method before the reporting of the viewing angle information to the connected playing terminal, the method further includes: after accessing the network where the playing terminal is located, receiving a connection request sent by the playing terminal for requesting connection; After determining to connect with the playing terminal, returning a connection response to the playing terminal, wherein the connection response carries the terminal type and the code stream decoding capability.
  • the playing terminal can learn the terminal type of the display terminal and the code stream decoding capability, thereby selecting the sharing mode according to the terminal type of the display terminal, and determining to send the decoded video data to the display terminal according to the code stream decoding capability. Still send the video stream directly.
  • the viewing angle sharing tracking may be performed between the display terminals, and the following is described: the reporting of the viewing angle information to the connected playing terminal includes: reporting the first viewing angle information to the connected playing terminal, where the first The second view terminal is connected to the play terminal, and the video area corresponding to the view information returned by the play terminal includes: receiving the return sent by the play terminal to the first view information. And displaying the video area corresponding to the second view information of the terminal; performing video play according to the video area includes: performing video play according to the video area corresponding to the second view information.
  • the viewing angle information can be shared between the display terminals, and the viewing angle of the display terminal can be changed according to the change of the viewing angle of the second display terminal.
  • the above embodiment is mainly described from the display terminal side.
  • the present invention is generally described in connection with a playback terminal and a display terminal:
  • the problem to be solved by the present invention is that an efficient panoramic video sharing method is needed, which can ensure that multiple users can independently view the same panoramic video program while playing a single program source.
  • the present invention provides a method for sharing a family panoramic video, as shown in FIG. 4, including:
  • Step 401 A plurality of display terminals are connected to the playing terminal.
  • Step 402 The playback terminal plays a program source, and the program source may be a complete panoramic video code stream or a panoramic video code stream spliced by multiple streams;
  • Step 403 The display terminal separately collects perspective data.
  • Step 404 The display terminal reports the view data to the play terminal, and the play terminal calculates the view angle and collects the video data from the server. If the program source has only one way, the playing terminal requests the complete code stream from the server, and only decodes the video of the view angle and collects part of the video; if the program source has multiple channels, the play terminal requests the view angle from the server to collect the corresponding code stream;
  • Step 405 The playback terminal decodes the panoramic video data. If the program source has only one way, the playback display terminal has a view angle and a corresponding video area. If the program source has multiple channels, the multiplexed code stream needs to be spliced before decoding.
  • Step 406 The multi display terminal outputs video images of corresponding views respectively.
  • the playback terminal can play a panoramic video while saving the network bandwidth and the central processing unit (CPU) resources, and use the shared perspective to allow multiple users to enjoy through the independent display terminal.
  • Panoramic video for panoramic video sharing purposes.
  • the display terminal can be accessed through a High Definition Multimedia Interface (HDMI), wired or wireless, and the playback terminal can automatically discover the display terminal and automatically connect.
  • HDMI High Definition Multimedia Interface
  • the automatic discovery function flow chart can be as shown in FIG. 5, and includes the following steps:
  • Step 501 Display the terminal accessing the network: the display terminal can access the network by using HDMI, wired, or wireless;
  • Step 502 The playback terminal searches for other terminals: the playback terminal can search for the display terminal in the network through a protocol such as Simple Service Discovery Protocol (SSDP), and periodically search;
  • SSDP Simple Service Discovery Protocol
  • Step 503 whether it is a display terminal: the type of the terminal to be searched must be a display terminal;
  • Step 504 The playback terminal sends a connection request.
  • Step 505 The display terminal responds to the connection request and feeds back the terminal type: the display terminal connects to the display terminal, and sends information such as its own decoding capability to the playback terminal: for example, whether the display terminal supports decoding of the panoramic video, and the capability of supporting decoding.
  • Step 506 The playback terminal selects a sharing mode according to the terminal type: the playback terminal selects different sharing modes according to different types of display terminals.
  • the display terminal can collect the offset angle of the terminal by using a camera, a gyroscope, an accelerometer, a magnetometer, and a proximity sensor.
  • step 404 after the play terminal receives the view data of the plurality of display terminals, if the program has only one code stream, the play terminal requests the complete code stream from the server. If the program has multiple code streams, if only the code rate is different, only one of the code streams is requested at a time according to the network environment. If the program has multiple streams, and each stream corresponds to a different perspective in the panoramic video, the playback terminal performs the calculation after receiving the perspective data sent by the display terminal, and removes the overlapping portions of the perspectives to obtain a view angle, and the perspective is The method of the set is as shown in Fig. 6. At this time, only the corresponding code streams are aggregated from the service request perspective. In addition, if the server can also support video data requesting from a perspective, it is only necessary to request a view angle from the server and collect the corresponding video data;
  • FIG. 6 An example of the calculation of the angle of view is shown in FIG. 6.
  • the panoramic video is segmented into multiple streams by angle. In the two-dimensional coordinates, each stream represents an angle of the panoramic video.
  • each stream represents an angle of the panoramic video.
  • any one of the code streams included in the viewing angle range of the display terminal must be downloaded.
  • the code streams corresponding to the view angles are represented by gray shaded parts in FIG. 6, which are the code streams that the play terminal needs to request from the server.
  • step 405 if the program source supports, the decoder of the playback terminal only needs to parse the view angle and collect the corresponding video data, and the overlapping portions of the view only need to be decoded once, and then each view is taken.
  • the video images are reorganized and output to the display terminal respectively; otherwise, the decoder decodes the entire panoramic video first, and then sends it to the display terminal, and the display terminal takes an image corresponding to the offset angle for display.
  • the playback terminal can also share the panoramic video by means of code stream distribution, and the decoding and display are all handed to the display terminal for processing.
  • the display terminal has a function of viewing angle sharing follow-up.
  • the display terminal has a function of viewing angle sharing follow-up.
  • other users can directly select the viewing angle or select to follow the viewing angle of the display terminal to achieve the purpose of sharing the viewing angle.
  • Step 701 A plurality of display terminals are connected to the play terminal: at least two display terminals are required to access the view sharing;
  • Step 702 The playback terminal provides a viewing angle selection function: the display terminal can display the viewing angle of other display terminals currently connected to the playing terminal through the function, and can mark the relative positions of the respective viewing angles in the current display terminal;
  • Step 703 the display terminal selects an effective viewing angle a
  • Step 704 The playback terminal sends the video data of the corresponding view: if the display terminal does not support the decoding, the play terminal may copy the image data of the view angle a and send it to the display terminal for display. Otherwise, the play terminal directly sends the data of the selected view a to the display terminal. Display terminal, processed by the display terminal;
  • Step 705 whether to select the angle of view following: if the angle of view is not selected, after the display terminal switches to the selected perspective, the viewing angle is still controlled by the display terminal;
  • Step 706 The viewing angle of the display terminal changes according to the change of the display terminal corresponding to the view angle a: the display terminal switches to the passive display mode, and the angle changes according to the change of the selected view angle corresponding to the display terminal.
  • the display terminal can be a simple virtual reality helmet with sensors such as a gyroscope, an accelerometer, and a magnetometer for capturing angle of view data, and having two left and right display screens, and does not need to support panoramic video decoding. ;
  • the user wears the display terminal and accesses through HDMI, wired, wireless, etc., and the playback terminal automatically discovers the display terminal and establishes a link;
  • the decoder parses the data of the default view of the panoramic video, and sends the parsed data to each display terminal, and the display terminal is responsible for displaying the video image;
  • the display terminal calculates the offset angle of view by using the built-in sensor of the display terminal, and transmits the angle of view data (corresponding to the angle of view information described above) to the playback terminal.
  • the playing terminal calculates a set of viewing angles, wherein the black shaded portion indicates that the viewing angle regions overlap, and if the program source has multiple channels, each channel corresponds to one perspective of the panoramic video, and the playing terminal only requests the viewing angle to be combined, that is, The code stream corresponding to the gray and black parts is sufficient. If there is only one stream, the complete video data is requested.
  • the code stream corresponding to the gray shaded portion in FIG. 6 only needs to be decoded once, and then spliced into video images corresponding to each view.
  • the decoded video image is finally transmitted to the display terminal for display through the control module of the playback terminal;
  • the user turns off the display terminal, and the playback device disconnects from the terminal.
  • the display terminal may be a simple virtual reality helmet with sensors for capturing perspective data, and having two left and right display screens, and does not need to support panoramic video decoding;
  • the user wears the display terminal and accesses through HDMI, wired, wireless, etc., and the playback terminal automatically discovers the display terminal and establishes a link;
  • the playback terminal downloads the complete stream and decodes the source, and establishes a server at the playback terminal, and is configured to distribute the decoded video image (corresponding to the video data described above);
  • the display terminal calculates the offset angle of view, receives the decoded video image, and calculates the angle of view, and takes the portion of the decoded video image that needs to be displayed and projects it to the display screen;
  • the user turns off the display terminal, and the playback device disconnects from the terminal.
  • the display terminal is a general-purpose virtual reality helmet with sensors for capturing perspective data, and has two left and right display screens, and the display terminal supports decoding of panoramic video;
  • the user wears the display terminal and accesses through HDMI, wired, wireless, etc., and the playback terminal automatically discovers the display terminal and establishes a link;
  • the playing terminal When the video starts playing, as shown in FIG. 10, the playing terminal establishes a server for distributing the code stream to the display terminal, and the display terminal receives the code stream and decodes the video image.
  • the user moves the head, and the display terminal calculates the offset angle of view through the sensor, and simultaneously parses the code stream of the corresponding view of the panoramic video and displays the video image.
  • the user turns off the device, and the playback device is disconnected from the terminal.
  • the first three steps are the same as the first three steps of mode 3;
  • the decoding capability of the display terminal is limited, and the current panoramic video cannot be correctly parsed.
  • the projection coordinate system used is divided into various types, such as spherical projection, cylindrical projection, cube projection, pyramid projection, and the like. If the display terminal can only decode the panoramic video showing the spherical projection type, when the cylindrical video of the cylindrical projection type is played, the display area calculated by the angular offset is not the correct area because the coordinate system is inconsistent.
  • the playing terminal can obtain the format supported by the display terminal through automatic discovery, and if the currently displayed panoramic video can be correctly decoded, the processing is performed according to mode 3. Otherwise, the playback terminal transcodes the source to a format that the display terminal can support, and then sends the display to the display terminal to decode the display.
  • the user turns off the device, and the playback device is disconnected from the terminal.
  • the type of the display terminal is first acquired. If it is a simple virtual reality helmet, the playback terminal decodes and outputs according to mode 1 or mode 2; if it is a normal helmet, performs code according to mode 3 or mode 4.
  • Stream distribution
  • the decoder of the playback terminal corresponds to the decoding output corresponding to the type or the local server is used to save CPU resources.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
  • a video playback device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 11 is a structural block diagram of a first video playback apparatus according to an embodiment of the present invention. As shown in FIG. 11, the apparatus includes a first acquisition module 112, a second acquisition module 114, and a return module 116. Description:
  • the first obtaining module 112 is configured to acquire the viewing angle information reported by the display terminal connected to the playing terminal, where the number of the display terminals is two or more, and the viewing angle information is viewing angle information when the display terminal is watching the video;
  • the module 114 is connected to the first acquiring module 112, and is configured to acquire a video area corresponding to the video view information.
  • the returning module 116 is connected to the second acquiring module 114, and is configured to return the obtained video area to the display terminal. Video playback.
  • the foregoing second obtaining module 114 includes: a first summarizing unit, configured to collect the viewing angle information reported by the display terminal, to obtain a view angle combination; and a sending unit, connected to the first summary unit, And being configured to send a first request message to a server that is configured to store the video, where the first request message is used to request to acquire a video area of a video corresponding to a view angle combination; and the first obtaining unit is connected to the sending unit And configured to obtain a video area of the video corresponding to the view angle set returned by the server according to the first request message.
  • the first acquiring unit is configured to: obtain a video code stream of the video corresponding to the view angle set returned by the server according to the first request message; or acquire the view angle returned by the server according to the first request.
  • the video data of the corresponding video is aggregated.
  • the server supports the video requesting by the angle of view. Therefore, when responding, the server may return a video code stream of the video corresponding to the view angle combination (subsequent completion of decoding by the play terminal, or decoding by the display terminal) ), the decoded video data of the video corresponding to the view angle union may also be returned (ie, the decoding operation of the video code stream is completed by the server).
  • the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to divide and/or recombine two or more video code streams to obtain a view and a view set.
  • the server is configured to store the panoramic video, and the panoramic video may be divided into multiple streams at a predetermined angle in the server (one stream may represent an angle of the panoramic video), and does not exist in the server.
  • the server may divide and/or recombine the multiple code streams stored in advance at a predetermined angle to obtain a code stream corresponding to the view angle set requested by the playback terminal.
  • the foregoing second obtaining module 114 includes: a second summarizing unit configured to collectively display the viewing angle information reported by the terminal to obtain a view aggregation, and send the same to the server configured to store the video.
  • the second request message is used to obtain the video code stream of the video;
  • the second obtaining unit is connected to the second summary unit, and is configured to obtain a video code stream of the video corresponding to the view angle combination in the video code stream.
  • the returning module 116 is configured to: after obtaining the video code stream of the video corresponding to the view angle, after determining that the display terminal supports the code stream decoding, The video code stream of the video is returned to the display terminal for video playback; when it is determined that the display terminal does not support the code stream decoding, the video code stream of the video corresponding to the view angle is parsed to obtain video data; and the video data is returned to The display terminal plays video.
  • the foregoing apparatus is further configured to: before acquiring the view information reported by the display terminal connected to the play terminal, perform the following operations: when determining that the display terminal accesses the network where the play terminal is located, to the display terminal Sending a connection request, wherein the connection request is used to request to connect the play terminal and the display terminal; and receiving a connection response returned by the display terminal after determining to connect with the play terminal, wherein the connection response carries the terminal type and code of the display terminal Stream decoding capability.
  • the playing terminal can learn the terminal type of the display terminal and the code stream decoding capability, thereby selecting the sharing mode according to the terminal type of the display terminal, and determining to send the decoded video data to the display terminal according to the code stream decoding capability. Still send the video stream directly.
  • the display terminal can perform the perspective sharing tracking.
  • the first acquisition module 112 is configured to: acquire the first perspective information reported by the first display terminal connected to the playback terminal.
  • the first viewing angle information is the same as the second viewing angle information reported by the second display terminal, and the second display terminal is connected to the playing terminal.
  • the second acquiring module 114 is configured to: acquire and send to the second display terminal. a video area corresponding to the second view information; the returning module 116 is configured to: send the acquired video area corresponding to the second view information to the first display terminal for video playback.
  • the above-described apparatus shown in FIG. 11 can be applied to a playback terminal.
  • FIG. 12 is a structural block diagram of a second video playing device according to an embodiment of the present invention. As shown in FIG. 12, the device includes a reporting module 122, a receiving module 124, and a playing module 126. The device is described below:
  • the reporting module 122 is configured to report the viewing angle information to the connected playing terminal, where the number of the display terminals connected to the playing terminal is two or more, the viewing angle information is the viewing angle information when watching the video, and the receiving module 124 is connected to The reporting module 122 is configured to receive a video area corresponding to the viewing angle information returned by the playback terminal, and the playing module 126 is connected to the receiving module 124 and configured to perform video playback according to the video area.
  • the receiving module 124 includes: a first receiving unit, configured to receive video data of a video corresponding to the viewing angle information returned by the playing terminal; or
  • the receiving module 124 includes: a second receiving unit, configured to receive a video code stream of a video corresponding to the viewing angle information returned by the playing terminal; and a parsing unit connected to the second receiving unit, configured to set a video corresponding to the viewing angle information The video stream is parsed to obtain video data.
  • the foregoing apparatus is further configured to: before accessing the network where the playing terminal is located, before receiving the viewing angle information to the connected playing terminal, receiving a connection request sent by the playing terminal for requesting connection; After determining to connect with the playing terminal, returning a connection response to the playing terminal, wherein the connection response carries the terminal type and the code stream decoding capability.
  • the viewing angle sharing tracking can be performed between the display terminals.
  • the reporting module 122 is configured to report the first viewing angle information to the connected playing terminal, where the first viewing angle information is The second display terminal is connected to the playback terminal
  • the receiving module 124 is configured to: receive the second viewing angle information corresponding to the second display terminal that is sent by the playback terminal and is sent to the second display terminal.
  • the video module is configured to: perform video playback according to a video area corresponding to the second perspective information.
  • the above-described apparatus shown in Fig. 12 can be applied to a display terminal.
  • the video sharing device in the embodiment of the present invention is generally described below in conjunction with a server, a playback terminal, and a display terminal:
  • FIG. 13 is a sharing device of a home panoramic video according to an embodiment of the present invention.
  • the device ie, the sharing device 1300
  • the terminal includes: a playback terminal and a display terminal.
  • one playing terminal can connect to multiple display terminals.
  • the following shows the modules shown in Figure 13:
  • the server is set to store panoramic video, a panoramic video program, and may have one or more code streams. In the case of multiple code streams, each code stream may correspond to a perspective of the panoramic video.
  • the 1302 playback terminal includes: a 1303 control module (corresponding to the first obtaining module 112 and the second obtaining module 114 described above), configured to connect the access module of the display terminal, and configured to receive the viewing angle data from the display terminal and the transmitting playback terminal.
  • the slice source data; the 1304 decoding module (corresponding to the decoding function of the return module 116 described above) is configured to parse the data of the corresponding view of the panoramic video and output the image data.
  • the 1305 display terminal comprises: 1307 access module, accessing the network and performing data interaction with the control module of the play terminal; 1306 sensor module, after the user moves the head, used to collect the current view offset data; 1308 display module (corresponding to The above-mentioned playing module 126): displays a video image of a corresponding viewing angle.
  • the 1302 playing terminal does not need to request complete video data, and only needs to play the video data of the required viewing area, To save network bandwidth; if the 1301 server does not support the above scheme, the 1302 playback terminal will request complete video data in the conventional manner.
  • the access module of the display terminal of the 1305 terminal can be accessed through HDMI, wired, wireless, etc.
  • the control module of the 1302 playback terminal has an automatic discovery function, which can actively discover and connect to exist in the home network environment. Any one of the display terminals.
  • the 1304 decoder module scheme supports, in the case where the viewing angles overlap, the video data of the overlapping viewing angle only needs to be parsed once, which
  • the scheme can save the CPU resources of the playback terminal; otherwise, the traditional decoding method is used, and the 1304 decoder module separately decodes the view area corresponding to each 1305 display terminal, but this scheme occupies more CPU resources.
  • a video playing system comprising: a server configured to store a video code stream; a playback terminal connected to the server, the play terminal comprising any one of the above embodiments The first type of video playback device; the display terminal is connected to the play terminal, and the number of the display terminals is two or more, and the display terminal includes the second video playback device in any of the above embodiments.
  • the method and device for sharing a family panoramic video can be implemented by using the technical solution in the embodiment of the present invention, and the panoramic video can be shared to the home multi-user for viewing when a single program source is played.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination.
  • the forms are located in different processors.
  • Embodiments of the present invention also provide a storage medium including a stored program, wherein the program runs to perform the method of any of the above embodiments.
  • the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM).
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • Embodiments of the present invention also provide a processor for running a program, wherein the program is executed to perform the method of any of the above embodiments.
  • Embodiments of the present invention also provide an electronic device comprising a memory and a processor having a computer program stored therein, the processor being arranged to execute a computer program to perform the steps of any of the method embodiments described above.
  • the electronic device may further include a transmission device and an input and output device, wherein the transmission device is connected to the processor, and the input and output device is connected to the processor.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • a video playing method, apparatus, and system level storage medium provided by an embodiment of the present invention have the following beneficial effects: enabling a plurality of users to independently select a viewing angle to view a panoramic video under the condition of playing a single program source. Therefore, the problem that the related technologies cannot realize the viewing of the panoramic video by independently selecting the viewing angle under the condition of playing the single program source can be solved, thereby achieving the effect of improving the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Provided are a video playing method, apparatus and system, and a storage medium. The method comprises: acquiring viewing angle information reported by display terminals connected to a playing terminal, wherein there are two or more display terminals, and the viewing angle information is viewing angle information of the display terminals when a video is watched; acquiring a video region, corresponding to the viewing angle information, of the video; and returning the acquired video region to the display terminals to play the video. By means of the embodiments of the present invention, the problem in the related art that it cannot be realized that multiple users all can independently select a viewing angle to enjoy a panoramic video where a single program source is played is solved.

Description

视频播放方法、装置、***及存储介质Video playing method, device, system and storage medium 技术领域Technical field
本发明涉及通信领域，具体而言，涉及一种视频播放方法、装置、***及存储介质。The present invention relates to the field of communications, and in particular to a video playing method, apparatus, system, and storage medium.
背景技术Background technique
随着科技的发展，供用户观看的视频种类也越来越多，全景视频是一种新型的视频技术，全景视频是一种用3D摄像机进行全方位360°进行拍摄的视频，用户可以在拍摄视角左右上下360°的选择任意一个视角观看动态视频，从而为用户提供一种身临其境的虚拟现实的感觉。With the development of technology, there are more and more types of videos for users to watch. Panorama video is a new type of video technology. Panoramic video is a kind of video that is shot 360° with 3D cameras. Users can shoot. Viewing dynamic video from any angle of view from 360° to 360° provides users with an immersive virtual reality feel.
在现有技术中，针对同一个全景视频节目源，一个播放终端仅对应一个显示终端，也就是说全景视频的播放限制了单个用户使用，很难满足多用户间的差异化观赏需求。在家庭娱乐、远程教育、博物馆导览、会议电视等场景下，都可能存在全景视频的差异化观赏需求。In the prior art, for a same panoramic video program source, one play terminal only corresponds to one display terminal, that is to say, the playback of the panoramic video limits the use of a single user, and it is difficult to meet the differentiated viewing requirements among multiple users. In the scenes of home entertainment, distance education, museum navigation, conference TV, etc., there may be different viewing requirements for panoramic video.
但是，目前还无法实现在播放单节目源的条件下，能够让多位用户都可以独立选择喜欢的视角观赏全景视频。However, at present, it is impossible to allow a plurality of users to independently select a favorite viewing angle to view a panoramic video under the condition of playing a single program source.
针对上述问题，相关技术中并未提出有效的解决方案。In view of the above problems, an effective solution has not been proposed in the related art.
发明内容Summary of the invention
本发明实施例提供了一种视频播放方法、装置、***及存储介质，以至少解决相关技术中存在的无法实现在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频的问题。The embodiment of the invention provides a video playing method, device, system and storage medium, so as to at least solve the problem that the related technologies cannot be realized under the condition of playing a single program source, so that multiple users can independently select a viewing angle to view the panoramic video. The problem.
根据本发明的一个实施例，提供了一种视频播放方法，包括：获取与播放终端连接的显示终端上报的视角信息，其中，所述显示终端的数量为两个以上，所述视角信息为所述显示终端在观看视频时的视角信息；获取所述视频对应所述视角信息的视频区域；将获取的所述视频区域返回给所述显示终端进行视频播放。According to an embodiment of the present invention, a video playing method is provided, which includes: acquiring viewing angle information reported by a display terminal connected to a playback terminal, wherein the number of the display terminals is two or more, and the viewing angle information is The viewing area information of the terminal when viewing the video is displayed; the video area corresponding to the viewing angle information is obtained by the video; and the obtained video area is returned to the display terminal for video playback.
可选地，获取所述视频对应所述视角信息的视频区域包括：汇总所述显示终端上报的视角信息，得到视角并集；向设置为存储所述视频的服务器发送第一请求消息，其中，所述第一请求消息用于请求获取与所述视角并集对应的视频的视频区域；获取所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频区域。Optionally, the obtaining the video area corresponding to the view information of the video comprises: summarizing view angle information reported by the display terminal, and obtaining a view angle combination; and sending a first request message to a server configured to store the video, where The first request message is used to request to acquire a video area of a video corresponding to the view aggregation; and acquire a video area of the video corresponding to the view angle set returned by the server according to the first request message.
可选地，接收所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频区域包括以下之一：获取所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频码流；获取所述服务器依据所述第一请求返回的与所述视角并集对应的视频的视频数据。Optionally, the video area that receives the video that is returned by the server according to the first request message and that corresponds to the view aggregation includes one of: acquiring the server and returning according to the first request message. Obtaining a video code stream of the corresponding video in a view; acquiring video data of the video corresponding to the view angle set returned by the server according to the first request.
可选地，所述服务器中存储有两个以上分别与预定角度对应的视频码流，所述服务器具备对所述两个以上视频码流进行分割和/或重组以获取与所述视角并集对应的视频的视频码流的能力。Optionally, the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to segment and/or recombine the two or more video code streams to obtain the view angles. The ability of the video stream of the corresponding video.
可选地，获取所述视频对应所述视角信息的视频区域包括：汇总所述显示终端上报的视角信息以得到视角并集，以及，通过向设置为存储所述视频的服务器发送第二请求消息来获取所述视频的视频码流；获取所述视频码流中与所述视角并集对应的视频的视频码流。Optionally, acquiring the video area corresponding to the view information of the video includes: summarizing view angle information reported by the display terminal to obtain a view angle, and sending a second request message to a server configured to store the video. Obtaining a video code stream of the video; acquiring a video code stream of the video corresponding to the view angle union in the video code stream.
可选地，在获取与所述视角并集对应的视频的视频码流后，将获取的所述视频区域返回给所述显示终端进行视频播放包括：在确定所述显示终端支持码流解码时，将获取的与所述视角并集对应的视频的视频码流返回给所述显示终端进行视频播放；在确定所述显示终端不支持码流解码时，对与所述视角并集对应的视频的视频码流进行解析，得到视频数据；将所述视频数据返回给所述显示终端进行视频播放。Optionally, after acquiring the video code stream of the video corresponding to the view angle, returning the obtained video area to the display terminal for video playback includes: determining that the display terminal supports code stream decoding And returning the obtained video code stream of the video corresponding to the view angle set to the display terminal for video playback; and when determining that the display terminal does not support code stream decoding, the video corresponding to the view angle is combined The video code stream is parsed to obtain video data; the video data is returned to the display terminal for video playback.
可选地，在获取与所述播放终端连接的所述显示终端上报的所述视角信息之前，所述方法还包括：在确定所述显示终端接入所述播放终端所在的网络时，向所述显示终端发送连接请求，其中，所述连接请求用于请求连接所述播放终端和所述显示终端；接收所述显示终端在确定与所述播放终端进行连接后返回的连接响应，其中，所述连接响应中携带所述显示终 端的终端类型以及码流解码能力。Optionally, before the obtaining the view information reported by the display terminal connected to the play terminal, the method further includes: when determining that the display terminal accesses the network where the play terminal is located, The display terminal sends a connection request, wherein the connection request is used to request connection between the play terminal and the display terminal; and receives a connection response returned by the display terminal after determining to connect with the play terminal, where The connection type carries the terminal type of the display terminal and the code stream decoding capability.
可选地，获取与播放终端连接的显示终端上报的视角信息包括：获取与播放终端连接的第一显示终端上报的第一视角信息，其中，所述第一视角信息与第二显示终端预先上报的第二视角信息相同，所述第二显示终端与所述播放终端连接；获取所述视频对应所述第一视角信息的视频区域包括：获取发送给所述第二显示终端的与所述第二视角信息对应的视频区域；将获取的所述视频区域返回给所述显示终端进行视频播放包括：将获取的与所述第二视角信息对应的视频区域发送给所述第一显示终端进行视频播放。Optionally, the obtaining the view information reported by the display terminal connected to the play terminal includes: acquiring the first view information reported by the first display terminal connected to the play terminal, where the first view information and the second display terminal are reported in advance The second view terminal is the same, the second display terminal is connected to the play terminal; and acquiring the video area corresponding to the first view information of the video comprises: acquiring and transmitting the second display terminal to the second display terminal The video area corresponding to the two-view information; the video area that is returned to the display terminal for video playback includes: sending the acquired video area corresponding to the second view information to the first display terminal for video Play.
根据本发明的另一个实施例，还提供了一种视频播放方法，包括：向连接的播放终端上报视角信息，其中，与所述播放终端连接的显示终端的数量为两个以上，所述视角信息为在观看视频时的视角信息；接收所述播放终端返回的与所述视角信息对应的视频区域；依据所述视频区域进行视频播放。According to another embodiment of the present invention, a video playing method is further provided, including: reporting perspective information to a connected playing terminal, wherein the number of display terminals connected to the playing terminal is two or more, the viewing angle The information is view information when the video is viewed; the video area corresponding to the view information returned by the play terminal is received; and the video is played according to the video area.
可选地，接收所述播放终端返回的与所述视角信息对应的视频区域包括以下之一：接收所述播放终端返回的与所述视角信息对应的视频的视频数据；接收所述播放终端返回的与所述视角信息对应的视频的视频码流，对与所述视角信息对应的视频的视频码流进行解析得到视频数据。Optionally, receiving the video area corresponding to the view information returned by the play terminal includes one of: receiving video data of a video corresponding to the view information returned by the play terminal; receiving the play terminal to return And a video code stream of the video corresponding to the view information, and parsing a video code stream of the video corresponding to the view information to obtain video data.
可选地，在向连接的所述播放终端上报所述视角信息之前，所述方法还包括：在接入所述播放终端所在的网络后，接收所述播放终端发送的用于请求进行连接的连接请求；在确定与所述播放终端进行连接后向所述播放终端返回连接响应，其中，所述连接响应中携带终端类型以及码流解码能力。Optionally, before the reporting of the view information to the connected play terminal, the method further includes: after accessing the network where the play terminal is located, receiving, by the play terminal, requesting to connect a connection request; returning a connection response to the playback terminal after determining to connect with the play terminal, wherein the connection response carries a terminal type and a code stream decoding capability.
可选地，向连接的播放终端上报视角信息包括：向连接的播放终端上报第一视角信息，其中，所述第一视角信息与第二显示终端预先上报的第二视角信息相同，所述第二显示终端与所述播放终端连接；接收所述播放终端返回的与所述视角信息对应的视频区域包括：接收所述播放终端返回 的发送给所述第二显示终端的与所述第二视角信息对应的视频区域；依据所述视频区域进行视频播放包括：依据与所述第二视角信息对应的视频区域进行视频播放。Optionally, the reporting the view information to the connected play terminal includes: reporting the first view information to the connected play terminal, where the first view information is the same as the second view information reported by the second display terminal in advance. The second display terminal is connected to the play terminal; receiving the video area corresponding to the view information returned by the play terminal includes: receiving, by the play terminal, the second view that is sent to the second display terminal The video area corresponding to the information; performing video playback according to the video area includes: performing video playback according to a video area corresponding to the second view information.
根据本发明的另一个实施例，提供了第一种视频播放装置，包括：第一获取模块，设置为获取与播放终端连接的显示终端上报的视角信息，其中，所述显示终端的数量为两个以上，所述视角信息为所述显示终端在观看视频时的视角信息；第二获取模块，设置为获取所述视频对应所述视角信息的视频区域；返回模块，设置为将获取的所述视频区域返回给所述显示终端进行视频播放。According to another embodiment of the present invention, there is provided a first video playing device, comprising: a first acquiring module, configured to acquire viewing angle information reported by a display terminal connected to the playing terminal, wherein the number of the display terminals is two And the view information is the view information when the display terminal is watching the video; the second obtaining module is configured to acquire the video area corresponding to the view information, and the return module is configured to be the obtained The video area is returned to the display terminal for video playback.
可选地，所述第二获取模块包括：第一汇总单元，设置为汇总所述显示终端上报的视角信息，得到视角并集；发送单元，设置为向设置为存储所述视频的服务器发送第一请求消息，其中，所述第一请求消息用于请求获取与所述视角并集对应的视频的视频区域；第一获取单元，设置为获取所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频区域。Optionally, the second obtaining module includes: a first summarizing unit configured to summarize view angle information reported by the display terminal to obtain a view angle combination; and a sending unit configured to send the first to a server configured to store the video a request message, wherein the first request message is used to request to acquire a video area of a video corresponding to the view aggregation; the first obtaining unit is configured to acquire, according to the first request message, the server returns The view angles combine the video regions of the corresponding video.
可选地，所述第二获取模块包括：第二汇总单元，设置为汇总所述显示终端上报的视角信息以得到视角并集，以及，通过向设置为存储所述视频的服务器发送第二请求消息来获取所述视频的视频码流；第二获取单元，设置为获取所述视频码流中与所述视角并集对应的视频的视频码流。Optionally, the second obtaining module includes: a second summarizing unit, configured to summarize view angle information reported by the display terminal to obtain a view angle, and send a second request to a server configured to store the video a message to obtain a video code stream of the video; and a second acquiring unit, configured to acquire a video code stream of the video corresponding to the view angle union in the video code stream.
根据本发明的另一个实施例，还提供了第二种视频播放装置，包括：上报模块，设置为向连接的播放终端上报视角信息，其中，与所述播放终端连接的显示终端的数量为两个以上，所述视角信息为在观看视频时的视角信息；接收模块，设置为接收所述播放终端返回的与所述视角信息对应的视频区域；播放模块，设置为依据所述视频区域进行视频播放。According to another embodiment of the present invention, a second video playback apparatus is further provided, including: a reporting module, configured to report perspective information to a connected playback terminal, wherein the number of display terminals connected to the playback terminal is two And the view module is configured to receive the video region corresponding to the view information returned by the play terminal, and the play module is configured to perform video according to the video region. Play.
可选地，所述接收模块包括：第一接收单元，设置为接收所述播放终端返回的与所述视角信息对应的视频的视频数据；或者，第二接收单元，设置为接收所述播放终端返回的与所述视角信息对应的视频的视频码流； 以及解析单元，设置为对与所述视角信息对应的视频的视频码流进行解析得到视频数据。Optionally, the receiving module includes: a first receiving unit configured to receive video data of a video corresponding to the view information returned by the playing terminal; or a second receiving unit configured to receive the playing terminal Returning a video code stream of the video corresponding to the view information; and analyzing means configured to parse the video code stream of the video corresponding to the view information to obtain video data.
根据本发明的另一个实施例，提供了一种视频播放***，包括：服务器，设置为存储视频码流；播放终端，与所述服务器连接，所述播放终端包括上述任一项所述的第一种视频播放装置；显示终端，与所述播放终端连接，所述显示终端的数量为两个以上，所述显示终端包括上述任一项所述的第二种视频播放装置。According to another embodiment of the present invention, a video playing system is provided, including: a server configured to store a video code stream; a playback terminal connected to the server, the play terminal including the foregoing A video playback device; a display terminal, connected to the playback terminal, the number of the display terminals being two or more, the display terminal comprising the second video playback device according to any one of the above.
根据本发明的另一个实施例，提供了一种存储介质，所述存储介质包括存储的程序，其中，所述程序运行时执行上述任一项所述的方法。According to another embodiment of the present invention, a storage medium is provided, the storage medium comprising a stored program, wherein the program is executed to perform the method of any of the above.
根据本发明的又一个实施例，还提供了一种处理器，所述处理器用于运行程序，其中，所述程序运行时执行上述任一项所述的方法。According to still another embodiment of the present invention, there is also provided a processor for running a program, wherein the program is executed to perform the method of any of the above.
根据本发明的又一个实施例，还提供了一种电子装置，包括存储器和处理器，所述存储器中存储有计算机程序，所述处理器被设置为运行所述计算机程序以执行上述任一项方法实施例中的步骤。According to still another embodiment of the present invention, there is also provided an electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to run the computer program to perform any of the above The steps in the method embodiments.
通过本发明，由于单个播放终端可以连接多个显示终端，并且，每个显示终端均可以请求自己需要的视角的视频区域进行播放，因此，实现了在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频，从而解决了相关技术中存在的无法实现在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频的问题，达到提高用户体验的效果。According to the present invention, since a single playback terminal can connect a plurality of display terminals, and each display terminal can request a video area of a viewing angle that is required for playback, the multi-bit is realized under the condition of playing a single program source. Users can independently select the viewing angle to view the panoramic video, thus solving the problem that the related technologies cannot realize the panoramic video selection under the condition of playing the single program source, so that multiple users can independently select the viewing angle to achieve the effect of improving the user experience. .
附图说明DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是本发明实施例的一种视频播放方法的移动终端的硬件结构框图；1 is a block diagram showing the hardware structure of a mobile terminal of a video playing method according to an embodiment of the present invention;
图2是根据本发明实施例的第一种视频播放方法的流程图；2 is a flowchart of a first video playing method according to an embodiment of the present invention;
图3是根据本发明实施例的第二种视频播放方法的流程图；3 is a flowchart of a second video playing method according to an embodiment of the present invention;
图4是根据本发明实施例的家庭全景视频的共享方法的流程图；4 is a flowchart of a method for sharing a home panoramic video according to an embodiment of the present invention;
图5是根据本发明实施例的自动发现的流程图；Figure 5 is a flow diagram of automatic discovery in accordance with an embodiment of the present invention;
图6是根据本发明实施例的视角并集确定示意图；6 is a schematic diagram of a view angle combination determination according to an embodiment of the present invention;
图7是根据本发明实施例的视角共享追踪示意图；7 is a schematic diagram of perspective sharing tracking according to an embodiment of the present invention;
图8是根据本发明实施例的全景视频共享装置视频传输示意图一；FIG. 8 is a first schematic diagram of video transmission of a panoramic video sharing device according to an embodiment of the present invention; FIG.
图9是根据本发明实施例的全景视频共享装置视频传输示意图二；FIG. 9 is a second schematic diagram of video transmission of a panoramic video sharing device according to an embodiment of the present invention; FIG.
图10是根据本发明实施例的全景视频共享装置视频传输示意图三；FIG. 10 is a third schematic diagram of video transmission of a panoramic video sharing device according to an embodiment of the present invention; FIG.
图11是根据本发明实施例的第一种视频播放装置的结构框图；11 is a block diagram showing the structure of a first video playback apparatus according to an embodiment of the present invention;
图12是根据本发明实施例的第二种视频播放装置的结构框图；FIG. 12 is a structural block diagram of a second video playback apparatus according to an embodiment of the present invention; FIG.
图13是根据本发明实施例的家庭全景视频的共享装置结构框图。FIG. 13 is a structural block diagram of a sharing device of a home panoramic video according to an embodiment of the present invention.
具体实施方式Detailed ways
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.
实施例1Example 1
本申请实施例一所提供的方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在移动终端上为例，图1是本发明实施例的一种视频播放方法的移动终端的硬件结构框图。如图1所示，移动终端10可以包括一个或多个(图1中仅示出一个)处理器102(处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)、用于存储数据的存储器104、以及用于通信功能的传输装置106。本领域普通技术人员可以理解，图1所示的结构仅为示意，其并不对上述电 子装置的结构造成限定。例如，移动终端10还可包括比图1中所示更多或者更少的组件，或者具有与图1所示不同的配置。The method embodiment provided in Embodiment 1 of the present application can be executed in a mobile terminal, a computer terminal or the like. Taking a mobile terminal as an example, FIG. 1 is a hardware structural block diagram of a mobile terminal of a video playing method according to an embodiment of the present invention. As shown in FIG. 1, mobile terminal 10 may include one or more (only one shown in FIG. 1) processor 102 (processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA. A memory 104 for storing data, and a transmission device 106 for communication functions. It will be understood by those skilled in the art that the structure shown in FIG. 1 is merely illustrative and does not limit the structure of the above electronic device. For example, the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
存储器104可设置为存储应用软件的软件程序以及模块，如本发明实施例中的视频播放方法对应的程序指令/模块，处理器102通过运行存储在存储器104内的软件程序以及模块，从而执行各种功能应用以及数据处理，即实现上述的方法。存储器104可包括高速随机存储器，还可包括非易失性存储器，如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中，存储器104可进一步包括相对于处理器102远程设置的存储器，这些远程存储器可以通过网络连接至移动终端10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 104 can be configured as a software program and a module for storing application software, such as program instructions/modules corresponding to the video playing method in the embodiment of the present invention, and the processor 102 executes each by executing a software program and a module stored in the memory 104. A functional application and data processing, that is, the above method is implemented. Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 104 may further include memory remotely located relative to processor 102, which may be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
传输装置106设置为经由一个网络接收或者发送数据。上述的网络具体实例可包括移动终端10的通信供应商提供的无线网络。在一个实例中，传输装置106包括一个网络适配器(Network Interface Controller，简称为NIC)，其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中，传输装置106可以为射频(Radio Frequency，简称为RF)模块，其设置为通过无线方式与互联网进行通讯。Transmission device 106 is arranged to receive or transmit data via a network. The above-described network specific example may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module configured to communicate with the Internet wirelessly.
实施例2Example 2
在本实施例中提供了一种可以运行于上述移动终端的视频播放方法，图2是根据本发明实施例的第一种视频播放方法的流程图，如图2所示，该流程包括如下步骤：In this embodiment, a video playback method that can be run on the mobile terminal is provided. FIG. 2 is a flowchart of a first video playback method according to an embodiment of the present invention. As shown in FIG. 2, the process includes the following steps. :
步骤S202，获取与播放终端连接的显示终端上报的视角信息，其中，该显示终端的数量为两个以上，上述视角信息为显示终端在观看视频时的视角信息；In step S202, the viewing angle information reported by the display terminal connected to the playing terminal is obtained, where the number of the display terminals is two or more, and the viewing angle information is the viewing angle information when the display terminal is watching the video;
步骤S204，获取上述视频对应视角信息的视频区域；Step S204, acquiring a video area corresponding to the viewing angle information of the video.
步骤S206，将获取的上述视频区域返回给显示终端进行视频播放。Step S206, returning the acquired video area to the display terminal for video playback.
其中，执行上述操作的可以上述播放终端。在上述实施例中，与播放终端连接的多个显示终端上报的视角信息可以是相对独立的，也就是说，各显示终端上报的视角信息可以是互不相同，或部分显示终端上报的视角信息相同，每个显示终端都可以请求自身希望观看的视角的视频区域。Wherein, the above operation may be performed on the above-mentioned playback terminal. In the above embodiment, the viewing angle information reported by the plurality of display terminals connected to the playing terminal may be relatively independent, that is, the viewing angle information reported by each display terminal may be different from each other, or partially display the viewing angle information reported by the terminal. Similarly, each display terminal can request a video area of the viewing angle that it wishes to view.
通过上述步骤，由于单个播放终端可以连接多个显示终端，并且，每个显示终端均可以请求自己希望观看的视角的视频区域进行播放，因此，实现了在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频，从而解决了相关技术中存在的无法实现在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频的问题，达到提高用户体验的效果。Through the above steps, since a single playback terminal can connect a plurality of display terminals, and each display terminal can request a video area of a viewing angle that he or she wishes to view, it is realized that under the condition of playing a single program source, Users can independently select the viewing angle to view the panoramic video, thus solving the problem that the related technology can not realize the viewing of the panoramic video under the condition of playing the single program source, so that multiple users can independently select the viewing angle to achieve the user experience. effect.
在一个可选的实施例中，获取上述视频对应视角信息的视频区域包括：汇总显示终端上报的视角信息，得到视角并集；向设置为存储上述视频的服务器发送第一请求消息，其中，该第一请求消息用于请求获取与视角并集对应的视频的视频区域；获取上述服务器依据第一请求消息返回的与视角并集对应的视频的视频区域。在本实施例中，在获取视角并集时，可以将两个以上显示终端上报的视角信息中重叠部分除去，仅保留一份重叠部分即可，在后续具体实施例中会进行说明。In an optional embodiment, the obtaining the video area corresponding to the view information of the video includes: displaying the view information reported by the terminal, and obtaining the view set; and sending the first request message to the server configured to store the video, where The first request message is used to request to acquire a video area of the video corresponding to the view angle union; and obtain a video area of the video corresponding to the view angle union returned by the server according to the first request message. In this embodiment, when the view angles are acquired, the overlapping portions of the view information reported by the two or more display terminals may be removed, and only one overlap portion may be reserved, which will be described in the following specific embodiments.
在一个可选的实施例中，接收上述服务器依据第一请求消息返回的与视角并集对应的视频的视频区域包括以下之一：获取服务器依据第一请求消息返回的与视角并集对应的视频的视频码流；获取服务器依据第一请求返回的与视角并集对应的视频的视频数据。在本实施例中，服务器是支持按视角请求视频的，因此，服务器在进行响应时，可以返回与视角并集对应的视频的视频码流(后续由播放终端完成解码，或者由显示终端完成解码)，也可以返回解码后的与视角并集对应的视频的视频数据(即，由服务器完成视频码流的解码操作)。In an optional embodiment, the video area that receives the video corresponding to the view angle set returned by the server according to the first request message includes one of the following: the video corresponding to the view angle set returned by the server according to the first request message. The video code stream; the video data of the video corresponding to the view angle union returned by the server according to the first request. In this embodiment, the server supports the video requesting by the angle of view. Therefore, when responding, the server may return a video code stream of the video corresponding to the view angle combination (subsequent completion of decoding by the play terminal, or decoding by the display terminal) ), the decoded video data of the video corresponding to the view angle union may also be returned (ie, the decoding operation of the video code stream is completed by the server).
在一个可选的实施例中，上述服务器中存储有两个以上分别与预定角度对应的视频码流，上述服务器具备对两个以上视频码流进行分割和/或重 组以获取与视角并集对应的视频的视频码流的能力。在本实施例中，服务器是设置为存储全景视频的，在服务器中可以按预定角度将全景视频分割成多路码流(一路码流可以表示全景视频的一个角度)，当服务器中并不存在与播放终端请求的视角并集对应的码流时，服务器可以对预先按预定角度存储的多路码流进行分割和/或重组，以得到与播放终端请求的视角并集对应的码流。In an optional embodiment, the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to divide and/or recombine two or more video code streams to obtain a view and a view set. The ability of the video to stream video streams. In this embodiment, the server is configured to store the panoramic video, and the panoramic video may be divided into multiple streams at a predetermined angle in the server (one stream may represent an angle of the panoramic video), and does not exist in the server. When the code stream corresponding to the view angle set by the playback terminal is merged, the server may divide and/or recombine the multiple code streams stored in advance at a predetermined angle to obtain a code stream corresponding to the view angle set requested by the playback terminal.
在一个可选的实施例中，获取上述视频对应上述视角信息的视频区域包括：汇总显示终端上报的视角信息以得到视角并集，以及，通过向设置为存储视频的服务器发送第二请求消息来获取上述视频的视频码流；获取上述视频码流中与视角并集对应的视频的视频码流。在本实施例中，汇总两个以上显示终端上报的视角信息以得到视角并集，以及从服务器中获取上述视频的视频码流两个操作的先后顺序是不受限的，可以先得到视角并集，再从服务器中获取上述视频的视频码流；也可以先从服务器中获取上述视频的视频码流，再得到视角并集，或者同时执行得到视角并集以及获取视频的视频码流的操作。在本实施例中，播放终端从服务器侧获取的是完整的视频的码流，播放终端再从获取的完整的视频的码流中截取于视角并集对应的视频的视频码流，也就是说，在本实施例中，服务器可以不再支持按视角请求视频，或者，不开启该功能。In an optional embodiment, the obtaining the video area corresponding to the view information by the video includes: displaying the view information reported by the terminal to obtain a view aggregation, and sending the second request message to the server configured to store the video. Obtaining a video code stream of the above video; acquiring a video code stream of the video corresponding to the view angle union in the video code stream. In this embodiment, the view angle information reported by two or more display terminals is aggregated to obtain a view angle union, and the order of the two operations of obtaining the video code stream of the video from the server is not limited, and the angle of view may be obtained first. Set, and then obtain the video code stream of the above video from the server; or obtain the video code stream of the video from the server first, and then obtain the view aggregation, or simultaneously perform the operation of obtaining the view and collecting the video code stream of the video. . In this embodiment, the playback terminal obtains the code stream of the complete video from the server side, and the playback terminal intercepts the video stream of the video corresponding to the view angle from the acquired code stream of the complete video, that is, In this embodiment, the server may no longer support requesting video by view, or may not enable the function.
在一个可选的实施例中，在获取与上述视角并集对应的视频的视频码流后，将获取的上述视频区域返回给显示终端进行视频播放包括：在确定上述显示终端支持码流解码时，将获取的与视角并集对应的视频的视频码流返回给显示终端进行视频播放；在确定显示终端不支持码流解码时，对与视角并集对应的视频的视频码流进行解析，得到视频数据；将上述视频数据返回给显示终端进行视频播放。在本实施例中，是分别针对显示终端是否支持码流解码来分情况进行说明的，若显示终端不支持码流解码(或者，未开启解码功能)，则由播放终端进行解码，再将解码后的数据返回给显示终端，若显示终端支持码流解码，则可以由显示终端自己对码流进行解码，从而可以减轻播放终端的解码压力。在本实施例中，显示终端可 以预先将自身是否支持码流解码的能力信息上报给播放终端，在本实施例中，显示终端不支持码流解码可以包括以下几种情况：情况1)显示终端本身不具备解码功能；情况2)显示终端支持解码格式与待解码的码流的格式不一致(比如显示终端只能解码显示球面投影型的全景视频，而待解码的码流是柱面投影型的全景视频)。In an optional embodiment, after acquiring the video code stream of the video corresponding to the foregoing view aggregation, returning the acquired video area to the display terminal for video playback includes: determining that the display terminal supports the code stream decoding And returning the obtained video code stream of the video corresponding to the view angle set to the display terminal for video playback; and when determining that the display terminal does not support the code stream decoding, parsing the video code stream of the video corresponding to the view angle combination, and obtaining Video data; returning the above video data to the display terminal for video playback. In this embodiment, the description is made separately for whether the display terminal supports the code stream decoding. If the display terminal does not support the code stream decoding (or the decoding function is not enabled), the playback terminal performs decoding, and then decodes. The subsequent data is returned to the display terminal. If the display terminal supports the code stream decoding, the display terminal can decode the code stream by itself, thereby reducing the decoding pressure of the playback terminal. In this embodiment, the display terminal may report the capability information of the code stream decoding to the playback terminal in advance. In this embodiment, the display terminal does not support the code stream decoding, which may include the following situations: Case 1) Display terminal It does not have the decoding function itself; Case 2) The display terminal supports the decoding format and the format of the code stream to be decoded is inconsistent (for example, the display terminal can only decode the panoramic video showing the spherical projection type, and the code stream to be decoded is the cylindrical projection type. Panoramic video).
在一个可选的实施例中，在获取与播放终端连接的显示终端上报的视角信息之前，上述方法还包括：在确定上述显示终端接入播放终端所在的网络时，向显示终端发送连接请求，其中，该连接请求用于请求连接播放终端和显示终端；接收上述显示终端在确定与播放终端进行连接后返回的连接响应，其中，该连接响应中携带显示终端的终端类型以及码流解码能力。在本实施例中，播放终端可以获知显示终端的终端类型以及码流解码能力，从而依据显示终端的终端类型选择共享方式，以及依据码流解码能力来决定向显示终端发送解码后的视频数据，还是直接发送视频码流。In an optional embodiment, before the obtaining the viewing angle information reported by the display terminal connected to the playing terminal, the method further includes: sending a connection request to the display terminal when determining that the display terminal accesses the network where the playing terminal is located, The connection request is used to request to connect the play terminal and the display terminal; and receive the connection response returned by the display terminal after determining the connection with the play terminal, wherein the connection response carries the terminal type of the display terminal and the code stream decoding capability. In this embodiment, the playing terminal can learn the terminal type of the display terminal and the code stream decoding capability, thereby selecting the sharing mode according to the terminal type of the display terminal, and determining to send the decoded video data to the display terminal according to the code stream decoding capability. Still send the video stream directly.
在一个可选的实施例中，显示终端间可以进行视角共享追踪，下面对此进行说明：获取与播放终端连接的显示终端上报的视角信息包括：获取与播放终端连接的第一显示终端上报的第一视角信息，其中，该第一视角信息与第二显示终端预先上报的第二视角信息相同，该第二显示终端与播放终端连接；获取视频对应上述第一视角信息的视频区域包括：获取发送给上述第二显示终端的与第二视角信息对应的视频区域；将获取的上述视频区域返回给显示终端进行视频播放包括：将获取的与第二视角信息对应的视频区域发送给第一显示终端进行视频播放。在本实施例中，第一显示终端共享第二显示终端的视角信息，第一显示终端的视角可以跟随第二显示终端的视角的变化而变化。需要说明的是，在第一显示终端可以设置是否需要开启视角共享追踪功能，开启的话，则会选择一个与播放终端连接的显示终端的视角进行共享，若不开启的话，第一显示终端按照自己的视角观看视频。In an optional embodiment, the viewing terminal sharing tracking can be performed between the display terminals. The following is to describe: obtaining the viewing angle information reported by the display terminal connected to the playing terminal includes: acquiring the first display terminal connected to the playing terminal. The first view information is the same as the second view information that is previously reported by the second display terminal, and the second display terminal is connected to the play terminal; and the video area corresponding to the first view information is obtained by: Acquiring the video area corresponding to the second view information sent to the second display terminal; and returning the obtained video area to the display terminal for video playback comprises: sending the acquired video area corresponding to the second view information to the first The display terminal plays video. In this embodiment, the first display terminal shares the viewing angle information of the second display terminal, and the viewing angle of the first display terminal may change according to the change of the viewing angle of the second display terminal. It should be noted that, in the first display terminal, whether the perspective sharing tracking function needs to be turned on is turned on, and if it is turned on, a viewing terminal connected to the playing terminal is selected for sharing. If not, the first display terminal according to the user. View the video from the perspective.
上述实施例主要是从播放终端侧进行描述的。The above embodiment is mainly described from the side of the playback terminal.
实施例3Example 3
在本实施例中还提供了一种可以运行于上述移动终端的视频播放方法，图3是根据本发明实施例的第二种视频播放方法的流程图，如图3所示，该流程包括如下步骤：In this embodiment, a video playback method that can be run on the mobile terminal is provided. FIG. 3 is a flowchart of a second video playback method according to an embodiment of the present invention. As shown in FIG. 3, the process includes the following steps. step:
步骤S302，向连接的播放终端上报视角信息，其中，与该播放终端连接的显示终端的数量为两个以上，视角信息为在观看视频时的视角信息；In step S302, the viewing angle information is reported to the connected playing terminal, where the number of the display terminals connected to the playing terminal is two or more, and the viewing angle information is the viewing angle information when the video is viewed;
步骤S304，接收上述播放终端返回的与视角信息对应的视频区域；Step S304, receiving a video area corresponding to the view information returned by the play terminal;
步骤S306，依据上述视频区域进行视频播放。Step S306, performing video playback according to the video area.
其中，执行上述操作的可以是显示终端，上述视角信息为显示终端在观看视频时的视角信息。一个播放终端可以连接多个显示终端，不同的显示终端上报给播放终端的视角信息可以是相对独立的。The above operation may be performed by the display terminal, and the perspective information is the perspective information of the display terminal when watching the video. A playback terminal can be connected to multiple display terminals, and the viewing angle information reported by different display terminals to the playback terminal can be relatively independent.
通过上述步骤，由于单个播放终端可以连接多个显示终端，并且，每个显示终端均可以请求自己希望观看的视角的视频区域进行播放，因此，实现了在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频，从而解决了相关技术中存在的无法实现在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频的问题，达到提高用户体验的效果。Through the above steps, since a single playback terminal can connect a plurality of display terminals, and each display terminal can request a video area of a viewing angle that he or she wishes to view, it is realized that under the condition of playing a single program source, Users can independently select the viewing angle to view the panoramic video, thus solving the problem that the related technology can not realize the viewing of the panoramic video under the condition of playing the single program source, so that multiple users can independently select the viewing angle to achieve the user experience. effect.
在一个可选的实施例中，接收上述播放终端返回的与视角信息对应的视频区域包括以下之一：接收上述播放终端返回的与视角信息对应的视频的视频数据；接收上述播放终端返回的与视角信息对应的视频的视频码流，对与上述视角信息对应的视频的视频码流进行解析得到视频数据。在本实施例中，当显示终端不支持码流解码或未开启码流解码功能时，显示终端可以接收到来自播放终端的解码后的视频数据；当显示终端支持码流解码功能时，显示终端可以接收到来自播放终端的视频码流，然后对视频码流进行解码以得到视频数据。In an optional embodiment, receiving the video area corresponding to the view information returned by the play terminal includes one of: receiving video data of the video corresponding to the view information returned by the play terminal; receiving the return of the play terminal The video code stream of the video corresponding to the view information is parsed to obtain a video data stream of the video corresponding to the view information. In this embodiment, when the display terminal does not support the code stream decoding or the code stream decoding function is not enabled, the display terminal may receive the decoded video data from the playing terminal; when the display terminal supports the code stream decoding function, the display terminal A video stream from the playback terminal can be received and then the video stream can be decoded to obtain video data.
在一个可选的实施例中，在向连接的播放终端上报视角信息之前，上 述方法还包括：在接入上述播放终端所在的网络后，接收播放终端发送的用于请求进行连接的连接请求；在确定与播放终端进行连接后向播放终端返回连接响应，其中，该连接响应中携带终端类型以及码流解码能力。在本实施例中，播放终端可以获知显示终端的终端类型以及码流解码能力，从而依据显示终端的终端类型选择共享方式，以及依据码流解码能力来决定向显示终端发送解码后的视频数据，还是直接发送视频码流。In an optional embodiment, before the reporting of the viewing angle information to the connected playing terminal, the method further includes: after accessing the network where the playing terminal is located, receiving a connection request sent by the playing terminal for requesting connection; After determining to connect with the playing terminal, returning a connection response to the playing terminal, wherein the connection response carries the terminal type and the code stream decoding capability. In this embodiment, the playing terminal can learn the terminal type of the display terminal and the code stream decoding capability, thereby selecting the sharing mode according to the terminal type of the display terminal, and determining to send the decoded video data to the display terminal according to the code stream decoding capability. Still send the video stream directly.
在一个可选的实施例中，显示终端间可以进行视角共享追踪，下面对此进行说明：向连接的播放终端上报视角信息包括：向连接的播放终端上报第一视角信息，其中，该第一视角信息与第二显示终端预先上报的第二视角信息相同，该第二显示终端与播放终端连接；接收播放终端返回的与视角信息对应的视频区域包括：接收上述播放终端返回的发送给第二显示终端的与第二视角信息对应的视频区域；依据上述视频区域进行视频播放包括：依据与上述第二视角信息对应的视频区域进行视频播放。在本实施例中，显示终端之间可以共享视角信息，上述显示终端的视角可以跟随第二显示终端的视角的变化而变化。In an optional embodiment, the viewing angle sharing tracking may be performed between the display terminals, and the following is described: the reporting of the viewing angle information to the connected playing terminal includes: reporting the first viewing angle information to the connected playing terminal, where the first The second view terminal is connected to the play terminal, and the video area corresponding to the view information returned by the play terminal includes: receiving the return sent by the play terminal to the first view information. And displaying the video area corresponding to the second view information of the terminal; performing video play according to the video area includes: performing video play according to the video area corresponding to the second view information. In this embodiment, the viewing angle information can be shared between the display terminals, and the viewing angle of the display terminal can be changed according to the change of the viewing angle of the second display terminal.
上述实施例主要是从显示终端侧进行描述的。The above embodiment is mainly described from the display terminal side.
实施例4Example 4
在本实施中结合播放终端与显示终端对本发明进行整体说明：In the present embodiment, the present invention is generally described in connection with a playback terminal and a display terminal:
本发明所要解决的问题在于，需要一种高效的全景视频共享的方式，能够保证在播放单节目源的情况下，多个用户可以独立观赏同一个全景视频节目。The problem to be solved by the present invention is that an efficient panoramic video sharing method is needed, which can ensure that multiple users can independently view the same panoramic video program while playing a single program source.
有鉴于此，本发明提供一种家庭全景视频的共享方法，如图4所示，包括：In view of this, the present invention provides a method for sharing a family panoramic video, as shown in FIG. 4, including:
步骤401，多个显示终端连接播放终端；Step 401: A plurality of display terminals are connected to the playing terminal.
步骤402，播放终端播放一个节目源，节目源可以为一路完整的全景视频码流，或者是由多路码流拼接成的全景视频码流；Step 402: The playback terminal plays a program source, and the program source may be a complete panoramic video code stream or a panoramic video code stream spliced by multiple streams;
步骤403，显示终端分别采集视角数据；Step 403: The display terminal separately collects perspective data.
步骤404，显示终端向播放终端上报视角数据，播放终端计算出视角并集，并向服务器请求视频数据。如果节目源只有一路，播放终端向服务器请求完整的码流，并只解码视角并集部分的视频；如果节目源有多路，播放终端向服务器请求视角并集对应的码流；Step 404: The display terminal reports the view data to the play terminal, and the play terminal calculates the view angle and collects the video data from the server. If the program source has only one way, the playing terminal requests the complete code stream from the server, and only decodes the video of the view angle and collects part of the video; if the program source has multiple channels, the play terminal requests the view angle from the server to collect the corresponding code stream;
步骤405，播放终端解码全景视频数据，如果节目源只有一路，则解码播放显示终端视角并集对应视频区域，如果节目源有多路，则在解码之前，还需要对多路码流进行拼接。Step 405: The playback terminal decodes the panoramic video data. If the program source has only one way, the playback display terminal has a view angle and a corresponding video area. If the program source has multiple channels, the multiplexed code stream needs to be spliced before decoding.
步骤406，多显示终端分别输出对应视角的视频图像。Step 406: The multi display terminal outputs video images of corresponding views respectively.
通过本实施例，播放终端可以实现在节约网络带宽和中央处理器(Central Processing Unit，简称为CPU)资源的前提下播放一个全景视频，同时利用共享视角的方式让多用户通过独立的显示终端欣赏全景视频，达到全景视频共享的目的。With the embodiment, the playback terminal can play a panoramic video while saving the network bandwidth and the central processing unit (CPU) resources, and use the shared perspective to allow multiple users to enjoy through the independent display terminal. Panoramic video for panoramic video sharing purposes.
可选地，在上述步骤401中，显示终端可以通过高清晰度多媒体接口(High Definition Multimedia Interface，简称为HDMI)、有线或无线等方式接入，播放终端能够自动发现显示终端并自动连接。Optionally, in the foregoing step 401, the display terminal can be accessed through a High Definition Multimedia Interface (HDMI), wired or wireless, and the playback terminal can automatically discover the display terminal and automatically connect.
自动发现功能流程图可以如图5所示，包括如下步骤：The automatic discovery function flow chart can be as shown in FIG. 5, and includes the following steps:
步骤501，显示终端接入网络：显示终端可以通过HDMI、有线或者无线的方式接入网络；Step 501: Display the terminal accessing the network: the display terminal can access the network by using HDMI, wired, or wireless;
步骤502，播放终端搜索其他终端：播放终端可通过简单服务发现协议(Simple Service Discovery Protocol，简称为SSDP)等协议搜索网络中显示终端，定时查找；Step 502: The playback terminal searches for other terminals: the playback terminal can search for the display terminal in the network through a protocol such as Simple Service Discovery Protocol (SSDP), and periodically search;
步骤503，是否是显示终端：搜索的终端类型必须是显示终端；Step 503, whether it is a display terminal: the type of the terminal to be searched must be a display terminal;
步骤504，播放终端发出连接请求；Step 504: The playback terminal sends a connection request.
步骤505，显示终端响应连接请求并反馈终端类型：显示终端连接显示终端的同时，将自身的解码能力等信息发送给播放终端：例如显示终端 是否支持全景视频的解码，支持解码的能力如何。Step 505: The display terminal responds to the connection request and feeds back the terminal type: the display terminal connects to the display terminal, and sends information such as its own decoding capability to the playback terminal: for example, whether the display terminal supports decoding of the panoramic video, and the capability of supporting decoding.
步骤506，播放终端根据终端类型选择共享方式：播放终端根据显示终端类型的不同，选择不同的共享方式。Step 506: The playback terminal selects a sharing mode according to the terminal type: the playback terminal selects different sharing modes according to different types of display terminals.
在上述实施例中，在所述步骤403中，显示终端可以使用摄像头、陀螺仪、加速计、磁力计和近距离传感器等设备采集终端的偏移角度。In the above embodiment, in the step 403, the display terminal can collect the offset angle of the terminal by using a camera, a gyroscope, an accelerometer, a magnetometer, and a proximity sensor.
在上述实施例中，可选地，在步骤404中，播放终端接收多个显示终端的视角数据后，如果节目只有一路码流，则播放终端向服务器请求完整的码流。如果节目有多个码流，如果只是码率不同，则根据网络环境，一次只请求其中的一路码流。如果该节目有多路码流，每路码流对应全景视频中不同的视角，则播放终端在接收显示终端发送的视角数据后，进行计算，除去视角重叠的部分，得到视角并集，视角并集的求法如图6所示，此时只向服务请求视角并集对应的各路码流。另外，如果服务器还能能够支持按视角请求视频数据，也只需要向服务器请求视角并集对应的视频数据即可；In the above embodiment, optionally, in step 404, after the play terminal receives the view data of the plurality of display terminals, if the program has only one code stream, the play terminal requests the complete code stream from the server. If the program has multiple code streams, if only the code rate is different, only one of the code streams is requested at a time according to the network environment. If the program has multiple streams, and each stream corresponds to a different perspective in the panoramic video, the playback terminal performs the calculation after receiving the perspective data sent by the display terminal, and removes the overlapping portions of the perspectives to obtain a view angle, and the perspective is The method of the set is as shown in Fig. 6. At this time, only the corresponding code streams are aggregated from the service request perspective. In addition, if the server can also support video data requesting from a perspective, it is only necessary to request a view angle from the server and collect the corresponding video data;
视角并集的计算示例图如图6所示，服务器存储全景视频时，按角度将全景视频分割成多路码流，在二维坐标下，每一路码流表示全景视频的一个角度。在有多个显示终端(例如，图6中所示的801显示终端，802显示终端以及803显示终端)接入时，显示终端的视角范围包含的任意一路码流都必须下载。其中视角并集对应的码流，在图6中使用灰色阴影部分来表示，这些就是播放终端需要向服务器请求的码流。An example of the calculation of the angle of view is shown in FIG. 6. When the server stores the panoramic video, the panoramic video is segmented into multiple streams by angle. In the two-dimensional coordinates, each stream represents an angle of the panoramic video. When there are multiple display terminals (for example, 801 display terminals, 802 display terminals, and 803 display terminals shown in FIG. 6), any one of the code streams included in the viewing angle range of the display terminal must be downloaded. The code streams corresponding to the view angles are represented by gray shaded parts in FIG. 6, which are the code streams that the play terminal needs to request from the server.
在上述实施例中，可选地，在步骤405中，如果节目源支持，播放终端的解码器只需要解析视角并集对应的视频数据，视角重叠的部分仅需解码一次，然后将每个视角的视频画面重组，分别输出到显示终端；否则，解码器将整个全景视频先解码，然后发送到显示终端，由显示终端取偏移角度对应的图像进行显示。另外，如果显示终端也支持全景视频的解码，播放终端也可以通过码流分发的方式实现全景视频的共享，解码和显示全部交给显示终端处理。In the above embodiment, optionally, in step 405, if the program source supports, the decoder of the playback terminal only needs to parse the view angle and collect the corresponding video data, and the overlapping portions of the view only need to be decoded once, and then each view is taken. The video images are reorganized and output to the display terminal respectively; otherwise, the decoder decodes the entire panoramic video first, and then sends it to the display terminal, and the display terminal takes an image corresponding to the offset angle for display. In addition, if the display terminal also supports the decoding of the panoramic video, the playback terminal can also share the panoramic video by means of code stream distribution, and the decoding and display are all handed to the display terminal for processing.
在上述实施例中，可选地，在步骤406中，显示终端具备视角共享追随的功能。在多个显示终端同时接入的情况下，如果一个用户发现了一个很好的观赏视角，其他用户可以直接选择这个视角或者选择跟随这个显示终端的视角进行观赏，达到视角共享追随的目的。In the above embodiment, optionally, in step 406, the display terminal has a function of viewing angle sharing follow-up. In the case that multiple display terminals are simultaneously accessed, if a user finds a good viewing angle, other users can directly select the viewing angle or select to follow the viewing angle of the display terminal to achieve the purpose of sharing the viewing angle.
视角共享追踪的示意图如图7所示，步骤如下：The schematic diagram of the perspective sharing tracking is shown in Figure 7. The steps are as follows:
步骤701，多个显示终端接入播放终端：实现视角共享至少需要两台显示终端接入；Step 701: A plurality of display terminals are connected to the play terminal: at least two display terminals are required to access the view sharing;
步骤702，播放终端提供视角选择功能：显示终端可通过该功能呈现当前连接到播放终端的其他显示终端的观赏视角，并可以在当前显示终端标注各视角的相对位置；Step 702: The playback terminal provides a viewing angle selection function: the display terminal can display the viewing angle of other display terminals currently connected to the playing terminal through the function, and can mark the relative positions of the respective viewing angles in the current display terminal;
步骤703，显示终端选择一个有效视角a； Step 703, the display terminal selects an effective viewing angle a;
步骤704，播放终端发送对应视角的视频数据：如果显示终端不支持解码，播放终端可以拷贝一份视角a的图像数据发送到显示终端显示，否则，播放终端将选择的视角a的数据直接发送到显示终端，由显示终端处理；Step 704: The playback terminal sends the video data of the corresponding view: if the display terminal does not support the decoding, the play terminal may copy the image data of the view angle a and send it to the display terminal for display. Otherwise, the play terminal directly sends the data of the selected view a to the display terminal. Display terminal, processed by the display terminal;
步骤705，是否选择视角跟随：如果不选择视角跟随，显示终端切换到所选视角后，依然由本显示终端控制视角； Step 705, whether to select the angle of view following: if the angle of view is not selected, after the display terminal switches to the selected perspective, the viewing angle is still controlled by the display terminal;
步骤706，显示终端的视角随着视角a对应的显示终端变化而变化：显示终端切换到被动显示模式，角度跟随所选视角对应显示终端变化而变化。Step 706: The viewing angle of the display terminal changes according to the change of the display terminal corresponding to the view angle a: the display terminal switches to the passive display mode, and the angle changes according to the change of the selected view angle corresponding to the display terminal.
下面结合具体实现方式对本发明中的视频共享进行说明：The video sharing in the present invention will be described below in conjunction with specific implementations:
方式1：Method 1:
如图8所示，显示终端可以是一种简单型的虚拟现实头盔，具备陀螺仪、加速计、磁力计等传感器用于捕捉视角数据，同时具备左右两个显示屏，不需要支持全景视频解码；As shown in FIG. 8 , the display terminal can be a simple virtual reality helmet with sensors such as a gyroscope, an accelerometer, and a magnetometer for capturing angle of view data, and having two left and right display screens, and does not need to support panoramic video decoding. ;
用户佩戴显示终端，并通过HDMI、有线、无线等方式接入，播放终 端自动发现显示终端并建立链接；The user wears the display terminal and accesses through HDMI, wired, wireless, etc., and the playback terminal automatically discovers the display terminal and establishes a link;
视频开始播放时，解码器解析全景视频默认视角的数据，同时将解析后数据发送到每个显示终端，由显示终端负责显示视频图像；When the video starts playing, the decoder parses the data of the default view of the panoramic video, and sends the parsed data to each display terminal, and the display terminal is responsible for displaying the video image;
用户移动头部，显示终端利用显示终端内置的传感器计算出偏移视角，并将视角数据(对应于上述的视角信息)发送到播放终端。如图8所示，播放终端计算播放视角并集，其中黑色阴影部分表示视角区域有重叠，如果节目源有多路，每一路对应全景视频的一个视角，播放终端只请求视角并集，也就是灰色和黑色部分对应的码流即可。如果只有一路码流，则请求完整的视频数据。The user moves the head, and the display terminal calculates the offset angle of view by using the built-in sensor of the display terminal, and transmits the angle of view data (corresponding to the angle of view information described above) to the playback terminal. As shown in FIG. 8 , the playing terminal calculates a set of viewing angles, wherein the black shaded portion indicates that the viewing angle regions overlap, and if the program source has multiple channels, each channel corresponds to one perspective of the panoramic video, and the playing terminal only requests the viewing angle to be combined, that is, The code stream corresponding to the gray and black parts is sufficient. If there is only one stream, the complete video data is requested.
请求数据后，图6中灰色阴影部分对应的码流也只需要解码一次，然后拼接成每个视角对应视频图像。解码后的视频图像通过播放终端的控制模块，最终传输到显示终端进行显示；After requesting the data, the code stream corresponding to the gray shaded portion in FIG. 6 only needs to be decoded once, and then spliced into video images corresponding to each view. The decoded video image is finally transmitted to the display terminal for display through the control module of the playback terminal;
用户关闭显示终端，播放装置与该终端断开连接。The user turns off the display terminal, and the playback device disconnects from the terminal.
方式2：Method 2:
如图9所示，显示终端可以是一种简单型的虚拟现实头盔，具备传感器用于捕捉视角数据，同时具备左右两个显示屏，不需要支持全景视频解码；As shown in FIG. 9 , the display terminal may be a simple virtual reality helmet with sensors for capturing perspective data, and having two left and right display screens, and does not need to support panoramic video decoding;
用户佩戴显示终端，并通过HDMI、有线、无线等方式接入，播放终端自动发现显示终端并建立链接；The user wears the display terminal and accesses through HDMI, wired, wireless, etc., and the playback terminal automatically discovers the display terminal and establishes a link;
视频播放时，如图9所示，播放终端下载完整码流并对片源进行解码，同时在播放终端建立一个服务器，设置为分发解码后的视频图像(对应于上述的视频数据)；During video playback, as shown in FIG. 9, the playback terminal downloads the complete stream and decodes the source, and establishes a server at the playback terminal, and is configured to distribute the decoded video image (corresponding to the video data described above);
用户移动头部，显示终端计算偏移视角，接收解码后的视频图像之后，并计算视角，取解码后的视频图像中，需要显示的部分，投射到显示屏；The user moves the head, the display terminal calculates the offset angle of view, receives the decoded video image, and calculates the angle of view, and takes the portion of the decoded video image that needs to be displayed and projects it to the display screen;
用户关闭显示终端，播放装置与该终端断开连接。The user turns off the display terminal, and the playback device disconnects from the terminal.
方式3：Method 3:
显示终端是一种普通型的虚拟现实头盔，具备传感器用于捕捉视角数据，同时具备左右两个显示屏，显示终端支持全景视频的解码；The display terminal is a general-purpose virtual reality helmet with sensors for capturing perspective data, and has two left and right display screens, and the display terminal supports decoding of panoramic video;
用户佩戴显示终端，并通过HDMI、有线、无线等方式接入，播放终端自动发现显示终端并建立链接；The user wears the display terminal and accesses through HDMI, wired, wireless, etc., and the playback terminal automatically discovers the display terminal and establishes a link;
视频开始播放时，如图10所示，播放终端建立一个服务器，用于向显示终端分发码流，显示终端接收码流并进行解码，显示视频图像。When the video starts playing, as shown in FIG. 10, the playing terminal establishes a server for distributing the code stream to the display terminal, and the display terminal receives the code stream and decodes the video image.
用户移动头部，显示终端通过传感器计算偏移视角，同时解析全景视频对应视角的码流并显示视频图像。The user moves the head, and the display terminal calculates the offset angle of view through the sensor, and simultaneously parses the code stream of the corresponding view of the panoramic video and displays the video image.
用户关闭装置，播放装置与该终端断开连接。The user turns off the device, and the playback device is disconnected from the terminal.
方式4：Method 4:
前3个步骤和方式3的前三个步骤相同；The first three steps are the same as the first three steps of mode 3;
显示终端的解码能力有限，不能正确解析当前全景视频。全景视频在制作时，使用的投影坐标系分为多种，例如：球面投影、柱面投影、立方体投影、金字塔投影等。如果显示终端只能解码显示球面投影型的全景视频，在播放柱面投影型的全景视频时，由于坐标系不一致，利用角度偏移计算的显示区域并非正确的区域。这种情况下，显示终端在连接到播放终端时，播放终端能够通过自动发现，获取显示终端支持的格式，如果当前播放的全景视频，显示终端能正确解码，则按照方式3进行处理。否则，播放终端将片源转码成显示终端能够支持的格式，然后发送给显示终端解码显示。The decoding capability of the display terminal is limited, and the current panoramic video cannot be correctly parsed. When the panoramic video is produced, the projection coordinate system used is divided into various types, such as spherical projection, cylindrical projection, cube projection, pyramid projection, and the like. If the display terminal can only decode the panoramic video showing the spherical projection type, when the cylindrical video of the cylindrical projection type is played, the display area calculated by the angular offset is not the correct area because the coordinate system is inconsistent. In this case, when the display terminal is connected to the playing terminal, the playing terminal can obtain the format supported by the display terminal through automatic discovery, and if the currently displayed panoramic video can be correctly decoded, the processing is performed according to mode 3. Otherwise, the playback terminal transcodes the source to a format that the display terminal can support, and then sends the display to the display terminal to decode the display.
用户关闭装置，播放装置与该终端断开连接。The user turns off the device, and the playback device is disconnected from the terminal.
方式5：Method 5:
显示终端有多个，既有简单型虚拟现实头盔，也有普通型的虚拟现实头盔；There are multiple display terminals, ranging from simple virtual reality helmets to common virtual reality helmets;
播放终端连接显示终端后，先获取显示终端的类型，如果是简单型虚拟现实头盔，播放终端则按方式1或方式2进行解码输出；如果是普通型头盔，则按方式3或方式4进行码流分发；After the playback terminal is connected to the display terminal, the type of the display terminal is first acquired. If it is a simple virtual reality helmet, the playback terminal decodes and outputs according to mode 1 or mode 2; if it is a normal helmet, performs code according to mode 3 or mode 4. Stream distribution
同类型的显示终端全部断开连接后，播放终端的解码器对应关闭该类型对应的解码输出或者本地服务器用于节约CPU资源。After all the display terminals of the same type are disconnected, the decoder of the playback terminal corresponds to the decoding output corresponding to the type or the local server is used to save CPU resources.
实施例5Example 5
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
在本实施例中还提供了一种视频播放装置，该装置用于实现上述实施例及优选实施方式，已经进行过说明的不再赘述。如以下所使用的，术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现，但是硬件，或者软件和硬件的组合的实现也是可能并被构想的。In the embodiment, a video playback device is also provided, which is used to implement the above-mentioned embodiments and preferred embodiments, and has not been described again. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
图11是根据本发明实施例的第一种视频播放装置的结构框图，如图11所示，该装置包括第一获取模块112，第二获取模块114和返回模块116，下面对该装置进行说明：11 is a structural block diagram of a first video playback apparatus according to an embodiment of the present invention. As shown in FIG. 11, the apparatus includes a first acquisition module 112, a second acquisition module 114, and a return module 116. Description:
第一获取模块112，设置为获取与播放终端连接的显示终端上报的视角信息，其中，该显示终端的数量为两个以上，该视角信息为显示终端在 观看视频时的视角信息；第二获取模块114，连接至上述第一获取模块112，设置为获取上述视频对应视角信息的视频区域；返回模块116，连接至上述第二获取模块114，设置为将获取的上述视频区域返回给显示终端进行视频播放。The first obtaining module 112 is configured to acquire the viewing angle information reported by the display terminal connected to the playing terminal, where the number of the display terminals is two or more, and the viewing angle information is viewing angle information when the display terminal is watching the video; The module 114 is connected to the first acquiring module 112, and is configured to acquire a video area corresponding to the video view information. The returning module 116 is connected to the second acquiring module 114, and is configured to return the obtained video area to the display terminal. Video playback.
在一个可选的实施例中，上述第二获取模块114包括：第一汇总单元，设置为汇总所述显示终端上报的视角信息，得到视角并集；发送单元，连接至上述第一汇总单元，设置为向设置为存储所述视频的服务器发送第一请求消息，其中，所述第一请求消息用于请求获取与视角并集对应的视频的视频区域；第一获取单元，连接至上述发送单元，设置为获取上述服务器依据第一请求消息返回的与视角并集对应的视频的视频区域。In an optional embodiment, the foregoing second obtaining module 114 includes: a first summarizing unit, configured to collect the viewing angle information reported by the display terminal, to obtain a view angle combination; and a sending unit, connected to the first summary unit, And being configured to send a first request message to a server that is configured to store the video, where the first request message is used to request to acquire a video area of a video corresponding to a view angle combination; and the first obtaining unit is connected to the sending unit And configured to obtain a video area of the video corresponding to the view angle set returned by the server according to the first request message.
在一个可选的实施例中，上述第一获取单元设置为：获取服务器依据第一请求消息返回的与视角并集对应的视频的视频码流；或者，获取服务器依据第一请求返回的与视角并集对应的视频的视频数据。在本实施例中，服务器是支持按视角请求视频的，因此，服务器在进行响应时，可以返回与视角并集对应的视频的视频码流(后续由播放终端完成解码，或者由显示终端完成解码)，也可以返回解码后的与视角并集对应的视频的视频数据(即，由服务器完成视频码流的解码操作)。In an optional embodiment, the first acquiring unit is configured to: obtain a video code stream of the video corresponding to the view angle set returned by the server according to the first request message; or acquire the view angle returned by the server according to the first request. The video data of the corresponding video is aggregated. In this embodiment, the server supports the video requesting by the angle of view. Therefore, when responding, the server may return a video code stream of the video corresponding to the view angle combination (subsequent completion of decoding by the play terminal, or decoding by the display terminal) ), the decoded video data of the video corresponding to the view angle union may also be returned (ie, the decoding operation of the video code stream is completed by the server).
在一个可选的实施例中，上述服务器中存储有两个以上分别与预定角度对应的视频码流，上述服务器具备对两个以上视频码流进行分割和/或重组以获取与视角并集对应的视频的视频码流的能力。在本实施例中，服务器是用于存储全景视频的，在服务器中可以按预定角度将全景视频分割成多路码流(一路码流可以表示全景视频的一个角度)，当服务器中并不存在与播放终端请求的视角并集对应的码流时，服务器可以对预先按预定角度存储的多路码流进行分割和/或重组，以得到与播放终端请求的视角并集对应的码流。In an optional embodiment, the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to divide and/or recombine two or more video code streams to obtain a view and a view set. The ability of the video to stream video streams. In this embodiment, the server is configured to store the panoramic video, and the panoramic video may be divided into multiple streams at a predetermined angle in the server (one stream may represent an angle of the panoramic video), and does not exist in the server. When the code stream corresponding to the view angle set by the playback terminal is merged, the server may divide and/or recombine the multiple code streams stored in advance at a predetermined angle to obtain a code stream corresponding to the view angle set requested by the playback terminal.
在一个可选的实施例中，上述第二获取模块114包括：第二汇总单元，设置为汇总显示终端上报的视角信息以得到视角并集，以及，通过向设置 为存储所述视频的服务器发送第二请求消息来获取所述视频的视频码流；第二获取单元，连接至上述第二汇总单元，设置为获取视频码流中与上述视角并集对应的视频的视频码流。In an optional embodiment, the foregoing second obtaining module 114 includes: a second summarizing unit configured to collectively display the viewing angle information reported by the terminal to obtain a view aggregation, and send the same to the server configured to store the video. The second request message is used to obtain the video code stream of the video; the second obtaining unit is connected to the second summary unit, and is configured to obtain a video code stream of the video corresponding to the view angle combination in the video code stream.
在一个可选的实施例中，上述返回模块116设置为在获取与上述视角并集对应的视频的视频码流后，在确定上述显示终端支持码流解码时，将获取的与视角并集对应的视频的视频码流返回给显示终端进行视频播放；在确定显示终端不支持码流解码时，对与视角并集对应的视频的视频码流进行解析，得到视频数据；将上述视频数据返回给显示终端进行视频播放。In an optional embodiment, the returning module 116 is configured to: after obtaining the video code stream of the video corresponding to the view angle, after determining that the display terminal supports the code stream decoding, The video code stream of the video is returned to the display terminal for video playback; when it is determined that the display terminal does not support the code stream decoding, the video code stream of the video corresponding to the view angle is parsed to obtain video data; and the video data is returned to The display terminal plays video.
在一个可选的实施例中，上述装置还设置为在获取与播放终端连接的显示终端上报的视角信息之前，执行以下操作：在确定上述显示终端接入播放终端所在的网络时，向显示终端发送连接请求，其中，该连接请求用于请求连接播放终端和显示终端；接收上述显示终端在确定与播放终端进行连接后返回的连接响应，其中，该连接响应中携带显示终端的终端类型以及码流解码能力。在本实施例中，播放终端可以获知显示终端的终端类型以及码流解码能力，从而依据显示终端的终端类型选择共享方式，以及依据码流解码能力来决定向显示终端发送解码后的视频数据，还是直接发送视频码流。In an optional embodiment, the foregoing apparatus is further configured to: before acquiring the view information reported by the display terminal connected to the play terminal, perform the following operations: when determining that the display terminal accesses the network where the play terminal is located, to the display terminal Sending a connection request, wherein the connection request is used to request to connect the play terminal and the display terminal; and receiving a connection response returned by the display terminal after determining to connect with the play terminal, wherein the connection response carries the terminal type and code of the display terminal Stream decoding capability. In this embodiment, the playing terminal can learn the terminal type of the display terminal and the code stream decoding capability, thereby selecting the sharing mode according to the terminal type of the display terminal, and determining to send the decoded video data to the display terminal according to the code stream decoding capability. Still send the video stream directly.
在一个可选的实施例中，显示终端间可以进行视角共享追踪，下面对此进行说明：上述第一获取模块112设置为：获取与播放终端连接的第一显示终端上报的第一视角信息，其中，该第一视角信息与第二显示终端预先上报的第二视角信息相同，该第二显示终端与播放终端连接；上述第二获取模块114设置为：获取发送给上述第二显示终端的与第二视角信息对应的视频区域；上述返回模块116设置为：将获取的与第二视角信息对应的视频区域发送给第一显示终端进行视频播放。In an optional embodiment, the display terminal can perform the perspective sharing tracking. The first acquisition module 112 is configured to: acquire the first perspective information reported by the first display terminal connected to the playback terminal. The first viewing angle information is the same as the second viewing angle information reported by the second display terminal, and the second display terminal is connected to the playing terminal. The second acquiring module 114 is configured to: acquire and send to the second display terminal. a video area corresponding to the second view information; the returning module 116 is configured to: send the acquired video area corresponding to the second view information to the first display terminal for video playback.
上述图11所示的装置可以应用于播放终端中。The above-described apparatus shown in FIG. 11 can be applied to a playback terminal.
图12是根据本发明实施例的第二种视频播放装置的结构框图，如图12所示，该装置包括上报模块122，接收模块124和播放模块126，下面 对该装置进行说明：FIG. 12 is a structural block diagram of a second video playing device according to an embodiment of the present invention. As shown in FIG. 12, the device includes a reporting module 122, a receiving module 124, and a playing module 126. The device is described below:
上报模块122，设置为向连接的播放终端上报视角信息，其中，与该播放终端连接的显示终端的数量为两个以上，上述视角信息为在观看视频时的视角信息；接收模块124，连接至上述上报模块122，设置为接收上述播放终端返回的与视角信息对应的视频区域；播放模块126，连接至上述接收模块124，设置为依据上述视频区域进行视频播放。The reporting module 122 is configured to report the viewing angle information to the connected playing terminal, where the number of the display terminals connected to the playing terminal is two or more, the viewing angle information is the viewing angle information when watching the video, and the receiving module 124 is connected to The reporting module 122 is configured to receive a video area corresponding to the viewing angle information returned by the playback terminal, and the playing module 126 is connected to the receiving module 124 and configured to perform video playback according to the video area.
在一个可选的实施例中，上述接收模块124包括：第一接收单元，设置为接收播放终端返回的与视角信息对应的视频的视频数据；或者，In an optional embodiment, the receiving module 124 includes: a first receiving unit, configured to receive video data of a video corresponding to the viewing angle information returned by the playing terminal; or
上述接收模块124包括：第二接收单元，设置为接收播放终端返回的与视角信息对应的视频的视频码流；以及解析单元，连接至上述第二接收单元，设置为对与视角信息对应的视频的视频码流进行解析得到视频数据。The receiving module 124 includes: a second receiving unit, configured to receive a video code stream of a video corresponding to the viewing angle information returned by the playing terminal; and a parsing unit connected to the second receiving unit, configured to set a video corresponding to the viewing angle information The video stream is parsed to obtain video data.
在一个可选的实施例中，上述装置还设置为在向连接的播放终端上报视角信息之前，在接入上述播放终端所在的网络后，接收播放终端发送的用于请求进行连接的连接请求；在确定与播放终端进行连接后向播放终端返回连接响应，其中，该连接响应中携带终端类型以及码流解码能力。In an optional embodiment, the foregoing apparatus is further configured to: before accessing the network where the playing terminal is located, before receiving the viewing angle information to the connected playing terminal, receiving a connection request sent by the playing terminal for requesting connection; After determining to connect with the playing terminal, returning a connection response to the playing terminal, wherein the connection response carries the terminal type and the code stream decoding capability.
在一个可选的实施例中，显示终端间可以进行视角共享追踪，下面对此进行说明：上述上报模块122设置为：向连接的播放终端上报第一视角信息，其中，该第一视角信息与第二显示终端预先上报的第二视角信息相同，该第二显示终端与播放终端连接；上述接收模块124设置为：接收上述播放终端返回的发送给第二显示终端的与第二视角信息对应的视频区域；上述播放模块126设置为：依据与上述第二视角信息对应的视频区域进行视频播放。In an optional embodiment, the viewing angle sharing tracking can be performed between the display terminals. The following is described: the reporting module 122 is configured to report the first viewing angle information to the connected playing terminal, where the first viewing angle information is The second display terminal is connected to the playback terminal, and the receiving module 124 is configured to: receive the second viewing angle information corresponding to the second display terminal that is sent by the playback terminal and is sent to the second display terminal. The video module is configured to: perform video playback according to a video area corresponding to the second perspective information.
上述图12所示的装置可以应用于显示终端中。The above-described apparatus shown in Fig. 12 can be applied to a display terminal.
下面结合服务器、播放终端以及显示终端对本发明实施例中的视频共享装置进行整体说明：The video sharing device in the embodiment of the present invention is generally described below in conjunction with a server, a playback terminal, and a display terminal:
图13是根据本发明实施例的家庭全景视频的共享装置，如图13所示，该装置(即，共享装置1300)包括服务器部分和两种终端，终端包括：播 放终端和显示终端。其中，一个播放终端可以连接多个显示终端。下面对图13所示的各模块进行说明：FIG. 13 is a sharing device of a home panoramic video according to an embodiment of the present invention. As shown in FIG. 13, the device (ie, the sharing device 1300) includes a server portion and two types of terminals, and the terminal includes: a playback terminal and a display terminal. Wherein, one playing terminal can connect to multiple display terminals. The following shows the modules shown in Figure 13:
1301服务器：服务器设置为存储全景视频，一个全景视频节目，可能有一路或多路码流，多路码流的情况下，每一路码流可以对应全景视频的一个视角。1301 server: The server is set to store panoramic video, a panoramic video program, and may have one or more code streams. In the case of multiple code streams, each code stream may correspond to a perspective of the panoramic video.
1302播放终端包括：1303控制模块(对应于上述的第一获取模块112和第二获取模块114)，设置为连接显示终端的接入模块，同时设置为接收来自显示终端的视角数据和发送播放终端的片源数据；1304解码模块(对应于上述的返回模块116的解码功能)，设置为解析全景视频相应视角的数据并输出图像数据。The 1302 playback terminal includes: a 1303 control module (corresponding to the first obtaining module 112 and the second obtaining module 114 described above), configured to connect the access module of the display terminal, and configured to receive the viewing angle data from the display terminal and the transmitting playback terminal. The slice source data; the 1304 decoding module (corresponding to the decoding function of the return module 116 described above) is configured to parse the data of the corresponding view of the panoramic video and output the image data.
1305显示终端包括：1307接入模块，接入网络和与播放终端的控制模块进行数据交互；1306传感器模块，用户移动头部后，用来采集当前的视角偏移数据；1308显示模块(对应于上述的播放模块126)：显示相应视角的视频图像。The 1305 display terminal comprises: 1307 access module, accessing the network and performing data interaction with the control module of the play terminal; 1306 sensor module, after the user moves the head, used to collect the current view offset data; 1308 display module (corresponding to The above-mentioned playing module 126): displays a video image of a corresponding viewing angle.
在上述技术方案中，优选地，1301服务器存储全景视频时，一个节目对应，如图8所示，则1302播放终端不需要请求完整视频数据，只需请求播放所需视角区域的视频数据，用于节约网络带宽；如果1301服务器不支持上述方案，则1302播放终端将按照传统方式请求完整的视频数据。In the above technical solution, preferably, when the 1301 server stores the panoramic video, one program corresponds, as shown in FIG. 8 , the 1302 playing terminal does not need to request complete video data, and only needs to play the video data of the required viewing area, To save network bandwidth; if the 1301 server does not support the above scheme, the 1302 playback terminal will request complete video data in the conventional manner.
在上述实施例中，可选地，1305显示终端的接入模块可以通过HDMI、有线、无线等方式接入，1302播放终端的控制模块具备自动发现功能，可主动发现并连接家庭网络环境中存在的任意一个显示终端。In the foregoing embodiment, optionally, the access module of the display terminal of the 1305 terminal can be accessed through HDMI, wired, wireless, etc., and the control module of the 1302 playback terminal has an automatic discovery function, which can actively discover and connect to exist in the home network environment. Any one of the display terminals.
在上述实施例中，可选地，当多个1305显示终端接入1302播放终端，如果1304解码器模块方案上支持，在视角有重叠的情况下，重叠视角的视频数据只需要解析一次，这种方案可以节约播放终端的CPU资源；否则使用传统的解码方式，1304解码器模块为每个1305显示终端对应的视角区域做单独解码，但这种方案会占用较多的CPU资源。In the above embodiment, optionally, when a plurality of 1305 display terminal accesses the 1302 playback terminal, if the 1304 decoder module scheme supports, in the case where the viewing angles overlap, the video data of the overlapping viewing angle only needs to be parsed once, which The scheme can save the CPU resources of the playback terminal; otherwise, the traditional decoding method is used, and the 1304 decoder module separately decodes the view area corresponding to each 1305 display terminal, but this scheme occupies more CPU resources.
根据本发明的另一个实施例，提供了一种视频播放***，包括：服务 器，设置为存储视频码流；播放终端，与所述服务器连接，所述播放终端包括上述任一项实施例中的第一种视频播放装置；显示终端，与所述播放终端连接，所述显示终端的数量为两个以上，所述显示终端包括上述任一项实施例中的第二种视频播放装置。According to another embodiment of the present invention, there is provided a video playing system, comprising: a server configured to store a video code stream; a playback terminal connected to the server, the play terminal comprising any one of the above embodiments The first type of video playback device; the display terminal is connected to the play terminal, and the number of the display terminals is two or more, and the display terminal includes the second video playback device in any of the above embodiments.
通过本发明实施例中的技术方案，可以实现一种家庭全景视频共享的方法和装置，能够在播放单一节目源的情况下，将全景视频共享给家庭多用户观赏。The method and device for sharing a family panoramic video can be implemented by using the technical solution in the embodiment of the present invention, and the panoramic video can be shared to the home multi-user for viewing when a single program source is played.
需要说明的是，上述各个模块是可以通过软件或硬件来实现的，对于后者，可以通过以下方式实现，但不限于此：上述模块均位于同一处理器中；或者，上述各个模块以任意组合的形式分别位于不同的处理器中。It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination. The forms are located in different processors.
本发明的实施例还提供了一种存储介质，该存储介质包括存储的程序，其中，上述程序运行时执行上述任一实施例中的方法。Embodiments of the present invention also provide a storage medium including a stored program, wherein the program runs to perform the method of any of the above embodiments.
可选地，在本实施例中，上述存储介质可以包括但不限于：U盘、只读存储器(Read-Only Memory，简称为ROM)、随机存取存储器(Random Access Memory，简称为RAM)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。Optionally, in the embodiment, the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM). A variety of media that can store program code, such as a hard disk, a disk, or an optical disk.
本发明的实施例还提供了一种处理器，该处理器用于运行程序，其中，该程序运行时执行上述任一实施例中的方法。Embodiments of the present invention also provide a processor for running a program, wherein the program is executed to perform the method of any of the above embodiments.
本发明的实施例还提供了一种电子装置，包括存储器和处理器，该存储器中存储有计算机程序，该处理器被设置为运行计算机程序以执行上述任一项方法实施例中的步骤。Embodiments of the present invention also provide an electronic device comprising a memory and a processor having a computer program stored therein, the processor being arranged to execute a computer program to perform the steps of any of the method embodiments described above.
可选地，上述电子装置还可以包括传输设备以及输入输出设备，其中，该传输设备和上述处理器连接，该输入输出设备和上述处理器连接。Optionally, the electronic device may further include a transmission device and an input and output device, wherein the transmission device is connected to the processor, and the input and output device is connected to the processor.
显然，本领域的技术人员应该明白，上述的本发明的各模块或各步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执行的程序代码来实现，从而，可以将它们存储在存储装置中由计算装置来 执行，并且在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤，或者将它们分别制作成各个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样，本发明不限制于任何特定的硬件和软件结合。It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the scope of the present invention are intended to be included within the scope of the present invention.
工业实用性Industrial applicability
如上所述，本发明实施例提供的一种视频播放方法、装置、***级存储介质具有以下有益效果：实现了在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频，从而解决了相关技术中存在的无法实现在播放单节目源的条件下，让多位用户都可以独立选择视角观赏全景视频的问题，达到提高用户体验的效果。As described above, a video playing method, apparatus, and system level storage medium provided by an embodiment of the present invention have the following beneficial effects: enabling a plurality of users to independently select a viewing angle to view a panoramic video under the condition of playing a single program source. Therefore, the problem that the related technologies cannot realize the viewing of the panoramic video by independently selecting the viewing angle under the condition of playing the single program source can be solved, thereby achieving the effect of improving the user experience.

Claims (20)

  1. 一种视频播放方法，包括：A video playing method includes:
    获取与播放终端连接的显示终端上报的视角信息，其中，所述显示终端的数量为两个以上，所述视角信息为所述显示终端在观看视频时的视角信息；Acquiring the viewing angle information reported by the display terminal connected to the playing terminal, where the number of the display terminals is two or more, and the viewing angle information is viewing angle information when the display terminal is watching the video;
    获取所述视频对应所述视角信息的视频区域；Obtaining a video area corresponding to the view information of the video;
    将获取的所述视频区域返回给所述显示终端进行视频播放。Returning the obtained video area to the display terminal for video playback.
  2. 根据权利要求1所述的方法，其中，获取所述视频对应所述视角信息的视频区域包括：The method of claim 1, wherein acquiring the video region of the video corresponding to the view information comprises:
    汇总所述显示终端上报的视角信息，得到视角并集；Aggregating the viewing angle information reported by the display terminal to obtain a view angle combination;
    向设置为存储所述视频的服务器发送第一请求消息，其中，所述第一请求消息用于请求获取与所述视角并集对应的视频的视频区域；Sending a first request message to a server that is configured to store the video, where the first request message is used to request to acquire a video area of a video corresponding to the view angle union;
    获取所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频区域。Acquiring a video area of the video corresponding to the view angle set returned by the server according to the first request message.
  3. 根据权利要求2所述的方法，其中，接收所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频区域包括以下之一：The method of claim 2, wherein receiving a video region of the video corresponding to the view angle union returned by the server according to the first request message comprises one of the following:
    获取所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频码流；Obtaining a video code stream of the video corresponding to the view angle union returned by the server according to the first request message;
    获取所述服务器依据所述第一请求返回的与所述视角并集对应的视频的视频数据。Acquiring video data of the video corresponding to the view angle set returned by the server according to the first request.
  4. 根据权利要求2所述的方法，其中，所述服务器中存储有两个以上分别与预定角度对应的视频码流，所述服务器具备对所述两个以上视频码流进行分割和/或重组以获取与所述视角并集对应的视频的视频码流的能力。The method according to claim 2, wherein the server stores two or more video code streams respectively corresponding to predetermined angles, and the server is configured to divide and/or recombine the two or more video code streams. The ability to obtain a video stream of video corresponding to the view angle.
  5. 根据权利要求1所述的方法，其中，获取所述视频对应所述视角信息的视频区域包括：The method of claim 1, wherein acquiring the video region of the video corresponding to the view information comprises:
    汇总所述显示终端上报的视角信息以得到视角并集，以及，通过向设置为存储所述视频的服务器发送第二请求消息来获取所述视频的视频码流；And summarizing the view information reported by the display terminal to obtain a view aggregation, and acquiring a video code stream of the video by sending a second request message to a server configured to store the video;
    获取所述视频码流中与所述视角并集对应的视频的视频码流。Obtaining a video code stream of the video corresponding to the view angle union in the video code stream.
  6. 根据权利要求3或5所述的方法，其中，在获取与所述视角并集对应的视频的视频码流后，将获取的所述视频区域返回给所述显示终端进行视频播放包括：The method according to claim 3 or 5, wherein, after acquiring the video code stream of the video corresponding to the view angle, returning the obtained video area to the display terminal for video playback comprises:
    在确定所述显示终端支持码流解码时，将获取的与所述视角并集对应的视频的视频码流返回给所述显示终端进行视频播放；When it is determined that the display terminal supports the code stream decoding, the obtained video code stream of the video corresponding to the view angle union is returned to the display terminal for video playback;
    在确定所述显示终端不支持码流解码时，对与所述视角并集对应的视频的视频码流进行解析，得到视频数据；将所述视频数据返回给所述显示终端进行视频播放。When it is determined that the display terminal does not support the code stream decoding, the video code stream of the video corresponding to the view angle combination is parsed to obtain video data; and the video data is returned to the display terminal for video playback.
  7. 根据权利要求1所述的方法，其中，在获取与所述播放终端连接的所述显示终端上报的所述视角信息之前，所述方法还包括：The method of claim 1, wherein the method further comprises: before acquiring the view information reported by the display terminal connected to the play terminal, the method further comprising:
    在确定所述显示终端接入所述播放终端所在的网络时，向所述显示终端发送连接请求，其中，所述连接请求用于请求连接所述播放终端和所述显示终端；When determining that the display terminal accesses the network where the playing terminal is located, sending a connection request to the display terminal, where the connection request is used to request connection between the playing terminal and the display terminal;
    接收所述显示终端在确定与所述播放终端进行连接后返回的连接响应，其中，所述连接响应中携带所述显示终端的终端类型以及码流解码能力。And receiving, by the display terminal, a connection response returned after determining to connect with the play terminal, where the connection response carries a terminal type of the display terminal and a code stream decoding capability.
  8. 根据权利要求1所述的方法，其中，The method of claim 1 wherein
    获取与播放终端连接的显示终端上报的视角信息包括：获取与播放终端连接的第一显示终端上报的第一视角信息，其中，所述第一视角信息与第二显示终端预先上报的第二视角信息相同，所述第二显示 终端与所述播放终端连接；Acquiring the view information reported by the display terminal connected to the play terminal includes: acquiring the first view information reported by the first display terminal connected to the play terminal, where the first view information and the second view terminal are reported in advance The information is the same, and the second display terminal is connected to the playing terminal;
    获取所述视频对应所述第一视角信息的视频区域包括：获取发送给所述第二显示终端的与所述第二视角信息对应的视频区域；Obtaining the video area corresponding to the first view information of the video includes: acquiring a video area corresponding to the second view information that is sent to the second display terminal;
    将获取的所述视频区域返回给所述显示终端进行视频播放包括：将获取的与所述第二视角信息对应的视频区域发送给所述第一显示终端进行视频播放。Returning the obtained video area to the display terminal for video playback includes: transmitting the acquired video area corresponding to the second perspective information to the first display terminal for video playback.
  9. 一种视频播放方法，包括：A video playing method includes:
    向连接的播放终端上报视角信息，其中，与所述播放终端连接的显示终端的数量为两个以上，所述视角信息为在观看视频时的视角信息；The viewing angle information is reported to the connected playing terminal, where the number of the display terminals connected to the playing terminal is two or more, and the viewing angle information is viewing angle information when watching the video;
    接收所述播放终端返回的与所述视角信息对应的视频区域；Receiving a video area corresponding to the view information returned by the play terminal;
    依据所述视频区域进行视频播放。Video playback is performed according to the video area.
  10. 根据权利要求9所述的方法，其中，接收所述播放终端返回的与所述视角信息对应的视频区域包括以下之一：The method according to claim 9, wherein the receiving the video region corresponding to the view information returned by the playback terminal comprises one of the following:
    接收所述播放终端返回的与所述视角信息对应的视频的视频数据；Receiving video data of a video corresponding to the view information returned by the playback terminal;
    接收所述播放终端返回的与所述视角信息对应的视频的视频码流，对与所述视角信息对应的视频的视频码流进行解析得到视频数据。Receiving a video code stream of the video corresponding to the view information returned by the playback terminal, and parsing a video code stream of the video corresponding to the view information to obtain video data.
  11. 根据权利要求9所述的方法，其中，在向连接的所述播放终端上报所述视角信息之前，所述方法还包括：The method of claim 9, wherein the method further comprises: before reporting the view information to the connected play terminal, the method further comprising:
    在接入所述播放终端所在的网络后，接收所述播放终端发送的用于请求进行连接的连接请求；After accessing the network where the playing terminal is located, receiving a connection request sent by the playing terminal for requesting connection;
    在确定与所述播放终端进行连接后向所述播放终端返回连接响应，其中，所述连接响应中携带终端类型以及码流解码能力。After determining to connect with the play terminal, return a connection response to the play terminal, where the connection response carries a terminal type and a code stream decoding capability.
  12. 根据权利要求9所述的方法，其中，The method of claim 9 wherein
    向连接的播放终端上报视角信息包括：向连接的播放终端上报第 一视角信息，其中，所述第一视角信息与第二显示终端预先上报的第二视角信息相同，所述第二显示终端与所述播放终端连接；The reporting of the view information to the connected play terminal includes: reporting the first view information to the connected play terminal, where the first view information is the same as the second view information reported by the second display terminal in advance, and the second display terminal is The play terminal is connected;
    接收所述播放终端返回的与所述视角信息对应的视频区域包括：接收所述播放终端返回的发送给所述第二显示终端的与所述第二视角信息对应的视频区域；Receiving the video area corresponding to the view information returned by the play terminal includes: receiving a video area corresponding to the second view information sent by the play terminal and sent to the second display terminal;
    依据所述视频区域进行视频播放包括：依据与所述第二视角信息对应的视频区域进行视频播放。Performing video playback according to the video area includes: performing video playback according to a video area corresponding to the second perspective information.
  13. 一种视频播放装置，包括：A video playback device comprising:
    第一获取模块，设置为获取与播放终端连接的显示终端上报的视角信息，其中，所述显示终端的数量为两个以上，所述视角信息为所述显示终端在观看视频时的视角信息；The first obtaining module is configured to acquire the viewing angle information reported by the display terminal connected to the playing terminal, where the number of the display terminals is two or more, and the viewing angle information is the viewing angle information when the display terminal is watching the video;
    第二获取模块，设置为获取所述视频对应所述视角信息的视频区域；a second acquiring module, configured to acquire a video area corresponding to the view information of the video;
    返回模块，设置为将获取的所述视频区域返回给所述显示终端进行视频播放。And returning to the module, configured to return the obtained video area to the display terminal for video playback.
  14. 根据权利要求13所述的装置，其中，所述第二获取模块包括：The apparatus of claim 13, wherein the second acquisition module comprises:
    第一汇总单元，设置为汇总所述显示终端上报的视角信息，得到视角并集；a first summary unit, configured to summarize view angle information reported by the display terminal, to obtain a view angle combination;
    发送单元，设置为向设置为存储所述视频的服务器发送第一请求消息，其中，所述第一请求消息用于请求获取与所述视角并集对应的视频的视频区域；a sending unit, configured to send a first request message to a server that is configured to store the video, where the first request message is used to request to acquire a video area of a video corresponding to the view aggregation;
    第一获取单元，设置为获取所述服务器依据所述第一请求消息返回的与所述视角并集对应的视频的视频区域。The first obtaining unit is configured to acquire a video area of the video corresponding to the view angle set returned by the server according to the first request message.
  15. 根据权利要求13所述的装置，其中，所述第二获取模块包 括：The apparatus of claim 13 wherein said second acquisition module comprises:
    第二汇总单元，设置为汇总所述显示终端上报的视角信息以得到视角并集，以及，通过向设置为存储所述视频的服务器发送第二请求消息来获取所述视频的视频码流；a second summary unit, configured to summarize the view information reported by the display terminal to obtain a view aggregation, and obtain a video code stream of the video by sending a second request message to a server configured to store the video;
    第二获取单元，设置为获取所述视频码流中与所述视角并集对应的视频的视频码流。And a second acquiring unit, configured to acquire a video code stream of the video corresponding to the view angle union in the video code stream.
  16. 一种视频播放装置，包括：A video playback device comprising:
    上报模块，设置为向连接的播放终端上报视角信息，其中，与所述播放终端连接的显示终端的数量为两个以上，所述视角信息为在观看视频时的视角信息；The reporting module is configured to report the viewing angle information to the connected playing terminal, where the number of the display terminals connected to the playing terminal is two or more, and the viewing angle information is viewing angle information when watching the video;
    接收模块，设置为接收所述播放终端返回的与所述视角信息对应的视频区域；a receiving module, configured to receive a video area corresponding to the view information returned by the play terminal;
    播放模块，设置为依据所述视频区域进行视频播放。The playing module is configured to perform video playback according to the video area.
  17. 根据权利要求16所述的装置，其中，所述接收模块包括：The apparatus of claim 16 wherein said receiving module comprises:
    第一接收单元，设置为接收所述播放终端返回的与所述视角信息对应的视频的视频数据；或者，a first receiving unit, configured to receive video data of a video corresponding to the view information returned by the play terminal; or
    第二接收单元，设置为接收所述播放终端返回的与所述视角信息对应的视频的视频码流；以及解析单元，设置为对与所述视角信息对应的视频的视频码流进行解析得到视频数据。a second receiving unit, configured to receive a video code stream of the video corresponding to the view information returned by the play terminal, and a parsing unit configured to parse the video bit stream of the video corresponding to the view information to obtain a video data.
  18. 一种视频播放***，包括：A video playback system comprising:
    服务器，设置为存储视频码流；a server, configured to store a video stream;
    播放终端，与所述服务器连接，所述播放终端包括权利要求13-15中任一项所述的装置；a playback terminal, connected to the server, the playback terminal comprising the apparatus of any one of claims 13-15;
    显示终端，与所述播放终端连接，所述显示终端的数量为两个以上，所述显示终端包括权利要求16-17中任一项所述的装置。The display terminal is connected to the play terminal, and the number of the display terminals is two or more, and the display terminal includes the device according to any one of claims 16-17.
  19. 一种存储介质，所述存储介质包括存储的程序，其中，所述程序运行时执行权利要求1至8中任一项所述的方法，或者执行权利要求9至12任一项中所述的方法。A storage medium, the storage medium comprising a stored program, wherein the program is executed to perform the method of any one of claims 1 to 8, or to perform the method of any one of claims 9 to method.
  20. 一种电子装置，包括存储器和处理器，所述存储器中存储有计算机程序，所述处理器被设置为运行所述计算机程序以执行所述权利要求1至8任一项中所述的方法，或者执行权利要求9至12任一项中所述的方法。An electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to execute the computer program to perform the method of any one of claims 1 to 8, Or the method of any one of claims 9 to 12 is carried out.
PCT/CN2018/080939 2017-11-27 2018-03-28 Video playing method, apparatus and system, and storage medium WO2019100631A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711203201.1 2017-11-27
CN201711203201.1A CN109842792B (en) 2017-11-27 2017-11-27 Video playing method, device, system and storage medium

Publications (1)

Publication Number Publication Date
WO2019100631A1 true WO2019100631A1 (en) 2019-05-31

Family

ID=66631802

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/080939 WO2019100631A1 (en) 2017-11-27 2018-03-28 Video playing method, apparatus and system, and storage medium

Country Status (2)

Country Link
CN (1) CN109842792B (en)
WO (1) WO2019100631A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110719522B (en) * 2019-10-31 2021-12-24 广州视源电子科技股份有限公司 Video display method and device, storage medium and electronic equipment
CN111246261A (en) * 2020-02-28 2020-06-05 北京视博云信息技术有限公司 Content delivery method, device and system
CN111526323B (en) * 2020-03-24 2023-05-23 视联动力信息技术股份有限公司 Panoramic video processing method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106162204A (en) * 2016-07-06 2016-11-23 传线网络科技（上海）有限公司 Panoramic video generation, player method, Apparatus and system
CN106385587A (en) * 2016-09-14 2017-02-08 三星电子（中国）研发中心 Method, device and system for sharing virtual reality view angle
US20170180680A1 (en) * 2015-12-21 2017-06-22 Hai Yu Object following view presentation method and system
CN107395984A (en) * 2017-08-25 2017-11-24 北京佰才邦技术有限公司 A kind of method and device of transmission of video

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4642538B2 (en) * 2005-04-20 2011-03-02 キヤノン株式会社 Image processing method and image processing apparatus
US9270976B2 (en) * 2005-11-02 2016-02-23 Exelis Inc. Multi-user stereoscopic 3-D panoramic vision system and method
US9192860B2 (en) * 2010-11-08 2015-11-24 Gary S. Shuster Single user multiple presence in multi-user game
US9524588B2 (en) * 2014-01-24 2016-12-20 Avaya Inc. Enhanced communication between remote participants using augmented and virtual reality
US9818225B2 (en) * 2014-09-30 2017-11-14 Sony Interactive Entertainment Inc. Synchronizing multiple head-mounted displays to a unified space and correlating movement of objects in the unified space
US20170061686A1 (en) * 2015-08-28 2017-03-02 Hai Yu Stage view presentation method and system
CN106572359A (en) * 2016-10-27 2017-04-19 乐视控股（北京）有限公司 Method and device for synchronously playing panoramic video on multiple terminals

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170180680A1 (en) * 2015-12-21 2017-06-22 Hai Yu Object following view presentation method and system
CN106162204A (en) * 2016-07-06 2016-11-23 传线网络科技（上海）有限公司 Panoramic video generation, player method, Apparatus and system
CN106385587A (en) * 2016-09-14 2017-02-08 三星电子（中国）研发中心 Method, device and system for sharing virtual reality view angle
CN107395984A (en) * 2017-08-25 2017-11-24 北京佰才邦技术有限公司 A kind of method and device of transmission of video

Also Published As

Publication number Publication date
CN109842792B (en) 2021-05-11
CN109842792A (en) 2019-06-04

Similar Documents

Publication Publication Date Title
US11282283B2 (en) System and method of predicting field of view for immersive video streaming
US11974001B2 (en) Secondary content insertion in 360-degree video
WO2018171487A1 (en) Panoramic video playback method and client terminal
CN110383848B (en) Customized video streaming for multi-device presentation
WO2019096064A1 (en) Data transmission method and device, storage medium, and electronic device
US10659815B2 (en) Method of dynamic adaptive streaming for 360-degree videos
CN107896333A (en) The method and device that a kind of remote control panoramic video based on intelligent terminal plays
US20200145736A1 (en) Media data processing method and apparatus
TWI786572B (en) Immersive media providing method and acquiring method, device, equipment and storage medium
WO2019100631A1 (en) Video playing method, apparatus and system, and storage medium
KR102564729B1 (en) Method and apparatus for transmitting information on 3D content including a plurality of viewpoints
CN110798707B (en) Method, client and server for transmitting media data
WO2014190655A1 (en) Application synchronization method, application server and terminal
CN108810567B (en) Audio and video visual angle matching method, client and server
CN110662119A (en) Video splicing method and device
US10694245B2 (en) Device, system, and method for game enhancement using cross-augmentation
CN112188219B (en) Video receiving method and device and video transmitting method and device
CN109686341B (en) Video display method and device, display equipment and display system
KR20150073573A (en) Method and apparatus for displaying contents related in mirroring picture
US11134236B2 (en) Image processing device and system
KR101406425B1 (en) The differential media content transmission method and system according to the network status in a home environment
CN112583814A (en) Multi-terminal equipment merging playing method
EP3386203A1 (en) Signalling of auxiliary content for a broadcast signal
KR20200080041A (en) Method and apparatus for generating multi channel images using mobile terminal
KR102465403B1 (en) Method and device for providing video contents that combine 2d video and 360 video

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18881971

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30/09/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18881971

Country of ref document: EP

Kind code of ref document: A1