WO2022217416A1 - 手机多机位可切换虚拟摄像头 - Google Patents

手机多机位可切换虚拟摄像头 Download PDF

Info

Publication number
WO2022217416A1
WO2022217416A1 PCT/CN2021/086530 CN2021086530W WO2022217416A1 WO 2022217416 A1 WO2022217416 A1 WO 2022217416A1 CN 2021086530 W CN2021086530 W CN 2021086530W WO 2022217416 A1 WO2022217416 A1 WO 2022217416A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile phone
camera
video
virtual camera
video frame
Prior art date
Application number
PCT/CN2021/086530
Other languages
English (en)
French (fr)
Inventor
周绮
秦绮玲
Original Assignee
苏州思萃人工智能研究所有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州思萃人工智能研究所有限公司 filed Critical 苏州思萃人工智能研究所有限公司
Priority to PCT/CN2021/086530 priority Critical patent/WO2022217416A1/zh
Publication of WO2022217416A1 publication Critical patent/WO2022217416A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion

Definitions

  • the invention relates to the field of live video and the Internet, in particular to a multi-camera switchable virtual camera of a mobile phone.
  • the present invention discloses a multi-camera switchable virtual camera of a mobile phone.
  • the virtual camera is a virtual camera video frame buffer.
  • the mobile phone processor CPU
  • the application module fetches the video frame
  • the address of the video frame of the camera is changed to the address of the video frame buffer of the virtual camera, that is, the virtual camera is used instead of the camera of the mobile phone to capture the video frame.
  • the video data of the video frame buffer of the virtual camera is switched to the slave mobile phone by the mobile phone multi-camera multi-scene video switching system deployed on the host mobile phone and received the push stream, and then is decoded into the video or written by the mobile phone.
  • the mobile phone multi-camera multi-scene video switching system includes: a host mobile phone, at least one slave mobile phone, and a cloud backup server.
  • the host mobile phone and the slave mobile phone are connected to the Internet through a wireless network
  • the cloud backup server is connected to the host mobile phone through the Internet.
  • the wireless network and the Internet transmit video stream data.
  • the plurality of slave mobile phones and cloud backup multimedia content can be switched under the command and control of the host mobile phone, and the host mobile phone camera is replaced with virtual cameras of different slave mobile phone scenarios.
  • the slave mobile phone is in a standby state before switching.
  • the slave mobile phone In the standby state, the slave mobile phone continuously collects video signals through the local camera, encodes them by the local video encoder, and sends them to the HTTP server for broadcast, and the data is first-in, first-out. Further, when the host mobile phone is switched to the slave mobile phone, the host mobile phone initiates a push request to the slave mobile phone, and the video signal collected by the slave mobile phone is encoded by the video and sent to the host mobile phone through its built-in HTTP server. push flow. Further, after the host mobile phone receives the video stream pushed by the slave mobile phone, the video is decoded and sent to the virtual camera video frame buffer in frame order.
  • the cloud standby multimedia content is stored on the cloud standby server, and each piece of content has an independent URL, and the anchor mobile phone, when switching to the multimedia content, retrieves the multimedia content from the cloud standby server through the URL. data. Further, according to the different formats of the multimedia data, after being processed into a video frame of the same format as that required by the virtual camera video frame buffer, it is sent to the virtual camera video frame buffer.
  • the technical scheme of the present invention enables mobile phone users to obtain different scenes through multiple slave mobile phones, and flexibly complete video scene switching between these scenes through the host mobile phone; Multimedia content insertion; the virtual camera method of the present invention, when the host mobile phone is switched to the slave mobile phone, replaces the video frame collected by the host mobile phone camera with the slave mobile phone video frame, and only replaces the mobile phone camera with a virtual camera, thereby It will not affect the play of other video processing functions during live video; the video multi-scene switching and multimedia switching of the present invention are realized by multiple mobile phones, and have the advantages of low cost, simple and convenient use.
  • FIG. 1 is a schematic structural diagram of a simulated virtual camera provided by a preferred embodiment of the present invention
  • FIG. 2 is a system diagram of a multi-camera multi-scene mobile phone provided by a preferred embodiment of the present invention
  • FIG. 3 is a mobile phone simulation provided by a preferred embodiment of the present invention. The flow chart of the anchor's mobile phone camera.
  • FIG. 1 is a schematic structural diagram of a simulated virtual camera provided by a preferred embodiment of the present invention.
  • 1 is the camera of the host mobile phone
  • 2 is the virtual camera video frame buffer
  • 3 is the application module that the host mobile phone runs
  • 4 is the host mobile phone CPU
  • 5 is the live broadcast mobile phone wireless Module
  • 6 is the built-in video stream buffer of the host mobile phone
  • 7 is the video decoder of the host mobile phone.
  • FIG. 1 is only a block diagram of a partial structure related to the technical solution, and does not constitute a limitation on the mobile phone device to which the solution of the present application is applied. More and fewer components are shown in the figures, either in combination with certain components or with different arrangements of the components.
  • FIG. 2 is a diagram of a mobile phone multi-camera multi-scene system provided by a preferred embodiment of the present invention.
  • the system includes: a cloud backup server 21, the Internet 22, a WiFi local area network 23, two slave mobile phones 24, and a host mobile phone 25.
  • 24 and 25 are connected to the same WiFi network 23; then 23 is then connected to the Internet 22, and 21 is also connected to 22.
  • the host mobile phone 25 controls the instruction to switch the live stream from 25 to 24, the video stream of 24 is transmitted to 22 through 23; Obtain the multimedia content.
  • FIG. 3 is a flowchart of a slave mobile phone simulating a host mobile phone camera according to a preferred embodiment of the present invention. As shown in Figure 3, the steps are as follows: S11, the application module of the host mobile phone calls the local camera to collect video; S12, the host mobile phone runs an instruction to switch to the slave mobile phone.
  • the host mobile phone initiates a push request to the slave mobile phone, and turns to the virtual camera to fetch the video frame instruction to the application module one by one; S13, the application module will fetch the video frame from the host camera address to the virtual camera video frame buffer address, from the virtual camera
  • the video frame buffer fetches the video frame;
  • S14 the slave mobile phone receives the stream push request instruction of the host mobile phone, and pushes the stream to the host mobile phone;
  • S15 the host mobile phone stores the video stream of the host mobile phone after receiving the push stream from the slave mobile phone buffer;
  • S16 the video stream stored in the video stream buffer by the host mobile phone is decoded in frame order, and then sent to the virtual camera video frame buffer; S17, the host mobile phone CPU sends a new push stream switching request, and returns to S11.
  • This embodiment also provides a computer-readable storage medium, which is characterized in that it includes a computer program, and when the computer program is executed on the processor, the method for switching a virtual camera with a multi-camera switch of a mobile phone is executed. .
  • a computer-readable storage medium which is characterized in that it includes a computer program, and when the computer program is executed on the processor, the method for switching a virtual camera with a multi-camera switch of a mobile phone is executed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

一种手机多机位可切换虚拟摄像头，虚拟摄像头是一个虚拟摄像头视频帧缓存器，手机处理器可以控制应用模块在从摄像头取视频帧时，将摄像头视频帧地址改为虚拟摄像头视频帧缓存器地址，即，用虚拟摄像头替代手机摄像头采集视频帧。虚拟摄像头视频帧缓存器的视频数据由部署在主播手机上的手机多机位多场景视频切换***，在切换到从播手机并收到其推流后，经视频解码后写入或由云备播服务器推流经视频解码后写入。用户在做直播时，可以通过多个从播手机获取不同场景，可以通过云备播方式预编丰富的多媒体内容，并灵活地在这些场景视频和云备播多媒体内容之间完成直播内容切换。

Description

手机多机位可切换虚拟摄像头 技术领域
本发明涉及视频直播和互联网领域，特别涉及一种手机多机位可切换虚拟摄像头。
 背景技术
为了实现专业电视台一样的直播效果，需要多角度多场景拍摄视频，并在直播时不断切换所拍摄的视频场景，实现丰富的直播内容效果。电视台的做法是采用多摄像机拍摄，通过视频切换台和编辑***实现。网络大咖们的做法是和电视台采用的方法一样，通过一个制作团队和专业切换与编辑设备完成多机位多场景视频切换。还有一种方法是，当需要多个手机采集的视频互相切换时，将这些视频推到各自的私有云服务器进行云切换与编辑，实现手机多机位多场景直播切换。
 技术问题
上述方案都存在设备成本昂贵，所需专业人员多，需要的专业技能及成本高昂的问题，一般用户难以承担的痛点。而且，这些技术方案不支持通过手机实现多个手机相互切换，如果采用专业设备实现手机多机位视频切换后，存在无法在现有手机应用程序中使用的问题。
 技术解决方案
为有效地解决上述问题，本发明公开一种手机多机位可切换虚拟摄像头，所述虚拟摄像头是一个虚拟摄像头视频帧缓存器，在手机应用模块调用摄像头时，手机处理器（CPU）可以控制所述应用模块在取视频帧时，将从所述摄像头视频帧地址改为所述虚拟摄像头视频帧缓存器地址，即，用所述虚拟摄像头替代所述手机摄像头采集视频帧。所述虚拟摄像头视频帧缓存器的视频数据由部署在主播手机上的手机多机位多场景视频切换***，在切换到从播手机并收到其推流后，经视频解码后写入或由云备播服务器来的推流经视频解码后写入。根据本发明的一个方面，所述手机多机位多场景视频切换***包括：一个主播手机、至少一个从播手机、云备播服务器。优选地，所述主播手机和从播手机通过无线网络连网，所述云备播服务器通过互联网与所述主播手机连接。进一步，所述无线网络和互联网传输视频流数据。根据本发明的另一方面，所述多个从播手机和云备播多媒体内容可以在主播手机指令控制下切换，用不同从播手机场景的虚拟摄像头替代所述主播手机摄像头。优选地，所述从播手机在切换前，处于备播状态。在所述备播状态，从播手机不断通过本机摄像头采集视频信号，经本地视频编码器编码，送入所述HTTP服务器备播，数据先入先出。进一步，在主播手机切换到从播手机时，主播手机向所述从播手机发起推流请求，所述从播手机所采集的视频信号经视频编码后，通过其内置HTTP服务器向所述主播手机推流。进一步，所述主播手机收到所述从播手机推送来的视频流后，经视频解码，按帧顺序送入所述虚拟摄像头视频帧缓存器。进一步，所述云备播多媒体内容存储在所述云备播服务器上，每条内容有独立URL，主播手机在切换到所述多媒体内容时，通过所述URL从所述云备播服务器取多媒体数据。进一步，根据所述多媒体数据格式不同，经处理成与所述虚拟摄像头视频帧缓存器要求相同格式的视频帧后，送入所述虚拟摄像头视频帧缓存器。
 有益效果
本发明的技术方案为手机用户做直播时，可以通过多个从播手机获取不同的场景，并灵活地在这些场景之间通过主播手机完成视频场景切换；可以通过云备播服务器提供更加丰富的多媒体内容插播；本发明的虚拟摄像头方法，当主播手机切换到从播手机时，用从播手机视频帧替换所述主播手机摄像头采集的视频帧，只是用虚拟摄像头替代了所述手机摄像头，从而不会影响视频直播时的其它视频处理功能的发挥；本发明的视频多场景切换和多媒体切换通过多个手机实现，具有成本低、使用简单方便的优点。
 附图说明
为使本发明的上述目的、特征和优点能够更为明显易懂，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚完整的描述，显然所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基与本发明实施例，本领域普通技术人员在没有做出创造性劳动前提下，所获得的所有其它实施例都属于本发明保护的范围。图1为本发明优先实施例提供的模拟虚拟摄像头结构原理图；图2为本发明优先实施例提供的手机多机位多场景***图；图3为本发明优先实施例提供的从播手机模拟主播手机摄像头流程图。
 本发明的实施方式
为使本发明的上述目的、特征和优点能够更为明显易懂，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚完整的描述，显然所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基与本发明实施例，本领域普通技术人员在没有做出创造性劳动前提下，所获得的所有其它实施例都属于本发明保护的范围。图1为本发明优先实施例提供的模拟虚拟摄像头结构原理图。如图1所示，1为所述主播手机摄像头、2为所述虚拟摄像头视频帧缓存器、3为所述主播手机运行的应用模块、4所述主播手机CPU、5是所述直播手机无线模组、6是所述主播手机内置的视频流缓存器、7是所述主播手机视频解码器。在4发出切换指令后，3转向2取视频帧；同时，被切换的从播手机通过5向6推流，6的视频流经7解码后，按帧顺序写入2。如果4发出切换指令是从云备播服务器取多媒体流，3转向2取视频帧，此时所述云备播流媒体服务器通过5向6推流送视频流，6的视频流经7解码后，按帧顺序写入2。本领域技术人员可以理解图1中示出的结构仅仅是与本技术方案相关的部分结构的框图，并不构成对本申请方案所应用于其上的手机设备的限定，具体的手机设备可以包括比图中所示更多和更少的部件或者组合某些部件或者具有不同的部件布置。图2为本发明优先实施例提供的手机多机位多场景***图。如图2所示，所述***包括：一个云备播服务器21、互联网22、WiFi局域网23、两个从播手机24、一个主播手机25。24和25连接到同一个WiFi网络23上；然后23再连接到互联网22上，21也连接到22上。当主播手机25操控指令将直播流从25切换到24时，24的视频流通过23传送给22；当主播手机25操控指令将直播视频流切换到多媒体内容时，25通过所述URL直接从21获取所述多媒体内容。图3为本发明优先实施例提供的从播手机模拟主播手机摄像头流程图。如图3所示步骤如下：S11、主播手机的应用模块调用本机摄像头采集视频；S12、主播手机运行指令切换到从播手机。主播手机向从播手机发起推流请求，向应用模块按次转向虚拟摄像头取视频帧指令；S13、应用模块将从主播摄像头取视频帧的地址转向从虚拟摄像头视频帧缓存器地址，从虚拟摄像头视频帧缓存器取视频帧；S14、从播手机收到主播手机推流请求指令，向主播手机推流；S15、主播手机收到所述从播手机推流后，存入主播手机的视频流缓存器；S16、主播手机存入视频流缓存器的视频流按帧顺序解码后，送入虚拟摄像头视频帧缓存器；S17、主播手机CPU发请新的推流切换请求，返回S11。本实施例还提供了一种计算机可读存储介质，其特征在于，包括计算机程序，当所示计算机程序在处理器上运行时，使得所述的手机多机位可切换虚拟摄像头切换方法被执行。本发明虽然已以较佳实施例公开如上，但其并不是用来限定本发明，任何本领域技术人员在不脱离本发明的精神和范围内，都可以利用上述揭示的方法和技术内容对本发明技术方案做出可能的变动和修改，因此，凡是未脱离本发明技术方案的内容，依据本发明的技术实质对以上实施例所作的任何简单修改、等同变化及修饰，均属于本发明技术方案的保护范围。

Claims (3)

  1. 一种手机多机位可切换虚拟摄像头，其特征在于，所述虚拟摄像头用一个虚拟摄像头视频帧缓存器模拟，在手机应用模块调用摄像头时，通过手机处理器（CPU）控制应用模块将摄像头视频帧地址改为所述虚拟摄像头视频帧缓存器地址，实现用虚拟摄像头视频帧替代所述手机摄像头视频帧。
  2. 根据权利要求1所述虚拟摄像头视频帧缓存器，其特征在于，所述虚拟摄像头视频帧缓存器的视频数据由部署在主播手机上的手机多机位多场景视频切换***，在切换到从播手机时，将收到从播手机的推流，经视频解码后逐帧写入。
  3. 根据权利要求1所述虚拟摄像头视频帧缓存器，其特征在于，所述虚拟摄像头视频帧缓存器的视频数据在切换到云备播服务器推送的多媒体流后，经视频解码后逐帧写入。
PCT/CN2021/086530 2021-04-12 2021-04-12 手机多机位可切换虚拟摄像头 WO2022217416A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/086530 WO2022217416A1 (zh) 2021-04-12 2021-04-12 手机多机位可切换虚拟摄像头

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/086530 WO2022217416A1 (zh) 2021-04-12 2021-04-12 手机多机位可切换虚拟摄像头

Publications (1)

Publication Number Publication Date
WO2022217416A1 true WO2022217416A1 (zh) 2022-10-20

Family

ID=83639389

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/086530 WO2022217416A1 (zh) 2021-04-12 2021-04-12 手机多机位可切换虚拟摄像头

Country Status (1)

Country Link
WO (1) WO2022217416A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106713975A (zh) * 2016-12-08 2017-05-24 广州华多网络科技有限公司 直播处理方法和装置
JP2017158101A (ja) * 2016-03-03 2017-09-07 三菱電機インフォメーションネットワーク株式会社 仮想カメラ運用システム
CN109168021A (zh) * 2018-10-25 2019-01-08 京信通信***（中国）有限公司 一种推流的方法及装置
CN112087642A (zh) * 2020-09-07 2020-12-15 北京红云融通技术有限公司 云导播播放方法、云导播服务器及远程管理终端

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017158101A (ja) * 2016-03-03 2017-09-07 三菱電機インフォメーションネットワーク株式会社 仮想カメラ運用システム
CN106713975A (zh) * 2016-12-08 2017-05-24 广州华多网络科技有限公司 直播处理方法和装置
CN109168021A (zh) * 2018-10-25 2019-01-08 京信通信***（中国）有限公司 一种推流的方法及装置
CN112087642A (zh) * 2020-09-07 2020-12-15 北京红云融通技术有限公司 云导播播放方法、云导播服务器及远程管理终端

Similar Documents

Publication Publication Date Title
WO2016131223A1 (zh) 一种视频帧丢帧方法及视频发送装置
US20150208103A1 (en) System and Method for Enabling User Control of Live Video Stream(s)
CN107040794A (zh) 视频播放方法、服务器、虚拟现实设备以及全景虚拟现实播放***
CN104954633A (zh) 一种直播导播的方法、客户端及***
US10708469B2 (en) Image processing apparatus, method of controlling the same, non-transitory computer-readable storage medium, and image processing system
CN110636257B (zh) 一种监控视频处理方法、装置、电子设备及存储介质
CN107835435B (zh) 一种赛事宽视角直播设备和相关联的直播***和方法
CN115250356A (zh) 手机多机位可切换虚拟摄像头
JP2020524450A (ja) 多チャネル映像のための伝送システム及びその制御方法、多チャネル映像再生方法及びその装置
CN108989833B (zh) 一种视频封面图像的生成方法及装置
CN108574816B (zh) 一种视联网终端以及基于视联网终端的通信方法、装置
CN108282685A (zh) 一种音视频同步的方法及监控***
CN108965930B (zh) 一种视频数据处理的方法和装置
CN114630051A (zh) 视频处理方法以及***
CN110460898B (zh) 一种视频处理方法及***、装置、机器可读介质
CN112866725A (zh) 一种直播控制方法及装置
CN113194278A (zh) 一种会议控制方法、装置及计算机可读存储介质
CN109544879B (zh) 一种报警数据的处理方法和***
CN110769179B (zh) 一种音视频数据流的处理方法和***
CN104348845A (zh) 一种Wi-Fi相机接入互联网的***及方法
CN110661992A (zh) 数据处理方法和装置
CN104038741A (zh) 一种视频数据的投影方法
WO2022217416A1 (zh) 手机多机位可切换虚拟摄像头
CN108632635B (zh) 一种基于视联网的数据处理方法和装置
CN115225920A (zh) 手机多机位多场景云支撑直播***

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21936311

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE