CN110784525A - Cloud mobile phone control method, system and storage medium based on H5 webpage technology - Google Patents
Cloud mobile phone control method, system and storage medium based on H5 webpage technology Download PDFInfo
- Publication number
- CN110784525A CN110784525A CN201910977546.5A CN201910977546A CN110784525A CN 110784525 A CN110784525 A CN 110784525A CN 201910977546 A CN201910977546 A CN 201910977546A CN 110784525 A CN110784525 A CN 110784525A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- cloud mobile
- module
- control service
- service module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
- H04L69/162—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
Abstract
The invention discloses a cloud mobile phone control method, a system and a storage medium based on H5 webpage technology, wherein the method comprises the following steps: after a user logs in a client to connect cloud mobile phone equipment, the user connects a control service module through an SDK interface of an H5 webpage, and sends the serial number of the cloud mobile phone equipment to the control service module; the control service module is connected with a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, so that the remote playing module is pushed to the control service module; the video data and the audio data on the cloud mobile phone equipment are coded through the remote playing module and are sent to the control service module in a websocket mode; and after the control service module transmits the received video data and audio data which are subjected to coding processing to the client, the client decodes and plays the video data and the audio data through an H5 webpage technology. According to the invention, the cloud mobile phone can be controlled through the H5 webpage technology, so that real-time interaction between a user and the cloud mobile phone is realized, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of cloud networks, in particular to a cloud mobile phone control method and system based on an H5 webpage technology and a storage medium.
Background
The cloud mobile phone is a smart phone application cloud platform based on cloud computing powerful virtual application and the mobile internet. Based on the outstanding advantages of cloud computing in large-scale computing, strong storage capacity, virtualization application and the like, the cloud platform provides diversified and omnibearing virtual mobile phone application and service for a smart mobile phone user, comprehensively supports display, downloading, application and management service of various mobile phone application programs, excellently realizes all-weather cloud intelligent hosting application, enables the user to be capable of hosting various used programs to the cloud under the state of being separated from a mobile terminal, keeps all-weather online state and comprehensively realizes smart mobile phone application virtualization.
At present, when a user uses a cloud mobile phone on a webpage, the picture of the cloud mobile phone needs to be transmitted to an H5 interface and played in real time through a decoding technology of H5, so that the user can obtain the experience of really using the mobile phone. However, if the user only plays, the user does not interact with the cloud mobile phone, and the significance of the cloud mobile phone is lost. Because the cloud mobile phone is also a mobile phone in a certain sense, the user can operate applications, play games and the like on the cloud mobile phone as an actual mobile phone. Therefore, a method for enabling a client to remotely control a cloud mobile phone on a webpage is needed, so that the purpose of interaction between the client and the cloud mobile phone is achieved.
Disclosure of Invention
The technical problem to be solved by the embodiments of the present invention is to provide a cloud phone control method, system and storage medium based on an H5 webpage technology, which can implement real-time interaction between a user and a cloud phone.
In order to solve the above problem, an embodiment of the present invention provides a cloud mobile phone control method based on an H5 web page technology, which at least includes the following steps:
after a user logs in a client to connect cloud mobile phone equipment, the user connects a control service module through an SDK interface of an H5 webpage, and sends the serial number of the cloud mobile phone equipment to the control service module;
the control service module is connected with a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, so that the remote playing module is pushed to the control service module;
the video data and the audio data on the cloud mobile phone equipment are coded through the remote playing module and are sent to the control service module in a websocket mode;
and after the control service module transmits the received video data and audio data which are subjected to coding processing to the client, the client decodes and plays the video data and the audio data through an H5 webpage technology.
Further, the cloud mobile phone control method based on the H5 webpage technology further includes:
and the interaction with the cloud mobile phone equipment is completed through the control service module and the remote playing module.
Further, the SDK interface of the H5 webpage is connected to the control service module, and the serial number of the cloud mobile phone device is sent to the control service module, specifically:
after a request for connecting cloud mobile phone equipment sent by a client is received, an SDK interface of an H5 webpage identifies the serial number of the cloud mobile phone equipment and calls a background interface so that the background interface returns the IP address and port information of a control service node where the cloud mobile phone equipment is located;
and after receiving the IP address and the port information, the SDK interface is in long connection with the control service module in a websocket mode.
Further, the encoding process further includes:
and converting the video data in the cloud mobile phone equipment into video data in an h264 format through the remote playing module.
Further, the control service module includes a video encoder, a data transmitter, and an event handler.
Further, the interaction with the cloud mobile phone device is completed through the control service module and the remote play module, and specifically includes:
sending the event type and the coordinates of the event occurrence to the service control module through an SDK interface;
the service control module transmits the event type and the coordinates of the event occurrence to an event processor in the remote playing module;
converting the occurrence coordinates of the event into real coordinates of the cloud mobile phone according to the proportion of pixels through an event processor, and returning the converted picture to the service control module after the event processing is finished;
and the converted pictures are collected into a video stream through the service control module and are sent to the client in real time so that the client decodes and plays the video stream.
Further, the event types include single click, double click, long press, touch, and drop down slider.
An embodiment of the present invention provides a cloud mobile phone control system based on an H5 web page technology, including:
the client module is used for enabling a user to log in a client to be connected with the cloud mobile phone device, connecting the client to the control service module through an SDK interface of an H5 webpage, and sending the serial number of the cloud mobile phone device to the control service module; receiving the video data and the audio data which are sent by the control service module and subjected to coding processing, and decoding and playing the video data and the audio data through an H5 webpage technology;
the control service module is used for connecting a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device and transmitting the received video data and audio data which are subjected to coding processing to the client module;
the remote playing module is used for pushing the stream to the control service module after being connected with the control service module; and coding the video data and the audio data on the cloud mobile phone equipment, and sending the video data and the audio data to the control service module in a websocket mode.
Further, the control service module comprises a video coding unit, a data transmission unit and an event processing unit;
the event processing unit is used for converting the occurrence coordinates of the event sent by the control service module into real coordinates of the cloud mobile phone according to the proportion of pixels, and returning the converted picture to the service control module after the event processing is finished.
Another embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where the computer program, when running, controls a device on which the computer-readable storage medium is located to perform the cloud mobile phone control method based on the H5 webpage technology.
The embodiment of the invention has the following beneficial effects:
the embodiment of the invention provides a cloud mobile phone control method, a cloud mobile phone control system and a storage medium based on an H5 webpage technology, wherein the method comprises the following steps: after a user logs in a client to connect cloud mobile phone equipment, the user connects a control service module through an SDK interface of an H5 webpage, and sends the serial number of the cloud mobile phone equipment to the control service module; the control service module is connected with a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, so that the remote playing module is pushed to the control service module; the video data and the audio data on the cloud mobile phone equipment are coded through the remote playing module and are sent to the control service module in a websocket mode; and after the control service module transmits the received video data and audio data which are subjected to coding processing to the client, the client decodes and plays the video data and the audio data through an H5 webpage technology. The invention can enable the user to control the cloud mobile phone through the H5 webpage technology, realize the real-time interaction between the user and the cloud mobile phone, transmit the interacted pictures in real time, and greatly improve the experience effect of the user when using the cloud mobile phone.
Drawings
Fig. 1 is a schematic flowchart of a cloud mobile phone control method based on an H5 web page technology according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of another cloud mobile phone control method based on the H5 web page technology according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a cloud mobile phone control system based on an H5 web page technology according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Firstly, application scenarios that can be provided by the invention are introduced, for example, a user interacts with a cloud mobile phone in real time through an H5 webpage.
The first embodiment of the present invention:
please refer to fig. 1-2.
As shown in fig. 1, the cloud mobile phone control method based on the H5 web page technology provided in this embodiment at least includes the following steps:
s101, after a user logs in a client to connect cloud mobile phone equipment, connecting the cloud mobile phone equipment with a control service module through an SDK interface of an H5 webpage, and sending the serial number of the cloud mobile phone equipment to the control service module;
specifically, for step S101, when the user clicks and connects a certain cloud mobile phone device by logging in the client, the SDK interface of the H5 webpage first calls the background interface through the unique number of the cloud mobile phone device, and the background interface returns the IP information and the port information of the control service node where the device is located; after receiving the IP information and the port information, the SDK interface of the H5 web page establishes a long connection with the control service module in a websocket manner, so that the control service module is positioned in an intermediary role between the user and the device.
S102, the control service module is connected with a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, so that the remote playing module is pushed to the control service module;
specifically, for step S102, after receiving the connection event, the control service module determines, through the device code, which device to connect with, and starts to push the stream to the control service module. When the plug flow is carried out, the picture displayed by the client side and the picture of the cloud mobile phone are kept synchronous; when the client is not connected, the control service module does not perform any data processing; the other mode is that when a client is connected with the cloud mobile phone, the picture displayed by the client is only a static picture at a certain moment in the cloud mobile phone. The difference between the push stream and the non-push stream is that the display effect of the push stream is equivalent to that of the video stream, the transmitted picture is the video playing picture, and the display effect of the non-push stream is equivalent to that of only one picture.
S103, encoding the video data and the audio data on the cloud mobile phone equipment through the remote playing module, and sending the encoded video data and the audio data to the control service module in a websocket mode;
specifically, for step S103, the control service module connects to a remote-play service on the device, the remote-play starts streaming, converts the video data of the device into an h264 format, and transmits the video data to the control service module in a websocket manner.
And S104, after the control service module transmits the received video data and audio data which are subjected to coding processing to the client module, the client module decodes and plays the video data and the audio data through an H5 webpage technology.
Specifically, for step S104, the control service module transmits the encoded H264 video data to the JS library of the client, so that the client decodes and plays the video data through the H5 web page technology.
In a preferred embodiment, the cloud mobile phone control method based on the H5 webpage technology further includes:
and the interaction with the cloud mobile phone equipment is completed through the control service module and the remote playing module.
In a preferred embodiment, the interaction with the cloud mobile phone device is completed through the control service module and the remote play module, specifically:
sending the event type and the coordinates of the event occurrence to the service control module through an SDK interface;
the service control module transmits the event type and the coordinates of the event occurrence to an event processor in the remote playing module;
converting the occurrence coordinates of the event into real coordinates of the cloud mobile phone according to the proportion of pixels through an event processor, and returning the converted picture to the service control module after the event processing is finished;
and the converted pictures are collected into a video stream through the service control module and are sent to the client in real time so that the client decodes and plays the video stream.
Specifically, the embodiment further provides an implementation method for interaction between a user and a cloud mobile phone through an H5 webpage, which includes the following steps: after a user clicks a certain part of the cloud mobile phone, the SDK interface of the H5 webpage sends the type of an event and the coordinates of the event to the control service module, wherein the type of the event comprises a user single-click, double-click, long-press, touch and pull-down scroll bar; the control service module sends the event type and the coordinate where the time occurs to an event processor in remote-play for realization; the event processor converts the occurrence coordinates of the event into real coordinates of the cloud mobile phone according to the proportion of pixels according to a coordinate conversion formula to obtain a converted picture; after the remote-play finishes processing, transmitting the converted picture to a control service module; the control service module integrates the received converted pictures into a video stream and sends the video stream to the front end, so that the front end decodes and plays the video stream through the SDK of the H5 webpage.
In a specific embodiment, the key to realize the real-time interactive picture of the cloud mobile phone is to correctly convert the occurrence coordinates of the event into the real coordinates of the cloud mobile phone according to the proportion of the pixels through the event processor, and since the pixels of the cloud mobile phone are not consistent with the pixels of the front-end H5 canvas, the pixels need to be converted into the coordinates of the cloud mobile phone according to the proportion of the pixels. Firstly, pixels of a cloud mobile phone and a client side screen are respectively obtained, assuming that the pixels of the cloud mobile phone are w1 × h1 (for example, 1024 multiplied by 768), and the pixels of the client side are w2 × h2 (for example, 1024 multiplied by 1536), when the client clicks a certain coordinate (x1 and y1) on the client side, the coordinate mapped to the cloud mobile phone is (x2 and y2), wherein the coordinate conversion formula is x2 ═ w1/w2 × 1;
y2＝(h1/h2)*y1。
the converted h264 format data has 4 levels of picture quality, namely BP-BaselinE Profile, EP-Extended profile, MP-Main profile and HP-High profile. In this embodiment, BP-Baseline Profile is mainly used, but not limited to BP-Baseline Profile, and different converted image qualities may be used according to actual requirements.
In a preferred embodiment, the control service module is connected through an SDK interface of an H5 webpage, and sends the cloud mobile phone device number to the control service module, specifically:
after a request for connecting cloud mobile phone equipment sent by a client is received, an SDK interface of an H5 webpage identifies the serial number of the cloud mobile phone equipment and calls a background interface so that the background interface returns the IP address and port information of a control service node where the cloud mobile phone equipment is located;
and after receiving the IP address and the port information, the SDK interface is in long connection with the control service module in a websocket mode.
In a preferred embodiment, the encoding process further includes:
and converting the video data in the cloud mobile phone equipment into video data in an h264 format through the remote playing module.
Specifically, a remote-play service on the device is connected through the control service module, the remote-play starts streaming, video data of the device is converted into an h264 format and transmitted to the control service module, and the control service module transmits the h264 video data to the JS library of the client for decoding and playing.
In a preferred embodiment, the control service module includes a video encoder, a data transmitter, and an event handler.
Specifically, in this embodiment, the control service module is an independent functional module based on a TCP protocol, written in a C + + language, and separately deployed, and mainly includes: video coding, data transmission and event processing.
In a preferred embodiment, the event types include single click, double click, long press, touch, and drop down slider.
As shown in fig. 2, this embodiment further provides another implementation manner of a cloud mobile phone control method based on an H5 web technology, where a user connects to a cloud mobile phone, a control service module connects to a remote-play of the corresponding cloud mobile phone for event transmission, and after event processing is completed by the remote-play, the remote-play is pushed to the control service module, so that the control service module sends a video stream to a front end of the user, decodes the video stream, and plays the video.
The cloud mobile phone control method based on the H5 webpage technology provided by the embodiment comprises the following steps: after a user logs in a client to connect cloud mobile phone equipment, the user connects a control service module through an SDK interface of an H5 webpage, and sends the serial number of the cloud mobile phone equipment to the control service module; the control service module is connected with a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, so that the remote playing module is pushed to the control service module; the video data and the audio data on the cloud mobile phone equipment are coded through the remote playing module and are sent to the control service module in a websocket mode; and after the control service module transmits the received video data and audio data which are subjected to coding processing to the client, the client decodes and plays the video data and the audio data through an H5 webpage technology. The invention can enable the user to control the cloud mobile phone through the H5 webpage technology, realize the real-time interaction between the user and the cloud mobile phone, transmit the interacted pictures in real time, and greatly improve the experience effect of the user when using the cloud mobile phone.
Second embodiment of the invention
Please refer to fig. 3.
As shown in fig. 3, an embodiment of the present invention further provides a cloud phone control system based on the H5 web page technology, including:
the client module 100 is used for a user to log in a client to connect with the cloud mobile phone device, connect with the control service module 200 through an SDK interface of an H5 webpage, and send the serial number of the cloud mobile phone device to the control service module 200; receiving the video data and the audio data which are sent by the control service module 200 and are subjected to encoding processing, and decoding and playing the video data and the audio data through an H5 webpage technology;
specifically, for the client module 100, when a user logs in a client and clicks and connects a certain cloud mobile phone device, the SDK interface of the H5 webpage first calls a background interface through the unique number of the cloud mobile phone device, and the background interface returns the IP information and the port information of the control service node where the device is located; after receiving the IP information and the port information, the SDK interface of the H5 webpage establishes a long connection with the control service module in a websocket mode,
the control service module 200 is configured to connect the remote play module 300 of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, and transmit the received video data and audio data after encoding processing to the client module 100;
specifically, for the control service module 200, after receiving the connection event, the control service module 200 determines which device remote-play is connected to through the device code, and starts to push the stream to the control service module 200; and transmitting the received video data and audio data after the encoding processing to the client module 100, so that the client module 100 decodes and plays the video data and the audio data through the H5 webpage technology
The remote playing module 300 is used for pushing the stream to the control service module after being connected with the control service module; and coding the video data and the audio data on the cloud mobile phone equipment, and sending the video data and the audio data to the control service module in a websocket mode.
Specifically, for the remote play module 300, the video data and the audio data on the cloud mobile phone device are encoded and sent to the control service module 200 in a websocket manner.
In a preferred embodiment, the control service module includes a video encoding unit, a data transmission unit, and an event processing unit;
the event processing unit is used for converting the occurrence coordinates of the event sent by the control service module into real coordinates of the cloud mobile phone according to the proportion of pixels, and returning the converted picture to the service control module after the event processing is finished.
In a specific embodiment, the key to realize the real-time interactive picture of the cloud mobile phone is to correctly convert the occurrence coordinates of the event into the real coordinates of the cloud mobile phone according to the proportion of the pixels through the event processor, and since the pixels of the cloud mobile phone are not consistent with the pixels of the front-end H5 canvas, the pixels need to be converted into the coordinates of the cloud mobile phone according to the proportion of the pixels. Firstly, pixels of a cloud mobile phone and a client side screen are respectively obtained, assuming that the pixels of the cloud mobile phone are w1 × h1 (for example, 1024 multiplied by 768), and the pixels of the client side are w2 × h2 (for example, 1024 multiplied by 1536), when the client clicks a certain coordinate (x1 and y1) on the client side, the coordinate mapped to the cloud mobile phone is (x2 and y2), wherein the coordinate conversion formula is x2 ═ w1/w2 × 1;
y2＝(h1/h2)*y1。
the converted h264 format data has 4 levels of picture quality, namely BP-BaselinE Profile, EP-Extended profile, MP-Main profile and HP-High profile. In this embodiment, BP-Baseline Profile is mainly used, but not limited to BP-Baseline Profile, and different converted image qualities may be used according to actual requirements.
The cloud mobile phone control system based on the H5 webpage technology provided by the embodiment comprises: the client module 100 is used for a user to log in a client to connect cloud mobile phone equipment, connect a control service module through an SDK interface of an H5 webpage, and send the serial number of the cloud mobile phone equipment to the control service module; receiving the video data and the audio data which are sent by the control service module and subjected to coding processing, and decoding and playing the video data and the audio data through an H5 webpage technology; the control service module 200 is used for connecting a remote play module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device and transmitting the received video data and audio data which are subjected to encoding processing to the client; the remote playing module 300 is used for pushing the stream to the control service module after being connected with the control service module; and coding the video data and the audio data on the cloud mobile phone equipment, and sending the video data and the audio data to the control service module in a websocket mode. The invention can enable the user to control the cloud mobile phone through the H5 webpage technology, realize the real-time interaction between the user and the cloud mobile phone, transmit the interacted pictures in real time, and greatly improve the experience effect of the user when using the cloud mobile phone.
Another embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where the computer program, when running, controls a device on which the computer-readable storage medium is located to perform the cloud mobile phone control method based on the H5 webpage technology.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the modules may be a logical division, and in actual implementation, there may be another division, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
The foregoing is directed to the preferred embodiment of the present invention, and it is understood that various changes and modifications may be made by one skilled in the art without departing from the spirit of the invention, and it is intended that such changes and modifications be considered as within the scope of the invention.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Claims (10)
1. A cloud mobile phone control method based on H5 webpage technology is characterized by at least comprising the following steps:
after a user logs in a client to connect cloud mobile phone equipment, the user connects a control service module through an SDK interface of an H5 webpage, and sends the serial number of the cloud mobile phone equipment to the control service module;
the control service module is connected with a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device, so that the remote playing module is pushed to the control service module;
the video data and the audio data on the cloud mobile phone equipment are coded through the remote playing module and are sent to the control service module in a websocket mode;
and after the control service module transmits the received video data and audio data which are subjected to coding processing to the client, the client decodes and plays the video data and the audio data through an H5 webpage technology.
2. The cloud mobile phone control method based on the H5 webpage technology of claim 1, further comprising:
and the interaction with the cloud mobile phone equipment is completed through the control service module and the remote playing module.
3. The cloud mobile phone control method based on the H5 webpage technology of claim 1, wherein the SDK interface through the H5 webpage is connected to the control service module, and sends the cloud mobile phone device number to the control service module, specifically:
after a request for connecting cloud mobile phone equipment sent by a client is received, an SDK interface of an H5 webpage identifies the serial number of the cloud mobile phone equipment and calls a background interface so that the background interface returns the IP address and port information of a control service node where the cloud mobile phone equipment is located;
and after receiving the IP address and the port information, the SDK interface is in long connection with the control service module in a websocket mode.
4. The cloud phone control method based on the H5 webpage technology of claim 1, wherein the encoding process further includes:
and converting the video data in the cloud mobile phone equipment into video data in an h264 format through the remote playing module.
5. The cloud phone control method based on the H5 webpage technology of claim 1, wherein the control service module comprises a video encoder, a data transmitter and an event processor.
6. The method for controlling the cloud mobile phone based on the H5 web page technology of claim 2, wherein the interaction with the cloud mobile phone device is completed through the control service module and the remote play module, and specifically comprises:
sending the event type and the coordinates of the event occurrence to the service control module through an SDK interface;
the service control module transmits the event type and the coordinates of the event occurrence to an event processor in the remote playing module;
converting the occurrence coordinates of the event into real coordinates of the cloud mobile phone according to the proportion of pixels through an event processor, and returning the converted picture to the service control module after the event processing is finished;
and the converted pictures are collected into a video stream through the service control module and are sent to the client in real time so that the client decodes and plays the video stream.
7. The H5 webpage technology-based cloud mobile phone control method of claim 6, wherein the event types include single click, double click, long press, touch and drop-down slider.
8. A cloud mobile phone control system based on H5 webpage technology is characterized by comprising:
the client module is used for enabling a user to log in a client to be connected with the cloud mobile phone device, connecting the client to the control service module through an SDK interface of an H5 webpage, and sending the serial number of the cloud mobile phone device to the control service module; receiving the video data and the audio data which are sent by the control service module and subjected to coding processing, and decoding and playing the video data and the audio data through an H5 webpage technology;
the control service module is used for connecting a remote playing module of the corresponding cloud mobile phone device according to the received serial number of the cloud mobile phone device and transmitting the received video data and audio data which are subjected to coding processing to the client module;
the remote playing module is used for pushing the stream to the control service module after being connected with the control service module; and coding the video data and the audio data on the cloud mobile phone equipment, and sending the video data and the audio data to the control service module in a websocket mode.
9. The cloud mobile phone control system based on the H5 webpage technology of claim 8, wherein the control service module comprises a video encoding unit, a data transmission unit and an event processing unit;
the event processing unit is used for converting the occurrence coordinates of the event sent by the control service module into real coordinates of the cloud mobile phone according to the proportion of pixels, and returning the converted picture to the service control module after the event processing is finished.
10. A computer-readable storage medium, comprising a stored computer program, wherein when the computer program runs, the computer-readable storage medium controls a device to execute the cloud mobile phone control method based on the H5 webpage technology according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910977546.5A CN110784525A (en) | 2019-10-14 | 2019-10-14 | Cloud mobile phone control method, system and storage medium based on H5 webpage technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910977546.5A CN110784525A (en) | 2019-10-14 | 2019-10-14 | Cloud mobile phone control method, system and storage medium based on H5 webpage technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110784525A true CN110784525A (en) | 2020-02-11 |
Family
ID=69385517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910977546.5A Pending CN110784525A (en) | 2019-10-14 | 2019-10-14 | Cloud mobile phone control method, system and storage medium based on H5 webpage technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110784525A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111405026A (en) * | 2020-03-11 | 2020-07-10 | 广州微算互联信息技术有限公司 | Method and device for synchronously controlling volumes of android mobile phone and cloud mobile phone |
| CN111669624A (en) * | 2020-05-08 | 2020-09-15 | 广州微算互联信息技术有限公司 | Cloud mobile phone control method and system |
| CN111694660A (en) * | 2020-05-08 | 2020-09-22 | 广州微算互联信息技术有限公司 | Cloud mobile phone data sending method, computer device and storage medium |
| CN112839174A (en) * | 2020-12-31 | 2021-05-25 | 深圳瞬玩科技有限公司 | Method and system for generating preview image of character image of cloud mobile phone |
| CN113488065A (en) * | 2021-07-01 | 2021-10-08 | 上海卓易科技股份有限公司 | Audio output method and device based on cloud mobile phone, computer equipment and storage medium |
| WO2021218751A1 (en) * | 2020-04-30 | 2021-11-04 | 华为技术有限公司 | Cloud phone-based media data processing method and terminal device |
| CN113691602A (en) * | 2021-08-17 | 2021-11-23 | 北京百度网讯科技有限公司 | Service processing method, system, device, equipment and medium based on cloud mobile phone |
| CN113949917A (en) * | 2020-07-16 | 2022-01-18 | 深圳瞬玩科技有限公司 | Online video synchronization method and system based on cloud mobile phone |
| CN114968015A (en) * | 2022-05-18 | 2022-08-30 | 北京眼神智能科技有限公司 | Method, device and medium for information interaction and network communication module control |
| CN113488065B (en) * | 2021-07-01 | 2024-05-14 | 上海卓易科技股份有限公司 | Audio output method and device based on cloud mobile phone, computer equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150150066A1 (en) * | 2013-11-27 | 2015-05-28 | Lg Electronics Inc. | Digital device and method of processing a service thereof |
| CN105847988A (en) * | 2016-03-25 | 2016-08-10 | 合网络技术（北京）有限公司 | Video sharing method and apparatus |
| CN107229453A (en) * | 2016-03-23 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Terminal control method and device |
| CN108471376A (en) * | 2017-02-23 | 2018-08-31 | 腾讯科技（深圳）有限公司 | Data processing method, apparatus and system |
| CN109788343A (en) * | 2018-11-26 | 2019-05-21 | 广州微算互联信息技术有限公司 | The method and cloud handset server of html web page audio stream plays |
| CN110119321A (en) * | 2019-04-30 | 2019-08-13 | 广州微算互联信息技术有限公司 | Cloud mobile phone is to the response method of local input content, system and storage medium |
| CN110177086A (en) * | 2019-04-30 | 2019-08-27 | 广州微算互联信息技术有限公司 | A kind of cloud mobile phone screen sharing method, system and device |
| CN110289015A (en) * | 2019-05-27 | 2019-09-27 | 北京大米科技有限公司 | A kind of audio-frequency processing method, device, server, storage medium and system |
-
2019
- 2019-10-14 CN CN201910977546.5A patent/CN110784525A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150150066A1 (en) * | 2013-11-27 | 2015-05-28 | Lg Electronics Inc. | Digital device and method of processing a service thereof |
| CN107229453A (en) * | 2016-03-23 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Terminal control method and device |
| CN105847988A (en) * | 2016-03-25 | 2016-08-10 | 合网络技术（北京）有限公司 | Video sharing method and apparatus |
| CN108471376A (en) * | 2017-02-23 | 2018-08-31 | 腾讯科技（深圳）有限公司 | Data processing method, apparatus and system |
| CN109788343A (en) * | 2018-11-26 | 2019-05-21 | 广州微算互联信息技术有限公司 | The method and cloud handset server of html web page audio stream plays |
| CN110119321A (en) * | 2019-04-30 | 2019-08-13 | 广州微算互联信息技术有限公司 | Cloud mobile phone is to the response method of local input content, system and storage medium |
| CN110177086A (en) * | 2019-04-30 | 2019-08-27 | 广州微算互联信息技术有限公司 | A kind of cloud mobile phone screen sharing method, system and device |
| CN110289015A (en) * | 2019-05-27 | 2019-09-27 | 北京大米科技有限公司 | A kind of audio-frequency processing method, device, server, storage medium and system |
Non-Patent Citations (1)
| Title |
|---|
| 王佳骏: "《上海交通大学硕士学位论文》", 12 January 2016 * |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111405026B (en) * | 2020-03-11 | 2023-04-07 | 广州微算互联信息技术有限公司 | Method and device for synchronously controlling volumes of android mobile phone and cloud mobile phone |
| CN111405026A (en) * | 2020-03-11 | 2020-07-10 | 广州微算互联信息技术有限公司 | Method and device for synchronously controlling volumes of android mobile phone and cloud mobile phone |
| WO2021218751A1 (en) * | 2020-04-30 | 2021-11-04 | 华为技术有限公司 | Cloud phone-based media data processing method and terminal device |
| CN111694660B (en) * | 2020-05-08 | 2022-03-25 | 广州微算互联信息技术有限公司 | Cloud mobile phone data sending method, computer device and storage medium |
| CN111669624A (en) * | 2020-05-08 | 2020-09-15 | 广州微算互联信息技术有限公司 | Cloud mobile phone control method and system |
| CN111694660A (en) * | 2020-05-08 | 2020-09-22 | 广州微算互联信息技术有限公司 | Cloud mobile phone data sending method, computer device and storage medium |
| CN113949917B (en) * | 2020-07-16 | 2023-09-15 | 深圳瞬玩科技有限公司 | Online video synchronization method and system based on cloud mobile phone |
| CN113949917A (en) * | 2020-07-16 | 2022-01-18 | 深圳瞬玩科技有限公司 | Online video synchronization method and system based on cloud mobile phone |
| CN112839174B (en) * | 2020-12-31 | 2022-05-20 | 深圳瞬玩科技有限公司 | Method and system for generating preview image of character image of cloud mobile phone |
| CN112839174A (en) * | 2020-12-31 | 2021-05-25 | 深圳瞬玩科技有限公司 | Method and system for generating preview image of character image of cloud mobile phone |
| CN113488065A (en) * | 2021-07-01 | 2021-10-08 | 上海卓易科技股份有限公司 | Audio output method and device based on cloud mobile phone, computer equipment and storage medium |
| CN113488065B (en) * | 2021-07-01 | 2024-05-14 | 上海卓易科技股份有限公司 | Audio output method and device based on cloud mobile phone, computer equipment and storage medium |
| CN113691602A (en) * | 2021-08-17 | 2021-11-23 | 北京百度网讯科技有限公司 | Service processing method, system, device, equipment and medium based on cloud mobile phone |
| CN113691602B (en) * | 2021-08-17 | 2024-04-05 | 北京百度网讯科技有限公司 | Service processing method, system, device, equipment and medium based on cloud mobile phone |
| CN114968015A (en) * | 2022-05-18 | 2022-08-30 | 北京眼神智能科技有限公司 | Method, device and medium for information interaction and network communication module control |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110784525A (en) | Cloud mobile phone control method, system and storage medium based on H5 webpage technology | |
| CN102883135B (en) | Screen sharing and control method | |
| CN102883134B (en) | Screen sharing and controlling method for video conference system | |
| CN113489805B (en) | Butt joint method, device, equipment and storage medium of cloud desktop system | |
| CN1613045B (en) | Personal computer system based on wireless man machine interacting device and its data transmitting method | |
| CN103873568A (en) | System and method for realizing remote virtual desktop display based on cloud computing | |
| CN108055304B (en) | Remote data synchronization method, device, server, equipment and storage medium | |
| WO2010147433A2 (en) | Apparatus and method for transmitting and receiving a user interface in a communication system | |
| CN104168453A (en) | Method for implementing video monitoring stream media application system | |
| CN113209632A (en) | Cloud game processing method, device, equipment and storage medium | |
| CN105653221A (en) | Remote information synchronization method, terminals and system | |
| CN102033726A (en) | Display method and server | |
| US11146662B2 (en) | Method and system of transmitting state based input over a network | |
| CN112221127B (en) | Multi-point control method and device for cloud game | |
| WO2024037110A1 (en) | Data processing method and apparatus, device, and medium | |
| CN114268618A (en) | KVM switch remote control system and method | |
| CN114006894A (en) | Data processing system, method, electronic device, and computer storage medium | |
| CN113926185A (en) | Data processing method, device, equipment and storage medium | |
| CN113766270A (en) | Video playing method, system, server, terminal equipment and electronic equipment | |
| CN112911320A (en) | Live broadcast method and device, computer equipment and storage medium | |
| CN109587118B (en) | Distributed multi-terminal and multi-network supporting system for Android online game | |
| CN114040220A (en) | Live broadcasting method and device | |
| CN103428297A (en) | Remote interaction system framework based on desktop virtualization | |
| WO2023098017A1 (en) | Method and apparatus for controlling cloud game, storage medium, and electronic device | |
| CN110798700B (en) | Video processing method, video processing device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200211 |