CN105100673B - Desktop sharing method and device based on VoLTE - Google Patents
Desktop sharing method and device based on VoLTE Download PDFInfo
- Publication number
- CN105100673B CN105100673B CN201510317523.3A CN201510317523A CN105100673B CN 105100673 B CN105100673 B CN 105100673B CN 201510317523 A CN201510317523 A CN 201510317523A CN 105100673 B CN105100673 B CN 105100673B
- Authority
- CN
- China
- Prior art keywords
- information
- image
- screen picture
- module
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Telephone Function (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a kind of desktop sharing method and device based on VoLTE, the method includes the steps: screen printing image, it obtains the first image information of the screen picture and is sent to distant terminal, the first image information includes the parameter information of the screen picture；The second image information for receiving the screen picture that the distant terminal returns parses second image information according to the parameter information, obtains operational order and execution of the distant terminal to the screen picture.To the Desktop Share for realizing mobile terminal and remotely control, practicability, flexibility and the interest of video calling are enhanced, the user experience is improved.
Description
Technical field
The present invention relates to field of communication technology more particularly to a kind of desktop sharing methods and device based on VoLTE.
Background technique
VoLTE, that is, Voice over LTE, it is a kind of IP data transmission technology, is not necessarily to 2G/3G net, whole service bearers
In on 4G network, it can be achieved that the unification of data and voice service under consolidated network.Existing VoLTE video calling, session are double
Side by mobile camera function and IMS (processing of (IP Multimedia Subsystem, IP multimedia system) protocol stack,
Image is passed into other side, so that other side can be clearly apparent the picture of oneself.
It is specific as shown in Figure 1, capturing sound and image by Mike and camera shooting (camera) module and being sent to APP and (answer
With) processor, APP processor handles transmission ADSP module after sound and image procossing, while carrying out to ADSP module
Control, sound and image after ADSP resume module become data packet format, then transfer to IMS protocol stack and LTE (Long
Term Evolution, long term evolution) protocol stack carries out plus the processing such as packet header, compressed encoding, it is sent finally by radio-frequency module
It goes out.
However, existing VoLTE video call function, can only make other side see the image before oneself mobile phone camera, no
It can be less able to achieve long-range control with other side's share desktop, practicability and interest are insufficient, affect user experience.
Summary of the invention
It is a primary object of the present invention to propose a kind of desktop sharing method and device based on VoLTE, movement is realized
The Desktop Share of terminal and long-range control, enhance the practicability and interest of video calling.
To achieve the above object, the present invention proposes a kind of desktop sharing method based on VoLTE, comprising steps of
Screen printing image obtains the first image information of the screen picture and is sent to distant terminal, and described first
Image information includes the parameter information of the screen picture；
The second image information for receiving the screen picture that the distant terminal returns, according to parameter information parsing
Second image information obtains operational order and execution of the distant terminal to the screen picture.
Preferably, the parameter information is corresponding parameter information when transmitting image according to RFB agreement.
Preferably, the parameter information includes at least pixel information, color depth information, syllable sequence information and coding class
Pixel information and coding type information in type information.
Preferably, after the step of screen printing image further include: formatted to the screen picture
After transfer to photographing module to perform corresponding processing.
Preferably, described that second image information is parsed according to the parameter information, distant terminal is obtained to the screen
Curtain image operational order and execution, comprising:
Second image information is decoded according to the parameter information, by distant terminal to the screen picture
Operational order is reduced to corresponding pixel information, and is handled by corresponding desktop processing unit.
The present invention proposes a kind of Desktop Share device based on VoLTE simultaneously, comprising:
Screen capture module is used for screen printing image；
First processing module, for obtaining the first image information of the screen picture, the first image information includes
The parameter information of the screen picture；
Transceiver module for sending the first image information to distant terminal, and receives what the distant terminal returned
Second image information of screen picture；
It is whole to obtain the other side for parsing second image information according to the parameter information for Second processing module
Hold the operational order to the screen picture and execution.
Preferably, further include photographing module, the screen capture module is used for: being sent out after being formatted to the screen picture
Give the photographing module；The photographing module: for being sent to described after performing corresponding processing to the screen picture
One processing module.
Preferably, the Second processing module includes resolution unit and desktop processing unit, and the resolution unit is used for: root
Second image information is decoded according to the parameter information, also to the operational order of the screen picture by distant terminal
Originally it was corresponding pixel information, and is sent to corresponding desktop processing unit and is handled.
A kind of desktop sharing method based on VoLTE proposed by the invention, it is good using existing intelligent mobile terminal
The high speed of system performance and operation readiness and LTE network intercepts the machine when carrying out VOLTE voice or video calling
Screen picture and send distant terminal to, and receive distant terminal to the operational order of screen picture, the operation that will be received
Instruction is reduced to local operation instruction, and carries out corresponding operation.The Desktop Share for realizing mobile terminal and remotely control, increase
The strong practicability of video calling, flexibility and interest, the user experience is improved.
Detailed description of the invention
Fig. 1 is the interaction schematic diagram that mobile terminal carries out each unit module when video calling in the prior art；
The hardware structural diagram of Fig. 2 mobile terminal of each embodiment to realize the present invention；
Fig. 3 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 2；
Fig. 4 is that the present invention is based on the flow charts of one embodiment of desktop sharing method of VoLTE；
Fig. 5 is the interaction schematic diagram that mobile terminal carries out each unit module when Desktop Share in the present invention；
Fig. 6 is that the present invention is based on the module diagrams of one embodiment of Desktop Share device of VoLTE.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The mobile terminal of each embodiment of the present invention is realized in description with reference to the drawings.In subsequent description, use
For indicate element such as " module ", " component " or " unit " suffix only for being conducive to explanation of the invention, itself
There is no specific meanings.Therefore, " module " can be used mixedly with " component ".
Mobile terminal can be implemented in a variety of manners.For example, terminal described in the present invention may include such as moving
Phone, smart phone, laptop, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet computer), PMP
The mobile terminal of (portable media player), navigation device etc. and such as number TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that in addition to being used in particular for moving
Except the element of purpose, the construction of embodiment according to the present invention can also apply to the terminal of fixed type.
Fig. 2 to realize the present invention the mobile terminal of each embodiment hardware configuration signal.
Mobile terminal 100 may include wireless communication unit 110, A/V (audio/video) input unit 120, user's input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power supply unit 190
Etc..Fig. 2 shows the mobile terminals with various assemblies, it should be understood that being not required for implementing all groups shown
Part.More or fewer components can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more components, allows mobile terminal 100 and wireless communication system
Or the radio communication between network.For example, wireless communication unit may include broadcasting reception module 111, mobile communication module
112, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast from external broadcast management server via broadcast channel
Relevant information.Broadcast channel may include satellite channel and/or terrestrial channel.Broadcast management server, which can be, to be generated and sent
The broadcast singal and/or broadcast related information generated before the server or reception of broadcast singal and/or broadcast related information
And send it to the server of terminal.Broadcast singal may include TV broadcast singal, radio signals, data broadcasting
Signal etc..Moreover, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Closing information can also provide via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 receives.Broadcast singal can exist in a variety of manners, for example, it can be with the electronics of digital multimedia broadcasting (DMB)
Program guide (EPG), digital video broadcast-handheld (DVB-H) electronic service guidebooks (ESG) etc. form and exist.Broadcast
Receiving module 111 can receive signal broadcast by using various types of broadcast systems.Particularly, broadcasting reception module 111
It can be wide by using such as multimedia broadcasting-ground (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video
It broadcasts-holds (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service
(ISDB-T) etc. digit broadcasting system receives digital broadcasting.Broadcasting reception module 111, which may be constructed such that, to be adapted to provide for extensively
Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via the received broadcast singal of broadcasting reception module 111 and/
Or broadcast related information can store in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal may include that voice is logical
It talks about signal, the Desktop Share signal based on VoLTE or is sent according to text and/or Multimedia Message and/or received various
The data of type.
The Wi-Fi (Wireless Internet Access) of the support mobile terminal of wireless Internet module 113.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting short range communication.Some examples of short-range communication technology include indigo plant
ToothTM, radio frequency identification (RFID), Infrared Data Association (IrDA), ultra wide band (UWB), purple honeybeeTMEtc..
Location information module 115 is the module for checking or obtaining the location information of mobile terminal.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115, which calculates, comes from three or more satellites
Range information and correct time information and the Information application triangulation for calculating, thus according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, it is defended for the method for calculating position and temporal information using three
Star and the error that calculated position and temporal information are corrected by using an other satellite.In addition, GPS module 115
It can be by Continuous plus current location information in real time come calculating speed information.
A/V input unit 120 is for receiving audio or video signal.A/V input unit 120 may include 121 He of camera
Microphone 1220, camera 121 is to the static map obtained in video acquisition mode or image capture mode by image capture apparatus
The image data of piece or video is handled.Treated, and picture frame may be displayed on display module 151.At camera 121
Picture frame after reason can store in memory 160 (or other storage mediums) or carry out via wireless communication unit 110
It sends, two or more cameras 1210 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone relation mould
Sound (audio data) is received via microphone in formula, logging mode, speech recognition mode etc. operational mode, and can be incited somebody to action
Such acoustic processing is audio data.Audio that treated (voice) data can be converted in the case where telephone calling model
For the format output that can be sent to mobile communication base station via mobile communication module 112.Various types can be implemented in microphone 122
Noise eliminate (or inhibit) algorithm with eliminate noise that (or inhibition) generates during sending and receiving audio signal or
Person's interference.
The order that user input unit 130 can be inputted according to user generates key input data to control each of mobile terminal
Kind operation.User input unit 130 allows user to input various types of information, and may include keyboard, metal dome, touch
Plate (for example, the sensitive component of detection due to the variation of resistance, pressure, capacitor etc. caused by being contacted), idler wheel, rocking bar etc.
Deng.Particularly, when touch tablet is superimposed upon in the form of layer on display module 151, touch screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 100, (for example, mobile terminal 100 opens or closes shape
State), the position of mobile terminal 100, user is for the presence or absence of contact (that is, touch input) of mobile terminal 100, mobile terminal
100 orientation, the acceleration or deceleration movement of mobile terminal 100 and direction etc., and generate for controlling mobile terminal 100
The order of operation or signal.For example, sensing unit 140 can sense when mobile terminal 100 is embodied as sliding-type mobile phone
The sliding-type phone is to open or close.In addition, sensing unit 140 be able to detect power supply unit 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).Sensing unit 140 may include that proximity sensor 1410 will combine below
Touch screen is described this.
Interface unit 170 be used as at least one external device (ED) connect with mobile terminal 100 can by interface.For example,
External device (ED) may include wired or wireless headphone port, external power supply (or battery charger) port, wired or nothing
Line data port, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be storage and use each of mobile terminal 100 for verifying user
It plants information and may include subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM)
Etc..In addition, the device (hereinafter referred to as " identification device ") with identification module can take the form of smart card, therefore, know
Other device can be connect via port or other attachment devices with mobile terminal 100.Interface unit 170, which can be used for receiving, to be come from
The input (for example, data information, electric power etc.) of external device (ED) and the input received is transferred in mobile terminal 100
One or more elements can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 100 is connect with external base, interface unit 170 may be used as allowing will be electric by it
Power, which is provided from pedestal to the path or may be used as of mobile terminal 100, allows the various command signals inputted from pedestal to pass through it
It is transferred to the path of mobile terminal.The various command signals or electric power inputted from pedestal, which may be used as mobile terminal for identification, is
The no signal being accurately fitted on pedestal.Output unit 150 is configured to provide with vision, audio and/or tactile manner defeated
Signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.) out.Output unit 150 may include display
Module 151, audio output module 152, alarm modules 153 etc..
Display module 151 may be displayed on the information handled in mobile terminal 100.For example, when mobile terminal 100 is in electricity
When talking about call mode, display module 151 can show and converse or other communicate (for example, text messaging, multimedia file
Downloading etc.) relevant user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in the table based on VoLTE
When face shared model or image capture mode, display module 151 can show captured image and/or received image, show
Video or the UI or GUI of image and correlation function etc. out.
Meanwhile when display module 151 and touch tablet in the form of layer it is superposed on one another to form touch screen when, display module
151 may be used as input unit and output device.Display module 151 may include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user to watch from outside, this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
Desired embodiment, mobile terminal 100 may include two or more display modules (or other display devices), for example, moving
Dynamic terminal may include external display module (not shown) and internal display module (not shown).Touch screen can be used for detecting touch
Input pressure and touch input position and touch input area.
Audio output module 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is when under the isotypes such as speech recognition mode, broadcast reception mode, wireless communication unit 110 is received or in memory 160
The audio data transducing audio signal of middle storage and to export be sound.Moreover, audio output module 152 can provide and movement
The relevant audio output of specific function (for example, call signal receives sound, message sink sound etc.) that terminal 100 executes.
Audio output module 152 may include loudspeaker, buzzer etc..
Alarm modules 153 can provide output notifying event to mobile terminal 100.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..Other than audio or video output, alarm modules
153 can provide output in different ways with the generation of notification event.For example, alarm modules 153 can be in the form of vibration
Output is provided, when receiving calling, message or some other entrance communications (incomingcommunication), alarm mould
Block 153 can provide tactile output (that is, vibration) to notify to user.By providing such tactile output, even if
When the mobile phone of user is in the pocket of user, user also can recognize that the generation of various events.Alarm modules 153
The output of the generation of notification event can be provided via display module 151 or audio output module 152.
Memory 160 can store the software program etc. of the processing and control operation that are executed by controller 180, Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And memory 160 can store about the vibrations of various modes and audio signal exported when touching and being applied to touch screen
Data.
Memory 160 may include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, more
Media card, card-type memory (for example, SD or DX memory etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..Moreover, mobile terminal 100 can execute memory with by network connection
The network storage device of 160 store function cooperates.
The overall operation of the usually control mobile terminal of controller 180.For example, controller 180 executes and voice communication, data
Communication, Desktop Share based on VoLTE etc. relevant control and processing.In addition, controller 180 may include for reproducing
The multi-media module 1810 of (or playback) multi-medium data, multi-media module 1810 can construct in controller 180, Huo Zheke
To be configured to separate with controller 180.Controller 180 can be with execution pattern identifying processing, the hand that will be executed on the touchscreen
It writes input or picture draws input and is identified as character or image.
Power supply unit 190 receives external power or internal power under the control of controller 180 and provides operation each member
Electric power appropriate needed for part and component.
Various embodiments described herein can be to use the calculating of such as computer software, hardware or any combination thereof
Machine readable medium is implemented.Hardware is implemented, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), controller, microcontroller, microprocessor, is designed to execute function described herein processor
At least one of electronic unit is implemented, and in some cases, such embodiment can be implemented in controller 180.
For software implementation, the embodiment of such as process or function can with allow to execute the individual of at least one functions or operations
Software module is implemented.Software code can by the software application (or program) write with any programming language appropriate Lai
Implement, software code can store in memory 160 and be executed by controller 180.
So far, oneself is through describing mobile terminal according to its function.In the following, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc., which is used as, to be shown
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Mobile terminal 100 as shown in Figure 2 may be constructed such that using via frame or grouping send data it is all if any
Line and wireless communication system and satellite-based communication system operate.
Referring now to Fig. 3 description communication system that wherein mobile terminal according to the present invention can operate.
Different air interface and/or physical layer can be used in such communication system.For example, used by communication system
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications system
System (UMTS) (particularly, long term evolution (LTE)), global system for mobile communications (GSM) etc..As non-limiting example, under
The description in face is related to cdma communication system, but such introduction is equally applicable to other types of system.
With reference to Fig. 3, cdma wireless communication system may include multiple mobile terminals 100, multiple base stations (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 form interface.MSC280 is also structured to form interface with the BSC275 that can be couple to base station 270 via back haul link.
Back haul link can be constructed according to any in several known interfaces, and the interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that system may include multiple BSC2750 as shown in Figure 3.
Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of direction specific direction
Each subregion of line covering is radially far from BS270.Alternatively, each subregion can be by two or more for diversity reception
Antenna covering.Each BS270, which may be constructed such that, supports multiple frequency distribution, and the distribution of each frequency has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
What subregion and frequency were distributed, which intersects, can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
System (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly indicating single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Alternatively, each subregion of specific BS270 can be claimed
For multiple cellular stations.
As shown in Figure 3, broadcast singal is sent to the mobile terminal operated in system by broadcsting transmitter (BT) 295
100.Broadcasting reception module 111 as shown in Figure 2 is arranged at mobile terminal 100 to receive the broadcast sent by BT295
Signal.In fig. 3 it is shown that several global positioning system (GPS) satellites 300.The help of satellite 300 positions multiple mobile terminals
At least one of 100.
In Fig. 3, multiple satellites 300 are depicted, it is understood that, it is useful to can use any number of satellite acquisition
Location information.GPS module 115 as shown in Figure 2 is generally configured to cooperate with satellite 300 to obtain desired positioning and believe
Breath.It substitutes GPS tracking technique or except GPS tracking technique, the other of the position that can track mobile terminal can be used
Technology.In addition, at least one 300 property of can choose of GPS satellite or extraly processing satellite dmb transmission.
As a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminals 100
Signal.Mobile terminal 100 usually participates in call, information receiving and transmitting and other types of communication.Certain base station 270 is received each anti-
It is handled in specific BS270 to link signal.The data of acquisition are forwarded to relevant BSC275.BSC provides call
The mobile management function of resource allocation and the coordination including the soft switching process between BS270.The number that BSC275 will also be received
According to MSC280 is routed to, the additional route service for forming interface with PSTN290 is provided.Similarly, PSTN290 with
MSC280 forms interface, and MSC and BSC275 form interface, and BSC275 controls BS270 correspondingly with by forward link signals
It is sent to mobile terminal 100.
Based on above-mentioned mobile terminal hardware configuration and communication system, propose that the present invention is based on the Desktop Share sides of VoLTE
One embodiment of method.As shown in Figure 4, Figure 5, it the described method comprises the following steps:
S11, in video call process, start Desktop Share function.
Specifically, as shown in figure 5, carry out traditional LTE video calling after terminal starting video calling, by Mike and
Photographing module captures sound and image, and APP processor handles transmission ADSP module after sound and image procossing, while right
ADSP module is controlled, and the sound and image after ADSP resume module become data packet format, then transfer to IMS protocol stack and
LTE protocol stack carries out plus the processing such as packet header, compressed encoding, sends finally by radio-frequency module.
Meanwhile in video call process, user can start Desktop Share function at any time, can be opened by menu option
It is dynamic, programmable button, the default starting such as gesture or phonetic order can also be passed through.
In certain embodiments, user directly can also directly initiate Desktop Share function in main interface, without first opening
Restart Desktop Share function after dynamic video call function.
S12, screen printing image.
After starting Desktop Share function, the screen capture module of terminal intercepts a screen picture every preset time, described
UI (user) interface that screen picture, that is, terminal is currently shown.
S13, the first image information for obtaining screen picture, which includes the parameter information of screen picture.
Specifically, as shown in figure 5, transmitting a closing camera function mark first after starting Desktop Share function and giving
Photographing module closes camera function, but is not turned off the port that photographing module obtains image data.When screen capture module screen printing
After image, first the image data of screen picture is formatted, the format that photographing module is capable of handling is converted to, then sends out
It gives photographing module to perform corresponding processing, forms frame structure data, then screen picture is sent to first processing module processing.
So as to the data port ready-made using photographing module, without in addition setting data port, save the cost.Certainly, certain
In embodiment, can also in addition data port be set and sends screen picture to first processing module.
First processing module obtains the first image information of screen picture, and carries out compression processing, first image information
Image data, parameter information including screen picture etc., wherein parameter information be according to RFB (Remote Frame Buffer,
Remote Frame Buffer) agreement transmission image when corresponding parameter information, which includes at least pixel information and coding class
Type information can also include color depth information, syllable sequence information etc..Then the first image information is sent to APP processor
It performs corresponding processing.
Preferably, previous screen picture and this screen picture can be compared by first processing module, be based on
Previous screen picture calculates the more new data of this screen picture, only handles the data of update, and will be after processing
Data be sent to APP processor, and retain this screen picture.So as to reduce data processing amount and transmission quantity, mention
High treatment efficiency and efficiency of transmission.
After the processing of APP processor, it is sent to ADSP resume module, then specific via IMS protocol stack and the progress of LTE protocol stack
Radio-frequency module is sent to after processing.APP processor, ADSP module, IMS protocol stack and LTE protocol stack are to the first image information
Processing mode is identical as the processing mode of tradition LTE video in video call process image, and details are not described herein.
S14, the first image information is sent to distant terminal.
After radio-frequency module receives the first image information, first image information is sent to distant terminal.
S15, the second image information for receiving the screen picture that distant terminal returns.
Specifically, after distant terminal receives the first image information of screen picture, according to the first image information to screen
Image is restored, and shows the screen picture on the screen.Screen printing image is started simultaneously at, it can be as step S12
A screen picture is intercepted every preset time, it can also be when detecting that user operates the screen picture currently shown
Intercept a screen picture.
After distant terminal has intercepted screen picture, subsequent processing mode is identical as step S13, obtains the screen of interception
Second image information of image, and the second image information is sent by radio-frequency module.
S16, the second image information is parsed according to parameter information, obtains distant terminal to the operational order of screen picture and holds
Row.
Specifically, as shown in figure 5, after radio-frequency module receives the second image information, successively through LTE protocol stack, IMS agreement
Stack, ADSP module and APP processor send Second processing module to after carrying out respective handling, which includes solution
Analyse unit and desktop processing unit.The resolution unit of Second processing module is according to the pixel information of screen picture, type of coding
The parameter informations such as information are decoded the second image information, obtain distant terminal to the operational order of screen picture, by the behaviour
Make instruction and be reduced to corresponding pixel information, and be sent to the interface function of corresponding desktop processing unit, so that at desktop
Reason unit performs corresponding processing, and executes the operational order.
To which the present invention is based on the desktop sharing methods of VoLTE, utilize the good system performance of existing intelligent mobile terminal
The screen map of the machine is intercepted when carrying out VOLTE voice or video calling with the high speed of operation readiness and LTE network
Picture simultaneously sends distant terminal to, and receives distant terminal to the operational order of screen picture, and the operational order received is restored
It is instructed for local operation, and carries out corresponding operation.The Desktop Share for realizing mobile terminal and remotely control, enhance video
Practicability, flexibility and the interest of call, the user experience is improved.
The present invention further provides a kind of Desktop Share device based on VoLTE is applied to aforementioned mobile terminal.Now it is based on
Above-mentioned mobile terminal hardware configuration and communication system propose that the present invention is based on one embodiments of Desktop Share device of VoLTE.Such as
Shown in Fig. 6, described device includes sequentially connected screen capture module, photographing module, first processing module, APP processor, ADSP mould
Block, IMS protocol stack, LTE protocol stack, transceiver module, and the Second processing module of connection APP processor, in which:
Screen capture module: for intercepting a screen picture every preset time, and to screen after starting Desktop Share function
The image data of curtain image formats, and is converted to the format that photographing module is capable of handling, is then sent to photographing module.
UI (user) interface that the screen picture, that is, terminal is currently shown.
Photographing module: being frame knot by the image real time transfer of screen picture for performing corresponding processing to screen picture
Structure data, and it is sent to first processing module.
First processing module: for obtaining the first image information of screen picture, and carrying out compression processing, first image
Information includes the image data of screen picture, parameter information etc., and wherein parameter information is corresponding when transmitting image according to RFB agreement
Parameter information, the parameter information include at least pixel information and coding type information, can also include color depth information,
Syllable sequence information etc..Then the first image information APP processor is sent to perform corresponding processing.
Preferably, previous screen picture and this screen picture can be compared by first processing module, be based on
Previous screen picture calculates the more new data of this screen picture, only handles the data of update, and will be after processing
Data be sent to APP processor, and retain this screen picture.So as to reduce data processing amount and transmission quantity, mention
High treatment efficiency and efficiency of transmission.
After APP processor carries out respective handling to the first image information that first processing module is sent, it is sent to ADSP mould
Block processing, then sending module is sent to after carrying out particular procedure via IMS protocol stack and LTE protocol stack.APP processor, ADSP
Module, IMS protocol stack and LTE protocol stack in the processing mode of the first image information and tradition LTE video call process to view
The processing mode of frequency image is identical, and details are not described herein.
Transceiver module: for sending the first image information to distant terminal, and the screen picture of distant terminal return is received
The second image information, preferably pass through radio-frequency module carry out information transmitting-receiving.
After transceiver module receives the second image information, successively through LTE protocol stack, IMS protocol stack, ADSP module and
APP processor sends Second processing module to after carrying out respective handling.
Second processing module: for parsing the second image information according to parameter information, distant terminal is obtained to the screen
The operational order of image and execution.
Second processing module includes resolution unit and desktop processing unit.Resolution unit is used for the pixel according to screen picture
The parameter informations such as point information, coding type information are decoded the second image information, obtain distant terminal to screen picture
The operational order is reduced to corresponding pixel information, and is sent to the interface of corresponding desktop processing unit by operational order
Function executes the operational order so that desktop processing unit performs corresponding processing.
To which the present invention is based on the Desktop Share devices of VoLTE, utilize the good system performance of existing intelligent mobile terminal
The screen map of the machine is intercepted when carrying out VOLTE voice or video calling with the high speed of operation readiness and LTE network
Picture simultaneously sends distant terminal to, and receives distant terminal to the operational order of screen picture, and the operational order received is restored
It is instructed for local operation, and carries out corresponding operation.The Desktop Share for realizing mobile terminal and remotely control, enhance video
Practicability, flexibility and the interest of call, the user experience is improved.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothes
Business device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (8)
1. a kind of desktop sharing method based on VoLTE, which is characterized in that comprising steps of
Screen printing image obtains the first image information of the screen picture and is sent to distant terminal, the first image
Information includes the parameter information of the screen picture；
The second image information for receiving the screen picture that the distant terminal returns, according to parameter information parsing described second
Image information obtains operational order and execution of the distant terminal to the screen picture；
After the step of screen printing image further include: starting is for obtaining image data in the photographing module of video calling
Port, the screen picture is formatted, then transfers to image by the port by the screen picture after conversion
Module performs corresponding processing, and the screen picture of frame structure data is formed, to be sent to distant terminal.
2. the desktop sharing method according to claim 1 based on VoLTE, which is characterized in that the parameter information be according to
Corresponding parameter information when according to RFB agreement transmission image.
3. the desktop sharing method according to claim 1 based on VoLTE, which is characterized in that the parameter information is at least
Including the pixel information and type of coding in pixel information, color depth information, syllable sequence information and coding type information
Information.
4. the desktop sharing method according to claim 1-3 based on VoLTE, which is characterized in that the basis
The parameter information parses second image information, obtains operational order and execution of the distant terminal to the screen picture,
Include:
Second image information is decoded according to the parameter information, the operation by distant terminal to the screen picture
Instruction is reduced to corresponding pixel information, and is handled by corresponding desktop processing unit.
5. a kind of Desktop Share device based on VoLTE characterized by comprising
Screen capture module is used for screen printing image；
First processing module, for obtaining the first image information of the screen picture, the first image information includes described
The parameter information of screen picture；
Transceiver module for sending the first image information to distant terminal, and receives the screen that the distant terminal returns
Second image information of image；
Second processing module obtains the distant terminal pair for parsing second image information according to the parameter information
The operational order of the screen picture and execution；
The Desktop Share device based on VoLTE, further includes photographing module, the screen capture module is used for: starting is used for video
The port that image data is obtained in the photographing module of call, formats the screen picture, then will be after conversion
Screen picture is sent to the photographing module by the port；The photographing module: for carrying out phase to the screen picture
After the processing answered, the screen picture of frame structure data is formed, the first processing module is then forwarded to.
6. the Desktop Share device according to claim 5 based on VoLTE, which is characterized in that the parameter information be according to
Corresponding parameter information when according to RFB agreement transmission image.
7. the Desktop Share device according to claim 5 based on VoLTE, which is characterized in that the parameter information is at least
Including the pixel information and type of coding in pixel information, color depth information, syllable sequence information and coding type information
Information.
8. according to the described in any item Desktop Share devices based on VoLTE of claim 5~7, which is characterized in that described second
Processing module includes resolution unit and desktop processing unit, and the resolution unit is used for: according to the parameter information to described
Two image informations are decoded, and operational order of the distant terminal to the screen picture is reduced to corresponding pixel information,
And it is sent to corresponding desktop processing unit and is handled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510317523.3A CN105100673B (en) | 2015-06-10 | 2015-06-10 | Desktop sharing method and device based on VoLTE |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510317523.3A CN105100673B (en) | 2015-06-10 | 2015-06-10 | Desktop sharing method and device based on VoLTE |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105100673A CN105100673A (en) | 2015-11-25 |
| CN105100673B true CN105100673B (en) | 2019-07-19 |
Family
ID=54580104
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510317523.3A Active CN105100673B (en) | 2015-06-10 | 2015-06-10 | Desktop sharing method and device based on VoLTE |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105100673B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110881082A (en) * | 2019-10-10 | 2020-03-13 | 袁建平 | Cloud desktop layering method |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107872426A (en) * | 2016-09-26 | 2018-04-03 | 中兴通讯股份有限公司 | A kind of long-range control establishing method and device based on VOLTE |
| CN108270734A (en) * | 2016-12-30 | 2018-07-10 | 展讯通信（上海）有限公司 | Mobile terminal realizes the method and device of Desktop Share |
| CN107509051A (en) * | 2017-08-14 | 2017-12-22 | 宇龙计算机通信科技(深圳)有限公司 | Long-range control method, device, terminal and computer-readable recording medium |
| CN110493482A (en) * | 2019-07-05 | 2019-11-22 | 潘子萌 | A kind of cloud desktop throwing screen phone |
| CN111885015A (en) * | 2020-07-06 | 2020-11-03 | 惠州市源医科技有限公司 | Method for remotely controlling equipment based on RTP |
| CN111885393A (en) * | 2020-07-31 | 2020-11-03 | 广州华多网络科技有限公司 | Live broadcast method, system, storage medium and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010109151A1 (en) * | 2009-03-25 | 2010-09-30 | Sagem Communications Sas | Method for the remote sharing of computer office(s) |
| CN101964798A (en) * | 2010-10-15 | 2011-02-02 | 德讯科技股份有限公司 | Multi-graphic protocol unified proxy system based on remote desktop protocol |
| CN102340792A (en) * | 2010-07-22 | 2012-02-01 | 上海贝尔股份有限公司 | Switching method and equipment |
| CN102855866A (en) * | 2011-06-30 | 2013-01-02 | 联想(北京)有限公司 | Terminal, display terminal, display system and display method |
| CN103546629A (en) * | 2012-07-13 | 2014-01-29 | Lg电子株式会社 | Mobile terminal and controlling method thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103618884A (en) * | 2013-12-16 | 2014-03-05 | 东方网力科技股份有限公司 | Video transmission method, device and tablet computer |
-
2015
- 2015-06-10 CN CN201510317523.3A patent/CN105100673B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010109151A1 (en) * | 2009-03-25 | 2010-09-30 | Sagem Communications Sas | Method for the remote sharing of computer office(s) |
| CN102340792A (en) * | 2010-07-22 | 2012-02-01 | 上海贝尔股份有限公司 | Switching method and equipment |
| CN101964798A (en) * | 2010-10-15 | 2011-02-02 | 德讯科技股份有限公司 | Multi-graphic protocol unified proxy system based on remote desktop protocol |
| CN102855866A (en) * | 2011-06-30 | 2013-01-02 | 联想(北京)有限公司 | Terminal, display terminal, display system and display method |
| CN103546629A (en) * | 2012-07-13 | 2014-01-29 | Lg电子株式会社 | Mobile terminal and controlling method thereof |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110881082A (en) * | 2019-10-10 | 2020-03-13 | 袁建平 | Cloud desktop layering method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105100673A (en) | 2015-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105100673B (en) | Desktop sharing method and device based on VoLTE | |
| CN104991819B (en) | Terminal applies switching method and device | |
| CN106231087B (en) | A kind of method and apparatus of front and back sides dual-screen display device false-touch prevention | |
| CN105718027B (en) | The management method and mobile terminal of background application | |
| CN105282245B (en) | Cross-server message push system and method | |
| CN104731512B (en) | The method, apparatus and terminal that picture is shared | |
| CN105263049B (en) | A kind of video Scissoring device, method and mobile terminal based on frame coordinate | |
| CN105721002B (en) | A kind of terminal filtering method, system, device and terminal can be filtered | |
| CN106097284B (en) | A kind of processing method and mobile terminal of night scene image | |
| CN105430258B (en) | A kind of method and apparatus of self-timer group photo | |
| CN106131274B (en) | Mobile terminal control device and method | |
| CN105187709B (en) | A kind of method and terminal for realizing strange land shooting | |
| CN106534552B (en) | Mobile terminal and its photographic method | |
| CN104735254B (en) | terminal screen locking method and system | |
| CN105049582B (en) | A kind of save set of calling record, method and display methods | |
| CN106412328B (en) | A kind of method and apparatus obtaining field feedback | |
| CN106656278B (en) | A kind of near field communication device and terminal device | |
| CN105126339B (en) | A kind of game control device and method | |
| CN105187663B (en) | Automatically the method and terminal conversed | |
| CN105049916B (en) | A kind of video recording method and device | |
| CN105302457B (en) | Terminal control method and device | |
| CN105117751B (en) | Two-dimentional decoding transmission method and device | |
| CN104837122B (en) | Multi-party communications method, terminal and system | |
| CN105049610B (en) | A kind of input method and terminal | |
| CN105898158B (en) | A kind of data processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |