CN104902017B - A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown - Google Patents
A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown Download PDFInfo
- Publication number
- CN104902017B CN104902017B CN201510258579.6A CN201510258579A CN104902017B CN 104902017 B CN104902017 B CN 104902017B CN 201510258579 A CN201510258579 A CN 201510258579A CN 104902017 B CN104902017 B CN 104902017B
- Authority
- CN
- China
- Prior art keywords
- interactive
- user terminal
- viewing area
- synchronization
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a kind of remote interaction method that multi-screen synchronous for supporting QoS is shown, comprise the following steps：The interaction platform of simultaneous display is established, shares the file source material bag of synchronization interactive, into synchronization interactive interface, synchronization interactive, exits synchronization interactive interface, cancels interaction platform.The method of the invention first shares file source material bag to interaction platform, user terminal, which need to load the file source material bag comprising larger data amount in advance and could enter synchronization interactive interface and other users end, synchronize interaction, and the less command information of prevailing transmission data volume, file source Update log realize the interaction of multi-screen synchronous and exact flow during synchronization interactive.
Description
Technical field
Shown the present invention relates to a kind of synchronization interactive technical field, in particular to a kind of multi-screen synchronous for supporting QoS remote
Journey interactive approach.
Background technology
Multi-screen synchronous interaction at present is mainly based upon IP network and is transmitted to far using screenshotss after the whole screen of periodic refreshing
What the mode at end carried out, no matter screen has the transmission that no change all carries out whole screen shots, the method consumes substantial amounts of network
A large amount of Installed System Memories and CPU usage in resource and occupied terminal equipment.And IP network is the network of a kind of " doing one's best ",
It does not provide network service quality QoS（Quality of Service）Pledge system, need simultaneous transmission video, audio,
Data are when multiple business, by network bandwidth and rate limitation, phenomena such as excessively delay, interim card can be caused, and the effect of synchronization interactive
Fruit is not ideal enough.In order to ensure network service quality, strengthen the usage experience of user, propose a kind of multi-screen synchronous for supporting QoS
The remote interaction method of display, the data transfer during synchronization interactive is reduced using the segment transmissions of data, ensures multi-screen
Simultaneous display and the accurate smooth Interactive Experience of user terminal.
The content of the invention
It is an object of the invention to provide a kind of remote interaction method that multi-screen synchronous for supporting QoS is shown, using data
Segment transmissions and reduce the data transfer during synchronization interactive, ensure that the simultaneous display of multi-screen and user terminal are accurately smooth
Interactive Experience.
The present invention is achieved through the following technical solutions：A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown, bag
Include following steps：
Step S100：Establish the interaction platform of simultaneous display；
Step S200：The file source material bag of shared synchronization interactive；
Step IF110：The webserver constantly search whether have new access request or it is new exit request, if having
Then jump procedure IF210, step S200 is continued to execute if nothing；
Step IF210：Access request or after exiting request processing, judges the numerical value of user terminal sum N in interaction platform, N
For nonnegative integer, the direct jump procedure S600 if N=0, if the jump procedure S500 of N=1, if N >=2 perform step S300；
Step S300：Into synchronization interactive interface；
Step S400：Synchronization interactive；
Step IF120：The webserver constantly search whether have new access request or it is new exit request, if having
Then jump procedure IF220, step S400 is continued to execute if nothing；
Step IF220：Access request or after exiting request processing, judges the numerical value of user terminal sum N in interaction platform, if
N=0 item directly jump procedure S600, the jump procedure S500 if N=1, if N >=2 continue to execute step S300；
Step S500：Exit synchronization interactive interface, and jump procedure S200；
Step S600：Cancel interaction platform；
The step S100：Any one user terminal relies on succeed in registration after in the interaction platform that obtains unique ID number to
The webserver sends interactive request, establishes interaction platform and waits the addition of other users；User in the interaction platform
End is established by the webserver and connected, and passes through the data in webserver called data server；
The step S200：The Shared Folders in a subsidiary default document source and storage are automatically generated in interaction platform
In data server, existing Shared Folders does not repeat then to create, any one user terminal in interaction platform is using pre-
If big data transport protocol, upload file source material bag into Shared Folders from local memory module and supply under other users
Carry, or download file source material bag to local memory module from Shared Folders and be locally stored；Data server
User terminal constantly into interaction platform, which is sent, calls file source information, and user terminal sends feedback daily record to examine to data server
Whether survey is locally stored in module is stored with newest complete file source material bag, does not complete the user terminal downloaded and continues to load
Until completing to download or exiting download, the user terminal for having completed to download stops downloading, and realizes the shared of file source material bag；Institute
Stating file source material bag includes file source and file source Update log, and file source, file source Update log include multimedia text
The figure layer data in multi-medium data, figure layer file in part, the time in command information and associated with command file
Script flow；The time script flow refer to synchronization module according to interaction platform timing send timestamp stream to multi-medium data,
Figure layer data, command information synchronize the data for associating and being recorded in xml format；
The step S300：Complete the user terminal that file source material bag is downloaded and enter synchronization interactive interface, call file source
Data bag and the interactive viewing area for loading aspect ratio fixation, the user terminal for having loaded interactive viewing area only update file source material bag
In data, perform step S400 after completing newest interactive viewing area loading；The broadcast layer of the interaction viewing area including lower floor,
The transparent figure layer on upper strata and the instruction list on backstage, in broadcast layer loading multimedia data when loading interactive viewing area, transparent
It is the coordinate system and loading of X-axis and vertical direction for Y-axis to be established in figure layer by coordinate origin, horizontal direction of upper left vertex
Figure layer data, command information is loaded in instruction list；Each coordinate points are coordinate pixel in the coordinate system；
The step S400：Any one user terminal in interaction platform carries out operation in local interactive viewing area to be made mutually
Change in dynamic viewing area, the change of interactive viewing area is converted into the command information being made of instruction, word, ordered series of numbers, instruction
Information is transmitted to data server by local terminal coding, then is sent to other-end and carried out after being called by the webserver
Decoding, other-end is classified after decoded command information is changed is loaded onto broadcast layer or transparent figure layer, and by same
Step module synchronizes calibration and the interactive viewing area of a plurality of clients is synchronously changed, and realizes the interactive operation of multi-screen；
The step S500：When only having a user terminal in synchronization interactive interface, can not synchronize it is interactive and from synchronization
Interactive interface exits；
The step S600：When not having user terminal in interaction platform, which cancels automatically.
The step S100, step S200, step S300, step S400, step S500, step S600 are main flow；Institute
It is to be interspersed in time that condition judgment is constantly carried out in main flow to state step IF110, step IF210, step IF120, step IF220
Flow.
First, the present invention in any one by the user terminal of authentication can be established by network one it is provisional
For simultaneous display interaction platform and in interaction platform with other user terminal opening relationships；User terminal in interaction platform is first
The file source material bag of shared synchronization interactive simultaneously could enter synchronization interactive interface, synchronization interactive interface after being locally stored
Under multi-screen synchronous interaction rely primarily on the small data files such as command information, Update log transmission carry out.It is involved in the present invention
Method will need the large data files such as the audio, the video that are transmitted during synchronization interactive originally and support synchronous mutual
The user terminal that dynamic default file is shared in the form of file source material bag in interaction platform is loaded in advance, is reduced synchronous
The transmission of data in interactive process, saves the Internet resources during synchronization interactive, avoid caused by network congestion delay or
Packet loss, supports QoS network service quality pledge systems, ensures the simultaneous display of multi-screen and the accurate smooth mutual kinetoplast of user terminal
Test.
On the one hand, although the user terminal in different network environments in load document source material bag there are larger difference,
But during synchronization interactive, network environment influence is not readily susceptible to since the data volume of transmission is smaller, so that with preferable
Synchronization interactive is experienced.
On the other hand, since the large data files such as audio, video can be loaded in advance, network bandwidth and transmission speed are broken through
The limitation of degree, can share the resources such as high quality audio, video, further lift user experience.
Second, the interaction platform in the present invention is open, relative to enclosed interaction platform, meets the use of condition
The synchronization interactive that family end freely can be added or be exited without influencing other users end, is that all user terminals in interaction platform are built
More comfortable experience environment.Meanwhile the user terminal newly added after load document source material bag by realizing and having added use
The synchronization at family end synchronization interactive interface, ensures the effect of synchronization interactive.
3rd, avoid the repetition of data from transmitting as far as possible in of the invention, as described in step S200, if user terminal adds completely
Newest file source material Bao Ze is carried without repeated downloads, if user terminal has loaded the part in newest file source material bag
Data need not then download repeated data and only download missing data, and the transmission of data in network is reduced with this, save Internet resources, carry
The efficiency of high data sharing.The file source material bag includes file source, file source Update log, and file source is basic data
Bag, and file source Update log be temporally stamp stream recording synchronism interactive process in each time synchronization interactive when multi-medium data,
The change and the data packet of three's incidence relation that figure layer data, command information each occur.User terminal in synchronization interactive interface
As long as loading newest file source Update log can be achieved synchronization interactive.
4th, the present invention in order to adapt to the terminal device at different user end, as described in step S300, only in terminal device
Display on the interactive viewing area fixed of one aspect ratio of loading, user terminal can wake up according to actual conditions, hide, dragging,
Amplification, reduce interactive viewing area.Interactive viewing area in the present invention has two main advantages relative to full frame loading：When
Member-retaining portion privacy zone on the display of user terminal, facilitates other operations of user；Second, although interactive viewing area size is different
But aspect ratio is fixed, equivalent to zooming in or out in proportion, the calculation amount of data during simultaneous display is reduced, is further improved
The speed of service and the real-time smoothness for ensureing synchronization interactive process.
5th, broadcast layer, the transparent figure layer on upper strata and the instruction column on backstage of lower floor are divided into interactive display by the present invention
Table, broadcast layer are mainly used for playing multimedia file, and transparent figure layer is mainly used for the figure layers such as annotation text equivalent to electronic whiteboard
The operation of part, instruction list are mainly used for the Background scheduling of instruction.Call instruction can realize different input equipments to multimedia
The control of the broadcast state, playing progress rate of file and editor etc. to annotating form in figure layer file.Therefore, in transparent figure layer
The operation such as annotation do not influence the broadcasting of multimedia file, the backstage that is invoked at of instruction is not influenced display effect.
6th, the present invention constantly searches for access request in interaction platform, exits request, synchronization request, control data etc.
GET or POST request and timely processing, fast response time, enhancing user experience.
Further, the step S400 specifically refers to following steps：
Step S410：Any one user terminal becomes control terminal, and other users end, which becomes, participates in end, and only control terminal possesses behaviour
Weigh；
Step S420：The synchronization module of control terminal monitors whether local input unit has action, is failure to actuate if without if, if
Have, send synchronization request to the webserver and step S430 is performed after synchronization request is authorized to；
Step S430：The synchronization module of control terminal judges whether interactive viewing area changes, and is failure to actuate if without if, if having
The corresponding change in interactive viewing area is then converted into command information and generates corresponding file source Update log, then jump procedure
S440；
Step S440：Command information, file source Update log are encoded by control terminal and packed, using default small data transmission
Agreement is sent to data server, is updated by data server added to Shared Folders and is preserved and be forwarded to interaction platform
Interior participation end is decoded；
Step S450：Decoded command information synchronizes output in the interactive viewing area for participating in end；
Step S460：After the completion of this synchronization interactive, again jump procedure S410 and realize interaction.
Entering any one user terminal of interactive viewing area in the present invention can be operated as control terminal, but if
There is a plurality of clients to be carried out at the same time operation and be easy to cause interference, especially when user terminal quantity is more, multi-user grasps at end at the same time
Work can increase system operations amount and cause system to be run quickly and burst.In order to reduce the computational burden of system, limits synchronization interaction of the present invention
Only have in journey within the same period control terminal possess operating rights but control terminal in different time periods can with free switching, with
This realizes orderly, efficient interactive.
Further, the step S410 specifically includes following steps：
Step S411：Each user terminal is ranked up by the time sequencing for adding interaction platform in interaction platform, and by net
Network server Match in sequence controls thread and forms control thread list；The control thread is divided into online, active, three kinds of vacancy
State, is presence into the thread that controls shared by the user terminal at synchronization interactive interface, possesses the online control of operating rights
Thread processed is active state, and the thread that controls exited shared by the user terminal at synchronization interactive interface is open position, and acquiescence is in
The thread that controls of the front end of presence is active state, and the corresponding user terminal of control thread of active state is held in order to control,
Presence controls the corresponding user terminal of thread to participate in end；
Step S412：The webserver receives when exiting request, agrees to that sending the user terminal for exiting request exits synchronization
Interactive interface, corresponding control thread are changed into open position from presence and wait redistributing for the webserver, at the same time
Generation control thread change log is preserved, and the corresponding control thread order in other users end and position do not change；
Step S413：When the webserver receives access request, it is synchronous to agree to that the user terminal for sending access request adds
Interactive interface, while control thread change log is transferred to the control line in existing control thread list with the presence or absence of open position
Cheng Jinhang is retrieved, and the control thread of any one open position is distributed to so far user terminal if having, if without a newly-built control
Thread processed distributes so far user terminal；
Step S414：Whether the webserver constantly search has new control data, the jump procedure S415 if having, if nothing
Then it is failure to actuate；
Step S415：Any one participates in end and sends control data to the webserver, and will be controlled by the webserver please
Ask and be forwarded to current control terminal, the current control terminal power out of hand if current control terminal is agreed to and being changed into participate in end and
This participation end for sending control data obtains control and is changed into control terminal, and control is not if current control terminal disagrees
Become and this control data fails.
The method of control terminal selection and switching involved in the present invention, subtracts as far as possible on the premise of meeting to actually use needs
The treating capacity of small data.
Further, in the step S430, the change of interactive viewing area includes multimedia file in broadcast layer and plays shape
The change of coordinate pixel and its corresponding color value in state, the change of playing progress rate or transparent figure layer；The step S430 is specific
Comprise the following steps：
Step S431：Control terminal judges the change for whether having corresponding local mouse action in interactive viewing area, is held if without if
Row step S432, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S432：Control terminal judges the change for whether having corresponding local touch screen operation in interactive viewing area, if without if
Step S433 is performed, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S433：Control terminal judges the change for whether having corresponding local keyboard operation in interactive viewing area, is held if without if
Row step S434, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S434：Control terminal judges the change for whether having respective local audio acquisition module to operate in interactive viewing area,
If performing step S435 without if, the corresponding change in interactive viewing area is converted into jump procedure S440 after command information if having；
Step S435：Control terminal judges the change for whether having corresponding local video acquisition module operation in interactive viewing area,
It is failure to actuate if without if, the corresponding change in interactive viewing area is converted into jump procedure S440 after command information if having.
Change in the present invention in control terminal interaction viewing area is monitored by the moment, and the change in control terminal interaction viewing area
It is related to the action of multiple input device.The present invention sets different priority and according to priority for the action of different input units
Circulation is monitored successively, to reduce the efficiency for computing repeatedly, improving monitoring of data.
Further, the step S450 specifically includes following steps：
Step S451：Compared with the size of interactive viewing area of the size of the interactive viewing area of control terminal with participating in end simultaneously
Obtain ratio；
Step S452：The corresponding change of control terminal mouse action calls the command information at participation end and with reference to the step
Exported after the ratio matching obtained in rapid S451；
Step S453：The corresponding change of control terminal touch screen operation calls the command information at participation end and with reference to described
Exported after the ratio matching obtained in step S451；
Step S454：The corresponding change of control terminal keyboard operation calls the command information at participation end and with reference to the step
Exported after the ratio matching obtained in rapid S451；
Step S455：The command information and knot for participating in end are called in the corresponding change of control terminal audio collection module operation
Exported after closing the ratio matching obtained in the step S451；
Step S456：The command information and knot for participating in end are called in the corresponding change of control terminal video acquisition module operation
Exported after closing the ratio matching obtained in the step S451；
Step S457：After the completion of output, the synchronization module for participating in end sends synchronous calibration request to the webserver；
Step S458：After synchronous calibration request passes through, the webserver calls newest time script in data server
Circulation, which is sent to, participates in end；
Step S459：After the synchronization module at participation end receives time script flow, parsing time script flow synchronizes school
It is accurate.
After the change in control terminal interaction viewing area is listened in the present invention, as described in step S451, control terminal is first obtained
Interactive viewing area and the ratio for participating in end interaction viewing area size, for another example step S452, step S453, step S454, step
Described in S455, step S456, the action of different input units is according to priority obtained respectively and calls corresponding command information to carry out
Output, finally as described in step S457, step S458, step S459, calibration is also synchronized after the completion of each step synchronization interactive,
Provide more accurately synchronous experience to the user.
Further, the step S453 specifically includes following steps：
Step S4531：Obtain the track streaked on control terminal touch-screen in interactive viewing area；
Step S4532：The track obtained in step S4531 is converted into a series of sampled point, compares local transparent print
Coordinate on layer obtains the coordinate value of all sampled points；
Step S4533：The corresponding color value of sampled point in obtaining step S4532；
Step S4534：According to the sequencing of sampled point, coordinate value and color value are associated afterwards and form ordered series of numbers；
Step S4535：Ratio calculation sampled point according to being obtained in step S451 is corresponded in the interaction viewing area of this participation end
Coordinate value and the associated color value of respective coordinates value it is constant and obtain new ordered series of numbers, by coordinate value in new ordered series of numbers and associated color
Value output realizes the synchronization interactive of track to end interaction viewing area is participated in.
After the change in control terminal interaction viewing area is listened in the present invention, as described in step S451, control terminal is first obtained
Interactive viewing area and the ratio for participating in end interaction viewing area size, for another example step S452, step S453, step S454, step
Described in S455, step S456, the action of different input units is according to priority obtained respectively and calls corresponding command information to carry out
Output, finally as described in step S457, step S458, step S459, calibration is also synchronized after the completion of each group of synchronization interactive,
Provide more accurately synchronous experience to the user.
In the present invention, user terminal can carry out the annotation for including the editors such as word, figure in transparent figure layer, and annotation is not logical
The picture for crossing screenshotss carries out remote synchronization, but editor's action of annotation is converted to the instruction being made of instruction, word, ordered series of numbers
Information is simultaneously transmitted with Java forms, and the data volume that command information transmits for the picture transfer of a large amount of screenshotss is small
It is more, it is small by network environment influence, it is ensured that unobstructed data transfer.
The word includes Chinese character, English character, numerical character, sign character, existing Chinese character, English words
Symbol, numerical character, sign character can directly invoke, and the character of figure or other None- identifieds is converted to a series of coordinate pixel
The change such as point, the change reflection figure of coordinate pixel attribute, the coordinate pixel of attribute change is sampled point.The coordinate picture
The attribute of vegetarian refreshments include coordinate value and with the associated color value of this coordinate value, with the coordinate value of decimal representation with hexadecimal
An item in ordered series of numbers is formed after the color value association of expression.A series of attribute of sampled points forms ordered series of numbers.
Further, after the step S459 specifically refers to the synchronization module parsing time script flow at participation end, controlled
End processed and the time difference for participating in end response latest command information, it is failure to actuate if the time difference is in the threshold values of setting, if the time difference
Compensation is then synchronized beyond the threshold values of setting, completes synchronous calibration.
Allow in the present invention during synchronization interactive between different user end there are certain response time is poor, but in order to carry
The accuracy of high multi-screen synchronous, starts synchroballistic when the response time difference at unique user end is beyond the threshold values of setting, completes
Synchronous calibration, keeps the accurate synchronization of multi-screen.
Further, default big data transport protocol uses RTP/RTCP agreements in the step S200；The step
In S440, the default small data transmission agreement uses ICP/IP protocol.
RTP/ is used after the large data files such as sound intermediate frequency of the present invention, video are by Software Coding, H.264 algorithm is compressed
Rtcp protocol is transmitted；The small data files such as command information, control thread change log, file source Update log use TCP/
IP agreement is transmitted.The RTP（Realtime Transport Protocol）For real-time transport protocol；The RTCP
（Realtime Transport Control Protocol）For RTCP Real-time Transport Control Protocol；The RTP/RTCP agreements are should
With the transport layer protocol of type, RTP and RTCP are used cooperatively, and with minimum expense efficiency of transmission can be made optimal with effective feed back
Change, therefore be particularly suitable for the real time data in transmission net.The TCP（Transmission Control Protocol）For transmission
Control protocol；The IP（Internet Protocol）For network interconnection agreement；The ICP/IP protocol is assisted by the IP of network layer
The Transmission Control Protocol composition of negotiation transport layer, independent of any specific computer hardware or operating system, there is provided reliable data
Transmission.The RTP/RTCP agreements, ICP/IP protocol are the prior art and improvement of the invention does not lie in this yet, therefore no longer
Repeat.
Further, the step IF110 specifically includes following steps：
Step IF111：Whether the webserver constantly search has new access request, and step IF112 is performed if having, if
Without then jump procedure IF113；
Step IF112：The access request for the user terminal that file source material bag is downloaded is completed by not completing file source material
Wrap the access request of user terminal downloaded to be refused, the numerical value that N is recalculated after access request has been handled, if this batch access request
P is increased by the numerical value of a then N of p, step IF113 is performed after completing the calculating of N；
Step IF113：The webserver constantly search whether have it is new exit request, the execution step IF114 if having, if
Nothing then continues to execute step S200；
Step IF114：Exit request to pass through, handled and recalculated the numerical value of N after exiting request, if exit please for this batch
Ask the numerical value by a then N of q to reduce q, step IF210 is performed after completing the calculating of N；
The step IF120 specifically includes following steps：
Step IF121：Whether the webserver constantly search has new access request, and step IF122 is performed if having, if
Without then jump procedure IF123；
Step IF122：The access request for the user terminal that file source material bag is downloaded is completed by not completing file source material
Wrap the access request of user terminal downloaded to be refused, the numerical value that N is recalculated after access request has been handled, if this batch access request
R is increased by the numerical value of a then N of r, step IF123 is performed after completing the calculating of N；
Step IF123：The webserver constantly search whether have it is new exit request, the execution step IF124 if having, if
Nothing then continues to execute step S400；
Step IF124：Exit request to pass through, handled and recalculated the numerical value of N after exiting request, if exit please for this batch
Ask the numerical value by a then N of s to reduce s, step IF220 is performed after completing the calculating of N.
The webserver constantly searches for access request or exits request in the present invention, and the priority of access request, which is higher than, to be exited
Request, so first handling access request reprocessing exits request.
Further, the multimedia file include audio file, video file, electronic book documentary, electronic courseware file,
Photo files, OFFICE office documents.
Broadcast layer can load different types of multimedia file to adapt to be actually needed in the present invention.
Compared with prior art, the present invention haing the following advantages and beneficial effect：
（1）The present invention supports the file source resource bag of synchronization interactive to share in advance into the Shared Folders of interaction platform
It is locally stored for qualified user terminal, synchronization interactive relies primarily on the small data files such as command information, Update log
Transmission carry out, data segment transmission so reduce synchronization interactive during data transfer, reduce synchronization interactive process to net
The dependence of network environment, supports QoS network service quality pledge systems, ensures that the simultaneous display of multi-screen and user terminal are accurately smooth
Interactive Experience.
（2）The present invention supports open interaction platform, has been built for all user terminals in interaction platform more comfortable
Experience environment.
（3）The present invention uses different data processing methods during synchronization interactive, reduces Internet resources as far as possible
With the occupation rate of Installed System Memory, user experience is further lifted.
Brief description of the drawings
Fig. 1 is the broad flow diagram of the present invention.
Embodiment
The present invention is described in further detail with reference to embodiment, but the implementation of the present invention is not limited to this.
Embodiment 1：
The remote interaction method that a kind of multi-screen synchronous for supporting QoS of the present embodiment is shown, as shown in Figure 1, mainly logical
Cross following technical proposals realization：Comprise the following steps：
Step S100：Establish the interaction platform of simultaneous display；
Step S200：The file source material bag of shared synchronization interactive；
Step IF110：The webserver constantly search whether have new access request or it is new exit request, if having
Then jump procedure IF210, step S200 is continued to execute if nothing；
Step IF210：Access request or after exiting request processing, judges the numerical value of user terminal sum N in interaction platform, N
For nonnegative integer, the direct jump procedure S600 if N=0, if the jump procedure S500 of N=1, if N >=2 perform step S300；
Step S300：Into synchronization interactive interface；
Step S400：Synchronization interactive；
Step IF120：The webserver constantly search whether have new access request or it is new exit request, if having
Then jump procedure IF220, step S400 is continued to execute if nothing；
Step IF220：Access request or after exiting request processing, judges the numerical value of user terminal sum N in interaction platform, if
N=0 item directly jump procedure S600, the jump procedure S500 if N=1, if N >=2 continue to execute step S300；
Step S500：Exit synchronization interactive interface, and jump procedure S200；
Step S600：Cancel interaction platform；
The step S100：Any one user terminal relies on succeed in registration after in the interaction platform that obtains unique ID number to
The webserver sends interactive request, establishes interaction platform and waits the addition of other users；User in the interaction platform
End is established by the webserver and connected, and passes through the data in webserver called data server；
The step S200：The Shared Folders in a subsidiary default document source and storage are automatically generated in interaction platform
In data server, existing Shared Folders does not repeat then to create, any one user terminal in interaction platform is using pre-
If big data transport protocol, upload file source material bag into Shared Folders from local memory module and supply under other users
Carry, or download file source material bag to local memory module from Shared Folders and be locally stored；Data server
User terminal constantly into interaction platform, which is sent, calls file source information, and user terminal sends feedback daily record to examine to data server
Whether survey is locally stored in module is stored with newest complete file source material bag, does not complete the user terminal downloaded and continues to load
Until completing to download or exiting download, the user terminal for having completed to download stops downloading, and realizes the shared of file source material bag；Institute
Stating file source material bag includes file source and file source Update log, and file source, file source Update log include multimedia text
The figure layer data in multi-medium data, figure layer file in part, the time in command information and associated with command file
Script flow；The time script flow refer to synchronization module according to interaction platform timing send timestamp stream to multi-medium data,
Figure layer data, command information synchronize the data for associating and being recorded in xml format；
The step S300：Complete the user terminal that file source material bag is downloaded and enter synchronization interactive interface, call file source
Data bag and the interactive viewing area for loading aspect ratio fixation, the user terminal for having loaded interactive viewing area only update file source material bag
In data, perform step S400 after completing newest interactive viewing area loading；The broadcast layer of the interaction viewing area including lower floor,
The transparent figure layer on upper strata and the instruction list on backstage, in broadcast layer loading multimedia data when loading interactive viewing area, transparent
It is the coordinate system and loading of X-axis and vertical direction for Y-axis to be established in figure layer by coordinate origin, horizontal direction of upper left vertex
Figure layer data, command information is loaded in instruction list；Each coordinate points are coordinate pixel in the coordinate system；
The step S400：Any one user terminal in interaction platform carries out operation in local interactive viewing area to be made mutually
Change in dynamic viewing area, the change of interactive viewing area is converted into the command information being made of instruction, word, ordered series of numbers, instruction
Information is transmitted to data server by local terminal coding, then is sent to other-end and carried out after being called by the webserver
Decoding, other-end is classified after decoded command information is changed is loaded onto broadcast layer or transparent figure layer, and by same
Step module synchronizes calibration and the interactive viewing area of a plurality of clients is synchronously changed, and realizes the interactive operation of multi-screen；
The step S500：When only having a user terminal in synchronization interactive interface, can not synchronize it is interactive and from synchronization
Interactive interface exits；
The step S600：When not having user terminal in interaction platform, which cancels automatically.
Embodiment 2：
The present embodiment comprises the following steps：
Step S100：Party A-subscriber end relies on succeed in registration after in the interaction platform that obtains unique ID number to the webserver
Interactive request is sent, interaction platform is established and waits the addition of other users；
Step S200：The Shared Folders in a subsidiary default document source is automatically generated in interaction platform and is stored in data
In server, party A-subscriber end uploads file source material bag to Shared Folders using RTP/RTCP agreements from local memory module
It is middle to be downloaded for other users；
Step IF111：The webserver receives party B-subscriber end, C user terminals, D user terminals, E user terminals in the same period
The access request of transmission, jump procedure IF112；
Step IF112：Data server detects that mould is locally stored in party A-subscriber end, BYong Huduan, C user terminal, D user terminals
Complete file source material bag has been stored with block；E user terminals are downloading file source material bag, then pass through party B-subscriber end, C
The access request of user terminal, D user terminals, refuses the access request of E user terminals, at this time p=3, N=4, performs step IF113；
Step IF113：The webserver searches the request of exiting of D user terminals transmission, execution step IF114；
Step IF114：Exit request to pass through, at this time q=1, N=3, perform step IF210；
Step IF210：N=3 meet the condition of N >=2 at this time, perform step S300；
Step S300：Party A-subscriber end, BYong Huduan, C user terminal enter synchronization interactive interface, the interactive displays of party A-subscriber end loading A
Area, party B-subscriber end loading B interactions viewing area, C user terminals loading C interactions viewing area, step is performed after the completion of interactive viewing area loading
S400；
Step S400：Comprise the following steps that：
Step S410：Party A-subscriber end possesses operating rights as control terminal, and BYong Huduan, C user terminal, which become, participates in end；
Step S420：The synchronization module at party A-subscriber end, which does not hear local input unit, action, continues to execute step
S420, until the synchronization module at party A-subscriber end listens to local input unit and has action, party A-subscriber end is sent to the webserver
Synchronization request simultaneously performs step S430 after synchronization request is authorized to；
Step S430：The synchronization module at party A-subscriber end does not find that A interactions viewing area changes, continues to execute step S430, directly
Synchronization module to party A-subscriber end finds that A interactions viewing area changes, and the corresponding change in A interactions viewing area is converted to instruction letter
Cease and generate file source Update log, then jump procedure S440；
Step S440：Command information, 1# file sources Update log are encoded by party A-subscriber end and packed, and are sent out using ICP/IP protocol
Send to data server, be updated by data server added to Shared Folders and preserve and be forwarded to respectively party B-subscriber end, C
User terminal is decoded；
Step S450：Party B-subscriber end is by decoded command information synchronism output to B interactions viewing area, while C user terminals will
Decoded command information synchronism output is to C interactions viewing area；
Step IF121：The access request that the webserver receives D user terminals in the same period, E user terminals are sent,
Perform step IF122；
Step IF122：Data server detects that D user terminals, being locally stored in module for E user terminals have been stored with completely
File source material bag, D user terminals not only completely download file source material bag described in the present embodiment step S200 it is also new under
The 1# file source Update logs described in the present embodiment step S440 are carried, E user terminal breakpoints have renewed the present embodiment step
1# file source Update logs described in the also newly downloaded the present embodiment step S440 of file source material bag described in S200, because
This D user terminal, E user terminals are by access request, p=2 at this time, and N=5, perform step IF123；
Step IF123：The webserver searches the request of exiting of party A-subscriber end transmission, execution step IF124；
Step IF124：Exit request to pass through, at this time q=1, N=4, perform step IF220；
Step IF220：N=4 meet the condition of N >=2 at this time, perform step S300；
Step S300：D user terminals, E user terminals enter synchronization interactive interface, and party A-subscriber exits at end synchronization interactive interface,
D user terminals loading D interactions viewing area, E user terminals loading E interactions viewing area, each interaction viewing area loading are completed
Step S400 is performed afterwards；
Step S400：Comprise the following steps that：
Step S410：Party B-subscriber end according to condition automatically becomes control terminal, but E user terminals send control data, and party B-subscriber end is same
E user terminals possess operating rights as control terminal after its control data of anticipating, and BYong Huduan, C user terminal, D user terminals, which become, participates in end；
Step S420：The synchronization module of E user terminals, which does not hear local input unit, action, continues to execute step
S420, until the synchronization module of E user terminals listens to local input unit and has action, E user terminals are sent to the webserver
Synchronization request simultaneously performs step S430 after synchronization request is authorized to；
Step S430：The synchronization module of E user terminals does not find that E interactions viewing area changes, continues to execute step S430, directly
Synchronization module to E user terminals finds that E interactions viewing area changes, and the corresponding change in E interactions viewing area is converted to instruction letter
Cease and generate file source Update log, then jump procedure S440；
Step S440：Command information, 2# file sources Update log are encoded by E user terminals and packed, and are sent out using ICP/IP protocol
Send to data server, be updated by data server added to Shared Folders and preserve and be forwarded to respectively party B-subscriber end, C
User terminal, D user terminals are decoded；
Step S450：Party B-subscriber end will decode decoded command information synchronism output to B interactions viewing area, C user terminals
Command information synchronism output afterwards is to C interactions viewing area, while D user terminals are mutual to D by decoded command information synchronism output
Dynamic viewing area；At this time, the synchronization module of C user terminals detects threshold values of the synchronization time difference beyond setting, is sent out to the webserver
After sending synchronous calibration to ask, synchronous calibration request passes through and calls 2# file sources in data server to update day by the webserver
Time script flow in will synchronizes calibration；
Step S460：After the completion of this synchronization interactive, again jump procedure S410 and realize interaction；
Step IF121：Whether the webserver constantly search has new access request, and being not received by new access please
Ask, jump procedure IF123；
Step IF123：The webserver, which receives party B-subscriber end, C user terminals, E user terminals are sent exits request, performs
Step IF124；
Step IF124：Request is exited to pass through, BYong Huduan, C user terminal, E user terminals exit synchronization interactive interface, at this time s=
3, N=1, perform step IF220；
Step IF220：N=1 meets the condition of N=1, jump procedure S500 at this time；
Step S500：D user terminals exit synchronization interactive interface, and jump procedure S200；
Step S200：The text described in the present embodiment step S200 has been stored with the memory module of D user terminals local
Part source material bag, and 1# file sources Update log, 2# file source Update logs described in the present embodiment step S440, without
Repeated downloads；
Step IF111：The webserver does not receive new access request, jump procedure IF113；
Step IF113：The webserver receives the request of exiting that D user terminals send, and performs step IF114；
Step IF114：The request of exiting of D user terminals passes through, at this time q=1, N=0, performs step IF210；
Step IF210：N=0 meets the condition of N=0, direct jump procedure S600 at this time；
Step S600：There is no user terminal in interaction platform, this interaction platform established temporarily is cancelled and removed altogether automatically
Enjoy all data in file.
The other parts of the present embodiment are same as Example 1, and so it will not be repeated.
The above, is only presently preferred embodiments of the present invention, not does limitation in any form to the present invention, it is every according to
Any simply modification, the equivalent variations made according to the technical spirit of the present invention to above example, each fall within the protection of the present invention
Within the scope of.
Claims (9)
1. a kind of remote interaction method that multi-screen synchronous for supporting QoS is shown, it is characterised in that comprise the following steps：
Step S100：Establish the interaction platform of simultaneous display；
Step S200：The file source material bag of shared synchronization interactive；
Step IF110：The webserver constantly search whether have new access request or it is new exit request, jumped if having
IF210 is gone to step, step S200 is continued to execute if nothing；
Step IF210：Access request or after exiting request processing, judges the numerical value of user terminal sum N in interaction platform, N is non-
Negative integer, the direct jump procedure S600 if N=0, if the jump procedure S500 of N=1, if N >=2 perform step S300；
Step S300：Into synchronization interactive interface；
Step S400：Synchronization interactive；
Step IF120：The webserver constantly search whether have new access request or it is new exit request, jumped if having
IF220 is gone to step, step S400 is continued to execute if nothing；
Step IF220：Access request or after exiting request processing, judges the numerical value of user terminal sum N in interaction platform, if N=0
Then direct jump procedure S600, the jump procedure S500 if N=1, if N >=2 continue to execute step S300；
Step S500：Exit synchronization interactive interface, and jump procedure S200；
Step S600：Cancel interaction platform；
The step S100：Any one user terminal relies on succeed in registration after in the interaction platform that obtains unique ID number to network
Server sends interactive request, establishes interaction platform and waits the addition of other users；User terminal in the interaction platform leads to
Cross the webserver and establish connection, and pass through the data in webserver called data server；
The step S200：The Shared Folders in a subsidiary default document source is automatically generated in interaction platform and is stored in number
According in server, existing Shared Folders does not repeat then to create, any one user terminal in interaction platform is using default
Big data transport protocol, uploads file source material bag from local memory module and other users download is supplied into Shared Folders,
Or file source material bag to local memory module is downloaded from Shared Folders and is locally stored；Data server is continuous
User terminal into interaction platform, which is sent, calls file source information, and user terminal sends feedback daily record to detect this to data server
Newest complete file source material bag whether is stored with ground memory module, do not complete the user terminal downloaded continue loading until
Complete to download or exit download, the user terminal for having completed to download stops downloading, and realizes the shared of file source material bag；The text
Part source material bag includes file source and file source Update log, and file source, file source Update log include in multimedia file
Multi-medium data, the figure layer data in figure layer file, the time script in the command information and associated with command file
Stream；The time script flow refers to synchronization module according to the timestamp stream of interaction platform timing transmission to multi-medium data, figure layer
Data, command information synchronize the data for associating and being recorded in xml format；The big data transport protocol uses RTP/
Rtcp protocol；
The step S300：Complete the user terminal that file source material bag is downloaded and enter synchronization interactive interface, call file source material
Wrap and load the interactive viewing area of aspect ratio fixation, the user terminal for having loaded interactive viewing area is only updated in file source material bag
Data, step S400 is performed after completing newest interactive viewing area loading；The interaction viewing area includes the broadcast layer of lower floor, upper strata
Transparent figure layer and backstage instruction list, in broadcast layer loading multimedia data when loading interactive viewing area, in transparent figure layer
Upper foundation is X-axis and vertical direction for the coordinate system of Y-axis as coordinate origin, horizontal direction using upper left vertex and loads figure layer
Data, command information is loaded in instruction list；Each coordinate points are coordinate pixel in the coordinate system；
The step S400：Any one user terminal in interaction platform, which carries out operation in local interactive viewing area, makes interactive show
Show in area and change, the change of interactive viewing area is converted into the command information being made of instruction, word, ordered series of numbers, command information
Transmitted by local terminal coding to data server, then send to other-end and solved after being called by the webserver
Code, classification is loaded onto broadcast layer or transparent figure layer after other-end is changed decoded command information, and passes through synchronization
Module synchronizes calibration and the interactive viewing area of a plurality of clients is synchronously changed, and realizes the interactive operation of multi-screen；
The step S500：When only having a user terminal in synchronization interactive interface, can not synchronize it is interactive and from synchronization interactive
Interface is exited；
The step S600：When not having user terminal in interaction platform, which cancels automatically.
2. the remote interaction method that a kind of multi-screen synchronous for supporting QoS according to claim 1 is shown, it is characterised in that：
The step S400 specifically refers to following steps：
Step S410：Any one user terminal becomes control terminal, and other users end, which becomes, participates in end, and only control terminal possesses operation
Power；
Step S420：The synchronization module of control terminal monitors whether local input unit has action, is failure to actuate if without if, if having
Synchronization request is sent to the webserver and step S430 is performed after synchronization request is authorized to；
Step S430：The synchronization module of control terminal judges whether interactive viewing area changes, and is failure to actuate if without if, will if having
Corresponding change is converted to command information and generates corresponding file source Update log for interactive viewing area, then jump procedure
S440；
Step S440：Command information, file source Update log are encoded by control terminal and packed, using default small data transmission agreement
Send to data server, be updated by data server added to Shared Folders and preserve and be forwarded in interaction platform
End is participated in be decoded；The small data transmission agreement uses ICP/IP protocol；
Step S450：Decoded command information synchronizes output in the interactive viewing area for participating in end；
Step S460：After the completion of this synchronization interactive, again jump procedure S410 and realize interaction.
3. the remote interaction method that a kind of multi-screen synchronous for supporting QoS according to claim 2 is shown, it is characterised in that：
The step S410 specifically includes following steps：
Step S411：Each user terminal is ranked up by the time sequencing for adding interaction platform in interaction platform, and is taken by network
Business device Match in sequence control thread simultaneously forms control thread list；The control thread is divided into online, active, three kinds of shapes of vacancy
State, is presence into the thread that controls shared by the user terminal at synchronization interactive interface, possesses the online control of operating rights
Thread is active state, and the thread that controls exited shared by the user terminal at synchronization interactive interface is open position, and acquiescence is in
The thread that controls of the front end of wire state is active state, and the corresponding user terminal of control thread of active state is held in order to control,
Wire state controls the corresponding user terminal of thread to participate in end；
Step S412：The webserver receives when exiting request, agrees to that sending the user terminal for exiting request exits synchronization interactive
Interface, corresponding control thread are changed into open position from presence and wait redistributing for the webserver, generate at the same time
Control thread change log is preserved, and the corresponding control thread order in other users end and position do not change；
Step S413：When the webserver receives access request, agree to that the user terminal for sending access request adds synchronization interactive
Interface, at the same transfer control thread change log to it is existing control thread list in the presence or absence of open position control thread into
Row retrieval, the control thread of any one open position is distributed to so far user terminal if having, if without a newly-built control line
Journey distributes so far user terminal；
Step S414：Whether the webserver constantly search has new control data, the jump procedure S415 if having, if without not
Action；
Step S415：Any one participates in end and sends control data to the webserver, is turned control data by the webserver
Be sent to current control terminal, the current control terminal power out of hand if current control terminal is agreed to and being changed into participate in end and this
Send control data participation end obtain control and be changed into control terminal, if current control terminal disagrees control it is constant and
This control data fails.
4. the remote interaction method that a kind of multi-screen synchronous for supporting QoS according to claim 2 is shown, it is characterised in that：
In the step S430, the change of interactive viewing area includes the change of multimedia file broadcast state, playing progress rate in broadcast layer
Or in transparent figure layer coordinate pixel and its corresponding color value change；The step S430 specifically includes following steps：
Step S431：Control terminal judges the change for whether having corresponding local mouse action in interactive viewing area, and step is performed if nothing
Rapid S432, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S432：Control terminal judges the change for whether having corresponding local touch screen operation in interactive viewing area, is performed if without if
Step S433, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S433：Control terminal judges the change for whether having corresponding local keyboard operation in interactive viewing area, and step is performed if nothing
Rapid S434, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S434：Control terminal judges the change for whether having respective local audio acquisition module to operate in interactive viewing area, if nothing
Step S435 is then performed, if corresponding change is converted to jump procedure S440 after command information by interactive viewing area if having；
Step S435：Control terminal judges the change for whether having corresponding local video acquisition module operation in interactive viewing area, if nothing
Then it is failure to actuate, if by interactive viewing area, corresponding change is converted to jump procedure S440 after command information if having.
5. the remote interaction method that a kind of multi-screen synchronous for supporting QoS according to claim 4 is shown, it is characterised in that：
The step S450 specifically includes following steps：
Step S451：Compared with the size of interactive viewing area of the size of the interactive viewing area of control terminal with participating in end and obtain
Ratio；
Step S452：The corresponding change of control terminal mouse action calls the command information at participation end and with reference to the step
Exported after the ratio matching obtained in S451；
Step S453：The corresponding change of control terminal touch screen operation calls the command information at participation end and with reference to the step
Exported after the ratio matching obtained in S451；
Step S454：The corresponding change of control terminal keyboard operation calls the command information at participation end and with reference to the step
Exported after the ratio matching obtained in S451；
Step S455：The corresponding change of control terminal audio collection module operation calls the command information for participating in end and combines institute
Exported after stating the ratio matching obtained in step S451；
Step S456：The corresponding change of control terminal video acquisition module operation calls the command information for participating in end and combines institute
Exported after stating the ratio matching obtained in step S451；
Step S457：After the completion of output, the synchronization module for participating in end sends synchronous calibration request to the webserver；
Step S458：After synchronous calibration request passes through, the webserver calls newest time script circulation in data server
It is sent to and participates in end；
Step S459：After the synchronization module at participation end receives time script flow, parsing time script flow synchronizes calibration.
6. the remote interaction method that a kind of multi-screen synchronous for supporting QoS according to claim 5 is shown, it is characterised in that：
The step S453 specifically includes following steps：
Step S4531：Obtain the track streaked on control terminal touch-screen in interactive viewing area；
Step S4532：The track obtained in step S4531 is converted into a series of sampled point, control is locally in transparent figure layer
Coordinate obtain the coordinate values of all sampled points；
Step S4533：The corresponding color value of sampled point in obtaining step S4532；
Step S4534：According to the sequencing of sampled point, coordinate value and color value are associated afterwards and form ordered series of numbers；
Step S4535：Ratio calculation sampled point according to being obtained in step S451 corresponds to the seat in the interaction viewing area of this participation end
The scale value and associated color value of respective coordinates value is constant and obtain new ordered series of numbers, coordinate value in new ordered series of numbers and associated color value is defeated
Go out to end interaction viewing area is participated in, realize the synchronization interactive of track.
7. the remote interaction method that a kind of multi-screen synchronous for supporting QoS according to claim 5 is shown, it is characterised in that：
After the step S459 specifically refers to the synchronization module parsing time script flow at participation end, obtain control terminal and responded most with participating in end
The time difference of new command information, is failure to actuate if the time difference is in the threshold values of setting, if the time difference beyond setting threshold values into
Row synchroballistic, completes synchronous calibration.
8. a kind of according to claim 1-7 any one supports the remote interaction method that the multi-screen synchronous of QoS is shown, its
It is characterized in that：The step IF110 specifically includes following steps：
Step IF111：Whether the webserver constantly search has new access request, and step IF112 is performed if having, if without
Jump procedure IF113；
Step IF112：The access request for the user terminal that file source material bag is downloaded is completed by not completing under file source material bag
The access request of the user terminal of load is refused, and the numerical value that N is recalculated after access request has been handled, if this batch access request passes through
The numerical value increase p of a then N of p, step IF113 is performed after completing the calculating of N；
Step IF113：The webserver constantly search whether have it is new exit request, step IF114 is performed if having, if nothing
Continue to execute step S200；
Step IF114：Exit request to pass through, handled and recalculated the numerical value of N after exiting request, if to exit request logical for this batch
The numerical value for crossing a then N of q reduces q, and step IF210 is performed after completing the calculating of N；
The step IF120 specifically includes following steps：
Step IF121：Whether the webserver constantly search has new access request, and step IF122 is performed if having, if without
Jump procedure IF123；
Step IF122：The access request for the user terminal that file source material bag is downloaded is completed by not completing under file source material bag
The access request of the user terminal of load is refused, and the numerical value that N is recalculated after access request has been handled, if this batch access request passes through
The numerical value increase r of a then N of r, step IF123 is performed after completing the calculating of N；
Step IF123：The webserver constantly search whether have it is new exit request, step IF124 is performed if having, if nothing
Continue to execute step S400；
Step IF124：Exit request to pass through, handled and recalculated the numerical value of N after exiting request, if to exit request logical for this batch
The numerical value for crossing a then N of s reduces s, and step IF220 is performed after completing the calculating of N.
9. a kind of according to claim 1-7 any one supports the remote interaction method that the multi-screen synchronous of QoS is shown, its
It is characterized in that：The multimedia file includes audio file, video file, electronic book documentary, electronic courseware file, photo text
Part, OFFICE office documents.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510258579.6A CN104902017B (en) | 2015-05-20 | 2015-05-20 | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510258579.6A CN104902017B (en) | 2015-05-20 | 2015-05-20 | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104902017A CN104902017A (en) | 2015-09-09 |
| CN104902017B true CN104902017B (en) | 2018-05-15 |
Family
ID=54034413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510258579.6A Expired - Fee Related CN104902017B (en) | 2015-05-20 | 2015-05-20 | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104902017B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106610763B (en) * | 2015-10-26 | 2020-11-20 | 阿里巴巴集团控股有限公司 | Method and device for synchronizing user operation across screens |
| CN105979336A (en) * | 2015-12-03 | 2016-09-28 | 乐视致新电子科技（天津）有限公司 | Startup advertisement processing method and device |
| CN105407176A (en) * | 2015-12-21 | 2016-03-16 | Tcl集团股份有限公司 | Data sharing method and system, and server side |
| CN106303650A (en) * | 2016-08-31 | 2017-01-04 | 成都炫境科技有限公司 | Audio video synchronization display packing |
| CN110020305B (en) * | 2017-11-29 | 2023-12-12 | 深圳市雅阅科技有限公司 | Webpage loading method, webpage loading device, computer equipment and storage medium |
| CN107992255B (en) * | 2017-12-01 | 2020-11-20 | 珠海格力电器股份有限公司 | Method for generating image and server |
| CN108958858A (en) * | 2018-05-24 | 2018-12-07 | 北京长城华冠汽车科技股份有限公司 | The page synchronization method of graphic user interface |
| CN110784340B (en) * | 2019-10-09 | 2022-07-12 | 无线生活(北京)信息技术有限公司 | Configuration information updating method and device |
| CN111240618A (en) * | 2019-12-31 | 2020-06-05 | 北京升哲科技有限公司 | Multi-user multi-screen display method and device based on android |
| CN111679881B (en) * | 2020-06-09 | 2022-03-15 | 腾讯科技（深圳）有限公司 | File processing method and device, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248712A (en) * | 2013-05-24 | 2013-08-14 | 杭州东信北邮信息技术有限公司 | Simultaneous broadcasting management method and system of multi-media electronic screen |
| CN104158900A (en) * | 2014-08-25 | 2014-11-19 | 焦点科技股份有限公司 | Method and system for synchronizing courseware through iPad controlling |
| CN104184739A (en) * | 2014-09-01 | 2014-12-03 | 陈小鹏 | Class synchronization system based on wireless network |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7937325B2 (en) * | 1998-12-08 | 2011-05-03 | Yodlee.Com, Inc. | Interactive bill payment center |
-
2015
- 2015-05-20 CN CN201510258579.6A patent/CN104902017B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103248712A (en) * | 2013-05-24 | 2013-08-14 | 杭州东信北邮信息技术有限公司 | Simultaneous broadcasting management method and system of multi-media electronic screen |
| CN104158900A (en) * | 2014-08-25 | 2014-11-19 | 焦点科技股份有限公司 | Method and system for synchronizing courseware through iPad controlling |
| CN104184739A (en) * | 2014-09-01 | 2014-12-03 | 陈小鹏 | Class synchronization system based on wireless network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104902017A (en) | 2015-09-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104902017B (en) | A kind of remote interaction method that multi-screen synchronous for supporting QoS is shown | |
| CN108681436A (en) | Image quality parameter adjusting method, device, terminal and storage medium | |
| CN102640103B (en) | Method and apparatus for providing access to social content | |
| US20090193345A1 (en) | Collaborative interface | |
| US10025547B2 (en) | Systems, methods, and apparatuses for implementing frame aggregation with screen sharing | |
| US20140344286A1 (en) | Method and apparatus for displaying webcast roomss | |
| CN110765744A (en) | Multi-person collaborative document editing method and system | |
| WO2004025466A3 (en) | Distributed computing infrastructure | |
| US11910048B2 (en) | Synchronizing video content among clients in a collaboration system | |
| CN104267887B (en) | Five application page self-adaption typesetting display methods based on application widget dimensional parameters | |
| CN104253814A (en) | Streaming media processing method, server and browser | |
| CN111723558A (en) | Document display method and device, electronic equipment and storage medium | |
| CN109905629A (en) | Method, apparatus, medium and the equipment of document sharing are realized when audio/video conference | |
| CN104685873A (en) | Encoding control device and encoding control method | |
| CN113395243A (en) | Information interaction method and device, electronic equipment and storage medium | |
| CN106302362A (en) | Content of multimedia sending method, sharing method, method of reseptance and corresponding intrument | |
| EP2979198A1 (en) | Apparatus and method for presenting html page | |
| CN109600423A (en) | Method of data synchronization, device, electronic equipment and storage medium | |
| WO2021029671A1 (en) | Method and system for playing streaming content | |
| JP2005208710A (en) | Synchronous control method, communication synchronous controller and interactive communication system | |
| CN104980685A (en) | Video service providing method and video service providing system | |
| US10021205B2 (en) | Rules-based multipoint routing of real-time information using client-server architecture | |
| EP4184924A1 (en) | Network live broadcast interaction method and device | |
| CN106941485B (en) | Signaling control method and system based on multimedia interaction system | |
| US20240097926A1 (en) | Dynamic Participant Device Management for Hosting a Teleconference |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Tong Xiang Inventor before: He Yunchuan Inventor before: Kang Gangqiang |
|
| CB03 | Change of inventor or designer information | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180413 Address after: 510000 self compiled A, 603 building, business building, 118 Whampoa Avenue West Road, Tianhe District, Guangzhou, Guangdong Applicant after: Guangzhou Xun Information Technology Co., Ltd. Address before: 610000 No. 1, No. 9, No. 9, No. 160, Jianshe South Road, Chengdu, Sichuan, Chenghua District Applicant before: SICHUAN JINGTIAN AIREN SCIENCE & TECHNOLOGY CO., LTD. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180515 Termination date: 20200520 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |