CN111324216A - Character input method, device and system for cloud application - Google Patents
Character input method, device and system for cloud application Download PDFInfo
- Publication number
- CN111324216A CN111324216A CN202010100941.8A CN202010100941A CN111324216A CN 111324216 A CN111324216 A CN 111324216A CN 202010100941 A CN202010100941 A CN 202010100941A CN 111324216 A CN111324216 A CN 111324216A
- Authority
- CN
- China
- Prior art keywords
- application
- input method
- input
- report
- hid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 297
- 230000002093 peripheral effect Effects 0.000 claims description 38
- 230000001960 triggered effect Effects 0.000 claims description 9
- 238000004806 packaging method and process Methods 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 7
- 238000012546 transfer Methods 0.000 claims description 7
- 238000012544 monitoring process Methods 0.000 claims description 2
- 230000004044 response Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 101150054987 ChAT gene Proteins 0.000 description 3
- 101100203187 Mus musculus Sh2d3c gene Proteins 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000008092 positive effect Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a character input method, device and system for cloud application. The method comprises the following steps: receiving an HID information input report sent by a client; the HID information input report is generated by the client according to character data input by a user through an input method associated with the application after the application is started; and according to the identification of the input method contained in the HID information input report, transmitting the character data obtained by analyzing the HID information input report to an application associated with the input method for displaying. Therefore, the input of the content such as characters and characters in the cloud application can be realized, and the user experience is improved.
Description
Technical Field
The disclosure relates to the technical field of cloud computing, in particular to a character input method, device and system for cloud application.
Background
The cloud game is based on a cloud computing architecture, the game is operated at a cloud server, the cloud server performs rendering work of a game picture, the rendered game picture and audio generated in the game operation process are encoded and transmitted to a terminal in an audio and video stream mode in real time, and the terminal decodes and plays the real-time audio and video stream, so that the requirements of game operation on the rendering capacity, the storage capacity and the like of the terminal are reduced.
In the cloud game mode, a user needs to input information such as a game account number and a password when logging in a game, and in order to meet the game experience of the user, a chat interaction function between users may need to be met in the game process, so how to input information such as characters and numbers in a cloud game is a problem that improvement of the cloud game experience of the user needs to be solved urgently.
Disclosure of Invention
In view of this, the present disclosure provides a character input method, device and system for a cloud application, so as to realize character input in an application.
Specifically, the present disclosure is realized by the following technical solutions:
in a first aspect, an embodiment of the present disclosure provides a character input method for a cloud application, where the method includes:
receiving a human-computer interaction device HID information input report sent by a client; the HID information input report is generated by the client according to character data input by the user through an input method associated with the application after the application is started;
and according to the identification of the input method contained in the HID information input report, transmitting the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying.
In a second aspect, an embodiment of the present disclosure provides a character input method for a cloud application, where the method includes:
the client acquires character data input by a user through an input method associated with the application after the application is started, encapsulates the character data into an HID information input report and sends the HID information input report to the cloud server;
and the cloud server receives the HID information input report, and transmits character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
In a third aspect, an embodiment of the present disclosure provides a character input device for a cloud application, where the device includes:
the receiving module is used for receiving a human-computer interaction device HID information input report sent by the client; the HID information input report is generated by the client according to character data input by the user through an input method associated with the application after the application is started;
and the transfer module is used for transferring the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
In a fourth aspect, an embodiment of the present disclosure provides a character input system for cloud applications, where the system includes:
the client is used for acquiring character data input by a user through an input method associated with the application after the application is started, packaging the character data into an HID information input report and sending the HID information input report to the cloud server;
and the cloud server is used for receiving the HID information input report, and transmitting the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
In a fifth aspect, the disclosed embodiments provide a machine-readable storage medium having stored thereon several computer instructions, which when executed, implement the method according to the first aspect.
In a sixth aspect, an embodiment of the present disclosure provides a computer device, including: a machine-readable storage medium and a processor, the machine-readable storage medium: storing instruction code, the processor: communicating with a machine-readable storage medium, reading and executing instruction code in the machine-readable storage medium, to implement a method as described in the first aspect.
According to the character input method, the device and the system for the cloud application, the application runs at a cloud server, the cloud server receives an HID information input report sent by a client after the application is started, analyzes the HID information input report, and transmits character data obtained by analyzing the HID information input report to the application for output according to an identification of an input method related to the application in the HID information input report; the character input method for the cloud application provided by the embodiment of the disclosure realizes that data such as characters, numbers, characters and the like of applications such as cloud games and the like running at a cloud server can be input at a terminal.
Drawings
Fig. 1 is a schematic view of a specific application scenario of a character input method for a cloud application according to an exemplary embodiment of the present disclosure;
fig. 2 is a schematic flow chart illustrating an input method access according to an exemplary embodiment of the present disclosure;
FIG. 3 is a schematic flow diagram illustrating a first outgoing call input method according to an exemplary embodiment of the present disclosure;
fig. 4 is a flowchart illustrating a character input method for a cloud application according to an exemplary embodiment of the present disclosure;
fig. 5 is a flowchart illustrating another character input method for a cloud application according to an exemplary embodiment of the disclosure;
fig. 6 is a schematic structural diagram illustrating a character input device of a cloud application according to an exemplary embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a computer device according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
For an application such as a cloud game running on a cloud service end, when information input such as an account number and a password is performed on the application, or when a user performs chat interaction in the running process of the application, the application is required to support character input; based on this, the embodiment of the disclosure provides a method, a device and a system for character input method of cloud application.
Fig. 1 is a schematic view of a specific application scenario of a character input method for a cloud application according to an exemplary embodiment of the present disclosure; referring to fig. 1, an application runs on a cloud server 200, after the application is started, a user may call an input method at a client 100 through an operation of the call input method, input contents such as characters and symbols using the input method, and the client 100 generates an HID information input report according to character data input by the user through the input method.
Illustratively, the client 100 transmits the HID information input report to an application operation management module of the cloud server 200, where the application operation management module is in one-to-one correspondence with an application deployed by the cloud server and is used for managing the operation of the corresponding application. The cloud service 200 identifies an identifier of an input method included in the HID (Human Interface Device, Device interacting with Human) information input report through the application operation management module, for example, the identifier is a virtual peripheral identifier using the input method as a virtual peripheral, and the cloud service 200 analyzes the HID information input report through the application operation management module to obtain character data input by a user, transmits the character data to a corresponding application according to the identifier of the input method, and displays the character by the application.
For example, the application running management module directly transfers the received HID information input report to the Windows operating system, and the Windows operating system transfers the HID information input report to the application.
In another embodiment of the present disclosure, the application operation management module may also directly transmit the received HID information input report to the application itself, and the HID information input report is processed and then displayed by the application; the present disclosure is not limited thereto.
In the above embodiment of the present disclosure, after the application is started, if a user wants to input data information such as text and characters through an input method, it is first ensured that the input method is in an effective access state.
Fig. 2 is a schematic flow chart illustrating an input method access according to an exemplary embodiment of the present disclosure; the method is applied to the cloud server, and as shown in fig. 2, the method specifically includes the following steps S101 to S102:
s101, the cloud server receives an HID virtual peripheral access report sent by the client when the application is started, wherein the HID virtual peripheral access report contains the identification of the input method.
In a specific embodiment of the present disclosure, a virtual peripheral interface is set in an application streaming SDK (software development Kit) at a client, and if an application calls the application streaming SDK at the client to start streaming, an input method associated with the application calls the virtual peripheral interface of the application streaming SDK at the same time, and at this time, the application streaming SDK generates virtual peripheral access information, encapsulates the virtual peripheral access information into an HID virtual peripheral access report, and transmits the HID virtual peripheral access report to an application operation management module at a cloud service end; the virtual peripheral access report includes the identifier of the input method.
S102, analyzing the HID virtual peripheral access report, associating the input method with the application, and setting the state of the input method to be a connected state.
Illustratively, the application running management module of the cloud server receives the HID virtual peripheral access report, acquires an identifier of an input method from a report descriptor of the HID virtual peripheral access report, stores the identifier of the input method and the identifier of the application process in a one-to-one association manner, and sets the state of the input method associated with the application to a connected state.
In the connected state of the input method, the user can operate the outgoing call input method through the outgoing call input method to input characters in the application. In the embodiment of the disclosure, the outgoing call of the input method is realized through two modes.
FIG. 3 is a schematic flow diagram illustrating a first outgoing call input method according to an exemplary embodiment of the present disclosure; referring to fig. 3, in this embodiment, the method further includes the following steps S201 to S202:
s201, under the condition that an input method is in a connected state, a cloud service end receives a first touch screen instruction which is sent by a client and is triggered and generated by the user' S calling input method operation, and the first touch screen instruction is transmitted to the application so that the application can respond to the first touch screen instruction.
The user's outgoing call input method operation includes: the user clicks an information input box of the application, and the user clicks a set keyboard icon, and the like, which is not limited by the present disclosure.
In a specific embodiment of the disclosure, a client side application streaming SDK generates a first touch instruction in response to an operation of a user calling an input method, the application streaming SDK continues to send the first touch instruction to an application operation management module of the client side, the application operation management module sends the first touch instruction to a Windows operating system, the Windows operating system sends the first touch instruction to a corresponding application, and the application responds to the first touch instruction to call an API of the Windows operating system calling the input method.
S202, if monitoring that the application calls an API (application program interface) of an associated input method of an operating system, generating a message for displaying the input method, packaging the message for displaying the input method into a first HID (human interface device) output report, and sending the first HID output report to the client, so that the client displays the input method after receiving the first HID output report.
Illustratively, the application running management module monitors whether the application calls an associated input method API of the Windows operating system or not in a Hook manner, if it is monitored that the application calls the associated input method API of the Windows operating system to call out an input method associated with the application, a message for displaying the input method is generated, the message for displaying the input method is packaged to obtain a first HID output report, the first HID output report is sent to the client, the client displays the input method after receiving the first HID output report, and the user can input contents such as characters, numbers, symbols and the like in an information input box (such as a chat information input box, an account number input box and the like) of the application through the input method.
Furthermore, in the embodiment of the disclosure, the display operation of the input method is realized in a manner of common control of the client and the cloud server.
In another embodiment of the present disclosure, a second method for calling out an input method is provided, where the method may be implemented by controlling and displaying the input method only through a client, and illustratively, a user clicks a preset keyboard icon, and if the client determines that a current state of the input method is a hidden state, the input method is controlled and displayed.
Or in another embodiment of the present disclosure, in the above character input method, the method of the first outgoing call input method and the method of the second outgoing call input method are simultaneously supported, for example, if the user does not call out an input method by clicking an input box in an application (i.e., the client does not receive the first output report sent by the cloud server by using the method of the first outgoing call input method), the input method may be directly controlled and displayed locally by the client by clicking a keyboard icon again.
After the input method is displayed in the application, the user can input characters through the input method, such as inputting an account number and a password, and performing communication interaction with other users.
Fig. 4 is a flowchart illustrating a character input method for a cloud application according to an exemplary embodiment of the present disclosure; referring to fig. 4, the method is applied to a cloud server, and mainly includes the following steps S301 to S302:
s301, the cloud server receives an HID information input report sent by the client; the HID information input report is generated by the client according to character data input by the user through an input method associated with the application after the application is started.
In the embodiment of the disclosure, after an application is started, if a user wants to input information content such as a text, the user operates an outgoing call input method through the outgoing call input method, then uses the input method to input character content such as a text and a symbol, after the input is completed, a client obtains characters input by the user, the client generates an HID information input report according to character data input by the user, and transmits the HID information input report to a cloud server, and the client transmits the HID information input report to an application operation management module arranged at the cloud server.
S302, according to the identification of the input method contained in the HID information input report, transmitting the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying.
For example, after receiving the HID information input report, the application operation management module at the cloud server parses the HID information input report to obtain character data input by the user, which is included in the HID information input report, transmits the parsed character data to a corresponding application according to an identifier of an input method included in the HID information input report, and displays the character data after application processing.
For example, after the HID information input report is analyzed by the application operation management module to obtain the character data in the HID information input report, the character data is transferred to the Windows operating system, the character data is transferred to the application through the Windows operating system, and the character data is processed by the application and displayed
Furthermore, in the embodiment of the disclosure, the insertion and display of the input method in the cloud application and the input of character data such as characters and symbols through the input method are realized; the method has the positive effects of improving the convenience of the user and the user experience.
In another embodiment of the disclosure, after the user finishes inputting the characters, in order to avoid that the display of the input method affects the display effect of the application, and further after the character information is finished inputting, the cloud server implements hiding of the input method through the following steps a10-a 20:
step A10, the cloud service end receives a second touch screen instruction which is sent by the client and is triggered and generated by the hidden input method operation of the user, and the second touch screen instruction is transmitted to the application, so that the application responds to the second touch screen instruction.
Illustratively, the hidden input method operation of the user includes: the user clicks a blank of the application interface, or clicks an input method icon, or clicks a virtual key for indicating completion of input, such as a confirmation key or an enter key that the user clicks after inputting an account number and a password, which is not limited in this disclosure.
Step A20, if it is monitored that the application calls a disassociation input method API of the operating system, generating a message for hiding the input method, encapsulating the message for hiding the input method into a second HID output report, and sending the second HID output report to the client, so that the client hides the input method after receiving the second HID output report.
In a specific embodiment of the disclosure, after information is input in an application, a user executes an operation of hiding an input method, a client generates a second touch instruction in response to the operation of the user, the second touch instruction is sent to an application operation management module of a cloud service end, the application operation management module sends the second touch instruction to a corresponding application, and the application responds to the second touch instruction to call a disassociation input method API of an operating system; illustratively, if the application calls a disassociation input method API of the Windows operating system in a Hook manner, the application operation management module generates a hidden input method message, encapsulates the hidden input method message to obtain a second HID output report, sends the second HID output report to the client, and the client performs streaming analysis on the second HID output report to obtain the hidden input method message included in the second HID output report, and performs an operation of hiding the input method in response to the hidden input method message.
In the embodiment of the disclosure, the hiding of the input method is controlled by the client and the cloud server together.
In another embodiment of the present disclosure, the user may perform the hiding operation of the input method on the client, and the client independently performs the hiding operation of the input method.
Or if the user executes the first hidden input method operation on the client, the client and the cloud server are triggered to jointly control the hiding of the input method, and the client is triggered to directly execute the hidden operation of the input method by executing the second hidden input method operation. For example, after the user clicks a blank of the application interface, if the input method is not hidden, that is, the client may not receive the second HID output report sent by the cloud server, the user may continue to click the input method icon, and the client directly executes the hidden operation of the input method in response to the operation of clicking the input method icon by the user. Furthermore, in the embodiment, the user is ensured to be capable of hiding the input method, and the influence of the display of the input method on the display effect of the application interface is avoided.
In an embodiment of the disclosure, after the application exits, the cloud server receives an HID virtual peripheral pulling report sent by the client after the application exits, analyzes the HID virtual peripheral pulling report, and cancels the association relationship with the application according to the identifier of the input method in the descriptor of the HID virtual peripheral pulling report.
Furthermore, in the embodiment of the disclosure, aiming at the application of the video cloud computing system which needs to support the input method, the input of characters, symbols and the like in Windows is realized, and the user experience is met.
Fig. 5 is a flowchart illustrating another character input method for a cloud application according to an exemplary embodiment of the disclosure; the character input method of the cloud application in the embodiment realizes character input of application in a cloud application system architecture, the cloud application system architecture comprises a client and a cloud server, the method is described from two angles of the cloud server and the client respectively, and specific details can refer to descriptions of the character input method in each embodiment; referring to fig. 5, the method includes the following steps S601-S602:
s601, the client acquires character data input by a user through an input method associated with the application after the application is started, encapsulates the character data into an HID information input report, and sends the HID information input report to the cloud server.
After the application is started, a user operates the calling input method through the calling input method, then character contents such as texts, symbols and the like are input by using the input method, after the input is completed, the client acquires characters input by the user, generates an HID information input report according to character data input by the user, and transmits the HID input report to the cloud server.
S602, the cloud server receives the HID information input report, and transmits character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
In the embodiment of the disclosure, the insertion and display of the input method in the cloud application are realized, and the input of character data such as characters and symbols by a user through the input method can be realized; the method has the positive effects of improving the convenience of the user and the user experience.
Optionally, before the step S601, after the client starts the application, acquires character data input by the user through an input method associated with the application, the method further includes displaying, by the client, the input method, which specifically includes:
and the client responds to the operation of the calling input method of the user and displays the input method.
Or, before the step S601, after the client starts the application, acquires character data input by the user through an input method associated with the application, the method further includes displaying, by the client, the input method, which specifically includes:
the client responds to the call-out input method operation of the user to generate a first touch screen instruction, and the first touch screen instruction is sent to the cloud server;
under the condition that an input method is in an access state, the cloud server receives the first touch screen instruction, and transmits the first touch screen instruction to the application so that the application responds to the first touch screen instruction;
if the cloud server side monitors that the application calls an API (input application program interface) of an associated input method of an operating system, generating a message for displaying the input method, packaging the message for displaying the input method into a first HID (human interface device) output report, and sending the HID output report to the client side;
and the client displays the input method after receiving the first HID output report.
Optionally, before the client displays the input method, the method further includes:
if the application is started, the client sends an HID virtual peripheral access report to the cloud server; the HID virtual peripheral access report comprises the input method as the identifier of the virtual peripheral;
and after receiving the HID virtual peripheral access report, the cloud server associates the input method and the application one to one, and sets the state of the input method to be a connected state.
Optionally, the method further comprises:
the client responds to the hidden input method operation of the user to generate a second touch screen instruction, and the second touch screen instruction is sent to the cloud server;
the cloud server receives a second touch screen instruction sent by the client, and transmits the second touch screen instruction to the application so that the application can respond to the second touch screen instruction;
if the cloud server side monitors that the application calls a disassociation input method API of an operating system, a message for hiding the input method is generated, the message for hiding the input method is packaged into a second HID output report and sent to the client side, and the client side hides the input method after receiving the second HID output report.
In an embodiment of the present disclosure, after the application quits, the client sends an HID virtual peripheral unplugging report to the cloud server. And the cloud server receives the virtual peripheral pulling report, analyzes the HID peripheral pulling report to obtain an input method pulling message, and cancels the association relation with the application according to the report descriptor of the report.
Fig. 6 is a schematic structural diagram illustrating a character input device of a cloud application according to an exemplary embodiment of the present disclosure; referring to fig. 6, the apparatus includes:
a first receiving module 701, configured to receive a human-computer interaction device HID information input report sent by a client; the HID information input report is generated by the client according to character data input by the user through an input method associated with the application after the application is started;
a transfer module 702, configured to transfer, according to the identifier of the input method included in the HID information input report, character data included in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for display.
Optionally, the apparatus further comprises:
a second receiving module (not shown in the figure), configured to receive, when an input method is in a connected state, a first touch screen instruction that is generated and sent by the client and is triggered by a call-out input method operation of the user, and transmit the first touch screen instruction to the application, so that the application responds to the first touch screen instruction;
a first generating module (not shown in the figure), configured to generate a message for displaying the input method if it is monitored that the application calls an associated input method API of the operating system, encapsulate the message for displaying the input method into a first HID output report, and send the first HID output report to the client, so that the client displays the input method after receiving the first HID output report.
Optionally, the apparatus further comprises:
a third receiving module (not shown in the figure), configured to receive an HID virtual peripheral access report sent by the client when the application is started, where the HID virtual peripheral access report includes an identifier of an input method;
and an association module (not shown in the figure) configured to parse the HID virtual peripheral access report, perform one-to-one association between the input method and the application at the cloud server, and set a state of the input method to a connected state.
Optionally, the apparatus further comprises:
a fourth receiving module (not shown in the figure), configured to receive a second touch screen instruction, which is sent by the client and is triggered by a hidden input method operation of the user, and transmit the second touch screen instruction to the application, so that the application responds to the second touch screen instruction;
a second generating module (not shown in the figure), configured to generate a message for hiding the input method if it is monitored that the application calls a disassociation input method API of the operating system, encapsulate the message for hiding the input method into a second HID output report, and send the second HID output report to the client, so that the client hides the input method after receiving the second HID output report.
The embodiment of the present disclosure further provides a character input system for cloud applications, where the system includes:
the client is used for acquiring character data input by a user through an input method associated with the application after the application is started, packaging the character data into an HID information input report and sending the HID information input report to the cloud server;
and the cloud server is used for receiving the HID information input report, and transmitting the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
Optionally, the client is further configured to display the input method in response to an operation of the outgoing call input method by the user.
Optionally, the client is further configured to generate a first touch screen instruction in response to the call-out input method operation of the user, and send the first touch screen instruction to the cloud server;
under the condition that an input method is in an access state, the cloud server receives the first touch screen instruction, and transmits the first touch screen instruction to the application so that the application responds to the first touch screen instruction;
the cloud server is further used for generating a message for displaying the input method if the application calls an API (application programming interface) of an associated input method of the operating system, packaging the message for displaying the input method into a first HID (high intensity discharge) output report and sending the HID output report to the client;
and the client is also used for receiving the first HID output report and then displaying the input method.
Optionally, the client is further configured to send an HID virtual peripheral access report to the cloud server if the application is started; the HID virtual peripheral access report comprises the input method as the identifier of the virtual peripheral;
and the cloud server is further used for performing one-to-one association on the input method and the application after receiving the HID virtual peripheral access report, and setting the state of the input method to be a connected state.
Optionally, the client is further configured to generate a second touch screen instruction in response to a hidden input method operation of the user, and send the second touch screen instruction to the cloud server;
the cloud service end is further used for receiving a second touch screen instruction sent by the client and transmitting the second touch screen instruction to the application so that the application can respond to the second touch screen instruction;
the cloud server is further configured to generate a message for hiding the input method if it is monitored that the application calls a disassociation input method API of the operating system, encapsulate the message for hiding the input method into a second HID output report and send the second HID output report to the client, and the client hides the input method after receiving the second HID output report.
In another embodiment of the present disclosure, a machine-readable storage medium is further provided, on which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps of the character input method for the cloud application. The input of characters, numbers, characters and other data of applications such as cloud games running on a cloud server and the like can be realized at the terminal.
Fig. 7 is a schematic structural diagram of a computer device according to an exemplary embodiment of the present disclosure. Referring to fig. 7, the computer device 500 includes at least a memory 502 and a processor 501; the memory 502 is connected to the processor 501 through a communication bus 503, and is used for storing instruction codes executable by the processor 501; the processor 501 is configured to read and execute instruction codes from the memory 502 to implement the steps of the character input method of the cloud application in any of the above embodiments. The input of characters, numbers, characters and other data of applications such as cloud games running on a cloud server and the like can be realized at the terminal.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
Computers suitable for executing computer programs include, for example, general and/or special purpose microprocessors, or any other type of central processing unit. Generally, a central processing unit will receive instructions and data from a read-only memory and/or a random access memory. The basic components of a computer include a central processing unit for implementing or executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer does not necessarily have such a device. Moreover, a computer may be embedded in another device, e.g., a mobile telephone, a Personal Digital Assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device such as a Universal Serial Bus (USB) flash drive, to name a few.
Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices), magnetic disks (e.g., an internal hard disk or a removable disk), magneto-optical disks, and CD ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features specific to particular embodiments of particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. In other instances, features described in connection with one embodiment may be implemented as discrete components or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking and parallel processing may be advantageous. Moreover, the separation of various system modules and components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Thus, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. Further, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some implementations, multitasking and parallel processing may be advantageous.
The above description is only exemplary of the present disclosure and should not be taken as limiting the disclosure, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.
Claims (13)
1. A character input method for cloud application, the method comprising:
receiving a human-interactive device HID information input report sent by a client; the HID information input report is generated by the client according to character data input by the user through an input method associated with the application after the application is started;
and according to the identification of the input method contained in the HID information input report, transmitting the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying.
2. The method of claim 1, wherein prior to receiving the HID information input report sent by the client, the method further comprises:
under the condition that an input method is in a connected state, receiving a first touch screen instruction which is sent by the client and is triggered and generated by the operation of the user calling the input method, and transmitting the first touch screen instruction to the application so that the application responds to the first touch screen instruction;
and if monitoring that the application calls an API (application program interface) of an associated input method of an operating system, generating a message for displaying the input method, packaging the message for displaying the input method into a first HID (human interface device) output report, and sending the first HID output report to the client, so that the client displays the input method after receiving the first HID output report.
3. The method according to claim 2, wherein before the receiving of the first touch screen instruction generated by being triggered by the user's outgoing call input method operation and sent by the client, the method further comprises:
receiving an HID virtual peripheral access report sent by the client when the application is started, wherein the HID virtual peripheral access report contains an identifier of an input method;
analyzing the HID virtual peripheral access report, performing one-to-one association on the input method and the application at the cloud server, and setting the state of the input method to be a connected state.
4. The method according to any one of claims 1-3, further comprising:
receiving a second touch screen instruction which is sent by the client and is triggered and generated by the hidden input method operation of the user, and transmitting the second touch screen instruction to the application so that the application can respond to the second touch screen instruction;
if the situation that the application calls the API of the operating system for canceling the association input method is monitored, a message for hiding the input method is generated, the message for hiding the input method is packaged into a second HID output report and sent to the client, and the client can hide the input method after receiving the second HID output report.
5. A character input method for cloud application, the method comprising:
the client acquires character data input by a user through an input method associated with the application after the application is started, encapsulates the character data into an HID information input report and sends the HID information input report to the cloud server;
and the cloud server receives the HID information input report, and transmits character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
6. The method according to claim 5, wherein before the client obtains character data input by a user through an input method associated with the application after the application is started, the method further comprises displaying the input method by the client, specifically comprising:
and the client responds to the operation of the calling input method of the user and displays the input method.
7. The method of claim 5, wherein before the client obtains character data input by a user through an input method associated with the application after the application is launched, the method further comprises the client displaying the input method, and further comprising:
the client responds to the call-out input method operation of the user to generate a first touch screen instruction, and the first touch screen instruction is sent to the cloud server;
under the condition that an input method is in an access state, the cloud server receives the first touch screen instruction, and transmits the first touch screen instruction to the application so that the application responds to the first touch screen instruction;
if the cloud server side monitors that the application calls an API (input application program interface) of an associated input method of an operating system, generating a message for displaying the input method, packaging the message for displaying the input method into a first HID (human interface device) output report, and sending the HID output report to the client side;
and the client displays the input method after receiving the first HID output report.
8. The method of claim 6 or 7, wherein prior to the client displaying the input method, the method further comprises:
if the application is started, the client sends an HID virtual peripheral access report to the cloud server; the HID virtual peripheral access report comprises the input method as the identifier of the virtual peripheral;
and after receiving the HID virtual peripheral access report, the cloud server associates the input method and the application one to one, and sets the state of the input method to be a connected state.
9. The method according to any one of claims 5-6, further comprising:
the client responds to the hidden input method operation of the user to generate a second touch screen instruction, and the second touch screen instruction is sent to the cloud server;
the cloud server receives a second touch screen instruction sent by the client, and transmits the second touch screen instruction to the application so that the application can respond to the second touch screen instruction;
if the cloud server side monitors that the application calls a disassociation input method API of an operating system, a message for hiding the input method is generated, the message for hiding the input method is packaged into a second HID output report and sent to the client side, and the client side hides the input method after receiving the second HID output report.
10. A character input device for a cloud application, the device comprising:
the receiving module is used for receiving a human-computer interaction device HID information input report sent by the client; the HID information input report is generated by the client according to character data input by the user through an input method associated with the application after the application is started;
and the transfer module is used for transferring the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
11. A character input system for a cloud application, the system comprising:
the client is used for acquiring character data input by a user through an input method associated with the application after the application is started, packaging the character data into an HID information input report and sending the HID information input report to the cloud server;
and the cloud server is used for receiving the HID information input report, and transmitting the character data contained in the HID information input report obtained by analyzing the HID information input report to an application associated with the input method for displaying according to the identification of the input method contained in the HID information input report.
12. A machine-readable storage medium having stored thereon computer instructions which, when executed, perform the method of any one of claims 1-4.
13. A computer device, comprising: a machine-readable storage medium and a processor, the machine-readable storage medium: storing the instruction code; a processor: communicating with a machine-readable storage medium, reading and executing instruction code in the machine-readable storage medium, to implement the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010100941.8A CN111324216B (en) | 2020-02-19 | 2020-02-19 | Character input method, device and system for cloud application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010100941.8A CN111324216B (en) | 2020-02-19 | 2020-02-19 | Character input method, device and system for cloud application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111324216A true CN111324216A (en) | 2020-06-23 |
| CN111324216B CN111324216B (en) | 2024-05-14 |
Family
ID=71165341
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010100941.8A Active CN111324216B (en) | 2020-02-19 | 2020-02-19 | Character input method, device and system for cloud application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111324216B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111766958A (en) * | 2020-07-01 | 2020-10-13 | 腾讯科技（深圳）有限公司 | Input method implementation method and device, electronic equipment and storage medium |
| CN112099643A (en) * | 2020-08-31 | 2020-12-18 | 北京爱奇艺科技有限公司 | Cloud input method, system, device, electronic equipment and storage medium |
| CN114816082A (en) * | 2021-01-20 | 2022-07-29 | 腾讯科技（深圳）有限公司 | Input control method and device applied to cloud application and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1630665A1 (en) * | 2003-05-19 | 2006-03-01 | Vodafone K.K. | Character input method, character input device, and mobile communication terminal device |
| CN102685196A (en) * | 2010-12-22 | 2012-09-19 | 北京华夏未来信息技术有限公司 | Method and virtual application system for improving user experience in virtual application environment |
| CN102968190A (en) * | 2012-10-24 | 2013-03-13 | 深圳市深信服电子科技有限公司 | Local input method mapping device and method based on remote application |
-
2020
- 2020-02-19 CN CN202010100941.8A patent/CN111324216B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1630665A1 (en) * | 2003-05-19 | 2006-03-01 | Vodafone K.K. | Character input method, character input device, and mobile communication terminal device |
| CN102685196A (en) * | 2010-12-22 | 2012-09-19 | 北京华夏未来信息技术有限公司 | Method and virtual application system for improving user experience in virtual application environment |
| CN102968190A (en) * | 2012-10-24 | 2013-03-13 | 深圳市深信服电子科技有限公司 | Local input method mapping device and method based on remote application |
Non-Patent Citations (2)
| Title |
|---|
| DIEGO PEREZ-BOTERO: "Characterizing hypervisor vulnerabilities in cloud computing servers", CLOUD COMPUTING \'13: PROCEEDINGS OF THE 2013 INTERNATIONAL WORKSHOP ON SECURITY IN CLOUD COMPUTING, 8 May 2013 (2013-05-08), pages 3 * |
| 黄翔等: "基于云平台的移动相册的设计与实现", 高科技产品研发, no. 17, 8 September 2014 (2014-09-08), pages 12 - 13 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111766958A (en) * | 2020-07-01 | 2020-10-13 | 腾讯科技（深圳）有限公司 | Input method implementation method and device, electronic equipment and storage medium |
| CN111766958B (en) * | 2020-07-01 | 2023-07-25 | 腾讯科技（深圳）有限公司 | Input method implementation method, device, electronic equipment and storage medium |
| CN112099643A (en) * | 2020-08-31 | 2020-12-18 | 北京爱奇艺科技有限公司 | Cloud input method, system, device, electronic equipment and storage medium |
| CN114816082A (en) * | 2021-01-20 | 2022-07-29 | 腾讯科技（深圳）有限公司 | Input control method and device applied to cloud application and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111324216B (en) | 2024-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10009303B2 (en) | Message push method and apparatus | |
| CN111324216A (en) | Character input method, device and system for cloud application | |
| US20180043264A1 (en) | Game Accessing Method and Processing Method, Server, Terminal, and System | |
| CN111629239B (en) | Screen projection processing method, device, equipment and computer readable storage medium | |
| CN107329717B (en) | Processing method, display method and display system of screen display information | |
| US10637804B2 (en) | User terminal apparatus, communication system, and method of controlling user terminal apparatus which support a messenger service with additional functionality | |
| CN104144093A (en) | Intelligent device control method, relevant device and system | |
| CN106027631B (en) | Data transmission method and device | |
| CN111506283A (en) | Image display method, device and system | |
| CN111569417A (en) | Peripheral data transmission method and system for cloud games | |
| CN112235412B (en) | Message processing method and device | |
| CN107888478B (en) | Voice information forwarding method, device and storage medium in instant messaging process | |
| CN111615171B (en) | Access method and device of wireless local area network | |
| CN113452948B (en) | Conference terminal control method, device, equipment and storage medium | |
| CN113518143B (en) | Interface input source switching method and device, electronic equipment and storage medium | |
| CN113617020B (en) | Game control method, game control device, storage medium, server and terminal | |
| CN111135557B (en) | Interaction method and device for multiple screens | |
| CN107341392B (en) | file unshelling method and device in Android system | |
| CN113952736A (en) | Cloud game login method and device, electronic equipment and computer-readable storage medium | |
| CN111803926B (en) | Matching method and device of control object in cloud application and electronic equipment | |
| CN114265714A (en) | Drive control method and device based on cloud mobile phone and storage medium | |
| CN110968383B (en) | Message frame display method and device, terminal and storage medium | |
| CN109726026B (en) | Interactive data processing method, device, equipment and storage medium | |
| CN111818164A (en) | Resource transfer method and device based on cloud application and computer equipment | |
| CN112543350A (en) | Live broadcast interaction method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |