CN112717377A

CN112717377A - Cloud game auxiliary control method and device

Info

Publication number: CN112717377A
Application number: CN202011643323.4A
Authority: CN
Inventors: 李运福; 任文康; 李启光; 解锐
Original assignee: Guiyang Gloud Technology Co ltd
Current assignee: Guiyang Gloud Technology Co ltd
Priority date: 2020-12-31
Filing date: 2020-12-31
Publication date: 2021-04-30

Abstract

The invention discloses a cloud game auxiliary control method and a cloud game auxiliary control device, wherein the method comprises the following steps: identifying object information of all identification objects in an initial game picture in real time, wherein the identification objects comprise operable objects in the game; setting a trigger area corresponding to each identification object according to the information of each identification object; receiving a control signal sent by a client; determining a triggered identification object according to the position relation of the control signal relative to the trigger area; triggering the identification object and rendering to generate a triggering feedback game picture; and sending a triggering feedback game picture to the client. According to the cloud game auxiliary control method and device, the trigger area corresponding to the identification object in the game picture is determined in the game process, and the triggered identification object is determined according to the received control signal of the client, so that the control accuracy is improved, and the control experience is optimized.

Description

Cloud game auxiliary control method and device

Technical Field

The invention relates to the technical field of cloud services, in particular to a cloud game auxiliary control method and device.

Background

With the rapid development of the game industry, intelligent terminal technology and wireless networks, games have become an indispensable way for people to use the internet for recreation.

With the gradual maturity of cloud computing technology, a system architecture mode of reducing terminal configuration and transplanting a terminal to a cloud end is promoted. In this mode, the terminal device of the user originally used for running the highly-configured game is transferred to the cloud server, and the terminal device only needs to receive and display the game picture, that is, when the user performs the cloud game, the running process of the game is performed on the server, the server sends the game video picture to the client, and the client receives the video frame data and then displays the video frame data.

Through the cloud game technology, a user can enjoy different cloud games only by installing a client on a terminal device without installing game applications on a client machine, the actual operation of the games is stored in a cloud server, and the user can access the games at any place and at any time through any terminal device (such as a smart phone, a tablet computer, intelligent wearable device and the like).

By adopting the mode, the threshold of playing games by the user is reduced, the client used by the user can transmit the user operation signal to the cloud server through network connection only by capturing basic data (such as mouse click, keyboard click, handle keys and the like) of the user operation, and the cloud server running the games can replay the user operation after receiving the user operation signal and render the game effect. And the rendered game effect is sent to the client, and the client receives and decodes the video code stream to display the game. Therefore, the requirements for high-end configuration (a Central Processing Unit (CPU) and a high-end display card) of the terminal equipment are greatly reduced.

When a user uses a client to play a game, the user can use external equipment such as a handle to connect with terminal equipment to play a cloud game, but due to the fact that the screen of the terminal equipment is small, the problem of mistaken touch or inaccurate touch is prone to occur, so that the operation result deviates from the user intention, and further the game experience of the user is reduced.

Disclosure of Invention

In order to solve the technical problem, the invention provides a cloud game auxiliary control method and a cloud game auxiliary control device.

The invention provides a cloud game auxiliary control method which is applied to a server side, and the method comprises the following steps:

identifying object information of all identification objects in an initial game picture in real time, wherein the identification objects comprise operable objects in the game;

setting a trigger area corresponding to each identification object information according to each identification object information;

receiving a control signal sent by a client;

determining the triggered identification object according to the position relation of the control signal relative to the trigger area;

triggering the identification object and rendering to generate a triggering feedback game picture;

and sending the game picture of the trigger feedback to the client.

The method also has the following characteristics: the identification object information for identifying all identification objects in the initial game screen in real time includes:

an identification object type, position information, and a size of an area occupied by each identification object in an initial game screen are identified.

The method also has the following characteristics: the real-time recognition of the recognition object type and the position information of each recognition object in the initial game picture and the size of the area occupied by the recognition object comprises the following steps:

acquiring an image database, wherein images of all operable objects in a plurality of games and identification object types corresponding to the operable objects are stored in the image database;

determining a recognition object type of each recognition object in the initial game picture according to the image database and the initial game picture;

the position information of each recognition object in the initial game picture and the size of the area occupied by the recognition object are determined.

The method also has the following characteristics: the setting of the trigger area corresponding to each identification object according to the information of each identification object includes:

and setting a trigger area corresponding to each identification object according to the position information of each identification object and the size of the area occupied by the identification object at intervals of preset duration.

The method also has the following characteristics: the determining the triggered identification object according to the position relation of the control signal relative to the trigger area includes:

and when the position of the control signal falls into the trigger area, determining that the control corresponding to the trigger area is triggered.

The invention provides a cloud game auxiliary control device, which is applied to a server side and comprises:

the game system comprises a processing module, a processing module and a processing module, wherein the processing module is used for identifying identification object information of all identification objects in an initial game picture in real time, and the identification objects comprise operable objects in a game;

the processing module is further configured to set a trigger area corresponding to each piece of identification object information according to each piece of identification object information;

the receiving module is used for receiving the control signal sent by the client;

the processing module is further configured to determine the triggered identification object according to a position relationship of the control signal with respect to the trigger area;

the processing module is further used for triggering the identification object

The rendering module is also used for rendering and generating a triggering feedback game picture;

and the sending module is used for sending the game picture of the trigger feedback to the client.

The device also has the following characteristics: the processing module is specifically configured to:

an identification object type, position information, and a size of an area occupied by each identification object in the initial game screen are identified.

According to the cloud game auxiliary control method and device, the trigger area corresponding to the identification object in the game picture is determined in the game process, and the triggered identification object is determined according to the received control signal of the client, so that the control accuracy is improved, and the control experience is optimized.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate an embodiment of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:

fig. 1 is a flow diagram illustrating a cloud game image frame loss compensation method according to an example embodiment;

FIG. 2 is a flow diagram illustrating a method for cloud game image frame loss compensation in accordance with an exemplary embodiment;

fig. 3 is a block diagram illustrating a cloud game image loss frame compensation apparatus according to an exemplary embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.

In order to solve the above problems, the present disclosure provides a cloud game auxiliary control method, which is applied to a server, where the server is a server for running a game, and a plurality of games can be run on one server at the same time. The cloud game auxiliary control method in the embodiment comprises the following steps:

and S110, rendering to generate an initial game picture.

The pictures sent to the client by the server or the pictures fed back to the server after the user operates the client by using a mouse and the like are required to be rendered. The control method in this embodiment is implemented based on recognition of a game screen.

The initial game screen in this step is a game screen that is received from the client and that includes the user manipulation information, but has not yet been identified by the manipulation information.

And S120, identifying object information for identifying all identification objects in the initial game picture.

In the recognition process, the initial game screen includes a plurality of objects, such as the recognition object in the present embodiment, and the recognition object includes an operable object in the game. The object in the game may have an object that generates a corresponding feedback when the mouse clicks the object, for example, click a task pop-up dialog box in a certain game, i.e., the above-mentioned identified object. Some objects do not generate any reaction when the mouse clicks the object, for example, when a house in a background picture in a game is clicked, the game display picture does not generate any change and can be considered as the background object. The method in this embodiment ignores the background object that does not generate any reaction when clicked, for the above identified object. In the recognition process, all recognition objects in the initial game screen are recognized, and the background object displayed as the background is ignored.

In this embodiment, the identification is performed using an identification object identification model pre-stored in the server, and in the identification process, the identification object type and the position information of each identification object in the initial game screen and the size of the area occupied by the identification object can be identified. Specifically, the recognition object recognition model includes an image database in which images of all of the manipulatable objects in the plurality of games and recognition object types corresponding to the manipulatable objects are stored. The plurality of games may be, for example, all games served by the server, or a plurality of more typical cloud games, which may be, for example, 50, 100, 8, 21, etc. When all recognition objects in the initial game picture are recognized, the recognition object recognition model collects information in the initial game picture, such as shapes, colors and the like of all visible objects in the picture, and then compares the contents with the contents in the image database according to the information, so as to recognize the recognition object type of the visible objects. The recognition object type may be, for example, a character, a good, a dialog box, a natural object, etc., and the division of the specific type may be set according to the basic style of the game.

After the type of the identification object is determined, further identification can be performed based on the identification object, the position of the identification object in the initial game picture is identified, the position information of the identification object can be determined by establishing a coordinate system, and the size of the area of the initial game picture occupied by the identification object is determined.

For example, if there is a character in the initial game screen, the character is a controllable object, and belongs to the recognition object in this embodiment, and when the mouse clicks the character, corresponding feedback may be generated, such as movement, occurrence of a conversation, and the like. The person identification target information includes: the identification object type is a character, the position information is coordinates of (300 ), and the size of the area occupied by the identification object is 25. Of course, it is understood that, besides the above representation method, other identification methods commonly used in the art may be used for representation, and thus, the description is omitted here.

In the embodiment, the model for identifying the initial game picture is pre-stored in the server, and the model needs to be established in advance in a deep learning manner. In the process of establishing the model, firstly, an image database of the recognition objects is established, and the styles of the recognition objects in various games, including operable objects (namely, recognition objects) and non-operable objects, should be collected as much as possible in the database and marked. And then, a pre-training model based on deep learning is constructed by utilizing the created image database of the recognition object, and the model can realize the effect of inputting the image of the recognition object and outputting the image of the recognition object as the type of the recognition object. Further, the pre-training model is migrated to the recognition object recognition model through migration learning, so that the effect of inputting the image as the recognition object and outputting the image as the recognition object information is achieved.

In order to better understand the training process in the present application, the migration learning is described by way of an example. Transfer learning simply means that the model developed for task a is reused as an initial point in the process of developing the model for task B. The transfer learning comprises two steps of model development and model pre-training.

Wherein, the model development comprises the following contents:

1. a source task is selected. Selecting a relevant predictive modeling problem with rich data, wherein the input data, the output data and concepts learned from the mapping between the input data and the output data of the original task and the target task have a preset relationship.

2. A source model is developed. An elaborate model is developed for the first task. This model must be better than the normal model to ensure that some feature learning can be performed.

3. The model is reused. Models that are appropriate for the source task may be used as learning starting points for the target task. This may involve using the first model in whole or in part, depending on the modeling technique used.

4. And adjusting the model. The model can be selectively fine-tuned over the input-output pairs in the target dataset to adapt it to the target task.

Wherein, the model training comprises the following steps:

1. a source model is selected. A pre-trained source model is selected from the available models. Many research organizations have published models based on very large datasets, which can be candidates for source models.

2. The model is reused. The selected pre-trained model may serve as a learning starting point for the model for the second task. This may involve using and training the model in whole or in part, depending on the model training technique used.

3. And adjusting the model. The model can be selectively fine-tuned over the input-output pairs in the target dataset to adapt it to the target task.

And S130, setting a trigger area corresponding to each identification object according to the information of each identification object.

In the step, at intervals of preset duration, a trigger area corresponding to the identification object is set according to the position information of each identification object and the size of the area occupied by the identification object. Because the operation of the user is continuously performed and the speed is relatively high, the preset duration is kept at millisecond level, so that the operation of the user can be quickly fed back, and the real-time performance is ensured.

The game is continuously carried out, the game picture is continuously changed, the area of the picture occupied by the identification object is continuously changed, and in order to ensure the control accuracy, the trigger area after the change of the identification object is continuously determined, and the operation can be determined to be effective touch operation as long as the operation falls into the trigger area.

And S140, receiving the control signal sent by the client.

When a user controls a game through the client, the control signal can be communicated with the picture information and simultaneously transmitted to the server so that the server can analyze the picture information and quickly feed back the picture corresponding to the control information.

S150, determining the triggered identification object according to the position relation of the control signal relative to the trigger area.

Since the identification object information of the identification object has been identified in the above step, the position information of the identification object and the size range of the area where the identification object is located are included. And when the position of the control signal falls into the trigger area, determining that the control corresponding to the trigger area is triggered.

And S160, triggering the identification object and rendering to generate a triggering feedback game picture.

After the recognition object is determined to be triggered, the picture of the game is adjusted according to the triggering operation, and a triggering feedback game picture is generated in a rendering mode so as to feed back the operation of the user.

And S170, sending the game picture of the trigger feedback to the client.

According to the cloud game auxiliary control method provided by the invention, the control information of the user on the identification object can be determined according to the game picture, and then the feedback picture is rendered according to the control information and sent to the customer service terminal, so that the problem of poor game experience of the user due to factors such as difficulty in accurate touch control and handle operation limitation of a mobile terminal touch screen is solved, and the control and touch screen experience of the mobile terminal are improved.

According to an exemplary embodiment, as shown in fig. 2, the present disclosure provides a cloud game auxiliary control method, and the method in this embodiment is applied in an interaction process between a client and a server. The client can be a mobile terminal such as a mobile phone and a tablet personal computer, and the user can download the cloud game APP at the client to run the cloud game. The server side is a cloud server. The method comprises the following steps:

s201, the client sends game request information.

And S202, rendering by the server side to generate an initial game picture.

S203, the server identifies identification object information of all identification objects in the initial game screen.

And S204, the server sets a trigger area corresponding to each identification object according to the information of each identification object.

S205, the client sends the control signal.

S206, the server receives the control signal sent by the client.

And S207, the server determines the triggered identification object according to the position relation of the control signal relative to the trigger area.

And S208, the server triggers the identification object and generates a trigger feedback game picture in a rendering mode.

S209, the server side sends a game screen for triggering feedback to the client side.

S210, the client receives a trigger feedback game picture.

And S211, displaying a trigger feedback game picture by the client.

According to an exemplary embodiment, as shown in fig. 3, the present disclosure provides a cloud game auxiliary control apparatus, which is applied to a server, and is used for implementing the above-mentioned cloud game auxiliary control method as shown in fig. 1. The control device in this embodiment includes:

a rendering module 110, configured to render and generate an initial game screen;

a processing module 120 for identifying identification object information of all identification objects in the initial game screen;

the processing module 120 is further configured to set a trigger area corresponding to each identification object information according to each identification object information;

a receiving module 130, configured to receive a control signal sent by a client;

the processing module 120 is further configured to determine a triggered identification object according to a position relationship between the control signal and the trigger area;

a processing module 120, further configured to trigger identifying the object;

the rendering module 110 is further configured to render and generate a trigger feedback game screen;

the sending module 140 is configured to send the game screen for triggering feedback to the client.

The above-described aspects may be implemented individually or in various combinations, and such variations are within the scope of the present invention.

It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by instructing the relevant hardware through a program, and the program may be stored in a computer-readable storage medium, such as a read-only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the foregoing embodiments may also be implemented by using one or more integrated circuits, and accordingly, each module/unit in the foregoing embodiments may be implemented in the form of hardware, and may also be implemented in the form of a software functional module. The present invention is not limited to any specific form of combination of hardware and software.

It is to be noted that, in this document, the terms "comprises", "comprising" or any other variation thereof are intended to cover a non-exclusive inclusion, so that an article or apparatus including a series of elements includes not only those elements but also other elements not explicitly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of additional like elements in the article or device comprising the element.

The above embodiments are merely to illustrate the technical solutions of the present invention and not to limit the present invention, and the present invention has been described in detail with reference to the preferred embodiments. It will be understood by those skilled in the art that various modifications and equivalent arrangements may be made without departing from the spirit and scope of the present invention and it should be understood that the present invention is to be covered by the appended claims.

Claims

1. A cloud game auxiliary control method is applied to a server side, and is characterized by comprising the following steps:

setting a trigger area corresponding to each identification object according to the information of each identification object;

receiving a control signal sent by a client;

and sending the game picture of the trigger feedback to the client.

2. The cloud game auxiliary control method of claim 1, wherein the identification object information for identifying all identification objects in the initial game screen in real time includes:

3. The cloud game auxiliary control method of claim 2, wherein the identifying of the identification object type, the position information and the size of the area occupied by the identification object of each identification object in the initial game picture in real time comprises:

4. The cloud game auxiliary control method of claim 2, wherein the setting of the trigger area corresponding to each identification object according to the information of each identification object comprises:

5. The cloud game auxiliary control method of claim 1, wherein the determining the triggered identification object according to the position relationship of the manipulation signal relative to the trigger area comprises:

6. A cloud game auxiliary control device is applied to a server side and is characterized by comprising:

the processing module is further used for triggering the identification object;

7. The cloud game auxiliary control apparatus of claim 6, wherein the processing module is specifically configured to:

8. The cloud game auxiliary control apparatus of claim 7, wherein the processing module is specifically configured to:

9. The cloud game auxiliary control apparatus of claim 7, wherein the processing module is specifically configured to:

10. The cloud game auxiliary control apparatus of claim 6, wherein the processing module is specifically configured to: