CN113064689A - Scene recognition method and device, storage medium and electronic equipment - Google Patents
Scene recognition method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113064689A CN113064689A CN202110327061.9A CN202110327061A CN113064689A CN 113064689 A CN113064689 A CN 113064689A CN 202110327061 A CN202110327061 A CN 202110327061A CN 113064689 A CN113064689 A CN 113064689A
- Authority
- CN
- China
- Prior art keywords
- display
- target
- window
- parameter
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000009877 rendering Methods 0.000 claims description 57
- 230000015654 memory Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a scene recognition method and device, a storage medium and electronic equipment. Wherein, the method comprises the following steps: acquiring frame rate parameters of a target source end, wherein the frame rate parameters comprise an acquisition frame rate for acquiring images of a picture of a display desktop by the target source end; determining a target window in the display desktop, and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at a display top layer in the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing; and identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter. The invention solves the technical problem of image display abnormity caused by incapability of identifying scene types.
Description
Technical Field
The invention relates to the field of computers, in particular to a scene recognition method and device, a storage medium and electronic equipment.
Background
The cloud desktop system generally comprises a cloud server and a receiving end, wherein a source end corresponding to the receiving end is arranged in the cloud server, and the source end generally exists in a Virtual Machine (VM) form. The virtual machine VM comprises a collection end and an encoder, wherein the collection end is used for collecting a source picture running in the virtual machine VM and sending the source picture to the hardmac encoder for encoding, the hardmac encoder sends encoded data to a receiving end, and the receiving end displays an image corresponding to the source picture on a display of the receiving end after decoding.
With the increasingly wide application of the cloud desktop system, the cloud desktop system can be roughly divided into an office scene and a game scene based on the application scene of the cloud desktop system. When the application scene is a game scene, the source picture acquired by the acquisition end is a game interface for running the game program in the virtual machine VM, and the acquisition end directly sends all the acquired data of the game program to the hardmac encoder for encoding. Under the condition that the application scene is an office scene, the virtual machine VM runs an operating system, different application programs are usually run in the operating system to meet office requirements, and correspondingly, a collection end needs to collect desktop images of the operating system. Under different application scenes, objects corresponding to the desktop pictures acquired by the acquisition end are different, and correspondingly, the desktop pictures to be displayed by the receiving end are different.
In the prior art, the office scene and the game scene need a user to select and switch the scenes through a receiving end, that is, the scene switching of the cloud desktop system depends on a scene switching instruction received by the receiving end, and the automatic identification of the scenes cannot be realized. Therefore, under the condition that the switching instruction is not accepted, if the scene type changes, the source end cannot adaptively identify the current scene type, and the acquisition end cannot be correctly instructed to acquire the correct desktop picture, so that the problem that the image of the receiving end cannot be normally displayed is caused.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a scene recognition method and device, a storage medium and electronic equipment, which are used for at least solving the technical problem of image display abnormity caused by incapability of recognizing scene types.
According to an aspect of an embodiment of the present invention, there is provided a scene recognition method, including: acquiring frame rate parameters of a target source end, wherein the frame rate parameters comprise an acquisition frame rate for acquiring images of a picture of a display desktop by the target source end; determining a target window in the display desktop, and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at a display top layer in the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing; and identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
According to another aspect of the embodiments of the present invention, there is also provided a scene recognition apparatus, including: the acquisition module is used for acquiring frame rate parameters of a target source end, wherein the frame rate parameters comprise an acquisition frame rate for acquiring images of a picture of a display desktop by the target source end; a determining module, configured to determine a target window in the display desktop, and obtain a window parameter corresponding to the target window, where the target window is used to represent a window located at a top display layer in the display desktop, and the window parameter includes a performance parameter of the target window related to image display processing; and the identification module is used for identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
According to still another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned scene recognition method when running.
According to still another aspect of the embodiments of the present invention, there is also provided an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor is configured to execute the scene recognition method through the computer program.
In the embodiment of the invention, the frame rate parameter is acquired and the target window is determined to acquire the window parameter indicating the image processing performance of the target window, so that the application scene corresponding to the display desktop is identified according to the frame rate parameter and the window parameter combining the window parameter, the frame rate parameter indicating the acquisition frame rate and the window parameter indicating the image processing capacity of the target window are combined with the corresponding application scene for identification, the scene type of the application scene of the display desktop is determined, and the application scene is automatically identified, so that the technical effect of performing the acquisition processing of the corresponding mode on the display desktop according to the application scene of the display desktop is realized, and the technical problem of image display abnormity caused by incapability of identifying the scene type is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic diagram of an application environment of an alternative scene recognition method according to an embodiment of the invention;
FIG. 2 is a flow chart illustrating an alternative scene recognition method according to an embodiment of the present invention;
FIG. 3 is a flow chart illustrating an alternative scene recognition method according to an embodiment of the present invention;
FIG. 4 is a flow chart illustrating an alternative scene recognition method according to an embodiment of the present invention;
FIG. 5 is a flow chart illustrating an alternative scene recognition method according to an embodiment of the present invention;
FIG. 6 is a flow chart illustrating an alternative scene recognition method according to an embodiment of the present invention;
FIG. 7 is a flowchart illustrating an alternative scene recognition method according to an embodiment of the invention;
fig. 8 is a schematic structural diagram of an alternative scene recognition apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of an alternative electronic device according to an embodiment of the invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an aspect of the embodiments of the present invention, there is provided a scene recognition method, which may be applied to the environment shown in fig. 1. The source 102 interacts with the sink 122 via the server 110. The source end 102 receives the control instruction obtained by the receiving end 122 through the server 110, the source end 102 responds to the control instruction to display a corresponding desktop picture in the display desktop, encodes image data corresponding to the desktop picture according to a scene type of an application scene of the display desktop, and sends the image data obtained by encoding to the receiving end 122 so that the receiving end 122 displays the desktop picture in a corresponding display.
Optionally, the source 102 has a database 104 and a processing engine 106 running therein. The database 102 is used for storing the display desktop of the source terminal and corresponding data and parameters. The processing engine 106 is configured to analyze the processing to determine a scene type of an application scene corresponding to the display desktop. Specifically, the processing engine 106 sequentially executes S102 to S106. And acquiring frame rate parameters, wherein the frame rate parameters comprise an acquisition frame rate of a source end for acquiring images of the picture of the display desktop. And determining a target window and acquiring window parameters. The target window is used for representing a window positioned at the top layer of the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing. And identifying the scene type, and identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
Optionally, in this embodiment, both the source end 102 and the sink end 122 may be terminal devices, including but not limited to at least one of the following: mobile phones (such as Android phones, IOS phones, etc.), notebook computers, tablet computers, palm computers, MID (Mobile Internet Devices), PAD, desktop computers, smart televisions, etc. The server 110 may be a single server, a server cluster composed of a plurality of servers, or a cloud server. The above is merely an example, and this is not limited in this embodiment. The server 110 performs data interaction between the source 102 and the sink 122, and may be, but is not limited to, implemented based on a network. Such networks may include, but are not limited to: a wired network, a wireless network, wherein the wired network comprises: a local area network, a metropolitan area network, and a wide area network, the wireless network comprising: bluetooth, WIFI, and other networks that enable wireless communication.
As an alternative implementation, as shown in fig. 2, the scene recognition method includes:
s202, frame rate parameters of a target source end are obtained, wherein the frame rate parameters comprise an acquisition frame rate of the target source end for carrying out image acquisition on a picture of a display desktop;
s204, determining a target window in the display desktop, and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at the top display layer in the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing;
and S206, identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
Optionally, the display desktop is a desktop screen displayed in the operating system in the target source, and specifically, may be a desktop screen displayed in the operating system at the current time. The current time may be the current time period or the current time.
Alternatively, the frame rate parameters may include, but are not limited to: displaying frame rate, collecting frame rate and refreshing frame rate. The display frame rate is used for indicating the frame rate of the target source end displaying the desktop picture of the current display desktop, the acquisition frame rate is used for indicating the frame rate of the target source end performing image acquisition on the display desktop, and the refresh frame rate is used for indicating the refresh frame rate of the display card of the target source end.
Alternatively, the top layer of the display desktop can be a front layer of the layer display, and the top layer of the window display. The front layer positioned in the layer display means that the first layer is positioned in front of the layer display, and a window in the front layer cannot be shielded by windows of other layers in any window size. The window layer located in the front of the window display refers to a window currently displayed in the front in the window layer existing in the display desktop, and the window displayed in the front cannot be blocked by other windows in any window size. It should be noted that the number of target windows located at the top of the display, i.e., the front display, is one.
Optionally, the performance parameter related to the image display processing refers to a performance parameter of the target window performing display processing on the display image in the window, and may include, but is not limited to: the display degree parameter of the target window for the display image in the display desktop, and the processing capacity parameter of the target window for the display image.
Alternatively, the display degree parameter may be a display degree of the display window with respect to the display desktop, a display degree of the display image with respect to the target window.
Alternatively, the processing capability parameter may be a parameter indicating its capability to perform image processing on the display image, such as the complexity of performing image processing on the display image, the type of image processing performed on the display image, and a processing instruction to perform image processing on the display image. The processing instruction is not limited to a rendering instruction for image rendering, an identification instruction for image recognition, a slicing instruction for image slicing, and the like.
In the embodiment of the application, frame rate parameters are acquired and a target window is determined to acquire window parameters indicating the image processing performance of the target window, so that a mode of identifying an application scene corresponding to a display desktop according to the frame rate parameters and the window parameters combining the window parameters is adopted, the frame rate parameters indicating the acquisition frame rate and the window parameters indicating the image processing capacity of the target window are combined with the corresponding application scene for identification, the scene type of the application scene of the display desktop is determined, and the application scene is automatically identified, so that the technical effect of performing acquisition processing in a corresponding mode on the display desktop according to the application scene of the display desktop is realized, and the technical problem of image display abnormity caused by incapability of identifying the scene type is solved.
As an optional implementation manner, as shown in fig. 3, the obtaining of the window parameter corresponding to the target window includes:
s302, acquiring display parameters of the target window, wherein the display parameters are parameters representing the display degree of the target window in a display desktop;
s304, acquiring image parameters of a target window, wherein the image parameters are used for representing the image processing type executed on the display image in the target window;
and S306, taking the display parameters and the image parameters as window parameters.
Alternatively, the display parameter may be a display size degree of the target window to the display image and a display clarity degree of the target window to the display image. The display parameters of the display size degree may be: the size of the target window, the display scale of the target window relative to the display desktop, and the size of the display image. The display parameters for displaying the definition may be: the resolution of the displayed image.
Alternatively, the type of image processing performed on the display image may be a type in which the image processing performed on the display image is classified according to the purpose of execution, such as a drawing type indicating that drawing is performed, including 2D drawing in which a two-dimensional graphic is drawn and 3D drawing in which a three-dimensional graphic is drawn; the type of processing for performing the processing is indicated, including color processing, gradation processing, and the like.
In the embodiment of the application, the display parameters are determined according to the display degree of the target window in the display desktop, the image parameters are determined according to the image processing type of the target window for the display image, and therefore the display parameters and the image parameters are used as window parameters to reflect the performance of the target window in image display and image processing, the scene type of an application scene is determined according to the target window and the frame rate parameter, and the scene identification is achieved.
As an alternative implementation, as shown in fig. 4, the acquiring the display parameters of the target window includes:
s402, obtaining the window size of a target window, wherein the window size comprises the width and the height of the target window;
s404, calculating the display proportion of the target window in the display desktop according to the window size;
and S406, taking the display scale as a display parameter.
Optionally, the window size of the target window may be obtained by calling a corresponding data interface to obtain the width and height of the target window through the operating system. Taking the Windows system as an example of the operating system of the target source end, the HWND is obtained through the Windows API, and the width value and the height value of the target window are obtained through the HWND.
Optionally, calculating the display scale of the target window in the display desktop according to the window size includes: and calculating the display area of the target window according to the window size, acquiring the desktop area of the display desktop, and calculating the ratio of the display area to the desktop area to obtain the display proportion of the target window in the display desktop.
In the embodiment of the application, the area ratio of the target window to the display desktop is used as a display parameter, the size of the area occupied by the target window in the display desktop is used as a measure of the display degree of the target window on the display image, so as to determine the importance degree of the target window on the image display relative to the display desktop, and thus determine the application scene type corresponding to the display desktop.
As an alternative implementation, as shown in fig. 5, the acquiring of the image parameter of the target window includes:
s502, determining an application identifier of the target window, wherein the application identifier is used for identifying a target application of the running target window;
s504, acquiring an image rendering instruction of the display image according to the application identifier, wherein the image rendering instruction is used for indicating to perform rendering processing on the display image;
s506, the instruction type of the image rendering instruction is used as an image parameter.
Optionally, the application identifier of the target window may be, but is not limited to, an application name, an application abbreviation, of the target application corresponding to the target window. The application abbreviation may be name abbreviation, character string code, etc. that can uniquely refer to the target program.
As an optional implementation manner, the instruction to render an image for acquiring a display image according to an application identifier includes:
positioning an application process started by a target application according to the application identifier;
searching an image rendering instruction in an application process started by a target application;
an instruction type of the image rendering instruction is determined.
Alternatively, the instruction type of the image rendering instruction may be a type classified by the execution purpose of executing the image rendering instruction. For example, a drawing type for performing drawing purposes.
Alternatively, the instruction type of determining the image rendering instruction may be: and determining the system type of an operating system in the target source end, and determining the instruction type corresponding to the image rendering instruction according to the system type of the operating system. Rendering instructions corresponding to the instruction types in different operating system types may be different, for example, a 2D drawing type corresponds to a GDI in a Windows system, and corresponds to an Xlib in a Linux system and an Android system; the rendering instruction of the drawing type of 3D in the Windows system is Direct 3D, the rendering instruction in the Linux system is OpenGL, and the rendering instruction in the Android system is OpenGL ES.
As an alternative implementation, as shown in fig. 6, after determining the instruction type of the image rendering instruction, the method further includes:
s602, determining a target instruction type corresponding to the target parameter;
s604, comparing the instruction type of the image rendering instruction with the target instruction type;
s606, under the condition that the instruction type of the image rendering instruction is the same as the target instruction type, determining that the image parameters are consistent with the target parameters;
s608, under the condition that the instruction type of the image rendering instruction is different from the target instruction type, determining that the image parameter is inconsistent with the target parameter.
Optionally, a target parameter is preset, and the target parameter is used for representing a target instruction type. For example, the target parameter is set to a drawing type, which indicates that the rendering instruction is an instruction type of the drawing type.
Alternatively, comparing the instruction type of the image rendering instruction with the target instruction type may be comparing the image rendering instruction with the target instruction type corresponding to the system type of the operating system. And under the condition that the image rendering instruction and the target instruction are the same rendering instruction, determining that the instruction type of the image rendering instruction is the same as the target instruction type, and under the condition that the image rendering instruction and the target instruction are not the same rendering instruction, determining that the instruction type of the image rendering instruction is different from the target instruction type. For example, the image rendering instruction of the target window is OpenGL, the target parameter and the target instruction type are drawing types, the target instruction corresponding to the drawing type in the corresponding Linux system operating system is OpenGL, and since the image rendering instruction is identical to the target instruction, it is determined that the instruction type of the image rendering instruction is identical to the target instruction type, and further it is determined that the image parameter is identical to the target parameter.
In the embodiment of the application, the instruction type of the image rendering instruction in the target window is used as the image parameter for indicating the processing performance parameter of the target window for the display image, so that the processing type of the image by the target window is measured according to the image rendering instruction to determine the application scene of the display desktop, and the identification of the application scene type is realized.
As an optional implementation manner, the identifying, according to the frame rate parameter and the window parameter, a scene type of an application scene corresponding to a display desktop of the target source includes:
determining the scene type of an application scene corresponding to a display desktop of a target source end as a game scene under the condition that the frame rate parameter is greater than or equal to a frame rate threshold value or the frame rate parameter is less than the frame rate threshold value, the display parameter is greater than or equal to a display threshold value and the image parameter is consistent with the target parameter;
and under the condition that the frame rate parameter is less than the frame rate threshold and the display parameter is less than the display threshold or the frame rate parameter is less than the frame rate threshold and the display parameter is greater than or equal to the display threshold and the image parameter is inconsistent with the target parameter, determining that the scene type of the application scene corresponding to the display desktop of the target source end is an office scene.
Optionally, after acquiring the frame rate parameter, the frame rate parameter is compared with a frame rate threshold. And comparing the value of the frame rate parameter with a frame rate threshold value to obtain the size relation between the frame rate parameter and the frame rate threshold value.
Optionally, after the display parameter is acquired, the display parameter is compared with a display threshold, and the numerical value of the display parameter is compared with the display threshold, so as to obtain the size relationship between the display parameter and the display threshold.
Optionally, the scene type of the application scene is sequentially identified according to the frame rate parameter and the window parameter according to a preset judgment sequence. The preset judging sequence can be a frame rate parameter, a window parameter, and the judging sequence of the window parameter can be a display parameter and an image parameter. The preset judgment sequence can be a frame rate parameter, a display parameter and an image parameter.
Alternatively, identifying the scene type of the application scene according to the preset judgment order may perform the preset judgment order until determining the scene type of the application scene. In the case where the scene type of the application scene is determined, the execution of the judgment is stopped. For example, when the scene type can be determined only from the frame rate parameter, the window parameter may not be determined.
Alternatively, the scene type identifying the application scene may be as shown in fig. 7. Executing S702, obtaining frame rate parameters. Specifically, the frame rate of acquisition at the target source is used as a frame rate parameter. If the frame rate parameter is acquired, S704 is executed to determine whether the frame rate parameter is greater than or equal to the frame rate threshold. If it is determined in S704 that the frame rate parameter is equal to or greater than the frame rate threshold, S716 is performed to determine that the application scene type is a game scene.
If the frame rate parameter is not less than the frame rate threshold in S704, S706 is executed to obtain the display parameter. Specifically, a target window displayed in front of a display desktop is determined, the window size of the target window is obtained, the display area of the target window is calculated, and the ratio of the display area of the target window to the desktop area of the display desktop is used as a display parameter. If the display parameter is acquired, S708 is executed to determine whether the display parameter is smaller than the display threshold. If it is determined in S708 that the display parameter is smaller than the display threshold, S714 is performed to determine that the application scene type is an office scene.
If the determination in S708 is no, that is, if the display parameter is smaller than the display threshold, S710 is performed to acquire the image parameter. Specifically, an application process started by a corresponding target application is positioned through a target window, an image rendering instruction is searched in the application process, and the instruction type of the image rendering instruction is used as an image parameter. If the image parameter is acquired, S712 is executed to determine whether the image parameter matches the target parameter. If it is determined in S712 that the image parameter matches the target parameter, S716 is performed to determine that the application scene type is a game scene. In the case where the determination at S712 is no, that is, the image parameter does not coincide with the target parameter, S714 is performed to determine that the application scene type is an office scene.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
According to another aspect of the embodiment of the present invention, there is also provided a scene recognition apparatus for implementing the above-mentioned scene recognition method. As shown in fig. 8, the apparatus includes:
an obtaining module 802, configured to obtain a frame rate parameter of a target source, where the frame rate parameter includes an acquisition frame rate at which the target source performs image acquisition on a picture of a display desktop;
a determining module 804, configured to determine a target window in a display desktop, and obtain a window parameter corresponding to the target window, where the target window is used to represent a window located at a top display layer in the display desktop, and the window parameter includes a performance parameter of the target window related to image display processing;
and the identifying module 806 is configured to identify a scene type of the application scene corresponding to the display desktop of the target source according to the frame rate parameter and the window parameter.
Optionally, the obtaining module 802 includes:
the display device comprises a first acquisition unit, a second acquisition unit and a display unit, wherein the first acquisition unit is used for acquiring display parameters of a target window, and the display parameters are parameters representing the display degree of the target window in a display desktop;
a second acquisition unit configured to acquire an image parameter of a target window, wherein the image parameter is used to indicate a type of image processing performed on the display image in the target window;
and the combination unit is used for taking the display parameter and the image parameter as window parameters.
Optionally, the first obtaining unit includes:
the size unit is used for acquiring the window size of the target window, wherein the window size comprises the width and the height of the target window;
the computing unit is used for computing the display proportion of the target window in the display desktop according to the window size;
and the first parameter unit is used for taking the display scale as the display parameter.
Optionally, the second obtaining unit includes:
the identification unit is used for determining an application identifier of the target window, wherein the application identifier is used for identifying a target application running the target window;
the instruction unit is used for acquiring an image rendering instruction of the display image according to the application identifier, wherein the image rendering instruction is used for instructing the display image to perform rendering processing;
and a second parameter unit for taking an instruction type of the image rendering instruction as an image parameter.
Optionally, the identification unit includes:
the positioning unit is used for positioning the application process started by the target application according to the application identifier;
the searching unit is used for searching the image rendering instruction in the application process started by the target application;
a determination unit to determine an instruction type of the image rendering instruction.
Optionally, the scene recognition apparatus further includes:
the type unit is used for determining a target instruction type corresponding to the target parameter after determining the instruction type of the image rendering instruction;
a comparison unit for comparing an instruction type of the image rendering instruction with a target instruction type;
a third parameter unit which determines that the image parameter is consistent with the target parameter under the condition that the instruction type of the image rendering instruction is the same as the target instruction type;
and the fourth parameter unit is used for determining that the image parameters are inconsistent with the target parameters under the condition that the instruction type of the image rendering instruction is different from the target instruction type.
Optionally, the identifying module 806 includes:
the first identification unit is used for determining the scene type of an application scene corresponding to a display desktop of the target source end as a game scene under the conditions that the frame rate parameter is greater than or equal to a frame rate threshold value or the frame rate parameter is less than the frame rate threshold value, the display parameter is greater than or equal to a display threshold value and the image parameter is consistent with the target parameter;
and the second identification unit is used for determining that the scene type of the application scene corresponding to the display desktop of the target source end is an office scene under the conditions that the frame rate parameter is less than the frame rate threshold, the display parameter is less than the display threshold, or the frame rate parameter is less than the frame rate threshold, the display parameter is greater than or equal to the display threshold, and the image parameter is inconsistent with the target parameter.
In the embodiment of the application, frame rate parameters are acquired and a target window is determined to acquire window parameters indicating the image processing performance of the target window, so that a mode of identifying an application scene corresponding to a display desktop according to the frame rate parameters and the window parameters combining the window parameters is adopted, the frame rate parameters indicating the acquisition frame rate and the window parameters indicating the image processing capacity of the target window are combined with the corresponding application scene for identification, the scene type of the application scene of the display desktop is determined, and the application scene is automatically identified, so that the technical effect of performing acquisition processing in a corresponding mode on the display desktop according to the application scene of the display desktop is realized, and the technical problem of image display abnormity caused by incapability of identifying the scene type is solved.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device for implementing the scene recognition method, where the electronic device may be a terminal device (source terminal) or a server shown in fig. 1. The present embodiment takes the electronic device as a terminal device as an example for explanation. As shown in fig. 9, the electronic device comprises a memory 902 and a processor 904, the memory 902 having stored therein a computer program, the processor 904 being arranged to perform the steps of any of the above-described method embodiments by means of the computer program.
Optionally, in this embodiment, the electronic device may be located in at least one network device of a plurality of network devices of a computer network.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring frame rate parameters of the target source end, wherein the frame rate parameters comprise an acquisition frame rate of the target source end for image acquisition of a picture of the display desktop;
s2, determining a target window in the display desktop, and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at the top of the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing;
and S3, identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 9 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an Android phone, an IOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 9 does not limit the structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 9, or have a different configuration than shown in FIG. 9.
The memory 902 may be configured to store software programs and modules, such as program instructions/modules corresponding to the scene recognition method and apparatus in the embodiments of the present invention, and the processor 904 executes various functional applications and data processing by running the software programs and modules stored in the memory 902, that is, implements the scene recognition method. The memory 902 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 902 may further include memory located remotely from the processor 904, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 902 may be, but not limited to, specifically configured to store information such as a display desktop, a frame rate parameter, a window parameter, and the like. As an example, as shown in fig. 9, the memory 902 may include, but is not limited to, the obtaining module 802, the determining module 804, and the identifying module 806 in the scene recognition apparatus. In addition, the device may further include, but is not limited to, other module units in the scene recognition device, which is not described in detail in this example.
Optionally, the transmitting device 906 is used for receiving or sending data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transmission device 906 includes a Network adapter (NIC) that can be connected to a router via a Network cable and other Network devices to communicate with the internet or a local area Network. In one example, the transmission device 906 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In addition, the electronic device further includes: a display 908 for displaying the display desktop and the target window; and a connection bus 910 for connecting the respective module components in the above-described electronic apparatus.
In other embodiments, the terminal device or the server may be a node in a distributed system, where the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting a plurality of nodes through a network communication. Nodes can form a Peer-To-Peer (P2P, Peer To Peer) network, and any type of computing device, such as a server, a terminal, and other electronic devices, can become a node in the blockchain system by joining the Peer-To-Peer network.
According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in the various alternative implementations of the scene recognition aspect described above. Wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the above-mentioned computer-readable storage medium may be configured to store a computer program for executing the steps of:
s1, acquiring frame rate parameters of the target source end, wherein the frame rate parameters comprise an acquisition frame rate of the target source end for image acquisition of a picture of the display desktop;
s2, determining a target window in the display desktop, and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at the top of the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing;
and S3, identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
Alternatively, in this embodiment, a person skilled in the art may understand that all or part of the steps in the methods of the foregoing embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in the above computer-readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing one or more computer devices (which may be personal computers, servers, network devices, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A method for scene recognition, comprising:
acquiring frame rate parameters of a target source end, wherein the frame rate parameters comprise an acquisition frame rate for acquiring images of a picture of a display desktop by the target source end;
determining a target window in the display desktop, and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at a display top layer in the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing;
and identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
2. The method according to claim 1, wherein the obtaining of the window parameter corresponding to the target window comprises:
acquiring display parameters of the target window, wherein the display parameters are parameters representing the display degree of the target window in the display desktop;
acquiring image parameters of the target window, wherein the image parameters are used for representing the type of image processing performed on a display image in the target window;
and taking the display parameter and the image parameter as the window parameter.
3. The method of claim 2, wherein the obtaining the display parameters of the target window comprises:
acquiring a window size of the target window, wherein the window size comprises the width and the height of the target window;
calculating the display scale of the target window in the display desktop according to the window size;
and taking the display scale as the display parameter.
4. The method of claim 2, wherein the obtaining image parameters of the target window comprises:
determining an application identifier of the target window, wherein the application identifier is used for identifying a target application for running the target window;
acquiring an image rendering instruction of the display image according to the application identifier, wherein the image rendering instruction is used for instructing to perform rendering processing on the display image;
and taking the instruction type of the image rendering instruction as the image parameter.
5. The method of claim 4, wherein the image rendering instructions to obtain the display image according to the application identification comprise:
positioning the application process started by the target application according to the application identifier;
searching the image rendering instruction in an application process started by the target application;
an instruction type of the image rendering instruction is determined.
6. The method of claim 5, after determining the instruction type of the image rendering instruction, further comprising:
determining a target instruction type corresponding to the target parameter;
comparing the instruction type of the image rendering instruction with the target instruction type;
determining that the image parameters are consistent with the target parameters if the instruction type of the image rendering instruction is the same as the target instruction type;
determining that the image parameter is inconsistent with the target parameter if the instruction type of the image rendering instruction is not the same as the target instruction type.
7. The method of claim 6, wherein the identifying the scene type of the application scene corresponding to the display desktop of the target source according to the frame rate parameter and the window parameter comprises:
determining that the scene type of the application scene corresponding to the display desktop of the target source end is a game scene under the condition that the frame rate parameter is greater than or equal to a frame rate threshold value or the frame rate parameter is less than the frame rate threshold value, the display parameter is greater than or equal to a display threshold value, and the image parameter is consistent with the target parameter;
and determining that the scene type of the application scene corresponding to the display desktop of the target source end is an office scene under the condition that the frame rate parameter is smaller than the frame rate threshold and the display parameter is smaller than the display threshold or the frame rate parameter is smaller than the frame rate threshold and the display parameter is greater than or equal to the display threshold and the image parameter is inconsistent with the target parameter.
8. A scene recognition apparatus, comprising:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring frame rate parameters of a target source end, and the frame rate parameters comprise an acquisition frame rate for the target source end to acquire images of a picture of a display desktop;
the determining module is used for determining a target window in the display desktop and acquiring window parameters corresponding to the target window, wherein the target window is used for representing a window positioned at a display top layer in the display desktop, and the window parameters comprise performance parameters of the target window related to image display processing;
and the identification module is used for identifying the scene type of the application scene corresponding to the display desktop of the target source end according to the frame rate parameter and the window parameter.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program which when executed performs the method of any of claims 1 to 7.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 7 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110327061.9A CN113064689A (en) | 2021-03-26 | 2021-03-26 | Scene recognition method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110327061.9A CN113064689A (en) | 2021-03-26 | 2021-03-26 | Scene recognition method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113064689A true CN113064689A (en) | 2021-07-02 |
Family
ID=76563837
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110327061.9A Pending CN113064689A (en) | 2021-03-26 | 2021-03-26 | Scene recognition method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113064689A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113426113A (en) * | 2021-07-05 | 2021-09-24 | 未来科技（襄阳）有限公司 | 3D game starter and 3D starting method of 2D game |
| CN113660459A (en) * | 2021-08-02 | 2021-11-16 | 西安万像电子科技有限公司 | Image data transmission method, device, storage medium and processor |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354606A (en) * | 2016-09-20 | 2017-01-25 | 网易（杭州）网络有限公司 | Application program exception handling method and device |
| CN106919400A (en) * | 2017-03-10 | 2017-07-04 | 广东欧珀移动通信有限公司 | A kind of display scene recognition method of mobile terminal, device and mobile terminal |
| CN109413480A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Picture processing method, device, terminal and storage medium |
| CN110443238A (en) * | 2019-06-21 | 2019-11-12 | 努比亚技术有限公司 | A kind of display interface scene recognition method, terminal and computer readable storage medium |
| CN111245879A (en) * | 2018-11-29 | 2020-06-05 | 深信服科技股份有限公司 | Desktop content transmission method and system of virtual desktop and related components |
| WO2020187157A1 (en) * | 2019-03-18 | 2020-09-24 | 华为技术有限公司 | Control method and electronic device |
-
2021
- 2021-03-26 CN CN202110327061.9A patent/CN113064689A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354606A (en) * | 2016-09-20 | 2017-01-25 | 网易（杭州）网络有限公司 | Application program exception handling method and device |
| CN106919400A (en) * | 2017-03-10 | 2017-07-04 | 广东欧珀移动通信有限公司 | A kind of display scene recognition method of mobile terminal, device and mobile terminal |
| CN109413480A (en) * | 2018-09-30 | 2019-03-01 | Oppo广东移动通信有限公司 | Picture processing method, device, terminal and storage medium |
| CN111245879A (en) * | 2018-11-29 | 2020-06-05 | 深信服科技股份有限公司 | Desktop content transmission method and system of virtual desktop and related components |
| WO2020187157A1 (en) * | 2019-03-18 | 2020-09-24 | 华为技术有限公司 | Control method and electronic device |
| CN110443238A (en) * | 2019-06-21 | 2019-11-12 | 努比亚技术有限公司 | A kind of display interface scene recognition method, terminal and computer readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 王珂: "云平台中的瘦终端协议的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》, no. 10, 15 October 2018 (2018-10-15), pages 139 - 133 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113426113A (en) * | 2021-07-05 | 2021-09-24 | 未来科技（襄阳）有限公司 | 3D game starter and 3D starting method of 2D game |
| CN113426113B (en) * | 2021-07-05 | 2024-06-25 | 未来科技（襄阳）有限公司 | 3D game starter and 3D starting method of 2D game |
| CN113660459A (en) * | 2021-08-02 | 2021-11-16 | 西安万像电子科技有限公司 | Image data transmission method, device, storage medium and processor |
| CN113660459B (en) * | 2021-08-02 | 2023-11-14 | 西安万像电子科技有限公司 | Image data transmission method, device, storage medium and processor |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109461199B (en) | Picture rendering method and device, storage medium and electronic device | |
| CN110383274B (en) | Method, device, system, storage medium, processor and terminal for identifying equipment | |
| CN113064689A (en) | Scene recognition method and device, storage medium and electronic equipment | |
| CN105373471B (en) | Detection method and device for RAM leakage loophole | |
| CN111124567B (en) | Operation recording method and device for target application | |
| CN113098946B (en) | Cloud desktop scene identification method and device, storage medium and electronic device | |
| CN111324275B (en) | Broadcasting method and device for elements in display picture | |
| CN112001274A (en) | Crowd density determination method, device, storage medium and processor | |
| CN108470377A (en) | AR sees room device | |
| CN113076159B (en) | Image display method and device, storage medium and electronic equipment | |
| CN108230434B (en) | Image texture processing method and device, storage medium and electronic device | |
| CN113965773A (en) | Live broadcast display method and device, storage medium and electronic equipment | |
| CN109660508A (en) | Data visualization method, electronic device, computer equipment and storage medium | |
| CN112866738B (en) | Message processing method and live message management system | |
| CN116524136B (en) | Computer room three-dimensional visualization method, system, electronic equipment and readable storage medium | |
| CN110349504A (en) | A kind of museum guiding system based on AR | |
| CN116168045B (en) | Method and system for dividing sweeping lens, storage medium and electronic equipment | |
| CN113254123A (en) | Cloud desktop scene identification method and device, storage medium and electronic device | |
| CN115550645A (en) | Method and device for determining intra-frame prediction mode, storage medium and electronic equipment | |
| CN113066139A (en) | Picture processing method and device, storage medium and electronic equipment | |
| CN114092535A (en) | Depth map reconstruction method, system, device, storage medium and processor | |
| CN110909755A (en) | Object feature processing method and device | |
| CN112100678B (en) | Data processing method and device based on privacy protection and server | |
| CN107845103A (en) | Alarm method, device and computer-readable recording medium based on texture information | |
| CN118015176A (en) | Image rendering method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |