CN112543348A - Remote screen recording method, device, equipment and computer readable storage medium - Google Patents
Remote screen recording method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN112543348A CN112543348A CN202011366839.9A CN202011366839A CN112543348A CN 112543348 A CN112543348 A CN 112543348A CN 202011366839 A CN202011366839 A CN 202011366839A CN 112543348 A CN112543348 A CN 112543348A
- Authority
- CN
- China
- Prior art keywords
- screen
- client
- recording
- initial
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000001514 detection method Methods 0.000 claims abstract description 68
- 238000012545 processing Methods 0.000 claims abstract description 56
- 238000005070 sampling Methods 0.000 claims description 42
- 238000004891 communication Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 11
- 238000012544 monitoring process Methods 0.000 description 5
- 238000004088 simulation Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- GNFTZDOKVXKIBK-UHFFFAOYSA-N 3-(2-methoxyethoxy)benzohydrazide Chemical compound COCCOC1=CC=CC(C(=O)NN)=C1 GNFTZDOKVXKIBK-UHFFFAOYSA-N 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000020169 heat generation Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a remote screen recording method, a device, equipment and a computer readable storage medium, wherein the remote screen recording method comprises the following steps: when a remote screen recording instruction for a client screen is received, determining an initial screen recording parameter corresponding to the remote screen recording instruction, carrying out screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the running performance of the client meets a preset detection condition; if the initial recording parameter does not meet the preset detection condition, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter; and acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client. Therefore, the parameters are dynamically adjusted when the screen is recorded.
Description
Technical Field
The present invention relates to the field of communications network technologies, and in particular, to a remote screen recording method, apparatus, device, and computer-readable storage medium.
Background
At present, in a screen recording mode of an android terminal, fixed parameters such as a sampling rate, a frame rate and the like are firstly set, and then screen recording service is started to perform screen frame-to-frame acquisition, but the mode cannot dynamically change parameters in a screen recording process. For example, when the system turns on a camera or watches a high definition video, a chip with poor performance performs a screen recording and collecting operation while playing the video, which may cause a rapid increase in the heat value of the chip and cause a video pause phenomenon. Therefore, how to realize the dynamic parameter adjustment during screen recording becomes a technical problem to be solved urgently at present.
Disclosure of Invention
The invention mainly aims to provide a screen recording and frame changing method, a screen recording and frame changing device, screen recording and frame changing equipment and a computer readable storage medium, and aims to solve the technical problem of how to dynamically adjust parameters during screen recording.
In order to achieve the above object, the present invention provides a remote screen recording method, which includes the following steps:
when a remote screen recording instruction for a client screen is received, determining an initial screen recording parameter corresponding to the remote screen recording instruction, carrying out screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the running performance of the client meets a preset detection condition;
if the initial recording parameter does not meet the preset detection condition, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter;
and acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client.
Optionally, the step of detecting whether the operation performance of the client meets a preset detection condition includes:
detecting whether a camera device in the client is in a running state;
if the camera device is in an operating state, determining that the operating performance of the client does not meet a preset detection condition;
the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and determining a first storage capacity occupied by the camera device during operation, and adjusting the sampling rate in the initial recording parameters according to the first storage capacity to obtain adjusted recording parameters.
Optionally, the step of detecting whether the operation performance of the client meets a preset detection condition includes:
detecting whether the resolution of the video in the client screen is greater than a preset resolution or not;
if the resolution is larger than a preset resolution, determining that the operation performance of the client does not meet a preset detection condition;
the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and determining a second storage space occupied by the video during playing, and adjusting the sampling rate in the initial recording parameters according to the second storage space to obtain adjusted recording parameters.
Optionally, the step of detecting whether the operation performance of the client meets a preset detection condition includes:
detecting whether the real-time temperature of the CPU of the client is greater than a preset temperature threshold value;
if the real-time temperature is larger than a preset temperature threshold value, determining that the operation performance of the client does not meet a preset detection condition;
the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and acquiring a preset down frame rate, and updating and adjusting the sampling rate in the initial recording parameters according to the down frame rate to acquire adjusted recording parameters.
Optionally, the step of performing screen capture processing on the client screen according to the initial screen recording parameter includes:
and determining the frequency of frame picture receiving of a system interface in the client, and carrying out screen capture processing on the client screen according to the initial screen recording parameters and the frequency.
Optionally, the initial screen recording parameters include a frame rate, a sampling rate, and a screen recording time node.
Optionally, the step of encoding the video data and sending the encoded video data to a client includes:
determining a coding format supported by the client and the server together, coding the video data according to the coding format according to a preset time interval, and sending the coded video data to the client.
In addition, to achieve the above object, the present invention further provides a remote screen recording device, including:
the screen capturing module is used for determining an initial screen recording parameter corresponding to a remote screen recording instruction when the remote screen recording instruction for a client screen is received, performing screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the operation performance of the client meets a preset detection condition;
the adjusting module is used for adjusting the initial recording parameter to obtain an adjusted recording parameter if the preset detection condition is not met, and continuously performing screen capture processing on the client screen according to the adjusted recording parameter;
and the coding module is used for acquiring the video data subjected to screen capture processing, coding the video data and sending the coded video data to a client.
In addition, to achieve the above object, the present invention further provides a remote screen recording device, including: the remote screen recording method comprises a memory, a processor and a remote screen recording program stored on the memory and capable of running on the processor, wherein the steps of the remote screen recording method are realized when the remote screen recording program is executed by the processor.
In addition, to achieve the above object, the present invention also provides a computer readable storage medium having a remote screen recording program stored thereon, which when executed by a processor, implements the steps of the remote screen recording method as described above.
According to the method, when a remote screen recording instruction for a client screen is received, an initial screen recording parameter corresponding to the remote screen recording instruction is determined, screen capture processing is performed on the client screen according to the initial screen recording parameter, and whether the running performance of the client meets a preset detection condition is detected; if the initial recording parameter does not meet the preset detection condition, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter; and acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client. The screen capture processing is carried out on the screen of the client according to the initial screen capture parameter corresponding to the received remote screen capture instruction, the initial recording parameter is adjusted when the operation performance of the client does not meet the preset detection condition, the adjusted recording parameter is obtained, the screen capture processing is carried out according to the adjusted recording parameter, the video data processed by the screen capture processing is encoded, and the encoded video data is sent to the client, so that the phenomenon that the parameter cannot be changed in the screen capture process in the prior art to cause video blockage is avoided, the dynamic parameter adjustment is realized when the screen is recorded, and the video recording efficiency is improved.
Drawings
Fig. 1 is a schematic structural diagram of a remote screen recording device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a remote screen recording method according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram of a device module of the remote screen recording device according to the present invention;
fig. 4 is a schematic flow chart of the remote screen recording method according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a remote screen recording device in a hardware operating environment according to an embodiment of the present invention.
The remote screen recording device in the embodiment of the invention can be a terminal device such as a PC (personal computer) or a server (such as an X86 server) which is provided with a virtualization platform.
As shown in fig. 1, the remote screen recording apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a remote screen recording program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke a remote screener stored in the memory 1005 and perform the operations in the following security component's privilege configuration method embodiments.
When a remote screen recording instruction for a client screen is received, determining an initial screen recording parameter corresponding to the remote screen recording instruction, carrying out screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the running performance of the client meets a preset detection condition;
if the initial recording parameter does not meet the preset detection condition, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter;
and acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client.
Based on the above hardware structure, embodiments of the remote screen recording method of the present invention are provided as follows.
Referring to fig. 2, fig. 2 is a schematic flowchart of a remote screen recording method according to a first embodiment of the present invention, where the remote screen recording method includes:
step S10, when a remote screen recording instruction for a client screen is received, determining an initial screen recording parameter corresponding to the remote screen recording instruction, performing screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the operation performance of the client meets a preset detection condition;
in this embodiment, the remote screen recording method is applied to a server and a client, and a communication connection is established between the server and the client, wherein the client has a screen display function and is used for playing video pictures, and the client may include a mobile phone, a tablet computer, a television, a smart watch, and the like. And the operation of remote screen recording mainly comprises three parts, namely a monitoring part: the server side monitors whether a camera of the client side is opened or not, whether a GPU (Central Processing Unit) is used for watching high-definition videos or not, whether the temperature or the utilization rate of the CPU is too high or not and the like; sampling is carried out in a system screen capture mode, and a system screen capture interface is not occupied; and a frame changing part: and performing frame changing adjustment according to the data obtained by the monitoring part, for example, if the camera is started, reducing the frame rate and the sampling rate by 30%, if the video played by the client is a high-definition video, continuously reducing the frame rate and the sampling rate by 30%, and if the temperature of the CPU is too high, continuously reducing the frame rate and the sampling rate by 30%.
That is, in this embodiment, when performing remote screen recording, the original screen recording interface of the system is not occupied, the frame changing function (i.e., the sampling rate and the frame rate when recording the screen can be changed in real time) is realized by adopting a screenshot sampling mode, and when the pressure of the chip is too high, the operation smoothness of the chip can be ensured, and the probability of heat generation due to blocking is reduced.
Therefore, in this embodiment, when the server receives a remote screen recording instruction for the client screen, which is input by a user or forwarded by another terminal, it is first detected whether the server has an access right to access the client screen, if the server does not have the access right, the server needs to first obtain the access right, and when the server obtains the access right, a screen acquisition request is sent to the client. It should be noted that the initial screen recording parameter may be a default screen recording parameter set in advance by the user, and when the screen recording operation is to be performed, the user may adjust the default screen recording parameter at any time. In this embodiment, the initial screen recording parameters include a frame rate, a sampling rate, and a screen recording time node. Frame rate is the speed at which frames are played. The sampling rate is the sampling frequency, the number of samples per second taken from a continuous signal and made up into a discrete signal. The screen recording time node may be a start time node and an end time node of a screen recording for the client.
After the initial screen recording parameters are determined, screen capture processing can be performed on the client screen according to the initial screen recording parameters, namely, the screen capture can be set once every time a system interface of the client receives one frame of picture. And when the screen capture processing is carried out on the client screen, the server can monitor the operation performance of the client in real time through Socket (Socket) and judge whether the operation performance meets the preset detection condition or not. If a CPU, a GPU (Graphics Processing Unit) and a camera (e.g., a camera) of the client are monitored, that is, if the camera in the client is in an operating state, and if the camera is turned on, it is determined that the operating performance does not satisfy the preset detection condition; if the resolution of the played video is greater than the preset resolution, if the high-definition video exists, determining that the running performance does not meet the preset detection condition; and if the temperature of the CPU is too high or the utilization rate of the CPU is too high, determining that the running performance does not meet the preset detection condition. It should be noted that, when the operation performance of the client meets the preset detection condition, the screen capturing operation is continued according to the initial screen recording parameter.
Step S20, if the preset detection condition is not met, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter;
when the operation performance of the client is found to not meet the preset detection condition through judgment, the initial recording parameter needs to be adjusted to obtain the adjusted recording parameter, if the camera is started, the frame rate and the sampling rate in the 30% initial recording parameter are reduced, if the video played by the client is a high-definition video, the frame rate and the sampling rate in the 30% initial recording parameter are continuously reduced, and if the temperature of the CPU is too high, the frame rate and the sampling rate in the 30% initial recording parameter are continuously reduced. And taking the adjusted initial recording parameter as an adjusted recording parameter, and continuing to perform screen capture processing operation on the client screen according to the adjusted recording parameter, namely replacing the initial recording parameter with the adjusted recording parameter to perform screen capture processing operation.
That is, in this embodiment, in the process of performing remote screen recording, the server may automatically adjust the initial recording parameter according to the operation performance of the client, and record the screen according to the adjusted recording parameter at the continuous stage of the remote screen recording operation, so that it is not necessary to record the screen according to the set uniform initial recording parameter in the remote screen recording process, and in this embodiment, the screen recording operation is performed in a screenshot manner, that is, screen capture processing is performed, so that dynamic adjustment can be performed in the remote screen recording process, occurrence of undesirable phenomena such as jamming and the like at the client is avoided, and the use efficiency of the remote screen recording is also improved.
It should be noted that, in this embodiment, the factors that influence whether the operation performance of the client meets the preset detection condition may include a camera device (such as a camera switch), a codec switch, a chip usage rate, a chip temperature, a video resolution, and the like.
And step S30, acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client.
In this embodiment, when the server remotely performs screen capture processing on the screen of the client, the server needs to acquire video data after screen capture processing in real time, encode the video data according to an encoder configured in the server to acquire encoded video data, and send the encoded video data to the client. That is, in the server in this embodiment, it is further required to perform screen recording configuration on the encoder, and the configuration may include: the encoder object supports an encoding format of h264, an encoding frame rate of the encoder object is greater than or equal to 30 frames (which can be dynamically adjusted according to different installation environments), the encoder object uses different encoding devices on different platforms, preferably hardware encoding, an encoding bit rate of the encoder object is greater than or equal to 2.2Mb, a resolution of the encoder object is greater than or equal to 720p (pixel points 1080 × 720 and above), a sampling interval of the encoder object is less than or equal to 5 seconds, and one or more key frames are output at least every 5 seconds.
That is, in this embodiment, the server monitors the connection request of the client through Socket, starts to acquire video data in the screen after the connection is successful, encodes the acquired video data, and sends the encoded video data to the client, and the client decodes the received video data and displays the decoded video data on the screen.
In addition, in order to assist understanding of the remote screen recording in the present embodiment, the following description is made by way of example.
For example, as shown in fig. 4, a server needs to establish a connection with a client, start a service screen acquisition instruction in the server, and send the screen acquisition instruction to the client, when monitoring that acquisition is allowed according to feedback from the client, a real-time frame rate of the client can be obtained, and screen data acquisition is performed according to the real-time frame rate, and in the server, a Socket is created for monitoring the client, that is, a CPU, a GPU and a camera in the client are monitored to determine whether to adjust a frame rate acquired per second, if adjustment is needed, the real-time frame rate is adjusted, and the server is controlled to perform screen data acquisition according to the adjusted real-time frame rate, and then encode and send screen data to the client. And service touch simulation can be started in the server, and the simulation coordinates are received and the simulation of remote screen recording operation is started according to the simulation coordinates when the client is determined to allow simulation by monitoring the client.
In this embodiment, when a remote screen recording instruction for a client screen is received, an initial screen recording parameter corresponding to the remote screen recording instruction is determined, and a screen capture process is performed on the client screen according to the initial screen recording parameter to detect whether the operating performance of the client meets a preset detection condition; if the initial recording parameter does not meet the preset detection condition, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter; and acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client. The screen capture processing is carried out on the screen of the client according to the initial screen capture parameter corresponding to the received remote screen capture instruction, the initial recording parameter is adjusted when the operation performance of the client does not meet the preset detection condition, the adjusted recording parameter is obtained, the screen capture processing is carried out according to the adjusted recording parameter, the video data processed by the screen capture processing is encoded, and the encoded video data is sent to the client, so that the phenomenon that the parameter cannot be changed in the screen capture process in the prior art to cause video blockage is avoided, the dynamic parameter adjustment is realized when the screen is recorded, and the video recording efficiency is improved.
Further, based on the first embodiment of the present invention, a second embodiment of the remote screen recording method according to the present invention is provided, in this embodiment, in step S10 in the above embodiment, a refinement of the step of detecting whether the operation performance of the client meets a preset detection condition includes:
step a, detecting whether a camera device in the client is in a running state;
b, if the camera device is in an operating state, determining that the operating performance of the client does not meet a preset detection condition;
in this embodiment, when the server establishes a connection with the client and the server starts to perform screen capture processing on video data in a screen of the client, the server monitors the client in real time through Socket so as to detect whether the operation performance of the client meets a preset detection condition (a detection condition set in advance by a user), and determines whether to update an initial screen recording parameter according to a detection result. In this embodiment, it may be first detected whether the camera in the client is in the operating state, and if the camera in the client is turned on, it is determined that the camera is in the operating state, and if the camera is not turned on, it is determined that the camera is not in the operating state. And if the camera device is in the running state, the running performance of the client can be determined not to meet the preset detection condition, and the initial screen recording parameters need to be updated and adjusted.
Specifically, the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and c, determining a first storage space occupied by the camera device during operation, and adjusting the sampling rate in the initial recording parameters according to the first storage space to obtain adjusted recording parameters.
When the operation performance of the client is determined not to meet the preset detection condition, the initial recording parameter needs to be adjusted, at this time, the storage capacity occupied in the memory of the client when the camera device operates, namely the first storage capacity, can be obtained first, the sampling rate in the initial recording parameter is adjusted according to the size of the first storage capacity, if the first storage capacity is determined to be larger than the remaining available memory in the memory of the client, if the first storage capacity is larger than the remaining available memory, the sampling rate in the initial recording parameter is reduced by a certain proportion value, for example, 50%, and if the first storage capacity is smaller than or equal to the remaining available memory, the sampling rate in the initial recording parameter is reduced to another proportion value, for example, 30. In addition, in order to improve the screen recording efficiency, the sampling rate in the initial recording parameters can be directly reduced to a fixed value or a fixed proportion value when the operation of the camera device is detected. And the adjusted initial recording parameter is used as an adjusted recording parameter.
In this embodiment, when it is determined that the camera device in the client is in the operating state, it is determined that the operating performance of the client does not meet the preset detection condition, and the sampling rate in the initial recording parameter is adjusted according to the first storage amount occupied by the camera device during operation, so as to obtain the adjusted recording parameter, thereby ensuring the accuracy of the obtained adjusted recording parameter.
Further, the step of detecting whether the operation performance of the client meets a preset detection condition includes:
d, detecting whether the resolution of the video in the screen of the client is greater than a preset resolution or not;
step e, if the resolution ratio is larger than a preset resolution ratio, determining that the operation performance of the client does not meet a preset detection condition;
in this embodiment, when the server establishes a connection with the client and the server starts to perform screen capture processing on video data in a screen of the client, the server monitors the client in real time through Socket so as to detect whether the operation performance of the client meets a preset detection condition (a detection condition set in advance by a user), and determines whether to update an initial screen recording parameter according to a detection result. In this embodiment, the resolution of the video in the client screen may be detected first to determine that the video played in the client screen is a high-definition video, a standard-definition video, or a smooth video. That is, it may be detected whether the resolution of the video in the client screen is greater than a preset resolution (any resolution set in advance by the user), and when the resolution of the video is greater than the preset resolution, it is determined that the operation performance of the client does not satisfy the preset detection condition.
Specifically, the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and f, determining a second storage space occupied by the video during playing, and adjusting the sampling rate in the initial recording parameters according to the second storage space to obtain adjusted recording parameters.
When the operation performance of the client is determined not to meet the preset detection condition, the initial recording parameter needs to be adjusted, at this time, the storage capacity occupied in the memory of the client during video playing, namely, the second storage capacity, can be obtained first, the sampling rate in the initial recording parameter is adjusted according to the size of the second storage capacity, if the second storage capacity is determined to be larger than the remaining available memory in the memory of the client, if the second storage capacity is larger than the remaining available memory, the sampling rate in the initial recording parameter is reduced by a certain proportion value, for example, 50%, and if the second storage capacity is smaller than or equal to the remaining available memory, the sampling rate in the initial recording parameter is reduced to another proportion value, for example, 30%. In addition, in order to improve the screen recording efficiency, the sampling rate in the initial recording parameter can be directly reduced to a fixed value or a fixed proportion value when the video playing is detected. And the adjusted initial recording parameter is used as an adjusted recording parameter.
In this embodiment, when it is determined that the resolution of the client video is greater than the preset resolution, it is determined that the operation performance of the client does not meet the preset detection condition, and the sampling rate in the initial recording parameter is adjusted according to the second storage amount occupied during video playing, so as to obtain an adjusted recording parameter, thereby ensuring the accuracy of the obtained adjusted recording parameter.
Further, the step of detecting whether the operation performance of the client meets a preset detection condition includes:
step g, detecting whether the real-time temperature of the CPU of the client is greater than a preset temperature threshold value;
step h, if the real-time temperature is larger than a preset temperature threshold value, determining that the operation performance of the client does not meet a preset detection condition;
in this embodiment, when the server establishes a connection with the client and the server starts to perform screen capture processing on video data in a screen of the client, the server monitors the client in real time through Socket so as to detect whether the operation performance of the client meets a preset detection condition (a detection condition set in advance by a user), and determines whether to update an initial screen recording parameter according to a detection result. In this embodiment, the real-time temperature of the CPU of the client may be detected first, whether the real-time temperature of the CPU is greater than a preset temperature threshold (any temperature threshold set in advance by a user) is determined, and if the real-time temperature of the CPU is greater than the preset temperature, it is determined that the operation performance of the client does not satisfy the preset detection condition.
Specifically, the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and k, acquiring a preset down frame rate, and updating and adjusting the sampling rate in the initial recording parameters according to the down frame rate to acquire adjusted recording parameters.
When the operation performance of the client is determined not to meet the preset detection condition, the initial recording parameter needs to be adjusted, at this time, the down frame rate set in advance by the user can be obtained first, the sampling rate in the initial recording parameter is updated and adjusted to the down frame rate, and the updated and adjusted initial recording parameter is used as the adjusted recording parameter.
In this embodiment, when it is determined that the real-time temperature of the CPU of the client is greater than the preset temperature threshold, it is determined that the operation performance of the client does not satisfy the preset detection condition, and the sampling rate in the initial recording parameter is updated and adjusted according to the down-frame rate to obtain the adjusted recording parameter, thereby ensuring the accuracy of the obtained adjusted recording parameter.
Further, the step of performing screen capture processing on the client screen according to the initial screen recording parameter includes:
and m, determining the frequency of receiving frame pictures by a system interface in the client, and carrying out screen capture processing on the client screen according to the initial screen recording parameters and the frequency.
In this embodiment, after the initial screen recording parameter is determined, the frequency of receiving each frame of picture (i.e., frame picture) by the system interface in the client needs to be determined, and then the screen of the client is captured according to the set initial screen recording parameter and the frequency received by the system interface.
Specifically, the initial screen recording parameters include a frame rate, a sampling rate and a screen recording time node.
In the embodiment, the frequency of receiving the frame picture by the system interface in the client is determined, and the screen capture processing is performed according to the initial recording parameter and the frequency, so that the effective screen capture processing is ensured.
Further, the step of encoding the video data and sending the encoded video data to a client includes:
and n, determining a coding format supported by the client and the server together, coding the video data according to the coding format according to a preset time interval, and sending the coded video data to the client.
In this embodiment, it is necessary to determine the coding format commonly supported by the client and the server, and encode the video data according to the coding format according to a time interval set in advance by the user to obtain encoded video data, and send the encoded video data to the client, where the client decodes the received video data and displays the decoded video data on a screen.
In this embodiment, the effectiveness of the encoded data acquired by the client is ensured by determining the encoding format commonly supported by the client and the server, encoding the video data according to the encoding format according to the preset time interval, and then transmitting the encoded video data to the client.
Referring to fig. 3, the present invention further provides a remote screen recording device, in this embodiment, the remote screen recording device includes:
the screen capturing module A10 is configured to, when a remote screen recording instruction for a client screen is received, determine an initial screen recording parameter corresponding to the remote screen recording instruction, perform screen capturing processing on the client screen according to the initial screen recording parameter, and detect whether the operating performance of the client meets a preset detection condition;
the adjusting module a20 is configured to, if the preset detection condition is not met, adjust the initial recording parameter to obtain an adjusted recording parameter, and continue to perform screen capture processing on the client screen according to the adjusted recording parameter;
and the encoding module A30 is used for acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client.
Optionally, the screen capture module a10, configured to:
detecting whether a camera device in the client is in a running state;
if the camera device is in an operating state, determining that the operating performance of the client does not meet a preset detection condition;
optionally, the adjusting module a20 is configured to:
and determining a first storage capacity occupied by the camera device during operation, and adjusting the sampling rate in the initial recording parameters according to the first storage capacity to obtain adjusted recording parameters.
Optionally, the screen capture module a10, configured to:
detecting whether the resolution of the video in the client screen is greater than a preset resolution or not;
if the resolution is larger than a preset resolution, determining that the operation performance of the client does not meet a preset detection condition;
optionally, the adjusting module a20 is configured to:
and determining a second storage space occupied by the video during playing, and adjusting the sampling rate in the initial recording parameters according to the second storage space to obtain adjusted recording parameters.
Optionally, the screen capture module a10, configured to:
detecting whether the real-time temperature of the CPU of the client is greater than a preset temperature threshold value;
if the real-time temperature is larger than a preset temperature threshold value, determining that the operation performance of the client does not meet a preset detection condition;
optionally, the adjusting module a20 is configured to:
and acquiring a preset down frame rate, and updating and adjusting the sampling rate in the initial recording parameters according to the down frame rate to acquire adjusted recording parameters.
Optionally, the screen capture module a10, configured to:
and determining the frequency of frame picture receiving of a system interface in the client, and carrying out screen capture processing on the client screen according to the initial screen recording parameters and the frequency.
The initial screen recording parameters comprise a frame rate, a sampling rate and a screen recording time node.
Optionally, the encoding module a30 is configured to:
determining a coding format supported by the client and the server together, coding the video data according to the coding format according to a preset time interval, and sending the coded video data to the client.
The method for implementing each functional module can refer to the embodiment of the remote screen recording method of the present invention, and is not described herein again.
The invention also provides a remote screen recording device, which comprises: a memory, a processor, a communication bus, and a remote screen recording program stored on the memory:
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is used for executing the remote screen recording program to realize the steps of the remote screen recording method.
The invention also provides a computer readable storage medium.
The computer readable storage medium of the present invention stores thereon a remote screen recording program, which when executed by a processor implements the steps of the remote screen recording method as described above.
The method implemented when the remote screen recording program running on the processor is executed may refer to each embodiment of the remote screen recording method of the present invention, and details are not described here.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A remote screen recording method is characterized by comprising the following steps:
when a remote screen recording instruction for a client screen is received, determining an initial screen recording parameter corresponding to the remote screen recording instruction, carrying out screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the running performance of the client meets a preset detection condition;
if the initial recording parameter does not meet the preset detection condition, adjusting the initial recording parameter to obtain an adjusted recording parameter, and continuing to perform screen capture processing on the client screen according to the adjusted recording parameter;
and acquiring the video data subjected to screen capture processing, encoding the video data, and sending the encoded video data to a client.
2. The remote screen recording method according to claim 1, wherein the step of detecting whether the operation performance of the client meets a preset detection condition comprises:
detecting whether a camera device in the client is in a running state;
if the camera device is in an operating state, determining that the operating performance of the client does not meet a preset detection condition;
the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and determining a first storage capacity occupied by the camera device during operation, and adjusting the sampling rate in the initial recording parameters according to the first storage capacity to obtain adjusted recording parameters.
3. The remote screen recording method according to claim 1, wherein the step of detecting whether the operation performance of the client meets a preset detection condition comprises:
detecting whether the resolution of the video in the client screen is greater than a preset resolution or not;
if the resolution is larger than a preset resolution, determining that the operation performance of the client does not meet a preset detection condition;
the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and determining a second storage space occupied by the video during playing, and adjusting the sampling rate in the initial recording parameters according to the second storage space to obtain adjusted recording parameters.
4. The remote screen recording method according to claim 1, wherein the step of detecting whether the operation performance of the client meets a preset detection condition comprises:
detecting whether the real-time temperature of the CPU of the client is greater than a preset temperature threshold value;
if the real-time temperature is larger than a preset temperature threshold value, determining that the operation performance of the client does not meet a preset detection condition;
the step of adjusting the initial recording parameter to obtain an adjusted recording parameter includes:
and acquiring a preset down frame rate, and updating and adjusting the sampling rate in the initial recording parameters according to the down frame rate to acquire adjusted recording parameters.
5. The remote screen recording method according to claim 1, wherein the step of performing screen capture processing on the client screen according to the initial screen recording parameters comprises:
and determining the frequency of frame picture receiving of a system interface in the client, and carrying out screen capture processing on the client screen according to the initial screen recording parameters and the frequency.
6. The remote screen recording method according to any one of claims 1 to 5, wherein the initial screen recording parameters include a frame rate, a sampling rate, and a screen recording time node.
7. The remote screen recording method according to claim 1, wherein the step of encoding the video data and sending the encoded video data to a client comprises:
determining a coding format supported by the client and the server together, coding the video data according to the coding format according to a preset time interval, and sending the coded video data to the client.
8. A remote screen recording device, characterized in that the remote screen recording device comprises:
the screen capturing module is used for determining an initial screen recording parameter corresponding to a remote screen recording instruction when the remote screen recording instruction for a client screen is received, performing screen capturing processing on the client screen according to the initial screen recording parameter, and detecting whether the operation performance of the client meets a preset detection condition;
the adjusting module is used for adjusting the initial recording parameter to obtain an adjusted recording parameter if the preset detection condition is not met, and continuously performing screen capture processing on the client screen according to the adjusted recording parameter;
and the coding module is used for acquiring the video data subjected to screen capture processing, coding the video data and sending the coded video data to a client.
9. A remote screen recording device, the remote screen recording device comprising: memory, processor and a remote screen recording program stored on the memory and executable on the processor, the remote screen recording program when executed by the processor implementing the steps of the remote screen recording method according to any one of claims 1 to 7.
10. A computer-readable storage medium, having stored thereon a remote screen recording program, which when executed by a processor, performs the steps of the remote screen recording method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011366839.9A CN112543348A (en) | 2020-11-27 | 2020-11-27 | Remote screen recording method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011366839.9A CN112543348A (en) | 2020-11-27 | 2020-11-27 | Remote screen recording method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112543348A true CN112543348A (en) | 2021-03-23 |
Family
ID=75016405
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011366839.9A Pending CN112543348A (en) | 2020-11-27 | 2020-11-27 | Remote screen recording method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112543348A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115103220A (en) * | 2022-07-15 | 2022-09-23 | 福建合诚信息科技有限公司 | Remote control method for browser screen recording |
| CN115499698A (en) * | 2022-09-16 | 2022-12-20 | 中信百信银行股份有限公司 | Single app screen recording method and system capable of executing without sense |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636435A (en) * | 2014-12-26 | 2015-05-20 | 中电科华云信息技术有限公司 | Cloud terminal screen recording method |
| CN108024079A (en) * | 2017-11-29 | 2018-05-11 | 广东欧珀移动通信有限公司 | Record screen method, apparatus, terminal and storage medium |
| CN108121640A (en) * | 2017-12-29 | 2018-06-05 | 北京奇虎科技有限公司 | A kind of method and system for the operation data of acquisition application automatically |
| US20190182113A1 (en) * | 2017-12-11 | 2019-06-13 | Ati Technologies Ulc | Mobile application for monitoring and configuring second device |
| CN110753201A (en) * | 2019-11-12 | 2020-02-04 | 维沃移动通信有限公司 | Video recording method and device, electronic equipment and storage medium |
| CN111459437A (en) * | 2020-04-01 | 2020-07-28 | 杭州盈高科技有限公司 | Control method, controlled end, control end and system of remote screen |
| CN111866143A (en) * | 2020-07-22 | 2020-10-30 | 京东数字科技控股股份有限公司 | Remote data transmission method, device and monitoring system |
-
2020
- 2020-11-27 CN CN202011366839.9A patent/CN112543348A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636435A (en) * | 2014-12-26 | 2015-05-20 | 中电科华云信息技术有限公司 | Cloud terminal screen recording method |
| CN108024079A (en) * | 2017-11-29 | 2018-05-11 | 广东欧珀移动通信有限公司 | Record screen method, apparatus, terminal and storage medium |
| US20190182113A1 (en) * | 2017-12-11 | 2019-06-13 | Ati Technologies Ulc | Mobile application for monitoring and configuring second device |
| CN108121640A (en) * | 2017-12-29 | 2018-06-05 | 北京奇虎科技有限公司 | A kind of method and system for the operation data of acquisition application automatically |
| CN110753201A (en) * | 2019-11-12 | 2020-02-04 | 维沃移动通信有限公司 | Video recording method and device, electronic equipment and storage medium |
| CN111459437A (en) * | 2020-04-01 | 2020-07-28 | 杭州盈高科技有限公司 | Control method, controlled end, control end and system of remote screen |
| CN111866143A (en) * | 2020-07-22 | 2020-10-30 | 京东数字科技控股股份有限公司 | Remote data transmission method, device and monitoring system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115103220A (en) * | 2022-07-15 | 2022-09-23 | 福建合诚信息科技有限公司 | Remote control method for browser screen recording |
| CN115499698A (en) * | 2022-09-16 | 2022-12-20 | 中信百信银行股份有限公司 | Single app screen recording method and system capable of executing without sense |
| CN115499698B (en) * | 2022-09-16 | 2024-03-26 | 中信百信银行股份有限公司 | Single app screen recording method and system without sense of execution |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112492395A (en) | Data processing method and device and electronic equipment | |
| US9344678B2 (en) | Information processing apparatus, information processing method and computer-readable storage medium | |
| CN112543348A (en) | Remote screen recording method, device, equipment and computer readable storage medium | |
| US20150077578A1 (en) | Transmission apparatus, reception apparatus, transmission and reception system, transmission apparatus control method, reception apparatus control method, transmission and reception system control method, and program | |
| CN102664939A (en) | Method and device for mobile terminal of screen mirror image | |
| CN112764853A (en) | Screen projection method, equipment and system | |
| CN112601096A (en) | Video decoding method, device, equipment and readable storage medium | |
| US9226003B2 (en) | Method for transmitting video signals from an application on a server over an IP network to a client device | |
| CN113225585A (en) | Video definition switching method and device, electronic equipment and storage medium | |
| CN110418209B (en) | Information processing method applied to video transmission and terminal equipment | |
| CN114710637A (en) | Low-delay processing method, device, equipment and medium for WEB terminal monitoring video stream | |
| JP2003163914A (en) | Monitor system and picture transmission unit | |
| JP3933589B2 (en) | Video conversion device and monitoring system | |
| US20100049832A1 (en) | Computer program product, a system and a method for providing video content to a target system | |
| CN109922366B (en) | Equipment parameter adjusting method, device, equipment and medium | |
| US20200106821A1 (en) | Video processing apparatus, video conference system, and video processing method | |
| CN111093091A (en) | Video processing method, server and system | |
| CN107734278B (en) | Video playback method and related device | |
| JP2006246110A (en) | Apparatus and system for transmitting video | |
| JP2011192229A (en) | Server device and information processing method | |
| CN111541940B (en) | Motion compensation method and device for display equipment, television and storage medium | |
| CN107004018B (en) | Data processing method and device | |
| CN112887293A (en) | Streaming media processing method and device and electronic equipment | |
| JP2005341093A (en) | Contents adaptating apparatus, contents adaptation system, and contents adaptation method | |
| CN111147928A (en) | Video processing method, server, terminal and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210323 |
|
| RJ01 | Rejection of invention patent application after publication |