CN111880660B - Display screen control method and device, computer equipment and storage medium - Google Patents

Display screen control method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN111880660B
CN111880660B CN202010761968.1A CN202010761968A CN111880660B CN 111880660 B CN111880660 B CN 111880660B CN 202010761968 A CN202010761968 A CN 202010761968A CN 111880660 B CN111880660 B CN 111880660B
Authority
CN
China
Prior art keywords
gesture
static
sequence
standard
gestures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010761968.1A
Other languages
Chinese (zh)
Other versions
CN111880660A (en
Inventor
孙哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202010761968.1A priority Critical patent/CN111880660B/en
Publication of CN111880660A publication Critical patent/CN111880660A/en
Application granted granted Critical
Publication of CN111880660B publication Critical patent/CN111880660B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to a control method and device for display page transformation, computer equipment and a storage medium. The method comprises the following steps: in the process of acquiring the gesture actions, identifying standard static gestures in the gesture actions, and acquiring a first static gesture sequence; when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of a display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence; and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface. By adopting the method, the misoperation triggered when the gesture action is recovered to the original position can be avoided, and the accuracy of controlling the display page can be improved.

Description

Display screen control method and device, computer equipment and storage medium
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for controlling a display screen, a computer device, and a storage medium.
Background
At present, an intelligent terminal, such as a mobile phone, is generally controlled by touch operation based on a touch screen to realize human-computer interaction, but the touch operation mode based on the touch screen is limited and has low flexibility.
Disclosure of Invention
In view of the above, it is necessary to provide a method and an apparatus for controlling a display screen, a computer device, and a storage medium.
A method of controlling a display, the method comprising:
in the process of acquiring the gesture actions, identifying standard static gestures in the gesture actions, and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously identified;
when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of the display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; wherein the second static gesture sequence comprises at least two standard static gestures which are continuously recognized;
when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence;
and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface.
A method of page display, the method comprising:
displaying a first display picture;
in the process of acquiring the gesture action, determining target conversion operation according to a first static gesture sequence in the gesture action;
when the conversion operation corresponding to the second static gesture sequence in the gesture motion is consistent with the target conversion operation, acquiring a second display picture according to the gesture target conversion operation and the first display picture;
and displaying the second display picture.
A control apparatus for displaying a picture, the apparatus comprising:
the gesture recognition module is used for recognizing a standard static gesture in the gesture actions in the process of acquiring the gesture actions and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously recognized;
the operation setting module is used for determining the target conversion operation of the display picture according to the first static gesture sequence and acquiring a second static gesture sequence when the standard static gestures in the first static gesture sequence are the same type of standard static gestures; wherein the second static gesture sequence comprises at least two standard static gestures which are continuously recognized;
the operation acquisition module is used for determining the transformation operation corresponding to the second static gesture sequence when the standard static gestures in the second static gesture sequence are different types of standard static gestures;
and the page switching module is used for responding to the target conversion operation and converting the display picture in the display interface when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
in the process of acquiring the gesture actions, identifying standard static gestures in the gesture actions, and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously identified;
when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of the display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; wherein the second static gesture sequence comprises at least two standard static gestures which are continuously recognized;
when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence;
and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
in the process of acquiring the gesture actions, identifying standard static gestures in the gesture actions, and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously identified;
when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of the display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; wherein the second static gesture sequence comprises at least two standard static gestures which are continuously recognized;
when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence;
and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface.
According to the control method and device for displaying page transformation, the computer equipment and the storage medium, in the process of acquiring the gesture action, a standard static gesture in the gesture action is recognized, and a first static gesture sequence is acquired, wherein the first static gesture sequence comprises a plurality of standard static gestures which are obtained through continuous recognition; when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of a display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; the second static gesture sequence comprises at least two standard static gestures which are obtained by continuous recognition; when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence; and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface. The method can avoid the misoperation triggered when the gesture action restores to the original position, improve the accuracy of the control of the display page, simultaneously realize the continuous repeated execution of the target conversion operation and improve the flexibility of the gesture operation of the user.
Drawings
FIG. 1 is a flowchart illustrating a method for controlling a display screen according to an embodiment;
FIG. 2 is a diagram of a standard static gesture in one embodiment;
FIG. 3 is a flowchart illustrating a method for controlling a display screen according to another embodiment;
FIG. 4a is a diagram illustrating a control method for displaying an image according to an embodiment;
FIG. 4b is a flowchart illustrating a method for controlling a display screen according to another embodiment;
FIG. 5 is a flowchart illustrating a page display method according to an embodiment;
FIG. 6 is a block diagram showing the structure of a control device for displaying a screen in one embodiment;
FIG. 7 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.
In an embodiment, as shown in fig. 1, a method for controlling a display screen is provided, and this embodiment is described by taking the method as an example of being applied to a terminal, it is to be understood that the method may also be applied to a server, and may also be applied to a system including a terminal and a server, and is implemented by interaction between the terminal and the server. In this embodiment, the method includes the steps of:
step S102, in the process of acquiring the gesture action, identifying a standard static gesture in the gesture action, and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously identified.
The gesture motion refers to a non-contact gesture motion, and may be, for example, an air gesture motion facing the terminal; the gesture motion may be dynamic gesture motion or static gesture motion. Specifically, the terminal may acquire the gesture action of the user in multiple ways, for example, an image collector (e.g., a camera device) may collect a gesture image of the user in the process of implementing the gesture action, so as to identify the gesture action from the gesture image; the gesture of the user may also be obtained by an infrared light sensor or an ambient light sensor, which is not limited in this respect. The standard static gesture refers to a preset static gesture, for example, referring to fig. 2, the standard static gesture may include, but is not limited to, a palm (as shown in fig. 2 (a)), a back of a hand (as shown in fig. 2 (b)), a fist (as shown in fig. 2 (c)), and the like. Specifically, when the terminal performs static gesture recognition on the gesture actions input by the user, only standard static gestures may be marked, and gesture actions other than the standard static gestures may be marked as invalid gestures.
Specifically, the terminal can acquire a gesture image of a gesture action of a user through the image collector, sequentially identify a static gesture corresponding to each frame of gesture image, and record the static gesture corresponding to the gesture image into a first static gesture sequence (hereinafter, marked as a first static gesture sequence a) when the static gesture identified from the gesture image is a standard static gesture; and then, continuously recognizing the static gestures corresponding to the subsequent gesture images, and when the standard static gesture is recognized again, recording the static gesture of the frame into the first static gesture sequence A until the standard static gesture recorded in the first static gesture sequence A reaches a quantity threshold value. In a specific application process, the number threshold of the static gestures recorded in the first static gesture sequence a is fixed, for example, in one embodiment, the number threshold of the static gestures recorded in the first static gesture sequence a is 10, and when the number of the static gestures recorded in the first static gesture sequence a reaches 10, the preset target transformation operation may be confirmed according to the standard static gestures recorded in the first static gesture sequence a.
Step S104, when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of a display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; wherein the second static gesture sequence comprises at least two standard static gestures that are recognized consecutively.
Specifically, after the first static gesture sequence a is acquired, the terminal determines whether each static gesture in the first static gesture sequence a is a standard static gesture of the same type, when the static gestures in the first static gesture sequence a are all the standard static gestures of the same type, that is, a plurality of standard static gestures of the same type are continuously recognized, at this time, a target conversion operation can be determined according to the standard static gestures to realize a target conversion operation, and when a second static gesture sequence B corresponding to the target conversion operation is subsequently recognized, the operation can be quickly responded, and the conversion of a display picture is realized.
The second static gesture sequence (hereinafter, referred to as a second static gesture sequence B) includes at least two static gestures, and the static gestures in the second static gesture sequence B are all standard static gestures, specifically, each static gesture in the second static gesture sequence B may be a different standard static gesture or the same standard static gesture; in a specific application process, the threshold of the number of static gestures recorded in the second static gesture sequence B is fixed, for example, in one embodiment, the threshold of the number of static gestures recorded in the second static gesture sequence B is 2, and when the number of static gestures recorded in the second static gesture sequence B reaches 2, the conversion of the display screen may be controlled according to the standard static gestures recorded in the second static gesture sequence B.
Specifically, when a user wants to control the terminal to perform display screen conversion, the gesture action can be input in the way of facing the terminal; the terminal can acquire gesture images of gesture actions of a user through the image acquisition device, sequentially identifies static gestures corresponding to each frame of gesture images, and records the static gestures corresponding to the gesture images into a second static gesture sequence B when the static gestures identified from the gesture images are standard static gestures; and then, continuously recognizing the static gestures corresponding to the subsequent gesture images, and when the standard static gestures are recognized again, recording the static gestures of the frame into a second static gesture sequence B until the standard static gestures recorded in the second static gesture sequence B reach a quantity threshold value.
And S106, when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining the transformation operation corresponding to the second static gesture sequence.
After the second static gesture sequence B is obtained, the terminal judges whether each standard static gesture in the second static gesture sequence B is a standard static gesture of the same type; when the standard static gestures in the second static gesture sequence B are different types of standard static gestures, the gesture motion input by the user may be considered as a dynamic and continuously-changed gesture motion, and at this time, the current change operation of the display screen may be determined according to the second static gesture sequence B. Further, in an embodiment, when the standard static gestures in the second static gesture sequence B are the same type of standard static gestures, the gesture motion input by the user may be regarded as a static and persistent gesture motion, and the display screen in the display interface is kept unchanged.
Determining a conversion operation corresponding to the second static gesture sequence, specifically determining a conversion operation corresponding to the second static gesture sequence B according to a first standard static gesture in the second static gesture sequence B; or determining a transformation operation corresponding to the second static gesture sequence B according to the last standard static gesture in the second static gesture sequence B; and determining the transformation operation corresponding to the second static gesture sequence B according to the sequence relation among different standard static gestures in the second static gesture sequence B. Among other things, transformation operations include, but are not limited to: a display screen downslide operation, a display screen upslide operation, a display screen upspring operation, a display screen downslide operation, a display screen enlarging operation, a display screen reducing operation, a display screen clockwise rotation operation, a display screen counterclockwise rotation operation, and the like.
In an embodiment, the corresponding relationship between the static gestures of different standards and the transformation operation may be pre-stored, and after the second static gesture sequence B is recognized from the gesture actions input by the user, the transformation operation corresponding to the second static gesture sequence B is determined, which may be to obtain the transformation operation corresponding to the second static gesture sequence B from the corresponding relationship. Specifically, the corresponding relationship between a single standard static gesture and the conversion operation of the display screen may be pre-stored, and after the second static gesture sequence B is obtained, the conversion operation corresponding to the second static gesture sequence B may be determined according to a first standard static gesture or a last standard static gesture in the second static gesture sequence B; for example, taking a gesture motion in which the palm of the hand is turned to the back of the hand to control the display screen to slide down for displaying, a corresponding relationship between a standard static gesture "palm of the hand" and a conversion operation in which the display screen slides down may be stored in advance, after a gesture motion in which the palm of the hand input by the user is turned to the back of the hand is obtained, the terminal identifies the standard motion gesture in the gesture motion to obtain a second static gesture sequence B { "palm of the hand" and "back of the hand", and then determines the conversion operation of the display screen corresponding to the second static gesture sequence B according to a first standard static gesture "palm of the hand" in the second static gesture sequence B. Or, the corresponding relation between two or more different standard static gestures and the transformation operation can be preserved in advance; still taking the example of controlling the display screen to slide down by the gesture of turning the palm to the back of the hand, the corresponding relationship between { "palm", "back of the hand" } and the conversion operation of displaying the screen to slide down may be saved in advance, after the gesture action of turning the palm to the back of the hand input by the user is obtained, the terminal identifies the standard action gesture in the gesture action to obtain a second static gesture sequence B { "palm", "back of the hand" }, and then determines the display slow conversion operation corresponding to the second static gesture sequence B according to the first standard static gesture and the second standard static gesture in the second static gesture sequence B.
And S108, when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface.
The target transformation operation is a transformation operation of a preset display screen, and may specifically be determined by a previous static gesture in a gesture motion, or determined by a tap-and-touch gesture operation on the display screen displayed on the terminal, or determined by a pressing operation of a physical control of the terminal, or determined by a voice control instruction, which is not limited specifically herein. Specifically, after the terminal acquires the conversion operation corresponding to the second static gesture sequence B, the terminal compares whether the conversion operation is consistent with a preset target conversion operation, and if so, triggers the target conversion operation to convert a display picture in the display interface.
Further, in an embodiment, after responding to the target conversion operation and converting the display screen in the display interface, the step of obtaining the second static gesture sequence is returned to be executed, so that the static gesture sequence is recognized and obtained from the continuously changing gesture actions in real time, when the standard static gesture in the second static gesture sequence is the standard static gesture of different types, and the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, the target conversion operation is responded again, the display screen in the display interface is converted, the continuous execution of the conversion operation is realized, and the display screen in the display interface is converted.
In the control method for displaying page conversion, in the process of acquiring the gesture action, a standard static gesture in the gesture action is recognized, and a first static gesture sequence is acquired, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously recognized; when the standard static gestures in the first static gesture sequence are the same type of standard static gestures, determining target conversion operation of a display picture according to the first static gesture sequence, and acquiring a second static gesture sequence; the second static gesture sequence comprises at least two standard static gestures which are obtained by continuous recognition; when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence; and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface. The method can avoid the misoperation triggered when the gesture action restores to the original position, improve the accuracy of the control of the display page, simultaneously realize the continuous repeated execution of the target conversion operation and improve the flexibility of the gesture operation of the user. Meanwhile, a user only needs to repeatedly make gesture actions corresponding to the second static gesture sequence, the terminal can be triggered to continuously execute target conversion operation, the gesture actions corresponding to the first static gesture sequence do not need to be repeatedly made, the terminal does not need to repeatedly detect the first static gesture sequence, time consumption of repeated control is reduced, the second static gesture sequence is characterized by at least two gesture recognition results, namely the second static gesture sequence can be air-isolated gesture actions formed by different gestures, the application range of the gesture actions is expanded, and the accuracy, the fluency and the comprehensiveness of the air-isolated gesture control are improved.
Further, in one embodiment, after determining the transformation operation corresponding to the second static gesture sequence, the method further comprises: and when the conversion operation corresponding to the second static gesture sequence is inconsistent with the target conversion operation, keeping the display picture in the display interface unchanged. Specifically, after the terminal acquires the conversion operation corresponding to the second static gesture sequence B, the terminal compares whether the conversion operation is consistent with the preset target conversion operation, and if not, the display picture in the display interface is maintained, so that the misoperation of gesture actions is avoided, and the accuracy of controlling the display page is improved.
In one embodiment, the first static gesture sequence comprises a first moment static gesture and a second moment static gesture which are continuously recognized; when the standard static gestures in the first static gesture sequence are different types of standard static gestures, the step of determining the transformation operation corresponding to the second static gesture sequence comprises the following steps: and when the static gesture at the first moment and the static gesture at the second moment are different types of standard static gestures, determining a conversion operation according to the static gesture at the first moment and/or the static gesture at the second moment.
The static gesture B1 at the first moment is a standard static gesture recognized before the static gesture B2 at the second moment in recognition timing sequence. The first-time static gesture B1 and the second-time static gesture B2 may be standard static gestures of the same type or standard static gestures of different types.
Specifically, after the second static gesture sequence B is acquired, the terminal determines whether a first-time static gesture B1 in the second static gesture sequence B is the same as a second-time static gesture B2, and when the first-time static gesture B1 is different from the second-time static gesture B2, a transformation operation corresponding to the second static gesture sequence B may be determined according to the first-time static gesture B1 in the second static gesture sequence B; or determining a transformation operation corresponding to the second static gesture sequence B according to the second moment static gesture B2 in the second static gesture sequence B; and determining the transformation operation corresponding to the second static gesture sequence B according to the first moment static gesture B1 and the second moment static gesture B2 in the second static gesture sequence B.
Further, in one embodiment, when the static gesture B1 at the first time and the static gesture B2 at the second time are the same type of standard static gesture, the display page in the display interface is kept unchanged.
In one embodiment, the start gesture and the end gesture of the gesture actions corresponding to the transform operation may be set to standard static gestures. In the process of acquiring the gesture action, when a static gesture sequence with a first moment static gesture B1 as a starting gesture and a second moment static gesture B2 as an ending gesture is acquired, the corresponding transformation operation can be determined, and the accuracy of the acquisition of the transformation operation is ensured, and meanwhile, the workload of gesture recognition is effectively reduced.
In one embodiment, recognizing a standard static gesture in the gesture actions, obtaining a first sequence of static gestures comprises: acquiring a gesture image of a gesture action at a first image acquisition frame rate; recognizing a standard static gesture in the gesture actions based on the gesture image to obtain a first static gesture sequence; obtaining a second static gesture sequence comprising: adjusting the image acquisition frame rate, and acquiring a gesture image of the gesture action at a second image acquisition frame rate; recognizing a standard static gesture in the gesture actions based on the gesture image to obtain a second static gesture sequence; wherein the second frame rate is greater than the first frame rate.
Specifically, the terminal can continuously acquire gesture images of gesture actions of a user at a first image acquisition frame rate through an image acquisition device, and acquires a first static gesture sequence A by identifying standard static gestures in the acquired gesture images; the method also comprises the steps of acquiring a video stream of gesture actions of a user through an image acquirer, acquiring frame images from the video stream at a first image acquisition frame rate, and identifying standard static gestures in the frame images to acquire a first static gesture sequence A. After determining the target transformation operation of the display picture according to the first static gesture sequence a, the terminal may adjust the first image acquisition frame rate to the second image acquisition frame rate, and acquire the gesture image of the gesture motion with the second image. Similarly, the terminal may specifically continuously acquire a gesture image of the gesture action of the user at a second image acquisition frame rate through the image acquirer, and acquire a second static gesture sequence B by identifying a standard static gesture in the acquired gesture image; the image collector can also collect video streams of gesture actions of the user, frame images are obtained from the video streams at a second image collection frame rate, and standard static gestures in the frame images are identified to obtain a second static gesture sequence B.
In the embodiment, when no gesture action is input, the image is shot at a slower frame rate to monitor the input of the gesture action in real time, and after the gesture action input by the user is confirmed, the continuous gesture action is obtained at a faster frame rate, so that the smoothness of the user air-separating operation is improved, and the power consumption of the terminal is effectively reduced.
Further, in one embodiment, after acquiring the gesture image of the gesture motion at the second frame rate, the method further comprises: and when the standard static gesture cannot be recognized based on the gesture image, adjusting the image acquisition frame rate, and returning to the step of acquiring the gesture image of the gesture action at the first frame rate. Specifically, after the terminal determines the target conversion operation of the display picture according to the first static gesture sequence, the terminal adjusts the first image acquisition frame rate to be the second image acquisition frame rate, the second image acquisition frame rate is used for acquiring the image of the gesture action of the user, when the standard static gesture cannot be identified in the acquired image, the current gesture action input is considered to be absent or invalid, at the moment, the terminal adjusts the second image acquisition frame rate to be the first image acquisition frame rate, the gesture image is acquired at the first image acquisition frame rate, the image is acquired at the lower image acquisition frame rate to realize real-time monitoring of the gesture action input condition, and the power consumption of the terminal is reduced. Specifically, the terminal may preset a first time threshold, and within a certain first time threshold, if a standard static gesture cannot be recognized based on the gesture image, the image acquisition frame rate is adjusted, and the step of acquiring the gesture image of the gesture motion at the first frame rate is returned.
In one embodiment, the step of recognizing a standard static gesture in the gesture motion and obtaining a second sequence of static gestures comprises: identifying a static gesture in the gesture actions; when the static gesture is a standard static gesture, recording the static gesture into the second static gesture sequence; and returning to the step of identifying the static gesture in the gesture actions until the standard static gesture recorded in the second static gesture sequence reaches a quantity threshold value, so as to obtain a second static gesture sequence. Also, in one embodiment, the step of identifying a standard static gesture in the gesture actions and obtaining a second static gesture sequence comprises: recognizing a static gesture in the gesture actions; when the static gesture is a standard static gesture, recording the static gesture into a first static gesture sequence; and returning to the step of executing the static gesture in the gesture recognition action until the standard static gesture recorded in the first static gesture sequence reaches a quantity threshold value, and obtaining a first static gesture sequence.
Specifically, the terminal can acquire gesture images of gesture actions of a user through an image acquisition device, sequentially identify static gestures corresponding to each frame of gesture images, and record the static gestures to a first variable position in a static gesture sequence (comprising a second static gesture sequence B and a first static gesture sequence A) when the standard static gestures are identified for the first time from the gesture images; and then, continuously recognizing the static gestures corresponding to the subsequent gesture images, when the standard static gesture is recognized again, recording the static gesture of the frame to a second variable position in the static gesture sequence, and so on until the standard static gesture recorded in the static gesture sequence reaches a quantity threshold value, thereby obtaining the static gesture sequence.
Further, in an embodiment, the terminal may preset a second time threshold, and after the step of recording the standard static gesture to the second static gesture sequence, within the second time threshold, based on that the standard static gesture cannot be recognized again by the gesture image, the second static gesture sequence is cleared, and at the same time, the image capturing frame rate is adjusted, and the step of obtaining the gesture image of the gesture motion at the first frame rate is returned. Similarly, in an embodiment, the terminal may preset a third time threshold, and after the step of recording the standard static gesture to the first static gesture sequence, clear the first static gesture sequence if the standard static gesture cannot be recognized again based on the gesture image within the third time threshold, and return to the step of acquiring the gesture image of the gesture motion at the first frame rate.
In one embodiment, the target transform operation comprises a screen slide operation; responding to the target transformation operation, transforming the display screen in the display interface, and comprising: and displaying the display picture after the picture is slid in the display interface in response to the picture sliding operation.
When the terminal responds to the screen sliding operation, the display screen after sliding is determined according to the screen position of the display screen in the current display interface and the sliding operation information identified by the screen sliding operation. Specifically, the slide operation information may include a slide speed, a slide distance, a slide direction, and the like; after the picture sliding operation is acquired, the display page is controlled to slide for a certain sliding distance along the sliding direction at a certain sliding speed according to the sliding operation information of the picture sliding operation, so that the slid display picture is acquired.
In one embodiment, the target transformation operation includes a page turn operation; responding to the target transformation operation, transforming the display screen in the display interface, and comprising: and responding to the picture page turning operation, and displaying the display picture after page turning in the display interface. Wherein, the target transformation operation can be a picture page turning operation; and when the terminal responds to the picture sliding operation, controlling the display picture to turn forward or backward according to the picture identification of the display picture in the current display interface and the page turning information identified by the picture page turning operation.
In one embodiment, the target transform operation comprises a screen rotation operation; responding to the target transformation operation, transforming a display screen in a display interface, and comprising: and displaying the rotated display picture in the display interface in response to the picture rotation operation. Wherein the target transform operation may be a screen rotation operation; when the terminal responds to the picture rotation operation, the display picture is controlled to rotate a certain rotation angle value towards the rotation direction according to the rotation direction and the rotation angle value identified by the picture rotation operation.
In one embodiment, as shown in fig. 3, a method for controlling a display screen includes:
step S302, in the process of acquiring the gesture action, acquiring a gesture image of the gesture action at a first image acquisition frame rate.
Step S304, standard static gestures in the gesture actions are recognized based on the gesture images, and a first static gesture sequence is obtained, wherein the first static gesture sequence comprises a plurality of standard static gestures which are obtained through continuous recognition.
Step S306, when the standard static gestures in the first static gesture sequence are standard static gestures of the same type, determining the target conversion operation of the display picture according to the first static gesture sequence.
Step S308, acquiring a gesture image of the gesture motion at a second image acquisition frame rate.
Step S310, recognizing a standard static gesture in the gesture actions based on the gesture image, and acquiring a second static gesture sequence; wherein the second static gesture sequence comprises at least two standard static gestures which are continuously recognized.
In step S312, when the standard static gestures in the second static gesture sequence are different types of standard static gestures, the transformation operation corresponding to the second static gesture sequence is determined.
In step S314, when the standard static gestures in the second static gesture sequence are standard static gestures of the same type, the display screen in the display interface is kept unchanged.
And step S316, when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting the display picture in the display interface.
Step S318, when the conversion operation corresponding to the second static gesture sequence is inconsistent with the target conversion operation, keeping the display screen in the display interface unchanged.
When the terminal does not acquire any gesture actions, the terminal acquires images at a first image acquisition frame rate to monitor the gesture actions input by the current user in real time. At this time, when the terminal recognizes the same standard static gesture from a plurality of continuous collected images, the conversion operation corresponding to the standard static gesture is set as the current target conversion operation. Specifically, when the terminal recognizes a standard static gesture from a gesture image of a gesture action, recording a gesture identifier corresponding to the standard static gesture into a second queue corresponding to the first static gesture sequence a, when the number of variables (i.e., the recorded gesture identifiers of the standard static gesture) in the second queue reaches a preset number threshold, determining whether the variables in the second queue are the same, and if the variables in the second queue are the same, recording the gesture identifier corresponding to the standard static gesture into a status flag bit, where the status flag bit is used for identifying a target conversion operation of a current display picture.
When the terminal identifies a plurality of continuous same standard static gestures, the terminal adjusts the first image acquisition frame rate to a second image acquisition frame rate, acquires gesture images of gesture actions input by a user at the second image acquisition frame rate, and performs gesture identification on the gesture images to acquire a second static gesture sequence B. Specifically, when the terminal recognizes a standard static gesture from the collected gesture image, when the standard static gesture is recognized from the gesture image for the first time, the static gesture corresponding to the gesture image is recorded in a first variable position in a first queue corresponding to a second static gesture sequence B, then, the static gesture corresponding to a subsequent gesture image is continuously recognized, when the standard static gesture is recognized again, the static gesture of the gesture image is recorded in a second variable position in the first queue, and so on until the standard static gesture recorded in the static gesture sequence reaches a quantity threshold value, and a second static gesture sequence B is obtained. Further, after the standard static gesture is recognized, the standard static gesture is not recognized again in the collected gesture image within a certain period of time, at this time, if no gesture action input is considered or an input gesture is an invalid action gesture, the display picture in the display interface is kept unchanged, the terminal adjusts the image collection frame rate, and the gesture image of the gesture action is obtained again at the first frame rate. Or after the terminal adjusts the first image acquisition frame rate to the second image acquisition frame rate and acquires the gesture images of the gesture actions input by the user at the second image acquisition frame rate, a standard static gesture is not recognized in the acquired gesture images within a certain period of time, at this time, the terminal can be considered to have no gesture action input or input the gesture images of the gesture actions at the first frame rate again, and the image acquisition frame rate is adjusted.
After the second static gesture sequence B is acquired, the terminal judges whether each standard static gesture in the second static gesture sequence B is the same type of standard static gesture. When the standard static gestures in the second static gesture sequence B are standard static gestures of the same type, the gesture motion input by the user can be regarded as a static and persistent gesture motion, and the display picture in the display interface is kept unchanged; when the standard static gestures in the second static gesture sequence B are different types of standard static gestures, the gesture motion input by the user can be considered as a dynamic and continuously-changed gesture motion, at this time, the current change operation of the display screen can be determined according to the second static gesture sequence B, and whether the change operation is consistent with the preset target change operation or not is compared, if so, the target change operation is triggered, the display screen in the display interface is changed, and if not, the display screen in the display interface is kept unchanged.
In an embodiment, when the standard static gestures in the second static gesture sequence B are different types of standard static gestures, the terminal may determine whether a first standard static gesture in the second static gesture sequence B is the same as the standard static gesture in the first static gesture sequence a, and when the first standard static gesture in the second static gesture sequence B is the same as the standard static gesture in the first static gesture sequence a, a conversion operation corresponding to the second static gesture sequence B is consistent with a preset target conversion operation, and the target conversion operation is triggered to convert a display picture in the display interface.
With reference to fig. 4a and fig. 4b, taking the gesture action of turning the palm of the hand to the back of the hand to control the display screen to slide down for displaying, and taking the gesture action of turning the back of the hand to the palm of the hand as the example of controlling the display screen to slide up for displaying, the technical solution in this embodiment is further explained, wherein the standard static gesture is set as the "palm of the hand" gesture and the "back of the hand" gesture, and the gesture identifier of the "palm of the hand" gesture is 0, corresponding to the display screen slide down operation, and the gesture identifier of the "back of the hand" gesture is 1, corresponding to the display screen slide up operation.
When the terminal does not acquire any gesture actions, the terminal acquires images at a first image acquisition frame rate to monitor the gesture actions input by the current user in real time. When a user wants to control the display picture to slide upwards for display, the user can face the terminal with the palm of the hand and turn the palm of the hand over to the back of the hand, so that the display picture can be controlled to slide upwards for display. At the moment, the terminal identifies the gesture images of the gesture actions input by the user at the first image acquisition frame rate, and when a plurality of continuous gestures of the palm of the hand are identified, the terminal sets the display screen downslide operation for controlling the display screen to downslide as the current target conversion operation. Specifically, the terminal acquires a gesture image of a gesture action input by a user at a first image acquisition frame rate (at this time, fastFPS = false), and records a gesture identifier "0" corresponding to the gesture of the "palm" into a second queue when the gesture of the "palm" is recognized from the gesture image of the gesture action; when the number of the variables in the second queue reaches a preset number threshold (for example, 10) and each variable in the second queue is a gesture identifier "0", storing the gesture identifier "0" corresponding to the "palm of hand" gesture to a state flag bit, where the state flag bit identifies that the current target transformation operation is a display screen downslide operation, and simultaneously adjusting the first image acquisition frame rate to the second image acquisition frame rate (at this time, fastFPS = true).
Then, the terminal identifies a gesture image of a gesture action (turning of the palm of the hand to the back of the hand) input by the user at a second image acquisition frame rate, and records a gesture identifier '0' corresponding to the gesture of the palm of the hand or a gesture identifier '1' corresponding to the gesture of the back of the hand into the first queue when a standard static gesture in the gesture image is identified and the gesture of the palm of the hand or the gesture of the back of the hand is identified.
Assume that after the terminal adjusts the first image capturing frame rate to the second image capturing frame rate, when the gesture of the "palm of hand" is recognized from the captured gesture image, the gesture of the "palm of hand" is taken as the static gesture A1 at the first time, and the gesture identifier "0" is taken as the first element and recorded in the first queue. Then, continuously recognizing a standard static gesture from the acquired gesture image, when a hand gesture is recognized, taking the hand gesture as a static gesture B1 at a second moment, taking a gesture identifier 0 as a second element to be recorded into a first queue, wherein the gesture identifier of the first queue reaches a quantity threshold (for example 2), the first queue is [0,0], and the static gesture B1 at the first moment and the static gesture B2 at the second moment are standard static gestures of the same type corresponding to a second static gesture sequence { the hand and the hand }, namely the elements in the first queue are the same, and the display picture is kept unchanged; when the gesture of 'hand back' is recognized, the gesture mark '1' is recorded into the first queue as a second element, the gesture marks of the first queue reach a quantity threshold value, the first queue is [0,1], the first queue corresponds to a second static gesture sequence { palm of the hand, back of the hand }, the static gesture B1 at the first moment and the static gesture B2 at the second moment are standard static gestures of different types, the gesture mark '0' of the static gesture B1 at the first moment is the same as a state flag bit, namely the conversion operation determined according to the static gesture B1 at the first moment and the static gesture B2 at the second moment is the same as the target conversion operation, and the display picture A in the display interface is converted into the display picture B in response to the target conversion operation. The conversion of the display screen a into the display screen B in the display interface may be realized by sliding the display screen.
Assume that after the terminal adjusts the first image acquisition frame rate to the second image acquisition frame rate, when a "hand back" gesture is recognized from the acquired gesture images, the "hand back" gesture is taken as a first-time static gesture A1, and a gesture identifier "1" is taken as a first element and recorded in the first queue. Then, standard static gestures are continuously recognized from the collected gesture images, when a gesture of a hand center is recognized, the gesture of the hand center is used as a static gesture B2 at a second moment, a gesture mark 0 is used as a first element and recorded into a first queue, the gesture mark of the first queue reaches a quantity threshold value, the first queue is [1,0], the static gesture sequence corresponding to the second static gesture sequence { hand back, hand center }, the static gesture B1 at the first moment and the static gesture B2 at the second moment are different types of standard static gestures, and a display picture is kept unchanged if the gesture mark 1 of the static gesture B1 at the first moment is different from a state flag bit; when the gesture of 'hand back' is recognized, the gesture mark '1' is recorded into a first queue as a first element, the gesture marks of the first queue reach a quantity threshold value, the first queue is [1,1], the first queue corresponds to a second static gesture sequence { hand back, hand back }, and at the moment, the static gesture B1 at the first moment and the static gesture B2 at the second moment are standard static gestures of the same type, and the display picture is kept unchanged.
The gesture action control display picture that the palm of the hand was upset to the back of the hand is slided and is shown, the gesture action that the palm of the hand was upset to the palm of the hand is as control display picture and slide up and show, when the user wants to control display picture continuous gliding, when accomplishing the gesture action of a palm of the hand upset to the back of the hand, need overturn the back of the hand to the palm of the hand in order to resume gesture initial position, but this gesture action of resume gesture initial position (the palm of the hand is upset to the palm of the hand) often can be triggered the display picture gliding operation by the mistake, lead to showing and slide up and show, the gesture operation can't accomplish control display picture continuous gliding, the gesture operation is difficult to realize continuous operation. In the embodiment, in the process of acquiring the gesture actions, the standard static gestures in the gesture actions are recognized to obtain a second static gesture sequence B; when the standard static gestures in the second static gesture sequence B are different types of standard static gestures, determining the transformation operation corresponding to the second static gesture sequence B; when the conversion operation is consistent with the target conversion operation, the display frame in the display interface is converted in response to the target conversion operation, the phenomenon that other operations are triggered by mistake when the original position of the gesture action is recovered is effectively avoided, the accuracy of controlling the display page can be improved, meanwhile, the continuous repeated execution of the target conversion operation is realized, and the flexibility of the gesture operation of a user is improved.
In one embodiment, as shown in fig. 5, a page display method includes:
step S502, displaying a first display picture;
step S504, in the process of acquiring the gesture actions, determining target transformation operation according to a first static gesture sequence in the gesture actions;
step S506, when the conversion operation corresponding to the second static gesture sequence in the gesture motion is consistent with the target conversion operation, acquiring a second display picture according to the gesture target conversion operation and the first display picture;
step S508, displaying the second display screen.
It can be understood that, according to the transformation operation corresponding to the second static gesture sequence B in the gesture motion and the specific limitation of the first display image to obtain the second display image, reference may be made to the above limitation on the display image control method, and details are not described here. In the process of acquiring the gesture actions, identifying standard static gestures in the gesture actions to acquire a second static gesture sequence B; when the standard static gestures in the second static gesture sequence B are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence; when the conversion operation is consistent with the target conversion operation, the display frame in the display interface is converted in response to the target conversion operation, the phenomenon that other operations are triggered by mistake when the original position of the gesture action is recovered is effectively avoided, the accuracy of controlling the display page can be improved, meanwhile, the continuous repeated execution of the target conversion operation is realized, and the flexibility of the gesture operation of a user is improved.
It should be understood that although the various steps in the flow chart of fig. 1 or 3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in fig. 1 or fig. 3 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a portion of the steps or stages in other steps.
In one embodiment, as shown in fig. 6, there is provided a control apparatus for displaying a screen, which may be a part of a computer device using a software module or a hardware module, or a combination of the two modules, and specifically includes: a gesture recognition module 602, an operation setting module 604, an operation acquisition module 606, and a page switching module 608, wherein:
the gesture recognition module 602 is configured to, in the process of acquiring a gesture motion, recognize a standard static gesture in the gesture motion, and acquire a first static gesture sequence, where the first static gesture sequence includes multiple standard static gestures that are continuously recognized;
an operation setting module 604, configured to determine, according to the first static gesture sequence, a target change operation of the display screen when the standard static gestures in the first static gesture sequence are standard static gestures of the same type, and obtain a second static gesture sequence; wherein the second static gesture sequence comprises at least two standard static gestures obtained by continuous recognition
An operation obtaining module 606, configured to determine, when a standard static gesture in the second static gesture sequence is a standard static gesture of a different type, a transformation operation corresponding to the second static gesture sequence;
and a page switching module 608, configured to respond to the target conversion operation and convert a display screen in a display interface when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation.
In an embodiment, the page switching module 608 is further configured to keep a display screen in the display interface unchanged when the transformation operation corresponding to the second static gesture sequence is inconsistent with the target transformation operation.
In one embodiment, the page switch module 608 is further configured to clear the second static gesture sequence and invoke the gesture recognition module 602 to perform the step of obtaining the second static gesture sequence.
In one embodiment, the gesture recognition module 602 is specifically configured to acquire a gesture image of the gesture motion at a first image acquisition frame rate; recognizing a standard static gesture in the gesture actions based on the gesture image, and acquiring a first static gesture sequence; adjusting an image acquisition frame rate, and acquiring a gesture image of the gesture action at a second image acquisition frame rate; recognizing a standard static gesture in the gesture action based on the gesture image to obtain a second static gesture sequence; wherein the second frame rate is greater than the first frame rate.
In one embodiment, the gesture recognition module 602 is further configured to adjust the image capturing frame rate to return to the step of acquiring the gesture image of the gesture motion at the first frame rate when the standard static gesture cannot be recognized based on the gesture image.
In one embodiment, the second static gesture sequence comprises a first moment static gesture and a second moment static gesture which are continuously recognized; an operation obtaining module 606, configured to determine, when the first-time static gesture and the second-time static gesture are different types of standard static gestures, a transformation operation corresponding to the second static gesture sequence according to the first-time static gesture and/or the second-time static gesture.
In one embodiment, the gesture recognition module 602 is specifically configured to recognize a static gesture in the gesture actions; when the static gesture is a standard static gesture, recording the static gesture into the second static gesture sequence; and returning to the step of identifying the static gesture in the gesture actions until the standard static gesture recorded in the second static gesture sequence reaches a quantity threshold value, so as to obtain a second static gesture sequence.
In one embodiment, the target transform operation comprises a screen slide operation; the page switching module 608 is specifically configured to respond to the screen sliding operation, and display the slid display screen in the display interface.
In one embodiment, the target transformation operation comprises a page turn operation; the page switching module 608 is specifically configured to respond to the screen page turning operation, and display the display screen after page turning in the display interface.
In one embodiment, the target transform operation comprises a screen rotation operation; the page switching module 608 is specifically configured to respond to the screen rotation operation, and display the rotated display screen in the display interface.
For specific limitations of the control device for the display screen, reference may be made to the above limitations of the control method for the display screen, which are not described herein again. All or part of the modules in the control device for displaying the picture can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 7. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a method of controlling a display. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the configuration shown in fig. 7 is a block diagram of only a portion of the configuration associated with the present application, and is not intended to limit the computing device to which the present application may be applied, and that a particular computing device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is further provided, which includes a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above method embodiments when executing the computer program.
In an embodiment, a computer-readable storage medium is provided, in which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (11)

1. A method of controlling a display, the method comprising:
in the process of acquiring the gesture actions, acquiring gesture images of the gesture actions at a first image acquisition frame rate, identifying standard static gestures in the gesture actions based on the gesture images, and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of continuously identified standard static gestures;
when the standard static gestures in the first static gesture sequence are standard static gestures of the same type, determining target transformation operation of a display picture according to the first static gesture sequence, adjusting an image acquisition frame rate, acquiring gesture images of the gesture actions at a second image acquisition frame rate, and identifying the standard static gestures in the gesture actions based on the gesture images to obtain a second static gesture sequence, wherein the second image acquisition frame rate is greater than the first image acquisition frame rate, and the second static gesture sequence comprises at least two continuously identified standard static gestures;
when a standard static gesture cannot be recognized based on the gesture image, adjusting the image acquisition frame rate, and returning to the step of acquiring the gesture image of the gesture action at the first image acquisition frame rate;
when the standard static gestures in the second static gesture sequence are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence;
and when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation, responding to the target conversion operation and converting a display picture in a display interface.
2. The method of claim 1, wherein after the determining a transformation operation corresponding to the second static gesture sequence, the method further comprises:
and when the conversion operation corresponding to the second static gesture sequence is inconsistent with the target conversion operation, keeping the display frame in the display interface unchanged.
3. The method of claim 1, wherein after the step of transforming the display in the display interface, the method further comprises: and clearing the second static gesture sequence, and returning to execute the step of acquiring the second static gesture sequence.
4. The method of claim 1, wherein the second static gesture sequence comprises a first-time static gesture and a second-time static gesture which are continuously recognized;
when the standard static gestures in the second static gesture sequence are different types of standard static gestures, the step of determining the transformation operation corresponding to the second static gesture sequence comprises:
and when the static gesture at the first moment and the static gesture at the second moment are different types of standard static gestures, determining a transformation operation corresponding to the second static gesture sequence according to the static gesture at the first moment and/or the static gesture at the second moment.
5. The method of claim 1, wherein the step of obtaining a second sequence of static gestures comprises:
identifying a static gesture in the gesture actions;
when the static gesture is a standard static gesture, recording the static gesture into the second static gesture sequence;
and returning to the step of identifying the static gesture in the gesture actions until the standard static gesture recorded in the second static gesture sequence reaches a quantity threshold value, so as to obtain a second static gesture sequence.
6. The method of claim 1, wherein the target transform operation comprises a screen slide operation;
the responding to the target transformation operation, transforming the display picture in the display interface, comprising:
and responding to the picture sliding operation, and displaying the display picture after sliding in a display interface.
7. The method of claim 1, wherein the target transformation operation comprises a page flip operation;
the responding to the target transformation operation, transforming the display picture in the display interface, comprising:
and responding to the picture page turning operation, and displaying the display picture after page turning in a display interface.
8. The method of claim 1, wherein the target transform operation comprises a screen rotation operation;
the responding to the target transformation operation, transforming the display picture in the display interface, comprising:
and displaying the rotated display picture in a display interface in response to the picture rotation operation.
9. A control apparatus for displaying a screen, the apparatus comprising:
the gesture recognition module is used for acquiring a gesture image of the gesture action at a first image acquisition frame rate in the process of acquiring the gesture action, recognizing a standard static gesture in the gesture action based on the gesture image, and acquiring a first static gesture sequence, wherein the first static gesture sequence comprises a plurality of standard static gestures which are continuously recognized;
the operation setting module is used for determining target conversion operation of a display picture according to the first static gesture sequence when the standard static gestures in the first static gesture sequence are standard static gestures of the same type, adjusting an image acquisition frame rate, acquiring gesture images of the gesture actions at a second image acquisition frame rate, recognizing the standard static gestures in the gesture actions based on the gesture images, and acquiring a second static gesture sequence, wherein the second image acquisition frame rate is greater than the first image acquisition frame rate, and the second static gesture sequence comprises at least two continuously recognized standard static gestures; when a standard static gesture cannot be recognized based on the gesture image, adjusting the image acquisition frame rate, and returning to the step of acquiring the gesture image of the gesture action at the first image acquisition frame rate;
the operation acquisition module is used for determining the transformation operation corresponding to the second static gesture sequence when the standard static gestures in the second static gesture sequence are different types of standard static gestures;
and the page switching module is used for responding to the target conversion operation and converting a display picture in a display interface when the conversion operation corresponding to the second static gesture sequence is consistent with the target conversion operation.
10. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 8 when executing the computer program.
11. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.
CN202010761968.1A 2020-07-31 2020-07-31 Display screen control method and device, computer equipment and storage medium Active CN111880660B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010761968.1A CN111880660B (en) 2020-07-31 2020-07-31 Display screen control method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010761968.1A CN111880660B (en) 2020-07-31 2020-07-31 Display screen control method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111880660A CN111880660A (en) 2020-11-03
CN111880660B true CN111880660B (en) 2022-10-21

Family

ID=73205562

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010761968.1A Active CN111880660B (en) 2020-07-31 2020-07-31 Display screen control method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111880660B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113422972B (en) * 2021-06-03 2023-04-07 五八到家有限公司 Live broadcast picture switching method and device, electronic equipment and readable medium
CN115421591B (en) * 2022-08-15 2024-03-15 珠海视熙科技有限公司 Gesture control device and image pickup apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013095677A1 (en) * 2011-12-23 2013-06-27 Intel Corporation Computing system utilizing three-dimensional manipulation command gestures
CN110837792A (en) * 2019-11-04 2020-02-25 东南大学 Three-dimensional gesture recognition method and device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012000263A1 (en) * 2012-01-10 2013-07-11 Daimler Ag A method and apparatus for operating functions in a vehicle using gestures executed in three-dimensional space and related computer program product
CN104281265B (en) * 2014-10-14 2017-06-16 京东方科技集团股份有限公司 A kind of control method of application program, device and electronic equipment
CN108196678A (en) * 2018-01-19 2018-06-22 昆山国显光电有限公司 Gesture operation method and the electronic equipment with gesture operation function
CN111352499B (en) * 2018-12-24 2022-08-23 中移（杭州）信息技术有限公司 Application control method, device, terminal equipment and medium
CN110716648B (en) * 2019-10-22 2021-08-24 上海商汤智能科技有限公司 Gesture control method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013095677A1 (en) * 2011-12-23 2013-06-27 Intel Corporation Computing system utilizing three-dimensional manipulation command gestures
CN110837792A (en) * 2019-11-04 2020-02-25 东南大学 Three-dimensional gesture recognition method and device

Also Published As

Publication number Publication date
CN111880660A (en) 2020-11-03

Similar Documents

Publication Publication Date Title
US11163426B2 (en) Interaction position determination method and system, storage medium and smart terminal
CN111787223B (en) Video shooting method and device and electronic equipment
CN111880660B (en) Display screen control method and device, computer equipment and storage medium
CN108616712B (en) Camera-based interface operation method, device, equipment and storage medium
CN110572575A (en) camera shooting control method and device
WO2021169720A1 (en) Content operation method and device, terminal, and storage medium
CN107707824B (en) Shooting method, shooting device, storage medium and electronic equipment
CN111656313A (en) Screen display switching method, display device and movable platform
CN112911147B (en) Display control method, display control device and electronic equipment
US20210127071A1 (en) Method, system and computer program product for object-initiated redaction of surveillance video
CN112333382B (en) Shooting method and device and electronic equipment
CN112486394A (en) Information processing method and device, electronic equipment and readable storage medium
CN112788244B (en) Shooting method, shooting device and electronic equipment
CN105094297A (en) Display content zooming method and display content zooming device
CN114125226A (en) Image shooting method and device, electronic equipment and readable storage medium
CN112437231A (en) Image shooting method and device, electronic equipment and storage medium
CN113079342A (en) Target tracking method and system based on high-resolution image device
CN110958360A (en) Picture sharing method, mobile terminal and computer readable storage medium
CN112529770B (en) Image processing method, device, electronic equipment and readable storage medium
US20220283698A1 (en) Method for operating an electronic device in order to browse through photos
CN113271379A (en) Image processing method and device and electronic equipment
CN111880707A (en) Long screenshot method, system, device, computer and storage medium
CN112286430A (en) Image processing method, apparatus, device and medium
CN111913636A (en) Image display processing method, device, equipment and computer readable storage medium
CN112748805B (en) Gesture control method, gesture control device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant