CN110162138B - Folding angle adjusting method and device and foldable terminal - Google Patents
Folding angle adjusting method and device and foldable terminal Download PDFInfo
- Publication number
- CN110162138B CN110162138B CN201910285768.0A CN201910285768A CN110162138B CN 110162138 B CN110162138 B CN 110162138B CN 201910285768 A CN201910285768 A CN 201910285768A CN 110162138 B CN110162138 B CN 110162138B
- Authority
- CN
- China
- Prior art keywords
- face
- folding angle
- foldable terminal
- image
- folding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1652—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being flexible, e.g. mimicking a sheet of paper, or rollable
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a folding angle adjusting method, a folding angle adjusting device and a foldable terminal, wherein the folding angle adjusting method comprises the following steps: responding to a camera of the foldable terminal to start image acquisition, and acquiring an image for face recognition from the image acquired by the camera; carrying out face recognition on the image for face recognition to obtain face information carried in the image for face recognition; and adjusting the folding angle of the folding screen of the foldable terminal according to the face information. In the embodiment of the invention, the folding angle of the folding screen of the foldable terminal can be automatically adjusted by acquiring the face information of the foldable terminal user in real time and based on the real-time face information, and the face information carried in the image acquired in real time can reflect the spatial position of the foldable terminal user relative to the foldable terminal to a great extent, so that the folding angle of the foldable screen can be accurately adjusted under the condition of no manual operation of the user, and the adjustment efficiency is improved.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a folding angle adjusting method and device and a foldable terminal.
Background
With the development of science and technology and the improvement of the application level of technology industrialization, the performance of the terminal is higher and higher, and the hardware configuration is more and more complete. Meanwhile, in order to make the appearance of the terminal more innovative and attractive, the foldable terminal with the flexible screen gradually enters the sight of people.
In the prior art, if the folding angle of the folding screen in the foldable terminal is to be adjusted, the user needs to manually operate the folding screen to adjust the folding angle, the operation is more complicated, the control is not easy to be performed, and the efficiency is lower.
Disclosure of Invention
The embodiment of the invention provides a folding angle adjusting method and device and a foldable terminal, and aims to solve the technical problems of complex folding angle adjusting operation and low efficiency in the prior art.
According to a first aspect of the present invention, a folding angle adjusting method is disclosed, which is applied to a foldable terminal, the method comprising:
responding to a camera of the foldable terminal to start image acquisition, and acquiring an image for face recognition from the image acquired by the camera;
performing face recognition on the image for face recognition to obtain face information carried in the image for face recognition, wherein the face information is used for reflecting the spatial position of a face relative to the foldable terminal;
and adjusting the folding angle of the folding screen of the foldable terminal according to the face information.
Optionally, as an embodiment, the performing face recognition on the image for face recognition to obtain face information carried in the image for face recognition includes:
determining whether a human face exists in the image for human face recognition through a preset human face detection model;
and if the image for face recognition has a face, determining a face region in the image for face recognition through the face detection model.
Optionally, as an embodiment, the adjusting a folding angle of a folding screen of the foldable terminal according to the face information includes:
determining a target folding angle according to the size information of the face area;
and adjusting the folding angle of the folding screen of the foldable terminal according to the target folding angle.
Optionally, as an embodiment, the determining a target folding angle according to the size information of the face region includes:
determining the equivalent circle diameter of the face area according to the size information of the face area;
and determining a target folding angle according to a mapping relation between a preset equivalent circle diameter and a folding angle and the equivalent circle diameter of the face area.
Optionally, as an embodiment, the mapping relationship between the equivalent circle diameter and the folding angle includes:
the term "Degree" refers to a folding angle, K to a folding coefficient, D to an equivalent circle diameter, and C to a correction coefficient.
Optionally, as an embodiment, the adjusting the folding angle of the folding screen of the foldable terminal according to the target folding angle includes:
determining whether the target folding angle is within a preset folding angle range of the foldable terminal;
if yes, controlling the folding screen to adjust to a target folding angle;
and if not, controlling the folding screen to adjust to the maximum folding angle in the folding angle range.
According to a second aspect of the present invention, there is disclosed a folding angle adjusting apparatus applied to a foldable terminal, the apparatus comprising:
the image acquisition module is used for responding to the opening of image acquisition of a camera of the foldable terminal and acquiring an image for face recognition from the image acquired by the camera;
the face recognition module is used for carrying out face recognition on the image for face recognition to obtain face information carried in the image for face recognition, wherein the face information is used for reflecting the spatial position of a face relative to the foldable terminal;
and the angle adjusting module is used for adjusting the folding angle of the folding screen of the foldable terminal according to the face information.
Optionally, as an embodiment, the face recognition module includes:
the first determining submodule is used for determining whether a human face exists in the image for human face recognition or not through a preset human face detection model;
and the second determining sub-module is used for determining the face area in the image for face recognition through the face detection model under the condition that the determination result of the first determining sub-module is positive.
Optionally, as an embodiment, the angle adjusting module includes:
the third determining submodule is used for determining a target folding angle according to the size information of the face area;
and the folding angle adjusting submodule is used for adjusting the folding angle of the folding screen of the foldable terminal according to the target folding angle.
Optionally, as an embodiment, the third determining sub-module includes:
the equivalent circle diameter determining unit is used for determining the equivalent circle diameter of the face area according to the size information of the face area;
and the folding angle determining unit is used for determining a target folding angle according to a mapping relation between a preset equivalent circle diameter and a folding angle and the equivalent circle diameter of the face area.
Optionally, as an embodiment, the mapping relationship between the equivalent circle diameter and the folding angle includes:
the term "fold angle" refers to the angle of folding, the equivalent circle diameter refers to the diameter of the fold, K refers to the folding coefficient, and C refers to the correction coefficient.
Optionally, as an embodiment, the folding angle adjusting sub-module includes:
an angle range determining unit for determining whether the target folding angle is within a preset folding angle range of the foldable terminal;
a first control unit, configured to control the folding screen to adjust to a target folding angle if the determination result of the angle range determination unit is yes;
and the second control unit is used for controlling the folding screen to be adjusted to the maximum folding angle in the folding angle range under the condition that the determination result of the angle range determination unit is negative.
According to a third aspect of the present invention, there is disclosed a foldable terminal comprising: a memory, a processor and a program stored on the memory and executable on the processor, the program implementing the steps of the folding angle adjustment method as described above when executed by the processor.
Optionally, as an embodiment, the foldable terminal further includes:
a screen and a camera.
According to a fourth aspect of the present invention, a computer-readable storage medium is disclosed, on which a program is stored, which when executed by a processor implements the steps in the folding angle adjusting method as described above.
In the embodiment of the invention, the folding angle of the folding screen of the foldable terminal can be automatically adjusted by acquiring the face information of the foldable terminal user in real time and based on the real-time face information, and the face information carried in the image acquired in real time can reflect the spatial position of the foldable terminal user relative to the foldable terminal to a great extent, so that the folding angle of the foldable screen can be accurately adjusted under the condition of no manual operation of the user, and the adjustment efficiency is improved.
Drawings
FIG. 1 is a flow chart of a method of folding angle adjustment according to an embodiment of the present invention;
FIG. 2 is a diagram of a method for adjusting a folding angle according to an embodiment of the present invention;
FIG. 3 is a flow chart of a folding angle adjustment method according to another embodiment of the present invention;
FIG. 4 is an exemplary diagram of a face region of one embodiment of the invention;
fig. 5 is a schematic structural view of a foldable terminal according to an embodiment of the present invention;
fig. 6 is a schematic structural view of a folding angle adjusting apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
With the increasingly competitive terminal market, the terminal manufacturers have focused on the differentiated function planning, design and marketing of products, and under the circumstance that the terminal manufacturers simply rely on hardware configuration and cannot attract more electronic consumers. At present, when the folding angle of a folding screen in a foldable terminal is adjusted, a user needs to manually adjust the folding angle, the operation is complex, the control is not easy to perform, and the efficiency is low.
In order to solve the technical problem, embodiments of the present invention provide a method and an apparatus for adjusting a folding angle, and a foldable terminal.
First, a method for adjusting a folding angle according to an embodiment of the present invention will be described.
It should be noted that, the method provided by the embodiment of the present invention is applicable to a foldable terminal, and in practical application, the foldable terminal may include: the invention further provides a foldable mobile phone, a foldable tablet computer, a foldable television and the like.
Fig. 1 is a flowchart of a folding angle adjusting method according to an embodiment of the present invention, which may include the following steps, as shown in fig. 1: step 101, step 102 and step 103, wherein,
in step 101, in response to the camera of the foldable terminal turning on image capture, an image for face recognition is obtained from the image captured by the camera.
In the embodiment of the invention, in an application scene, a user can select whether to start the automatic adjusting function of the folding screen, for example, the user clicks a certain button or icon to start/close the automatic adjusting function of the folding screen, and when the user selects to start the automatic adjusting function of the folding screen, the camera of the foldable terminal starts image acquisition; and when the user selects to close the automatic adjusting function of the folding screen, the camera of the foldable terminal stops image acquisition.
In an embodiment of the present invention, in another application scenario, an automatic adjustment function for automatically opening a foldable screen when a setting condition is met may be set, where the setting condition may include: terminal power on, a certain period of time, etc.
In the embodiment of the present invention, the "camera of the foldable terminal" may be a camera preset in the factory of the foldable terminal, or may be a camera in wired connection or wireless connection with the foldable terminal.
In the embodiment of the invention, one or more images can be acquired by the camera, and when the image acquired by the camera is one, the image is directly used as an image for face recognition. When the number of the images collected by the camera is multiple, one or more images can be selected from the multiple collected images to serve as images for face recognition; specifically, the number of images may be selected according to the computing capability of the foldable terminal, and optionally, when the computing capability of the foldable terminal is higher, a plurality of images are selected from the plurality of collected images as the images for face recognition, and when the computing capability of the foldable terminal is lower, an image is selected from the plurality of collected images as the images for face recognition. For example, one or more images with higher image quality (e.g., higher definition, lower degree of face occlusion, and/or smaller face deflection angle, etc.) can be selected from the acquired multiple images as the image for face recognition.
In step 102, performing face recognition on the image for face recognition to obtain face information carried in the image for face recognition, wherein the face information is used for reflecting a spatial position of a face relative to the foldable terminal.
In the embodiment of the invention, when one image is used for face recognition, the face recognition is directly carried out on the image to obtain a group of face information; when the number of the images used for face recognition is multiple, face recognition is carried out on each image in the multiple images to obtain multiple groups of face information.
In the embodiment of the invention, a face detection model can be created in advance through a large number of samples, and the face detection model created in advance is used for carrying out face recognition on the image for face recognition; any face recognition algorithm (for example, a template matching algorithm) in the related art may also be used to perform face recognition on the image for face recognition, which is not limited by the embodiment of the present invention.
In the embodiment of the present invention, the spatial position of the face with respect to the foldable terminal may include: the distance from the face (user) to the foldable terminal, the angle of the face with respect to the foldable terminal, etc.
In step 103, the folding angle of the folding screen of the foldable terminal is adjusted according to the face information.
In the embodiment of the invention, when one image is used for face recognition, the folding angle of the folding screen of the foldable terminal is adjusted based on a group of face information; and when the number of the images for face recognition is multiple, adjusting the folding angle of the folding screen of the foldable terminal based on multiple groups of face information.
Considering that when the distance between the user and the foldable terminal is small, the visual angle of the user is small, and the foldable screen of the foldable terminal is not folded, so that the user can watch the content displayed on the foldable screen conveniently; when the distance between the user and the foldable terminal is large, the visual angle of the user is large, the foldable screen of the foldable terminal is folded, the influence on the content displayed on the foldable screen watched by the user is small, and the face information can reflect the spatial position (including the distance and the like) of the face relative to the foldable terminal to a great extent; therefore, in the embodiment of the invention, the folding angle of the folding screen of the foldable terminal is adjusted according to the face information, so that the folding angle of the folding screen can be accurately adjusted.
For convenience of understanding, the technical solution provided by the embodiment of the present invention is described with reference to the application scenario diagram shown in fig. 2. As shown in fig. 2, when the user 21 is at a distance of 1 meter from the foldable terminal 20, the folded screen of the foldable terminal 20 is not folded; a slight folding of the folding screen of the foldable terminal 20 when the user 21 is at a distance of 2 meters from the foldable terminal 20; when the user 21 is at a distance of 3 meters from the foldable terminal 20, the folding screen of the foldable terminal 20 is further folded.
It can be seen from the above embodiments that, in this embodiment, the folding angle of the folding screen of the foldable terminal can be automatically adjusted based on real-time face information by acquiring the face information of the foldable terminal user in real time, and the face information carried in the image acquired in real time can reflect the spatial position of the foldable terminal user relative to the foldable terminal to a great extent, so that the folding angle of the foldable screen can be adjusted relatively accurately without manual operation of the user, and the adjustment efficiency is improved.
Fig. 3 is a flowchart of a folding angle adjusting method according to another embodiment of the present invention, in the embodiment of the present invention, a face detection model may be created in advance, and the face detection model created in advance is used to perform face recognition on an image for face recognition, so as to improve the efficiency of face recognition, at this time, as shown in fig. 3, the method may include the following steps: step 301, step 302, step 303, step 304 and step 305, wherein,
in step 301, in response to the camera of the foldable terminal turning on image capture, an image for face recognition is obtained from the image captured by the camera.
In the embodiment of the invention, in an application scene, a user can select whether to start the automatic adjusting function of the folding screen, and when the user selects to start the automatic adjusting function of the folding screen, a camera of the foldable terminal starts image acquisition; and when the user selects to close the automatic adjusting function of the folding screen, the camera of the foldable terminal stops image acquisition.
In an embodiment of the present invention, in another application scenario, an automatic adjustment function for automatically opening a foldable screen when a setting condition is met may be set, where the setting condition may include: terminal power on, a certain period of time, etc.
In the embodiment of the present invention, the "camera of the foldable terminal" may be a camera preset in the factory of the foldable terminal, or may be a camera in wired connection or wireless connection with the foldable terminal.
In the embodiment of the invention, one or more images can be acquired by the camera, and when the image acquired by the camera is one, the image is directly used as an image for face recognition. When the number of the images collected by the camera is multiple, one or more images can be selected from the multiple collected images to serve as images for face recognition; specifically, the number of images may be selected according to the computing capability of the foldable terminal, and optionally, when the computing capability of the foldable terminal is higher, a plurality of images are selected from the plurality of collected images as the images for face recognition, and when the computing capability of the foldable terminal is lower, an image is selected from the plurality of collected images as the images for face recognition. For example, one or more images with higher image quality (e.g., higher definition, lower degree of face occlusion, and/or smaller face deflection angle, etc.) can be selected from the acquired multiple images as the image for face recognition.
In step 302, it is determined whether a face exists in an image for face recognition through a preset face detection model, if so, step 303 is performed, otherwise, no processing is performed.
In the embodiment of the present invention, before the step 302, the following steps (not shown in the figure) for constructing a face detection model may be further included: step 3001, step 3002, step 3003 and step 3004, wherein,
in step 3001, collecting a preset number of face image samples;
in the embodiment of the invention, the more the selected sample data is, the more accurate and reliable the training result is, so that the method can preferably select to collect a large number of face image samples, for example, collect 10 ten thousand face images as the face image samples.
In step 3002, performing face key point labeling on the face image sample to obtain a labeled face image;
in the embodiment of the present invention, the face key points include but are not limited to: face contour points, eye contour points, nose contour points, eyebrow contour points, forehead contour points, upper lip contour points, and lower lip contour points.
In the embodiment of the invention, in order to ensure the accuracy of the training result, the face key points of the face image sample can be accurately labeled, namely the accuracy of the input data of model training is ensured. In the embodiment of the present invention, any labeling method in the related art may be adopted to label the face key points of the face image sample.
In step 3003, dividing the labeled face image into a training set, a verification set and a test set;
in the embodiment of the invention, the training set is used as initial data of model training, the verification set is used for verifying and correcting the model obtained by training the training set, the test set is used for testing the model obtained by final training and measuring the performance and accuracy of the model, if the test is passed, the model can be used for subsequent face recognition, and if the test is not passed, the model training is carried out again.
In step 3004, performing model training on the training set by using a preset model training algorithm, and verifying the intermediate model in the model training process by using the verification set until the matching degree between the verification result and the labeling result of the verification set reaches a preset threshold, and stopping the model training to obtain a training model; and testing the training model by adopting the test set, and if the test is passed, taking the training model as a face detection model.
In the embodiment of the present invention, a machine learning related algorithm, for example, a neural network algorithm, a logistic regression algorithm, or the like, may be used to perform model training on the training set.
In the embodiment of the invention, the training model is tested by adopting the test set, and if the test fails, the model training is carried out again.
Therefore, in the embodiment of the invention, the face detection model is used for carrying out face detection on the image for face recognition, and the face detection model is obtained by training and correcting a large number of face image samples, so that the face detection can be carried out more accurately.
In the embodiment of the invention, if the image for face recognition does not have a face, the image is not processed any more, and the image is continuously collected by the camera, and the subsequent image for face recognition is selected from the images; if a face exists in the image for face recognition, a face region is further determined.
In step 303, a face region in the image for face recognition is determined by the face detection model.
In the embodiment of the invention, the face area is an area covering key points of the face. The shape of the face region may be a rectangle, or may be other shapes, such as a hexagonal region, an ellipse, a circle, and the like.
For ease of understanding, as shown in fig. 4, the image area 41 is an image for face recognition, the image area 42 is a face in the image for face recognition, and the image area 43 is a face area in the image for face recognition.
In step 304, a target folding angle is determined according to the size information of the face region.
In the embodiment of the present invention, for convenience of understanding, the description is given by taking the shape of the face region as a rectangle as an example, and at this time, the size information of the face region may include: width and length of the face region.
In the embodiment of the present invention, in consideration that, when a face is inclined at an angle relative to a foldable terminal, a target folding angle cannot be accurately determined only according to a length of a face region, and a target folding angle cannot be accurately determined only according to a width of the face region, in order to overcome this problem, a diameter of an equivalent circle of the face region may be calculated according to the size of the face region, and a target folding angle may be determined according to the diameter of the equivalent circle, even if the angle problem of the face may be directly overcome by using the equivalent circle of the face region, at this time, the step 304 may specifically include the following steps (not shown in the figure): step 3041 and step 3042, wherein,
in step 3041, determining an equivalent circle diameter of the face region according to the size information of the face region;
in one example, the length of the face region is H and the width of the face region is W, the area S of the face region is first calculated as H × W, and then the diameter of the equivalent circle is calculated
In the embodiment of the invention, when the image for face recognition is one, an equivalent circle diameter can be determined according to the size information of the face area in the image, and the equivalent circle diameter is used for determining the target folding angle; when the number of the images for face recognition is multiple, the equivalent circle diameters corresponding to the face areas in each image are calculated respectively, weighted average operation is carried out on the calculated equivalent circle diameters, and the equivalent circle diameters obtained through weighted average are used for determining the target folding angle.
In step 3042, a target folding angle is determined according to a mapping relationship between a preset equivalent circle diameter and a folding angle, and an equivalent circle diameter of the face area.
In the embodiment of the invention, the mapping relation between the equivalent circle diameter and the folding angle can be a linear relation or a nonlinear relation.
In the embodiment of the present invention, when the mapping relationship between the equivalent circle diameter and the folding angle is a linear relationship, the mapping relationship may be: the term "Degree" refers to a folding angle, K to a folding coefficient, D to an equivalent circle diameter, and C to a correction coefficient. In practical applications, C may be 0 or other values.
In the embodiment of the present invention, the folding coefficient may be set by a developer according to experimental data, or may be calculated by a certain algorithm, which is not limited in the embodiment of the present invention.
In the embodiment of the invention, the target folding angle is as follows: a folding angle with respect to an original state of the foldable terminal.
In step 305, the folding angle of the folding screen of the foldable terminal is adjusted according to the target folding angle.
In the embodiment of the present invention, considering that the foldable terminal generally has an extreme folding angle, i.e. the terminal is not folded without limitation, and if the extreme folding angle of the foldable terminal is exceeded, the foldable terminal may be damaged, in order to overcome the problem, the step 305 may specifically include the following steps (not shown in the figure): step 3051, step 3052 and step 3053, wherein,
in step 3051, determining whether the target folding angle is within a preset folding angle range of the foldable terminal;
in the embodiment of the present invention, the folding angle range of the foldable terminal is (the minimum folding angle of the foldable terminal to the maximum folding angle of the foldable terminal).
In step 3052, controlling the folding screen to adjust to the target folding angle when the target folding angle is within a preset folding angle range of the foldable terminal;
in step 3053, in case that the target folding angle is not within the preset folding angle range of the foldable terminal, controlling the folding screen to adjust to a maximum folding angle in the folding angle range.
Therefore, in the embodiment of the present invention, when adjusting the folding angle of the folding screen, it may be determined whether the folding angle to be adjusted is within the folding range of the foldable terminal, if so, the folding angle is adjusted to the corresponding folding angle, and if not, the folding angle is adjusted to the maximum folding angle of the foldable terminal, so as to avoid the damage of the foldable terminal.
It can be seen from the above embodiments that, in this embodiment, the folding angle of the folding screen of the foldable terminal can be automatically adjusted based on real-time face information by acquiring the face information of the foldable terminal user in real time, and the face information carried in the image acquired in real time can reflect the spatial position of the foldable terminal user relative to the foldable terminal to a great extent, so that the folding angle of the foldable screen can be adjusted relatively accurately without manual operation of the user, and the adjustment efficiency is improved.
In order to facilitate understanding of the technical solution of the present invention, a process of automatically adjusting a folding angle is described with reference to a specific structure diagram of a foldable terminal, and fig. 5 illustrates a structure diagram of a foldable terminal according to an embodiment of the present invention, and as shown in fig. 5, the foldable terminal 500 may include: the system comprises a processor 501, a screen 502, a memory 503, a folding control module 504 and a camera (not shown in the figure), wherein the screen 502 is a flexible screen, and the folding control module 504 comprises a face detection module 5041 and a folding drive module 5042.
In one scenario, the user turns on the foldable screen automatic adjustment function based on face detection (e.g., clicks a certain button or icon), the processor 501 loads a foldable screen adjustment default parameter table from the memory 503, wherein the folding angle range, the folding angle adjustment coefficient, and the like of the foldable screen may be recorded in the default parameter table.
Meanwhile, the processor 501 instructs the camera to start image acquisition, the processor 501 selects an image for face recognition from the image acquired by the camera, and instructs the face detection module 5041 to perform face detection on the image and determine a face region in the image, the processor 501 calculates an equivalent circle diameter according to face region information returned by the face detection module 5041, calculates a target folding angle according to the equivalent circle diameter, and instructs the folding driving module 5042 to drive the screen 502 to automatically adjust the folding angle after calculating the target folding angle.
It should be noted that the structure diagram of the foldable terminal shown in fig. 5 is only an exemplary structure diagram, the structure of the foldable terminal in the embodiment of the present invention is not limited to this structure, and other structures capable of implementing the method in the embodiment of the present invention are also within the protection scope of the embodiment of the present invention.
Fig. 6 is a schematic structural view of a folding angle adjusting apparatus according to an embodiment of the present invention, which is applied to a foldable terminal, and as shown in fig. 6, the folding angle adjusting apparatus 600 may include: an image acquisition module 601, a face recognition module 602, and an angle adjustment module 603, wherein,
the image acquisition module 601 is configured to respond to a camera of the foldable terminal to start image acquisition, and acquire an image for face recognition from an image acquired by the camera;
a face recognition module 602, configured to perform face recognition on the image for face recognition to obtain face information carried in the image for face recognition, where the face information is used to reflect a spatial position of a face relative to the foldable terminal;
and an angle adjusting module 603, configured to adjust a folding angle of the folding screen of the foldable terminal according to the face information.
It can be seen from the above embodiments that, in this embodiment, the folding angle of the folding screen of the foldable terminal can be automatically adjusted based on real-time face information by acquiring the face information of the foldable terminal user in real time, and the face information carried in the image acquired in real time can reflect the spatial position of the foldable terminal user relative to the foldable terminal to a great extent, so that the folding angle of the foldable screen can be adjusted relatively accurately without manual operation of the user, and the adjustment efficiency is improved.
Optionally, as an embodiment, the face recognition module 602 may include:
the first determining submodule is used for determining whether a human face exists in the image for human face recognition or not through a preset human face detection model;
and the second determining sub-module is used for determining the face area in the image for face recognition through the face detection model under the condition that the determination result of the first determining sub-module is positive.
Optionally, as an embodiment, the angle adjusting module 603 may include:
the third determining submodule is used for determining a target folding angle according to the size information of the face area;
and the folding angle adjusting submodule is used for adjusting the folding angle of the folding screen of the foldable terminal according to the target folding angle.
Optionally, as an embodiment, the third determining sub-module may include:
the equivalent circle diameter determining unit is used for determining the equivalent circle diameter of the face area according to the size information of the face area;
and the folding angle determining unit is used for determining a target folding angle according to a mapping relation between a preset equivalent circle diameter and a folding angle and the equivalent circle diameter of the face area.
Optionally, as an embodiment, the mapping relationship between the equivalent circle diameter and the folding angle includes:
the term "fold angle" refers to the angle of folding, the equivalent circle diameter refers to the diameter of the fold, K refers to the folding coefficient, and C refers to the correction coefficient.
Optionally, as an embodiment, the folding angle adjusting sub-module may include:
an angle range determining unit for determining whether the target folding angle is within a preset folding angle range of the foldable terminal;
a first control unit, configured to control the folding screen to adjust to a target folding angle if the determination result of the angle range determination unit is yes;
and the second control unit is used for controlling the folding screen to be adjusted to the maximum folding angle in the folding angle range under the condition that the determination result of the angle range determination unit is negative.
Therefore, in the embodiment of the present invention, when adjusting the folding angle of the folding screen, it may be determined whether the folding angle to be adjusted is within the folding range of the foldable terminal, if so, the folding angle is adjusted to the corresponding folding angle, and if not, the folding angle is adjusted to the maximum folding angle, so as to avoid the damage of the foldable terminal.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
According to still another embodiment of the present invention, there is also provided a foldable terminal including: a memory, a processor and a program stored on the memory and executable on the processor, the program implementing the steps of the folding angle adjusting method according to any one of the above embodiments when executed by the processor.
Optionally, in an embodiment, the foldable terminal further includes:
a screen and a camera.
According to still another embodiment of the present invention, there is also provided a computer-readable storage medium having a program stored thereon, the program implementing the steps in the folding angle adjusting method according to any one of the above-mentioned embodiments when executed by a processor.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method, the device and the foldable terminal for adjusting the folding angle provided by the invention are described in detail, and the principle and the implementation mode of the invention are explained by applying specific examples, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A folding angle adjusting method applied to a foldable terminal, the method comprising:
responding to a camera of the foldable terminal to start image acquisition, and acquiring an image for face recognition from the image acquired by the camera;
performing face recognition on the image for face recognition to obtain face information carried in the image for face recognition, wherein the face information is used for reflecting the spatial position of a face relative to the foldable terminal; wherein the spatial position comprises at least a distance of a user to the foldable terminal;
according to the face information, the folding angle of the folding screen of the foldable terminal is adjusted, and the method comprises the following steps: determining an equivalent circle diameter according to the size information of the face area in the image, wherein the equivalent circle diameter is used for determining a target folding angle of the folding screen;
when the distance between the user and the foldable terminal is small, the foldable screen of the foldable terminal is not folded, and when the distance between the user and the foldable terminal is large, the foldable screen of the foldable terminal is folded.
2. The method according to claim 1, wherein the performing face recognition on the image for face recognition to obtain face information carried in the image for face recognition comprises:
determining whether a human face exists in the image for human face recognition through a preset human face detection model;
and if the image for face recognition has a face, determining a face region in the image for face recognition through the face detection model.
3. The method according to claim 2, wherein the adjusting the folding angle of the folding screen of the foldable terminal according to the face information comprises:
determining a target folding angle according to the size information of the face area;
and adjusting the folding angle of the folding screen of the foldable terminal according to the target folding angle.
4. The method according to claim 3, wherein the determining a target folding angle according to the size information of the face region comprises:
determining the equivalent circle diameter of the face area according to the size information of the face area;
and determining a target folding angle according to a mapping relation between a preset equivalent circle diameter and a folding angle and the equivalent circle diameter of the face area.
5. The method of claim 4, wherein the mapping between equivalent circle diameter and fold angle comprises:
the term "Degree" refers to a folding angle, K to a folding coefficient, D to an equivalent circle diameter, and C to a correction coefficient.
6. The method according to claim 3, wherein the adjusting the folding angle of the folding screen of the foldable terminal according to the target folding angle comprises:
determining whether the target folding angle is within a preset folding angle range of the foldable terminal;
if yes, controlling the folding screen to adjust to a target folding angle;
and if not, controlling the folding screen to adjust to the maximum folding angle in the folding angle range.
7. A folding angle adjusting apparatus applied to a foldable terminal, the apparatus comprising:
the image acquisition module is used for responding to the opening of image acquisition of a camera of the foldable terminal and acquiring an image for face recognition from the image acquired by the camera;
the face recognition module is used for carrying out face recognition on the image for face recognition to obtain face information carried in the image for face recognition, wherein the face information is used for reflecting the spatial position of a face relative to the foldable terminal; wherein the spatial position comprises at least a distance of a user to the foldable terminal;
the angle adjusting module is used for adjusting the folding angle of the folding screen of the foldable terminal according to the face information, and comprises: determining an equivalent circle diameter according to the size information of the face area in the image, wherein the equivalent circle diameter is used for determining a target folding angle of the folding screen;
when the distance between the user and the foldable terminal is small, the foldable screen of the foldable terminal is not folded, and when the distance between the user and the foldable terminal is large, the foldable screen of the foldable terminal is folded.
8. A foldable terminal, comprising: memory, processor and program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the folding angle adjustment method according to any one of claims 1 to 6.
9. The foldable terminal according to claim 8, characterized in that the foldable terminal further comprises:
a screen and a camera.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a program which, when being executed by a processor, realizes the steps in the folding angle adjustment method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910285768.0A CN110162138B (en) | 2019-04-10 | 2019-04-10 | Folding angle adjusting method and device and foldable terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910285768.0A CN110162138B (en) | 2019-04-10 | 2019-04-10 | Folding angle adjusting method and device and foldable terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110162138A CN110162138A (en) | 2019-08-23 |
| CN110162138B true CN110162138B (en) | 2021-05-28 |
Family
ID=67639353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910285768.0A Active CN110162138B (en) | 2019-04-10 | 2019-04-10 | Folding angle adjusting method and device and foldable terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110162138B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110826414A (en) * | 2019-10-10 | 2020-02-21 | 珠海格力电器股份有限公司 | Display control method and device of mobile terminal, terminal and medium |
| CN111738043A (en) * | 2019-12-10 | 2020-10-02 | 珠海大横琴科技发展有限公司 | Pedestrian re-identification method and device |
| CN111124235B (en) * | 2019-12-31 | 2021-06-29 | 维沃移动通信有限公司 | Screen control method and flexible electronic equipment |
| CN111240567B (en) * | 2020-01-08 | 2021-03-26 | 维沃移动通信有限公司 | Display screen angle adjusting method and electronic equipment |
| CN113852721B (en) * | 2020-06-10 | 2023-01-10 | Oppo广东移动通信有限公司 | Device control method, device, storage medium and electronic device |
| CN111880873A (en) * | 2020-07-10 | 2020-11-03 | 北京小米移动软件有限公司 | Display processing method and device and computer storage medium |
| CN112135153A (en) * | 2020-08-24 | 2020-12-25 | 珠海格力电器股份有限公司 | Display device, control method and device thereof, and computer readable medium |
| CN111967431A (en) * | 2020-08-31 | 2020-11-20 | 珠海研果科技有限公司 | Angle correction method and device |
| CN113313758A (en) * | 2021-05-28 | 2021-08-27 | 维沃移动通信有限公司 | Folding angle calculation method and device, electronic equipment and storage medium |
| CN114333030A (en) * | 2021-12-31 | 2022-04-12 | 科大讯飞股份有限公司 | Image processing method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105138303A (en) * | 2015-09-14 | 2015-12-09 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN107948430A (en) * | 2017-11-29 | 2018-04-20 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer-readable recording medium |
| CN109194793A (en) * | 2018-10-29 | 2019-01-11 | 维沃移动通信有限公司 | A kind of screen adjustment method and mobile terminal |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102127926B1 (en) * | 2013-05-31 | 2020-06-29 | 엘지전자 주식회사 | Image display device and control method thereof |
| KR101632008B1 (en) * | 2014-04-30 | 2016-07-01 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
| CN108037845B (en) * | 2017-11-30 | 2021-07-23 | 努比亚技术有限公司 | Display control method, mobile terminal and computer-readable storage medium |
| CN107958234A (en) * | 2017-12-26 | 2018-04-24 | 深圳云天励飞技术有限公司 | Client-based face identification method, device, client and storage medium |
| CN109240504A (en) * | 2018-09-25 | 2019-01-18 | 北京旷视科技有限公司 | Control method, model training method, device and electronic equipment |
-
2019
- 2019-04-10 CN CN201910285768.0A patent/CN110162138B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105138303A (en) * | 2015-09-14 | 2015-12-09 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN107948430A (en) * | 2017-11-29 | 2018-04-20 | 努比亚技术有限公司 | A kind of display control method, mobile terminal and computer-readable recording medium |
| CN109194793A (en) * | 2018-10-29 | 2019-01-11 | 维沃移动通信有限公司 | A kind of screen adjustment method and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110162138A (en) | 2019-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110162138B (en) | Folding angle adjusting method and device and foldable terminal | |
| TWI709091B (en) | Image processing method and device | |
| CN101520842B (en) | Information processing apparatus, eye open/closed degree determination method and image sensing apparatus | |
| US9639758B2 (en) | Method and apparatus for processing image | |
| US9962093B2 (en) | Detecting oral temperature using thermal camera | |
| KR20170134256A (en) | Method and apparatus for correcting face shape | |
| CN103793719A (en) | Monocular distance-measuring method and system based on human eye positioning | |
| CN109685713B (en) | Cosmetic simulation control method, device, computer equipment and storage medium | |
| CN109120854B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN106295533A (en) | Optimization method, device and the camera terminal of a kind of image of autodyning | |
| CN102436590A (en) | Real-time tracking method based on on-line learning and tracking system thereof | |
| CN109451240B (en) | Focusing method, focusing device, computer equipment and readable storage medium | |
| CN114098636B (en) | Human health state management method, system and electronic equipment | |
| JP7322097B2 (en) | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, PROGRAM AND RECORDING MEDIUM | |
| CN106031148A (en) | Imaging device and method for automatic focus in an imaging device as well as a corresponding computer program | |
| RU2667790C1 (en) | Method of automatic adjustment of exposition for infrared camera and user computer device using this method | |
| CN112560649A (en) | Behavior action detection method, system, equipment and medium | |
| US20200210687A1 (en) | Face recognition device, face recognition method, and computer readable storage medium | |
| CN104252828A (en) | Vision-protective display method, vision-protective display device and terminal equipment | |
| CN108875506B (en) | Face shape point tracking method, device and system and storage medium | |
| WO2019230724A1 (en) | Image processing system, imaging device, image processing device, electronic device, control method thereof, and storage medium storing control method thereof | |
| CN108780568A (en) | A kind of image processing method, device and aircraft | |
| CN107169093B (en) | target image acquisition method and device | |
| WO2015096824A1 (en) | Analysis device and analysis method | |
| CN112116068A (en) | Annular image splicing method, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |