CN106371552B - Control method and device for media display at mobile terminal - Google Patents
Control method and device for media display at mobile terminal Download PDFInfo
- Publication number
- CN106371552B CN106371552B CN201510433741.3A CN201510433741A CN106371552B CN 106371552 B CN106371552 B CN 106371552B CN 201510433741 A CN201510433741 A CN 201510433741A CN 106371552 B CN106371552 B CN 106371552B
- Authority
- CN
- China
- Prior art keywords
- value
- offset
- current
- deviation
- correction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 238000012937 correction Methods 0.000 claims abstract description 102
- 238000012545 processing Methods 0.000 claims abstract description 17
- 230000006870 function Effects 0.000 claims description 21
- 230000001133 acceleration Effects 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 9
- 230000003044 adaptive effect Effects 0.000 claims 2
- 230000008569 process Effects 0.000 abstract description 4
- 230000004048 modification Effects 0.000 description 11
- 238000012986 modification Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 4
- 230000001815 facial effect Effects 0.000 description 3
- 208000002173 dizziness Diseases 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a media display control method and a device, wherein the method comprises the following steps: detecting a current face of a user; identifying a current face reference point of the current face; at least obtaining a position deviation value of the current face reference point relative to the previous face reference point, and determining a correction deviation value of a media display interface for displaying the current media content on a display screen of the mobile terminal based on the position deviation value; and performing offset correction on the current media content according to the corrected offset value. The technical scheme provided by the invention can improve the jitter problem of the media content relative to eyes in the moving and bumping process, improve the developability of the media content and enhance the processing function of the handheld device.
Description
Technical Field
The present invention relates to media display technologies, and in particular, to a method and an apparatus for controlling media display in a mobile terminal.
Background
With the wide application of various handheld devices such as smartphones, ipads, electronic book readers, and MP4, more and more people can watch media contents such as videos, pictures, or characters during daily walking or sitting in a car. However, sometimes, in the case of car jolting or fast walking, the media content to be watched shakes relative to the eyes, that is, during the process of moving jolting, the hands of the user hardly keep the handheld device in a state of being relatively still with the eyes, so that the user may feel dizzy and uncomfortable after seeing for a long time.
Disclosure of Invention
In view of the above, embodiments of the present invention provide a method for controlling media display in a mobile terminal, and provide a device for controlling media display in a mobile terminal, so as to improve jitter of media content relative to eyes during a bumpy movement process, improve the displayability of the media content, and enhance the processing function of a handheld device.
The control method for media display at a mobile terminal provided by the embodiment of the invention comprises the following steps:
detecting a current face of a user;
identifying a current face reference point of the current face;
at least obtaining a position deviation value of the current face reference point relative to the previous face reference point, and determining a correction deviation value of a media display interface for displaying the current media content on a display screen of the mobile terminal based on the position deviation value;
and performing offset correction on the current media content according to the corrected offset value.
The control device for media display in the mobile terminal provided by the embodiment of the invention comprises:
the face image detection module is used for detecting the current face of the user;
the face reference point determining module is used for identifying the current face reference point of the current face;
the offset value determining module is used for at least acquiring the position offset value of the current face reference point relative to the previous face reference point;
the correction value determining module is used for determining a correction offset value of a media display interface used for displaying the current media content on a display screen of the mobile terminal based on the position offset value; and
and the offset correction module is used for carrying out offset correction on the current media content according to the corrected offset value.
Therefore, in the embodiment of the invention, whether the eyes of the user have large offset relative to the screen of the mobile terminal device is determined by detecting the current face image of the user and according to the position offset of the face reference point in the two images, if so, the media display interface for displaying the current media content is controlled to reasonably offset in the same direction as the position offset, and the reasonable offset takes the principle of not influencing the relative integrity of the media content display as a principle, so that the jitter problem of the media content relative to the eyes in the moving and bumpy process can be improved, the displayability of the media content is improved, and the processing function of the handheld device can be enhanced.
In addition, when the user is determined to be in a stable state, the media content is normally displayed, so that the user can realize normal and complete media content browsing under the posture which is habituated by the user, the anti-shaking processing is more intelligent and humanized, and the processing function of the handheld device is further enhanced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein,
fig. 1 is an exemplary flowchart of a method for controlling media presentation in a mobile terminal according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating a method for controlling media presentation in a mobile terminal according to an example of the present invention.
Fig. 3 is an exemplary block diagram of a control device for media presentation in a mobile terminal according to an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a control device for media presentation in a mobile terminal according to an example of the present invention.
Fig. 5 is a schematic structural diagram of a mobile terminal device in an embodiment of the present invention.
Fig. 6A to 6C are schematic diagrams of an application scenario according to an example of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail by referring to the following examples.
Fig. 1 is an exemplary flowchart of a method for controlling media presentation in a mobile terminal according to an embodiment of the present invention. The method can be applied to a mobile terminal device. As shown in fig. 1, the method may include the steps of:
In the step, the current face image can be collected through a front-facing camera on the handheld device, and the current face of the user can be detected from the current face image.
And 102, identifying a current face reference point from the current face image.
In this step, a face may be located from a current face image based on a face recognition technique, and a set face reference point, such as an intersection between a binocular connection line and a nose-mouth connection line, or a focus point of a certain eye or focus points of two eyes, may be identified.
And 103, at least acquiring a position deviation value of the current face reference point relative to the previous face reference point.
In this step, it is equivalent to determine the position offset of the face reference point in the two adjacent face images, that is, the position offset of the face reference point is compared with the previous face image in the current face image.
Further, when the position deviation value of the current face reference point relative to the previous face reference point is obtained, the moving speed and/or acceleration information of the position deviation of the current face reference point relative to the previous face reference point can be further obtained, and an offset correction speed is calculated according to the moving speed and/or acceleration information.
And 104, determining a correction offset value of a media display interface for displaying the current media content on the display screen of the mobile terminal based on the position offset value.
In this step, the corrected offset value is used to offset the media presentation interface of the current media content from the face reference point in the same direction, so that the human eyes do not feel the shake of the media content relative to the eyes.
In the concrete implementation, the correction can be carried out in real time according to any deviation of human eyes, or the correction can not be carried out under the condition of slight deviation of the human eyes, at the moment, a deviation threshold value can be set, the correction is carried out when the position deviation value is greater than the deviation threshold value, otherwise, the correction is not carried out.
And 105, performing offset correction on the current media content according to the corrected offset value.
In this step, the current media content is shifted in the same direction as the correction offset value. If the offset correction speed is calculated in step 103, the offset correction may be performed on the current media content according to the correction offset value and the offset correction speed. The offset correction speed is on the principle of making the user feel as little jitter as possible.
An embodiment of the method described in fig. 1 is described in detail below by way of an example. Fig. 2 is a flowchart illustrating a method for controlling media presentation in a mobile terminal according to an example of the present invention. As shown in fig. 2, the method may include the steps of:
This step accessible handheld device is last to be put forward the camera and to gather the detection. In the specific implementation, the facial images may be collected at set time intervals in this step, for example, one facial image may be collected every 0.05 second, 0.1 second, 0.2 second, 0.5 second, 1 second, and the like.
In other embodiments, step 201 may be preceded by: and responding to an anti-shake function starting instruction of a user, and starting a front camera of the handheld device. Namely, when the user turns on the anti-shake function switch, the front camera of the equipment is turned on, and the anti-shake processing function is started. Further, the method may further comprise: and responding to an anti-shake function closing instruction of a user, closing a front camera of the handheld device, and closing an anti-shake processing function. The anti-shake function starting and ending function which can be operated by a user is set, so that the anti-shake processing can be carried out when the user has an anti-shake demand, and the anti-shake processing is stopped when the user does not have the anti-shake demand, so that system resources can be saved, and the resource occupancy rate of the handheld device is reduced.
In this step, a face may be located from a current face image based on a face recognition technique, a set face reference point, such as an intersection between a binocular line and a nose-mouth line, may be recognized, and a current position of the face reference point in a coordinate system may be determined based on a predetermined coordinate system, such as a screen coordinate system.
In this step, it is equivalent to determine the position offset of the face reference point in the two adjacent face images, that is, the position offset of the face reference point is compared with the previous face image in the current face image. When the previous position of the face reference point in the coordinate system is stored, it is indicated that the current face image is not the first face image, a face image is also collected before the current face image, and the position of the face reference point in the last collected face image in the coordinate system, that is, the previous position, is stored.
In this embodiment, when the previous position of the face reference point in the coordinate system is stored, that is, the current face image is not the first face image, the X coordinate offset value, the Y coordinate offset value, and the distance offset value of the current position relative to the previous position may be calculated. In other embodiments, only the X-coordinate offset value and the Y-coordinate offset value of the current position relative to the previous position may be calculated, i.e., the distance offset value may not be calculated. Of course, in another embodiment, only coordinate offset values for a single direction in the XY coordinate system, such as X coordinate offset values or Y coordinate offset values, may be calculated. The specific setting can be carried out according to actual needs, and the setting is not limited here.
In this embodiment, the position offset value of the current position relative to the previous position includes: when the X coordinate offset value, the Y coordinate offset value, and the distance offset value are determined, in this step, it may be determined whether the X coordinate offset value is greater than a preset X coordinate offset threshold value, whether the Y coordinate offset value is greater than a preset Y coordinate offset threshold value, and whether the distance offset value is greater than a preset distance offset threshold value, and if any of the three is determined to be yes, step 206 is executed.
In other embodiments, when only the X coordinate offset value and the Y coordinate offset value of the current position relative to the previous position are calculated, in this step, only whether the X coordinate offset value is greater than a preset X coordinate offset threshold and whether the Y coordinate offset value is greater than a preset Y coordinate offset threshold may be determined, and if the determination result of either of the two is yes, step 206 is executed.
In one embodiment, when only the X coordinate offset value or the Y coordinate offset value of the current position relative to the previous position is calculated, in this step, it may be determined whether only the X coordinate offset value is greater than a preset X coordinate offset threshold value, or whether the Y coordinate offset value is greater than a preset Y coordinate offset threshold value, and if so, step 206 is executed.
And step 206, determining a media display interface for displaying the current media content to correct the offset value on the display screen of the mobile terminal according to the position offset value and the set maximum allowable offset value.
In this step, the maximum allowable deviation value is set, in one embodiment, such that the deviation value does not affect the relative integrity of the media content presentation, that is, a certain amount of incomplete presentation of the media content is allowed, but the incomplete presentation does not affect the overall understanding of the media content; in another embodiment, an offset buffer is disposed around the display screen, the media display interface does not completely fill the entire display screen, the media display interface is located in a central position of the display screen during normal display, the offset buffer is disposed around the media display interface, and when jitter occurs subsequently, the media display interface can be offset in the offset buffer, so that an offset distance corresponding to a maximum boundary position of the offset buffer is a maximum allowable offset value.
In this embodiment, for the first two cases mentioned in step 204 and step 205, the maximum allowable offset value may be set as follows: and setting the maximum offset value in the X-axis direction and the maximum offset value in the Y-axis direction. For the last case mentioned in step 204 and step 205, the maximum allowable offset value set may only include: and setting the maximum offset value in the X-axis direction or the maximum offset value in the Y-axis direction.
The maximum offset value may be set according to actual conditions, for example, for video content, in an example of the present embodiment, the maximum offset value DxMax in the X-axis direction is DeviceWidth × 0.2, and the maximum offset value DyMax in the Y-axis direction is DeviceHeight × 0.1. For another example, for text content, in an example of the present embodiment, the maximum offset value DxMax in the X-axis direction is DeviceWidth × 0.05, and the maximum offset value DyMax in the Y-axis direction is DeviceHeight × 0.02, where DeviceWidth is device width and DeviceHeight is device height.
In determining the correction offset value of the media content, in this embodiment, one having the smallest absolute value may be selected from the X coordinate offset value and the X axis direction maximum offset value as the X axis direction correction offset value, and one having the smallest absolute value may be selected from the Y coordinate offset value and the Y axis direction maximum offset value as the Y axis direction correction offset value. The objective is to translate the user's excessive movement offset into a reasonable value so that the media content can be viewed relatively completely after the adjustment of the reasonable offset value.
The vector direction of the correction offset value coincides with the vector direction of the offset value.
For example, the correction offset value may be determined according to the following equation (1):
Dx2＝(Dx1<0？-1:1)×Min(abs(Dx1),DxMax)；
Dy2＝(Dy1<0？-1:1)×Min(abs(Dy1),DyMax) (1)
wherein Dx1 and Dy1 are the X coordinate offset value and the Y coordinate offset value calculated in step 103, respectively; dx2 and Dy2 are the X coordinate correction offset value and the Y coordinate correction offset value calculated in this step, respectively.
And step 207, controlling the media display interface for displaying the current media content to perform offset correction in the same direction as the position offset value according to the correction offset value.
This step may be implemented by an improved media player such as a video player, e-book reader, etc.
In this embodiment, after calculating the vector correction offset value based on the formula (1) in step 206, the media presentation interface for presenting the current media content may be controlled to perform offset according to the vector correction offset value, or if only the absolute value of the correction offset value is obtained, the media presentation interface for presenting the current media content may be controlled to perform offset in the same direction as the position offset value according to the correction offset value.
In practical applications, it is considered that if a user keeps the handheld device relatively stable and the duration exceeds a set threshold, for example, 0.5 second, 1 second, 2 seconds, and the like, the user may be considered to be in a stable state now, and accordingly, the media content may be normally displayed, for example, if a media display interface for displaying the current media content is in an offset display state, the media display interface is adjusted to be centered; and if the media display interface for displaying the current media content is normally displayed, keeping the normal display. Specifically, in this embodiment, when it is determined that the offset value is not greater than the preset offset threshold value in step 205, it may be determined whether a timer is currently running, if yes, it is determined whether the running time of the timer reaches the set running threshold value, if yes, the running of the timer is stopped, and the media display interface for displaying the current media content is controlled to perform reset display, that is, display is performed according to a normal display manner (usually, centered display) of the media content; and if no timer counts currently, starting the counting of the timer.
In this embodiment, no matter the offset correction is performed on the media presentation interface used for presenting the current media content in step 207, or the media presentation interface in offset presentation is centered, the offset correction may be performed at a certain degree. The speed is based on the principle that the user feels as little jitter as possible. For example, in step 107, when the position offset value of the current face reference point relative to the previous face reference point is obtained, the moving speed and/or the acceleration information of the position offset of the current face reference point relative to the previous face reference point may be further determined according to the time interval between two detections and the position offset value of the two, an offset correction speed is calculated according to the moving speed and/or the acceleration information, and the offset correction is performed on the current media content according to the offset correction offset value and the offset correction speed, that is, the offset correction speed may be adapted to the speed of the position offset of the face reference point of the user. When the media presentation interface in the offset presentation is centered, the adjustment speed may be a set speed that is less noticeable to the user because the user is substantially in a steady state.
The following are embodiments of the apparatus of the present invention that may be used to perform the above-described embodiments of the method of the present invention. For details which are not disclosed in the embodiments of the apparatus of the present invention, reference is made to the description of the embodiments of the method of the present invention.
Fig. 3 is an exemplary block diagram of a control device for media presentation in a mobile terminal according to an embodiment of the present invention. The apparatus can be implemented by software, hardware or a combination of the two, and the apparatus can be applied to a handheld device. As shown in fig. 3, the apparatus may include: a face image detection module 301, a face reference point determination module 302, an offset value determination module 303, a correction value determination module 304, and an offset correction module 305.
The face image detection module 301 is configured to detect a current face of a user from an acquired current face image. Specifically, a camera may be controlled to capture a current facial image of a user viewing media content.
The face reference point determination module 302 is used to identify the current face reference point of the current face.
The offset value determining module 303 is configured to obtain at least a position offset value of the current face reference point relative to the previous face reference point.
The correction value determining module 304 is configured to determine a correction offset value of a media presentation interface for presenting the current media content on the display screen of the mobile terminal based on the position offset value.
The offset modification module 305 is configured to perform offset modification on the current media content according to the modified offset value.
In one embodiment, the face reference point determining module 302 may further determine the current position of the current face reference point in the coordinate system based on the set coordinate system. Accordingly, the offset value determination module 303 is configured to calculate a position offset value of the current position relative to a previous position of the previous face reference point in the coordinate system. In this embodiment, as shown in fig. 4, a storage module 401 is further included for storing the previous position of the previous face reference point in the coordinate system and the current position of the current face reference point in the coordinate system.
In an embodiment, the correction value determining module 304 may perform real-time correction according to any deviation of human eyes, or may not perform correction under a condition of slight deviation of human eyes, at this time, an offset threshold may be set, and the correction value determining module 304 performs correction only when the position deviation value is greater than the offset threshold, otherwise, does not perform correction. In this case, the correction value determining module 304 may include a comparing module 402 and a correction value calculating module 403 as shown in fig. 4.
The comparing module 402 is configured to determine whether the position deviation value is greater than a preset deviation threshold, and if so, provide the position deviation value to the correction value calculating module 403; the correction value calculating module 403 is configured to determine, based on the position offset value and the set maximum tolerance offset value, a correction offset value of a media display interface on a display screen of the mobile terminal, where the media display interface is used for displaying current media content.
In one embodiment, the apparatus may further comprise: a speed information determining module 404, configured to determine moving speed and/or acceleration information of the position offset of the current face reference point relative to the previous face reference point, and determine an offset correction speed according to the moving speed and/or acceleration information; accordingly, the offset modification module 305 can perform offset modification on the current media content according to the modification offset value and the offset modification speed.
In one embodiment, the apparatus may further comprise, as shown in fig. 4: a timing control module 405 and a presentation reset module 406. The timing control module 405 is configured to, when the comparison module 401 determines that the offset value is not greater than the preset offset threshold, determine whether to start timing of a timer at present, if so, determine whether the timing time of the timer reaches the set timing threshold, if so, stop timing of the timer, and notify the display reset module 406; and if the timing of the timer is not started currently, starting the timing of the timer. The display resetting module 406 is configured to control the media display interface for displaying the current media content to perform resetting display.
Fig. 4 is a schematic structural diagram of a control device for media presentation in a mobile terminal according to an example of the present invention, which describes an embodiment of the device in fig. 3 in detail through an example. As shown in fig. 4, the apparatus may include: a face image detection module 301, a face reference point determination module 302, a storage module 401, an offset value determination module 303, a comparison module 402, a correction value calculation module 403, and an offset correction module 305. In addition, the method can further comprise the following steps: a speed information determination module 404, a timing control module 405, and a presentation reset module 406.
The face image detection module 301 is configured to control a camera to collect a current face image of a user watching media content, and detect a current face of the user from the collected current face image. The camera may be a front-facing camera on a handheld device. In other embodiments, the face image detection module 301 may respond to an anti-shake function start instruction of a user to start the front camera; and responding to an anti-shake function closing instruction of a user, and closing the front camera.
The face reference point determining module 302 is configured to identify a current face reference point from the current face, determine a current position of the face reference point in a set coordinate system based on the coordinate system, and store the current position in the storage module 401. The current position is used as the current position at the time of the current calculation and the previous position at the time of the next calculation.
The storage module 401 is configured to store a previous position of the previous face reference point in the coordinate system and a current position of the current face reference point in the coordinate system.
The offset value determining module 303 is configured to calculate a position offset value of the current position relative to the previous position when the previous position of the previous face reference point in the coordinate system is stored in the storage module 401.
The comparing module 402 is configured to determine whether the position deviation value is greater than a preset deviation threshold, and if so, provide the position deviation value to the correction value calculating module 403.
The correction value calculating module 403 is configured to determine a correction offset value of a media display interface for displaying the current media content on the display screen of the mobile terminal based on the position offset value and the set maximum allowable offset value.
The offset correction module 305 is configured to control the media presentation interface for presenting the current media content to perform an offset correction in the same direction as the position offset value according to the correction offset value. In a specific implementation, the offset correction module 305 may be a display control module of a media player, such as a video player and an e-book reader.
In one embodiment, the offset value determination module 303 may be configured to calculate an X coordinate offset value, a Y coordinate offset value, and a distance offset value of the current position relative to the previous position; the comparing module 401 is configured to determine whether the X coordinate offset value is greater than a preset X coordinate offset threshold, determine whether the Y coordinate offset value is greater than a preset Y coordinate offset threshold, and determine whether the distance offset value is greater than a preset distance offset threshold, and if any of the three is yes, provide the X coordinate offset value and the Y coordinate offset value to the correction value calculating module 402.
In another embodiment, the offset value determination module 303 may be configured to calculate an X-coordinate offset value and a Y-coordinate offset value of the current position relative to the previous position; the comparing module 401 is configured to determine whether the X coordinate offset value is greater than a preset X coordinate offset threshold, determine whether the Y coordinate offset value is greater than a preset Y coordinate offset threshold, and if the determination result of any one of the two values is yes, provide the X coordinate offset value and the Y coordinate offset value to the correction value calculating module 402.
In yet another embodiment, the offset value determination module 303 may be configured to calculate only an X-coordinate offset value or a Y-coordinate offset value of the current position relative to the previous position; the comparing module 401 is configured to determine whether the X coordinate offset value is greater than a preset X coordinate offset threshold, or determine whether the Y coordinate offset value is greater than a preset Y coordinate offset threshold, and if the determination result is yes, provide the X coordinate offset value and the Y coordinate offset value to the correction value calculating module 402.
For the first two cases, the set maximum allowable offset value may include: setting the maximum deviation value in the X-axis direction and the maximum deviation value in the Y-axis direction; accordingly, the correction value calculating module 402 may be configured to select one of the offset values with the smallest absolute value from the X coordinate offset value and the X-axis direction maximum offset value as the X-axis direction correction offset value, and select one of the position offset values with the smallest absolute value from the Y coordinate offset value and the Y-axis direction maximum offset value as the Y-axis direction correction offset value.
For the latter case, the set maximum allowable offset value may include: setting the maximum deviation value in the X-axis direction or the maximum deviation value in the Y-axis direction; accordingly, the correction value calculating module 402 may be configured to select one of the offset values with the smallest absolute value from the X coordinate offset value and the X-axis direction maximum offset value as the X-axis direction correction offset value, or select one of the offset values with the smallest absolute value from the Y coordinate offset value and the Y-axis direction maximum offset value as the Y-axis direction correction offset value.
In one embodiment, the control device for media presentation at a mobile terminal may further comprise: a speed information determining module 404, configured to determine moving speed and/or acceleration information of the position offset of the current face reference point relative to the previous face reference point, and determine an offset correction speed according to the moving speed and/or acceleration information; accordingly, the offset modification module 305 can perform offset modification on the current media content according to the modification offset value and the offset modification speed.
In one embodiment, the control device for media presentation at a mobile terminal may further comprise: a timing control module 405 and a presentation reset module 406.
The timing control module 405 is configured to, when the comparison module 401 determines that the offset value is not greater than the preset offset threshold, determine whether to start timing of a timer at present, if so, determine whether the timing time of the timer reaches the set timing threshold, if so, stop timing of the timer, and notify the display reset module 406; and if the timing of the timer is not started currently, starting the timing of the timer.
The display resetting module 406 is configured to control the media display interface for displaying the current media content to perform resetting display.
Fig. 5 is a schematic structural diagram of a handheld device in an embodiment of the present invention. The handheld device is used for implementing the control method for media display on the mobile terminal shown in fig. 1 to 2 and the control device for media display on the mobile terminal shown in fig. 3 to 4. As shown in fig. 3, the handheld device may include: a processor 501, a non-volatile computer-readable memory 502, a display unit 503, a network communication interface 504. These components communicate over a bus 505.
In this embodiment, the memory 502 stores a plurality of program modules: an operating system 506, a network communication module 507, and an application 508.
The processor 501 may read various modules (not shown) included in the application program in the memory 502 to execute various functional applications of the handheld device and data processing. The processor 501 in this embodiment may be one or multiple processors, and may be a CPU, a processing unit/module, an ASIC, a logic module, a programmable gate array, or the like.
The application 508 may include each functional module in the control device for media presentation at the mobile terminal as shown in fig. 3 or 4, or may be understood to include a set of computer-executable instructions and corresponding metadata and heuristics formed by each functional module in the device shown in fig. 3 or 4. These sets of computer-executable instructions may be executed by the processor 501 and perform the functions of the method shown in fig. 1 or 2 or the apparatus shown in fig. 3 or 4.
In this embodiment, the network communication interface 504 cooperates with the network communication module 506 to complete the transceiving of various network signals of the handheld device.
The display unit 503 has a display panel for inputting and displaying related information, including displaying the media content.
In this embodiment, the handheld device may be a smart phone, an iPad, an e-book reader, an MP4, or the like.
In addition, each of the embodiments of the present invention can be realized by a data processing program executed by a data processing apparatus such as a computer. It is clear that the data processing program constitutes the invention. Further, the data processing program, which is generally stored in one storage medium, is executed by directly reading the program out of the storage medium or by installing or copying the program into a storage device (such as a hard disk and/or a memory) of the data processing device. Such a storage medium therefore also constitutes the present invention. The storage medium may use any type of recording means, such as a paper storage medium (e.g., paper tape, etc.), a magnetic storage medium (e.g., a flexible disk, a hard disk, a flash memory, etc.), an optical storage medium (e.g., a CD-ROM, etc.), a magneto-optical storage medium (e.g., an MO, etc.), and the like.
The invention therefore also provides a storage medium in which a data processing program is stored which is designed to carry out any one of the embodiments of the method according to the invention described above.
An application scenario of the scheme in the embodiment of the present invention is briefly described below by an example, and fig. 6A to 6C are schematic diagrams of an application scenario in an example of the present invention. As shown in fig. 6A, an anti-shake function button, that is, a "VR" button in fig. 6A, is arranged in a media display interface of a mobile terminal (for example, iPad), when a user clicks the "VR" button, a system enters an anti-shake state, and at the same time, a media display interface for displaying current media content is reduced to a preset ratio, so as to leave a preset offset buffer around, as shown in fig. 6B, when a current face reference point of the user is detected to be offset, the media display interface is controlled to be offset accordingly, as shown in fig. 6C.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (9)
1. A control method for media display in a mobile terminal is characterized by comprising the following steps:
responding to an anti-shake function starting instruction of a user, starting a front camera of the handheld device, and starting an anti-shake processing function; responding to an anti-shake function closing instruction of a user, closing a front camera of the handheld device, and closing an anti-shake processing function;
when the anti-shake processing function is started, controlling the camera to collect the current face of the user and detecting the current face of the user;
identifying a current face reference point of the current face;
at least obtaining a position deviation value of the current face reference point relative to a previous face reference point, determining the moving speed and/or acceleration information of the position deviation of the current face reference point relative to the previous face reference point, judging whether the position deviation value is larger than a preset deviation threshold value, determining a correction deviation value of a media display interface for displaying current media content on a display screen of the mobile terminal according to the position deviation value and a set maximum allowable deviation value when the position deviation value is determined to be larger than the preset deviation threshold value, and calculating an offset correction speed which is adaptive to the position deviation speed of the user face reference point according to the moving speed and/or acceleration information; performing offset correction on the current media content according to the correction offset value and the offset correction speed; the set maximum allowable offset value is an offset value which allows a certain amount of incomplete presentation of the media content, but the incomplete presentation does not affect the overall understanding of the media content;
judging whether a timer is used for timing when the position deviation value is not larger than a preset deviation threshold value, if so, judging whether the timing time of the timer reaches the set timing threshold value, if so, confirming that a user is in a stable state currently, stopping timing of the timer, if a media display interface used for displaying the current media content is in a deviation display state, controlling the media display interface to adopt a set speed which is not easy to be perceived by the user for resetting display, and if the media display interface used for displaying the current media content is in normal display, keeping the normal display; and if no timer counts currently, starting the counting of the timer.
2. The method of claim 1, wherein obtaining at least a position offset value of the current face reference point relative to the previous face reference point comprises:
determining the current position of the current face reference point in a set coordinate system based on the coordinate system, and storing the current position;
when the previous position of the previous face reference point in the coordinate system is stored, calculating a position offset value of the current position relative to the previous position.
3. The method of claim 2, wherein the calculating a position offset value for the current position relative to the previous position comprises at least one of: calculating an X coordinate offset value, a Y coordinate offset value and a distance offset value of the current position relative to the previous position;
the determining whether the position deviation value is greater than a preset deviation threshold value includes at least one of the following determinations: judging whether the X coordinate deviation value is larger than a preset X coordinate deviation threshold value, judging whether the Y coordinate deviation value is larger than a preset Y coordinate deviation threshold value, and judging whether the distance deviation value is larger than a preset distance deviation threshold value;
and if any judgment result is yes, executing the step of determining a correction offset value of a media display interface for displaying the current media content on the display screen of the mobile terminal according to the offset value and the set maximum allowable offset value.
4. The method of claim 2, wherein the set maximum allowable offset value comprises: setting the maximum deviation value in the X-axis direction and the maximum deviation value in the Y-axis direction;
the step of determining a correction offset value of a media display interface for displaying the current media content on a display screen of the mobile terminal according to the offset value and the set maximum allowable offset value comprises the following steps: and selecting one with the smallest absolute value from the X coordinate deviation value and the X-axis direction maximum deviation value in the position deviation values as an X-axis direction correction deviation value, and selecting one with the smallest absolute value from the Y coordinate deviation value and the Y-axis direction maximum deviation value in the position deviation values as a Y-axis direction correction deviation value.
5. A control apparatus for media presentation in a mobile terminal, comprising:
the face image detection module is used for responding to an anti-shake function starting instruction of a user, starting a front camera, controlling the camera to collect the current face of the user and detecting the current face of the user; responding to an anti-shake function closing instruction of a user, and closing the front camera;
the face reference point determining module is used for identifying the current face reference point of the current face;
the offset value determining module is used for at least acquiring the position offset value of the current face reference point relative to the previous face reference point;
the speed information determining module is used for determining the moving speed and/or the acceleration information of the position offset of the current face reference point relative to the previous face reference point and determining an offset correction speed which is adaptive to the position offset speed of the user face reference point according to the moving speed and/or the acceleration information;
the correction value determining module is used for judging whether the position deviation value is greater than a preset deviation threshold value or not, and determining a correction deviation value of a media display interface for displaying the current media content on a display screen of the mobile terminal according to the position deviation value and a set maximum allowable deviation value when the position deviation value is determined to be greater than the preset deviation threshold value; the set maximum allowable offset value is an offset value which allows a certain amount of incomplete presentation of the media content, but the incomplete presentation does not affect the overall understanding of the media content;
the offset correction module is used for carrying out offset correction on the current media content according to the correction offset value and the offset correction speed;
the timing control module is used for judging whether the timing of a timer is started at present or not when the correction value determining module judges that the deviation value is not larger than a preset deviation threshold value, if so, judging whether the timing time of the timer reaches the set timing threshold value or not, if so, confirming that a user is in a stable state at present, stopping the timing of the timer, and informing a display resetting module; if the timing of the timer is not started currently, starting the timing of the timer;
the display reset module is used for controlling the media display interface to reset and display at a set speed which is not easily perceived by a user when the media display interface for displaying the current media content is in an offset display state; and if the media display interface for displaying the current media content is normally displayed, keeping the normal display.
6. The apparatus of claim 5, wherein the correction value determination module comprises: the device comprises a comparison module and a correction value calculation module;
the comparison module is used for judging whether the position deviation value is larger than a preset deviation threshold value or not, and if so, the position deviation value is provided for the correction value calculation module;
and the correction value calculation module is used for determining a correction offset value of a media display interface for displaying the current media content on a display screen of the mobile terminal based on the position offset value and the set maximum tolerance offset value.
7. The apparatus of claim 6, further comprising a memory module;
the face reference point determining module is further used for determining the current position of the current face reference point in the coordinate system based on the set coordinate system and storing the current position in the storage module;
the storage module is used for storing the previous position of the previous face reference point in the coordinate system and the current position of the current face reference point in the coordinate system;
the offset value determining module is used for calculating the position offset value of the current position relative to the previous position when the previous position of the previous face reference point in the coordinate system is stored in the storage module.
8. The apparatus of claim 7, wherein the offset value determination module is configured to calculate at least one of an X-coordinate offset value, a Y-coordinate offset value, and a distance offset value of the current position relative to the previous position;
the comparison module is configured to perform at least one of the following determinations: judging whether the X coordinate deviation value is larger than a preset X coordinate deviation threshold value, judging whether the Y coordinate deviation value is larger than a preset Y coordinate deviation threshold value, judging whether the distance deviation value is larger than a preset distance deviation threshold value, and if any judgment result is yes, providing the X coordinate deviation value and the Y coordinate deviation value to the correction value calculation module.
9. The apparatus of claim 8, wherein the set maximum allowable offset value comprises: setting the maximum deviation value in the X-axis direction and the maximum deviation value in the Y-axis direction;
the correction value calculation module is used for selecting one with the smallest absolute value from the X coordinate deviation value in the position deviation value and the X-axis direction maximum deviation value as an X-axis direction correction deviation value, and selecting one with the smallest absolute value from the Y coordinate deviation value in the position deviation value and the Y-axis direction maximum deviation value as a Y-axis direction correction deviation value.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510433741.3A CN106371552B (en) | 2015-07-22 | 2015-07-22 | Control method and device for media display at mobile terminal |
| PCT/CN2016/084586 WO2017005070A1 (en) | 2015-07-09 | 2016-06-02 | Display control method and device |
| US15/854,633 US10635892B2 (en) | 2015-07-09 | 2017-12-26 | Display control method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510433741.3A CN106371552B (en) | 2015-07-22 | 2015-07-22 | Control method and device for media display at mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106371552A CN106371552A (en) | 2017-02-01 |
| CN106371552B true CN106371552B (en) | 2021-04-16 |
Family
ID=57880582
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510433741.3A Active CN106371552B (en) | 2015-07-09 | 2015-07-22 | Control method and device for media display at mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106371552B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107801087B (en) * | 2017-10-27 | 2021-05-11 | Oppo广东移动通信有限公司 | Video playing method and device and terminal equipment |
| CN108090428B (en) * | 2017-12-08 | 2021-05-25 | 成都合盛智联科技有限公司 | Face recognition method and system |
| CN112911303B (en) * | 2021-01-27 | 2024-03-29 | 浙江商汤科技开发有限公司 | Image encoding method, decoding method, device, electronic device and storage medium |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7317816B2 (en) * | 2003-08-19 | 2008-01-08 | Intel Corporation | Enabling content-based search of objects in an image database with reduced matching |
| CN101625844A (en) * | 2008-07-07 | 2010-01-13 | 华晶科技股份有限公司 | System and method for preventing screen of image display device from vibrating |
| CN102841725A (en) * | 2011-06-21 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Electronic device and screen information adjusting method thereof |
| CN103176623B (en) * | 2011-12-20 | 2016-08-03 | 中国电信股份有限公司 | Mobile terminal reads anti-fluttering method, device and mobile terminal |
| CN103376892B (en) * | 2012-04-24 | 2017-02-08 | 联想(北京)有限公司 | Method, device and terminal device for controlling display of display interface |
| CN104464579A (en) * | 2013-09-12 | 2015-03-25 | 中兴通讯股份有限公司 | Data display method, data display device, data display terminal, display control method and display control device |
| CN103885593B (en) * | 2014-03-14 | 2016-04-06 | 努比亚技术有限公司 | A kind of handheld terminal and screen anti-fluttering method thereof and device |
-
2015
- 2015-07-22 CN CN201510433741.3A patent/CN106371552B/en active Active
Non-Patent Citations (2)
| Title |
|---|
| An Algorithm and Data Process Scheme for Indoor Location Based on Mobile Devices;Bin Wen 等;《The 5th International Conference on Computer Science and Software Engineering(CSSE 2014)》;20140112;全文 * |
| 智能移动终端计算迁移研究;张文丽 等;《计算机学报》;20150715;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106371552A (en) | 2017-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3195595B1 (en) | Technologies for adjusting a perspective of a captured image for display | |
| US10156909B2 (en) | Gesture recognition device, gesture recognition method, and information processing device | |
| CN102780893B (en) | Image processing apparatus and control method thereof | |
| CN112087574B (en) | Enhanced image capture | |
| CN109120984B (en) | Barrage display method and device, terminal and server | |
| KR102062310B1 (en) | Method and apparatus for prividing control service using head tracking in an electronic device | |
| CN103428428A (en) | Image capture device and image capture method | |
| CN103383595A (en) | Apparatus and method of controlling mobile terminal based on analysis of user's face | |
| CN110769158A (en) | Enhanced image capture | |
| EP3617851B1 (en) | Information processing device, information processing method, and recording medium | |
| WO2015136952A1 (en) | Gesture recognition device, head-mounted display, and portable terminal | |
| CN110969116B (en) | Gaze point position determining method and related device | |
| US10635892B2 (en) | Display control method and apparatus | |
| CN106371552B (en) | Control method and device for media display at mobile terminal | |
| JP2012238293A (en) | Input device | |
| KR101541061B1 (en) | Apparatus and method for guiding the sensory organ movements in portable terminal | |
| WO2015078189A1 (en) | Interface adjustment method and mobile device | |
| CN111986229A (en) | Video target detection method, device and computer system | |
| WO2018054097A1 (en) | Self-portrait line-of-sight alignment method, device, and terminal | |
| CN109040604B (en) | Shot image processing method and device, storage medium and mobile terminal | |
| US20220334648A1 (en) | Wearable information terminal, control method thereof, and storage medium | |
| CN107957781B (en) | Information display method and device | |
| CN110096132A (en) | A kind of method and intelligent glasses for eliminating intelligent glasses message informing | |
| EP3440532B1 (en) | Improving readability of content displayed on a screen | |
| CN110941344B (en) | Method for obtaining gazing point data and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221115 Address after: 1402, Floor 14, Block A, Haina Baichuan Headquarters Building, No. 6, Baoxing Road, Haibin Community, Xin'an Street, Bao'an District, Shenzhen, Guangdong 518133 Patentee after: Shenzhen Yayue Technology Co.,Ltd. Address before: 2, 518044, East 403 room, SEG science and Technology Park, Zhenxing Road, Shenzhen, Guangdong, Futian District Patentee before: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. |