CN113608641B - Method and device for adjusting display position of curved screen, intelligent sound box and storage medium - Google Patents
Method and device for adjusting display position of curved screen, intelligent sound box and storage medium Download PDFInfo
- Publication number
- CN113608641B CN113608641B CN202010558712.0A CN202010558712A CN113608641B CN 113608641 B CN113608641 B CN 113608641B CN 202010558712 A CN202010558712 A CN 202010558712A CN 113608641 B CN113608641 B CN 113608641B
- Authority
- CN
- China
- Prior art keywords
- camera
- screen
- display area
- curved screen
- current image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000001514 detection method Methods 0.000 claims description 47
- 230000005236 sound signal Effects 0.000 claims description 34
- 238000004590 computer program Methods 0.000 claims description 24
- 230000008859 change Effects 0.000 claims description 5
- 230000000694 effects Effects 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000013461 design Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
- H04R1/028—Casings; Cabinets ; Supports therefor; Mountings therein associated with devices performing functions other than acoustics, e.g. electric candles
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application is applicable to the technical field of intelligent sound boxes and provides a method and a device for adjusting a display position of a curved screen, the intelligent sound box and a storage medium. In the embodiment of the application, a current image is acquired through a camera, and the depth distance and the relative angle between a face and the camera are determined according to the current image; determining a screen display area of the curved screen according to the depth distance and the relative angle; and acquiring video information to be displayed, and displaying the video information to be displayed at the screen display area. Therefore, the problem of poor watching effect when people watch videos at corner positions is avoided.
Description
Technical Field
The application belongs to the technical field of intelligent sound boxes, and particularly relates to a method and a device for adjusting a curved screen display position, an intelligent sound box and a storage medium.
Background
Along with the development of society, intelligent sound boxes are more and more popular in life of people, and the design of functions of the intelligent sound boxes is more and more suitable for life of people, for example, the design of adding a curved flexible screen to the intelligent sound boxes is adopted, so that people can watch videos on the intelligent sound boxes. But the viewing effect is poor when people watch video in corner positions due to the viewing angle difference of the curved flexible screen.
Disclosure of Invention
The embodiment of the application provides a method and a device for adjusting a display position of a curved screen, an intelligent sound box and a storage medium, and can solve the problem that when people watch videos at corner positions, the watching effect is poor.
In a first aspect, an embodiment of the present application provides a method for adjusting a display position of a curved screen, including:
acquiring a current image through a camera, and determining a depth distance and a relative angle between a face and the camera according to the current image;
determining a screen display area of the curved screen according to the depth distance and the relative angle;
and acquiring video information to be displayed, and displaying the video information to be displayed at the screen display area.
Optionally, the determining the screen area of the curved screen according to the depth distance and the relative angle includes:
acquiring a corresponding relation between a depth distance and an angle relation model, and selecting the angle relation model corresponding to the depth distance according to the corresponding relation;
and selecting a screen display area corresponding to the relative angle according to the angle relation model.
Optionally, before the current image is acquired by the camera, the method includes:
acquiring a sound signal, and performing position detection according to the sound signal to obtain a detection result;
determining a user direction according to the detection result;
and selecting an optimal camera according to the user direction.
Optionally, before the current image is acquired by the camera, the method includes:
acquiring a sound signal, and performing position detection according to the sound signal to obtain a detection result;
determining a user direction according to the detection result;
and rotating the camera according to the user direction.
Optionally, the acquiring the sound signal, performing position detection according to the sound signal, to obtain a detection result, includes:
collecting sound signals of at least two microphones by utilizing a microphone array, and calculating a time difference value for collecting the sound signals;
and determining the user position according to the time difference value.
Optionally, before the current image is acquired by the camera, the method includes:
and respectively acquiring current images through cameras at all positions, and judging the definition of the face in the current images.
And selecting an optimal camera according to the definition of the face.
Optionally, the obtaining the current image through the camera, determining the depth distance and the relative angle between the face and the camera according to the current image, includes:
when the screen display area is smaller than or equal to a preset area threshold, if at least two faces exist in the current image, acquiring the distance between the at least two faces;
and if the distance is greater than a preset distance threshold, respectively detecting two faces with the distance greater than the preset distance threshold, and determining the depth distance and the relative angle between the two faces and the camera.
In a second aspect, an embodiment of the present application provides an adjustment device for a display position of a curved screen, including:
the acquisition module is used for acquiring a current image through a camera, and determining the depth distance and the relative angle between the face and the camera according to the current image;
the determining module is used for determining a screen display area of the curved screen according to the depth distance and the relative angle;
and the display module is used for acquiring the video information to be displayed and displaying the video information to be displayed at the screen display area.
In a third aspect, an embodiment of the present application provides an intelligent sound box, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the steps of any one of the above methods for adjusting a display position of a curved screen when executing the computer program.
In a fourth aspect, embodiments of the present application provide a computer readable storage medium storing a computer program, where the computer program when executed by a processor implements the steps of any one of the above methods for adjusting a display position of a curved screen.
In a fifth aspect, an embodiment of the present application provides a computer program product, when the computer program product runs on a smart sound box, so that the smart sound box performs any one of the above methods for adjusting a display position of a curved screen.
In the embodiment of the application, a current image is acquired through a camera, and the depth distance and the relative angle between a face and the camera are determined according to the current image; determining a screen display area of the curved screen according to the depth distance and the relative angle; and acquiring video information to be displayed, and displaying the video information to be displayed at the screen display area. According to the embodiment of the application, the camera is utilized to acquire the image, the depth distance and the relative angle between the face and the camera are obtained according to the image, so that the screen display area of the curved surface screen can be determined, the screen display area of the curved surface screen for displaying is determined according to the position of the face, and then the video information to be displayed is acquired and displayed in the determined screen display area, so that the problem that when people watch videos at corner positions, the watching effect is poor is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following description will briefly introduce the drawings that are needed in the embodiments or the description of the prior art, it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a first method for adjusting a display position of a curved screen according to an embodiment of the present application;
fig. 2 is a schematic diagram of an intelligent sound box with a camera and a curved screen according to an embodiment of the present application;
fig. 3 is a top view between a face and a camera provided in an embodiment of the present application;
fig. 4 is a second flowchart of a method for adjusting a display position of a curved screen according to an embodiment of the present application;
fig. 5 is a schematic diagram of a leftmost screen display area of a curved screen according to an embodiment of the present application;
FIG. 6 is a schematic view of a left-facing screen display area of a curved screen according to an embodiment of the present disclosure;
FIG. 7 is a schematic view of a centered screen display area of a curved screen provided in an embodiment of the present application;
fig. 8 is a schematic view of a right-leaning screen display area of a curved screen according to an embodiment of the present application;
fig. 9 is a schematic diagram of a rightmost screen display area of a curved screen according to an embodiment of the present application;
fig. 10 is a schematic view of a screen display area of a curved screen when a relative angle between a face and a camera provided in an embodiment of the present application is 0 °;
fig. 11 is a schematic view of a screen display area of a curved screen when a relative angle between a face and a camera provided in an embodiment of the present application is-6 °;
fig. 12 is a schematic view of a screen display area of a curved screen when a relative angle between a face and a camera provided in an embodiment of the present application is-9 °;
FIG. 13 is a top view of a cylindrical sound box provided by an embodiment of the present application;
FIG. 14 is a top view of a cylindrical sound box with a rotatable camera provided in an embodiment of the present application;
fig. 15 is a schematic structural diagram of an adjusting device for a curved screen display position according to an embodiment of the present application;
fig. 16 is a schematic structural diagram of an intelligent sound box provided in an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
In addition, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance.
Fig. 1 is a flow chart illustrating a method for adjusting a display position of a curved screen according to an embodiment of the present application, and as shown in fig. 1, the method for adjusting a display position of a curved screen may include the following steps:
step S101, a current image is obtained through a camera, and the depth distance and the relative angle between the face and the camera are determined according to the current image.
In this embodiment, the execution body may be an intelligent sound box with a camera and a curved screen, as shown in fig. 2, where the camera may have one or two or more cameras, and is specifically determined according to a design form of the intelligent sound box with the curved screen. The current image, namely the image containing the face, is obtained through the camera, and the depth distance and the relative angle between the face and the camera can be determined according to the current image. The depth distance is the depth from the face to the camera; the relative angle is the angle from the face to the camera relative to the central axis of the camera, as shown in fig. 3, and fig. 3 is a top view between the face and the camera.
It can be understood that, as can be seen from fig. 2, the curved screen displays the images at the same position, and the user experience is different when viewing at different viewing angles, and the viewing effect at some positions is more compromised, so that the current image is obtained by using the camera, and the depth distance and the relative angle between the face and the camera are determined according to the image, so that the position of the user relative to the curved screen is determined, and the image display is performed in a manner more suitable for the position of the user.
Optionally, the camera may use a depth camera, and may determine a depth distance and a relative angle between the face and the camera according to the current image obtained by the depth camera, where a face detection algorithm may be used to detect the face in real time and monitor a position change of the face, so as to adjust a display area of the curved screen in real time.
And S102, determining a screen display area of the curved screen according to the depth distance and the relative angle.
In this embodiment, the position of the user with respect to the curved screen may be confirmed according to the obtained depth distance and the relative angle, so as to determine the screen display area of the curved screen. Wherein, the curved surface screen can be a flexible curved surface screen.
Alternatively, the screen display area of the curved screen may be generally set to occupy half of the curved screen, and the screen display area may be adaptively adjusted according to the aspect ratio of the curved screen and the curvature of the curved screen, which is not limited herein. After the screen display area of the curved screen is determined, other areas of the curved screen which are not displayed can be replaced by black, so that the user viewing experience is improved.
Optionally, as shown in fig. 4, step S102 includes:
and S401, acquiring a corresponding relation between the depth distance and the angle relation model, and selecting the angle relation model corresponding to the depth distance according to the corresponding relation.
And S402, selecting a screen display area corresponding to the relative angle according to the angle relation model.
In this embodiment, a correspondence between depth distances and angle relation models is preset, that is, each depth distance range has a corresponding angle relation model, an angle relation model corresponding to the depth distance is selected according to the correspondence, and then a screen display area corresponding to the relative angle is selected according to the selected angle relation model. The angular relation model refers to that one angular range corresponds to one screen display area, that is, when the relative angle is within the angular range, the corresponding screen display area is displayed.
It can be understood that the screen display area can be correspondingly adjusted according to the position of the user, and the change of the screen display area can be regarded as the change of the display position, so that the best viewing effect is achieved. For example, when the distance moved by the user is small, the screen display area corresponding to the two movements will have an overlapping portion.
By way of specific example and not limitation, 5 display regions, respectively a first display region, a second display region, a third display region, a fourth display region, and a fifth display region, are set in advance on the curved screen. The five display areas may have overlapping portions due to the design of the curved screen, where the display area of the curved screen corresponds to the position of the user according to the position of the user, and the first display area is the leftmost display area of the curved screen, as shown in fig. 5. The second display area is a left-hand screen display area of the curved screen, as shown in fig. 6. The third display area is the center screen display area of the curved screen, as shown in fig. 7. The fourth display area is a right-side screen display area of the curved screen, as shown in fig. 8. The fifth display area is the rightmost screen display area of the curved screen, as shown in fig. 9. Setting a corresponding relation between the depth distance and the angle relation model, for example, setting the corresponding angle relation model to display in a third display area when the relative angle is within the range of-6 degrees to 6 degrees when the depth distance is detected to be within the range of 35 to 55 degrees; displaying in the second display area when the relative angle is within the range of-6 DEG to-9 DEG (including-6 DEG); displaying in the first display area when the relative angle is smaller than or equal to-9 degrees; displaying in the fourth display area when the relative angle is in the range of 6-9 degrees (including 6 degrees); and displaying in the fifth display area when the relative angle is greater than or equal to 9 degrees.
According to the setting, when the depth distance is detected to be 40cm, the depth distance accords with the set range, and an angle relation model is selected. If the relative angle is detected to be 0 °, the third display area is displayed according to the angular relationship model, as shown in fig. 10, and fig. 10 is a screen display area of the curved screen when the relative angle between the face and the camera is 0 °. If the relative angle is detected to be minus 6 degrees, the second display area is displayed according to the angle relation model, as shown in fig. 11, and fig. 11 is a screen display area of the curved screen when the relative angle between the face and the camera is minus 6 degrees. If the relative angle is detected to be-9 degrees, displaying the image in the first display area according to the angle relation model, as shown in fig. 12, fig. 12 is a screen display area of the curved screen when the relative angle between the face and the camera is-9 degrees.
Step S103, obtaining video information to be displayed, and displaying the video information to be displayed in the screen display area.
In this embodiment, video information to be displayed is acquired, and the acquired video with display is displayed in a screen display area determined by the video to realize that the curved screen is correspondingly displayed according to the position of the user.
Alternatively, if two or more faces exist in the current image, a fixed display area of the curved screen may be preset, the video information to be displayed is displayed in the preset fixed display area of the curved screen, and generally, the central screen display area of the curved screen in fig. 7 is set as the fixed display area of the curved screen when a plurality of faces are detected.
Optionally, step S101 may include:
and when the screen display area is smaller than or equal to a preset area threshold, if at least two faces exist in the current image, acquiring the distance between the at least two faces.
And if the distance is greater than a preset distance threshold, respectively detecting two faces with the distance greater than the preset distance threshold, and determining the depth distance and the relative angle between the two faces and the camera.
In this embodiment, when the screen display area is smaller than or equal to the preset area threshold, if the current image has two or more faces, the distance between the at least two faces is obtained, and if it is detected that the distance between the two faces exceeds the preset distance threshold, the two faces whose distances exceed the preset distance threshold can be detected respectively, and the depth distance and the relative angle between the two faces and the camera are determined, so that the corresponding screen display areas are determined respectively, and displayed on the curved screen respectively. For example, the rightmost screen display area of the curved screen in fig. 9 and the leftmost screen display area of the curved screen in fig. 5 can be displayed simultaneously. It will be understood that, if the two screen display areas are to be displayed simultaneously, the display area is determined according to the set size of the screen display area, and if the screen display area is too large, the overlapping portion occurs in the display areas when the two areas are displayed simultaneously, so the setting of the area threshold is determined according to the length of the curved screen, and the value of the area threshold is generally less than or equal to 1/2 of the length of the curved screen. Similarly, the preset distance threshold can be set by comprehensively analyzing according to the size of the curved screen and the size of the screen display area.
Optionally, step S101 may include:
and acquiring a sound signal, and performing position detection according to the sound signal to obtain a detection result.
And determining the direction of the user according to the detection result.
And selecting an optimal camera according to the user direction.
In this embodiment, a sound signal is obtained, position detection is performed according to the obtained sound information, and a sound source is located, so as to obtain a detection result, a user direction is determined according to the detection result, and then an optimal camera in that direction is selected according to the user direction, as shown in fig. 13, fig. 13 is a top view of a cylindrical sound box, and the cameras can be arranged on two sides of a microphone in the figure. The optimal camera is a camera which can obtain the current image most perfectly compared with other cameras.
Optionally, when the microphone includes at least one microphone, the microphone is used for waking up the screen for displaying. When the microphone comprises at least two microphones, the microphone is used for judging the direction of the user.
Optionally, step S101 may further include:
and acquiring a sound signal, and performing position detection according to the sound signal to obtain a detection result.
And determining the direction of the user according to the detection result.
And rotating the camera according to the user direction.
In this embodiment, a sound signal is acquired, position detection is performed according to the acquired sound information, and a sound source is located, so that a detection result is obtained, a user direction is determined according to the detection result, and then the camera is rotated according to the user direction, so that the camera can perfectly acquire a current image. As shown in fig. 14, fig. 14 is a top view of a cylindrical sound box with a rotatable camera that can be rotated to obtain an image according to the direction of a user.
Optionally, the acquiring a sound signal, performing position detection according to the sound signal to obtain a detection result, specifically includes:
the method comprises the steps of collecting sound signals of at least two microphones by utilizing a microphone array, and calculating a time difference value for collecting the sound signals.
And determining the user position according to the time difference value.
In this embodiment, the microphone array is used to collect sound signals of at least two microphones, and the time difference of collecting each sound signal is calculated, and the user position is determined according to the obtained time difference.
Optionally, step S101 includes, before:
and respectively acquiring current images through cameras at all positions, and judging the definition of the face in the current images.
And selecting an optimal camera according to the definition of the face.
In this embodiment, the current image is obtained by the cameras at the respective positions, and the definition of the face in the current image is determined. And selecting an optimal camera according to the definition of the face. It can be understood that some users are located at remote positions, and the situation that the camera cannot shoot a human face or shoots the human face incompletely may occur, so that each camera is utilized to acquire a current image respectively, and an optimal camera is selected according to the definition of the human face in the current image.
In the embodiment of the application, a current image is acquired through a camera, and the depth distance and the relative angle between a face and the camera are determined according to the current image; determining a screen display area of the curved screen according to the depth distance and the relative angle; and acquiring video information to be displayed, and displaying the video information to be displayed at the screen display area. According to the embodiment of the application, the camera is utilized to acquire the image, the depth distance and the relative angle between the face and the camera are obtained according to the image, so that the screen display area of the curved surface screen can be determined, the screen display area of the curved surface screen for displaying is determined according to the position of the face, and then the video information to be displayed is acquired and displayed in the determined screen display area, so that the problem that when people watch videos at corner positions, the watching effect is poor is solved.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way.
Fig. 15 is a schematic structural diagram of an adjusting device for a display position of a curved screen according to an embodiment of the present application, and as shown in fig. 15, the adjusting device for a display position of a curved screen may include:
the obtaining module 151 is configured to obtain a current image through a camera, and determine a depth distance and a relative angle between a face and the camera according to the current image.
And the determining module 152 is configured to determine a screen display area of the curved screen according to the depth distance and the relative angle.
And the display module 153 is configured to obtain video information to be displayed, and display the video information to be displayed at the screen display area.
Optionally, the determining module 152 may include:
the first selecting unit 1521 is configured to obtain a correspondence between a depth distance and an angular relationship model, and select the angular relationship model corresponding to the depth distance according to the correspondence.
A second selecting unit 1522, configured to select a screen display area corresponding to the relative angle according to the angular relationship model.
Optionally, the device for adjusting the display position of the curved screen may further include:
the first detection module is used for acquiring sound signals, and carrying out position detection according to the sound signals to obtain detection results.
And the first direction determining module is used for determining the direction of the user according to the detection result.
The first selecting module is used for selecting the optimal camera according to the user direction.
Optionally, the device for adjusting the display position of the curved screen may further include:
and the second detection module is used for acquiring the sound signal, and carrying out position detection according to the sound signal to obtain a detection result.
And the second direction determining module is used for determining the direction of the user according to the detection result.
And the rotating module is used for rotating the camera according to the user direction.
Alternatively, the first detection module or the second detection module may include:
and the calculating unit is used for acquiring sound signals of at least two microphones by utilizing the microphone array and calculating a time difference value for acquiring the sound signals.
And the position determining unit is used for determining the position of the user according to the time difference value.
Optionally, the device for adjusting the display position of the curved screen may further include:
the judging module is used for respectively acquiring the current images through cameras at all positions and judging the definition of the face in the current images.
And the second selecting module is used for selecting the optimal camera according to the definition of the face.
Optionally, the acquiring module 151 may include:
and the existence module is used for acquiring the distance between at least two faces if the current image has the at least two faces when the screen display area is smaller than or equal to a preset area threshold value.
And the detection module is used for respectively detecting two faces with the distance larger than a preset distance threshold value if the distance is larger than the preset distance threshold value and determining the depth distance and the relative angle between the two faces and the camera.
In the embodiment of the application, a current image is acquired through a camera, and the depth distance and the relative angle between a face and the camera are determined according to the current image; determining a screen display area of the curved screen according to the depth distance and the relative angle; and acquiring video information to be displayed, and displaying the video information to be displayed at the screen display area. According to the embodiment of the application, the camera is utilized to acquire the image, the depth distance and the relative angle between the face and the camera are obtained according to the image, so that the screen display area of the curved surface screen can be determined, the screen display area of the curved surface screen for displaying is determined according to the position of the face, and then the video information to be displayed is acquired and displayed in the determined screen display area, so that the problem that when people watch videos at corner positions, the watching effect is poor is solved.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus and modules described above may refer to corresponding procedures in the foregoing system embodiments and method embodiments, which are not described herein again.
Fig. 16 is a schematic structural diagram of an intelligent sound box provided in an embodiment of the present application. For convenience of explanation, only portions relevant to the embodiments of the present application are shown.
As shown in fig. 16, the smart speaker 16 of this embodiment includes: at least one processor 1600 (only one shown in fig. 16), a memory 1601 coupled to the processor 1600, and a computer program 1602 stored in the memory 1601 and executable on the at least one processor 1600, such as a curved screen display position adjustment program. The processor 1600, when executing the computer program 1602, implements the steps in the above embodiments of the method for adjusting the display position of each curved screen, for example, steps S101 to S103 shown in fig. 1. Alternatively, the processor 1600, when executing the computer program 1602, performs the functions of the modules in the apparatus embodiments described above, such as the functions of the modules 151 through 153 shown in fig. 15.
For example, the computer program 1602 may be partitioned into one or more modules that are stored in the memory 1601 and executed by the processor 1600 to complete the present application. The one or more modules may be a series of computer program instruction segments capable of performing particular functions describing the execution of the computer program 1602 in the intelligent speaker 16. For example, the computer program 1602 may be divided into an acquisition module 151, a determination module 152, and a display module 153, each of which functions as follows:
an obtaining module 151, configured to obtain a current image through a camera, and determine a depth distance and a relative angle between a face and the camera according to the current image;
a determining module 152, configured to determine a screen display area of the curved screen according to the depth distance and the relative angle;
and the display module 153 is configured to obtain video information to be displayed, and display the video information to be displayed at the screen display area.
The smart speakers 16 may include, but are not limited to, a processor 1600, a memory 1601. It will be appreciated by those skilled in the art that fig. 16 is merely an example of the smart speaker 16 and is not meant to be limiting as the smart speaker 16, and may include more or fewer components than shown, or may combine certain components, or different components, such as may also include input and output devices, network access devices, buses, etc.
The processor 1600 may be a central processing unit (Central Processing Unit, CPU), and the processor 1600 may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 1601 may be an internal storage unit of the smart speaker 16 in some embodiments, such as a hard disk or a memory of the smart speaker 16. The memory 1601 may also be an external storage device of the Smart box 16 in other embodiments, such as a plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card) or the like, which are provided on the Smart box 16. Further, the memory 1601 may also include both internal storage units and external storage devices of the smart speaker 16. The memory 1601 is used to store an operating system, application programs, boot Loader (Boot Loader), data, and other programs, such as program code of the computer program. The memory 1601 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/smart speakers and methods may be implemented in other manners. For example, the apparatus/smart speaker embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a camera device/smart box, a recording medium, computer Memory, read-Only Memory (ROM), random access Memory (RAM, random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. Such as a U-disk, removable hard disk, magnetic or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.
Claims (8)
1. The method for adjusting the display position of the curved screen is characterized by comprising the following steps of:
acquiring a current image through a camera, and determining a depth distance and a relative angle between a face and the camera according to the current image;
determining a screen display area of the curved screen according to the depth distance and the relative angle;
acquiring video information to be displayed, and displaying the video information to be displayed at the screen display area; detecting a human face in real time by adopting a human face detection algorithm, and adjusting the display area of the curved screen in real time according to the position change of the monitored human face, wherein the display area of the screen corresponding to the twice movement has an overlapping part;
the determining the screen area of the curved screen according to the depth distance and the relative angle comprises the following steps:
acquiring a corresponding relation between a depth distance and an angle relation model, and selecting the angle relation model corresponding to the depth distance according to the corresponding relation;
selecting a screen display area corresponding to the relative angle according to the angle relation model;
the step of obtaining the current image through the camera, and determining the depth distance and the relative angle between the face and the camera according to the current image comprises the following steps:
when the screen display area is smaller than or equal to a preset area threshold, if at least two faces exist in the current image, acquiring the distance between the at least two faces;
if the distance is greater than a preset distance threshold, respectively detecting two faces with the distance greater than the preset distance threshold, determining the depth distance and the relative angle between the two faces and the camera so as to respectively determine corresponding screen display areas, and respectively displaying on a curved screen.
2. The method for adjusting the display position of a curved screen according to claim 1, comprising, before the current image is acquired by the camera:
acquiring a sound signal, and performing position detection according to the sound signal to obtain a detection result;
determining a user direction according to the detection result;
and selecting an optimal camera according to the user direction.
3. The method for adjusting the display position of a curved screen according to claim 1, comprising, before the current image is acquired by the camera:
acquiring a sound signal, and performing position detection according to the sound signal to obtain a detection result;
determining a user direction according to the detection result;
and rotating the camera according to the user direction.
4. The method for adjusting the display position of the curved screen according to claim 2 or 3, wherein the obtaining the sound signal, and performing position detection according to the sound signal, to obtain a detection result, includes:
collecting sound signals of at least two microphones by utilizing a microphone array, and calculating a time difference value for collecting the sound signals;
and determining the user position according to the time difference value.
5. The method for adjusting the display position of a curved screen according to claim 1, comprising, before the current image is acquired by the camera:
acquiring current images through cameras at all positions respectively, and judging the definition of a face in the current images;
and selecting an optimal camera according to the definition of the face.
6. An adjusting device for a display position of a curved screen, comprising:
the acquisition module is used for acquiring a current image through a camera, and determining the depth distance and the relative angle between the face and the camera according to the current image;
the determining module is used for determining a screen display area of the curved screen according to the depth distance and the relative angle;
the display module is used for acquiring video information to be displayed and displaying the video information to be displayed at the screen display area; detecting a human face in real time by adopting a human face detection algorithm, and adjusting the display area of the curved screen in real time according to the position change of the monitored human face, wherein the display area of the screen corresponding to the twice movement has an overlapping part;
the determining the screen area of the curved screen according to the depth distance and the relative angle comprises the following steps:
acquiring a corresponding relation between a depth distance and an angle relation model, and selecting the angle relation model corresponding to the depth distance according to the corresponding relation;
selecting a screen display area corresponding to the relative angle according to the angle relation model;
the step of obtaining the current image through the camera, and determining the depth distance and the relative angle between the face and the camera according to the current image comprises the following steps:
when the screen display area is smaller than or equal to a preset area threshold, if at least two faces exist in the current image, acquiring the distance between the at least two faces;
if the distance is greater than a preset distance threshold, respectively detecting two faces with the distance greater than the preset distance threshold, determining the depth distance and the relative angle between the two faces and the camera so as to respectively determine corresponding screen display areas, and respectively displaying on a curved screen.
7. A smart sound box comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor, when executing the computer program, implements the steps of a method for adjusting the display position of a curved screen according to any one of claims 1 to 5.
8. A computer-readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the steps of a method for adjusting a display position of a curved screen according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010558712.0A CN113608641B (en) | 2020-06-18 | 2020-06-18 | Method and device for adjusting display position of curved screen, intelligent sound box and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010558712.0A CN113608641B (en) | 2020-06-18 | 2020-06-18 | Method and device for adjusting display position of curved screen, intelligent sound box and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113608641A CN113608641A (en) | 2021-11-05 |
| CN113608641B true CN113608641B (en) | 2024-01-16 |
Family
ID=78303153
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010558712.0A Active CN113608641B (en) | 2020-06-18 | 2020-06-18 | Method and device for adjusting display position of curved screen, intelligent sound box and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113608641B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114468799A (en) * | 2022-02-25 | 2022-05-13 | 广东美的厨房电器制造有限公司 | Cooking equipment, control method and device thereof and readable storage medium |
| CN114811353B (en) * | 2022-04-28 | 2023-11-28 | 青岛海尔科技有限公司 | Control method of intelligent support based on voice, intelligent support and storage medium |
| CN115209193B (en) * | 2022-07-15 | 2024-03-12 | 海宁奕斯伟集成电路设计有限公司 | Display processing equipment and method and display system |
| CN115546111B (en) * | 2022-09-13 | 2023-12-05 | 武汉海微科技有限公司 | Curved surface screen detection method, device, equipment and storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20130133347A (en) * | 2012-05-29 | 2013-12-09 | 한국과학기술원 | Contents controll method and apparatus for touch panel |
| WO2015184810A1 (en) * | 2014-11-18 | 2015-12-10 | 中兴通讯股份有限公司 | Method and device for adjusting screen display |
| KR20160071797A (en) * | 2014-12-12 | 2016-06-22 | 삼성전자주식회사 | Display apparatus and control method thereof |
| CN106155200A (en) * | 2016-06-30 | 2016-11-23 | 联想(北京)有限公司 | A kind of electronic equipment and display packing |
| CN106201392A (en) * | 2016-06-27 | 2016-12-07 | 北京小米移动软件有限公司 | The display control method of curve screens and device |
| WO2017052143A1 (en) * | 2015-09-22 | 2017-03-30 | Samsung Electronics Co., Ltd. | Image display device and method of operating the same |
| CN106686520A (en) * | 2017-01-03 | 2017-05-17 | 南京地平线机器人技术有限公司 | Multi-channel audio system capable of tracking user and equipment with multi-channel audio system |
| CN106686423A (en) * | 2016-12-30 | 2017-05-17 | 惠科股份有限公司 | Multi-screen display method and display device |
| JP2018103580A (en) * | 2016-12-28 | 2018-07-05 | コニカミノルタ株式会社 | Image formation apparatus and program |
| CN108762104A (en) * | 2018-05-17 | 2018-11-06 | 江西午诺科技有限公司 | Speaker control method, device, readable storage medium storing program for executing and mobile terminal |
| CN109460074A (en) * | 2018-10-29 | 2019-03-12 | 歌尔科技有限公司 | A kind of audio frequency apparatus orientation display methods, device and audio frequency apparatus |
| CN209069251U (en) * | 2019-01-09 | 2019-07-05 | 郑州大学 | One kind can obstacle detouring smart electronics measuring scale |
| CN110858883A (en) * | 2018-08-24 | 2020-03-03 | 深圳市冠旭电子股份有限公司 | Intelligent sound box and use method thereof |
| CN111240780A (en) * | 2020-01-06 | 2020-06-05 | 北京奇艺世纪科技有限公司 | Image display method, image display device, display terminal and readable storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101975906B1 (en) * | 2012-01-09 | 2019-05-08 | 삼성전자주식회사 | Apparatus and method for scaling layout of application program in visual display unit |
| CN104238923B (en) * | 2014-07-29 | 2019-03-29 | 京东方科技集团股份有限公司 | A kind of display equipment and its working method |
-
2020
- 2020-06-18 CN CN202010558712.0A patent/CN113608641B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20130133347A (en) * | 2012-05-29 | 2013-12-09 | 한국과학기술원 | Contents controll method and apparatus for touch panel |
| WO2015184810A1 (en) * | 2014-11-18 | 2015-12-10 | 中兴通讯股份有限公司 | Method and device for adjusting screen display |
| KR20160071797A (en) * | 2014-12-12 | 2016-06-22 | 삼성전자주식회사 | Display apparatus and control method thereof |
| WO2017052143A1 (en) * | 2015-09-22 | 2017-03-30 | Samsung Electronics Co., Ltd. | Image display device and method of operating the same |
| CN106201392A (en) * | 2016-06-27 | 2016-12-07 | 北京小米移动软件有限公司 | The display control method of curve screens and device |
| CN106155200A (en) * | 2016-06-30 | 2016-11-23 | 联想(北京)有限公司 | A kind of electronic equipment and display packing |
| JP2018103580A (en) * | 2016-12-28 | 2018-07-05 | コニカミノルタ株式会社 | Image formation apparatus and program |
| CN106686423A (en) * | 2016-12-30 | 2017-05-17 | 惠科股份有限公司 | Multi-screen display method and display device |
| CN106686520A (en) * | 2017-01-03 | 2017-05-17 | 南京地平线机器人技术有限公司 | Multi-channel audio system capable of tracking user and equipment with multi-channel audio system |
| CN108762104A (en) * | 2018-05-17 | 2018-11-06 | 江西午诺科技有限公司 | Speaker control method, device, readable storage medium storing program for executing and mobile terminal |
| CN110858883A (en) * | 2018-08-24 | 2020-03-03 | 深圳市冠旭电子股份有限公司 | Intelligent sound box and use method thereof |
| CN109460074A (en) * | 2018-10-29 | 2019-03-12 | 歌尔科技有限公司 | A kind of audio frequency apparatus orientation display methods, device and audio frequency apparatus |
| CN209069251U (en) * | 2019-01-09 | 2019-07-05 | 郑州大学 | One kind can obstacle detouring smart electronics measuring scale |
| CN111240780A (en) * | 2020-01-06 | 2020-06-05 | 北京奇艺世纪科技有限公司 | Image display method, image display device, display terminal and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113608641A (en) | 2021-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113608641B (en) | Method and device for adjusting display position of curved screen, intelligent sound box and storage medium | |
| CN110660066B (en) | Training method of network, image processing method, network, terminal equipment and medium | |
| CN109166156B (en) | Camera calibration image generation method, mobile terminal and storage medium | |
| CN108230245B (en) | Image splicing method, image splicing device and electronic equipment | |
| US7554575B2 (en) | Fast imaging system calibration | |
| CN108833784B (en) | Self-adaptive composition method, mobile terminal and computer readable storage medium | |
| CN111062234A (en) | Monitoring method, intelligent terminal and computer readable storage medium | |
| CN105100688A (en) | Image processing method, image processing device and monitoring system | |
| CN109040596B (en) | Method for adjusting camera, mobile terminal and storage medium | |
| CN111444748B (en) | Sitting posture detection method, device, equipment and storage medium | |
| CN103260081A (en) | Method and device of video image zooming processing | |
| CN112101123B (en) | Attention detection method and device | |
| CN112689221B (en) | Recording method, recording device, electronic equipment and computer readable storage medium | |
| US20220245839A1 (en) | Image registration, fusion and shielding detection methods and apparatuses, and electronic device | |
| US10417743B2 (en) | Image processing device, image processing method and computer readable medium | |
| CN112633218B (en) | Face detection method, face detection device, terminal equipment and computer readable storage medium | |
| JP6991045B2 (en) | Image processing device, control method of image processing device | |
| WO2024022301A1 (en) | Visual angle path acquisition method and apparatus, and electronic device and medium | |
| CN109688381B (en) | VR monitoring method, device, equipment and storage medium | |
| CN111402391A (en) | User face image display method, display device and corresponding storage medium | |
| CN111340722A (en) | Image processing method, processing device, terminal device and readable storage medium | |
| CN114821987B (en) | Reminding method and device and terminal equipment | |
| CN114463393A (en) | Image registration method, computer equipment and storage device | |
| CN114757866A (en) | Definition detection method, device and computer storage medium | |
| CN111353929A (en) | Image processing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |