CN107147868B - Method for processing collected image and electronic equipment - Google Patents
Method for processing collected image and electronic equipment Download PDFInfo
- Publication number
- CN107147868B CN107147868B CN201710426934.5A CN201710426934A CN107147868B CN 107147868 B CN107147868 B CN 107147868B CN 201710426934 A CN201710426934 A CN 201710426934A CN 107147868 B CN107147868 B CN 107147868B
- Authority
- CN
- China
- Prior art keywords
- image
- display direction
- window
- display
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the invention provides a method for processing a collected image and electronic equipment. The method for processing the acquired image is applied to the electronic equipment and comprises the following steps: displaying a first window; opening a first image acquisition unit corresponding to the first window; obtaining a first image through a first image acquisition unit, wherein the first image has a first display direction; determining whether the first display direction conforms to a predetermined display direction; when the first display direction does not accord with the preset display direction, generating a collection adjustment instruction; and adjusting the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the preset display direction.
Description
The divisional application is a divisional application of an invention patent application with the application date of 2011, 12 and 15, and the application number of 201110421886.3, namely a method for processing acquired images and electronic equipment.
Technical Field
The embodiment of the invention relates to a method for processing a collected image and electronic equipment.
Background
With the development of technology, various communication devices and applications have been widely used. Pure voice communication has gradually failed to meet the increasingly diverse requirements of users. Many electronic devices currently can communicate video via an image capture unit, such as a camera.
However, the user is not necessarily in a still state while engaged in video communication, and may need to move his or her own position. The orientation of the camera in existing electronic devices is fixed (e.g. a camera integrated in a notebook or a mobile phone) or requires the user to manually adjust the capturing orientation of the image capturing component. Therefore, when a user is engaged in a video call, it is often necessary to adjust and maintain their own position to ensure that an image capture device, such as a camera, can capture a front view of their face. This restricts the activities of the user during the video call, and causes inconvenience to the user.
Disclosure of Invention
An object of an embodiment of the present invention is to provide a method and an electronic device for processing a captured image, so as to solve the above problem.
One embodiment of the present invention provides a method for processing a captured image, which is applied to an electronic device, and the method comprises the following steps: displaying a first window; opening a first image acquisition unit corresponding to the first window; obtaining a first image through a first image acquisition unit, wherein the first image has a first display direction; determining whether the first display direction conforms to a predetermined display direction; when the first display direction does not accord with the preset display direction, generating a collection adjustment instruction; and adjusting the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the preset display direction.
Another embodiment of the present invention provides an electronic device including: a display unit configured to display a first window; the acquisition control unit is configured to start a first image acquisition unit corresponding to the first window; the first image acquisition unit is configured to obtain a first image through the first image acquisition unit, wherein the first image has a first display direction; the processing unit is configured to determine whether the first display direction accords with a preset display direction, and when the first display direction does not accord with the preset display direction, a collection adjustment instruction is generated; and the acquisition adjusting unit is configured to adjust the first image acquisition unit according to the acquisition adjusting instruction so as to obtain a second image, wherein the second image has a second display direction, and the second display direction accords with the preset display direction.
By the scheme provided by the embodiment of the invention, the image acquisition unit can be adjusted by determining whether the direction of the image acquired by the image acquisition unit accords with the preset display direction, so that the image with the preset display direction is provided for the corresponding application. So that the user does not need to adjust his own position in order to fit the acquisition direction of the image acquisition unit.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. The drawings in the following description are merely exemplary embodiments of the invention.
FIG. 1 is a flow chart depicting a method of processing a captured image in accordance with one embodiment of the present invention.
Fig. 2A and 2B are schematic diagrams illustrating a first image acquired by a first image acquisition unit according to an example of the present aspect.
FIG. 3 is a flow chart depicting a method of processing an acquired image in accordance with another embodiment of the present invention.
Fig. 4 is a flowchart describing a method of controlling the turning on of an associated image capturing element of the array of image capturing elements as the first window moves, after the method of controlling the capturing of an image shown in fig. 3, according to an embodiment of the present invention.
Fig. 5 is a flowchart illustrating a method of detecting a touch operation performed by a user in a first window through an image pickup element array.
Fig. 6 is a block diagram illustrating an exemplary structure of an electronic device according to an embodiment of the present invention.
Fig. 7 is a block diagram illustrating an exemplary structure of an electronic device according to another embodiment of the present invention.
Detailed Description
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that in the present specification and the drawings, steps and elements having substantially the same structure are denoted by the same reference numerals, and repeated explanation of the steps and elements will be omitted.
In the following embodiments of the present invention, an electronic device refers to a device capable of communicating with other devices. Specific forms of electronic devices include, but are not limited to, mobile phones, personal digital assistants, portable computers, tablet computers, game consoles, music players, and the like.
FIG. 1 is a flow chart depicting a method 100 of processing an acquired image in accordance with one embodiment of the invention. An explanatory diagram of an example situation in which an input image is displayed on a display device. Next, a method of processing a captured image according to an embodiment of the present invention will be described with reference to fig. 1. The method 100 of processing a captured image may be used in the electronic device described above. Further, in the present embodiment, the method 100 of processing a captured image may be applied to an electronic device including an image display unit and an image capturing unit.
As shown in fig. 1, in step S101, a first window is displayed. According to one example of the present invention, the first window may correspond to a first application installed on the electronic device. Then, in step S102, a first image capturing unit corresponding to the first window is turned on. According to one example of the present invention, an electronic device may include a display screen and a plurality of cameras positioned around the display screen. Which camera in the image acquisition unit the first window corresponds to can be determined according to the display position of the first window on the screen.
In step S103, a first image is obtained by a first image capturing unit, wherein the first image has a first display orientation. And determines whether the first display orientation corresponds to a predetermined display orientation in step S104. According to an example of the present invention, in step S104, an acquisition object in the first image may be identified, and it is determined whether a first display direction of the acquisition object conforms to a predetermined display direction. Further, according to another example of the present invention, the predetermined display direction may be a display direction of the first window.
Fig. 2A and 2B are schematic diagrams illustrating a first image acquired by a first image acquisition unit according to an example of the present aspect. As shown in FIG. 2A, the captured object in the first image 210 is user U1, user U1 having a first display orientation as indicated by arrow A. The first window 220 has a display direction as indicated by arrow B. In the example shown in fig. 2A, it may be determined that the first display orientation does not conform to the predetermined display orientation, i.e., the first display orientation is different from the display orientation of the first window 220.
Whereas, as shown in fig. 2B, the captured object in the first image 210' is user U2, user U2 has a first display orientation as indicated by arrow C. The first window 220' has a display direction as indicated by arrow D. In the example shown in fig. 2B, it may be determined that the first display direction coincides with the predetermined display direction, i.e., the first display direction is the same as the display direction of the first window 220.
Further, according to another example of the present invention, the method shown in fig. 1 may further include receiving a window rotation operation, wherein the window rotation operation may be used to display a display direction of the first window. In a case where the predetermined display direction is the display direction of the first window, it may be determined whether the first display direction corresponds to the display direction of the rotated window according to a window rotation operation. For example, in the example shown in fig. 2B, when a window rotation operation of rotating the displayed first window 90 degrees to the left is received, it may be determined that the first display orientation does not conform to the predetermined display orientation.
Then, in step S105, when the first display direction does not conform to the predetermined display direction, an acquisition adjustment instruction is generated. According to an example of the present invention, when the first display direction does not conform to the predetermined display direction, a separation angle between the first display direction and the predetermined display direction may be determined, and the acquisition adjustment instruction may be generated according to the separation angle. For example, in the example shown in fig. 2B, when a window rotation operation of rotating the displayed first window 180 degrees to the left is received, it may be determined that the interval angle between the first display direction and a predetermined display direction (i.e., the display direction of the first window) is 180 degrees.
Finally, in step S106, the first image capturing unit is adjusted according to the capturing adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the predetermined display direction. According to one example of this aspect, an acquisition unit rotation component coupled to the image acquisition unit may be included in the electronic device. In response to the acquisition adjustment instruction in step S106, the first image acquisition unit may be rotated according to the interval angle, and the second image may be obtained by the rotated first image acquisition unit. For example, in the example shown in fig. 2B, when a window rotation operation of rotating the displayed first window by 180 degrees is received, an acquisition adjustment instruction indicating that an interval angle between the first display direction and a predetermined display direction (i.e., the display direction of the first window) is 180 degrees may be generated. Then, in response to the acquisition adjustment instruction, the first image acquisition unit may be rotated by 180 degrees by the acquisition unit rotation member, and the second image may be obtained by the rotated first image acquisition unit.
Alternatively, according to another example of the present invention, an image rotating part connected to the image pickup unit may be included in the electronic device. In response to the acquisition adjustment instruction in step S106, the first image acquisition unit rotates the first image according to the interval angle to obtain a second image. For example, in the example shown in fig. 2B, when a window rotation operation of rotating the displayed first window by 180 degrees is received, an acquisition adjustment instruction indicating that an interval angle between the first display direction and a predetermined display direction (i.e., the display direction of the first window) is 180 degrees may be generated. The first image 210 is then rotated by 180 degrees by the acquisition unit in response to the acquisition adjustment instruction.
By the method for processing the acquired image, the image acquisition unit can be adjusted by determining whether the direction of the image acquired by the image acquisition unit conforms to the preset display direction, so that the image with the preset display direction is provided for the corresponding application. So that the user does not need to adjust his own position in order to fit the acquisition direction of the image acquisition unit.
Further, according to an example of the present aspect, the method illustrated in fig. 1 may further include providing the first image or the second image conforming to the predetermined display direction to the first application corresponding to the first window. According to an example of the present invention, the first application may be an instant messaging application capable of video transmission, or other application that supports image capture functionality or is capable of processing captured images.
As described in the above embodiments, the display unit may be a camera. However, the present invention is not limited thereto. FIG. 3 is a flow chart depicting a method 300 of processing an acquired image in accordance with another embodiment of the invention. The method 300 shown in fig. 3 is an example of the method 300 described in fig. 1. The method 300 of processing a captured image may be used in an electronic device that includes an array of image display elements and an array of image capture elements arranged in correspondence in a direction perpendicular to its screen.
According to an example of the present invention, the image display part array and the image pickup part array may be disposed on the same plane in a direction perpendicular to a screen of the electronic apparatus. For example, the image display component and the image capture component may be disposed in spaced rows and/or spaced columns within a transparent housing of the display screen. Thus, the image capturing section can capture an image of a user viewing the display content while the image display section displays the image.
Alternatively, according to another example of the present invention, the image display part array and the image pickup part array may be disposed on different planes in a direction perpendicular to a screen of the electronic device. For example, the array of image display components may be disposed proximate to a screen housing of the electronic device, while the array of image capture components is disposed behind a plane in which the array of image display components is disposed in a direction perpendicular to a screen of the electronic device. In this case, the image display sections in the image display section array may be switched between the on state and the off state at a predetermined frequency. When the image display part is closed, the image acquisition parts in the image acquisition part array can be opened to facilitate image acquisition through the transparent shell of the screen.
As shown in fig. 3, in step S301, a first window is displayed by the image display section array. The position of the first region in the first window is obtained in step S302. The first area may be less than or equal to a display area of the first window. For example, the first window may include an image display area and a function selection area, and the first area may be the image display area in the first window.
In step S303, an image capturing element in the array of image capturing elements corresponding to the first area is determined as a first image capturing unit according to the position of the first area. Then, the determined first image capturing unit is turned on in step S304.
As described above, the first area may be less than or equal to the display area of the first window, and accordingly the number of image capturing elements corresponding to the first area is less than or equal to the number of image capturing elements in the array of image capturing elements.
According to an example of the present invention, when the image display part array and the image pickup part array are disposed on the same plane in a direction perpendicular to the screen of the electronic device, the image pickup part corresponding to the first area may include a part located within a display range of the first window, and the image pickup part corresponding to the second area may include a part located within a display range of the second window. And when the image display part array and the image pickup part array are disposed on different planes in a direction perpendicular to the screen of the electronic device, the image pickup part corresponding to the first area may include the image pickup part in a range corresponding to the display area of the first window in the image pickup array, and the image pickup part corresponding to the second area may include the image pickup part in a range corresponding to the display area of the second window in the image pickup array.
Then, in step S305, a first image is obtained by the first image capturing unit, wherein the first image has a first display direction. And determines whether the first display orientation corresponds to a predetermined display orientation in step S306. According to an example of the present invention, in step S306, an acquisition object in the first image may be identified, and it is determined whether a first display direction of the acquisition object conforms to a predetermined display direction. Further, according to another example of the present invention, the predetermined display direction may be a display direction of the first window.
When the first display direction does not conform to the predetermined display direction, in step S307, a capture adjustment instruction is generated. Finally, in step S308, the first image capturing unit is adjusted according to the capturing adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the predetermined display direction.
With the method according to the present embodiment, when the display screen of the electronic device including the image display element array and the image pickup element array disposed correspondingly in the direction perpendicular to the screen thereof is placed horizontally, a pickup image conforming to a predetermined display direction can be obtained regardless of which side of the display screen the user is located.
According to an example of the present invention, a first image or a second image conforming to a predetermined display direction may be displayed in the first region. Alternatively, the display content displayed in the first region may be independent of the image captured by the first image capturing unit. For example, when the first application corresponding to the first window is an instant messaging application, an image of an opposite party communicating with a user using the current electronic device may be displayed in the first area. Since the user views the image of the opposite party of communication in the first area while the user is in a video call, the front view of the user can be collected by the image collecting part corresponding to the first area to be transmitted to the opposite party of communication. In addition, when the first application corresponding to the first window is an instant messaging application, in addition to the first area, a local image viewing area may be included in the first window to display the first image or the second image that conforms to the predetermined display direction.
When the display content displayed in the first area can be independent of the image acquired by the first image acquisition unit, the direction of the display content in the first area can be rotated according to the window rotation operation under the condition of receiving the window rotation operation, and meanwhile, an acquisition adjustment instruction can be generated according to the rotation angle of the window and the first image acquisition unit can be adjusted.
For example, in the example shown in fig. 2B, when a window rotation operation of rotating the displayed first window by 90 degrees to the left is received, the first window 220 'is rotated by 90 degrees to the left, and an acquisition adjustment instruction may be generated to rotate the first image acquisition unit by 90 degrees to the left, or to rotate the first image 210' acquired by the first image acquisition unit by 90 degrees to the right thereafter.
In addition, according to another example of the present invention, the method shown in fig. 3 may further include determining a free area of the array of image capturing elements where the window is not displayed, and turning off an image capturing element of the array of image capturing elements corresponding to the free area. For example, a free area of the image capturing element array where no window is displayed may be determined at predetermined time intervals. Further, when the first window is closed, the image pickup section corresponding to the first region in the first window may be closed. Thereby saving the power consumption of the image acquisition part and the burden of the electronic equipment for processing the image.
Further, on the other hand, when the user is not necessarily in a stationary state while viewing the window, he or she can move his or her own position, and for easy viewing, the user can operate the window to move the display position of the window. In this case, it may be caused that the capturing means, which is turned on according to the position of the first area when the first window is initially displayed, cannot capture the image desired by the user. Therefore, according to another example of the present invention, after the method 300 described in fig. 3, the first window may also be moved according to the first window moving instruction, and the related image capturing component in the image capturing component array may be turned on according to the moved first window. FIG. 4 is a flow chart illustrating a method 400 of controlling the activation of an associated image capturing component in an array of image capturing components as a first window moves after the method 300 of controlling the capturing of an image shown in FIG. 3, in accordance with one embodiment of the present invention.
As shown in fig. 4, in step S401, the first window is moved in accordance with the first window movement instruction. According to an example of the present invention, a first window moving instruction may be received from a user before moving the first window according to the first window moving instruction.
Alternatively, according to another example of the present invention, before moving the first window according to the first window moving instruction, the following steps may be further included: identifying the acquisition object in the first image after obtaining the first image; determining a position of the acquisition object in the first image; and generating a first window moving instruction when the position of the acquisition object in the first image exceeds a predetermined range. For example, the acquisition object may be a user who views the first window, and it may be predetermined that the user should be in a middle area of the first image in the acquired first image. The position of the user viewing the first window in the first image may be determined by image recognition, and the first window moving instruction may be generated when the position of the user in the first image exceeds a predetermined middle area of the first image. More specifically, the moving direction of the first window may be determined according to the position of the user in the first image, so as to generate a corresponding first window moving instruction.
In step S402, the position of the first area in the moved first window is obtained in real time. Then, in step S403, the image capturing element in the array of image capturing elements corresponding to the first area in the moved first window is newly determined as the first image capturing unit according to the position of the first area in the moved first window. Then, in step S404, the newly determined first image capturing unit is turned on.
By the method provided by the embodiment, when the position of the first window viewed by the user is moved, the corresponding image acquisition component in the image acquisition component array can be opened along with the moving position of the first window.
Further, according to another example of the present invention, it is also possible to detect a touch operation of an operating body on a display screen by an image pickup section. Specifically, fig. 5 is a flow chart illustrating a method 500 of detecting a touch operation performed by a user in a first window by an array of image capturing components.
As shown in fig. 5, in step S501, the position of the second region in the first window is obtained. According to an example of the present invention, the first window may include an image display area and a function selection area, the first area may be the image display area in the first window, and the second area may be the function selection area in the first window.
In step S502, according to the position of the second area, image capturing components corresponding to the second area in the array of image capturing components are turned on, wherein the number of the image capturing components corresponding to the second area is less than or equal to the number of the image capturing components in the array of image capturing components. According to an example of the present invention, the first area and the second area may be two different areas in the first window and do not overlap each other. Alternatively, the first region may overlap or partially overlap the second region. In the case where the first region and the second region at least partially overlap, when an operation body such as a finger of a user operates on the display screen in the overlapping region, while the first image is obtained by the image capturing array, the finger of the user in the first image may also be identified, thereby determining the position of the finger.
In step S503, the position of the operation body is obtained by the image pickup means corresponding to the second region. Finally, in step S504, the position of the operation body is provided to the first application. So that the first application can determine the corresponding function option according to the position of the operation body and execute the function.
By the method provided by the embodiment, the corresponding image acquisition component in the image acquisition component array can be opened according to the window watched by the user, so that the image corresponding to the window and the touch input corresponding to the window are acquired by the image acquisition array.
Next, an electronic apparatus according to an embodiment of the present invention is described with reference to fig. 6. Fig. 6 is a block diagram illustrating an exemplary configuration of an electronic device 600 according to an embodiment of the present invention. As shown in fig. 6, the electronic device of the present embodiment may include a display unit 610, an acquisition control unit 620, a first image acquisition unit 630, a processing unit 640, and an acquisition adjustment unit 650. The various units of the electronic device 600 perform the various steps/functions of the display method of fig. 1 described above, and therefore, for brevity of description, will not be described in detail.
For example, the display unit 610 may display a first window. According to one example of the present invention, the first window may correspond to a first application installed on the electronic device. The acquisition control unit 620 may turn on the first image acquisition unit 630 corresponding to the first window. According to one example of the present invention, an electronic device may include a display screen and a plurality of cameras positioned around the display screen. Which camera in the image acquisition unit the first window corresponds to can be determined according to the display position of the first window on the screen.
A first image may be obtained by the first image capturing unit 630, wherein the first image has a first display direction. The processing unit 640 may determine whether the first display direction corresponds to a predetermined display direction, and generate an acquisition adjustment instruction when the first display direction does not correspond to the predetermined display direction. According to an example of the present invention, the processing unit 640 may identify the acquisition object in the first image and determine whether a first display direction of the acquisition object corresponds to a predetermined display direction. Further, according to another example of the present invention, the predetermined display direction may be a display direction of the first window.
Further, according to another example of the present invention, the electronic device 600 may further include a receiving unit to receive a window rotating operation. And in a case where the predetermined display direction is the display direction of the first window, the processing unit may determine whether the first display direction corresponds to the display direction of the rotated window according to the window rotating operation.
Further, according to another example of the present invention, when the first display direction does not conform to the predetermined display direction, the processing unit may determine an interval angle between the first display direction and the predetermined display direction, and generate the acquisition adjustment instruction according to the interval angle.
The capture adjustment unit 650 may adjust the first image capture unit according to the capture adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction corresponds to the predetermined display direction. According to an example of the present aspect, the acquisition adjustment unit 650 may rotate the first image acquisition unit according to the interval angle in response to the acquisition adjustment instruction, and obtain the second image by the rotated first image acquisition unit. Alternatively, according to another example of the present invention, the acquisition adjusting unit 650 may rotate the first image according to the interval angle in response to the acquisition adjustment instruction to obtain the second image.
With the electronic device provided by the embodiment, the image acquisition unit can be adjusted by determining whether the direction of the image acquired by the image acquisition unit conforms to the predetermined display direction, so that the image with the predetermined display direction is provided for the corresponding application. So that the user does not need to adjust his own position in order to fit the acquisition direction of the image acquisition unit.
Further, according to an example of the present aspect, the processing unit in the electronic device shown in fig. 6 may further provide the first image or the second image conforming to the predetermined display direction to the first application corresponding to the first window. According to an example of the present invention, the first application may be an instant messaging application capable of video transmission, or other application that supports image capture functionality or is capable of processing captured images.
As described in the above embodiments, the display unit may be a camera. However, the present invention is not limited thereto. Fig. 7 is a block diagram illustrating an exemplary structure of an electronic device 700 according to another embodiment of the present invention. The electronic device 700 shown in fig. 7 is one example of the electronic device 600 described in fig. 6. Next, an electronic device according to another embodiment of the present invention is described with reference to fig. 7.
As shown in fig. 7, the electronic apparatus of the present embodiment may include an image display section array 710, an image pickup section array 720, an area position obtaining unit 730, a pickup control unit 740, and a processing unit 750 and a pickup adjusting unit 760. The various units of the electronic device 700 perform the various steps/functions of the display method of fig. 3 described above, and therefore, for brevity of description, will not be described in detail.
For example, the image display part array 710 may display a first window. The image pickup part array 720 may be disposed in a direction perpendicular to a screen of the electronic device, corresponding to the image display part array 710. According to an example of the present invention, the image display part array and the image pickup part array may be disposed on the same plane in a direction perpendicular to a screen of the electronic apparatus. For example, the image display component and the image capture component may be disposed in spaced rows and/or spaced columns within a transparent housing of the display screen. Thus, the image capturing section can capture an image of a user viewing the display content while the image display section displays the image.
Alternatively, according to another example of the present invention, the image display part array and the image pickup part array may be disposed on different planes in a direction perpendicular to a screen of the electronic device. For example, the array of image display components may be disposed proximate to a screen housing of the electronic device, while the array of image capture components is disposed behind a plane in which the array of image display components is disposed in a direction perpendicular to a screen of the electronic device. In this case, the image display sections in the image display section array may be switched between the on state and the off state at a predetermined frequency. When the image display part is closed, the image acquisition parts in the image acquisition part array can be opened to facilitate image acquisition through the transparent shell of the screen.
The first image pickup unit shown in fig. 6 may be constituted by a part of the image pickup element in the image pickup element array 720, which will be described later.
The region position obtaining unit 730 may obtain a position of the first region in the first window. The first area may be less than or equal to a display area of the first window. For example, the first window may include an image display area and a function selection area, and the first area may be the image display area in the first window.
Acquisition control unit 740 may include a unit determination module 741 and a switch control module 742. The unit determining module 741 may determine, according to the position of the first area, an image capturing element corresponding to the first area in the array of image capturing elements as a first image capturing unit. The switch control module 742 may turn on the determined first image capturing unit.
As described above, the first area may be less than or equal to the display area of the first window, and accordingly the number of image capturing elements corresponding to the first area is less than or equal to the number of image capturing elements in the array of image capturing elements.
According to an example of the present invention, when the image display part array and the image pickup part array are disposed on the same plane in a direction perpendicular to the screen of the electronic device, the image pickup part corresponding to the first area may include a part located within a display range of the first window, and the image pickup part corresponding to the second area may include a part located within a display range of the second window. And when the image display part array and the image pickup part array are disposed on different planes in a direction perpendicular to the screen of the electronic device, the image pickup part corresponding to the first area may include the image pickup part in a range corresponding to the display area of the first window in the image pickup array, and the image pickup part corresponding to the second area may include the image pickup part in a range corresponding to the display area of the second window in the image pickup array.
A first image may be obtained by a first image acquisition unit, wherein the first image has a first display orientation. The processing unit 750 may determine whether the first display direction corresponds to a predetermined display direction, and generate an acquisition adjustment instruction when the first display direction does not correspond to the predetermined display direction. According to an example of the present invention, the processing unit 750 may identify the acquisition object in the first image and determine whether a first display direction of the acquisition object conforms to a predetermined display direction. Further, according to another example of the present invention, the predetermined display direction may be a display direction of the first window.
Further, according to another example of the present invention, the electronic device 700 may further include a receiving unit to receive a window rotating operation. And in a case where the predetermined display direction is the display direction of the first window, the processing unit may determine whether the first display direction corresponds to the display direction of the rotated window according to the window rotating operation.
Further, according to another example of the present invention, when the first display direction does not conform to the predetermined display direction, the processing unit may determine an interval angle between the first display direction and the predetermined display direction, and generate the acquisition adjustment instruction according to the interval angle.
The capture adjustment unit 760 may adjust the first image capture unit according to the capture adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction corresponds to a predetermined display direction. According to an example of the present aspect, the acquisition adjustment unit 760 may rotate the first image acquisition unit according to the interval angle in response to the acquisition adjustment instruction, and obtain the second image through the rotated first image acquisition unit. Alternatively, according to another example of the present invention, the acquisition adjusting unit 760 may rotate the first image according to the interval angle in response to the acquisition adjustment instruction to obtain the second image.
With the electronic apparatus according to the present embodiment, when the display screen of the electronic apparatus including the image display element array and the image pickup element array disposed correspondingly in the direction perpendicular to the screen thereof is placed horizontally, a pickup image conforming to a predetermined display direction can be obtained regardless of which side of the display screen the user is located.
According to an example of the present invention, the electronic device shown in fig. 7 may further include a free area determination unit to determine a free area of the image capturing element array where the window is not displayed, and turn off an image capturing element of the image capturing element array corresponding to the free area. For example, the free area determination unit may determine a free area of the image pickup element array where no window is displayed at predetermined time intervals. Further, the acquisition control unit may close the image acquisition part corresponding to the first region in the first window and/or the second region in the second window when the first window and/or is closed. Thereby further saving the power consumption of the image acquisition part and the burden of the electronic equipment for processing the image.
Further, on the other hand, when the user is not necessarily in a stationary state while viewing the window, he or she can move his or her own position, and for easy viewing, the user can operate the window to move the display position of the window. In this case, it may be caused that the capturing means, which is turned on according to the position of the first area when the first window is initially displayed, cannot capture the image desired by the user. Therefore, according to another example of the present invention, in the electronic device shown in fig. 7, the processing unit may move the first window according to the first window moving instruction. The region position obtaining unit may obtain the position of the first region in the moved first window in real time. The unit determining module may re-determine, as the first image capturing unit, an image capturing element of the array of image capturing elements corresponding to the first area in the moved first window, according to the position of the first area in the moved first window. The switch control module may turn on the redetermined first image capturing unit.
Further, while the respective image pickup elements in the array of image pickup elements are turned on in accordance with the moved position of the first window, the switch control module may turn off the image pickup elements corresponding to the vacant regions in the array of image pickup elements, as described above.
According to another example of the present invention, the electronic device may further include a touch sensing unit disposed to overlap the screen to detect a touch input of the operating body. Further, according to another example of the present invention, it is also possible to detect a touch operation of an operating body on a display screen by an image pickup section.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. And the software modules may be disposed in any form of computer storage media. To clearly illustrate this interchangeability of hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It should be understood by those skilled in the art that various modifications, combinations, partial combinations and substitutions may be made in the present invention depending on design requirements and other factors as long as they are within the scope of the appended claims and their equivalents.
Claims (17)
1. A method of processing a captured image for use in an electronic device comprising an array of image capturing elements, the method comprising:
displaying a first window;
opening an image acquisition component in the image acquisition component array, which corresponds to the display position of the first area in the first window on the display screen, as a first image acquisition unit, wherein the first window is moved according to a first window movement instruction, the position of the first area in the moved first window is obtained in real time, and the image acquisition component in the image acquisition component array, which corresponds to the first area in the moved first window, is re-determined as the first image acquisition unit according to the position of the first area in the moved first window;
obtaining a first image by the first image acquisition unit, wherein the first image has a first display direction;
determining whether the first display direction conforms to a predetermined display direction;
when the first display direction does not accord with the preset display direction, generating a collection adjustment instruction; and
adjusting the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the preset display direction.
2. The method of claim 1, wherein the determining whether the first display orientation conforms to a predetermined display orientation comprises:
identifying an acquisition object in the first image;
determining whether a first display orientation of the acquisition object corresponds to the predetermined display orientation.
3. The method of claim 1, wherein
When the first display direction does not accord with the preset display direction, generating a collection adjustment instruction comprises:
determining a spacing angle between the first display direction and the predetermined display direction;
and generating an acquisition adjusting instruction according to the interval angle.
4. The method of claim 3, wherein said adjusting said first image acquisition unit to obtain a second image in accordance with said acquisition adjustment instructions comprises:
responding to the acquisition adjusting instruction, and rotating the first image acquisition unit according to the interval angle; and
and obtaining the second image through the rotated first image acquisition unit.
5. The method of claim 1, wherein
The electronic device includes: an image display component array and the image acquisition component array which are correspondingly arranged along the direction vertical to the screen of the electronic equipment,
the displaying the first window includes:
displaying the first window by the array of image display components;
the turning on the first image capturing unit includes:
obtaining a position of a first region in the first window;
according to the position of the first area, determining an image acquisition component corresponding to the first area in the image acquisition component array as the first image acquisition unit; and
and starting the determined first image acquisition unit.
6. The method of claim 1, further comprising:
and providing a first image or a second image which accords with the preset display direction to a first application corresponding to the first window.
7. A method for processing an acquired image, applied to an electronic device, comprises the following steps:
displaying a first window;
opening a first image acquisition unit corresponding to the first window;
obtaining a first image by the first image acquisition unit, wherein the first image has a first display direction;
determining whether the first display direction conforms to a predetermined display direction;
when the first display direction does not accord with the preset display direction, generating a collection adjustment instruction; and
adjusting the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the predetermined display direction, wherein
The predetermined display direction is a display direction of the first window.
8. The method of claim 7, wherein the determining whether the first display orientation conforms to a predetermined display orientation comprises:
receiving window rotation operation;
and determining whether the first display direction accords with the display direction of the rotated window according to the window rotation operation.
9. A method for processing an acquired image, applied to an electronic device, comprises the following steps:
displaying a first window;
opening a first image acquisition unit corresponding to the first window;
obtaining a first image by the first image acquisition unit, wherein the first image has a first display direction;
determining whether the first display direction accords with a preset display direction, wherein the preset display direction is the display direction of the first window;
when the first display direction does not accord with the preset display direction, generating a collection adjustment instruction; and
adjusting the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction conforms to the predetermined display direction, wherein
When the first display direction does not accord with the preset display direction, generating a collection adjustment instruction comprises:
determining a spacing angle between the first display direction and the predetermined display direction;
generating an acquisition adjustment instruction according to the interval angle;
the adjusting the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image comprises:
in response to the acquisition adjustment instruction, rotating the first image acquired by the first image acquisition unit according to the interval angle to acquire the second image.
10. An electronic device, comprising:
an array of image acquisition components;
a display unit configured to display a first window;
the acquisition control unit is configured to start an image acquisition component in the image acquisition component array, which corresponds to the display position of the first area in the first window on the display screen, to serve as a first image acquisition unit, wherein the first window is moved according to a first window movement instruction, the position of the first area in the moved first window is obtained in real time, and the image acquisition component in the image acquisition component array, which corresponds to the first area in the moved first window, is determined as the first image acquisition unit again according to the position of the first area in the moved first window;
the first image acquisition unit is configured to obtain a first image through the first image acquisition unit, wherein the first image has a first display direction;
the processing unit is configured to determine whether the first display direction accords with a preset display direction, and when the first display direction does not accord with the preset display direction, a collection adjusting instruction is generated;
the acquisition adjusting unit is configured to adjust the first image acquisition unit according to the acquisition adjusting instruction so as to obtain a second image, wherein the second image has a second display direction, and the second display direction accords with the preset display direction.
11. The electronic device of claim 10, wherein
The processing unit is further configured to identify an acquisition object in the first image, and
the processing unit determines whether a first display orientation of the acquisition object corresponds to the predetermined display orientation.
12. The electronic device of claim 10, wherein
The processing unit is further configured to determine a separation angle between the first display direction and the predetermined display direction, and generate the acquisition adjustment instruction according to the separation angle.
13. The electronic device of claim 12, wherein
The acquisition adjusting unit responds to the acquisition adjusting instruction and rotates the first image acquisition unit according to the interval angle; and
and obtaining the second image through the rotated first image acquisition unit.
14. The electronic device of claim 10, wherein
The display unit includes an image display section array through which the first window is displayed;
the first image acquisition unit is composed of a partial image acquisition part in an image acquisition part array of the electronic device, wherein the image acquisition part array is arranged corresponding to the image display part array along a direction perpendicular to a screen of the electronic device;
the electronic device further includes:
an area position obtaining unit configured to obtain a position of a first area in the first window; the acquisition control unit includes:
a unit determining module configured to determine, according to a position of the first area, an image capturing component corresponding to the first area in the array of image capturing components as the first image capturing unit; and
a switch control module configured to turn on the determined first image capturing unit.
15. The electronic device of claim 10, wherein
The processing unit provides a first image or a second image which accords with the preset display direction to a first application corresponding to the first window.
16. An electronic device, comprising:
a display unit configured to display a first window;
the acquisition control unit is configured to start a first image acquisition unit corresponding to the first window;
the first image acquisition unit is configured to obtain a first image through the first image acquisition unit, wherein the first image has a first display direction;
the processing unit is configured to determine whether the first display direction accords with a preset display direction, and when the first display direction does not accord with the preset display direction, a collection adjusting instruction is generated;
an acquisition adjustment unit configured to adjust the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction corresponds to the predetermined display direction, wherein
The preset display direction is the display direction of the first window;
the electronic device further includes:
a receiving unit configured to receive a window rotation operation;
and the processing unit determines whether the first display direction accords with the display direction of the rotated window according to the window rotation operation.
17. An electronic device, comprising:
a display unit configured to display a first window;
the acquisition control unit is configured to start a first image acquisition unit corresponding to the first window;
the first image acquisition unit is configured to obtain a first image through the first image acquisition unit, wherein the first image has a first display direction;
the processing unit is configured to determine whether the first display direction accords with a preset display direction, wherein the preset display direction is the display direction of the first window, and when the first display direction does not accord with the preset display direction, a collection adjusting instruction is generated;
an acquisition adjustment unit configured to adjust the first image acquisition unit according to the acquisition adjustment instruction to obtain a second image, wherein the second image has a second display direction, and the second display direction corresponds to the predetermined display direction, wherein
The processing unit is further configured to determine an interval angle between the first display direction and the predetermined display direction, and generate the acquisition adjustment instruction according to the interval angle;
the acquisition adjusting unit responds to the acquisition adjusting instruction, and rotates the first image acquired by the first image acquisition unit according to the interval angle to acquire the second image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710426934.5A CN107147868B (en) | 2011-12-15 | 2011-12-15 | Method for processing collected image and electronic equipment |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110421886.3A CN103167263B (en) | 2011-12-15 | 2011-12-15 | Collected image processing method and electronic equipment |
| CN201710426934.5A CN107147868B (en) | 2011-12-15 | 2011-12-15 | Method for processing collected image and electronic equipment |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110421886.3A Division CN103167263B (en) | 2011-12-15 | 2011-12-15 | Collected image processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107147868A CN107147868A (en) | 2017-09-08 |
| CN107147868B true CN107147868B (en) | 2021-06-15 |
Family
ID=48589972
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710426934.5A Active CN107147868B (en) | 2011-12-15 | 2011-12-15 | Method for processing collected image and electronic equipment |
| CN201110421886.3A Active CN103167263B (en) | 2011-12-15 | 2011-12-15 | Collected image processing method and electronic equipment |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110421886.3A Active CN103167263B (en) | 2011-12-15 | 2011-12-15 | Collected image processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN107147868B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104571796B (en) * | 2013-10-28 | 2018-12-14 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| US20150281141A1 (en) * | 2014-03-31 | 2015-10-01 | Htc Corporation | Electronic device of messaging and method thereof |
| CN103885611B (en) * | 2014-04-22 | 2018-01-19 | 锤子科技（北京）股份有限公司 | A kind of method and apparatus for adjusting image |
| CN104469252B (en) * | 2014-11-20 | 2019-02-01 | 深圳怡化电脑股份有限公司 | Facial image for VTM extracts implementation method, apparatus and system |
| CN106210507A (en) * | 2016-06-27 | 2016-12-07 | 联想(北京)有限公司 | Image adjusting method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020080836A (en) * | 2001-04-18 | 2002-10-26 | 사단법인 고등기술연구원 연구조합 | Apparatus for measuring coordinate based on optical triangulation using the images |
| CN101415103A (en) * | 2007-10-19 | 2009-04-22 | 英华达（南京）科技有限公司 | Method for regulating video signal picture |
| CN201639664U (en) * | 2010-02-10 | 2010-11-17 | 青岛海信移动通信技术股份有限公司 | Photographing system and mobile terminal with same |
| CN101945287A (en) * | 2010-10-14 | 2011-01-12 | 杭州华三通信技术有限公司 | ROI encoding method and system thereof |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100619811B1 (en) * | 2003-09-06 | 2006-09-08 | 엘지전자 주식회사 | Picture auto-reverse apparatus for mobile terminal with camera |
| KR100708178B1 (en) * | 2005-09-01 | 2007-04-16 | 삼성전자주식회사 | Method for image processing, apparatus and information storage medium storing image information therefor |
| JP4816336B2 (en) * | 2006-02-07 | 2011-11-16 | 日本ビクター株式会社 | Imaging method and imaging apparatus |
| GB2439098A (en) * | 2006-06-12 | 2007-12-19 | Sharp Kk | Image sensor and display |
| CN101068309A (en) * | 2007-05-24 | 2007-11-07 | 中兴通讯股份有限公司 | Method and device for automatic rotating mobile terminal camera head shooting results |
| EP2333652B1 (en) * | 2008-09-29 | 2016-11-02 | Panasonic Intellectual Property Corporation of America | Method and apparatus for improving privacy of users of a display device for several users wherein each user has a private space allocated to him |
| JP4983784B2 (en) * | 2008-12-18 | 2012-07-25 | ソニー株式会社 | Imaging system, image presentation method, control device, program |
| CN101853048B (en) * | 2009-03-31 | 2012-06-06 | 联想(北京)有限公司 | Adjustable image display and acquisition device |
| CN101924857A (en) * | 2009-06-12 | 2010-12-22 | 深圳市福智软件技术有限公司 | Method for keeping video film upright and videoing device |
| CN101998046A (en) * | 2009-08-21 | 2011-03-30 | 鸿富锦精密工业（深圳）有限公司 | Image pickup device and adjusting method thereof |
| CN102158680A (en) * | 2010-02-11 | 2011-08-17 | 北京华旗随身数码股份有限公司 | Telephone conference terminal with visualization function |
| CN101917548A (en) * | 2010-08-11 | 2010-12-15 | 无锡中星微电子有限公司 | Image pickup device and method for adaptively adjusting picture |
| CN102170564A (en) * | 2011-03-28 | 2011-08-31 | 上海理工大学 | Intelligent high-definition high-frame optical monitoring camera system based on periphery component interface express (PCIE) interface |
-
2011
- 2011-12-15 CN CN201710426934.5A patent/CN107147868B/en active Active
- 2011-12-15 CN CN201110421886.3A patent/CN103167263B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020080836A (en) * | 2001-04-18 | 2002-10-26 | 사단법인 고등기술연구원 연구조합 | Apparatus for measuring coordinate based on optical triangulation using the images |
| CN101415103A (en) * | 2007-10-19 | 2009-04-22 | 英华达（南京）科技有限公司 | Method for regulating video signal picture |
| CN201639664U (en) * | 2010-02-10 | 2010-11-17 | 青岛海信移动通信技术股份有限公司 | Photographing system and mobile terminal with same |
| CN101945287A (en) * | 2010-10-14 | 2011-01-12 | 杭州华三通信技术有限公司 | ROI encoding method and system thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103167263B (en) | 2017-05-24 |
| CN103167263A (en) | 2013-06-19 |
| CN107147868A (en) | 2017-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101496467B1 (en) | Mobile terminal enable to shot of panorama and method for controlling operation thereof | |
| US9449583B2 (en) | Control method and electronic apparatus | |
| CN108449641B (en) | Method, device, computer equipment and storage medium for playing media stream | |
| KR101604846B1 (en) | Mobile terminal and operation control method thereof | |
| CN107147868B (en) | Method for processing collected image and electronic equipment | |
| CN106791893A (en) | Net cast method and device | |
| WO2016038971A1 (en) | Imaging control device, imaging control method, camera, camera system and program | |
| JP4591798B2 (en) | Terminal device and program | |
| CN110602321A (en) | Application program switching method and device, electronic device and storage medium | |
| KR20100064873A (en) | Terminal and method for controlling the same | |
| KR20090101733A (en) | Mobile terminal and displaying method of display information using face recognition thereof | |
| CN110121084B (en) | Method, device and system for switching ports | |
| CN109726064B (en) | Method, device and system for simulating abnormal operation of client and storage medium | |
| EP2930924A1 (en) | Method of displaying on a single screen images captured by plural cameras and electronic device adapted thereto | |
| CN113938748B (en) | Video playing method, device, terminal, storage medium and program product | |
| EP3131282A1 (en) | Method and apparatus for controlling video image and terminal | |
| CN107515669A (en) | Display methods and device | |
| CN110941375A (en) | Method and device for locally amplifying image and storage medium | |
| CN116871982A (en) | Device and method for detecting spindle of numerical control machine tool and terminal equipment | |
| CN106817608A (en) | Realize the method and device of local display | |
| JP2005025268A (en) | Electronic device and method for controlling display | |
| CN108804894A (en) | Unlocking screen method, apparatus, mobile terminal and computer-readable medium | |
| CN110493457A (en) | A kind of terminal equipment control method and terminal device | |
| KR20120045850A (en) | Mobile terminal | |
| CN108391050A (en) | A kind of image processing method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |