WO2005119591A1 - Dispositif de commande d'affichage, procédé de commande d'affichage, programme et appareil portable - Google Patents
Dispositif de commande d'affichage, procédé de commande d'affichage, programme et appareil portable Download PDFInfo
- Publication number
- WO2005119591A1 WO2005119591A1 PCT/JP2005/009180 JP2005009180W WO2005119591A1 WO 2005119591 A1 WO2005119591 A1 WO 2005119591A1 JP 2005009180 W JP2005009180 W JP 2005009180W WO 2005119591 A1 WO2005119591 A1 WO 2005119591A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- display
- feature
- camera
- extracted
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
- G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
- G06F2200/163—Indexing scheme relating to constructional details of the computer
- G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Definitions
- the present invention relates to a display control method using image measurement or image recognition, and in particular,
- the present invention relates to a technique for detecting the position and orientation of a device equipped with a camera using a photographed image of the camera and controlling display based on the detected position and orientation of the device.
- the system needs to automatically understand the user's intention. For example, the position of the interface device or A technique for detecting the orientation is effective.
- One such interface device is a pointing marker.
- the user holds an object (such as blue LED) having a luminance or color different from that of the user as a pointing marker.
- the system detects the position of the pointing marker using an image sensor and manipulates the displayed image according to the detected position. This allows the user to communicate with the system intuitively and without having to understand how to operate the system.
- a marker is extracted from a photographed image using the difference in brightness and color from the subject!
- a method see, for example, Patent Document 2.
- the position of the reference marker that has been photographed in advance is compared with the current marker position, and the distance between the subject and the image sensor is detected.
- the user only needs to register the reference marker by executing a predetermined initialization process at the time of system startup, and then the system power will detect the change in the position of the marker that is taken sequentially, and the distance between the subject and the imaging sensor will be automatically get.
- Patent Document 1 Japanese Patent Laid-Open No. 2001-356875 (Fig. 1)
- Patent Document 2 Japanese Patent Laid-Open No. 2000-230806 (Fig. 1)
- Patent Document 3 Japanese Patent Laid-Open No. 11 18025 (FIG. 11)
- Patent Document 1 has a problem that a special marker must be prepared, lacks versatility, and uses scenes are limited. In other words, since the difference in brightness and color from the subject is used to detect the marker, for example, a marker that is brighter than any subject or a color that is not included in any subject is used. It is necessary to give.
- Patent Document 3 uses an acceleration sensor or the like, and is excellent in versatility of a system configuration that does not require imaging of a marker.
- the speed sensor cannot cope with constant speed movement, and there is a problem in terms of sensor sensitivity.
- a force sensor which is effective for the so-called sensor version that detects and complements the position and orientation information in multiple ways using magnetic sensors, ultrasonic sensors, etc., leads to an increase in system costs. Increase the volume and weight of the device.
- the increase in the number of sensors, which are often in continuous operation leads to an increase in the power consumption of the device, which is particularly a problem for portable devices.
- An object of the present invention is to provide a display control method and a display control apparatus capable of controlling the display.
- the display control method displays a display image based on the position of a device on which the first and second cameras having a known geometric relationship are mounted.
- a method for controlling wherein the first camera captures a first image including an object with known image characteristics, and the second camera includes a second image including a scene around the object.
- the image feature of the target object is extracted from the first image, and the extracted image feature of the target object is compared with the known image feature of the target object.
- the distance to the recording device is calculated, the image feature of the second image is extracted from the second image, the image feature of the object extracted from the first image, and the second image force are also obtained.
- Using at least one of the extracted image features of the second image Calculating the direction of the device viewed from the object, and controlling the display of the display image based on the calculated distance from the object to the device and the direction of the device.
- the position and orientation of the device can be detected by two cameras, an increase in the volume and weight of the device required for detection can be suppressed, and the display image can be displayed easily. Can be controlled. In addition, power consumption can be kept low.
- FIG. 1 is a diagram showing an execution state of a display control method according to an embodiment of the present invention.
- FIG. 2 is a conceptual diagram showing a representation of the state of FIG. 1 by relative coordinates.
- FIG. 3 is a conceptual diagram for showing a representation of the orientation of the device.
- FIG. 4 is a block diagram showing a configuration of a display control apparatus according to an embodiment of the present invention.
- FIG. 5 is a diagram for explaining an example of a method for detecting a distance to a device.
- FIG. 6 is a diagram for explaining an example of a device direction detection method.
- FIG. 7 is a diagram for explaining an example of a device orientation detection method.
- FIG. 8 is a diagram for explaining control of enlargement or reduction display.
- FIG. 9 is a diagram for explaining display direction change display control.
- FIG. 10 is a modification of the configuration of FIG.
- FIG. 11 is a modification of the configuration of FIG.
- the display control method displays a display image based on the position of the device on which the first and second cameras having a known geometric relationship are mounted.
- the first camera captures a first image including an object with known image characteristics
- the second camera includes a second scene including a scene around the object.
- the image feature of the object is extracted from the first image, and the extracted image feature of the object is compared with a known image feature of the object.
- the distance from the device to the device is calculated, the image feature of the second image is extracted from the second image, the first image force, the extracted image feature of the object, and the second image Force
- the extracted object using at least one of the image features of the second image. Calculating the direction of the device as viewed et al., The distance from the calculated said object to said equipment, and Te based ⁇ in the direction of the device, and controlling the display of the display image.
- the distance from the object to the device is calculated from the first image including the object having a known image feature, which is photographed by the first camera, and the second camera Therefore, the direction of the device viewed from the target object is calculated from the second image taken.
- the distance and direction of the device relative to the object that is, the three-dimensional position can be detected by the two cameras.
- the display of the display image can be easily controlled by the three-dimensional position of the device.
- the object is preferably a face of a user who uses the device. This allows the user to hold the device in hand and take a picture of his / her face with the first camera, as well as taking a picture of the surrounding landscape with the second camera, and using the device based on his / her face as a reference. The three-dimensional position of is calculated.
- the image features of the second image extracted from the second image are extracted from a past image captured by the second camera. Images The direction of the device may be calculated in comparison with the feature. In addition, when calculating the direction of the device, the direction of the device is calculated by comparing the image feature of the object extracted from the first image with the known image feature of the object. May be.
- the display control method further includes the orientation of the device with respect to the object, the image characteristics of the object extracted from the first image force, and the second image force extracted from the second image force.
- the object force calculated when using at least one of the image features of the two images and controlling the display of the display image, the distance to the device, the direction of the device, and the device
- the display of the display image may be controlled based on the orientation of the display. This makes it possible to more easily control the display of the display image according to the orientation of the device as well as the three-dimensional position of the device.
- the present invention can be realized as such a display control method, and can be realized as a display control device using the characteristic steps included in the display control method such as NAGKO as a means. It can also be realized as a program that causes a computer to execute steps. Needless to say, such a program can be distributed via a recording medium such as a CD-ROM or a transmission medium such as the Internet.
- FIG. 1 is a diagram illustrating a state in which a display control method according to an embodiment of the present invention is executed.
- a mobile phone 20 as a device according to the present invention is equipped with a camera 21 on the own side and a camera 22 on the other side as first and second cameras having a known geometric relationship, and The interactive display system that switches the display image according to the position and orientation of the mobile phone 20 has been realized.
- the user 10 holds the mobile phone 20 with his / her hand and is watching a video on a screen (not shown).
- the own camera 21 captures the face of the user 10 as an object whose image characteristics are known.
- the partner camera 22 shares the optical axis with the camera 21 on its own side, and the shooting direction is opposite. Therefore, the user 10 does not enter the shooting angle of view of the counterpart camera 22, and the counterpart camera 22 takes a picture of the scene opposite to the user 10.
- the mobile phone 20 includes a position / orientation detection circuit 30 as a position detection device, which will be described later. Detect the position and orientation of the mobile phone 20 determined by. An image corresponding to the position and orientation of the mobile phone 20 is displayed on the screen, and the user 10 can freely select an image to be viewed by moving the mobile phone 20.
- the size of the display unit is naturally limited, and the image size that can be displayed is limited. Therefore, when an image that is widely distributed for televisions and computers is displayed on the display of a mobile phone, there is a visibility problem that details are difficult to read. In order to improve visibility, it is only necessary to enlarge the image around the point of interest, but at this time, image enlargement is performed intuitively by changing the position and orientation of the mobile phone instead of using buttons and dials. If you can, convenience will improve. Also, if you want to view the whole image again after confirming the details, it is effective in terms of operability if you can change the size and cutout range of the displayed image directly by changing the position and orientation of the mobile phone. It is.
- the video switching function in the interactive display system is not limited to image enlargement / reduction, but can be applied to various functions such as the orientation of the projected subject and changes in the shadow of the illumination that illuminates the subject. This greatly contributes to the improvement of performance.
- the position of the mobile phone 20 is represented by a rotating coordinate system with the center of both eyes of the user 10 as the center of rotation.
- the distance from the center of rotation to the mobile phone 20 is o
- the horizontal rotation angle with respect to the position coordinate normal NL is ⁇ o
- the vertical rotation angle with respect to the position coordinate normal NL is ⁇ ⁇ .
- FIG. 2 is a conceptual diagram for showing a representation by relative coordinates.
- FIG. 3 is a conceptual diagram for showing the expression of the orientation of the mobile phone 20.
- the direction of the mobile phone 20 (schematically represented in Fig. 3) is represented by the horizontal and vertical angles with the reference plane.
- the reference plane can be set arbitrarily.
- the reference plane RS is also determined for the positions of both eyes and nose of the user 10 taken in the initial state.
- the orientation of the mobile phone 20 in FIG. 3 is represented by the horizontal angle ⁇ c and the vertical angle ⁇ c with respect to the reference plane RS.
- the center of rotation is not limited to the center of both eyes, and should be set near the center of rotation of user 10.
- FIG. 4 is a block diagram showing the configuration of the display control apparatus according to one embodiment of the present invention.
- the display control device 30 in FIG. 4 is based on the first image IM1 that is a captured image of the camera 21 on the own side and the second image IM2 that is a captured image of the camera 22 on the other side.
- the position (ro, ⁇ ⁇ , ⁇ ⁇ ) and direction (0 c, ⁇ i) c) are calculated and the display of the display image is controlled.
- the display control device 30 includes a face feature extraction unit 31, a size comparison unit 32a, a position comparison unit 32b, a shape comparison unit 32c, a memory 33, a distance calculation unit 34, a direction calculation unit 35, a scene.
- a feature extraction unit 36, a size comparison unit 37a, a position comparison unit 37b, a shape comparison unit 37c, a memory 38, an orientation calculation unit 39, and a display control unit 41 are provided.
- the size comparison unit 32a, the memory 33, and the distance calculation unit 34 constitute a first calculation means.
- the position comparison unit 37b, the shape comparison unit 37c, the memory 38, and the direction calculation unit 35 configure the first calculation unit. Two calculation means are configured.
- the face feature extraction unit 31 as the first feature extraction unit extracts face feature points from the first image IM1, centering on face parts such as eyes, nose, and mouth, and outputs a face feature signal S1. .
- the face feature signal S1 is supplied to the size comparison unit 32a, the position comparison unit 32b, and the shape comparison unit 32c.
- face feature points extracted in advance are stored as reference figures.
- the scene feature extraction unit 36 as the second feature extraction means extracts a scene feature point from the second image IM2, and outputs a scene feature signal S2.
- the scene feature signal S2 is supplied to the size comparison unit 37a, the position extraction unit 37b, and the shape extraction unit 37c.
- the memory 38 stores feature points extracted from past image forces and marker graphic information.
- the size comparison unit 32a compares the size of the image feature (marker figure) obtained from the face feature signal SI with the reference figure stored in the memory 33.
- the distance calculation unit 34 calculates the comparison result force distance ro by the size comparison unit 32a.
- FIG. 5 is a diagram for explaining an example of a method for obtaining the distance ro.
- a facial feature point is provided at the center of the pupil, and the line segment connecting the centers of the pupils is set as a marker figure.
- the line segment L2 connecting the pupil centers obtained from the above is stored in advance.
- the length of the line segment L1 is (de, near, base), and the length of the line segment L2 is (de, far, base).
- the distance ro is given by the following equation.
- the method of giving initial data and the calculation of distance ro are limited to this. It is not a thing.
- pupil detection is performed at the time of system initialization after power-on of a mobile phone, and the change rate of the pupil distance is calculated based on the distance between the pupils, and it can be used for the change rate of the distance ro. Absent.
- the line segment connecting the pupil centers is used as a marker figure, and the length of the line segment is used as its size.
- the type, size, number, and definition of the marker figure are defined. Various things can be considered.
- FIG. 6 shows images taken by the local camera 21 and the remote camera 22 when the mobile phone 20 is moved in the horizontal direction (angle ⁇ o).
- a pencil, a notebook and a mug are placed on the desk in front of the user 10.
- the counterpart camera 22 captures the scene on the opposite side of the user 10, the obtained video changes greatly according to the movement of the mobile phone 20 as shown in the images Bl, B 2 and B 3.
- feature points are extracted from the image B2 using the brightness difference between the edges of the notebook and pencil, and the detection of the angle ⁇ o is started.
- the mobile phone 20 moves the mobile phone 20 to the left hand side, as shown in the image B1
- a part of the notebook disappears from the middle of the image and the entire pencil is displayed.
- a mug appears in the image as shown in image B3. Therefore, a plurality of feature point tracking accompanying the movement of the counterpart camera 22 is executed in parallel.
- the angle ⁇ o can be detected from other feature points. Also, when a new feature point is detected for the object force appearing in the image, it is added to the feature point tracking target. In this way, by tracking the feature points in the image taken by the counterpart camera 22, that is, the image features extracted from the second image IM2 are compared with the image features extracted from the past image features. By the angle ⁇ . Can be detected with high resolution. However, since the object to be photographed is arbitrary in the counterpart camera 22, the feature detection is not stable compared to the camera 21 that always captures a face image.
- the camera 21 on the own side and the camera 22 on the other side are both at an angle of 0. Because detection has both advantages and disadvantages, the detection accuracy can be improved by complementing each other. For example, if feature point detection fails for the image of the far-end camera 22, the angle ⁇ o of the image cover of the own-side camera 21 is detected, and To the image! It is sufficient to use the local camera 21 until the previous feature point detection is recovered.
- an average value of the angles ⁇ o calculated from the image of the own camera 21 and the image of the counterpart camera 22 may be used. Also, for example, out of the angle ⁇ o calculated from the image of the own camera 21 and the image of the other camera 22, do not use a value that is unique from the past history or a predetermined threshold value. It ’s okay.
- the rotation angle ⁇ o in the vertical direction can also be detected in the same manner as the rotation angle ⁇ o in the horizontal direction. It should be noted that since the video of the camera 21 on the own side changes more compared to the movement in the horizontal direction, the detection accuracy is considered to improve somewhat. However, the relationship between the merit and demerit of the camera 21 on the own side and the camera 22 on the other side is the same as that in the horizontal direction. Therefore, cooperative processing by complementary operation is effective for improving the position detection accuracy.
- the direction calculation unit 35 calculates the angles 0 o, ⁇ o, that is, the direction of the mobile phone 20, using the comparison result by the position comparison unit 32b and the comparison result by the position comparison unit 37b.
- Cooperative processing based on the captured images of the two cameras is also effective in detecting the distance ro.
- the distance ro can be obtained from the second image IM2 using the change in the size of the marker figure.
- any scene force also extracts marker graphics, so detection may be unstable.
- First image Marker extraction from IM1 may fail for some reason, so second image Distance detection from IM2 is effective as a knock-up.
- FIG. 7 shows an image taken by the local camera 21 when the orientation of the mobile phone 20 is changed.
- an image D1 is an image when the mobile phone 20 is rotated by an angle ⁇ c in the horizontal direction.
- image D1 user 10 is moving in the horizontal direction (right side in this example).
- Image D2 shows the mobile phone 20 at an angle in the vertical direction. It is a picture when only rotating.
- image D2 user 10 is moving vertically in the image (up in this example).
- the direction of the mobile phone 20 can be detected by obtaining the amount of movement of the position of the marker graphic (for example, the shoulder edge). Focusing on the shape of the marker figure, The figure is flattened, for example, the circle is transformed into an ellipse. Therefore, the orientation of the mobile phone 20 can be detected from the change in the shape of the marker graphic. Similarly, the orientation of the mobile phone 20 can be detected from the captured image of the counterpart camera 22.
- the marker graphic for example, the shoulder edge
- the orientation calculation unit 39 compares the comparison results of the position comparison unit 32b and the shape comparison unit 32c.
- the angle 0c, ⁇ c that is, the orientation of the mobile phone 20 is calculated.
- the first image IM1 captured by the own camera 21 it may be more effective to use the illumination on the background of the face of the user 10 as a marker. In such a case, give the first image IM1 to the scene feature point extraction unit 36 to extract the marker figure.
- the display control unit 41 displays the image stored in the image storage unit 43 selected by the user 10 on the display unit 44.
- the display control unit 41 is based on the distance ro calculated by the distance calculation unit 34, the angles 0 o and ⁇ ⁇ calculated by the direction calculation unit 35, and the angle ⁇ c ⁇ c calculated by the direction calculation unit 39.
- the display of the image (display image) displayed on the display unit 44 is controlled.
- the image storage unit 43 it is assumed that a plurality of images taken in different directions and sizes are preliminarily stored.
- FIG. 8 is a diagram for explaining control of enlargement or reduction display.
- the display control unit 41 performs control to display the display image E shown in FIG. 8 in an enlarged or reduced manner according to the distance ro calculated by the distance calculating unit 34.
- the display control unit 41 performs control so that the image is enlarged and displayed as a display image E1 shown in FIG.
- the display control unit 41 performs control so that the image is reduced and displayed as a display image E2 shown in FIG.
- the display control unit 41 controls the center position when the display image E is enlarged or reduced by the angle ⁇ c ⁇ c calculated by the direction calculation unit 39.
- FIG. 9 is a diagram for explaining control of display direction change display.
- the display control unit 41 changes the display direction of the display image E shown in FIG. 9 according to the angles ⁇ o and ⁇ o calculated by the direction calculation unit 35. Control to change and display. That is, when the mobile phone 20 is moved by the user 10 and moved to the right direction (the angle ⁇ o is the positive direction), the display control unit 41 is viewed from the right direction as shown in the display image E3 shown in FIG. Control to display the image.
- the display control unit 41 moves leftward (angle ⁇ o is negative), the display control unit 41 performs control so as to display an image viewed from the left like the display image E4. Further, for example, when moving upward (the angle ⁇ is positive), the display control unit 41 performs control so as to display an image in which the downward force is seen as in the display image ⁇ 5. On the other hand, for example, when the display controller 41 moves downward (angle ⁇ is negative), the display control unit 41 performs control so as to display an image viewed from above as in the display image ⁇ 6.
- the display control unit 41 displays the display image according to the mobile phone 20 being powered by the user 10 from the initial position as described above and the movement amount of the initial position force (relative value). Controlling force It is not limited to this.
- the display control unit 41 may calculate the distance ro calculated by the distance calculation unit 34, the angles ⁇ ⁇ and ⁇ ⁇ calculated by the direction calculation unit 35, and the angles 0 c and 0 c calculated by the direction calculation unit 39 themselves.
- the display image display may be controlled according to the value (absolute value).
- the display control unit 41 displays the image stored in the image storage unit 43 on the display unit 44, but only the image stored in the image storage unit 43 included in the mobile phone 20 is displayed. Instead, for example, display of an image acquired via a network such as the Internet, such as an image in online shopping, may be controlled.
- the display control unit 41 when controlling the display of the display image, stores one image in the memory 42 without using a plurality of images taken in different directions and sizes.
- the display image display may be controlled by image processing.
- FIG. 10 is a block diagram showing another configuration of the position / orientation detection circuit.
- the position of the mobile phone 20 is described in the rotation coordinate system with the user 10 as the rotation center, the direction of the mobile phone 20 is detected by the counterpart camera 22 as described in FIG. It is preferable to use the second image IM2. From this point of view, the configuration of Fig. 10 significantly reduces the circuit scale compared to the configuration of Fig. 4.
- the angles ⁇ o and ⁇ ⁇ are The position comparison unit 37b and the direction calculation unit 35A detect the second image IM2 taken by the camera 22 by the position detector 22a.
- the difference in the position of the marker figure is calculated by the position comparison unit 37 b, and this is used to detect it by the direction calculation unit 39A.
- the distance ro is detected by using the first image IM 1 captured by the own camera 21 because the marker extraction with the facial image power is stable.
- FIG. 11 is also a block diagram showing another configuration of the position / orientation detection circuit.
- the key to detection is that a specific object can be detected more accurately than an arbitrary subject. Therefore, in the configuration of Fig. 11, priority is given to the process of extracting markers from the face image, so that the circuit scale is greatly reduced compared to the configuration of Fig. 4.
- the angles ⁇ o and ⁇ ⁇ are detected by the position comparison unit 37b and the direction calculation unit 35 from the second image ⁇ 2 taken by the counterpart camera 22. Execute. On the other hand, distance ro and direction 0 c, ⁇ . Detects a face image as a marker graphic from the first image IM1 photographed by its own camera 21 by the size comparison unit 32a, the distance calculation unit 34A, and the orientation calculation unit 39B.
- the case where the user 10 moves the mobile phone 20 by hand has been described as an example, but the method of moving the device is arbitrary, and the present invention is not limited thereto.
- the positions of the two cameras are different from each other. Usually, since the cameras are small, the difference can be ignored. Even if it cannot be ignored, it may be possible to adopt the average value of the two camera positions by correcting the geometric position of the two cameras.
- the optical axes of own camera 21 and counterpart camera 22 are the same.
- the two cameras 21, 22 are in the simplest geometric relationship. In other words, this is an idea to simplify the geometric transformation between the two cameras 21, 22.
- the optical axes of the two cameras do not need to coincide with each other. If the geometric relationship is known, the two cameras may be in an arbitrary positional relationship.
- the force using two cameras for example, a single wide-angle power camera may be used to cover a wide field of view. That is, two shot images One of the images only needs to contain an object with known image features.
- the present invention can be realized with a simple configuration of two cameras, it can be easily introduced into a portable device. Even if the display area of the display is small, the user can view the entire subject or pick it up in the hand even if the display area of the display is small by displaying the video according to the detected device position and orientation sequentially. Since the subject can be observed with a sense of reality, for example, the practicality of online shopping can be greatly improved.
- the present invention can be used for museum purposes such as digital archives and medical uses where the combined use of live-action and computer graphics is effective.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
- Position Input By Displaying (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006514063A JP3926837B2 (ja) | 2004-06-04 | 2005-05-19 | 表示制御方法および装置、プログラム、並びに携帯機器 |
US11/526,680 US7535486B2 (en) | 2004-06-04 | 2006-09-26 | Display control device, display control method, program, and portable apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004167242 | 2004-06-04 | ||
JP2004-167242 | 2004-06-04 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/526,680 Continuation US7535486B2 (en) | 2004-06-04 | 2006-09-26 | Display control device, display control method, program, and portable apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005119591A1 true WO2005119591A1 (fr) | 2005-12-15 |
Family
ID=35463086
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2005/009180 WO2005119591A1 (fr) | 2004-06-04 | 2005-05-19 | Dispositif de commande d'affichage, procédé de commande d'affichage, programme et appareil portable |
Country Status (4)
Country | Link |
---|---|
US (1) | US7535486B2 (fr) |
JP (1) | JP3926837B2 (fr) |
CN (1) | CN100461212C (fr) |
WO (1) | WO2005119591A1 (fr) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010009502A (ja) * | 2008-06-30 | 2010-01-14 | Nec Corp | 携帯端末、表示動作制御方法、及び表示制御プログラム |
JP2010517129A (ja) * | 2007-01-22 | 2010-05-20 | トタル イメルシオン | ビデオストリームにおいて、マーク無しに、テクスチャー化平面幾何学的オブジェクトをリアルタイムで自動追跡するリアリティ向上方法および装置 |
JP2011510364A (ja) * | 2007-12-20 | 2011-03-31 | ソニー エリクソン モバイル コミュニケーションズ, エービー | 表示を動的に変更するシステム及び方法 |
JP2011108028A (ja) * | 2009-11-18 | 2011-06-02 | Fujifilm Corp | 画像再生装置、撮像装置、画像再生方法 |
JP2011165068A (ja) * | 2010-02-12 | 2011-08-25 | Nec System Technologies Ltd | 画像生成装置、画像表示システム、画像生成方法、及びプログラム |
JP2011528819A (ja) * | 2008-06-11 | 2011-11-24 | ノキア コーポレイション | ユーザインターフェース制御のためのカメラジェスチャ |
JP2013061988A (ja) * | 2013-01-04 | 2013-04-04 | Fujitsu Ltd | 表示制御装置、表示制御方法および表示制御プログラム |
WO2013069796A1 (fr) * | 2011-11-10 | 2013-05-16 | 株式会社ニコン | Dispositif électronique, système d'information et serveur |
JP2014041642A (ja) * | 2013-10-16 | 2014-03-06 | Nec Corp | 携帯端末、表示動作制御方法、及び表示制御プログラム |
KR20140048221A (ko) * | 2011-08-02 | 2014-04-23 | 마이크로소프트 코포레이션 | 디스플레이 장치 관찰 모드들 사이의 변경 기법 |
JP2014135086A (ja) * | 2010-08-04 | 2014-07-24 | Apple Inc | 動き特性を使用することによるディスプレイへの三次元ユーザインターフェイス効果 |
JP2014160471A (ja) * | 2008-06-20 | 2014-09-04 | Yahoo Inc | ナビゲータとしてのモバイルイメージング装置 |
JP2015170339A (ja) * | 2014-03-11 | 2015-09-28 | 沖電気工業株式会社 | 制御装置、制御方法、プログラムおよび端末 |
US9411413B2 (en) | 2010-08-04 | 2016-08-09 | Apple Inc. | Three dimensional user interface effects on a display |
Families Citing this family (68)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040162637A1 (en) | 2002-07-25 | 2004-08-19 | Yulun Wang | Medical tele-robotic system with a master remote station with an arbitrator |
US6925357B2 (en) | 2002-07-25 | 2005-08-02 | Intouch Health, Inc. | Medical tele-robotic system |
US7813836B2 (en) | 2003-12-09 | 2010-10-12 | Intouch Technologies, Inc. | Protocol for a remotely controlled videoconferencing robot |
US20050204438A1 (en) | 2004-02-26 | 2005-09-15 | Yulun Wang | Graphical interface for a remote presence system |
US8077963B2 (en) | 2004-07-13 | 2011-12-13 | Yulun Wang | Mobile robot with a head-based movement mapping scheme |
US9198728B2 (en) | 2005-09-30 | 2015-12-01 | Intouch Technologies, Inc. | Multi-camera mobile teleconferencing platform |
US8849679B2 (en) | 2006-06-15 | 2014-09-30 | Intouch Technologies, Inc. | Remote controlled robot system that provides medical images |
US7860382B2 (en) * | 2006-10-02 | 2010-12-28 | Sony Ericsson Mobile Communications Ab | Selecting autofocus area in an image |
US9596401B2 (en) | 2006-10-02 | 2017-03-14 | Sony Corporation | Focusing an image based on a direction of a face of a user |
JP4656331B2 (ja) * | 2006-12-27 | 2011-03-23 | 富士フイルム株式会社 | 撮像装置および撮像方法 |
US8433130B2 (en) | 2007-01-29 | 2013-04-30 | Vergence Media, Inc. | Methodology to optimize and provide streaming object rotation using composite images |
US20080231726A1 (en) * | 2007-03-23 | 2008-09-25 | Motorola, Inc. | Apparatus and method for image color correction in a portable device |
US20080266326A1 (en) * | 2007-04-25 | 2008-10-30 | Ati Technologies Ulc | Automatic image reorientation |
US9160783B2 (en) | 2007-05-09 | 2015-10-13 | Intouch Technologies, Inc. | Robot system that operates through a network firewall |
SG150414A1 (en) * | 2007-09-05 | 2009-03-30 | Creative Tech Ltd | Methods for processing a composite video image with feature indication |
US8384718B2 (en) * | 2008-01-10 | 2013-02-26 | Sony Corporation | System and method for navigating a 3D graphical user interface |
CN101489082B (zh) * | 2008-01-18 | 2011-12-28 | 华硕电脑股份有限公司 | 电子装置、影像串流的处理模块与处理方法 |
US10875182B2 (en) | 2008-03-20 | 2020-12-29 | Teladoc Health, Inc. | Remote presence system mounted to operating room hardware |
US8179418B2 (en) | 2008-04-14 | 2012-05-15 | Intouch Technologies, Inc. | Robotic based health care system |
US8170241B2 (en) | 2008-04-17 | 2012-05-01 | Intouch Technologies, Inc. | Mobile tele-presence system with a microphone system |
JP2009294728A (ja) * | 2008-06-02 | 2009-12-17 | Sony Ericsson Mobilecommunications Japan Inc | 表示処理装置、表示処理方法、表示処理プログラム、及び携帯端末装置 |
US9193065B2 (en) | 2008-07-10 | 2015-11-24 | Intouch Technologies, Inc. | Docking system for a tele-presence robot |
US9842192B2 (en) | 2008-07-11 | 2017-12-12 | Intouch Technologies, Inc. | Tele-presence robot system with multi-cast features |
US8340819B2 (en) | 2008-09-18 | 2012-12-25 | Intouch Technologies, Inc. | Mobile videoconferencing robot system with network adaptive driving |
US8996165B2 (en) | 2008-10-21 | 2015-03-31 | Intouch Technologies, Inc. | Telepresence robot with a camera boom |
US8463435B2 (en) | 2008-11-25 | 2013-06-11 | Intouch Technologies, Inc. | Server connectivity control for tele-presence robot |
US9138891B2 (en) | 2008-11-25 | 2015-09-22 | Intouch Technologies, Inc. | Server connectivity control for tele-presence robot |
US8849680B2 (en) | 2009-01-29 | 2014-09-30 | Intouch Technologies, Inc. | Documentation through a remote presence robot |
US8111247B2 (en) * | 2009-03-27 | 2012-02-07 | Sony Ericsson Mobile Communications Ab | System and method for changing touch screen functionality |
US8897920B2 (en) | 2009-04-17 | 2014-11-25 | Intouch Technologies, Inc. | Tele-presence robot system with software modularity, projector and laser pointer |
US8384755B2 (en) | 2009-08-26 | 2013-02-26 | Intouch Technologies, Inc. | Portable remote presence robot |
US11399153B2 (en) * | 2009-08-26 | 2022-07-26 | Teladoc Health, Inc. | Portable telepresence apparatus |
JP5343773B2 (ja) * | 2009-09-04 | 2013-11-13 | ソニー株式会社 | 情報処理装置、表示制御方法及び表示制御プログラム |
TW201129084A (en) * | 2010-02-02 | 2011-08-16 | Hon Hai Prec Ind Co Ltd | Controlling system and method for camera, adjusting apparatus for camera including the same |
US11154981B2 (en) | 2010-02-04 | 2021-10-26 | Teladoc Health, Inc. | Robot user interface for telepresence robot system |
US8670017B2 (en) | 2010-03-04 | 2014-03-11 | Intouch Technologies, Inc. | Remote presence system including a cart that supports a robot face and an overhead camera |
US8826184B2 (en) * | 2010-04-05 | 2014-09-02 | Lg Electronics Inc. | Mobile terminal and image display controlling method thereof |
US10343283B2 (en) | 2010-05-24 | 2019-07-09 | Intouch Technologies, Inc. | Telepresence robot system that can be accessed by a cellular phone |
US10808882B2 (en) | 2010-05-26 | 2020-10-20 | Intouch Technologies, Inc. | Tele-robotic system with a robot face placed on a chair |
JP5439281B2 (ja) * | 2010-05-27 | 2014-03-12 | エヌ・ティ・ティ・コムウェア株式会社 | ユーザ視点空間映像提示装置、ユーザ視点空間映像提示方法及びプログラム |
US8866587B2 (en) | 2010-08-17 | 2014-10-21 | Empire Technology Development Llc | Remote display control |
EP2447915A1 (fr) * | 2010-10-27 | 2012-05-02 | Sony Ericsson Mobile Communications AB | Ombrage en temps réel de menu/icône tridimensionnel |
US9264664B2 (en) | 2010-12-03 | 2016-02-16 | Intouch Technologies, Inc. | Systems and methods for dynamic bandwidth allocation |
US8965579B2 (en) | 2011-01-28 | 2015-02-24 | Intouch Technologies | Interfacing with a mobile telepresence robot |
US9323250B2 (en) | 2011-01-28 | 2016-04-26 | Intouch Technologies, Inc. | Time-dependent navigation of telepresence robots |
US10769739B2 (en) | 2011-04-25 | 2020-09-08 | Intouch Technologies, Inc. | Systems and methods for management of information among medical providers and facilities |
US8843346B2 (en) * | 2011-05-13 | 2014-09-23 | Amazon Technologies, Inc. | Using spatial information with device interaction |
US20140139616A1 (en) | 2012-01-27 | 2014-05-22 | Intouch Technologies, Inc. | Enhanced Diagnostics for a Telepresence Robot |
US9098611B2 (en) | 2012-11-26 | 2015-08-04 | Intouch Technologies, Inc. | Enhanced video interaction for a user interface of a telepresence network |
US20130002722A1 (en) * | 2011-07-01 | 2013-01-03 | Krimon Yuri I | Adaptive text font and image adjustments in smart handheld devices for improved usability |
US8836751B2 (en) | 2011-11-08 | 2014-09-16 | Intouch Technologies, Inc. | Tele-presence system with a user interface that displays different communication links |
US8902278B2 (en) | 2012-04-11 | 2014-12-02 | Intouch Technologies, Inc. | Systems and methods for visualizing and managing telepresence devices in healthcare networks |
US9251313B2 (en) | 2012-04-11 | 2016-02-02 | Intouch Technologies, Inc. | Systems and methods for visualizing and managing telepresence devices in healthcare networks |
US9201495B2 (en) * | 2012-04-24 | 2015-12-01 | Mobitv, Inc. | Control of perspective in multi-dimensional media |
US9361021B2 (en) | 2012-05-22 | 2016-06-07 | Irobot Corporation | Graphical user interfaces including touchpad driving interfaces for telemedicine devices |
WO2013176760A1 (fr) | 2012-05-22 | 2013-11-28 | Intouch Technologies, Inc. | Interfaces utilisateur graphiques contenant des interfaces de pilotage par pavé tactile destinées à des dispositifs de télémédecine |
KR20140093513A (ko) * | 2013-01-18 | 2014-07-28 | 삼성전자주식회사 | 휴대 단말기의 디스플레이 제어 장치 및 방법 |
KR102416814B1 (ko) | 2013-04-08 | 2022-07-06 | 스냅 아이엔씨 | 멀티-카메라 장치를 사용하는 거리 추정 |
CN103795864B (zh) * | 2014-01-29 | 2016-09-28 | 华为技术有限公司 | 移动终端前后摄像头的选择方法和移动终端 |
US9807316B2 (en) * | 2014-09-04 | 2017-10-31 | Htc Corporation | Method for image segmentation |
KR102402048B1 (ko) | 2015-10-14 | 2022-05-26 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
CN108154058B (zh) * | 2016-12-05 | 2021-04-23 | 北京小米移动软件有限公司 | 图形码展示、位置区域确定方法及装置 |
US11200743B2 (en) * | 2017-03-30 | 2021-12-14 | Christopher Carmichael | Social network access via virtual-reality |
DE102017108194A1 (de) * | 2017-04-18 | 2018-10-18 | Vorwerk & Co. Interholding Gmbh | Verfahren zum Betrieb eines sich selbsttätig fortbewegenden Fahrzeugs |
US11862302B2 (en) | 2017-04-24 | 2024-01-02 | Teladoc Health, Inc. | Automated transcription and documentation of tele-health encounters |
US10483007B2 (en) | 2017-07-25 | 2019-11-19 | Intouch Technologies, Inc. | Modular telehealth cart with thermal imaging and touch screen user interface |
US11636944B2 (en) | 2017-08-25 | 2023-04-25 | Teladoc Health, Inc. | Connectivity infrastructure for a telehealth platform |
US10617299B2 (en) | 2018-04-27 | 2020-04-14 | Intouch Technologies, Inc. | Telehealth cart that supports a removable tablet with seamless audio/video switching |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000259856A (ja) * | 1999-03-09 | 2000-09-22 | Nippon Telegr & Teleph Corp <Ntt> | 3次元コンピュータグラフィックス表示方法及び装置 |
JP2002007027A (ja) * | 2000-06-27 | 2002-01-11 | Masanori Idesawa | 画像情報表示装置 |
JP2002366271A (ja) * | 2001-06-13 | 2002-12-20 | Sharp Corp | 画像表示システムおよび画像表示方法 |
JP2004147046A (ja) * | 2002-10-24 | 2004-05-20 | Matsushita Electric Ind Co Ltd | ディジタルカメラおよびディジタルカメラ付き携帯電話装置 |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3626210B2 (ja) | 1991-11-14 | 2005-03-02 | 中部電力株式会社 | 動画像に基づくカメラの3次元運動検出方法およびその装置 |
SE507680C2 (sv) | 1997-01-13 | 1998-07-06 | Qualisys Ab | Metod och anordning för att bestämma positionen av ett objekt |
JP4251673B2 (ja) * | 1997-06-24 | 2009-04-08 | 富士通株式会社 | 画像呈示装置 |
JP4281139B2 (ja) | 1999-02-09 | 2009-06-17 | ソニー株式会社 | 位置認識装置、位置認識方法及び仮想画像立体合成装置 |
JP4768196B2 (ja) * | 2000-05-17 | 2011-09-07 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 3次元モデリングを行うことなく画像処理によってターゲットを指し示す装置及びその方法 |
JP2001356875A (ja) | 2000-06-13 | 2001-12-26 | Toshiba Corp | ポインタ表示システム |
JP2002164990A (ja) | 2000-11-28 | 2002-06-07 | Kyocera Corp | 携帯通信端末装置 |
JP4025516B2 (ja) | 2001-04-25 | 2007-12-19 | 日本電信電話株式会社 | マウス代替方法、マウス代替プログラム、および同プログラムを記録した記録媒体 |
JP2002366272A (ja) | 2001-06-05 | 2002-12-20 | Kyocera Corp | 携帯端末装置および表示画面のスクロール方法 |
KR100438841B1 (ko) * | 2002-04-23 | 2004-07-05 | 삼성전자주식회사 | 이용자 검증 및 데이터 베이스 자동 갱신 방법, 및 이를이용한 얼굴 인식 시스템 |
JP2004021870A (ja) | 2002-06-20 | 2004-01-22 | Matsushita Electric Ind Co Ltd | 視線入力機能付携帯電話 |
JP3851601B2 (ja) | 2002-09-27 | 2006-11-29 | 富士写真フイルム株式会社 | 携帯端末装置 |
WO2004080064A1 (fr) * | 2003-03-06 | 2004-09-16 | Fujitsu Limited | Dispositif de traitement d'informations, procede de traitement d'informations et programme de traitement d'informations |
JP4053444B2 (ja) * | 2003-03-07 | 2008-02-27 | シャープ株式会社 | 携帯可能な多機能電子機器 |
JP2004312194A (ja) | 2003-04-03 | 2004-11-04 | Konica Minolta Photo Imaging Inc | ポインティングデバイス機能付き携帯電話及び携帯電話 |
US7057620B2 (en) * | 2003-08-25 | 2006-06-06 | Ati Technologies Inc. | Method and apparatus for graphics rendering on a mobile device |
US7301528B2 (en) * | 2004-03-23 | 2007-11-27 | Fujitsu Limited | Distinguishing tilt and translation motion components in handheld devices |
-
2005
- 2005-05-19 CN CNB2005800088628A patent/CN100461212C/zh not_active Expired - Fee Related
- 2005-05-19 JP JP2006514063A patent/JP3926837B2/ja not_active Expired - Fee Related
- 2005-05-19 WO PCT/JP2005/009180 patent/WO2005119591A1/fr active Application Filing
-
2006
- 2006-09-26 US US11/526,680 patent/US7535486B2/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000259856A (ja) * | 1999-03-09 | 2000-09-22 | Nippon Telegr & Teleph Corp <Ntt> | 3次元コンピュータグラフィックス表示方法及び装置 |
JP2002007027A (ja) * | 2000-06-27 | 2002-01-11 | Masanori Idesawa | 画像情報表示装置 |
JP2002366271A (ja) * | 2001-06-13 | 2002-12-20 | Sharp Corp | 画像表示システムおよび画像表示方法 |
JP2004147046A (ja) * | 2002-10-24 | 2004-05-20 | Matsushita Electric Ind Co Ltd | ディジタルカメラおよびディジタルカメラ付き携帯電話装置 |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010517129A (ja) * | 2007-01-22 | 2010-05-20 | トタル イメルシオン | ビデオストリームにおいて、マーク無しに、テクスチャー化平面幾何学的オブジェクトをリアルタイムで自動追跡するリアリティ向上方法および装置 |
JP2011510364A (ja) * | 2007-12-20 | 2011-03-31 | ソニー エリクソン モバイル コミュニケーションズ, エービー | 表示を動的に変更するシステム及び方法 |
JP2011528819A (ja) * | 2008-06-11 | 2011-11-24 | ノキア コーポレイション | ユーザインターフェース制御のためのカメラジェスチャ |
JP2014160471A (ja) * | 2008-06-20 | 2014-09-04 | Yahoo Inc | ナビゲータとしてのモバイルイメージング装置 |
JP2010009502A (ja) * | 2008-06-30 | 2010-01-14 | Nec Corp | 携帯端末、表示動作制御方法、及び表示制御プログラム |
JP2011108028A (ja) * | 2009-11-18 | 2011-06-02 | Fujifilm Corp | 画像再生装置、撮像装置、画像再生方法 |
JP2011165068A (ja) * | 2010-02-12 | 2011-08-25 | Nec System Technologies Ltd | 画像生成装置、画像表示システム、画像生成方法、及びプログラム |
JP2014135086A (ja) * | 2010-08-04 | 2014-07-24 | Apple Inc | 動き特性を使用することによるディスプレイへの三次元ユーザインターフェイス効果 |
US9411413B2 (en) | 2010-08-04 | 2016-08-09 | Apple Inc. | Three dimensional user interface effects on a display |
US9417763B2 (en) | 2010-08-04 | 2016-08-16 | Apple Inc. | Three dimensional user interface effects on a display by using properties of motion |
US9778815B2 (en) | 2010-08-04 | 2017-10-03 | Apple Inc. | Three dimensional user interface effects on a display |
KR20140048221A (ko) * | 2011-08-02 | 2014-04-23 | 마이크로소프트 코포레이션 | 디스플레이 장치 관찰 모드들 사이의 변경 기법 |
JP2014529094A (ja) * | 2011-08-02 | 2014-10-30 | マイクロソフト コーポレーション | 表示装置閲覧モード間の変更 |
KR102073998B1 (ko) * | 2011-08-02 | 2020-02-05 | 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 | 디스플레이 장치 관찰 모드들 사이의 변경 기법 |
WO2013069796A1 (fr) * | 2011-11-10 | 2013-05-16 | 株式会社ニコン | Dispositif électronique, système d'information et serveur |
JPWO2013069796A1 (ja) * | 2011-11-10 | 2015-04-02 | 株式会社ニコン | 電子機器、情報システム及びサーバ |
JP2017207753A (ja) * | 2011-11-10 | 2017-11-24 | 株式会社ニコン | 電子機器、情報システム及びサーバ |
JP2013061988A (ja) * | 2013-01-04 | 2013-04-04 | Fujitsu Ltd | 表示制御装置、表示制御方法および表示制御プログラム |
JP2014041642A (ja) * | 2013-10-16 | 2014-03-06 | Nec Corp | 携帯端末、表示動作制御方法、及び表示制御プログラム |
JP2015170339A (ja) * | 2014-03-11 | 2015-09-28 | 沖電気工業株式会社 | 制御装置、制御方法、プログラムおよび端末 |
Also Published As
Publication number | Publication date |
---|---|
US7535486B2 (en) | 2009-05-19 |
CN100461212C (zh) | 2009-02-11 |
CN1934584A (zh) | 2007-03-21 |
US20070019000A1 (en) | 2007-01-25 |
JPWO2005119591A1 (ja) | 2008-04-03 |
JP3926837B2 (ja) | 2007-06-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP3926837B2 (ja) | 表示制御方法および装置、プログラム、並びに携帯機器 | |
US11195307B2 (en) | Image processing apparatus, image processing method, and program | |
EP3218781B1 (fr) | Interaction spatiale en réalité augmentée | |
CN108734736B (zh) | 相机姿态追踪方法、装置、设备及存储介质 | |
US9454834B2 (en) | Storage medium storing image processing program for implementing controlled image display according to input coordinate, and information processing device | |
Beardsley et al. | Interaction using a handheld projector | |
US7477236B2 (en) | Remote control of on-screen interactions | |
CN111158469A (zh) | 视角切换方法、装置、终端设备及存储介质 | |
KR20140090159A (ko) | 정보 처리 장치, 정보 처리 방법, 및 프로그램 | |
TW201346640A (zh) | 影像處理裝置及電腦程式產品 | |
JP7005161B2 (ja) | 電子機器及びその制御方法 | |
CN112581571B (zh) | 虚拟形象模型的控制方法、装置、电子设备及存储介质 | |
CN113546419B (zh) | 游戏地图显示方法、装置、终端及存储介质 | |
CN113066189B (zh) | 一种增强现实设备及虚实物体遮挡显示方法 | |
CN113160031B (zh) | 图像处理方法、装置、电子设备及存储介质 | |
JP7005160B2 (ja) | 電子機器及びその制御方法 | |
WO2018186004A1 (fr) | Dispositif électronique et son procédé de commande | |
López et al. | Multimodal sensing-based camera applications | |
US20220245858A1 (en) | Interaction method and interaction system between reality and virtuality | |
WO2023221929A1 (fr) | Procédé et appareil d'affichage d'image, dispositif électronique et support de stockage | |
TW201913298A (zh) | 可顯示實體輸入裝置即時影像之虛擬實境系統及其控制方法 | |
CN117687500A (zh) | 远程控制***、远程控制器以及远程控制方法 | |
CN103593876B (zh) | 电子装置以及在电子装置中控制虚拟场景中的对象的方法 | |
CN112667079A (zh) | 一种虚拟现实设备及反向提示画面显示方法 | |
Lópeza et al. | Multimodal sensing-based camera applications |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
DPEN | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2006514063 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 200580008862.8 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11526680 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 11526680 Country of ref document: US |
|
122 | Ep: pct application non-entry in european phase |