CN107024974B - Interaction method and interaction device based on deformable equipment and user equipment - Google Patents
Interaction method and interaction device based on deformable equipment and user equipment Download PDFInfo
- Publication number
- CN107024974B CN107024974B CN201510578268.8A CN201510578268A CN107024974B CN 107024974 B CN107024974 B CN 107024974B CN 201510578268 A CN201510578268 A CN 201510578268A CN 107024974 B CN107024974 B CN 107024974B
- Authority
- CN
- China
- Prior art keywords
- light
- information
- piece
- emitting
- deformable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Position Input By Displaying (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses an interaction method, an interaction device and user equipment based on deformable equipment, wherein the method comprises the following steps: acquiring at least one light sensing information acquired at least one first position of a deformable device; acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable equipment; and determining the shape of the deformable device at least according to the at least one piece of light sensing information and the at least one piece of light outlet information. The shape of the deformable device is determined according to the at least one piece of optical sensing information and the at least one piece of light-emitting information, and a convenient and quick shape detection scheme is provided for the deformable device.
Description
Technical Field
The present application relates to the field of interaction technologies, and in particular, to an interaction method and an interaction apparatus based on a deformable device, and a user equipment.
Background
The deformable device may be changed from one shape to another, either automatically or passively, wherein the deformable device may have different functions corresponding to the different shapes of the deformable device; alternatively, a change in the shape of the deformable device may trigger a corresponding operation. Therefore, detection of a change in the shape of the deformable device is important.
Disclosure of Invention
The possible purposes of the embodiment of the application are as follows: an interaction technical scheme based on deformable equipment is provided.
In a first aspect, a possible embodiment of the present application provides an interaction method based on a deformable device, including:
acquiring at least one light sensing information acquired at least one first position of a deformable device;
acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable equipment;
and determining the shape of the deformable device at least according to the at least one piece of light sensing information and the at least one piece of light outlet information.
In a second aspect, a possible embodiment of the present application provides an interaction apparatus based on a deformable device, including:
the first information acquisition module is used for acquiring at least one piece of optical sensing information acquired at least one first position of a deformable device;
the second information acquisition module is used for acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable equipment;
and the analysis processing module is used for determining the shape of the deformable equipment at least according to the at least one piece of light sensing information and the at least one piece of light emitting information.
In a third aspect, a possible embodiment of the present application provides a user equipment, including:
a memory for storing a program;
a processor for executing the memory-stored program, the program causing the processor to:
acquiring at least one light sensing information acquired at least one first position of a deformable device;
acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable equipment;
and determining the shape of the deformable device at least according to the at least one piece of light sensing information and the at least one piece of light outlet information.
According to at least one implementation of the embodiment of the application, at least one piece of optical sensing information is acquired at least one first position of the deformable device, and the shape of the deformable device is determined according to the at least one piece of optical sensing information and at least one piece of light-emitting information of at least one second position of the deformable device, so that a convenient and rapid shape detection scheme is provided for the deformable device.
Drawings
Fig. 1 is a flowchart of an interaction method according to an embodiment of the present application;
fig. 2a to 2c are schematic views of application scenarios of an interaction method according to an embodiment of the present application;
fig. 3a to 3b are schematic diagrams of application scenarios of an interaction method according to an embodiment of the present application;
FIG. 4 is a block diagram illustrating an exemplary structure of an interactive apparatus according to an embodiment of the present disclosure;
FIGS. 5a to 5f are schematic block diagrams illustrating structures of six interaction devices according to embodiments of the present disclosure;
fig. 6 is a block diagram illustrating a structure of a user equipment according to an embodiment of the present application.
Detailed Description
The following detailed description of the present application will be made in conjunction with the accompanying drawings (like numerals represent like elements throughout the several figures) and examples. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application.
It will be understood by those within the art that the terms "first", "second", etc. in this application are used only to distinguish one step, device or module from another, and do not denote any particular technical meaning or necessarily logical order therebetween.
The inventors of the present application have found that when a deformable device such as a flexible device is in different shapes, the relative position between some regions at different locations on the deformable device may vary, and thus determining the relative position between these regions may also facilitate determining the shape of the deformable device.
As shown in fig. 1, an embodiment of the present application provides an interaction method based on a deformable device, including:
s110, acquiring at least one piece of light sensing information acquired at least one first position of a deformable device;
s120, acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable equipment;
s130 determines a shape of the deformable device at least according to the at least one light sensing information and the at least one light exit information.
For example, the interactive apparatus provided in the present application is used as the execution subject of the present embodiment to execute S110 to S130. Specifically, the interaction means may be provided in the user equipment in a software, hardware or a combination of software and hardware, or the interaction means itself is the user equipment; the user equipment includes but is not limited to: electronic devices such as mobile phones, tablet computers, hand rings, etc., that are flexible or have a flexible portion (e.g., a flexible display portion).
The shape of the deformable device can be determined according to the at least one piece of optical sensing information and the at least one piece of light-emitting information, and a convenient and quick shape detection scheme is provided for the deformable device.
The steps of the examples of the present application are further illustrated by the following examples:
s110 acquires at least one light sensing information acquired at least one first location of a deformable device.
In one possible embodiment, there is a one-to-one correspondence between the at least one first position and the at least one light sensing information.
In one possible embodiment, the method further comprises:
and acquiring the at least one piece of optical sensing information at the at least one first position through at least one optical sensing device.
In a possible embodiment, each of the at least one photo-sensing device may be, for example, a photo-sensing device, such as at least one of a photodiode, a phototransistor, a photoresistor, etc.; alternatively, in a possible embodiment, each of the photo-sensing devices may optionally include a plurality of photo-sensing devices, such as a CCD module; alternatively, in a possible implementation manner, each of the photo-sensing devices may also be a functional module such as a camera that includes a photo-sensing device and other structures such as a lens.
In a possible embodiment, the at least one light-sensing device is embedded or integrated in the at least one first location. For example, in one possible embodiment, the at least one light sensing device may be, for example, at least one camera (e.g., a camera on a cell phone) that the at least one first location inherently has. In the latter embodiments, several possible embodiments of the at least one light-sensing device are also listed.
In a possible implementation manner, optionally, the main execution subject of the embodiment of the present application is the deformable device, and the S110 may be directly obtaining the at least one light sensing information from the at least one light sensing device. Alternatively, in a possible embodiment, the at least one light sensing device acquires the at least one light sensing information and stores the acquired at least one light sensing information in one or more storage media, and the S110 may be configured to read the at least one light sensing information from the one or more storage media.
In a possible implementation manner, optionally, the main execution subject of the embodiment of the present application is other than the deformable device, and the S110 may be to acquire the at least one piece of optical sensing information from the deformable device by means of communication.
S120, at least one piece of light-emitting information corresponding to at least one second position of the deformable device is obtained.
In a possible embodiment, optionally, the at least one first position corresponds differently to the at least one second position, corresponding to a different shape of the deformable device.
Here, the correspondence between a first position and a second position may be, for example: and receiving optical sensing information corresponding to the light-emitting information corresponding to the second position at the first position. For example, the first position is towards the second position.
In a possible implementation manner, the at least one outgoing-light information and the at least one second location may have a one-to-one correspondence relationship. In another possible implementation manner, one light-exiting message may also correspond to a plurality of second locations, for example, in one possible implementation manner, one light-exiting message is light-emitting pattern information or surface pattern information corresponding to an area including the plurality of second locations.
In a possible implementation manner, optionally, the at least one outgoing light message may include: at least one light emitting information.
For example, in some possible embodiments, at least one of the at least one second position has a light emitting device, and a light emitting information corresponding to a light emitting device in the at least one light emitting information is information corresponding to light emission of the light emitting device. For example, control input information of the light emitting device, or light emission property information of the light emitting device.
In a possible embodiment, a light information of the at least one light information includes one or more of the following:
light emission frequency, light emission intensity, light emission time, light emission modulation information, and light emission pattern information.
In this embodiment, the light emission modulation information corresponds to modulation information for modulating information to be emitted during light emission, for example, the information is modulated during light emission by a change in one or more combinations of light emission frequency, light emission intensity, light emission time, and flicker of light emission, for example, a first light emission frequency represents 1, and a second light emission frequency represents 0.
In this embodiment, the light emission pattern information may be, for example, pattern information that needs to be presented by the light emitting device. For example, when the light emitting device is a light emitting unit of a display screen of the deformable device, the light emitting pattern information may be, for example, display content information of the display screen at a second position corresponding to the light emitting device.
In one possible embodiment, the light emitting device does not need to be controlled additionally, for example, in some possible embodiments, the light emitting device is a light emitting unit of a display screen of the deformable device, and corresponding content is displayed according to display requirements.
In another possible embodiment, the deformable device needs to be controlled to emit light corresponding to the at least one outgoing light message. Thus, in one possible implementation, optionally, the method may further include:
and controlling the deformable equipment to emit light corresponding to the at least one light-emitting message at the at least one second position.
Here, the light emission of the deformable device corresponding to the at least one light emitting information may be, for example:
the light-emitting information comprises a light-emitting frequency, and the deformable device emits light at the light-emitting frequency corresponding to the light-emitting information at the at least one second position;
the at least one piece of light-emitting information comprises luminous intensity, and the deformable device emits light at the at least one second position with the luminous intensity corresponding to the at least one piece of light-emitting information;
the at least one piece of light-emitting information comprises light-emitting time, and the deformable device emits light at the at least one second position according to the light-emitting time corresponding to the at least one piece of light-emitting information;
the light emitting information comprises light emitting modulation information, and the deformable device emits light at the at least one second position in a modulation mode corresponding to the at least one light emitting information;
the at least one piece of light-emitting information comprises light-emitting pattern information, and the deformable device emits light at the at least one second position according to the light-emitting pattern corresponding to the at least one piece of light-emitting information.
Those skilled in the art will appreciate that the light may or may not be visible to the human eye, such as infrared light.
In addition to the above-mentioned light emitting information, in another possible embodiment, the at least one light emitting information may further include: at least one surface pattern information.
In this embodiment, the at least one surface pattern information may be information corresponding to a surface pattern of the deformable device, for example. The surface pattern may be, for example: the shape of the edges of the deformable device, the pattern of structures on the surface of the deformable device (e.g., bumps on the housing, buttons, speakers, etc.), logo patterns, etc. In a possible embodiment, it is also possible to provide at least one mark at the at least one second position, and the surface pattern information may also be, for example, a pattern corresponding to the at least one mark.
In some possible embodiments, the at least one light-emitting message may include both the at least one light-emitting message and the at least one surface pattern message. For example, in one possible embodiment, some of the at least one second position have the light emitting device, and other second positions do not have the light emitting device, and the light emitting information corresponding to the some second positions may be the light emitting pattern information; the light emitting information corresponding to the other second positions may be the surface pattern information.
Those skilled in the art will appreciate that S110 and S120 may also be performed in reverse order or simultaneously.
In a possible embodiment, the at least one first position and the at least one second position may be different positions. In another possible embodiment, some of the at least one first location may also overlap some of the at least one second location.
In a possible embodiment, the method may determine the at least one first position and the at least one second position as desired. For example, the at least one first location and the at least one second location are determined according to a possible shape of the deformable device. In this way, the shape of the deformable device may be more conveniently confirmed based on the at least one light sensory information and the at least one light output information.
In an implementation manner of the embodiment of the present application, where the execution subject is the deformable device, the S120 may be to obtain the at least one light emitting information from a storage medium, a light emitting control module, and the like of the deformable device.
In an embodiment of the present application, where the executing subject is another device other than the deformable device, the S120 may further be configured to obtain the at least one light-emitting information from the deformable device by a communication manner.
S130 determines a shape of the deformable device at least according to the at least one light sensing information and the at least one light exit information.
In one possible implementation, S130 includes:
and determining the shape of the deformable equipment at least according to the matching condition of the at least one piece of optical sensing information and the at least one piece of light outlet information.
Wherein the matching condition comprises:
whether at least one of the at least one light sensing information matches at least one of the at least one light exiting information.
The matching between a light sensing information and a light output information may be, for example:
the similarity between at least one parameter information corresponding to the light sensing information and the light emergent information meets a set range.
For example, when the light-emitting information includes light-emitting frequency information, the receiving light frequency corresponding to the light-sensing information is the same as or within an error range from the light-emitting frequency of the light-emitting information.
For example: in an embodiment where the at least one piece of optical sensing information is optical sensing information, and the at least one piece of light-emitting information is light-emitting information, the matching condition includes: and the light sensing information is matched with and not matched with the light emergent information. For example: in one possible embodiment, the light sensory information matches the light extraction information to correspond to a first shape or a first range of shapes of the deformable device; the light sensory information does not match the light extraction information corresponding to a second shape or a second range of shapes of the deformable device.
In an embodiment where the at least one optical sensing information includes a plurality of optical sensing information and/or the at least one optical information includes a plurality of optical information, the matching condition includes: a combination of whether the at least one light sensing information matches the at least one light exiting information. For example: in one possible embodiment, the at least one light sensory information includes first light sensory information and second light sensory information; the light-exiting information comprises first light-exiting information and second light-exiting information. In this embodiment, the matching condition may include several or a combination of the following:
1) the first optical sensing information is matched with the first light-emitting information; and the second light sensing information is matched with the second light outgoing information;
2) the first light sensing information is matched with the first light-emitting information, and the second light sensing information is not matched with the second light-emitting information;
3) the first light sensing information is not matched with the first light-emitting information, and the second light sensing information is matched with the second light-emitting information;
4) the first light sensing information is not matched with the first light outgoing information, and the second light sensing information is not matched with the second light outgoing information.
Of course, in some possible embodiments, whether the first light-sensing information matches the second light-exiting information, whether the second light-sensing information matches the first light-exiting information, etc. may also be included in the matching case. Possible combinations of matching of the at least one light-sensing information with the at least one light-exiting information may be determined based on possible shapes of the deformable device, etc.
In another possible embodiment, in addition to the matching case described above, the S130 may determine the shape of the deformable device according to the position information of the at least one first position and the at least one second position on the deformable device.
In yet another possible embodiment, in addition to the matching cases described above, the S130 may further determine the shape of the deformable device according to a corresponding relationship between at least one matching case and at least one shape.
In this embodiment, the corresponding relationship may be obtained through calculation or training in advance, and then after the matching condition is determined, the shape of the deformable device may be conveniently determined directly according to the corresponding relationship, which is more suitable for several fixed possible scenarios where possible shapes of the deformable device are used.
In a possible implementation, after determining the shape of the deformable device, the method may further comprise:
and executing at least one operation corresponding to the shape.
In some possible embodiments, the at least one operation may be, for example, changing a display mode or displaying content; or may be to start, progress or end interaction with an external device, etc.
Several possible implementations of the embodiments of the present application are given below:
in one possible embodiment, as shown in fig. 2 a-2 c, the deformable device may be, for example, a flexible tablet 210.
In this embodiment, the at least one optical sensing device is two cameras 211 and 214 on the flexible tablet computer 210 (wherein, for example, one camera 211 is on the same side as the display screen 215, and the other camera 214 is on the same side as the back 216 of the display screen 215). In some possible embodiments, a camera that is provided in the flexible tablet computer 210 may be used, and an additional camera is not required. In this embodiment, the at least one first position is two positions where the two cameras 211 and 214 are located.
In this embodiment, the at least one piece of optical sensing information may be, for example, two images or two image sequences captured by the two cameras 211 and 214.
In this embodiment, the at least one light emitting message may be, for example, a light emitting message corresponding to a light emitting content of an area where at least one second location is located on the flexible tablet computer 210.
The at least one second position is determined according to the two positions of the two cameras 211 and 214 and the possible shape of the flexible tablet computer 210. In this embodiment, taking the flexible tablet computer 210 including three shapes as an example, two second positions 212, 213 are determined, wherein: as shown in fig. 2a, in the first shape of the flexible tablet computer 210, the two cameras 211 and 214 cannot capture images corresponding to the light-emitting information of the two second positions 212 and 213; as shown in fig. 2b, in the second shape of the flexible tablet computer 210, the camera 211 can capture an image corresponding to the lighting information of a second location 212, and the other camera 214 cannot capture an image corresponding to the lighting information of the two second locations 212 and 213; as shown in fig. 2c, in the third shape of the flexible tablet computer 210, the camera 211 can capture an image corresponding to the lighting information of the second position 212, and at the same time, the other camera 214 can capture an image corresponding to the lighting information of the other second position 213.
According to the above description, in the case that the shape of the flexible tablet computer 210 is unknown, the shape of the flexible tablet computer 210 may be determined according to the matching condition of the at least one light sensing information and the at least one light exiting information.
It can be seen that, in this embodiment, the method of this embodiment can be implemented by using an existing hardware module of the deformable device, that is, the implementation of this embodiment may be implemented conveniently without increasing the hardware cost of the deformable device.
In one possible embodiment, the deformable device may comprise a bi-directional OLED module.
The bidirectional OLED module comprises a plurality of light emitting units capable of emitting light towards one side and a plurality of light sensing units capable of acquiring light information of the side. For example, in one possible implementation, the bidirectional OLED module may be a display module of the deformable device, which displays and acquires image information of the environment on the display side.
In this embodiment, the at least one light sensing device includes:
the bidirectional OLED module comprises at least one light sensing unit at the at least one first position.
In a possible embodiment, the at least one first position is a position where one or more set points or areas on the bidirectional OLED module are located, and the at least one light sensing information is obtained by the light sensing units at these positions.
In this embodiment, the at least one outgoing light message includes:
and the bidirectional OLED module is used for generating at least one piece of light emitting information corresponding to at least one light emitting unit at the at least one second position.
In one possible embodiment, as shown in fig. 3b, the shape of the bi-directional OLED module 310 may be varied at will.
In this embodiment, any region on the light emitting side of the bi-directional OLED module 310 can be used as both a light emitting region and a light sensing region. Therefore, either one of the regions may be the first position or the second position.
In a possible embodiment, the bidirectional OLED module 310 may optionally be logically divided into a plurality of sub-regions 311, for example, in fig. 3a, into 50 sub-regions 311 of 5 rows x10 columns, and the position of each sub-region 311 on the bidirectional OLED module 310 is known.
In a possible implementation manner, the at least one first position may be, for example, a position corresponding to one or more sub-regions 311 in the 50 sub-regions 311, where the one or more pieces of light sensing information acquired by the light sensing devices of the one or more sub-regions 311 is the at least one piece of light sensing information.
In a possible implementation manner, the at least one second position may also be a position corresponding to one or more sub-regions 311 in the 50 sub-regions 311, and the light emitting information corresponding to the light emitting devices of the one or more sub-regions 311 is the at least one light emitting information.
Analyzing the at least one light-emitting information and the at least one light-sensing information, determining a matching condition between the at least one light-sensing information and the at least one light-emitting information, and determining the shape of the bidirectional OLED module 310 according to positions of sub-regions 311 on the bidirectional OLED module 310, where the sub-regions correspond to the light-emitting information and the light-sensing information which are matched with each other respectively.
As shown in fig. 3b, when a piece of photo sensing information matched with a piece of light emitting information of the second sub-region 311b is acquired at the first sub-region 311a, the current shape of the bidirectional OLED module 310 can be determined according to the positions of the first sub-region 311a and the second sub-region 311b (except for the first sub-region 311a and the second sub-region 311b, other sub-regions are not shown in fig. 3 b) on the bidirectional OLED module 310 as shown in fig. 3 b.
In another possible implementation, each sub-region 311 in the 50 sub-regions 311 may be simultaneously used as a first position and a second position, and at this time, the photo-sensing information and the light-emitting information corresponding to each sub-region 311 may be matched with other photo-sensing information and other light-emitting information corresponding to other sub-regions 311, so as to determine a plurality of pairs of sub-regions 311 that are matched with each other. The shape of the bi-directional OLED module 310 can be determined according to the matching result and the position of the pairs of sub-regions 311 on the bi-directional OLED module 310 as described above.
In some possible embodiments, a deformable device may enable the display of content through an array of LEDs. Thus, in one possible embodiment, the deformable device comprises: an LED array; each LED unit of the LED array comprises: a light emitting operating state and a light sensing operating state.
For example, for an LED unit in the LED array, whether the LED unit is in a light emitting operation state or a light sensing operation state can be controlled by controlling a forward bias and a reverse bias of a voltage thereof.
In this embodiment, for example, it can be determined which LED units at which positions are required to be in the light sensing operation state and which LED units at which positions are required to be in the light emitting operation state according to the possible shapes of the deformable device. Or, as required, at a first time, the LED unit at a position is controlled to be in a light sensing working state, and at a second time, the LED unit at the position is controlled to be in a light emitting working state.
In this embodiment, the at least one light sensing device may include:
and the LED array is at least one LED unit in the light sensing working state at the at least one first position.
In this embodiment, the at least one outgoing light message includes:
and the LED array is at least one piece of luminous information corresponding to at least one LED unit in a luminous state at the at least one second position.
In the above two embodiments, a flexible bidirectional OLED module or LED array is used as a deformable device or a part of a deformable device, so that the implementation of the embodiments of the present application is more convenient, and more possible first positions and second positions can be obtained, so that the shape determination of the deformable device is more accurate.
It is understood by those skilled in the art that, in the method according to the embodiments of the present application, the sequence numbers of the steps do not mean the execution sequence, and the execution sequence of the steps should be determined by their functions and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
As shown in fig. 4, one possible implementation manner of the embodiment of the present application provides an interaction apparatus 400 based on a deformable device, including:
a first information acquisition module 410 for acquiring at least one light sensing information acquired at least one first location of a deformable device;
a second information obtaining module 420, configured to obtain at least one light-emitting information corresponding to at least one second position of the deformable device;
an analyzing and processing module 430, configured to determine a shape of the deformable device according to at least the at least one light sensing information and the at least one light exiting information.
The shape of the deformable device can be determined according to the at least one piece of optical sensing information and the at least one piece of light-emitting information, and a convenient and quick shape detection scheme is provided for the deformable device.
The modules and units of the embodiments of the present application are further described by the following embodiments.
In a possible implementation manner, optionally, the interaction device 400 is not the deformable device itself, and the first information obtaining module 410 may also be a communication module for obtaining the at least one light sensing information from at least one external device (e.g., the deformable device).
In a possible implementation, as shown in fig. 5a, optionally, the interaction device 400 further includes at least one light sensing device 440 located at the at least one first location, for collecting the at least one light sensing information at the at least one first location. Further description of the at least one photo-sensing device 440 may refer to the corresponding description in the embodiment shown in fig. 1, and is not repeated here.
In a possible implementation, optionally, the interaction device 400 is the deformable device itself, where the first information obtaining module 410 may obtain the at least one light sensing information directly from the at least one light sensing device; alternatively, in a possible implementation, the at least one light sensor 440 acquires the at least one light sensing information and stores the acquired at least one light sensing information in one or more storage media, and the first information acquiring module 410 may read the at least one light sensing information from the one or more storage media.
In a possible embodiment, the correspondence between the first position and the second position may be, for example: and receiving optical sensing information corresponding to the light-emitting information corresponding to the second position at the first position.
In one possible embodiment, as shown in fig. 5a, optionally, the apparatus 400 comprises at least one light emitting device 470 at least one of the at least one second position;
the at least one outgoing light message may include: at least one light emitting device 470 corresponds to at least one light emitting information.
As will be appreciated by those skilled in the art, the light emitted by the at least one light emitting device herein may be visible or invisible to the human eye, such as infrared light.
In a possible embodiment, a light information of the at least one light information includes one or more of the following:
light emission frequency, light emission intensity, light emission time, light emission modulation information, and light emission pattern information.
In the present embodiment, the light emission modulation information corresponds to modulation information for modulating information to be emitted during light emission, for example, modulating information during light emission by a change in one or more combinations of light emission frequency, light emission intensity, light emission time, and flicker of light emission.
In this embodiment, the light emission pattern information may be, for example, pattern information that needs to be presented by the light emitting device.
In one possible embodiment, the light emitting device does not need to be controlled additionally, for example, in some possible embodiments, the light emitting device is a light emitting unit of a display screen of the deformable device, and corresponding content is displayed according to display requirements.
In another possible embodiment, the at least one light emitting device needs to be controlled to emit light corresponding to the at least one outgoing light message. Therefore, in a possible embodiment, optionally, as shown in fig. 5b, the apparatus 400 further includes a light emitting control module 450 for controlling the at least one light emitting device to emit light corresponding to the at least one outgoing light information at the at least one second position.
The light emitted by the deformable device corresponding to the at least one light-emitting message may refer to the corresponding description in the embodiment shown in fig. 1.
In addition to the above-mentioned light emitting information, in another possible embodiment, the at least one light emitting information may further include: at least one surface pattern information. In this embodiment, the at least one surface pattern information may be information corresponding to a surface pattern of the deformable device, for example.
In some possible embodiments, the at least one light-emitting message may include both the at least one light-emitting message and the at least one surface pattern message.
In a possible embodiment, the at least one first position and the at least one second position may be different positions. In another possible embodiment, some of the at least one first location may also overlap some of the at least one second location.
In a possible embodiment, optionally, the at least one first position corresponds differently to the at least one second position, corresponding to a different shape of the deformable device.
Here, the correspondence between a first position and a second position may be, for example: and receiving optical sensing information corresponding to the light-emitting information corresponding to the second position at the first position. For example, the first position is towards the second position.
In a possible embodiment, the at least one first position and the at least one second position may be determined as desired. For example, the at least one first location and the at least one second location are determined according to a possible shape of the deformable device. In this way, the shape of the deformable device may be more conveniently confirmed based on the at least one light sensory information and the at least one light output information.
In an embodiment where the interaction apparatus 400 is the deformable device itself, the second information obtaining module 420 may obtain the at least one piece of light emitting information from a storage medium, a light emitting control module, and the like of the deformable device, for example.
In an embodiment where the interaction apparatus 400 is a device other than the deformable device, the second information obtaining module 420 may be, for example, a communication module, configured to obtain the at least one light-emitting information from the deformable device or another device by a communication manner.
In a possible implementation, as shown in fig. 5c, the analysis processing module 430 optionally includes:
a first determining unit 431, configured to determine a shape of the deformable device at least according to a matching condition of the at least one piece of light sensing information and the at least one piece of light exiting information.
In this embodiment, the matching case includes:
whether at least one of the at least one light sensing information matches at least one of the at least one light exiting information.
The matching between a light sensing information and a light output information may be, for example:
the similarity between at least one parameter information corresponding to the light sensing information and the light emergent information meets a set range.
For example, when the light-emitting information includes light-emitting frequency information, the receiving light frequency corresponding to the light-sensing information is the same as or within an error range from the light-emitting frequency of the light-emitting information.
The matching condition of the at least one piece of optical sensing information and the at least one piece of light exiting information may specifically refer to the corresponding description in the embodiment shown in fig. 1.
In one possible implementation, as shown in fig. 5d, the analysis processing module 430 optionally includes:
a second determining unit 432, configured to determine a shape of the deformable device according to a matching condition of the at least one light sensing information and the at least one light exiting information, and position information of the at least one first position and the at least one second position on the deformable device.
In one possible implementation, as shown in fig. 5e, the analysis processing module 430 optionally includes:
the third determining unit 433 is configured to determine a shape of the deformable device according to a matching condition of the at least one piece of light sensing information and the at least one piece of light exiting information, and a correspondence between the at least one matching condition and the at least one shape.
In this embodiment, the corresponding relationship may be obtained through calculation or training in advance, and then after the matching condition is determined, the shape of the deformable device may be conveniently determined directly according to the corresponding relationship, which is more suitable for several fixed possible scenarios where possible shapes of the deformable device are used.
As shown in fig. 5f, in a possible implementation, optionally, the apparatus 400 may further include:
an executing module 460, configured to execute at least one operation corresponding to the shape.
Thus, after determining the shape of the deformable device, the execution module 460 may perform the at least one operation.
Several possible implementations of the embodiments of the present application are given below:
in one possible implementation, as shown in fig. 2a to 2c, the interaction device 400 is the deformable device 210 itself, the deformable device 210 includes two cameras 211, 214 as light sensing devices, and the first information acquiring module 410 may acquire the at least one piece of light sensing information from the two cameras 211, 214. The second information obtaining module 410 may obtain the at least one light-emitting information from the display information of the display screen 215.
It can be seen that, in this embodiment, the method of this embodiment can be implemented by using an existing hardware module of the deformable device, that is, the implementation of this embodiment may be implemented conveniently without increasing the hardware cost of the deformable device.
In one possible embodiment, the deformable device may comprise a bi-directional OLED module.
The bidirectional OLED module comprises a plurality of light emitting units capable of emitting light towards one side and a plurality of light sensing units capable of acquiring light information of the side.
In this embodiment, the at least one light sensing device includes:
the bidirectional OLED module comprises at least one light sensing unit at the at least one first position.
In a possible embodiment, the at least one first position is a position where one or more set points or areas on the bidirectional OLED module are located, and the at least one light sensing information is obtained by the light sensing units at these positions.
In this embodiment, the at least one outgoing light message includes:
and the bidirectional OLED module is used for generating at least one piece of light emitting information corresponding to at least one light emitting unit at the at least one second position.
In a possible embodiment, the distribution of the at least one first location and the at least one second location on the bi-directional OLED module may optionally be as shown in fig. 3 a.
In some possible embodiments, a deformable device may enable the display of content through an array of LEDs. Thus, in one possible embodiment, the deformable device comprises: an LED array; each LED unit of the LED array comprises: a light emitting operating state and a light sensing operating state.
For example, for an LED unit in the LED array, whether the LED unit is in a light emitting operation state or a light sensing operation state can be controlled by controlling a forward bias and a reverse bias of a voltage thereof.
In this embodiment, for example, it can be determined which LED units at which positions are required to be in the light sensing operation state and which LED units at which positions are required to be in the light emitting operation state according to the possible shapes of the deformable device. Or, as required, at a first time, the LED unit at a position is controlled to be in a light sensing working state, and at a second time, the LED unit at the position is controlled to be in a light emitting working state.
In this embodiment, the at least one light sensing device may include:
and the LED array is at least one LED unit in the light sensing working state at the at least one first position.
In this embodiment, the at least one outgoing light message includes:
and the LED array is at least one piece of luminous information corresponding to at least one LED unit in a luminous state at the at least one second position.
In the above two embodiments, a flexible bidirectional OLED module or LED array is used as a deformable device or a part of a deformable device, so that the implementation of the embodiments of the present application is more convenient, and more possible first positions and second positions can be obtained, so that the shape determination of the deformable device is more accurate.
For further description of functions of each module and unit in the embodiments of the present application, reference is made to corresponding description in the above method embodiments.
Fig. 6 is a schematic structural diagram of another interaction apparatus 600 based on a deformable device according to an embodiment of the present application, and the specific embodiment of the present application does not limit the specific implementation of the interaction apparatus 600. As shown in fig. 6, the interaction device 600 may include:
a processor (processor)610, a Communications Interface 620, a memory 630, and a communication bus 640. Wherein:
the processor 610, communication interface 620, and memory 630 communicate with each other via a communication bus 640.
A communication interface 620 for communicating with network elements such as clients and the like.
The processor 610 is configured to execute the program 632, and may specifically execute the relevant steps in the foregoing method embodiments.
In particular, the program 632 may include program code that includes computer operating instructions.
The processor 610 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present application.
The memory 630 is used for storing the program 632. Memory 630 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory. The program 632 may specifically be configured to cause the interaction apparatus 600 to perform the following steps:
acquiring at least one light sensing information acquired at least one first position of a deformable device;
acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable equipment;
and determining the shape of the deformable device at least according to the at least one piece of light sensing information and the at least one piece of light outlet information.
For specific implementation of each step in the program 632, reference may be made to corresponding steps and corresponding descriptions in units in the foregoing embodiments, which are not described herein again. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described devices and modules may refer to the corresponding process descriptions in the foregoing method embodiments, and are not described herein again.
Those of ordinary skill in the art will appreciate that the various illustrative elements and method steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above embodiments are merely illustrative, and not restrictive, and those skilled in the relevant art can make various changes and modifications without departing from the spirit and scope of the present application, and therefore all equivalent technical solutions also fall within the scope of the present application, and the scope of the present application is defined by the appended claims.
Claims (28)
1. A deformable device-based interaction method, comprising:
acquiring at least one light sensing information acquired at least one first position of a deformable device, the at least one light sensing information being: information acquired by at least one light sensing device at the at least one first location;
acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable device, wherein the at least one first position and the at least one second position are not completely the same position, and the at least one piece of light-emitting information comprises: control input information or light emission attribute information of the light emitting device at the at least one second position;
determining the shape of the deformable device at least according to the matching condition of the at least one piece of optical sensing information and the at least one piece of light extraction information, wherein the matching condition comprises: whether at least one of the at least one light sensing information matches at least one of the at least one light exiting information.
2. The method of claim 1, wherein the at least one outgoing message comprises: at least one light emitting information.
3. The method of claim 2, wherein each of the at least one light emitting message comprises at least one of:
light emission frequency, light emission intensity, light emission time, light emission modulation information, and light emission pattern information.
4. The method of claim 2, wherein the method further comprises:
and controlling the deformable equipment to emit light corresponding to the at least one light-emitting message at the at least one second position.
5. The method of claim 1, wherein the at least one outgoing message comprises: at least one surface pattern information.
6. The method of claim 1, wherein said determining the shape of the deformable device based at least on the matching of the at least one light sensory information to the at least one light output information comprises:
and determining the shape of the deformable device according to the matching condition of the at least one piece of optical sensing information and the at least one piece of light-emitting information and the position information of the at least one first position and the at least one second position on the deformable device.
7. The method of claim 1, wherein said determining the shape of the deformable device based at least on the matching of the at least one light sensory information to the at least one light output information comprises:
and determining the shape of the deformable equipment according to a matching condition of the at least one piece of optical sensing information and the at least one piece of light-emitting information and a corresponding relationship between the at least one matching condition and the at least one shape.
8. The method of claim 1, wherein the method further comprises:
and executing at least one operation corresponding to the shape.
9. The method of claim 1,
the deformable device comprises a bi-directional Organic Light Emitting Diode (OLED) module;
the at least one light sensing device comprises:
the bidirectional OLED module comprises at least one light sensing unit at the at least one first position.
10. The method of claim 9, wherein the at least one outgoing message comprises:
and the bidirectional OLED module is used for generating at least one piece of light emitting information corresponding to at least one light emitting unit at the at least one second position.
11. The method of claim 1, wherein the deformable device comprises: a Light Emitting Diode (LED) array; each LED unit of the LED array comprises: a light emitting working state and a light sensing working state;
the at least one light sensing device comprises:
and the LED array is at least one LED unit in the light sensing working state at the at least one first position.
12. The method of claim 11, wherein the at least one outgoing message comprises:
and the LED array is at least one piece of luminous information corresponding to at least one LED unit in a luminous state at the at least one second position.
13. The method of claim 1, wherein the at least one first location and the at least one second location correspond differently to different shapes of the deformable device.
14. A deformable device based interaction apparatus, comprising:
a first information obtaining module, configured to obtain at least one piece of light sensing information obtained at least one first position of a deformable device, where the at least one piece of light sensing information is: information acquired by at least one light sensing device at the at least one first location;
a second information obtaining module, configured to obtain at least one piece of light extraction information corresponding to at least one second position of the deformable device, where the at least one first position and the at least one second position are not exactly the same position, and the at least one piece of light extraction information includes: control input information or light emission attribute information of the light emitting device at the at least one second position;
an analysis processing module, configured to determine a shape of the deformable device according to at least a matching condition of the at least one piece of light sensing information and the at least one piece of light exiting information, where the matching condition includes: whether at least one of the at least one light sensing information matches at least one of the at least one light exiting information.
15. The apparatus of claim 14, wherein the apparatus comprises at least one light emitting device at least one of the at least one second location;
the at least one outgoing light message may include: and at least one piece of light-emitting information corresponding to the at least one light-emitting device.
16. The apparatus of claim 15, wherein each of the at least one light-emitting information comprises at least one of:
light emission frequency, light emission intensity, light emission time, light emission modulation information, and light emission pattern information.
17. The apparatus of claim 15, further comprising a light emission control module for controlling the at least one light emitting device to emit light corresponding to the at least one light exit message at the at least one second location.
18. The apparatus of claim 14, wherein the at least one outgoing message comprises: at least one surface pattern information.
19. The apparatus of claim 14, wherein the analysis processing module comprises:
and the second determining unit is used for determining the shape of the deformable device according to the matching condition of the at least one piece of optical sensing information and the at least one piece of light-emitting information and the position information of the at least one first position and the at least one second position on the deformable device.
20. The apparatus of claim 14, wherein the analysis processing module comprises:
a third determining unit, configured to determine a shape of the deformable device according to a matching condition of the at least one piece of light sensing information and the at least one piece of light exiting information, and a correspondence between the at least one matching condition and the at least one shape.
21. The apparatus of claim 14, wherein the apparatus further comprises:
and the execution module is used for executing at least one operation corresponding to the shape.
22. The apparatus of claim 14, wherein the apparatus comprises at least one light sensing device located at the at least one first location for collecting the at least one light sensing information at the at least one first location.
23. The apparatus of claim 22,
the deformable device comprises a bi-directional Organic Light Emitting Diode (OLED) module;
the at least one light sensing device comprises:
the bidirectional OLED module comprises at least one light sensing unit at the at least one first position.
24. The apparatus of claim 23, wherein the at least one outgoing message comprises:
and the bidirectional OLED module is used for generating at least one piece of light emitting information corresponding to at least one light emitting unit at the at least one second position.
25. The apparatus of claim 22, wherein the deformable device comprises: a Light Emitting Diode (LED) array; each LED unit of the LED array comprises: a light emitting working state and a light sensing working state;
the at least one light sensing device comprises:
and the LED array is at least one LED unit in the light sensing working state at the at least one first position.
26. The apparatus of claim 25, wherein the at least one outgoing message comprises:
and the LED array is at least one piece of luminous information corresponding to at least one LED unit in a luminous state at the at least one second position.
27. The apparatus of claim 14, wherein the at least one first position corresponds differently to the at least one second position corresponding to a different shape of the deformable device.
28. A user equipment, the user equipment comprising:
a memory for storing a program;
a processor for executing the memory-stored program, the program causing the processor to:
acquiring at least one light sensing information acquired at least one first position of a deformable device, the at least one light sensing information being: information acquired by at least one light sensing device at the at least one first location;
acquiring at least one piece of light-emitting information corresponding to at least one second position of the deformable device, wherein the at least one first position and the at least one second position are not completely the same position, and the at least one piece of light-emitting information comprises: control input information or light emission attribute information of the light emitting device at the at least one second position;
determining the shape of the deformable device at least according to the matching condition of the at least one piece of optical sensing information and the at least one piece of light extraction information, wherein the matching condition comprises: whether at least one of the at least one light sensing information matches at least one of the at least one light exiting information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510578268.8A CN107024974B (en) | 2015-09-11 | 2015-09-11 | Interaction method and interaction device based on deformable equipment and user equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510578268.8A CN107024974B (en) | 2015-09-11 | 2015-09-11 | Interaction method and interaction device based on deformable equipment and user equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107024974A CN107024974A (en) | 2017-08-08 |
| CN107024974B true CN107024974B (en) | 2020-12-29 |
Family
ID=59523901
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510578268.8A Active CN107024974B (en) | 2015-09-11 | 2015-09-11 | Interaction method and interaction device based on deformable equipment and user equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107024974B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109547619B (en) * | 2018-11-28 | 2020-09-04 | 三星电子（中国）研发中心 | Method, device and system for detecting and establishing connection between devices based on flexible screen |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1967937A1 (en) * | 2007-03-06 | 2008-09-10 | Polymer Vision Limited | A display unit, a method and a computer program product |
| FR2915591A1 (en) * | 2007-04-27 | 2008-10-31 | Thomson Licensing Sas | METHOD FOR DETECTING A FLEXION EXERCISED ON A FLEXIBLE SCREEN, AND APPARATUS PROVIDED WITH SUCH A SCREEN FOR CARRYING OUT THE METHOD |
| US20130321373A1 (en) * | 2012-05-31 | 2013-12-05 | Semiconductor Energy Laboratory Co., Ltd. | Electronic device, program, and recording medium |
| KR102104588B1 (en) * | 2012-07-11 | 2020-04-24 | 삼성전자주식회사 | Flexible display apparatus and operating method thereof |
| WO2015002037A1 (en) * | 2013-07-02 | 2015-01-08 | Semiconductor Energy Laboratory Co., Ltd. | Data processing device |
-
2015
- 2015-09-11 CN CN201510578268.8A patent/CN107024974B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107024974A (en) | 2017-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10579853B2 (en) | Method and apparatus for acquiring fingerprint image and terminal device | |
| JP6360621B2 (en) | Distance image acquisition device and distance image acquisition method | |
| ES2708695T3 (en) | Coded light detector | |
| US9484001B2 (en) | Portable electronic device controlling diffuse light source to emit light approximating color of object of user interest | |
| CN104641727B (en) | A kind of method, apparatus and system for controlling one or more light sources via hand held computer device | |
| JP6290512B2 (en) | Distance image acquisition device and distance image acquisition method | |
| JP3802892B2 (en) | Iris authentication device | |
| EP1037163A2 (en) | Coordinate input apparatus and method | |
| KR101634265B1 (en) | Touch Pen And Selecting Mathod Of Color Thereof | |
| JP2014206952A (en) | Projector and control method | |
| WO2016157601A1 (en) | Range image acquisition apparatus and range image acquisition method | |
| JP2006277552A (en) | Information display system and information display method | |
| KR20180135044A (en) | PROCESSING METHOD AND APPARATUS FOR PROJECTION EQUIPMENT | |
| CN107024974B (en) | Interaction method and interaction device based on deformable equipment and user equipment | |
| JP6065477B2 (en) | Image processing apparatus and program | |
| CN106249850B (en) | Interaction method and interaction device based on deformable equipment and user equipment | |
| US20160063711A1 (en) | Non-transitory storage medium encoded with computer readable image processing program, information processing system, information processing apparatus, and image processing method | |
| KR100860331B1 (en) | Electronic device having apparatus for controlling moving of pointer | |
| JP2015184906A (en) | Skin color detection condition determination device, skin color detection condition determination method and skin color detection condition determination computer program | |
| US11081516B2 (en) | Display screen, electronic device and method for three-dimensional feature recognition | |
| EP2738648A1 (en) | Display system | |
| CN108351684B (en) | Operation detection device, operation detection method and image display system | |
| JP6508730B2 (en) | Light emission marker device, marker detection device, transmission system, marker light emission method, marker detection method, and program | |
| JP2012226507A (en) | Emitter identification device, emitter identification method and emitter identification program | |
| JP2016184850A (en) | Projector and detection method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |