EP3167347A1 - Interaktiver spiegel - Google Patents
Interaktiver spiegelInfo
- Publication number
- EP3167347A1 EP3167347A1 EP15745156.8A EP15745156A EP3167347A1 EP 3167347 A1 EP3167347 A1 EP 3167347A1 EP 15745156 A EP15745156 A EP 15745156A EP 3167347 A1 EP3167347 A1 EP 3167347A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- mirror
- display
- interactive
- sensor
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 53
- 230000033001 locomotion Effects 0.000 claims abstract description 37
- 238000000034 method Methods 0.000 claims description 12
- 238000004891 communication Methods 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 239000011521 glass Substances 0.000 description 7
- 230000003993 interaction Effects 0.000 description 4
- 230000005855 radiation Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 2
- 229910052782 aluminium Inorganic materials 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- 238000001429 visible spectrum Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 239000002313 adhesive film Substances 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001680 brushing effect Effects 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007334 memory performance Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000012732 spatial analysis Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47G—HOUSEHOLD OR TABLE EQUIPMENT
- A47G1/00—Mirrors; Picture frames or the like, e.g. provided with heating, lighting or ventilating means
- A47G1/02—Mirrors used as equipment
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/08—Mirrors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
- G06F1/1605—Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3231—Monitoring the presence, absence or movement of users
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- the present invention relates to an interactive mirror that can be controlled by means of movements and / or gestures.
- WO 2005/031552 A2 therefore proposes to control a display integrated in a mirror by means of gestures which are monitored by several cameras. However, even if such an interactive mirror is to communicate with other external devices and in particular the Internet, many users will be afraid to be picked up by cameras if necessary.
- the present invention relates to an interactive mirror having an at least partially reflecting mirror surface and at least one integrated in the mirror surface display.
- the mirror according to the invention further comprises an active infrared sensor, which in the mirror is integrated or mounted on the mirror.
- the mirror has a processor which is suitable for determining, based on the data acquired by the at least one sensor in front of the mirror, movements and / or gestures of a person.
- a component of the active infrared sensor emits radiation in the infrared range, which is reflected on a person in front of the mirror.
- the reflected infrared rays are received by a component of the active infrared sensor and the received data is evaluated by the processor.
- the processor is able to use the data acquired by the at least one sensor to determine movements and / or gestures that the person executes in front of the mirror.
- the transmitter and receiver components of the active infrared sensor can be integrated into a single sensor or consist of separate components that can be mounted remotely on the mirror.
- the at least one display is integrated into the mirror surface in such a way that the display area of the mirror surface can display information when the display is switched on and is so reflective when the display is switched off that there is no difference in the mirror image between the display surface and the remaining mirror surface for a person in front of the mirror lets recognize.
- the at least partially reflecting mirror surface is preferably formed with a light transmittance in the visible spectrum of at least 10%, more preferably at least 15% and particularly preferably at least 20%.
- those areas of the mirror surface, in which no display is integrated are laminated on the back of the mirror with a black film, which increases the contrast.
- the switched-off black display and the black film preferably have substantially the same optical properties in the visible spectrum in order to ensure that a homogeneous mirror image is formed.
- the interactive mirror according to the invention has at least two active infrared sensors, which are preferably arranged at or near two opposite edges of the mirror surface or the mirror.
- the mirror according to the invention preferably has an active infrared sensor at both lateral mirror edges. This makes it particularly good for example gestures of the right and left hand determine and distinguish from each other.
- an active infrared sensor is particularly preferred, the present invention is not limited to such sensors. Rather, instead of the active infrared sensor and a passive infrared sensor for Use come, which measures only the radiated by a person infrared radiation or an ultrasonic sensor can be provided. All features described in the context of the present invention can therefore also be used in an interactive mirror with a passive infrared sensor integrated in the mirror or an ultrasonic sensor integrated in the mirror.
- the processor is preferably suitable for adapting the brightness of the integrated display to the ambient brightness.
- the mirror according to the invention preferably has a brightness sensor, such as e.g. a photodiode on.
- a brightness sensor may additionally or alternatively also serve to activate the mirror, i. from a purely reflective state (commercial mirror) to an interactive mirror capable of determining movements and / or gestures and / or displaying information on the display.
- the mirror according to the invention can be activated by switching on light in the bathroom.
- the interactive mirror of the present invention is adapted to communicate wirelessly or via a cable connection with one or more external electronic devices.
- These external electronic devices may be, for example, servers, PCs, tablets, smartphones or Internet access.
- the external electronic devices are e.g. around electric shavers, electric toothbrushes, hair dryers and the like.
- the interactive mirror is adapted to detect an external electronic device if it is brought near the mirror and / or turned on near the mirror.
- the interactive mirror may comprise one or a combination of the following interfaces: near field communication, Bluetooth transmitter and / or receiver, Wifi, TP Ethernet, 433/866 MHz network, Zigbee network, RFID sensor, infrared transmitter and / or receiver.
- the interactive mirror is adapted to perform one or more of the following actions based on the data received from an external electronic device: switching from an inactive mode to an active mode, switching from an active mode to an inactive mode, starting and / or Exit an application related to the external electronic device, displaying device-specific information on the display, display of instructions on the display, display of usage data related to the previous and / or recommended usage of the external electronic device, control of another external electronic device, transfer of device-specific information and / or usage data another external electronic device.
- a digitally meshed toothbrush may display a control and information area on the display of the interactive mirror to inform the user of the current and prior use of the toothbrush and / or to provide guidance on the dental care process currently taking place.
- the mirror could be activated or deactivated by e.g. this toothbrush is brought close to the mirror or a predefined zone on the mirror glass.
- a home automation system so that, for example, information such as opening the front door or garage, or even an alarm condition of a smoke or glass breakage detector are displayed as information in the mirror.
- the interactive mirror is adapted to control an external electronic device, preferably two or more electronic devices simultaneously.
- the control can be controlled via movements and / or gestures carried out in front of the mirror.
- the control of the bathtub water supply could be controlled with respect to water temperature and time of filling and the subsequent signaling to the user of another device when the bathtub is filled.
- Another example would be to enter appointments in the calendar on e.g. the smartphone with gestures that are recognized by the mirror.
- the interactive mirror preferably further comprises a microphone.
- a microphone This allows, for example, an additional acoustic control. For example, emails or calendar entries could be dictated.
- the processor may be adapted to use the sounds picked up by the microphone to infer a currently active external electronic device by comparing the received sounds with the stored operating noise of the external electronic device. So Electronic toothbrushes, hair driers, and electric razors generate specific sounds that could be detected by the mirror of the invention using the microphone.
- the processor for example by means of a network connection, is suitable for displaying certain retrofittable applications ("apps” and "widgets") on the display.
- apps and “widgets”
- These could, for example, generally or specifically for the user relevant information such. Weather, traffic information, news, etc. but also content of social networks such as Facebook and Twitter include.
- such applications may already be preinstalled in the processor or a memory unit.
- the mirror according to the invention is preferably suitable for integrating or displaying information displayed on the display in the mirror image of a person located in front of the mirror.
- the application is preferably adapted adaptively to the current position of the person. For example, when used with a compatible electric shaver, predefined shaving patterns could be placed over the subject's mirror image.
- the processor of the mirror according to the invention is capable of distinguishing intentional interactions of the person in front of the mirror from general movements in order to avoid misuse by the user. This can be achieved, inter alia, that, for example, only certain gestures are recognized as control gestures when they occur in combination with a specific external electronic device.
- the mirror according to the invention even in the absence of a person in front of the mirror or in the room in the deactivated state automatically messages / information represent and / or acoustically and / or via a backlight can trigger an alarm.
- This can be useful, for example, for incoming messages with high priority (smoke detector, severe weather warning, etc.).
- the processor of the mirror according to the invention is suitable for, on the basis of the data acquired by the at least one sensor, a person located in front of the mirror identify. This may be done, for example, by the processor closing the size of the person in front of the mirror on the basis of the data acquired by the at least one sensor. Additionally or alternatively, the processor may be adapted to recognize certain patterns of motion typical of a particular person. Another way of identification may be the use of personal items (toothbrush, RFID bracelet, smartwatch, etc.). The processor is also preferably adapted to display personalized data on the display based on the identification.
- the at least one display has two displays arranged side by side and / or two separate display fields arranged side by side, which can be used by the user according to preference (eg for left-handed or right-handed users).
- the two can be used simultaneously next to each other on parent displays or display panels of two people in front of the mirror.
- the processor is preferably suitable for determining movements and / or gestures carried out simultaneously in front of the mirror of two persons on the basis of the data acquired by the at least one sensor and assigning them to the respective persons.
- the mirror according to the invention also allows the user to define certain gestures and / or gesture combinations and associate certain control commands with them, so that the mirror processor performs the associated action whenever the gesture or gesture combination so defined is executed, i. for example, display a certain content on the display, communicate with a particular external electronic device, and the like.
- Such gestures or combinations of gestures may involve any movement of the body or one or more parts of the body, such as the body. an arm or a hand, for example, horizontal and / or vertical wiping movements, folding movements of the fingers, pointing movements with one or more fingers, openings and / or closing the hand, raising or lowering of an arm, nodding with the head and / or head shaking and the like ,
- the present invention further relates to a method comprising the steps of providing an interactive mirror with a display, a sensor and a processor, preferably an interactive mirror as described above.
- Running a Movement and / or gesture in front of the mirror wherein the movement and / or gesture can be performed by one or more persons at the same time.
- an action is preferably initiated and / or performed by the processor.
- This is preferably one or a combination of the following actions: changing the mirror from an inactive mode to an active mode, changing the mirror from an active mode to an inactive mode, starting and / or ending an external electronic device in Related application, display of device-specific information on the display, display of instructions on the display, display of usage data related to the previous and / or recommended usage of an external electronic device, display of general and / or user-specific information such as News, Emails, Weather, Twitter, Facebook, etc.
- the inventive method further comprises the step of wirelessly communicating the interactive mirror with one or more external electronic devices and / or wirelessly controlling one or more external electronic devices.
- the method according to the invention further comprises the step of wirelessly controlling one or more external electronic devices by means of a movement and / or gesture carried out in front of the mirror.
- the method according to the invention further comprises the step of configuring the interactive mirror, wherein a user associates one or more movements and / or gestures with specific actions that the processor of the mirror is to perform in executing the movement and / or gesture.
- the movement or gesture is preferably carried out one or more times in front of the mirror until the mirror signals that the movement and / or gesture has been detected and stored with sufficient accuracy.
- the gesture and / or movement is then linked to a specific action such as "displaying messages" so that, for example, whenever the Users clenching a hand in front of the mirror to fist and re-opens, the latest news will be displayed on the mirror's display.
- the method according to the invention preferably further comprises the step of identifying a person in front of the mirror on the basis of the data acquired by the at least one sensor. This can be done, for example, based on the size of the person in front of the mirror. Additionally or alternatively, other body features and / or typical movement behavior can be used to identify the person. Another way of identification may be the use of personal items (toothbrush, RFID bracelet, smartwatch, etc.). If the interactive mirror has a microphone, the identification can additionally or alternatively also take place via the voice of the person. Furthermore, the method according to the invention preferably comprises the step of displaying personalized data on the display based on the identification of the person.
- profiles and requirements of individual users are preferably stored in the main software of the processor, which can influence the output of data (personalization).
- data provided by one or more sensors are preferably interpreted by the main software of the processor in order to distinguish the possible users from each other, for example by gesture, size (infrared), outline (camera) and / or voice (voice input).
- the mirror according to the invention represents an extremely versatile device which allows the user complex possibilities of interaction both with the mirror itself and with other external electronic devices, without the need for a keyboard or a touch-sensitive screen.
- the gestures and / or movements of the user are thereby determined in a confidential manner, since no camera shots of the user for the identification of the gestures and / or movements are necessary.
- preferred features of the mirror according to the invention have been described primarily in connection with a mirror located in the bath, it should be understood that the mirror according to the invention also outside the bath, For example, in the hall, in hotel rooms, in fitness rooms and the like can be used.
- Fig. 1 is a schematic plan view of a preferred embodiment of an interactive mirror according to the invention
- Fig. 2a is a schematic plan view in partial section of a preferred
- FIG. 2b shows a partial side sectional view of the embodiment of Figure 2a.
- FIG. 2c is a partial sectional top view of the embodiment of FIG. 2a.
- FIG. 1 shows schematically a preferred embodiment of the interactive mirror according to the invention.
- the interactive mirror has an at least partially reflecting mirror surface 1, a plurality of displays 2a and 2b integrated in the mirror surface, two active infrared sensors 3 integrated in the mirror and a processor (not shown) suitable for this purpose Sensors 3 detected data in front of the mirror executed movements and / or gestures of a person to identify or identify.
- the interactive mirror according to FIG. 1 has two optional microphones 4 which can supply audio information which can be evaluated on the one hand after the noise itself (for example the operating noise of an electric toothbrush or razor) but on the other hand can also be recorded and evaluated as speech, for example, to allow a voice input.
- One possible implementation of the processor is an 8 or 32 bit microprocessor for embedded solutions, on which a software written, for example, in the C programming language, for example, reads interrupt-based sensors 3 connected via a serial data bus such as I2C. The transmitted data is then checked for soundness and gesture by the microprocessor and translated into a gesture code used by the mirror's control software for other applications.
- a software written for example, in the C programming language
- I2C serial data bus
- the transmitted data is then checked for soundness and gesture by the microprocessor and translated into a gesture code used by the mirror's control software for other applications.
- One An example of an active infrared sensor suitable for determining gestures according to the invention is the Halios E909.05 sensor from Mechaless Systems GmbH. This then supplies gesture codes to the main system software of the processor.
- the documentation of the E909.05 sensor documents how these gestures are accurately identified.
- the processor preferably has corresponding subsystems (Bluetooth, Wifi, etc.), in connection of which the processor performs a recognition of the device (for example a toothbrush via Bluetooth) on the basis of the device identifier and triggers a corresponding function in the main program of the mirror.
- a recognition of the device for example a toothbrush via Bluetooth
- the interactive mirror is preferably adapted to perform one or more of the following actions based on the data received from an external electronic device: switching from an inactive mode to an active mode, switching from an active mode to an inactive mode, starting and / or Termination of an application related to the external electronic device, display of device-specific information on the display, display of instructions on the display, display of usage data related to the previous and / or recommended usage of the external electronic device, control of a another external electronic device, transfer of device-specific information and / or usage data to another external electronic device.
- the functions necessary for this purpose are triggered, for example, via local control processors and via network data from the main software of the mirror processor.
- the main software also preferably controls the visual representation on the display and evaluates data from the sensors 3 or other devices (not shown).
- a multiplicity of display fields 2 a of different shape and size are respectively provided in the two lateral edge regions of the mirror surface 1.
- these are not separate displays.
- both edge regions of the mirror surface 1 preferably each have a large-area, for example rectangular, display, by means of which, controlled by the processor, one or more display fields can be superimposed as required.
- individual display fields can be provided for different contents. For example, messages, traffic information, weather information, emails, Facebook, Twitter, calendar entries, and the like can be displayed in separate panels as needed become.
- the arrangement, shape and size of the display fields assigned to the different contents can preferably be set or programmed by the user.
- each of the two lateral displays occupies a width of less than 30%, more preferably less than 25%, and most preferably less than 20% of the width of the mirror surface 1.
- a further centrally arranged display 2b is preferably provided, which is preferably suitable for displaying information in the mirror image of the user.
- predefined shaving patterns could be faded into the mirror image of the user's face.
- an analysis of the position of a person via the built-in sensors is preferably queried and used for the corresponding position of the image memory which corresponds to the physical position of the representation in front of the person.
- the main software is able to integrate and display information in the right place, even during movements.
- This central display 2b preferably occupies at least 40%, more preferably at least 50%, and most preferably at least 60% of the width of the mirror surface 1.
- a single large-area display can also be provided which, as required, displays information in one or both border areas and displays information in a central area via the mirror image of the user.
- the two integrated in the mirror active infrared sensors 3 are preferably attached to the two lateral edges of the mirror surface 1, as shown in Figure 1.
- the two sensors 3 are arranged approximately centrally with respect to the mirror width, as can also be seen in FIG.
- the two sensors 3 can also be offset upwards or downwards and / or arranged on the upper and / or lower edge of the mirror surface 1. It is also possible to provide more than two sensors 3, for example four or six sensors.
- sensors 3 on at least two lateral edges of the mirror surface 1 can be distinguished particularly well between gestures of the left and right hands or between two persons located in front of the mirror.
- Each active infrared sensor 3 preferably consists of two outer transmitters 3 a of radiation in the infrared range and a centrally, preferably centrally, arranged receiver 3 b for reflected radiation in the infrared range.
- other sensor geometries can also be used.
- three or four infrared LEDs in the form of a triangle, rectangle or square may be arranged around one or more infrared photodiodes.
- the two microphones 4 are preferably likewise arranged on the two lateral edges of the mirror surface 1, as can be seen in FIG. However, they need not be arranged at the bottom of the mirror surface 1, but may also be provided further above.
- the mirror has a mirror surface 1 mounted on a frame 9, which preferably has mirror glass with a reflective coating which has a light transmission of at least 10%, preferably of at least 15% and particularly preferably of at least 20%.
- the back side of the coated mirror glass is preferably laminated with a black film, which increases the contrast.
- This film preferably has recesses for the display or display elements 2a and 2b, so that data and information can be faded into the mirror image.
- two displays provided on the lateral mirror edges and a display 2b arranged centrally in the middle are provided. Even if the three displays 2 a and 2 b are shown with approximately the same size and shape, the size and shape of the two side displays 2 a on the one hand and the central display 2 b on the other hand may differ.
- the central display 2b occupies at least 40%, more preferably at least 50%, and most preferably at least 60% of the width of the mirror surface 1.
- different display fields with different information are preferably superimposed on the two lateral displays 2 a, whereas information about the mirror image of the user is preferably displayed in the central display 2 b.
- each of the three displays 2a and 2b is equipped with its own processor 5a and 5b.
- a single processor may be provided for all three displays.
- the displays and the processors are powered by a power supply 6.
- At the two lateral edges of the mirror surface 1 are two active infrared sensors 3.
- two near field sensors 7 and two sensors 8 are provided, which are adapted to detect whether a person is in front of the mirror.
- These near field sensors can be realized for example on the basis of active or passive infrared technology (PIR), laser removal, light section measurement or ultrasound.
- PIR passive infrared technology
- an active infrared sensor 3 and such a sensor 8 is connected to a processor 5a (indicated by the dashed lines), so that in each case two sensors 3 and 8, a display 2a and a processor 5a, a left or form a right unit.
- the near field sensors 7 are each connected to a processor 5a.
- the displays 2a and 2b may, for example, be TFT display elements which are connected to the processors via suitable connections (eg HDMI, LVDS or the like) in order to enable as lossless a representation as possible.
- the control of the displays or display elements including the power supply and an optional backlight takes place via integrated controls.
- a control computer can supply one or more screens.
- the core tasks of the control computer are to receive and transmit data, information and control sequences via a network standard such as Ethernet, Wifi, Bluetooth, Zigbee or similar, to process and render the data and controls on the display units or displays mounted behind the mirror glass the utilization and processing of the data of the installed sensors (proximity sensor, gesture sensor, NFC reader, brightness sensor).
- the control computer can consist of a suitable embedded system, which can be equipped with an operating system such as Linux and allows the connection of one or more display units. Sensors are preferably integrated directly via connections such as USB or Bluetooth, but can also be connected via a special electronic extension that supports the Sensor information is captured, integrated.
- the computing and memory performance of the embedded system must be sufficient to enable even complex displays with simultaneous network and sensor operation.
- the interactive mirror is preferably suitable for controlling an external electronic device, preferably two or more electronic devices at the same time.
- the control is carried out by preferably the main operating software, the external electronic devices via local network components / subsystems as well as the standard network interfaces (Wifi, Ethernet, Bluetooth etc). can control. Rules and dependencies for the control can be implemented firmly anchored in the main operating software or, alternatively, reloaded as a set of rules via a network connection.
- the active infrared sensors 3 are preferably integrated in the center of the left and right in the edge of the mirror surface 1. Based on an infrared field established by transmitter portions 3a (see Figure 1) of the sensor in the region in front of each display area, gestures in a 2D or 3D field can be detected by producing specific reflections of the infrared field signal. These reflections are detected by an infrared sensor 3b (see Figure 1), which are each directly above and below the infrared transmitter 3a. By analyzing the reflection information of both sensors, the reflection originator (e.g., hand making a gesture) can be determined in real time in position and depth.
- the reflection originator e.g., hand making a gesture
- This information is forwarded to the control computer, for example, via a serial bus, which determines the current gesture from the position data and carries out the rule deposited for the interaction (for example, weather data displays).
- a serial bus which determines the current gesture from the position data and carries out the rule deposited for the interaction (for example, weather data displays).
- An example of an active infrared sensor that is suitable for determining gestures according to the invention is the Halios E909.05 sensor from Mechaless Systems GmbH.
- two or more displays can preferably be used simultaneously by two persons located in front of the mirror. This is technically made possible, for example, by programming the main software to process more than one user context simultaneously (parallel processing / threads). Alternatively, two independent systems can be installed.
- the processor is then preferably also suitable for determining movements and / or gestures carried out simultaneously in front of the mirror of two persons on the basis of the data acquired by the at least one sensor and assigning them to the respective persons.
- These sensor signals preferably take place by a spatial analysis of the movements / gestures generated, which can take place on a coordinate basis in an infrared sensor, or alternatively on an image analysis in a camera image.
- the frame 9 may be, for example, an aluminum frame of, for example, L-profiles.
- the mirror glass can be fastened to the frame 9, for example, by means of a special adhesive film.
- the frame 9 ensures a certain minimum distance (for example 4-6 cm) to the wall to mount components and screens behind the mirror glass.
- the frame 9 preferably serves as a mounting surface for indirect mirror lighting (not shown) and as a heat sink for light and electronic elements.
- Aluminum is particularly suitable for the latter.
- one or more LED strips are preferably glued to the rear of the frame 9 in a radiating manner.
- the arrangement of the individual components, the relative size and shape of the individual components and the like are merely exemplary.
- three displays 2a and 2b only one or two displays can be provided.
- the sensors 3, 7 and 8 can be arranged differently and more than 2 sensors of one type can be provided in each case.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Optics & Photonics (AREA)
- User Interface Of Digital Computer (AREA)
- Closed-Circuit Television Systems (AREA)
- Mirrors, Picture Frames, Photograph Stands, And Related Fastening Devices (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102014010352.8A DE102014010352A1 (de) | 2014-07-10 | 2014-07-10 | Interaktiver Spiegel |
PCT/EP2015/065379 WO2016005333A1 (de) | 2014-07-10 | 2015-07-06 | Interaktiver spiegel |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3167347A1 true EP3167347A1 (de) | 2017-05-17 |
Family
ID=53773412
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15745156.8A Withdrawn EP3167347A1 (de) | 2014-07-10 | 2015-07-06 | Interaktiver spiegel |
Country Status (6)
Country | Link |
---|---|
US (1) | US20170199576A1 (ja) |
EP (1) | EP3167347A1 (ja) |
JP (1) | JP2017524216A (ja) |
CN (1) | CN106537280A (ja) |
DE (1) | DE102014010352A1 (ja) |
WO (1) | WO2016005333A1 (ja) |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11083344B2 (en) | 2012-10-11 | 2021-08-10 | Roman Tsibulevskiy | Partition technologies |
EP3301543A1 (en) | 2016-09-30 | 2018-04-04 | Nokia Technologies OY | Selectively reducing reflectivity of a display |
DE102017102144A1 (de) * | 2017-02-03 | 2018-08-09 | Stecnius UG (haftungsbeschränkt) | Trainingsvorrichtung sowie Verfahren zur Evaluierung von Bewegungsabläufen |
CN106820802B (zh) * | 2017-03-16 | 2018-05-29 | 昆山信德佳电气科技有限公司 | 智能仪容镜 |
CN107149352B (zh) * | 2017-06-05 | 2018-11-13 | 深圳好多银科技有限公司 | 一种智能镜子 |
US11093554B2 (en) | 2017-09-15 | 2021-08-17 | Kohler Co. | Feedback for water consuming appliance |
US10887125B2 (en) * | 2017-09-15 | 2021-01-05 | Kohler Co. | Bathroom speaker |
US11314215B2 (en) | 2017-09-15 | 2022-04-26 | Kohler Co. | Apparatus controlling bathroom appliance lighting based on user identity |
US11205405B2 (en) | 2017-10-19 | 2021-12-21 | Hewlett-Packard Development Company, L.P. | Content arrangements on mirrored displays |
JP6961845B2 (ja) | 2018-05-29 | 2021-11-05 | キュリアサー プロダクツ インコーポレイテッド | 対話型トレーニング及びデモンストレーション用の反射ビデオディスプレイ機器及びその使用方法 |
DE102018116781A1 (de) * | 2018-07-11 | 2020-01-16 | Oliver M. Röttcher | Spiegel und Verfahren zur Benutzerinteraktion |
EP3637423A1 (en) | 2018-10-10 | 2020-04-15 | Koninklijke Philips N.V. | Identifying a user of a display unit |
EP3641319A1 (en) * | 2018-10-16 | 2020-04-22 | Koninklijke Philips N.V. | Displaying content on a display unit |
CN110147046A (zh) * | 2019-06-17 | 2019-08-20 | 东莞理工学院城市学院 | 基于物联网的智能家居镜 |
US11145126B1 (en) | 2019-06-27 | 2021-10-12 | Facebook Technologies, Llc | Movement instruction using a mirror in an artificial reality environment |
US11036987B1 (en) | 2019-06-27 | 2021-06-15 | Facebook Technologies, Llc | Presenting artificial reality content using a mirror |
US11055920B1 (en) * | 2019-06-27 | 2021-07-06 | Facebook Technologies, Llc | Performing operations using a mirror in an artificial reality environment |
DE102019006064A1 (de) * | 2019-08-28 | 2021-03-04 | Oliver M. Röttcher | Wandspiegel mit adaptiver Benutzeroberfläche |
CN110840609B (zh) * | 2019-11-11 | 2022-03-01 | 爱马斯克(深圳)科技有限公司 | 电动牙刷控制方法及电动牙刷 |
CN111157952B (zh) * | 2020-01-06 | 2022-04-01 | 北京大学 | 一种基于移动麦克风阵列的房间边界估计方法 |
JP7432417B2 (ja) * | 2020-03-26 | 2024-02-16 | 株式会社Lixil | 表示機能付き鏡及びそれを備えている化粧台 |
EP4143809A1 (en) | 2020-04-30 | 2023-03-08 | Curiouser Products Inc. | Reflective video display apparatus for interactive training and demonstration and methods of using same |
US11167172B1 (en) | 2020-09-04 | 2021-11-09 | Curiouser Products Inc. | Video rebroadcasting with multiplexed communications and display via smart mirrors |
CN117012113B (zh) * | 2023-07-24 | 2024-05-07 | 苏州旭智新文化科技有限公司 | 一种书墙式展厅led互动展示*** |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6560027B2 (en) | 2000-12-21 | 2003-05-06 | Hewlett-Packard Development Company | System and method for displaying information on a mirror |
JP3505575B2 (ja) * | 2001-03-23 | 2004-03-08 | 独立行政法人産業技術総合研究所 | デジタルミラー装置 |
US20070124694A1 (en) * | 2003-09-30 | 2007-05-31 | Koninklijke Philips Electronics N.V. | Gesture to define location, size, and/or content of content window on a display |
US20090092955A1 (en) * | 2005-06-20 | 2009-04-09 | Jin-Sang Hwang | Tooth brushing pattern analyzing/modifying device, method and system for interactively modifying tooth brushing behavior |
CN1949790B (zh) * | 2005-10-13 | 2012-03-14 | 鸿富锦精密工业(深圳)有限公司 | 具有镜子的移动电话 |
US20070040033A1 (en) * | 2005-11-18 | 2007-02-22 | Outland Research | Digital mirror system with advanced imaging features and hands-free control |
DE102007009378A1 (de) * | 2007-02-21 | 2008-08-28 | Julia Becker | Spiegelvorrichtung |
US20090059175A1 (en) * | 2007-08-30 | 2009-03-05 | The Big Space Ltd. | Display arrangement |
JP4569613B2 (ja) * | 2007-09-19 | 2010-10-27 | ソニー株式会社 | 画像処理装置および画像処理方法、並びにプログラム |
JP2010009558A (ja) * | 2008-05-28 | 2010-01-14 | Oki Semiconductor Co Ltd | 画像認識装置、電装機器動作制御ユニット、電化製品、画像認識プログラム、半導体装置 |
JP2009288513A (ja) * | 2008-05-29 | 2009-12-10 | Sony Corp | ミラー駆動装置および撮像装置 |
US20130145272A1 (en) * | 2011-11-18 | 2013-06-06 | The New York Times Company | System and method for providing an interactive data-bearing mirror interface |
JP5898702B2 (ja) * | 2012-01-17 | 2016-04-06 | チームラボ株式会社 | ミラー装置、ミラー装置の制御方法及び制御プログラム |
-
2014
- 2014-07-10 DE DE102014010352.8A patent/DE102014010352A1/de not_active Withdrawn
-
2015
- 2015-07-06 CN CN201580037241.6A patent/CN106537280A/zh active Pending
- 2015-07-06 US US15/324,797 patent/US20170199576A1/en not_active Abandoned
- 2015-07-06 JP JP2017521300A patent/JP2017524216A/ja active Pending
- 2015-07-06 EP EP15745156.8A patent/EP3167347A1/de not_active Withdrawn
- 2015-07-06 WO PCT/EP2015/065379 patent/WO2016005333A1/de active Application Filing
Also Published As
Publication number | Publication date |
---|---|
US20170199576A1 (en) | 2017-07-13 |
DE102014010352A1 (de) | 2016-01-14 |
CN106537280A (zh) | 2017-03-22 |
JP2017524216A (ja) | 2017-08-24 |
WO2016005333A1 (de) | 2016-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3167347A1 (de) | Interaktiver spiegel | |
DE112019001713B4 (de) | Verfolgung und rangeinstufung von desinfektionsverhalten | |
US10891839B2 (en) | Customizable intrusion zones associated with security systems | |
US10306187B2 (en) | Adjustable movement detection doorbell | |
DE112015002463T5 (de) | Systeme und Verfahren zum gestischen Interagieren in einer im Umfeld vorhandenen Computerumgebung | |
DE102014019631A1 (de) | Elektronische Vorrichtung und Beschaffungssteuerverfahren | |
DE112013000535T5 (de) | Verfahren und Vorrichtung zum Aktivieren elektronischer Vorrichtungen mit Gesten | |
DE102010033818A1 (de) | Sensor | |
DE102016100356A1 (de) | Tragbare elektronische Vorrichtung mit doppelten diagonalen Näherungssensoren und Modusschaltfunktionalität | |
DE112016000745B4 (de) | System und Verfahren zum Steuern einer Endgeräteeinrichtung | |
EP2608511A1 (de) | Türsprechanlage und Verfahren zum Betrieb einer Türsprechanlage | |
DE102014019688A1 (de) | Elektronische Vorrichtung | |
DE102017111440A1 (de) | Universalgateway für automatisiertes lernen | |
EP3166370B1 (de) | Beleuchtungssystem mit personenbezogener steuerung | |
EP2596408A1 (de) | System und verfahren zum verarbeiten von visueller, auditiver, olfaktorischer und/oder haptischer information | |
EP3221504B1 (de) | Hausgerät mit einer berührungsempfindlichen bedieneinrichtung sowie verfahren zu seinem betrieb | |
EP2890056A1 (de) | Unterstützung von Nutzern in einer intelligenten häuslichen Umgebung | |
EP2952981B1 (de) | Verfahren zum betreiben einer gebäudeinstallation mit einem situationswächter sowie gebäudeinstallation mit einem situationswächter | |
DE112018005641T5 (de) | Informationsverarbeitungsgerät, informationsverarbeitungsverfahren und programm | |
EP2745503B1 (de) | Laserprojektionsvorrichtung und verfahren | |
US20160240057A1 (en) | System and method for providing alerts regarding occupancy conditions | |
EP2453426B1 (de) | Überwachungssensor mit Selbsttest | |
AT511784A1 (de) | Dosiervorrichtung, insbesondere sanitärspender, und netzwerk zur datenkommunikation | |
DE102014208016A1 (de) | Intelligentes Anwenderendgerät zur Steuerung fernbedienbarer Geräte | |
CN104102330A (zh) | 显示屏控制方法、装置及电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20170210 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20180117 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20180726 |