EP3852572A1 - System zur erfassung und zuordnung eines zustandes eines körperteils des benutzers mit einer dreidimensionalen umgebung bei verwendung einer kosmetischen vorrichtung - Google Patents

System zur erfassung und zuordnung eines zustandes eines körperteils des benutzers mit einer dreidimensionalen umgebung bei verwendung einer kosmetischen vorrichtung

Info

Publication number
EP3852572A1
EP3852572A1 EP19795066.0A EP19795066A EP3852572A1 EP 3852572 A1 EP3852572 A1 EP 3852572A1 EP 19795066 A EP19795066 A EP 19795066A EP 3852572 A1 EP3852572 A1 EP 3852572A1
Authority
EP
European Patent Office
Prior art keywords
body part
sensor
sensed condition
user
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19795066.0A
Other languages
English (en)
French (fr)
Inventor
Gregoire CHARRAUD
Helga MALAPRADE
Guive BALOOCH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BALOOCH, GUIVE
LOreal SA
Original Assignee
LOreal SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/137,614 external-priority patent/US10943394B2/en
Priority claimed from US16/137,610 external-priority patent/US20200093254A1/en
Application filed by LOreal SA filed Critical LOreal SA
Publication of EP3852572A1 publication Critical patent/EP3852572A1/de
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D1/00Curling-tongs, i.e. tongs for use when hot; Curling-irons, i.e. irons for use when hot; Accessories therefor
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D1/00Curling-tongs, i.e. tongs for use when hot; Curling-irons, i.e. irons for use when hot; Accessories therefor
    • A45D1/16Curling-tongs, i.e. tongs for use when hot; Curling-irons, i.e. irons for use when hot; Accessories therefor with a single heated member
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D20/00Hair drying devices; Accessories therefor
    • A45D20/04Hot-air producers
    • A45D20/08Hot-air producers heated electrically
    • A45D20/10Hand-held drying devices, e.g. air douches
    • A45D20/12Details thereof or accessories therefor, e.g. nozzles, stands
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D44/005Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
    • AHUMAN NECESSITIES
    • A46BRUSHWARE
    • A46BBRUSHES
    • A46B15/00Other brushes; Brushes with additional arrangements
    • A46B15/0002Arrangements for enhancing monitoring or controlling the brushing process
    • A46B15/0004Arrangements for enhancing monitoring or controlling the brushing process with a controlling means
    • AHUMAN NECESSITIES
    • A46BRUSHWARE
    • A46BBRUSHES
    • A46B15/00Other brushes; Brushes with additional arrangements
    • A46B15/0002Arrangements for enhancing monitoring or controlling the brushing process
    • A46B15/0004Arrangements for enhancing monitoring or controlling the brushing process with a controlling means
    • A46B15/0006Arrangements for enhancing monitoring or controlling the brushing process with a controlling means with a controlling brush technique device, e.g. stroke movement measuring device
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D2/00Hair-curling or hair-waving appliances ; Appliances for hair dressing treatment not otherwise provided for
    • A45D2002/003Appliances for hair dressing treatment not otherwise provided for
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D2044/007Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D2200/00Details not otherwise provided for in A45D
    • A45D2200/15Temperature
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D2200/00Details not otherwise provided for in A45D
    • A45D2200/20Additional enhancing means
    • AHUMAN NECESSITIES
    • A46BRUSHWARE
    • A46BBRUSHES
    • A46B2200/00Brushes characterized by their functions, uses or applications
    • A46B2200/10For human or animal care
    • A46B2200/104Hair brush
    • AHUMAN NECESSITIES
    • A46BRUSHWARE
    • A46BBRUSHES
    • A46B2200/00Brushes characterized by their functions, uses or applications
    • A46B2200/10For human or animal care
    • A46B2200/1046Brush used for applying cosmetics

Definitions

  • the present application relates to a system for tracking a location of a sensed condition on a user based on information from a sensor of a styling tool and a tracked location in space during a sensing operation, for reconstructing the sensed condition on a user’s head in a virtual three-dimensional environment, and for utilizing the three- dimensional reconstruction for providing feedback to a display of the user or for controlling a connected styling tool based on the sensed condition.
  • a system and method where a device is configured to treat a body part of a user, the device including, at least one sensor configured to sense a condi tion of the body part; and a location tracker is confi gured to track a location of the device in space, wherein the system is includes processing circuitry configured to receive information of a specific sensed condition of the body part detected by the at least one sensor during a session, receive, from the location tracker, information of the tracked location of the device during the session, and associate a specific time when the specific sensed condition is detected by the device with a location of the device in space at the specific time.
  • the device is a hair styling tool and the body part is a user’s hair.
  • the sensed condition is a damaged region of the hair.
  • the sensed condition is based on at least one sensed image of the body part.
  • the sensed condition is based on a sensed sound when the device contacts the body part.
  • the sensed condition is based on a sensed dryness level of the body part.
  • the device is a skincare tool and the body party is the user’s skin.
  • the sensed condition is at least one of wrinkles, crow’s feet, acne, and a blackhead.
  • the senor is on the device and configured to face the body part of the user.
  • the at least one sensor is external and captures the movement of the device in relation to the body part.
  • processing circuitry is configured to receive information of a specific sensed condition of a body part of a user detected by the at least one sensor of a device during a session, receive information of a tracked location of the device from a location tracker during the session, associate a specific time when the specific sensed condition is detected with a location of the device in space at the specific time, and determine a location on the body part in a three- dimensional virtual environment where the specific sensed condition occurs based on the associated specific time and location of the device
  • the processing circuitry is configured to generate a digital file having a predetermined file format which associates the specific sensed condition to the three-dimensional virtual environment.
  • the predetermined file format includes at least one of a timestamp field, accelerometer coordinate fields, gyroscope fields, magnetic compass fields, sensor measurement fields, 3D coordinate fields, 3D normal fields, and a field for indicating if entries corresponding to a particular timestamp represent an area of interest to be displayed.
  • the processing circuitry is configured to output the digital file to a display device for generating a display of the three-dimensional virtual environment
  • the display of the three-dimensional virtual environment depicts the specific sensed condition on a three-dimensional representation of the user.
  • the processing circuitry' is configured to generate a digital recipe based on the digital file for controlling a device to treat the sensed condition, and transmit the digital recipe to the styling tool.
  • Fig. 1 shows a feedback system for sensing a characteristic of a user.
  • Fig. 2 shows components of an overall system according to an embodiment.
  • Fig. 3 shows an overview of the sensing component according to an embodiment.
  • Figs. 4A, 4B and 4C show an example of how the motion and spatial position of a device may be tracked in an“on-board” example.
  • Fig. 5 shows a process performed at the device according to the“on-board” example in an embodiment.
  • Figs. 6A and 6B show an example where a separate sensor is utilized according to an embodiment.
  • Fig. 7 shows a process performed between a device and a sensor according to an embodiment.
  • Fig. 8 shows a diagram of the electrical block diagram of the hardware components of a device according to an embodiment.
  • Fig. 9 shows a diagram of the electrical block diagram of the hardware components of the sensor according to an embodiment.
  • Fig. 10 shows overview of the 3D reconstruction component according to an embodiment.
  • Fig. 11 shows a process performed by the system to map a coordinate of the sensed condition to the virtual 3D user image according to an embodiment.
  • Fig. 12 show's examples of different digital file formats created based on the 3D reconstruction algorithm according to an embodiment.
  • Fig.13 shows an overview of the feedback component according to an
  • Fig. 14 shows an algorithm that may be performed by the device according to an embodiment.
  • Fig. 15 shows uses of the digital recipe when the device is a hair styling tool according to an embodiment.
  • Fig. 16 show's examples of the device being sonic vibrating brush device which act upon a user’s skin according to an embodiment.
  • Fig. 17 show's uses of the 3D reconstruction and digital recipe when the device is a hair styling tool according to an embodiment.
  • Fig. 1 shows feedback system 100 which is currently described in co-pending U.S. Application No 15/721,286, incorporated herein by reference.
  • the system 100 includes a hair dryer device 110 and a brush device 150.
  • the hair dryer 110 performs the functionality of a conventional hair dryer, such as generating and emitting hot air from outlet 1 12.
  • the brush 150 includes bristles 154, which are disposed around the axis of the brush (a "round" hairbrush type). However, additional known hairbrush types may be used as well.
  • the hair dryer device 110 and the brush device 150 include additional components.
  • the hair dryer device 1 10 further includes a temperature controller 114 and actuators 116.
  • the temperature controller 114 controls and adjusts the temperature of the air emitted by the hair dryer.
  • the actuators control a shape of a pattern of air flow and the speed of air flow.
  • the actuators may be mobile mechanical parts that could be moved in the air flow to modify its shape.
  • the hair dryer may further include a proximity sensor 118 preferably disposed near the outlet 112 of the hair dryer.
  • the proximity sensor may be an optical sensor, such as an infrared sensor, which is understood in the art. However other examples may be employed as well, such as a capacitive, ultrasonic, or Doppler sensors.
  • the hair dryer device 110 is configured to vary at least one setting at the hair dryer based on the received sensed characteristic. In an embodiment, the hair dryer device 110 is configured to dynamically modulate at least one setting at the hair diver based on the received sensed characteristic.
  • the brush device may further include its own PCB 180 that includes
  • a wireless RF communication interface for performing wireless communication with an external device (such as hair dryer 150).
  • the PCB may further hold a motion detector, such as an accelerator/gyrometer.
  • the brush device also may include a hair humidity sensor and a temperature sensor. Hair and humidity sensors are known and understood in the art.
  • a wireless machine-to-machine feedback loop between the brash device 150 and the hair diver 1 10, facilitated by communication between the wireless RF communication interface embedded in each device.
  • the brush can sense the temperature when the hair dryer is operational and the humidity level of the user's hair and provide such feedback to the hair dryer. Based on this information, the hair dryer may adjust the temperature and/or the shape and/or speed of the air flow, by for example, adjusting the resistance of the heating element in the hair dryer, adjusting the fan speed, and/or adjusting the shape of the mechanical elements which control the air flow shape.
  • a hairbrush and/or hair dryer that can sense a characteristic at the user’s hair for causing adjustments directly at the hair dryer.
  • the ability to determine the specific location of the sensed condition on the user so that it may be reconstructed in a virtual three-dimensional environment for feedback to the user and to provide more precise control and adjustments to a styling tool when treating the user’s hair in the future or even in real time.
  • a system may be composed of;
  • the 3D position system can be completed by a vision system with a camera and/or proximity sensor based on infrared or ultrasonic method,
  • the system is able to determine in real time the position and the orientation of the tool on the user’s head or another part of the user’s body depending on the type of tool being used.
  • Another objective of the system is to utilize a digital format to normalize and combine different kind of measurements on the same scale.
  • Each smart styling tool or diagnosis tool has specific sensors built-in:
  • a connected hair brush may include a microphone to listen to hair damage, force sensors, conductivity
  • a styling iron may sense temperature and humidity, hair conductance, contact duration and total energy applied on hair.
  • a camera diagnosis tool microscopic images of skin/hair features, hydration with image processing capability under different wavelengths lighting.
  • a generic file format can be created to combine the measurement and l ocalize it on user body surface.
  • This file format should have a least following;
  • FIG. 2 shows components of an overall system 200 according to an embodiment.
  • the system is broadly depicted as including a sensing component 201, a 3D
  • Fig. 3 shows an overview of the sensing component 201 according to the above system 200.
  • the sensing component includes a styling tool 301, which is depicted as a hairbrush with a sensor. However, it may be any number of styling tools, such as a hair dryer, a flat iron, or the like.
  • the sensor may be a sensor for detecting a condition of a user’s hair, such as the type of sensors shown in Fig. 1, which include a hair humidity sensor and/or a temperature sensor.
  • the sensor may also be an optical sensor for detecting damage to the hair up close, or even an audio sensor for detecting a condition of the hair based sound when the brush is applied.
  • the sensor may be a proximity sensor, such as an infrared cell or ultrasonic sensor.
  • the proximity sensor is used to measure the distance between the device/sensor and execute the appropriate action. For example, a hair dryer should not blow too warm hair when the user’s head is too close to the hair dryer exhaust. On the contrary the device shall detect when the sensors are in a good range to make a relevant measurement of the skin and/or hair.
  • the hairbrush may include an accelerometer/gyroscope or a magnetic compass, as known in the art.
  • the sensing component may alternatively also include a separate sensor 302.
  • the sensor 302 may include similar sensor as are contained in the styling tool, while optionally including a camera that can capture images of the environment and perform image recognition. The image recognition may he used to detect the presence and position of the user in relation to the styling tool.
  • the sensor 302 may also detect specific signals being transmitted from the styling tool, which may allow the sensor 302 to detect the specific position of the styling tool in relation to the position of the sensor. If the user also wears a wearable sensor in a predetermined position in the area of the head (such as in the form a necklace or an adhesive sensor that attaches to the user’s face), then the sensor 302 may further detect the spatial position of the user in relation to the sensor 302.
  • Fig. 4 shows an example of how the motion and spatial position of the styling tool 301 may be tracked in the“on-board” example.
  • the spatial difference based on the movement detected by, for example, an accelerometer/gyroscope/magnetic compass, between the initial position the second position can be detected.
  • the spatial difference can again be determined from the initial position (or alternatively from the second position).
  • the initial position 401 of the styling tool 301 is a predetermined position above the top of the head while the brush is held straight.
  • the predetermine position 401 is not limited to the one shown in Fig. 4 and any
  • predetermined position may be used, but it is preferable that it is easy for the user to recreate in a predictable location in relation to the user’s head.
  • Fig. 5 shows a process performed at the styling tool 301 according to the“on board” example described above.
  • one or more conditions are detected (such as humidity, temperature, hair damage) by a sensor on the styling tool.
  • the location detector described above which detects the approximate spatial position/location of the styling tool, and more specifically, the spatial position of the sensor, starts the detecting the location.
  • the sensor and the location detector continue to operate in parallel, recording their respective detected data in association with the same synchronized time data.
  • the sensor and location data stop their operations at the same synchronized timing in response to a“stop” input provided by the user.
  • Fig. 7 shows a process performed between the styling tool 301 and the sensor 302 similar to the process shown in Fig. 5 above.
  • the user may input a“start” input when the styling tool is in the initial position at Time 0.
  • the styling tool may transmit a“start” signal to the sensor 302. Therefore, the styling tool proceeds to use a sensor as described above to sense one or more conditions (such as humidity, temperature, hair damage).
  • the sensor 302 detects the
  • the sensor and the location detector continue to operate in parallel, recording their respective detected data in association with the same synchronized time data.
  • the sensor and location data stop their operations at the same synchronized timing in response to a“stop” input provided by the user at the styling tool 301, which may result in a“stop” signal being transmitted to the sensor 302.
  • Fig. 8 shows a diagram of the electrical block diagram of the hardware components of the styling tool 301, when the styling tool 301 is a hairbrush according to an embodiment.
  • the hairbrush includes a micro-controller/processor 803, a power source 804, a communication interface 805, a user interface 806, a memory' 807.
  • the hairbrush may also include sound sensing circuitry 809, which may include a microphone to detect the dryness of the user’s hair based on day-to-day energy and spectral sound variation.
  • the hairbrush may also include moisture sensing circuitry' 81 1.
  • This circuitry may be similar to that described in U.S. Application No. 13/112,533 (US Pub. No.
  • the moisture sensing circuitry may rely on a hall-effect sensor which detects changes in a magnetic field, such changes being sensitive to a moisture level.
  • the hairbrush may also include a force sensor 811, which may be in the form of a load cell disposed between the head and handle.
  • the hairbrush may also include an ambient temperature/humidity sensor 812, discussed above, that detects the local temperature or humidity near the hairbrush.
  • the hairbrush may include conducted pin quills 813 embedded in the hairbrush for detecting if the hair is wet or dry, or for detecting contact with the hair of the user.
  • the hairbrush may also include an imaging unit 814, which may be a camera disposed on an outer surface of the brush which faces the users' head or hair while the user is using the hairbrush.
  • the imaging unit may optionally have a thermal imaging capability for sensing thermal characteristics of the user's hair.
  • the imaging unit may also be equipped with a lighting unit (such as an LED light) to aid in the imaging process.
  • the hair dryer includes a position/motion sensor 808 that can detect an orientation of the hair dryer too as it is being held by the user, and it may also detect movements and motion paths of the hair dryer as well.
  • the position/motion sensor is at least one of or a combination of a geomagnetic sensor and an acceleration sensor.
  • a 3-axis geomagnetic sensor ascertains the direction of geomagnetism, or in other words a geomagnetic vector Vt, given the current orientation of (the housing of) the styling tool housing the 3-axis geomagnetic sensor.
  • a 3-axis acceleration sensor ascertains the direction of gravity, or in other words a gravity vector G, given the current orientation of (the housing of) the styling tool housing the 3 -axis acceleration sensor in a still state.
  • the gravity vector G matches the downward vertical direction.
  • the gravity vector G likewise may be decomposed into Xs, Ys, and Zs axis components.
  • a gyroscope may be used which is a sensor that detects angular velocity about the three axes Xs, Zs, and Ys (roll, pitch, and yaw), and is able to detect the rotation of an object.
  • the geomagnetic sensor is able to ascertain the heading in which the object faces, based on a geomagnetic vector as discussed earlier.
  • the styling tool 301 above is described as a hairbrush
  • the styling tool may be any other type of styling tool or personal appliance that is configured to sense a condition or characteristic of the user, such as a flat iron, hair dryer, comb, facial massager, or the liker.
  • Fig. 9 shows a diagram of the electrical block diagram of the hardware components of the sensor 302 according to an embodiment.
  • the power from the power source 904 is controlled by the micro-controller/processor 903.
  • the sensor 302 may communicate data with another de vice through a communication interface 905.
  • the sensor 302 may include a user interface 906, which may be in the form of input buttons on the housing of the tool, or it may be in the form of a contact-sensitive display, such as a capacitive or resistive touch screen display.
  • the senor 302 includes output indicator 902 which may be in the form of lights (such as LED lights), an indicator on a touch screen, or an audible output through a speaker.
  • output indicator 902 may be in the form of lights (such as LED lights), an indicator on a touch screen, or an audible output through a speaker.
  • the senor 302 includes a memory 907 that stores software for controlling the hair dryer, or for storing user data or other information.
  • the sensor 302 may also include proximity sensor 918, which may detect the present of external objects or devices, and may be an optical sensor, such as an infrared sensor, which is understood in the art. However other examples may be employed as well, such as a capacitive, ultrasonic, or Doppler sensors.
  • the sensor 302 may include a motion/position sensor 908, which is similar to the position/motion sensor 808 included in the styling tool and described above.
  • the sensor 302 includes image sensor 909, such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS) that generates a captured image.
  • image sensor 909 such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS) that generates a captured image.
  • CCD charge coupled device
  • CMOS complementary metal oxide semiconductor
  • both the styling tool 301 and the sensor 302 include a communication interface (I/F) that can include circuitry' and hardware for communication with a client device 120.
  • the communication interface 205 may include a network controller such as BCM43342 Wi-Fi, Frequency Modulation, and Bluetooth combo chip from Broadcom, for interfacing with a network.
  • the hardware can be designed for reduced size.
  • the processor 203 may be a CPU as understood in the art.
  • the processor may be an APL0778 from Apple Inc., or may be other processor types that would be recognized by one of ordinary' skill in the art.
  • the CPU may be implemented on an FPGA, ASIC, PLD or using discrete logic circuits, as one of ordinary skill in the art would recognize. Further, the CPU may be implemented as multiple processors cooperatively working in parallel to perfor the instructions of the inventive processes described above.
  • Fig. 10 shows overview of the 3D reconstruction component 202 shown above in Fig. 2.
  • the styling tool(s) 301 provide their sensed condition data to an information system 1001, which may be in the form of a cloud server, computer, or portable device (smartphone, tablet, etc.).
  • the sensor 302 may also provide its recorded data related to the detected position of the objects in the environment to the information system 1001.
  • the information system 1001 can then map the sensed data to a virtual 3D user image as depicted in 1002.
  • the virtual 3D user image 1002 may he a virtual 3D image of a predetermined representative person image based on the characteristics of the user, such as gender, height, weight, hair length, hair type, and others. It is not necessary to have a virtual 3D image that is an exact replica of the actual user.
  • the data provided by the location tracker of either the styling tool or the sensor 302 is in the form of three-dimensional coordinates with respect to an origin that coincides with the origin of the virtual 3D image depicted in 1002.
  • the system 1001 may directly map a coordinate of a sensed condition (such as hair damage) received from the styling tool to the virtual 3D image environment.
  • a sensed condition such as hair damage
  • the system 1001 is configure to apply an offset if necessary to map a coordinate of the sensed condition to the most appropriate position on the surface of the hair of the virtual 3D user image.
  • This offset may be applied based on adjusting the coordinate of the sensed condition to the nearest spot on the hair surface of the virtual 3D user image.
  • the system 1001 may be configured to use machine learning techniques to optimize the application of the offset based on receiving feedback when using training samples as necessary.
  • Fig. 11 shows a process performed by the system 1001 to map a coordinate of the sensed condition to the virtual 3D user image.
  • the system receives and stores sensed condition data received from the styling tool 301.
  • the system receives and stores detected location data, which may be provided by either the styling tool 301 or a sensor 302 as described above.
  • the system analyzes and extracts areas of interest (such as hair damage) and associated time stamps based on sensed condition data. This step will be different based on the type of sensor that is involved. For instance, in detecting damaged hair, a moisture sensor reading that detects an above threshold of dryness in the hair may trigger an extraction of an area of interest.
  • an image recognition of split ends may trigger an extraction of an area of interest.
  • the area of interest may be a location where a sound in the brushing of the hair triggers a certain frequency threshold which is characteristic of overly dry or damaged hair.
  • step 1104 the system 1001 extracts stored location data which has a time stamp that matches a time stamp of an area of interest, and the location data and the area of interest are associated with each other.
  • step 1 105 the system“maps” the area of interest to the 3D virtual user image based on association of the area of interest to the location data, which as discussed above is in the form of 3D coordinate data.
  • this“mapping” involves storing the area of interest in association with a displayed feature on the virtual 3D image (such as a portion of the user’s hair).
  • the system 1001 may include a display which shows the results of the mapping, which may involve displaying a placeholder indicator or image at the mapped location on the 3D avatar as shown in 1002.
  • the system is configured to create a digital file that is format standardized as shown in 1003 in Fig. 10.
  • Fig. 12 show's examples of different digital file formats created based on the 3D reconstruction algorithm.
  • the file format shown in Fig. 12 represents data collected from a single device, such as the hair dryer in this example.
  • the file format includes a multiple fields, such as a timestamp field 1211, accelerometer coordinate fields 1212, gyroscope fields 1213, magnetic compass fields 1214, sensor measurement fields 1214, 3D coordinate fields 1215, 3D normal fields 1216, and a field 1217 for indicating if entries corresponding to a particular timestamp represent an area of interest to be displayed.
  • the data in the digital file may be filtered or compressed as necessary' to reduce storage space.
  • Fig.13 shows an overview of the feedback component 203 shown above in Fig. 2.
  • the digital file 1003 is provided to a system 1301, which may be the same system as system 1001, or it may be a different system, device, or even the personal device of the user (such as a smartphone).
  • the system 1301 is configured to use machine learning to combine the sensed data for areas of interest for different types of measurements. This may involve comparing sensed data over time and predicting the future health and beauty of the user.
  • the system 1301 is configured to determine if a pattern of onset of the grey hairs is occurring based on comparing the sensed data over time. Such a determination can be used to generate 3D image data which may depict the predicted results on the 3D virtual user image. These results may be transmitted o the user to be displayed on user device, such as a smartphone, as shown in step 1302
  • the display of the results at the user’s smartphone may include a“damage overlay view” which shows an indicator at an area of interest on a 3D virtual user.
  • the display may include a“picture localization view” which actually shows or depicts a zoomed in area of the area of interest on the virtual 3D user image. For instance, if the area of interest is damaged hair, then the picture localization will show an actual representative image of damaged hair at the spot on the user where the area of interest resides.
  • a personalized 3D recipe or treatment may be generated at 1303 by the information system.
  • a digital recipe may be generated by the system to treat the user’s hair with a styling tool (such as a hair dryer) in a way to prevent further damage to the user’s hair.
  • the digital recipe may be transmitted to the hair dryer itself, and the hair dryer may adjust the temperature and/or the shape and/or speed of the air flow, by for example, adjusting the resistance of the heating element in the hair dryer, adjusting the fan speed, and/or adjusting the shape of the mechanical elements which control the air flow shape.
  • Fig. 14 show's an algorithm that may be performed by the hair dryer according to an embodiment.
  • the hair dryer receives the digital recipe.
  • the digital recipe is processed or analyzed.
  • the hair dryer performs adjustment of the settings on the hair dryer based on the processed/analyzed digital recipe.
  • Fig 14 shows that the digital recipe may be used to cause adjustments to a hair dryer device (or other styling tool)
  • the digital recipe may be utilized for a variety of benefits as shown in Fig. 15.
  • the digital recipe may be simultaneously or alternatively used as an input for adjustments or a regime when using a hair dryer/ tyling tool 1501 as discussed above, a recommendation for particular one or more hair products 1502; and it also may be output to a virtual assistant device 1503 which may audibly provide information to a user as appropriate.
  • Fig. 16 shows examples of sonic vibrating brush device 1600 which act upon a user’s skin.
  • the brush device may include a sensor 1601, similar to the sensor 301 described above, disposed on the front face of the device for capturing images, sounds, texture, or dryness of the face of the user. Additionally or alternatively, an external sensor 1602 may be provided which is similar to the sensor 302 described above.
  • the areas of interest may include detecting any number of skin conditions such as wrinkles, crow’s feet, acne, dry' skin, black heads, or others.
  • the results of the 3D reconstruction for the facial region are analogous to the results of the hair region as described above.
  • the 3D reconstruction may be output to a display on a smartphone 1701, which highlights the sensed condition areas on an avatar of the user.
  • the 3D reconstruction may be used to create a digital recipe, which may be output for (i) adjusting or controlling a facial skincare device 1702, (ii) recommending skin care products 1703, (iii) being used to create a customized facial mask 1704, or (iii) for outputting to a virtual assistant device 1705 which may audibly provide information to a user as appropriate.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
EP19795066.0A 2018-09-21 2019-09-20 System zur erfassung und zuordnung eines zustandes eines körperteils des benutzers mit einer dreidimensionalen umgebung bei verwendung einer kosmetischen vorrichtung Pending EP3852572A1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/137,614 US10943394B2 (en) 2018-09-21 2018-09-21 System that generates a three-dimensional beauty assessment that includes region specific sensor data and recommended courses of action
US16/137,610 US20200093254A1 (en) 2018-09-21 2018-09-21 System for sensing and associating a condition on a body part of the user with a three-dimensional environment when using a cosmetic device
PCT/US2019/052253 WO2020061514A1 (en) 2018-09-21 2019-09-20 A system for sensing and associating a condition on a body part of the user with a three-dimensional environment when using a cosmetic device

Publications (1)

Publication Number Publication Date
EP3852572A1 true EP3852572A1 (de) 2021-07-28

Family

ID=68382480

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19795066.0A Pending EP3852572A1 (de) 2018-09-21 2019-09-20 System zur erfassung und zuordnung eines zustandes eines körperteils des benutzers mit einer dreidimensionalen umgebung bei verwendung einer kosmetischen vorrichtung

Country Status (5)

Country Link
EP (1) EP3852572A1 (de)
JP (2) JP2022500180A (de)
KR (1) KR102543674B1 (de)
CN (1) CN112672662B (de)
WO (1) WO2020061514A1 (de)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11779104B2 (en) * 2018-08-20 2023-10-10 Antawon Franklin Wave hairstyle generating brush
US20220087406A1 (en) * 2020-09-18 2022-03-24 L'oreal Portable hair styling device with massaging bristles and formulation dispenser
GB2626150A (en) * 2023-01-11 2024-07-17 Dyson Technology Ltd Hair care appliance

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030065526A1 (en) * 2001-10-01 2003-04-03 Daniela Giacchetti Historical beauty record
US7324668B2 (en) * 2001-10-01 2008-01-29 L'oreal S.A. Feature extraction in beauty analysis
JP2004159830A (ja) * 2002-11-12 2004-06-10 Lion Corp 毛髪評価システム
US20050147955A1 (en) * 2003-12-29 2005-07-07 L'oreal Beauty-related information collection and diagnosis using environments
KR20080059157A (ko) * 2005-08-12 2008-06-26 릭 비. 예거 인간의 피부의 시각적 매력을 강화하기 위하여 반사율변형제를 가하는 시스템 및 방법
US9138038B2 (en) 2011-05-20 2015-09-22 Spectrum Brands, Inc. Hair styling apparatus having hair-protection function
JP6008323B2 (ja) * 2013-02-01 2016-10-19 パナソニックIpマネジメント株式会社 メイクアップ支援装置、メイクアップ支援方法、およびメイクアップ支援プログラム
US20160000518A1 (en) * 2013-02-11 2016-01-07 Neomedz Sàrl Tracking apparatus for tracking an object with respect to a body
JP5902878B1 (ja) * 2013-03-15 2016-04-13 メディガイド リミテッド 医療装置誘導システム
US9301598B2 (en) * 2013-12-13 2016-04-05 Elwha Llc Grooming systems, devices, and methods including detection of hair-covered skin lesions during grooming and including topographical analysis
JP6379519B2 (ja) * 2014-02-27 2018-08-29 カシオ計算機株式会社 肌処理装置、肌処理方法及びプログラム
US10842254B2 (en) * 2014-03-21 2020-11-24 Koninklijke Philips N.V. System and a method for treating a part of a body of a person
US20160038033A1 (en) * 2014-08-05 2016-02-11 Rakesh M. Lal Method, system and apparatus for quantifying oral health with a toothbrush
JP2016073526A (ja) * 2014-10-08 2016-05-12 シャープ株式会社 ヘアブラシ
CN108780100B (zh) * 2016-03-09 2021-09-07 联合利华知识产权控股有限公司 建模***
FR3061499B1 (fr) * 2016-12-30 2019-05-24 L'oreal Systeme pour realiser un traitement de la chevelure, a relier a au moins une arrivee d'eau
EP3525621B1 (de) * 2016-12-30 2023-11-08 L'oreal Verbundene haarbürste
CN107048665B (zh) * 2017-03-29 2020-12-22 台州智奥通信设备有限公司 一种智能梳、基于智能梳的毛发护理***及护理方法

Also Published As

Publication number Publication date
KR20210057150A (ko) 2021-05-20
JP2022500180A (ja) 2022-01-04
JP2023134415A (ja) 2023-09-27
KR102543674B1 (ko) 2023-06-15
CN112672662B (zh) 2024-07-19
WO2020061514A1 (en) 2020-03-26
CN112672662A (zh) 2021-04-16

Similar Documents

Publication Publication Date Title
US10943394B2 (en) System that generates a three-dimensional beauty assessment that includes region specific sensor data and recommended courses of action
US20200093254A1 (en) System for sensing and associating a condition on a body part of the user with a three-dimensional environment when using a cosmetic device
JP2023134415A (ja) 美容装置を使用する場合におけるユーザーの身体部分の状態を検知し、3次元環境に関連付けるためのシステム
KR102565755B1 (ko) 얼굴의 특징점의 움직임에 따라 모션이 수행된 아바타를 표시하는 전자 장치와 이의 동작 방법
US9936900B2 (en) System and method of biomechanical posture detection and feedback including sensor normalization
JP6155448B2 (ja) 3d撮像し、マッピングし、ネットワーク化しおよびインタフェースするための無線手首コンピューティングおよびコントロールするデバイスおよび方法
CN107107355B (zh) 用于确定设备相对于用户的取向的***
US10353460B2 (en) Eye and head tracking device
WO2015200419A1 (en) Detecting a primary user of a device
US20180239428A1 (en) Remote perception of depth and shape of objects and surfaces
US11468595B2 (en) Personal care device localization
KR20200077775A (ko) 전자 장치 및 그의 정보 제공 방법
JP6563580B1 (ja) コミュニケーションシステム及びプログラム
CN111263926B (zh) 信息处理装置、信息处理方法和计算机可读存储介质
KR102407095B1 (ko) 혈압 측정 장치 및 방법
CN111415185A (zh) 业务处理方法、装置、终端及存储介质
US11600155B2 (en) Sensing device suitable for haptic perception applications
Kempfle et al. Quaterni-On: Calibration-free Matching of Wearable IMU Data to Joint Estimates of Ambient Cameras
EP4220074A1 (de) Bestimmung einer parameterkarte für einen körperbereich eines probanden
US20220319045A1 (en) System For Posture Detection Using The Camera Of A Hand-Held Device
KR20230101498A (ko) 가상현실에 기반하여 감정을 출력하는 방법 및 그 전자장치
KR20230100979A (ko) 객체 인식 거울 및 이를 이용한 객체 인식 방법
JP2022101330A (ja) 画像投影方法、画像投影装置、無人航空機および画像投影プログラム。
CN112445325A (zh) 虚拟触控方法、装置、计算机设备和存储介质
CN116992276A (zh) 解耦数据确定模型的训练、关节角度的确定方法及装置

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210318

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BALOOCH, GUIVE

Owner name: L'OREAL

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230912