US20180017797A1 - Head-mounted display - Google Patents

Head-mounted display Download PDF

Info

Publication number
US20180017797A1
US20180017797A1 US15/709,870 US201715709870A US2018017797A1 US 20180017797 A1 US20180017797 A1 US 20180017797A1 US 201715709870 A US201715709870 A US 201715709870A US 2018017797 A1 US2018017797 A1 US 2018017797A1
Authority
US
United States
Prior art keywords
smell
time
moving image
fan
opener
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/709,870
Inventor
Yasuhito Watanabe
Taiji Sasaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Corp of America
Original Assignee
Panasonic Intellectual Property Corp of America
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Corp of America filed Critical Panasonic Intellectual Property Corp of America
Priority to US15/709,870 priority Critical patent/US20180017797A1/en
Publication of US20180017797A1 publication Critical patent/US20180017797A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0176Head mounted characterised by mechanical features
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D34/00Containers or accessories specially adapted for handling liquid toiletry or cosmetic substances, e.g. perfumes
    • A45D34/02Scent flasks, e.g. with evaporator
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61LMETHODS OR APPARATUS FOR STERILISING MATERIALS OR OBJECTS IN GENERAL; DISINFECTION, STERILISATION OR DEODORISATION OF AIR; CHEMICAL ASPECTS OF BANDAGES, DRESSINGS, ABSORBENT PADS OR SURGICAL ARTICLES; MATERIALS FOR BANDAGES, DRESSINGS, ABSORBENT PADS OR SURGICAL ARTICLES
    • A61L9/00Disinfection, sterilisation or deodorisation of air
    • A61L9/015Disinfection, sterilisation or deodorisation of air using gaseous or vaporous substances, e.g. ozone
    • A61L9/02Disinfection, sterilisation or deodorisation of air using gaseous or vaporous substances, e.g. ozone using substances evaporated in the air by heating or combustion
    • A61L9/03Apparatus therefor
    • A61L9/032Apparatus therefor comprising a fan
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61LMETHODS OR APPARATUS FOR STERILISING MATERIALS OR OBJECTS IN GENERAL; DISINFECTION, STERILISATION OR DEODORISATION OF AIR; CHEMICAL ASPECTS OF BANDAGES, DRESSINGS, ABSORBENT PADS OR SURGICAL ARTICLES; MATERIALS FOR BANDAGES, DRESSINGS, ABSORBENT PADS OR SURGICAL ARTICLES
    • A61L9/00Disinfection, sterilisation or deodorisation of air
    • A61L9/015Disinfection, sterilisation or deodorisation of air using gaseous or vaporous substances, e.g. ozone
    • A61L9/02Disinfection, sterilisation or deodorisation of air using gaseous or vaporous substances, e.g. ozone using substances evaporated in the air by heating or combustion
    • A61L9/03Apparatus therefor
    • A61L9/035Apparatus therefor emanating multiple odours
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00Advertising or display means not otherwise provided for
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00Advertising or display means not otherwise provided for
    • G09F19/005Scented advertising means
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/64Constructional details of receivers, e.g. cabinets or dust covers

Definitions

  • the present disclosure relates to a smell reproduction apparatus.
  • the techniques disclosed here feature a head-mounted display including a playback processor which plays back a moving image from first time until second time, the first time corresponding to timing of starting playback of the moving image and the second time corresponding to timing of ending playback of the moving image, a box for placing a container containing a perfume inside, a filled section which is temporarily filled with the perfume and emits the temporarily filled perfume according to starting playback of the moving image, and a tubular vent hole which is in contact with a nose of a user when the user wears the head-mounted display.
  • An aspect of the present disclosure achieves the further improvement.
  • FIG. 1 is a diagram of an overall configuration according to a first embodiment of the present disclosure
  • FIG. 2 is a diagram of a configuration of a smell reproduction apparatus according to the first embodiment of the present disclosure
  • FIG. 3 is a timing diagram of the operations of an opener-closer and a fan according to the first embodiment of the present disclosure
  • FIG. 4 is a timing diagram with a signal added thereto which is defined by smell control metadata
  • FIGS. 5A and 5B are diagrams for explaining a configuration to store different smells
  • FIG. 6 is a diagram for explaining a smell box set value
  • FIG. 7 is a diagram showing an example of a configuration to store two or more smell boxes
  • FIG. 8 is a diagram for explaining a method for mixing a plurality of smells
  • FIG. 9 is a diagram of a configuration of a smell reproduction apparatus according to a second embodiment of the present disclosure.
  • FIG. 10A is a diagram showing a positional relationship between an object and an operator according to the second embodiment of the present disclosure
  • FIG. 10B is a diagram showing a positional relationship between the object and the operator according to the second embodiment of the present disclosure.
  • FIG. 11 is a diagram of a configuration of a smell reproduction apparatus according to a third embodiment of the present disclosure.
  • FIG. 12 is a timing diagram of the operations of an opener-closer, a sending section, and a filled section opener-closer according to the third embodiment of the present disclosure
  • FIG. 13A is a diagram for explaining a configuration which provides a sense of augmented reality using a smell
  • FIG. 13B is a diagram for explaining the configuration that provides a sense of augmented reality using a smell
  • FIG. 14A is a timing diagram of the operations of the opener-closer, the sending section, and the filled section opener-closer according to the third embodiment of the present disclosure
  • FIG. 14B is a timing diagram of the operations of the opener-closer, the sending section, and the filled section opener-closer according to the third embodiment of the present disclosure
  • FIG. 15 is a diagram of a configuration of a conventional smell reproduction apparatus.
  • FIG. 16 is a diagram of a configuration of a conventional scent reproduction system.
  • FIG. 15 shows a smell generation apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2011-184486.
  • a smell generation apparatus 500 includes a plurality of electroosmotic flow pumps 510 X, 510 Y, and 5102 , a plurality of pipes 520 X, 520 Y, and 520 Z, a merging pipe 530 , a plurality of liquid quantity sensors 540 X, 540 Y, and 540 Z, a power source section 550 , a switch section 560 , an ultrasonic vibrator 570 , a radio frequency (RF) amplifier 580 , a blowing section 590 , and a control section 600 .
  • RF radio frequency
  • FIG. 16 shows a scent provision system disclosed in Japanese Unexamined Patent Application Publication No. 2013-74476.
  • a reproduction system 610 which plays back a moving image medium with sound and a scent provision apparatus 620 which emits a scent provided by the reproduction system 610 are provided.
  • the reproduction system 610 is provided with a scent information processing section 613 which generates a control signal for scent generation, a scent generation section 614 which generates a desired scent on the basis of a control signal output from the scent information processing section 613 , and a cleaning section 615 which gets rid of a scent collected from the air.
  • the scent provision apparatus 620 is mounted on an eyeglass type display which a user wears and receives a scent together with a picture.
  • a head-mounted display is a head-mounted display including a playback processor which plays back a moving image from first time until second time, the first time corresponding to timing of starting playback of the moving image and the second time corresponding to timing of ending playback of the moving image, a box for placing a container containing a perfume inside, a filled section which is temporarily filled with the perfume and emits the temporarily filled perfume according to starting playback of the moving image, and a tubular vent hole which is in contact with a nose of a user when the user wears the head-mounted display.
  • the filled section may have a first opener-closer at an upper portion, in which the first opener-closer may open according to ending playback of the moving image.
  • the smell reproduction system may further include a fan above the vent hole and below the filled section.
  • the smell reproduction system may further include a gyro which senses a direction that the user faces.
  • the vent hole may include one left vent hole and one right vent hole.
  • the fan may include one left fan and one right fan.
  • the smell reproduction system may further include a second opener-closer between the box and the filled section, and the second opener-closer may open and close according to starting and ending playback of the moving image.
  • the fan rotates both forward and backward, opening and closing of the first opener-closer, opening and closing of the second opener, stopping and stopping of rotation of the fan, rotation direction of the fan and the number of revolutions of the fan may be controlled in accordance with a control signal.
  • control signal may be a sound signal which is included in the moving image.
  • control signal may be a MIDI signal corresponding to the moving image.
  • the smell reproduction system may further include a control signal processor which generates the control signal.
  • the second opener-closer may open at third time and closes at fourth time, the third time being before the first time according to the control signal, and the fourth time being after the first time and before the second time
  • the first opener-closer may open at the fourth time and closes at fifth time according to the control signal, the fifth time being after the second time
  • the fan may rotate forward at the third time or sixth time according to the control signal, the sixth time being after the third time and before the first time, and the fan may rotate backward at the fourth time according to the control signal, the fan may stop at the fifth time according to the control signal.
  • the smell reproduction system may further include a distance calculator which calculates a distance between an object in the moving image and the nose of the user on a basis of the sensed direction and a predetermined position of the object in the moving image, the object being a source of a smell corresponding to the emitted perfume, and a scent controller which performs control to change the number of revolutions of the fan in accordance with the calculated distance.
  • FIG. 1 shows a configuration of a smell reproduction system.
  • the smell reproduction system is composed of a playback processor 100 which plays back a moving image and a smell reproduction apparatus 200 which provides a smell.
  • the playback processor 100 is integral with the smell reproduction apparatus 200 .
  • the smell reproduction apparatus 200 is a head-mounted display and includes lenses 11 for enlarging a displayed picture and guiding the picture to eyes, a central section 12 , and temple sections 18 .
  • a user views an image through the lenses 11 .
  • the central section 12 is a recessed portion for causing the head-mounted display to engage with a nose of the user.
  • the temple sections 18 are portions to be hooked over ears of the head-mounted display.
  • the playback processor 100 provides a moving image to be played back to the smell reproduction apparatus 200 .
  • a moving image may be played back by playing back a medium, such as a DVD or a BD, or by downloading or streaming a moving image file on a network.
  • An object to be played back is not limited to a moving image, and a game image may be provided.
  • a smell playback processor according to the present disclosure will be described below in a first embodiment.
  • FIG. 2 shows a configuration of a smell reproduction apparatus 200 according to the present disclosure.
  • the smell reproduction apparatus 200 is of head-mounted display type.
  • the smell reproduction apparatus 200 is particularly marked by constituent features (vent holes 13 , smell boxes 14 , opener-closers 15 , and a fan 16 ) for reproducing a smell besides an image display section like a liquid crystal panel.
  • a head-mounted display according to the present disclosure is not limited to a smell reproduction apparatus with the configuration shown in FIG. 2 .
  • Each vent hole 13 is tubular, and an opening is located near an upper portion of a nose when a user wears the smell reproduction apparatus 200 .
  • a container containing a perfume can be placed in each smell box 14 .
  • a smell can be changed by changing a container.
  • Each opener-closer 15 is closed under normal conditions and is opened to release a smell in the corresponding smell box 14 .
  • the fan 16 rotates so as to emit the smell remaining in the filled section 17 through the vent holes 13 .
  • Two fans 16 are desirably mounted such that left and right ones can be controlled independently of each other, but even one will do.
  • the filled section 17 is filled with part of a smell from the smell boxes 14 .
  • FIG. 3 is a timing diagram of the operations of the opener-closers 15 and the fan 16 according to the first embodiment.
  • a container containing a perfume corresponding to a moving image to be played back is placed in each smell box 14 .
  • the opener-closers 15 are opened several seconds before timing of smell emission (a scent reproduction start time t 1 ). At the same time as or slightly later than the opening, the fan 16 starts rotating.
  • the rotation of the fan 16 creates an airflow.
  • the smell of the perfume travels from the smell boxes 14 to a nose through the filled section 17 and the vent holes 13 .
  • the opener-closers 15 are closed before a scent reproduction end time (t 2 ), and rotation of the fan 16 is then stopped.
  • the earlier closing of the opener-closers 15 stops a smell from entering the filled section 17 .
  • a smell remaining in the filled section 17 is discharged by the fan 16 after the closing, which stops a smell from floating out continuously.
  • the stopping of rotation of the fan 16 stops air from flowing, and the nose no longer senses a smell.
  • a sound signal may be used to control rotation of the fan 16 .
  • Use of a low-frequency sinusoidal signal as a single-channel sound signal of a multichannel sound signal accompanying a moving image file to control the fan 16 removes the need for a particularly complicated control section.
  • a sound signal belonging to another channel may be similarly used to control the opener-closers 15 .
  • a control signal shared with the fan 16 may be used.
  • a common control sound signal for the opener-closers 15 and the fan 16 is used in the manner below.
  • a sound signal may be reproduced in advance to control the opener-closers 15 , and the sound signal for controlling the opener-closers 15 may be subjected to delay processing and used as a control sound signal for the fan 16 .
  • a MIDI signal may be used. If a MIDI signal is used, a scent controller may be provided in the playback processor 100 or the smell reproduction apparatus 200 to control the fan 16 and the opener-closers 15 in accordance with a MIDI signal.
  • smell control metadata indicating whether to enable or disable smell emission may be prepared to control rotation of the fan 16 .
  • Each control metadata entry indicates the absence of a smell when the entry has a value of 0 and the presence of a smell when the entry has a value of 1.
  • a control metadata entry is set in each video frame of a video stream. This allows judgment as to whether to emit a smell in one in question of the video frames.
  • FIG. 4 shows the timing diagram in FIG. 3 with a smell control signal added thereto which is obtained by reproducing metadata.
  • the scent reproduction start time (t 1 ) and the scent reproduction end time (t 2 ) are defined by a period when the smell control signal is 1.
  • a piece of control metadata may he stored in, for example, an area (for example, user data in the case of MPEG-2 or an SEI message in the case of MPEG-4 AVC) storing supplemental data of each video frame of a video stream.
  • an area for example, user data in the case of MPEG-2 or an SEI message in the case of MPEG-4 AVC
  • rotation control of the fan based on smell control metadata at timing of decoding and displaying a video stream removes the need for a complicated control section and allows control of smell emission synchronized with a picture.
  • a piece of smell control metadata need not be stored in every video frame and may be stored in a top frame of a GOP.
  • control signals (a sound channel, a MIDI signal, and control metadata) used to control smell emission will be simply referred to as a smell control signal hereinafter.
  • FIGS. 5A and 5B show a configuration of a smell reproduction apparatus when different smells are stored.
  • perfumes serving as sources of different smells are stored in a smell box 14 A and a smell box 14 B, as shown in FIG. 5A .
  • Opener-closers 15 A and 15 B open and close respective doors to the smell boxes 14 A and 14 B.
  • Pieces of timing information for emitting the perfumes are separately stored in a moving image.
  • FIG. 5B shows an example of the configuration of control metadata. Two pieces of control data, a first smell control signal specifying scent reproduction timing for the smell box 14 A and a second smell control signal specifying scent reproduction timing for the smell box 14 B, are prepared. The smell reproduction apparatus judges the smell emission timing for the smell boxes 14 A and 14 B by referring to the pieces of information.
  • the smell reproduction apparatus opens only the opener-closer 15 A if the smell reproduction apparatus judges, by referring to the first smell control signal, that it is time to send a scent from the smell box 14 A and opens only the opener-closer 15 B if the smell reproduction apparatus judges, by referring to the second smell control signal, that it is time to send a scent from the smell box 14 B.
  • a plurality of different smells can be provided to a user during same content.
  • lack of direct connection between the smell boxes 14 A and 14 B and the vent holes 13 and the presence of the filled section 17 that is temporarily filled allow implementation of provision of a plurality of different smells.
  • the opener-closers 15 A and 15 B are controlled by the process of storing a low-frequency sinusoidal signal as a single-channel sound signal of a multichannel sound signal accompanying a moving image file, as described above, respective channels may be prepared for the plurality of smells. The same applies to a case using a MIDI signal, and a plurality of MIDI signals may be stored.
  • smell emission is controlled in accordance with a control signal set in a moving image.
  • the configuration may be such that a smell emission method can be selected in accordance with a user's preferences or the loading status of the smell boxes 14 . A specific configuration will be described.
  • FIG. 6 is a diagram for explaining a smell box set value. As shown on the right side of FIG. 6 , a smell reproduction system includes a smell box set value, a scent controller, and a playback processor.
  • a piece of smell control information stored in a moving image has a smell ID which is set for a corresponding smell.
  • the smell reproduction system has the added “smell box set value” indicating whether to send a smell specified in the moving image.
  • a plurality of smells are prepared for a moving image, and pieces of control data having a smell ID of 0 and a smell ID of 1 are stored in the moving image.
  • the smell box set value has only the smell ID of 1.
  • a smell reproduction apparatus refers to the smell box set value, refers to only a control signal with the specified smell ID, and emits a smell.
  • the smell box set value may be set by a user through a GUI or the like even when necessary smell boxes are loaded.
  • a smell suited to a user's preferences or a situation can be emitted during a moving image, for which a plurality of perfumes serving sources of smells are set.
  • the smell box set value may be automatically set at the time of smell box loading.
  • an NFC chip storing information, such as a smell ID of a corresponding scent is embedded in each smell box, and the smell reproduction apparatus has an NFC communication function.
  • the smell reproduction apparatus can judge which perfume the loaded smell box stores by reading the information of the NFC chip in each smell box through NFC communication. All smell boxes preferably have unique smell IDs.
  • a piece of information obtained by quantifying a smell may be included in a piece of information to be stored as the smell box set value or a smell control signal to be stored in a moving image.
  • An example of smell quantification is a method adopted in a smell identification device by SHIMADZU CORPORATION. There are various methods for smell quantification.
  • the smell reproduction apparatus may select a smell box to be opened and closed in accordance with the degree of closeness to a piece of quantified information stored as the smell box set value (the degree of closeness is higher if an absolute value of a difference is smaller).
  • smell control is performed using the smell control signal with the smell ID of 1, which has a smaller absolute value for a difference in value.
  • a threshold may be set for the degree of closeness. For example, assume that a smell value of a smell control signal with the smell ID of 0 included in a moving image is 100, a smell value of a smell control signal with the smell ID of 1 included in the moving image is 200, a smell value stored as the smell box set value is 1,000, and a smell threshold is 500. In this case, absolute values of differences for both smells exceed the threshold value of 500.
  • the smell reproduction apparatus may judge that the smells are quite different to disable both the smells. With this configuration, a scent different from an impression of a user is not provided to the user any longer.
  • a smell control signal may not be stored in a moving image and may be separately transmitted through a network. With this configuration, it is possible to easily change only a smell sent from an object by not changing video content, such as a moving image, but changing only a smell control signal.
  • FIG. 7 shows an example of a configuration in which a smell reproduction apparatus stores three or more smell boxes.
  • a smell control signal in which whether to send a smell from a smell box 14 B is set, is updated via a network at the time of playback of a next picture, a smell to be sent can be easily changed even during same content.
  • smell control signals may include pieces of information indicating mixture proportions for smell boxes with different smells.
  • FIG. 8 is a diagram for explaining a method for mixing a plurality of smells.
  • smell control signals for a moving image in FIG. 8 instructions for smell sending are given for a group of frames denoted by X and a group of frames denoted by Y.
  • a value of each of control signals is a piece of information indicating a mixture proportion and is a percentage. That is FIG. 8 shows that a smell sent in the group X of frames is a smell obtained by mixing a smell with a smell ID of 0 and a smell with a smell ID of 2 in proportions of 30% and 70%, respectively.
  • FIG. 8 shows that a smell sent in the group X of frames is a smell obtained by mixing a smell with a smell ID of 0 and a smell with a smell ID of 2 in proportions of 30% and 70%, respectively.
  • FIG. 8 shows that a smell sent in the group X of frames is a smell obtained by mixing a smell with a smell ID of 0 and a smell with a smell ID of
  • a smell sent in the group Y of frames is a smell obtained by mixing a smell with a smell ID of 1 and the smell with the smell ID of 2 in proportions of 50% and 50%, respectively.
  • a smell reproduction apparatus may adjust the number of revolutions of the fan 16 .
  • Calculation of a smell mixture proportion parameter may be implemented in a cloud system, and only a result of the calculation may be transmitted as a smell control signal over a network. This allows updating of content without complicated processing on the reproduction apparatus side.
  • FIG. 9 is a diagram of a configuration of a smell reproduction apparatus according to a second embodiment of the present disclosure.
  • same components as those in the smell reproduction apparatus in FIGS. 1 and 2 are denoted by same reference numerals, and a description thereof will be omitted.
  • the smell reproduction apparatus in FIG. 9 is different from the smell reproduction apparatus in FIG. 2 in that a gyro 19 is provided.
  • FIG. 9 is different from FIG. 2 in that a distance calculator 101 and a scent controller 102 are provided in addition to a playback processor 100 .
  • the operation of the smell reproduction apparatus with the above-described configuration will be described with reference to FIGS. 10A and 10B together with FIG. 9 .
  • FIGS. 10A and 10B are diagrams showing positional relationships between an object and an operator according to the second embodiment of the present disclosure.
  • a position serving as a source of a smell is set in advance in a moving image to be played back.
  • An object 300 which reproduces a smell is located to the right of a person wearing the smell reproduction apparatus, as shown in FIG. 10A .
  • the person wearing the smell reproduction apparatus faces to the right and looks toward the object 300 , as in FIG. 10B .
  • which direction the person faces is detected by the gyro 19 attached to the smell reproduction apparatus.
  • a distance between the person wearing the smell reproduction apparatus and the object 300 is calculated by the distance calculator 101 .
  • the distance calculator 101 may calculate distances to left and right halves of a nose independently of each other to thereby control the numbers of revolutions of the left and right fans 16 independently of each other or make a distinction between left and right rotation time periods.
  • FIG. 11 is a diagram of a configuration of a smell reproduction apparatus according to a third embodiment of the present disclosure.
  • same components as those in the smell reproduction apparatus in FIG. 2 are denoted by same reference numerals, and a description thereof will be omitted.
  • the smell reproduction apparatus is different from the smell reproduction apparatus in FIG. 2 in that a filled section 17 has a filled section opener-closer 20 .
  • the operation of the smell reproduction apparatus with the above-described configuration will be described with reference to FIG. 12 together with FIG. 11 .
  • FIG. 12 is a timing diagram of the operations of an opener-closer 15 , a fan 16 , and the filled section opener-closer 20 according to the third embodiment of the present disclosure.
  • a container containing a perfume which is fitted to, for example, a moving image to be played back is first placed in each smell box 14 .
  • the opener-closers 15 are opened several seconds before timing of smell emission (a scent reproduction start time t 1 ).
  • the fan 16 starts being positively rotated.
  • the positive rotation causes air to flow toward vent holes 13 .
  • the positive rotation of the fan 16 creates an airflow.
  • a smell travels from the smell boxes 14 to a nose through the filled section 17 and the vent holes 13 .
  • the opener-closers 15 are then closed before a scent reproduction end time (t 2 ). At the same time, the filled section opener-closer 20 is opened.
  • the earlier closing of the opener-closers 15 , the opening of the filled section opener-closer 20 , and the negative rotation of the fan 16 cause air to flow against the vent holes 13 . That is, a smell remaining in the filled section 17 is discharged through the filled section opener-closer 20 . After the negative rotation of the fan 16 , the filled section opener-closer 20 is closed, and rotation of the fan 16 is stopped. In this manner, the smell remaining in the filled section 17 can be discharged.
  • the filled section opener-closer 20 is configured to be openable and closable with timing, as described above.
  • An air hole may be formed in an upper portion of the filled section 17 .
  • a smell enable/disable button may be provided at the smell reproduction apparatus and that the smell reproduction apparatus may refer to the status of the smell enable/disable button and perform smell emission control.
  • the smell reproduction apparatus closes the opener-closers 15 to prohibit smell emission even if smell sending is specified by a smell control signal.
  • a user can easily make an adjustment to enable or disable smell emission in accordance with a situation or preferences.
  • Such a button is preferably located in the vicinity of a central section 12 that is close to the position of a nose of the user because the user intuitively knows the position of the button.
  • a gesture recognition function such as Kinect, may be used, and a nose-pinching gesture may be used as an operation of enabling or disabling smell emission.
  • the smell reproduction apparatus may be provided with a button or a slide switch for setting smell level and that the smell reproduction apparatus may refer to the smell level and perform smell emission control.
  • the smell reproduction apparatus adjusts the intensity of smell in accordance with the smell level. More specifically, the smell reproduction apparatus adjusts the number of revolutions of the fan 16 . With this configuration, a user can easily adjust the intensity of smell in accordance with a situation or preferences.
  • a button is preferably located in the vicinity of the central section 12 that is close to the position of the nose of the user because the user intuitively knows the position of the button.
  • the present disclosure is not limited to smell emission synchronous with a picture. If the user can select between synchronism and asynchronism using a GUI menu or the like and can select a smell box to emit a smell in the case of asynchronism, smell emission asynchronous with a picture can be implemented.
  • the present application is intended for interlock with a moving image recorded in real time.
  • FIGS. 13A and 13B are diagrams for explaining a configuration which provides a sense of augmented reality using a smell.
  • FIG. 13A moving images taken by the cameras are displayed without change, and a smell is changed depending on the content of the images, an augmented reality effect can be given.
  • FIG. 13B A specific system configuration is shown in FIG. 13B .
  • the smell reproduction apparatus has the additional miniature cameras.
  • the miniature cameras are set at the positions of eyes when a user wears the smell reproduction apparatus, and the user can receive pictures at the specified positions.
  • Pictures taken by the miniature cameras are transmitted to a playback processor and are compressed as video streams and transmitted to a smell determiner.
  • the playback processor displays the pictures output from the miniature cameras on a display on the smell reproduction apparatus without change.
  • a scent controller of the smell reproduction apparatus emits a smell on the basis of a smell control signal received from the smell determiner.
  • the smell determiner is composed of a body recognition processing section and a smell determination section.
  • the body recognition processing section decodes the input video streams, performs image recognition processing on a resultant picture, identifies a body in the picture, and inputs information on the body to the smell determination section.
  • the smell determination section refers to a smell DB and identifies a smell corresponding to the body. For example, the smell determination section selects a smell of a “banana” if there is a “banana” in the picture and a smell of a “freshscent perfume” if there is an idol in the picture. In this manner, the smell determination section identifies a piece of scent information corresponding to the body. The smell determination section creates a smell control signal and transmits the smell control signal to the smell reproduction apparatus.
  • an augmented reality effect corresponding to a picture actually viewed by a user can be achieved, and an emphasized smell can be delivered to the user.
  • amplification of a smell of food allows the user to enjoy a dish.
  • An application is also conceivable which gives a weight loss effect to a user by sending a smell decreasing appetite.
  • the body recognition section may support an AR marker and be configured to determine an object to be displayed on an AR marker and transmit a result of the determination to the playback processor of the smell reproduction apparatus.
  • the playback processor may create an object, such as 3DCG, and display the object superimposed on a picture displayed on the smell reproduction apparatus.
  • the smell reproduction apparatus can display an object corresponding to an AR marker to a user and send a smell corresponding to the object, as shown in FIG. 14A .
  • a piece of scent information may be expressed as a piece of character information like “LEMON SCENT” in FIG. 14A , a color, or the like on a screen.
  • the sense of taste and a perfume have a close relationship. It is well known that a taste sensed by a human changes with a change in perfume. For example, if a human smells a chocolate while chewing tasteless gum, the human feels like chewing chocolaty gum.
  • a cup is labeled “LEMON JUICE”.
  • the cup contains not lemon juice but a sugar solution.
  • the smell determiner detects the label, judges that “LEMON JUICE” is denoted on the label, and transmits a smell control signal for lemon.
  • the smell reproduction apparatus emits a lemon smell, and a user can enjoy a sense of drinking lemon juice in a simulated manner. If a liquid portion of the picture is simultaneously changed to lemon yellow, more effect can be obtained. Note that although the label “LEMON JUICE” is recognized to determine how a food or a drink is simulated, the smell reproduction apparatus may automatically make a determination on the basis of information of loaded smell boxes.
  • a server on a network may play as sections which process calculations, such as a distance calculator and the smell determiner, in the present embodiment. This configuration allows device miniaturization.
  • a smell reproduction apparatus is a small-sized smell reproduction apparatus mounted on a head-mounted display.
  • the smell reproduction apparatus is small-sized and can be easily used by a general user.

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Epidemiology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Disinfection, Sterilisation Or Deodorisation Of Air (AREA)

Abstract

A head-mounted perfume dispenser apparatus includes a processor which plays a moving image, a box, in which a container containing a perfume is received, a reservoir which is filled with the perfume received from the box and emits the perfume according to a start of playing the moving image, a tubular vent hole which vents the emitted perfume toward a nose of a user when the user wears the head-mounted perfume dispenser apparatus, and a first opener-closer provided between the box and the reservoir. The first opener-closer opens and closes according to the start and an end of the moving image played by the processor. The reservoir has a second opener-closer provided at an upper portion of the reservoir. The second opener-closer opens according to the end of the moving image played by the processor.

Description

  • This application is a continuation application of U.S. application Ser. No. 14/708,264, filed on May 10, 2015, which is a continuation application of International Application No. PCT/JP2014/004221, filed on Aug. 19, 2014, which claims the benefit of Japanese Application No. 2013-173295, filed on Aug. 23, 2013, the disclosures of which are incorporated by reference herein in their entireties.
  • BACKGROUND 1. Technical Field
  • The present disclosure relates to a smell reproduction apparatus.
  • 2. Description of the Related Art
  • Attempts have been started to present olfactory information to a user in recent years (see, for example, Japanese Unexamined Patent Application Publications Nos. 2011-184486 and 2013-74476).
  • SUMMARY
  • Japanese Unexamined Patent Application Publications Nos. 2011-184486 and 2013-74476 described above need further improvement.
  • In one general aspect, the techniques disclosed here feature a head-mounted display including a playback processor which plays back a moving image from first time until second time, the first time corresponding to timing of starting playback of the moving image and the second time corresponding to timing of ending playback of the moving image, a box for placing a container containing a perfume inside, a filled section which is temporarily filled with the perfume and emits the temporarily filled perfume according to starting playback of the moving image, and a tubular vent hole which is in contact with a nose of a user when the user wears the head-mounted display.
  • An aspect of the present disclosure achieves the further improvement.
  • Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagram of an overall configuration according to a first embodiment of the present disclosure;
  • FIG. 2 is a diagram of a configuration of a smell reproduction apparatus according to the first embodiment of the present disclosure;
  • FIG. 3 is a timing diagram of the operations of an opener-closer and a fan according to the first embodiment of the present disclosure;
  • FIG. 4 is a timing diagram with a signal added thereto which is defined by smell control metadata;
  • FIGS. 5A and 5B are diagrams for explaining a configuration to store different smells;
  • FIG. 6 is a diagram for explaining a smell box set value;
  • FIG. 7 is a diagram showing an example of a configuration to store two or more smell boxes;
  • FIG. 8 is a diagram for explaining a method for mixing a plurality of smells;
  • FIG. 9 is a diagram of a configuration of a smell reproduction apparatus according to a second embodiment of the present disclosure;
  • FIG. 10A is a diagram showing a positional relationship between an object and an operator according to the second embodiment of the present disclosure;
  • FIG. 10B is a diagram showing a positional relationship between the object and the operator according to the second embodiment of the present disclosure;
  • FIG. 11 is a diagram of a configuration of a smell reproduction apparatus according to a third embodiment of the present disclosure;
  • FIG. 12 is a timing diagram of the operations of an opener-closer, a sending section, and a filled section opener-closer according to the third embodiment of the present disclosure;
  • FIG. 13A is a diagram for explaining a configuration which provides a sense of augmented reality using a smell;
  • FIG. 13B is a diagram for explaining the configuration that provides a sense of augmented reality using a smell;
  • FIG. 14A is a timing diagram of the operations of the opener-closer, the sending section, and the filled section opener-closer according to the third embodiment of the present disclosure;
  • FIG. 14B is a timing diagram of the operations of the opener-closer, the sending section, and the filled section opener-closer according to the third embodiment of the present disclosure;
  • FIG. 15 is a diagram of a configuration of a conventional smell reproduction apparatus; and
  • FIG. 16 is a diagram of a configuration of a conventional scent reproduction system.
  • DETAILED DESCRIPTION (Underlying Knowledge Forming Basis of the Present Disclosure)
  • The present inventor has found that the techniques disclosed in Japanese Unexamined Patent Application Publications Nos. 2011-184486 and 2013-74476 cause the problems below.
  • FIG. 15 shows a smell generation apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2011-184486.
  • In FIG. 15, a smell generation apparatus 500 includes a plurality of electroosmotic flow pumps 510X, 510Y, and 5102, a plurality of pipes 520X, 520Y, and 520Z, a merging pipe 530, a plurality of liquid quantity sensors 540X, 540Y, and 540Z, a power source section 550, a switch section 560, an ultrasonic vibrator 570, a radio frequency (RF) amplifier 580, a blowing section 590, and a control section 600.
  • FIG. 16 shows a scent provision system disclosed in Japanese Unexamined Patent Application Publication No. 2013-74476.
  • In FIG. 16, a reproduction system 610 which plays back a moving image medium with sound and a scent provision apparatus 620 which emits a scent provided by the reproduction system 610 are provided. The reproduction system 610 is provided with a scent information processing section 613 which generates a control signal for scent generation, a scent generation section 614 which generates a desired scent on the basis of a control signal output from the scent information processing section 613, and a cleaning section 615 which gets rid of a scent collected from the air. The scent provision apparatus 620 is mounted on an eyeglass type display which a user wears and receives a scent together with a picture.
  • However, the apparatus disclosed in Japanese Unexamined Patent Application Publication No. 2011-184486 and the system disclosed in Japanese Unexamined Patent Application Publication No. 2013-74476 suffer from the problem of user-unfriendliness due to large configuration.
  • Under the circumstances, the present inventor has studied the remedial measures below.
  • (1) A head-mounted display according to an aspect of the present disclosure is a head-mounted display including a playback processor which plays back a moving image from first time until second time, the first time corresponding to timing of starting playback of the moving image and the second time corresponding to timing of ending playback of the moving image, a box for placing a container containing a perfume inside, a filled section which is temporarily filled with the perfume and emits the temporarily filled perfume according to starting playback of the moving image, and a tubular vent hole which is in contact with a nose of a user when the user wears the head-mounted display.
  • (2) In the aspect, the filled section may have a first opener-closer at an upper portion, in which the first opener-closer may open according to ending playback of the moving image.
  • (3) In the aspect, the smell reproduction system may further include a fan above the vent hole and below the filled section.
  • (4) In the aspect, the smell reproduction system may further include a gyro which senses a direction that the user faces.
  • (5) In the aspect, the vent hole may include one left vent hole and one right vent hole.
  • (6) In the aspect, the fan may include one left fan and one right fan.
  • (7) In the aspect, the smell reproduction system may further include a second opener-closer between the box and the filled section, and the second opener-closer may open and close according to starting and ending playback of the moving image.
  • (8) In the aspect, starting of rotation, the fan rotates both forward and backward, opening and closing of the first opener-closer, opening and closing of the second opener, stopping and stopping of rotation of the fan, rotation direction of the fan and the number of revolutions of the fan may be controlled in accordance with a control signal.
  • (9) In the aspect, the control signal may be a sound signal which is included in the moving image.
  • (10) In the aspect, the control signal may be a MIDI signal corresponding to the moving image.
  • (11) In the aspect, the smell reproduction system may further include a control signal processor which generates the control signal.
  • (12) In the aspect, the second opener-closer may open at third time and closes at fourth time, the third time being before the first time according to the control signal, and the fourth time being after the first time and before the second time, the first opener-closer may open at the fourth time and closes at fifth time according to the control signal, the fifth time being after the second time, the fan may rotate forward at the third time or sixth time according to the control signal, the sixth time being after the third time and before the first time, and the fan may rotate backward at the fourth time according to the control signal, the fan may stop at the fifth time according to the control signal.
  • (13) In the aspect, the smell reproduction system may further include a distance calculator which calculates a distance between an object in the moving image and the nose of the user on a basis of the sensed direction and a predetermined position of the object in the moving image, the object being a source of a smell corresponding to the emitted perfume, and a scent controller which performs control to change the number of revolutions of the fan in accordance with the calculated distance.
  • Embodiments of the present disclosure will be described below with reference to the drawings.
  • FIG. 1 shows a configuration of a smell reproduction system. The smell reproduction system is composed of a playback processor 100 which plays back a moving image and a smell reproduction apparatus 200 which provides a smell. As shown in FIG. 1, the playback processor 100 is integral with the smell reproduction apparatus 200.
  • The smell reproduction apparatus 200 is a head-mounted display and includes lenses 11 for enlarging a displayed picture and guiding the picture to eyes, a central section 12, and temple sections 18.
  • A user views an image through the lenses 11. The central section 12 is a recessed portion for causing the head-mounted display to engage with a nose of the user. The temple sections 18 are portions to be hooked over ears of the head-mounted display. The playback processor 100 provides a moving image to be played back to the smell reproduction apparatus 200. A moving image may be played back by playing back a medium, such as a DVD or a BD, or by downloading or streaming a moving image file on a network. An object to be played back is not limited to a moving image, and a game image may be provided.
  • A smell playback processor according to the present disclosure will be described below in a first embodiment.
  • First Embodiment
  • FIG. 2 shows a configuration of a smell reproduction apparatus 200 according to the present disclosure.
  • The smell reproduction apparatus 200 is of head-mounted display type. The smell reproduction apparatus 200 is particularly marked by constituent features (vent holes 13, smell boxes 14, opener-closers 15, and a fan 16) for reproducing a smell besides an image display section like a liquid crystal panel.
  • Note that the configuration except for features of the present disclosure will not be described in detail but a configuration of a conventional head-mounted display can be used. A head-mounted display according to the present disclosure is not limited to a smell reproduction apparatus with the configuration shown in FIG. 2.
  • Each vent hole 13 is tubular, and an opening is located near an upper portion of a nose when a user wears the smell reproduction apparatus 200.
  • A container containing a perfume can be placed in each smell box 14. A smell can be changed by changing a container.
  • Each opener-closer 15 is closed under normal conditions and is opened to release a smell in the corresponding smell box 14.
  • The fan 16 rotates so as to emit the smell remaining in the filled section 17 through the vent holes 13. Two fans 16 are desirably mounted such that left and right ones can be controlled independently of each other, but even one will do.
  • The filled section 17 is filled with part of a smell from the smell boxes 14.
  • The operation of the smell reproduction apparatus with the above-described configuration will be described with reference to FIGS. 2 and 3.
  • FIG. 3 is a timing diagram of the operations of the opener-closers 15 and the fan 16 according to the first embodiment.
  • A container containing a perfume corresponding to a moving image to be played back is placed in each smell box 14.
  • When playback of the moving image is started, the opener-closers 15 are opened several seconds before timing of smell emission (a scent reproduction start time t1). At the same time as or slightly later than the opening, the fan 16 starts rotating.
  • The rotation of the fan 16 creates an airflow. The smell of the perfume travels from the smell boxes 14 to a nose through the filled section 17 and the vent holes 13.
  • Finally, the opener-closers 15 are closed before a scent reproduction end time (t2), and rotation of the fan 16 is then stopped.
  • The earlier closing of the opener-closers 15 stops a smell from entering the filled section 17. A smell remaining in the filled section 17 is discharged by the fan 16 after the closing, which stops a smell from floating out continuously.
  • The stopping of rotation of the fan 16 stops air from flowing, and the nose no longer senses a smell.
  • For example, a sound signal may be used to control rotation of the fan 16. Use of a low-frequency sinusoidal signal as a single-channel sound signal of a multichannel sound signal accompanying a moving image file to control the fan 16 removes the need for a particularly complicated control section.
  • A sound signal belonging to another channel may be similarly used to control the opener-closers 15. Alternatively, a control signal shared with the fan 16 may be used.
  • For example, a common control sound signal for the opener-closers 15 and the fan 16 is used in the manner below. A sound signal may be reproduced in advance to control the opener-closers 15, and the sound signal for controlling the opener-closers 15 may be subjected to delay processing and used as a control sound signal for the fan 16.
  • As another example of a control signal, a MIDI signal may be used. If a MIDI signal is used, a scent controller may be provided in the playback processor 100 or the smell reproduction apparatus 200 to control the fan 16 and the opener-closers 15 in accordance with a MIDI signal.
  • Note that smell control metadata indicating whether to enable or disable smell emission may be prepared to control rotation of the fan 16. Each control metadata entry indicates the absence of a smell when the entry has a value of 0 and the presence of a smell when the entry has a value of 1.
  • A control metadata entry is set in each video frame of a video stream. This allows judgment as to whether to emit a smell in one in question of the video frames.
  • FIG. 4 shows the timing diagram in FIG. 3 with a smell control signal added thereto which is obtained by reproducing metadata. As shown in FIG. 4, the scent reproduction start time (t1) and the scent reproduction end time (t2) are defined by a period when the smell control signal is 1.
  • A piece of control metadata may he stored in, for example, an area (for example, user data in the case of MPEG-2 or an SEI message in the case of MPEG-4 AVC) storing supplemental data of each video frame of a video stream. With this configuration, rotation control of the fan based on smell control metadata at timing of decoding and displaying a video stream removes the need for a complicated control section and allows control of smell emission synchronized with a picture. Note that a piece of smell control metadata need not be stored in every video frame and may be stored in a top frame of a GOP.
  • The above-described control signals (a sound channel, a MIDI signal, and control metadata) used to control smell emission will be simply referred to as a smell control signal hereinafter.
  • (Application of First Embodiment)
  • FIGS. 5A and 5B show a configuration of a smell reproduction apparatus when different smells are stored.
  • To implement sending of a plurality of different smells, perfumes serving as sources of different smells are stored in a smell box 14A and a smell box 14B, as shown in FIG. 5A. Opener- closers 15A and 15B open and close respective doors to the smell boxes 14A and 14B.
  • Pieces of timing information for emitting the perfumes are separately stored in a moving image. For example, FIG. 5B shows an example of the configuration of control metadata. Two pieces of control data, a first smell control signal specifying scent reproduction timing for the smell box 14A and a second smell control signal specifying scent reproduction timing for the smell box 14B, are prepared. The smell reproduction apparatus judges the smell emission timing for the smell boxes 14A and 14B by referring to the pieces of information.
  • The smell reproduction apparatus opens only the opener-closer 15A if the smell reproduction apparatus judges, by referring to the first smell control signal, that it is time to send a scent from the smell box 14A and opens only the opener-closer 15B if the smell reproduction apparatus judges, by referring to the second smell control signal, that it is time to send a scent from the smell box 14B.
  • With the above-described configuration, a plurality of different smells can be provided to a user during same content. Note that lack of direct connection between the smell boxes 14A and 14B and the vent holes 13 and the presence of the filled section 17 that is temporarily filled allow implementation of provision of a plurality of different smells. If the opener- closers 15A and 15B are controlled by the process of storing a low-frequency sinusoidal signal as a single-channel sound signal of a multichannel sound signal accompanying a moving image file, as described above, respective channels may be prepared for the plurality of smells. The same applies to a case using a MIDI signal, and a plurality of MIDI signals may be stored.
  • (Sending of Smell Suited to Loading Status)
  • In the first embodiment, smell emission is controlled in accordance with a control signal set in a moving image. The configuration may be such that a smell emission method can be selected in accordance with a user's preferences or the loading status of the smell boxes 14. A specific configuration will be described.
  • FIG. 6 is a diagram for explaining a smell box set value. As shown on the right side of FIG. 6, a smell reproduction system includes a smell box set value, a scent controller, and a playback processor.
  • A piece of smell control information stored in a moving image has a smell ID which is set for a corresponding smell. The smell reproduction system has the added “smell box set value” indicating whether to send a smell specified in the moving image.
  • For example, a plurality of smells are prepared for a moving image, and pieces of control data having a smell ID of 0 and a smell ID of 1 are stored in the moving image. In this case, if only a perfume with the smell ID of 1 is stored in loaded smell boxes 14A and 14B, the smell box set value has only the smell ID of 1. A smell reproduction apparatus refers to the smell box set value, refers to only a control signal with the specified smell ID, and emits a smell.
  • Note that the smell box set value may be set by a user through a GUI or the like even when necessary smell boxes are loaded. With this configuration, a smell suited to a user's preferences or a situation can be emitted during a moving image, for which a plurality of perfumes serving sources of smells are set.
  • The smell box set value may be automatically set at the time of smell box loading. For example, a configuration is conceivable in which an NFC chip storing information, such as a smell ID of a corresponding scent, is embedded in each smell box, and the smell reproduction apparatus has an NFC communication function. The smell reproduction apparatus can judge which perfume the loaded smell box stores by reading the information of the NFC chip in each smell box through NFC communication. All smell boxes preferably have unique smell IDs.
  • (Quantification of Smell)
  • A piece of information obtained by quantifying a smell may be included in a piece of information to be stored as the smell box set value or a smell control signal to be stored in a moving image. An example of smell quantification is a method adopted in a smell identification device by SHIMADZU CORPORATION. There are various methods for smell quantification.
  • The smell reproduction apparatus may select a smell box to be opened and closed in accordance with the degree of closeness to a piece of quantified information stored as the smell box set value (the degree of closeness is higher if an absolute value of a difference is smaller).
  • For example, if a smell value of a smell control signal with the smell ID of 0 included in a moving image is 100, a smell value of a smell control signal with the smell ID of 1 included in the moving image is 200, and a smell value stored as the smell box set value is 180, smell control is performed using the smell control signal with the smell ID of 1, which has a smaller absolute value for a difference in value. With this configuration, a scent which is not the same as but close to a scent included in a moving image can be provided to a user. The user can make effective use of a smell box.
  • Note that, in this case, a threshold may be set for the degree of closeness. For example, assume that a smell value of a smell control signal with the smell ID of 0 included in a moving image is 100, a smell value of a smell control signal with the smell ID of 1 included in the moving image is 200, a smell value stored as the smell box set value is 1,000, and a smell threshold is 500. In this case, absolute values of differences for both smells exceed the threshold value of 500. The smell reproduction apparatus may judge that the smells are quite different to disable both the smells. With this configuration, a scent different from an impression of a user is not provided to the user any longer.
  • Note that a smell control signal may not be stored in a moving image and may be separately transmitted through a network. With this configuration, it is possible to easily change only a smell sent from an object by not changing video content, such as a moving image, but changing only a smell control signal.
  • (Expansion of Boxes)
  • Note that the number of boxes is not limited to two and can, of course, be expanded in the manner shown in FIG. 7. FIG. 7 shows an example of a configuration in which a smell reproduction apparatus stores three or more smell boxes.
  • For example, assume that four types of scents are stored, as in FIG. 7, and that sending of a scent from a smell box 14A is set in a smell control signal at the time of playback of a first picture. If only a smell control signal, in which whether to send a smell from a smell box 14B is set, is updated via a network at the time of playback of a next picture, a smell to be sent can be easily changed even during same content.
  • This can be applied in the manner below. For example, if a scent of a perfume used by an idol is updated in the form of a “smell control signal” every day in video content associated with the idol, a user can enjoy the idol video content every day together with a perfume used by the idol on the day.
  • (Addition of Mixture Proportion)
  • Note that smell control signals may include pieces of information indicating mixture proportions for smell boxes with different smells.
  • FIG. 8 is a diagram for explaining a method for mixing a plurality of smells. For example, in smell control signals for a moving image in FIG. 8, instructions for smell sending are given for a group of frames denoted by X and a group of frames denoted by Y. A value of each of control signals is a piece of information indicating a mixture proportion and is a percentage. That is FIG. 8 shows that a smell sent in the group X of frames is a smell obtained by mixing a smell with a smell ID of 0 and a smell with a smell ID of 2 in proportions of 30% and 70%, respectively. Similarly, FIG. 8 shows that a smell sent in the group Y of frames is a smell obtained by mixing a smell with a smell ID of 1 and the smell with the smell ID of 2 in proportions of 50% and 50%, respectively. To mix smells in such mixture proportions, a smell reproduction apparatus may adjust the number of revolutions of the fan 16.
  • With this configuration, various smells can be created even with a small number of smell boxes. Calculation of a smell mixture proportion parameter may be implemented in a cloud system, and only a result of the calculation may be transmitted as a smell control signal over a network. This allows updating of content without complicated processing on the reproduction apparatus side.
  • Second Embodiment
  • FIG. 9 is a diagram of a configuration of a smell reproduction apparatus according to a second embodiment of the present disclosure. In FIG. 9, same components as those in the smell reproduction apparatus in FIGS. 1 and 2 are denoted by same reference numerals, and a description thereof will be omitted.
  • The smell reproduction apparatus in FIG. 9 is different from the smell reproduction apparatus in FIG. 2 in that a gyro 19 is provided. FIG. 9 is different from FIG. 2 in that a distance calculator 101 and a scent controller 102 are provided in addition to a playback processor 100. The operation of the smell reproduction apparatus with the above-described configuration will be described with reference to FIGS. 10A and 10B together with FIG. 9.
  • FIGS. 10A and 10B are diagrams showing positional relationships between an object and an operator according to the second embodiment of the present disclosure. A position serving as a source of a smell is set in advance in a moving image to be played back. For example, assume that an object 300 which reproduces a smell is located to the right of a person wearing the smell reproduction apparatus, as shown in FIG. 10A. The person wearing the smell reproduction apparatus faces to the right and looks toward the object 300, as in FIG. 10B. At this time, which direction the person faces is detected by the gyro 19 attached to the smell reproduction apparatus. A distance between the person wearing the smell reproduction apparatus and the object 300 is calculated by the distance calculator 101. As the distance becomes shorter, the scent controller 102 increases the number of revolutions of a fan 16, and the person wearing the smell reproduction apparatus comes to smell the object 300. The distance calculator 101 may calculate distances to left and right halves of a nose independently of each other to thereby control the numbers of revolutions of the left and right fans 16 independently of each other or make a distinction between left and right rotation time periods.
  • Third Embodiment
  • FIG. 11 is a diagram of a configuration of a smell reproduction apparatus according to a third embodiment of the present disclosure. In FIG. 11, same components as those in the smell reproduction apparatus in FIG. 2 are denoted by same reference numerals, and a description thereof will be omitted.
  • In FIG. 11, the smell reproduction apparatus is different from the smell reproduction apparatus in FIG. 2 in that a filled section 17 has a filled section opener-closer 20. The operation of the smell reproduction apparatus with the above-described configuration will be described with reference to FIG. 12 together with FIG. 11.
  • FIG. 12 is a timing diagram of the operations of an opener-closer 15, a fan 16, and the filled section opener-closer 20 according to the third embodiment of the present disclosure.
  • A container containing a perfume which is fitted to, for example, a moving image to be played back is first placed in each smell box 14.
  • When playback of the moving image is started, the opener-closers 15 are opened several seconds before timing of smell emission (a scent reproduction start time t1). At the same time as or slightly later than the opening, the fan 16 starts being positively rotated. The positive rotation causes air to flow toward vent holes 13. The positive rotation of the fan 16 creates an airflow. A smell travels from the smell boxes 14 to a nose through the filled section 17 and the vent holes 13.
  • The opener-closers 15 are then closed before a scent reproduction end time (t2). At the same time, the filled section opener-closer 20 is opened.
  • Finally, the fan 16 is negatively rotated.
  • The earlier closing of the opener-closers 15, the opening of the filled section opener-closer 20, and the negative rotation of the fan 16 cause air to flow against the vent holes 13. That is, a smell remaining in the filled section 17 is discharged through the filled section opener-closer 20. After the negative rotation of the fan 16, the filled section opener-closer 20 is closed, and rotation of the fan 16 is stopped. In this manner, the smell remaining in the filled section 17 can be discharged.
  • The filled section opener-closer 20 is configured to be openable and closable with timing, as described above. An air hole may be formed in an upper portion of the filled section 17. Note that a smell enable/disable button may be provided at the smell reproduction apparatus and that the smell reproduction apparatus may refer to the status of the smell enable/disable button and perform smell emission control.
  • In this case, when smell emission is disabled, the smell reproduction apparatus closes the opener-closers 15 to prohibit smell emission even if smell sending is specified by a smell control signal. With this configuration, a user can easily make an adjustment to enable or disable smell emission in accordance with a situation or preferences. Such a button is preferably located in the vicinity of a central section 12 that is close to the position of a nose of the user because the user intuitively knows the position of the button. A gesture recognition function, such as Kinect, may be used, and a nose-pinching gesture may be used as an operation of enabling or disabling smell emission.
  • Note that the smell reproduction apparatus may be provided with a button or a slide switch for setting smell level and that the smell reproduction apparatus may refer to the smell level and perform smell emission control.
  • In this case, the smell reproduction apparatus adjusts the intensity of smell in accordance with the smell level. More specifically, the smell reproduction apparatus adjusts the number of revolutions of the fan 16. With this configuration, a user can easily adjust the intensity of smell in accordance with a situation or preferences. Such a button is preferably located in the vicinity of the central section 12 that is close to the position of the nose of the user because the user intuitively knows the position of the button.
  • Note that although a system which emits a smell synchronously with a picture has been described in the present embodiment, the present disclosure is not limited to smell emission synchronous with a picture. If the user can select between synchronism and asynchronism using a GUI menu or the like and can select a smell box to emit a smell in the case of asynchronism, smell emission asynchronous with a picture can be implemented.
  • (Application of Third Embodiment)
  • The present application is intended for interlock with a moving image recorded in real time.
  • (Sense of Augmented Reality Using Smell)
  • FIGS. 13A and 13B are diagrams for explaining a configuration which provides a sense of augmented reality using a smell. In particular, if cameras are mounted at eyeglass sections of a smell reproduction apparatus, as shown in FIG. 13A, moving images taken by the cameras are displayed without change, and a smell is changed depending on the content of the images, an augmented reality effect can be given.
  • A specific system configuration is shown in FIG. 13B. In FIG. 13B, the smell reproduction apparatus has the additional miniature cameras. The miniature cameras are set at the positions of eyes when a user wears the smell reproduction apparatus, and the user can receive pictures at the specified positions.
  • Pictures taken by the miniature cameras are transmitted to a playback processor and are compressed as video streams and transmitted to a smell determiner. The playback processor displays the pictures output from the miniature cameras on a display on the smell reproduction apparatus without change. A scent controller of the smell reproduction apparatus emits a smell on the basis of a smell control signal received from the smell determiner.
  • The smell determiner is composed of a body recognition processing section and a smell determination section.
  • The body recognition processing section decodes the input video streams, performs image recognition processing on a resultant picture, identifies a body in the picture, and inputs information on the body to the smell determination section.
  • The smell determination section refers to a smell DB and identifies a smell corresponding to the body. For example, the smell determination section selects a smell of a “banana” if there is a “banana” in the picture and a smell of a “freshscent perfume” if there is an idol in the picture. In this manner, the smell determination section identifies a piece of scent information corresponding to the body. The smell determination section creates a smell control signal and transmits the smell control signal to the smell reproduction apparatus.
  • With this configuration, an augmented reality effect corresponding to a picture actually viewed by a user can be achieved, and an emphasized smell can be delivered to the user. For example, amplification of a smell of food allows the user to enjoy a dish. An application is also conceivable which gives a weight loss effect to a user by sending a smell decreasing appetite.
  • The body recognition section may support an AR marker and be configured to determine an object to be displayed on an AR marker and transmit a result of the determination to the playback processor of the smell reproduction apparatus. The playback processor may create an object, such as 3DCG, and display the object superimposed on a picture displayed on the smell reproduction apparatus.
  • With this configuration, the smell reproduction apparatus can display an object corresponding to an AR marker to a user and send a smell corresponding to the object, as shown in FIG. 14A. A piece of scent information may be expressed as a piece of character information like “LEMON SCENT” in FIG. 14A, a color, or the like on a screen.
  • (Interlock With Perfume)
  • The sense of taste and a perfume have a close relationship. It is well known that a taste sensed by a human changes with a change in perfume. For example, if a human smells a chocolate while chewing tasteless gum, the human feels like chewing chocolaty gum.
  • For this reason, a smell different from the actual smell of a drink or a food is provided to a user, thereby making the user virtually experience feels of various foods.
  • Referring to FIG. 14B, in a picture taken by the miniature cameras, a cup is labeled “LEMON JUICE”. In fact, the cup contains not lemon juice but a sugar solution.
  • The smell determiner detects the label, judges that “LEMON JUICE” is denoted on the label, and transmits a smell control signal for lemon. The smell reproduction apparatus emits a lemon smell, and a user can enjoy a sense of drinking lemon juice in a simulated manner. If a liquid portion of the picture is simultaneously changed to lemon yellow, more effect can be obtained. Note that although the label “LEMON JUICE” is recognized to determine how a food or a drink is simulated, the smell reproduction apparatus may automatically make a determination on the basis of information of loaded smell boxes.
  • Note that a server on a network may play as sections which process calculations, such as a distance calculator and the smell determiner, in the present embodiment. This configuration allows device miniaturization.
  • A smell reproduction apparatus according to the present disclosure is a small-sized smell reproduction apparatus mounted on a head-mounted display. The smell reproduction apparatus is small-sized and can be easily used by a general user.

Claims (11)

What is claimed is:
1. A head-mounted perfume dispenser apparatus comprising:
a processor which plays a moving image;
a box, in which a container containing a perfume is received;
a reservoir which is filled with the perfume received from the box and emits the perfume according to a start of playing the moving image;
a tubular vent hole which vents the emitted perfume toward a nose of a user when the user wears the head-mounted perfume dispenser apparatus; and
a first opener-closer provided between the box and the reservoir,
wherein the first opener-closer opens and closes according to the start and an end of the moving image played by the processor,
the reservoir has a second opener-closer provided at an upper portion of the reservoir, and
the second opener-closer opens according to the end of the moving image played by the processor.
2. The head-mounted perfume dispenser apparatus according to claim 1, further comprising:
a fan provided above the vent hole and below the reservoir.
3. The head-mounted perfume dispenser apparatus according to claim 2, further comprising:
a gyro which senses a direction that the user faces.
4. The head-mounted perfume dispenser apparatus according to claim 1, wherein
the vent hole includes one left vent hole and one right vent hole.
5. The head-mounted perfume dispenser apparatus according to claim 2, wherein
the fan includes one left fan and one right fan.
6. The head-mounted perfume dispenser apparatus according to claim 1, further comprising a fan provided above the vent hole and below the reservoir, wherein
the fan rotates both forward and backward,
opening and closing the first opener-closer, opening and closing the second opener, starting and stopping a fan rotation, a fan rotation direction and a number of revolutions of the fan are controlled in accordance with a control signal.
7. The head-mounted perfume dispenser apparatus according to claim 6, wherein
the control signal is a sound signal which is included in the moving image.
8. The head-mounted perfume dispenser apparatus according to claim 6, wherein
the control signal is a MIDI signal corresponding to the moving image.
9. The head-mounted perfume dispenser apparatus according to claim 6, further comprising:
a control signal processor which generates the control signal.
10. The head-mounted perfume dispenser apparatus according to claim 6, wherein
the first opener-closer opens at a first time and closes at a second time according to the control signal, the first time being before a third time and the second time being after the third time and before the fourth time, the third time corresponding to a moving image play start time and the fourth time corresponding to a moving image play end time,
the second opener-closer opens at the second time and closes at a fifth time according to the control signal, the fifth time being after the fourth time,
the fan rotates forward at the first time or a sixth time according to the control signal, the sixth time being after the first time and before the third time,
the fan rotates backward at the second time according to the control signal, and
the fan stops at the fifth time according to the control signal.
11. The head-mounted perfume dispenser apparatus according to claim 3, further comprising:
a calculator which calculates a distance between an object in the moving image and the nose of the user based on the sensed direction and a position of the object in the moving image, the object being a source of a smell corresponding to the emitted perfume; and
a controller which changes a number of revolutions of the fan in accordance with the calculated distance.
US15/709,870 2013-08-23 2017-09-20 Head-mounted display Abandoned US20180017797A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/709,870 US20180017797A1 (en) 2013-08-23 2017-09-20 Head-mounted display

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2013173295 2013-08-23
JP2013-173295 2013-08-23
PCT/JP2014/004221 WO2015025511A1 (en) 2013-08-23 2014-08-19 Odor reproduction device
US14/708,264 US9804398B2 (en) 2013-08-23 2015-05-10 Head-mounted perfume dispenser apparatus
US15/709,870 US20180017797A1 (en) 2013-08-23 2017-09-20 Head-mounted display

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/708,264 Continuation US9804398B2 (en) 2013-08-23 2015-05-10 Head-mounted perfume dispenser apparatus

Publications (1)

Publication Number Publication Date
US20180017797A1 true US20180017797A1 (en) 2018-01-18

Family

ID=52483306

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/708,264 Expired - Fee Related US9804398B2 (en) 2013-08-23 2015-05-10 Head-mounted perfume dispenser apparatus
US15/709,870 Abandoned US20180017797A1 (en) 2013-08-23 2017-09-20 Head-mounted display

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/708,264 Expired - Fee Related US9804398B2 (en) 2013-08-23 2015-05-10 Head-mounted perfume dispenser apparatus

Country Status (3)

Country Link
US (2) US9804398B2 (en)
JP (1) JPWO2015025511A1 (en)
WO (1) WO2015025511A1 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3310041B1 (en) * 2015-06-12 2023-03-08 Sony Interactive Entertainment Inc. Perfume presentation device
WO2016199452A1 (en) * 2015-06-12 2016-12-15 株式会社ソニー・インタラクティブエンタテインメント Information processing device
EP3309655B1 (en) * 2015-06-12 2021-05-05 Sony Interactive Entertainment Inc. Information processing device
US11226124B2 (en) 2015-10-09 2022-01-18 The Procter & Gamble Company Systems and methods for coupling the operations of an air handling device and a volatile composition dispenser
US10416687B2 (en) * 2015-10-09 2019-09-17 The Procter & Gamble Company Systems and methods for coupling the operations of a volatile composition dispenser and a smart appliance
JP6513218B2 (en) 2015-11-30 2019-05-15 株式会社ソニー・インタラクティブエンタテインメント Information processing device
KR101720266B1 (en) * 2016-03-04 2017-03-28 피움랩스 주식회사 Fragrance discharge apparatus
US9925458B2 (en) * 2016-03-21 2018-03-27 Eye Labs, LLC Scent dispersal systems for head-mounted displays
US9925549B2 (en) 2016-03-21 2018-03-27 Eye Labs, LLC Head-mounted displays and attachments that enable interactive sensory experiences
KR101997318B1 (en) * 2016-05-12 2019-07-08 민상규 Phone having virtual reality function
WO2017188740A1 (en) 2016-04-28 2017-11-02 민상규 Virtual reality cell phone
KR101867153B1 (en) 2016-05-25 2018-06-12 민상규 Phone protection case having virtual reality function
US10743087B2 (en) * 2017-06-21 2020-08-11 Z5X Global FZ-LLC Smart furniture content interaction system and method
IT201700085213A1 (en) * 2017-07-26 2019-01-26 Renata Falconi Device for virtual reality.
WO2019171216A1 (en) * 2018-03-07 2019-09-12 Elon Littwitz Augmented reality device and/or system and/or method for using same for assisting in walking or movement disorders
JP6856060B2 (en) * 2018-10-10 2021-04-07 ダイキン工業株式会社 Blower
US10922376B2 (en) * 2018-11-26 2021-02-16 Nag Mun Song Perfume package accessory design system and method of operating perfume package accessory design system

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1749187A (en) * 1927-08-31 1930-03-04 John H Leavell Method of and apparatus for presenting theatrical impressions
US2540144A (en) * 1947-10-13 1951-02-06 Emery I Stern Television with scent effects
US2905049A (en) * 1956-06-25 1959-09-22 Len Ruskin Motion pictures with synchronized odor emission
US3628829A (en) * 1966-03-09 1971-12-21 Morton L Heilig Experience theater
CA1291261C (en) * 1982-11-25 1991-10-22 Akihisa Osawa Video theater system
JPS6141229A (en) * 1984-07-31 1986-02-27 Tamapatsuku Kk Acoustic reproducer with perfume generating function
KR960004813B1 (en) * 1992-10-06 1996-04-13 엘지전자주식회사 Scent occurring television receiver
WO1994009493A1 (en) * 1992-10-16 1994-04-28 Gerold Tebbe Recording medium and appliance for generating sounds and/or images
DE4314886C2 (en) * 1993-05-05 1996-02-22 Wittek Method and device for the synchronous presentation of fragrances for visual and / or acoustic stimuli
US5610674A (en) * 1995-06-19 1997-03-11 Martin; David A. Precision fragrance dispenser apparatus
US5591409A (en) * 1995-08-15 1997-01-07 Watkins; Carl J. Providing aromas
US5724256A (en) * 1996-06-10 1998-03-03 International Business Machines Corporation Computer controlled olfactory mixer and dispenser for use in multimedia computer applications
US5949522A (en) * 1996-07-03 1999-09-07 Manne; Joseph S. Multimedia linked scent delivery system
US6803987B2 (en) * 1996-07-03 2004-10-12 Joseph S. Manne Portable scent delivery system
JP3779987B2 (en) * 1996-07-24 2006-05-31 雅信 鯨田 Fragrance equipment
US6149873A (en) * 1998-05-14 2000-11-21 Potter; Mike Computer game enhancement
US6024783A (en) * 1998-06-09 2000-02-15 International Business Machines Corporation Aroma sensory stimulation in multimedia
JP2001036829A (en) * 1999-07-21 2001-02-09 Shoichi Takagi Television receiver that emits smell
WO2001042852A1 (en) * 1999-12-07 2001-06-14 Schermerhorn James G Olfactory special effects system
CA2410020C (en) * 2000-05-26 2008-07-22 Yukinobu Tajima Method and apparatus for generating smell
US20030026728A1 (en) * 2001-08-02 2003-02-06 Avram Vlad Iorgulescu Substance and microclimate simulator
GB0217116D0 (en) * 2002-07-24 2002-09-04 Givaudan Sa Device
US7154579B2 (en) * 2004-03-03 2006-12-26 Selander Raymond K Fragrance delivery for multimedia systems
US20050226601A1 (en) * 2004-04-08 2005-10-13 Alon Cohen Device, system and method for synchronizing an effect to a media presentation
WO2005099663A2 (en) * 2004-04-14 2005-10-27 University Of Southern California Scent delivery device and method of simulating scent in a virtual environment
JP2006208997A (en) * 2005-01-31 2006-08-10 Konica Minolta Photo Imaging Inc Video display device and video display system
CN101305313B (en) * 2005-11-10 2010-09-08 皇家飞利浦电子股份有限公司 Fluid transmission through a visual display panel
US8295529B2 (en) * 2006-08-28 2012-10-23 Bcinet, Inc. Gaming headset with integrated microphone and adapted for olfactory stimulation
KR101352790B1 (en) * 2007-07-27 2014-01-16 삼성전자주식회사 Method for providing environmental information, video apparatus and video system thereof
JP2011512188A (en) * 2008-02-15 2011-04-21 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Fragrance dispenser
EP2416305A4 (en) * 2009-04-01 2012-09-05 Nec Corp Collision prediction system, collision prediction device, collision detection method, and program
JP5421144B2 (en) * 2010-02-09 2014-02-19 Necカシオモバイルコミュニケーションズ株式会社 Terminal device and program
JP5429993B2 (en) 2010-03-04 2014-02-26 国立大学法人東京工業大学 Odor generator
US20110250962A1 (en) * 2010-04-09 2011-10-13 Feiner Steven K System and method for a 3d computer game with true vector of gravity
JP2013074476A (en) 2011-09-28 2013-04-22 Toppan Printing Co Ltd Aroma providing device
WO2013005615A1 (en) * 2011-07-06 2013-01-10 凸版印刷株式会社 Scent-providing device
US9931425B2 (en) * 2013-03-15 2018-04-03 Vapor Communications, Inc. Systems, methods and articles to provide olfactory sensations
CN105358181B (en) * 2013-04-22 2019-06-11 加利福尼亚大学董事会 Changeable gas and liquid release and conveying equipment, system and method
US9715223B2 (en) * 2013-07-10 2017-07-25 Scentair Technologies, Llc Bias setting in a scent delivery system

Also Published As

Publication number Publication date
WO2015025511A1 (en) 2015-02-26
US20150241708A1 (en) 2015-08-27
JPWO2015025511A1 (en) 2017-03-02
US9804398B2 (en) 2017-10-31

Similar Documents

Publication Publication Date Title
US9804398B2 (en) Head-mounted perfume dispenser apparatus
US11363349B2 (en) Geometry matching in virtual reality and augmented reality
TWI713911B (en) Optimizing audio delivery for virtual reality applications
JP6847148B2 (en) Real-time lens aberration correction by eye tracking
JP2020171721A (en) Expanded visual field re-rendering for vr watching
US20140245367A1 (en) Method for providing a video, transmitting device, and receiving device
US9805767B1 (en) Perspective view entertainment system and method
US9744459B2 (en) Computer-readable storage medium storing information processing program, information processing device, information processing system, and information processing method
JP2011086283A (en) System and method for three-dimensional video capture workflow for dynamic rendering
US9933985B2 (en) Systems and methods for managing content presentation involving a head mounted display and a presentation device
US8954885B2 (en) Display system using metadata to adjust area of interest and method
US10691405B2 (en) Sound control apparatus, sound control method, and program
US11546713B2 (en) Information processing device, information processing method, program, and information processing system
JP2005124741A (en) Game machine
KR102163601B1 (en) 4d theater system
TWI491245B (en) Method and apparatus for authoring stereoscopic 3d video information, and method and apparatus for displaying such stereoscopic 3d video information
US9066095B2 (en) Display control device, display control method, display control program, computer-readable recording medium, recording/playback device equipped with abovementioned display control device, speech output device, and recording/playback device equipped with speech output device
Sasaki Watanabe et al.
CN107844177A (en) Device parameter method of adjustment, device and electronic equipment
US20240223834A1 (en) Method and means for providing multi-content media
US20220174358A1 (en) Content moderation for extended reality media
US20230342989A1 (en) Virtual Content
JP5097149B2 (en) Content data playback device
EP4331229A1 (en) Method and means for providing multi-content media
JP2013211914A (en) Display device, display method, program, and recording medium

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION