GB2583822A - Head mountable imaging apparatus and system for assisting a user with reduced vision - Google Patents

Head mountable imaging apparatus and system for assisting a user with reduced vision Download PDF

Info

Publication number
GB2583822A
GB2583822A GB2002406.3A GB202002406A GB2583822A GB 2583822 A GB2583822 A GB 2583822A GB 202002406 A GB202002406 A GB 202002406A GB 2583822 A GB2583822 A GB 2583822A
Authority
GB
United Kingdom
Prior art keywords
imaging apparatus
video signal
output
head mountable
delay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB2002406.3A
Other versions
GB202002406D0 (en
GB2583822B (en
Inventor
Hicks Stephen
Campbell Alex
Herrera Fernando
Ali Athar
Roshan Rakesh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oxsight Ltd
Original Assignee
Oxsight Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oxsight Ltd filed Critical Oxsight Ltd
Priority to CN202010118736.4A priority Critical patent/CN111629238A/en
Publication of GB202002406D0 publication Critical patent/GB202002406D0/en
Publication of GB2583822A publication Critical patent/GB2583822A/en
Application granted granted Critical
Publication of GB2583822B publication Critical patent/GB2583822B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/008—Teaching or communicating with blind persons using visual presentation of the information for the partially sighted
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43076—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

Apparatus for enhancing an image of a video for a user with reduced vision, or partially sighted, comprising a head mounted imaging apparatus 30 such as a head mounted display HMD, and a separate first device 10. The first device comprises an input for receiving audio-visual media content, an output to output the audio and video signal to a media presentation device 50, 51, and a wireless transmitter to send the video to the HMD. The HMD has a wireless receiver to receive the video signal, a display device to provide a display to an eye of the user, and a processor. The processor processes the input video signal to provide image enhancement for assisting a user with reduced vision. Alternatively, the first device may introduce a delay to the audio output signal compared to the video signal. The first device may be a set-top box and receive media using IPTV. Enhancement may be edge detection, magnification, contrast change.

Description

HEAD MOUNTABLE IMAGING APPARATUS AND SYSTEM FOR ASSISTING A USER WITH REDUCED VISION
TECHNICAL FIELD
The present invention relates to a head mountable imaging apparatus and system for assisting a user with reduced vision.
BACKGROUND
People with various forms of visual impairment, including those with peripheral vision loss and those with central vision loss, struggle to watch distant objects as they have difficulty focussing upon them. This is relevant for many daily activities, including watching TV as they are generally placed at a distance from the viewer's location. This can be obstacle for visually impaired individuals having either peripheral or loss of peripheral vision who cannot usually focus on objects afar. As a consequence such individuals are usually forced to sit quite close to the TV in order to view it at an acceptable quality. Many visually impaired individuals may be further inconvenienced by having to rely solely on sound guides such as Audio Description (AD).
It is an aim of the present invention to address at least one disadvantage associated with the
prior art.
SUMMARY OF THE INVENTION
There is provided a system for assisting a user with reduced vision comprising: a head mountable imaging apparatus and a first device which is separate to the head mountable imaging apparatus, the first device comprising: a first input configured to receive media content comprising audio and video; a first output configured to output at least one of an output audio signal and an output video signal to a media presentation device; a second output configured to send a video signal to the head mountable imaging apparatus; and the head mountable imaging apparatus comprising: a display device configured to provide a display to an eye of the user; an input configured to receive the video signal from the first device; a processor configured to process an input video signal to provide at least one type of image enhancement for assisting a user with reduced vision.
Optionally, the second output comprises a wireless transmitter configured to send a video signal to the head mountable imaging apparatus and the head mountable imaging apparatus comprises a wireless receiver configured to receive the video signal from the first device.
Alternatively, the second output of the first device can be connected to the input of the head mountable imaging apparatus by a cable.
Optionally, the head mountable imaging apparatus comprises: a camera configured to provide a video signal representing a scene in front of the imaging apparatus; and wherein the head mountable imaging apparatus is configured to selectively operate in a first mode in which the video signal from the camera is processed and output to the display device and in a second mode in which the video signal received from the first device is processed and output to the display device.
Optionally, the first device comprises a processor configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
Optionally, a value of the delay is preconfigured.
Optionally, a value of the delay is user configurable.
Optionally, the first device is configured to selectively operate in: a first mode in which the wireless transmitter is configured to send a video signal to the head mountable imaging apparatus and the processor is configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus; and a second mode in which the wireless transmitter is not configured to send a video signal to the head mountable imaging apparatus and the processor is not configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
Optionally, the image enhancement comprises at least one of: edge detection and presentation of detected edges; contrast enhancement; magnification of a selected area of an overall image.
Optionally, the first device is a set top box, the first input is configured to receive at least one of: a terrestrial TV signal, a satellite TV signal and a cable TV signal and the first device comprises a tuner.
Optionally, the first device is configured to receive an Internet Protocol Television (IPTV) signal.
Optionally, the set top box comprises media storage and the first device is capable of recording and playback of media content.
Optionally, the first device is configured to connect to a host device, the first input comprises a wireless interface configured to receive the media content as a data stream from a server.
Optionally, the first device is configured to connect to an HDMI port of the host device.
There is provided apparatus for assisting a user with reduced vision comprising: a first device which is separate to a head mountable imaging apparatus, the first device comprising: a first input configured to receive media content comprising audio and video; a first output configured to output at least one of an output audio signal and an output video signal to a media presentation device; a wireless transmitter configured to send a video signal to the head mountable imaging apparatus; and a processor configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
Optionally, a value of the delay is preconfigured.
Optionally, a value of the delay is user configurable.
Optionally, the first device is configured to selectively operate in: a first mode in which the wireless transmitter is configured to send a video signal to the head mountable imaging apparatus and the processor is configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus; and a second mode in which the wireless transmitter is not configured to send a video signal to the head mountable imaging apparatus and the processor is not configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
Optionally, the first device comprises a processor configured to process an input video signal to provide at least one type of image enhancement for assisting a user with reduced vision. The image enhancement performed by the processor at the first device can be used in conjunction with, or instead of, any image enhancement performed by the head mountable imaging apparatus. An advantage of performing image enhancement at the first device can be improved processing performance. An advantage of performing image enhancement at the first device can be reduced energy consumption at the head mountable imaging apparatus, as less processing is required. This can prolong battery life. Optionally, only the first device has a processor configured to process an input video signal to provide at least one type of image enhancement for assisting a user with reduced vision, and no processing capability is present at the head mountable imaging apparatus.
An advantage of at least one example is allowing visually impaired users to watch media content, such as live television signals or other media content, with improved quality.
An advantage of at least one example is allowing visually impaired users to watch media content via the head mountable imaging apparatus, and to listen to audio of the media content, with improved synchronisation between images and audio.
The functionality described here can be implemented in hardware, software executed by a processing apparatus, or by a combination of hardware and software. The processing apparatus can comprise a computer, a processor, a state machine, a logic array or any other suitable processing apparatus. The processing apparatus can be a general-purpose processor which executes software to cause the general-purpose processor to perform the required tasks, or the processing apparatus can be dedicated to perform the required functions. Another aspect of the invention provides machine-readable instructions (software) which, when executed by a processor, perform any of the described methods. The machine-readable instructions may be stored on an electronic memory device, hard disk, optical disk or other machine-readable storage medium. The machine-readable medium can be a non-transitory machine-readable medium. The term "non-transitory machine-readable medium" comprises all machine-readable media except for a transitory, propagating signal. The machine-readable instructions can be downloaded to the storage medium via a network connection.
Within the scope of this application it is envisaged that the various aspects, embodiments, examples and alternatives, and in particular the individual features thereof, set out in the preceding paragraphs, in the claims and/or in the following description and drawings, may be taken independently or in any combination. For example features described in connection with one embodiment are applicable to all embodiments, unless such features are incompatible.
For the avoidance of doubt, it is to be understood that features described with respect to one aspect of the invention may be included within any other aspect of the invention, alone or in appropriate combination with one or more other features.
BRIEF DESCRIPTION OF THE DRAWINGS
One or more embodiments of the invention will now be described, by way of example only, with reference to the accompanying figures in which: FIGURES 1 and 2 show a first example of a system; FIGURE 3 shows a set top box for use in the system; FIGURE 4 shows a head mountable imaging apparatus for use in the system; FIGURE 5 shows a handset of the head mountable imaging apparatus; FIGURES 6A-6D show examples of image enhancement; FIGURE 7 shows an example of a device for use in place of the set top box.
DETAILED DESCRIPTION
Figures 1-4 show an example of a system for assisting a user with reduced vision. The system comprises a set top box (STB) 10, a head mountable imaging apparatus 30 and media presentation devices in the form of a display (TV 50) and an audio speaker 51.
The STB 10 comprises an input port 11 for receiving a TV signal. The TV signal may be a terrestrial TV signal, a satellite TV signal or a cable TV signal. The TV signal is typically modulated in the radio frequency (RF) band. The STB 10 comprises a TV tuner 12 for down-converting a selected TV channel from RF to baseband. A demodulator demodulates the TV signal selected by the tuner. The demodulator may be provided as part of tuner 12, or separately. A decoder decodes the audio and video data. The demodulator outputs a digital signal comprising audio and video in digital form. A range of modulation and coding schemes are in use. For example, Digital Video Broadcasting -Terrestrial (DVB-T) uses orthogonal frequency division multiplexing (OFDM) and Motion Pictures Experts Group (MPEG) MPEG-2 or MPEG-4 coding. Some TV formats, such as DVB-T, also include data. Data may be used to carry subtitle information for a TV channel. The audio, video (and optionally data) together comprise media content, such as a TV programme, a film, or some other media content. The STB 10 may be configured to receive an IPTV signal instead of, or in addition to, the other types of TV signal mentioned above.
The STB 10 comprises audio and video outputs 18 for connecting to external media presentation devices. The audio and video outputs may be in the form of digital outputs (e.g. High Definition Multimedia Interface (HDMI), Universal Serial Bus Type C (USB-C)) and/or analog outputs, such as: phono/RCA ports and headphone port(s) for audio output. The external media presentation device may be a display, such as a TV. The external media presentation device may be an audio amplifier and speakers.
The STB 10 may comprise a port 13 for connecting to a media storage device. The port 13 may be a port to receive a micro SD card, a Universal Serial Bus (USB) port to connect to an external disk drive or another video streaming input device. The STB can use the port 13 to stream content from one of the storage devices.
The STB 10 comprises a wireless transmitter 19 for transmitting to the head mountable imaging apparatus 30. The wireless transmitter 19 may be a BluetoothT" transmitter, or a transmitter which is configured to use another short range wireless protocol. The STB 10 uses the wireless transmitter 19 to transmit video data to the head mountable imaging apparatus 30.
The STB 10 may comprise a wireless transmitter (e.g. wireless transmitter 19 or a separate wireless transmitter) for transmitting audio data to wireless headphones or a wireless earpiece.
The STB 10 may also comprise a media store 21. The media store 21 may be used to store media content for later playback or to provide a pause live TV feature. The STB 10 may provide the functions of a conventional digital video recorder (DVR).
Wth reference to Fig. 1, the system can include a table top device/computer with a power connection; a smart glass with or without optical elements image processing functionality and wireless module; and a smart glass controller or remote control (add in picture). The proposed system can further include a Television with a wired connection or wireless module to receive TV signals from the set top box.
Figure 4 shows an example of head mountable imaging apparatus 30. The imaging apparatus 30 may be in the form of a head mountable pair of glasses, but it could be in the form of a headset. The imaging apparatus 30 shown in Figure 2 has a frame which is worn in a similar manner to a conventional pair of glasses. The head mountable imaging apparatus 30 comprises a camera 31 which is configured to provide a video signal 32 representing a scene in front of the imaging apparatus. The imaging apparatus 30 may have a single camera 31, or multiple cameras, such as one camera per eye. The imaging apparatus 30 may comprise a left eye display 38 and a right eye display 39. A processor 35 receives the video signal 31 and outputs a processed video signal to displays 38, 39. The processor 40 is configured to perform image processing to assist a user with reduced vision. Examples of image processing are shown in Figures 6A-6D. The imaging apparatus 30 may comprise a transparent screen or lenses which allow a user to view a combination of a displayed image and the surrounding environment through the screen/lenses, or may comprise an opaque screen which only allows the user to view the displayed image. The head mountable imaging apparatus 30 may be called "smart glasses".
The imaging apparatus 30 can be used in two possible modes. In a first mode, the imaging apparatus 30 provides image processing enhancements to assist the user with their view of the surrounding environment. The video signal 32 from the camera 31 is processed to assist the user and output to the displays 38, 39. In a second mode, the imaging apparatus 30 provides image processing enhancements to assist the user with media content received from the first device 10. The video signal 34 received from the first device 10 is processed and output to the displays 38, 39.
The head mountable imaging apparatus 30 may comprise one or more controls for allowing a user to control the image processing. For example, the controls may allow the user to control a parameter of the image processing, such as controlling the number of edges displayed or selecting a portion of the image for magnification. The one or more controls may be located on the portion 40 of the apparatus which is worn on the user's head, such as on arms of the glasses. One or more controls 43 may be located on a handset 42. The handset 42 may be connected to the head worn portion 40 by a cable 41 or by a wireless interface.
In some examples, the processor 35 of the imaging apparatus 30 is located within the portion 40 of the apparatus which is worn on the user's head. In other examples, the processor 35 may be located in a box which is physically separate to the portion 40 of the apparatus which is worn on the user's head. The handset 42 may house the processor 35.
A battery to power the apparatus 30 may also be provided within the handset 42.
The system enables visually impaired users to stream live television signals (or other media content) from the STB 10 to their glasses 30 and to use the processor 35 on the glasses 30 to enhance the live television signals. For example, the user may select an object or area of interest to magnify objects of interest in real-time. The processor 35 can apply image processing filters which are demonstrated to be beneficial to the visually impaired.
In an aspect, the TV signal can be streamed in real-time to multiple type of display systems including a smart glasses and a TV at the same time. In this aspect, the visually impaired individual can view images from a closer distance (e.g. with High Definition (HD) quality), instead of using the camera 31 on the glasses 30, while other viewers can view the same images on the TV screen 50.
In an aspect, the visually impaired individual can view objects from a closer distance in HD quality and apply image processing filters such as different levels of contrast while their families can view the same images on the TV screen but without needing the image processing filters.
One issue with the system shown in Figure 2 is that images displayed on the head mountable imaging apparatus 30 can lag audio which is delivered via TV 50 or speaker 51.
The lag can be due to the difference in the two processing paths: path 1 = STB 10 to head mountable apparatus 30 and includes a delay due to wireless transmission (delay at transmitter 19, delay in transmission, delay at receiver 33) and a delay due to processing at processor 35 before display to the user; path 2 = STB 10 to TV 50 or speaker 51.
The system may introduce a delay in the path of the audio signal (and video signal) output to port 20. This can help to synchronise images displayed on the head mountable imaging apparatus 30 with audio which is delivered via TV 50 or speaker 51. Other viewers of the TV 50 will view images and audio in sync and will be unaware of the delay introduced in the path to the TV 50. The value of the delay may be based on the length of time that it typically takes to transmit to the glasses 30. In this way, both parties can listen to the audio from the TV speakers, and look at the images in sync with their preferred display. There are various ways of implementing the delay. One possibility is for the processor 15 to separately read out: (i) audio data (and video data) destined for output port 20 and (ii) video data destined for the wireless transmitter 19. The processor 15 can be configured to read out the audio data (and video data) destined for output port 20 at a later time compared to reading out the video data destined for the wireless transmitter 19.
The value of the delay may be preconfigured, or may be user configurable. For example, the user may configure the delay by using a control on the head mountable imaging apparatus 30, such as a control on handset 42. Alternatively, the user may configure the delay by using a control on the STB 10 or a user interface of the STB 10.
The handset 42 may comprise one or more sensors which can detect movement of the handset. One or more accelerometers may be provided within the handset to measure movement along different axes, such as an x-axis accelerometer, a y-axis accelerometer and a z-axis accelerometer. Figure 5 shows two possible forms of movement detection for handset 42: movement about an axis of rotation (in this example the axis of rotation is the longitudinal axis of the handset 42); movement along an axis (in this example the axis is along. or parallel to, the longitudinal axis of the handset 42.) In an example, a value of the delay may be adjusted by rotating the handset, such as clockwise to increase the delay and anti-clockwise to reduce the delay. In an example, a value of the delay may be adjusted by moving the handset along the axis, such as forward to increase the delay and backward to reduce the delay.
The STB 10 is configured to selectively operate in: a first mode in which the wireless transmitter 19 is configured to send a video signal to the head mountable imaging apparatus 30 and the processor 15 is configured to introduce a delay between the output audio signal output to the media presentation device 50 and the video signal sent to the head mountable imaging apparatus 30; and a second mode in which the wireless transmitter 19 is not configured to send a video signal to the head mountable imaging apparatus 30 and the processor 15 is not configured to introduce a delay between the output audio signal output to the media presentation device 50 and the video signal sent to the head mountable imaging apparatus 30.
The processor 15 comprises mode selector functionality 16 to allow selection of the first mode and the second mode. The mode may be selected via a control or user interface of the STB 10. The mode may be selected by data sent from the head mountable imaging apparatus 30.
Figures 6A-6D show some examples of image processing to assist a user with reduced vision. Figure 6A shows an example of varying brightness of the image. This can be applied to a colour or grayscale image. Figure 6B shows an example of edge detection and presentation of the detected edges as white edges on a black background. Figure 6C shows an example of edge detection and presentation of the detected edges as white edges overlaid upon a colour or a grayscale image. Figure 6D shows an example of enhanced contrast between features of the image. This may present a black and white high-contrast image with a global threshold that applies to the entire screen, or a black and white high contrast image with multiple regional thresholds to compensate for lighting changes across a screen.
Other possible image processing enhancements may include an algorithm to detect large regions of similar hues (e.g. regardless of brightness) and then presenting these regions as high brightness swatches of the same colour. Other enhancements or image processing may be performed by the processor 35. Other processing functions include one or more of: magnification or minification; display of a high resolution static image; presentation of a picture-within-picture; text identification and recognition. The type of enhancement(s) or image processing performed by the processor 35 may depend on the vision defects of the user.
Figure 7 shows an example of a device 110 which can be used instead of the STB 10. Device 110 is intended to be an accessory (e.g. a dongle or a small device) which can directly plug in to an input port of a host device (e.g. an HDMI port), or connect to an input port of the host device via a cable and connector. The host device 150 may be a display or TV 50, a computer (e.g. laptop or tablet) or some other media presentation device. The device 110 has a wireless receiver 111 to receive a stream of media content from a server. The wireless receiver may use WiFi, and may stream content via a wireless local area network (WLAN) from a local or remote server, such as an internet server. Device 110 comprises at least one audio/video output 120 for connecting to the host device 150.
external media presentation devices. The audio/video output 118 may be an HDMI port, a USB-C port, or any suitable port. The device 110 may be powered by a power supply connection 121 (e.g. USB) to the host device 150, or via a separate power supply.
The device 110 comprises a wireless transmitter 119 for transmitting to the head mountable imaging apparatus 30. The wireless transmitter 119 may be a BluetoothTM transmitter, or a transmitter which is configured to use another short range wireless protocol. The device 110 uses the wireless transmitter 119 to transmit video data to the head mountable imaging apparatus 30.
The device 110 of Figure 7 may have an input port 125 in addition to the wireless receiver 111. Alternatively, the device 110 of Figure 7 may have an input port 125 and no wireless receiver 111. The input port 125 may be an HDMI port, a USB-C port, or any other suitable type of port to receive media content. A user may connect a source of media content to the input port 125 via a suitable lead. The source of media content may be a smartphone, tablet, computer or any other device which can output media content to the device 110.
Device 110 may have similar functionality as described above for the STB 10. It can introduce a delay in the path of the audio signal (and video signal) output to port 120. This can help to synchronise images displayed on the head mountable imaging apparatus 30 with audio which is delivered via host device 150. Options for selecting the delay are the same as described above.
Optionally, the STB 10 or device 110 may process an input video signal to provide at least one type of image enhancement 23, 123 for assisting a user with reduced vision. The image enhancement 23, 123 performed by the processor at the STB or device 110 can be used in conjunction with, or instead of, any image enhancement performed by the head mountable imaging apparatus 30. This can help reduce power requirements at the head mountable imaging apparatus 30 and prolong battery life.
In Figures 3, 4, 6 and 7 the processors 15, 35, 115 may be implemented as one or more processors which may be microprocessors, controllers or any other suitable type of processors for executing instructions to control the operation of the device. Processor-executable instructions may be provided using any computer-readable media, such as memory 22, 41, 122. The processor-executable instructions can comprise instructions for implementing the functionality of the described methods. The memory is of any suitable type such as read-only memory (ROM), random access memory (RAM), a storage device of any type such as a magnetic or optical storage device.
Throughout the description and claims of this specification, the words "comprise" and "contain" and variations of the words, for example "comprising" and "comprises", means "including but not limited to", and is not intended to (and does not) exclude other moieties, additives, components, integers or steps.
Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.
Features, integers, characteristics, compounds, chemical moieties or groups described in conjunction with a particular aspect, embodiment or example of the invention are to be understood to be applicable to any other aspect, embodiment or example described herein unless incompatible therewith.

Claims (17)

  1. CLAIMS1. A system for assisting a user with reduced vision comprising: a head mountable imaging apparatus and a first device which is separate to the head mountable imaging apparatus, the first device comprising: a first input configured to receive media content comprising audio and video; a first output configured to output at least one of an output audio signal and an output video signal to a media presentation device; a wireless transmitter configured to send a video signal to the head mountable imaging apparatus; and the head mountable imaging apparatus comprising: a display device configured to provide a display to an eye of the user; a wireless receiver configured to receive the video signal from the first device; a processor configured to process an input video signal to provide at least one type of image enhancement for assisting a user with reduced vision.
  2. 2. A system according to claim 1 wherein the head mountable imaging apparatus 20 comprises: a camera configured to provide a video signal representing a scene in front of the imaging apparatus; and wherein the head mountable imaging apparatus is configured to selectively operate in a first mode in which the video signal from the camera is processed and output to the display device and in a second mode in which the video signal received from the first device is processed and output to the display device.
  3. 3. A system according to claim 1 or 2 wherein the first device comprises a processor configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
  4. A system according to claim 3 wherein a value of the delay is preconfigured.
  5. 5. A system according to any one of the preceding claims wherein a value of the delay is user configurable.
  6. 6. A system according to any one of claims 3 to 5 wherein the first device is configured to selectively operate in: a first mode in which the wireless transmitter is configured to send a video signal to the head mountable imaging apparatus and the processor is configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus; and a second mode in which the wireless transmitter is not configured to send a video signal to the head mountable imaging apparatus and the processor is not configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
  7. 7. A system according to any one of the preceding claims wherein the image enhancement comprises at least one of: edge detection and presentation of detected edges; contrast enhancement; magnification of a selected area of an overall image; text identification and recognition.
  8. 8. A system according to any one of the preceding claims wherein the first device is a set top box, the first input is configured to receive at least one of: a terrestrial TV signal, a satellite TV signal and a cable TV signal and the first device comprises a tuner.
  9. 9. A system according to any one of the preceding claims wherein the set top box comprises media storage and the first device is capable of recording and playback of media 25 content.
  10. 10. A system according to any one of claims 1 to 7 wherein the first device is configured to receive an I PTV signal.
  11. 11. A system according to any one of claims 1 to 7 wherein the first device is configured to connect to a host device.
  12. 12. A system according to claim 11 wherein the first input comprises a wireless interface configured to receive the media content as a data stream from a server.
  13. 13. A system according to claim 11 or 12 wherein the first device is configured to connect to an HDMI port of the host device.
  14. 14. Apparatus for assisting a user with reduced vision comprising: a first device which is separate to a head mountable imaging apparatus, the first device comprising: a first input configured to receive media content comprising audio and video; a first output configured to output at least one of an output audio signal and an output video signal to a media presentation device; a wireless transmitter configured to send a video signal to the head mountable imaging apparatus; and a processor configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
  15. 15. A system according to claim 14 wherein a value of the delay is preconfigured.
  16. 16. A system according to claim 14 or 15 wherein a value of the delay is user configurable.
  17. 17. A system according to any one of claims 14 to 16 wherein the first device is configured to selectively operate in: a first mode in which the wireless transmitter is configured to send a video signal to the head mountable imaging apparatus and the processor is configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus; and a second mode in which the wireless transmitter is not configured to send a video signal to the head mountable imaging apparatus and the processor is not configured to introduce a delay between the output audio signal output to the media presentation device and the video signal sent to the head mountable imaging apparatus.
GB2002406.3A 2019-02-27 2020-02-20 Head mountable imaging apparatus and system for assisting a user with reduced vision Active GB2583822B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010118736.4A CN111629238A (en) 2019-02-27 2020-02-26 Head-mountable imaging device and system for assisting users with reduced vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GBGB1902664.0A GB201902664D0 (en) 2019-02-27 2019-02-27 Head mountable imaging apparatus and system for assisting a user with reduced vision

Publications (3)

Publication Number Publication Date
GB202002406D0 GB202002406D0 (en) 2020-04-08
GB2583822A true GB2583822A (en) 2020-11-11
GB2583822B GB2583822B (en) 2022-05-25

Family

ID=65999027

Family Applications (2)

Application Number Title Priority Date Filing Date
GBGB1902664.0A Ceased GB201902664D0 (en) 2019-02-27 2019-02-27 Head mountable imaging apparatus and system for assisting a user with reduced vision
GB2002406.3A Active GB2583822B (en) 2019-02-27 2020-02-20 Head mountable imaging apparatus and system for assisting a user with reduced vision

Family Applications Before (1)

Application Number Title Priority Date Filing Date
GBGB1902664.0A Ceased GB201902664D0 (en) 2019-02-27 2019-02-27 Head mountable imaging apparatus and system for assisting a user with reduced vision

Country Status (2)

Country Link
CN (1) CN111629238A (en)
GB (2) GB201902664D0 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017059522A1 (en) * 2015-10-05 2017-04-13 Esight Corp. Methods for near-to-eye displays exploiting optical focus and depth information extraction
US20170246070A1 (en) * 2016-02-29 2017-08-31 Osterhout Group, Inc. Radar imagery in head-worn computing
US20180125716A1 (en) * 2016-11-10 2018-05-10 Samsung Electronics Co., Ltd. Visual aid display device and method of operating the same

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8291322B2 (en) * 2009-09-30 2012-10-16 United Video Properties, Inc. Systems and methods for navigating a three-dimensional media guidance application
US9888232B2 (en) * 2011-01-17 2018-02-06 Sony Corporation 3D motion picture processing device
US8836771B2 (en) * 2011-04-26 2014-09-16 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
GB2507106A (en) * 2012-10-19 2014-04-23 Sony Europe Ltd Directional sound apparatus for providing personalised audio data to different users
US20160098180A1 (en) * 2014-10-01 2016-04-07 Sony Corporation Presentation of enlarged content on companion display device
US9338391B1 (en) * 2014-11-06 2016-05-10 Echostar Technologies L.L.C. Apparatus, systems and methods for synchronization of multiple headsets

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017059522A1 (en) * 2015-10-05 2017-04-13 Esight Corp. Methods for near-to-eye displays exploiting optical focus and depth information extraction
US20170246070A1 (en) * 2016-02-29 2017-08-31 Osterhout Group, Inc. Radar imagery in head-worn computing
US20180125716A1 (en) * 2016-11-10 2018-05-10 Samsung Electronics Co., Ltd. Visual aid display device and method of operating the same

Also Published As

Publication number Publication date
GB201902664D0 (en) 2019-04-10
GB202002406D0 (en) 2020-04-08
GB2583822B (en) 2022-05-25
CN111629238A (en) 2020-09-04

Similar Documents

Publication Publication Date Title
US20220279237A1 (en) Streaming and Rendering of Multidimensional Video Using a Plurality of Data Streams
EP2384009B1 (en) Display device and method of outputting audio signal
US9317957B2 (en) Enhancement of stereoscopic effect of an image through use of modified depth information
US8810563B2 (en) Transmitting apparatus, stereoscopic image data transmitting method, receiving apparatus, and stereoscopic image data receiving method
EP2840800A1 (en) Content-based audio/video adjustment
EP3306940B1 (en) Device and method for processing video content for display control
JP4937369B2 (en) Electronic device, video output system, and video output method
JP4693918B2 (en) Image quality adjusting apparatus and image quality adjusting method
US20120050509A1 (en) Stereoscopic glasses, stereoscopic video display device, and stereoscopic video display system
US20110234831A1 (en) Communication device
JP5221745B2 (en) Image processing apparatus, control program, and image processing apparatus control method
JP2019083504A (en) Hardware system for inputting stereoscopic image in flat panel
US8537207B2 (en) Video-audio playing system relating to 2-view application and method thereof
JP5066244B2 (en) Video playback apparatus and video playback method
GB2583822A (en) Head mountable imaging apparatus and system for assisting a user with reduced vision
US20120281073A1 (en) Customization of 3DTV User Interface Position
US9106885B2 (en) Recording/reproduction device, recording/reproduction method, television receiver, program, and recording medium
WO2011013670A1 (en) Video displaying device, program, and storage medium
US20120249754A1 (en) Electronic apparatus, display control method for video data, and program
US20130047186A1 (en) Method to Enable Proper Representation of Scaled 3D Video
US20150189257A1 (en) Electronic device and method for controlling the same
CN114667737B (en) Multiple output control based on user input
GB2480999A (en) 3D display with automatic switching between 2D and 3D display modes
RU178954U1 (en) MULTI-THREAD VISUALIZATION OF MULTIMEDIA DATA DEVICE
JP2012175339A (en) Three-dimensional video signal processing apparatus and processing method

Legal Events

Date Code Title Description
732E Amendments to the register in respect of changes of name or changes affecting rights (sect. 32/1977)

Free format text: REGISTERED BETWEEN 20240509 AND 20240515