EP4027185A1 - Kopfmontiertes anzeigesystem - Google Patents

Kopfmontiertes anzeigesystem Download PDF

Info

Publication number
EP4027185A1
EP4027185A1 EP21150964.1A EP21150964A EP4027185A1 EP 4027185 A1 EP4027185 A1 EP 4027185A1 EP 21150964 A EP21150964 A EP 21150964A EP 4027185 A1 EP4027185 A1 EP 4027185A1
Authority
EP
European Patent Office
Prior art keywords
head
mounted display
display system
control device
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21150964.1A
Other languages
English (en)
French (fr)
Inventor
Mark CAPELLI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BHS Technologies GmbH
Original Assignee
BHS Technologies GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BHS Technologies GmbH filed Critical BHS Technologies GmbH
Priority to EP21150964.1A priority Critical patent/EP4027185A1/de
Priority to CN202111363154.3A priority patent/CN114755826A/zh
Priority to US17/571,568 priority patent/US20220221727A1/en
Publication of EP4027185A1 publication Critical patent/EP4027185A1/de
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G02B2027/0154—Head-up displays characterised by mechanical features with movable elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G02B2027/0161—Head-up displays characterised by mechanical features characterised by the relative positioning of the constitutive elements
    • G02B2027/0163—Electric or electronic control thereof

Definitions

  • the present invention relates to a head-mounted display system.
  • Head-mounted display systems are used for different applications like displaying images of a medical imaging device to medical personal during a medical procedure.
  • an operator wearing a head-mounted display system may have to change views, for example, between microscopic images displayed by the head-mounted display and the real environment for macroscopic procedures.
  • Simply taking off the head-mounted display system for a view on the real scene is disadvantageous in the medical field with respect to a required sterile environment. Therefore, known head-mounted display systems are equipped with semi-transparent displays to display images in parallel to providing a view on the real environment. Due to the semitransparent display, the view on the real environment is shaded, which results in less visibility of details and respective risks.
  • head-mounted display systems have been proposed that provide a display configured to be manually pivotable out of an operator's viewing field.
  • the weight of such display requires a comparably rigid support structure capable of securely holding the display in each pivoted position.
  • the weight of the display may cause inconveniences for an operator in at least some of the pivot positions.
  • the head-mounted display system comprises at least one head-mounted display comprising at least one display portion, a carrier member to be worn by an operator to movably support the at least one head-mounted display, and at least one control device configured to control the at least one head-mounted display, wherein the at least one control device is spatially separated from the head-mounted display.
  • the control device may be attached to the carrier member or may be otherwise attached to the head-mounted display system.
  • the control device may also be configured to be connected to the head-mounted display system by a wired or wireless connection instead of being attached to the head-mounted display system as such.
  • the at least one head-mounted display is pivotably supported by the carrier member, and the at least one control device is connected to the at least one head-mounted display by at least one flexible conductive element.
  • control device is attached to the carrier member, wherein the flexible conductive element transmits control signals from the control device to the head-mounted display. Due to the flexibility of the flexible conductive element, the head-mounted display can be pivoted with respect to the carrier member without affecting the connection to the control device.
  • control device may be configured to transmit control signals wirelessly, as already indicated above.
  • the at least one flexible conductive element is a coaxial cable, preferably a micro coaxial cable.
  • a coaxial cable is mechanically robust with respect to the pivoting of the head-mounted display.
  • rigid-flex circuit boards or a flat ribbon cable may be used to connect with the head-mounted display.
  • a coaxial cable also provides more flexibility when the head-mounted display is configured to provide a lateral movement with respect to the carrier member in addition or alternatively to a pivot movement.
  • a lateral movement may be implemented to move the head-mounted display out of an operator's view alternatively or in addition to a respective pivot movement and/or to adapt the head-mounted display to an individual interocular distance of an operator and/or for an individual diopter compensation.
  • the inner core of the coaxial cable provides data transfer line surrounded by a first isolating layer, followed by a shielding layer and a subsequent second isolating layer.
  • a rigid-flex circuit board or a flat ribbon cable as alternatives to the coaxial cable preferably provide a data line sandwiched between two isolating layers, each of which followed by a shielding layer and a subsequent further isolating layer.
  • the head-mounted display system comprises at least two head-mounted displays each of which comprises at least one display portion, and wherein the at least one control device is configured to control both of the at least two head-mounted displays based on a control input.
  • the head-mounted display system comprises more than one head-mounted display
  • the head-mounted displays can be controlled by one control device.
  • each of the head-mounted displays is connected to the control device by at least one flexible conductive element, and wherein the at least one control device is configured to control both of the at least two head-mounted displays by a respective one of the flexible conductive elements.
  • control device is configured to control the head-mounted displays based on a single control input.
  • the single control input is not restricted to a single control command and may also comprise a set of control commands.
  • the head-mounted displays are connected in series and the control command or control commands are transmitted from the control device to the first of the head-mounted displays and from the first of the head-mounted displays to the subsequent one and so on.
  • control device is configured to control each of the at least two head-mounted displays independently.
  • control device may comprise a processor unit to process a received control input and to assign a control command or control commands to one and/or the other of the head-mounted display systems. Such assignment may depend on a preset configuration, e.g. to display images to both of the head-mounted displays while displaying text information only to one of the head-mounted displays.
  • the control may also be configured to process images to be displayed, e.g. to provide 3D images by providing respectively processed images to a head-mounted display associated with a right eye of an operator and a head-mounted display associated with a right eye of a user.
  • the head-mounted display system comprises at least two head-mounted displays each of which comprises at least one display portion, and two control devices each of which is connected to one of the at least two head-mounted displays by a respective one of the flexible conductive elements.
  • the at least two head-mounted displays are not controlled by a common control device but each head-mounted display provides its own control device assigned thereto by the respective connection.
  • the respective control devices may be less complex, e.g. may not require a processor unit capable of processing a control input with respect to an individual assignment of control commands.
  • more than one control device may be implemented for redundancy reasons since the risk of a simultaneous failure of all control devices is minor. Accordingly, the risk of a total display loss is reduced.
  • control device comprises a SPS-connector.
  • control device is configured to receive further signals and/or processed data without requiring a respective capability to provide such signals and/or process data by the control device itself.
  • respective signals and/or data may be provided by a IMU (inertial measurement unit) configured to detect a position and/or orientation of the head-mounted display system to adapt images to be displayed in accordance with such position and/or orientation of the head-mounted display system.
  • a CAN bus may be connected to the SPS-connector to provide signals and/or data of other external devices.
  • the head-mounted display system comprises a motor for pivoting the at least one head-mounted display with respect to the carrier member, and wherein the motor is preferably arranged offset from the pivot axis of the at least one head-mounted display.
  • a manual pivoting of the head-mounted display can be avoided by the motor.
  • a respective movement of the head-mounted display may be controlled by tracked gestures, tracked head and/or eye movements, a footswitch and/or other control mechanisms allowing a sterile operation.
  • the respective control mechanisms may not require a movement of an operator's hand associated with a current procedure of the operator.
  • the arrangement of the motor offset from the pivot axis of the head-mounted display may improve the weight distribution. Further, the center of gravity may be displaced from a leading position to a more rearward position of the head-mounted display. Accordingly, a tendency of the head-mounted display to fall down or to provide a pulling force when an operator's head is leant forward may be reduced.
  • control device may provide a flexible connection to the head-mounted display, the offset of the motor does not interfere with such connection.
  • the control device since the control device may be held stationary with only the head-mounted display being pivoted, the motor may be offset from the pivot axis without further adaptions.
  • the head-mounted display system is configured to display images of a medical imaging device.
  • the inventive head-mounted display system provides specific advantages with respect to a sterile handling and free-hands requirements in view of medical procedures.
  • the medical imaging device is a microscope.
  • the use of the head-mounted system according to the invention for displaying images of a medical microscope, preferably a robotic medical microscope, allows an operator like a surgeon to change the view from microscopic to macroscopic and vice versa in a sterile manner and with a head-mounted display system with improved ergonomics with respect to weight and weight distribution.
  • the medical imaging device is an endoscope.
  • Fig. 1 shows a schematic perspective view of a head-mounted display system 1 with a control device 30 according to a first exemplary embodiment.
  • the head-mounted display system 1 further comprises a carrier member 20 and two head-mounted displays 10a and 10b each of which comprising a display portion 11 a and 11b, respectively.
  • the head-mounted displays are pivotably supported by the carrier member 20.
  • the control device 30 is configured to provide images of a medical imaging device (not shown), like a microscope or endoscope, to the head-mounted displays 10a, 10b and the display portions 11a, 11b, respectively. Further, the control device 30 is configured to control the displayed images, for example, by adjusting a contrast, brightness and/or magnification. Alternatively or in addition, the control device 30 may be configured to also provide other information, like text information or optical alert signal, to at least one of the head-mounted display systems 10a, 10b and/or to control further functions independent of displaying images and/or other information. The control device 30 may be also configured to receive signals from the head-mounted displays 10a, 10b.
  • a medical imaging device not shown
  • the control device 30 is configured to control the displayed images, for example, by adjusting a contrast, brightness and/or magnification.
  • the control device 30 may be configured to also provide other information, like text information or optical alert signal, to at least one of the head-mounted display systems 10a, 10b and/or to control further functions
  • each of the head-mounted displays 10a, 10b is connected to the control device 30 by a flexible conductive element, here, a coaxial cable 31.
  • the respective ends of the respective coaxial cable 31 to be connected with one of the head-mounted displays 10a, 10b are directly connected to the respective display portions 11a, 11b.
  • the ends of the respective coaxial cables 31 may also be connected to a processor of the respective head-mounted displays 10a, 10b to further process image signals or the provide signals to another component different from the display portion 11a, 11b.
  • control device 30 is configured as mono-processing unit. i.e. both head-mounted displays 10a and 10b receive the same signals according to a control input to the control device 30.
  • Fig. 2 shows a schematic perspective view of a head-mounted display system 1' with a control device 30' according to a second exemplary embodiment.
  • the second embodiment differs from the first embodiment in that the control device 30' is configured as stereo-processing unit, i.e. the head-mounted displays 10a and 10b can be controlled independently. Accordingly, the control device 30' comprises two distinct processing units 30'a, 30'b ( Fig. 4 ). In an alternative embodiment, a common processor is portioned accordingly two provide such functionality. According to the second embodiment, the two processing units 30'a, 30'b are configured to process a control input differently with respect to the assignment of control signals to the respective head-mounted display 10a, 10b connected thereto.
  • the independent control of the head-mounted displays 10a, 10b may depend, for example, on a type of a control input, predetermined settings and/or defined trigger events.
  • each of the processing units 30'a, 30'b of the control device 30' provides the same image signals to each of the head-mounted displays 10a, 10b and display portions 11a, 11b, respectively.
  • the stereo-processing unit may receive separate control inputs for each of the head-mounted displays 10a, 10b. In other words, the stereo-processing unit provides two separate signal channels.
  • Fig. 3 shows a schematic front view on the head-mounted display system 1' according to the second embodiment.
  • the following description may be also applicable analogously to the first embodiment.
  • the head-mounted displays 10a, 10b are pivotably supported by the carrier member 20.
  • the head-mounted displays 10a. 10b can be pivoted independently from each other.
  • the head-mounted display system 1' may be configured to pivot the head-mounted displays 10a, 10b simultaneously.
  • the control device 30' is arranged stationary in the carrier member 20, when the head-mounted displays 10a, 10b are or at least one of the head-mounted displays 10a, 10b is pivoted around the axis O. Accordingly, there is a relative movement between the control device 30 and the respective head-mounted display 10a, 10b. However, due to the coaxial cable 31, the relative movement is neither impeded in principle nor the connection is prone to broke.
  • the pivoting of the head-mounted displays 10a, 10b is implemented by a motor 40.
  • An independent movement of the head-mounted displays 10a, 10b is implements by a respectively switchable transmission system (not shown).
  • each of the head-mounted displays 10a, 10b may be driven by separate motors.
  • the motor 40 is arranged offset from the pivot axis O. Accordingly, the weight of the motor 40 is displaced to a position providing a better balance of the head-mounted display system and therefore an improved comfort for an operator wearing the head-mounted display system may be achieved.
  • Fig. 4 shows a schematic view of the control device 30' according to the second embodiment and flexible conductive elements. More precisely, two coaxial cables 31 are each connected to the control device 30' via connection interfaces 30'c, 30'd.
  • the connection interface 30'c is associated with the processing unit 30'a to provide control signals to the head-mounted display 10a and the connection interface 30'd is associated with the processing unit 30'b to provide control signals to the head-mounted display 10b.
  • the control device 30' comprises a SPS-connector 32 to allow the reception of further signals and commands without providing respective components for such signal generation on the control device 30'.
  • Fig. 5 illustrates a partial cross-sectional perspective view of a coaxial cable 31 as exemplary embodiment of a flexible conductive element and as shown Figs. 1 to 5 .
  • a data transfer line 31a accomplishes the data transfer.
  • the data transfer line 31a is surrounded by a first isolating layer 31b followed by a shielding layer 31c and a subsequent second isolation layer 31d.
  • Fig. 6 shows a cross-sectional view of a rigid-flex circuit board 31' shielded on both sides as further exemplary embodiment of a flexible conductive element.
  • the rigid-flex circuit board 31' provides a similar configuration as the coaxial cable 31 but the data transfer line 31'a is not surrounded by respective layers but sandwiched by such layers. Specifically, the data transfer line 31'a is sandwiched between two first isolating layers 31'b followed by respective shielding layers 31'c and subsequent second isolating layers 31 'd.
  • the layer configuration is covered by a cover layer 31'e, for example, made of polyimide.
  • Fig. 7 shows a cross-sectional view of a rigid-flex circuit board 32" shielded on one side as further exemplary embodiment of a flexible conductive element.
  • the rigid-flex circuit board 32" provides a first isolating layer adjacent to the data transfer line 31'a followed by a shielding layer 31'c, a subsequent second isolating layer 31'd and a cover layer 31'e.
  • a first isolating layer 31'b is disposed adjacent to the data transfer lien 31'a followed by a cover layer 31'e.
  • the given examples are specific embodiments and not intended to restrict the scope of protection given in the claims.
  • single features of one embodiment may be combined with another embodiment.
  • different components of the head-mounted display systems as described may be substituted by other components.
  • the rigid-flex circuit board may be substituted by a flat ribbon cable.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
EP21150964.1A 2021-01-11 2021-01-11 Kopfmontiertes anzeigesystem Pending EP4027185A1 (de)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21150964.1A EP4027185A1 (de) 2021-01-11 2021-01-11 Kopfmontiertes anzeigesystem
CN202111363154.3A CN114755826A (zh) 2021-01-11 2021-11-17 头戴式显示***
US17/571,568 US20220221727A1 (en) 2021-01-11 2022-01-10 Head-mounted display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP21150964.1A EP4027185A1 (de) 2021-01-11 2021-01-11 Kopfmontiertes anzeigesystem

Publications (1)

Publication Number Publication Date
EP4027185A1 true EP4027185A1 (de) 2022-07-13

Family

ID=74130128

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21150964.1A Pending EP4027185A1 (de) 2021-01-11 2021-01-11 Kopfmontiertes anzeigesystem

Country Status (3)

Country Link
US (1) US20220221727A1 (de)
EP (1) EP4027185A1 (de)
CN (1) CN114755826A (de)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170322410A1 (en) * 2016-05-05 2017-11-09 Robert D. Watson Surgical stereoscopic visualization system with movable head mounted display

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102009010448B4 (de) * 2009-02-26 2015-10-29 Carl Zeiss Meditec Ag Kameraadapter für ein medizinisch optisches Beobachtungsgerät und Kamera-Adapter-Kombination
KR101636665B1 (ko) * 2013-05-27 2016-07-05 미쓰비시덴키 가부시키가이샤 프로그래머블 표시기 및 그 화면 조작 처리 프로그램
US9629229B2 (en) * 2014-07-21 2017-04-18 J. Kinderman & Sons, Inc. Connectable and synchronizable light strings
CN107003523B (zh) * 2014-10-24 2019-05-14 埃马金公司 基于微显示器的沉浸式头戴视图器
JP6550885B2 (ja) * 2015-04-21 2019-07-31 セイコーエプソン株式会社 表示装置、表示装置の制御方法、及び、プログラム
WO2017061677A1 (en) * 2015-10-08 2017-04-13 Lg Electronics Inc. Head mount display device
US10283883B2 (en) * 2017-01-27 2019-05-07 Microsoft Technology Licensing, Llc Space-saving micro-coax cable harness
JP6869853B2 (ja) * 2017-08-30 2021-05-12 株式会社日立エルジーデータストレージ 画像表示装置
US20190254753A1 (en) * 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
US20200225492A1 (en) * 2019-01-11 2020-07-16 Microsoft Technology Licensing, Llc Split computing architecture for managing near-eye-display device center of gravity

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170322410A1 (en) * 2016-05-05 2017-11-09 Robert D. Watson Surgical stereoscopic visualization system with movable head mounted display

Also Published As

Publication number Publication date
CN114755826A (zh) 2022-07-15
US20220221727A1 (en) 2022-07-14

Similar Documents

Publication Publication Date Title
JP6264087B2 (ja) 表示制御装置、表示装置および表示制御システム
JP5704833B2 (ja) 操作入力装置およびマニピュレータシステム
US10269132B2 (en) Displaying images according to head posture and camera posture
EP3912588B1 (de) Abbildungssystem für einen chirurgischen roboter und chirurgischer roboter
US8451229B2 (en) Monocular video display device
JP5938977B2 (ja) ヘッドマウントディスプレイ及び手術システム
WO2016042705A1 (en) Display control device, display control method, display control system, and head-mounted display
US10134185B2 (en) Endoscopic surgery assisting system using head-mounted displays and associated methodology
CN102186434B (zh) 手术机器人的3d显示***及其控制方法
WO2016158000A1 (ja) 情報処理装置、情報処理方法及び情報処理システム
US20060072206A1 (en) Image display apparatus and image display system
CN103607971A (zh) 医疗主从操作器
WO2014163109A1 (ja) ３ｄ映像を表示する内視鏡システム
JPH11202256A (ja) 頭部搭載型画像表示装置
JP2019508925A (ja) 回転するディスプレイを有するヘッドマウントディスプレイ
EP4027185A1 (de) Kopfmontiertes anzeigesystem
JPWO2007119351A1 (ja) ヘッドマウントディスプレイ
US10330945B2 (en) Medical image display apparatus, medical information processing system, and medical image display control method
CN115244448A (zh) 头戴式显示***
KR101603551B1 (ko) 차량에서 웨어러블 기기를 이용한 기능 실행 방법 및 이를 수행하는 차량
JP2018061850A (ja) 内視鏡システム、表示制御システムおよび表示制御装置
EP3677213A1 (de) Medizinische kontrollvorrichtung und medizinisches beobachtungssystem
EP4086687A1 (de) Optischer träger für ein zumindest teilweise digitales mikroskop, anschliessbares betrachtungsmodul zum betrachten eines bildes eines objekts, chirurgiemikroskop und system
JP2023007087A (ja) 装着型表示装置
JP2018063336A (ja) 頭部装着型映像表示装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20221130

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR