CN113260427A

CN113260427A - Drop detection system and method

Info

Publication number: CN113260427A
Application number: CN202080008665.0A
Authority: CN
Inventors: P·J·格尔根; T·M·特鲁吉罗; M·E·格拉厄姆
Original assignee: Universal City Studios LLC
Current assignee: Universal City Studios LLC
Priority date: 2019-01-11
Filing date: 2020-01-10
Publication date: 2021-08-13
Also published as: ES2966264T3; US20200225715A1; US20200226838A1; US11200656B2; WO2020146783A1; EP3908381A1; EP3908380A1; WO2020146780A1; SG11202106745SA; JP2022517945A; KR20210113641A; CN113226498A; SG11202106742XA; WO2020146785A1; CA3124892A1; JP2022517775A; US11200655B2; US11210772B2; EP3908382A1; EP3908382B1

Abstract

A detection system (50) is configured to detect improper manipulation of a wearable visualization device (12). The detection system (50) includes a sensor (40) coupled to the wearable visualization device (12), a light emitter (42) coupled to the wearable visualization device (12), and a processor (54) configured to receive a signal from the sensor (40). The processor (54) is further configured to determine whether the signal indicates incorrect manipulation of the wearable visualization device (12), and direct illumination of the light emitter (42) in response to determining that the signal indicates incorrect manipulation of the wearable visualization device (12).

Description

Drop detection system and method

Cross reference to related applications

This application claims priority and benefit from united states provisional application No. 62/791,735 entitled "AUGMENTED REALITY (AR) head set FOR HIGH THROUGHPUT landscapes" filed on 2019, month 1, and day 11, which is hereby incorporated by reference in its entirety FOR all purposes.

Background

This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present technology that are described and/or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

Amusement and/or theme parks are designed to provide entertainment to patrons. The area of the amusement park may have different themes specifically targeting certain audiences. For example, some areas may include topics that are traditionally of interest to children, while other areas may include topics that are traditionally of interest to more mature viewers. In general, such areas with themes may be referred to as landscapes or themed landscapes. It is recognized that it may be desirable to increase the immersive experience of guests in such a landscape, such as by augmenting the theme with virtual features.

Disclosure of Invention

The following sets forth a summary of certain embodiments disclosed herein. It should be understood that these aspects are presented merely to provide the reader with a brief summary of these certain embodiments and that these aspects are not intended to limit the scope of this disclosure. Indeed, this disclosure may encompass a variety of aspects that may not be set forth below.

In one embodiment, the detection system is configured to detect incorrect manipulation of the wearable visualization device. The detection system includes a sensor coupled to the wearable visualization device, a light emitter coupled to the wearable visualization device, and a processor configured to receive a signal from the sensor. The processor is further configured to determine whether the signal indicates improper manipulation of the wearable visualization device, and direct illumination of the light emitter in response to determining that the signal indicates improper manipulation of the wearable visualization device.

In one embodiment, a wearable visualization device includes a housing, a sensor supported by the housing and configured to detect motion of the wearable visualization device, a light emitter supported by the housing, and a processor configured to receive a signal from the sensor, determine whether the signal indicates that the wearable visualization device has been dropped or thrown based on the detected motion of the wearable visualization device, and direct illumination of the light emitter in response to determining that the signal indicates that the wearable visualization device has been dropped.

In one embodiment, a method of detecting improper manipulation of a wearable visualization device using a detection system includes receiving, at a processor, a signal from a sensor coupled to the wearable visualization device. The method also includes determining, using the processor, that the signal indicates improper manipulation of the wearable visualization device. The method also includes counting, using the processor, a number of incorrectly manipulated events of the wearable visualization device over time. The method also includes directing, using the processor, illumination of the light emitter in response to determining that the number of events exceeds the count threshold.

Various modifications may be made to the above-described features with respect to various aspects of the present disclosure. Additional features may also be incorporated in these various aspects as well. These refinements and additional features may exist individually or in any combination.

Drawings

These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:

fig. 1 is a perspective view of a wearable visualization device and interface device of an Augmented Reality (AR), Virtual Reality (VR) and/or mixed reality (combination of AR and VR) system (AR/VR system) in a jointed configuration according to an embodiment;

fig. 2 is a perspective view of the wearable visualization device and the interface device of fig. 1 in a disassembled configuration according to the present embodiment;

fig. 3 is a schematic illustration of components of a detection system for the wearable visualization device of fig. 1 according to the present embodiment;

FIG. 4 is a perspective view of a portion of a ride feature in which the AR/VR system of FIG. 1 may be utilized in accordance with the present embodiments;

FIG. 5 is a method of using the AR/VR system of FIG. 1 in accordance with the present embodiments; and

fig. 6 is a schematic illustration of a question that may be presented via the wearable visualization device of fig. 1 according to the present embodiment, wherein the wearable visualization device enables a user to respond to the question with gesture inputs.

Detailed Description

One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.

When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. In addition, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

An amusement park may include Augmented Reality (AR), Virtual Reality (VR), and/or mixed reality (a combination of AR and VR) systems (e.g., AR/VR systems) configured to augment a guest experience of an amusement park landscape by providing the guest with an AR/VR experience (e.g., an AR experience, a VR experience, or both). Indeed, a combination of certain hardware configurations, software configurations (e.g., algorithmic structure and/or modeled responses), and certain landscape features may be utilized to provide a guest with an AR/VR experience that may be customizable, personalized, and/or interactive. For example, the AR/VR system may include a wearable visualization device, such as a head mounted display (e.g., electronic mirror or display, eyepiece), that may be worn by the guest and may be configured to enable the guest to view the virtual feature. In particular, wearable visualization devices may be used to augment guest experiences by overlaying virtual features onto the real-world environment of an amusement park, by providing an adaptable virtual environment to provide different experiences in a landscape, and so forth.

Advantageously, the disclosed embodiments provide a detection system (e.g., a drop detection system) configured to monitor whether a wearable visualization device has been improperly manipulated (e.g., experienced an adverse or potentially damaging event, such as a drop or a throw). In particular, the detection system may include a sensor (e.g., an inertial measurement unit [ IMU ]) coupled to the wearable visualization device and configured to monitor one or more parameters (e.g., acceleration and/or deceleration) of the wearable visualization device indicative of being improperly manipulated. The sensor may provide a signal indicative of the parameter to a controller (e.g., an electronic controller), which may process the signal to determine whether the wearable visualization device has been improperly manipulated, and may cause one or more actions in response to determining that the wearable visualization device has been improperly manipulated. For example, the controller may cause illumination of lights (e.g., light emitters; light emitting diodes [ LEDs ]) on the wearable visualization device, on a ride vehicle of the landscape, at an operator station of the landscape, or otherwise provide notification that the wearable visualization device has been improperly manipulated. In some embodiments, the controller may count the number of times the wearable visualization device has been improperly manipulated over time (e.g., the number of times the acceleration of the wearable visualization device has exceeded an acceleration threshold, as indicated by the signal from the sensor), and the controller may cause one or more actions in response to the number of times the wearable visualization device has been improperly manipulated exceeding the count threshold. Thus, the detection system may facilitate the effective removal of any wearable visualization device that may be damaged due to being improperly handled, and may facilitate the operation of the AR/VR system such that guests can experience a landscape with a functioning wearable visualization device.

In view of the foregoing, fig. 1 is a perspective view of an embodiment of an AR/VR system 10 (e.g., a wearable visualization system), the AR/VR system 10 configured to enable a user (e.g., a guest, an amusement park employee, an operator of a landscape, a passenger riding a vehicle) to experience an AR/VR scene (e.g., view, interact with the AR/VR scene). As shown, the AR/VR system 10 includes a wearable visualization device 12 (e.g., a head-mounted display) and a guest interface device 14, which may be removably coupleable to one another to facilitate use of the AR/VR system 10.

In the illustrated embodiment, the wearable visualization device 12 includes a lens portion 16 coupled to a housing 18 of the wearable visualization device 12. The lens portion 16 may include one or more lenses 20 (e.g., a display; transparent, translucent, or opaque). In some embodiments, the lens 20 may enable a user to view a real-world environment 22 (e.g., a physical structure in a landscape) through the lens 20, with certain virtual features 24 (e.g., AR features) overlaid onto the lens 20, such that the user perceives the virtual features 24 as being integrated into the real-world environment 22. That is, the lens portion 16 may at least partially control the user's FOV by overlaying the virtual feature 24 onto the user's line of sight. To this end, the wearable visualization device 12 may enable a user to visualize and perceive a super-reality environment 26 (e.g., a gaming environment), the super-reality environment 26 having certain virtual features 24 overlaid onto the real-world environment 22 that are viewable by the user through the lens 20.

By way of non-limiting example, the lens 20 may comprise a transparent (e.g., see-through) Light Emitting Diode (LED) display or a transparent (e.g., see-through) Organic Light Emitting Diode (OLED) display. In some embodiments, the lens portion 16 may be formed of a one-piece construction spanning a distance to display an image to both eyes of the user. That is, in such embodiments, lenses 20 (e.g., first lens 28, second lens 30) may be formed from a single, continuous piece of material, where first lens 28 may be aligned with a first eye of the user and second lens 30 may be aligned with a second eye of the user. In other embodiments, the lens portion 16 may be a multi-piece construction formed from two or more separate lenses 20.

In some embodiments, the wearable visualization device 12 may fully control the user's field of view (e.g., using an opaque viewing surface). That is, lens 20 may include an opaque or non-transparent display configured to display virtual features 24 (e.g., VR features) to a user. Thus, the hyper-reality environment 26 that is viewable by the user may be, for example, a real-time video that includes a real-world image of the real-world environment 22 electronically merged with one or more virtual features 24. Thus, when wearing the wearable visualization device 12, the user may feel fully surrounded by the hyper-reality environment 26 and may perceive the hyper-reality environment 26 as a real-world environment 22 including certain virtual features 24. In some embodiments, the wearable visualization device 12 may include features, such as light projecting features, configured to project light into one or both eyes of the user such that certain virtual features 24 are superimposed over real-world objects viewable by the user. Such wearable visualization device 12 may be considered to comprise a retinal display.

Thus, it should be understood that the super-reality environment 26 may include an AR experience, a VR experience, a mixed reality experience, a computer mediated reality experience, a combination thereof, or other similar super-reality environment. Further, it should be understood that the wearable visualization device 12 may be used alone or in combination with other features to create the super-reality environment 26. Indeed, as discussed below, a user may wear the wearable visualization device 12 for the entire duration of a ride landscape in an amusement park or during another time (such as during a game, within an entire particular area or landscape of an amusement park, during a ride to a hotel associated with the amusement park, at the hotel, etc.). In some embodiments, the wearable visualization device 12 may be physically coupled (e.g., tethered via a cable 32) to a structure (e.g., a ride vehicle) to prevent separation of the wearable visualization device 12 from the structure and/or may be electronically coupled (e.g., via the cable 32) to a computing system to facilitate operation of the wearable visualization device 12 (e.g., to display the virtual feature 24; to monitor whether the wearable visualization device 12 has been improperly manipulated and provide related notifications).

As shown, the wearable visualization device 12 is removably coupleable (e.g., tool-less coupleable; coupleable without tools; detachable without tools and without destroying the guest interface device 14 or components of the wearable visualization device 12) to the guest interface device 14 to enable the wearable visualization device 12 to be quickly transitioned between an engaged configuration 34 (where the wearable visualization device 12 is coupled to the guest interface device 14 in the engaged configuration 34) and a disengaged configuration 36 (see, e.g., fig. 2) (where the wearable visualization device 12 is decoupled from the guest interface device 14 in the disengaged configuration 36). In the illustrated embodiment, the guest interface device 14 is configured to be attached to the head of a user, and thus enables the user to comfortably wear the wearable visualization device 12 throughout various landscapes or while traversing certain amusement park environments. For example, the guest interface device 14 may include a head strap assembly 38, the head strap assembly 38 configured to span around a periphery of the user's head and configured to tighten (e.g., contract) on the user's head. In this manner, the head strap assembly 38 facilitates attachment of the guest interface device 14 to the head of the user such that the guest interface device 14 can be used to retain the wearable visualization device 12 on the user (e.g., when the wearable visualization device 12 is in the engaged configuration 34).

Such a configuration may enable a user or another person (e.g., an operator, a maintenance technician) to effectively couple and decouple the wearable visualization device 12 from the guest interface device 14 (e.g., upon determining that the wearable visualization device 12 should be serviced, such as due to being improperly handled). However, it should be understood that the wearable visualization device 12 and/or the guest interface device 14 may have any of a variety of forms or structures that enable the wearable visualization device 12 to function in the manner described herein. For example, the wearable visualization device 12 may be used without a separate guest interface device 14 and/or the wearable visualization device 12 may be integrally formed with the guest interface device 14. As shown, the wearable visualization device 12 may include a sensor 40 (e.g., an IMU) and/or one or more lights 42 (e.g., LEDs). As discussed in more detail below, the sensor 40 may be configured to monitor one or more parameters (e.g., acceleration and/or deceleration) that indicate that the wearable visualization device 12 has been improperly manipulated, and the light 42 may be configured to illuminate, such as in response to determining (e.g., by the controller) that the wearable visualization device 12 has been improperly manipulated. In this manner, even if the wearable visualization device 12 does not appear to be damaged (e.g., at the time of visual inspection), the wearable visualization device 12 may be identified as potentially damaged and may be flagged for maintenance operations.

Fig. 2 is a perspective view of an embodiment of the AR/VR system 10 illustrating the wearable visualization device 12 and the guest interface device 14 in a disassembled configuration 36. In some embodiments, housing 18 may be assembled from a plurality of plates (e.g., housing sections; molded and/or machined plates) such as cover 44, base plate 46, and lens mount 48 (e.g., plates configured to support lens portion 16), which may collectively form housing 18. As discussed below, some or all of the plates may include component mating features (e.g., machined and/or molded features on a surface of the plate) configured to receive various subcomponents of the wearable visualization device 12 (e.g., sensors 40; lights 42; other electronic components, such as a controller) and/or to couple to various subcomponents of the wearable visualization device 12 (e.g., sensors 40; lights 42; other electronic components, such as a controller).

As discussed below, after the sub-components are assembled on one or more of the plates, the plates may be assembled (e.g., coupled to each other via fasteners, adhesives, and/or other techniques) to form housing 18. Accordingly, housing 18 may support and/or encapsulate the subcomponents to substantially seal (e.g., hermetically seal) at least portions of the subcomponents within housing 18 to shield these subcomponents from direct exposure to the surrounding environmental elements (e.g., moisture) surrounding wearable visualization device 12. It is understood that in other embodiments, the housing 18 may be assembled from additional or fewer plates than the cover 44, the base plate 46, and the lens mount 48. Indeed, in certain embodiments, the housing 18 may include 1, 2, 3, 4, 5, 6, or more than six separate plates that may collectively form the housing 18 in an assembled configuration.

It should also be understood that the sensors 40 may be positioned at any location of the wearable visualization device 12 and/or any number (e.g., 1, 2, 3, 4, or more) of sensors 40 may be provided. As non-limiting examples, the sensors 40 may be position sensors and/or impact sensors, such as accelerometers, magnetometers, gyroscopes, global positioning system receivers, motion tracking sensors, electromagnetic and solid state motion tracking sensors, and/or IMUs. When the sensor 40 is an IMU, the IMU may comprise a nine degree of freedom system on a chip equipped with an accelerometer, a gyroscope, a magnetometer, and a processor for executing a sensor fusion algorithm. Thus, the signals from the IMU may be used to determine the acceleration and/or direction of the wearable visualization device 12 (e.g., relative to the gravity vector). The wearable visualization device 12 may include different types of sensors 40, such as different types of sensors 40 that detect different parameters (e.g., an IMU that detects acceleration of the wearable visualization device 12 and one or more impact sensors that detect the location of an impact on the wearable visualization device 12).

Similarly, the lights 42 may be positioned at any location of the wearable visualization device 12 and/or any number (e.g., 1, 2, 3, 4, or more) of lights 42 may be provided. The light 42 may be positioned to be visible when the wearable visualization device 12 is coupled to the guest interface device 14, visible when the wearable visualization device 12 is docked (docked) (e.g., coupled to or stored on a structure, such as a ride vehicle), visible to a user when the wearable visualization device 12 is worn by the user, and/or visible to an operator (e.g., a person other than the user) to facilitate visualization of the light 42 when the light 42 is illuminated.

Fig. 3 is a schematic diagram of components of a detection system 50 (e.g., a drop detection system) for a wearable visualization device 12. As shown, the detection system 50 may include the sensor 40 and the light 42 of the wearable visualization device 12. The detection system 50 may also include a controller 52 having a processor 54 and a memory device 56. As shown, the controller 52 is positioned on the wearable visualization device 12; however, it should be understood that the controller 52 may be located off of the wearable visualization device 12, such as on a ride vehicle or on a system located remotely from the wearable visualization device 12. Further, the functions and processing steps described herein as being performed by the controller 52 may be distributed between the controller 52 and any other suitable controller or processing system (e.g., the sensor 40, the ride vehicle, a system located remotely from the wearable visualization device 12; the controller 52 may be or may be part of a distributed control system having multiple processors). For example, the sensor 40 may be an IMU having a first processor configured to count the number of accelerations above an acceleration threshold, and the sensor 40 may provide this number to a second processor for further processing and/or to enable the second processor to perform certain actions, such as illuminating the light 42. Thus, processor 54 may include one or more processors located in any suitable location, and memory device 56 may include one or more memory devices located in any suitable location.

Memory device 56 may include one or more tangible, non-transitory, computer-readable media that store instructions executable by processor 54 and/or data (e.g., parameters; number of events) to be processed by processor 54. For example, memory device 56 may include Random Access Memory (RAM), Read Only Memory (ROM), rewritable non-volatile memory (such as flash memory), a hard disk drive, an optical disk, and/or the like. Additionally, the processor 54 may include one or more general purpose microprocessors, one or more application specific processors (ASICs), one or more Field Programmable Gate Arrays (FPGAs), or any combination thereof. Further, memory device 56 may store instructions executable by processor 54 to perform the methods and control actions described herein. The controller 52 may also include a communication device 58 that enables communication with other devices or systems, such as an operator system 60 (e.g., having a computing system with a processor and a memory device) and/or a landscape system 62 (e.g., having a computing system with a processor and a memory device), via a communication network.

The sensor 40 may be configured to detect one or more parameters indicating that the wearable visualization device 12 is improperly manipulated. For example, if the user drops the wearable visualization device 12 (e.g., to a free fall toward the ground/along a gravity vector), the sensor 40 may detect an acceleration (e.g., a sudden acceleration or deceleration). The sensor 40 may provide a signal to the processor 54, and the processor 54 may process the signal by comparing the acceleration (e.g., the maximum acceleration value) to an acceleration threshold (e.g., an acceleration threshold). The processor 54 may be configured to determine that the wearable visualization device 12 has been dropped in response to determining that the acceleration exceeds an acceleration threshold. It should be understood that acceleration is a broad term encompassing various ways of detecting a fall and/or a throw, and thus, acceleration may be negative, and acceleration threshold may be a negative acceleration threshold (e.g., due to a fall), or acceleration threshold may be considered a deceleration threshold (e.g., due to an abrupt stop due to an impact). Processor 54 may also be considered to determine and analyze accelerations and/or other parameters (e.g., acceleration patterns or signatures) over time to determine whether wearable visualization device 12 has been improperly manipulated (e.g., and to characterize events, as discussed below).

Acceleration above an acceleration threshold may generally indicate that the severity (e.g., severity level) of the drop exceeds the severity threshold (e.g., the motion of the wearable visualization device 12 is sufficient to be considered a drop, which may potentially damage the wearable visualization device 12). Thus, the acceleration threshold may represent a severity threshold. In some embodiments, processor 54 may compare the acceleration to a plurality of acceleration thresholds, each of which may represent a different severity threshold, and may enable the processor to more accurately determine the severity of the drop. For example, if the acceleration is above a first acceleration threshold and below a second acceleration threshold, the processor 54 may determine that a drop has occurred and has a first, lower severity level. And if the acceleration is above both the first acceleration threshold and the second acceleration threshold, the processor 54 may determine that a drop has occurred and has a second, higher severity level. The processor 54 may be configured to determine that the wearable visualization device 12 has been flung and determine the severity of the flung in a similar manner (e.g., compared to one or more acceleration thresholds). It should be understood that the sensor 40 may additionally or alternatively detect various other parameters, such as the direction, angular rate, and/or deceleration of the wearable visualization device 12 (e.g., relative to the gravity vector). Processor 54 may process the signals from sensors 40 in a similar manner (e.g., compared to one or more thresholds) to determine whether wearable visualization device 12 has been dropped or otherwise improperly manipulated and the associated severity level.

In some embodiments, regardless of the parameters and regardless of the number of parameters, processor 54 may process the signals from sensors 40 to determine characteristics of the motion of wearable visualization device 12 (e.g., to characterize the event and/or incorrect manipulation, such as to characterize the event as being dropped or thrown). For example, the processor 54 may determine that the signal indicates that the wearable visualization device 12 is dropped, the speed of the wearable visualization device 12 during the drop, the time and/or distance traveled during the drop, indicates that the wearable visualization device 12 is thrown, the speed at which the wearable visualization device 12 is thrown, the time and/or distance of the throw, the location of the impact, and/or the like. The drop can typically have a lower acceleration than the throw, as well as other parameters than the throw. Accordingly, the processor 54 may characterize an event as being a drop or a throw based on a comparison of the parameter(s) to known parameters (e.g., stored in the memory device 56) related to the drop or throw.

As described above, in some embodiments, the processor 54 may be configured to compare the parameter(s) and/or characteristic(s) to respective thresholds (e.g., one or more acceleration thresholds, one or more velocity thresholds, one or more time thresholds, one or more distance thresholds) to determine the severity of the incorrect manipulation and/or event. For example, a short drop with a lower acceleration may be less severe than a high speed throw with a higher acceleration. In some cases, the processor 54 may be configured to input the parameter(s) and/or characteristic(s) into a model configured to output a severity or otherwise classify (e.g., categorize) the event and/or incorrect manipulation based on the parameter(s) and/or characteristic(s). For example, the model may be responsible for certain combinations of parameters that historically cause damage or compromise the operation of a similar wearable visualization device 12. In some embodiments, the processor 54 may interpret the location of the impact (e.g., based on signals from the impact sensor) to determine severity, as the impact at the lens 20 may be more severe than the impact at the housing 18 (fig. 1) and may be more likely to cause damage. The processor 54 may also be configured to determine the motion of the wearable visualization device 12 relative to the ride vehicle (e.g., to decouple the motion of the wearable visualization device 12 from the motion of the ride vehicle, such as from an expected or known motion or acceleration of the ride vehicle during the ride vehicle's course, and/or from the motion or acceleration of the ride vehicle during the ride vehicle's course as detected by a ride vehicle sensor configured to monitor the motion of the ride vehicle). In this manner, sudden movements or accelerations of the ride vehicle (e.g., at portions of the ride designed to move the ride vehicle in this manner) may be ignored or disregarded by the processor 54 as incorrect maneuvers.

In response to determining that the wearable visualization device 12 has been dropped or otherwise improperly manipulated (e.g., has a severity that exceeds a severity threshold), the processor 54 may then cause one or more actions, such as illumination of at least one of the lights 42. Illumination of at least one of the lights 42 may prompt the user or operator to perform a maintenance operation, such as inspecting the wearable visualization device 12, performing a test of the wearable visualization device 12, detaching the wearable visualization device 12 from the guest interface device 14, detaching the wearable visualization device 12 from any structure (e.g., a ride vehicle), replacing the wearable visualization device 12, and/or sending the wearable visualization device 12 to a maintenance technician for repair. In some cases, the controller 52 may direct the lights 42 to illuminate in a particular color based on the parameters, characteristics, and/or severity of the event. For example, a short drop with a lower acceleration may cause the light 42 to illuminate in a yellow color, while a high speed throw with a higher acceleration may cause the light 42 to illuminate in a red color. Any number of colors may be utilized to communicate various types of events (e.g., yellow to indicate a drop; red to indicate a throw) and/or severity (e.g., yellow to indicate acceleration below a first acceleration threshold; red to indicate acceleration above the first acceleration threshold). In some embodiments, the lights 42 may be capable of illuminating in different colors and/or a variety of different lights may be provided.

In some embodiments, the processor 54 may be configured to count the number of events over time (e.g., the number of events in which the wearable visualization device 12 has been improperly manipulated). For example, the processor 54 may direct at least one of the lights 42 to illuminate once a certain number of drops or throws are reached (e.g., each having an acceleration above an acceleration threshold; each having a severity above a severity threshold). In some cases, the processor 54 may direct one light 42 to illuminate for each event. For example, wearable visualization device 12 may include five lights, a first light may illuminate upon a first drop of wearable visualization device 12, a second light may illuminate upon a second drop of wearable visualization device 12, a third light may illuminate upon a throw of wearable visualization device 12, and so on. In some embodiments, the processor 54 may direct one or more lights 42 to illuminate for each event, and the number of lights 42 may be based on the severity of each event. For example, wearable visualization device 12 may include five lights, a first light may be illuminated upon a first brief drop of wearable visualization device 12, a second light and a third light may be illuminated upon a high speed throw of wearable visualization device 12, and so on. Then, when a certain number (e.g., all) of the lights 42 of the wearable visualization device 12 are illuminated, the operator may be notified (e.g., by looking at the lights 42) to take an action. In some embodiments, wearable visualization device 12 may include a speaker, and the one or more actions may include providing an audible output via the speaker.

In addition to or as an alternative to the illumination of the at least one light 42, the processor 54 may take one or more other actions, such as sending a notification to the operator system 60 and/or the landscape system 62. Various actions (e.g., automated actions) are envisioned. For example, upon determining that an event has occurred (e.g., the event has a severity above a severity threshold; a certain number of such events have occurred), the processor 54 may turn off the wearable visualization device 12 or at least some features of the wearable visualization device 12 (e.g., turn off the lens 20; prevent display of virtual features on the lens 20). In some embodiments, the processor 54 may prevent the display of the virtual feature on the lens 20 in response to determining that the event has a first, higher severity (e.g., high speed throw; first, higher acceleration), but the processor 54 may continue to enable the display of the virtual feature on the lens 20 in response to determining that the event has a second, lower severity (e.g., short drop; second, lower acceleration).

In some embodiments, the wearable visualization device 12 can be coupled (e.g., removably coupled; temporarily locked) to the guest interface device 14 and/or to a structure such as a ride vehicle. For example, the wearable visualization device 12 may be locked to the guest interface device 14 via an electromagnetic system. In this case, in response to determining that an event has occurred, power to the electromagnetic system may be blocked (e.g., the electromagnet may be deactivated), thereby enabling separation of the wearable visualization device 12 from the guest interface device 14. In some such cases, power to the electromagnetic system may be prevented only when the ride vehicle is in the loading/unloading zone and/or when the ride vehicle is stationary. Similarly, the locking device coupling the wearable visualization device 12 to the ride vehicle may be unlocked in response to determining that an event has occurred and/or while the ride vehicle is in the loading/unloading zone and/or while the ride vehicle is stationary. The wearable visualization device 12 can then be coupled to the guest interface device 14 and/or to the structure only via a mechanical connection (e.g., hook, key/slot interface) that can be quickly, manually disconnected. For example, such techniques may enable wearable visualization devices 12 that have experienced an event to be quickly removed for maintenance operations and replaced with another wearable visualization device 12 without slowing throughput (e.g., unloading and loading by a user) at the landscape. As another example, the processor 54 may be configured to initiate (e.g., run) a test (e.g., a health test) in response to determining that an event has occurred. The testing may include displaying an image (e.g., a pattern, a line) on the lens 20 of the wearable visualization device 12 and using the camera 64 of the wearable visualization device 12 to determine that the image is properly displayed on the lens 20. The processor 54 may receive images from the camera 64 and may process the images (e.g., via template or pattern matching) to determine whether the wearable visualization device 12 is functioning properly after the event. The testing may include providing information (e.g., questions and/or images) on the lens 20 for visualization by the user, and then receiving gesture input from the user (e.g., nodding of the user's head) detected by the sensor 40, as discussed in more detail below with respect to fig. 6.

In some embodiments, the processor 54 may be configured to send an indication (e.g., via the communication device 58) to an operator system 60, which operator system 60 may be located remotely from the wearable visualization device 12 (e.g., a tablet held by an operator of the landscape, a computer accessed by an operator overseeing operations of the amusement park). The indication may include a text message or other notification (e.g., illumination of a light) that the wearable visualization device 12 has been improperly manipulated. The indication may also include data relating to parameters, characteristics, and/or severity of the event.

It should be appreciated that the data relating to the number of events and the data relating to the parameters, characteristics, and/or severity of each event may be used to generate an event report (e.g., a table) for each wearable visualization device 12 and/or may enable an operator of the amusement park to maintain a grasp of the reliability and/or durability of the wearable visualization devices 12. For example, if the wearable visualization device 12 used in landscapes typically experiences impaired functionality after only a few minor drops, the operator may be able to focus on improving reliability and/or durability (even in the presence of drops) and/or taking measures to reduce drops. If the wearable visualization device 12 experiences multiple severe drops and/or throws, the operator may be able to focus on taking steps to reduce the drops and/or throws. Furthermore, if the wearable visualization device 12 experiences impaired functionality without any drop, the operator may be able to focus on improving other features of the wearable visualization device 12 and/or seeking replacement according to warranty.

In some embodiments, the processor 54 may be configured to send instructions to the landscape system 62 (e.g., via the communication device 58) to cause the landscape system 62 to illuminate lights (e.g., on a ride vehicle) and/or adjust operation of features of the landscape, such as adjusting the path or movement of the ride vehicle. For example, in response to determining that an event has occurred, the landscape system 62 may transfer the ride vehicle (e.g., to a maintenance bay and/or a loading/unloading zone) to facilitate maintenance operations. The transfer may occur during the ride in order to avoid the user experiencing the ride with the potentially malfunctioning wearable visualization device 12. Thus, the user or operator may inspect, repair and/or replace the wearable visualization device 12 and/or the user may unload from the ride vehicle and reload into another ride vehicle with a properly functioning wearable visualization device 12, enabling the user to enjoy the AR/VR experience throughout the remainder of the ride. The transfer may occur after the ride so that the wearable visualization device 12 can be inspected, repaired, and/or replaced between ride cycles and/or between users to avoid the user experiencing the ride with a potentially malfunctioning wearable visualization device 12. The transfer may include preventing the ride vehicle from moving forward out of the loading/unloading zone until the wearable visualization device 12 is inspected or otherwise processed. In some embodiments, in response to determining that an event has occurred, the landscape system 62 may be configured to increase physical features on the ride vehicle and/or within the landscape, such as a display, an electronic animal, a light show, etc. (e.g., to enable a user to view text or images, such as on the display, and to enjoy the landscape generally, even in the absence of a properly functioning wearable visualization device 12).

FIG. 4 is a perspective view of a landscape 70 in which the AR/VR system 10 may be employed. As shown, the user 72 is positioned within a ride vehicle 74 that travels along a path 76. At least at certain times of the ride, the user 72 may be able to view the physical structure 78 in the real-world environment 22 through the lens of the wearable visualization device 12. At least at certain times of the ride, the user 72 may be able to view the virtual feature 24 on the lens of the wearable visualization device 12. As represented in fig. 4, the virtual feature 24 may be overlaid onto the real-world environment 22 such that the user is able to view both the physical structure 78 and the virtual feature 24 in the real-world environment 22 simultaneously. Each user 72 may be presented with a different virtual feature 24 such that each user 72 has a different experience on the ride. The user 72 may board the ride vehicle 74 in a loading zone and exit from the ride vehicle 74 in an unloading zone (e.g., loading/unloading zone 80). However, in the excitement of a ride, it may be that the user 72 may drop the wearable visualization device 12, or the wearable visualization device 12 may otherwise fall off the user 72. It is also possible that the user 72 may throw the wearable visualization device 12 and/or the wearable visualization device 12 may otherwise be improperly manipulated.

Referring to fig. 3 and 4, each wearable visualization device 12 may include components that are part of a detection system 50, which detection system 50 may monitor whether the wearable visualization device 12 is improperly manipulated during the ride. In some embodiments, during the ride, the detection system 50 may illuminate at least one light 42, provide notification to the operator system 60, and/or cause action to be taken by the landscape system 62. Additionally or alternatively, the detection system 50 may count or record events within the memory device 56. Additionally or alternatively, the detection system 50 may illuminate the at least one light 42, provide notification to the operator system 60, and/or cause action to be taken by the landscape system 62 only after the ride is finished (e.g., in the loading/unloading zone 80) so as not to interrupt the ride.

In some embodiments, the processor 54 may count the total number of events and/or may periodically cause one or more actions based on the event(s), such as after a period of time (e.g., hourly, daily, weekly), whenever the wearable visualization device 12 is coupled to or decoupled from the guest interface device 14, whenever the wearable visualization device 12 is docked to a structure (e.g., docked to the ride vehicle 74, which may be detected via a positioning sensor), whenever the ride vehicle 74 is in the loading/unloading zone 80 (e.g., after each ride cycle), and/or in response to a request by a user or other person (e.g., an operator, a maintenance technician). Although fig. 4 illustrates the landscape 70 with ride vehicles 74, it should be understood that the landscape 70 may not include ride vehicles 74. Alternatively, the landscape 70 may include a path over which the user 72 walks while wearing the wearable visualization device 12, a theater in which the user 72 sits or stands while wearing the wearable visualization device 12, or any other suitable type of landscape. Further, the landscape 70 may be configured to enable the user 72 to wear and/or carry the wearable visualization device 12 outside of the ride vehicle 74 (such as while queuing to board the ride vehicle 74, after unloading from the ride vehicle 74, etc.). Thus, it may be possible for the user 72 or another person (e.g., operator, maintenance technician) to drop the wearable visualization device 12 at other locations relative to the ride vehicle 74 and/or at other times outside of the ride. The detection system 50 may be configured to detect, count, and/or cause one or more actions disclosed herein when the wearable visualization device 12 is at other locations relative to the ride vehicle 74 and/or at other times outside of the ride.

Fig. 5 is a method 90 of using the detection system 50 to monitor for an event (e.g., improper manipulation) of the wearable visualization device 12. The method 90 disclosed herein includes various steps represented by blocks. It should be noted that at least some of the steps in the method 90 may be performed by a system (such as any of the detection systems 50 disclosed herein) as an automated procedure. Although the flow diagrams illustrate steps in a certain order, it should be understood that the steps may be performed in any suitable order, and certain steps may be performed simultaneously where appropriate. Additionally, steps may be added to the method 90 or omitted from the method 90.

As shown, the method 90 may begin in step 92 with receiving a signal (e.g., from the sensor 40, at the processor 54) indicative of an event regarding the wearable visualization device 12. As discussed above, the processor 54 may be configured to receive and process the signals to determine that an event has occurred and/or to characterize the event (e.g., type, time, distance, speed, severity, location of impact). In step 94, the processor 54 may count the number of events over time. For example, data relating to parameters, characteristics, severity, and/or quantity of events may be stored in the memory device 56.

In step 96, the processor 54 may direct at least one light 42 on the wearable visualization device 12 to illuminate. For example, the processor 54 may direct the at least one light 42 to illuminate in response to detection of drops having a severity above a severity threshold and/or in response to detection of a number of drops above a count threshold. In step 98, processor 54 may provide a notification to operator system 60 that operator system 60 may be located remotely from wearable visualization device 12. In step 100, the processor 54 may communicate with the landscape system 62, which may cause the landscape system 62 to adjust features of the landscape, such as illuminating lights on the ride vehicles, adjusting the path of the ride vehicles, and so forth.

The sensors 40 of the wearable visualization device 12 may enable the user to provide gesture input. In view of this, fig. 6 is a schematic illustration of a problem that may be presented on the lens 20 of the wearable visualization device 12. For example, the question may be "can you see the image below

", and the image may be a geometric shape or other image. The user may pan their head up and down to answer "yes" and the user may pan their head left and right to answer "no".

Referring to both fig. 3 and 6, the sensor 40 may be capable of detecting movement of the user's head when the wearable visualization device 12 is worn by the user. The sensor 40 may provide a signal indicative of the motion to the processor 54, and the processor 54 may determine a response or answer from the user based on the signal. In this case, processor 54 may characterize the response based on a comparison of the parameter(s) to known parameters (e.g., stored in memory device 56) associated with a "yes" or "no" motion. The illustrated example may be used as part of a test to test whether the wearable visualization device 12 is functional, such as after being improperly manipulated. In response to determining that the wearable visualization device has been improperly manipulated, a test may be automatically initiated by the processor 54. For example, if the user responds with a "yes," the processor 54 may determine that the wearable visualization device 12 is functional after being improperly manipulated. However, if the user responds with "no," the processor 54 may determine that the wearable visualization device 12 is not functioning properly after being improperly manipulated. In such a case, processor 54 may take one or more actions, including one or more actions disclosed herein (e.g., illuminate light 42; notify operator system 60 and/or landscape system 62). It should be understood that the test may be initiated in response to an input (e.g., by a user or operator), or may be initiated at any other time, prior to exiting the loading area of the ride (e.g., in response to coupling the wearable visualization device 12 to the guest interface device 14), and so forth.

The gesture input may be used to provide various responses to various questions or other prompts, the gesture input may be used as part of a game, and/or the gesture input may be used to control wearable visualization device 12 and/or other aspects of the landscape. In practice, different movements of the user's head may correspond to different responses or inputs. For example, moving the user's head in one way may be one input (e.g., to brighten the image on the lens 20 to cause display of one image as part of a game, adjusting the motion of the ride vehicle in one way), and moving the user's head in another way may be another input (e.g., to darken the image on the lens 20 to cause display of another image as part of a game, adjusting the motion of the ride vehicle in another way).

The gesture input may also be used to enable an operator and/or maintenance technician to unlock certain features of the wearable visualization device 12 (e.g., by moving the wearable visualization device 12 in some manner and/or in some pattern of movement). The gesture input may enable an operator and/or a maintenance technician to interact with the wearable visualization device 12 and/or the landscape (e.g., game) in order to diagnose problems and/or see information not available to the guest. The gesture input may enable an operator and/or a maintenance technician to access a menu (e.g., a menu viewable on lens 20 of wearable visualization device 12; a menu viewable on a display connected to wearable visualization device 12 (such as a display on a ride vehicle)), move through a menu, make selections on a menu, and/or perform maintenance tests and/or procedures using gesture input (e.g., only gesture input and motion of wearable visualization device 12; without auxiliary devices, such as a mouse or keyboard). In some cases, the gesture input may enable an operator and/or maintenance technician to perform maintenance and/or provide input to a computing system coupled to the wearable visualization device 12, such as a computing system of a ride vehicle (e.g., the landscape system 62 of fig. 3), to thereby adjust the operation of the computing system.

The sensor 40 of the wearable visualization device 12 may also enable other operations, such as head tracking of the user's head. The sensor 40 (e.g., IMU) may be used to obtain data indicative of the manner in which the user's head travels through the space. However, in some settings, a user may be positioned on a moving ride vehicle (e.g., translated and/or rotated relative to the ground). Accordingly, the AR/VR system 10 may include additional features and/or be configured to perform processing steps to decouple the movement of the user's head from the movement of the ride vehicle. For example, the AR/VR system 10 may use a solid state cabin tracking system and may secondarily use the sensor 40 (e.g., if needed) for additional input to a prediction algorithm (e.g., kalman filter).

The sensor 40 may also be used for off-board development (e.g., desktop development) as it provides a low cost way to have head tracking in a wearable visualization device 10. Developers can take advantage of the basic tracking provided by the sensors 40 to look around the virtual scene; however, a developer may not be able to align a virtual scene with the real world in order to create the virtual scene. Thus, a developer may not utilize a ride vehicle/cabin tracking system, which may be more expensive, use many devices, and be time consuming to set up than the sensor 40, which sensor 40 may operate to obtain data indicative of movement of the user's head when plugged into a cable (e.g., a USB cable; cable 32).

As set forth above, embodiments of the present disclosure may provide one or more technical effects useful for facilitating performance of maintenance activities on wearable visualization devices and for facilitating integration of wearable visualization devices in amusement parks. It should be understood that the technical effects and technical problems in the specification are exemplary and not restrictive. Indeed, it should be noted that the embodiments described in the specification may have other technical effects and may be capable of solving other technical problems.

While the embodiments set forth in this disclosure may be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and have been described in detail herein. It should be understood, however, that the disclosure is not intended to be limited to the particular forms disclosed. The disclosure is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure as defined by the following appended claims.

The technology presented and claimed herein is cited and applied to practical and concrete examples of a significant improvement in the art, and thus is not abstract, intangible, or purely theoretical. Furthermore, if any claim appended to the end of this specification contains one or more elements designated as "means for [ performing ] … … [ function" or "step for [ performing ] … … [ function"), it is intended that such elements be construed in accordance with 35 u.s.c.112 (f). However, for any claim that contains elements specified in any other way, it is intended that such elements not be construed in accordance with 35 u.s.c. § 112 (f).

Claims

1. A detection system configured to detect improper manipulation of a wearable visualization device, the detection system comprising:

a sensor coupled to the wearable visualization device;

a light emitter coupled to the wearable visualization device; and

a processor configured to receive a signal from the sensor, determine whether the signal indicates improper manipulation of the wearable visualization device, and direct illumination of the light emitter in response to determining that the signal indicates improper manipulation of the wearable visualization device.

2. The detection system of claim 1, wherein the signal is indicative of an acceleration of the wearable visualization device, and the processor is configured to compare the acceleration to an acceleration threshold and determine that the signal is indicative of an incorrect manipulation of the wearable visualization device in response to the acceleration exceeding the acceleration threshold.

3. The detection system of claim 2, wherein the processor is configured to determine the acceleration of the wearable visualization device relative to a ride vehicle based on the signal to determine that the signal indicates incorrect manipulation of the wearable visualization device.

4. The detection system of claim 1, wherein the processor is configured to determine a number of events of improper manipulation of the wearable visualization device over time, and direct illumination of the light emitter in response to determining that the number of events exceeds a count threshold.

5. The detection system of claim 1, wherein the processor is configured to determine a severity of the incorrect manipulation based on the signal.

6. The detection system of claim 5, wherein the processor is configured to direct illumination of the light emitter in a first color in response to determining that the severity is a first level, and direct illumination of the light emitter in a second color in response to determining that the severity is a second level.

7. The detection system of claim 5, wherein the processor is configured to determine the severity by comparing a parameter of the signal to one or more parameter thresholds.

8. The detection system of claim 1, wherein the processor is configured to stop operation of at least one component of the wearable visualization device in response to determining that the signal indicates improper manipulation of the wearable visualization device.

9. The detection system of claim 1, wherein the processor is configured to determine a type of improper manipulation of the wearable visualization device based on the signal.

10. The detection system of claim 8, wherein the processor is configured to direct illumination of the light emitter in a first color in response to determining the type relates to dropping the wearable visualization device, and direct illumination of the light emitter in a second color in response to determining the type relates to throwing the wearable visualization device.

11. The detection system of claim 1, wherein the sensor comprises an inertial measurement unit.

12. The detection system of claim 1, wherein the processor is configured to provide a notification to a remote system located remotely from the wearable visualization device in response to determining that the signal indicates improper manipulation of the wearable visualization device.

13. The detection system of claim 12, wherein the remote system comprises a landscape system, and the notification is configured to cause the landscape system to adjust a characteristic of a landscape.

14. A wearable visualization device, comprising:

a housing;

a sensor supported by the housing and configured to detect movement of the wearable visualization device;

a light emitter supported by the housing; and

a processor configured to receive a signal from the sensor, determine whether the signal indicates that the wearable visualization device has been dropped or thrown based on the detected motion of the wearable visualization device, and direct illumination of the light emitter in response to determining that the signal indicates that the wearable visualization device has been dropped or thrown.

15. The wearable visualization device of claim 14, wherein the processor is configured to determine a number of times the wearable visualization device has been dropped or thrown over time, and direct illumination of the light emitter in response to determining that the number exceeds a count threshold.

16. The wearable visualization device of claim 14, wherein the processor is configured to determine a severity of a drop or a throw of the wearable visualization device based on the signal.

17. The wearable visualization device of claim 16, wherein the processor is configured to direct illumination of the light emitter in a first color in response to determining that the severity is a first level, and direct illumination of the light emitter in a second color in response to determining that the severity is a second level.

18. A method of detecting improper manipulation of a wearable visualization device using a detection system, the method comprising:

receiving, at a processor, a signal from a sensor coupled to the wearable visualization device;

determining, using the processor, that the signal is indicative of improper manipulation of the wearable visualization device;

counting, using the processor, a number of events of incorrect manipulation of the wearable visualization device over time; and

directing, using the processor, illumination of a light emitter in response to determining that the number of events exceeds a count threshold.

19. The method of claim 18, in response to determining that the signal indicates improper manipulation of the wearable visualization device, ceasing, via the processor, operation of at least one component of the wearable visualization device.

20. The method of claim 18, providing, via the processor, a notification to a remote system located remotely from the wearable visualization device in response to determining that the signal indicates improper manipulation of the wearable visualization device.