EP2844435B1 - Line sensing robot and a method of using the same with a digital display - Google Patents
Line sensing robot and a method of using the same with a digital display Download PDFInfo
- Publication number
- EP2844435B1 EP2844435B1 EP13784531.9A EP13784531A EP2844435B1 EP 2844435 B1 EP2844435 B1 EP 2844435B1 EP 13784531 A EP13784531 A EP 13784531A EP 2844435 B1 EP2844435 B1 EP 2844435B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light
- base surface
- line segment
- chassis
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 10
- 230000007246 mechanism Effects 0.000 claims description 28
- 238000004891 communication Methods 0.000 claims description 24
- 230000004044 response Effects 0.000 claims description 14
- 230000007704 transition Effects 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000017280 response to inactivity Effects 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 2
- 230000003287 optical effect Effects 0.000 description 9
- 238000013459 approach Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004397 blinking Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63H—TOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
- A63H33/00—Other toys
- A63H33/005—Motorised rolling toys
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63H—TOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
- A63H17/00—Toy vehicles, e.g. with self-drive; ; Cranes, winches or the like; Accessories therefor
- A63H17/26—Details; Accessories
- A63H17/36—Steering-mechanisms for toy vehicles
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63H—TOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
- A63H18/00—Highways or trackways for toys; Propulsion by special interaction between vehicle and track
- A63H18/16—Control of vehicle drives by interaction between vehicle and track; Control of track elements by vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0234—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using optical markers or beacons
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63H—TOYS, e.g. TOPS, DOLLS, HOOPS OR BUILDING BLOCKS
- A63H2200/00—Computerized interactive toys, e.g. dolls
Definitions
- the present invention relates generally to a toy robot, and more specifically to a toy robot configured to move in a direction corresponding to a line on a base surface, the toy robot further being configured to operatively transition between use on a digital display and a non-digital display.
- Smart phones and tablet computers are typically compact in size relative to a conventional desktop computer, and include a touch screen display which a user may use to input commands.
- Smart phones generally define a slightly smaller form factor relative to tablet computers, and thus, the display screen on a smart phone is typically smaller than the display screen on a conventional tablet computer.
- Smart phones and tablet computers generally include sufficient computing capability to allow games, educational tools and the like to be played and operated thereon.
- Several games and educational tools may be downloaded onto the smart phones and tablet computers via the Internet. Due to the compact size of both smart phones and tablet computers, such devices may be easily transported for use in almost any location. For instance, smart phones and tablet computers may be used in the car during road trips, on airplanes, in waiting rooms, or even around the house. In view of the ease in transporting the devices, smart phones and tablet computers are readily used by children of all ages for entertainment and educational purposes.
- JP2006340853A discloses a toy vehicle body equipped with optical sensors with light emitters and light receivers.
- US5596255A discloses a self-propelled electronic device in the form of a microrobot, according to the preamble of claim 1.
- the method includes providing a digital display including a smooth flat display surface.
- the method further includes placing a self-propelled electronic device upon the display surface and electronically displaying a line segment upon the display surface.
- the line segment is sensed using the device, and the device is automatically moved along the line segment in response to sensing the line segment.
- Various aspects of the present invention allow for use of a self-propelled electronic device on the surface of a digital display.
- the digital display is configured to generate a line segment along which the self-propelled electronic device moves.
- the electronic device may be a toy robot which travels along the surface of the electronic device to provide entertainment to a child.
- the movement of the electronic device may be associated with a game or as part of a learning tool.
- the digital display may be a mobile computing device.
- the line segment displayed by the digital display may be defined by a line color, wherein the line segment is displayed with a background color immediately adjacent to the line segment, where the line color is different than the background color.
- the line segment may also be defined by a line pixel variance value.
- the line segment may be displayed with a background pixel variance value immediately adjacent to the line segment, wherein the line pixel variance value and the background pixel variance value are different.
- the electronic device may include a line sensor, which may include a phototransistor element.
- the line sensor may be sized and configured to sense the line segment based upon a color difference of the line color and the background color.
- the line sensor may also be sized and configured to sense the line segment based upon a pixel variance value difference of the line pixel variance value and the background pixel variance.
- the method may further include extending the line segment and sensing the extended line segment using the electronic device.
- the method may further include automatically moving the electronic device along the extended line segment.
- the digital display may be a touch screen, and the method may additionally include detecting physical contact with the display surface, extending the line segment in response to the detected physical contact with the display surface, and sensing the extended line segment using the device.
- a self-propelled electronic device for use on a base surface.
- the electronic device includes a chassis disposable over the base surface.
- the chassis includes a first surface facing the base surface when the chassis is disposed over the base surface.
- a light meter is coupled to the chassis and is configured to detect light incident toward the first surface and determine a luminance level of the detected light.
- a light source is also coupled to the chassis and is configured to selectively transition between an ON state to emit light away from the first surface and an OFF state to not emit any light.
- a control unit is coupled to the chassis and is in operative communication with the light meter and the light source.
- the control unit is configured to transition the light source to the ON state in response to the luminance level of the detected light being below a threshold luminance and to the OFF state in response to the luminance level of the detected light being above the threshold luminance.
- a line sensor is coupled to the chassis and is configured to sense a line segment on the base surface.
- a movement mechanism is coupled to the chassis and is placeable on the base surface. The movement mechanism is in operative communication with the line sensor to move on the base surface in a pattern corresponding to the line sensed on the base surface.
- the self-propelled electronic device includes a light meter to monitor the brightness of the light under the chassis, such that when the brightness is low (as may be the case when the electronic device is placed on a table), the light source is turned ON to illuminate the base surface. When the brightness is high, the light source is turned OFF so as not to wash out the line depicted on the base surface.
- the electronic device may include a power device in operative communication with the light meter, the light source, and the line sensor.
- the power device may be configured to store and provide electrical power to the light meter, the light source and the line sensor.
- the power device may be configured to cease power transmission to the light meter, the light source, the line sensor and the movement mechanism in response to inactivity for a preset time period.
- Figures 1-3 generally depict an embodiment of a self-propelled electronic device, i.e., a toy robot 10, configured to follow a line segment 12 (see Figure 4 ) appearing on a base surface 14 (see Figure 4 ).
- the base surface 14 may be the display screen of an electronic computing device 16 (see Figure 4 ), such as a smart phone or tablet computer, or alternatively, the base surface 14 may include the top of a table/desk 18 (see Figure 10 ).
- the toy robot 10 may be configured for use with devices which emit light (such as a tablet computer) as well as objects which simply reflect light (such as a table or counter).
- devices which emit light such as a tablet computer
- objects which simply reflect light such as a table or counter.
- self-emitting devices devices which emit light
- objects which do not emit light and instead, simply reflect light will be referred to herein as “non-emitting objects.”
- Various aspects of the present invention are directed toward facilitating seamless transition of the toy robot 10 between use on the surface of the self-emitting device 16, and the surface of the non-emitting object 18.
- the toy robot 10 includes a chassis 20 including a first surface 22 (i.e., outer surface) and a second surface (i.e., inner surface).
- first surface 22 of the chassis 20 is disposed in spaced relation to the base surface 14 (see Figure 11 ) and is oriented in a manner wherein the first surface 22 is facing the base surface 14.
- the robot 10 includes a movement mechanism, i.e., wheels, which is placed directly on the base surface 14 and causes the first surface 22 to be spaced from the base surface 14.
- the robot 10 additionally includes a housing 25 coupled to the chassis 20.
- the housing 25 defines a generally rounded configuration, although other configurations may be defined in other implementations of the present invention.
- the housing 25 and chassis 20 collectively define an inner compartment which houses several of the control and power components described below.
- the housing 25 and chassis 20 may be fabricated from plastic, rubber or other materials commonly used in the art.
- the toy robot 10 additionally includes a light meter 24 coupled to the chassis 20 and configured to detect light incident toward the first surface 22 of the chassis 20 for determining a luminance level of the detected light.
- a light meter 24 coupled to the chassis 20 and configured to detect light incident toward the first surface 22 of the chassis 20 for determining a luminance level of the detected light.
- the phrase "light incident toward the first surface 22 of the chassis 20" refers to light traveling toward the first surface 22, including light emitted from a self-emitting device, as well as light reflected from a non-emitting object.
- Light emitted from an illuminated base surface 14, such as the surface of an iPadTM may travel toward the first surface 22 when the robot 10 is placed on the base surface 14.
- light emitted from the iPadTM may be "light incident toward the first surface 22 of the chassis 20.”
- a non-illuminated surface 18 such as a desk or table
- light may reflect off the surface of the desk or table and travel toward the first surface 22, and thus, may be "light incident toward the first surface 22 of the chassis 20.”
- the luminance level of the light incident toward the first surface 22 will vary according to several different factors. One significant factor is whether the base surface 14 is part of a self-emitting device 16 or conversely, part of a non-emitting object 18. The luminance level of the light incident on the first surface 22 will, in most cases, be greater when the base surface 14 is part of a self-emitting device 16, rather than when the base surface 14 is part of a non-emitting object 18.
- the toy robot 10 includes a light source 26 (see Figures 3 , 5 , and 11 ) coupled to the chassis 20 for illuminating the line segment 12 on the base surface.
- the light source 26 is configured to selectively transition between an ON state to emit light away from the first surface 22, and an OFF state to not emit any light.
- the light source 26 may be in the ON state to direct light toward the base surface 14 for making it easier to detect the line segment thereon.
- the light source 26 is turned into the OFF state so as not to emit any light to avoid washing out the line segment on the base surface 14.
- a user may place the robot 10 on a self-emitting device to follow a line segment 12 depicted thereon. Subsequently, the user may lift the robot 10 from the self-emitting device and place the robot 10 on a non-emitting object to follow a separate line segment 12 depicted thereon.
- the luminance level is typically above the threshold, and thus, the light source 26 is in the OFF state.
- the luminance level is typically below the threshold, and thus, the light source 26 transitions to the ON state.
- the light source 26 typically transitions from the ON state to the OFF state since the luminance level typically increases from below the threshold to above the threshold.
- the light source 26 may include any lighting mechanism known in the art capable of providing sufficient light under the robot 10 for illuminating the line segment 12.
- the light source 26 includes three light emitting devices (LEDs) positioned adjacent a peripheral portion of the chassis 20.
- LEDs light emitting devices
- the number and position of the LEDs or equivalent lighting mechanisms may be varied without departing from the scope of the present invention. For instance, some embodiments may include fewer than three LEDs, while other embodiments may include more than three LEDs.
- the threshold luminance is approximately equal to 80-120 cd/m 2 (80-120 nits), and preferably approximately equal to 100 cd/m 2 (100 nits). Therefore, in an embodiment wherein the threshold luminance is equal to 100 cd/m 2 (100 nits), if the luminance of the detected light is below 100 cd/m2 (100 nits), the light source 26 will automatically be placed in the ON state to direct light away from the first surface 22 and toward the base surface 14. However, if the luminance of the detected light at any time exceeds 100 cd/ m2 (100 nits), the light source 26 will automatically transition to the OFF state to cease light emission.
- threshold luminance 80-120 cd/m2 (80-120 nits) as an exemplary threshold luminance range
- 80 cd/m2 80-120 nits
- other embodiments may define the threshold luminance as being less than 80 cd/m2 (80 nits) or greater than 120 cd/m2 (120 nits).
- the toy robot 10 includes a control unit 28 (see Figure 5 ) coupled to the chassis 20 and in operative communication with the light meter 24 and the light source 26.
- the control unit 28 is configured to transition the light source 26 to the ON state in response to the luminance level of the detected light being below a threshold luminance and to the OFF state in response to the luminance level of the detected light being above the threshold luminance.
- the toy robot 10 further includes a line sensor 30 (see Figures 3 and 5 ) coupled to the chassis 20 and configured to sense a line segment 12 on the base surface 14.
- the line sensor 30 employs optical technology to discern different optical characteristics between the line segment 12 and the remainder of the base surface 14. The discerned optical difference is generally representative of the boundary between the line segment 12 and the background color or display.
- the line segment 12 is defined by a line color.
- the line segment 12 is displayed with a background color depicted on the base surface 14 immediately adjacent to the line segment 12, wherein the line color and the background color are different.
- the line sensor 30 may be sized and configured to sense the line segment 12 based upon a color difference of the line color and the background color.
- the line segment 12 is defined by a line pixel variance value.
- the line segment 12 is displayed with a background pixel variance value immediately adjacent to the line segment 12, wherein the line pixel variance value and the background pixel variance value are different.
- the line sensor 30 may be sized and configured to sense the line segment 12 based upon a pixel variance value difference of the line pixel variance value and the background pixel variance.
- the line sensor 30 may be positioned in various locations on the robot 10 without departing from the spirit and scope of the present invention. Although the exemplary embodiment shows the line sensor 30 positioned between the movement mechanism 32 and the light source 26, it is understood that other embodiments may include the line sensor 30 in other locations. For instance, one particular implementation may include the line sensor 30 positioned proximate, and in the same vicinity as the light source(s) 26.
- a movement mechanism 32 is coupled to the chassis 20 and is placeable on the base surface 14.
- the movement mechanism 32 is in operative communication with the line sensor 30 to move on the base surface 14 in a pattern corresponding to the line segment 12 sensed on the base surface 14.
- the movement mechanism 32 includes at least one wheel, and preferably a plurality of wheels.
- the plurality of wheels may be driven by a drive mechanism, which may be a "wind-up" type drive mechanism, wherein a user winds a shaft or pushes the device in reverse to wind the drive mechanism.
- the drive mechanism may be electrically powered.
- the robot 10 may be primarily supported by the wheels 32, although the chassis 20 may include an auxiliary support 35 for balancing the robot 10 as it moves.
- the auxiliary support 35 may come in contact with the base surface 14 if the robot 10 tips toward the auxiliary support.
- the robot 10 may be turned via a wheel connected to a pivotable axle.
- the pivoting axle may be part of a steering module 37, which is controlled by the control unit 28.
- the control unit 28 may transmit commands to the steering module 37 to pivot the axle in response to a detected turn in the line segment 12 to guide the robot 10 along the line segment 12.
- the steering module 38 may be in direct communication with the drive wheels, such that turning is controlled by varying the output of wheels. For instance, if the robot 10 includes a pair of wheels, power may be increased to one wheel and decreased to the other wheel to create a differential which results in turning/steering of the robot 10. Other steering/turning mechanisms known in the art may also be employed.
- the movement mechanism 32 may include one or more rotating tracks, similar to a tank.
- the movement mechanism may employ a propeller, similar to a hovercraft, for moving the robot 10.
- the robot 10 may optionally include an end cap 39 connectable to the chassis 20 and/or housing 25 to cover the first surface 22 and the movement mechanism 32.
- the end cap 39 may be used to protect the light source 26, line sensor 30, light meter 24, and movement mechanism 32 during periods of non-use.
- the toy robot 10 may additionally include a power device 34, such as an onboard battery, in operative communication with the light meter 24, the light source 26, and the line sensor 30.
- the power device 34 may be configured to store and provide electrical power to the light meter 24, the light source 26 and the line sensor 30.
- the power device 34 may be in operative communication therewith and operative to store and provide electrical power thereto.
- the power device 34 is configured to cease power transmission to the light meter 24, the light source 26, the line sensor 30 and the movement mechanism 32 in response to inactivity for a preset time period.
- the preset period of time may be in the range from 30-60 seconds, and preferably 45 seconds; although those skilled in the art will readily appreciate that the preset period of time may be less than 30 seconds or greater than 60 seconds without departing from the spirit and scope of the present invention.
- the power device 34 may be configured to cease power to the various components receiving power therefrom, such as the light meter 24, the light source 26, and the line sensor 30.
- the power device 34 may be in electrical communication with the movement mechanism 32, in which case, the power device 34 may cease power thereto in response to inactivity for a period of time exceeding the threshold.
- the toy robot 10 includes a power port 36 in operative communication with the power device 34.
- the power port 36 is configured to be connectable with an external power source 38 for recharging the power device 34.
- the power port 36 may be a USB port capable of receiving a USB connector 38 for charging the power device 34.
- Other ports having a size and configuration that differ from a USB port may also be used.
- the preferred embodiment includes a rechargeable power device 34, it is contemplated that other embodiments of the robot 10 employ replaceable batteries as the power device 34.
- the toy robot 10 may additionally include an indicator light 40 coupled to the chassis 20 and in operative communication with the control unit 28.
- the indicator light 40 may be configured to emit light signals representative of one or more operating conditions. For instance, the indicator light 40 may emit a first signal corresponding to the power level of the power device 34. For instance, the first signal may be brighter when the power level of the power device 34 is high, and dimmer when the power level of the power device 34 is low. Furthermore, the indicator light 40 may emit a second signal when the toy robot 10 is moving and a third signal when the toy robot 10 is stationary, wherein the second signal differs from the third signal.
- the second signal may include a blinking signal, wherein the frequency of the signal corresponds to the speed of the toy robot 10, i.e., as the robot 10 moves faster, the frequency increases, and vice versa.
- the third signal may be a constant signal, either constantly ON or OFF, to differentiate from the second signal.
- the various signals emitted by the indicator light 40 may vary not only by frequency and brightness (as noted above), but also by color.
- the indicator light 40 may include one or more light emitting devices (LEDs) capable of generating light signals in several different colors.
- the toy robot 10 may further include a communications port 42 for programming the toy robot 10.
- the communications port 42 may be capable of receiving programming instructions from a programming device, such as a computer, smart phone, tablet computer or other programming devices known in the art.
- a programming device such as a computer, smart phone, tablet computer or other programming devices known in the art.
- the algorithm which governs the path chosen by the toy robot 10 may also be modified through programming. For instance, if the line segment 12 reaches an intersection or branches off to form a fork or "Y" in the line segment 12, the toy robot 10 may be programmed to assign a specific instruction when the toy robot 10 has more than two options (i.e., more than one line segment 12 which it may follow). The toy robot 10 may be programmed to randomly follow one of line segment options. Alternatively, the toy robot 10 may be programmed to always turn right, when possible, or always turn left, when possible, or to alternate between turning right and left. Furthermore, the device may be programmed to go straight, if possible, but if not possible to turn either right or left. It may also be possible to program the device 10 to reverse direction under certain conditions (i.e., reach the end of the line or an intersection). The robot 10 may be pre-programmed to follow default commands, which may be superseded by subsequent programming.
- the display screen may depict one or more command signals readable by the line sensor 30 for steering the robot 10.
- the exemplary command signals include five boxes which are either filled in, or left blank to generate an optical command signal. For instance, if all of the boxes are blank, the robot may stop. If only the left-most box is filled in, the robot 10 may be instructed to take the left-most turn when it reaches an intersection. If only the center-left box is filled, the robot 10 may take a fork to the left when it approaches a fork. If only the center box is filled in, the robot 10 may speed-up.
- the robot 10 may take a fork to the right when it approaches a fork. If only the right-most box is filled in, the robot 10 may take a right turn when it reaches an intersection.
- the aforementioned commands are exemplary in nature only, and are not intended to limit the scope of the present invention.
- the optical commands are not limited to square boxes; other shapes may also be used in other embodiments.
- optical commands may be represented via different color schemes which form part of the line segment 12. In this regard, a yellow line segment may represent a first command, while a red line segment may represent a second, different command.
- the robot 10 may be configured to read the various commands depicted on the display screen.
- the line sensor 30 may be configured to sense or read the various optical signals
- the control unit 28 may include processing capability to understand the various signals and generate instructions for the movement mechanism 32 and the steering module 37. It is contemplated that the software for recognizing the various optical commands may be updated on the control unit 28 as needed.
- the communications port 42 may be configured to connect with a programming device via a cable 38 to facilitate wired communication between the toy robot 10 and the programming device.
- the communications port 42 is shared with the power port 36, and more specifically, a single USB port which connects with a USB cable to simultaneously recharge the power device 34 and program the toy robot 10.
- the communications port 42 is a wireless port configured to receive a wireless signal from the programming device.
- the wireless programming port may not be externally visible, and may be contained with the housing of the toy robot 10.
- the robot 10 may include an ON/OFF switch or button 44 to allow a user to turn the robot 10 ON or OFF.
- the ON/OFF button 44 may be externally located to allow the user to easily press the ON/OFF button 44 as desired.
- the robot 10 includes a speaker 46 to emit audible signals during operation of the robot 10.
- the speaker 46 may play songs, communicate instructions, or simply emit "beeps.”
- the audible signals may correspond to movement of the robot 10 (i.e., frequency of beep increases as speed increases), the power level, the mode of operation (i.e., always turn left when the robot 10 reaches an intersection), etc.
- the speaker 46 is in operative communication with the control unit 28, and thus, the audible signals emitted by the speaker 46 may be programmed via connection of a programming device to the communications port 42.
- the digital display may be configured to generate the line segment 12 to allow the toy robot 10 to move on the digital display, wherein the movement of the toy robot 10 corresponds to the pattern of the line segment 12 generated by the digital display.
- the digital display may include any device capable of generating a digital image of the line segment 12.
- the digital display may include a mobile computing device, such as a smart phone, PDA, tablet computer, hand-held video game unit, etc.
- the digital display may also include a smooth flat display surface, typically fabricated from glass, plastic, or the like, which covers the digital screen.
- the line segment 12 may be extended on the digital display, such that when the toy robot 10 is placed on the digital display, the line segment 12 is sensed and the toy robot 10 automatically moves along the line segment 12.
- the digital display may be a touch screen, wherein the digital display is capable of detecting physical contact between the toy robot 10 and the display surface and extending/generating the line segment 12 in response to the detected physical contact with the display surface.
- the digital display and the toy robot 10 may be in wireless communication with each other, such that when the digital display receives a wireless signal indicating that the toy robot 10 is within an operative range, the display surface extends/generates the line segment in response to receiving the wireless signal from the toy robot 10.
- both the digital display and the toy robot 10 may include sufficient transceiving hardware and software to implement the aforementioned wireless detection.
- the digital display may include software for generating the line segment 12 thereon.
- the software may be downloadable onto the digital display as a downloadable application, i.e., "app.”
- the app may be available for purchase, or alternatively, offered at no cost to the user.
- the app. may be relatively simple and merely generate line segments 12 on the display screen for the robot 10 to follow. Conversely, the app. may be more sophisticated and generate line segments 12 in connection with an activity or game. For instance, the line segments 12 may be constructed with one or more puzzle pieces 48 (see Figures 6 and 7 ) which may be selectively arranged on the display screen to construct a unique line segment 12. Alternatively, the app. may generate a maze-like line segment configuration (see Figure 8 ) for the robot 10 to explore.
- the app. may be more of an educational app., wherein a player is quizzed with questions and the line segment 12 is generated when the child answers correctly.
- the app. may not only display the line segment 12 of the primary user, but also the line segment 12 of a competing user, which may be located in a remote location.
- the line segment 12a associated with the primary user is shown on the top or upper potion of the digital display, while the line segment 12b and robot icon 50 of the competing player is shown on the bottom or lower portion of the display screen.
- the position of the respective robots 10 may be determined via the touch screen feature of the display screen or via wireless communication between the robots 10 and the respective display screens.
- the robot 10 adds an entertaining feature to conventional smart phones, tablet computers, and the like, in that it provides a concrete, three-dimensional accessory which moves relative to the computing device when a child plays with the computing device. In this regard, the child is not simply engaged with the two-dimensional display screen provided by the computing device. Rather, the robot 10 provides a three-dimensional entertainment unit which is more entertaining for the child.
- the entertainment provided by the robot 10 may be enhanced by providing a character accessory which may be engaged with the robot 10.
- the child's favorite hero, princess, animal, etc. may be adapted as a covering which fits over the housing 25 to couple the covering to the housing 25, such that when the robot 10 moves, the covering moves.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Electromagnetism (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Toys (AREA)
Description
- The present invention relates generally to a toy robot, and more specifically to a toy robot configured to move in a direction corresponding to a line on a base surface, the toy robot further being configured to operatively transition between use on a digital display and a non-digital display.
- Those skilled in the art will readily appreciate that there has been a recent widespread proliferation of smart phones and tablet computers. Approximately half of the mobile phone consumers in the United States own a smart phone, and it is projected that by 2013, smart phones could account for around 70% of all U.S. mobile devices. With regard to tablet computers, approximately 31% of Internet users in the United States are believed to own a tablet computer.
- Smart phones and tablet computers are typically compact in size relative to a conventional desktop computer, and include a touch screen display which a user may use to input commands. Smart phones generally define a slightly smaller form factor relative to tablet computers, and thus, the display screen on a smart phone is typically smaller than the display screen on a conventional tablet computer.
- Smart phones and tablet computers generally include sufficient computing capability to allow games, educational tools and the like to be played and operated thereon. Several games and educational tools (collectively referred to herein as applications or "apps.") may be downloaded onto the smart phones and tablet computers via the Internet. Due to the compact size of both smart phones and tablet computers, such devices may be easily transported for use in almost any location. For instance, smart phones and tablet computers may be used in the car during road trips, on airplanes, in waiting rooms, or even around the house. In view of the ease in transporting the devices, smart phones and tablet computers are readily used by children of all ages for entertainment and educational purposes.
-
JP2006340853A -
US5596255A discloses a self-propelled electronic device in the form of a microrobot, according to the preamble ofclaim 1. - One deficiency commonly associated with games and educational tools for smart phones and tablet computers is that the entirety of the game is contained within the screen of the smart phone or tablet computer. In other words, the game is two-dimensional. Thus, children may quickly become bored or disinterested in the game since there is no tangible aspect to the game, other than the smart phone or tablet computer, which the child can touch or see.
- Therefore, there is a need in the art for an improved accessory configured for use with a smart phone and/or tablet computer that provides additional entertainment value and interest to a child playing a game or using an educational tool. Various aspects of the present invention address these particular needs, as will be discussed in more detail below.
- There is provided a method of providing a visual progress indicator. The method includes providing a digital display including a smooth flat display surface. The method further includes placing a self-propelled electronic device upon the display surface and electronically displaying a line segment upon the display surface. The line segment is sensed using the device, and the device is automatically moved along the line segment in response to sensing the line segment.
- Various aspects of the present invention allow for use of a self-propelled electronic device on the surface of a digital display. The digital display is configured to generate a line segment along which the self-propelled electronic device moves. The electronic device may be a toy robot which travels along the surface of the electronic device to provide entertainment to a child. The movement of the electronic device may be associated with a game or as part of a learning tool.
- The digital display may be a mobile computing device. The line segment displayed by the digital display may be defined by a line color, wherein the line segment is displayed with a background color immediately adjacent to the line segment, where the line color is different than the background color. The line segment may also be defined by a line pixel variance value. The line segment may be displayed with a background pixel variance value immediately adjacent to the line segment, wherein the line pixel variance value and the background pixel variance value are different.
- The electronic device may include a line sensor, which may include a phototransistor element. The line sensor may be sized and configured to sense the line segment based upon a color difference of the line color and the background color. The line sensor may also be sized and configured to sense the line segment based upon a pixel variance value difference of the line pixel variance value and the background pixel variance.
- The method may further include extending the line segment and sensing the extended line segment using the electronic device. The method may further include automatically moving the electronic device along the extended line segment.
- The digital display may be a touch screen, and the method may additionally include detecting physical contact with the display surface, extending the line segment in response to the detected physical contact with the display surface, and sensing the extended line segment using the device.
- According to another aspect of the present invention, there is provided a self-propelled electronic device for use on a base surface. The electronic device includes a chassis disposable over the base surface. The chassis includes a first surface facing the base surface when the chassis is disposed over the base surface. A light meter is coupled to the chassis and is configured to detect light incident toward the first surface and determine a luminance level of the detected light. A light source is also coupled to the chassis and is configured to selectively transition between an ON state to emit light away from the first surface and an OFF state to not emit any light. A control unit is coupled to the chassis and is in operative communication with the light meter and the light source. The control unit is configured to transition the light source to the ON state in response to the luminance level of the detected light being below a threshold luminance and to the OFF state in response to the luminance level of the detected light being above the threshold luminance. A line sensor is coupled to the chassis and is configured to sense a line segment on the base surface. A movement mechanism is coupled to the chassis and is placeable on the base surface. The movement mechanism is in operative communication with the line sensor to move on the base surface in a pattern corresponding to the line sensed on the base surface.
- Various aspects of the self-propelled electronic device are directed toward allowing the electronic device to seamlessly transition from use on a light emitting base surface (such as an iPad™) to use on a non-emitting base surface, such as a desk or table. The electronic device includes a light meter to monitor the brightness of the light under the chassis, such that when the brightness is low (as may be the case when the electronic device is placed on a table), the light source is turned ON to illuminate the base surface. When the brightness is high, the light source is turned OFF so as not to wash out the line depicted on the base surface.
- The electronic device may include a power device in operative communication with the light meter, the light source, and the line sensor. The power device may be configured to store and provide electrical power to the light meter, the light source and the line sensor. The power device may be configured to cease power transmission to the light meter, the light source, the line sensor and the movement mechanism in response to inactivity for a preset time period.
- The present invention is best understood by reference to the following detailed description when read in conjunction with the accompanying drawings.
- These and other features and advantages of the various embodiments disclosed herein will be better understood with respect to the following description and drawings, in which like numbers refer to like parts throughout, and in which:
-
Figure 1 is an upper perspective view of an embodiment of a toy robot configured to move in a direction corresponding to a line on a base surface; -
Figure 2 is a side view of the toy robot shown inFigure 1 , with a case coupled to a lower end portion thereof; -
Figure 3 is a bottom view of the toy robot depicted inFigure 1 ; -
Figure 4 is an upper perspective view of the toy robot depicted inFigure 1 placed on a display surface of a computing device; -
Figure 5 is a schematic view of several electrical components incorporated into an embodiment of the toy robot; -
Figure 6 is a top view of a computing device depicting a line segment defined by a pair of selectively positional puzzle pieces; -
Figure 7 is a top view of a computing device depicting a line segment defined by four selectively positional puzzle pieces; -
Figure 8 is a top view of a computing device depicting a line segment in a maze-like configuration; -
Figure 9 is a top view of a computing device depicting an educational game for defining a line segment along which the toy robot may move; -
Figure 10 is an upper perspective view of a table having a line segment depicted thereon; -
Figure 11 is a side view of the toy robot on the table, wherein the toy robot includes a light source to illuminate the line depicted in the table; and -
Figure 12 is a schematic diagram of exemplary line commands readable and executable by the toy robot for controlling the movement of the robot. - Common reference numerals are used throughout the drawings and detailed description to indicate like elements.
- The detailed description set forth below is intended as a description of the presently preferred embodiment of the invention, and is not intended to represent the only form in which the present invention may be constructed or utilized. The description sets forth the functions and sequences of steps for constructing and operating the invention. It is to be understood, however, that the same or equivalent functions and sequences may be accomplished by different embodiments and that they are also intended to be encompassed within the scope of the invention.
- Referring now to the drawings, wherein the showings are for purposes of illustrating preferred embodiments of the present invention only, and are not for purposes of limiting the same,
Figures 1-3 generally depict an embodiment of a self-propelled electronic device, i.e., atoy robot 10, configured to follow a line segment 12 (seeFigure 4 ) appearing on a base surface 14 (seeFigure 4 ). Thebase surface 14 may be the display screen of an electronic computing device 16 (seeFigure 4 ), such as a smart phone or tablet computer, or alternatively, thebase surface 14 may include the top of a table/desk 18 (seeFigure 10 ). In this regard, thetoy robot 10 may be configured for use with devices which emit light (such as a tablet computer) as well as objects which simply reflect light (such as a table or counter). For purposes of the following discussion, devices which emit light will be referred to herein as "self-emitting devices," whereas objects which do not emit light and instead, simply reflect light will be referred to herein as "non-emitting objects." Various aspects of the present invention are directed toward facilitating seamless transition of thetoy robot 10 between use on the surface of the self-emittingdevice 16, and the surface of thenon-emitting object 18. - The
toy robot 10 includes achassis 20 including a first surface 22 (i.e., outer surface) and a second surface (i.e., inner surface). When therobot 10 is disposed on thebase surface 14, thefirst surface 22 of thechassis 20 is disposed in spaced relation to the base surface 14 (seeFigure 11 ) and is oriented in a manner wherein thefirst surface 22 is facing thebase surface 14. As will be discussed in more detail below, therobot 10 includes a movement mechanism, i.e., wheels, which is placed directly on thebase surface 14 and causes thefirst surface 22 to be spaced from thebase surface 14. - The
robot 10 additionally includes ahousing 25 coupled to thechassis 20. In the exemplary embodiment, thehousing 25 defines a generally rounded configuration, although other configurations may be defined in other implementations of the present invention. Thehousing 25 andchassis 20 collectively define an inner compartment which houses several of the control and power components described below. Thehousing 25 andchassis 20 may be fabricated from plastic, rubber or other materials commonly used in the art. - The
toy robot 10 additionally includes alight meter 24 coupled to thechassis 20 and configured to detect light incident toward thefirst surface 22 of thechassis 20 for determining a luminance level of the detected light. As used herein, the phrase "light incident toward thefirst surface 22 of thechassis 20" refers to light traveling toward thefirst surface 22, including light emitted from a self-emitting device, as well as light reflected from a non-emitting object. Light emitted from an illuminatedbase surface 14, such as the surface of an iPad™, may travel toward thefirst surface 22 when therobot 10 is placed on thebase surface 14. Thus, light emitted from the iPad™ may be "light incident toward thefirst surface 22 of thechassis 20." Furthermore, it is also contemplated that when thetoy robot 10 is placed on anon-illuminated surface 18, such as a desk or table, light may reflect off the surface of the desk or table and travel toward thefirst surface 22, and thus, may be "light incident toward thefirst surface 22 of thechassis 20." - Those skilled in the art will readily appreciate that the luminance level of the light incident toward the
first surface 22 will vary according to several different factors. One significant factor is whether thebase surface 14 is part of a self-emittingdevice 16 or conversely, part of anon-emitting object 18. The luminance level of the light incident on thefirst surface 22 will, in most cases, be greater when thebase surface 14 is part of a self-emittingdevice 16, rather than when thebase surface 14 is part of anon-emitting object 18. - If the luminance level is too low, it may be difficult for the
toy robot 10 to detect theline segment 12 on thebase surface 14. Therefore, thetoy robot 10 includes a light source 26 (seeFigures 3 ,5 , and11 ) coupled to thechassis 20 for illuminating theline segment 12 on the base surface. Thelight source 26 is configured to selectively transition between an ON state to emit light away from thefirst surface 22, and an OFF state to not emit any light. Referring now specifically toFigure 11 , when the luminance level is too low, thelight source 26 may be in the ON state to direct light toward thebase surface 14 for making it easier to detect the line segment thereon. Conversely, when the luminance level is above a sufficient level, thelight source 26 is turned into the OFF state so as not to emit any light to avoid washing out the line segment on thebase surface 14. - In this regard, it is contemplated that a user may place the
robot 10 on a self-emitting device to follow aline segment 12 depicted thereon. Subsequently, the user may lift therobot 10 from the self-emitting device and place therobot 10 on a non-emitting object to follow aseparate line segment 12 depicted thereon. When therobot 10 is on the self-emitting device, the luminance level is typically above the threshold, and thus, thelight source 26 is in the OFF state. However, when the user places therobot 10 on the non-emitting surface, the luminance level is typically below the threshold, and thus, thelight source 26 transitions to the ON state. - In the reverse scenario, i.e., when the
robot 10 is lifted from a non-emitting object and placed on a self-emitting device, thelight source 26 typically transitions from the ON state to the OFF state since the luminance level typically increases from below the threshold to above the threshold. - The
light source 26 may include any lighting mechanism known in the art capable of providing sufficient light under therobot 10 for illuminating theline segment 12. In the exemplary embodiment depicted inFigure 3 , thelight source 26 includes three light emitting devices (LEDs) positioned adjacent a peripheral portion of thechassis 20. However, the number and position of the LEDs or equivalent lighting mechanisms may be varied without departing from the scope of the present invention. For instance, some embodiments may include fewer than three LEDs, while other embodiments may include more than three LEDs. - According to one implementation, the threshold luminance is approximately equal to 80-120 cd/m2 (80-120 nits), and preferably approximately equal to 100 cd/m2 (100 nits). Therefore, in an embodiment wherein the threshold luminance is equal to 100 cd/m2 (100 nits), if the luminance of the detected light is below 100 cd/m2 (100 nits), the
light source 26 will automatically be placed in the ON state to direct light away from thefirst surface 22 and toward thebase surface 14. However, if the luminance of the detected light at any time exceeds 100 cd/ m2 (100 nits), thelight source 26 will automatically transition to the OFF state to cease light emission. Although the foregoing lists 80-120 cd/m2 (80-120 nits) as an exemplary threshold luminance range, those skilled in the art will readily appreciate that other embodiments may define the threshold luminance as being less than 80 cd/m2 (80 nits) or greater than 120 cd/m2 (120 nits). - According to one embodiment, the
toy robot 10 includes a control unit 28 (seeFigure 5 ) coupled to thechassis 20 and in operative communication with thelight meter 24 and thelight source 26. Thecontrol unit 28 is configured to transition thelight source 26 to the ON state in response to the luminance level of the detected light being below a threshold luminance and to the OFF state in response to the luminance level of the detected light being above the threshold luminance. - The
toy robot 10 further includes a line sensor 30 (seeFigures 3 and5 ) coupled to thechassis 20 and configured to sense aline segment 12 on thebase surface 14. Theline sensor 30 employs optical technology to discern different optical characteristics between theline segment 12 and the remainder of thebase surface 14. The discerned optical difference is generally representative of the boundary between theline segment 12 and the background color or display. - According to an embodiment, the
line segment 12 is defined by a line color. In that case, theline segment 12 is displayed with a background color depicted on thebase surface 14 immediately adjacent to theline segment 12, wherein the line color and the background color are different. Theline sensor 30 may be sized and configured to sense theline segment 12 based upon a color difference of the line color and the background color. - According to another embodiment, the
line segment 12 is defined by a line pixel variance value. In that case, theline segment 12 is displayed with a background pixel variance value immediately adjacent to theline segment 12, wherein the line pixel variance value and the background pixel variance value are different. Theline sensor 30 may be sized and configured to sense theline segment 12 based upon a pixel variance value difference of the line pixel variance value and the background pixel variance. - The
line sensor 30 may be positioned in various locations on therobot 10 without departing from the spirit and scope of the present invention. Although the exemplary embodiment shows theline sensor 30 positioned between themovement mechanism 32 and thelight source 26, it is understood that other embodiments may include theline sensor 30 in other locations. For instance, one particular implementation may include theline sensor 30 positioned proximate, and in the same vicinity as the light source(s) 26. - A
movement mechanism 32 is coupled to thechassis 20 and is placeable on thebase surface 14. Themovement mechanism 32 is in operative communication with theline sensor 30 to move on thebase surface 14 in a pattern corresponding to theline segment 12 sensed on thebase surface 14. According to one embodiment, themovement mechanism 32 includes at least one wheel, and preferably a plurality of wheels. The plurality of wheels may be driven by a drive mechanism, which may be a "wind-up" type drive mechanism, wherein a user winds a shaft or pushes the device in reverse to wind the drive mechanism. Alternatively, the drive mechanism may be electrically powered. Referring now specifically toFigures 2 and 3 , therobot 10 may be primarily supported by thewheels 32, although thechassis 20 may include anauxiliary support 35 for balancing therobot 10 as it moves. In this regard, theauxiliary support 35 may come in contact with thebase surface 14 if therobot 10 tips toward the auxiliary support. - The
robot 10 may be turned via a wheel connected to a pivotable axle. The pivoting axle may be part of asteering module 37, which is controlled by thecontrol unit 28. In particular, thecontrol unit 28 may transmit commands to thesteering module 37 to pivot the axle in response to a detected turn in theline segment 12 to guide therobot 10 along theline segment 12. In another embodiment, thesteering module 38 may be in direct communication with the drive wheels, such that turning is controlled by varying the output of wheels. For instance, if therobot 10 includes a pair of wheels, power may be increased to one wheel and decreased to the other wheel to create a differential which results in turning/steering of therobot 10. Other steering/turning mechanisms known in the art may also be employed. - Although the foregoing describes the exemplary embodiment of the
movement mechanism 32 as including wheels, it is contemplated that other movement elements may be incorporated into themovement mechanism 32. For instance, in one embodiment, the movement elements may include one or more rotating tracks, similar to a tank. In another embodiment, the movement mechanism may employ a propeller, similar to a hovercraft, for moving therobot 10. - Referring now specifically to
Figure 2 , therobot 10 may optionally include anend cap 39 connectable to thechassis 20 and/orhousing 25 to cover thefirst surface 22 and themovement mechanism 32. Theend cap 39 may be used to protect thelight source 26,line sensor 30,light meter 24, andmovement mechanism 32 during periods of non-use. - The
toy robot 10 may additionally include apower device 34, such as an onboard battery, in operative communication with thelight meter 24, thelight source 26, and theline sensor 30. Thepower device 34 may be configured to store and provide electrical power to thelight meter 24, thelight source 26 and theline sensor 30. In embodiments having an electric drive mechanism and steering module for driving themovement mechanism 32, thepower device 34 may be in operative communication therewith and operative to store and provide electrical power thereto. - According to one embodiment, the
power device 34 is configured to cease power transmission to thelight meter 24, thelight source 26, theline sensor 30 and themovement mechanism 32 in response to inactivity for a preset time period. For instance, the preset period of time may be in the range from 30-60 seconds, and preferably 45 seconds; although those skilled in the art will readily appreciate that the preset period of time may be less than 30 seconds or greater than 60 seconds without departing from the spirit and scope of the present invention. If there is no movement for the preset time period, thepower device 34 may be configured to cease power to the various components receiving power therefrom, such as thelight meter 24, thelight source 26, and theline sensor 30. In some cases, thepower device 34 may be in electrical communication with themovement mechanism 32, in which case, thepower device 34 may cease power thereto in response to inactivity for a period of time exceeding the threshold. - According to various aspects of the present invention, the
toy robot 10 includes apower port 36 in operative communication with thepower device 34. Thepower port 36 is configured to be connectable with anexternal power source 38 for recharging thepower device 34. Thepower port 36 may be a USB port capable of receiving aUSB connector 38 for charging thepower device 34. Other ports having a size and configuration that differ from a USB port may also be used. Although the preferred embodiment includes arechargeable power device 34, it is contemplated that other embodiments of therobot 10 employ replaceable batteries as thepower device 34. - The
toy robot 10 may additionally include anindicator light 40 coupled to thechassis 20 and in operative communication with thecontrol unit 28. Theindicator light 40 may be configured to emit light signals representative of one or more operating conditions. For instance, theindicator light 40 may emit a first signal corresponding to the power level of thepower device 34. For instance, the first signal may be brighter when the power level of thepower device 34 is high, and dimmer when the power level of thepower device 34 is low. Furthermore, theindicator light 40 may emit a second signal when thetoy robot 10 is moving and a third signal when thetoy robot 10 is stationary, wherein the second signal differs from the third signal. The second signal may include a blinking signal, wherein the frequency of the signal corresponds to the speed of thetoy robot 10, i.e., as therobot 10 moves faster, the frequency increases, and vice versa. The third signal may be a constant signal, either constantly ON or OFF, to differentiate from the second signal. - According to other implementations, the various signals emitted by the
indicator light 40 may vary not only by frequency and brightness (as noted above), but also by color. In this regard, theindicator light 40 may include one or more light emitting devices (LEDs) capable of generating light signals in several different colors. - The
toy robot 10 may further include acommunications port 42 for programming thetoy robot 10. Thecommunications port 42 may be capable of receiving programming instructions from a programming device, such as a computer, smart phone, tablet computer or other programming devices known in the art. There may be several aspects of thetoy robot 10 capable of being modified via programming instructions. For instance, the various signals emitted by theindicator light 40 may be changed or assigned via programming instructions. Furthermore, the preset time period at which thepower device 34 ceases power transmission may also be altered or modified through programming. - The algorithm which governs the path chosen by the
toy robot 10 may also be modified through programming. For instance, if theline segment 12 reaches an intersection or branches off to form a fork or "Y" in theline segment 12, thetoy robot 10 may be programmed to assign a specific instruction when thetoy robot 10 has more than two options (i.e., more than oneline segment 12 which it may follow). Thetoy robot 10 may be programmed to randomly follow one of line segment options. Alternatively, thetoy robot 10 may be programmed to always turn right, when possible, or always turn left, when possible, or to alternate between turning right and left. Furthermore, the device may be programmed to go straight, if possible, but if not possible to turn either right or left. It may also be possible to program thedevice 10 to reverse direction under certain conditions (i.e., reach the end of the line or an intersection). Therobot 10 may be pre-programmed to follow default commands, which may be superseded by subsequent programming. - It is also contemplated that steering or movement of the
robot 10 may be controlled via codes which form part of theline segment 12 or are located adjacent theline segment 12. Referring now specifically toFigure 12 , the display screen may depict one or more command signals readable by theline sensor 30 for steering therobot 10. The exemplary command signals include five boxes which are either filled in, or left blank to generate an optical command signal. For instance, if all of the boxes are blank, the robot may stop. If only the left-most box is filled in, therobot 10 may be instructed to take the left-most turn when it reaches an intersection. If only the center-left box is filled, therobot 10 may take a fork to the left when it approaches a fork. If only the center box is filled in, therobot 10 may speed-up. If the right-center box is filled, therobot 10 may take a fork to the right when it approaches a fork. If only the right-most box is filled in, therobot 10 may take a right turn when it reaches an intersection. The aforementioned commands are exemplary in nature only, and are not intended to limit the scope of the present invention. Furthermore, the optical commands are not limited to square boxes; other shapes may also be used in other embodiments. In addition, optical commands may be represented via different color schemes which form part of theline segment 12. In this regard, a yellow line segment may represent a first command, while a red line segment may represent a second, different command. - The
robot 10 may be configured to read the various commands depicted on the display screen. In this regard, theline sensor 30 may be configured to sense or read the various optical signals, and thecontrol unit 28 may include processing capability to understand the various signals and generate instructions for themovement mechanism 32 and thesteering module 37. It is contemplated that the software for recognizing the various optical commands may be updated on thecontrol unit 28 as needed. - The
communications port 42 may be configured to connect with a programming device via acable 38 to facilitate wired communication between thetoy robot 10 and the programming device. In the exemplary embodiment, thecommunications port 42 is shared with thepower port 36, and more specifically, a single USB port which connects with a USB cable to simultaneously recharge thepower device 34 and program thetoy robot 10. In an alternatively embodiment, thecommunications port 42 is a wireless port configured to receive a wireless signal from the programming device. In this regard, the wireless programming port may not be externally visible, and may be contained with the housing of thetoy robot 10. - The
robot 10 may include an ON/OFF switch orbutton 44 to allow a user to turn therobot 10 ON or OFF. The ON/OFF button 44 may be externally located to allow the user to easily press the ON/OFF button 44 as desired. - According to one embodiment, the
robot 10 includes aspeaker 46 to emit audible signals during operation of therobot 10. Thespeaker 46 may play songs, communicate instructions, or simply emit "beeps." For instance, the audible signals may correspond to movement of the robot 10 (i.e., frequency of beep increases as speed increases), the power level, the mode of operation (i.e., always turn left when therobot 10 reaches an intersection), etc. Thespeaker 46 is in operative communication with thecontrol unit 28, and thus, the audible signals emitted by thespeaker 46 may be programmed via connection of a programming device to thecommunications port 42. - Although the foregoing discussion focuses on the
robot 10 itself, various aspects of the present invention are directed toward configuring a digital display for use with thetoy robot 10. In this regard, the digital display may be configured to generate theline segment 12 to allow thetoy robot 10 to move on the digital display, wherein the movement of thetoy robot 10 corresponds to the pattern of theline segment 12 generated by the digital display. As noted above, the digital display may include any device capable of generating a digital image of theline segment 12. In this regard, the digital display may include a mobile computing device, such as a smart phone, PDA, tablet computer, hand-held video game unit, etc. The digital display may also include a smooth flat display surface, typically fabricated from glass, plastic, or the like, which covers the digital screen. - The
line segment 12 may be extended on the digital display, such that when thetoy robot 10 is placed on the digital display, theline segment 12 is sensed and thetoy robot 10 automatically moves along theline segment 12. It is contemplated that the digital display may be a touch screen, wherein the digital display is capable of detecting physical contact between thetoy robot 10 and the display surface and extending/generating theline segment 12 in response to the detected physical contact with the display surface. - It is additionally contemplated that the digital display and the
toy robot 10 may be in wireless communication with each other, such that when the digital display receives a wireless signal indicating that thetoy robot 10 is within an operative range, the display surface extends/generates the line segment in response to receiving the wireless signal from thetoy robot 10. As such, both the digital display and thetoy robot 10 may include sufficient transceiving hardware and software to implement the aforementioned wireless detection. - The digital display may include software for generating the
line segment 12 thereon. According to one implementation, the software may be downloadable onto the digital display as a downloadable application, i.e., "app." The app may be available for purchase, or alternatively, offered at no cost to the user. - The app. may be relatively simple and merely generate
line segments 12 on the display screen for therobot 10 to follow. Conversely, the app. may be more sophisticated and generateline segments 12 in connection with an activity or game. For instance, theline segments 12 may be constructed with one or more puzzle pieces 48 (seeFigures 6 and 7 ) which may be selectively arranged on the display screen to construct aunique line segment 12. Alternatively, the app. may generate a maze-like line segment configuration (seeFigure 8 ) for therobot 10 to explore. - Referring now specifically to
Figure 9 , the app. may be more of an educational app., wherein a player is quizzed with questions and theline segment 12 is generated when the child answers correctly. The app. may not only display theline segment 12 of the primary user, but also theline segment 12 of a competing user, which may be located in a remote location. InFigure 9 , the line segment 12a associated with the primary user is shown on the top or upper potion of the digital display, while the line segment 12b androbot icon 50 of the competing player is shown on the bottom or lower portion of the display screen. As noted above, the position of therespective robots 10 may be determined via the touch screen feature of the display screen or via wireless communication between therobots 10 and the respective display screens. - The
robot 10 adds an entertaining feature to conventional smart phones, tablet computers, and the like, in that it provides a concrete, three-dimensional accessory which moves relative to the computing device when a child plays with the computing device. In this regard, the child is not simply engaged with the two-dimensional display screen provided by the computing device. Rather, therobot 10 provides a three-dimensional entertainment unit which is more entertaining for the child. - The entertainment provided by the
robot 10 may be enhanced by providing a character accessory which may be engaged with therobot 10. In particular, the child's favorite hero, princess, animal, etc. may be adapted as a covering which fits over thehousing 25 to couple the covering to thehousing 25, such that when therobot 10 moves, the covering moves. - The above description is given by way of example, and not limitation. Given the above disclosure, one skilled in the art could devise variations that are within the scope of the invention disclosed herein. Further, the various features of the embodiments disclosed herein can be used alone, or in varying combinations with each other and are not intended to be limited to the specific combination described herein. Thus, the scope of the claims is not to be limited by the illustrated embodiments.
Claims (7)
- A self-propelled electronic device for use on a base surface (14), the electronic device comprising:• a chassis (20) disposed, in use, over the base surface, the chassis having a first surface (22) facing the base surface when the chassis is disposed over the base surface;• a light meter (24) coupled to the chassis and configured to:- detect light incident toward the first surface; and- determine a luminance level of the detected light,• a line sensor (30) coupled to the chassis and configured to sense a line segment (12) on the base surface; and• a movement mechanism (32) coupled to the chassis and placeable on the base surface, the movement mechanism being in operative communication with the line sensor to move on the base surface in a pattern corresponding to the line sensed on the base surface, the self-propelled electronic device being characterized by comprising:• a light source (26) coupled to the chassis and configured to selectively transition between an ON state to emit light away from the first surface and an OFF state to not emit any light; and• a control unit (28) coupled to the chassis and in operative communication with the light meter and the light source, the control unit being configured to transition the light source to the ON state in response to the luminance level of the detected light being below a threshold luminance and to the OFF state in response to the luminance level of the detected light being above the threshold luminance.
- The electronic device of claim 1, further comprising a power device (34) in operative communication with the light meter, the light source, and the line sensor, the power device being configured to store and provide electrical power to the light meter, the light source and the line sensor.
- The electronic device of claim 2, wherein the power device is configured to cease power transmission to the light meter, the light source, the line sensor and the movement mechanism in response to inactivity for a preset time period.
- The electronic device of claim 1, wherein the threshold luminance is approximately equal to 100 cd/m2.
- The electronic device of claim 1, wherein the line sensor is configured to sense the line in the base surface based on detected color differences of a line color defined by the line segment and a background color of the base surface.
- A method of providing a visual progress indicator, the method comprising:(a) providing for a self-propelled electronic device including: a first surface (22) facing a base surface (14) when the electronic device is placed on the base surface; and a light source (26) configured to selectively transition between an ON state to emit light toward the base surface and an OFF state to not emit any light;(b) determining a luminance level of a light incident toward the first surface;(c) transitioning the light source to the ON state in response to the luminance level being below a threshold luminance and to the OFF state in response to the luminance level being above the threshold luminance;(d) sensing a line segment (12) on the base surface using the device; and(e) automatically moving the device along the line segment in response to the sensed line segment.
- The method of claim 6 wherein the base surface is defined by a digital display.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261640526P | 2012-04-30 | 2012-04-30 | |
US13/645,039 US20130288560A1 (en) | 2012-04-30 | 2012-10-04 | Line sensing robot and a method of using the same with a digital display |
PCT/US2013/037434 WO2013165710A1 (en) | 2012-04-30 | 2013-04-19 | Line sensing robot and a method of using the same with a digital display |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2844435A1 EP2844435A1 (en) | 2015-03-11 |
EP2844435A4 EP2844435A4 (en) | 2015-12-30 |
EP2844435B1 true EP2844435B1 (en) | 2018-06-06 |
Family
ID=49477703
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP13784531.9A Active EP2844435B1 (en) | 2012-04-30 | 2013-04-19 | Line sensing robot and a method of using the same with a digital display |
Country Status (3)
Country | Link |
---|---|
US (1) | US20130288560A1 (en) |
EP (1) | EP2844435B1 (en) |
WO (1) | WO2013165710A1 (en) |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101189568B1 (en) * | 2010-12-01 | 2012-10-11 | 현대자동차주식회사 | Automated system and method for steering wheel leveler |
US9766610B2 (en) * | 2012-03-07 | 2017-09-19 | Rehco, Llc | Interactive application platform for a motorized toy entity and display |
US9492762B2 (en) * | 2012-05-08 | 2016-11-15 | Funfare, Llc | Sensor configuration for toy |
US20140357155A1 (en) * | 2013-05-29 | 2014-12-04 | Stephen Koehl | Tracer race cars and track |
US9545582B2 (en) * | 2013-08-23 | 2017-01-17 | Evollve, Inc. | Robotic activity system using color patterns |
JP6132754B2 (en) * | 2013-12-06 | 2017-05-24 | 株式会社ソニー・インタラクティブエンタテインメント | Information processing system, output device, and output method |
AU2015240773B2 (en) * | 2014-04-02 | 2019-04-18 | President And Fellows Of Harvard College | Color- or grayscale-sensing, magnetic, mobile, marking robot |
US10086516B2 (en) | 2014-04-02 | 2018-10-02 | President And Fellows Of Harvard College | Color- or grayscale-sensing, magnetic, mobile, marking robot |
US9975054B2 (en) * | 2014-06-12 | 2018-05-22 | Melvin Schindler | Building block kit |
BR112017007839B1 (en) * | 2014-10-21 | 2022-06-07 | Lego A/S | toy building system |
KR101662550B1 (en) * | 2015-06-15 | 2016-10-10 | 주식회사 네오펙트 | Rehabilitation training apparatus of mouse type |
US20160375354A1 (en) * | 2015-06-23 | 2016-12-29 | Intel Corporation | Facilitating dynamic game surface adjustment |
CN205796543U (en) * | 2016-07-05 | 2016-12-14 | 福建蓝帽子互动娱乐科技股份有限公司 | Interactive device based on light intensity identification |
JP7138314B2 (en) * | 2017-03-15 | 2022-09-16 | 株式会社Icon | learning toys |
JP7219906B2 (en) * | 2018-07-19 | 2023-02-09 | 株式会社Icon | Learning toy, mobile object for learning toy used for this, and portable information processing terminal for learning toy used for this |
WO2020017396A1 (en) * | 2018-07-19 | 2020-01-23 | 株式会社Icon | Learning toy, and learning toy mobile body and learning toy panel used in learning toy |
KR101937246B1 (en) * | 2018-08-29 | 2019-01-10 | 허소정 | Puzzle toy and smart toy using the same |
US10814489B1 (en) * | 2020-02-28 | 2020-10-27 | Nimble Robotics, Inc. | System and method of integrating robot into warehouse management software |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4618254A (en) * | 1982-10-15 | 1986-10-21 | Ncr Canada Ltd | Automatic light control system |
US5596255A (en) * | 1993-06-07 | 1997-01-21 | Seiko Epson Corporation | Method of and apparatus for guiding microrobot |
WO2001015059A2 (en) * | 1999-08-24 | 2001-03-01 | Gamalong Ltd. | System and method for detecting the location of a physical object placed on a screen |
US6695668B2 (en) * | 2001-01-29 | 2004-02-24 | Kevin Gerard Donahue | Toy vehicle and method of controlling a toy vehicle from a printed track |
JP5290577B2 (en) * | 2004-09-21 | 2013-09-18 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Game board, pawn, seal and system for playing board games |
CN101171061A (en) * | 2005-05-11 | 2008-04-30 | 皇家飞利浦电子股份有限公司 | Computer controlled pawn |
JP4647402B2 (en) * | 2005-06-08 | 2011-03-09 | パイロットインキ株式会社 | Traveling toy set |
US20080310677A1 (en) * | 2007-06-18 | 2008-12-18 | Weismuller Thomas P | Object detection system and method incorporating background clutter removal |
US8302033B2 (en) * | 2007-06-22 | 2012-10-30 | Apple Inc. | Touch screen device, method, and graphical user interface for providing maps, directions, and location-based information |
US8245807B2 (en) * | 2009-02-12 | 2012-08-21 | Edison Nation, Llc | Automated vehicle and system utilizing an optical sensing system |
US8396597B2 (en) * | 2009-08-18 | 2013-03-12 | Deere & Company | Distributed robotic guidance |
GB2475273B (en) * | 2009-11-12 | 2011-09-28 | Liberation Consulting Ltd | Toy systems and position systems |
US9766610B2 (en) * | 2012-03-07 | 2017-09-19 | Rehco, Llc | Interactive application platform for a motorized toy entity and display |
-
2012
- 2012-10-04 US US13/645,039 patent/US20130288560A1/en not_active Abandoned
-
2013
- 2013-04-19 EP EP13784531.9A patent/EP2844435B1/en active Active
- 2013-04-19 WO PCT/US2013/037434 patent/WO2013165710A1/en active Application Filing
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
EP2844435A1 (en) | 2015-03-11 |
WO2013165710A1 (en) | 2013-11-07 |
US20130288560A1 (en) | 2013-10-31 |
EP2844435A4 (en) | 2015-12-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2844435B1 (en) | Line sensing robot and a method of using the same with a digital display | |
US11529567B2 (en) | Robot having a changeable character | |
US11648485B2 (en) | Toy robot | |
US6507773B2 (en) | Multi-functional robot with remote and video system | |
US8430753B2 (en) | Video game system with wireless modular handheld controller | |
US11077359B1 (en) | Apparatus, system and method for sensing a state of a cubic puzzle | |
US6482064B1 (en) | Electronic toy system and an electronic ball | |
JP2019115481A (en) | Information processing program, information processing system, information processing device, and information processing method | |
KR101685401B1 (en) | Smart toy and service system thereof | |
EP2379188B1 (en) | Torch | |
US20130231029A1 (en) | Interactive Toy | |
CN211073602U (en) | Multifunctional shell-replaceable robot and decorative shell thereof | |
CN216536900U (en) | Toy control device | |
CN215136868U (en) | Toy control device | |
CN215351980U (en) | Toy control device | |
KR102316568B1 (en) | Coding education apparatus using motion coding of robot | |
WO2001014033A1 (en) | Electronic toy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20141119 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
RA4 | Supplementary search report drawn up and despatched (corrected) |
Effective date: 20151202 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: A63H 33/00 20060101AFI20151126BHEP Ipc: A63H 18/16 20060101ALI20151126BHEP Ipc: B25J 9/16 20060101ALI20151126BHEP Ipc: A63H 17/36 20060101ALI20151126BHEP |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: EVOLLVE, INC. |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: ABOU-HAMDA, NADER |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602013038631 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: B25J0009160000 Ipc: A63H0033000000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: A63H 18/16 20060101ALI20171023BHEP Ipc: B25J 9/16 20060101ALI20171023BHEP Ipc: A63H 17/36 20060101ALI20171023BHEP Ipc: G05D 1/02 20060101ALI20171023BHEP Ipc: A63H 33/00 20060101AFI20171023BHEP |
|
INTG | Intention to grant announced |
Effective date: 20171128 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1005396 Country of ref document: AT Kind code of ref document: T Effective date: 20180615 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602013038631 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180906 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180906 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180907 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1005396 Country of ref document: AT Kind code of ref document: T Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602013038631 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20190307 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190419 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190430 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190419 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181008 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20130419 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180606 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230425 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240429 Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240429 Year of fee payment: 12 |