GB2500701A

GB2500701A - Automated wireless device configuration with a wireless network

Info

Publication number: GB2500701A
Application number: GB1205714.7A
Authority: GB
Inventors: Jay Jeyasingam
Original assignee: Y Cam Solutions Ltd
Current assignee: Y Cam Solutions Ltd
Priority date: 2012-03-30
Filing date: 2012-03-30
Publication date: 2013-10-02
Anticipated expiration: 2032-03-30
Also published as: GB201205714D0; GB2500701B

Abstract

A wireless network enabled camera (101) includes a microphone and is set up to communicate with a wireless network enabled smartphone (102) over a wireless network. In this way, the wireless camera may operate as a baby monitor or intruder alarm. Network enabling codes for a local network are collected at the smartphone, and converted to audio signals (103). These are then output by the smartphone (102) and detected by the microphone on the wireless camera (101). The audio signals (103) are then converted back to the network codes by the wireless camera (101) to establish communication with a local network router (104). This allows automated set up of a wireless device within a wireless network without having to manually enter a Service Set Identifier (SSID), Wired Equivalent Privacy (WEP) or network key. An additional feature allows automatic camera activation based upon detecting a preset noise level and duration, upon which the video feed can be pushed to the smartphone.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This application represents the first application for a patent directed towards the invention and the subject mailer.

S BACKGROUND OF THE INVENTION

1. Field of the Invention

A first aspect of the present invention relates to a wireless network enabled apparatus, comprising a camera, microphone, a processor and embedded instructions.

A second aspect of the present invention relates to a method of communicating with a network enabled device using a network configured mobile device, including the step of installing application instructions.

A third aspect of the present invention relates to a method of setting up a wireless network enabled camera with a microphone in combination with a wireless network enabled smartpbone to operate as a baby monitor.

2. Description of the Related Art

Wireless networks for data communications are in widespread use, both for commercial and domestic applications. The installation of new equipment is facilitated by the provision of enhanced sophistication within said equipment. However, this can represent a significant overhead if the additional sophistication is only required for the establishment of the initial functionality and is thereafter redundant. Thus, it is preferable for equipment to be provided with only its essential elements required for its primary function and for the provision of additional equipment for setting up purposes to be minimised.

However, such an approach may require a greater expertise and knowledge to initialise the system and often costs incurred in terms of using an expert may outweigh gains made by minimising the system requirements. Consequently, there is a demand for the installation of optimised equipment requiring minimal additional resource or expertise.

BRIEF SUMMARY OF THE INVENTION

According to said first aspect of the invention, there is provided a wireless network enabled apparatus, comprising a camera, a microphone, a processor and embedded instructions for instructing said processor to perform a configuration process and a first monitoring process, wherein during said configuration process: said microphone receives audio tones representing configuration codes and conveys electrical representations of said audio tones to said processor; said electrical representations are interpreted by said processor to reconstruct digital network codes; and said digital network codes are deployed to automate a network set up procedure and establish network communication within a wireless network.

in an embodiment, the reconstructed digital network codes include an SSlD, a WEP and a network key.

According to said second aspect of the present invention, there is provided a method of communicating with a network enabled device using a network configured mobile device, comprising the steps of: installing application instructions for performing a configuration process and a second monitoring process, wherein said configuration process comprises the steps of: collecting network enabling codes; modulating an audio frequency signal in response to said network enabling codes; and energising a loudspeaker to convey audio signals to a wireless network enabled device.

In an embodiment, the first network enabled codes are read from storage within the mobUe device.

According to said third aspect of the present invention, there is provided a method of selling up a wireless network enabled camera with a microphone in combination with a wireless network enabled smartphone to operate as a baby monitor, comprising the steps of: collecting network enabling codes at said smartphone for a local network; transmitting said network enabling codes as audio signals to said wireless network enabled camera; receiving said audio signals at said wireless network enabled camera, thereby authorising said wireless network enabled camera to operate within said local network: and executing first monitoring instructions at said wireless network enabled camera and executing second monitoring instructions at said smartphone.

In an embodiment, the audio signals are modulated by said network enabling codes by a process of frequency shift keying.

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 shows a wireless network enabled apparatus communicating with a mobile cellular telephone; Figure 2 details the wireless network enabled apparatus identified in Figure 1; Figure 3 shows operations performed by the mobile cellular telephone identified in Figure 1; Figure 4 shows a graphical user interlace for capturing a wireless key; Figure 5 shows additional functionality performed by the mobile cellular telephone; Figure 6 shows the display of a visual message on the mobile cellular telephone: Figure 7 shows an example of instructions embedded within the wireless network enabled apparatus; and Figure 8 shows s protocol diagram for setting up a wireless network enabled camera.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS

Figure 1 A wireless network enabled apparatus 101 is shown in Figure 1, being, in an embodiment, primarily a wireless network enabled camera. Thus, the apparatus 101 includes a camera and a microphone as detailed in Figure 2.

The apparatus 101 is configured to execute first monitoring instructions thereby enabling it to communicate, over a wireless network, with a mobile network enabled device 102, such as a smart cellular telephone. During a setting up procedure, network enabling codes are transmitted as audio signals 103 from the smartphone 102 to the apparatus 101. The audio signals are received at the wireless network enabled apparatus (camera) 101, thereby authorising the apparatus 101 to operate within the local network, established by wireless router 104. Thus, after being authorised to communicate, it is possible for radio signals 105 to pass video data to the router 104 which in turn conveys wireless signals 106 to the mobile cellular telephone 102.

Figure 2 The wireless network enabled apparatus 101 is detailed in Figure 2.

The apparatus has a camera 2D1, a microphone 202 and a processor 203.

The processor 203 operates in response to embedded instructions such that these embedded instructions instruct the processor to perform a configuration process and to perform a first monitoring process.

Owing the configuration process, the microphone 202 receives audio tones representing configuration codes and conveys electrical representations of these audio tones to the processor 203. The electrical representations are interpreted by the processor 203 to reconstruct digital network codes, possibly stored within memory 204. The digital network codes are deployed to automate a network set up procedure and establish network communication In an embodiment, the apparatus includes a housing 205 for containing the camera 201, the microphone 202, a power supply 206 and a mounting device 207, The power supply 206 may include batteries or power may be received from an external source and transformed appropriately.

In an embodiment, the audio tones represent reconstructable data having been produced by a modulating process. The modulating process may make use of frequency shift keying.

In an embodiment, the reconstructed digital network codes include an SSIO, a WEP and a network key. Greater levels of sophistication may be introduced over time, often to improve security and prevent unauthorised access. However, when used in combination with a mobile telephone, procedures for obtaining access will have been established given that these procedures will have been performed in order to allow the mobile telephone itself to communicate within the wireless environment.

In an embodiment, the apparatus also includes an illuminating device 208, that may be a light emitting diode. The illuminating device is illuminated upon successfully establishing communication within the wireless network.

In an embodiment, the first monitoring process, preferably entered after the configuration process, monitors audio input and generates an alert signal if audio input exceeds a predetermined threshold. In response to generating an alert signal, an embodiment of the apparatus then anticipates receipt of an acknowledgement signal. In an embodiment, in response to receiving an acknowledgement signal, output video data is pushed to the network, for reception at the mobile cellular telephone 102.

In an embodiment, the apparatus is used as a baby monitor. Thus, an alert signal is generated in response to audio being detected which, in this application, will be the sound of a baby crying. Instructions for the first monitoring process will specify the duration of crying that can be tolerated before the alert signal is generated.

In an embodiment, there is minimal processing power at the camera apparatus 101. Sufficient processing power is required for the apparatus to perform the required level of functionality but beyond this it should be appreciated that the apparatus is not a general purpose device and for the overall operation of the system, reliance is made upon the processing capabilities within the mobile cellular telephone 102. Thus, the camera apparatus 101 notifies the mobile cellular telephone 102 when audio has been received over a predetermine threshold for a predetermined time. The mobile cellular telephone 102 may then be interrupted and may start pulling a video stream, in response to the video images generated by apparatus 101.

Figure 3 Operations performed by the mobile cellular telephone 102 are shown in Figure 3. At step 301 the application is installed which may be initiated by a process of downloading an application from an appropriately configured distribution source.

At step 302 internal codes (relevant for wireless operation) within the mobile cellular telephone 102 itself are identified. These represent first network enabling codes that may include an SSID and WEP.

At step 303 external wireless related codes are captured. These represent second network enabling codes that may include a wireless key provided manually by a user, as illustrated in Figure 4.

Having identified internal codes at step 302 and having captured the external codes at step 303, all of the appropriate network enabling codes will have been collected. Consequently, at step 304 an audio frequency is modulated in response to the network enabling codes. A loudspeaker present within the cellular mobile telephone is energised to convey audio signals to a wireless network enabled device. In an embodiment, a loudspeaker used for voice telephony is energised. However, in an alternative embodiment, the cellular mobile telephone may include additional loudspeaker devices and these may be energised, enabling the communication to take place at a greater distance from the apparatus 101.

After generating the audio output, a question may be asked at step 305 as the whether an acknowledgment signal has been received back from device 101, generally referred to as a handshaking process. Thus, at step 305 a question is asked as to whether the handshake has been received and if answered in the negative, the audio output is generated again. This process may be repeated several times after which an error message will be raised to the effect that the audio tones have not been received by the device. This may in turn prompt the user to place the mobile cellular telephone closer to the device or take measures to ensure that external sources of noise have been removed. After following these measures, and following a further audio output at step 304, the question asked at step 305 should be answered in the affirmative thereby allowing the additional functionality to be performed at step 306.

In an embodiment, the additional functionality represents a monitoring functionality and in a more refined embodiment the monitoring functionality takes the form of baby monitoring functionality.

Figure 4 As shown in Figure 3, step 303 captures external codes by receiving data from a user. As shown in Figure 4, in an embodiment, the collecting step includes displaying a first graphical interface 401 to request the input of the wireless key or any other information, in alternative configurations, where the information is not available internally from within the mobile telephone itself.

In an embodiment, the user interface 401 requests entry of the wireless key at 402. In response to manual input, the key data is received within field 403. As known in the art, some mobile devices will include a keyboard and others will display a soft keyboard prompting input via a touch sensitive screen.

After the key data has been received, the user is invited to press an activate button 404. Alternatively, the user may press a cancel button 405.

Thereafter, the audio output may be generated as described with respect to Figure 3.

Figure 5 The performance of additional functionality, identified at step 306, is detailed in Figure 5. This additional functionality is performed by the mobile cellular telephone, which may be considered as executing second monitoring instructions and thereby communicating with the wireless network enabled camera which itself is performing first monitoring instructions in order to provide the enhanced functionality, as identified in Figure 7.

Following the setting up process, the application running on the mobile cellular telephone will search for the existence of the camera such that, when both are connected to the wireless network, the mobile telephone application is in a position to receive video data and audio data from the camera device 101.

In the baby monitoring application described herein it is possible, when in use, to watch a monitored baby sleeping. However, in an embodiment, the mobile cellular telephone application is designed to work as a background process so that the telephone can be used for other purposes. The camera device 101 will identify the cries of the baby being monitored and convey and alert to the mobile cellular telephone, which will then be in a position to notify the user. In an embodiment, the type of notification may be selected or the intensity of the notification may escalate.

A first type of notification may involve conveying the audio of the crying baby to a loudspeaker present within the mobile cellular telephone. In a second mode of operation, the cellular mobile telephone may be instructed to vibrate and in a third mode a visual message may be produced.

In an embodiment, altemative types of notification may be produced when the mobile cellular telephone is being used for other purposes, such as when making a call or running another application. Thus, if the mobile cellular telephone is in use to the extent that a different function is generating audio output, the mobile cellular telephone may pop up a message to the effect that the baby requires attention. Thus, with the application running in the background, it is possible to continue monitoring the baby while allowing the mobile cellular telephone to operate in a conventional manner, thereby enhancing the overall functionality of the combination.

As previously described, the camera device is configured to generate an alert in response to the enhanced monitoring functionality. Thus, in an embodiment, an alert is generated if the sound of a baby crying is detected for a period longer than 5 seconds.

At the mobile cellular telephone, an interrupt is generated in response to the alert signal being received at step 501. At step 502 a question is asked as to whether the device is in use and if this question is answered in the negative, an alarm is generated and video is shown at step 503. In an embodiment, a question is then asked as to whether an acknowledgment signal has been generated, in response to manual activation, at step 504. If the question asked at step 504 is answered in the negative, to the effect that an acknowledgement has not been received, the alarm continues to sound at step 503. Eventually, an acknowledgement is received, resulting in the question asked at step 504 being answered in the affirmative, whereafter received video is displayed and received audio is played at step 511.

If the question asked at step 502 is answered in the affirmative, to the effect that the mobile cellular telephone is in use (possibly due to a telephone call being in progress) a visual message is generated at step 505, as detailed in Figure 6. At step 506 a question is asked as to whether an acknowledgement has been received and if answered in the affirmative, video data is displayed at step 511.

If the question asked at step 506 is answered in the negative, to the effect that an acknowledgement has not been received, the alarm level, in an embodiment, escalates. Thus, in this example, in response to the question asked at step 506 being answered in the negative, a vibrate operation is performed at step 507. At step 508 a question is asked as to whether an acknowledgement has been received and if answered in the affirmative, video data is displayed at step 511. However, if the question asked at step 508 is answered in the negative, to the effect that an acknowledgement has not been received, the alarm level again escalates. Thus, in response to the question asked at step 508 being answered in the negative, an audio interrupt is generated at step 509 and again a question is asked at step 510 as to whether an acknowledgment has been received.

If the question asked at step 510 is answered in the negative, the audio interrupt at step 509 is repeated and so on until an acknowledgement has been received.

Thus, in response to receiving an acknowledgement and a question at step 510 being answered in the affirmative, the video data is displayed at step 511.

Alternative approaches may be taken to achieve levels of escalation and the number of levels present may also vary. In an embodiment, the mobile cellular telephone continues to take escalating measures in order to bring the alert condition to the.attention of the user.

is In an embodiment, a live connection is maintained during the monitoring process. The mobile cellular telephone is configured to detect conditions to the effect that the wireless data connection has been lost.

However, maintaining the connection between the camera device 101 and a mobile cellular telephone can provide additional problems. In an embodiment, a heartbeat mechanism is provided taking the form of a low bandwidth communication that is maintained between the camera device and the application running on the mobile telephone. In some systems, this may be implemented by opening ports defined by an underlying operating system executing on the mobile cellular telephone; this often being unix or unix based.

Thus, the heartbeat communication occurs at a very low level within the operating environment of the additional functionality.

Figure 6 Visual message 505 is detailed in Figure 6. In this example, the visual message displays "monitor alert" 601 and invites an acknowledgement at 602.

Thus, in response to a user pressing an acknowledge button 603, the question asked at step 506 is answered in the affirmative resulting in video data being displayed and the audio data being played at step 511.

Figure 7 An example of instructions embedded within processor 203 are detailed in Figure 7. Upon energising the wireless network enabled apparatus, an attempt is made to communicate at step 701. At step 702 a question is asked as to whether the network has been configured and when answered in the affirmative, the apparatus performs enhanced functionality at step 706. In an embodiment, this enhanced functionality takes the form of a monitoring operation and in a refined embodiment takes the form of a baby monitoring operation. However, it should be appreciated that other operations may take place that benefit from the set up procedure described herein.

In response to the question asked at step 702 being answered in the negative, to the effect that network communication has not been configured, configuration is initiated at step 703.

At step 704, audio codes are received, possibly from a smart mobile cellular telephone of the type (102) shown in Figure 1 although other devices, such as a computer, could be used to generate these codes.

Having received the audio codes at step 704, the configuration is completed at step 705 and the enhanced functionality is then performed at step 706.

Figure 8 A protocol diagram is shown in Figure 8, representing a method for selling up a wireless network enabled camera with a microphone in combination with a wireless network enabled smart phone to operate as a baby monitor. The method involves collecting network enabling codes at the smart phone for the local network. The network enabling codes are transmitted as audio signals to the wireless network enabled camera. The audio signals are received at the wireless network enabled camera, thereby authorizing the wireless network enabled camera to operate within the local network. First monitoring instructions are executed at the wireless network enabled camera and second monitoring instructions are enabled at the smartphone.

In this example, it is assumed that a user 801 has obtained wireless network enabled camera 101 to operate in combination with wireless network enabled smart phone 102. Mounting device 207 may be used to position the wireless network enabled camera at a suitable location and power supplied to power supply 206 may be energised. The mobile cellular telephone itself may be of conventional design and as such applications executable thereon are downloaded from an application server 802.

At 803 a user interacts with phone 102 to the effect that an application is to be downloaded. At 804 the phone 102 makes a request to the application server 802, resulting in the application being downloaded at 805 and installed as is known in the art.

As previously described, when executing, the mobile telephone application identifies internal codes at step 302. At step 303 external codes are captured by making a request 806 to user 801 by presenting a user interface of the type shown in Figure 4 to the user. Thus, in response to presenting the interface of Figure 4, the wireless network key is captured at 807.

At 808 the mobile cellular telephone 102 transmits the network enabling codes as audio signals to the camera 101. As shown at step 705, the camera 101 now completes its configuration process so as to be active within the wireless environment. This status is conveyed to the user 801 at 809 by the illumination of LED device 208. This status is also conveyed to the mobile cellular telephone 101 at 810 by means of the handshake response described at step 305. Thus, this completes the set up stage.

Having completed the set up stage, it is now possible to enter the monitoring stage, with a mobile cellular telephone performing additional functionality 306 and the network enabled camera performing enhanced functionality 706.

As previously described, during the monitoring process a low bandwidth heartbeat signal is sent periodically from the camera 101 to the telephone 102.

In the example shown in Figure 8, four of these heartbeat signals are shown, identified as 811, 812, 813 and 814. While monitoring is taking place these heartbeat signals will continue to be transmitted until the device is de-energised or until an alarm condition has been identified. Thus, the second monitoring instructions being executed upon the mobile phone will expect to receive these heartbeat notifications and will raise an alarm if a heartbeat signal is not received before a predetermined timeout period.

In an embodiment, the network enabled camera will raise an alert condition if a sound is heard having an amplitude over a predetermined threshold for a predetermined period. In a specific application, this will represent a baby crying for a predetermined period. Thus, when such a condition occurs, an alert signal 815 is transmitted from the camera 101 to the mobile cellular telephone 102. In response to receiving the alert condition 815, the mobile cellular telephone 102 will raise escalating alarm signals to the user 801. Thus, in this example, in response to receiving the alert 815, the mobile cellular telephone 102 issues a visual notice 816 to the user 801. When no response is received thereto, the mobile cellular telephone 102, in this example, issues a vibrate command 817. For the purposes of this example, assuming no response is made, the alarm signal from the mobile cellular telephone 102 will escalate to an audio alarm 818 which will continue until a response is made.

A response to the alarm from the user 801 to the mobile cellular telephone 102 is shown at 819. This response is conveyed from the mobile cellular telephone 102 to the camera 101 at 820. Thus, the alarm situation has been brought to the notice of the user and this has been acknowledged.

Consequently, the communication between the camera 101 and the user 801 now takes the highest priority from the user's perspective and as such the communication may make use of the full available bandwidth. Consequently, video and audio data is streamed at 821 from the camera 101 to the mobile cellular telephone 102 over the wireless network. This results in video images and audio sound being played to the user 801 as shown at 822.

Claims

Claims What we claim is: 1. A wireless network enabled apparatus, comprising a camera, a S microphone, a processor and embedded instructions for instructing said processor to perform a configuration process and a first monitoring process, wherein during said configuration process: said microphone receives audio tones representing configuration codes and conveys electrical representations of said audio tones to said processor; said electrical representations are interpreted by said processor to reconstruct digital network codes; and said digital network codes are deployed to automate a network set-up procedure and establish network communication within a wireless network.
2. The apparatus of claim 1, further comprising a housing for containing said camera, said microphone, a power supply and a mounting device.
3. The apparatus of claim 1 or claim 2, wherein said audio tones represent reconstructable data having been produced by a modulating process.
4. The apparatus of any of claims 1 to 3, wherein said re-constructed digital network codes include an SSID, a WEP and a network key.
5. The apparatus of any of claims 1 to 4, further comprising an illuminating device, wherein said illuminating device is illuminated upon successfully establishing communication with said wireless network.
6. The apparatus of any of claims 1 to 5, wherein said first monitoring process monitors audio input and generates an alert signal if audio input exceeds a predetermined threshold.
7. The apparatus of claim 6, wherein an acknowledgement signal is expected in response to said alert signaL
8. The apparatus of claim 7, wherein output video data is pushed in response to receiving said acknowledgement signal.
9. A method of communicating with a network enabled device using a network configured mobile device, comprising the steps of: installing application instructions for performing a configuration process and a second monitoring process, wherein said configuration process comprises the steps of: collecting network-enabling codes; modulating an audio frequency signal in response to said network-enabling codes; and energising a loudspeaker to convey audio signals to a wireless network enabled device.
10. The method of claim 9, wherein first network enabled codes are read from storage within the mobile device.
11. The method of claim 10, wherein said first network enabled codes include an SSID and a WEP.
12. The method of claim 9, wherein a second network enabled code includes a WiFi key provided manually by a user.
13. The method of claim 12, wherein said collecting step includes displaying a first graphical interface to request the input of said WiFi key.
14. The method of any of claims 9 to 13, wherein said second monitoring process includes displaying a second graphical interface for requesting an acknowledgement from a user in response to receiving an alert signal.
15. The method of claim 14, wherein said second monitoring process escalates output alarms in response to the continuing presence of unacknowledged alert signals.
16. The method of claim 14, wherein said second monitoring process includes displaying a third graphical interface for displaying video images derived from received video data after transmitting an acknowledgement signal.
17. A method of setting up a wireless network enabled camera with a microphone in combination with a wireless network enabled smart-phone to operate as a baby monitor, comprising the steps of: collecting network enabling codes at said smart-phone for a local network; transmitting said network enabling codes as audio signals to said receiving said audio signals at said wireless network enabled camera, thereby enabling said wireless network enabled camera to operate within said local network; and executing first monitoring instructions at said wireless network enabled camera and second monitoring instructions at said smart-phone.
18. The method of claim 17, wherein said audio signals are modulated by said network enabling codes by a process of frequency shift keying.
19. The method of claim 17 or claim 18, wherein said collecting step includes reading codes stored internally within the smart-phone and receiving a manually supplied code from the user.
20. The method of any of claims l7to 19, wherein: said first monitoring instructions generate an alert signal in response to the sound of a baby crying; said second monitoring instructions prompt the response of an acknowledgement from a user in response to receiving said alert signal: and said first monitoring instructions push video output data to said second monitoring instructions in response to receiving said acknowledgement signal.