WO2017048128A1 - Mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium - Google Patents

Mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium Download PDF

Info

Publication number
WO2017048128A1
WO2017048128A1 PCT/NL2016/050642 NL2016050642W WO2017048128A1 WO 2017048128 A1 WO2017048128 A1 WO 2017048128A1 NL 2016050642 W NL2016050642 W NL 2016050642W WO 2017048128 A1 WO2017048128 A1 WO 2017048128A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile device
streaming
server
video stream
modus
Prior art date
Application number
PCT/NL2016/050642
Other languages
French (fr)
Inventor
Fadi KHALIL
Original Assignee
Khalil Fadi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Khalil Fadi filed Critical Khalil Fadi
Priority to EP16777810.9A priority Critical patent/EP3351027A1/en
Priority to CN201680066794.9A priority patent/CN108463990A/en
Publication of WO2017048128A1 publication Critical patent/WO2017048128A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/90—Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/756—Media network packet handling adapting media to device capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72418—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/029—Location-based management or tracking services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/52—Network services specially adapted for the location of the user terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/565—Conversion or adaptation of application format or content
    • H04L67/5651—Reducing the amount or size of exchanged application data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72418—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services
    • H04M1/72421—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services with automatic activation of emergency service functions, e.g. upon sensing an alarm
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72418—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services
    • H04M1/72424—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting emergency services with manual activation of emergency-service functions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices

Definitions

  • the invention relates to a mobile device, i.e. a mobile electronic device, and method for initiating a video stream.
  • the invention further relates to a server and method for forwarding a video stream.
  • the invention further relates to a system including the mobile device and the server, and to a computer readable storage medium storing computer executable instructions for executing the steps of the method.
  • the recorded video may assist the police in arresting the perpetrator or reconstructing the events.
  • Another example of a situation wherein a user may want to record a video is in the case of police brutality.
  • streaming video applications may be used for said purpose.
  • Streaming video from a mobile device is known per se e.g. in the form of video chat applications such as Skype TM.
  • video chat applications the camera of the mobile device is used to record a video, which is then streamed to a server.
  • the server forwards the video stream to the other user participating in the video call.
  • the user has to unlock the mobile device, locate the video streaming application, open said video streaming application etc..
  • the user may not be in a position to perform said actions. For example, when a user is being robbed or assaulted by a criminal, he will not be given the opportunity to perform said actions.
  • An object of the invention is to reduce said disadvantages and to enable quickly streaming a video using a mobile device in case of an emergency.
  • the mobile device comprises:
  • the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state
  • the mobile device is configured to switch to a streaming modus upon detection of a predetermined user input by the input unit in the locked state of the mobile device, wherein the device in said streaming modus is configured to establish a communication connection with a remote server using the wireless communication unit, to activate the at least one camera and to stream video from the at least one camera to the remote server.
  • the mobile device may for example be a tablet computer, a laptop or a smart watch.
  • the mobile device is a smartphone.
  • Mobile devices having a locked state and an unlocked state are known per se.
  • the mobile device may be unlocked by a user by entering a passcode, e.g. on a touch-sensitive display or a keyboard.
  • Most functions of the mobile device are not available in the locked state.
  • a locked smartphone does not allow initiating phone calls or starting applications.
  • the device is switchable to a streaming modus.
  • this streaming modus video from the one or more cameras of the mobile device is streamed to a remote server.
  • the device is configured such that it can be switched to the streaming modus when it is in the locked state.
  • the device in its locked state can start streaming video from the camera.
  • the device is configured to switch to said streaming modus when a
  • the user does not have to unlock the mobile device and can immediately start starting streaming, which is of particular importance in an emergency situation. Moreover, the user does not need to manually open an application and/or select items from a menu: the video streaming is started automatically upon detecting the predetermined user input.
  • the streaming modus may be implemented in hardware and/or software.
  • the memory of the device stores computer readable instructions which, when executed by the at least one processor, activate the streaming modus when the predetermined user input is detected.
  • the mobile device is further configured to switch to the streaming modus upon detection of said predetermined user input by the input unit in the unlocked state of the mobile device irrespective of the current application running on said mobile device in its unlocked state.
  • the user may also start streaming when the device is unlocked. Therefore, also in case an emergency occurs while the user is using his mobile device, the user can immediately start streaming video by providing the predetermined user input. For example, the user may be in the middle of a call when an emergency occurs. In another example, the user may be using an application (app) when an emergency occurs. By providing the predetermined input, the user may start streaming video of the emergency, irrespective of whether the device is currently running a different application or function.
  • the mobile device is further configured in the streaming modus to automatically call emergency services using the wireless communication unit.
  • This call may be accompanied by the sending of identifying information of the mobile device user.
  • the display is a touch-sensitive display and the input unit for detecting said predetermined user input comprises at least one input unit distinct from said touch-sensitive display.
  • the predetermined user input is received via another input unit than the touch-sensitive display.
  • the invention overcomes said problem by providing a user input different from the touch-sensitive screen as the predetermined input for switching to the streaming modus.
  • the input unit comprises an accelerometer or gyroscope, i.e. a gyro sensor, wherein the input unit is configured to detect shaking of the mobile device by the user as said predetermined user input.
  • the predetermined user input may comprise shaking the mobile phone for a predetermined time span, e.g. at least 5 seconds or at least 10 seconds.
  • the predetermined user input comprises shaking the mobile phone according to a predetermined pattern, e.g. intermittently shaking and holding still the mobile phone with at least two repetitions.
  • the input unit comprises a voice control unit comprising a microphone, the voice control unit being configured to detect a voice command of the user as said
  • the predetermined user input may comprise the voice command "expose! "start streaming! or "emergency!.
  • the input unit comprises a button of the mobile phone, the input unit being configured to detect a pattern of repeatedly operating said button by the user within a predetermined time span as said predetermined user input.
  • the time span may for example be at least 5 seconds or at least 10 seconds.
  • the input unit comprises a squeezable cover accessory of the mobile device, wherein the input unit is configured to detect squeezing of the cover accessory by the user as said predetermined user input.
  • the predetermined input may comprise a pattern of repeatedly squeezing the squeeze cover accessory.
  • the mobile device further comprises a bandwidth monitoring unit configured to determine the available bandwidth for streaming, wherein the mobile device is further configured to adjust the video quality according to the available bandwidth determined by the bandwidth monitoring unit.
  • the mobile device may convert the video to black and white and/or reduce the resolution of the video if the available bandwidth is below a predetermined threshold. In situations with very low bandwidth, only intermittently taken photos may be streamed.
  • the mobile device is further configured to store said video in its memory in addition to streaming the video to said remote server. This may also be done if an internet connection is for some reason unavailable. In such cases it is advantageous to configure the mobile device to stream the stored video to said remote server as soon as an internet connection is restored.
  • the mobile device is further configured to stay in the streaming modus for at least a predetermined time span.
  • the mobile device will stay in the streaming modus, i.e. is locked in the streaming modus, for at least a predetermined time span. Therefore, the perpetrator will not be able to shut down the streaming modus.
  • the streaming modus can only be ended if a security code is entered.
  • the mobile device remains in the streaming modus indefinitely, until a security code is entered.
  • the security code may be entered using a touch-sensitive display of the mobile device.
  • the mobile device further comprises a GPS unit for determining the location coordinates of the device, wherein the mobile device is further configured to send the location coordinates determined by the GPS unit to the server using the wireless communication unit in the streaming modus.
  • the mobile device upon detecting the predetermined user input in the locked state or unlocked state, the mobile device will in addition to start streaming video send the GPS location of the mobile device to the server. This enables watchers of the video stream to view the location of the incident.
  • the GPS location may be displayed on an interactive map application of a mobile device such as a smartphone.
  • the GPS location may be displayed using Google Maps TM or Bing Maps TM.
  • emergency services are able to retrieve the location coordinates of the emergency.
  • the location coordinates are sent to the emergency services in conjunction with calling the emergency services.
  • the wireless communication unit is suitable for receiving a stream notification message from a server, said stream notification message announcing a video stream originating from another mobile device, wherein the mobile device is configured in both the locked stated and unlocked state to display a notification interface on the display of the mobile device upon receipt of a stream notification message by the wireless communication unit and to start playout of said video stream upon selection of a user selectable item of said notification interface by the user.
  • the notification interface may be a pop-up screen displayed on the touchscreen of the mobile device.
  • the pop-up screen is displayed irrespective of whether the mobile device is locked or unlocked. Even in the locked state of the mobile device, the user may select a user selectable item to start playout of the corresponding video stream.
  • the user selectable item is for example a link, a button, a clickable image or the like.
  • the stream notification message includes a location coordinate of said other mobile device, the mobile device being configured in both the locked stated and unlocked state to display said notification interface if the location coordinate of said other mobile device is within a predetermined range of the location coordinate of the mobile device as determined by the GPS unit.
  • a first mobile device receives a stream notification message originating from a second mobile device.
  • the stream notification message includes a GPS coordinate of the second mobile device.
  • the first mobile device determines its own GPS coordinate using its GPS unit.
  • the first mobile device compares the GPS location of the first mobile device with the GPS location of the second mobile device. If the locations are within a predetermined range, the notification interface is displayed on the first mobile device. If the distance between the locations exceeds the predetermined range, no notification interface is displayed.
  • the predetermined range is adjustable.
  • the user of the first mobile device may configure the range using a settings menu.
  • the mobile device is further configured to send to the server identification data for identifying the user in the streaming modus.
  • the mobile device upon detecting the predetermined user input, the mobile device initiates the video stream and sends the identification data and/or GPS location.
  • the notification message send by the server to other mobile devices may include said identification data. Therefore, the identity of the user of the mobile device is shown to users of said other mobile devices.
  • the mobile device is configured to receive a notification message including identification data and/or GPS location, wherein the notification interface is only displayed if the GPS location is within a predetermined range as described above or the identification data corresponds to identification data in an adjustable contact list stored on the mobile device.
  • the user may specify from which contacts he wishes to display notification messages in case of a video stream notification message, irrespective of the location of said contact.
  • Notification messages corresponding to video streams of a person not included in the contact list only result in a notification if said person is within the predetermined range.
  • the invention further relates to a method for initiating a video stream from a mobile device, wherein the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state.
  • the method comprises automatically switching the device to a streaming modus if a predetermined user input is detected in the locked state of the mobile device, wherein in the streaming modus the following steps are executed by the mobile device:
  • the invention further relates to a server for forwarding a video stream.
  • the server comprises:
  • the communication unit is configured to receive, from at least one first mobile device, location coordinates of said at least one first mobile device and a video stream, and to receive, from at least one second mobile device, location coordinates of said at least one second mobile device, the processing component being configured to forward the video stream of said at least one first mobile device to said at least one second mobile device if the location coordinates of said at least one first mobile device is within a predetermined distance of the location coordinates of said at least one second mobile device.
  • the server may further be configured to store the video of the video stream in a memory of the server in addition to forwarding the video stream.
  • a user of a first mobile device may open a user account, wherein all videos stored on the server from said first mobile device are associated with said user account.
  • the user may then log in to a web service running on the server, to be able to view the videos associated with his user account.
  • the server is configured to receive from said at least one first mobile device identification data for identifying the user, e.g. a unique user name or number.
  • the server may store a contact list associated with said identification data and be configured to forward said video stream received from said at least one first mobile device to selected contacts of said contact list associated with said identification data. In other words, the server forwards the video stream to the contacts associated with the user.
  • the invention further relates to a method for forwarding a video stream using a server.
  • the method comprises the following steps executed by the server:
  • the invention further relates to a system comprising the server as described above and the mobile device as described above.
  • the invention relates to a non-transitory computer readable storage medium storing computer executable instructions which when executed by an electronic device, execute the steps of any of the methods described above.
  • FIG. 1 shows a mobile device according to an embodiment of the invention
  • FIG. 2 shows schematically an architecture of the mobile device of figure 1
  • - Figure 3 shows schematically a network including the mobile device of figures 1 and 2;
  • FIG. 4 shows a block diagram of a method for initiating a video stream from a mobile device according to an embodiment of the invention
  • FIG. 5 shows a block diagram of a method for forwarding a video stream by a server according to an embodiment of the invention
  • FIG. 7 shows a block diagram of a method for receiving a video stream by a mobile device according to an embodiment of the invention.
  • the mobile device is a smartphone 2 having a touch-sensitive display 4, i.e. a touch screen 4.
  • the smartphone may further comprise one or more physical buttons 6.
  • the mobile device 2 comprises a central processing unit, CPU, 8 (figure 2).
  • the mobile device 2 may comprise a graphics processing unit, GPU, in addition to a CPU.
  • the mobile device 2 further comprises a bus 10, a GPS unit 12, a memory 14, a camera 16, a communication interface 18 for wireless
  • the CPU 8 touch screen 4, GPS unit 12, memory 14, camera 16, communication interface 18 and input units 20 are all connected to bus 10, directly or via an appropriate interface.
  • the bus 10 enables communication between the components connected thereto.
  • the mobile device 2 may connect to a network 26, such as the internet, using the communication interface 18 (figure 3).
  • the mobile device 2 may establish a communication connection with a server 28 for streaming video to said server 28.
  • the server 28 may forward the video stream to other mobile devices, such as smartphones 30 or tablets 32.
  • FIG 4. An embodiment of a method performed by mobile device 2 is illustrated in figure 4.
  • the mobile device 2 will be in its locked state SI 00 when not used by a user.
  • SI 00 usage of the mobile device 2 is restricted.
  • a user has to enter a passcode to unlock the mobile device, i.e. to switch the device from the locked state S100 to an unlocked state.
  • the CPU 2 of mobile device 2 checks whether a predetermined input is received via input units 20 in step S102. If no input is detected or detected input does not correspond to the predetermined input, the mobile device 2 remains in the locked state S100. If the CPU 2 determines that input has been received from the input units 20 and that said input corresponds to the predetermined input, the mobile device switches to the streaming modus in step SI 04. Optionally, the mobile device 2 also communicates with emergency services in step S104, e.g. by initiating a call to an emergency service or sending data to an emergency service.
  • the predetermined input may be defined as shaking of the mobile device 2 as detected using gyro sensor 22 and/or accelerometer 24.
  • the CPU 2 may detect a pattern in the sensor output of the gyro sensor 22 corresponding to shaking mobile device 2 as the predetermined input.
  • a communication connection is established with server 28 via the network 26 using the communication interface 18.
  • the camera 16 of the mobile device 2 is activated and the video captured by the camera 16 is streamed to server 28.
  • the "streaming mode" may also consist of taking still pictures with the camera, or even just a single still picture with the camera. These may be streamed to the server, and may additionally or alternately also be stored on the mobile device. In this way, activating the streaming mode may also function as a quick access to the camera mode.
  • the CPU 2 may check whether the streaming modus has been active for a predetermined time span in step SI 06. For example, a timer is started when the mobile device 2 enters the streaming modus. The CPU 2 then checks whether the timer has expired in step S106. If the timer has not yet expired, the mobile device remains in the streaming modus and keeps streaming video in step SI 04. However, if the timer has expired, the user may exit the streaming modus, i.e. stop streaming video to server 28.
  • a timer is started when the mobile device 2 enters the streaming modus. The CPU 2 then checks whether the timer has expired in step S106. If the timer has not yet expired, the mobile device remains in the streaming modus and keeps streaming video in step SI 04. However, if the timer has expired, the user may exit the streaming modus, i.e. stop streaming video to server 28.
  • step S108 after the optional steps 106, or directly after step S104, the CPU 2 may optionally check whether a passcode has been entered by the user.
  • the passcode used in step SI 08 may be identical the passcode used for switching the mobile device 2 from the locked state to the unlocked state, or the passcode in step SI 08 may be different. If no passcode is entered, the mobile device 2 remains in the streaming modus and the method continues from step SI 04. If however a passcode is entered in step SI 08, the mobile device 2 enables stopping the video stream in step
  • step SI 10 the video stream may be stopped automatically upon entering the passcode.
  • an on-screen button is display on touch screen 4, activation of which stops the video stream.
  • step S208 comprises receiving location coordinates of a second mobile device, e.g. mobile device 30 or 32 in step S210 (figure 6).
  • the server 28 calculates the distance between the first mobile device and the second device on the basis of the coordinates of the first mobile device received in step S204 and the coordinates of the second mobile device received in step S210. The server 28 then checks whether the distance calculated is smaller than a predetermined threshold, i.e. a predetermined range. If the distance between the devices is smaller than the predetermined range, the video stream of the first mobile device is forwarded to the second mobile device 30 or 32 in step S216.
  • a predetermined threshold i.e. a predetermined range
  • Forwarding the video stream to a second device 30 or 32 may comprise sending a stream notification message from the server 28 to said second device 30 or 32.
  • the second device 30 or 32 may be configured to display a notification interface on its display allowing the user to accept or decline the video stream. If the video stream is accepted by the second device 30 or 32, said second device sends a corresponding message to server 28, which subsequently starts forwarding the video stream to said second mobile device 30, 32.
  • the server 28 does not make a selection based on the GPS coordinates and broadcasts a stream notification message to all second mobile devices 30, 32.
  • the second mobile devices may execute the method of figure 7.
  • a second mobile device 30, 32 may receive said stream notification message in step S300 (figure 7).
  • the stream notification message may include the GPS coordinate of the first mobile device 2 from which the video stream originates.
  • the second mobile device 30, 32 may extract the location coordinate of the first mobile device from the stream notification message.
  • the second mobile device 30, 32 may determine its own location coordinates using its GPS unit. It is noted that step S304 may alternatively precede step S302.
  • the second mobile device 30, 32 then calculates the distance to the second mobile device on the basis of the location coordinates of the first mobile device extracted in step S302 and its own location coordinates, in step S306.
  • the second mobile device 30, 32 checks in step S308 whether the calculated distance is smaller than a predetermined threshold, i.e. a predetermined range. This predetermined threshold is preferably adjustable by the user, e.g. via a settings menu. If the first and second mobile devices are within the predetermined range, the second mobile device 30, 32 request the server 28 to forward the video stream of the first mobile device 2 in step S310. The server 28 responds by sending the video stream which is received by mobile device 2 in step S312. If the condition of step S308 does not apply, no further actions are performed (step S314).
  • the second mobile device 2 may first request confirmation by the user before requesting forwarding of the video stream.
  • the second mobile device may display a notification interface indicating to the user that a video stream is broadcasted within the predetermined range. If the user accepts the video stream, the method continues to step S310. However, if the user declines the broadcasting in step S308, the method proceeds to step S314 and no video is forwarded to the second mobile device 30, 32.
  • Figure 1 illustrates an exemplary interface displayed on the touch-screen of a mobile device in the streaming modus.
  • the interface may optionally display an indication 34 of the time left according to the timer of step SI 06 in figure 4.
  • the touch-screen may include a series of buttons 36, including an SOS button 38, a public button 40, a followers button 42, a private button 44 and a settings button 46. These buttons 38, 40, 42, 44, 46 correspond to different submodi in the streaming modus.
  • the SOS submodus has been described above.
  • the video stream may be forwarded to other mobile device within a predetermined range from the mobile device recording the videos stream.
  • the emergency service may be contacted automatically in the SOS submodus.
  • Identification data for identifying the user of the mobile device and/or a GPS location of the mobile device may also be sent to the emergency service.
  • a video forward in the SOS submodus may be indicated as such on displays of second mobile devices.
  • the first mobile device may send to the server 28 an indication that the video stream is recorded in an SOS submodus.
  • the server 28 sends a stream notification message to other mobile devices, the server may include in said message that the video stream is an "SOS stream".
  • Mobile devices receiving the stream notification message may indicate that the available video stream is an "SOS stream”.
  • the notification interface may have a red color.
  • the contacting of the emergency services may be prompted by a user of a mobile device receiving the stream indicating that the available video stream is an "SOS stream".
  • a user may activate the streaming mode as a precaution when entering a potentially dangerous situation, and a user of another mobile device following the stream may activate the SOS submodus and/or prompt the forwarding of the stream to emergency services if the potentially dangerous situation turns into a actually dangerous situation, even if the user of the first mobile device is unable to activate the SOS submodus, for instance due to being (temporarily) incapacitated.
  • the stream is accessible by anybody. Furthermore, other mobile phones within a predetermined of the first mobile device may receive a notification that the video stream is available. However, in the public submodus the mobile device does not contact the emergency services. Moreover, mobile devices receiving a stream notification message corresponding to the public submodus may indicate that the available stream is a public stream. For example, the notification interface may have a blue color.
  • the followers submodus only selected contacts of the user of the first mobile device receive a notification that a video stream is available. Moreover, the video stream is only accessible by the selected contacts. As in the public submodus, the mobile device does not contact emergency services. Mobile device receiving a stream notification message corresponding to the followers submodus may indicate that the available stream is a followers stream. For example, the notification interface may have a green color.
  • the video stream is not forward to other mobile devices, but stored on the server for later use by the user.
  • the video may be played back later by the user, after logging onto the server e.g. using a web service.
  • the notification interface announcing an available video stream may indicate a user ID corresponding to the user of the mobile device recording said video stream.
  • the user of mobile device 2 may set the desired submodus to be used when entering the streaming modus. For example, the user may control settings of the streaming modus such that the SOS submodus is started if the device enters the streaming modus. In another example, the user may select that the public submodus is used when entering the streaming modus.
  • the user may switch between the different submodi by operating the corresponding button 38, 40, 42, 44.
  • the mobile device can only be switched to any of the other submodi by entering a passcode, as in step SI 08 of figure 4.
  • the settings menu allows the user to select which submodi is started when entering the streaming modus.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Emergency Management (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Environmental & Geological Engineering (AREA)
  • Public Health (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephone Function (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention relates to a mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium. The mobile device comprising at least one processing component; a memory; a display; an input unit for detecting user input; at least one camera; and a wireless communication unit; wherein the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state, characterized in that the mobile device is configured to switch to a streaming modus upon detection of a predetermined user input by the input unit in the locked state of the mobile device, wherein the device in said streaming modus is configured to establish a communication connection with a remote server using the wireless communication unit, to activate the at least one camera and to stream video from the at least one camera to the remote server.

Description

MOBILE DEVICE AND METHOD FOR INITIATING A VIDEO STREAM, SERVER AND METHOD FOR FORWARDING A VIDEO STREAM AND CORRESPONDING SYSTEM AND COMPUTER READABLE STORAGE MEDIUM The invention relates to a mobile device, i.e. a mobile electronic device, and method for initiating a video stream. The invention further relates to a server and method for forwarding a video stream. The invention further relates to a system including the mobile device and the server, and to a computer readable storage medium storing computer executable instructions for executing the steps of the method.
Nowadays, mobile devices having internet connectivity, such as smartphones, tablet computers and laptops are ubiquitous. Moreover, many people always carry their mobile device with them. This holds in particular true for smartphones. This trend is of great importance in emergency situations or safety situations, as many people can now immediately warn emergency services, e.g. call 911. Therefore, response times can be lowered.
Moreover, many mobile devices, smartphones in particular, are equipped with a camera.
This enables users to record the emergency situation, e.g. a robbery, vandalism, burglary or accidents. Many other situations, such as hostage takings, fires, assaults, rapes etc., can also be thought of in this context. The recorded video may assist the police in arresting the perpetrator or reconstructing the events. Another example of a situation wherein a user may want to record a video is in the case of police brutality.
Moreover, streaming video applications may be used for said purpose. Streaming video from a mobile device is known per se e.g. in the form of video chat applications such as Skype TM. In such video chat applications, the camera of the mobile device is used to record a video, which is then streamed to a server. The server forwards the video stream to the other user participating in the video call.
However, in order to start streaming video, the user has to unlock the mobile device, locate the video streaming application, open said video streaming application etc.. In an emergency situation the user may not be in a position to perform said actions. For example, when a user is being robbed or assaulted by a criminal, he will not be given the opportunity to perform said actions.
An object of the invention is to reduce said disadvantages and to enable quickly streaming a video using a mobile device in case of an emergency.
This object is achieved with the mobile device according to the invention. In an embodiment the mobile device comprises:
- at least one processing component;
- a memory; - a display;
- an input unit for detecting user input;
- at least one camera; and
- a wireless communication unit;
wherein the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state,
characterized in that the mobile device is configured to switch to a streaming modus upon detection of a predetermined user input by the input unit in the locked state of the mobile device, wherein the device in said streaming modus is configured to establish a communication connection with a remote server using the wireless communication unit, to activate the at least one camera and to stream video from the at least one camera to the remote server.
The mobile device may for example be a tablet computer, a laptop or a smart watch.
Preferably, the mobile device is a smartphone.
Mobile devices having a locked state and an unlocked state are known per se. For example, the mobile device may be unlocked by a user by entering a passcode, e.g. on a touch-sensitive display or a keyboard. Most functions of the mobile device are not available in the locked state. For example, a locked smartphone does not allow initiating phone calls or starting applications.
According to the embodiment above, the device is switchable to a streaming modus. In this streaming modus, video from the one or more cameras of the mobile device is streamed to a remote server. In particular, the device is configured such that it can be switched to the streaming modus when it is in the locked state. In other words, the device in its locked state can start streaming video from the camera. The device is configured to switch to said streaming modus when a
predetermined user input is received.
Therefore, the user does not have to unlock the mobile device and can immediately start starting streaming, which is of particular importance in an emergency situation. Moreover, the user does not need to manually open an application and/or select items from a menu: the video streaming is started automatically upon detecting the predetermined user input.
The streaming modus may be implemented in hardware and/or software. In an example, the memory of the device stores computer readable instructions which, when executed by the at least one processor, activate the streaming modus when the predetermined user input is detected.
In an embodiment, the mobile device is further configured to switch to the streaming modus upon detection of said predetermined user input by the input unit in the unlocked state of the mobile device irrespective of the current application running on said mobile device in its unlocked state.
Therefore, in addition to being able to switch the streaming modus in the locked state of the mobile device, the user may also start streaming when the device is unlocked. Therefore, also in case an emergency occurs while the user is using his mobile device, the user can immediately start streaming video by providing the predetermined user input. For example, the user may be in the middle of a call when an emergency occurs. In another example, the user may be using an application (app) when an emergency occurs. By providing the predetermined input, the user may start streaming video of the emergency, irrespective of whether the device is currently running a different application or function.
In an embodiment, the mobile device is further configured in the streaming modus to automatically call emergency services using the wireless communication unit.
This call may be accompanied by the sending of identifying information of the mobile device user.
In addition to providing video evidence of the emergency or preventing an unsafe situation, emergency service are simultaneously warned.
In an embodiment, the display is a touch-sensitive display and the input unit for detecting said predetermined user input comprises at least one input unit distinct from said touch-sensitive display. In other words, the predetermined user input is received via another input unit than the touch-sensitive display.
User interaction with a touch-sensitive display requires a user to view the screen, as the user has to touch the right areas on the screen to activate on screen buttons. However, in emergency situations, the user may not be in a position to view the screen or at least not be in a position to accurately operate a touch interface. The invention overcomes said problem by providing a user input different from the touch-sensitive screen as the predetermined input for switching to the streaming modus.
In an embodiment, the input unit comprises an accelerometer or gyroscope, i.e. a gyro sensor, wherein the input unit is configured to detect shaking of the mobile device by the user as said predetermined user input.
For example, the predetermined user input may comprise shaking the mobile phone for a predetermined time span, e.g. at least 5 seconds or at least 10 seconds. In another example, the predetermined user input comprises shaking the mobile phone according to a predetermined pattern, e.g. intermittently shaking and holding still the mobile phone with at least two repetitions.
In an embodiment, the input unit comprises a voice control unit comprising a microphone, the voice control unit being configured to detect a voice command of the user as said
predetermined user input.
For example, the predetermined user input may comprise the voice command "expose!" "start streaming!" or "emergency!". In an embodiment, the input unit comprises a button of the mobile phone, the input unit being configured to detect a pattern of repeatedly operating said button by the user within a predetermined time span as said predetermined user input.
The time span may for example be at least 5 seconds or at least 10 seconds.
In an embodiment, the input unit comprises a squeezable cover accessory of the mobile device, wherein the input unit is configured to detect squeezing of the cover accessory by the user as said predetermined user input.
For example, the predetermined input may comprise a pattern of repeatedly squeezing the squeeze cover accessory.
In an embodiment, the mobile device further comprises a bandwidth monitoring unit configured to determine the available bandwidth for streaming, wherein the mobile device is further configured to adjust the video quality according to the available bandwidth determined by the bandwidth monitoring unit.
For example, the mobile device may convert the video to black and white and/or reduce the resolution of the video if the available bandwidth is below a predetermined threshold. In situations with very low bandwidth, only intermittently taken photos may be streamed.
In an embodiment, the mobile device is further configured to store said video in its memory in addition to streaming the video to said remote server. This may also be done if an internet connection is for some reason unavailable. In such cases it is advantageous to configure the mobile device to stream the stored video to said remote server as soon as an internet connection is restored.
In an embodiment, the mobile device is further configured to stay in the streaming modus for at least a predetermined time span.
In an unsafe situation, a perpetrator may try to take the phone away from the user to stop the emergency video stream. According to the above embodiment however, the mobile device will stay in the streaming modus, i.e. is locked in the streaming modus, for at least a predetermined time span. Therefore, the perpetrator will not be able to shut down the streaming modus.
In one example, the streaming modus can only be ended if a security code is entered. In a further example, the mobile device remains in the streaming modus indefinitely, until a security code is entered. For example, the security code may be entered using a touch-sensitive display of the mobile device.
In an embodiment, the mobile device further comprises a GPS unit for determining the location coordinates of the device, wherein the mobile device is further configured to send the location coordinates determined by the GPS unit to the server using the wireless communication unit in the streaming modus. In other words, upon detecting the predetermined user input in the locked state or unlocked state, the mobile device will in addition to start streaming video send the GPS location of the mobile device to the server. This enables watchers of the video stream to view the location of the incident. For example, the GPS location may be displayed on an interactive map application of a mobile device such as a smartphone. For example, the GPS location may be displayed using Google Maps TM or Bing Maps TM.
Furthermore, emergency services are able to retrieve the location coordinates of the emergency. In another embodiment, the location coordinates are sent to the emergency services in conjunction with calling the emergency services.
In an embodiment, the wireless communication unit is suitable for receiving a stream notification message from a server, said stream notification message announcing a video stream originating from another mobile device, wherein the mobile device is configured in both the locked stated and unlocked state to display a notification interface on the display of the mobile device upon receipt of a stream notification message by the wireless communication unit and to start playout of said video stream upon selection of a user selectable item of said notification interface by the user.
For example, the notification interface may be a pop-up screen displayed on the touchscreen of the mobile device. In particular, the pop-up screen is displayed irrespective of whether the mobile device is locked or unlocked. Even in the locked state of the mobile device, the user may select a user selectable item to start playout of the corresponding video stream. The user selectable item is for example a link, a button, a clickable image or the like.
In a further embodiment, the stream notification message includes a location coordinate of said other mobile device, the mobile device being configured in both the locked stated and unlocked state to display said notification interface if the location coordinate of said other mobile device is within a predetermined range of the location coordinate of the mobile device as determined by the GPS unit.
In other words, a first mobile device receives a stream notification message originating from a second mobile device. The stream notification message includes a GPS coordinate of the second mobile device. Moreover, the first mobile device determines its own GPS coordinate using its GPS unit. The first mobile device compares the GPS location of the first mobile device with the GPS location of the second mobile device. If the locations are within a predetermined range, the notification interface is displayed on the first mobile device. If the distance between the locations exceeds the predetermined range, no notification interface is displayed.
Therefore, when a user streams a video of an incident, all mobile devices embodying the invention which are within range receive a notification of said video stream. Therefore, users of mobile devices nearby become aware of the incident and may act in order to deescalate the emergency or safety situation.
Preferably, the predetermined range is adjustable. For example, the user of the first mobile device may configure the range using a settings menu.
In an embodiment, the mobile device is further configured to send to the server identification data for identifying the user in the streaming modus. In other words, upon detecting the predetermined user input, the mobile device initiates the video stream and sends the identification data and/or GPS location. In particular, the notification message send by the server to other mobile devices may include said identification data. Therefore, the identity of the user of the mobile device is shown to users of said other mobile devices.
In a further embodiment, the mobile device is configured to receive a notification message including identification data and/or GPS location, wherein the notification interface is only displayed if the GPS location is within a predetermined range as described above or the identification data corresponds to identification data in an adjustable contact list stored on the mobile device.
Therefore, the user may specify from which contacts he wishes to display notification messages in case of a video stream notification message, irrespective of the location of said contact. Notification messages corresponding to video streams of a person not included in the contact list only result in a notification if said person is within the predetermined range.
The invention further relates to a method for initiating a video stream from a mobile device, wherein the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state.
In an embodiment, the method comprises automatically switching the device to a streaming modus if a predetermined user input is detected in the locked state of the mobile device, wherein in the streaming modus the following steps are executed by the mobile device:
- establishing a communication connection from the mobile device to a remote server;
- activating at least one camera of the mobile device; and
- streaming video captured by said at least one camera to the remote server.
The invention further relates to a server for forwarding a video stream. In an embodiment the server comprises:
- a communication unit; and
- a processing component connected to the communication unit,
wherein the communication unit is configured to receive, from at least one first mobile device, location coordinates of said at least one first mobile device and a video stream, and to receive, from at least one second mobile device, location coordinates of said at least one second mobile device, the processing component being configured to forward the video stream of said at least one first mobile device to said at least one second mobile device if the location coordinates of said at least one first mobile device is within a predetermined distance of the location coordinates of said at least one second mobile device.
The server may further be configured to store the video of the video stream in a memory of the server in addition to forwarding the video stream.
For example, a user of a first mobile device may open a user account, wherein all videos stored on the server from said first mobile device are associated with said user account. The user may then log in to a web service running on the server, to be able to view the videos associated with his user account.
In an embodiment, the server is configured to receive from said at least one first mobile device identification data for identifying the user, e.g. a unique user name or number. The server may store a contact list associated with said identification data and be configured to forward said video stream received from said at least one first mobile device to selected contacts of said contact list associated with said identification data. In other words, the server forwards the video stream to the contacts associated with the user.
The invention further relates to a method for forwarding a video stream using a server. In an embodiment the method comprises the following steps executed by the server:
- receiving location coordinates from at least one first mobile device;
- receiving location coordinates from at least one second mobile device; and
- forwarding a video stream received from said at least one first mobile device to said at least one further mobile device if the location coordinates of said first mobile device are within a predetermined distance of the location coordinates of said at least one second mobile device.
The invention further relates to a system comprising the server as described above and the mobile device as described above.
Finally, the invention relates to a non-transitory computer readable storage medium storing computer executable instructions which when executed by an electronic device, execute the steps of any of the methods described above.
The same effects and advantages apply to the method, server and system according to the invention as described above for the mobile device according to the invention. Moreover, features of the mobile device, method, server and system may be combined.
Further details, effects and advantages of the invention will be elucidated on the basis of exemplary embodiments thereof, wherein reference is made to the accompanying drawings.
- Figure 1 shows a mobile device according to an embodiment of the invention; - Figure 2 shows schematically an architecture of the mobile device of figure 1 ; - Figure 3 shows schematically a network including the mobile device of figures 1 and 2;
- Figure 4 shows a block diagram of a method for initiating a video stream from a mobile device according to an embodiment of the invention;
- Figure 5 shows a block diagram of a method for forwarding a video stream by a server according to an embodiment of the invention;
- Figure 6 shows substeps of the last step of the method of figure 5; and
- Figure 7 shows a block diagram of a method for receiving a video stream by a mobile device according to an embodiment of the invention.
The mobile device according to the embodiment of figure 1 is a smartphone 2 having a touch-sensitive display 4, i.e. a touch screen 4. The smartphone may further comprise one or more physical buttons 6.
According to the exemplary embodiment, the mobile device 2 comprises a central processing unit, CPU, 8 (figure 2). Optionally, the mobile device 2 may comprise a graphics processing unit, GPU, in addition to a CPU. The mobile device 2 further comprises a bus 10, a GPS unit 12, a memory 14, a camera 16, a communication interface 18 for wireless
communication, e.g. for internet access, and one or more input units 20, e.g. including sensors such as a gyro sensor 22 and accelerometer 24 and/or buttons, such as button 6. The CPU 8, touch screen 4, GPS unit 12, memory 14, camera 16, communication interface 18 and input units 20 are all connected to bus 10, directly or via an appropriate interface. The bus 10 enables communication between the components connected thereto.
The mobile device 2 may connect to a network 26, such as the internet, using the communication interface 18 (figure 3). In particular, the mobile device 2 may establish a communication connection with a server 28 for streaming video to said server 28. The server 28 may forward the video stream to other mobile devices, such as smartphones 30 or tablets 32.
An embodiment of a method performed by mobile device 2 is illustrated in figure 4. The mobile device 2 will be in its locked state SI 00 when not used by a user. In the locked state SI 00, usage of the mobile device 2 is restricted. Typically, a user has to enter a passcode to unlock the mobile device, i.e. to switch the device from the locked state S100 to an unlocked state.
In the locked state S100 of mobile device 2, the CPU 2 of mobile device 2 checks whether a predetermined input is received via input units 20 in step S102. If no input is detected or detected input does not correspond to the predetermined input, the mobile device 2 remains in the locked state S100. If the CPU 2 determines that input has been received from the input units 20 and that said input corresponds to the predetermined input, the mobile device switches to the streaming modus in step SI 04. Optionally, the mobile device 2 also communicates with emergency services in step S104, e.g. by initiating a call to an emergency service or sending data to an emergency service.
In particular, the predetermined input may be defined as shaking of the mobile device 2 as detected using gyro sensor 22 and/or accelerometer 24. For example, the CPU 2 may detect a pattern in the sensor output of the gyro sensor 22 corresponding to shaking mobile device 2 as the predetermined input.
When the mobile device 2 enters the streaming modus in step SI 04, a communication connection is established with server 28 via the network 26 using the communication interface 18. Moreover, the camera 16 of the mobile device 2 is activated and the video captured by the camera 16 is streamed to server 28. Note that the "streaming mode" may also consist of taking still pictures with the camera, or even just a single still picture with the camera. These may be streamed to the server, and may additionally or alternately also be stored on the mobile device. In this way, activating the streaming mode may also function as a quick access to the camera mode.
Optionally, the CPU 2 may check whether the streaming modus has been active for a predetermined time span in step SI 06. For example, a timer is started when the mobile device 2 enters the streaming modus. The CPU 2 then checks whether the timer has expired in step S106. If the timer has not yet expired, the mobile device remains in the streaming modus and keeps streaming video in step SI 04. However, if the timer has expired, the user may exit the streaming modus, i.e. stop streaming video to server 28.
In step S108, after the optional steps 106, or directly after step S104, the CPU 2 may optionally check whether a passcode has been entered by the user. The passcode used in step SI 08 may be identical the passcode used for switching the mobile device 2 from the locked state to the unlocked state, or the passcode in step SI 08 may be different. If no passcode is entered, the mobile device 2 remains in the streaming modus and the method continues from step SI 04. If however a passcode is entered in step SI 08, the mobile device 2 enables stopping the video stream in step
SI 10. For example, in step SI 10 the video stream may be stopped automatically upon entering the passcode. Alternatively, in step SI 10 an on-screen button is display on touch screen 4, activation of which stops the video stream.
An embodiment of a method performed by server 28 is illustrated in figure 5. When a first mobile device 2 enters the streaming modus, a connection request is send to server 28. The server receives said connection request in step S200. Upon receiving said connection request, a connection is established between the server 28 and the first mobile device 2 in step S202. The server 28 receives the location coordinates of the first mobile device 2 in step S204 and further receives the video stream of the first mobile device 2 in step S206. The video stream is forwarded to second mobile devices in step S208. Step S208 will be further elucidated with reference to figure 6. In an embodiment, step S208 comprises receiving location coordinates of a second mobile device, e.g. mobile device 30 or 32 in step S210 (figure 6). In this embodiment, the server 28 calculates the distance between the first mobile device and the second device on the basis of the coordinates of the first mobile device received in step S204 and the coordinates of the second mobile device received in step S210. The server 28 then checks whether the distance calculated is smaller than a predetermined threshold, i.e. a predetermined range. If the distance between the devices is smaller than the predetermined range, the video stream of the first mobile device is forwarded to the second mobile device 30 or 32 in step S216.
Forwarding the video stream to a second device 30 or 32 may comprise sending a stream notification message from the server 28 to said second device 30 or 32. The second device 30 or 32 may be configured to display a notification interface on its display allowing the user to accept or decline the video stream. If the video stream is accepted by the second device 30 or 32, said second device sends a corresponding message to server 28, which subsequently starts forwarding the video stream to said second mobile device 30, 32.
In an alternative embodiment, the server 28 does not make a selection based on the GPS coordinates and broadcasts a stream notification message to all second mobile devices 30, 32. In such an embodiment, the second mobile devices may execute the method of figure 7. In particular, a second mobile device 30, 32 may receive said stream notification message in step S300 (figure 7). The stream notification message may include the GPS coordinate of the first mobile device 2 from which the video stream originates. In step S302 the second mobile device 30, 32 may extract the location coordinate of the first mobile device from the stream notification message. In step S304 the second mobile device 30, 32 may determine its own location coordinates using its GPS unit. It is noted that step S304 may alternatively precede step S302. The second mobile device 30, 32 then calculates the distance to the second mobile device on the basis of the location coordinates of the first mobile device extracted in step S302 and its own location coordinates, in step S306. The second mobile device 30, 32 checks in step S308 whether the calculated distance is smaller than a predetermined threshold, i.e. a predetermined range. This predetermined threshold is preferably adjustable by the user, e.g. via a settings menu. If the first and second mobile devices are within the predetermined range, the second mobile device 30, 32 request the server 28 to forward the video stream of the first mobile device 2 in step S310. The server 28 responds by sending the video stream which is received by mobile device 2 in step S312. If the condition of step S308 does not apply, no further actions are performed (step S314).
Optionally, in step S310, the second mobile device 2 may first request confirmation by the user before requesting forwarding of the video stream. For example, the second mobile device may display a notification interface indicating to the user that a video stream is broadcasted within the predetermined range. If the user accepts the video stream, the method continues to step S310. However, if the user declines the broadcasting in step S308, the method proceeds to step S314 and no video is forwarded to the second mobile device 30, 32.
Figure 1 illustrates an exemplary interface displayed on the touch-screen of a mobile device in the streaming modus. The interface may optionally display an indication 34 of the time left according to the timer of step SI 06 in figure 4. Further optionally, the touch-screen may include a series of buttons 36, including an SOS button 38, a public button 40, a followers button 42, a private button 44 and a settings button 46. These buttons 38, 40, 42, 44, 46 correspond to different submodi in the streaming modus.
The SOS submodus has been described above. In particular, in the SOS submodus the video stream may be forwarded to other mobile device within a predetermined range from the mobile device recording the videos stream. Preferably, the emergency service may be contacted automatically in the SOS submodus. Identification data for identifying the user of the mobile device and/or a GPS location of the mobile device may also be sent to the emergency service.
Furthermore, a video forward in the SOS submodus may be indicated as such on displays of second mobile devices. In particular, the first mobile device may send to the server 28 an indication that the video stream is recorded in an SOS submodus. When the server 28 sends a stream notification message to other mobile devices, the server may include in said message that the video stream is an "SOS stream". Mobile devices receiving the stream notification message may indicate that the available video stream is an "SOS stream". For example, the notification interface may have a red color.
The contacting of the emergency services may be prompted by a user of a mobile device receiving the stream indicating that the available video stream is an "SOS stream". In this manner, a user may activate the streaming mode as a precaution when entering a potentially dangerous situation, and a user of another mobile device following the stream may activate the SOS submodus and/or prompt the forwarding of the stream to emergency services if the potentially dangerous situation turns into a actually dangerous situation, even if the user of the first mobile device is unable to activate the SOS submodus, for instance due to being (temporarily) incapacitated.
In the public submodus, like in the SOS submodus, the stream is accessible by anybody. Furthermore, other mobile phones within a predetermined of the first mobile device may receive a notification that the video stream is available. However, in the public submodus the mobile device does not contact the emergency services. Moreover, mobile devices receiving a stream notification message corresponding to the public submodus may indicate that the available stream is a public stream. For example, the notification interface may have a blue color.
In the followers submodus, only selected contacts of the user of the first mobile device receive a notification that a video stream is available. Moreover, the video stream is only accessible by the selected contacts. As in the public submodus, the mobile device does not contact emergency services. Mobile device receiving a stream notification message corresponding to the followers submodus may indicate that the available stream is a followers stream. For example, the notification interface may have a green color.
In the private submodus, the video stream is not forward to other mobile devices, but stored on the server for later use by the user. The video may be played back later by the user, after logging onto the server e.g. using a web service.
In any submodus, the notification interface announcing an available video stream may indicate a user ID corresponding to the user of the mobile device recording said video stream.
The user of mobile device 2 may set the desired submodus to be used when entering the streaming modus. For example, the user may control settings of the streaming modus such that the SOS submodus is started if the device enters the streaming modus. In another example, the user may select that the public submodus is used when entering the streaming modus.
However, when the mobile device 2 is in the streaming modus, the user may switch between the different submodi by operating the corresponding button 38, 40, 42, 44. However, if the mobile device is in the SOS submodus, the device can only be switched to any of the other submodi by entering a passcode, as in step SI 08 of figure 4.
If the on-screen button 46 is activated, a settings menu is shown. For example, the settings menu allows the user to select which submodi is started when entering the streaming modus.
The present invention is by no means limited to the above described preferred embodiments thereof. The rights sought are defined by the following claims, within the scope of which many modifications can be envisaged.

Claims

1. Mobile device comprising:
- at least one processing component;
- a memory;
- a display;
- an input unit for detecting user input;
- at least one camera; and
- a wireless communication unit;
wherein the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state,
characterized in that the mobile device is configured to switch to a streaming modus upon detection of a predetermined user input by the input unit in the locked state of the mobile device, wherein the device in said streaming modus is configured to establish a communication connection with a remote server using the wireless communication unit, to activate the at least one camera and to stream video from the at least one camera to the remote server.
2. Mobile device according to clause 1 , wherein the mobile device is further configured to switch to the streaming modus upon detection of said predetermined user input by the input unit in the unlocked state of the mobile device irrespective of the current application running on said mobile device in its unlocked state.
3. Mobile device according to clause 1 or 2, wherein the mobile device is further configured in the streaming modus to automatically call emergency services using the wireless communication unit.
4. Mobile device according to clauses 1, 2 or 3, wherein the display is a touch-sensitive display and the input unit for detecting said predetermined user input comprises at least one input unit distinct from said touch-sensitive display.
5. Mobile device according to any of the clauses 1-4, wherein the input unit comprises an accelerometer or gyroscope, the input unit being configured to detect shaking of the mobile device by the user as said predetermined user input.
6. Mobile device according to any of the clauses 1-5, wherein the input unit comprises a voice control unit comprising a microphone, the voice control unit being configured to detect a voice command of the user as said predetermined user input.
7. Mobile device according to any of the clauses 1-6, wherein the input unit comprises a button of the mobile phone, the input unit being configured to detect a pattern of repeatedly operating said button by the user within a predetermined time span as said predetermined user input.
8. Mobile device according to any of the clauses 1-7, wherein the input unit comprises a squeezable cover accessory of the mobile device, wherein the input unit is configured to detect squeezing of the cover accessory by the user as said predetermined user input.
9. Mobile device according to any of the clauses 1-8, further comprising a bandwidth monitoring unit configured to determine the available bandwidth for streaming and the mobile device is further configured to adjust the video quality according to the available bandwidth determined by the bandwidth monitoring unit.
10. Mobile device according to any of the clauses 1-9, the mobile device further being configured to store said video in its memory in addition to streaming the video to said remote server.
11. Mobile device according to any of the clauses 1-10, the mobile device further being configured to stay in the streaming modus for at least a predetermined time span.
12. Mobile device according to any of the clauses 1-11, further comprising:
- a GPS unit for determining the location coordinates of the device,
wherein the mobile device is further configured to send the location coordinates determined by the GPS unit to the server using the wireless communication unit in the streaming modus.
13. Mobile device according to any of the clauses 1-12, wherein the wireless communication unit is suitable for receiving a stream notification message from a server, said stream notification message announcing a video stream originating from another mobile device, wherein the mobile device is configured in both the locked stated and unlocked state to display a notification interface on the display of the mobile device upon receipt of a stream notification message by the wireless communication unit and to start playout of said video stream upon selection of a user selectable item of said notification interface by the user.
14. Mobile device according to any of the clauses 12 and 13, wherein the stream notification message includes a location coordinate of said other mobile device, the mobile device being configured in both the locked stated and unlocked state to display said notification interface if the location coordinate of said other mobile device is within a predetermined range of the location coordinate of the mobile device as determined by the GPS unit.
15. Method for initiating a video stream from a mobile device, wherein the mobile device is switchable between a locked state preventing unauthorized and unintentional usage of the device and an unlocked state, the method being characterized by automatically switching the device to a streaming modus if a predetermined user input is detected in the locked state of the mobile device, wherein in the streaming modus the following steps are executed by the mobile device:
- establishing a communication connection from the mobile device to a remote server; - activating at least one camera of the mobile device; and
- streaming video captured by said at least one camera to the remote server.
16. Server for forwarding a video stream, the server comprising:
- a communication unit; and
- a processing component connected to the communication unit,
characterized in that the communication unit is configured to receive, from at least one first mobile device, location coordinates of said at least one first mobile device and a video stream, and to receive, from at least one second mobile device, location coordinates of said at least one second mobile device, the processing component being configured to forward the video stream of said at least one first mobile device to said at least one second mobile device if the location coordinates of said at least one first mobile device is within a predetermined distance of the location coordinates of said at least one second mobile device.
17. Method for forwarding a video stream using a server, characterized by the following steps executed by the server:
- receiving location coordinates from at least one first mobile device;
- receiving location coordinates from at least one second mobile device; and
- forwarding a video stream received from said at least one first mobile device to said at least one further mobile device if the location coordinates of said first mobile device are within a predetermined distance of the location coordinates of said at least one second mobile device.
18. System comprising the server of clause 16 and the mobile device according to any of the clauses 1-14.
19. A non-transitory computer readable storage medium storing computer executable instructions which when executed by an electronic device, execute the steps of the method of clause 15 or 17.
PCT/NL2016/050642 2015-09-16 2016-09-16 Mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium WO2017048128A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP16777810.9A EP3351027A1 (en) 2015-09-16 2016-09-16 Mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium
CN201680066794.9A CN108463990A (en) 2015-09-16 2016-09-16 Mobile device with for initiating the method for video flowing, server and method for forwarding video flowing and corresponding system and computer readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL2015449 2015-09-16
NL2015449A NL2015449B1 (en) 2015-09-16 2015-09-16 Mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium.

Publications (1)

Publication Number Publication Date
WO2017048128A1 true WO2017048128A1 (en) 2017-03-23

Family

ID=55077594

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NL2016/050642 WO2017048128A1 (en) 2015-09-16 2016-09-16 Mobile device and method for initiating a video stream, server and method for forwarding a video stream and corresponding system and computer readable storage medium

Country Status (4)

Country Link
EP (1) EP3351027A1 (en)
CN (1) CN108463990A (en)
NL (1) NL2015449B1 (en)
WO (1) WO2017048128A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120040635A1 (en) * 2010-08-13 2012-02-16 Boucher Joseph N Mobile Interoperability Workstation Controller Having Video Capabilities Within an Incident Communications Network
EP2464149A1 (en) * 2010-12-07 2012-06-13 Research In Motion Limited Emergency communication using images
US20120225635A1 (en) * 2010-12-24 2012-09-06 Touch Technologies, Inc. Method and apparatus to take emergency actions when a device is shaken rapidly by its user
US20130040600A1 (en) * 2010-06-25 2013-02-14 EmergenSee, LLC Notification and Tracking System for Mobile Devices
US20130091561A1 (en) * 2011-10-11 2013-04-11 Keisey L. Bruso Executing commands provided during user authentication
US20140120860A1 (en) * 2012-10-25 2014-05-01 David Amis Systems and methods for user customized security responses
US20140315513A1 (en) * 2013-04-19 2014-10-23 Tencent Technology (Shenzhen) Company Limited Method for making emergency call, mobile electronic device and computer readable storage medium
US8934015B1 (en) * 2011-07-20 2015-01-13 Google Inc. Experience sharing

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101246633A (en) * 2008-04-02 2008-08-20 朱凯 Cooperative alarming and deterring method and device
CN102402364A (en) * 2010-09-10 2012-04-04 北京创新方舟科技有限公司 Method and device for scheduling application according to touch screen operation of user
KR20130110774A (en) * 2012-03-30 2013-10-10 삼성전자주식회사 Method and apparatus for configuring and providing first-aid guide in a portable terminal
CN103402189A (en) * 2013-08-19 2013-11-20 黄斌 Smart phone based one-key resorting and information management platform and implementing method thereof
CN104320543A (en) * 2014-11-06 2015-01-28 上海斐讯数据通信技术有限公司 System and method for automatically making help seeking phone call by shaking mobile phone
CN104539838A (en) * 2014-12-02 2015-04-22 厦门美图移动科技有限公司 Method and device for rapidly opening mobile phone camera for performing video recording

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130040600A1 (en) * 2010-06-25 2013-02-14 EmergenSee, LLC Notification and Tracking System for Mobile Devices
US20120040635A1 (en) * 2010-08-13 2012-02-16 Boucher Joseph N Mobile Interoperability Workstation Controller Having Video Capabilities Within an Incident Communications Network
EP2464149A1 (en) * 2010-12-07 2012-06-13 Research In Motion Limited Emergency communication using images
US20120225635A1 (en) * 2010-12-24 2012-09-06 Touch Technologies, Inc. Method and apparatus to take emergency actions when a device is shaken rapidly by its user
US8934015B1 (en) * 2011-07-20 2015-01-13 Google Inc. Experience sharing
US20130091561A1 (en) * 2011-10-11 2013-04-11 Keisey L. Bruso Executing commands provided during user authentication
US20140120860A1 (en) * 2012-10-25 2014-05-01 David Amis Systems and methods for user customized security responses
US20140315513A1 (en) * 2013-04-19 2014-10-23 Tencent Technology (Shenzhen) Company Limited Method for making emergency call, mobile electronic device and computer readable storage medium

Also Published As

Publication number Publication date
NL2015449B1 (en) 2017-04-03
EP3351027A1 (en) 2018-07-25
CN108463990A (en) 2018-08-28

Similar Documents

Publication Publication Date Title
US10178214B2 (en) Methods and apparatuses for binding with device
US10560491B2 (en) Methods and apparatuses for binding with device
US10123196B2 (en) Method and device for alarm triggering
WO2016192323A1 (en) Video communication method and device
RU2637470C2 (en) Method and device for detecting intelligent device
US10064000B2 (en) Method, apparatus, and storage medium for acquiring terminal information
WO2016101482A1 (en) Connection method and device
US20160381276A1 (en) Method and user terminal for capturing video frame
US9041763B2 (en) Method for establishing video conference
US20170272425A1 (en) Method and device for accessing smart camera
JP2016521478A (en) Method, apparatus, terminal device, program, and recording medium for protecting terminal device
CN106231052B (en) Electronic equipment and help calling method thereof
US20160182624A1 (en) Method and device for wireless connection
CA2774089C (en) Communications via a media content device
US20200136846A1 (en) Terminal and method for bidirectional live sharing and smart monitoring
CN113329240A (en) Screen projection method and device
JP2000235688A (en) Controlling method for personal security, its system and storage medium recording its control program
WO2024016772A1 (en) Incoming-call reminding method and electronic device
EP3282681A1 (en) Method and device for alarming with terminal, and storage medium
US20160234868A1 (en) Mobile security monitoring
CN107493284B (en) Account login method and device
EP3223514A1 (en) System and method for tele-assistance by means of a smart television
US9674768B2 (en) Method and device for accessing wireless network
CN106781241A (en) A kind of emergency system for seeking help and method
EP3337100B1 (en) Method for providing a communication between a doorbell unit of a smart home and an external device, computer program products and doorbell unit

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16777810

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2016777810

Country of ref document: EP