WO2013054145A1 - Interactive video mobile communications system - Google Patents

Interactive video mobile communications system Download PDF

Info

Publication number
WO2013054145A1
WO2013054145A1 PCT/HU2012/000080 HU2012000080W WO2013054145A1 WO 2013054145 A1 WO2013054145 A1 WO 2013054145A1 HU 2012000080 W HU2012000080 W HU 2012000080W WO 2013054145 A1 WO2013054145 A1 WO 2013054145A1
Authority
WO
WIPO (PCT)
Prior art keywords
transmitter
user
internet
web page
int
Prior art date
Application number
PCT/HU2012/000080
Other languages
French (fr)
Inventor
Ferenc BROKÉS
Imre SCHOFHAUSER
Róbert VARGÁ
Original Assignee
Brokes Ferenc
Schofhauser Imre
Varga Robert
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Brokes Ferenc, Schofhauser Imre, Varga Robert filed Critical Brokes Ferenc
Publication of WO2013054145A1 publication Critical patent/WO2013054145A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information

Definitions

  • the invention relates to an interactive mobile video communication system that interactively transmits live on-site data and information network from a remote location, where appropriate, it retrieves data through the Internet and on request it can mediate on-site realtime video and audio.
  • Smartphone is a mobile phone with an operation system that has a standardized interface and platform for application developers.
  • a smartphone is simply a device that provides advanced functionalities such as e-mail, Internet, e-book reader, and/or a full keyboard, etc. a miniature computer, which is capable of functioning as a phone. ".
  • Skype A variety of solutions are currently known for sending image information from a remote location:
  • the nowadays commonly used Skype system has the ability to transmit voice and conversation through the Internet between two or more users, and if the parties' computers are connected to cameras, than the parties can even transmit live video information.
  • This image is typically the person involved in the conversation, or the image of the environment surrounding the person.
  • the partners who are connected are each other's friends, but there is also the possibility to search through Skype contacts according to the given criteria and to add new contacts.
  • Skype is available on mobile devices, where the smartphone can replace the personal computer and where the signal transmission is via mobile broadband Internet.
  • Video communication applications written for mobile devices (such as Google Talk, FaceTime, etc.) that allow for transmitting video data, even in a remote controlled way. Where appropriate, it is possible to use front and/or rear cameras as well. These applications are however, operating system, device type, and country specific.
  • the Mobiola Application http://www.warelex.com/) allows the camera of the mobile phone to function as a web camera, so the video chat applications (Skype, MSN, Yahoo Messenger, etc.) are becoming more mobile and remote controlling is are, but it is limited by the range of WiFi devices, through which the PC and the mobile phone are connected. This use in conjunction with any video chat service allows for no transmitter search. Only those can be contacted who are already in your contact list.
  • Bambuser system http://www.bambuser.com
  • Bambuser system http://www.bambuser.com
  • the Bird'sEye application (http : /itunes . apple. com/app/birds-eve/id440061583) using e.g. Twitter, can display the geographic position of logged in users, and users that can be contacted to chat, but there is no broadcast or streaming.
  • tourism and tourism-related collection portals where you can search for specific geographic locations, but only archived photos and videos can be viewed of the locations.
  • the EP No. 1152617 patent describes method and apparatus for image broadcast on mobile video cameras.
  • the CA No. 2336451 patent describes a personal computer-based real-time video conferencing system. (Reallybeingthere)
  • the CN No. 101291379 patent describes a picture phone application method and mobile terminal.
  • the CN No. 2739897 patent describes a mobile terminal with a camera feature.
  • JP No. 2002112239 patent describes a retrieval based camera-signal transmitter operation method and device.
  • WO No. 2005003993 patent describes a free video retrieval system and its operation of a digital device and knowledge of method.
  • the goal during the development of the system according to invention was such a smartphone / internet service which connects users and transmitters anonymously, so that if the user wants to be present in real time somewhere in the world, than on a personal website, using a world map to narrow the area of focus, can choose from the online registered transmitters.
  • the transmitter using the transmitting device shows information the way the user wants to see.
  • the transmitted video content relying on technical conditions may also include audio and other information.
  • the base of the service would be a server program running on the publisher's website, which is connected to clients on smartphones and PCs as applications.
  • the server program is reachable using the browser of smartphones and PCs via the website or direct access from the installed application, and allows for many different uses.
  • Users can link between smartphone - smartphone, smartphone - PC and PC to PC as well. Different communications can take place between the transmitter and the user, which may be entirely free, but the administration comes essentially with a fee.
  • the service fee is deducted from the registered users' internal personal account, according to usage of the service, and is credited to transmitter users, acting as transmitters on their personal accounts.
  • the invention is an interactive video-mobile-communications system, which interactively transmits live-picture from a remote location site and information data network, where appropriate, it retrieves through the Internet and can request on-site real-time image, and, where appropriate voice terminal is suitable, and which system is on a remote-accessible data network, where appropriate, from system operator via internet data connection, which is built up from user and transmitter sides, between which one side commands request data, the other sends video/audio information.
  • the system operator operates a personal website, where the system's services and functions are available, and this is provided by a web-application serving system, that runs on a web server, furthermore, a database server connects to the web server, that contains the database containing the system's data, and the website accesses remote data networks through Internet.
  • a web-application serving system that runs on a web server
  • a database server connects to the web server, that contains the database containing the system's data, and the website accesses remote data networks through Internet.
  • the end-user device connects to the internet, through which it accesses the website, and through that the services of the system, and during the connection the end-user device uses two-way communication, whereby the end-user device to the website, and through that to the transmitter, sends control directions, data, while the transmitter sends video/audio information to the end-user device.
  • the end user device has a microphone, and/or data-input console, optionally a keyboard, for the sending of instructions, furthermore, to visualize the received image/audio information, it provides a display and speakers.
  • the transmitting device also connects to the internet, accesses to the website, and through that the user, and during the connection, the transmitting device follows two-way communication, it receives control instructions and data from the user, while the transmitting device delivers video/audio information to the user, furthermore, the transmitting device, has a camera and microphone to deliver on-site image and audio information, and, also has, when appropriate, a display and speakers for the visualization of received commands and instructions.
  • the end-user device should be a mobile communication device, preferably a mobile device that can connect to the Internet, in case a smartphone, tablet or notebook.
  • the end-user device may also preferably be a personal computer with a microphone, which also has, in the usual configuration, a monitor with display function, and which can connect to the Internet.
  • the transmitting device can preferably be a mobile device, capable of mobile communication and connecting to the internet, in case a smartphone, tablet or notebook.
  • the transmitting device may also preferably be a personal computer with a microphone and camera, which also has, in the usual configuration, a monitor with display function, and which can connect to the Internet.
  • the preferred transmitting device optionally connects a position determining device, e.g. GPS device, through which the system can identify the exact geographical location of the transmitter.
  • a position determining device e.g. GPS device
  • system operator side contains a personal web server, which secures the system's services and which generates the website, manages database, transacts and manages connections
  • personal website is such an internet portal, which is a managing and providing surface for both the users and operators.
  • the transmitter receives and decides upon the request, when accepting, the connection establishes, the transmission begins, when request is completed the connection ends, closure of process takes place, in case the transmitter refuses the request, than there is no connection and the process closes.
  • a further advantageous practical application of the system according to invention is the possibility to navigate the transmitting device in space, in more directions around a given point, it is rotatable in two directions when appropriate, along the z and x axis, and may be shifted in every direction in space B (x, y, z).
  • FIG. 1 shows the components of the system of the invention, and their interrelationships.
  • Figure 2 shows the system's operation from the controlling users' perspective.
  • FIG 3 shows the transmitting process from the perspective of the controlling user. This is the sub-process of the process described on Figure 2, within the system's operation process.
  • FIG. 5 shows the transmittance process from the transmitter's perspective. This is the sub-process of the process described on Figure 4, within the system's operation process.
  • Figure 7 shows the spatial movement possibilities of the transmitting system.
  • Figure 1 shows the components of the system and their interrelationships.
  • the system of the invention is built up from the components as shown on Figure 1.
  • C Camera which at a given situation is connected to a TD transmitting device, mobile phone, or other wired or wireless communication device, e.g. Tablet, smartphone.
  • the C camera can also connect using wire to a data input device, that than connects to the INT Internet.
  • the C camera is always at the Transmitter side, at the transmitter.
  • the transmitter may be a person, but may also be a remote-controlled device.
  • an M microphone can be used together with C camera, to record the audio and acoustic information of the location.
  • the TD transmitting device which is a mobile phone, wireless or wired communication device.
  • the C camera and the M microphone are both built in the device.
  • the TD transmitting device can be connected to a place and/or position detecting device, e.g. GPS, according to which, the system can identify the transmitter's geographical position.
  • the operation of C camera and M microphone, as well as the transmission of data over a network is provided by a software.
  • the network providing the communication:
  • DS Database Server that manages the database.
  • the personal WP webpage online portal, which is an operator and service provider surface for the users and system operators.
  • UR User acting as a data endpoint, selects the desired transmission point, retrieves the geographical coordinates, addresses the TR transmitter, and when accepted, gets into interactive contact with him.
  • UD end user device PC Personal Computer, NB notebook, SP smartphone, TB tablets and all other data processing devices that allow the users to connect to a data network, and/or to the INT internet and has a video display device or can be connected to one.
  • the software running on the UD end user device ensures the managing of transferred data and the handling of the display device, and receives user interactions.
  • Image displayer can be any display device that can display any received image information received from data network and/or the INT internet, the display of a display-monitor, Tablet or smartphone.
  • the SO system operator operates its own WP web page on which the system services and functions are available. This is ensured by the SS system service Web application server, which runs in the WS web server.
  • the WS web server is connected to the DS database server, which contains SD system database.
  • the WP web page connects to a remote data access network, preferably the INT Internet.
  • the UD end user device From the side of the UR user, the UD end user device connects to the INT internet, through which it reaches the WP own web page, and its services. During the connection, the UD end user device exercises a two-way communication, towards the WP web page, and through that, sends control instructions and data to the TR transmitter, while towards the UD end user, the TR transmitter sends audio/video information.
  • the UD end user device provides an M microphone, and/or data-input KB console, optionally a keyboard, furthermore, to display the received audio/video data, it has a D display and L loudspeaker.
  • the UD end user device can advantageously be an MB mobile device, i.e. a device capable of mobile communications, which can connect to the INT internet, optionally SP smartphone, TB tablet, NB notebook.
  • the UD end user device can also advantageously be a PC with an M microphone, which in a normal configuration also has a monitor that supplies the D display function, and can connect to the INT internet.
  • the TD transmitting device From the TR transmitter side, the TD transmitting device also connects to the INT internet, reaches the WP web page, and through that the UR user. During the connection, the TD transmitting device exercises a two-way communications, since the TD transmitting device receives the control instructions and data from the UR user, while the TD transmitting device sends audio/video information towards the UR user.
  • the TD transmitting device has a C camera and an M microphone for the transmission of local audio/video data, and optionally, it can has a D display and L loudspeaker to display received control instructions.
  • the TD transmitting device can advantageously be an MB mobile device capable for mobile communication that can connect to the INT internet, optionally SP smartphone, TB tablet, NB notebook.
  • the TD transmitting device can advantageously be a PC with an M microphone and C camera, and in a normal configuration it also has a monitor that supplies the D display function, and connects to the INT internet.
  • the UR user selects a geographical location from the map provided on the WP web page, while the WP web page and the program running behind it searches for those TR transmitters who are signed up to the system and are actively present in it.
  • the UR user than selects one TR transmitter, with whom he wants to carry out the transmission.
  • the TR transmitter than responds to this request, and starts the transmission, and the interaction defining the transmission's subject.
  • the UR user sends those instructions, either verbally using an M microphone, or using a KB console, whereby the subject matter of the transmission to be provided by the TR transmitter is determined.
  • the TR transmitter when the TR transmitter performs services for a fee, than a financial transaction launches from the UR user's side, in which the transmission's costs are charged, e.g. on a previously opened and credited internal account, and at the same time, the amount the TR transmitter receives for the transmission is credited on his account at the SO system operator, or at the service provider.
  • This can be a kind of point system, bonus system or virtual or real money.
  • the bonus system may be converted to real money and is accessible as real money, or it can be paid. The user orders and pays for it, the transmitter will provide, and therefore receives payment or bonus.
  • the information sent by the TR transmitter during the transmission is: still and/or moving images, live video and audio information and other data, text, or other information specific to that location, e.g. speed, acceleration, which can be detected by a smart phone, or peripheral device.
  • Figure 2 shows the operation process of the system from the controlling UR user's perspective.
  • the UR user logs in to the WP web page, with the intention to watch something, somewhere.
  • the next step is to find the TR transmitters in the right location. Following that, required information about the TR transmitters is gathered then the appropriate TR transmitter is selected. Finally, the request is sent, and the TR transmitter decides on whether accepting or declining the request.
  • connection occurs, and relationship is established. This starts the transmission process. As the intent is met, the relationship ends and the process closes.
  • Figure 3 shows the transmission process from the controlling UR user's perspective. This is a sub-process of the process described on Figure 2, within the operation of the system.
  • controlling UR user gives different types of instructions: controlling and completion of control.
  • the TR transmitter When control directions are given from the UR user, the TR transmitter shows what and how the UR user wants to see. Where appropriate, reports back as request is completed and gives new control orders. If the control is finished, the transmission process ends.
  • Figure 4 shows the process of the operation of the system from the perspective of the TR transmitter.
  • the TR transmitter enters the WP web page, and sends an offer to provide a service. Following that the transmitter will be in a standby status. As the controller UR user selects a TR transmitter, he also receives a transmission request. This is followed by obtaining information about the controller, upon which the TR transmitter decides on the request.
  • Figure 5 shows the transmission process from the perspective of the TR transmitter. This is a sub-process of the process described on Figure 4, within the operation of the system.
  • the transmitting TR transmitter may receive different types of instructions: transmitting or termination of transmission.
  • the TR transmitter shows what and how the UR user wants to see. Where appropriate, the transmitter will be reported as transmission is completed. If the transmitter receives a new request, the process repeats. If the control instruction is to end the transmission than the transmission process ends.
  • Figures 6 and 7 show TD transmitting device's spatial handling potential in 3-dimensional, rectangular and Cartesian-type coordinate system.
  • Figure 6 shows the TD transmitting device's spatial rotation possibilities. When appropriate, it is rotatable in two directions, along the z and x axis, which makes it possible to choose the position of transmission.
  • Figure 7 shows the TD transmitting device's spatial shifting possibilities.
  • the TD transmitting device is movable in every direction in space B (x, y, z), which beyond the position of the transmission, also allows for the selection of the location of the transmission.
  • the system according to invention makes it possible for the creation of such a smartphone/internet service, which connects users and transmitters anonymously, in a way that if the user wants to be present somewhere in the World in real-time, than using a World- map on a personal web page, has the possibility to focus on a specific geographical location, and select from the logged in transmitters.
  • the user sends control instructions to the transmitter, who than using the transmitting device, shows what and how the user wants to see.
  • the transmitted video-data can contain audio and/or other information as well.
  • connection can be made between the control user and the transmitter, which can even be free, but fee is essentially charged for controlling.
  • the fee of the service is charged on the registered control user's internal account, while the transmitter transmitting gets credited on his internal account for his service.
  • the service is based on a server program running on the displaying web page, which is an own web page created for this purpose, which connects client applications running smartphones and PCs.
  • the server-program can be reached through the browser and/or downloaded application running on smartphones or PCs, and allows for a number of different uses. Users can establish connection between smartphone - smartphone, smartphone - PC, and PC to PC as well.
  • the control user is a logged in user, who connects to a controllable transmitter transmitting video information through a personal web page or application, whom the user can control verbally, or by using the PC's keyboard or a smartphones interface - similar to a game, using simple instructions, e.g. instructs through a console.
  • Login is required for controlling, and if the controllable transmitter does not provide otherwise, the transmitting service is only available for a fee.
  • non-controlling user who connects through a personal web page or application to such a video information transmitter, that cannot be controlled.
  • the transmission is one-way, as the non-controlling user cannot send instructions, cannot communicate, but can observe what the non-controllable transmitter shows in a subjective manner.
  • Transmitter is defined as a logged in user, that provides live-video data to the control - and/or non-control users connected to him. Transmitter may be anyone, who has a transmitting device, smartphone or webcam, has Internet access, and runs the required application. The positioning of the transmitter is based on GPS coordinates. Using a smartphone, it is required to turn on GPS location services, while in the case of a PC the location is automatically extracted by the application from the user's IP address which can be refined manually.
  • the transmitting is primarily done by the (rear panel) camera, and in the case of a PC, it is executed by the webcam.
  • a controllable transmitter is a logged in user, that by choosing this function undertakes to show, according to the verbal or console given instructions from a control user, using his smartphone or webcam, what and how the control user wants to, according to possibilities and within the boundaries of reasonability.
  • the control user gives control instructions using a console, provided by either a control surface on his smartphone, or by his PC's keyboard.
  • the control surface of the smartphone is built up by two semi-transparent icons, one for physical movement (forward, backward, left, right, stop), and the other one for the coordination of camera movement (up, down, left, right, zoom).
  • the icons can be placed anywhere on the smartphones display, therefore being usable for left- or right-handed, or even in a console-way (one icon for either of the hands) mode.
  • On the keyboard of a PC the physical operation is executed with keyboard keys, while the operation of the camera is done by the arrow-keys (up, down, right, left).
  • the control surface can also be activated on a PC, and operated using its mouse by clicking on the icon.
  • the controllable transmitter's phone communicates it to the transmitter by either in words and/or visual signals.
  • a verbal communication is established, which makes communication and transmission easier, more accurate and more personal, while eliminating the need for a console for operation.
  • An essential condition for the establishment of such a connection is a mutually spoken language. When there are no linguistic issues, and both sides are willing, than the control user instructs the controllable transmitter verbally, using his phone's or PC's microphone.
  • Only one control user can connect to a controllable transmitter at a time. If the controllable transmitter is busy transmitting, than the logged in users have the opportunity to sign up on a waiting list for connection, according to which, users are connected to the transmitter in the order of sign up.
  • a warning message is shown when signing up on the waiting list, which draws attention to the fact that signing up does not guarantee that the connection will be established.
  • Non-Controllable Transmitter As soon as the connection between the controlled transmitter and the control user is ended, the user on the first place of the waiting list receives a message about the opportunity for connection. There is a given time period for the establishment of connection, if which expires, the next user in line receives a message and takes the place of the previous user.
  • non-controllable transmitter If the transmitter will not undertake controllability, than transmits subjectively the information he deems important. In the case, an unlimited number of non-controlling users can connect to him.
  • the video information transmitted by a non-controllable transmitter is free of charge, meaning that no movement will take place on either the non-controlling users' or the non-controllable transmitter's internal accounts.
  • the non-controllable transmitter transmits data by using his smartphones primary (rear panel) camera. This allows for mobility of the subjectively chosen transmitted information's presentation.
  • the non-controllable transmitter transmits with the help of a webcam, which can be the camera of a PC or notebook, or a webcam positioned at a fix location.
  • a webcam which can be the camera of a PC or notebook, or a webcam positioned at a fix location.
  • the system dedicated to culture and education opportunities, provides opportunity for certain institutions to promote themselves at special events (e.g. Louvre guided tour at night). These emphasized non-controllable transmissions are only viewable for logged in users, based on a view-time-proportional charged fee.
  • the product is based on its own web page which ensures that users and transmitters can establish connection with each other.
  • the main visual element of the personal web page is the world map with its filtering panel, the advertisement band (banner), statistics and news.
  • the internal account is an account where cash flow occurs within the system.
  • the balance of the internal account for internal transactions can be uploaded using internationally accepted transactions (VISA, PayPal, Money Bookers, Neteller, bank transfer, etc.), and payments also take place in these ways.
  • the necessary information and management features of the cash flow are inside the internal account.
  • the user can set the most commonly used transmitting mode, which is then considered as default by the system. Using this, the set-up required at the start of each transmission is eliminated.
  • the transmitter who does not allow the use of a waiting list is not visible on the map during transmission, is also not visible with his username when searched.
  • the zoom-able world map is the surface where users can visually choose the transmitters in their preferred location. From the resulting transmitters, the user can select an ideal transmitter, according to the way of transmission and detailed information.
  • the logged in transmitters are represented by different colored icons on the map, according to their GPS coordinates. The color of the transmitter's icon represents the type of transmission the transmitter provides.
  • the filtering panel is located on the left side of the map and can be hidden at any time, thereby increasing the size of the map.
  • the panel contains the following options:
  • the user can search for logged in transmitters, and for location (in writing, or by GPS coordinates).
  • the map zooms in on the location or the transmitter. If there are more matches for the typed in text, the map indicates the locations and logged in transmitters whose name contains the searched word.
  • the users can search among all registered users, regardless of whether they are logged in or not.
  • the system will specify potential results from the database, according to the typed-in word, here it is shown in writing and by GPS coordinates, representing the user's current location.
  • the transmitted video material is stored in the archive.
  • the application is
  • the application is an essential requirement as a transmitter, as well as making it easier and faster to access the service from both smartphone and PC.
  • the application must be installed both on the smartphone and on the PC.
  • the running application will detect and notify the user when there is no access to the Internet or it is interrupted.
  • the application, in the standby mode will be placed on the tray, which it will only exit when receiving a request for accession. In standby mode, the application can also be quit manually.
  • the username and/or password can optionally be saved, allowing automatic login.
  • the login can take place:
  • the default browser opens and runs the website, while the smartphone logs in to the mobile rewritten version of the web page (mobile base- program) through the application.
  • Transmitting mode can not only be logged into based on the specified transmitting settings, but also without pre-specified settings, allowing the user to choose the mode of transmission from the offered possibilities.
  • the modified transmission settings can be saved or used only for the current login time.
  • the settings can be changed at any time in the future in transmission settings menu. It can be set to automatically log in to your own web page. When this option and the automatic login are selected, the user can launch the application as a registered user to immediately use their own web page or the mobile base- program.
  • the application offers the possible transmission settings. As long as the user does not fill these in, or doesn't set them, then there is no possibility for transmit. Once completed, the data is saved to the transmission settings of the data sheet.
  • the application After logging in, in case of a controllable transmitter, or a non-controllable transmitter, by whom the standby mode is selected, the application will enter standby mode.
  • the transmitter until the start of transmission, or temporary or permanent discontinuation of it, uses the personal web page or the mobile base-program as a logged in user, but control user functions are not available for him.
  • the telephone application is the phone application-optimized version of the system, with the opportunities provided by the telephone interface's controls.
  • the application Upon installation, the application will appear as two separate programs, one for the mobile base-program, the other is for the program enabling transmission that makes it quick and easy to log for transmitters.
  • the latter is available when starting login, so that the login happens with given transmitting preferences, or by modifying them.
  • the user can specify the transmission settings, so that the transmission will always start according to specified settings. Selecting this and the automatic login, allows the user to launch the application immediately ready for transmitting.
  • Selectable at installation is the possibility for the creation of a shortcut next to the application's standard shortcut on the desktop that allows for an immediate login as a transmitter.
  • the transmission is built up of the connection, actual transmission and the end of the connection.
  • the logged in user can initiate the establishment of connection with the transmitter selected. Connecting to a Controllable Transmitter
  • the system When initiating contact to a controllable transmitter, the system sends a message about the request.
  • the controllable transmitter can see the control user's username, language skills, classification sheet, and statistics.
  • the controllable transmitter may accept, decline, or delay the received request. Delaying provides enough time for the controllable transmitter to review the control user's data and for the optimal setup for transmission. While the system shows the remaining time of delay to the control user, the controllable transmitter receives an audio notice before the expiration of the delay time. After the provided delay time, the connection is automatically established.
  • the non-controllable transmitter chose the standby mode, than he receives an audio-visual notice from the system, when the first non-controlling user connects with him. Then the non- controllable transmitter may launch the transmission, or decline the request. The system considers declining as the breakup of the connection, and notices the non-controlling user. Then the non-controllable transmitter quits the transmission mode, his icon disappears from the map, but remains logged in his personal web page.
  • the non-controllable transmitter chose immediate streaming at login, or a non-controlling user is already connected to him, then the connection is immediately launched after connecting.
  • controllable transmitter has selected console and verbal control modes, and/or video chat mode, but there is no mutually spoken language, than the transmitter is automatically shown to the control user as a console-controllable transmitter. In this case, at request, the controllable transmitter is noticed by the system, that the user wants to connect using this method.
  • controllable transmitter has selected all three control modes, than upon the request of a control user, the user can choose any of the three control modes.
  • the system notices the controllable transmitter about which control mode the control user has chosen. If a controllable transmitter is busy and has activated his waiting list than the user can queue there for the connection.
  • both sides will see the transmitted image on a full-screen window (on the display) and hear the audio information.
  • the system When disconnecting, the system notices both sides with an audio-visual warning. Excluded from this is the non-controllable transmitter, with whom a non-controlling user breaks connection. But that non-controllable transmitter that chose standby mode, the system will notify him when the last non-controlling user disconnects. Then the application automatically puts itself into standby mode.
  • Classification of the transmitter is done after disconnection.
  • both the control user and the non-control user is returned to the main site, in case of a transmitter, the application automatically puts itself into standby mode, except a non-controllable transmitter, and the controllable transmitter that is on a waiting list.
  • the system according to invention connects users with transmitters anonymously, so that if the user wants to be present somewhere in real-time, then according to the user's control instructions, the transmitter with the transmitting device, will show according to circumstances, what and how the requesting user wants to see. Helped by the system according to invention, the user is able to do this by searching between transmitters according to their geographical location, choose from them and send them transmission requests.
  • the system according to invention makes it possible for those, to obtain detailed knowledge of the landscapes of the World, according to their own criteria of interest, who would otherwise not have this possibility.
  • the advantage of the system according to invention is, that users can acquire new cultural and scientific knowledge, while obtaining new experiences about parts of the World that would otherwise be hard for them to reach.
  • the system according to invention includes individual alternative utilisation possibilities (security, surveillance, broadcast live event, etc.).
  • the system according to invention can be used in many remote areas of life:
  • the system according to invention is an integral part of everyday life and the worldwide network of information circulation process, and creates a new segment to expand our understanding of the World more diversely.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention relates to an interactive video mobile communication system transmitting on-site data from a remote location. During the operation of the system, the system operator operates a personal web page, where the system's services and functions are available, and this is provided by a system service web-application running on a web server, a database server connects to the web server containing the database containing the system's data, and the web page accesses remote data networks, preferably the Internet. The end-user device connects to the internet, through which it reaches the web page, and through that the services of the system, during the connection end-user device uses two-way communication, whereby the end-user device to the web page, and through that to the transmitter, sends control instructions, data, while the transmitter sends video/audio information to the end-user device.

Description

Interactive Video Mobile Communications System
The invention relates to an interactive mobile video communication system that interactively transmits live on-site data and information network from a remote location, where appropriate, it retrieves data through the Internet and on request it can mediate on-site realtime video and audio.
Today, the development of increasingly sophisticated technology, suitable for mobile communication devices, mobile phones and services related are given in the hands of users. Examples are smart phones, tablets, etc., which are not only suitable for the transmission of audio information through mobile broadband Internet, but also image information and where applicable, even real-time transmission of video information. These new technical possibilities, the targeted new uses, open up a wide range of new applications.
According to a review (http:/ hu.wikipedia.org/wiki/Okostelefon) on Wikipedia: "so called smartphones are advanced mobile phones, often providing PC-like functionality. Smartphone is a mobile phone with an operation system that has a standardized interface and platform for application developers. A smartphone is simply a device that provides advanced functionalities such as e-mail, Internet, e-book reader, and/or a full keyboard, etc. a miniature computer, which is capable of functioning as a phone. ".
A variety of solutions are currently known for sending image information from a remote location: The nowadays commonly used Skype system has the ability to transmit voice and conversation through the Internet between two or more users, and if the parties' computers are connected to cameras, than the parties can even transmit live video information. This image is typically the person involved in the conversation, or the image of the environment surrounding the person. The partners who are connected are each other's friends, but there is also the possibility to search through Skype contacts according to the given criteria and to add new contacts. However, there is no way to search by location. Skype is available on mobile devices, where the smartphone can replace the personal computer and where the signal transmission is via mobile broadband Internet.
There are already video communication applications written for mobile devices (such as Google Talk, FaceTime, etc.) that allow for transmitting video data, even in a remote controlled way. Where appropriate, it is possible to use front and/or rear cameras as well. These applications are however, operating system, device type, and country specific.
The Mobiola Application (http://www.warelex.com/) allows the camera of the mobile phone to function as a web camera, so the video chat applications (Skype, MSN, Yahoo Messenger, etc.) are becoming more mobile and remote controlling is are, but it is limited by the range of WiFi devices, through which the PC and the mobile phone are connected. This use in conjunction with any video chat service allows for no transmitter search. Only those can be contacted who are already in your contact list.
Well known is the general web-camera collecting portals. These web cameras are installed at different locations that can be searched and selected according to thematic and local features, aspects. Here you can find a geographical location, but not or only rarely can orders be sent to the recording device and the device's point of installation can not be moved.
Well known is the EarthCam system (http://www.earthcam.com/mapsearch/) which is one of the many web-camera collecting portals. Here it is possible to search for specific venues for live streaming, but since these are only web-cameras, their incidental control is limited.
Also known is the so-called QIK system (http://qik.com/). Here you can share any event in real time on the provided surface and allows for real-time image streaming, video streaming and self-broadcasting. The site focuses on the transmitter, who wants to share the things he deems important. At the start of broadcast, the transmitter will receive a link which he can publish and by clicking on it, the broadcast can be viewed live. However access is limited, because it can only be viewed by those to whom the transmission link was sent, on an Internet interface, e.g. Facebook, or web page - where the link was shared - or becomes aware of the link otherwise, where the camera is available. Interactivity and request sending is only possible to a limited extent, for example via chat. Compared to our system, it is less in an extent that there is no search or location selection option, and that management is limited only to chat. The process is triggered by the transmitter, not the search party that would start the request.
Also known is Ustreamtv (http://www.ustream.tv): This is similar to the previous one, but it's basically just an Internet TV with an on-air feature that allows anyone to share real-time. There is search here for live broadcasts, but the interactive connections are also limited here to chat.
Also known is the so-called Bambuser system (http://www.bambuser.com), which is similar to the previous two, but it is possible to narrow search by location, but it is limited only to continent and country, and it is not map, but list based. It is possible to look for a transmitter (by name), but it is independent of geographic search, and there is no handling of cameras.
The Bird'sEye application (http : /itunes . apple. com/app/birds-eve/id440061583) using e.g. Twitter, can display the geographic position of logged in users, and users that can be contacted to chat, but there is no broadcast or streaming.
There are also numbers of tourism and tourism-related collection portals, where you can search for specific geographic locations, but only archived photos and videos can be viewed of the locations.
According to the state of technology, the EP No. 1152617 patent describes method and apparatus for image broadcast on mobile video cameras.
The CA No. 2336451 patent describes a personal computer-based real-time video conferencing system. (Reallybeingthere) The CN No. 101291379 patent describes a picture phone application method and mobile terminal.
The CN No. 2739897 patent describes a mobile terminal with a camera feature.
JP No. 2002112239 patent describes a retrieval based camera-signal transmitter operation method and device.
WO No. 2005003993 patent describes a free video retrieval system and its operation of a digital device and knowledge of method.
The goal during the development of the system according to invention was such a smartphone / internet service which connects users and transmitters anonymously, so that if the user wants to be present in real time somewhere in the world, than on a personal website, using a world map to narrow the area of focus, can choose from the online registered transmitters. After selection, according to the instructions of the user, the transmitter using the transmitting device, according to possibilities, shows information the way the user wants to see. The transmitted video content relying on technical conditions may also include audio and other information.
During the development of the system according to the invention we realized, that we would build the system in a ways, that the base of the service would be a server program running on the publisher's website, which is connected to clients on smartphones and PCs as applications. The server program is reachable using the browser of smartphones and PCs via the website or direct access from the installed application, and allows for many different uses. Users can link between smartphone - smartphone, smartphone - PC and PC to PC as well. Different communications can take place between the transmitter and the user, which may be entirely free, but the administration comes essentially with a fee. The service fee is deducted from the registered users' internal personal account, according to usage of the service, and is credited to transmitter users, acting as transmitters on their personal accounts.
The invention is an interactive video-mobile-communications system, which interactively transmits live-picture from a remote location site and information data network, where appropriate, it retrieves through the Internet and can request on-site real-time image, and, where appropriate voice terminal is suitable, and which system is on a remote-accessible data network, where appropriate, from system operator via internet data connection, which is built up from user and transmitter sides, between which one side commands request data, the other sends video/audio information. Its virtue is that during the operation of the system, the system operator operates a personal website, where the system's services and functions are available, and this is provided by a web-application serving system, that runs on a web server, furthermore, a database server connects to the web server, that contains the database containing the system's data, and the website accesses remote data networks through Internet. From the side of the user, the end-user device connects to the internet, through which it accesses the website, and through that the services of the system, and during the connection the end-user device uses two-way communication, whereby the end-user device to the website, and through that to the transmitter, sends control directions, data, while the transmitter sends video/audio information to the end-user device. The end user device, has a microphone, and/or data-input console, optionally a keyboard, for the sending of instructions, furthermore, to visualize the received image/audio information, it provides a display and speakers. From the transmitter side, the transmitting device also connects to the internet, accesses to the website, and through that the user, and during the connection, the transmitting device follows two-way communication, it receives control instructions and data from the user, while the transmitting device delivers video/audio information to the user, furthermore, the transmitting device, has a camera and microphone to deliver on-site image and audio information, and, also has, when appropriate, a display and speakers for the visualization of received commands and instructions.
During a preferred application of the system according to invention, the end-user device should be a mobile communication device, preferably a mobile device that can connect to the Internet, in case a smartphone, tablet or notebook.
During another preferred application of the system according to invention, the end-user device may also preferably be a personal computer with a microphone, which also has, in the usual configuration, a monitor with display function, and which can connect to the Internet.
A further preferred application of the system according to invention, the transmitting device can preferably be a mobile device, capable of mobile communication and connecting to the internet, in case a smartphone, tablet or notebook. At an even further preferred application of the system according to invention, the transmitting device may also preferably be a personal computer with a microphone and camera, which also has, in the usual configuration, a monitor with display function, and which can connect to the Internet.
In a further preferred application of the system according to invention, the preferred transmitting device optionally connects a position determining device, e.g. GPS device, through which the system can identify the exact geographical location of the transmitter.
Another advantageous practical application of the system according to invention is when the system operator side contains a personal web server, which secures the system's services and which generates the website, manages database, transacts and manages connections, and the personal website is such an internet portal, which is a managing and providing surface for both the users and operators.
During a further advantageous practical application of the system according to invention, while the operation of the system, from the view of the controlling user, first the login of the user to the portal takes place, with the intention to watch something somewhere, in the next step the user searches for the transmitters at the appropriate location, after this, an information gathering takes place about the transmitters, than the selection of a transmitter, and the request is sent, the transmitter receives and decides upon the request, when accepting, the connection establishes, the transmission begins, when request is completed the connection ends, closure of process takes place, in case the transmitter refuses the request, than there is no connection and the process closes.
During a further advantageous practical application of the system according to invention, while the operation of the system, from the view of the transmitter, first the login of the transmitter to the portal takes place, with the intention to provide his services, after this the transmitter will be in a standby status. As soon as the controlling user has selected the transmitter, the controlling user sends his request to the selected transmitter, after this, an information gathering takes place about the controlling user upon which the transmitter decides on the request, when accepting by the transmitter, the connection establishes, the transmission begins, when request is completed the connection ends, closure of process takes place, in case the transmitter refuses the request, than there is no connection and the process closes.
A further advantageous practical application of the system according to invention is the possibility to navigate the transmitting device in space, in more directions around a given point, it is rotatable in two directions when appropriate, along the z and x axis, and may be shifted in every direction in space B (x, y, z).
Hereinafter, the system of the invention is presented and described with the accompanying figures:
- Figure 1 shows the components of the system of the invention, and their interrelationships.
Figure 2 shows the system's operation from the controlling users' perspective.
Figure 3 shows the transmitting process from the perspective of the controlling user. This is the sub-process of the process described on Figure 2, within the system's operation process.
- Figure 4 shows the system's process of operation from the transmitter's perspective.
- Figure 5 shows the transmittance process from the transmitter's perspective. This is the sub-process of the process described on Figure 4, within the system's operation process.
- Figure 6 shows one of the spatial rotation possibilities of the transmitting system.
Figure 7 shows the spatial movement possibilities of the transmitting system.
Detailed description of figures:
Figure 1 shows the components of the system and their interrelationships.
The system of the invention is built up from the components as shown on Figure 1.
Components of the TR transmitter side:
C Camera, which at a given situation is connected to a TD transmitting device, mobile phone, or other wired or wireless communication device, e.g. Tablet, smartphone. In an optional case, the C camera can also connect using wire to a data input device, that than connects to the INT Internet. The C camera is always at the Transmitter side, at the transmitter. The transmitter may be a person, but may also be a remote-controlled device. At a given case, an M microphone can be used together with C camera, to record the audio and acoustic information of the location.
The TD transmitting device, which is a mobile phone, wireless or wired communication device. Optionally, the C camera and the M microphone are both built in the device. Optionally the TD transmitting device can be connected to a place and/or position detecting device, e.g. GPS, according to which, the system can identify the transmitter's geographical position. The operation of C camera and M microphone, as well as the transmission of data over a network is provided by a software.
The network providing the communication:
- Remote access data-network, optionally INT Internet - through this, the devices are linked with a data connection.
The components of the SO System Operator:
- Personal WS Web Server, which provides the system's services, generates the WP Web Page, implements and manages connections, DS Database Server, that manages the database.
The personal WP webpage, online portal, which is an operator and service provider surface for the users and system operators.
The components of the UR User side:
UR User: acting as a data endpoint, selects the desired transmission point, retrieves the geographical coordinates, addresses the TR transmitter, and when accepted, gets into interactive contact with him.
UD end user device: PC Personal Computer, NB notebook, SP smartphone, TB tablets and all other data processing devices that allow the users to connect to a data network, and/or to the INT internet and has a video display device or can be connected to one. The software running on the UD end user device, ensures the managing of transferred data and the handling of the display device, and receives user interactions. Image displayer can be any display device that can display any received image information received from data network and/or the INT internet, the display of a display-monitor, Tablet or smartphone.
General description of the operation of the system, according to Figure 1 :
The SO system operator (administrator) operates its own WP web page on which the system services and functions are available. This is ensured by the SS system service Web application server, which runs in the WS web server. The WS web server is connected to the DS database server, which contains SD system database. The WP web page connects to a remote data access network, preferably the INT Internet.
From the side of the UR user, the UD end user device connects to the INT internet, through which it reaches the WP own web page, and its services. During the connection, the UD end user device exercises a two-way communication, towards the WP web page, and through that, sends control instructions and data to the TR transmitter, while towards the UD end user, the TR transmitter sends audio/video information.
The UD end user device provides an M microphone, and/or data-input KB console, optionally a keyboard, furthermore, to display the received audio/video data, it has a D display and L loudspeaker. The UD end user device can advantageously be an MB mobile device, i.e. a device capable of mobile communications, which can connect to the INT internet, optionally SP smartphone, TB tablet, NB notebook. The UD end user device can also advantageously be a PC with an M microphone, which in a normal configuration also has a monitor that supplies the D display function, and can connect to the INT internet.
From the TR transmitter side, the TD transmitting device also connects to the INT internet, reaches the WP web page, and through that the UR user. During the connection, the TD transmitting device exercises a two-way communications, since the TD transmitting device receives the control instructions and data from the UR user, while the TD transmitting device sends audio/video information towards the UR user.
The TD transmitting device has a C camera and an M microphone for the transmission of local audio/video data, and optionally, it can has a D display and L loudspeaker to display received control instructions. The TD transmitting device can advantageously be an MB mobile device capable for mobile communication that can connect to the INT internet, optionally SP smartphone, TB tablet, NB notebook. The TD transmitting device can advantageously be a PC with an M microphone and C camera, and in a normal configuration it also has a monitor that supplies the D display function, and connects to the INT internet.
At the beginning of the system's use, the UR user selects a geographical location from the map provided on the WP web page, while the WP web page and the program running behind it searches for those TR transmitters who are signed up to the system and are actively present in it. The UR user than selects one TR transmitter, with whom he wants to carry out the transmission. The TR transmitter than responds to this request, and starts the transmission, and the interaction defining the transmission's subject. In the course of this interaction the UR user sends those instructions, either verbally using an M microphone, or using a KB console, whereby the subject matter of the transmission to be provided by the TR transmitter is determined.
In an ideal case, when the TR transmitter performs services for a fee, than a financial transaction launches from the UR user's side, in which the transmission's costs are charged, e.g. on a previously opened and credited internal account, and at the same time, the amount the TR transmitter receives for the transmission is credited on his account at the SO system operator, or at the service provider. This can be a kind of point system, bonus system or virtual or real money. The bonus system may be converted to real money and is accessible as real money, or it can be paid. The user orders and pays for it, the transmitter will provide, and therefore receives payment or bonus.
The information sent by the TR transmitter during the transmission is: still and/or moving images, live video and audio information and other data, text, or other information specific to that location, e.g. speed, acceleration, which can be detected by a smart phone, or peripheral device.
Figure 2 shows the operation process of the system from the controlling UR user's perspective.
During this process, firstly the UR user logs in to the WP web page, with the intention to watch something, somewhere. The next step is to find the TR transmitters in the right location. Following that, required information about the TR transmitters is gathered then the appropriate TR transmitter is selected. Finally, the request is sent, and the TR transmitter decides on whether accepting or declining the request.
If accepted, the connection occurs, and relationship is established. This starts the transmission process. As the intent is met, the relationship ends and the process closes.
If the request is rejected than no connection is made and the process is ended.
Figure 3 shows the transmission process from the controlling UR user's perspective. This is a sub-process of the process described on Figure 2, within the operation of the system.
During the process, the controlling UR user gives different types of instructions: controlling and completion of control.
When control directions are given from the UR user, the TR transmitter shows what and how the UR user wants to see. Where appropriate, reports back as request is completed and gives new control orders. If the control is finished, the transmission process ends.
Figure 4 shows the process of the operation of the system from the perspective of the TR transmitter.
For the first step, the TR transmitter enters the WP web page, and sends an offer to provide a service. Following that the transmitter will be in a standby status. As the controller UR user selects a TR transmitter, he also receives a transmission request. This is followed by obtaining information about the controller, upon which the TR transmitter decides on the request.
If accepted by the TR transmitter, the connection occurs, and relationship is established. This starts the transmission process.
As the intent is met, the relationship ends and the process closes.
If the TR transmitter rejects the request than no connection is made and the process is ended.
Figure 5 shows the transmission process from the perspective of the TR transmitter. This is a sub-process of the process described on Figure 4, within the operation of the system.
During the process, the transmitting TR transmitter may receive different types of instructions: transmitting or termination of transmission. When transmission takes place, the TR transmitter shows what and how the UR user wants to see. Where appropriate, the transmitter will be reported as transmission is completed. If the transmitter receives a new request, the process repeats. If the control instruction is to end the transmission than the transmission process ends.
Figures 6 and 7 show TD transmitting device's spatial handling potential in 3-dimensional, rectangular and Cartesian-type coordinate system.
Figure 6 shows the TD transmitting device's spatial rotation possibilities. When appropriate, it is rotatable in two directions, along the z and x axis, which makes it possible to choose the position of transmission.
Figure 7 shows the TD transmitting device's spatial shifting possibilities. The TD transmitting device is movable in every direction in space B (x, y, z), which beyond the position of the transmission, also allows for the selection of the location of the transmission.
The transformations described in Figures 6 and 7, can be preformed one after another, in a preferred order, and/or repeatedly.
The advantageous use of the solution of the system according to invention:
The system according to invention makes it possible for the creation of such a smartphone/internet service, which connects users and transmitters anonymously, in a way that if the user wants to be present somewhere in the World in real-time, than using a World- map on a personal web page, has the possibility to focus on a specific geographical location, and select from the logged in transmitters. Following the selection of the transmitter, the user sends control instructions to the transmitter, who than using the transmitting device, shows what and how the user wants to see. According to the technical conditions, the transmitted video-data can contain audio and/or other information as well.
Different types of connections can be made between the control user and the transmitter, which can even be free, but fee is essentially charged for controlling. The fee of the service is charged on the registered control user's internal account, while the transmitter transmitting gets credited on his internal account for his service. The service is based on a server program running on the displaying web page, which is an own web page created for this purpose, which connects client applications running smartphones and PCs.
The server-program can be reached through the browser and/or downloaded application running on smartphones or PCs, and allows for a number of different uses. Users can establish connection between smartphone - smartphone, smartphone - PC, and PC to PC as well.
At the advantageous use of the system according to invention, the control user is a logged in user, who connects to a controllable transmitter transmitting video information through a personal web page or application, whom the user can control verbally, or by using the PC's keyboard or a smartphones interface - similar to a game, using simple instructions, e.g. instructs through a console. Login is required for controlling, and if the controllable transmitter does not provide otherwise, the transmitting service is only available for a fee.
We call a user "non-controlling user", who connects through a personal web page or application to such a video information transmitter, that cannot be controlled. The transmission is one-way, as the non-controlling user cannot send instructions, cannot communicate, but can observe what the non-controllable transmitter shows in a subjective manner.
Transmitter is defined as a logged in user, that provides live-video data to the control - and/or non-control users connected to him. Transmitter may be anyone, who has a transmitting device, smartphone or webcam, has Internet access, and runs the required application. The positioning of the transmitter is based on GPS coordinates. Using a smartphone, it is required to turn on GPS location services, while in the case of a PC the location is automatically extracted by the application from the user's IP address which can be refined manually.
Using smartphones, the transmitting is primarily done by the (rear panel) camera, and in the case of a PC, it is executed by the webcam.
A controllable transmitter is a logged in user, that by choosing this function undertakes to show, according to the verbal or console given instructions from a control user, using his smartphone or webcam, what and how the control user wants to, according to possibilities and within the boundaries of reasonability.
In absence of verbal communication, the control user gives control instructions using a console, provided by either a control surface on his smartphone, or by his PC's keyboard. The control surface of the smartphone is built up by two semi-transparent icons, one for physical movement (forward, backward, left, right, stop), and the other one for the coordination of camera movement (up, down, left, right, zoom). The icons can be placed anywhere on the smartphones display, therefore being usable for left- or right-handed, or even in a console-way (one icon for either of the hands) mode. On the keyboard of a PC, the physical operation is executed with keyboard keys, while the operation of the camera is done by the arrow-keys (up, down, right, left). The control surface can also be activated on a PC, and operated using its mouse by clicking on the icon. As soon as the control user gives out the control instruction, the controllable transmitter's phone communicates it to the transmitter by either in words and/or visual signals.
Between the verbally controllable transmitter and the control user, a verbal communication is established, which makes communication and transmission easier, more accurate and more personal, while eliminating the need for a console for operation. An essential condition for the establishment of such a connection is a mutually spoken language. When there are no linguistic issues, and both sides are willing, than the control user instructs the controllable transmitter verbally, using his phone's or PC's microphone.
The Waiting List
Only one control user can connect to a controllable transmitter at a time. If the controllable transmitter is busy transmitting, than the logged in users have the opportunity to sign up on a waiting list for connection, according to which, users are connected to the transmitter in the order of sign up.
A warning message is shown when signing up on the waiting list, which draws attention to the fact that signing up does not guarantee that the connection will be established.
As soon as the connection between the controlled transmitter and the control user is ended, the user on the first place of the waiting list receives a message about the opportunity for connection. There is a given time period for the establishment of connection, if which expires, the next user in line receives a message and takes the place of the previous user. Non-Controllable Transmitter
If the transmitter will not undertake controllability, than transmits subjectively the information he deems important. In the case, an unlimited number of non-controlling users can connect to him. The video information transmitted by a non-controllable transmitter is free of charge, meaning that no movement will take place on either the non-controlling users' or the non-controllable transmitter's internal accounts. There are three different types of non- controllable transmitters, according to the way of transmission:
Non-Controllable Transmitter Using Smartphone
The non-controllable transmitter transmits data by using his smartphones primary (rear panel) camera. This allows for mobility of the subjectively chosen transmitted information's presentation.
Non-Controllable Transmitter Using Webcam
The non-controllable transmitter transmits with the help of a webcam, which can be the camera of a PC or notebook, or a webcam positioned at a fix location.
Special Non-Controllable Transmitter
The system, dedicated to culture and education opportunities, provides opportunity for certain institutions to promote themselves at special events (e.g. Louvre guided tour at night). These emphasized non-controllable transmissions are only viewable for logged in users, based on a view-time-proportional charged fee.
Personal Web Page
The product is based on its own web page which ensures that users and transmitters can establish connection with each other. The main visual element of the personal web page is the world map with its filtering panel, the advertisement band (banner), statistics and news.
Registration
Certain elements of the page are available without registration, but for the full use of the service, a registration is required. When registering, the user must provide a username, which is not changeable in the future, a login password and personal data (name, address, email address, etc.). The registration is finalized by clicking on the link sent to the e-mail address, which also means the creation of an internal account. Internal Account
The internal account is an account where cash flow occurs within the system. The balance of the internal account for internal transactions can be uploaded using internationally accepted transactions (VISA, PayPal, Money Bookers, Neteller, bank transfer, etc.), and payments also take place in these ways. The necessary information and management features of the cash flow are inside the internal account.
Transmitting Settings
On this panel, the user can set the most commonly used transmitting mode, which is then considered as default by the system. Using this, the set-up required at the start of each transmission is eliminated.
Setting Possibilities for Controllable Transmitters:
- video chat
- orally guided,
- console controlled,
- using the Waiting List: the transmitter who does not allow the use of a waiting list, is not visible on the map during transmission, is also not visible with his username when searched.
- free stream.
Setting Possibilities for Non-Controllable Transmitters:
- instant streaming: the streaming starts immediately after login.
- standby mode: after login, the application is on standby until the first user connects.
The World Map
The zoom-able world map is the surface where users can visually choose the transmitters in their preferred location. From the resulting transmitters, the user can select an ideal transmitter, according to the way of transmission and detailed information. The logged in transmitters are represented by different colored icons on the map, according to their GPS coordinates. The color of the transmitter's icon represents the type of transmission the transmitter provides. The Filtering Panel
The filtering panel is located on the left side of the map and can be hidden at any time, thereby increasing the size of the map. The panel contains the following options:
The Search Panel
Other than searching on the personal web page's map, the user can search for logged in transmitters, and for location (in writing, or by GPS coordinates).
While typing in the text, the possible matches are offered from the database, according to the word-part already typed in.
If a hit is selected, the map zooms in on the location or the transmitter. If there are more matches for the typed in text, the map indicates the locations and logged in transmitters whose name contains the searched word.
Favorites
In the Favorites menu, on the favorites - friends - blacklists panel, there is a search panel through which your favorite places, users, friends, blacklists and panel settings are available. Using this, the user can collect familiar users and social network site users.
Search by Username
Here - in contrast to the search panel - the users can search among all registered users, regardless of whether they are logged in or not.
When a user name is entered, the system will specify potential results from the database, according to the typed-in word, here it is shown in writing and by GPS coordinates, representing the user's current location.
The Archive
The transmitted video material is stored in the archive. The application
The application is an essential requirement as a transmitter, as well as making it easier and faster to access the service from both smartphone and PC. The application must be installed both on the smartphone and on the PC. The running application will detect and notify the user when there is no access to the Internet or it is interrupted. The application, in the standby mode will be placed on the tray, which it will only exit when receiving a request for accession. In standby mode, the application can also be quit manually.
At the start of the application, the user must sign in. The username and/or password can optionally be saved, allowing automatic login.
The login can take place:
- to your personal web page: using a PC, the default browser opens and runs the website, while the smartphone logs in to the mobile rewritten version of the web page (mobile base- program) through the application.
- transmitting mode: the transmission starts according to the settings specified in the application. Transmitting mode can not only be logged into based on the specified transmitting settings, but also without pre-specified settings, allowing the user to choose the mode of transmission from the offered possibilities. The modified transmission settings can be saved or used only for the current login time. The settings can be changed at any time in the future in transmission settings menu. It can be set to automatically log in to your own web page. When this option and the automatic login are selected, the user can launch the application as a registered user to immediately use their own web page or the mobile base- program.
If a registered user wants to transmit for the first time, then by all means, the application offers the possible transmission settings. As long as the user does not fill these in, or doesn't set them, then there is no possibility for transmit. Once completed, the data is saved to the transmission settings of the data sheet.
After logging in, in case of a controllable transmitter, or a non-controllable transmitter, by whom the standby mode is selected, the application will enter standby mode.
The transmitter, until the start of transmission, or temporary or permanent discontinuation of it, uses the personal web page or the mobile base-program as a logged in user, but control user functions are not available for him.
In transmission mode on the personal web page, or in the mobile base-program, next to the username, the user's controlled- or non-controlled transmitter classification is visible, according to which transmission mode he chose. Smartphone Application
The telephone application is the phone application-optimized version of the system, with the opportunities provided by the telephone interface's controls.
Upon installation, the application will appear as two separate programs, one for the mobile base-program, the other is for the program enabling transmission that makes it quick and easy to log for transmitters. The latter is available when starting login, so that the login happens with given transmitting preferences, or by modifying them. The user can specify the transmission settings, so that the transmission will always start according to specified settings. Selecting this and the automatic login, allows the user to launch the application immediately ready for transmitting.
When clicking on the application that is in standby mode, the main page of the mobile base- program will open.
In the telephone application, it is possible to change the default program between transmitting or logged-in modes.
PC Application
Selectable at installation, is the possibility for the creation of a shortcut next to the application's standard shortcut on the desktop that allows for an immediate login as a transmitter.
Clicking on the shortcut for immediate transmitter login launches the application. Identical to the telephone application's login procedure, transmission becomes possible. Then, by clicking on the application in standby, or on the application shortcut, the personal web page opens, with the user being already logged in in the browser.
The Transmission Process
The transmission is built up of the connection, actual transmission and the end of the connection.
Connection
The logged in user can initiate the establishment of connection with the transmitter selected. Connecting to a Controllable Transmitter
When initiating contact to a controllable transmitter, the system sends a message about the request. The controllable transmitter can see the control user's username, language skills, classification sheet, and statistics. The controllable transmitter may accept, decline, or delay the received request. Delaying provides enough time for the controllable transmitter to review the control user's data and for the optimal setup for transmission. While the system shows the remaining time of delay to the control user, the controllable transmitter receives an audio notice before the expiration of the delay time. After the provided delay time, the connection is automatically established.
Connecting to a Non-Controllable Transmitter
If the non-controllable transmitter chose the standby mode, than he receives an audio-visual notice from the system, when the first non-controlling user connects with him. Then the non- controllable transmitter may launch the transmission, or decline the request. The system considers declining as the breakup of the connection, and notices the non-controlling user. Then the non-controllable transmitter quits the transmission mode, his icon disappears from the map, but remains logged in his personal web page.
If the non-controllable transmitter chose immediate streaming at login, or a non-controlling user is already connected to him, then the connection is immediately launched after connecting.
Transmitter and User Statistics
In the statistics, information is available about the spoken languages by the transmitter, the time and date of his registration, and details on broadcast (transmission modes, their number and the average length of coverage and the corresponding rating). Here the user can select the connection method, which will be offered by the system, according to the settings of the transmitter and the control user.
If the controllable transmitter has selected console and verbal control modes, and/or video chat mode, but there is no mutually spoken language, than the transmitter is automatically shown to the control user as a console-controllable transmitter. In this case, at request, the controllable transmitter is noticed by the system, that the user wants to connect using this method.
If the controllable transmitter has selected all three control modes, than upon the request of a control user, the user can choose any of the three control modes. At request, the system notices the controllable transmitter about which control mode the control user has chosen. If a controllable transmitter is busy and has activated his waiting list than the user can queue there for the connection.
Transmission
Once the connection is established between a control user or non-control user and the transmitter, both sides will see the transmitted image on a full-screen window (on the display) and hear the audio information.
When disconnecting, the system notices both sides with an audio-visual warning. Excluded from this is the non-controllable transmitter, with whom a non-controlling user breaks connection. But that non-controllable transmitter that chose standby mode, the system will notify him when the last non-controlling user disconnects. Then the application automatically puts itself into standby mode.
Classification of the transmitter is done after disconnection.
After the classification process, both the control user and the non-control user is returned to the main site, in case of a transmitter, the application automatically puts itself into standby mode, except a non-controllable transmitter, and the controllable transmitter that is on a waiting list.
Benefits
The system according to invention connects users with transmitters anonymously, so that if the user wants to be present somewhere in real-time, then according to the user's control instructions, the transmitter with the transmitting device, will show according to circumstances, what and how the requesting user wants to see. Helped by the system according to invention, the user is able to do this by searching between transmitters according to their geographical location, choose from them and send them transmission requests.
The system according to invention makes it possible for those, to obtain detailed knowledge of the landscapes of the World, according to their own criteria of interest, who would otherwise not have this possibility. The advantage of the system according to invention is, that users can acquire new cultural and scientific knowledge, while obtaining new experiences about parts of the World that would otherwise be hard for them to reach. The system according to invention includes individual alternative utilisation possibilities (security, surveillance, broadcast live event, etc.).
The system according to invention can be used in many remote areas of life:
-tourism (guided tours, resorts, hotels, tourist attractions are presented in a new way, etc.);
- teaching (new types of language learning, distance learning, documentary materials that have not been provided this way until now);
- labor (new earning opportunities);
- community-relations;
- dissemination of culture (interactive presentation of cultural treasures of the World in a way never seen before);
- entertainment;
- advertisement (search related advertising, advertisers participating as transmitter provides a new form of advertising options, only ads specific search mode).
The system according to invention is an integral part of everyday life and the worldwide network of information circulation process, and creates a new segment to expand our understanding of the World more diversely.
Feature Figure: 1
List of Reference Abbreviations:
INT - Internet
WP - Web Page
SS - System Service
SD - System Database
WS - Web Server
DS - Database Server
UD - User Device
TD - Transmitting Device
M - Microphone
C - Camera
L - Loudspeaker
D - Display
KB - Keyboard
MB - Mobile Device
SP - Smartphone
TB - Tablet
NB - Notebook
PC - PC (w/microphone)
UR - User
SO - System Operator
TR - Transmitter

Claims

Claims What is claimed is:
1. Interactive video mobile communication system, that that interactively transmits live- image from a remote location site, through information data network, where appropriate, through the Internet to retrieve and request on-site real-time image, and, where appropriate is suitable for voice transmission, and which system can remotely access data network, preferably the Internet (INT) linked through a data network to the system operator (SO), consists of user part (UR), and transmitter part (TR), between which, over the Internet (INT) in one direction control data is sent, whereas in the other direction video and audio information is sent, characterized by, that during the operation of the system, the system operator (SO) operates a personal web page (WP), on which the system's services, functions are available, and this is provided by the providing web application system service (SS), which runs on a web server (WS), and a database server (DS) is connected to it, which contains the system's database (SD), and the web page (WP) connects to the remote access providing data network, preferably the Internet (INT), from the user (UR) side, the end-user device (UD) connects to the Internet (INT), through which it reaches the web page (WP), and through that the services of the system, and during the connection, the end-user device (UD) exercises two-way communication, during which, the end-user device (UD) to the web page (WP) and the through that gives control instructions, send data to the transmitter (TR), while towards the end-user device (UD), the transmitter (TR) sends audio/video information, the end-user device (UD) uses a microphone (M) for sending control instructions, and/or a data entry console (KB), where appropriate keyboard, and for the presentation of the received image/audio information, it provides a display (D), and loudspeakers (L), from the transmitter's (TR) side, the transmitting device (TD) also connects to the Internet (INT), reaches the web page (WP) and through that it reaches the user (UR), and during the connection, the transmitting device (TD) exercises a two-way communication, the (TD) transmitting device receives the control instructions and data from the (UR) user, while the (TD) transmitting device sends audio/video information towards the (UR) user, furthermore, the (TD) transmitting device has a (C) camera and a (M) microphone for the transmission of local audio/video data, optionally, it has a (D) display and (L) loudspeakers to display received control instructions.
2. The interactive video mobile communication system as recited in claim 1, characterized by that, the (UD) end user device can advantageously be a device capable of mobile communications, (MB) mobile device, which can connect to the (INT) internet, optionally (SP) smartphone, (TB) tablet, (NB) notebook.
3. The interactive video mobile communication system as recited in claim 1, characterized by that, the (UD) end user device can also advantageously be a personal computer (PC) with a microphone (M), which in a normal configuration also has a monitor that supplies the (D) display function, and can connect to the (INT) internet.
4. The interactive video mobile communication system as recited in any of the claims 1 - 3, characterized by that, the (TD) transmitting device can advantageously be a (MB) mobile device, that can connect to the (INT) internet, e.g. (SP) smartphone, (TB) tablet, (NB) notebook.
5. The interactive video mobile communication system as recited in any of the claims 1 - 3, characterized by that, the (TD) transmitting device can also advantageously be a personal computer (PC) with a microphone (M) and camera (C), which in a normal configuration also has a monitor that supplies the (D) display function, and can connect to the (INT) internet.
6. The interactive video mobile communication system as recited in any of the claims 1 - 5, characterized by that, the preferred transmitting device (TD), optionally connects a localization or position determining device, e.g. GPS device, through which the system can identify the exact geographical location of the transmitter.
7. The interactive video mobile communication system as recited in any of the claims 1 - 6, characterized by that, the system operator (SO) side provides a personal web server (WS), which provides the system's services and generates the web page (WP), manages database, executes and manages connections, and the personal web page (WP) is such an internet portal, which is a service and interface provider for users and system maintainers.
8. The interactive video mobile communication system as recited in any of the claims 1 - 7, characterized by that, during the operation of the system, from the control user's (UR) perspective, first the login of the user (UR) to the portal takes place, with the intention to watch something somewhere, in the next step the user (UR) searches for the appropriate location of transmitters (TR), after this, an information gathering takes place about the transmitters (TR), than the selection of a transmitter (TR), and the request is sent, the transmitter receives and decides upon the request, when accepting, the connection establishes, the transmission begins, when request is completed the connection ends, closure of process takes place, in case the transmitter (TR) refuses the request, than there is no connection and the process closes.
9. The interactive video mobile communication system as recited in any of the claims 1 - 8, characterized by that, during the process of the operation of the system from the perspective of the (TR) transmitter, first the login of the transmitter (TR) to the portal takes place and delivers an offer to provide a service then being in a standby mode, as soon as a control (UR) user selects the (TR) transmitter, he also receives a request for transmitting, this is followed by obtaining information about the controller, upon which the (TR) transmitter decides about the request. If accepted by the (TR) transmitter, the connection occurs, and relationship is established, the process of transmission begins. As the intent is met, the relationship ends and the process close. If rejection is performed by the (TR) transmitter, than no connection is made and the process is ended.
10. The interactive video mobile communication system as recited in any of the claims 1 - 9, characterized by that, the (TD) transmitting device is rotatable in space, in more directions around a given point, when appropriate in two directions along the z and x axis and may be shifted in every direction in space B (x, y, z).
PCT/HU2012/000080 2011-08-30 2012-08-29 Interactive video mobile communications system WO2013054145A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
HU1100468A HUP1100468A2 (en) 2011-08-30 2011-08-30 Interactive video mobile communication system
HUP1100468 2011-08-30

Publications (1)

Publication Number Publication Date
WO2013054145A1 true WO2013054145A1 (en) 2013-04-18

Family

ID=89990409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/HU2012/000080 WO2013054145A1 (en) 2011-08-30 2012-08-29 Interactive video mobile communications system

Country Status (2)

Country Link
HU (1) HUP1100468A2 (en)
WO (1) WO2013054145A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE2030132A1 (en) * 2020-04-19 2021-10-20 Seyd Nasrollah Esmaeilzadeh BeMyCam

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010074009A (en) * 2000-11-24 2001-08-04 김연수 A Method For Downloading Tone Data and Graphical Image (Character) Data To Mobile Station, And The System Therefor
WO2002001388A2 (en) * 2000-06-23 2002-01-03 Epicentric, Inc. Portal server that provides a customizable user interface for access to computer networks
US20050285934A1 (en) * 2002-10-15 2005-12-29 Ronald Carter Automated audio video messaging and answering system
JP2006051945A (en) * 2005-08-30 2006-02-23 Fumiaki Nakamura System wherein individual can view landscape of travel/landscape of travel to space such as space observation/earth observation/mars in real time on individual personal computer through transmission of data on ground with artificial sattelite for server by intercommunicating with personal mini artificial sattelite launched with space shuttle or artificial sattelite for other application rounding earth, and utilize as screen saver or wall paper for personal computer
KR20070111797A (en) * 2006-05-19 2007-11-22 (주)케이티에프테크놀로지스 Method for relay broadcast in image communication of portable terminal
KR20100113138A (en) * 2008-09-05 2010-10-20 엘지전자 주식회사 Mobile station assisted location based service

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002001388A2 (en) * 2000-06-23 2002-01-03 Epicentric, Inc. Portal server that provides a customizable user interface for access to computer networks
KR20010074009A (en) * 2000-11-24 2001-08-04 김연수 A Method For Downloading Tone Data and Graphical Image (Character) Data To Mobile Station, And The System Therefor
US20050285934A1 (en) * 2002-10-15 2005-12-29 Ronald Carter Automated audio video messaging and answering system
JP2006051945A (en) * 2005-08-30 2006-02-23 Fumiaki Nakamura System wherein individual can view landscape of travel/landscape of travel to space such as space observation/earth observation/mars in real time on individual personal computer through transmission of data on ground with artificial sattelite for server by intercommunicating with personal mini artificial sattelite launched with space shuttle or artificial sattelite for other application rounding earth, and utilize as screen saver or wall paper for personal computer
KR20070111797A (en) * 2006-05-19 2007-11-22 (주)케이티에프테크놀로지스 Method for relay broadcast in image communication of portable terminal
KR20100113138A (en) * 2008-09-05 2010-10-20 엘지전자 주식회사 Mobile station assisted location based service

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE2030132A1 (en) * 2020-04-19 2021-10-20 Seyd Nasrollah Esmaeilzadeh BeMyCam

Also Published As

Publication number Publication date
HUP1100468A2 (en) 2013-04-29

Similar Documents

Publication Publication Date Title
US10638280B2 (en) Method and system for facilitating real-time location sharing
US10356476B2 (en) Playback of pre-recorded social media sessions
US20180255114A1 (en) Participant selection for multi-party social media sessions
US8924880B2 (en) Methods and systems to facilitate real time communications in virtual reality
US9451092B2 (en) Mobile device messaging application
US9148627B2 (en) System and method for interactive internet video conferencing
US9154536B2 (en) Automatic delivery of content
US20080262911A1 (en) Methods and Systems to Search in Virtual Reality for Real Time Communications
US11297391B2 (en) Television interface for multi-party social media sessions
US20080263459A1 (en) Methods and Systems to Determine Availability for Real Time Communications via Virtual Reality
US20240193642A1 (en) Triggering live media streams via dynamic display object
US20080263460A1 (en) Methods and Systems to Connect People for Virtual Meeting in Virtual Reality
US20080263446A1 (en) Methods and Systems to Connect People to Services via Virtual Reality
WO2021129157A1 (en) Video-based interaction realization method and apparatus, device and medium
JP7394101B2 (en) A method for providing information on social network service-related activities to a chat room, a computer program, and a server for providing information on social network service-related activities to a chat room.
US20110197148A1 (en) Apparatus and method for providing network community service
KR20140054487A (en) Group conversation method and computer-readable recording meduim having recorded group conversation program therein
US20240089547A1 (en) System and method for group consensus voting
WO2008130842A9 (en) Methods and systems to connect people via virtual reality for real time communications
US10809889B2 (en) Live interactive event indication based on notification profile for display device
WO2013054145A1 (en) Interactive video mobile communications system
US20140046861A1 (en) Method and System for Representing Collective and Individual Responses to a Shared Experience Event
KR102096733B1 (en) Video reproduction service method and server
KR102573946B1 (en) On-line group viewing service system, server and method
WO2023153137A1 (en) Information processing device, information processing method, recording medium, and server device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12839447

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12839447

Country of ref document: EP

Kind code of ref document: A1