WO2014049386A1 - In-car system and method for communication of voice with location information - Google Patents

In-car system and method for communication of voice with location information Download PDF

Info

Publication number
WO2014049386A1
WO2014049386A1 PCT/IB2012/002275 IB2012002275W WO2014049386A1 WO 2014049386 A1 WO2014049386 A1 WO 2014049386A1 IB 2012002275 W IB2012002275 W IB 2012002275W WO 2014049386 A1 WO2014049386 A1 WO 2014049386A1
Authority
WO
WIPO (PCT)
Prior art keywords
server
voice
location information
car
car system
Prior art date
Application number
PCT/IB2012/002275
Other languages
French (fr)
Inventor
Yimeng HE
Shanshan Cao
Original Assignee
Audi Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi Ag filed Critical Audi Ag
Priority to PCT/IB2012/002275 priority Critical patent/WO2014049386A1/en
Publication of WO2014049386A1 publication Critical patent/WO2014049386A1/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3679—Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21—Monitoring or handling of messages
    • H04L51/222—Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/52—Network services specially adapted for the location of the user terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/75—Indicating network or usage conditions on the user display

Definitions

  • the invention relates to the field of vehicle communication, particularly relates to an in-car system and method for communication of voice with location information which can provide a fast, friendly, fun way to communicate anonymously among the drivers.
  • the in-car system and method can also enhance and enrich driving experience, providing the user with new experience with driving and map concept.
  • voice input is one of the most important and common functions of modern personal communication.
  • Voice control is also widely used in human-machine interaction system in-car.
  • the increasingly use of internet access in-car certainly promotes the prospects for the future application of inter- vehicle online messaging communication.
  • the object of the invention is to provide an in-car system for communication of voice with location information.
  • Another object of the invention is to provide an in-car method for communication of voice with location information.
  • the in-car system for communication of voice with location information includes a data collecting device, a data transferring device, a server, and a video display, wherein the in-car system also includes a virtual map creating device, the data collecting device includes a voice input device and a real time location information collecting device.
  • the data transferring device connects with the data collecting device and the server.
  • the server connects with the virtual map creating device and the video display.
  • the server is a cloudy server.
  • the data collecting device collects voice information and real time location information, and the data transferring device transfers them to the cloudy server.
  • the virtual map creating device receives voice information and real time location information from the cloudy server and creates a virtual map.
  • the in-car method for communication of voice with location information includes the following steps:
  • a voice input device collecting voice information, and a real time location information collecting device collecting real time location information
  • the in-car communication method also includes the following step:
  • the server is a cloudy server.
  • This invention use combination technology of LBS (Location based service), GPRS, data connection and transfer to cloudy server, and voice recognition and voice command control.
  • LBS Location based service
  • GPRS Radio Resource Management Protocol
  • data connection and transfer to cloudy server and voice recognition and voice command control.
  • the in-car system and method according to the invention can realize very good function of communicating of voice with location information and provide a fast, friendly, fun way to communicate anonymously among the drivers. Meanwhile, Voice communication is direct and the best way for communication. Embedded with geographical information, voice message has the potential to become a new way of communication. In addition to enhance and enrich driving experience, user will also be able to experience a new concept of interactive map.
  • This in-car system can collect real time installation with projection and ongoing data from the users, and use a virtual map to locate what users have talked about at a certain spot in this place. All data will be transferred to cloudy server to be stored. Viewers of this virtual map can also interact with it by speaking to the system. The talk just generated will be tagged on the virtual map and then available for other users to listen, or respond. Or, viewers can just listen or respond to some already existed talks through control device (multi-touch screen or other hardware device to move cursor and confirm). In addition, Voice control of the system can be supported.
  • Figure 1 is a flow diagram illustrating a process for user interacting with the system
  • Figure 2 is a front view of a framework of user interface for a display screen or portion thereof showing the embodiments;
  • Figure 3 is a front view of a framework of user interface for a display screen or portion thereof showing the embodiments;
  • Figure 4 is a flow diagram illustrating a process for producing voice message into the system and present in map according to various embodiments
  • Figure 5 is a block diagram illustrating a suitable computing environment for practicing various embodiments described herein.
  • All of personal information is loaded from the user's identity number, when the user buy a car, this number will be provided. Meanwhile users can also manually set up their own personal information considering different privacy preferences.
  • the in-car system for communication of voice with location information includes a data collecting device, a data transferring device, a server, and a video display, wherein the in-car system also includes a virtual map creating device, the data collecting device includes a voice input device and a real time location information collecting device.
  • FIG.1 is a flow diagram illustrating a process for user interacting with the in-car system.
  • dialog box 1 the in-car system is already embedded in car and once log in, this function will allow user to active it.
  • dialog box 2 once users select this function, voice control is automatically initiated.
  • dialog boxes 3 and 4 the function will allow any user to start a talk or response to an existed talk without any click while driving, through the in-car voice control system.
  • dialog box 5 all micro voice messages will be automatically located and tagged on the virtual map of a city. When other users pass this spot of talking, they can receive the voice message through this in-car system.
  • dialog box 6 each message is located on the virtual map and can only be listened to or replied on the same spot on the virtual map, which is called 'talk map'.
  • FIG. 2 is a front view of a framework of user interface for a display screen or portion thereof showing the virtual map. It is designed to give user a visual preview of their location based voice talk, and also help user to keep record. All the talk users started or responded to would be loaded into this section, where users can track what they have listened to or talked over a period of time.
  • Voice messages can be category into different group, e.g., talk that one user has listened, talk that one user has taken response, or fresh talk user hasn't listened to.
  • user could select different category to display in the map. That will avoid heavy searching for users. User could switch among different locations to view the latest voice message.
  • the voice messages will be tagged more often at the cross road, or during a traffic jam. And the in-car system can automatically detect the drivers' complaints, questions, sighs, exclamation and put it on that very spot on the map, and other cars can receive and respond to those voice messages by will.
  • FIG.3 is a front view of a framework of user interface for a display screen or portion thereof showing the virtual map. There are more details which present more features in FIG. 3 than FIG. 2.
  • buttons with which users can easily respond to this message, clear this history, share/save them into other media platform, private or public, or even share the talks on other social networks. User also can control to play/ stop this message.
  • FIG.4 is a flow diagram illustrating a process for producing voice message into system and present in map according to various embodiments.
  • a voice message input request can be received by two ways, voice control to active or by other control hardware.
  • a modal dialog is opened to allow voice input from the user.
  • the modal dialog can be any box or display that has a field for text entry display.
  • Voice input is received and the message is then supplied to group of websites (Cloudy server) with location information tagged.
  • the cloudy server includes a side component. In the side component, the voice messages will be transferred to text messages which can be visualized. Then the server will send the data back to the car system to display.
  • FIG. 5 is a block diagram illustrating a suitable computing environment for practicing various embodiments described herein.
  • FIG. 5 illustrates a diagrammatic representation of a machine in the exemplary form of a computer system within which a set of instructions, for instructing the machine to perform any one or more of the methodologies discussed herein, may be executed.
  • the exemplary computer system includes a processor, a main memory, a static memory, and a secondary memory, which communicate with each other via a bus.
  • Various components described herein may be a means for performing the functions described herein.
  • the data transferring device connects with the data collecting device and the server
  • the server connects with the virtual map creating device and the video display
  • the server is a cloudy server.
  • the data collecting device collects voice information and real time location information, and the data transferring device transfers them to the cloudy server.
  • the virtual map creating device receives voice information and real time location information from the cloudy server and creates a virtual map.
  • the voice input device collects voice information
  • the real time location information collecting device collects real time location information.
  • the data transferring device transfers the above information to the cloudy server.
  • the virtual map creating device receives the above information from the cloudy server and creates a virtual map.
  • the virtual map is stored in the cloudy server, according to the instruction of the users, the video display can display the virtual map stored in the cloudy server.
  • This in-car system and method for communication of voice with location information can provide a fast, friendly, fun way to communicate anonymously among the drivers, enhancing and enriching driving experience, and the user is also able to experience a new concept of map. It is suitable to widely apply in the field of vehicle communication.

Abstract

An in-car system for communication of voice with location information, includes a data collecting device, a data transferring device, a server, and a video display, wherein the in-car system also includes a virtual map creating device, the data collecting device includes a voice input device and a real time location information collecting device. An in-car method for communication of voice with location information is also provided. The said in-car system and method for communication can provide a fast, friendly, fun way to communicate anonymously among the drivers, enhancing and enriching driving experience, and the user is also able to experience a new concept of map.

Description

In-Car System and Method for Communication of Voice with Location Information
Technical Field
The invention relates to the field of vehicle communication, particularly relates to an in-car system and method for communication of voice with location information which can provide a fast, friendly, fun way to communicate anonymously among the drivers. The in-car system and method can also enhance and enrich driving experience, providing the user with new experience with driving and map concept.
Background Art
In big cities, as an intuitive way to communicate, voice input is one of the most important and common functions of modern personal communication. Voice control is also widely used in human-machine interaction system in-car. The increasingly use of internet access in-car certainly promotes the prospects for the future application of inter- vehicle online messaging communication.
In recently years, GPS-based navigation systems have grown in popularity and are now widely available in a variety of forms, including different types of vehicle-installed units as well as hand-held portable units. For example, Chinese application No.201010617458.3 discloses a pretreatment method and system for navigation voice.
However, there is a lack of connection and interaction between car systems, whose function is limited only to be a transfer tool with little communication or entertainment features. In the current in-car system, voice data cannot be recorded with location and time based information and visualized in real time map.
Summary of the Invention
The object of the invention is to provide an in-car system for communication of voice with location information.
Another object of the invention is to provide an in-car method for communication of voice with location information.
The in-car system for communication of voice with location information according to the invention includes a data collecting device, a data transferring device, a server, and a video display, wherein the in-car system also includes a virtual map creating device, the data collecting device includes a voice input device and a real time location information collecting device.
In the above in-car system, the data transferring device connects with the data collecting device and the server.
In the above in-car system, the server connects with the virtual map creating device and the video display.
In the above in-car system, the server is a cloudy server.
In the above in-car system, the data collecting device collects voice information and real time location information, and the data transferring device transfers them to the cloudy server.
In the above in-car system, the virtual map creating device receives voice information and real time location information from the cloudy server and creates a virtual map.
The in-car method for communication of voice with location information according to the invention includes the following steps:
1) a voice input device collecting voice information, and a real time location information collecting device collecting real time location information;
2) a data transferring device transferring the above information to a server;
3) a virtual map creating device receiving the above information from the server and creating a virtual map;
4) the virtual map being stored in the server.
In the above in-car communication method, the in-car communication method also includes the following step:
5) a video display displaying the virtual map stored in the server.
In the above in-car communication method, the server is a cloudy server.
The advantages of the invention lie in that:
This invention use combination technology of LBS (Location based service), GPRS, data connection and transfer to cloudy server, and voice recognition and voice command control.
The in-car system and method according to the invention can realize very good function of communicating of voice with location information and provide a fast, friendly, fun way to communicate anonymously among the drivers. Meanwhile, Voice communication is direct and the best way for communication. Embedded with geographical information, voice message has the potential to become a new way of communication. In addition to enhance and enrich driving experience, user will also be able to experience a new concept of interactive map.
This in-car system can collect real time installation with projection and ongoing data from the users, and use a virtual map to locate what users have talked about at a certain spot in this place. All data will be transferred to cloudy server to be stored. Viewers of this virtual map can also interact with it by speaking to the system. The talk just generated will be tagged on the virtual map and then available for other users to listen, or respond. Or, viewers can just listen or respond to some already existed talks through control device (multi-touch screen or other hardware device to move cursor and confirm). In addition, Voice control of the system can be supported.
Take an example to describe the advantage of interacting with the message in real time map. One user is driving to destination A, during the journey, the user see a new voice message added on the talk map for street B, which is on his plan route to destination A. And the user selects it which says there is a strike on street B and it is crowded of people. That is important information to this user, then he will avoid street B. With this visualized voice message shown in map, user could have the benefit of quick response to emergency and easy communication with others.
Brief Description of the Drawings
The following description includes discussion of figures illustrating example of implementations of embodiments of the invention.
Figure 1 is a flow diagram illustrating a process for user interacting with the system;
Figure 2 is a front view of a framework of user interface for a display screen or portion thereof showing the embodiments;
Figure 3 is a front view of a framework of user interface for a display screen or portion thereof showing the embodiments;
Figure 4 is a flow diagram illustrating a process for producing voice message into the system and present in map according to various embodiments;
Figure 5 is a block diagram illustrating a suitable computing environment for practicing various embodiments described herein.
Embodiments
The contents of the invention will be described in details with reference to the drawings of the description; however, it should not be understood to limit the scope of the invention. A person skilled in the art may make various modifications and changes to the following embodiments without departing from the spirit and scope of the invention.
All of personal information is loaded from the user's identity number, when the user buy a car, this number will be provided. Meanwhile users can also manually set up their own personal information considering different privacy preferences.
The in-car system for communication of voice with location information includes a data collecting device, a data transferring device, a server, and a video display, wherein the in-car system also includes a virtual map creating device, the data collecting device includes a voice input device and a real time location information collecting device.
FIG.1 is a flow diagram illustrating a process for user interacting with the in-car system. As dialog box 1, the in-car system is already embedded in car and once log in, this function will allow user to active it. As dialog box 2, once users select this function, voice control is automatically initiated. As dialog boxes 3 and 4, the function will allow any user to start a talk or response to an existed talk without any click while driving, through the in-car voice control system. As dialog box 5, all micro voice messages will be automatically located and tagged on the virtual map of a city. When other users pass this spot of talking, they can receive the voice message through this in-car system. As dialog box 6, each message is located on the virtual map and can only be listened to or replied on the same spot on the virtual map, which is called 'talk map'.
The visualization of all the talk tags in the city is very helpful, and also a beautiful way of showing the users a lively talking city.
FIG. 2 is a front view of a framework of user interface for a display screen or portion thereof showing the virtual map. It is designed to give user a visual preview of their location based voice talk, and also help user to keep record. All the talk users started or responded to would be loaded into this section, where users can track what they have listened to or talked over a period of time.
Generally, user could take a visual preview of all voice messages in the map. Voice messages can be category into different group, e.g., talk that one user has listened, talk that one user has taken response, or fresh talk user hasn't listened to. In the settings, user could select different category to display in the map. That will avoid heavy searching for users. User could switch among different locations to view the latest voice message.
The voice messages will be tagged more often at the cross road, or during a traffic jam. And the in-car system can automatically detect the drivers' complaints, questions, sighs, exclamation and put it on that very spot on the map, and other cars can receive and respond to those voice messages by will.
The interesting feature of this function would be that each talk can be considered as a life. When more people respond to one talk, the very talk would live longer. Those talks that receive not many response for a while would die and disappear on the map. That is an efficient way to help user filter useful and valuable information. Hot spot issue will get more response, so it will be shown in talk map for longer time.
FIG.3 is a front view of a framework of user interface for a display screen or portion thereof showing the virtual map. There are more details which present more features in FIG. 3 than FIG. 2.
According to the selected message, there are several option buttons, with which users can easily respond to this message, clear this history, share/save them into other media platform, private or public, or even share the talks on other social networks. User also can control to play/ stop this message.
FIG.4 is a flow diagram illustrating a process for producing voice message into system and present in map according to various embodiments.
A voice message input request can be received by two ways, voice control to active or by other control hardware. In response to the request, a modal dialog is opened to allow voice input from the user. As discussed herein, the modal dialog can be any box or display that has a field for text entry display. Voice input is received and the message is then supplied to group of websites (Cloudy server) with location information tagged. The cloudy server includes a side component. In the side component, the voice messages will be transferred to text messages which can be visualized. Then the server will send the data back to the car system to display.
FIG. 5 is a block diagram illustrating a suitable computing environment for practicing various embodiments described herein. FIG. 5 illustrates a diagrammatic representation of a machine in the exemplary form of a computer system within which a set of instructions, for instructing the machine to perform any one or more of the methodologies discussed herein, may be executed. The exemplary computer system includes a processor, a main memory, a static memory, and a secondary memory, which communicate with each other via a bus. Various components described herein may be a means for performing the functions described herein.
In the present application, the data transferring device connects with the data collecting device and the server, the server connects with the virtual map creating device and the video display, and the server is a cloudy server.
The data collecting device collects voice information and real time location information, and the data transferring device transfers them to the cloudy server. The virtual map creating device receives voice information and real time location information from the cloudy server and creates a virtual map.
The voice input device collects voice information, and the real time location information collecting device collects real time location information. The data transferring device transfers the above information to the cloudy server. Then the virtual map creating device receives the above information from the cloudy server and creates a virtual map. The virtual map is stored in the cloudy server, according to the instruction of the users, the video display can display the virtual map stored in the cloudy server.
Industrial applicability
This in-car system and method for communication of voice with location information according to the invention can provide a fast, friendly, fun way to communicate anonymously among the drivers, enhancing and enriching driving experience, and the user is also able to experience a new concept of map. It is suitable to widely apply in the field of vehicle communication.

Claims

Claims
1. An in-car system for communication of voice with location information, includes a data collecting device, a data transferring device, a server, and a video display, wherein the in-car system also includes a virtual map creating device, the data collecting device includes a voice input device and a real time location information collecting device.
2. The in-car system according to claim 1 , wherein the data transferring device connects with the data collecting device and the server.
3. The in-car system according to claim 1 , wherein the server connects with the virtual map creating device and the video display.
4. The in-car system according to any one of claims 1-3, wherein the server is a cloudy server.
5. The in-car system according to claim 4, wherein the data collecting device collects voice information and real time location information, and the data transferring device transfers them to the cloudy server.
6. The in-car system according to claim 5, wherein the virtual map creating device receives voice information and real time location information from the cloudy server and creates a virtual map.
7. An in-car method for communication of voice with location information, wherein the in-car communication method includes the following steps:
1) a voice input device collecting voice information, and a real time location information collecting device collecting real time location information;
2) a data transferring device transferring the above information to a server;
3) a virtual map creating device receiving the above information from the server and creating a virtual map;
4) the virtual map being stored in the server.
8. The in-car communication method according to claim 7, wherein the in-car communication method also includes the following step:
5) a video display displaying the virtual map stored in the server.
9. The in-car communication method according to claims 7 or 8, wherein the server is a cloudy server.
PCT/IB2012/002275 2012-09-27 2012-09-27 In-car system and method for communication of voice with location information WO2014049386A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IB2012/002275 WO2014049386A1 (en) 2012-09-27 2012-09-27 In-car system and method for communication of voice with location information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2012/002275 WO2014049386A1 (en) 2012-09-27 2012-09-27 In-car system and method for communication of voice with location information

Publications (1)

Publication Number Publication Date
WO2014049386A1 true WO2014049386A1 (en) 2014-04-03

Family

ID=47557389

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/002275 WO2014049386A1 (en) 2012-09-27 2012-09-27 In-car system and method for communication of voice with location information

Country Status (1)

Country Link
WO (1) WO2014049386A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090254840A1 (en) * 2008-04-04 2009-10-08 Yahoo! Inc. Local map chat
WO2011100307A1 (en) * 2010-02-09 2011-08-18 Google Inc. Geo-coded comments in a messaging service

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090254840A1 (en) * 2008-04-04 2009-10-08 Yahoo! Inc. Local map chat
WO2011100307A1 (en) * 2010-02-09 2011-08-18 Google Inc. Geo-coded comments in a messaging service

Similar Documents

Publication Publication Date Title
JP7216751B2 (en) Inter-device handoff
US11953339B2 (en) Systems and methods for generating an interactive user interface
JP7066753B2 (en) Dynamic adaptation of the provision of notification output to reduce user distraction and / or reduce the use of computational resources
US20220103972A1 (en) Time-delimited action suggestion system
KR102393817B1 (en) Pre-integration of unsolicited content into human-to-computer dialogs
CN105359060B (en) User interface (UI) is configured based on background
US20170178269A1 (en) Displayed identifier for a ridesharing service
CN105764033A (en) Information processing method, first terminal, and second terminal
EP3639506B1 (en) Customized communications for network systems
CN107036614A (en) Navigation data between the computing device of coexistence is shared
CN104516449A (en) Vehicular device, server, and information processing method
US20140214933A1 (en) Method and Apparatus for Vehicular Social Networking
US11451595B1 (en) Virtual carpooling
US10809082B2 (en) Information processing apparatus, riding vehicle adjusting method, and riding vehicle adjusting program
US20200019906A1 (en) Information processing apparatus, riding vehicle adjusting method, and riding vehicle adjusting program
Heikkinen et al. Mobile devices as infotainment user interfaces in the car: contextual study and design implications
CN102546455A (en) Communication system and communication method based on on-vehicle equipment
CN107483324A (en) For the instant messaging approaches to IM and device of vehicle device, storage medium, terminal
JP2019511719A (en) Navigation method based on map, device, storage medium and device
CN110202587A (en) Information interacting method and device, electronic equipment and storage medium
JP2012059005A (en) Information service system, relay device and terminal device
US9659008B2 (en) Information-sharing system
WO2013101879A1 (en) Unified platform for collecting, storing, sharing geographical information and providing relevant services across network clouds
JP2006309744A (en) Information service provision method and information service provision system
WO2014049386A1 (en) In-car system and method for communication of voice with location information

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12813955

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12813955

Country of ref document: EP

Kind code of ref document: A1