CN116659541A - Information processing device, information processing method, storage medium, and route guidance system - Google Patents

Abstract

The invention provides an information processing apparatus, an information processing method, a storage medium, and a route guidance system. In route guidance using the function of the mobile terminal, the direction of the left-right turn is displayed to the user so that the direction of the left-right turn can be more easily and intuitively understood, and even if the meaning of the language cannot be understood, the direction of the left-right turn can be displayed. In the present invention, a guidance route of a vehicle used by a user is acquired. The sound output device worn by the user is caused to output sound while the vehicle is traveling on the guide path. The localization position of the sound image of the sound is controlled according to the guide path.

Description

Information processing device, information processing method, storage medium, and route guidance system

Technical Field

The invention relates to an information processing apparatus, an information processing method, a storage medium, and a route guidance system.

Background

Conventionally, there is a technology of presenting a direction to a user of a vehicle by sound. Patent document 1 discloses the following technique: when the obstacle approaches within a predetermined distance, a warning sound with no localization is output via a speaker, and then a warning sound with a sound image localized in the direction of the obstacle is output.

Prior art literature

Patent literature

Patent document 1: japanese patent laid-open No. 2020-123143

Disclosure of Invention

Problems to be solved by the invention

However, patent document 1 does not consider a use environment such as a motorcycle in which a user rides a motorcycle while using a function of a portable terminal for making a call, listening to music, or the like. That is, for example, a case where a guidance sound of route guidance of a portable terminal is output to a headphone by wireless communication or the like is not considered.

Accordingly, an object of the present invention is to provide a route guidance using a function of a mobile terminal that allows a user to more intuitively understand a direction of turning left and right, and that allows the user to understand the direction of turning left and right even if the user cannot understand the meaning of a language.

Means for solving the problems

According to the present invention, there is provided an information processing apparatus characterized in that,

the information processing device is provided with:

a route acquisition means for acquiring a guide route of a vehicle for use by a user; and

a control means for causing the sound output device worn by the user to output a sound during the travel of the vehicle on the guide path,

the control means controls the localization position of the sound image of the sound according to the guide path.

Further, according to the present invention, there is provided an information processing method characterized in that,

the information processing method comprises the following steps:

a step of acquiring a guide path of a vehicle for a user to use; and

a step of causing a sound output device worn by the user to output sound during running of the vehicle on the guide path,

in the information processing method, a localization position of an acoustic image of the sound is controlled according to the guide path.

In addition, according to the present invention, there is provided a storage medium,

the storage medium stores a program that causes a portable terminal carried by a user to function as:

a route acquisition means for acquiring a guide route of a vehicle for use by the user; and

a control means for causing the sound output device worn by the user to output a sound during the travel of the vehicle on the guide path,

it is characterized in that the method comprises the steps of,

the control means controls the localization position of the sound image of the sound according to the guide path.

In addition, according to the present invention, there is provided a route guidance system characterized in that,

the route guidance system comprises a portable terminal and a voice output device,

The portable terminal is provided with:

a route acquisition means for acquiring a guide route of a vehicle for use by a user; and

a transmitting means for transmitting a sound to be outputted from a sound output device worn by the user during the travel of the vehicle on the guide path,

the sound output device is provided with:

a receiving means for receiving the sound from the portable terminal; and

and an output means for outputting an acoustic image in which the sound is positioned in a direction set according to the guide path.

Effects of the invention

According to the present invention, in route guidance using the function of a mobile terminal, the direction of turning left and right can be displayed to the user so that the direction of turning left and right can be more easily and intuitively understood, and even if the meaning of language cannot be understood.

Drawings

Fig. 1 is a right side view of a saddle-ride type vehicle according to an embodiment of the present invention.

Fig. 2 is a front view of the straddle-type vehicle of fig. 1.

Fig. 3 is a block diagram showing an example of the configuration of a control device for a saddle-ride type vehicle.

Fig. 4 is a diagram showing an outline of the route guidance system according to an embodiment of the present invention.

Fig. 5 is a block diagram showing an example of the configuration of the terminal device.

Fig. 6 is a block diagram showing an example of the functional configuration of the terminal device.

Fig. 7 is a block diagram showing an example of the structure of the audio output apparatus.

Fig. 8 is a diagram for explaining a process of determining the localization position of the sound image in the route guidance system.

Fig. 9 is a diagram for explaining output timings of sounds corresponding to right or left turns.

Fig. 10 is a flowchart showing an example of processing performed by the terminal device according to one embodiment.

Description of the reference numerals

601: a position acquisition unit; 602: a path acquisition unit; 603: a determination unit; 604: an audio/video position determining unit; 605: and a control unit.

Detailed Description

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The following embodiments are not limited to the invention according to the technical means, and all combinations of the features described in the embodiments are not limited to the essential elements of the invention. Two or more of the features described in the embodiments may be arbitrarily combined. The same or similar structures are denoted by the same reference numerals, and repetitive description thereof will be omitted.

In each drawing, an arrow X, Y, Z indicates mutually orthogonal directions, an X direction indicates a front-rear direction of the saddle-ride type vehicle, a Y direction indicates a vehicle width direction (left-right direction) of the saddle-ride type vehicle, and a Z direction indicates an up-down direction. The left and right sides of the saddle-ride type vehicle are left and right sides when viewed in the forward direction. Hereinafter, the front or rear of the saddle-ride type vehicle in the front-rear direction may be simply referred to as the front or rear. Further, the inner side or the outer side in the vehicle width direction (left-right direction) of the saddle-ride type vehicle may be simply referred to as the inner side or the outer side.

The information processing device according to the present embodiment is used in a route guidance system for performing navigation of a vehicle. In the route guidance system according to one embodiment, when the user uses the vehicle, the information processing device and the audio output device are connected by wireless communication. Next, during the travel of the vehicle on the guide path, the sound image of the sound output from the sound output device is controlled according to the guide path.

In the route guidance system according to the present embodiment (described later in fig. 4), sounds generated by applications such as route guidance applications installed in a terminal device are output to a sound output device, and the terminal device can be operated by a user inputting to the sound output device. That is, the audio output device can output weather information, navigation, telephone, message, music playing, or functions such as a dashboard, which can be mounted in the mobile terminal, and these operations can be performed via a microphone and buttons provided in the audio output device. For example, weather information of the current location or destination of the user is used as weather information output by the voice output device in the route guidance system, but the function that can be mounted in the terminal device is not particularly limited thereto. Such a configuration makes it possible to use the function of the terminal device without interfering with the driving operation during the running of the vehicle.

[ outline of saddle-ride type vehicle ]

First, a vehicle in the route guidance system according to the present embodiment will be described. Fig. 1 is a right side view of a saddle-ride type vehicle 1 according to an embodiment of the present invention, and fig. 2 is a front view of the saddle-ride type vehicle 1.

The saddle-ride type vehicle 1 is a traveling-system motorcycle suitable for long-distance movement, but the present invention can be applied to various saddle-ride type vehicles including other types of motorcycles, and can be applied to electric vehicles having a motor as a drive source in addition to vehicles having an internal combustion engine as a drive source. Hereinafter, the saddle-ride type vehicle 1 may be referred to as a vehicle 1.

The vehicle 1 includes a power unit 2 between front wheels FW and rear wheels RW. In the case of the present embodiment, the power unit 2 includes an engine 21 and a transmission 22 of horizontally opposed six cylinders. The driving force of the transmission 22 is transmitted to the rear wheels RW via a drive shaft, not shown, and rotates the rear wheels RW.

The power unit 2 is supported by the body frame 3. The body frame 3 includes a pair of left and right main frames 31 extending in the X direction. A fuel tank 5 and an air cleaner tank (not shown) are disposed above the main frame 31. An instrument panel MP having an electronic image display device or the like for displaying various information to a rider is provided in front of the fuel tank 5.

A head pipe 32 rotatably supporting a steering shaft (not shown) through rotation of the handle bar 8 is provided at a front end portion of the main frame 31. A pair of right and left pivot plates 33 are provided at the rear end portion of the main frame 31. The lower end portion of the pivot plate 33 and the front end portion of the main frame 31 are connected by a pair of left and right lower arms (not shown), and the power unit 2 is supported by the main frame 31 and the lower arms. A pair of left and right seat rails (not shown) extending rearward are further provided at the rear end portion of the main frame 31, and support a seat 4a on which a rider sits, a seat 4b on which a co-rider sits, a rear trunk 7b, and the like.

The pivot plate 33 rotatably supports a front end portion of a rear swing arm (not shown) extending in the front-rear direction. The rear swing arm is swingable in the up-down direction, and a rear wheel RW is supported at a rear end portion thereof. An exhaust muffler 6 for reducing the exhaust gas of the engine 21 is provided to extend in the X direction on the lower side of the rear wheel RW. A left and right saddle bag 7a is provided on the upper side of the rear wheel RW.

A front suspension mechanism 9 for supporting the front wheels FW is formed at the front end portion of the main frame 31. The front suspension mechanism 9 includes an upper link 91, a lower link 92, a fork supporting body 93, a cushion unit 94, and a pair of left and right front forks 95.

The upper link 91 and the lower link 92 are disposed at the front end of the main frame 31 at intervals in the vertical direction. The rear end portions of the upper link 91 and the lower link 92 are rotatably coupled to a support portion provided at the front end portion of the main frame 31. The front end portions of the upper link 91 and the lower link 92 are rotatably coupled to the fork supporting body 93. The upper link 91 and the lower link 92 extend in the front-rear direction and are arranged substantially in parallel.

The damper unit 94 has a structure in which a damper is inserted into a coil spring, and an upper end portion thereof is rotatably supported by the main frame 31. The lower end portion of the buffer unit 94 is rotatably supported by the lower link 92.

The fork support 93 is cylindrical and reclined. The front end portion of the upper link 21 is rotatably connected to the upper front portion of the fork supporting body 93. The front end portion of the lower link 92 is rotatably connected to the lower rear portion of the fork supporting body 93.

The steering shaft 96 is rotatably supported by the fork support 93 about its axis. The steering shaft 96 has a shaft portion (not shown) through which the fork support 93 is inserted. A bridge (not shown) is provided at a lower end portion of the steering shaft 96, and a pair of left and right front forks 95 are supported by the bridge. The front wheel FW is rotatably supported by the front fork 95. The upper end portion of the steering shaft 96 is coupled to a steering shaft (not shown) that is turned by the handle bar 8 via a link 97. The steering shaft 96 is rotated by steering operation of the handle bar 8, and the front wheels FW are steered.

The vehicle 1 includes a brake device 19F that brakes the front wheels FW and a brake device 19R that brakes the rear wheels RW. The brake devices 19F and 19R are configured to be operable by a rider operating the brake lever 8a or the brake pedal 8 b. The braking devices 19F, 19R are, for example, disc brakes. The braking devices 19F, 19R are collectively referred to as a braking device 19 without distinguishing them.

A headlight unit 11 that irradiates light to the front of the vehicle 1 is disposed at the front of the vehicle 1. The headlamp unit 11 of the present embodiment is a binocular type headlamp unit including a right light irradiation portion 11R and a left light irradiation portion 11L in bilateral symmetry. However, a single-eye type or triple-eye type headlight unit, or a double-eye type headlight unit having left and right asymmetry may be employed.

The front portion of the vehicle 1 is covered with a front cover 12, and the front side portion of the vehicle 1 is covered with a pair of left and right side covers 14. A windshield 13 is disposed above the front cover 12. The windshield 13 is a windshield for reducing the wind pressure applied to the rider during traveling, and is formed of, for example, a transparent resin member.

A pair of left and right side mirror units 15 are disposed laterally of the front cover 12. A side mirror (not shown) for visually checking the rear of the rider is supported by the side mirror unit 15.

In the case of the present embodiment, the front cover 12 is constituted by cover members 121 to 123. The cover member 121 extends in the Y direction to form the main body of the front cover 12, and the cover member 122 forms an upper portion of the cover member 121. The cover member 123 is disposed so as to be separated downward from the cover member 121.

Openings for exposing the headlight unit 11 are formed between the cover member 121 and the cover member 123 and between the left and right pair of side covers 14, and the upper edge of the opening is defined by the cover member 121, the lower edge is defined by the cover member 123, and the left and right side edges are defined by the side covers 14.

An imaging unit 16A and a radar 16B are disposed behind the front cover 12 as detection means for detecting a condition in front of the vehicle 1. Radar 16B is, for example, a millimeter wave radar. The imaging unit 16A includes imaging elements such as a CCD image sensor and a CMOS image sensor, and an optical system such as a lens, and captures an image of the front of the vehicle 1. The imaging unit 16A is disposed behind a cover member 122 constituting an upper portion of the front cover 12. The cover member 122 has an opening 122a formed therethrough, and the imaging unit 16A images the front of the vehicle 1 through the opening 122 a.

The radar 16B is disposed behind the cover member 121. The presence of the cover member 121 makes it possible to make the presence of the detection unit 16 inconspicuous when the vehicle 1 is viewed from the front, and to avoid deterioration of the appearance of the vehicle 1. The cover member 121 is made of a material that can transmit electromagnetic waves, such as resin.

The imaging unit 16A and the radar 16B are disposed in the center portion of the front cover 12 in the Y direction when the vehicle is viewed from the front. By disposing the imaging unit 16A and the radar 16B in the center portion of the vehicle 1 in the Y direction, a wider imaging range and detection range can be obtained in the front left and right of the vehicle 1, and the situation in front of the vehicle 1 can be detected more without omission. Further, since the front of the vehicle 1 can be monitored equally by one imaging unit 16A and one radar 16B, it is particularly advantageous in a configuration in which one imaging unit 16A and one radar 16B are not provided, respectively.

Control device for saddle-ride type vehicle

Fig. 3 is a block diagram of the control device 10 of the vehicle 1, and only the configuration necessary for the relationship with the following description is illustrated. The vehicle 1 includes a control unit (ECU) 10a. The control unit 10a includes a processor typified by a CPU, a storage device such as a semiconductor memory, an input/output interface with an external device, a communication interface, and the like. Programs executed by the processor, data used by the processor in processing, and the like are stored in the storage device. The control unit 10a may include a plurality of sets of processors, storage devices, interfaces, and the like corresponding to the respective functions of the vehicle 1.

The control unit 10a acquires the detection results of the imaging unit 16A and the radar 16B, and recognizes the object and the road state around the vehicle 1 at any time. The control unit 10a acquires information from the GPS sensor 17, the communication device 18, and the map information database DB. The GPS sensor 17 detects position information indicating the current position of the vehicle 1. The communication device 18 wirelessly communicates with a server that provides map information and traffic information, and acquires these pieces of information. In the present embodiment, the communication device 18 can communicate wirelessly with a terminal device carried by a user of the vehicle 1. The map information database DB can store map information with high accuracy, and the control unit 10a can determine the form of a road being traveled and the position of the vehicle 1 on a lane with higher accuracy based on the map information and the like.

The control unit 10a can control the respective actuators of the power unit 2 and the brake 19. In the case of the present embodiment, the control unit 10a controls the speed limiting process described later. The control unit 10a can also perform display control of the dashboard MP. In the present embodiment, various kinds of alarm display for the rider is performed on the instrument panel MP. In the present embodiment, the alarm is activated by displaying an image of the instrument panel MP, but the alarm may be activated by lighting or flashing a lamp or by sound. The activation of the alarm by sound may be controlled so that sound is output from a speaker provided in the helmet of the rider through wireless communication.

[ Path guidance System ]

Fig. 4 is a diagram showing an example of the configuration of the route guidance system according to the present embodiment. In the route guidance system 400, the terminal device 410, the audio output device 420, and the vehicle 430 are communicably connected to each other. The terminal device 410 is an information processing device capable of performing route guidance of the vehicle 430 for use by a user, and is a smart phone, for example. The terminal device 410 transmits audio data to the audio output device 420, and outputs audio. The content of the sound to be outputted from the sound output device 420 is not particularly limited as long as it can be outputted from a general terminal device, and for example, the sound may be a sound for notifying information based on an application program including a route guidance application, or the like, and may be music or a call sound. The terminal device 410 according to the present embodiment basically causes the audio output device 420 to output the guidance audio from the route guidance application, and the following description will be made.

The sound output device 420 is a device worn by the user that outputs sound received from the terminal device 410. The audio output device 420 may be, for example, a headset integrated with a helmet, or may be a wireless headset, and is not particularly limited to this embodiment as long as it is wirelessly connected to the terminal device 410 and is capable of outputting audio. The audio output device 420 of the present embodiment includes a communication unit (not shown) capable of Bluetooth (registered trademark) based communication, and is connected to the terminal device 410.

The terminal device 410 is connected to the vehicle 430, and performs a process of starting the route guidance application. The vehicle 430 is a vehicle as shown in fig. 1 to 3, and the control unit 10a transmits a start signal of an application program installed in the terminal device 410 to the terminal device 410. In the present embodiment, vehicle 430 is a straddle-type vehicle. The communication device 18 of the vehicle 430 is a communication unit capable of Bluetooth (registered trademark) communication, and is connected to the terminal device 410 by wireless.

Fig. 5 is a block diagram showing an example of the hardware configuration of the terminal apparatus 410. The terminal device 410 includes a processing unit 510, a storage unit 520, a communication unit 530, and a display unit 540. The processing unit 510 is a central processing unit such as a CPU, and executes programs stored in the storage unit 520 to perform respective processes. The storage unit 520 is a storage device such as RAM, ROM, or hard disk. The program stored in the storage unit 520 includes an application program of a navigation service of the route guidance system according to the present embodiment. The application program may be downloaded from a server or distributed via a storage medium such as a CD-ROM.

The storage unit 520 stores map data, and can be used for route guidance of the vehicle 430. The map data stored in the storage unit 520 may include information related to a search for a route, such as information related to a node corresponding to a connection point in a road network including a guidance point in route guidance such as an intersection, and information related to a link to a road formed between the nodes.

The communication unit 530 includes a wireless communication interface or a wired communication interface capable of communicating with the audio output device 420 and the vehicle 430. The display unit 540 is, for example, a liquid crystal display or a touch panel, and can display the result of processing such as displaying a map in route guidance together with the current location. The display unit 540 can acquire a user input based on a user's touch on the touch panel or the like. Here, the display unit 540 may acquire destination information, position information, and the like of a user, which will be described later, for use in the route guidance system, for example.

Fig. 6 is a block diagram showing an example of the functional configuration of the terminal apparatus 410 according to the present embodiment. The terminal device 410 according to the present embodiment includes a position acquisition section 601, a path acquisition section 602, a determination section 603, an audio-visual position determination section 604, and a control section 605.

The position acquisition unit 601 can acquire the position of the user of the vehicle 430. In the present embodiment, the position acquisition unit 601 may receive a GNSS (Global Navigation Satelite System: global navigation satellite system) signal and calculate the current position based on the received GNSS signal, or may acquire position information based on an input of a user. The position acquisition unit 601 may acquire, from the vehicle 430, position information acquired by the GPS sensor 17 provided in the vehicle 430 as position information of the user. The position acquisition unit 601 can acquire position information by any known means, and detailed description thereof is omitted.

The position acquisition unit 601 can acquire input of a destination by a user, which is used in the route guidance system. In the present embodiment, the position acquisition unit 601 acquires a destination set according to the voice input of the user to the microphone provided in the voice output device 420, but a different method may be used, for example, to acquire the destination of the user based on the input of the user to the touch panel of the terminal device 410. The destination may be acquired based on the input of the user when the route guidance application is used, or may be set in advance.

In the route guidance system 400 according to the present embodiment, a destination can be retrieved by a sound input of a user. Here, the destination may be searched by name, address, or category search such as a gas station or a parking lot. Here, the terminal device 410 can perform the search for the destination using the map information on the server. In addition, favorites setting of the destination of the storage unit 520 (for example, 5) can be stored, and various processes for setting a destination preferable to the user, such as advice to the user when setting the destination, can be performed.

The route acquisition unit 602 acquires a guide route used for route guidance of the vehicle 430. The route acquisition unit 602 according to the present embodiment acquires a guidance route based on the user's position information and destination acquired by the position acquisition unit 601.

The determination unit 603 determines whether the vehicle 430 turns right or left at the guide point on the guide route. The guidance point of the present embodiment is a point of the guidance route acquired by the route acquisition unit 602 at which the route of the vehicle 430 is guided by the guidance sound. For example, the guidance point is an intersection, and the terminal device 410 can cause the sound output device 420 to output the guidance sound of the route at the intersection at a point before the vehicle 430 reaches a predetermined distance from the intersection.

The sound image position determining unit 604 determines the position of the sound image of the sound output by the sound output device 420 based on the guide route acquired by the route acquiring unit 602. The sound image position determining unit 604 determines the localization position of the sound image, for example, according to whether the vehicle 430 turns right or left at the guidance point. An example of the determination processing of the localization position of the sound image will be described later with reference to fig. 8 and 9. Hereinafter, the term "localization position" refers to a localization position of an acoustic image. The control unit 605 controls the audio output device 420 so that the audio image is positioned at the position determined by the audio image position determining unit 604.

The sound image position determining section 604 allows the user to perceive whether or not the sound source is present at the position where the sound image is localized through the sound output device 420. Therefore, the sound image position determining section 604 can locate the sound image by adjusting the volume or timing of the sound to be output to the sound output device 420 left and right.

When a user who drives a vehicle is given a guide sound in which an acoustic image is positioned in either the left or right direction in addition to an environmental sound, the user may feel that the driving is easily inclined in the direction in which the acoustic image is positioned. From such a viewpoint, by outputting to the user a guiding sound in which an acoustic image is positioned in the direction in which the user turns at the guiding point of turning left and right, it is possible to provide a guiding sound in which the user turns more easily and naturally and can understand the direction more easily and intuitively than a guiding sound without positioning.

In addition, even when the sound image-localized guide sound is further output in a state where the vehicle body of the vehicle 430 is tilted, the driving may be excessively tilted, which may cause imbalance. In view of this, the sound image position determining unit 604 may acquire information indicating the inclination angle of the vehicle 430, and if the inclination angle is equal to or greater than a predetermined threshold value, the sound image of the sound output by the sound output device 420 may be set to be non-localized. The threshold value related to the inclination angle can be arbitrarily set to 30 degrees, for example.

The sound image position determining unit 604 may acquire the inclination angle of the vehicle 430 from the vehicle 430. For example, the vehicle 430 may have an inclination angle sensor, not shown, for detecting an inclination, and the sound image position determining unit 604 may acquire the inclination angle of the vehicle 430 measured by the motorcycle angle sensor. The sound image position determining unit 604 may estimate the inclination angle based on the speed of the vehicle 430, a curve, and the like, and compare the estimated value with a threshold value, and any method may be used as long as the inclination of the vehicle body of the vehicle 430 can be estimated. The vehicle 430 does not need to be acquired by a sensor provided in the vehicle 430, and may be estimated by a gyro sensor or the like incorporated in the audio output device 420, for example.

The audio output device 420 is a headphone incorporated in a helmet as shown in fig. 4, and the manner and function thereof are not particularly limited as long as it is wirelessly connected to the terminal device 410 and is capable of outputting audio as described above. Fig. 7 is a block diagram showing an example of the configuration of a headphone as the sound output apparatus 420. The audio output apparatus 420 includes a communication unit 710, an input unit 720, an output unit 730, an AIF731, a DAC732, and an amplifier 733. The communication unit 710 is a communication unit for performing wireless communication with the terminal device 410 and the vehicle 430, and transmits and receives various data including data of the guidance sound between the devices.

The input unit 720 obtains input from a user to an application program running on the terminal device 410. The input section 720 according to the present embodiment is, for example, a sound receiver (microphone), and acquires a sound input of a user to input a destination or the like. The input unit 720 is, for example, a dial-type or toggle-type mechanical switch, and may acquire user input such as adjustment of the output volume, or setting of on/off of the sound.

An AIF (Audio Interface) 731 transmits the signal of the sound received from the terminal apparatus 410 to the DAC732 in the left and right channels. The DAC (Digtal to Analog Converter: digital-to-analog converter) 732 converts the digital signal input from the AIF731 into an analog signal. The amplifier 733 amplifies the analog signal input from the DAC732 and supplies the amplified analog signal to the speaker 730. Accordingly, the sound received from the terminal device 410 is outputted from the speaker 730 as the sound of the localization position determined by the sound image position determining section 604.

[ processing for determining the position of an audio image ]

Fig. 8 is a diagram for explaining a process performed by the sound image position determining unit 604 in the route guidance system according to the present embodiment, in which the localization position of the output sound is determined based on the guidance route. In fig. 8, a vehicle 430 travels along a guide route and approaches an intersection 801 to be subjected to a guide sound. Here, a specific example of the positioning position determination processing corresponding to the guidance route at the intersection 801 will be described.

The sound image position determining unit 604 may determine the sound image localization position according to whether the vehicle 430 turns right or left at the intersection 801. For example, the sound image position determining unit 604 may position the localization position in the right direction with respect to the front of the vehicle 430 when the vehicle 430 turns right at the intersection 801, or position the localization position in the left direction with respect to the front of the vehicle 430 when the vehicle 430 turns left at the intersection 801. According to such processing, the direction of the left-right turn can be intuitively indicated by the positioning position, and the direction of the left-right turn can be indicated even if the meaning of the language cannot be understood. Hereinafter, when the positioning position is indicated as only "right direction" or "left direction", the description will be given referring to the right direction or the left direction as viewed from the front of the vehicle 430. In this case, the sound image position determining unit 604 outputs the guidance sound without any localization when the vehicle 430 is traveling straight at the intersection 801.

In the example of fig. 8, it is considered that it takes more time to prepare for a right turn than a left turn, for example, when the vehicle 430 travels on a left lane of the entrance route 802, for example, when it first needs to enter a right turn dedicated lane or the like in the case of a right turn. From such a viewpoint, the sound image position determining unit 604 may cause the sound output device 420 to output the guide sound at a different timing (in this example, at a timing earlier than the right turn) depending on whether the vehicle turns right or left at the intersection 801. Since the left-hand travel is assumed in fig. 8, for example, when the obligation of the right-hand travel is predetermined, the sound image position determining unit 604 may output the guidance sound at an earlier timing of the left turn. In this process, the sound image position determining unit 604 may change the timing itself of outputting the guide sound indicating the direction of turning left and right such as "turn right (turn left) after 200 m", or may change the timing of locating the guide sound output at equal intervals.

In addition, the sound image position determining unit 604 may cause the sound output device 420 to output sound so that the localization position moves according to the distance to the intersection 801 when the vehicle 430 turns left and right. That is, in the initial state, the localization position of the output sound image may be set to be neutral (no localization), and the localization position may be moved to the right (in the case of a right turn) or to the left (in the case of a left turn) as the localization position approaches the intersection 801 of a left turn and right turn.

Fig. 9 is a diagram for explaining an example of a point 901 at which a guidance sound is output when a right turn is made and a point 902 at which a guidance sound is output when a left turn is made, with respect to a vehicle 430 traveling on an entry route 802. In the case of turning left at the intersection 801, an instruction of "turning left at the next intersection" is given by a guide sound whose sound image is located in the left direction of the vehicle at the point 901 at a distance S1 from the intersection 801. In the case of turning right at the intersection 801, an instruction such as "turning right at the next intersection, please note that there is a right-turn dedicated lane" is given by a guide sound whose sound image is located in the right direction of the vehicle at the point 902 of S2, which is a distance from the intersection 801 that is greater than S1. Here, the method for determining the position of the sound image localization is not particularly limited. For example, the sound image position determining unit 604 may determine the localization position based on only whether the route guidance is a right turn or a left turn, or may determine the localization position based on a distance reference table or the like from the vehicle 430 to the intersection 801. In addition, for example, the sound image position determining section 604 may acquire a reference position for determining a localization position set on the map data, and calculate the localization position based on the position of the vehicle 430 on the map data and the acquired reference position (e.g., localizing the sound image from the current position of the vehicle 430 toward the reference position).

The sound image position determining unit 604 may cause the sound output device 420 to output the sound so that the sound image positioning position is moved from the start of playing the guide sound to the end of playing the guide sound. That is, for example, when outputting a guide sound such as "turn right (left) at the next intersection", the sound may be output such that the sound image is positioned at the neutral position at the start of the playback, and the sound image is gradually moved to the right (left) direction at the end of the playback (playback is started from the neutral position at the second output). By locating the sound image from the neutral right or left direction, the user can grasp the left-turn right turning direction more intuitively according to the contrast at the start of playback of the sound and at the end of playback.

In the present embodiment, the sound output from the sound output device 420 is, for example, a guidance sound indicating the left-right turning direction at the intersection 801 and the distance from the current position to the intersection 801. However, the sound image position determining section 604 may determine the localization position of the sound other than such a guide sound, and cause the sound output device 420 to output the localization position. For example, the sound image position determining section 604 may determine the position of the sound image of the call sound with the external terminal that is communicating, instead of the position of the guide sound. That is, in the case where the output sound of the call function of the terminal apparatus 410 is output via the sound output apparatus 420, the sound image position determining unit 604 may change the position of the sound image of the call sound instead of outputting the guide sound. Further, the sound image position determining section 604 may change the sound image of the music being played instead of the localization position of the talking sound. According to these processes, it is possible to indicate the direction of turning left and right when the guide sound is played without interrupting the function of the terminal device 410 such as a call or music play. In addition, the call function and the music play function can be realized by a process using a general application program, and thus a detailed description thereof will be omitted.

Fig. 10 is a flowchart showing an example of processing performed by the terminal device 410 in the route guidance system according to the present embodiment.

In S1001, the terminal device 410 receives a start signal of the route guidance application from the control unit 10a of the vehicle 430, and starts route guidance. Here, the control unit 10a may transmit a start signal to the terminal device 410, for example, in response to the start of the vehicle 430, may transmit the start signal in response to a signal from the terminal device 410 that has executed the application program, or may detect that the user starts to use (e.g., straddle) the vehicle 430 and transmit the start signal. The transmission processing of the start signal can be performed by any steps. In the processing shown in fig. 10, the location of the sound image is determined for the guidance sound of the route guidance application, but the processing may be performed to change the location of the sound image of the call sound or music as described above.

In S1002, the position acquisition section 601 acquires position information about the current position and destination of the user. As described above, for example, the position acquisition unit 601 can acquire each piece of position information by the GPS function, and set a destination by voice input of the user. In S1003, the route acquisition unit 602 acquires a guidance route based on the position information acquired in S1002.

In S1004, the determination unit 603 determines a guide point at which route guidance is performed next in the guide route acquired in S1003, and determines whether the guide point is a right turn or a left turn (or a straight run). In S1005, the sound image position determining unit 604 determines the sound localization position for the guide point designated in S1004.

In S1006, the control section 605 transmits the sound for which the positioning position is determined in S1005 to the sound output device 420, and outputs the sound. In S1007, the determination unit 603 determines whether or not the guidance route acquired in S1003 has a guidance point. If there is a guidance point left, the process returns to S1004, and if not, the process ends.

According to this configuration, the sound output device worn by the user can be caused to output the sound at the positioning position corresponding to the guide path while the vehicle is traveling on the guide path. Therefore, the direction of the left-right turn is displayed to the user so that the direction of the left-right turn can be intuitively understood, and even if the meaning of the language cannot be understood, the direction of the left-right turn can be displayed.

In the route guidance system according to the present embodiment, the case where the sound positioning position is used to indicate the direction of turning left and right at the guidance point has been described, but the line LED on the instrument panel may be used in addition to this. For example, the terminal device 410 can assist the direction instruction by controlling the output of the guidance sound for turning left and right of the positioning position and causing the panel provided in the dashboard of the vehicle 430 or the panel provided in the helmet with the built-in sound output device 420 to display light in the turning left and right direction. The light-emitting display may be, for example, a blinking display having a deviation in the right or left direction, or a lighting display having a flow in the right or left direction, and a desired display method may be employed as long as an instruction to a specific direction is possible.

In the above embodiment, the terminal device 410, the audio output device 420, and the vehicle 430 were described as being completely independent devices for performing the respective processes, but these devices may share some or all of the processes with other devices. For example, the vehicle 430 may perform some or all of the processing performed by the terminal device 410.

Summary of the embodiments

In the above embodiments, at least the following information processing apparatus, information processing method, program, and route guidance system are disclosed.

1. The information processing device (e.g., 410) of the above embodiment includes:

a route acquisition means for acquiring a guide route of a vehicle for use by a user; and

a control means for causing the sound output device worn by the user to output a sound during the travel of the vehicle on the guide path,

the control means controls the localization position of the sound image of the sound according to the guide path.

According to this embodiment, in route guidance using the function of the mobile terminal, the direction of turning left and right can be displayed to the user so that the direction of turning left and right can be more easily and intuitively understood, and even if the meaning of language cannot be understood.

2. In addition to the information processing apparatus of the above embodiment,

the sound is a guide sound for performing route guidance of the vehicle based on the guide route.

According to this embodiment, in the guide sound for route guidance, the direction of turning left and right can be indicated by the localization position of the sound image.

3. In addition to the information processing apparatus of the above embodiment,

when the vehicle turns right or left at a guidance point in the guidance route, the control means causes the sound output device to output the guidance sound at different timings according to whether the vehicle turns right or left at the guidance point.

According to this embodiment, the timing of outputting the guide sound whose localization position of the sound image is controlled can be adjusted based on whether the sound image is turned right or left.

4. In addition to the information processing apparatus of the above embodiment,

when the vehicle turns right at the guidance point, the control means outputs the guidance sound at an earlier timing than when the vehicle turns left at the guidance point.

According to this embodiment, when it takes time to prepare for a right turn compared to a left turn, the right turn at the next guidance point can be notified earlier.

5. In addition to the information processing apparatus of the above embodiment,

the control means causes the sound output device to output the guidance sound so that the localization position of the sound image moves in accordance with a distance from a current position to the guidance point when the vehicle turns right or left at the guidance point in the guidance path.

According to this embodiment, the distance to the guidance point can be more easily perceived from the localization position of the sound image.

6. In addition to the information processing apparatus of the above embodiment,

the control means causes the sound output device to output the guide sound so that the sound image localization position moves in the rightward direction as the distance from the current position to the guide point is closer when the vehicle turns right at the guide point, and causes the sound output device to output the guide sound so that the sound image localization position moves in the leftward direction as the distance from the current position to the guide point is closer when the vehicle turns left at the guide point.

According to this embodiment, the closer the localization position of the sound image is to the right or to the left, the closer the guidance point for turning in this direction is.

7. In addition to the information processing apparatus of the above embodiment,

when the vehicle turns right at a guide point in the guide route, the control means causes the sound output device to output the guide sound so that the sound image position moves in the right direction from the start of playing of the guide sound to the end of playing,

when the vehicle turns left at the guidance point, the control means causes the sound output device to output the guidance sound so that the sound image localization position moves in the left direction from the start of playing of the guidance sound to the end of playing.

According to this embodiment, the user can grasp the left-right turning direction more intuitively according to the contrast at the start of playback and at the end of playback of the guide sound.

8. In addition to the information processing apparatus of the above embodiment,

the sound includes a call sound for making a call with an external terminal in communication.

According to this embodiment, the user can be guided to the left-right turn direction at the guidance site by playing the guidance sound without interrupting the call function of the terminal device.

9. In addition to the information processing apparatus of the above embodiment,

The sound includes music in play.

According to this embodiment, it is possible to guide the user to the left-right turning direction at the guide point without interrupting the music play of the terminal device and playing the guide sound.

10. In addition to the information processing apparatus of the above embodiment,

the information processing apparatus further includes an inclination acquisition means for acquiring information indicating an inclination angle of the vehicle,

when the tilt angle is equal to or greater than a predetermined threshold value, the control means causes the sound output device to output the sound so that the sound image is positioned at a non-positioned position.

According to this embodiment, by detecting the inclination of the vehicle body and setting the sound image localization position to be non-localization, it is possible to prevent driving from being excessively inclined and becoming a factor of unbalance.

11. In addition to the information processing apparatus of the above embodiment,

the information processing apparatus further includes a receiving means for receiving a start signal from a control unit of the saddle-ride type vehicle as the vehicle,

the path acquisition means starts the acquisition of the guide path in accordance with the reception of the start signal.

According to this embodiment, route guidance can be started by communication with the vehicle.

12. The information processing method according to the above embodiment includes:

a step of acquiring a guide path of a vehicle for a user to use; and

a step of causing a sound output device worn by the user to output sound during running of the vehicle on the guide path,

in the information processing method, a localization position of an acoustic image of the sound is controlled according to the guide path.

According to this embodiment, in route guidance using the function of the mobile terminal, the direction of turning left and right can be displayed to the user so that the direction of turning left and right can be more easily and intuitively understood, and even if the meaning of language cannot be understood.

13. The program according to the above embodiment is a program for causing a mobile terminal carried by a user to function as:

a route acquisition means for acquiring a guide route of a vehicle for use by the user; and

a control means for causing the sound output device worn by the user to output a sound during the travel of the vehicle on the guide path,

the control means controls the localization position of the sound image of the sound according to the guide path.

According to this embodiment, in route guidance using the function of the mobile terminal, the direction of turning left and right can be displayed to the user so that the direction of turning left and right can be more easily and intuitively understood, and even if the meaning of language cannot be understood.

14. The route guidance system of the above embodiment includes a mobile terminal and a voice output device,

the portable terminal is provided with:

a route acquisition means for acquiring a guide route of a vehicle for use by a user; and

a transmitting means for transmitting a sound to be outputted from a sound output device worn by the user during the travel of the vehicle on the guide path,

the sound output device is provided with:

a receiving means for receiving the sound from the portable terminal; and

and an output means for outputting an acoustic image in which the sound is positioned in a direction set according to the guide path.

According to this embodiment, in route guidance using the function of the mobile terminal, the direction of turning left and right can be displayed to the user so that the direction of turning left and right can be more easily and intuitively understood, and even if the meaning of language cannot be understood.

The embodiments of the present invention have been described above, but the present invention is not limited to the above embodiments, and various modifications and changes can be made within the scope of the present invention.

Claims (14)

1. An information processing apparatus, characterized in that,

the information processing device is provided with:

a route acquisition means for acquiring a guide route of a vehicle for use by a user; and

a control means for causing the sound output device worn by the user to output a sound during the travel of the vehicle on the guide path,

the control means controls the localization position of the sound image of the sound according to the guide path.

2. The information processing apparatus according to claim 1, wherein the sound is a guide sound that performs route guidance of the vehicle based on the guide route.

3. The information processing apparatus according to claim 2, wherein in the case where the vehicle turns right or left at a guidance point in the guidance route, the control means causes the sound output device to output the guidance sound at different timings depending on whether the vehicle turns right or left at the guidance point.

4. The information processing apparatus according to claim 3, wherein the control means outputs the guidance sound at an earlier timing than the vehicle turns left at the guidance point in the case where the vehicle turns right at the guidance point.

5. The information processing apparatus according to any one of claims 2 to 4, wherein in a case where the vehicle turns right or left at a guidance point in the guidance route, the control means causes the sound output device to output the guidance sound in such a manner that the localization position of the sound image moves according to a distance from a current position to the guidance point.

6. The information processing apparatus according to claim 5, wherein,

in the case where the vehicle turns right at the guidance point, the control means causes the sound output device to output the guidance sound so that the localization position of the sound image moves in the right direction as the distance from the current position to the guidance point is closer,

when the vehicle turns left at the guidance point, the control means causes the sound output device to output the guidance sound so that the sound image localization position moves in the left direction as the distance from the current position to the guidance point is closer.

7. The information processing apparatus according to claim 2, wherein,

when the vehicle turns right at a guide point in the guide route, the control means causes the sound output device to output the guide sound so that the sound image position moves in the right direction from the start of playing of the guide sound to the end of playing,

When the vehicle turns left at the guidance point, the control means causes the sound output device to output the guidance sound so that the sound image localization position moves in the left direction from the start of playing of the guidance sound to the end of playing.

8. The information processing apparatus according to claim 1, wherein the sound includes a call sound of a call with an external terminal in communication.

9. The information processing apparatus according to claim 1, wherein the sound includes music in play.

10. The information processing apparatus according to claim 1, wherein,

the information processing apparatus further includes an inclination acquisition means for acquiring information indicating an inclination angle of the vehicle,

when the tilt angle is equal to or greater than a predetermined threshold value, the control means causes the sound output device to output the sound so that the sound image is positioned at a non-positioned position.

11. The information processing apparatus according to claim 1, wherein,

the information processing apparatus further includes a receiving means for receiving a start signal from a control unit of the saddle-ride type vehicle as the vehicle,

The path acquisition means starts the acquisition of the guide path in accordance with the reception of the start signal.

12. An information processing method, characterized in that,

the information processing method comprises the following steps:

a step of acquiring a guide path of a vehicle for a user to use; and

a step of causing a sound output device worn by the user to output sound during running of the vehicle on the guide path,

in the information processing method, a localization position of an acoustic image of the sound is controlled according to the guide path.

13. A storage medium storing a program for causing a portable terminal carried by a user to function as:

a route acquisition means for acquiring a guide route of a vehicle for use by the user; and

a control means for causing the sound output device worn by the user to output a sound during the travel of the vehicle on the guide path,

it is characterized in that the method comprises the steps of,

the control means controls the localization position of the sound image of the sound according to the guide path.

14. A route guidance system, characterized in that,

the route guidance system comprises a portable terminal and a voice output device,

The portable terminal is provided with:

a route acquisition means for acquiring a guide route of a vehicle for use by a user; and

a transmitting means for transmitting a sound to be outputted from a sound output device worn by the user during the travel of the vehicle on the guide path,

the sound output device is provided with:

a receiving means for receiving the sound from the portable terminal; and

and an output means for outputting an acoustic image in which the sound is positioned in a direction set according to the guide path.