WO2021192526A1 - Information processing device, information processing method, information processing program, and storage medium - Google Patents

Information processing device, information processing method, information processing program, and storage medium Download PDF

Info

Publication number
WO2021192526A1
WO2021192526A1 PCT/JP2021/001127 JP2021001127W WO2021192526A1 WO 2021192526 A1 WO2021192526 A1 WO 2021192526A1 JP 2021001127 W JP2021001127 W JP 2021001127W WO 2021192526 A1 WO2021192526 A1 WO 2021192526A1
Authority
WO
WIPO (PCT)
Prior art keywords
information processing
information
occupant
unit
route
Prior art date
Application number
PCT/JP2021/001127
Other languages
French (fr)
Japanese (ja)
Inventor
祥子 佐藤
智也 大石
Original Assignee
パイオニア株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パイオニア株式会社 filed Critical パイオニア株式会社
Priority to JP2022509302A priority Critical patent/JPWO2021192526A1/ja
Publication of WO2021192526A1 publication Critical patent/WO2021192526A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B29/00—Maps; Plans; Charts; Diagrams, e.g. route diagram

Definitions

  • the present invention relates to an information processing device, an information processing method, an information processing program, and a storage medium.
  • Non-Patent Document 1 an automobile having an automatic driving function, a low floor, a vast interior space with a box-shaped design, and being able to be equipped with equipment corresponding to various services has been proposed (see, for example, Non-Patent Document 1).
  • the present invention has been made in view of the above, and an object of the present invention is to provide an information processing device, an information processing method, an information processing program, and a storage medium that can propose efficient use of travel time.
  • the information processing device is for an acquisition unit that acquires information on a traveling route of a moving body and an occupant who is a occupant of the moving body and is not in operation according to the information acquired by the acquisition unit. It is characterized by having an operation determining unit for determining a recommended operation and a notification unit for notifying information on the operation determined by the operation determining unit.
  • the information processing method is an information processing method executed by an information processing apparatus, and is based on an acquisition step of acquiring information on a traveling route of a moving body and information acquired by the acquisition step. It is characterized by including an operation determination step for determining a recommended operation for an occupant of the moving body who is not in operation, and a notification step for notifying information about the operation determined by the operation determination step.
  • the information processing program according to claim 8 applies to an acquisition step for acquiring information on a traveling route of a moving body and an occupant who is a occupant of the moving body and is not driving according to the information acquired by the acquisition step.
  • the computer is made to execute an operation determination step for determining a recommended operation and a notification step for notifying information about the operation determined by the operation determination step.
  • the storage medium according to claim 9 is recommended for an acquisition step for acquiring information on a traveling route of a moving object and for an occupant who is an occupant of the moving object and is not in operation according to the information acquired by the acquisition step. It is characterized in that it stores an information processing program for causing a computer to execute an operation determination step for determining an operation to be performed and a notification step for notifying information about an operation determined by the operation determination step.
  • the information processing apparatus is the acquisition unit that acquires information on a series of operations performed by an occupant who is a mobile occupant and is not in operation, and the information processing device according to the information acquired by the acquisition unit. It is characterized by having a route determining unit for determining a traveling route of a moving body.
  • the information processing method according to claim 12 is an information processing method executed by an information processing apparatus, which includes an acquisition step of acquiring information on a series of operations performed by a moving occupant who is not in operation. It is characterized by including a route determination step for determining a traveling route of the moving body according to the information acquired by the acquisition step.
  • the information processing program according to claim 13 is described in accordance with an acquisition step of acquiring information regarding a series of operations performed by a moving occupant who is not driving, and information acquired by the acquisition step. Have the computer perform a route determination step that determines the travel route of the moving object.
  • the storage medium according to claim 14 has an acquisition step of acquiring information about a series of operations performed by a moving occupant who is not in operation, and the movement according to the information acquired by the acquisition step. It is characterized by storing an information processing program for causing a computer to execute a route determination step for determining a traveling route of a body.
  • FIG. 1 is a block diagram showing a configuration of an information processing system according to an embodiment.
  • FIG. 2 is a block diagram showing a configuration example of the vehicle control device.
  • FIG. 3 is a block diagram showing a configuration example of the information processing device.
  • FIG. 4 is a diagram showing an example of the data structure of the occupant DB.
  • FIG. 5 is a diagram showing an example of the data structure of the history DB.
  • FIG. 6 is a diagram showing an example of the data structure of the operation DB.
  • FIG. 7 is a diagram showing an example of the shape of the route.
  • FIG. 8 is a diagram showing an example of a conversation between an agent and an occupant.
  • FIG. 9 is a diagram showing an example of a conversation between an agent and an occupant.
  • FIG. 9 is a diagram showing an example of a conversation between an agent and an occupant.
  • FIG. 10 is a diagram showing an example of a conversation between an agent and an occupant.
  • FIG. 11 is a flowchart showing an example of the information processing method.
  • FIG. 12 is a flowchart showing an example of the information processing method.
  • FIG. 13 is a flowchart showing an example of the information processing method.
  • FIG. 1 is a block diagram showing a configuration of an information processing system according to an embodiment.
  • the information processing system 1 provides the occupants of the vehicle VE with information on the operation based on the information on the movement of the vehicle VE which is a moving body. Further, the information processing system 1 controls the vehicle VE according to the movement of the occupant.
  • the vehicle VE in the present embodiment is assumed to be a vehicle having a vast interior space as described in Non-Patent Document 1.
  • the information processing system 1 includes a vehicle control device 10 and an information processing device 20. Further, the vehicle control device 10 and the information processing device 20 are communicably connected via the network NE.
  • the network NE is, for example, the Internet.
  • the number of information processing devices 20 and vehicle VEs included in the information processing system 1 is not limited to that shown in FIG.
  • the information processing device 20 may be connected to a vehicle control device 10 provided in each of the plurality of vehicle VEs.
  • FIG. 2 is a block diagram showing a configuration example of the vehicle control device.
  • the vehicle control device 10 is, for example, a computer having a function as an ECU (Engine Control Unit). Further, the vehicle control device 10 may be, for example, a stationary navigation device or a drive recorder installed in the vehicle VE. Further, the vehicle control device 10 may be a system realized by combining a stationary device and a terminal device such as a smartphone used by an occupant. As shown in FIG. 2, the vehicle control device 10 includes a communication unit 11, a control unit 12, a storage unit 13, an input unit 14, an output unit 15, an imaging unit 16, and a sensor unit 17.
  • the communication unit 11 transmits and receives information to and from the information processing device 20 via the network NE under the control of the control unit 12.
  • the control unit 12 is realized by executing various programs stored in the storage unit 13 by a controller such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and controls the operation of the entire vehicle control device 10. do.
  • a controller such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and controls the operation of the entire vehicle control device 10. do.
  • the control unit 12 is not limited to the CPU and MPU, but may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
  • the storage unit 13 stores various programs executed by the control unit 12, data necessary for executing processing by the control unit 12, and the like.
  • the input unit 14 is an interface for receiving data input via an input device.
  • the input unit 14 can accept input by text, voice, or the like.
  • the input unit 14 receives an input by voice.
  • the input unit 14 generates voice information by performing A / D (Analog / Digital) conversion or the like on an electric signal input via a microphone provided in the vehicle VE. It is assumed that the voice information generated by the input unit 14 is a digital signal.
  • the output unit 15 is an interface for outputting data to the output device.
  • the output unit 15 converts the digital audio signal generated by the control unit 12 into an analog audio signal by D / A (Digital / Analog) conversion, and outputs the digital audio signal to the speaker.
  • the output unit 15 may output visual information such as an image or text generated by the control unit 12 to a display or the like provided in the vehicle VE.
  • the imaging unit 16 photographs the surroundings and the interior of the vehicle VE to generate an image.
  • the image pickup unit 16 is, for example, a camera.
  • the sensor unit 17 includes a GPS (Global Positioning System) sensor 171, a gyro sensor 172, a road surface detection sensor 173, a weather sensor 174, and a biological sensor 175. Each sensor generates data in a predetermined format based on the detected signal.
  • GPS Global Positioning System
  • the GPS sensor 171 receives radio waves including positioning data transmitted from the satellite and detects the current position of the vehicle VE.
  • the gyro sensor 172 detects the orientation and rotation of the vehicle VE.
  • the road surface detection sensor 173 detects a state such as unevenness of the road surface from the image of the road surface and the vibration of the vehicle VE.
  • the weather sensor 174 detects information on the weather such as humidity and temperature.
  • the biosensor 175 detects biometric information such as the occupant's heartbeat, pulse wave, respiration, body movement, and brain wave.
  • the biosensor 175 may be built in the seat of the vehicle VE, or may be a wearable device worn by the occupant.
  • the output unit 15 transmits the control signal from the control unit 12 to the drive system of the vehicle VE to realize automatic driving. Further, the control unit 12 can control the vehicle VE so as to travel according to the designated travel route. At least a destination is set for the traveling route.
  • the storage unit 13 stores the set travel route. The travel route may be manually input by the occupant, or may be automatically set by the vehicle control device 10 or the information processing device 20.
  • FIG. 3 is a block diagram showing a configuration example of the information processing device.
  • the information processing device 20 is, for example, a server. As shown in FIG. 3, the information processing device 20 includes a communication unit 21, a control unit 22, and a storage unit 23.
  • the communication unit 21 transmits and receives information to and from the information processing device 20 via the network NE under the control of the control unit 22.
  • the control unit 22 is realized by executing various programs stored in the storage unit 23 by a controller such as a CPU or MPU, and controls the operation of the entire information processing device 20.
  • the control unit 22 is not limited to the CPU and MPU, but may be realized by an integrated circuit such as an ASIC or FPGA.
  • the storage unit 23 stores various programs executed by the control unit 22, data necessary for executing processing by the control unit 22, and the like.
  • the control unit 22 includes an acquisition unit 221, an update unit 222, a posture detection unit 223, an operation determination unit 224, a route determination unit 225, a notification unit 226, and an agent control unit 227.
  • the acquisition unit 221 acquires information used in the processing of each unit of the control unit 22.
  • the acquisition unit 221 can acquire the data generated by the vehicle control device 10 via the communication unit 21.
  • the acquisition unit 221 acquires an image generated by the image pickup unit 16 of the vehicle control device 10.
  • the acquisition unit 221 can acquire the data generated by the sensor unit 17 of the vehicle control device 10.
  • the acquisition unit 221 can acquire road traffic information from an external server or the like via the communication unit 21.
  • Road traffic information such as traffic congestion information and traffic information acquired from the VICS (registered trademark, Vehicle Information Communication System) center.
  • the acquisition unit 221 acquires the current position detected by the GPS sensor 171 and the road traffic information of the destination of the set travel route.
  • the acquisition unit 221 acquires information on the travel route of the vehicle VE.
  • the vehicle VE is an example of a moving body.
  • the acquisition unit 221 acquires the traveling time until the vehicle arrives at the set destination.
  • the acquisition unit 221 acquires information on the type or shape of the traveling route until the arrival at the set destination.
  • the type of travel route includes whether or not it is an expressway.
  • the shape of the traveling route is represented by the degree of linearity. That is, the acquisition unit 221 acquires the degree of linearity of the shape of the traveling route.
  • the acquisition unit 221 can acquire information from the storage unit 23. For example, a series of operations determined by the operation determination unit 224, which will be described later, are stored in the storage unit 23. At this time, the acquisition unit 221 can acquire a series of operations determined by the operation determination unit 224 from the storage unit 23. That is, the acquisition unit 221 can acquire information on a series of operations performed by an occupant of the vehicle VE who is not driving.
  • whether or not the driver is driving may be determined not only by whether or not he / she is sitting in the driver's seat but also whether or not he / she is in automatic driving. For example, even if there is only one occupant and the vehicle is running, if the occupant is in automatic driving, it may be considered that the occupant is not driving. Further, in the present embodiment, the series of operations does not include operations related to driving such as steering wheel operation. Movements include those unrelated to driving, such as strength training.
  • the update unit 222 updates the data of each DB of the storage unit 23.
  • the data structure of each DB will be described later.
  • the posture detection unit 223 detects the posture of the occupant of the vehicle VE.
  • the posture of the occupant includes the posture taken by the occupant unconsciously.
  • the posture detection unit 223 detects the posture by skeleton detection.
  • the posture detection unit 223 detects the skeleton of the occupant of the vehicle VE included as a subject in the image acquired by the acquisition unit 221 by image recognition (image recognition using AI) using the learning model shown below. By doing so, the posture of the occupant is detected.
  • the learning model an image in which the position of the joint point of the person is labeled in advance with respect to the photographed image of the person is used as a teacher image, and the position of the joint point is machine-learned (for example, deep layer) based on the teacher image. It is a model obtained by learning (learning, etc.).
  • the operation determination unit 224 determines the recommended operation for the occupant of the vehicle VE who is not driving, according to the information acquired by the acquisition unit 221.
  • the motion determination unit 224 determines a series of motions in which predetermined motions are combined.
  • the operation determination unit 224 can determine the operation based on the transition of the traveling state of the vehicle VE.
  • the acquisition unit 221 acquires information on the transition of the traveling state of the vehicle VE until it arrives at the set destination. For example, the acquisition unit 221 acquires information from the sensor unit 17.
  • the acquisition unit 221 acquires from the sensor unit 17 the degree and frequency of acceleration / deceleration, the weather, the unevenness of the asphalt on the road surface, and the status of objects that move irregularly, such as surrounding pedestrians and manually driven automobiles. do. Further, the operation determination unit 224 estimates the transition of the traveling state based on the acquired information and determines a series of operations.
  • the operation determination unit 224 may make a comprehensive judgment from various acquired information, estimate whether the transition of the running state is deteriorated or improved, and determine a series of operations.
  • the deterioration is a mode of transition of the traveling state in which the stability of the posture of the occupant is lowered, and sudden acceleration / deceleration, sudden change of direction, shaking, vibration, slip, etc. are likely to occur.
  • the improvement is a mode of transition of the traveling state in which the stability of the posture of the occupant is improved, and sudden acceleration / deceleration, sudden change of direction, shaking, vibration, slip, etc. are less likely to occur.
  • the motion determination unit 224 determines the motion performed in the “sitting” posture in the case of deterioration, and determines the motion performed in the “standing” posture in the case of improvement.
  • Deterioration is thought to occur due to the high degree and frequency of acceleration and deceleration, the rainy weather, the large unevenness of the road surface, and the large number of pedestrians in the surrounding area.
  • improvement is a mode of transition of the running state so as to improve the stability of the posture of the occupant, that the degree and frequency of acceleration / deceleration are small, the weather is sunny or cloudy, and the road surface is uneven. It is thought to be caused by the small size and the small number of pedestrians around.
  • the route determination unit 225 determines the travel route of the vehicle VE according to the information acquired by the acquisition unit 221.
  • the notification unit 226 notifies the occupants of the vehicle VE of each information.
  • the notification unit 226 can notify information in the form of voice, image, text, or the like via the output unit 15 of the vehicle control device 10.
  • the notification unit 226 notifies the information regarding the operation determined by the operation determination unit 224.
  • the agent control unit 227 executes a program called an agent for exchanging information with the occupants.
  • the agent inputs and outputs information by having a pseudo conversation with the occupant.
  • the agent accepts voice or text input via the input unit 14.
  • the agent outputs voice or text via the output unit 15.
  • the storage unit 23 has an occupant DB 231 and a history DB 232 and an operation DB 233.
  • FIG. 4 is a diagram showing an example of the data structure of the occupant DB.
  • the occupant DB 231 stores the registered occupant information. As shown in FIG. 4, the occupant DB 231 stores the "occupant ID", "name”, “gender”, “age”, and "face image information”.
  • the "occupant ID” is an ID for identifying an occupant.
  • the "face image information” is a feature amount of the occupant's face image and the like, and is information used for recognizing the face image. For example, in the example of FIG. 4, it is shown that the name of the occupant whose occupant ID is "U001" is "Taro Yamada", the gender is "male”, and the age is "25".
  • FIG. 5 is a diagram showing an example of the data structure of the history DB.
  • the history DB 232 stores a history of a series of operations for each occupant.
  • a series of operations is called a menu.
  • the history DB 232 stores the “occupant ID”, the “date and time”, and the “menu”.
  • the occupant with the occupant ID "U001” carried out the menu "M001 ⁇ M002" at "2020/2/11 14:35”.
  • "M001" and "M002" are IDs for identifying individual operations included in the menu.
  • FIG. 6 is a diagram showing an example of the data structure of the operation DB.
  • the operation DB 233 stores information on each operation included in the menu.
  • the motion DB 233 stores the “motion ID”, the “name”, the “posture”, and the “part”.
  • the name of the operation whose operation ID is "M001” is "squat", which is performed in the "standing” posture, and is shown to be an operation related to "feet”.
  • the name of the operation whose operation ID is "M002” is "sit-up", which is performed in the "sitting" posture, and is shown to be an operation related to "belly”.
  • the information processing device 20 can determine the operation of notifying the occupant according to the shape of the traveling route.
  • the motion determination unit 224 corresponds to the motion performed in a standing state in the region where the linearity degree is equal to or higher than the predetermined value in the traveling route, and sits in the region where the linearity degree is not equal to or higher than the predetermined value.
  • the action is determined so that the action performed in the state corresponds to the action performed in the state.
  • FIG. 7 is a diagram showing an example of the shape of the route. As shown in FIG. 7, it is assumed that there are regions 311 and 312 having different road shape tendencies between the current location 31 (Start) and the destination 32 (Goal). Region 311 is composed of substantially straight lines. On the other hand, the region 312 is mostly composed of corners and curves. That is, it can be said that the region 312 has a larger degree of linearity than the region 311.
  • the information processing device 20 presents a menu that ensures the safety of the occupants and makes effective use of the travel time.
  • the operation “squat” is performed in the "standing” posture.
  • the movement “dumbbell” is performed in a “sitting” posture. Therefore, the operation determination unit 224 determines a menu for performing the operation "squat” while traveling in the area 311 and performing the operation "dumbbell” while traveling in the area 312. Then, the notification unit 226 notifies the occupant of the menu determined by the operation determination unit 224.
  • the operation determination unit 224 may determine the menu not only by the degree of linearity of the travel route but also by the type of the travel route. In this case, for example, if the traveling route is an expressway, there is little acceleration / deceleration or change of direction, so that the occupant can easily maintain a standing posture. Therefore, the motion determination unit 224 determines the motion to be performed in the "standing" posture if the traveling route is an expressway.
  • the operation determination unit 224 may determine the operation according to the change in the traveling condition until the vehicle arrives at the destination. For example, if it is expected that acceleration / deceleration will be repeated due to waiting for a traffic light or the like before arriving at the destination, it is difficult for the occupant to easily maintain a standing posture. Therefore, the motion determining unit 224 determines the motion performed in the “sitting” posture in the region where the frequency of acceleration / deceleration is expected to be a certain value or more.
  • the information processing device 20 may determine the traveling route according to the menu designated by the occupant.
  • the operation performed in the standing state corresponds to the region of the traveling route in which the degree of linearity is equal to or higher than a predetermined value
  • the operation performed in the sitting state is traveling.
  • the travel route is determined so as to correspond to the region of the route where the degree of linearity is not equal to or higher than a predetermined value.
  • the route determination unit 225 determines a travel route that travels in the region 311 for 5 minutes and travels in the region 312 for 10 minutes.
  • FIG. 8 is a diagram showing an example of a conversation between an agent and an occupant.
  • the agent 227a is an example of an agent executed by the agent control unit 227.
  • Agent 227a may be implemented by text or voice chat.
  • the agent 227a says, "You are a new person. Please tell me your name and the part you want to train.” Confirm that it is a new registration and acquire the occupant information. Then, the occupant inputs his / her own information to the agent 227a.
  • the update unit 222 stores the information acquired from the occupant via the agent 227a in the occupant DB 231.
  • FIG. 9 is a diagram showing an example of a conversation between an agent and an occupant.
  • the agent 227a suggests that the occupant has been registered as "Mr. Yamada, what do you do today?" And encourage the occupants to specify the menu.
  • the operation determination unit 224 determines the menu based on the travel route information.
  • FIG. 10 is a diagram showing an example of a conversation between an agent and an occupant.
  • the agent 227a notifies the occupant to change the menu because the vehicle speed changes.
  • the motion determination unit 224 determines the motion to be performed, for example, in the “sitting” posture.
  • FIG. 11 is a flowchart showing an example of the information processing method.
  • the process shown in FIG. 11 is an example of the process for confirming the registration of the occupant and for new registration, and is performed before the vehicle VE travels.
  • the acquisition unit 221 acquires and recognizes an image of the occupant's face (step S101). If the image of the occupant's face is already registered in the occupant DB 231 (step S102, Yes), the information processing apparatus 20 ends the process.
  • step S102 when the image of the occupant's face is not registered in the occupant DB 231 (step S102, No), the update unit 222 newly registers the occupant information acquired by the acquisition unit 221 in the occupant DB (step S103).
  • the acquisition unit 221 acquires the biometric information of the occupant (step S104). Then, the operation determination unit 224 determines the menu based on the acquired information (step S105). For example, the motion determination unit 224 determines a menu for first taking a break when the occupant's heart rate is equal to or higher than a predetermined value. In that case, the notification unit 226 utters, "Because the heart rate is rising, let's take a break for the first 5 minutes.” The update unit 222 saves the menu determined by the operation determination unit 224 in the history DB 232 (step S106).
  • FIG. 12 is a flowchart showing an example of an information processing method.
  • the process shown in FIG. 12 is an example of the process performed by the information processing device 20 when the occupant specifies the menu by himself / herself.
  • the acquisition unit 221 acquires the input information (step S201).
  • the entered information is information about the menu specified by the occupant.
  • the acquisition unit 221 acquires the occupant information from the occupant DB 231 (step S202). Further, the acquisition unit 221 acquires information from the sensor unit 17 (step S203). The operation determination unit 224 determines the menu based on the information acquired by the acquisition unit 221 (step S204). Then, the update unit 222 saves the menu determined by the operation determination unit 224 in the history DB 232 (step S205).
  • the route determination unit 225 determines the travel route based on the menu determined by the operation determination unit 224 (step S206).
  • the notification unit 226 notifies the menu determined by the operation determination unit 224 (step S207).
  • the operation determination unit 224 may simply pass the information regarding the specified menu to the update unit 222. Further, as shown in FIG. 8, it may be vaguely specified as "I want to train my legs". In that case, the motion determination unit 224 determines one of the motions whose portion is the "foot" in the motion DB 233, for example.
  • FIG. 13 is a flowchart showing an example of an information processing method.
  • the process shown in FIG. 13 is an example of the process performed by the information processing device 20 when the occupant does not specify the menu.
  • the acquisition unit 221 acquires the information of the route to the destination (step S301).
  • the operation determination unit 224 determines the menu based on the information acquired by the acquisition unit 221 (step S302).
  • the update unit 222 saves the menu determined by the operation determination unit 224 in the history DB 232 (step S303).
  • the notification unit 226 notifies the menu determined by the operation determination unit 224 (step S304).
  • the acquisition unit 221 acquires information regarding the travel route of the vehicle VE. Further, the operation determination unit 224 determines the recommended operation for the occupant of the vehicle VE and not in operation according to the information acquired by the acquisition unit 221. In addition, the notification unit 226 notifies the information regarding the operation determined by the operation determination unit 224. As a result, the occupant can determine the operation according to the traveling route without designating himself / herself, and can be notified of the operation suitable for the traveling route. As described above, according to the present embodiment, it is possible to propose efficient use of travel time.
  • the motion determination unit 224 determines a series of motions in which predetermined motions are combined. In this way, the condition of the traveling route changes with the passage of time during traveling. On the other hand, according to the present embodiment, it is possible to propose a combination of operations adapted to changes in the traveling route.
  • the acquisition unit 221 acquires the traveling time until it arrives at the set destination. Therefore, according to the present embodiment, it is possible to propose including the execution time of each operation.
  • the acquisition unit 221 acquires information on the type or shape of the travel route until it arrives at the set destination. It is considered that the suitable operation differs depending on the type and shape of the traveling route. On the other hand, according to the present embodiment, it is possible to propose including the execution time of each operation.
  • the acquisition unit 221 acquires the degree of linearity of the shape of the traveling route.
  • the posture that the occupant can take differs depending on the shape of the traveling route.
  • the motion determination unit 224 corresponds to the motion performed in a standing state in the region where the linearity degree is equal to or higher than the predetermined value in the traveling route, and sits in the region where the linearity degree is not equal to or higher than the predetermined value. Determine the action so that it corresponds to the action taken in. For example, on a road with many straight lines, the occupant can perform a standing motion. On the other hand, on a road with many curves, it is difficult for the occupant to perform a standing motion. On the other hand, according to the present embodiment, it is possible to propose the operation after ensuring the safety of the occupants.
  • the acquisition unit 221 acquires information on the transition of the traveling state of the vehicle VE until it arrives at the set destination.
  • the running state may change depending on the frequency of acceleration / deceleration, weather, road surface conditions, surrounding moving objects, and the like.
  • the acquisition unit 221 acquires information on a series of operations performed by an occupant of the vehicle VE who is not driving. Further, the route determination unit 225 determines the travel route of the vehicle VE according to the information acquired by the acquisition unit 221. As described above, according to the present embodiment, the moving body can be traveled on a route suitable for the movement desired by the occupant.
  • the operation performed in the standing state corresponds to the region of the traveling route in which the degree of linearity is equal to or higher than a predetermined value
  • the operation performed in the sitting state is the traveling route.
  • the traveling route is determined so as to correspond to the region where the degree of linearity is not equal to or higher than the predetermined value. As described above, according to the present embodiment, it is possible to determine a traveling route that matches the movement desired by the occupant and ensures the safety of the occupant.
  • the present invention is not limited to the embodiments described so far.
  • various actions can be considered in addition to those given as examples so far.
  • movements include not only exercises such as dancing and stretching, but also all physical movements such as eating and changing clothes.
  • the information processing device 20 stores in what posture the movements are performed and for what purpose, and combines the movements according to the traveling route. A series of operations, that is, a menu is determined.
  • the information processing device 20 can determine the action of wearing trousers on a straight road and the action of wearing a shirt on a road having many curves.
  • Information processing system 10 Vehicle control device 11, 21 Communication unit 12, 22 Control unit 13, 23 Storage unit 14 Input unit 15 Output unit 16 Imaging unit 17 Sensor unit 20 Information processing device 31 Current location 32 Destination 171 GPS sensor 172 Gyro sensor 173 Road surface detection sensor 174 Weather sensor 175 Biological sensor 221 Acquisition unit 222 Update unit 223 Attitude detection unit 224 Motion determination unit 225 Route determination unit 226 Notification unit 227 Agent control unit 227a Agent 231 Crew member DB 232 history DB 233 Operation DB 311, 312 Area VE Vehicle NE Network

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Automation & Control Theory (AREA)
  • Navigation (AREA)

Abstract

An acquisition unit (221) acquires information relating to a traveling route of a vehicle (VE). A motion determination unit (224) determines a motion to be recommended to an occupant that is an occupant of the vehicle (VE) and is not driving according to the information acquired by the acquisition unit (221). A notification unit (226) notifies the information relating to the motion determined by the motion determination unit (224).

Description

情報処理装置、情報処理方法、情報処理プログラム及び記憶媒体Information processing equipment, information processing methods, information processing programs and storage media
　本発明は、情報処理装置、情報処理方法、情報処理プログラム及び記憶媒体に関する。 The present invention relates to an information processing device, an information processing method, an information processing program, and a storage medium.
　従来、自動運転機能を備え、低床、箱型デザインによる広大な室内空間を持ち、様々なサービスに応じた設備を搭載可能な自動車が提案されている（例えば、非特許文献１を参照）。 Conventionally, an automobile having an automatic driving function, a low floor, a vast interior space with a box-shaped design, and being able to be equipped with equipment corresponding to various services has been proposed (see, for example, Non-Patent Document 1).
　しかしながら、従来の技術では、乗員が移動時間を効率的に利用できない場合があるという問題がある。例えば、目的地まで自動運転で移動する間、乗員は運転に関する操作を行う必要がなくなる場合があるが、その移動中の時間及び広大な室内空間を有効活用できないことがある。 However, with the conventional technology, there is a problem that the occupant may not be able to use the travel time efficiently. For example, while traveling to a destination by automatic driving, the occupant may not need to perform operations related to driving, but the time during the movement and the vast interior space may not be effectively utilized.
　本発明は、上記に鑑みてなされたものであって、移動時間の効率的な利用を提案できる情報処理装置、情報処理方法、情報処理プログラム及び記憶媒体を提供することを目的とする。 The present invention has been made in view of the above, and an object of the present invention is to provide an information processing device, an information processing method, an information processing program, and a storage medium that can propose efficient use of travel time.
　請求項１に記載の情報処理装置は、移動体の走行ルートに関する情報を取得する取得部と、前記取得部によって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定部と、前記動作決定部によって決定された動作に関する情報を通知する通知部と、を有することを特徴とする。 The information processing device according to claim 1 is for an acquisition unit that acquires information on a traveling route of a moving body and an occupant who is a occupant of the moving body and is not in operation according to the information acquired by the acquisition unit. It is characterized by having an operation determining unit for determining a recommended operation and a notification unit for notifying information on the operation determined by the operation determining unit.
　請求項７に記載の情報処理方法は、情報処理装置が実行する情報処理方法であって、移動体の走行ルートに関する情報を取得する取得ステップと、前記取得ステップによって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定ステップと、前記動作決定ステップによって決定された動作に関する情報を通知する通知ステップと、を含むことを特徴とする。 The information processing method according to claim 7 is an information processing method executed by an information processing apparatus, and is based on an acquisition step of acquiring information on a traveling route of a moving body and information acquired by the acquisition step. It is characterized by including an operation determination step for determining a recommended operation for an occupant of the moving body who is not in operation, and a notification step for notifying information about the operation determined by the operation determination step.
　請求項８に記載の情報処理プログラムは、移動体の走行ルートに関する情報を取得する取得ステップと、前記取得ステップによって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定ステップと、前記動作決定ステップによって決定された動作に関する情報を通知する通知ステップと、をコンピュータに実行させる。 The information processing program according to claim 8 applies to an acquisition step for acquiring information on a traveling route of a moving body and an occupant who is a occupant of the moving body and is not driving according to the information acquired by the acquisition step. The computer is made to execute an operation determination step for determining a recommended operation and a notification step for notifying information about the operation determined by the operation determination step.
　請求項９に記載の記憶媒体は、移動体の走行ルートに関する情報を取得する取得ステップと、前記取得ステップによって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定ステップと、前記動作決定ステップによって決定された動作に関する情報を通知する通知ステップと、をコンピュータに実行させるための情報処理プログラムを記憶したことを特徴とする。 The storage medium according to claim 9 is recommended for an acquisition step for acquiring information on a traveling route of a moving object and for an occupant who is an occupant of the moving object and is not in operation according to the information acquired by the acquisition step. It is characterized in that it stores an information processing program for causing a computer to execute an operation determination step for determining an operation to be performed and a notification step for notifying information about an operation determined by the operation determination step.
　請求項１０に記載の情報処理装置は、移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得部と、前記取得部によって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定部と、を有することを特徴とする。 The information processing apparatus according to claim 10 is the acquisition unit that acquires information on a series of operations performed by an occupant who is a mobile occupant and is not in operation, and the information processing device according to the information acquired by the acquisition unit. It is characterized by having a route determining unit for determining a traveling route of a moving body.
　請求項１２に記載の情報処理方法は、情報処理装置が実行する情報処理方法であって、移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得ステップと、前記取得ステップによって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定ステップと、を含むことを特徴とする。 The information processing method according to claim 12 is an information processing method executed by an information processing apparatus, which includes an acquisition step of acquiring information on a series of operations performed by a moving occupant who is not in operation. It is characterized by including a route determination step for determining a traveling route of the moving body according to the information acquired by the acquisition step.
　請求項１３に記載の情報処理プログラムは、移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得ステップと、前記取得ステップによって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定ステップと、をコンピュータに実行させる。 The information processing program according to claim 13 is described in accordance with an acquisition step of acquiring information regarding a series of operations performed by a moving occupant who is not driving, and information acquired by the acquisition step. Have the computer perform a route determination step that determines the travel route of the moving object.
　請求項１４に記載の記憶媒体は、移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得ステップと、前記取得ステップによって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定ステップと、をコンピュータに実行させるための情報処理プログラムを記憶したことを特徴とする。 The storage medium according to claim 14 has an acquisition step of acquiring information about a series of operations performed by a moving occupant who is not in operation, and the movement according to the information acquired by the acquisition step. It is characterized by storing an information processing program for causing a computer to execute a route determination step for determining a traveling route of a body.
図１は、実施の形態に係る情報処理システムの構成を示すブロック図である。FIG. 1 is a block diagram showing a configuration of an information processing system according to an embodiment. 図２は、車両制御装置の構成例を示すブロック図である。FIG. 2 is a block diagram showing a configuration example of the vehicle control device. 図３は、情報処理装置の構成例を示すブロック図である。FIG. 3 is a block diagram showing a configuration example of the information processing device. 図４は、乗員ＤＢのデータ構造の例を示す図である。FIG. 4 is a diagram showing an example of the data structure of the occupant DB. 図５は、履歴ＤＢのデータ構造の例を示す図である。FIG. 5 is a diagram showing an example of the data structure of the history DB. 図６は、動作ＤＢのデータ構造の例を示す図である。FIG. 6 is a diagram showing an example of the data structure of the operation DB. 図７は、ルートの形状の例を示す図である。FIG. 7 is a diagram showing an example of the shape of the route. 図８は、エージェントと乗員との間の会話の例を示す図である。FIG. 8 is a diagram showing an example of a conversation between an agent and an occupant. 図９は、エージェントと乗員との間の会話の例を示す図である。FIG. 9 is a diagram showing an example of a conversation between an agent and an occupant. 図１０は、エージェントと乗員との間の会話の例を示す図である。FIG. 10 is a diagram showing an example of a conversation between an agent and an occupant. 図１１は、情報処理方法の例を示すフローチャートである。FIG. 11 is a flowchart showing an example of the information processing method. 図１２は、情報処理方法の例を示すフローチャートである。FIG. 12 is a flowchart showing an example of the information processing method. 図１３は、情報処理方法の例を示すフローチャートである。FIG. 13 is a flowchart showing an example of the information processing method.
　以下に、図面を参照しつつ、本発明を実施するための形態（以下、実施の形態）について説明する。なお、以下に説明する実施の形態によって本発明が限定されるものではない。さらに、図面の記載において、同一の部分には同一の符号を付している。 Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as embodiments) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. Further, in the description of the drawings, the same parts are designated by the same reference numerals.
　〔情報処理システムの概略構成〕
　図１は、実施の形態に係る情報処理システムの構成を示すブロック図である。情報処理システム１は、移動体である車両ＶＥの移動に関する情報を基に、車両ＶＥの乗員に動作に関する情報を提供する。また、情報処理システム１は、乗員の動作に応じて車両ＶＥを制御する。なお、本実施の形態における車両ＶＥは、非特許文献１に記載されているような広大な室内空間を持つ車両であるものとする。 [Outline configuration of information processing system]
FIG. 1 is a block diagram showing a configuration of an information processing system according to an embodiment. The information processing system 1 provides the occupants of the vehicle VE with information on the operation based on the information on the movement of the vehicle VE which is a moving body. Further, the information processing system 1 controls the vehicle VE according to the movement of the occupant. The vehicle VE in the present embodiment is assumed to be a vehicle having a vast interior space as described in Non-Patent Document 1.
　情報処理システム１は、図１に示すように、車両制御装置１０と、情報処理装置２０とを備える。また、車両制御装置１０及び情報処理装置２０は、ネットワークＮＥを介して通信可能に接続されている。ネットワークＮＥは、例えばインターネットである。 As shown in FIG. 1, the information processing system 1 includes a vehicle control device 10 and an information processing device 20. Further, the vehicle control device 10 and the information processing device 20 are communicably connected via the network NE. The network NE is, for example, the Internet.
　なお、情報処理システム１に含まれる情報処理装置２０及び車両ＶＥの数は、図１に示すものに限られない。例えば、情報処理装置２０は、複数の車両ＶＥのそれぞれに備えられた車両制御装置１０と接続されていてもよい。 The number of information processing devices 20 and vehicle VEs included in the information processing system 1 is not limited to that shown in FIG. For example, the information processing device 20 may be connected to a vehicle control device 10 provided in each of the plurality of vehicle VEs.
［車両制御装置の構成］
　図２は、車両制御装置の構成例を示すブロック図である。車両制御装置１０は、例えば、ＥＣＵ（Engine　Control　Unit）としての機能を備えたコンピュータである。また、車両制御装置１０は、例えば、車両ＶＥに設置される据え置き型のナビゲーション装置又はドライブレコーダであってもよい。また、車両制御装置１０は、据え置き型の装置と乗員が利用するスマートフォン等の端末装置を組み合わせて実現されるシステムであってもよい。図２に示すように、車両制御装置１０は、通信部１１、制御部１２、記憶部１３、入力部１４、出力部１５、撮像部１６、センサ部１７を有する。 [Vehicle control device configuration]
FIG. 2 is a block diagram showing a configuration example of the vehicle control device. The vehicle control device 10 is, for example, a computer having a function as an ECU (Engine Control Unit). Further, the vehicle control device 10 may be, for example, a stationary navigation device or a drive recorder installed in the vehicle VE. Further, the vehicle control device 10 may be a system realized by combining a stationary device and a terminal device such as a smartphone used by an occupant. As shown in FIG. 2, the vehicle control device 10 includes a communication unit 11, a control unit 12, a storage unit 13, an input unit 14, an output unit 15, an imaging unit 16, and a sensor unit 17.
　通信部１１は、制御部１２による制御の下、ネットワークＮＥを介して情報処理装置２０との間で情報の送受信を行う。 The communication unit 11 transmits and receives information to and from the information processing device 20 via the network NE under the control of the control unit 12.
　制御部１２は、ＣＰＵ（Central　Processing　Unit）やＭＰＵ（Micro　Processing　Unit）等のコントローラによって、記憶部１３に記憶された各種プログラムが実行されることにより実現され、車両制御装置１０全体の動作を制御する。なお、制御部１２は、ＣＰＵやＭＰＵに限らず、ＡＳＩＣ（Application　Specific　Integrated　Circuit）やＦＰＧＡ（Field　Programmable　Gate　Array）等の集積回路によって実現されてもよい。 The control unit 12 is realized by executing various programs stored in the storage unit 13 by a controller such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and controls the operation of the entire vehicle control device 10. do. The control unit 12 is not limited to the CPU and MPU, but may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
　記憶部１３は、制御部１２が実行する各種のプログラムや、制御部１２による処理の実行に必要なデータ等を記憶する。 The storage unit 13 stores various programs executed by the control unit 12, data necessary for executing processing by the control unit 12, and the like.
　入力部１４は、入力装置を介してデータの入力を受け付けるためのインタフェースである。入力部１４は、テキスト及び音声等により入力を受け付けることができる。本実施の形態では、入力部１４は、音声による入力を受け付けるものとする。入力部１４は、車両ＶＥに備えられたマイクロフォンを介して入力された電気信号にＡ／Ｄ（Analog／Digital）変換等を行うことにより音声情報を生成する。入力部１４にて生成された音声情報は、デジタル信号であるものとする。 The input unit 14 is an interface for receiving data input via an input device. The input unit 14 can accept input by text, voice, or the like. In the present embodiment, the input unit 14 receives an input by voice. The input unit 14 generates voice information by performing A / D (Analog / Digital) conversion or the like on an electric signal input via a microphone provided in the vehicle VE. It is assumed that the voice information generated by the input unit 14 is a digital signal.
　出力部１５は、出力装置に対してデータを出力するためのインタフェースである。例えば、出力部１５は、制御部１２によって生成されたデジタルの音声信号をＤ／Ａ（Digital／Analog）変換によってアナログの音声信号に変換し、スピーカに対して出力する。また、出力部１５は、制御部１２によって生成された画像やテキスト等の視覚的情報を車両ＶＥに備えられたディスプレイ等に出力してもよい。 The output unit 15 is an interface for outputting data to the output device. For example, the output unit 15 converts the digital audio signal generated by the control unit 12 into an analog audio signal by D / A (Digital / Analog) conversion, and outputs the digital audio signal to the speaker. Further, the output unit 15 may output visual information such as an image or text generated by the control unit 12 to a display or the like provided in the vehicle VE.
　撮像部１６は、車両ＶＥの周囲及び室内を撮影し画像を生成する。撮像部１６は、例えばカメラである。 The imaging unit 16 photographs the surroundings and the interior of the vehicle VE to generate an image. The image pickup unit 16 is, for example, a camera.
　センサ部１７は、図２に示すように、ＧＰＳ（Global　Positioning　System）センサ１７１、ジャイロセンサ１７２、路面検出センサ１７３、天候センサ１７４、生体センサ１７５を有する。各センサは、検出した信号を基に所定の形式のデータを生成する。 As shown in FIG. 2, the sensor unit 17 includes a GPS (Global Positioning System) sensor 171, a gyro sensor 172, a road surface detection sensor 173, a weather sensor 174, and a biological sensor 175. Each sensor generates data in a predetermined format based on the detected signal.
　ＧＰＳセンサ１７１は、衛星から送信された測位用データを含む電波を受信し、車両ＶＥの現在の位置を検出する。ジャイロセンサ１７２は、車両ＶＥの向きや回転を検出する。また、路面検出センサ１７３は、路面の画像や車両ＶＥの振動から、路面の凹凸等の状態を検出する。また、天候センサ１７４は、湿度や温度等の天候に関する情報を検出する。また、生体センサ１７５は、乗員の心拍、脈波、呼吸、体動、及び脳波等の生体情報を検出する。生体センサ１７５は、車両ＶＥの座席に内蔵されるものであってもよいし、乗員が身に着けるウェアラブル機器であってもよい。 The GPS sensor 171 receives radio waves including positioning data transmitted from the satellite and detects the current position of the vehicle VE. The gyro sensor 172 detects the orientation and rotation of the vehicle VE. Further, the road surface detection sensor 173 detects a state such as unevenness of the road surface from the image of the road surface and the vibration of the vehicle VE. Further, the weather sensor 174 detects information on the weather such as humidity and temperature. In addition, the biosensor 175 detects biometric information such as the occupant's heartbeat, pulse wave, respiration, body movement, and brain wave. The biosensor 175 may be built in the seat of the vehicle VE, or may be a wearable device worn by the occupant.
　ここで、出力部１５は、制御部１２による制御信号を車両ＶＥの駆動系に伝達し自動運転を実現する。また、制御部１２は、指定された走行ルートに従って走行するように車両ＶＥを制御することができる。走行ルートには、少なくとも目的地が設定される。記憶部１３は、設定された走行ルートを記憶する。走行ルートは、乗員が手動で入力したものであってもよいし、車両制御装置１０又は情報処理装置２０により自動的に設定されたものであってもよい。 Here, the output unit 15 transmits the control signal from the control unit 12 to the drive system of the vehicle VE to realize automatic driving. Further, the control unit 12 can control the vehicle VE so as to travel according to the designated travel route. At least a destination is set for the traveling route. The storage unit 13 stores the set travel route. The travel route may be manually input by the occupant, or may be automatically set by the vehicle control device 10 or the information processing device 20.
［情報処理装置の構成］
　図３は、情報処理装置の構成例を示すブロック図である。情報処理装置２０は、例えばサーバである。図３に示すように、情報処理装置２０は、通信部２１、制御部２２、記憶部２３を有する。 [Configuration of information processing device]
FIG. 3 is a block diagram showing a configuration example of the information processing device. The information processing device 20 is, for example, a server. As shown in FIG. 3, the information processing device 20 includes a communication unit 21, a control unit 22, and a storage unit 23.
　通信部２１は、制御部２２による制御の下、ネットワークＮＥを介して情報処理装置２０との間で情報の送受信を行う。 The communication unit 21 transmits and receives information to and from the information processing device 20 via the network NE under the control of the control unit 22.
　制御部２２は、ＣＰＵやＭＰＵ等のコントローラによって、記憶部２３に記憶された各種プログラムが実行されることにより実現され、情報処理装置２０全体の動作を制御する。なお、制御部２２は、ＣＰＵやＭＰＵに限らず、ＡＳＩＣやＦＰＧＡ等の集積回路によって実現されてもよい。 The control unit 22 is realized by executing various programs stored in the storage unit 23 by a controller such as a CPU or MPU, and controls the operation of the entire information processing device 20. The control unit 22 is not limited to the CPU and MPU, but may be realized by an integrated circuit such as an ASIC or FPGA.
　記憶部２３は、制御部２２が実行する各種のプログラムや、制御部２２による処理の実行に必要なデータ等を記憶する。制御部２２は、取得部２２１、更新部２２２、姿勢検出部２２３、動作決定部２２４、ルート決定部２２５、通知部２２６及びエージェント制御部２２７を有する。 The storage unit 23 stores various programs executed by the control unit 22, data necessary for executing processing by the control unit 22, and the like. The control unit 22 includes an acquisition unit 221, an update unit 222, a posture detection unit 223, an operation determination unit 224, a route determination unit 225, a notification unit 226, and an agent control unit 227.
　取得部２２１は、制御部２２の各部の処理で使用される情報を取得する。取得部２２１は、通信部２１を介して、車両制御装置１０によって生成されるデータを取得することができる。例えば、取得部２２１は、車両制御装置１０の撮像部１６で生成された画像を取得する。また、例えば、取得部２２１は、車両制御装置１０のセンサ部１７で生成されたデータを取得することができる。 The acquisition unit 221 acquires information used in the processing of each unit of the control unit 22. The acquisition unit 221 can acquire the data generated by the vehicle control device 10 via the communication unit 21. For example, the acquisition unit 221 acquires an image generated by the image pickup unit 16 of the vehicle control device 10. Further, for example, the acquisition unit 221 can acquire the data generated by the sensor unit 17 of the vehicle control device 10.
　さらに、取得部２２１は、通信部２１を介して、外部のサーバ等から道路交通情報を取得することができる。ＶＩＣＳ（登録商標、Vehicle　Information　Communication　System）センタから取得する渋滞情報や交通情報等の道路交通情報である。特に、取得部２２１は、ＧＰＳセンサ１７１によって検出された現在の位置及び、設定された走行ルートの目的地の道路交通情報を取得する。 Further, the acquisition unit 221 can acquire road traffic information from an external server or the like via the communication unit 21. Road traffic information such as traffic congestion information and traffic information acquired from the VICS (registered trademark, Vehicle Information Communication System) center. In particular, the acquisition unit 221 acquires the current position detected by the GPS sensor 171 and the road traffic information of the destination of the set travel route.
　取得部２２１は、車両ＶＥの走行ルートに関する情報を取得する。なお、車両ＶＥは移動体の一例である。例えば、取得部２２１は、設定された目的地に到着するまでの走行時間を取得する。また、例えば、取得部２２１は、設定された目的地に到着するまでの走行ルートの種別又は形状に関する情報を取得する。走行ルートの種別には、高速道路であるか否か等が含まれる。また、例えば、走行ルートの形状は、線形度合いによって表される。つまり、取得部２２１は、走行ルートの形状の線形度合いを取得する。 The acquisition unit 221 acquires information on the travel route of the vehicle VE. The vehicle VE is an example of a moving body. For example, the acquisition unit 221 acquires the traveling time until the vehicle arrives at the set destination. Further, for example, the acquisition unit 221 acquires information on the type or shape of the traveling route until the arrival at the set destination. The type of travel route includes whether or not it is an expressway. Further, for example, the shape of the traveling route is represented by the degree of linearity. That is, the acquisition unit 221 acquires the degree of linearity of the shape of the traveling route.
　さらに、取得部２２１は、記憶部２３から情報を取得することができる。例えば、後述する動作決定部２２４によって決定された一連の動作は、記憶部２３に記憶される。このとき、取得部２２１は、動作決定部２２４によって決定された一連の動作を記憶部２３から取得することができる。つまり、取得部２２１は、車両ＶＥの乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得することができる。 Further, the acquisition unit 221 can acquire information from the storage unit 23. For example, a series of operations determined by the operation determination unit 224, which will be described later, are stored in the storage unit 23. At this time, the acquisition unit 221 can acquire a series of operations determined by the operation determination unit 224 from the storage unit 23. That is, the acquisition unit 221 can acquire information on a series of operations performed by an occupant of the vehicle VE who is not driving.
　ここで、運転中であるか否かは、運転席に座っているか否かだけでなく、自動運転中であるか否かによって決まるものであってもよい。例えば、乗員が一人でかつ車両が走行中であっても、自動運転中であれば、その乗員は運転中でないとみなせる場合がある。また、本実施の形態では、一連の動作には、例えばハンドル操作のような運転に関する操作は含まれないものとする。動作には、筋力トレーニングのような運転と無関係なものが含まれる。 Here, whether or not the driver is driving may be determined not only by whether or not he / she is sitting in the driver's seat but also whether or not he / she is in automatic driving. For example, even if there is only one occupant and the vehicle is running, if the occupant is in automatic driving, it may be considered that the occupant is not driving. Further, in the present embodiment, the series of operations does not include operations related to driving such as steering wheel operation. Movements include those unrelated to driving, such as strength training.
　更新部２２２は、記憶部２３の各ＤＢのデータの更新を行う。各ＤＢのデータ構成については後述する。 The update unit 222 updates the data of each DB of the storage unit 23. The data structure of each DB will be described later.
　姿勢検出部２２３は、車両ＶＥの乗員の姿勢を検出する。当該乗員の姿勢は、当該乗員が無意識にとった姿勢を含む。本実施の形態では、姿勢検出部２２３は、骨格検知により当該姿勢を検出する。 The posture detection unit 223 detects the posture of the occupant of the vehicle VE. The posture of the occupant includes the posture taken by the occupant unconsciously. In the present embodiment, the posture detection unit 223 detects the posture by skeleton detection.
　例えば、姿勢検出部２２３は、以下に示す学習モデルを用いた画像認識（ＡＩを用いた画像認識）により、取得部２２１によって取得された画像内に被写体として含まれる車両ＶＥの乗員の骨格を検知することで当該乗員の姿勢を検出する。当該学習モデルは、人が撮影された撮影画像に対して当該人の関節点の位置があらかじめラベリングされた画像を教師画像とし、当該教師画像に基づいて当該関節点の位置を機械学習（例えば深層学習等）することにより得られたモデルである。 For example, the posture detection unit 223 detects the skeleton of the occupant of the vehicle VE included as a subject in the image acquired by the acquisition unit 221 by image recognition (image recognition using AI) using the learning model shown below. By doing so, the posture of the occupant is detected. In the learning model, an image in which the position of the joint point of the person is labeled in advance with respect to the photographed image of the person is used as a teacher image, and the position of the joint point is machine-learned (for example, deep layer) based on the teacher image. It is a model obtained by learning (learning, etc.).
　動作決定部２２４は、取得部２２１によって取得された情報に応じて、車両ＶＥの乗員であって運転中でない乗員に推奨する動作を決定する。動作決定部２２４は、あらかじめ定められた動作を組み合わせた一連の動作を決定する。 The operation determination unit 224 determines the recommended operation for the occupant of the vehicle VE who is not driving, according to the information acquired by the acquisition unit 221. The motion determination unit 224 determines a series of motions in which predetermined motions are combined.
　ここで、動作決定部２２４は、車両ＶＥの走行状態の推移を基に動作を決定することができる。このとき、取得部２２１は、設定された目的地に到着するまでの車両ＶＥの走行状態の推移に関する情報を取得する。例えば、取得部２２１は、センサ部１７からの情報を取得する。 Here, the operation determination unit 224 can determine the operation based on the transition of the traveling state of the vehicle VE. At this time, the acquisition unit 221 acquires information on the transition of the traveling state of the vehicle VE until it arrives at the set destination. For example, the acquisition unit 221 acquires information from the sensor unit 17.
　例えば、取得部２２１は、センサ部１７から、加減速の度合い及び発生頻度、天候、路面のアスファルトの凹凸、周囲の歩行者や手動運転の自動車等の不規則な動きをする物体の状況を取得する。さらに、動作決定部２２４は、取得した情報を基に走行状態の推移を推定し、一連の動作を決定する。 For example, the acquisition unit 221 acquires from the sensor unit 17 the degree and frequency of acceleration / deceleration, the weather, the unevenness of the asphalt on the road surface, and the status of objects that move irregularly, such as surrounding pedestrians and manually driven automobiles. do. Further, the operation determination unit 224 estimates the transition of the traveling state based on the acquired information and determines a series of operations.
　例えば、動作決定部２２４は、取得した各種の情報から総合的な判定を行い、走行状態の推移が悪化、良化のいずれであるかを推定し、一連の動作を決定してもよい。なお、悪化は、乗員の姿勢の安定性が低下するような走行状態の推移の態様であり、急な加減速、急な方向転換、揺れや振動、スリップ等が発生しやすくなる。逆に、良化は、乗員の姿勢の安定性が向上するような走行状態の推移の態様であり、急な加減速、急な方向転換、揺れや振動、スリップ等が発生しにくくなる。例えば、動作決定部２２４は、悪化の場合は「座り」の姿勢で行われる動作を決定し、良化の場合は「立ち」の姿勢で行われる動作を決定する。 For example, the operation determination unit 224 may make a comprehensive judgment from various acquired information, estimate whether the transition of the running state is deteriorated or improved, and determine a series of operations. The deterioration is a mode of transition of the traveling state in which the stability of the posture of the occupant is lowered, and sudden acceleration / deceleration, sudden change of direction, shaking, vibration, slip, etc. are likely to occur. On the contrary, the improvement is a mode of transition of the traveling state in which the stability of the posture of the occupant is improved, and sudden acceleration / deceleration, sudden change of direction, shaking, vibration, slip, etc. are less likely to occur. For example, the motion determination unit 224 determines the motion performed in the “sitting” posture in the case of deterioration, and determines the motion performed in the “standing” posture in the case of improvement.
　悪化は、加減速の度合い及び頻度が大きいこと、天候が雨であること、路面の凹凸が大きいこと、周囲に歩行者が多いこと等により起こると考えられる。逆に、良化は、乗員の姿勢の安定性が向上するような走行状態の推移の態様であり、加減速の度合い及び頻度が小さいこと、天候が晴れ又は曇りであること、路面の凹凸が小さいこと、周囲に歩行者が少ないこと等により起こると考えられる。 Deterioration is thought to occur due to the high degree and frequency of acceleration and deceleration, the rainy weather, the large unevenness of the road surface, and the large number of pedestrians in the surrounding area. On the contrary, improvement is a mode of transition of the running state so as to improve the stability of the posture of the occupant, that the degree and frequency of acceleration / deceleration are small, the weather is sunny or cloudy, and the road surface is uneven. It is thought to be caused by the small size and the small number of pedestrians around.
　ルート決定部２２５は、取得部２２１によって取得された情報に応じて、車両ＶＥの走行ルートを決定する。 The route determination unit 225 determines the travel route of the vehicle VE according to the information acquired by the acquisition unit 221.
　通知部２２６は、車両ＶＥの乗員に対し、各情報を通知する。例えば、通知部２２６は、車両制御装置１０の出力部１５を介して、情報を、音声、画像、テキスト等の形式で通知することができる。例えば、通知部２２６は、動作決定部２２４によって決定された動作に関する情報を通知する。 The notification unit 226 notifies the occupants of the vehicle VE of each information. For example, the notification unit 226 can notify information in the form of voice, image, text, or the like via the output unit 15 of the vehicle control device 10. For example, the notification unit 226 notifies the information regarding the operation determined by the operation determination unit 224.
　エージェント制御部２２７は、乗員との間で情報のやり取りを行うためのエージェントと呼ばれるプログラムを実行する。エージェントは、乗員との間で擬似的な会話を行うことにより情報の入出力を行う。例えば、エージェントは、入力部１４を介して、音声やテキストの入力を受け付ける。また、エージェントは、出力部１５を介して、音声やテキストを出力する。 The agent control unit 227 executes a program called an agent for exchanging information with the occupants. The agent inputs and outputs information by having a pseudo conversation with the occupant. For example, the agent accepts voice or text input via the input unit 14. In addition, the agent outputs voice or text via the output unit 15.
　記憶部２３は、乗員ＤＢ２３１、履歴ＤＢ２３２及び動作ＤＢ２３３を有する。 The storage unit 23 has an occupant DB 231 and a history DB 232 and an operation DB 233.
　図４は、乗員ＤＢのデータ構造の例を示す図である。乗員ＤＢ２３１は、登録された乗員の情報を記憶する。図４に示すように、乗員ＤＢ２３１は、「乗員ＩＤ」、「氏名」、「性別」、「年齢」及び「顔画像情報」を記憶する。「乗員ＩＤ」は、乗員を識別するためのＩＤである。また、「顔画像情報」は、乗員の顔画像の特徴量等であり、顔画像の認識に使われる情報である。例えば、図４の例では、乗員ＩＤが「Ｕ００１」の乗員の氏名が「山田太郎」であり、性別が「男」であり、年齢が「２５」であることが示されている。 FIG. 4 is a diagram showing an example of the data structure of the occupant DB. The occupant DB 231 stores the registered occupant information. As shown in FIG. 4, the occupant DB 231 stores the "occupant ID", "name", "gender", "age", and "face image information". The "occupant ID" is an ID for identifying an occupant. Further, the "face image information" is a feature amount of the occupant's face image and the like, and is information used for recognizing the face image. For example, in the example of FIG. 4, it is shown that the name of the occupant whose occupant ID is "U001" is "Taro Yamada", the gender is "male", and the age is "25".
　図５は、履歴ＤＢのデータ構造の例を示す図である。履歴ＤＢ２３２は、乗員ごとの一連の動作の履歴を記憶する。ここでは、一連の動作をメニューと呼ぶ。図５に示すように、履歴ＤＢ２３２は、「乗員ＩＤ」、「日時」、「メニュー」を記憶する。例えば、図５の例では、乗員ＩＤが「Ｕ００１」の乗員が「２０２０／２／１１　１４：３５」に、「Ｍ００１→Ｍ００２」というメニューを実施したことが示されている。ここで、「Ｍ００１」及び「Ｍ００２」は、メニューに含まれる個別の動作を識別するためのＩＤである。 FIG. 5 is a diagram showing an example of the data structure of the history DB. The history DB 232 stores a history of a series of operations for each occupant. Here, a series of operations is called a menu. As shown in FIG. 5, the history DB 232 stores the “occupant ID”, the “date and time”, and the “menu”. For example, in the example of FIG. 5, it is shown that the occupant with the occupant ID "U001" carried out the menu "M001 → M002" at "2020/2/11 14:35". Here, "M001" and "M002" are IDs for identifying individual operations included in the menu.
　図６は、動作ＤＢのデータ構造の例を示す図である。動作ＤＢ２３３は、メニューに含まれる各動作の情報を記憶する。図６に示すように、動作ＤＢ２３３は、「動作ＩＤ」、「名称」、「姿勢」及び「部位」を記憶する。例えば、図６の例では、動作ＩＤが「Ｍ００１」の動作の名称は「スクワット」であり、「立ち」の姿勢で行われ、「足」に関する動作であることが示されている。一方、動作ＩＤが「Ｍ００２」の動作の名称は「シットアップ」であり、「座り」の姿勢で行われ、「腹」に関する動作であることが示されている。 FIG. 6 is a diagram showing an example of the data structure of the operation DB. The operation DB 233 stores information on each operation included in the menu. As shown in FIG. 6, the motion DB 233 stores the “motion ID”, the “name”, the “posture”, and the “part”. For example, in the example of FIG. 6, the name of the operation whose operation ID is "M001" is "squat", which is performed in the "standing" posture, and is shown to be an operation related to "feet". On the other hand, the name of the operation whose operation ID is "M002" is "sit-up", which is performed in the "sitting" posture, and is shown to be an operation related to "belly".
［第１の実施例］
　情報処理装置２０は、走行ルートの形状に応じて、乗員に通知する動作を決定することができる。例えば、動作決定部２２４は、走行ルートのうち、線形度合いが所定値以上である領域には、立った状態で行われる動作が対応し、線形度合いが所定値以上でない領域に対しては、座った状態で行われる動作が対応するように、動作を決定する。 [First Example]
The information processing device 20 can determine the operation of notifying the occupant according to the shape of the traveling route. For example, the motion determination unit 224 corresponds to the motion performed in a standing state in the region where the linearity degree is equal to or higher than the predetermined value in the traveling route, and sits in the region where the linearity degree is not equal to or higher than the predetermined value. The action is determined so that the action performed in the state corresponds to the action performed in the state.
　図７は、ルートの形状の例を示す図である。図７に示すように、現在地３１（Start）から目的地３２（Goal）までの間に、道路の形状の傾向が異なる領域３１１及び領域３１２が存在するものとする。領域３１１は、ほぼ直線で構成されている。一方、領域３１２は、大部分が曲がり角や曲線で構成されている。つまり、領域３１２は、領域３１１と比べて線形度合いが大きいということができる。 FIG. 7 is a diagram showing an example of the shape of the route. As shown in FIG. 7, it is assumed that there are regions 311 and 312 having different road shape tendencies between the current location 31 (Start) and the destination 32 (Goal). Region 311 is composed of substantially straight lines. On the other hand, the region 312 is mostly composed of corners and curves. That is, it can be said that the region 312 has a larger degree of linearity than the region 311.
　このような場合、車両ＶＥが領域３１１を走行している間、乗員は立った姿勢を容易に保つことができると考えられる。一方、車両ＶＥが領域３１２を走行している間は、乗員は立った姿勢を保つことが困難であると考えられる。また、領域３１２を車両ＶＥが走行している間は、乗員が立っていると転倒の恐れがあり危険である。そのため、情報処理装置２０は、乗員の安全性を確保しかつ移動時間を有効に使えるようなメニューを提示する。 In such a case, it is considered that the occupant can easily maintain the standing posture while the vehicle VE is traveling in the area 311. On the other hand, it is considered difficult for the occupant to maintain a standing posture while the vehicle VE is traveling in the area 312. Further, while the vehicle VE is traveling in the area 312, if the occupant is standing, there is a risk of falling, which is dangerous. Therefore, the information processing device 20 presents a menu that ensures the safety of the occupants and makes effective use of the travel time.
　図６に示すように、動作「スクワット」は「立ち」の姿勢で行われる。また、動作「ダンベル」は「座り」の姿勢で行われる。そこで、動作決定部２２４は、領域３１１を走行中には動作「スクワット」を行い、領域３１２を走行中には動作「ダンベル」を行うメニューを決定する。そして、通知部２２６は、動作決定部２２４によって決定されたメニューを乗員に通知する。 As shown in FIG. 6, the operation "squat" is performed in the "standing" posture. In addition, the movement "dumbbell" is performed in a "sitting" posture. Therefore, the operation determination unit 224 determines a menu for performing the operation "squat" while traveling in the area 311 and performing the operation "dumbbell" while traveling in the area 312. Then, the notification unit 226 notifies the occupant of the menu determined by the operation determination unit 224.
　また、動作決定部２２４は、走行ルートの線形度合いだけでなく、走行ルートの種別によってメニューを決定してもよい。この場合、例えば、走行ルートが高速道路であれば、加減速や方向転換が少ないため、乗員は容易に立った姿勢を保つことができる。そのため、動作決定部２２４は、走行ルートが高速道路であれば、「立ち」の姿勢で行われる動作を決定する。 Further, the operation determination unit 224 may determine the menu not only by the degree of linearity of the travel route but also by the type of the travel route. In this case, for example, if the traveling route is an expressway, there is little acceleration / deceleration or change of direction, so that the occupant can easily maintain a standing posture. Therefore, the motion determination unit 224 determines the motion to be performed in the "standing" posture if the traveling route is an expressway.
　さらに、動作決定部２２４は、目的地に到着するまでの走行状況の変化に応じて動作を決定してもよい。例えば、目的地に到着するまでに、信号待ち等により加減速を繰り返すことが予想される場合、乗員は容易に立った姿勢を保つことが困難である。そのため、動作決定部２２４は、加減速の頻度が一定値以上であることが予想される領域に対しては、「座り」の姿勢で行われる動作を決定する。 Further, the operation determination unit 224 may determine the operation according to the change in the traveling condition until the vehicle arrives at the destination. For example, if it is expected that acceleration / deceleration will be repeated due to waiting for a traffic light or the like before arriving at the destination, it is difficult for the occupant to easily maintain a standing posture. Therefore, the motion determining unit 224 determines the motion performed in the “sitting” posture in the region where the frequency of acceleration / deceleration is expected to be a certain value or more.
［第２の実施例］
　乗員は、自身が希望するメニューを車両制御装置１０の入力部１４を介して指定することができる。この場合、情報処理装置２０は、乗員によって指定されたメニューに応じて走行ルートを決定してもよい。例えば、ルート決定部２２５は、一連の動作のうち、立った状態で行われる動作が、走行ルートのうち線形度合いが所定値以上である領域に対応し、座った状態で行われる動作が、走行ルートのうち線形度合いが所定値以上でない領域に対応するように、走行ルートを決定する。 [Second Example]
The occupant can specify the menu he / she desires via the input unit 14 of the vehicle control device 10. In this case, the information processing device 20 may determine the traveling route according to the menu designated by the occupant. For example, in the route determination unit 225, of the series of operations, the operation performed in the standing state corresponds to the region of the traveling route in which the degree of linearity is equal to or higher than a predetermined value, and the operation performed in the sitting state is traveling. The travel route is determined so as to correspond to the region of the route where the degree of linearity is not equal to or higher than a predetermined value.
　例えば、乗員が、動作「スクワット」を５分間行った後、動作「ダンベル」を１０分間行うメニューを指定した場合を考える。この場合、ルート決定部２２５は、領域３１１を５分間走行し、領域３１２を１０分間走行する走行ルートを決定する。 For example, consider a case where the occupant specifies a menu in which the operation "squat" is performed for 5 minutes and then the operation "dumbbell" is performed for 10 minutes. In this case, the route determination unit 225 determines a travel route that travels in the region 311 for 5 minutes and travels in the region 312 for 10 minutes.
［第３の実施例］
　図８は、エージェントと乗員との間の会話の例を示す図である。エージェント２２７ａは、エージェント制御部２２７によって実行されるエージェントの一例である。エージェント２２７ａは、テキスト又は音声によるチャットによって実現されてもよい。 [Third Example]
FIG. 8 is a diagram showing an example of a conversation between an agent and an occupant. The agent 227a is an example of an agent executed by the agent control unit 227. Agent 227a may be implemented by text or voice chat.
　図８に示すように、乗員の顔の画像が乗員ＤＢ２３１の顔画像情報と一致しない場合、エージェント２２７ａは、「新しい人ですね。お名前と鍛えたい部分を教えてください。」のように、新規登録であることを確認し、乗員の情報を取得する。そして、乗員は、自身の情報をエージェント２２７ａに入力する。更新部２２２は、エージェント２２７ａを介して乗員から取得した情報を乗員ＤＢ２３１に保存する。 As shown in FIG. 8, when the image of the occupant's face does not match the face image information of the occupant DB231, the agent 227a says, "You are a new person. Please tell me your name and the part you want to train." Confirm that it is a new registration and acquire the occupant information. Then, the occupant inputs his / her own information to the agent 227a. The update unit 222 stores the information acquired from the occupant via the agent 227a in the occupant DB 231.
　図９は、エージェントと乗員との間の会話の例を示す図である。図９に示すように、乗員の顔の画像が乗員ＤＢ２３１の顔画像情報と一致した場合、エージェント２２７ａは、「山田さん、今日はどうしますか？」のように、登録済みであることを示唆し、乗員によるメニューの指定を促す。ここで、乗員が「エージェントのおまかせで。」のように、特にメニューを指定しなかった場合、動作決定部２２４が走行ルートの情報に基づいてメニューを決定する。 FIG. 9 is a diagram showing an example of a conversation between an agent and an occupant. As shown in FIG. 9, when the face image of the occupant matches the face image information of the occupant DB231, the agent 227a suggests that the occupant has been registered as "Mr. Yamada, what do you do today?" And encourage the occupants to specify the menu. Here, when the occupant does not specify a menu in particular, such as "Random to the agent.", The operation determination unit 224 determines the menu based on the travel route information.
　図１０は、エージェントと乗員との間の会話の例を示す図である。図１０に示すように、エージェント２２７ａは、車両速度が変化するため、メニューを変更することを乗員に通知する。このとき、動作決定部２２４は、例えば「座り」の姿勢で行う動作を決定する。 FIG. 10 is a diagram showing an example of a conversation between an agent and an occupant. As shown in FIG. 10, the agent 227a notifies the occupant to change the menu because the vehicle speed changes. At this time, the motion determination unit 224 determines the motion to be performed, for example, in the “sitting” posture.
［情報処理方法］
　図１１は、情報処理方法の例を示すフローチャートである。例えば、図１１に示す処理は、乗員の登録の確認及び新規登録のための処理の例であり、車両ＶＥの走行前に行われる。図１１に示すように、まず、取得部２２１は、乗員の顔の画像を取得し認識を行う（ステップＳ１０１）。乗員の顔の画像が乗員ＤＢ２３１に登録済みであれば（ステップＳ１０２、Ｙｅｓ）、情報処理装置２０は処理を終了する。 [Information processing method]
FIG. 11 is a flowchart showing an example of the information processing method. For example, the process shown in FIG. 11 is an example of the process for confirming the registration of the occupant and for new registration, and is performed before the vehicle VE travels. As shown in FIG. 11, first, the acquisition unit 221 acquires and recognizes an image of the occupant's face (step S101). If the image of the occupant's face is already registered in the occupant DB 231 (step S102, Yes), the information processing apparatus 20 ends the process.
　一方、乗員の顔の画像が乗員ＤＢ２３１に登録済みでない場合（ステップＳ１０２、Ｎｏ）、更新部２２２は、取得部２２１が取得した乗員の情報を乗員ＤＢに新規登録する（ステップＳ１０３）。 On the other hand, when the image of the occupant's face is not registered in the occupant DB 231 (step S102, No), the update unit 222 newly registers the occupant information acquired by the acquisition unit 221 in the occupant DB (step S103).
　さらに、取得部２２１は、乗員の生体情報を取得する（ステップＳ１０４）。そして、動作決定部２２４は、取得した情報を基にメニューを決定する（ステップＳ１０５）。例えば、動作決定部２２４は、乗員の心拍数が所定値以上である場合、初めに休憩を行うメニューを決定する。その場合、通知部２２６は、「心拍数が上がっているので、最初の５分は休憩しましょう。」のように発話する。更新部２２２は、動作決定部２２４が決定したメニューを履歴ＤＢ２３２に保存する（ステップＳ１０６）。 Further, the acquisition unit 221 acquires the biometric information of the occupant (step S104). Then, the operation determination unit 224 determines the menu based on the acquired information (step S105). For example, the motion determination unit 224 determines a menu for first taking a break when the occupant's heart rate is equal to or higher than a predetermined value. In that case, the notification unit 226 utters, "Because the heart rate is rising, let's take a break for the first 5 minutes." The update unit 222 saves the menu determined by the operation determination unit 224 in the history DB 232 (step S106).
　図１２は、情報処理方法の例を示すフローチャートである。図１２に示す処理は、乗員が自らメニューを指定した場合に情報処理装置２０によって行われる処理の例である。図１２に示すように、まず、取得部２２１は、入力された情報を取得する（ステップＳ２０１）。入力された情報とは、乗員が指定したメニューに関する情報である。 FIG. 12 is a flowchart showing an example of an information processing method. The process shown in FIG. 12 is an example of the process performed by the information processing device 20 when the occupant specifies the menu by himself / herself. As shown in FIG. 12, first, the acquisition unit 221 acquires the input information (step S201). The entered information is information about the menu specified by the occupant.
　次に、取得部２２１は、乗員ＤＢ２３１から乗員の情報を取得する（ステップＳ２０２）。また、取得部２２１は、センサ部１７からの情報を取得する（ステップＳ２０３）。動作決定部２２４は、取得部２２１が取得した情報を基にメニューを決定する（ステップＳ２０４）。そして、更新部２２２は、動作決定部２２４が決定したメニューを履歴ＤＢ２３２に保存する（ステップＳ２０５）。 Next, the acquisition unit 221 acquires the occupant information from the occupant DB 231 (step S202). Further, the acquisition unit 221 acquires information from the sensor unit 17 (step S203). The operation determination unit 224 determines the menu based on the information acquired by the acquisition unit 221 (step S204). Then, the update unit 222 saves the menu determined by the operation determination unit 224 in the history DB 232 (step S205).
　ここで、ルート決定部２２５は、動作決定部２２４が決定したメニューを基に走行ルートを決定する（ステップＳ２０６）。通知部２２６は、動作決定部２２４が決定したメニューを通知する（ステップＳ２０７）。 Here, the route determination unit 225 determines the travel route based on the menu determined by the operation determination unit 224 (step S206). The notification unit 226 notifies the menu determined by the operation determination unit 224 (step S207).
　なお、ここでは乗員が自らメニューを指定しているので、動作決定部２２４は、単に指定されたメニューに関する情報を更新部２２２に受け渡すだけでもよい。また、図８のように、「足を鍛えたい」のようにあいまいに指定される場合がある。その場合、動作決定部２２４は、例えば動作ＤＢ２３３の中で部位が「足」である動作の中からいずれかを決定する。 Since the occupant specifies the menu by himself / herself here, the operation determination unit 224 may simply pass the information regarding the specified menu to the update unit 222. Further, as shown in FIG. 8, it may be vaguely specified as "I want to train my legs". In that case, the motion determination unit 224 determines one of the motions whose portion is the "foot" in the motion DB 233, for example.
　図１３は、情報処理方法の例を示すフローチャートである。図１３に示す処理は、乗員がメニューを指定しない場合に情報処理装置２０によって行われる処理の例である。図１３に示すように、まず、取得部２２１は、目的地までのルートの情報を取得する（ステップＳ３０１）。動作決定部２２４は、取得部２２１が取得した情報を基にメニューを決定する（ステップＳ３０２）。 FIG. 13 is a flowchart showing an example of an information processing method. The process shown in FIG. 13 is an example of the process performed by the information processing device 20 when the occupant does not specify the menu. As shown in FIG. 13, first, the acquisition unit 221 acquires the information of the route to the destination (step S301). The operation determination unit 224 determines the menu based on the information acquired by the acquisition unit 221 (step S302).
　更新部２２２は、動作決定部２２４が決定したメニューを履歴ＤＢ２３２に保存する（ステップＳ３０３）。通知部２２６は、動作決定部２２４が決定したメニューを通知する（ステップＳ３０４）。 The update unit 222 saves the menu determined by the operation determination unit 224 in the history DB 232 (step S303). The notification unit 226 notifies the menu determined by the operation determination unit 224 (step S304).
［効果］
　これまで説明してきたように、取得部２２１は、車両ＶＥの走行ルートに関する情報を取得する。また、動作決定部２２４は、取得部２２１によって取得された情報に応じて、車両ＶＥの乗員であって運転中でない乗員に推奨する動作を決定する。また、通知部２２６は、動作決定部２２４によって決定された動作に関する情報を通知する。これにより、乗員は自ら指定することなく、走行ルートに応じた動作を決定でき、走行ルートに適した動作の通知を受けることができる。このように、本実施の形態によれば、移動時間の効率的な利用を提案できる。 [effect]
As described above, the acquisition unit 221 acquires information regarding the travel route of the vehicle VE. Further, the operation determination unit 224 determines the recommended operation for the occupant of the vehicle VE and not in operation according to the information acquired by the acquisition unit 221. In addition, the notification unit 226 notifies the information regarding the operation determined by the operation determination unit 224. As a result, the occupant can determine the operation according to the traveling route without designating himself / herself, and can be notified of the operation suitable for the traveling route. As described above, according to the present embodiment, it is possible to propose efficient use of travel time.
　動作決定部２２４は、あらかじめ定められた動作を組み合わせた一連の動作を決定する。このように、走行ルートの状況は、走行中、時間の経過とともに変化する。これに対し、本実施の形態によれば、走行ルートの変化に適応した動作を組み合わせて提案することができる。 The motion determination unit 224 determines a series of motions in which predetermined motions are combined. In this way, the condition of the traveling route changes with the passage of time during traveling. On the other hand, according to the present embodiment, it is possible to propose a combination of operations adapted to changes in the traveling route.
　取得部２２１は、設定された目的地に到着するまでの走行時間を取得する。このため、本実施の形態によれば、各動作の実行時間を含めて提案することができる。 The acquisition unit 221 acquires the traveling time until it arrives at the set destination. Therefore, according to the present embodiment, it is possible to propose including the execution time of each operation.
　取得部２２１は、設定された目的地に到着するまでの走行ルートの種別又は形状に関する情報を取得する。走行ルートの種別及び形状に応じて、適する動作は異なると考えられる。これに対し、本実施の形態によれば、各動作の実行時間を含めて提案することができる。 The acquisition unit 221 acquires information on the type or shape of the travel route until it arrives at the set destination. It is considered that the suitable operation differs depending on the type and shape of the traveling route. On the other hand, according to the present embodiment, it is possible to propose including the execution time of each operation.
　取得部２２１は、走行ルートの形状の線形度合いを取得する。走行ルートの形状によって、乗員が取り得る姿勢は異なる。これに対し、本実施の形態によれば、走行ルートの形状に適応した動作を提案することができる。 The acquisition unit 221 acquires the degree of linearity of the shape of the traveling route. The posture that the occupant can take differs depending on the shape of the traveling route. On the other hand, according to the present embodiment, it is possible to propose an operation adapted to the shape of the traveling route.
　動作決定部２２４は、走行ルートのうち、線形度合いが所定値以上である領域には、立った状態で行われる動作が対応し、線形度合いが所定値以上でない領域に対しては、座った状態で行われる動作が対応するように、動作を決定する。例えば、直線が多い道路では、乗員は立った状態の動作を行うことができる。一方、曲線が多い道路では、乗員は立った状態の動作を行うことが困難である。これに対し、本実施の形態によれば、乗員の安全を確保した上で動作を提案することができる。 The motion determination unit 224 corresponds to the motion performed in a standing state in the region where the linearity degree is equal to or higher than the predetermined value in the traveling route, and sits in the region where the linearity degree is not equal to or higher than the predetermined value. Determine the action so that it corresponds to the action taken in. For example, on a road with many straight lines, the occupant can perform a standing motion. On the other hand, on a road with many curves, it is difficult for the occupant to perform a standing motion. On the other hand, according to the present embodiment, it is possible to propose the operation after ensuring the safety of the occupants.
　取得部２２１は、設定された目的地に到着するまでの車両ＶＥの走行状態の推移に関する情報を取得する。走行中、加減速等の発生頻度、天候、路面の状況、周囲の移動物体の状況等により走行状態が推移していく場合がある。これに対し、本実施の形態によれば、走行状況に適応した動作を提案することができる。 The acquisition unit 221 acquires information on the transition of the traveling state of the vehicle VE until it arrives at the set destination. During running, the running state may change depending on the frequency of acceleration / deceleration, weather, road surface conditions, surrounding moving objects, and the like. On the other hand, according to the present embodiment, it is possible to propose an operation adapted to the traveling situation.
　取得部２２１は、車両ＶＥの乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する。また、ルート決定部２２５は、取得部２２１によって取得された情報に応じて、車両ＶＥの走行ルートを決定する。このように、本実施の形態によれば、乗員の希望する動作に適したルートで移動体を走行させることができる。 The acquisition unit 221 acquires information on a series of operations performed by an occupant of the vehicle VE who is not driving. Further, the route determination unit 225 determines the travel route of the vehicle VE according to the information acquired by the acquisition unit 221. As described above, according to the present embodiment, the moving body can be traveled on a route suitable for the movement desired by the occupant.
　ルート決定部２２５は、一連の動作のうち、立った状態で行われる動作が、走行ルートのうち線形度合いが所定値以上である領域に対応し、座った状態で行われる動作が、走行ルートのうち線形度合いが所定値以上でない領域に対応するように、走行ルートを決定する。このように、本実施の形態によれば、乗員の希望する動作に合わせ、かつ乗員の安全が確保されるような走行ルートを決定することができる。 In the route determination unit 225, of the series of operations, the operation performed in the standing state corresponds to the region of the traveling route in which the degree of linearity is equal to or higher than a predetermined value, and the operation performed in the sitting state is the traveling route. The traveling route is determined so as to correspond to the region where the degree of linearity is not equal to or higher than the predetermined value. As described above, according to the present embodiment, it is possible to determine a traveling route that matches the movement desired by the occupant and ensures the safety of the occupant.
［その他の実施の形態］
　本発明は、これまでに説明してきた実施の形態によって限定されるものではない。例えば、動作には、これまでに例として挙げたもの以外にも様々なものが考えられる。例えば、動作には、ダンス、ストレッチ等のエクササイズに関するものだけでなく、食事、着替え等の身体を使ったあらゆる動作が含まれる。 [Other embodiments]
The present invention is not limited to the embodiments described so far. For example, various actions can be considered in addition to those given as examples so far. For example, movements include not only exercises such as dancing and stretching, but also all physical movements such as eating and changing clothes.
　情報処理装置２０は、それらの動作がどのような姿勢で行われるものであるか、また、どのような目的で行われるものであるかを記憶しておき、走行ルートに応じて動作を組み合わせた一連の動作、すなわちメニューを決定する。 The information processing device 20 stores in what posture the movements are performed and for what purpose, and combines the movements according to the traveling route. A series of operations, that is, a menu is determined.
　例えば、目的地に到着するまでの間に乗員が着替えを行うことが考えられる。着替えにおいて、ズボンを履く動作は、片足が地面から離れることがあるため、姿勢が不安定になることが考えられる。一方、シャツを着る動作は、常に両足が地面についているため、姿勢が安定している。このため、情報処理装置２０は、直線の道路に対してはズボンを履く動作を決定し、曲線が多い道路に対してはシャツを着る動作を決定することができる。 For example, it is conceivable that the occupants will change clothes before arriving at the destination. When changing clothes, the movement of putting on trousers may cause the posture to become unstable because one foot may be off the ground. On the other hand, when wearing a shirt, both feet are always on the ground, so the posture is stable. Therefore, the information processing device 20 can determine the action of wearing trousers on a straight road and the action of wearing a shirt on a road having many curves.
　１　情報処理システム
　１０　車両制御装置
　１１、２１　通信部
　１２、２２　制御部
　１３、２３　記憶部
　１４　入力部
　１５　出力部
　１６　撮像部
　１７　センサ部
　２０　情報処理装置
　３１　現在地
　３２　目的地
　１７１　ＧＰＳセンサ
　１７２　ジャイロセンサ
　１７３　路面検出センサ
　１７４　天候センサ
　１７５　生体センサ
　２２１　取得部
　２２２　更新部
　２２３　姿勢検出部
　２２４　動作決定部
　２２５　ルート決定部
　２２６　通知部
　２２７　エージェント制御部
　２２７ａ　エージェント
　２３１　乗員ＤＢ
　２３２　履歴ＤＢ
　２３３　動作ＤＢ
　３１１、３１２　領域
　ＶＥ　車両
　ＮＥ　ネットワーク 1 Information processing system 10 Vehicle control device 11, 21 Communication unit 12, 22 Control unit 13, 23 Storage unit 14 Input unit 15 Output unit 16 Imaging unit 17 Sensor unit 20 Information processing device 31 Current location 32 Destination 171 GPS sensor 172 Gyro sensor 173 Road surface detection sensor 174 Weather sensor 175 Biological sensor 221 Acquisition unit 222 Update unit 223 Attitude detection unit 224 Motion determination unit 225 Route determination unit 226 Notification unit 227 Agent control unit 227a Agent 231 Crew member DB
232 history DB
233 Operation DB
311, 312 Area VE Vehicle NE Network

Claims (14)

  1. 　移動体の走行ルートに関する情報を取得する取得部と、
    　前記取得部によって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定部と、
    　前記動作決定部によって決定された動作に関する情報を通知する通知部と、
    　を有することを特徴とする情報処理装置。     An acquisition unit that acquires information about the travel route of a moving object,
    An operation determination unit that determines a recommended operation for a occupant of the moving body and not in operation according to the information acquired by the acquisition unit.
    A notification unit that notifies information about the operation determined by the operation determination unit, and
    An information processing device characterized by having.
  2. 　前記動作決定部は、あらかじめ定められた動作を組み合わせた一連の動作を決定することを特徴とする請求項１に記載の情報処理装置。 The information processing device according to claim 1, wherein the operation determination unit determines a series of operations in which predetermined operations are combined.
  3. 　前記取得部は、設定された目的地に到着するまでの走行時間を取得することを特徴とする請求項１又は２に記載の情報処理装置。 The information processing device according to claim 1 or 2, wherein the acquisition unit acquires a traveling time until arriving at a set destination.
  4. 　前記取得部は、設定された目的地に到着するまでの走行ルートの種別又は形状に関する情報を取得することを特徴とする請求項１又は２に記載の情報処理装置。 The information processing device according to claim 1 or 2, wherein the acquisition unit acquires information on the type or shape of a traveling route until it arrives at a set destination.
  5. 　前記取得部は、前記走行ルートの形状の線形度合いを取得し、
    　前記動作決定部は、前記走行ルートのうち、前記線形度合いが所定値以上である領域には、立った状態で行われる動作が対応し、前記線形度合いが所定値以上でない領域に対しては、座った状態で行われる動作が対応するように、動作を決定することを特徴とする請求項４に記載の情報処理装置。     The acquisition unit acquires the degree of linearity of the shape of the traveling route.
    In the traveling route, the motion determining unit corresponds to an operation performed in a standing state in a region where the linearity degree is equal to or higher than a predetermined value, and corresponds to a region in which the linearity degree is not equal to or higher than a predetermined value. The information processing apparatus according to claim 4, wherein the motion is determined so that the motion performed in a sitting state corresponds to the motion.
  6. 　前記取得部は、設定された目的地に到着するまでの前記移動体の走行状態の推移に関する情報を取得することを特徴とする請求項１又は２に記載の情報処理装置。 The information processing device according to claim 1 or 2, wherein the acquisition unit acquires information regarding a transition of the traveling state of the moving body until it arrives at a set destination.
  7. 　情報処理装置が実行する情報処理方法であって、
    　移動体の走行ルートに関する情報を取得する取得ステップと、
    　前記取得ステップによって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定ステップと、
    　前記動作決定ステップによって決定された動作に関する情報を通知する通知ステップと、
    　を含むことを特徴とする情報処理方法。     It is an information processing method executed by an information processing device.
    The acquisition step to acquire information about the traveling route of the moving object, and
    An operation determination step for determining a recommended operation for a occupant of the moving body who is not in operation according to the information acquired by the acquisition step, and an operation determination step.
    A notification step for notifying information about the operation determined by the operation determination step, and
    An information processing method characterized by including.
  8. 　移動体の走行ルートに関する情報を取得する取得ステップと、
    　前記取得ステップによって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定ステップと、
    　前記動作決定ステップによって決定された動作に関する情報を通知する通知ステップと、
    　をコンピュータに実行させるための情報処理プログラム。     The acquisition step to acquire information about the traveling route of the moving object, and
    An operation determination step for determining a recommended operation for a occupant of the moving body who is not in operation according to the information acquired by the acquisition step, and an operation determination step.
    A notification step for notifying information about the operation determined by the operation determination step, and
    An information processing program that allows a computer to execute.
  9. 　移動体の走行ルートに関する情報を取得する取得ステップと、
    　前記取得ステップによって取得された情報に応じて、前記移動体の乗員であって運転中でない乗員に推奨する動作を決定する動作決定ステップと、
    　前記動作決定ステップによって決定された動作に関する情報を通知する通知ステップと、
    　をコンピュータに実行させるための情報処理プログラムを記憶したことを特徴とする記憶媒体。     The acquisition step to acquire information about the traveling route of the moving object, and
    An operation determination step for determining a recommended operation for a occupant of the moving body who is not in operation according to the information acquired by the acquisition step, and an operation determination step.
    A notification step for notifying information about the operation determined by the operation determination step, and
    A storage medium characterized by storing an information processing program for causing a computer to execute an information processing program.
  10. 　移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得部と、
    　前記取得部によって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定部と、
    　を有することを特徴とする情報処理装置。     An acquisition unit that acquires information about a series of actions performed by a moving occupant who is not driving.
    A route determination unit that determines a traveling route of the moving body according to the information acquired by the acquisition unit, and a route determination unit.
    An information processing device characterized by having.
  11. 　前記ルート決定部は、前記一連の動作のうち、立った状態で行われる動作が、走行ルートのうち線形度合いが所定値以上である領域に対応し、座った状態で行われる動作が、走行ルートのうち線形度合いが所定値以上でない領域に対応するように、走行ルートを決定することを特徴とする請求項１０に記載の情報処理装置。 In the route determination unit, in the series of operations, the operation performed in the standing state corresponds to the region of the traveling route in which the degree of linearity is equal to or higher than a predetermined value, and the operation performed in the sitting state is the traveling route. The information processing apparatus according to claim 10, wherein a traveling route is determined so as to correspond to a region in which the degree of linearity is not equal to or more than a predetermined value.
  12. 　情報処理装置が実行する情報処理方法であって、
    　移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得ステップと、
    　前記取得ステップによって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定ステップと、
    　を含むことを特徴とする情報処理方法。     It is an information processing method executed by an information processing device.
    An acquisition step that acquires information about a series of actions performed by a moving occupant who is not driving.
    A route determination step for determining a traveling route of the moving body according to the information acquired by the acquisition step, and a route determination step.
    An information processing method characterized by including.
  13. 　移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得ステップと、
    　前記取得ステップによって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定ステップと、
    　をコンピュータに実行させるための情報処理プログラム。     An acquisition step that acquires information about a series of actions performed by a moving occupant who is not driving.
    A route determination step for determining a traveling route of the moving body according to the information acquired by the acquisition step, and a route determination step.
    An information processing program that allows a computer to execute.
  14. 　移動体の乗員であって運転中でない乗員が実行する一連の動作に関する情報を取得する取得ステップと、
    　前記取得ステップによって取得された情報に応じて、前記移動体の走行ルートを決定するルート決定ステップと、
    　をコンピュータに実行させるための情報処理プログラムを記憶したことを特徴とする記憶媒体。     An acquisition step that acquires information about a series of actions performed by a moving occupant who is not driving.
    A route determination step for determining a traveling route of the moving body according to the information acquired by the acquisition step, and a route determination step.
    A storage medium characterized by storing an information processing program for causing a computer to execute an information processing program.
PCT/JP2021/001127 2020-03-27 2021-01-14 Information processing device, information processing method, information processing program, and storage medium WO2021192526A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022509302A JPWO2021192526A1 (en) 2020-03-27 2021-01-14

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020058885 2020-03-27
JP2020-058885 2020-03-27

Publications (1)

Publication Number Publication Date
WO2021192526A1 true WO2021192526A1 (en) 2021-09-30

Family

ID=77891327

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/001127 WO2021192526A1 (en) 2020-03-27 2021-01-14 Information processing device, information processing method, information processing program, and storage medium

Country Status (2)

Country Link
JP (1) JPWO2021192526A1 (en)
WO (1) WO2021192526A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016062414A (en) * 2014-09-19 2016-04-25 クラリオン株式会社 In-vehicle monitoring device and in-vehicle monitoring system
JP2018133032A (en) * 2017-02-17 2018-08-23 オムロン株式会社 Driving switching support device and driving switching support method
JP2018144544A (en) * 2017-03-02 2018-09-20 株式会社デンソー Traveling control system for vehicle
JP2018181120A (en) * 2017-04-18 2018-11-15 株式会社デンソーテン Driving assist system and driving assist method
JP2020003936A (en) * 2018-06-26 2020-01-09 株式会社デンソー Vehicle control method, vehicle control system, and vehicle control device
JP2020111194A (en) * 2019-01-11 2020-07-27 トヨタ自動車株式会社 Processing device, processing method, and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016062414A (en) * 2014-09-19 2016-04-25 クラリオン株式会社 In-vehicle monitoring device and in-vehicle monitoring system
JP2018133032A (en) * 2017-02-17 2018-08-23 オムロン株式会社 Driving switching support device and driving switching support method
JP2018144544A (en) * 2017-03-02 2018-09-20 株式会社デンソー Traveling control system for vehicle
JP2018181120A (en) * 2017-04-18 2018-11-15 株式会社デンソーテン Driving assist system and driving assist method
JP2020003936A (en) * 2018-06-26 2020-01-09 株式会社デンソー Vehicle control method, vehicle control system, and vehicle control device
JP2020111194A (en) * 2019-01-11 2020-07-27 トヨタ自動車株式会社 Processing device, processing method, and program

Also Published As

Publication number Publication date
JPWO2021192526A1 (en) 2021-09-30

Similar Documents

Publication Publication Date Title
US20170349184A1 (en) Speech-based group interactions in autonomous vehicles
JP6382273B2 (en) Facility satisfaction calculation device
JP2018060192A (en) Speech production device and communication device
EP3296944A1 (en) Information processing device, information processing method, and program
JP6083441B2 (en) Vehicle occupant emotion response control device
US20180096699A1 (en) Information-providing device
JP2020095406A (en) On-vehicle device, program, and vehicle
JP2024041746A (en) Information processing device
JP6552548B2 (en) Point proposing device and point proposing method
JPWO2019159605A1 (en) Operation management device, operation management method and operation management system
JP2016137200A (en) Control device for coping with feeling of passenger for vehicle
WO2007032278A1 (en) Path search apparatus, path search method, path search program, and computer readable recording medium
US11511157B2 (en) Device for assisting a driver of a vehicle to perform physical exercises connected to a remote server
WO2021192526A1 (en) Information processing device, information processing method, information processing program, and storage medium
CN111611330B (en) Information processing system, program, and control method
US20190286132A1 (en) Device for assisting a driver of a vehicle to perform physical exercises
JP2020144816A (en) Vehicle operation information provision device, vehicle operation information provision method, and program
JP2021163144A (en) Information processing apparatus, information processing method, information processing program, and storage medium
US20220324435A1 (en) Information processing method, information processing system, and control device
JP2024102198A (en) Information processing device
US20200265252A1 (en) Information processing apparatus and information processing method
JP2023184712A (en) Information processing device
US20230311926A1 (en) Biological state guidance device, biological state guidance method, and storage medium
US20240085198A1 (en) Navigation system, navigation method, and storage medium storing navigation program
WO2022208871A1 (en) Transportation service assistance device and transportation service assistance method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21775636

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022509302

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21775636

Country of ref document: EP

Kind code of ref document: A1