WO2014054171A1 - In-vehicle information processing device - Google Patents

In-vehicle information processing device Download PDF

Info

Publication number
WO2014054171A1
WO2014054171A1 PCT/JP2012/075990 JP2012075990W WO2014054171A1 WO 2014054171 A1 WO2014054171 A1 WO 2014054171A1 JP 2012075990 W JP2012075990 W JP 2012075990W WO 2014054171 A1 WO2014054171 A1 WO 2014054171A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
information
situation
state
acquired
Prior art date
Application number
PCT/JP2012/075990
Other languages
French (fr)
Japanese (ja)
Inventor
家田　邦代
達也 三次
直志 宮原
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2014539558A priority Critical patent/JP5847320B2/en
Priority to PCT/JP2012/075990 priority patent/WO2014054171A1/en
Publication of WO2014054171A1 publication Critical patent/WO2014054171A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes

Definitions

  • the present invention relates to an in-vehicle information processing apparatus that is mounted on a vehicle and presents information indicating the traveling state of the host vehicle and surrounding vehicles and the environment surrounding the host vehicle.
  • Patent Document 1 when the surrounding vehicle is photographed with a camera provided in the own vehicle and the surrounding vehicle performs a dangerous driving, an image of the surrounding vehicle and its accompanying information (position, date, vehicle registration number, etc.) are displayed.
  • a dangerous driving restraint device that creates a database with the accompanying information as a key using data transmitted to the server and transmitted on the server side. By searching a database created using a vehicle registration number or the like as a key, related stored images and accompanying information are provided. As a result, an image in which a number of dangerous acts are performed and the accompanying information are provided for a vehicle that is repeatedly running dangerously.
  • Patent Document 1 a vehicle that repeatedly performs a dangerous action is identified and recognized by the driver of the host vehicle, and is related to whether or not a dangerous action is being performed.
  • the technique disclosed in Patent Document 1 searches a database and provides images and accompanying information, and the driver intuitively determines the host vehicle and the state around the host vehicle from the presented information. There was a problem that it was difficult to do.
  • the present invention has been made to solve the above-described problems, and is not limited to notifying the presence of a surrounding vehicle that performs dangerous driving, but can intuitively recognize the state of the host vehicle and the surroundings of the host vehicle.
  • the purpose is to present.
  • the in-vehicle information processing apparatus images an information acquisition unit that acquires information indicating a vehicle situation and a situation around the vehicle, and an expression that describes a specific situation content of a predetermined item in the vehicle and around the vehicle Information relating to a predetermined item is extracted from a database for storing image information and information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and the extracted information is information indicating the status content of the predetermined item
  • An information conversion unit that converts the information into the database, and information indicating the situation content of the predetermined item converted by the information conversion unit, the specific situation content of the predetermined item is estimated, and image information corresponding to the estimated specific situation content is stored in the database
  • An entertainment content generation unit acquired from the display, and a display control unit for displaying the image information acquired by the entertainment content generation unit on the display unit. That.
  • the present invention it is possible to present highly convenient information that is not limited to notification of the presence of a surrounding vehicle that performs dangerous driving.
  • information capable of intuitively recognizing the host vehicle and the state around the host vehicle can be presented, and the driver of the host vehicle can quickly reflect the information in the driving operation.
  • FIG. 1 is a block diagram illustrating a configuration of an in-vehicle information processing apparatus according to Embodiment 1.
  • FIG. It is a figure which shows an example of the table of the information conversion part of the vehicle-mounted information processing apparatus by Embodiment 1.
  • FIG. It is a figure which shows an example of the expression database of the vehicle-mounted information processing apparatus by Embodiment 1.
  • FIG. 3 is a flowchart showing the operation of the in-vehicle information processing apparatus according to the first embodiment.
  • FIG. 3 is an explanatory diagram schematically showing processing contents of the in-vehicle information processing apparatus according to Embodiment 1; It is a block diagram which shows the other structure of the vehicle-mounted information processing apparatus by Embodiment 1.
  • FIG. 1 is a block diagram showing the configuration of an in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • the in-vehicle information processing apparatus 100 includes an information acquisition unit 1, an information conversion unit 2, an entertainment content generation unit 3, an expression database 4, a content database 5, an entertainment content storage unit 6, a display control unit 7, and an in-vehicle display (display unit) 8. It is configured.
  • the information acquisition unit 1 includes an in-vehicle camera 1a, a sensor 1b, a microphone 1c, a navigation device 1d, the Internet 1e, a mobile terminal 1f, and the like, and acquires data of the own vehicle and data around the own vehicle.
  • the data around the host vehicle is data indicating, for example, surrounding vehicles that run around the host vehicle, people walking around the host vehicle, roads on which the host vehicle runs, current weather, and the like.
  • the configuration of the information acquisition unit 1 can be changed as appropriate according to the usage situation. By forming the information acquisition unit 1 with a large number of information acquisition means, more information can be acquired, and entertainment content suitable for the current traveling state of the host vehicle and the surrounding state of the host vehicle is generated. Can do.
  • the information conversion unit 2 uses the data of the host vehicle and the data of surrounding vehicles acquired by the information acquiring unit 1 to provide information that the driver of the host vehicle can grasp visually and audibly during normal travel, that is, the information about the host vehicle and the surrounding vehicles.
  • Information such as traveling conditions, conditions of people inside and outside the vehicle, information on the environment outside the vehicle (hereinafter referred to as vehicle-related information), and the like are extracted.
  • vehicle-related information information on the environment outside the vehicle
  • the extracted vehicle related information is converted into predetermined information set in a table held in advance by the information conversion unit 2.
  • the entertainment content generating unit 3 is a driver of the host vehicle, a driver of the surrounding vehicle, a passenger of the host vehicle, and the outside of the vehicle.
  • An expression that describes the emotion, psychology, or movement of a person is acquired from the expression database 4.
  • an expression describing the emotion and psychology estimated to be received by the driver is acquired from the expression database 4.
  • entertainment content image information that visually shows a concept associated with the acquired adjective expression is acquired from the content database 5.
  • the expression database 4 stores expressions describing emotions, psychology or movements of the driver of the own vehicle and the surrounding vehicles, passengers of the own vehicle and people outside the vehicle, and describes emotions or psychology received by the person from the outside environment. Accumulate expressions.
  • the content database 5 accumulates illustrations (image information) that visually indicate concepts that are associated with expressions that describe human emotions, psychology, or movement.
  • the content database 5 stores illustrations (image information) that visually indicate alerts associated with expressions that describe emotions or psychology received by people from outside the vehicle.
  • the entertainment content storage unit 6 stores the entertainment content acquired by the entertainment content generation unit 3 in association with the corresponding vehicle-related information, conversion data, and description of the description.
  • the display control unit 7 performs control to display the entertainment content generated by the entertainment content generation unit 3 on the in-vehicle display 8. For example, when a navigation screen is displayed on the in-vehicle display 8, display control is performed to arrange entertainment content at a corresponding position on the navigation screen. Further, in accordance with a read instruction input via an operation input unit (not shown) or the like, the corresponding entertainment content is read from the entertainment content storage unit 6 and displayed on the in-vehicle display 8.
  • the in-vehicle display 8 is composed of, for example, an LCD (Liquid Crystal Display), and superimposes the entertainment content on a predetermined position of the navigation screen based on the display control of the display control unit 7.
  • the information acquisition unit 1 includes, for example, the in-vehicle camera 1a, the sensor 1b, the microphone 1c, the navigation device 1d, the Internet 1e, the mobile terminal 1f, and the like.
  • the in-vehicle camera 1a captures the host vehicle and the surroundings of the host vehicle, and the in-vehicle camera installed inside the host vehicle captures the situation of the driver and passengers and is installed outside the host vehicle.
  • the in-vehicle camera captures the relationship between the host vehicle and the surrounding vehicle, the driving situation of the surrounding vehicle, the environment outside the vehicle, and the like.
  • a plurality of in-vehicle cameras 1a can be arranged such as being installed in the front and rear of the vehicle, and inside and outside the vehicle.
  • the sensor 1b is composed of various sensors that detect the running conditions of the host vehicle and surrounding vehicles. For example, a distance sensor for monitoring the surrounding state of the host vehicle, a speed sensor for detecting the traveling state of the host vehicle, an acceleration sensor, a steering angle sensor for detecting the driving operation of the driver, an accelerator opening sensor, A brake sensor, a gear change lever sensor, a human sensor for detecting a passenger's state of the own vehicle, and the like are provided. A plurality of sensors 1b can be arranged according to information to be acquired.
  • the microphone 1c is arranged inside and outside the host vehicle, and collects sounds inside the host vehicle and sounds generated by surrounding vehicles. A plurality of microphones 1c can be arranged according to information to be acquired.
  • the navigation device 1d acquires information indicating the environment outside the vehicle, such as the travel distance and time of the host vehicle, the type of road on which the vehicle is traveling, and the congestion status of the road.
  • the Internet 1e acquires the vehicle type information of the surrounding vehicles from the captured images of the surrounding vehicles captured by the in-vehicle camera 1a and the mobile terminal 1f.
  • the mobile terminal 1f may estimate the personality of the driver and passengers based on the call history of the driver and passengers.
  • the information conversion unit 2 first extracts vehicle related information from the data acquired by the information acquisition unit 1.
  • the extracted vehicle-related information is converted into conversion data indicating the movement of the host vehicle, the movement of surrounding vehicles, the road situation, and the like set in a table held in advance by the information conversion unit 2.
  • conversion data indicating the movement of the host vehicle, the movement of surrounding vehicles, the road situation, and the like set in a table held in advance by the information conversion unit 2.
  • the in-vehicle camera 1a of the vehicle-related information and the navigation information of the navigation device 1d are analyzed, and conversion data corresponding to the analysis result is selected from the table.
  • FIG. 2 is a diagram showing an example of a table held and referred to by the information conversion unit 2 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • the table is composed of “conversion object” and “conversion data”.
  • the conversion target (predetermined item) is, for example, “movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, “movement of people in the passenger compartment”, “empty situation”, “ It consists of items such as “road situation”, “traffic signal situation”, and “traffic sign situation”.
  • the conversion data includes the lateral movement of the vehicle, the relationship with the vehicle in the front-rear direction, the characteristic behavior of the driver, the characteristic behavior and characteristic classification of the person outside the vehicle, the characteristic behavior of the person inside the vehicle, It is composed of data indicating the characteristics of the weather, the characteristics of the road on the road, the characteristics regarding the visibility of traffic signals and traffic signs, and the like.
  • the determination method of the vehicle related information is described together, but the determination method may not be stored in the table.
  • the information conversion unit 2 converts the movement of the host vehicle into converted data using the table shown in FIG. 2 is compared with the threshold value P obtained by the sensor 1b. Is less than the threshold value P, the conversion data “Do not wobble from side to side” is selected. On the other hand, if the degree of fluctuation A is equal to or greater than the threshold value P, the conversion data of “fluctuate left and right” is selected. Furthermore, when the state where the degree of fluctuation A is equal to or greater than the threshold value P continues for a predetermined time or longer, the conversion data “meandering operation” is selected.
  • the inter-vehicle distance B acquired by the sensor 1b is compared with the threshold value Q, and if the inter-vehicle distance B is less than the threshold value Q, conversion data “the inter-vehicle distance is short” is selected. On the other hand, when the inter-vehicle distance B is equal to or greater than the threshold value Q, the conversion data “the inter-vehicle distance is long” is selected. In addition, as a result of analyzing the captured video in the own vehicle, if it is determined that the driver is not facing the front, the conversion data of “side looking driving” is selected.
  • the entertainment content generation unit 3 performs a plurality of conversions converted by the information conversion unit 2 as “movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, and “movement of people in the passenger compartment”. Based on the data, the driving state of the driver of the own vehicle, the driving state of the driver of the surrounding vehicle, the state of the person around the own vehicle, and the state of the person in the passenger compartment are estimated based on the data. Based on each estimated state, an expression describing the driver's or person's emotion, psychology or movement is acquired from the database 4.
  • the driver of the host vehicle is converted based on the converted data of “Driving while talking”, “Long distance between vehicles” and “Wakimi driving” converted as “Vehicle movement”. It is estimated that the driving state is “My paced driving”.
  • An expression “niconico” that describes the driver's psychology is acquired from the database 4 based on the estimated “my pace driving”.
  • the entertainment content generation unit 3 is based on a plurality of conversion data converted by the information conversion unit 2 as “sky situation”, “road situation”, “traffic signal situation”, and “traffic sign situation”.
  • the impression received by the driver of the host vehicle for collation with the expression database 4 is estimated, and an expression describing the driver's emotion or psychology is acquired from the database 4 based on each estimated impression.
  • an expression “Harahara” that describes the psychology of the driver is acquired from the database 4.
  • the entertainment content generation unit 3 acquires from the content database 5 as an entertainment content an illustration visually showing a concept associated with the description of the description acquired from the database 4.
  • FIG. 3 is a diagram showing an example of the expression database 4 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • the expression database 4 includes “content generation target” and “adjective expression”.
  • the content generation target is the same items as the conversion target shown in FIG. 2 "movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, “movement of people in the vehicle interior”, “ It is composed of “empty situation”, “road situation”, “traffic signal situation”, “traffic sign situation”, and the like.
  • FIG. 4 is a diagram showing an example of the content database 5 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • a round face illustration is used to show the movement of the host vehicle
  • a square is used to show the movement of surrounding vehicles, the movement of people around the own vehicle, and the movement of people in the passenger compartment.
  • Visibility can be improved by using illustration notation that distinguishes the movement of the host vehicle from the rest, such as using a face illustration.
  • the distinction of the illustration notation is not limited to the shape, but may be based on a color or blinking display.
  • FIG. 5 is a flowchart showing the operation of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • the in-vehicle information processing apparatus 100 displays on the in-vehicle display 8 whether to generate entertainment content in advance, whether to re-acquire data, whether to accumulate entertainment content, or not. It is assumed that whether or not to set is set (hereinafter referred to as setting conditions).
  • the in-vehicle information processing apparatus 100 refers to the setting condition and determines whether to generate entertainment content (step ST1). If entertainment content is not generated (step ST1; NO), the process ends. On the other hand, when generating entertainment content (step ST1; YES), the information acquisition unit 1 acquires host vehicle data and host vehicle peripheral data (step ST2). The information conversion unit 2 determines the movement of the own vehicle, the movement of the surrounding vehicle, the movement of the person around the vehicle, the movement of the person in the vehicle interior, the situation of the sky, from the own vehicle data and the surrounding data of the own vehicle acquired in step ST2. Vehicle-related information that can be grasped by the driver of the host vehicle, such as road conditions, traffic signal conditions, and traffic sign conditions, is extracted (step ST3). Further, conversion data corresponding to the vehicle-related information extracted in step ST3 is acquired with reference to a table held in advance (step ST4).
  • the entertainment content generation unit 3 estimates the driving state of the driver of the host vehicle or the surrounding vehicle and the state of the passenger or the person outside the vehicle for collation with the expression database 4 based on the converted data converted in step ST4. At the same time, the impression received by the driver from the environment outside the vehicle is estimated (step ST5). Furthermore, the entertainment content generation unit 3 determines whether or not a description expression corresponding to the estimated driving state, the state of the person, and the impression received by the driver is stored in the expression database 4 (step ST6). When the corresponding adjective expression is not accumulated (step ST6; NO), it is determined whether or not the own vehicle data and the own vehicle surrounding data are acquired again with reference to the set condition (step ST7).
  • step ST7 When the own vehicle data and the own vehicle surrounding data are acquired again (step ST7; YES), the process returns to step ST1, and the above-described process is repeated. On the other hand, when the own vehicle data and the own vehicle surrounding data are not acquired (step ST7; NO), the process is terminated.
  • step ST6 if the corresponding adjective expression is accumulated (step ST6; YES), the entertainment content generation unit 3 selects the relevant adjective expression (step ST8), and further refers to the content database 5 to the selected adjective expression.
  • Entertainment content that is a corresponding illustration is acquired (step ST9).
  • the entertainment content generation unit 3 determines whether to store corresponding vehicle-related information, conversion data, description of description, and the like in the entertainment content storage unit 6 in addition to the acquired entertainment content (step ST10). When not storing (step ST10; NO), it progresses to the process of step ST12.
  • step ST10 when accumulating (step ST10; YES), the data is accumulated in the entertainment content accumulating unit 6 (step ST11).
  • the entertainment content generation unit 3 determines whether or not to display the entertainment content acquired in step ST9 on the in-vehicle display 8 with reference to the setting condition (step ST12). When not displaying on the vehicle-mounted display 8 (step ST12; NO), it progresses to the process of step ST14. When displaying on the vehicle-mounted display 8 (step ST12; YES), an entertainment content is displayed on the vehicle-mounted display 8 via the display control part 7 (step ST13).
  • the entertainment content generation unit 3 refers to the setting condition and determines whether or not to continue acquiring the own vehicle data and the surrounding data of the own vehicle (step ST14).
  • step ST14 determines whether or not to continue acquiring the own vehicle data and the surrounding data of the own vehicle.
  • step ST14 determines whether or not to continue acquiring the own vehicle data and the surrounding data of the own vehicle.
  • the case where the setting conditions are set in advance is shown as an example, but the screen for requesting the user's selection input in steps ST1, ST7, ST10, and ST12 without setting the setting conditions in advance.
  • You may comprise so that the audio
  • FIG. 6 is an explanatory diagram schematically showing the processing contents of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • 6A shows a configuration example of the information acquisition unit
  • FIG. 6B shows a conversion processing example of the information conversion unit
  • FIG. 6C shows a generation example of the entertainment content generation unit
  • FIG. d) shows a configuration example of the expression database
  • FIG. 6 (e) shows a configuration example of the content database
  • FIG. 6 (f) shows a display example of the in-vehicle display.
  • the information acquisition unit 1 includes an in-vehicle camera 1a, a sensor 1b, a microphone 1c, a navigation device 1d, and a mobile terminal 1f.
  • Each structure of the information acquisition part 1 acquires own vehicle data and own vehicle surrounding data as step ST2.
  • vehicle-related information is extracted as step ST3 from the data acquired in step ST2.
  • Vehicle-related information is classified and extracted as “movement of own vehicle”, “movement of surrounding vehicles”, “sky situation”, and “road situation”, for example, photographing the driver's facial expression about “movement of own vehicle”
  • the captured image, the vehicle wobble information, the in-vehicle state and the vehicle speed measurement result are extracted.
  • step ST4 conversion data is selected from the table based on the comparison between the vehicle related information and the threshold value or the analysis result of the vehicle related information. For example, from the analysis result of the shot image that captured the driver's facial expression, select conversion data that is ⁇ eyes are patchy '' and compare the vehicle speed measurement result with the threshold value to say ⁇ slower than the speed limit '' Select the conversion data.
  • step ST5 the driving of the host vehicle is determined based on the driving state, the sky condition, and the road condition of the driver of the host vehicle and the surrounding vehicles.
  • the impression that the person will receive For example, from the five conversion data indicating the movement of the host vehicle shown in FIG. 6B, the driving state of the driver of the host vehicle is estimated as “because of a call, the surrounding situation is not grasped”. Similarly, from the two conversion data indicating the empty situation shown in FIG. 6B, the impression received by the driver of the host vehicle from the outside environment is estimated as “needs attention”.
  • step ST6 and step ST8 referring to the expression database 4 shown in FIG. 6D, expressions expressing the driving state and impression estimated in step ST5 are acquired.
  • an adjective expression “Nico Nico” is acquired with respect to the driving state estimated as “because of the call, the surrounding situation is not grasped”.
  • an adjective expression “Harahara” is acquired for the impression that “the driver needs attention” received by the driver of the host vehicle from the outside environment.
  • the display control unit 7 displays the entertainment content acquired in step ST9 on the in-vehicle display 8 as step ST13.
  • the navigation screen is displayed on the in-vehicle display 8 as shown in FIG. 6 (f)
  • entertainment contents of the host vehicle and the surrounding vehicles are displayed at corresponding positions on the running road.
  • entertainment content indicating the environment outside the vehicle is displayed in an empty area of the navigation screen.
  • FIG. 7 shows a configuration of the in-vehicle information processing apparatus 100 having the voice announcement function.
  • FIG. 7 is a block diagram showing another configuration of in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
  • An audio output control unit 9 and a speaker 10 are additionally provided in the in-vehicle information processing apparatus 100 shown in FIG.
  • the audio output control unit 9 performs control to output the entertainment content generated by the entertainment content generation unit 3 from the speaker 10.
  • the speaker 10 outputs an audio announcement according to the entertainment content based on the audio output control of the audio output control unit 9.
  • the display example of the in-vehicle display 8 shown in FIG. 6F is an example, and various displays can be performed depending on the driving state and the driving scene. For example, if a vehicle traveling in front of the host vehicle is meandering and acceleration / deceleration of the speed is severe, it is estimated that the driver of the vehicle is frustrated and the vehicle traveling in front of the host vehicle is angry. An illustration showing In addition, when a traffic signal is allowed to turn right and a straight vehicle enters the intersection, it is estimated that the driver of the host vehicle is in danger, and the subject vehicle is indicated by an illustration indicating “in danger”.
  • the illustration showing the face of the person and the illustration showing the alert are displayed as entertainment content.
  • the illustration shows the own vehicle, surrounding vehicles, passengers of the own vehicle, people around the own vehicle, and the environment outside the vehicle. Any illustration may be used as long as the situation is appropriately expressed and the description can be easily associated with the description.
  • “danger” which is a human emotional expression
  • “danger” which is the expression of the psychological situation of a person
  • the illustrations of “sports car” and “horse” are generated as entertainment content for the expression of “cool” that is human psychological expression. To do. In this way, various illustrations such as natural objects and artificial objects can be used as entertainment content.
  • the driver can easily recognize the passenger's state and psychological state by displaying the entertainment content of the passenger of the own vehicle on the in-vehicle display 8. For example, it is possible to easily recognize the situation in which the child in the back seat is sleeping or going to sleep from the entertainment content, and the driver avoids sudden braking, accelerates slowly, etc. It is possible to operate according to.
  • the display color is changed to a warning color such as red or yellow, or You may comprise so that a warning sound may be output from the speaker 10 via the audio
  • the display control unit 7 reads out the entertainment content stored in the entertainment content storage unit 6 and the corresponding vehicle-related information, conversion data, and description of the description, and displays them on the in-vehicle display 8 again, thereby driving operation simulation, etc. It can be used for.
  • the entertainment content is output to one in-vehicle display 8.
  • the entertainment content may be output to a plurality of in-vehicle displays 8.
  • the passenger can have a simulated experience of driving and can give advice to the driver.
  • only entertainment content may be displayed on the display visually recognized by the passenger.
  • the in-vehicle display 8 it may be configured to display simultaneously on a display arranged at a remote location connected by a network. This makes it possible for a family member at home to grasp the running state of the vehicle.
  • the information acquisition part 1 showed the structure provided with several information acquisition means, such as the vehicle-mounted camera 1a, the sensor 1b, and the microphone 1c, even if comprised with any one information acquisition means.
  • any information acquisition means may be selected and configured.
  • vehicle related information is extracted from the acquired host vehicle data and host vehicle peripheral data, and the extracted vehicle related information is compared with a threshold value or the vehicle related information is analyzed.
  • An information conversion unit 2 that selects conversion data based on the result, and a person's emotion, psychology or movement for collation with the expression database 4 based on the conversion data, or an emotion or psychology that the person receives from the conversion data
  • An entertainment content generating unit 3 that acquires an expression describing the estimated emotion, psychology, or movement from the database 4, and an entertainment content that visually indicates the acquired description expression from the content database 5, and the entertainment content on the vehicle display
  • a display control unit 7 that performs control to display on Since the configurations and is not limited to the notification of presence around the vehicle to perform dangerous driving, the running state of the vehicle, passenger state, it is possible to always provide status information with high usability such as around the host vehicle.
  • the content expression 5 is stored so as to be associated with entertainment contents visually shown using illustrations, information that improves recognition performance is provided. Presentation can be realized.
  • the travel state of the host vehicle, the passenger's state, the state around the host vehicle, and the like can be intuitively recognized from the entertainment content, and the driver can promptly reflect it in the driving operation.
  • the description database is configured to include the content database 5 that is stored in association with entertainment contents visually shown using natural or artificial objects, the driver can It is possible to intuitively recognize the traveling state of the vehicle, the passenger's state, the state around the host vehicle, and the like.
  • any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
  • the in-vehicle information device enables presentation of entertainment content that visually indicates the host vehicle state and the surroundings of the host vehicle, the vehicle safety that requires intuitive recognition performance is required. It is suitable for a notification system.
  • 1 information acquisition unit 1a in-vehicle camera, 1b sensor, 1c microphone, 1d navigation device, 1e internet, 1f mobile terminal, 2 information conversion unit, 3 entertainment content generation unit, 4 expression database, 5 content database, 6 entertainment content storage unit 7, display control unit, 8 on-vehicle display, 9 audio output control unit, 10 speakers, 100 on-vehicle information processing device.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Navigation (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This in-vehicle information processing device is equipped with: an information acquisition unit (1) for obtaining information indicating conditions of a vehicle and conditions around the vehicle; a content database (5) for storing image information in the form of pictorial expressions describing the content of specific conditions of predetermined items concerning the vehicle and the surroundings of the vehicle; an information conversion unit (2) that extracts information related to a predetermined item from the information indicating the conditions of the vehicle and conditions around the vehicle and converts the extracted information into information that indicates the content of the condition of the predetermined item; an entertainment content generation unit (3) that estimates the content of a specific condition of the predetermined item from the information that indicates the content of the condition of the predetermined item and obtains image information that corresponds to the content of the estimated specific condition from the content database (5); and a display control unit (7) for displaying the obtained image information on an in-vehicle display (8).

Description

車載情報処理装置In-vehicle information processing equipment
　この発明は、車両に搭載し、自車両および周辺車両の走行状態および自車両周辺環境を示した情報を提示する車載情報処理装置に関するものである。 The present invention relates to an in-vehicle information processing apparatus that is mounted on a vehicle and presents information indicating the traveling state of the host vehicle and surrounding vehicles and the environment surrounding the host vehicle.
　従来より、車両にカメラやセンサなどを搭載し、自車両の周辺で危険な運転を行う車両のデータを収集し、自車両の走行の安全性を高める技術が利用されている。
　例えば特許文献１には、自車両に備えたカメラで周囲を撮影し、周辺車両が危険な運転を行った場合に、周辺車両の映像とその付随情報（位置、日時、車両登録番号など）をサーバに送信し、サーバ側で送信されたデータを用いて付随情報をキーとしたデータベースを作成する危険運転抑制装置が記載されている。車両登録番号などをキーとして作成されたデータベースを検索することにより、関連して保存された画像および付随情報が提供される。これにより、繰り返し危険な走行を行っている車両について、多数の危険行為を行っている画像とその付随情報を提供する。 2. Description of the Related Art Conventionally, a technique has been used in which a camera, a sensor, or the like is mounted on a vehicle to collect data on vehicles that perform dangerous driving around the host vehicle and improve the safety of traveling of the host vehicle.
For example, in Patent Document 1, when the surrounding vehicle is photographed with a camera provided in the own vehicle and the surrounding vehicle performs a dangerous driving, an image of the surrounding vehicle and its accompanying information (position, date, vehicle registration number, etc.) are displayed. There is described a dangerous driving restraint device that creates a database with the accompanying information as a key using data transmitted to the server and transmitted on the server side. By searching a database created using a vehicle registration number or the like as a key, related stored images and accompanying information are provided. As a result, an image in which a number of dangerous acts are performed and the accompanying information are provided for a vehicle that is repeatedly running dangerously.
特開２００２－３４２８８３号公報JP 2002-342883 A
　しかしながら、上述した特許文献１に開示された技術では、繰り返し危険な行為を行っている車両を特定して自車両の運転者に認識させるものであり、危険な行為を行っているか否かに関わることなく自車両の状態および車両周辺の状態を示す情報を提示することはできないという課題があった。また、特許文献１に開示された技術は、データベースを検索し、画像と付随情報を提供するものであり、運転者が、提示された情報から自車両および自車両周辺の状態を直感的に判断することが困難であるという課題があった。 However, in the technique disclosed in Patent Document 1 described above, a vehicle that repeatedly performs a dangerous action is identified and recognized by the driver of the host vehicle, and is related to whether or not a dangerous action is being performed. The subject that the information which shows the state of the own vehicle and the surroundings of a vehicle cannot be shown without it occurred. In addition, the technique disclosed in Patent Document 1 searches a database and provides images and accompanying information, and the driver intuitively determines the host vehicle and the state around the host vehicle from the presented information. There was a problem that it was difficult to do.
　この発明は上記のような課題を解決するためになされたもので、危険運転を行う周辺車両の存在の報知に限定することなく、自車両および自車両周辺の状態を直感的に認識可能な情報を提示することを目的とする。 The present invention has been made to solve the above-described problems, and is not limited to notifying the presence of a surrounding vehicle that performs dangerous driving, but can intuitively recognize the state of the host vehicle and the surroundings of the host vehicle. The purpose is to present.
　この発明に係る車載情報処理装置は、車両の状況および車両周辺の状況を示す情報を取得する情報取得部と、車両および車両周辺における所定の項目の特定の状況内容を形容する表現を画像化した画像情報を蓄積するデータベースと、情報取得部が取得した車両の状況および車両周辺の状況を示す情報から所定の項目に関連する情報を抽出し、抽出した情報を所定の項目の状況内容を示す情報に変換する情報変換部と、情報変換部が変換した所定の項目の状況内容を示す情報から、所定の項目の特定の状況内容を推定し、推定した特定の状況内容に対応した画像情報をデータベースから取得するエンタテイメントコンテンツ生成部と、エンタテイメントコンテンツ生成部が取得した画像情報を表示部に表示する表示制御部とを備えるものである。 The in-vehicle information processing apparatus according to the present invention images an information acquisition unit that acquires information indicating a vehicle situation and a situation around the vehicle, and an expression that describes a specific situation content of a predetermined item in the vehicle and around the vehicle Information relating to a predetermined item is extracted from a database for storing image information and information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and the extracted information is information indicating the status content of the predetermined item An information conversion unit that converts the information into the database, and information indicating the situation content of the predetermined item converted by the information conversion unit, the specific situation content of the predetermined item is estimated, and image information corresponding to the estimated specific situation content is stored in the database An entertainment content generation unit acquired from the display, and a display control unit for displaying the image information acquired by the entertainment content generation unit on the display unit. That.
　この発明によれば、危険運転を行う周辺車両の存在の報知に限定されない利便性の高い情報を提示することができる。また、自車両および自車両周辺の状態を直感的に認識可能な情報を提示することができ、自車両の運転者は速やかに運転操作に反映させることができる。 According to the present invention, it is possible to present highly convenient information that is not limited to notification of the presence of a surrounding vehicle that performs dangerous driving. In addition, information capable of intuitively recognizing the host vehicle and the state around the host vehicle can be presented, and the driver of the host vehicle can quickly reflect the information in the driving operation.
実施の形態１による車載情報処理装置の構成を示すブロック図である。1 is a block diagram illustrating a configuration of an in-vehicle information processing apparatus according to Embodiment 1. FIG. 実施の形態１による車載情報処理装置の情報変換部のテーブルの一例を示す図である。It is a figure which shows an example of the table of the information conversion part of the vehicle-mounted information processing apparatus by Embodiment 1. FIG. 実施の形態１による車載情報処理装置の表現データベースの一例を示す図である。It is a figure which shows an example of the expression database of the vehicle-mounted information processing apparatus by Embodiment 1. 実施の形態１による車載情報処理装置のコンテンツデータベースの一例を示す図である。It is a figure which shows an example of the content database of the vehicle-mounted information processing apparatus by Embodiment 1. FIG. 実施の形態１による車載情報処理装置の動作を示すフローチャートである。3 is a flowchart showing the operation of the in-vehicle information processing apparatus according to the first embodiment. 実施の形態１による車載情報処理装置の処理内容を模式的に示した説明図である。FIG. 3 is an explanatory diagram schematically showing processing contents of the in-vehicle information processing apparatus according to Embodiment 1; 実施の形態１による車載情報処理装置のその他の構成を示すブロック図である。It is a block diagram which shows the other structure of the vehicle-mounted information processing apparatus by Embodiment 1.
　以下、この発明をより詳細に説明するために、この発明を実施するための形態について、添付の図面に従って説明する。
実施の形態１．
　図１は、この発明の実施の形態１による車載情報処理装置１００の構成を示すブロック図である。
　車載情報処理装置１００は、情報取得部１、情報変換部２、エンタテイメントコンテンツ生成部３、表現データベース４、コンテンツデータベース５、エンタテイメントコンテンツ蓄積部６、表示制御部７および車載ディスプレイ（表示部）８で構成されている。 Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram showing the configuration of an in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
The in-vehicle information processing apparatus 100 includes an information acquisition unit 1, an information conversion unit 2, an entertainment content generation unit 3, an expression database 4, a content database 5, an entertainment content storage unit 6, a display control unit 7, and an in-vehicle display (display unit) 8. It is configured.
　情報取得部１は、車載カメラ１ａ、センサ１ｂ、マイク１ｃ、ナビゲーション装置１ｄ、インターネット１ｅ、モバイル端末１ｆなどで構成され、自車両のデータおよび自車両周辺のデータを取得する。自車両周辺のデータとは、例えば自車両の周辺を走行する周辺車両、自車両の周辺を歩行する人、自車両が走行する道路、現在の天候などを示すデータである。情報取得部１の構成は、使用状況に合わせて適宜変更可能である。情報取得部１が多くの情報取得手段で構成されることにより、より多くの情報を取得することができ、現在の自車両の走行状態や自車両周辺の状態に適したエンタテイメントコンテンツを生成することができる。 The information acquisition unit 1 includes an in-vehicle camera 1a, a sensor 1b, a microphone 1c, a navigation device 1d, the Internet 1e, a mobile terminal 1f, and the like, and acquires data of the own vehicle and data around the own vehicle. The data around the host vehicle is data indicating, for example, surrounding vehicles that run around the host vehicle, people walking around the host vehicle, roads on which the host vehicle runs, current weather, and the like. The configuration of the information acquisition unit 1 can be changed as appropriate according to the usage situation. By forming the information acquisition unit 1 with a large number of information acquisition means, more information can be acquired, and entertainment content suitable for the current traveling state of the host vehicle and the surrounding state of the host vehicle is generated. Can do.
　情報変換部２は、情報取得部１が取得した自車両のデータおよび周辺車両のデータから、自車両の運転者が通常の走行において視覚および聴覚により把握可能な情報、すなわち自車両および周辺車両の走行状況、車内および車外の人の状況、車外環境を示す情報など（以下、車両関連情報と称する）などを抽出する。抽出した車両関連情報は、情報変換部２があらかじめ保有しているテーブルに設定された所定の情報に変換される。 The information conversion unit 2 uses the data of the host vehicle and the data of surrounding vehicles acquired by the information acquiring unit 1 to provide information that the driver of the host vehicle can grasp visually and audibly during normal travel, that is, the information about the host vehicle and the surrounding vehicles. Information such as traveling conditions, conditions of people inside and outside the vehicle, information on the environment outside the vehicle (hereinafter referred to as vehicle-related information), and the like are extracted. The extracted vehicle related information is converted into predetermined information set in a table held in advance by the information conversion unit 2.
　エンタテイメントコンテンツ生成部３は、情報変換部２の変換データから推定される自車両の状態および周辺車両の状態に基づいて、自車両の運転者、周辺車両の運転者、自車両の同乗者および車外の人の感情、心理あるいは動静を形容する表現を表現データベース４から取得する。同様に、情報変換部２の車両環境の変換データから推定される車両環境の状態に基づいて、運転者が受け取ると推定される感情や心理を形容する表現を表現データベース４から取得する。さらに、取得した形容表現から連想される概念を視覚的に示したエンタテイメントコンテンツ（画像情報）をコンテンツデータベース５から取得する。 Based on the state of the host vehicle and the state of the surrounding vehicle estimated from the conversion data of the information converting unit 2, the entertainment content generating unit 3 is a driver of the host vehicle, a driver of the surrounding vehicle, a passenger of the host vehicle, and the outside of the vehicle. An expression that describes the emotion, psychology, or movement of a person is acquired from the expression database 4. Similarly, based on the vehicle environment state estimated from the vehicle environment conversion data of the information conversion unit 2, an expression describing the emotion and psychology estimated to be received by the driver is acquired from the expression database 4. Furthermore, entertainment content (image information) that visually shows a concept associated with the acquired adjective expression is acquired from the content database 5.
　表現データベース４は、自車両および周辺車両の運転者、自車両の同乗者および車外の人の感情、心理あるいは動静を形容する表現を蓄積すると共に、車外環境から人が受け取る感情または心理を形容する表現を蓄積する。コンテンツデータベース５は、人の感情、心理あるいは動静を形容する表現をから連想される概念を視覚的に示したイラスト（画像情報）を蓄積する。また、コンテンツデータベース５は、車外環境から人が受け取る感情または心理を形容する表現から連想される注意喚起を視覚的に示したイラスト（画像情報）を蓄積する。エンタテイメントコンテンツ蓄積部６は、エンタテイメントコンテンツ生成部３が取得したエンタテイメントコンテンツと、対応する車両関連情報、変換データおよび形容表現などを関連付けて蓄積する。 The expression database 4 stores expressions describing emotions, psychology or movements of the driver of the own vehicle and the surrounding vehicles, passengers of the own vehicle and people outside the vehicle, and describes emotions or psychology received by the person from the outside environment. Accumulate expressions. The content database 5 accumulates illustrations (image information) that visually indicate concepts that are associated with expressions that describe human emotions, psychology, or movement. In addition, the content database 5 stores illustrations (image information) that visually indicate alerts associated with expressions that describe emotions or psychology received by people from outside the vehicle. The entertainment content storage unit 6 stores the entertainment content acquired by the entertainment content generation unit 3 in association with the corresponding vehicle-related information, conversion data, and description of the description.
　表示制御部７は、エンタテイメントコンテンツ生成部３が生成したエンタテイメントコンテンツを車載ディスプレイ８に表示する制御を行う。例えば、車載ディスプレイ８にナビゲーション画面を表示している場合には、当該ナビゲーション画面の相当する位置にエンタテイメントコンテンツを配置する表示制御を行う。また、操作入力部（不図示）などを介して入力された読み出し指示に従って、エンタテイメントコンテンツ蓄積部６から相当するエンタテイメントコンテンツを読み出し、車載ディスプレイ８に表示する制御を行う。車載ディスプレイ８は、例えばＬＣＤ（Ｌｉｑｕｉｄ　Ｃｒｙｓｔａｌ　Ｄｉｓｐｌａｙ）で構成され、表示制御部７の表示制御に基づいて、エンタテイメントコンテンツを例えばナビゲーション画面の所定の位置に重畳表示する。 The display control unit 7 performs control to display the entertainment content generated by the entertainment content generation unit 3 on the in-vehicle display 8. For example, when a navigation screen is displayed on the in-vehicle display 8, display control is performed to arrange entertainment content at a corresponding position on the navigation screen. Further, in accordance with a read instruction input via an operation input unit (not shown) or the like, the corresponding entertainment content is read from the entertainment content storage unit 6 and displayed on the in-vehicle display 8. The in-vehicle display 8 is composed of, for example, an LCD (Liquid Crystal Display), and superimposes the entertainment content on a predetermined position of the navigation screen based on the display control of the display control unit 7.
　次に、各構成をより詳細に説明する。
　情報取得部１は、上述のように例えば、車載カメラ１ａ、センサ１ｂ、マイク１ｃ、ナビゲーション装置１ｄ、インターネット１ｅおよびモバイル端末１ｆなどで構成される。
　車載カメラ１ａは、自車両および自車両の周辺状況を撮影するものであり、自車両の車内に設置された車載カメラは運転者や同乗者の状況を撮影し、自車両の車外に設置された車載カメラは、自車両と周辺車両との関係、周辺車両の走行状況、および車外環境などを撮影する。車載カメラ１ａは、車両前方と後方、車両内部と外部に設置するなど複数配置することが可能である。 Next, each configuration will be described in more detail.
As described above, the information acquisition unit 1 includes, for example, the in-vehicle camera 1a, the sensor 1b, the microphone 1c, the navigation device 1d, the Internet 1e, the mobile terminal 1f, and the like.
The in-vehicle camera 1a captures the host vehicle and the surroundings of the host vehicle, and the in-vehicle camera installed inside the host vehicle captures the situation of the driver and passengers and is installed outside the host vehicle. The in-vehicle camera captures the relationship between the host vehicle and the surrounding vehicle, the driving situation of the surrounding vehicle, the environment outside the vehicle, and the like. A plurality of in-vehicle cameras 1a can be arranged such as being installed in the front and rear of the vehicle, and inside and outside the vehicle.
　センサ１ｂは、自車両および周辺車両の走行状況を検知する種々のセンサで構成される。例えば、自車両の周辺状況を監視するための距離センサ、自車両の走行状況を検知するための速度センサ、加速度センサ、運転者の運転操作を検知するための操舵角センサ、アクセル開度センサ、ブレーキセンサ、ギアチェンジレバーセンサ、自車両の同乗者の様子を検知するための人感センサなどが設けられる。センサ１ｂは、取得する情報に応じて複数配置可能である。 The sensor 1b is composed of various sensors that detect the running conditions of the host vehicle and surrounding vehicles. For example, a distance sensor for monitoring the surrounding state of the host vehicle, a speed sensor for detecting the traveling state of the host vehicle, an acceleration sensor, a steering angle sensor for detecting the driving operation of the driver, an accelerator opening sensor, A brake sensor, a gear change lever sensor, a human sensor for detecting a passenger's state of the own vehicle, and the like are provided. A plurality of sensors 1b can be arranged according to information to be acquired.
　マイク１ｃは、自車両内および自車両外に配置され、自車両の車内の音声や、周辺車両などが発する音を集音する。マイク１ｃも取得する情報に応じて複数配置可能である。ナビゲーション装置１ｄは、自車両の走行距離や時間、走行中の道路種別や道路の混雑状況など車外環境を示す情報を取得する。インターネット１ｅは、車載カメラ１ａやモバイル端末１ｆが撮影した周辺車両の撮影映像から周辺車両の車種情報を取得する。モバイル端末１ｆは、運転者や同乗者の通話履歴に基づいて、運転者や同乗者の性格などを推定してもよい。 The microphone 1c is arranged inside and outside the host vehicle, and collects sounds inside the host vehicle and sounds generated by surrounding vehicles. A plurality of microphones 1c can be arranged according to information to be acquired. The navigation device 1d acquires information indicating the environment outside the vehicle, such as the travel distance and time of the host vehicle, the type of road on which the vehicle is traveling, and the congestion status of the road. The Internet 1e acquires the vehicle type information of the surrounding vehicles from the captured images of the surrounding vehicles captured by the in-vehicle camera 1a and the mobile terminal 1f. The mobile terminal 1f may estimate the personality of the driver and passengers based on the call history of the driver and passengers.
　次に、情報変換部２について説明する。
　情報変換部２は、まず情報取得部１が取得したデータから車両関連情報を抽出する。抽出した車両関連情報は、情報変換部２があらかじめ保有するテーブルに設定された自車両の動き、周辺車両の動き、道路の状況などを示す変換データに変換される。データの変換方法は種々あるが、例えば車両関連情報の値と、あらかじめ設定されたしきい値とを比較し、比較結果に該当する変換データをテーブルから選択する。また、車両関連情報のうち車載カメラ１ａの撮影映像やナビゲーション装置１ｄのナビ情報を解析し、解析結果に該当する変換データをテーブルから選択する。 Next, the information conversion unit 2 will be described.
The information conversion unit 2 first extracts vehicle related information from the data acquired by the information acquisition unit 1. The extracted vehicle-related information is converted into conversion data indicating the movement of the host vehicle, the movement of surrounding vehicles, the road situation, and the like set in a table held in advance by the information conversion unit 2. There are various data conversion methods. For example, the value of the vehicle-related information is compared with a preset threshold value, and conversion data corresponding to the comparison result is selected from the table. Moreover, the in-vehicle camera 1a of the vehicle-related information and the navigation information of the navigation device 1d are analyzed, and conversion data corresponding to the analysis result is selected from the table.
　図２は、この発明の実施の形態１による車載情報処理装置１００の情報変換部２が保有し、参照するテーブルの一例を示す図である。
　テーブルは、「変換対象」および「変換データ」で構成される。変換対象（所定の項目）は、例えば「自車両の動き」、「周辺車両の動き」、「自車両周辺の人の動き」、「車室内の人の動き」、「空の状況」、「道路の状況」、「交通信号の状況」、「交通標識の状況」などの項目で構成される。 FIG. 2 is a diagram showing an example of a table held and referred to by the information conversion unit 2 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
The table is composed of “conversion object” and “conversion data”. The conversion target (predetermined item) is, for example, “movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, “movement of people in the passenger compartment”, “empty situation”, “ It consists of items such as “road situation”, “traffic signal situation”, and “traffic sign situation”.
　変換データは、車両の左右方向の移動、前後方向の車両との関係、運転者の特徴的動作、車外の人の特徴的な動作や特徴的な分類、車内の人の特徴的な動作、現在の天候の特徴、走行中の道路の特徴、交通信号および交通標識の視認性に関する特徴などを示すデータで構成される。なお、図２の例では、車両関連情報の判断手法を合わせて記載しているが、テーブル内に当該判断手法を蓄積していなくてもよい。 The conversion data includes the lateral movement of the vehicle, the relationship with the vehicle in the front-rear direction, the characteristic behavior of the driver, the characteristic behavior and characteristic classification of the person outside the vehicle, the characteristic behavior of the person inside the vehicle, It is composed of data indicating the characteristics of the weather, the characteristics of the road on the road, the characteristics regarding the visibility of traffic signals and traffic signs, and the like. In the example of FIG. 2, the determination method of the vehicle related information is described together, but the determination method may not be stored in the table.
　図２で示したテーブルを用いて、情報変換部２が自車両の動きを変換データに変換する例を示すと、センサ１ｂが取得したふらつき度合Ａをしきい値Ｐと比較し、ふらつき度合Ａがしきい値Ｐ未満である場合には「左右にふらつかない」との変換データを選択する。一方、ふらつき度合Ａがしきい値Ｐ以上である場合には「左右にふらつく」との変換データを選択する。さらに、ふらつき度合Ａがしきい値Ｐ以上である状態が所定時間以上続く場合には「蛇行運転」との変換データを選択する。 An example in which the information conversion unit 2 converts the movement of the host vehicle into converted data using the table shown in FIG. 2 is compared with the threshold value P obtained by the sensor 1b. Is less than the threshold value P, the conversion data “Do not wobble from side to side” is selected. On the other hand, if the degree of fluctuation A is equal to or greater than the threshold value P, the conversion data of “fluctuate left and right” is selected. Furthermore, when the state where the degree of fluctuation A is equal to or greater than the threshold value P continues for a predetermined time or longer, the conversion data “meandering operation” is selected.
　また、センサ１ｂが取得した車間距離Ｂをしきい値Ｑと比較し、車間距離Ｂがしきい値Ｑ未満である場合には「車間距離が短い」との変換データを選択する。一方、車間距離Ｂがしきい値Ｑ以上である場合には「車間距離が長い」との変換データを選択する。また、自車両内の撮影映像を解析した結果、運転者が正面を向いていないと判断した場合には「脇見運転」との変換データを選択する。 Further, the inter-vehicle distance B acquired by the sensor 1b is compared with the threshold value Q, and if the inter-vehicle distance B is less than the threshold value Q, conversion data “the inter-vehicle distance is short” is selected. On the other hand, when the inter-vehicle distance B is equal to or greater than the threshold value Q, the conversion data “the inter-vehicle distance is long” is selected. In addition, as a result of analyzing the captured video in the own vehicle, if it is determined that the driver is not facing the front, the conversion data of “side looking driving” is selected.
　次に、エンタテイメントコンテンツ生成部３、表現データベース４およびコンテンツデータベース５について説明する。
　エンタテイメントコンテンツ生成部３は、「自車両の動き」、「周辺車両の動き」、「自車両周辺の人の動き」および「車室内の人の動き」として情報変換部２が変換した複数の変換データに基づいて、表現データデータベース４と照合するための自車両の運転者の運転状態、周辺車両の運転者の運転状態、自車両周辺の人の状態および車室内の人の状態を推定し、推定した各状態に基づいて運転者や人の感情、心理あるいは動静を形容する表現をデータベース４から取得する。
　具体例を挙げて説明すると、「自車両の動き」として変換された「通話しながらの運転」、「車間距離が長い」および「脇見運転」との変換データに基づいて、自車両の運転者の運転状態が「マイペースな運転」であると推定する。推定した「マイペースな運転」に基づいて運転者の心理を形容する表現「ニコニコ」をデータベース４から取得する。 Next, the entertainment content generation unit 3, the expression database 4, and the content database 5 will be described.
The entertainment content generation unit 3 performs a plurality of conversions converted by the information conversion unit 2 as “movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, and “movement of people in the passenger compartment”. Based on the data, the driving state of the driver of the own vehicle, the driving state of the driver of the surrounding vehicle, the state of the person around the own vehicle, and the state of the person in the passenger compartment are estimated based on the data. Based on each estimated state, an expression describing the driver's or person's emotion, psychology or movement is acquired from the database 4.
To explain with specific examples, the driver of the host vehicle is converted based on the converted data of “Driving while talking”, “Long distance between vehicles” and “Wakimi driving” converted as “Vehicle movement”. It is estimated that the driving state is “My paced driving”. An expression “niconico” that describes the driver's psychology is acquired from the database 4 based on the estimated “my pace driving”.
　また、エンタテイメントコンテンツ生成部３は、「空の状況」、「道路の状況」、「交通信号の状況」、「交通標識の状況」として情報変換部２が変換した複数の変換データに基づいて、表現データベース４と照合するための自車両の運転者が受ける印象を推定し、推定した各印象に基づいて運転者の感情あるいは心理を形容する表現をデータベース４から取得する。
　具体例を挙げて説明すると、「空の状況」として変換された「夜」および「雨」との変換データから運転者が「運転し難い」との印象を受けると推定する。推定した「運転し難い」に基づいて運転者の心理を形容する表現「ハラハラ」をデータベース４から取得する。 In addition, the entertainment content generation unit 3 is based on a plurality of conversion data converted by the information conversion unit 2 as “sky situation”, “road situation”, “traffic signal situation”, and “traffic sign situation”. The impression received by the driver of the host vehicle for collation with the expression database 4 is estimated, and an expression describing the driver's emotion or psychology is acquired from the database 4 based on each estimated impression.
To explain with a specific example, it is estimated that the driver receives the impression that “it is difficult to drive” from the converted data of “night” and “rain” converted as “sky situation”. Based on the estimated “difficult to drive”, an expression “Harahara” that describes the psychology of the driver is acquired from the database 4.
　その後、エンタテイメントコンテンツ生成部３は、データベース４から取得した形容表現から連想される概念を視覚的に示したイラストをエンタテイメントコンテンツとしてコンテンツデータベース５から取得する。 Thereafter, the entertainment content generation unit 3 acquires from the content database 5 as an entertainment content an illustration visually showing a concept associated with the description of the description acquired from the database 4.
　図３は、この発明の実施の形態１による車載情報処理装置１００の表現データベース４の一例を示す図である。
　表現データベース４は、「コンテンツ生成対象」および「形容表現」で構成される。コンテンツ生成対象は、図２で示した変換対象と同様の項目「自車両の動き」、「周辺車両の動き」、「自車両周辺の人の動き」、「車室内の人の動き」、「空の状況」、「道路の状況」、「交通信号の状況」、「交通標識の状況」などで構成される。
　「自車両の動き」、「周辺車両の動き」、「自車両周辺の人の動き」、「車室内の人の動き」に対する形容表現は、人の感情表現（喜怒哀楽、ニコニコなど）、人の心理表現（汚い、怖い、危ない、美しいなど）、動静表現（セカセカなど）で構成される。一方、「空の状況」、「道路の状況」、「交通信号の状況」、「交通標識の状況」に対する形容表現は、該当する情報から人が受け取る感情表現（爽やか、デコボコなど）および心理表現（見えにくい、わかりにくいなど）を示す文字列で構成される。 FIG. 3 is a diagram showing an example of the expression database 4 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
The expression database 4 includes “content generation target” and “adjective expression”. The content generation target is the same items as the conversion target shown in FIG. 2 "movement of own vehicle", "movement of surrounding vehicles", "movement of people around the own vehicle", "movement of people in the vehicle interior", " It is composed of “empty situation”, “road situation”, “traffic signal situation”, “traffic sign situation”, and the like.
Explain expressions for "movement of own vehicle", "movement of surrounding vehicles", "movement of people around the own vehicle", and "movement of people in the passenger compartment" are expressions of human emotions (emotions, emotions, smiles, etc.) Consists of human psychological expressions (dirty, scary, dangerous, beautiful, etc.) and dynamic expressions (Secaseca, etc.). On the other hand, description expressions for “sky situation”, “road situation”, “traffic signal situation”, and “traffic sign situation” are emotional expressions (refreshing, squeaky, etc.) and psychological expressions that people receive from the corresponding information. Consists of character strings that indicate (difficult to see, difficult to understand).
　図４は、この発明の実施の形態１による車載情報処理装置１００のコンテンツデータベース５の一例を示す図である。
Figure JPOXMLDOC01-appb-I000001
FIG. 4 is a diagram showing an example of the content database 5 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
Figure JPOXMLDOC01-appb-I000001
　図４に示したように、自車両の動きを示す場合には丸顔のイラストを用い、周辺車両の動き、自車両周辺の人の動き、および車室内の人の動きを示す場合には四角顔のイラストを用いるなど、自車両の動きとそれ以外とを区別したイラスト表記を用いることにより、視認性を向上させることができる。イラスト表記の区別は、形状によるものに限定されることなく、色や点滅表示などによるものでもよい。 As shown in FIG. 4, a round face illustration is used to show the movement of the host vehicle, and a square is used to show the movement of surrounding vehicles, the movement of people around the own vehicle, and the movement of people in the passenger compartment. Visibility can be improved by using illustration notation that distinguishes the movement of the host vehicle from the rest, such as using a face illustration. The distinction of the illustration notation is not limited to the shape, but may be based on a color or blinking display.
　次に、「道路の状況」を例に説明すると、形容表現が「イライラ」、「ドキドキ」、「デコボコ」、「汚い」、「怖い」、「危ない」、「暗い」、「見えにくい」の場合には「路面注意！」を明示したイラストが対応付けられ、形容表現が「イライラ」、「ドキドキ」、「暗い」、「見えにくい」の場合には「視界不良注意！」を明示したイラストが対応付けられる。一方、形容表現が「ニコニコ」、「きれい」、「明るい」、「見やすい」の場合には注意喚起が必要でないため、イラストは設定されない。 Next, taking the “road situation” as an example, the description is “irritated”, “pounding”, “decorative”, “dirty”, “scary”, “dangerous”, “dark”, “difficult to see” In this case, an illustration clearly stating "Road attention!" Is associated, and if the description is "irritated", "pounding", "dark", or "difficult to see", an illustration clearly stating "noticeful visibility!" Are associated. On the other hand, when the expression is “Nico Nico”, “Beautiful”, “Bright”, or “Easy to see”, no alert is required and no illustration is set.
　次に、車載情報処理装置１００の動作について説明する。
　図５は、この発明の実施の形態１による車載情報処理装置１００の動作を示すフローチャートである。なお以下の説明では、車載情報処理装置１００には、あらかじめエンタテイメントコンテンツを生成するか否か、データを再取得するか否か、エンタテイメントコンテンツを蓄積するか否か、エンタテイメントコンテンツを車載ディスプレイ８に表示するか否かが設定されている（以下、設定条件と称する）ものとする。 Next, the operation of the in-vehicle information processing apparatus 100 will be described.
FIG. 5 is a flowchart showing the operation of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention. In the following description, the in-vehicle information processing apparatus 100 displays on the in-vehicle display 8 whether to generate entertainment content in advance, whether to re-acquire data, whether to accumulate entertainment content, or not. It is assumed that whether or not to set is set (hereinafter referred to as setting conditions).
　まず車載情報処理装置１００は、設定条件を参照し、エンタテイメントコンテンツを生成するか否か判定する（ステップＳＴ１）。エンタテイメントコンテンツを生成しない場合（ステップＳＴ１；ＮＯ）、処理を終了する。一方、エンタテイメントコンテンツを生成する場合（ステップＳＴ１；ＹＥＳ）、情報取得部１は、自車両データ、および自車両周辺データを取得する（ステップＳＴ２）。情報変換部２は、ステップＳＴ２で取得された自車両データおよび自車両周辺データから、自車両の動き、周辺車両の動き、車両周辺の人の動き、車室内の人の動き、空の状況、道路の状況、交通信号の状況、および交通標識の状況など、自車両の運転者が把握可能な車両関連情報を抽出する（ステップＳＴ３）。さらに、あらかじめ保有しているテーブルを参照して、ステップＳＴ３で抽出した車両関連情報に相当する変換データを取得する（ステップＳＴ４）。 First, the in-vehicle information processing apparatus 100 refers to the setting condition and determines whether to generate entertainment content (step ST1). If entertainment content is not generated (step ST1; NO), the process ends. On the other hand, when generating entertainment content (step ST1; YES), the information acquisition unit 1 acquires host vehicle data and host vehicle peripheral data (step ST2). The information conversion unit 2 determines the movement of the own vehicle, the movement of the surrounding vehicle, the movement of the person around the vehicle, the movement of the person in the vehicle interior, the situation of the sky, from the own vehicle data and the surrounding data of the own vehicle acquired in step ST2. Vehicle-related information that can be grasped by the driver of the host vehicle, such as road conditions, traffic signal conditions, and traffic sign conditions, is extracted (step ST3). Further, conversion data corresponding to the vehicle-related information extracted in step ST3 is acquired with reference to a table held in advance (step ST4).
　エンタテイメントコンテンツ生成部３は、ステップＳＴ４で変換された変換データに基づいて、表現データベース４と照合するための自車両または周辺車両の運転者の運転状態、同乗者または車外の人の状態を推定すると共に、車外環境から運転者が受ける印象を推定する（ステップＳＴ５）。さらにエンタテイメントコンテンツ生成部３は、推定した運転状態、人の状態、運転者が受ける印象に該当する形容表現が、表現データベース４に蓄積されているか否か判定を行う（ステップＳＴ６）。該当する形容表現が蓄積されていない場合（ステップＳＴ６；ＮＯ）、設定条件を参照し、再度自車両データおよび自車両周辺データを取得するか否か判定を行う（ステップＳＴ７）。再度、自車両データおよび自車両周辺データを取得する場合（ステップＳＴ７；ＹＥＳ）、ステップＳＴ１の処理に戻り、上述した処理を繰り返す。一方、自車両データおよび自車両周辺データを取得しない場合（ステップＳＴ７；ＮＯ）、処理を終了する。 The entertainment content generation unit 3 estimates the driving state of the driver of the host vehicle or the surrounding vehicle and the state of the passenger or the person outside the vehicle for collation with the expression database 4 based on the converted data converted in step ST4. At the same time, the impression received by the driver from the environment outside the vehicle is estimated (step ST5). Furthermore, the entertainment content generation unit 3 determines whether or not a description expression corresponding to the estimated driving state, the state of the person, and the impression received by the driver is stored in the expression database 4 (step ST6). When the corresponding adjective expression is not accumulated (step ST6; NO), it is determined whether or not the own vehicle data and the own vehicle surrounding data are acquired again with reference to the set condition (step ST7). When the own vehicle data and the own vehicle surrounding data are acquired again (step ST7; YES), the process returns to step ST1, and the above-described process is repeated. On the other hand, when the own vehicle data and the own vehicle surrounding data are not acquired (step ST7; NO), the process is terminated.
　一方、該当する形容表現が蓄積されている場合（ステップＳＴ６；ＹＥＳ）、エンタテイメントコンテンツ生成部３は該当する形容表現を選択し（ステップＳＴ８）、さらにコンテンツデータベース５を参照して選択した形容表現に対応するイラストであるエンタテイメントコンテンツを取得する（ステップＳＴ９）。エンタテイメントコンテンツ生成部３は、取得したエンタテイメントコンテンツに加えて、対応する車両関連情報、変換データおよび形容表現などをエンタテイメントコンテンツ蓄積部６に蓄積するか否か判定を行う（ステップＳＴ１０）。蓄積しない場合（ステップＳＴ１０；ＮＯ）、ステップＳＴ１２の処理に進む。一方、蓄積する場合（ステップＳＴ１０；ＹＥＳ）、データをエンタテイメントコンテンツ蓄積部６に蓄積する（ステップＳＴ１１）。 On the other hand, if the corresponding adjective expression is accumulated (step ST6; YES), the entertainment content generation unit 3 selects the relevant adjective expression (step ST8), and further refers to the content database 5 to the selected adjective expression. Entertainment content that is a corresponding illustration is acquired (step ST9). The entertainment content generation unit 3 determines whether to store corresponding vehicle-related information, conversion data, description of description, and the like in the entertainment content storage unit 6 in addition to the acquired entertainment content (step ST10). When not storing (step ST10; NO), it progresses to the process of step ST12. On the other hand, when accumulating (step ST10; YES), the data is accumulated in the entertainment content accumulating unit 6 (step ST11).
　さらに、エンタテイメントコンテンツ生成部３は、設定条件を参照してステップＳＴ９で取得したエンタテイメントコンテンツを車載ディスプレイ８に表示するか否か判定を行う（ステップＳＴ１２）。車載ディスプレイ８に表示しない場合（ステップＳＴ１２；ＮＯ）、ステップＳＴ１４の処理に進む。車載ディスプレイ８に表示する場合（ステップＳＴ１２；ＹＥＳ）、表示制御部７を介して車載ディスプレイ８にエンタテイメントコンテンツを表示する（ステップＳＴ１３）。 Further, the entertainment content generation unit 3 determines whether or not to display the entertainment content acquired in step ST9 on the in-vehicle display 8 with reference to the setting condition (step ST12). When not displaying on the vehicle-mounted display 8 (step ST12; NO), it progresses to the process of step ST14. When displaying on the vehicle-mounted display 8 (step ST12; YES), an entertainment content is displayed on the vehicle-mounted display 8 via the display control part 7 (step ST13).
　その後、エンタテイメントコンテンツ生成部３は、設定条件を参照して、自車両データおよび自車両周辺データの取得を継続するか否か判定を行う（ステップＳＴ１４）。継続しない場合（ステップＳＴ１４；ＮＯ）、処理を終了する。一方、継続する場合（ステップＳＴ１４；ＹＥＳ）、ステップＳＴ２の処理に戻り、上述した処理を繰り返す。 Thereafter, the entertainment content generation unit 3 refers to the setting condition and determines whether or not to continue acquiring the own vehicle data and the surrounding data of the own vehicle (step ST14). When not continuing (step ST14; NO), a process is complete | finished. On the other hand, when continuing (step ST14; YES), it returns to the process of step ST2 and repeats the process mentioned above.
　上述した図５のフローチャートでは、あらかじめ設定条件が設定されている場合を例に示したが、あらかじめ設定条件を設定することなく、ステップＳＴ１、ＳＴ７、ＳＴ１０、ＳＴ１２においてユーザの選択入力を求める画面を車載ディスプレイ８に表示する、あるいはユーザの選択入力を求める音声アナウンスをスピーカ（不図示）から出力するように構成してもよい。 In the flowchart of FIG. 5 described above, the case where the setting conditions are set in advance is shown as an example, but the screen for requesting the user's selection input in steps ST1, ST7, ST10, and ST12 without setting the setting conditions in advance. You may comprise so that the audio | voice announcement which displays on the vehicle-mounted display 8 or a user's selection input may be output from a speaker (not shown).
　次に、上述した図５のフローチャートに沿って、取得された自車両データおよび自車両周辺データからエンタテイメントコンテンツが生成されるまでの具体例を、図６を参照しながら説明する。
　図６は、この発明の実施の形態１による車載情報処理装置１００の処理内容を模式的に示した説明図である。図６（ａ）は情報取得部の構成例を示し、図６（ｂ）は情報変換部の変換処理例を示し、図６（ｃ）はエンタテイメントコンテンツ生成部の生成例を示し、図６（ｄ）は表現データベースの構成例を示し、図６（ｅ）はコンテンツデータベースの構成例を示し、図６（ｆ）は車載ディスプレイの表示例を示す。 Next, a specific example until entertainment content is generated from the acquired host vehicle data and host vehicle peripheral data will be described with reference to FIG.
FIG. 6 is an explanatory diagram schematically showing the processing contents of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention. 6A shows a configuration example of the information acquisition unit, FIG. 6B shows a conversion processing example of the information conversion unit, FIG. 6C shows a generation example of the entertainment content generation unit, and FIG. d) shows a configuration example of the expression database, FIG. 6 (e) shows a configuration example of the content database, and FIG. 6 (f) shows a display example of the in-vehicle display.
　図６（ａ）に示すように、情報取得部１は車載カメラ１ａ、センサ１ｂ、マイク１ｃ、ナビゲーション装置１ｄ、モバイル端末１ｆで構成される。情報取得部１の各構成は、ステップＳＴ２として自車両データおよび自車両周辺データを取得する。 As shown in FIG. 6A, the information acquisition unit 1 includes an in-vehicle camera 1a, a sensor 1b, a microphone 1c, a navigation device 1d, and a mobile terminal 1f. Each structure of the information acquisition part 1 acquires own vehicle data and own vehicle surrounding data as step ST2.
　図６（ｂ）に示すように、ステップＳＴ２で取得されたデータから、ステップＳＴ３として車両関連情報を抽出する。車両関連情報は「自車両の動き」、「周辺車両の動き」、「空の状況」、「道路の状況」に分類されて抽出され、例えば「自車両の動き」について運転者の表情を撮影した撮影映像、車体のふらつき情報、車内状態および車速測定の結果が抽出される。 As shown in FIG. 6B, vehicle-related information is extracted as step ST3 from the data acquired in step ST2. Vehicle-related information is classified and extracted as “movement of own vehicle”, “movement of surrounding vehicles”, “sky situation”, and “road situation”, for example, photographing the driver's facial expression about “movement of own vehicle” The captured image, the vehicle wobble information, the in-vehicle state and the vehicle speed measurement result are extracted.
　次に、ステップＳＴ４として、車両関連情報としきい値との比較、あるいは車両関連情報の解析結果に基づいて、変換データをテーブルから選択する。例えば、運転者の表情を撮影した撮影映像の解析結果から「目がパッチリ明いている」との変換データを選択し、車速測定結果をしきい値と比較することにより「制限速度より遅い」との変換データを選択する。 Next, as step ST4, conversion data is selected from the table based on the comparison between the vehicle related information and the threshold value or the analysis result of the vehicle related information. For example, from the analysis result of the shot image that captured the driver's facial expression, select conversion data that is `` eyes are patchy '' and compare the vehicle speed measurement result with the threshold value to say `` slower than the speed limit '' Select the conversion data.
　図６（ｃ）に示すように、ステップＳＴ４で選択された変換データから、ステップＳＴ５として自車両の運転者および周辺車両の運転者の運転状態、空の状況および道路の状況から自車両の運転者が受ける印象を推定する。例えば、図６（ｂ）で示した自車両の動きを示した５つの変換データから、自車両の運転者の運転状態を「通話中のため周囲の状況を把握していない」と推定する。同様に、図６（ｂ）で示した空の状況を示した２つの変換データから、車外環境から自車両の運転者が受ける印象を「注意を必要とする」と推定する。 As shown in FIG. 6 (c), based on the conversion data selected in step ST4, in step ST5, the driving of the host vehicle is determined based on the driving state, the sky condition, and the road condition of the driver of the host vehicle and the surrounding vehicles. The impression that the person will receive. For example, from the five conversion data indicating the movement of the host vehicle shown in FIG. 6B, the driving state of the driver of the host vehicle is estimated as “because of a call, the surrounding situation is not grasped”. Similarly, from the two conversion data indicating the empty situation shown in FIG. 6B, the impression received by the driver of the host vehicle from the outside environment is estimated as “needs attention”.
　続いて、ステップＳＴ６およびステップＳＴ８として、図６（ｄ）に示した表現データベース４を参照して、ステップＳＴ５で推定した運転状態および印象を形容する表現を取得する。例えば、自車両の運転者について「通話中のため、周囲の状況を把握していない」と推定した運転状態に対して「ニコニコ」との形容表現を取得する。また、車外環境から自車両の運転者が受けた「注意を必要とする」との印象に対して「ハラハラ」との形容表現を取得する。 Subsequently, as step ST6 and step ST8, referring to the expression database 4 shown in FIG. 6D, expressions expressing the driving state and impression estimated in step ST5 are acquired. For example, for the driver of the own vehicle, an adjective expression “Nico Nico” is acquired with respect to the driving state estimated as “because of the call, the surrounding situation is not grasped”. In addition, for the impression that “the driver needs attention” received by the driver of the host vehicle from the outside environment, an adjective expression “Harahara” is acquired.
Figure JPOXMLDOC01-appb-I000002
Figure JPOXMLDOC01-appb-I000002
　図６（ｆ）に示すように、表示制御部７は、ステップＳＴ９で取得したエンタテイメントコンテンツを、ステップＳＴ１３として車載ディスプレイ８に表示する。図６（ｆ）のように車載ディスプレイ８にナビ画面を表示している場合には、走行中の道路上の相当する位置に自車両および周辺車両のエンタテイメントコンテンツを表示する。さらに、ナビ画面の空き領域に、車外環境を示すエンタテイメントコンテンツを表示する。 As shown in FIG. 6 (f), the display control unit 7 displays the entertainment content acquired in step ST9 on the in-vehicle display 8 as step ST13. When the navigation screen is displayed on the in-vehicle display 8 as shown in FIG. 6 (f), entertainment contents of the host vehicle and the surrounding vehicles are displayed at corresponding positions on the running road. Furthermore, entertainment content indicating the environment outside the vehicle is displayed in an empty area of the navigation screen.
　なお、自車両の運転者に対して注意を喚起させるエンタテイメントコンテンツが生成された場合には、車載情報処理装置１００が備えるスピーカ１０を介して音声アナウンスを出力するように構成してもよい（図６（ｃ）および図６（ｆ）参照）。図６（ｆ）の例では、自車両の後方にイライラした周辺車両が存在し、且つ路面に注意する必要があるため「後方注意！路面注意！」との音声アナウンスを出力する。 In addition, when the entertainment content which alerts the driver | operator of the own vehicle is produced | generated, you may comprise so that an audio | voice announcement may be output via the speaker 10 with which the vehicle-mounted information processing apparatus 100 is provided (FIG. 6 (c) and FIG. 6 (f)). In the example of FIG. 6 (f), since there is an irritated surrounding vehicle behind the host vehicle and it is necessary to pay attention to the road surface, a voice announcement “rear warning! Road attention!” Is output.
　この音声アナウンス機能を備えた車載情報処理装置１００の構成を図７に示す。図７は、この発明の実施の形態１による車載情報処理装置１００のその他の構成を示すブロック図である。図１で示した車載情報処理装置１００に音声出力制御部９およびスピーカ１０を追加して設けている。
　音声出力制御部９は、エンタテイメントコンテンツ生成部３が生成したエンタテイメントコンテンツをスピーカ１０から音声出力する制御を行う。スピーカ１０は、音声出力制御部９の音声出力制御に基づいて、エンタテイメントコンテンツに応じた音声アナウンスを出力する。エンタテイメントコンテンツに応じた音声アナウンスを出力することにより、自車両の運転者は自車両の状況および自車両の周辺状況をより認識しやすくなる。 FIG. 7 shows a configuration of the in-vehicle information processing apparatus 100 having the voice announcement function. FIG. 7 is a block diagram showing another configuration of in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention. An audio output control unit 9 and a speaker 10 are additionally provided in the in-vehicle information processing apparatus 100 shown in FIG.
The audio output control unit 9 performs control to output the entertainment content generated by the entertainment content generation unit 3 from the speaker 10. The speaker 10 outputs an audio announcement according to the entertainment content based on the audio output control of the audio output control unit 9. By outputting a voice announcement according to the entertainment content, the driver of the host vehicle can more easily recognize the situation of the host vehicle and the surrounding situation of the host vehicle.
　図６（ｆ）で示した車載ディスプレイ８の表示例は一例であり、走行状態や走行場面により多種多様な表示を行うことができる。例えば、自車両の前を走行する車両が蛇行運転と速度の加減速が激しい場合には、当該車両の運転者はイライラしていると推定し、自車両の前を走行する車両を「怒」を示すイラストで示す。また、交通信号が右折可の場合に直進車両が交差点に進入してきた場合には、自車両の運転者がハラハラしていると推定し、自車両を「ハラハラ」を示すイラストで示す。 The display example of the in-vehicle display 8 shown in FIG. 6F is an example, and various displays can be performed depending on the driving state and the driving scene. For example, if a vehicle traveling in front of the host vehicle is meandering and acceleration / deceleration of the speed is severe, it is estimated that the driver of the vehicle is frustrated and the vehicle traveling in front of the host vehicle is angry. An illustration showing In addition, when a traffic signal is allowed to turn right and a straight vehicle enters the intersection, it is estimated that the driver of the host vehicle is in danger, and the subject vehicle is indicated by an illustration indicating “in danger”.
　上述した例では、エンタテイメントコンテンツを人の顔を示したイラストおよび注意喚起を示すイラストを表示したが、当該イラストは自車両、周辺車両、自車両の同乗者、自車両周辺の人および車外環境の状況を適切に表現し、且つ表示内容から容易に形容表現が連想可能なイラストであればどのようなもので構成してもよい。例えば、人の感情表現である「怒」の形容表現に対して「鬼」や「山の噴火」のイラストをエンタテイメントコンテンツとして生成する、人の心理状況表現である「危ない」の形容表現に対して「銃」や「ライオンの顔」のイラストをエンタテイメントコンテンツとして生成する、人の心理表現である「格好良い」の形容表現に対して「スポーツカー」や「馬」のイラストをエンタテイメントコンテンツとして生成する。このように、自然物や人工物など種々のイラストをエンタテイメントコンテンツとして用いることができる。 In the above-mentioned example, the illustration showing the face of the person and the illustration showing the alert are displayed as entertainment content. However, the illustration shows the own vehicle, surrounding vehicles, passengers of the own vehicle, people around the own vehicle, and the environment outside the vehicle. Any illustration may be used as long as the situation is appropriately expressed and the description can be easily associated with the description. For example, for the description of “danger”, which is a human emotional expression, and for the expression of “danger”, which is the expression of the psychological situation of a person, which generates illustrations of “demon” and “mountain eruption” as entertainment content. The illustrations of “sports car” and “horse” are generated as entertainment content for the expression of “cool” that is human psychological expression. To do. In this way, various illustrations such as natural objects and artificial objects can be used as entertainment content.
　また図６（ｆ）において例示しなかったが、車載ディスプレイ８に自車両の同乗者のエンタテイメントコンテンツを表示することにより、同乗者の状態や心理状態を運転者が容易に認識することができる。例えば、エンタテイメントコンテンツから後部座席の子供が寝ている、あるいは眠そうにしている状況を容易に認識することができ、当該認識により運転者は急ブレーキを避ける、緩やかに加速するなど同乗者の状況に合わせた運転を行うことができる。 Although not illustrated in FIG. 6 (f), the driver can easily recognize the passenger's state and psychological state by displaying the entertainment content of the passenger of the own vehicle on the in-vehicle display 8. For example, it is possible to easily recognize the situation in which the child in the back seat is sleeping or going to sleep from the entertainment content, and the driver avoids sudden braking, accelerates slowly, etc. It is possible to operate according to.
　また、車載ディスプレイ８にエンタテイメントコンテンツを表示する場合に、自車両の運転者や同乗者に対して警告となる情報を出力する場合には、表示色を赤色や黄色などの警告色にする、あるいは音声出力制御部９を介してスピーカ１０から警告音を出力するように構成してもよい。 In addition, when displaying entertainment content on the in-vehicle display 8, when outputting warning information to the driver or passenger of the host vehicle, the display color is changed to a warning color such as red or yellow, or You may comprise so that a warning sound may be output from the speaker 10 via the audio | voice output control part 9. FIG.
　また、表示制御部７が、エンタテイメントコンテンツ蓄積部６に蓄積されたエンタテイメントコンテンツ、および対応する車両関連情報、変換データおよび形容表現などを読み出し、車載ディスプレイ８に再度表示することにより、運転操作シミュレーションなどに活用することができる。 In addition, the display control unit 7 reads out the entertainment content stored in the entertainment content storage unit 6 and the corresponding vehicle-related information, conversion data, and description of the description, and displays them on the in-vehicle display 8 again, thereby driving operation simulation, etc. It can be used for.
　また、上述した例では、エンタテイメントコンテンツを一台の車載ディスプレイ８に出力する構成を示したが、複数台の車載ディスプレイ８に出力するように構成してもよい。これにより、同乗者は運転を擬似体験することができ、運転者に対してアドバイスを行うこともできる。なお、同乗者が視認するディスプレイには、エンタテイメントコンテンツのみを表示してもよい。
　さらに車載ディスプレイ８に加えて、ネットワークで接続された離れた場所に配置されたディスプレイにも同時に表示するように構成してもよい。これにより自宅にいる家族などを車両の走行状態などを把握することができる。 In the above-described example, the entertainment content is output to one in-vehicle display 8. However, the entertainment content may be output to a plurality of in-vehicle displays 8. Thereby, the passenger can have a simulated experience of driving and can give advice to the driver. Note that only entertainment content may be displayed on the display visually recognized by the passenger.
Further, in addition to the in-vehicle display 8, it may be configured to display simultaneously on a display arranged at a remote location connected by a network. This makes it possible for a family member at home to grasp the running state of the vehicle.
　また、上述した実施の形態１では、情報取得部１は車載カメラ１ａやセンサ１ｂ、マイク１ｃなど複数の情報取得手段を備える構成を示したが、いずれか１つの情報取得手段で構成してもよいし、任意の情報取得手段を選択して構成してもよい。 Moreover, in Embodiment 1 mentioned above, although the information acquisition part 1 showed the structure provided with several information acquisition means, such as the vehicle-mounted camera 1a, the sensor 1b, and the microphone 1c, even if comprised with any one information acquisition means. Alternatively, any information acquisition means may be selected and configured.
　以上のように、この実施の形態１によれば、取得した自車両データおよび自車両周辺データから車両関連情報を抽出し、抽出した車両関連情報としきい値との比較、あるいは車両関連情報の解析結果に基づいて変換データを選択する情報変換部２と、変換データに基づいて、表現データベース４と照合するための人の感情、心理あるいは動静、あるいは変換データから人が受ける感情あるいは心理を推定し、推定した感情、心理あるいは動静を形容する表現をデータベース４から取得し、取得した形容表現を視覚的に示したエンタテイメントコンテンツをコンテンツデータベース５から取得するエンタテイメントコンテンツ生成部３と、エンタテイメントコンテンツを車載ディスプレイ８に表示する制御を行う表示制御部７とを備えるように構成したので、危険運転を行う周辺車両の存在の報知に限定されない、自車両の走行状態、同乗者の状態、自車両周辺の状態など利便性の高い情報を常に提供することができる。 As described above, according to the first embodiment, vehicle related information is extracted from the acquired host vehicle data and host vehicle peripheral data, and the extracted vehicle related information is compared with a threshold value or the vehicle related information is analyzed. An information conversion unit 2 that selects conversion data based on the result, and a person's emotion, psychology or movement for collation with the expression database 4 based on the conversion data, or an emotion or psychology that the person receives from the conversion data An entertainment content generating unit 3 that acquires an expression describing the estimated emotion, psychology, or movement from the database 4, and an entertainment content that visually indicates the acquired description expression from the content database 5, and the entertainment content on the vehicle display And a display control unit 7 that performs control to display on Since the configurations and is not limited to the notification of presence around the vehicle to perform dangerous driving, the running state of the vehicle, passenger state, it is possible to always provide status information with high usability such as around the host vehicle.
　また、この実施の形態１によれば、形容表現を、イラストを用いて視覚的に示したエンタテイメントコンテンツと対応付けて蓄積したコンテンツデータベース５を備えるように構成したので、認識性能を向上させた情報提示を実現することができる。また、エンタテイメントコンテンツから自車両の走行状態、同乗者の状態、自車両周辺の状態などを直感的に認識することができ、運転者は速やかに運転操作に反映させることができる。 In addition, according to the first embodiment, since the content expression 5 is stored so as to be associated with entertainment contents visually shown using illustrations, information that improves recognition performance is provided. Presentation can be realized. In addition, the travel state of the host vehicle, the passenger's state, the state around the host vehicle, and the like can be intuitively recognized from the entertainment content, and the driver can promptly reflect it in the driving operation.
　また、この実施の形態１によれば、形容表現を、自然物または人工物を用いて視覚的に示したエンタテイメントコンテンツと対応付けて蓄積したコンテンツデータベース５を備えるように構成したので、運転者は自車両の走行状態、同乗者の状態、自車両周辺の状態などを直感的に認識することができる。 Further, according to the first embodiment, since the description database is configured to include the content database 5 that is stored in association with entertainment contents visually shown using natural or artificial objects, the driver can It is possible to intuitively recognize the traveling state of the vehicle, the passenger's state, the state around the host vehicle, and the like.
　なお、本願発明はその発明の範囲内において、実施の形態の任意の構成要素の変形、もしくは実施の形態の任意の構成要素の省略が可能である。 In the present invention, any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
　以上のように、この発明に係る車載情報装置は、自車両状態および自車両周辺の状態を視覚的に示したエンタテイメントコンテンツの提示を可能としたので、直感的な認識性能が求められる車両の安全報知システムなどに好適である。 As described above, since the in-vehicle information device according to the present invention enables presentation of entertainment content that visually indicates the host vehicle state and the surroundings of the host vehicle, the vehicle safety that requires intuitive recognition performance is required. It is suitable for a notification system.
　１　情報取得部、１ａ　車載カメラ、１ｂ　センサ、１ｃ　マイク、１ｄ　ナビゲーション装置、１ｅ　インターネット、１ｆ　モバイル端末、２　情報変換部、３　エンタテイメントコンテンツ生成部、４　表現データベース、５　コンテンツデータベース、６　エンタテイメントコンテンツ蓄積部、７　表示制御部、８　車載ディスプレイ、９　音声出力制御部、１０　スピーカ、１００　車載情報処理装置。 1 information acquisition unit, 1a in-vehicle camera, 1b sensor, 1c microphone, 1d navigation device, 1e internet, 1f mobile terminal, 2 information conversion unit, 3 entertainment content generation unit, 4 expression database, 5 content database, 6 entertainment content storage unit 7, display control unit, 8 on-vehicle display, 9 audio output control unit, 10 speakers, 100 on-vehicle information processing device.

Claims (10)

  1. 　車両に搭載され、当該車両の乗員に対して情報を提示する車載情報処理装置において、
    　前記車両の状況および車両周辺の状況を示す情報を取得する情報取得部と、
    　前記車両および車両周辺における所定の項目の特定の状況内容を形容する表現を画像化した画像情報を蓄積するデータベースと、
    　前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から前記所定の項目に関連する情報を抽出し、抽出した情報を前記所定の項目の状況内容を示す情報に変換する情報変換部と、
    　前記情報変換部が変換した前記所定の項目の状況内容を示す情報から、前記所定の項目の特定の状況内容を推定し、推定した特定の状況内容に対応した画像情報を前記データベースから取得するエンタテイメントコンテンツ生成部と、
    　前記エンタテイメントコンテンツ生成部が取得した画像情報を表示部に表示する表示制御部とを備えたことを特徴とする車載情報処理装置。     In an in-vehicle information processing apparatus mounted on a vehicle and presenting information to a passenger of the vehicle,
    An information acquisition unit for acquiring information indicating a situation of the vehicle and a situation around the vehicle;
    A database for storing image information obtained by imaging an expression describing a specific situation content of a predetermined item in the vehicle and around the vehicle;
    Information conversion for extracting information related to the predetermined item from information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converting the extracted information into information indicating the status content of the predetermined item And
    Entertainment for estimating the specific situation content of the predetermined item from the information indicating the situation content of the predetermined item converted by the information conversion unit, and acquiring image information corresponding to the estimated specific situation content from the database A content generation unit;
    An in-vehicle information processing apparatus comprising: a display control unit that displays image information acquired by the entertainment content generation unit on a display unit.
  2. 　前記データベースは、自車両の特定の走行状態を形容する自車両の運転者の感情、心理あるいは動静を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から自車両の走行状況に関連する情報を抽出し、自車両の走行状態を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記情報変換部が変換した自車両の走行状態を示す情報から、前記自車両の特定の走行状態を推定し、推定した自車両の特定の走行状態に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images the driver's emotion, psychology, or movement of the vehicle that describes the specific driving state of the vehicle,
    The information conversion unit extracts information related to the traveling state of the host vehicle from information indicating the state of the vehicle and the situation around the vehicle acquired by the information acquiring unit, and converts the information into the information indicating the traveling state of the host vehicle,
    The entertainment content generation unit estimates a specific driving state of the host vehicle from information indicating the driving state of the host vehicle converted by the information conversion unit, and image information corresponding to the estimated specific driving state of the host vehicle. The in-vehicle information processing apparatus according to claim 1, wherein the information is acquired from the database.
  3. 　前記データベースは、自車両周辺を走行する周辺車両の特定の走行状態を形容する周辺車両の運転者の感情、心理あるいは動静を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から周辺車両の走行状況に関連する情報を抽出し、周辺車両の走行状態を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記情報変換部が変換した周辺車両の走行状態を示す情報から、前記周辺車両の特定の走行状態を推定し、推定した周辺車両の特定の走行状態に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images the driver's emotion, psychology, or movement of the surrounding vehicle that describes a specific driving state of the surrounding vehicle that runs around the host vehicle,
    The information conversion unit extracts information related to the driving situation of the surrounding vehicle from the information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converts the information into the information indicating the driving state of the surrounding vehicle,
    The entertainment content generation unit estimates a specific driving state of the surrounding vehicle from information indicating the driving state of the surrounding vehicle converted by the information conversion unit, and image information corresponding to the estimated specific driving state of the surrounding vehicle The in-vehicle information processing apparatus according to claim 1, wherein the information is acquired from the database.
  4. 　前記データベースは、自車両周辺に位置する車外の人の特定の動作状態を形容する車外の人の感情、心理あるいは動静を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から車外の人の状況に関連する情報を抽出し、車外の人の動作状態を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記情報変換部が変換した車外の人の動作状態を示す情報から、車外の人の特定の動作状態を推定し、推定した車外の人の特定の動作状態に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images the emotion, psychology, or movement of a person outside the vehicle that describes a specific operation state of the person outside the vehicle located around the vehicle,
    The information conversion unit extracts information related to the situation of the person outside the vehicle from the information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converts the information into the information indicating the operation state of the person outside the vehicle. ,
    The entertainment content generation unit estimates a specific operation state of the person outside the vehicle from the information indicating the operation state of the person outside the vehicle converted by the information conversion unit, and corresponds to the estimated specific operation state of the person outside the vehicle. The in-vehicle information processing apparatus according to claim 1, wherein image information is acquired from the database.
  5. 　前記データベースは、自車両の同乗者の特定の動作状態を形容する同乗者の感情、心理あるいは動静を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況を示す情報から同乗者の状況に関連する情報を抽出し、同乗者の動作状態を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記変換部が変換した同乗者の動作状態を示す情報から、同乗者の特定の動作状態を推定し、推定した同乗者の特定の動作状態に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images passengers' emotions, psychology or movements that describe the specific operating state of the passengers of the vehicle,
    The information conversion unit extracts information related to the passenger's situation from the information indicating the state of the vehicle acquired by the information acquisition unit, and converts the information into information indicating the passenger's operating state,
    The entertainment content generation unit estimates a specific operation state of the passenger from the information indicating the operation state of the passenger converted by the conversion unit, and obtains image information corresponding to the estimated specific operation state of the passenger. The in-vehicle information processing apparatus according to claim 1, wherein the information is acquired from a database.
  6. 　前記データベースは、道路の特定の状態から自車両の運転者が受ける印象を形容する自車両の運転者の感情または心理を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から自車両が走行中の道路の状況に関連する情報を抽出し、道路の状況を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記情報変換部が変換した道路の状況を示す情報から、道路の特定の状態を推定し、推定した道路の特定の状態から自車両の運転者が受ける印象に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images the emotion or psychology of the driver of the own vehicle that describes the impression that the driver of the own vehicle receives from a specific state of the road,
    The information conversion unit extracts information related to the situation of the road on which the host vehicle is traveling from information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converts the information into information indicating the situation of the road And
    The entertainment content generation unit estimates the specific state of the road from the information indicating the road state converted by the information conversion unit, and corresponds to the impression received by the driver of the host vehicle from the estimated specific state of the road The in-vehicle information processing apparatus according to claim 1, wherein image information is acquired from the database.
  7. 　前記データベースは、天候の特定の状態から自車両の運転者が受ける印象を形容する自車両の運転者の感情または心理を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から天候の状況に関連する情報を抽出し、天候の状態を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記情報変換部が変換した天候の状態を示す情報から、天候の特定の状態を推定し、推定した天候の特定の状態から自車両の運転者が受ける印象に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images the emotion or psychology of the driver of the own vehicle that describes the impression that the driver of the own vehicle receives from a specific state of weather,
    The information conversion unit extracts information related to the weather situation from the information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition part, and converts the information into information indicating the weather condition,
    The entertainment content generation unit estimates a specific weather state from the information indicating the weather state converted by the information conversion unit, and corresponds to an impression received by the driver of the host vehicle from the estimated specific weather state. The in-vehicle information processing apparatus according to claim 1, wherein image information is acquired from the database.
  8. 　前記データベースは、信号機および標識の特定の視認状態から自車両の運転者が受ける印象を形容する自車両の運転者の感情または心理を画像化した画像情報を蓄積し、
    　前記情報変換部は、前記情報取得部が取得した車両の状況および車両周辺の状況を示す情報から自車両が走行中の道路に設置された信号機および標識の視認性に関連する情報を抽出し、信号機および標識の視認状態を示す情報に変換し、
    　前記エンタテイメントコンテンツ生成部は、前記情報変換部が変換した信号機および標識の視認状態を示す情報から、信号機および標識の特定の視認状態を推定し、推定した信号機および標識の特定の視認状態から自車両の運転者が受ける印象に対応した画像情報を前記データベースから取得することを特徴とする請求項１記載の車載情報処理装置。     The database accumulates image information that images the emotion or psychology of the driver of the host vehicle that describes the impression received by the driver of the host vehicle from a specific visual state of the traffic lights and signs,
    The information conversion unit extracts information related to the visibility of traffic lights and signs installed on the road on which the host vehicle is traveling from information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, Convert it into information that shows the visibility of traffic lights and signs,
    The entertainment content generation unit estimates a specific visual state of the traffic signal and the sign from information indicating the visual state of the traffic signal and the sign converted by the information conversion unit, and the host vehicle from the estimated specific visual state of the traffic signal and the sign The in-vehicle information processing apparatus according to claim 1, wherein image information corresponding to an impression received by the driver is acquired from the database.
  9. 　前記データベースは、前記車両および車両周辺における所定の項目の特定の状況内容を形容する表現を、人工物または自然物に置き換えて画像化した画像情報を蓄積することを特徴とする請求項１記載の車載情報処理装置。 The vehicle-mounted vehicle according to claim 1, wherein the database stores image information obtained by replacing an expression describing a specific situation content of a predetermined item in the vehicle and the vicinity of the vehicle with an artificial object or a natural object. Information processing device.
  10. 　前記エンタテイメントコンテンツ生成部が取得した画像情報を蓄積するエンタテイメントコンテンツ蓄積部を備え、
    　前記表示制御部は、前記エンタテイメントコンテンツ蓄積部に蓄積された画像情報を読み出し、前記表示部に表示することを特徴とする請求項１記載の車載情報処理装置。     An entertainment content storage unit for storing image information acquired by the entertainment content generation unit;
    The in-vehicle information processing apparatus according to claim 1, wherein the display control unit reads image information stored in the entertainment content storage unit and displays the image information on the display unit.
PCT/JP2012/075990 2012-10-05 2012-10-05 In-vehicle information processing device WO2014054171A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2014539558A JP5847320B2 (en) 2012-10-05 2012-10-05 In-vehicle information processing equipment
PCT/JP2012/075990 WO2014054171A1 (en) 2012-10-05 2012-10-05 In-vehicle information processing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2012/075990 WO2014054171A1 (en) 2012-10-05 2012-10-05 In-vehicle information processing device

Publications (1)

Publication Number Publication Date
WO2014054171A1 true WO2014054171A1 (en) 2014-04-10

Family

ID=50434530

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/075990 WO2014054171A1 (en) 2012-10-05 2012-10-05 In-vehicle information processing device

Country Status (2)

Country Link
JP (1) JP5847320B2 (en)
WO (1) WO2014054171A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019063335A (en) * 2017-10-03 2019-04-25 マツダ株式会社 Activity estimation device
JPWO2021125163A1 (en) * 2019-12-18 2021-06-24

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002148061A (en) * 2000-08-31 2002-05-22 Casio Comput Co Ltd Information terminal, system and method for weather forecast information service, and car navigation system with weather information
JP2003317197A (en) * 2002-04-26 2003-11-07 Aisin Aw Co Ltd Alarm system
JP2006308507A (en) * 2005-05-02 2006-11-09 Nissan Motor Co Ltd Careful drive guide device and method thereof
JP2009009446A (en) * 2007-06-29 2009-01-15 Denso Corp Information display apparatus for vehicle
JP2009111469A (en) * 2007-10-26 2009-05-21 Victor Co Of Japan Ltd Video image output device and method, video image display apparatus and method
JP2010282368A (en) * 2009-06-03 2010-12-16 Toyota Central R&D Labs Inc Driving support device and program
JP2011100298A (en) * 2009-11-06 2011-05-19 Fujitsu Ten Ltd Information processing device, on-vehicle device, information processing system, information processing method, and program
JP2011257984A (en) * 2010-06-09 2011-12-22 Toyota Central R&D Labs Inc Object detection device and program
JP2012155535A (en) * 2011-01-26 2012-08-16 Honda Motor Co Ltd Driver state detecting system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002148061A (en) * 2000-08-31 2002-05-22 Casio Comput Co Ltd Information terminal, system and method for weather forecast information service, and car navigation system with weather information
JP2003317197A (en) * 2002-04-26 2003-11-07 Aisin Aw Co Ltd Alarm system
JP2006308507A (en) * 2005-05-02 2006-11-09 Nissan Motor Co Ltd Careful drive guide device and method thereof
JP2009009446A (en) * 2007-06-29 2009-01-15 Denso Corp Information display apparatus for vehicle
JP2009111469A (en) * 2007-10-26 2009-05-21 Victor Co Of Japan Ltd Video image output device and method, video image display apparatus and method
JP2010282368A (en) * 2009-06-03 2010-12-16 Toyota Central R&D Labs Inc Driving support device and program
JP2011100298A (en) * 2009-11-06 2011-05-19 Fujitsu Ten Ltd Information processing device, on-vehicle device, information processing system, information processing method, and program
JP2011257984A (en) * 2010-06-09 2011-12-22 Toyota Central R&D Labs Inc Object detection device and program
JP2012155535A (en) * 2011-01-26 2012-08-16 Honda Motor Co Ltd Driver state detecting system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019063335A (en) * 2017-10-03 2019-04-25 マツダ株式会社 Activity estimation device
JP7041869B2 (en) 2017-10-03 2022-03-25 マツダ株式会社 Activity estimation device
JPWO2021125163A1 (en) * 2019-12-18 2021-06-24
WO2021125163A1 (en) * 2019-12-18 2021-06-24 日立Astemo株式会社 Vehicle control device, vehicle control method, and vehicle control system
JP7382425B2 (en) 2019-12-18 2023-11-16 日立Astemo株式会社 Vehicle control device, vehicle control method, and vehicle control system

Also Published As

Publication number Publication date
JP5847320B2 (en) 2016-01-20
JPWO2014054171A1 (en) 2016-08-25

Similar Documents

Publication Publication Date Title
CN108028015B (en) Information processing apparatus, information processing method, and storage medium
US10192171B2 (en) Method and system using machine learning to determine an automotive driver's emotional state
US10421459B2 (en) Contextual-assessment vehicle systems
JP5088669B2 (en) Vehicle periphery monitoring device
JP4211841B2 (en) Driver state estimation device, server, driver information collection device, and driver state estimation system
JP5282612B2 (en) Information processing apparatus and method, program, and information processing system
WO2016092650A1 (en) Image processing device, in-vehicle display system, display device, image processing method, and image processing program
JP2020102252A (en) Driver monitoring system
JP6062043B2 (en) Mobile body state notification device, server device, and mobile body state notification method
CN107901828B (en) Method and device for reminding overtaking through intelligent equipment cooperation
CN109690601B (en) Information providing device and moving object
CN110876047A (en) Vehicle exterior projection method, device, equipment and storage medium
CN112298024B (en) Avoidance reminding system and method, vehicle and computer storage medium
JP2014096632A (en) Imaging system
US20180022357A1 (en) Driving recorder system
CN112298021A (en) Environment interaction system, method, vehicle and computer storage medium
JP5847320B2 (en) In-vehicle information processing equipment
JP2005212709A (en) Vehicle driving supporting system
JP6115278B2 (en) Vehicle display device
JP2022047580A (en) Information processing device
JP2021060676A (en) System and program or the like
WO2017150466A1 (en) Driver monitoring system
CN112298017A (en) Interactive system, method and computer storage medium
CN111762192A (en) Audible communication for autonomous vehicles
JP2019104354A (en) Information processing method and information processor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12886004

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014539558

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12886004

Country of ref document: EP

Kind code of ref document: A1