WO2021020173A1 - Parked image utilization system - Google Patents

Parked image utilization system Download PDF

Info

Publication number
WO2021020173A1
WO2021020173A1 PCT/JP2020/027854 JP2020027854W WO2021020173A1 WO 2021020173 A1 WO2021020173 A1 WO 2021020173A1 JP 2020027854 W JP2020027854 W JP 2020027854W WO 2021020173 A1 WO2021020173 A1 WO 2021020173A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
image
parked
suspicious person
utilization system
Prior art date
Application number
PCT/JP2020/027854
Other languages
French (fr)
Japanese (ja)
Inventor
將隼 宇都宮
晋海 崔
昌平 佐藤
Original Assignee
株式会社デンソー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社デンソー filed Critical 株式会社デンソー
Priority to CN202080052044.2A priority Critical patent/CN114127815A/en
Publication of WO2021020173A1 publication Critical patent/WO2021020173A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/10—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device
    • B60R25/102—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device a signal being sent to a remote location, e.g. a radio signal being transmitted to a police station, a security company or the owner
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/10—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device
    • B60R25/104—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device characterised by the type of theft warning signal, e.g. visual or audible signals with special characteristics
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
    • B60R25/31—Detection related to theft or to other events relevant to anti-theft systems of human presence inside or outside the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R99/00—Subject matter not provided for in other groups of this subclass
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B15/00—Identifying, scaring or incapacitating burglars, thieves or intruders, e.g. by explosives
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present disclosure relates to a parked image utilization system for utilizing an image captured while the vehicle is parked.
  • Patent Document 1 an image in front of a moving vehicle and data obtained by measuring a running state of the vehicle such as acceleration acting on the vehicle are displayed as an image on the same screen, and the displayed image is stored as moving image data.
  • a vehicle running state monitoring device having a function of performing the above is disclosed. According to this, since the displayed image can be stored as the traveling record data of the vehicle, it is possible to sufficiently grasp the traveling state of the vehicle and the road surface condition at that time.
  • An object of the present disclosure is to provide a parking image utilization system that can effectively use an image captured while the vehicle is parked.
  • the parked image utilization system includes an imaging device and a processing device.
  • the image pickup device is mounted on a vehicle, operates by receiving electric power from a battery mounted on the vehicle, and can continuously image the surroundings of the vehicle.
  • the processing device acquires image data representing a parked image, which is an image captured by the image pickup device while the vehicle is parked, and utilizes the acquired image data to determine a predetermined condition related to the situation around the vehicle. Execute the processing of. According to such a configuration, an excellent effect that an image captured while the vehicle is parked can be effectively used can be obtained.
  • the predetermined process executed by the processing device includes a detection process for detecting the approach of a suspicious person to the parked vehicle. In this way, the image captured while the vehicle is parked can be effectively used to detect the approach of a suspicious person.
  • the predetermined process executed by the processing device includes a threatening process for threatening the suspicious person whose approach is detected by the detection process. .. In this way, the image captured while the vehicle is parked can be effectively used to intimidate a suspicious person.
  • the predetermined process executed by the processing device includes a management process for managing the availability of the parking lot in which the vehicle is parked. In this way, the image captured while the vehicle is parked can be effectively used to manage the availability of the parking lot.
  • FIG. 1 is a diagram schematically showing the overall configuration of the parked image utilization system according to the first embodiment.
  • FIG. 2 is a diagram schematically showing a detailed configuration of each part of the parked image utilization system according to the first embodiment.
  • FIG. 3 is a diagram showing a flow of a series of processes related to the detection process and the threatening process according to the first embodiment.
  • FIG. 4 is a diagram schematically showing the overall configuration of the parked image utilization system according to the second embodiment.
  • FIG. 5 is a diagram schematically showing a detailed configuration of each part of the parked image utilization system according to the second embodiment.
  • FIG. 6 is a diagram showing a flow of a series of processes related to the detection process and the threatening process according to the second embodiment.
  • FIG. 7 is a diagram schematically showing the overall configuration of the parked image utilization system according to the third embodiment.
  • FIG. 8 is a diagram schematically showing a detailed configuration of each part of the parked image utilization system according to the third embodiment.
  • FIG. 9 is a diagram showing a flow of management processing according to the third embodiment.
  • the parked image utilization system 100 of the present embodiment includes a terminal device 200, a vehicle 300, and a server device 400.
  • the terminal device 200 is a smart device having a communication function such as a smartphone or a tablet terminal.
  • the vehicle 300 is an Electric Vehicle, that is, an electric vehicle. In this specification, Electric Vehicle may be abbreviated as EV. In this case, the terminal device 200 and the vehicle 300 are owned by the same user.
  • the terminal device 200 and the vehicle 300 are configured to enable transmission / reception of data, that is, communication between them.
  • the terminal device 200 and the vehicle 300 are configured to transmit and receive data via the network 500.
  • Examples of the network 500 include a wireless LAN and a mobile communication network.
  • the server device 400 is a virtual server on the cloud, that is, a cloud server.
  • the terminal device 200 and the vehicle 300 can access the server device 400 via the network 500.
  • the terminal device 200, the vehicle 300, and the server device 400 are configured so that data can be transmitted and received from each other.
  • the vehicle 300 includes a battery 310, a drive recorder 320, an electronic control device 330, various lights 340, an air suspension 350, a horn 360, and the like.
  • the battery 310 is mounted on the vehicle 300, and since the vehicle 300 is an EV, a battery 310 having a capacity large enough to cope with the EV is used.
  • the drive recorder 320 includes various cameras 321 and various microphones 322, a control device 323, a storage device 324, and the like.
  • Various cameras 321 are mounted on the vehicle 300 so as to be able to image at least one of the periphery of the vehicle 300, specifically, the front and the rear of the vehicle 300, and function as an image pickup device.
  • the various cameras 321 include a camera that images the outer periphery of the vehicle 300, specifically, a camera that images the front of the vehicle 300, a camera that images the rear of the vehicle 300, and the like.
  • the various cameras 321 may be integrated with the drive recorder 320 or may be separated. In this case, as the various cameras 321, a black-and-white camera having a higher sensitivity than the color camera is used.
  • the various microphones 322 include an outside microphone for recording the sound outside the vehicle 300, an inside microphone for recording the sound inside the vehicle 300, and the like.
  • the various cameras 321 and the various microphones 322 are operated by receiving electric power from the large-capacity battery 310. Therefore, the various cameras 321 can continuously image the periphery of the vehicle 300. Specifically, the various cameras 321 can continuously capture images for about one year even if the vehicle 300 is not charged, if the image quality is HD, for example. Further, the various microphones 322 can continuously collect the sounds inside and outside the vehicle 300.
  • the various cameras 321 can constantly image the periphery of the vehicle 300 and various microphones.
  • the 322 can constantly collect the sounds inside and outside the vehicle 300. Therefore, in the present embodiment, the imaging operation by the various cameras 321 and the sound collecting operation by the various microphones 322 are always executed. That is, the various cameras 321 constantly execute the imaging operation both while the vehicle 300 is running and the vehicle is parked, and the various microphones 322 constantly execute the sound collecting operation both while the vehicle is running and when the vehicle is parked.
  • the image signal Sa representing the image captured by the various cameras 321 and the sound signal Sb representing the sound collected by the various microphones 322 are input to the control device 323.
  • the control device 323 executes various processes (for example, amplification, A / D conversion, etc.) on the input image signal Sa and sound signal Sb, and thereby represents image data captured by various cameras 321. Da and sound data Db representing the sound collected by various microphones 322 are generated. The control device 323 stores the generated image data Da and sound data Db in the storage device 324 and transmits the generated image data Da and sound data Db to the electronic control device 330.
  • various processes for example, amplification, A / D conversion, etc.
  • the electronic control device 330 is one or more electronic control devices mounted on the vehicle 300.
  • the electronic control unit may be abbreviated as ECU.
  • the ECU 330 controls the lighting of various lights 340, the operation of the air suspension 350, and the operation of the horn 360.
  • Various lights 340 include headlights, blinkers, tail lamps, brake lamps and the like.
  • the ECU 330 can transmit the image data Da and the sound data Db transmitted from the drive recorder 320 to the terminal device 200 and the server device 400 provided outside the vehicle 300.
  • the ECU 330 transmits the image data Da and the sound data Db to the terminal device 200. Further, the ECU 330 constantly transmits the image data Da and the sound data Db to the server device 400.
  • the server device 400 includes a storage device 410 and an image conversion unit 420. The server device 400 stores the image data Da and the sound data Db given by the vehicle 300 in the storage device 410.
  • the server device 400 transmits the image data Da and the sound data Db to the terminal device 200.
  • the image data Da which is a black-and-white image
  • the image conversion unit 420 various existing conversion technologies related to black-and-white-color conversion, such as conversion technology by deep learning or the like, can be used.
  • the terminal device 200 can transmit the request signals Sc and Sd in response to an operation from the user, thereby displaying the image data Da transmitted from the vehicle 300 or the server device 400 and displaying the sound data Db. Can be played. Therefore, the user who owns the terminal device 200 can check the image captured by the various cameras 221 and the sound collected by the various microphones 222 in real time, and can also store the server device 400, which is a cloud server. The image data Da stored in the device 410 can be displayed and the sound data Db can be reproduced.
  • the function as the processing device 600 is realized by the cooperation of the terminal device 200, the ECU 330 of the vehicle 300, and the server device 400.
  • the processing device 600 acquires image data Da representing a parked image, which is an image captured while the vehicle 300 is parked, and utilizes the acquired image data Da to determine a predetermined image related to the situation around the vehicle 300. Execute the process.
  • the processing device 600 acquires the sound data Db which is the sound collected while the vehicle 300 is parked, and the acquired sound data Db is also used, but the sound data Db Acquisition and utilization may be performed as needed, and may be omitted.
  • the predetermined process executed by the processing device 600 includes a detection process for detecting the approach of a suspicious person to the parked vehicle 300.
  • the detection process is a process executed mainly by the server device 400, and can be, for example, a process having the following contents. That is, the image captured while the vehicle 300 is parked and the sound collected usually do not change significantly. However, when a person approaches the vehicle 300, there is a high possibility that these images and sounds will change significantly. Therefore, the processing device 600 can determine that a person has approached the vehicle 300 when a large change occurs in the image captured while the vehicle 300 is parked and the sound collected.
  • the processing device 600 detects the approach of a person by the above determination, the processing device 600 notifies the user of the approach of the person via the terminal device 200. Then, the processing device 600 displays an image when the approach of a person is detected on the display unit of the terminal device 200, and causes the user to determine whether or not the person is a suspicious person. The user inputs the determination result into the terminal device 200 by performing a predetermined operation. The processing device 600 determines whether or not the person who approaches the vehicle 300 is a suspicious person based on the judgment of the user.
  • the predetermined process executed by the processing device 600 includes a threatening process for intimidating a suspicious person whose approach is detected by the above-mentioned detection process.
  • the threatening process is a process executed mainly by the ECU 330 of the vehicle 300, for example, a process of turning on or blinking various lights 340, a process of vibrating the vehicle body by the operation of the air suspension 350, a process of ringing the horn 360, and the like. It can be at least one of the processes.
  • the processing device 600 executes the threatening process when the approach of a suspicious person is detected by the detection process and the user of the vehicle 300 gives an instruction to execute the threatening process.
  • the user can give an instruction to the processing device 600 to execute the threatening process by executing a predetermined operation on the terminal device 200.
  • step S100 the user is notified of the approach of a person to the vehicle 300.
  • step S200 it is determined whether or not the person whose approach is detected is a suspicious person.
  • the result is "NO" in step S200, and the series of processes is completed without executing the threatening process.
  • step S300 it is determined whether or not to execute the threatening process.
  • the result is "NO" in step S300, and the series of processes is completed without executing the threatening process.
  • step S400 the threatening process is executed. After the execution of step S400, a series of processes is completed.
  • the parked image utilization system 100 of the present embodiment includes various cameras 321 and a processing device 600.
  • the various cameras 321 are mounted on the vehicle 300, which is an EV, operate by receiving electric power from the large-capacity battery 310 mounted on the vehicle 300, and can continuously image the periphery of the vehicle 300.
  • the processing device 600 acquires image data Da representing a parked image, which is an image captured by various cameras 321 while the vehicle 300 is parked, and utilizes the acquired image data Da to change the situation around the vehicle 300. Performs the relevant predetermined processing. According to such a configuration, an excellent effect that an image captured while the vehicle 300 is parked can be effectively used can be obtained.
  • the predetermined process executed by the processing device 600 includes a detection process for detecting the approach of a suspicious person to the parked vehicle 300. In this way, the image captured while the vehicle 300 is parked can be effectively used to detect the approach of a suspicious person. Further, the predetermined process executed by the processing device 600 includes a threatening process for intimidating a suspicious person whose approach is detected by the detection process. In this way, the image captured while the vehicle 300 is parked can be effectively used to intimidate a suspicious person.
  • the terminal device 200 owned by the user is notified to that effect. Therefore, even if the user is away from the parking lot where the vehicle 300 is parked, for example, at home, the user can immediately know the approach of a person such as a suspicious person to the vehicle 300, that is, in real time.
  • the user when the user confirms that the suspicious person or the like has approached the vehicle 300, the user can execute a threatening process for intimidating the suspicious person based on his / her own judgment. Therefore, even if the user cannot immediately rush to the vehicle 300, by executing the threatening process, the user executes a malicious act by a suspicious person such as mischief or theft that damages the vehicle 300, for example. Can be prevented.
  • the user can use the terminal device 200 to obtain an image of the vicinity of the parked vehicle 300 and It is possible to constantly check the sound, and by extension, to constantly know the state and situation of the parked vehicle 300.
  • the user can periodically check the state of the vehicle 300 even when the vehicle 300 is parked in a less popular parking lot, so that the user can feel relieved. You can get a feeling.
  • the various cameras 321 of the present embodiment generally use a black-and-white camera having a higher sensitivity than the color camera, the following effects can be obtained. That is, there is a high possibility that a user at home or the like wants to know the status of a vehicle 300 parked in a parking lot located away from the place at night. When capturing an image at night, it depends on the lighting conditions around the vehicle 300, but usually, when capturing an image with a camera having low sensitivity, only an unclear image can be obtained. Therefore, if a black-and-white camera having a relatively high sensitivity is used as the various cameras 321 as in the present embodiment, a relatively clear image can be obtained as an image around the parked vehicle 300 even in such a case. it can.
  • the image data captured by the black-and-white camera depends on the resolution and the like, but generally, the amount of data is smaller than the image data captured by the color camera. Therefore, according to the present embodiment, it is possible to obtain an effect that the communication cost required for transmitting the image data Da from the vehicle 300 to the terminal device 200 or the server device 400 can be suppressed to a low level.
  • the image data Da which is a black-and-white image
  • the image conversion unit 420 of the server device 400 is converted into a color image by the image conversion unit 420 of the server device 400, and then transmitted to the terminal device 200.
  • the user can confirm the image data Da stored in the storage device 410 of the server device 400 with a color image. Therefore, according to the present embodiment, after enjoying the merits of using the black-and-white camera described above, the merits of being able to confirm the image around the vehicle 300 as a color image, for example, a person who approaches the vehicle 300 is a suspicious person. There is a merit that the accuracy of judgment as to whether or not there is present is improved.
  • the detection process of the present embodiment may be any process for detecting the approach of a suspicious person to the parked vehicle 300, and the specific process content can be appropriately modified.
  • the server device 400 can perform image recognition, image analysis, and the like on the image data Da, and can determine whether or not the approaching person is a suspicious person based on the result.
  • an approaching person behaves suspiciously (for example, going back and forth around the vehicle 300), and the facial expression of the approaching person is suspicious (for example, moving around). It can be determined that the person is a suspicious person when a recognition result is obtained that the person who approaches the person is different from the person registered in advance. It should be noted that the determination as to whether or not the person is a pre-registered person can be performed using, for example, a personal authentication technique such as a face or an iris. According to such a modification of the detection process, it is possible to obtain an effect that the detection accuracy is improved as compared with the detection of a suspicious person by the judgment of the user.
  • the parking image utilization system 101 of the present embodiment is different from the parking image utilization system 100 of the first embodiment in that a server device 700 is added.
  • the server device 700 is a virtual server on the cloud, that is, a cloud server.
  • the terminal device 200, the vehicle 300, and the server device 400 can access the server device 700 via the network 500.
  • the terminal device 200, the vehicle 300, the server device 400, and the server device 700 are configured so that data can be transmitted and received from each other.
  • the server device 700 includes a personal information database 710.
  • the personal information database 710 is a database in which information on a suspicious person, specifically information necessary for identifying a suspicious person (for example, facial image data) is stored.
  • a personal information database 710 is, for example, a national database managed by the state.
  • the function as the processing device 601 is realized by the cooperation of the terminal device 200, the ECU 330 of the vehicle 300, the server device 400, and the server device 700.
  • the processing device 601 executes a predetermined process by utilizing the image data Da representing the parked image.
  • the approach of a suspicious person is detected by collating the image data Da with the personal information database 710.
  • the processing device 601 automatically executes the threatening process when the approach of a suspicious person is detected by the detection process.
  • the flow of a series of processes related to such detection process and intimidation process is as shown in FIG.
  • the series of processes shown in FIG. 6 is started when the approach of a person to the vehicle 300 is detected, as in the series of processes of the first embodiment shown in FIG.
  • the series of processes shown in FIG. 6 is different from the series of processes shown in FIG. 3 in that step S201 is provided instead of step S200, step S300 is omitted, and the like.
  • step S201 it is determined whether or not the person is a suspicious person by collating the image of the face of the person whose approach is detected with the personal information database 710.
  • the result is "NO" in step S201, and the series of processes is completed without executing the threatening process.
  • the process proceeds to step S400, and the threatening process is immediately executed.
  • the present embodiment described above also has an excellent effect that the image captured while the vehicle 300 is parked can be effectively used.
  • the approach of the suspicious person is detected by collating the person whose approach is detected with the personal information database 710 in which the information of the suspicious person is accumulated. In this way, although it depends on the accuracy of the data stored in the personal information database 710, if the accuracy is equal to or higher than a predetermined level, the effect of improving the detection accuracy of the approach of a suspicious person can be obtained.
  • the processing device 601 of the present embodiment automatically executes the threatening process when the approach of a suspicious person is detected by the detection process. In this way, when a suspicious person is detected, the threatening process can be immediately executed without waiting for the judgment by the user. Therefore, according to the present embodiment, it is possible to more reliably prevent the execution of a malicious act by a suspicious person.
  • the parking image utilization system 102 of the present embodiment includes the terminal device 202 instead of the terminal device 200 with respect to the parking image utilization system 100 of the first embodiment, that is, the vehicle 300.
  • the vehicle 302 is provided instead of the server device 400
  • the parking lot server device 800 is provided instead of the server device 400.
  • the terminal device 202 is a smart device having a communication function.
  • the vehicle 302 is an EV similar to the vehicle 300, and has substantially the same functions.
  • the parking lot server device 800 is a server device provided in the parking lot where the vehicle 302 is parked, and manages the availability of the parking lot.
  • the parking lot server device 800 is managed and controlled by a parking lot management company that manages such a parking lot.
  • the terminal device 202 and the vehicle 302 can access the parking lot server device 800 via the network 500.
  • the terminal device 202, the vehicle 302, and the parking lot server device 800 are configured so that data can be transmitted and received from each other.
  • the vehicle 302 has a point that various lights 340, an air suspension 350 and a horn 360 are omitted from the vehicle 300, a point that a drive recorder 370 is provided instead of a drive recorder 320, and an ECU 330.
  • the difference is that the ECU 380 is provided instead.
  • the drive recorder 370 is different from the drive recorder 320 in that various microphones 322 are omitted and that a control device 325 is provided instead of the control device 323.
  • the control device 325 executes various processes on the input image signal Sa to generate image data Da representing an image captured by various cameras 321.
  • the control device 325 stores the generated image data Da in the storage device 324 and transmits the generated image data Da to the ECU 380.
  • the ECU 380 is one or more ECUs mounted on the vehicle 302.
  • the ECU 380 can transmit the image data Da transmitted from the drive recorder 370 to the terminal device 202 and the parking lot server device 800 provided outside the vehicle 302.
  • the request signal Se representing the transmission request of the image data
  • the ECU 380 transmits the image data Da to the terminal device 202. Further, the ECU 380 constantly transmits the image data Da to the parking lot server device 800.
  • the parking lot server device 800 includes a control device 810 and a storage device 820.
  • the parking lot server device 800 is provided with image data Dc representing an image captured by a camera 830 provided in the parking lot so that at least a part of the parking lot can be captured.
  • the control device 810 stores the image data Da given from the vehicle 302 and the image data Dc given by the camera 830 in the storage device 820.
  • the parking lot server device 800 When the parking lot server device 800 is given a request signal Sf indicating a parking lot availability transmission request from the terminal device 202, the parking lot server device 800 transmits data Dd indicating the parking lot availability to the terminal device 202.
  • the function as the processing device 602 is realized by the cooperation between the ECU 380 of the vehicle 302 and the parking lot server device 800.
  • the processing device 602 acquires image data Da representing a parked image, which is an image captured while the vehicle 302 is parked, and utilizes the acquired image data Da to determine a predetermined image related to the situation around the vehicle 302. Execute the process.
  • the predetermined process executed by the processing device 602 includes a management process for managing the availability of the parking lot in which the vehicle 302 is parked.
  • the management process is a process executed mainly by the parking lot server device 800, and can be, for example, a process having the following contents. That is, a general parking lot server device determines whether or not a vehicle is parked in each parking space based on an image in the parking lot captured by a camera provided in the parking lot, and uses the determination result as a result. Based on this, the availability of parking lots is updated.
  • the parking lot There is a risk of insufficient management of availability. Therefore, in the management process of the present embodiment, whether or not the vehicle is parked in each parking space based on the images captured by the cameras 830 of the parking lot and the images captured by the various cameras 321 of the vehicle 302. Is judged, and the availability of parking lots is updated based on the judgment result.
  • the flow of a series of processes related to such management process is as shown in FIG.
  • the series of processes shown in FIG. 9 is executed at a predetermined timing.
  • a predetermined timing can be various timings such as a time when a predetermined predetermined time has elapsed, a time when it is detected that the vehicle has been loaded or unloaded.
  • step S500 executed first, image data Da representing an image captured by various cameras 321 of the vehicle 302 is acquired, and in step S600 executed subsequently, camera 830 in the parking lot Image data Dc representing the image captured by is acquired.
  • the execution order of steps S500 and S600 can be changed.
  • step S700 whether or not the vehicle is parked in each parking space is determined based on the image data Da and the image data Dc, and the availability of the parking lot is updated based on the determination result. After the execution of step S700, a series of processes is completed.
  • the present embodiment described above also has an excellent effect that the image captured while the vehicle 302 is parked can be effectively used as in each of the above embodiments.
  • the predetermined process executed by the processing device 602 of the present embodiment includes a management process for managing the availability of the parking lot in which the vehicle 302 is parked. In this way, the image captured while the vehicle 302 is parked can be effectively used for managing the availability of the parking lot.
  • each parking space is set based on the image data Da representing the image captured by the various cameras 321 of the vehicle 302. Whether or not the vehicle is parked is determined, and the availability of the parking lot is updated based on the determination result. In this way, even if a situation occurs in which the camera 830 provided in the parking lot cannot capture at least a part of the parking lot for some reason, it can be interpolated by the image captured by the vehicle 302. Is possible. Therefore, according to the present embodiment, it is possible to improve the accuracy of managing the availability of the parking lot.
  • the present disclosure is not limited to each of the embodiments described above and in the drawings, and can be arbitrarily modified, combined, or extended without departing from the gist thereof.
  • the numerical values and the like shown in each of the above embodiments are examples, and are not limited thereto.
  • the predetermined processing executed by the processing devices 600 and 601 may include a notification processing that automatically notifies the police, a security company, etc. when the approach of a suspicious person is detected by the detection processing.
  • the image pickup device is not limited to the various cameras 321 included in the drive recorder 320 and 370, that is, the camera dedicated to the drive recorder 320 and 370, and a camera used in another device different from the drive recorder 320 and 370 is diverted. It may be in the form of For example, the image pickup device may be a rear camera used to monitor the rear of the vehicle 300 when the vehicle is retracted.
  • the vehicle is not limited to the EV vehicles 300 and 302, and may be a hybrid vehicle or a non-hybrid vehicle, a so-called combo vehicle. However, when a hybrid vehicle or a combo vehicle is adopted as the vehicle, it is necessary to prepare a battery having a capacity sufficient to continuously enable imaging by the imaging device.
  • the controls and methods thereof described in the present disclosure are realized by a dedicated computer provided by configuring a processor and memory programmed to perform one or more functions embodied by a computer program. May be done.
  • the controls and methods thereof described in the present disclosure may be implemented by a dedicated computer provided by configuring the processor with one or more dedicated hardware logic circuits.
  • the control unit and method thereof described in the present disclosure may be a combination of a processor and memory programmed to perform one or more functions and a processor composed of one or more hardware logic circuits. It may be realized by one or more dedicated computers configured.
  • the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Burglar Alarm Systems (AREA)

Abstract

This parked image utilization system is provided with: an imaging device (321) that is mounted to a vehicle (300, 302), that operates by means of power supplied from a battery (310) mounted to the vehicle, and that can continuously capture images of the surroundings of the vehicle; and a processing device (600, 601, 602) that acquires image data representing a parked image captured by the imaging device while the vehicle is parked, and executes a prescribed process relevant to the state of the surroundings of the vehicle by utilizing the acquired image data.

Description

駐車中画像活用システムImage utilization system during parking 関連出願の相互参照Cross-reference of related applications
　本出願は、２０１９年７月２６日に出願された日本出願番号２０１９－１３７８６８号に基づくもので、ここにその記載内容を援用する。 This application is based on Japanese Application No. 2019-137868, which was filed on July 26, 2019, and the contents of the description are incorporated herein by reference.
　本開示は、車両の駐車中に撮像された画像を活用するための駐車中画像活用システムに関する。 The present disclosure relates to a parked image utilization system for utilizing an image captured while the vehicle is parked.
　従来、車両の走行中にカメラなどにより撮像された画像を記録し、その画像を用いて様々な処理を行う技術が考えられている。例えば、特許文献１には、走行中の車両前方の映像と車両に作用する加速度などの車両の走行状態を計測したデータとを同一画面に画像として表示するとともに、表示した画像を動画データとして記憶する機能を有する車両走行状態監視装置が開示されている。これによれば、表示した画像を車両の走行記録データとして記憶できるので、車両の走行状態やそのときの路面状況を十分に把握することが可能となる。 Conventionally, a technique of recording an image captured by a camera or the like while the vehicle is running and performing various processing using the image has been considered. For example, in Patent Document 1, an image in front of a moving vehicle and data obtained by measuring a running state of the vehicle such as acceleration acting on the vehicle are displayed as an image on the same screen, and the displayed image is stored as moving image data. A vehicle running state monitoring device having a function of performing the above is disclosed. According to this, since the displayed image can be stored as the traveling record data of the vehicle, it is possible to sufficiently grasp the traveling state of the vehicle and the road surface condition at that time.
特開２０１５－１６２１７３号公報Japanese Unexamined Patent Publication No. 2015-162173
　特許文献１に開示された技術を含めた従来技術によれば、車両の走行中に撮像された画像を有効に利用することができる。しかしながら、従来技術では、車両の駐車中に撮像された画像を記録するとともに、その画像を有効に利用するための手法に関しては何ら開示されていない。 According to the prior art including the technique disclosed in Patent Document 1, the image captured while the vehicle is running can be effectively used. However, in the prior art, there is no disclosure about a method for recording an image captured while the vehicle is parked and effectively using the image.
　本開示の目的は、車両の駐車中に撮像された画像を有効に利用することができる駐車中画像活用システムを提供することにある。 An object of the present disclosure is to provide a parking image utilization system that can effectively use an image captured while the vehicle is parked.
　本開示の一態様において、駐車中画像活用システムは、撮像装置および処理装置を備える。撮像装置は、車両に搭載され、前記車両に搭載されたバッテリから電力供給を受けて動作し、前記車両の周辺を継続的に撮像可能なものである。処理装置は、前記車両の駐車中に前記撮像装置により撮像された画像である駐車中画像を表す画像データを取得し、その取得した画像データを活用して前記車両の周辺の状況に関連する所定の処理を実行する。このような構成によれば、車両の駐車中に撮像された画像を有効に利用することができるという優れた効果が得られる。 In one aspect of the present disclosure, the parked image utilization system includes an imaging device and a processing device. The image pickup device is mounted on a vehicle, operates by receiving electric power from a battery mounted on the vehicle, and can continuously image the surroundings of the vehicle. The processing device acquires image data representing a parked image, which is an image captured by the image pickup device while the vehicle is parked, and utilizes the acquired image data to determine a predetermined condition related to the situation around the vehicle. Execute the processing of. According to such a configuration, an excellent effect that an image captured while the vehicle is parked can be effectively used can be obtained.
　本開示の一態様の駐車中画像活用システムにおいて、前記処理装置が実行する前記所定の処理には、駐車中の前記車両に対する不審者の接近を検知するための検知処理が含まれている。このようにすれば、車両の駐車中に撮像された画像を不審者の接近を検知するために有効に利用することができる。 In the parked image utilization system of one aspect of the present disclosure, the predetermined process executed by the processing device includes a detection process for detecting the approach of a suspicious person to the parked vehicle. In this way, the image captured while the vehicle is parked can be effectively used to detect the approach of a suspicious person.
　本開示の一態様の駐車中画像活用システムにおいて、前記処理装置が実行する前記所定の処理には、前記検知処理により接近が検知された前記不審者を威嚇するための威嚇処理が含まれている。このようにすれば、車両の駐車中に撮像された画像を、不審者を威嚇するために有効に利用することができる。 In the parked image utilization system of one aspect of the present disclosure, the predetermined process executed by the processing device includes a threatening process for threatening the suspicious person whose approach is detected by the detection process. .. In this way, the image captured while the vehicle is parked can be effectively used to intimidate a suspicious person.
　本開示の一態様の駐車中画像活用システムにおいて、前記処理装置が実行する前記所定の処理には、前記車両が駐車された駐車場の空き状況を管理するための管理処理が含まれている。このようにすれば、車両の駐車中に撮像された画像を駐車場の空き状況を管理するために有効に利用することができる。 In the parked image utilization system of one aspect of the present disclosure, the predetermined process executed by the processing device includes a management process for managing the availability of the parking lot in which the vehicle is parked. In this way, the image captured while the vehicle is parked can be effectively used to manage the availability of the parking lot.
　本開示についての上記目的およびその他の目的、特徴や利点は、添付の図面を参照しながら下記の詳細な記述により、より明確になる。その図面は、
図１は、第１実施形態に係る駐車中画像活用システムの全体構成を模式的に示す図であり、 図２は、第１実施形態に係る駐車中画像活用システムの各部の詳細構成を模式的に示す図であり、 図３は、第１実施形態に係る検知処理および威嚇処理に関する一連の処理の流れを示す図であり、 図４は、第２実施形態に係る駐車中画像活用システムの全体構成を模式的に示す図であり、 図５は、第２実施形態に係る駐車中画像活用システムの各部の詳細構成を模式的に示す図であり、 図６は、第２実施形態に係る検知処理および威嚇処理に関する一連の処理の流れを示す図であり、 図７は、第３実施形態に係る駐車中画像活用システムの全体構成を模式的に示す図であり、 図８は、第３実施形態に係る駐車中画像活用システムの各部の詳細構成を模式的に示す図であり、 図９は、第３実施形態に係る管理処理の流れを示す図である。 The above objectives and other objectives, features and advantages of the present disclosure will be clarified by the following detailed description with reference to the accompanying drawings. The drawing is
FIG. 1 is a diagram schematically showing the overall configuration of the parked image utilization system according to the first embodiment. FIG. 2 is a diagram schematically showing a detailed configuration of each part of the parked image utilization system according to the first embodiment. FIG. 3 is a diagram showing a flow of a series of processes related to the detection process and the threatening process according to the first embodiment. FIG. 4 is a diagram schematically showing the overall configuration of the parked image utilization system according to the second embodiment. FIG. 5 is a diagram schematically showing a detailed configuration of each part of the parked image utilization system according to the second embodiment. FIG. 6 is a diagram showing a flow of a series of processes related to the detection process and the threatening process according to the second embodiment. FIG. 7 is a diagram schematically showing the overall configuration of the parked image utilization system according to the third embodiment. FIG. 8 is a diagram schematically showing a detailed configuration of each part of the parked image utilization system according to the third embodiment. FIG. 9 is a diagram showing a flow of management processing according to the third embodiment.
　以下、複数の実施形態について図面を参照して説明する。なお、各実施形態において実質的に同一の構成には同一の符号を付して説明を省略する。
　　　（第１実施形態）
　以下、第１実施形態について図１～図３を参照して説明する。 Hereinafter, a plurality of embodiments will be described with reference to the drawings. In each embodiment, substantially the same configuration is designated by the same reference numerals and the description thereof will be omitted.
(First Embodiment)
Hereinafter, the first embodiment will be described with reference to FIGS. 1 to 3.
　図１に示すように、本実施形態の駐車中画像活用システム１００は、端末装置２００、車両３００およびサーバ装置４００を備える。本実施形態では、端末装置２００は、例えばスマートフォン、タブレット端末などの通信機能を有するスマートデバイスとなっている。車両３００は、Electric Vehicle、つまり電気自動車である。なお、本明細書では、Electric VehicleのことをＥＶと省略することがある。この場合、端末装置２００および車両３００は、同一のユーザが所有するものである。 As shown in FIG. 1, the parked image utilization system 100 of the present embodiment includes a terminal device 200, a vehicle 300, and a server device 400. In the present embodiment, the terminal device 200 is a smart device having a communication function such as a smartphone or a tablet terminal. The vehicle 300 is an Electric Vehicle, that is, an electric vehicle. In this specification, Electric Vehicle may be abbreviated as EV. In this case, the terminal device 200 and the vehicle 300 are owned by the same user.
　端末装置２００および車両３００は、それぞれの間でデータの送受信、つまり通信が可能に構成されている。この場合、端末装置２００および車両３００は、ネットワーク５００を介してデータの送受信を行う構成となっている。ネットワーク５００としては、例えば、無線ＬＡＮ、移動体通信網などを挙げることができる。 The terminal device 200 and the vehicle 300 are configured to enable transmission / reception of data, that is, communication between them. In this case, the terminal device 200 and the vehicle 300 are configured to transmit and receive data via the network 500. Examples of the network 500 include a wireless LAN and a mobile communication network.
　サーバ装置４００は、クラウド上にある仮想サーバ、つまりクラウドサーバである。この場合、端末装置２００および車両３００は、ネットワーク５００を介して、サーバ装置４００にアクセスが可能となっている。言い換えると、端末装置２００、車両３００およびサーバ装置４００は、それぞれの間で互いにデータの送受信が可能に構成されている。 The server device 400 is a virtual server on the cloud, that is, a cloud server. In this case, the terminal device 200 and the vehicle 300 can access the server device 400 via the network 500. In other words, the terminal device 200, the vehicle 300, and the server device 400 are configured so that data can be transmitted and received from each other.
　図２に示すように、車両３００は、バッテリ３１０、ドライブレコーダ３２０、電子制御装置３３０、各種ライト３４０、エアサスペンション３５０、クラクション３６０などを備えている。バッテリ３１０は、車両３００に搭載されたものであり、車両３００がＥＶであることから、それに対応可能な程度に大きい容量のものが用いられている。ドライブレコーダ３２０は、各種カメラ３２１、各種マイク３２２、制御装置３２３、記憶装置３２４などを備えている。 As shown in FIG. 2, the vehicle 300 includes a battery 310, a drive recorder 320, an electronic control device 330, various lights 340, an air suspension 350, a horn 360, and the like. The battery 310 is mounted on the vehicle 300, and since the vehicle 300 is an EV, a battery 310 having a capacity large enough to cope with the EV is used. The drive recorder 320 includes various cameras 321 and various microphones 322, a control device 323, a storage device 324, and the like.
　各種カメラ３２１は、車両３００の周辺、具体的には、車両３００の前方および後方の少なくとも一方を撮像可能となるように車両３００に搭載されたものであり、撮像装置として機能する。各種カメラ３２１には、車両３００の外部周辺、具体的には車両３００の前方を撮像するカメラ、車両３００の後方を撮像するカメラなどが含まれる。なお、各種カメラ３２１は、ドライブレコーダ３２０と一体型でもよいし、分離型でもよい。この場合、各種カメラ３２１としては、カラーカメラに比べて感度の高い白黒カメラが用いられる。 Various cameras 321 are mounted on the vehicle 300 so as to be able to image at least one of the periphery of the vehicle 300, specifically, the front and the rear of the vehicle 300, and function as an image pickup device. The various cameras 321 include a camera that images the outer periphery of the vehicle 300, specifically, a camera that images the front of the vehicle 300, a camera that images the rear of the vehicle 300, and the like. The various cameras 321 may be integrated with the drive recorder 320 or may be separated. In this case, as the various cameras 321, a black-and-white camera having a higher sensitivity than the color camera is used.
　各種マイク３２２には、車両３００外部の音を記録するための車外マイク、車両３００内部の音を記録するための車内マイクなどが含まれる。各種カメラ３２１および各種マイク３２２は、大容量のバッテリ３１０から電力供給を受けて動作するようになっている。そのため、各種カメラ３２１は、車両３００の周辺を継続的に撮像可能である。具体的には、各種カメラ３２１は、例えばＨＤ画質であれば、車両３００に対する充電が行われなくとも、１年程度は継続して撮像することができる。また、各種マイク３２２は、車両３００の内外の音を継続的に集音可能である。 The various microphones 322 include an outside microphone for recording the sound outside the vehicle 300, an inside microphone for recording the sound inside the vehicle 300, and the like. The various cameras 321 and the various microphones 322 are operated by receiving electric power from the large-capacity battery 310. Therefore, the various cameras 321 can continuously image the periphery of the vehicle 300. Specifically, the various cameras 321 can continuously capture images for about one year even if the vehicle 300 is not charged, if the image quality is HD, for example. Further, the various microphones 322 can continuously collect the sounds inside and outside the vehicle 300.
　ＥＶである車両３００の通常の使用方法においてバッテリ３１０が定期的に充電されることを考慮すれば、各種カメラ３２１は、車両３００の周辺を常時撮像することが可能であると言えるとともに、各種マイク３２２は、車両３００内外の音を常時集音することが可能であると言える。そのため、本実施形態では、各種カメラ３２１による撮像動作および各種マイク３２２による集音動作は、常時実行されるようになっている。つまり、各種カメラ３２１は、車両３００の走行中および駐車中の双方において撮像動作を常時実行し、各種マイク３２２は、車両の走行中および駐車中の双方において集音動作を常時実行する。各種カメラ３２１により撮像された画像を表す画像信号Ｓａおよび各種マイク３２２により集音された音を表す音信号Ｓｂは、制御装置３２３に入力されている。 Considering that the battery 310 is periodically charged in the normal usage of the vehicle 300 which is an EV, it can be said that the various cameras 321 can constantly image the periphery of the vehicle 300 and various microphones. It can be said that the 322 can constantly collect the sounds inside and outside the vehicle 300. Therefore, in the present embodiment, the imaging operation by the various cameras 321 and the sound collecting operation by the various microphones 322 are always executed. That is, the various cameras 321 constantly execute the imaging operation both while the vehicle 300 is running and the vehicle is parked, and the various microphones 322 constantly execute the sound collecting operation both while the vehicle is running and when the vehicle is parked. The image signal Sa representing the image captured by the various cameras 321 and the sound signal Sb representing the sound collected by the various microphones 322 are input to the control device 323.
　制御装置３２３は、入力された画像信号Ｓａおよび音信号Ｓｂに対して各種の処理（例えば、増幅、Ａ／Ｄ変換など）を実行することにより、各種カメラ３２１により撮像された画像を表す画像データＤａと、各種マイク３２２により集音された音を表す音データＤｂとを生成する。制御装置３２３は、これら生成された画像データＤａおよび音データＤｂを、記憶装置３２４に記憶するとともに、電子制御装置３３０に送信する。 The control device 323 executes various processes (for example, amplification, A / D conversion, etc.) on the input image signal Sa and sound signal Sb, and thereby represents image data captured by various cameras 321. Da and sound data Db representing the sound collected by various microphones 322 are generated. The control device 323 stores the generated image data Da and sound data Db in the storage device 324 and transmits the generated image data Da and sound data Db to the electronic control device 330.
　電子制御装置３３０は、車両３００に搭載される１つまたは複数の電子制御装置である。なお、本明細書では、電子制御装置のことをＥＣＵと省略することがある。ＥＣＵ３３０は、各種ライト３４０の点灯、エアサスペンション３５０の動作およびクラクション３６０の動作の動作を制御する。各種ライト３４０には、ヘッドライト、ウインカー、テールランプ、ブレーキランプなどが含まれる。ＥＣＵ３３０は、ドライブレコーダ３２０から送信される画像データＤａおよび音データＤｂを、車両３００の外部に設けられた端末装置２００およびサーバ装置４００へ送信することができる。 The electronic control device 330 is one or more electronic control devices mounted on the vehicle 300. In this specification, the electronic control unit may be abbreviated as ECU. The ECU 330 controls the lighting of various lights 340, the operation of the air suspension 350, and the operation of the horn 360. Various lights 340 include headlights, blinkers, tail lamps, brake lamps and the like. The ECU 330 can transmit the image data Da and the sound data Db transmitted from the drive recorder 320 to the terminal device 200 and the server device 400 provided outside the vehicle 300.
　ＥＣＵ３３０は、端末装置２００から画像データおよび音データの送信要求を表す要求信号Ｓｃが与えられると、画像データＤａおよび音データＤｂを端末装置２００へ送信する。また、ＥＣＵ３３０は、常時、画像データＤａおよび音データＤｂをサーバ装置４００へ送信する。サーバ装置４００は、記憶装置４１０および画像変換部４２０を備えている。サーバ装置４００は、車両３００から与えられた画像データＤａおよび音データＤｂを記憶装置４１０に記憶する。 When the terminal device 200 gives a request signal Sc representing a transmission request for image data and sound data, the ECU 330 transmits the image data Da and the sound data Db to the terminal device 200. Further, the ECU 330 constantly transmits the image data Da and the sound data Db to the server device 400. The server device 400 includes a storage device 410 and an image conversion unit 420. The server device 400 stores the image data Da and the sound data Db given by the vehicle 300 in the storage device 410.
　サーバ装置４００は、端末装置２００から画像データおよび音データの送信要求を表す要求信号Ｓｄが与えられると、画像データＤａおよび音データＤｂを端末装置２００へ送信する。ただし、この場合、白黒画像である画像データＤａは、画像変換部４２０においてカラー画像に変換されてから、端末装置２００へ送信されるようになっている。画像変換部４２０としては、例えばディープラーニングなどによる変換技術など、既存の白黒－カラー変換に関する各種の変換技術を利用することができる。 When the terminal device 200 gives the request signal Sd representing the transmission request of the image data and the sound data, the server device 400 transmits the image data Da and the sound data Db to the terminal device 200. However, in this case, the image data Da, which is a black-and-white image, is converted into a color image by the image conversion unit 420 and then transmitted to the terminal device 200. As the image conversion unit 420, various existing conversion technologies related to black-and-white-color conversion, such as conversion technology by deep learning or the like, can be used.
　端末装置２００は、ユーザからの操作に応じて、要求信号Ｓｃ、Ｓｄの送信を行うことができ、それにより、車両３００またはサーバ装置４００から送信される画像データＤａを表示するとともに音データＤｂを再生することができる。そのため、端末装置２００を所持するユーザは、各種カメラ２２１により撮像されている画像および各種マイク２２２により集音されている音をリアルタイムで確認することができるとともに、クラウドサーバであるサーバ装置４００の記憶装置４１０に記憶された画像データＤａを表示するとともに音データＤｂを再生することができる。 The terminal device 200 can transmit the request signals Sc and Sd in response to an operation from the user, thereby displaying the image data Da transmitted from the vehicle 300 or the server device 400 and displaying the sound data Db. Can be played. Therefore, the user who owns the terminal device 200 can check the image captured by the various cameras 221 and the sound collected by the various microphones 222 in real time, and can also store the server device 400, which is a cloud server. The image data Da stored in the device 410 can be displayed and the sound data Db can be reproduced.
　本実施形態では、端末装置２００、車両３００のＥＣＵ３３０およびサーバ装置４００が協働することにより処理装置６００としての機能が実現される。処理装置６００は、車両３００の駐車中に撮像された画像である駐車中画像を表す画像データＤａを取得し、その取得した画像データＤａを活用して車両３００の周辺の状況に関連する所定の処理を実行する。この場合、処理装置６００は、車両３００の駐車中に集音された音である音データＤｂを取得し、その取得した音データＤｂも併せて活用するようになっているが、音データＤｂの取得および活用は必要に応じて行えばよく、省略することも可能である。 In the present embodiment, the function as the processing device 600 is realized by the cooperation of the terminal device 200, the ECU 330 of the vehicle 300, and the server device 400. The processing device 600 acquires image data Da representing a parked image, which is an image captured while the vehicle 300 is parked, and utilizes the acquired image data Da to determine a predetermined image related to the situation around the vehicle 300. Execute the process. In this case, the processing device 600 acquires the sound data Db which is the sound collected while the vehicle 300 is parked, and the acquired sound data Db is also used, but the sound data Db Acquisition and utilization may be performed as needed, and may be omitted.
　処理装置６００が実行する所定の処理には、駐車中の車両３００に対する不審者の接近を検知するための検知処理が含まれている。検知処理は、サーバ装置４００が主体になって実行する処理であり、例えば、次のような内容の処理とすることができる。すなわち、車両３００の駐車中に撮像された画像および集音された音は、通常は大きく変化することはない。しかし、車両３００に対して人が接近するなどした場合、これらの画像および音が大きく変化する可能性が高い。そこで、処理装置６００は、車両３００の駐車中に撮像された画像および集音された音に大きな変化が生じると、車両３００に対して人が接近したと判断することができる。 The predetermined process executed by the processing device 600 includes a detection process for detecting the approach of a suspicious person to the parked vehicle 300. The detection process is a process executed mainly by the server device 400, and can be, for example, a process having the following contents. That is, the image captured while the vehicle 300 is parked and the sound collected usually do not change significantly. However, when a person approaches the vehicle 300, there is a high possibility that these images and sounds will change significantly. Therefore, the processing device 600 can determine that a person has approached the vehicle 300 when a large change occurs in the image captured while the vehicle 300 is parked and the sound collected.
　上記判断によれば、車両３００に対して人が接近したことは検知できるものの、その人が不審者であるのか否かを判断することは難しい。そこで、処理装置６００は、上記判断によって人の接近を検知すると、端末装置２００を介して人の接近をユーザに通知する。そして、処理装置６００は、人の接近が検知された際の画像を端末装置２００の表示部に表示させ、その人が不審者であるのか否かをユーザに判断させる。ユーザは、所定の操作を行うことにより、その判断結果を端末装置２００に入力する。処理装置６００は、ユーザの判断に基づいて、車両３００に接近した人が不審者であるか否かを判断する。 According to the above judgment, although it is possible to detect that a person has approached the vehicle 300, it is difficult to judge whether or not the person is a suspicious person. Therefore, when the processing device 600 detects the approach of a person by the above determination, the processing device 600 notifies the user of the approach of the person via the terminal device 200. Then, the processing device 600 displays an image when the approach of a person is detected on the display unit of the terminal device 200, and causes the user to determine whether or not the person is a suspicious person. The user inputs the determination result into the terminal device 200 by performing a predetermined operation. The processing device 600 determines whether or not the person who approaches the vehicle 300 is a suspicious person based on the judgment of the user.
　また、処理装置６００が実行する所定の処理には、上述した検知処理により接近が検知された不審者を威嚇するための威嚇処理が含まれている。威嚇処理は、車両３００のＥＣＵ３３０が主体になって実行する処理であり、例えば、各種ライト３４０を点灯または点滅させる処理、エアサスペンション３５０の動作により車体を振動させる処理、クラクション３６０を鳴動させる処理などのうち少なくとも１つの処理とすることができる。 Further, the predetermined process executed by the processing device 600 includes a threatening process for intimidating a suspicious person whose approach is detected by the above-mentioned detection process. The threatening process is a process executed mainly by the ECU 330 of the vehicle 300, for example, a process of turning on or blinking various lights 340, a process of vibrating the vehicle body by the operation of the air suspension 350, a process of ringing the horn 360, and the like. It can be at least one of the processes.
　この場合、処理装置６００は、検知処理により不審者の接近が検知されるとともに、車両３００のユーザから威嚇処理を実行するための指示が与えられると、威嚇処理を実行するようになっている。なお、この場合、ユーザは、端末装置２００に対して所定の操作を実行することにより、処理装置６００に対して威嚇処理を実行するための指示を与えることができる。 In this case, the processing device 600 executes the threatening process when the approach of a suspicious person is detected by the detection process and the user of the vehicle 300 gives an instruction to execute the threatening process. In this case, the user can give an instruction to the processing device 600 to execute the threatening process by executing a predetermined operation on the terminal device 200.
　このような検知処理および威嚇処理に関する一連の処理の流れは、図３に示すようなものとなる。図３に示す一連の処理は、車両３００に対する人の接近が検知されると開始されるようになっている。まず、ステップＳ１００では、車両３００に対する人の接近がユーザに通知される。続くステップＳ２００では、接近が検知された人が不審者であるか否かが判断される。ここで、接近が検知された人が不審者ではないというユーザの判断結果が得られた場合、ステップＳ２００で「ＮＯ」となり、威嚇処理が実行されることなく、一連の処理が終了となる。 The flow of a series of processes related to such detection process and intimidation process is as shown in FIG. The series of processes shown in FIG. 3 is started when the approach of a person to the vehicle 300 is detected. First, in step S100, the user is notified of the approach of a person to the vehicle 300. In the following step S200, it is determined whether or not the person whose approach is detected is a suspicious person. Here, when the user's determination result that the person whose approach is detected is not a suspicious person is obtained, the result is "NO" in step S200, and the series of processes is completed without executing the threatening process.
　これに対し、接近が検知された人が不審者であるというユーザの判断結果が得られた場合、ステップＳ２００で「ＹＥＳ」となり、ステップＳ３００に進む。ステップＳ３００では、威嚇処理を実行するか否かが判断される。ここで、ユーザから威嚇処理を実行するための指示が与えられなかった場合、ステップＳ３００で「ＮＯ」となり、威嚇処理が実行されることなく、一連の処理が終了となる。これに対し、ユーザから威嚇処理を実行するための指示が与えられた場合、ステップＳ３００で「ＹＥＳ」となり、ステップＳ４００に進む。ステップＳ４００では、威嚇処理が実行される。ステップＳ４００の実行後、一連の処理が終了となる。 On the other hand, when the user's judgment result that the person whose approach is detected is a suspicious person is obtained, "YES" is obtained in step S200, and the process proceeds to step S300. In step S300, it is determined whether or not to execute the threatening process. Here, if the user does not give an instruction to execute the threatening process, the result is "NO" in step S300, and the series of processes is completed without executing the threatening process. On the other hand, when the user gives an instruction to execute the threatening process, the result is "YES" in step S300, and the process proceeds to step S400. In step S400, the threatening process is executed. After the execution of step S400, a series of processes is completed.
　以上説明したように、本実施形態の駐車中画像活用システム１００は、各種カメラ３２１および処理装置６００を備えている。各種カメラ３２１は、ＥＶである車両３００に搭載され、その車両３００に搭載された大容量のバッテリ３１０から電力供給を受けて動作し、車両３００の周辺を継続的に撮像可能なものである。処理装置６００は、車両３００の駐車中に各種カメラ３２１により撮像された画像である駐車中画像を表す画像データＤａを取得し、その取得した画像データＤａを活用して車両３００の周辺の状況に関連する所定の処理を実行する。このような構成によれば、車両３００の駐車中に撮像された画像を有効に利用することができるという優れた効果が得られる。 As described above, the parked image utilization system 100 of the present embodiment includes various cameras 321 and a processing device 600. The various cameras 321 are mounted on the vehicle 300, which is an EV, operate by receiving electric power from the large-capacity battery 310 mounted on the vehicle 300, and can continuously image the periphery of the vehicle 300. The processing device 600 acquires image data Da representing a parked image, which is an image captured by various cameras 321 while the vehicle 300 is parked, and utilizes the acquired image data Da to change the situation around the vehicle 300. Performs the relevant predetermined processing. According to such a configuration, an excellent effect that an image captured while the vehicle 300 is parked can be effectively used can be obtained.
　処理装置６００が実行する所定の処理には、駐車中の車両３００に対する不審者の接近を検知するための検知処理が含まれている。このようにすれば、車両３００の駐車中に撮像された画像を不審者の接近を検知するために有効に利用することができる。また、処理装置６００が実行する所定の処理には、検知処理により接近が検知された不審者を威嚇するための威嚇処理が含まれている。このようにすれば、車両３００の駐車中に撮像された画像を、不審者を威嚇するために有効に利用することができる。 The predetermined process executed by the processing device 600 includes a detection process for detecting the approach of a suspicious person to the parked vehicle 300. In this way, the image captured while the vehicle 300 is parked can be effectively used to detect the approach of a suspicious person. Further, the predetermined process executed by the processing device 600 includes a threatening process for intimidating a suspicious person whose approach is detected by the detection process. In this way, the image captured while the vehicle 300 is parked can be effectively used to intimidate a suspicious person.
　上記した検知処理では、車両３００に対して人が接近したことが検知されると、その旨をユーザが所持する端末装置２００に通知するようになっている。そのため、ユーザは、例えば自宅など、車両３００が駐車された駐車場などから離れた場所にいたとしても、車両３００に対する不審者などの人の接近を即座に、つまりリアルタイムで知ることができる。 In the above detection process, when it is detected that a person has approached the vehicle 300, the terminal device 200 owned by the user is notified to that effect. Therefore, even if the user is away from the parking lot where the vehicle 300 is parked, for example, at home, the user can immediately know the approach of a person such as a suspicious person to the vehicle 300, that is, in real time.
　また、この場合、ユーザは、不審者などが車両３００に接近したことを確認すると、自身の判断に基づいて、その不審者を威嚇するための威嚇処理を実行することができる。そのため、ユーザは、直ちに車両３００のもとに駆け付けることができないような場合でも、威嚇処理を実行することにより、例えば車両３００を傷つけるようないたずら、盗難などの不審者による悪意のある行為の実行を未然に防止することができる。 Further, in this case, when the user confirms that the suspicious person or the like has approached the vehicle 300, the user can execute a threatening process for intimidating the suspicious person based on his / her own judgment. Therefore, even if the user cannot immediately rush to the vehicle 300, by executing the threatening process, the user executes a malicious act by a suspicious person such as mischief or theft that damages the vehicle 300, for example. Can be prevented.
　本実施形態の駐車中画像活用システム１００によれば、ユーザは、車両３００が駐車された駐車場から離れた場所にいたとしても、端末装置２００を用いて、駐車中の車両３００周辺の画像および音を常時確認すること、ひいては駐車中の車両３００の様子、状況などを常時知ることができる。このような構成によれば、ユーザは、例えば車両３００を人気の少ない駐車場に駐車している場合であっても、定期的に車両３００の様子を確認することが可能となり、それにより、安心感などを得ることができる。 According to the parked image utilization system 100 of the present embodiment, even if the user is away from the parking lot where the vehicle 300 is parked, the user can use the terminal device 200 to obtain an image of the vicinity of the parked vehicle 300 and It is possible to constantly check the sound, and by extension, to constantly know the state and situation of the parked vehicle 300. With such a configuration, the user can periodically check the state of the vehicle 300 even when the vehicle 300 is parked in a less popular parking lot, so that the user can feel relieved. You can get a feeling.
　また、本実施形態の各種カメラ３２１は、一般的にカラーカメラに比べて感度が高い白黒カメラを用いているため、次のような効果が得られる。すなわち、自宅などにいるユーザが、その場所から離れた場所にある駐車場に駐車した車両３００の状況などを知りたいケースは、夜間である可能性が高い。夜間における画像の撮像では、車両３００の周囲の照明状況にも依存するが、通常は、感度が低いカメラでの撮像では、不鮮明な画像しか得ることができない。そこで、本実施形態のように、各種カメラ３２１として、比較的感度の高い白黒カメラを用いれば、このようなケースにおいても、駐車中の車両３００周辺の画像として比較的鮮明な画像を得ることができる。 Further, since the various cameras 321 of the present embodiment generally use a black-and-white camera having a higher sensitivity than the color camera, the following effects can be obtained. That is, there is a high possibility that a user at home or the like wants to know the status of a vehicle 300 parked in a parking lot located away from the place at night. When capturing an image at night, it depends on the lighting conditions around the vehicle 300, but usually, when capturing an image with a camera having low sensitivity, only an unclear image can be obtained. Therefore, if a black-and-white camera having a relatively high sensitivity is used as the various cameras 321 as in the present embodiment, a relatively clear image can be obtained as an image around the parked vehicle 300 even in such a case. it can.
　さらに、白黒カメラにより撮像された画像データは、その解像度などにも依存するが、一般的には、カラーカメラにより撮像された画像データに比べて小さいデータ量となる。そのため、本実施形態によれば、車両３００から端末装置２００またはサーバ装置４００に対して画像データＤａを送信するために要する通信コストを低く抑えることができるという効果が得られる。 Furthermore, the image data captured by the black-and-white camera depends on the resolution and the like, but generally, the amount of data is smaller than the image data captured by the color camera. Therefore, according to the present embodiment, it is possible to obtain an effect that the communication cost required for transmitting the image data Da from the vehicle 300 to the terminal device 200 or the server device 400 can be suppressed to a low level.
　また、この場合、白黒画像である画像データＤａは、サーバ装置４００の画像変換部４２０においてカラー画像に変換されてから、端末装置２００へ送信されるようになっている。このようにすれば、ユーザは、サーバ装置４００の記憶装置４１０に記憶された画像データＤａを確認する際には、カラー画像で確認することができる。そのため、本実施形態によれば、上述した白黒カメラを用いたことによるメリットを享受したうえで、車両３００周辺の画像をカラー画像として確認できることによるメリット、例えば車両３００に接近した人が不審者であるか否かの判断の精度が向上するといったメリットが得られる。 Further, in this case, the image data Da, which is a black-and-white image, is converted into a color image by the image conversion unit 420 of the server device 400, and then transmitted to the terminal device 200. In this way, the user can confirm the image data Da stored in the storage device 410 of the server device 400 with a color image. Therefore, according to the present embodiment, after enjoying the merits of using the black-and-white camera described above, the merits of being able to confirm the image around the vehicle 300 as a color image, for example, a person who approaches the vehicle 300 is a suspicious person. There is a merit that the accuracy of judgment as to whether or not there is present is improved.
　　＜検知処理の変形例＞
　本実施形態の検知処理は、駐車中の車両３００に対する不審者の接近を検知するための処理であればよく、その具体的な処理内容は適宜変形することができる。例えば、検知処理において、サーバ装置４００が画像データＤａについて画像認識、画像解析などを行い、その結果に基づいて接近した人が不審者であるか否かを判断することができる。 <Modification example of detection processing>
The detection process of the present embodiment may be any process for detecting the approach of a suspicious person to the parked vehicle 300, and the specific process content can be appropriately modified. For example, in the detection process, the server device 400 can perform image recognition, image analysis, and the like on the image data Da, and can determine whether or not the approaching person is a suspicious person based on the result.
　具体的には、サーバ装置４００は、接近した人が不審な行動をしている（例えば、車両３００の周囲を行き来するなど）、接近した人の表情が不審なものである（例えば、周囲を気にするような表情など）、または、接近した人が予め登録された人物とは異なる人物であるとの認識結果が得られた場合に不審者であると判断することができる。なお、予め登録された人物であるか否かの判断は、例えば、顔、虹彩などの個人認証技術を利用して行うことができる。このような検知処理の変形例によれば、ユーザの判断による不審者の検知に比べ、その検知精度が向上するという効果が得られる。 Specifically, in the server device 400, an approaching person behaves suspiciously (for example, going back and forth around the vehicle 300), and the facial expression of the approaching person is suspicious (for example, moving around). It can be determined that the person is a suspicious person when a recognition result is obtained that the person who approaches the person is different from the person registered in advance. It should be noted that the determination as to whether or not the person is a pre-registered person can be performed using, for example, a personal authentication technique such as a face or an iris. According to such a modification of the detection process, it is possible to obtain an effect that the detection accuracy is improved as compared with the detection of a suspicious person by the judgment of the user.
　　　（第２実施形態）
　以下、第２実施形態について図４～図６を参照して説明する。
　図４に示すように、本実施形態の駐車中画像活用システム１０１は、第１実施形態の駐車中画像活用システム１００に対し、サーバ装置７００が追加されている点などが異なる。サーバ装置７００は、クラウド上にある仮想サーバ、つまりクラウドサーバである。この場合、端末装置２００、車両３００およびサーバ装置４００は、ネットワーク５００を介して、サーバ装置７００にアクセスが可能となっている。言い換えると、端末装置２００、車両３００、サーバ装置４００およびサーバ装置７００は、それぞれの間で互いにデータの送受信が可能に構成されている。 (Second Embodiment)
Hereinafter, the second embodiment will be described with reference to FIGS. 4 to 6.
As shown in FIG. 4, the parking image utilization system 101 of the present embodiment is different from the parking image utilization system 100 of the first embodiment in that a server device 700 is added. The server device 700 is a virtual server on the cloud, that is, a cloud server. In this case, the terminal device 200, the vehicle 300, and the server device 400 can access the server device 700 via the network 500. In other words, the terminal device 200, the vehicle 300, the server device 400, and the server device 700 are configured so that data can be transmitted and received from each other.
　図５に示すように、サーバ装置７００は、個人情報データベース７１０を備えている。個人情報データベース７１０は、不審者の情報、具体的には不審者を特定するために必要な情報（例えば顔の画像データなど）が蓄積されたデータベースである。このような個人情報データベース７１０は、例えば国家により管理される国家データベースとなっている。この場合、端末装置２００、車両３００のＥＣＵ３３０、サーバ装置４００およびサーバ装置７００が協働することにより処理装置６０１としての機能が実現される。 As shown in FIG. 5, the server device 700 includes a personal information database 710. The personal information database 710 is a database in which information on a suspicious person, specifically information necessary for identifying a suspicious person (for example, facial image data) is stored. Such a personal information database 710 is, for example, a national database managed by the state. In this case, the function as the processing device 601 is realized by the cooperation of the terminal device 200, the ECU 330 of the vehicle 300, the server device 400, and the server device 700.
　処理装置６０１は、第１実施形態の処理装置６００と同様、駐車中画像を表す画像データＤａを活用して所定の処理を実行する。ただし、この場合、処理装置６０１が実行する検知処理では、画像データＤａを個人情報データベース７１０と照合することにより、不審者の接近を検知するようになっている。また、この場合、処理装置６０１は、検知処理により不審者の接近が検知されると、自動的に威嚇処理を実行するようになっている。 Similar to the processing device 600 of the first embodiment, the processing device 601 executes a predetermined process by utilizing the image data Da representing the parked image. However, in this case, in the detection process executed by the processing device 601, the approach of a suspicious person is detected by collating the image data Da with the personal information database 710. Further, in this case, the processing device 601 automatically executes the threatening process when the approach of a suspicious person is detected by the detection process.
　このような検知処理および威嚇処理に関する一連の処理の流れは、図６に示すようなものとなる。図６に示す一連の処理は、図３に示した第１実施形態の一連の処理と同様に車両３００に対する人の接近が検知されると開始されるようになっている。図６に示す一連の処理は、図３に示した一連の処理に対し、ステップＳ２００に代えてステップＳ２０１が設けられている点、ステップＳ３００が省かれている点などが異なっている。 The flow of a series of processes related to such detection process and intimidation process is as shown in FIG. The series of processes shown in FIG. 6 is started when the approach of a person to the vehicle 300 is detected, as in the series of processes of the first embodiment shown in FIG. The series of processes shown in FIG. 6 is different from the series of processes shown in FIG. 3 in that step S201 is provided instead of step S200, step S300 is omitted, and the like.
　ステップＳ２０１では、接近が検知された人の顔の画像を個人情報データベース７１０と照合することにより、不審者であるか否かが判断される。ここで、接近が検知された人が不審者ではないという照合結果が得られた場合、ステップＳ２０１で「ＮＯ」となり、威嚇処理が実行されることなく、一連の処理が終了となる。これに対し、接近が検知された人が不審者であるという照合結果が得られた場合、ステップＳ２０１で「ＹＥＳ」となり、ステップＳ４００に進み、直ちに威嚇処理が実行される。 In step S201, it is determined whether or not the person is a suspicious person by collating the image of the face of the person whose approach is detected with the personal information database 710. Here, if a collation result is obtained that the person whose approach is detected is not a suspicious person, the result is "NO" in step S201, and the series of processes is completed without executing the threatening process. On the other hand, when the collation result that the person whose approach is detected is a suspicious person is obtained, the result is "YES" in step S201, the process proceeds to step S400, and the threatening process is immediately executed.
　以上説明した本実施形態によっても、第１実施形態と同様、車両３００の駐車中に撮像された画像を有効に利用することができるという優れた効果が得られる。また、本実施形態の検知処理では、接近が検知された人を不審者の情報が蓄積された個人情報データベース７１０と照合することにより不審者の接近を検知するようになっている。このようにすれば、個人情報データベース７１０に蓄積されたデータの精度にも依存するが、その精度が所定の水準以上であれば、不審者の接近の検知精度が向上するという効果が得られる。 Similar to the first embodiment, the present embodiment described above also has an excellent effect that the image captured while the vehicle 300 is parked can be effectively used. Further, in the detection process of the present embodiment, the approach of the suspicious person is detected by collating the person whose approach is detected with the personal information database 710 in which the information of the suspicious person is accumulated. In this way, although it depends on the accuracy of the data stored in the personal information database 710, if the accuracy is equal to or higher than a predetermined level, the effect of improving the detection accuracy of the approach of a suspicious person can be obtained.
　また、本実施形態の処理装置６０１は、検知処理により不審者の接近が検知されると、自動的に威嚇処理を実行するようになっている。このようにすれば、不審者が検知された場合、ユーザによる判断を待つことなく、直ちに威嚇処理を実行することができる。そのため、本実施形態によれば、不審者による悪意のある行為の実行を一層確実に防止することができる。 Further, the processing device 601 of the present embodiment automatically executes the threatening process when the approach of a suspicious person is detected by the detection process. In this way, when a suspicious person is detected, the threatening process can be immediately executed without waiting for the judgment by the user. Therefore, according to the present embodiment, it is possible to more reliably prevent the execution of a malicious act by a suspicious person.
　　　（第３実施形態）
　以下、第３実施形態について図７～図９を参照して説明する。
　図７に示すように、本実施形態の駐車中画像活用システム１０２は、第１実施形態の駐車中画像活用システム１００に対し、端末装置２００に代えて端末装置２０２を備えている点、車両３００に代えて車両３０２を備えている点、サーバ装置４００に代えて駐車場サーバ装置８００を備えている点などが異なる。端末装置２０２は、端末装置２００と同様、通信機能を有するスマートデバイスである。 (Third Embodiment)
Hereinafter, the third embodiment will be described with reference to FIGS. 7 to 9.
As shown in FIG. 7, the parking image utilization system 102 of the present embodiment includes the terminal device 202 instead of the terminal device 200 with respect to the parking image utilization system 100 of the first embodiment, that is, the vehicle 300. The difference is that the vehicle 302 is provided instead of the server device 400, and the parking lot server device 800 is provided instead of the server device 400. Like the terminal device 200, the terminal device 202 is a smart device having a communication function.
　車両３０２は、車両３００と同様のＥＶであり、概ね同様の機能を有する。駐車場サーバ装置８００は、車両３０２が駐車される駐車場に設けられるサーバ装置であり、その駐車場の空き状況などを管理する。駐車場サーバ装置８００は、このような駐車場を管理する駐車場管理会社により管理および管轄されている。この場合、端末装置２０２および車両３０２は、ネットワーク５００を介して、駐車場サーバ装置８００にアクセスが可能となっている。言い換えると、端末装置２０２、車両３０２および駐車場サーバ装置８００は、それぞれの間で互いにデータの送受信が可能に構成されている。 The vehicle 302 is an EV similar to the vehicle 300, and has substantially the same functions. The parking lot server device 800 is a server device provided in the parking lot where the vehicle 302 is parked, and manages the availability of the parking lot. The parking lot server device 800 is managed and controlled by a parking lot management company that manages such a parking lot. In this case, the terminal device 202 and the vehicle 302 can access the parking lot server device 800 via the network 500. In other words, the terminal device 202, the vehicle 302, and the parking lot server device 800 are configured so that data can be transmitted and received from each other.
　図８に示すように、車両３０２は、車両３００に対し、各種ライト３４０、エアサスペンション３５０およびクラクション３６０が省かれている点、ドライブレコーダ３２０に代えてドライブレコーダ３７０を備えている点、ＥＣＵ３３０に代えてＥＣＵ３８０を備えている点などが異なる。ドライブレコーダ３７０は、ドライブレコーダ３２０に対し、各種マイク３２２が省かれている点、制御装置３２３に代えて制御装置３２５を備えている点などが異なる。 As shown in FIG. 8, the vehicle 302 has a point that various lights 340, an air suspension 350 and a horn 360 are omitted from the vehicle 300, a point that a drive recorder 370 is provided instead of a drive recorder 320, and an ECU 330. The difference is that the ECU 380 is provided instead. The drive recorder 370 is different from the drive recorder 320 in that various microphones 322 are omitted and that a control device 325 is provided instead of the control device 323.
　制御装置３２５は、制御装置３２３と同様、入力された画像信号Ｓａに対して各種の処理を実行することにより、各種カメラ３２１により撮像された画像を表す画像データＤａを生成する。制御装置３２５は、その生成された画像データＤａを、記憶装置３２４に記憶するとともに、ＥＣＵ３８０に送信する。ＥＣＵ３８０は、ＥＣＵ３３０と同様、車両３０２に搭載される１つまたは複数のＥＣＵである。 Similar to the control device 323, the control device 325 executes various processes on the input image signal Sa to generate image data Da representing an image captured by various cameras 321. The control device 325 stores the generated image data Da in the storage device 324 and transmits the generated image data Da to the ECU 380. Like the ECU 330, the ECU 380 is one or more ECUs mounted on the vehicle 302.
　ＥＣＵ３８０は、ドライブレコーダ３７０から送信される画像データＤａを、車両３０２の外部に設けられた端末装置２０２および駐車場サーバ装置８００へ送信することができる。ＥＣＵ３８０は、端末装置２０２から画像データの送信要求を表す要求信号Ｓｅが与えられると、画像データＤａを端末装置２０２へ送信する。また、ＥＣＵ３８０は、常時、画像データＤａを駐車場サーバ装置８００へ送信する。 The ECU 380 can transmit the image data Da transmitted from the drive recorder 370 to the terminal device 202 and the parking lot server device 800 provided outside the vehicle 302. When the request signal Se representing the transmission request of the image data is given from the terminal device 202, the ECU 380 transmits the image data Da to the terminal device 202. Further, the ECU 380 constantly transmits the image data Da to the parking lot server device 800.
　駐車場サーバ装置８００は、制御装置８１０および記憶装置８２０を備えている。駐車場サーバ装置８００には、駐車場の少なくとも一部を撮像可能に駐車場に設けられたカメラ８３０により撮像された画像を表す画像データＤｃが与えられている。制御装置８１０は、車両３０２から与えられた画像データＤａおよびカメラ８３０から与えられた画像データＤｃを記憶装置８２０に記憶する。 The parking lot server device 800 includes a control device 810 and a storage device 820. The parking lot server device 800 is provided with image data Dc representing an image captured by a camera 830 provided in the parking lot so that at least a part of the parking lot can be captured. The control device 810 stores the image data Da given from the vehicle 302 and the image data Dc given by the camera 830 in the storage device 820.
　駐車場サーバ装置８００は、端末装置２０２から駐車場の空き状況の送信要求を表す要求信号Ｓｆが与えられると、駐車場の空き状況を表すデータＤｄを端末装置２０２へ送信する。本実施形態では、車両３０２のＥＣＵ３８０および駐車場サーバ装置８００が協働することにより処理装置６０２としての機能が実現される。処理装置６０２は、車両３０２の駐車中に撮像された画像である駐車中画像を表す画像データＤａを取得し、その取得した画像データＤａを活用して車両３０２の周辺の状況に関連する所定の処理を実行する。 When the parking lot server device 800 is given a request signal Sf indicating a parking lot availability transmission request from the terminal device 202, the parking lot server device 800 transmits data Dd indicating the parking lot availability to the terminal device 202. In the present embodiment, the function as the processing device 602 is realized by the cooperation between the ECU 380 of the vehicle 302 and the parking lot server device 800. The processing device 602 acquires image data Da representing a parked image, which is an image captured while the vehicle 302 is parked, and utilizes the acquired image data Da to determine a predetermined image related to the situation around the vehicle 302. Execute the process.
　処理装置６０２が実行する所定の処理には、車両３０２が駐車された駐車場の空き状況を管理するための管理処理が含まれている。管理処理は、駐車場サーバ装置８００が主体になって実行する処理であり、例えば、次のような内容の処理とすることができる。すなわち、一般的な駐車場サーバ装置は、駐車場に設けられたカメラにより撮像された駐車場内の画像に基づいて、各駐車スペースに車両が駐車されているか否かを判断し、その判断結果に基づいて駐車場の空き状況の更新などを行うようになっている。 The predetermined process executed by the processing device 602 includes a management process for managing the availability of the parking lot in which the vehicle 302 is parked. The management process is a process executed mainly by the parking lot server device 800, and can be, for example, a process having the following contents. That is, a general parking lot server device determines whether or not a vehicle is parked in each parking space based on an image in the parking lot captured by a camera provided in the parking lot, and uses the determination result as a result. Based on this, the availability of parking lots is updated.
　しかし、駐車場に設けられたカメラが、例えばその撮像範囲を遮るような障害物が存在する場合など、何らかの原因で駐車場の少なくとも一部を撮像できなくなるような状況が生じた場合、駐車場の空き状況の管理が不十分になるおそれがある。そこで、本実施形態の管理処理では、駐車場のカメラ８３０により撮像された画像に加え、車両３０２の各種カメラ３２１により撮像された画像に基づいて、各駐車スペースに車両が駐車されているか否かが判断され、その判断結果に基づいて駐車場の空き状況の更新などが行われるようになっている。 However, if for some reason the camera installed in the parking lot cannot capture at least a part of the parking lot, such as when there is an obstacle that blocks the imaging range of the parking lot, the parking lot There is a risk of insufficient management of availability. Therefore, in the management process of the present embodiment, whether or not the vehicle is parked in each parking space based on the images captured by the cameras 830 of the parking lot and the images captured by the various cameras 321 of the vehicle 302. Is judged, and the availability of parking lots is updated based on the judgment result.
　このような管理処理に関する一連の処理の流れは、図９に示すようなものとなる。図９に示す一連の処理は、予め定められた所定のタイミングで実行されるようになっている。このような所定のタイミングとしては、予め定められた所定時間が経過した時点、車両の入庫または出庫が行われたことが検知された時点など、様々なタイミングとすることができる。 The flow of a series of processes related to such management process is as shown in FIG. The series of processes shown in FIG. 9 is executed at a predetermined timing. Such a predetermined timing can be various timings such as a time when a predetermined predetermined time has elapsed, a time when it is detected that the vehicle has been loaded or unloaded.
　このような一連の処理において、最初に実行されるステップＳ５００では、車両３０２の各種カメラ３２１により撮像された画像を表す画像データＤａが取得され、次いで実行されるステップＳ６００では、駐車場のカメラ８３０により撮像された画像を表す画像データＤｃが取得される。なお、ステップＳ５００およびＳ６００の実行順は、入れ替えることができる。続くステップＳ７００では、画像データＤａおよび画像データＤｃに基づいて、各駐車スペースに対する車両の駐車の有無が判断され、その判断結果に基づいて駐車場の空き状況の更新が行われる。ステップＳ７００の実行後、一連の処理が終了となる。 In such a series of processes, in step S500 executed first, image data Da representing an image captured by various cameras 321 of the vehicle 302 is acquired, and in step S600 executed subsequently, camera 830 in the parking lot Image data Dc representing the image captured by is acquired. The execution order of steps S500 and S600 can be changed. In the following step S700, whether or not the vehicle is parked in each parking space is determined based on the image data Da and the image data Dc, and the availability of the parking lot is updated based on the determination result. After the execution of step S700, a series of processes is completed.
　以上説明した本実施形態によっても、上記各実施形態と同様、車両３０２の駐車中に撮像された画像を有効に利用することができるという優れた効果が得られる。本実施形態の処理装置６０２が実行する所定の処理には、車両３０２が駐車された駐車場の空き状況を管理するための管理処理が含まれている。このようにすれば、車両３０２の駐車中に撮像された画像を駐車場の空き状況を管理するために有効に利用することができる。 The present embodiment described above also has an excellent effect that the image captured while the vehicle 302 is parked can be effectively used as in each of the above embodiments. The predetermined process executed by the processing device 602 of the present embodiment includes a management process for managing the availability of the parking lot in which the vehicle 302 is parked. In this way, the image captured while the vehicle 302 is parked can be effectively used for managing the availability of the parking lot.
　本実施形態の管理処理では、駐車場のカメラ８３０により撮像された画像を表す画像データＤｃに加え、車両３０２の各種カメラ３２１により撮像された画像を表す画像データＤａに基づいて、各駐車スペースに車両が駐車されているか否かが判断され、その判断結果に基づいて駐車場の空き状況の更新などが行われるようになっている。このようにすれば、駐車場に設けられたカメラ８３０が何らかの原因で駐車場の少なくとも一部を撮像できなくなるような状況が生じた場合でも、それを車両３０２により撮像された画像により補間することが可能となる。したがって、本実施形態によれば、駐車場の空き状況の管理に関する精度を向上することができるという効果が得られる。 In the management process of the present embodiment, in addition to the image data Dc representing the image captured by the camera 830 of the parking lot, each parking space is set based on the image data Da representing the image captured by the various cameras 321 of the vehicle 302. Whether or not the vehicle is parked is determined, and the availability of the parking lot is updated based on the determination result. In this way, even if a situation occurs in which the camera 830 provided in the parking lot cannot capture at least a part of the parking lot for some reason, it can be interpolated by the image captured by the vehicle 302. Is possible. Therefore, according to the present embodiment, it is possible to improve the accuracy of managing the availability of the parking lot.
　　　（その他の実施形態）
　なお、本開示は上記し且つ図面に記載した各実施形態に限定されるものではなく、その要旨を逸脱しない範囲で任意に変形、組み合わせ、あるいは拡張することができる。
　上記各実施形態で示した数値などは例示であり、それに限定されるものではない。
　処理装置６００、６０１が実行する所定の処理のうち、威嚇処理は省略してもよい。
　処理装置６００、６０１が実行する所定の処理として、検知処理により不審者の接近が検知された際に警察、警備会社などに自動的に通報する通報処理が含まれていてもよい。 (Other embodiments)
It should be noted that the present disclosure is not limited to each of the embodiments described above and in the drawings, and can be arbitrarily modified, combined, or extended without departing from the gist thereof.
The numerical values and the like shown in each of the above embodiments are examples, and are not limited thereto.
Of the predetermined processes executed by the processing devices 600 and 601, the threatening process may be omitted.
The predetermined processing executed by the processing devices 600 and 601 may include a notification processing that automatically notifies the police, a security company, etc. when the approach of a suspicious person is detected by the detection processing.
　撮像装置としては、ドライブレコーダ３２０、３７０に含まれる各種カメラ３２１、つまりドライブレコーダ３２０、３７０専用のカメラに限らずともよく、ドライブレコーダ３２０、３７０とは異なる他の装置で用いられるカメラなどを流用する形でもよい。例えば、撮像装置としては、車両３００の後退時に後方をモニタするために用いられるリアカメラなどでもよい。
　車両としては、ＥＶである車両３００、３０２に限らずともよく、ハイブリッド車でもよいし、非ハイブリッド車、いわゆるコンベ車でもよい。ただし、車両としてハイブリッド車またはコンベ車を採用する場合、撮像装置による撮像を継続的に可能とすることができるだけの容量を有するバッテリを準備する必要がある。 The image pickup device is not limited to the various cameras 321 included in the drive recorder 320 and 370, that is, the camera dedicated to the drive recorder 320 and 370, and a camera used in another device different from the drive recorder 320 and 370 is diverted. It may be in the form of For example, the image pickup device may be a rear camera used to monitor the rear of the vehicle 300 when the vehicle is retracted.
The vehicle is not limited to the EV vehicles 300 and 302, and may be a hybrid vehicle or a non-hybrid vehicle, a so-called combo vehicle. However, when a hybrid vehicle or a combo vehicle is adopted as the vehicle, it is necessary to prepare a battery having a capacity sufficient to continuously enable imaging by the imaging device.
　本開示は、実施例に準拠して記述されたが、本開示は当該実施例や構造に限定されるものではないと理解される。本開示は、様々な変形例や均等範囲内の変形をも包含する。加えて、様々な組み合わせや形態、さらには、それらに一要素のみ、それ以上、あるいはそれ以下、を含む他の組み合わせや形態をも、本開示の範疇や思想範囲に入るものである。 Although this disclosure has been described in accordance with the examples, it is understood that the disclosure is not limited to the examples and structures. The present disclosure also includes various modifications and modifications within an equal range. In addition, various combinations and forms, as well as other combinations and forms that include only one element, more, or less, are also within the scope of the present disclosure.
　本開示に記載の制御部及びその手法は、コンピュータプログラムにより具体化された一つ乃至は複数の機能を実行するようにプログラムされたプロセッサ及びメモリーを構成することによって提供された専用コンピュータにより、実現されてもよい。あるいは、本開示に記載の制御部及びその手法は、一つ以上の専用ハードウェア論理回路によってプロセッサを構成することによって提供された専用コンピュータにより、実現されてもよい。もしくは、本開示に記載の制御部及びその手法は、一つ乃至は複数の機能を実行するようにプログラムされたプロセッサ及びメモリーと一つ以上のハードウェア論理回路によって構成されたプロセッサとの組み合わせにより構成された一つ以上の専用コンピュータにより、実現されてもよい。また、コンピュータプログラムは、コンピュータにより実行されるインストラクションとして、コンピュータ読み取り可能な非遷移有形記録媒体に記憶されていてもよい。 The controls and methods thereof described in the present disclosure are realized by a dedicated computer provided by configuring a processor and memory programmed to perform one or more functions embodied by a computer program. May be done. Alternatively, the controls and methods thereof described in the present disclosure may be implemented by a dedicated computer provided by configuring the processor with one or more dedicated hardware logic circuits. Alternatively, the control unit and method thereof described in the present disclosure may be a combination of a processor and memory programmed to perform one or more functions and a processor composed of one or more hardware logic circuits. It may be realized by one or more dedicated computers configured. Further, the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.

Claims (7)

  1. 　車両（３００、３０２）に搭載され、前記車両に搭載されたバッテリ（３１０）から電力供給を受けて動作し、前記車両の周辺を継続的に撮像可能な撮像装置（３２１）と、
    　前記車両の駐車中に前記撮像装置により撮像された画像である駐車中画像を表す画像データを取得し、その取得した画像データを活用して前記車両の周辺の状況に関連する所定の処理を実行する処理装置（６００、６０１、６０２）と、
    　を備える駐車中画像活用システム。     An image pickup device (321) that is mounted on a vehicle (300, 302), operates by receiving power from a battery (310) mounted on the vehicle, and can continuously image the surroundings of the vehicle.
    Image data representing a parked image, which is an image captured by the imaging device while the vehicle is parked, is acquired, and the acquired image data is used to execute a predetermined process related to the situation around the vehicle. Processing equipment (600, 601, 602) and
    A parking image utilization system equipped with.
  2. 　前記処理装置（６００、６０１）が実行する前記所定の処理には、駐車中の前記車両に対する不審者の接近を検知するための検知処理が含まれている請求項１に記載の駐車中画像活用システム。 The parked image utilization according to claim 1, wherein the predetermined process executed by the processing device (600, 601) includes a detection process for detecting the approach of a suspicious person to the parked vehicle. system.
  3. 　前記検知処理では、前記画像データを前記不審者の情報が蓄積されたデータベース（７１０）と照合することにより、前記不審者の接近を検知する請求項２に記載の駐車中画像活用システム。 The parking image utilization system according to claim 2, wherein in the detection process, the image data is collated with a database (710) in which information on the suspicious person is accumulated to detect the approach of the suspicious person.
  4. 　前記処理装置（６００、６０１）が実行する前記所定の処理には、前記検知処理により接近が検知された前記不審者を威嚇するための威嚇処理が含まれている請求項２または３に記載の駐車中画像活用システム。 The second or third claim, wherein the predetermined process executed by the processing apparatus (600, 601) includes a threatening process for intimidating the suspicious person whose approach is detected by the detection process. Image utilization system while parking.
  5. 　前記処理装置（６０１）は、前記検知処理により前記不審者の接近が検知されると、自動的に前記威嚇処理を実行するようになっている請求項４に記載の駐車中画像活用システム。 The parking image utilization system according to claim 4, wherein the processing device (601) automatically executes the threatening process when the approach of the suspicious person is detected by the detection process.
  6. 　前記処理装置（６００）は、前記検知処理により前記不審者の接近が検知されるとともに、前記車両のユーザから前記威嚇処理を実行するための指示が与えられると、前記威嚇処理を実行するようになっている請求項４に記載の駐車中画像活用システム。 When the detection process detects the approach of the suspicious person and the user of the vehicle gives an instruction to execute the threatening process, the processing device (600) executes the threatening process. The parking image utilization system according to claim 4.
  7. 　前記処理装置（６０２）が実行する前記所定の処理には、前記車両（３０２）が駐車された駐車場の空き状況を管理するための管理処理が含まれている請求項１に記載の駐車中画像活用システム。 The parking lot according to claim 1, wherein the predetermined process executed by the processing device (602) includes a management process for managing the availability of the parking lot in which the vehicle (302) is parked. Image utilization system.
PCT/JP2020/027854 2019-07-26 2020-07-17 Parked image utilization system WO2021020173A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202080052044.2A CN114127815A (en) 2019-07-26 2020-07-17 Image utilization system in parking

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019137868A JP2021020548A (en) 2019-07-26 2019-07-26 Image during parking utilization system
JP2019-137868 2019-07-26

Publications (1)

Publication Number Publication Date
WO2021020173A1 true WO2021020173A1 (en) 2021-02-04

Family

ID=74229670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/027854 WO2021020173A1 (en) 2019-07-26 2020-07-17 Parked image utilization system

Country Status (3)

Country Link
JP (1) JP2021020548A (en)
CN (1) CN114127815A (en)
WO (1) WO2021020173A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006107279A (en) * 2004-10-07 2006-04-20 Matsushita Electric Ind Co Ltd Crime preventing device and remote surveillance system
JP2007126118A (en) * 2005-10-04 2007-05-24 Toyota Motor Corp Warning device and vehicle security system
JP2011065279A (en) * 2009-09-15 2011-03-31 Aisin Seiki Co Ltd Parking space guidance system
JP2011251563A (en) * 2010-05-31 2011-12-15 Toyota Motor Corp Security device and security system
JP3176875U (en) * 2011-12-06 2012-07-12 ツーフィット株式会社 Adapter with a built-in timer for operating the drive recorder in conjunction with the car security system
JP2013036251A (en) * 2011-08-09 2013-02-21 Aisin Seiki Co Ltd Vehicle opening/closing body operation device and system with on-vehicle camera and portable information terminal, and control method thereof
JP2013116694A (en) * 2011-12-05 2013-06-13 Denso Corp Vehicle power supply system
JP2019079194A (en) * 2017-10-23 2019-05-23 トヨタ自動車株式会社 Information providing system, vehicle, and, program

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100583128C (en) * 2008-06-12 2010-01-20 浙江大学 Real time intelligent control method based on natural video frequency
CN101692313A (en) * 2009-07-03 2010-04-07 华东师范大学 Portable vehicle recognition device base on embedded platform

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006107279A (en) * 2004-10-07 2006-04-20 Matsushita Electric Ind Co Ltd Crime preventing device and remote surveillance system
JP2007126118A (en) * 2005-10-04 2007-05-24 Toyota Motor Corp Warning device and vehicle security system
JP2011065279A (en) * 2009-09-15 2011-03-31 Aisin Seiki Co Ltd Parking space guidance system
JP2011251563A (en) * 2010-05-31 2011-12-15 Toyota Motor Corp Security device and security system
JP2013036251A (en) * 2011-08-09 2013-02-21 Aisin Seiki Co Ltd Vehicle opening/closing body operation device and system with on-vehicle camera and portable information terminal, and control method thereof
JP2013116694A (en) * 2011-12-05 2013-06-13 Denso Corp Vehicle power supply system
JP3176875U (en) * 2011-12-06 2012-07-12 ツーフィット株式会社 Adapter with a built-in timer for operating the drive recorder in conjunction with the car security system
JP2019079194A (en) * 2017-10-23 2019-05-23 トヨタ自動車株式会社 Information providing system, vehicle, and, program

Also Published As

Publication number Publication date
JP2021020548A (en) 2021-02-18
CN114127815A (en) 2022-03-01

Similar Documents

Publication Publication Date Title
US11606516B2 (en) Image processing device, image processing method, and image processing system
US11704947B2 (en) In-vehicle sensing module for monitoring a vehicle
CN105015421A (en) Running automobile safety monitoring instrument and control method
KR100775610B1 (en) Black box for vehicle and method for management using the same
JP6669240B1 (en) Recording control device, recording control system, recording control method, and recording control program
KR101428011B1 (en) Method for Recognizing Vehicle Information of Vehicle Black Box and System thereof
CN104730494A (en) Mobile Gunshot Detection
WO2021244591A1 (en) Driving auxiliary device and method, and vehicle and storage medium
US11044566B2 (en) Vehicle external speaker system
CN102819880B (en) A kind of method of comprehensive reduction road accident image
JP7002371B2 (en) Vehicle rental system and vehicle rental management device
KR20140128836A (en) Image-processing Apparatus for Car and Method of Providing Information Using The Same
KR102111755B1 (en) Image-processing Apparatus for Car and Method of Controlling The Same
CN111064921A (en) Vehicle monitoring method, system and monitoring terminal
WO2021020173A1 (en) Parked image utilization system
KR20200085244A (en) Image-processing Apparatus for Car and Method of Processing Data Using The Same
CN111862529A (en) Alarm method and equipment
CN113544750A (en) Vehicle recording control device, vehicle recording control method, and program
JP6989347B2 (en) Vehicle condition determination device, vehicle condition determination system, vehicle condition determination method, and vehicle condition determination program
CN115601852A (en) Method and device for processing vehicle data and vehicle
JP2003085695A (en) Vehicle management system
JP2019086895A (en) Drive recorder system, vehicle to be used thereof, information collection device, and method
CN114898524A (en) Control system and method for voice interaction between vehicle owner and pedestrian
KR20140068312A (en) Method of managing traffic accicident information using electronic recording device of vehicle and apparatus for the same
CN114407831A (en) Vehicle with anti-theft alarm function and anti-theft alarm method and system for vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20848559

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20848559

Country of ref document: EP

Kind code of ref document: A1