CN111866359A - Multifunctional camera and automobile - Google Patents

Multifunctional camera and automobile Download PDF

Info

Publication number
CN111866359A
CN111866359A CN202010913492.9A CN202010913492A CN111866359A CN 111866359 A CN111866359 A CN 111866359A CN 202010913492 A CN202010913492 A CN 202010913492A CN 111866359 A CN111866359 A CN 111866359A
Authority
CN
China
Prior art keywords
camera
processor
processing result
video image
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010913492.9A
Other languages
Chinese (zh)
Inventor
陈宇
万炜
张鹏飞
吴伟峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Haima Motor Corp
Haima New Energy Vehicle Co Ltd
Original Assignee
Haima Motor Corp
Haima New Energy Vehicle Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Haima Motor Corp, Haima New Energy Vehicle Co Ltd filed Critical Haima Motor Corp
Priority to CN202010913492.9A priority Critical patent/CN111866359A/en
Publication of CN111866359A publication Critical patent/CN111866359A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Studio Devices (AREA)

Abstract

The application provides a multi-functional camera and car relates to car technical field, and this multi-functional camera includes: the device comprises a rotary camera, a video signal input module, a processor and a display module; the rotary camera is connected with the processor through the video signal input module and is used for rotating to a preset target angle under the control of the processor, acquiring a video image and transmitting the video image to the processor through the video signal input module; the processor processes the video image, generates a processing result in a corresponding working mode, and transmits the processing result to the display module for displaying. The utility model provides a scheme need not set up a plurality of cameras, only sets up a rotatory camera, has reduced the automobile body and has installed the cost of camera additional, makes whole car subtract heavy simultaneously, realizes the lightweight, through setting up rotatable camera, can launch different functions when the camera rotates to not equidirectional angle, with multi-functional integration on a camera, satisfies the demand of customer to the different scenes of camera.

Description

Multifunctional camera and automobile
Technical Field
The invention relates to the technical field of automobiles, in particular to a multifunctional camera and an automobile.
Background
The camera quantity of present inside camera system of car is more, and to whole car, every sets up a camera more and all need increase extra erection support and guard shield, and these mounting structure and installation space all need consider, set up extra erection support, guard shield and automobile body cooperation change and all increase the mould cost to the camera that extra is many also increases a lot to whole car cost itself. The quantity of camera is more, and is more with control module's video transmission/receiving chip, and the fault point is more, can increase problem analysis's the degree of difficulty, reduces failure analysis's speed, to sum up, each camera of current inside camera system of car is towards different target direction, each plays its own role, integrates poorly.
Disclosure of Invention
The invention aims to provide a multifunctional camera and an automobile, which can solve the problems of more cameras, poor integration, high cost and the like in the traditional automobile.
The invention provides a technical scheme that:
in a first aspect, an embodiment of the present invention provides a multifunctional camera, where the multifunctional camera includes: the device comprises a rotary camera, a video signal input module, a processor and a display module;
the rotary camera is connected with the processor through the video signal input module, and the processor is electrically connected with the display module;
the rotary camera is used for rotating to a preset target angle under the control of the processor and collecting a video image of the preset target angle, and the rotary camera transmits the collected video image to the processor through the video signal input module;
the processor is used for processing the video image according to a working mode set by a user, generating a processing result corresponding to the working mode, and transmitting the processing result to the display module for displaying.
In an optional embodiment, the working mode includes a fatigue driving detection mode, and when the working mode of the multifunctional camera is the fatigue driving detection mode, the rotating camera is used for rotating to an angle towards a driving position of the automobile under the control of the processor to acquire a video image;
the processor is used for determining the ratio of the area of the pupil of the driver covered by the eyelid to the pupil area according to the collected video image;
and when the proportional value is larger than a set value, generating a fatigue driving processing result.
In an optional embodiment, the working mode includes a face recognition mode, and when the working mode of the multifunctional camera is the face recognition mode, the rotating camera is configured to rotate to an angle toward a driving seat of an automobile under the control of the processor to acquire a video image;
and the processor is used for matching the face image in the video image with a preset face image of the driver and generating an abnormal processing result of the driver when the matching degree is lower than a set value.
In an optional embodiment, the working mode includes a bad behavior detection mode, and when the working mode of the multifunctional camera is the bad behavior detection mode, the rotating camera is configured to rotate to an angle toward a driving seat of an automobile under the control of the processor to acquire a video image;
the processor is configured to determine gaze direction data of the driver from the video images, the gaze direction data including a time at which the driver gazes in a non-traffic direction;
when the time that the driver gazes at the non-passing direction exceeds a threshold value, the processor generates an adverse driving behavior processing result.
In an optional implementation manner, the multifunctional camera comprises an alarm module, the processor is configured to generate an alarm signal when the processing result is a fatigue driving processing result, a driver abnormal processing result or a bad driving behavior processing result, and send the alarm signal to the alarm module, and the alarm module sends out warning information according to the alarm signal.
In an optional embodiment, the operation mode further comprises an anti-forgetting mode;
when the automobile is in a flameout state and the working mode of the multifunctional camera is a forgetting prevention mode, the rotary camera is used for rotating to an angle towards a rear seat under the control of the processor so as to collect a video image;
the processor is used for determining whether passengers exist in the carriage or not according to the video images, and if the passengers exist, an anti-forgetting processing result is generated.
In an alternative embodiment, the multifunctional camera comprises a communication unit, the communication unit is connected with the processor;
when the processor generates the anti-forgetting processing result, the processor sends the anti-forgetting processing result to a mobile terminal hosted by the vehicle through the communication unit.
In an optional embodiment, the multifunctional camera includes a communication unit, the communication unit is electrically connected to the processor, the communication unit is further configured to be electrically connected to a mobile terminal of a vehicle owner, the communication unit is configured to receive an angle adjustment instruction of the mobile terminal and send the angle adjustment instruction to the processor, and the angle adjustment instruction includes target angle information;
and the processor controls the rotary camera to rotate to the target angle according to the angle adjusting instruction.
In an optional embodiment, the rotary camera includes a rotary base and a near-infrared camera, and the near-infrared camera is disposed on the rotary base.
In a second aspect, an embodiment of the present invention provides an automobile, which includes the multifunctional camera according to any one of the foregoing embodiments.
Compared with the prior art, the multifunctional camera provided by the invention comprises: the device comprises a rotary camera, a video signal input module, a processor and a display module; the rotary camera is connected with the processor through the video signal input module, and the processor is electrically connected with the display module; the rotary camera is used for rotating to a preset target angle under the control of the processor and collecting a video image of the preset target angle, and the rotary camera transmits the collected video image to the processor through the video signal input module; the processor is used for processing the video image according to the working mode set by the user, generating a processing result in the corresponding working mode and transmitting the processing result to the display module for displaying. Need not set up a plurality of cameras, only set up a rotatory camera, reduced the automobile body and installed the cost of camera additional, made whole car subtract heavy simultaneously, realized the lightweight, through setting up rotatable camera, the camera is rotatory can launch different functions when not equidirectional angle, with multi-functional integration on a camera, satisfies the demand of customer to the different scenes of camera.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a schematic diagram of functional modules of a multifunctional camera according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a connection between a multifunctional camera and a mobile terminal according to the present invention;
fig. 3 is a schematic diagram of functional modules of another multifunctional camera according to the present invention.
Icon: 100-a multifunctional camera; 110-a processor; 120-rotating camera; 130-video signal input module; 140-a communication unit; 150-a power module; 160-alarm module; 170-display module.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", and the like, indicate orientations or positional relationships that are based on the orientations or positional relationships shown in the drawings, or the orientations or positional relationships that the products of the present invention conventionally put into use, or the orientations or positional relationships that the persons skilled in the art conventionally understand, are only used for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the equipment or elements referred to must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The traditional in-vehicle multifunctional camera system is an image system comprising 1 control module and a plurality of cameras, a plurality of cameras in a vehicle are used for image recognition and collection, then image files are transmitted to the control module, and the control module performs analysis processing.
The mainstream function that multi-functional camera system realized in the car includes face identification, driver fatigue, children prevent forgetting, bad behavior monitoring (like the smoking, see window outdoor scenery etc.) functions such as, realize these functions of above-mentioned camera in the car, need 4 cameras at least according to traditional mode, to whole car, every extra camera that sets up more all need increase extra erection support and guard shield, these mounting structure and installation space all need consider, furthermore, erection support, the guard shield, the mould cost is all increased in the automobile body cooperation change, and the extra camera that sets up more quantity also can produce higher cost itself, the camera is more, and control module's video transmission/receiving chip is more, the fault point is more, entire system's stability, the reliability is lower.
In order to improve the above problem, the present embodiment provides a multifunctional camera 100, please refer to fig. 1, and fig. 1 shows a functional module schematic diagram of the multifunctional camera 100 provided in the present embodiment.
The multifunctional camera 100 provided in this embodiment includes: a rotary camera 120, a video signal input module 130, a processor 110 and a display module 170.
The rotary camera 120 is connected to the processor 110 through the video signal input module 130, the display module 170 is connected to the processor 110, and the rotary camera 120 is further connected to the processor 110 through a control line.
The rotary camera 120 is connected to the processor 110 through a control line to rotate to different angles under the control of the processor 110 for image capturing, in this embodiment, the rotary camera 120 is configured to rotate to a preset target angle under the control of the processor 110 and capture a video image of the preset target angle, and the rotary camera 120 transmits the captured video image to the processor 110 through the video signal input module 130.
The multifunctional camera 100 includes a plurality of different operating modes, such as a fatigue driving detection mode, and the processor 110 is configured to process the video image according to the operating mode set by the user, generate a processing result in the corresponding operating mode, and transmit the processing result to the display module 170 for displaying.
In different working modes, the processor 110 performs different processing on the acquired video images, for example, when the video images are in a face recognition mode, the processor 110 is mainly used for recognizing people in the video images, and when the video images are in a bad behavior detection mode, the processor 110 is mainly used for judging whether the driver has bad behaviors according to the video images; under different working modes, the processor 110 performs different processing on the video image to generate corresponding processing results, and outputs the processing results to the display module 170 for display.
In a possible implementation manner, the display module 170 may be a car machine, which may be disposed on a center console, or may be disposed on an instrument panel of a driving seat, which is not limited in this embodiment.
In one possible implementation, the multifunctional camera 100 includes a communication unit 140, the communication unit 140 is connected to the processor 110, and the communication unit 140 is further configured to be in communication connection with a mobile terminal of a user (vehicle owner). Referring to fig. 2, the communication unit 140 may be configured to send the relevant information generated by the processor 110 to a mobile terminal of a vehicle owner, for example, send a video image acquired by the rotary camera 120 to the mobile terminal of the vehicle owner, the communication unit 140 may further receive an instruction sent by the vehicle owner through the mobile terminal, for example, the vehicle owner may send an angle adjustment instruction to the multifunctional camera 100 through the mobile terminal, the communication unit 140 is configured to receive the angle adjustment instruction of the mobile terminal and send the angle adjustment instruction to the processor 110, and the angle adjustment instruction includes target angle information; the processor 110 controls the rotating camera 120 to rotate to the target angle according to the angle adjustment instruction. After the target angle is reached, the rotating camera 120 captures a video image of the target angle, and transmits the video image to the processor 110 through the video signal input module 130, and the processor 110 can transmit the video image to the mobile terminal of the vehicle owner through the communication unit 140 for the user to watch.
In one possible implementation manner, please refer to fig. 3, the multifunctional camera 100 includes an alarm module 160, the alarm module 160 is electrically connected to the processor 110, the processor 110 is configured to generate an alarm signal when the processing result is a processing result of fatigue driving, a processing result of driver abnormality, or a processing result of bad driving behavior, and send the alarm signal to the alarm module 160, and the alarm module 160 sends out warning information according to the alarm signal.
The alarm module 160 includes an audible and visual prompting unit, for example, on one hand, it can display the related warning information for the user to browse; on the other hand, it may send out a related warning sound or broadcast a preset voice message to warn the user, for example, when the multifunctional camera 100 detects fatigue driving of the driver, it may send out an audible and visual warning through the warning module 160 to remind the user to pay attention to safety.
In an alternative embodiment, the rotating camera 120 includes a rotating base and a near infrared camera disposed on the rotating base. The rotary base is controlled by three-phase motors in the x direction, the y direction and the z direction, and can rotate 360 degrees.
In a possible implementation manner, the rotary camera 120 may be disposed in a rear view mirror inside a vehicle cabin, and may also be disposed in a center console of a vehicle, which is not limited in this embodiment.
The camera preferentially selects a near-infrared camera, and the near-infrared camera consists of a camera and an IR (near-infrared) LED module. Generally, 1-2 infrared night vision LED lamps with wavelength of 940nm or 850nm are usually selected, and the specific number can be selected according to the illumination effect inside the automobile.
In one possible implementation, the lens view angle of the camera cannot be the fisheye camera view angle, preferably the near-infrared camera HFOV horizontal view angle is 60 ° to 80 °, and the near-infrared camera VFOV vertical view angle is 30 ° to 50 °.
In one possible implementation, the multifunctional camera 100 further includes a power module 150, and the power module 150 is used to supply power to the multifunctional camera 100, for example, the power module 150 may convert the power supplied by the automobile to supply the processor 110, the rotating camera 120, and other components.
The processor 110 may be an integrated circuit chip having signal processing capabilities. The Processor 110 may be a general-purpose Processor 110, including a Central Processing Unit (CPU) 110, a Network Processor (NP) 110, and the like; but may also be a Digital signal processor 110 (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware components. General purpose processor 110 may be a microprocessor 110; the processor 110 may also be any conventional processor 110 or the like. In this embodiment, the processor 110 may preferably adopt a model of full log SOCT7/T5+ NPU.
Several different modes of operation of the multi-function camera 100 are described below.
In a possible implementation manner, the operation mode of the multifunctional camera 100 includes a fatigue driving detection mode, when the operation mode of the multifunctional camera 100 is the fatigue driving detection mode, the rotating camera 120 is rotated to an angle towards the driving position of the automobile under the control of the processor 110 to capture a video image of the driving position of the automobile, and understandably, the fatigue driving detection mode is mainly used for detecting whether the driver of the automobile has fatigue driving or not, and therefore, the rotating camera 120 is controlled to rotate to the angle towards the driving position to capture a video image of the driving position.
The rotary camera 120 transmits the captured video image to the processor 110 through the video signal input module 130, and the processor 110 is configured to determine whether the driver is tired driving according to the captured video image.
In one possible implementation, the processor 110 extracts a face image of the driver in the video image, determines a ratio of an area of the pupil of the driver covered by the eyelid to an area of the pupil, and generates a fatigue driving processing result when the ratio is greater than a set value.
It can be understood that when the driver is tired, the driver is easy to doze because of excessive fatigue, and traffic accidents are very easy to happen when the driver is inattentive or doze. In the solution provided in this embodiment, by extracting the pupil area of the eyes of the driver and taking the ratio of the covered area of the eyelid to the pupil area as the basis for determining whether the eyes are open, understandably, when the driver closes the eyes, the pupils are completely covered; when the driver is in good spirit and focuses on driving, the pupil is not covered or is covered by a small part, so that when the ratio of the area of the pupil of the driver covered by the eyelid to the pupil area is larger than a set value, the fatigue driving of the driver is judged, and a fatigue driving result is generated.
In one possible implementation, when generating the fatigue driving result, the processor 110 may control an alarm device in the vehicle to give an alarm, alert the driver, and send a voice prompt, such as "please take a rest, ensure driving safety", or the like.
In another possible implementation manner, the working mode of the multifunctional camera 100 includes a face recognition mode, and when the working mode of the multifunctional camera 100 is the face recognition mode, the multifunctional camera is mainly used for recognizing whether a driver at the driving position is a preset driver with authority, so that the rotary camera 120 is controlled to rotate to an angle towards the driving position to acquire a video image of the driving position.
The rotary camera 120 rotates to an angle toward a driving position of the automobile under the control of the processor 110, and collects a video image; the acquired video image is transmitted to the processor 110 through the video signal input module 130, and the processor 110 is configured to match a face image in the video image with a preset face image of the driver, and generate a driver exception handling result when the matching degree is lower than a set value.
In a possible implementation manner, the processor 110 may collect face images of a plurality of different drivers in advance as a driver face image database with authority, and of course, the face image database is not limited to the face image of the driving position, and may also be a co-driving position face image database.
When the working mode of the multifunctional camera 100 is a face recognition mode, the rotary camera 120 rotates to a corresponding position to collect a corresponding face image, which is not limited to a driving position, but also includes a co-driving position. For example, the rotary camera 120 rotates to an angle toward the driving position, shoots a face image of the driving position, and sends the collected face image to the processor 110, the processor 110 matches the collected face image of the driving position with a preset driver face image database, when the matching degree is greater than a set value, it is determined that the person in the driving position is a driver with authority, and when the matching degree is lower than the set value, it is determined that the person in the driving position is not a driver with related authority, and a driver exception handling result is generated.
In another possible implementation manner, the face of the copilot can be recognized by using a face recognition mode, and a functional area (such as a part of the central control functional area) corresponding to the copilot can be opened or closed according to the face recognition result.
For example, the center control area of the copilot is provided with an audio-visual module, when the rotary camera 120 rotates to an angle towards the copilot, the face image of the copilot is shot, the collected face image is sent to the processor 110, the processor 110 compares the collected copilot face image with the copilot face image database, when the matching degree is greater than a set value, the person in the copilot is determined to be the copilot person with authority, and then the functional area corresponding to the copilot is started; and when the matching degree is lower than a set value, determining that the passenger in the copilot is not a driver with related authority, and closing the functional area corresponding to the copilot.
In another possible implementation, the operation mode of the multifunctional camera 100 includes a bad behavior detection mode for detecting whether the driver is attentive to driving.
When the operation mode of the multifunctional camera 100 is the bad behavior detection mode, the rotating camera 120 is configured to rotate to an angle toward the driving seat of the automobile under the control of the processor 110 to capture a video image. The processor 110 is configured to determine, from the video images, gaze direction data of the driver, the gaze direction data including a time at which the driver gazes in the non-traffic direction; when the time the driver looks in the non-passing direction exceeds a threshold, the processor 110 generates an adverse driving behavior processing result.
It is understood that the driver should be looking at the driving direction of the car without looking to the right during driving, and is determined as bad behavior if the driver frequently looks to the right during driving and looks at the non-passing direction.
In one possible implementation, when the operation mode of the multifunctional camera 100 is the bad behavior detection mode, the rotating camera 120 captures a video image of the driving seat, the processor 110 extracts image frames, for example, 0.1s, from the video image at preset time intervals, and determines the gaze direction data of the driver according to the image frames in the extracted video image, wherein the gaze direction data includes the time when the driver gazes in the non-traffic direction.
For example, a plurality of image frames are continuously extracted at time intervals of 0.1s, the direction of the driver's gaze in each image frame is determined, and if the number of the continuous image frames in which the driver gazes in the non-passing direction reaches a certain number, that is, the time for the driver to continuously gaze in the non-passing direction exceeds a threshold value, a poor driving behavior processing result is generated.
In another possible implementation manner, the operation mode of the multifunctional camera 100 includes a forgetting prevention mode, and the forgetting prevention mode is used for preventing a part of passengers from being locked in the vehicle by the vehicle, so as to avoid a safety accident.
When the automobile is in an off state, the operation mode of the multifunctional camera 100 is a forgetting prevention mode, and the rotating camera 120 is used for rotating to an angle towards the rear seat under the control of the processor 110 to collect a video image.
In this embodiment, the rotating camera 120 is a near-infrared camera, the near-infrared camera can capture an infrared image of the vehicle compartment, and the processor 110 is configured to determine whether a passenger is present in the vehicle compartment according to the infrared image, and generate an anti-forgetting processing result if the passenger is present in the vehicle compartment and the vehicle status is in a flameout locked state.
When the processor 110 generates the anti-forgetting processing result, the processor 110 transmits the anti-forgetting processing result to the mobile terminal of the user through the communication unit 140, and simultaneously transmits the video image in the vehicle compartment to the mobile terminal of the user.
In a second aspect, the present embodiment further provides an automobile (not shown), which includes the multifunctional camera 100 provided in the foregoing embodiment.
It should be noted that the technical effects and technical principles of the vehicle according to the present embodiment are substantially the same as those of the multifunctional camera 100 according to the above-mentioned embodiment, and the detailed description of the present embodiment is omitted.
To sum up, this application provides a multi-functional camera and car, and this multi-functional camera includes: the device comprises a rotary camera, a video signal input module, a processor and a display module; the rotary camera is connected with the processor through the video signal input module, and the processor is electrically connected with the display module; the rotary camera is used for rotating to a preset target angle under the control of the processor and collecting a video image of the preset target angle, and the rotary camera transmits the collected video image to the processor through the video signal input module; the processor is used for processing the video image according to the working mode set by the user, generating a processing result in the corresponding working mode and transmitting the processing result to the display module for displaying. Need not set up a plurality of cameras, only set up a rotatory camera, reduced the automobile body and installed the cost of camera additional, made whole car subtract heavy simultaneously, realized the lightweight, through setting up rotatable camera, the camera is rotatory can launch different functions when not equidirectional angle, with multi-functional integration on a camera, satisfies the demand of customer to the different scenes of camera.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. The utility model provides a multifunctional camera which characterized in that, multifunctional camera includes: the device comprises a rotary camera, a video signal input module, a processor and a display module;
the rotary camera is connected with the processor through the video signal input module, and the processor is electrically connected with the display module;
the rotary camera is used for rotating to a preset target angle under the control of the processor and collecting a video image of the preset target angle, and the rotary camera transmits the collected video image to the processor through the video signal input module;
the processor is used for processing the video image according to a working mode set by a user, generating a processing result corresponding to the working mode, and transmitting the processing result to the display module for displaying.
2. The multi-function camera of claim 1, wherein the operating mode comprises a fatigue driving detection mode, and when the operating mode of the multi-function camera is the fatigue driving detection mode, the rotating camera is configured to rotate to an angle toward a driving position of the vehicle under the control of the processor to capture video images;
the processor is used for determining the ratio of the area of the pupil of the driver covered by the eyelid to the pupil area according to the collected video image;
and when the ratio is larger than a set value, generating a fatigue driving processing result.
3. The multifunctional camera of claim 1, wherein the working mode comprises a face recognition mode, and when the working mode of the multifunctional camera is the face recognition mode, the rotating camera is configured to rotate to an angle toward a driving seat of a car under the control of the processor to capture a video image;
and the processor is used for matching the face image in the video image with a preset face image of the driver and generating an abnormal processing result of the driver when the matching degree is lower than a set value.
4. The multi-function camera of claim 1, wherein the operation mode comprises a bad behavior detection mode, and when the operation mode of the multi-function camera is the bad behavior detection mode, the rotating camera is configured to rotate to an angle toward a driving seat of a vehicle under the control of the processor to capture a video image;
the processor is used for determining the gazing direction data of the driver according to the video images, wherein the gazing direction data comprises the time when the driver gazes in the non-passing direction;
when the time that the driver gazes at the non-passing direction exceeds a threshold value, the processor generates an adverse driving behavior processing result.
5. The multifunctional camera according to claim 1, wherein the multifunctional camera comprises an alarm module, the processor is configured to generate an alarm signal when the processing result is a fatigue driving processing result, a driver abnormal processing result, or a bad driving behavior processing result, and send the alarm signal to the alarm module, and the alarm module sends out alarm information according to the alarm signal.
6. The multi-functional camera of claim 1, wherein the operating modes further include an anti-forget mode;
when the automobile is in a flameout state and the working mode of the multifunctional camera is a forgetting prevention mode, the rotary camera is used for rotating to an angle towards the rear seat under the control of the processor so as to collect a video image;
the processor is used for determining whether passengers exist in the carriage or not according to the video images, and if the passengers exist, an anti-forgetting processing result is generated.
7. The multi-function camera of claim 6, comprising a communication unit, the communication unit being connected to the processor;
when the processor generates the anti-forgetting processing result, the processor sends the anti-forgetting processing result to a mobile terminal hosted by the vehicle through the communication unit.
8. The multifunctional camera according to claim 1, wherein the multifunctional camera comprises a communication unit, the communication unit is electrically connected with the processor, the communication unit is further electrically connected with a mobile terminal of a vehicle owner, the communication unit is configured to receive an angle adjustment instruction of the mobile terminal and send the angle adjustment instruction to the processor, and the angle adjustment instruction comprises target angle information;
and the processor controls the rotary camera to rotate to the target angle according to the angle adjusting instruction.
9. The multifunctional camera according to claim 1, wherein the rotary camera comprises a rotary base and a near-infrared camera, the near-infrared camera being disposed on the rotary base.
10. An automobile, characterized in that the automobile comprises the multifunctional camera as claimed in any one of claims 1 to 9.
CN202010913492.9A 2020-09-03 2020-09-03 Multifunctional camera and automobile Pending CN111866359A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010913492.9A CN111866359A (en) 2020-09-03 2020-09-03 Multifunctional camera and automobile

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010913492.9A CN111866359A (en) 2020-09-03 2020-09-03 Multifunctional camera and automobile

Publications (1)

Publication Number Publication Date
CN111866359A true CN111866359A (en) 2020-10-30

Family

ID=72966954

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010913492.9A Pending CN111866359A (en) 2020-09-03 2020-09-03 Multifunctional camera and automobile

Country Status (1)

Country Link
CN (1) CN111866359A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115914617A (en) * 2022-11-02 2023-04-04 清智汽车科技(苏州)有限公司 Auxiliary testing device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115914617A (en) * 2022-11-02 2023-04-04 清智汽车科技(苏州)有限公司 Auxiliary testing device

Similar Documents

Publication Publication Date Title
CN111417990B (en) System and method for vehicle fleet management in a fleet of vehicles using driver-oriented imaging devices to monitor driver behavior
US9460601B2 (en) Driver distraction and drowsiness warning and sleepiness reduction for accident avoidance
CN104408879B (en) Method, device and system for processing fatigue driving early warning
US7202792B2 (en) Drowsiness detection system and method
CN106218405A (en) Fatigue driving monitoring method and cloud server
US11783600B2 (en) Adaptive monitoring of a vehicle using a camera
CN105144199A (en) Imaging device based occupant monitoring system supporting multiple functions
WO2007112169A2 (en) Vision based alert system using portable device with camera
CN106184016A (en) A kind of Intelligent rearview mirror system and control method thereof
CN111645694B (en) Driver driving state monitoring system and method based on attitude estimation
CN109190600A (en) A kind of driver's monitoring system of view-based access control model sensor
CN109955786A (en) Vehicle-mounted active safety monitoring device
CN107585026A (en) A kind of anti-fatigue-driving system
CN106157537A (en) Anti-fatigue-driving system
CN113401067A (en) Automobile central control system and control method for controlling same
CN111866359A (en) Multifunctional camera and automobile
CN112712043A (en) Intelligent cabin image processing system
CN112438728A (en) Safe driving detection device and detection method
CN212811829U (en) Multifunctional camera and automobile
EP2762363A1 (en) Vehicle safety and monitoring system
CN212541557U (en) Fatigue-prevention auxiliary device based on automobile data recorder
KR102494530B1 (en) Camera Apparatus Installing at a Car for Detecting Drowsy Driving and Careless Driving and Method thereof
CN210955422U (en) Safety monitoring system for medical ambulance
CN107933461A (en) In-car identification fusing device and method based on single camera
KR20220005297A (en) In-Cabin Security Sensor Installed at a Car and Platform Service Method therefor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination