WO2019184837A1 - 车载显示设备的控制方法及控制设备 - Google Patents
车载显示设备的控制方法及控制设备 Download PDFInfo
- Publication number
- WO2019184837A1 WO2019184837A1 PCT/CN2019/079441 CN2019079441W WO2019184837A1 WO 2019184837 A1 WO2019184837 A1 WO 2019184837A1 CN 2019079441 W CN2019079441 W CN 2019079441W WO 2019184837 A1 WO2019184837 A1 WO 2019184837A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- displays
- display area
- display
- response
- view images
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000004044 response Effects 0.000 claims description 49
- 230000000007 visual effect Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 238000001514 detection method Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 239000000463 material Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/80—Arrangements for controlling instruments
- B60K35/81—Arrangements for controlling instruments for controlling displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/182—Distributing information between displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
Definitions
- the present disclosure relates to the field of display technology. More specifically, it relates to a control method and a control device for an in-vehicle display device.
- HUD head-up display
- smart mirrors allow the driver to view information such as the vehicle's condition without having to look down at the vehicle during driving.
- the heads-up display only has a display function, and cannot directly realize interaction with the driver; on the other hand, the smart rearview mirror with a touch screen facilitates the operation of the interface interaction, but due to the limitation of the position and the screen size, after the intelligence
- the display function of the sight glass has a large limitation.
- the collaborative display scheme of the two includes the following two types: first, both are displayed at the same time. Although this scheme improves the convenience and user experience, the dual screen simultaneous display increases power consumption; the second and the two switch display However, the driver is required to manually switch at this time, which increases the danger of the driver during driving.
- An object of the present disclosure is to provide a control device and a control method for an in-vehicle display device based on line of sight tracking.
- a control method for an in-vehicle display device comprising a plurality of displays, the method comprising:
- the plurality of displays are controlled based on the result of the determination.
- the determining, according to the acquired sequence of view images, whether the at least one of the plurality of displays is of interest is:
- the at least one display is determined to be in focus in response to the gaze point being in the display area of the at least one display for a duration exceeding a first time threshold.
- the determining, according to the acquired sequence of view images, whether the at least one of the plurality of displays is of interest is:
- the at least two displays are determined to be in focus in response to whether the gaze point is in the display area of the at least two displays multiple times within a second threshold time.
- the step of controlling the plurality of displays in response to the determining result comprises:
- the plurality of displays are turned off in response to a lack of attention in the display area of the plurality of displays.
- the plurality of displays comprises a heads up display, a smart rear view mirror.
- the first threshold time ranges from 1-2 seconds.
- the second threshold time ranges from 1-2 minutes.
- a control device for an in-vehicle display device comprising a plurality of displays, the control device comprising:
- a gaze tracker configured to acquire a sequence of visual field images including gaze points in real time
- a determining unit configured to determine whether at least one of the plurality of displays is in focus according to the acquired sequence of view images
- control unit configured to control the plurality of displays based on the result of the determining.
- the determining unit comprises:
- a first identification subunit configured to identify, by the object recognition algorithm, whether a display area of at least one of the plurality of displays exists in the acquired sequence of view images
- a first detecting subunit configured to detect whether the gaze point is in a display area of the at least one display in response to a display area of at least one of the plurality of displays being present in the acquired sequence of view images The duration exceeds the first threshold time
- a first decision subunit configured to determine that the at least one display is in focus in response to the gaze point being in a display area of the at least one display for a duration exceeding a first time threshold.
- the determining unit comprises:
- a second identification subunit configured to identify, by the object recognition algorithm, whether a display area of at least two of the plurality of displays exists in the acquired sequence of view images
- a second detecting subunit configured to detect whether the gaze point is multiple times in a second threshold time in response to a display area of at least two of the plurality of displays being present in the acquired sequence of view images In the display area of the at least two displays;
- the second determining subunit is configured to determine that the at least two displays are all in focus in response to whether the gaze point is in the display area of the at least two displays multiple times within a second threshold time.
- control unit comprises:
- a first control subunit configured to turn on the at least one display and turn off other ones of the plurality of displays in response to a display area of at least one of the plurality of displays being focused;
- a second control subunit configured to turn off the plurality of displays in response to a lack of attention in a display area of the plurality of displays.
- an in-vehicle display system comprising: an in-vehicle display device comprising a plurality of displays, and a control device for controlling the in-vehicle display device in accordance with some embodiments of the disclosure.
- the determining unit comprises:
- a first identification subunit configured to identify, by the object recognition algorithm, whether a display area of at least one of the plurality of displays exists in the acquired sequence of view images
- a first detecting subunit configured to detect whether the gaze point is in a display area of the at least one display in response to a display area of at least one of the plurality of displays being present in the acquired sequence of view images The duration exceeds the first threshold time
- a first decision subunit configured to determine that the at least one display is in focus in response to the gaze point being in a display area of the at least one display for a duration exceeding a first time threshold.
- the determining unit comprises:
- a second identification subunit configured to identify, by the object recognition algorithm, whether a display area of at least two of the plurality of displays exists in the acquired sequence of view images
- a second detecting subunit configured to detect whether the gaze point is multiple times in a second threshold time in response to a display area of at least two of the plurality of displays being present in the acquired sequence of view images In the display area of the at least two displays;
- the second determining subunit is configured to determine that the at least two displays are all in focus in response to whether the gaze point is in the display area of the at least two displays multiple times within a second threshold time.
- control unit comprises:
- a first control subunit configured to turn on the at least one display and turn off other ones of the plurality of displays in response to a display area of at least one of the plurality of displays being focused;
- a second control subunit configured to close the plurality of displays in response to a lack of attention in a display area of the plurality of displays.
- a computer readable storage medium having stored thereon a computer program that, when executed, implements a control method for an in-vehicle display device according to some embodiments of the present disclosure.
- FIG. 1 illustrates a flow chart of a control method for an in-vehicle display device in accordance with some embodiments of the present disclosure
- FIG. 2 illustrates a flow chart of a control method for an in-vehicle display device in accordance with further embodiments of the present disclosure
- FIG. 3 illustrates a flow chart of a control method for an in-vehicle display device in accordance with still further embodiments of the present invention
- FIG. 4 shows a flow chart of a control method for an in-vehicle display device in accordance with still further embodiments of the present invention
- FIG. 5a illustrates a structural block diagram of a control device for an in-vehicle display device, in accordance with some embodiments of the present invention
- FIG. 5b is a block diagram showing the structure of a determination unit in a control device for an in-vehicle display device according to some embodiments of the present invention.
- 5c is a block diagram showing the structure of a determination unit in a control device for an in-vehicle display device according to further embodiments of the present invention.
- Figure 5d illustrates a block diagram of a control unit in a control device for an in-vehicle display device, in accordance with some embodiments of the present invention
- FIG. 6 shows a block diagram of a structure of an in-vehicle display system in accordance with some embodiments of the present invention.
- FIG. 1 illustrates a flow chart of a control method for an in-vehicle display device in accordance with some embodiments of the present disclosure.
- the vehicle display device may include a plurality of displays, such as a head-up display, a smart rear view mirror, a central control display, a dashboard display, etc., and the displayed contents may include vehicles such as vehicle speed, rotational speed, tire pressure, water temperature, and fault indication.
- the related information may also include environmental information such as inside/outside temperature, and may even include driving route information provided by the in-vehicle navigation device or an external independent navigation device.
- a vehicle-mounted display screen that a driver is interested in is automatically identified by a line-of-sight tracking technique, and each display is controlled accordingly.
- a control method for an in-vehicle display device includes the following steps S110-S130.
- Step S110 real-time acquisition of a sequence of visual field images including gaze points by gaze tracking.
- Sight tracking technology also known as eye tracking technology, refers to the use of software algorithms, mechanical, electronic, optical and other detection methods to obtain the subject's current visual gaze direction or fixation point. It is widely used in human-computer interaction and assistance. Driving, psychological research, virtual reality and military.
- the line of sight can be realized by a line of sight (or eye tracking) tracking device, which mainly includes a dedicated line of sight tracker and a non-dedicated device, such as a camera on a computer or a mobile phone, and can also achieve eye tracking with software support. , but there are differences in accuracy, speed and stability.
- a line of sight (or eye movement) tracker may be employed to track the driver's line of sight in real time to capture the driver's field of view image or field of view in real time using the image acquisition component therein. Includes the current driver's gaze point.
- the gaze tracker the visual field image of the driver at any time can be obtained, thereby obtaining a sequence of visual field images including the fixation point over a period of time. Subsequently, it can be judged whether the driver is paying attention to the in-vehicle display device by analyzing the position of the fixation point in the sequence of the view image.
- the gaze point in step S110 is typically the gaze point of the gaze tracker wearer.
- the wearer of the gaze tracker is usually the driver, and of course other people in the car, such as the first officer.
- a gaze point refers to a point of an object in which a line of sight is aligned during visual perception.
- the sequence of the view image in step S110 refers to a plurality of view images continuously acquired in real time by the line of sight tracker, for example, a plurality of view images continuously recorded at a higher rate by the camera in the line of sight tracker, for example, recording no less than 24 frames of image.
- Step S120 Determine, according to the acquired sequence of visual field images, whether at least one of the plurality of displays is of interest.
- whether the display area is noticed by the driver can be determined simply by determining whether the driver's gaze point acquired at a certain time is located in the display area of at least one of the displays. For example, if the gaze point is in the display area, it can be determined that the display or display area is being followed by the driver; if the gaze point is not in the display area, it can be determined that the display area is not of interest to the driver.
- an additional condition may be added on the basis of determining that the gaze point is in the display area, that is, the gaze point is in the display area.
- the continuous dwell time in the middle is sufficiently long that the display area is considered to be of interest to the driver only when both conditions are met (the fixation point is in the display area and the continuous dwell time is long enough). For example, after determining that the gaze point is in the display area, it is possible to detect whether the duration of the gaze point continuously staying in the display area reaches an expected duration, such as whether the preset first time threshold is exceeded, and if so, determine The driver is indeed paying attention to the display area; otherwise, it is determined that the driver is not paying attention to the display area.
- an expected duration such as whether the preset first time threshold is exceeded
- the determination of the positional relationship between the fixation point and the display area of the display in the in-vehicle display device may be implemented by a depth learning-based target detection algorithm object recognition method, that is, first, in the field of view image sequence Using the object recognition method described above to detect whether there is a display area of each display in the in-vehicle display device, and then determining a positional relationship between the fixation point and the detected display area, and finally according to whether the fixation point is in the display area and the duration exceeds the threshold time To determine if the area is being watched. See Figure 2 for the detailed steps above.
- the positional relationship between the gaze point and the display area of the display in the in-vehicle display device may be determined by other methods, for example, by comparing the visual field image including the fixation point with the image of the display area of each display. achieve.
- Step S130 controlling the plurality of displays according to the result of the determining.
- controlling the display in step 130 can include controlling the opening and closing of the display. For example, if it is determined that the plurality of displays are not of interest, all displays may be turned off to save energy; if it is determined that at least one display is of interest, in order to save energy, only the driver's attention may be turned on. The display, while turning off all other displays that are not of interest. For example, during driving, it has been determined that the driver's line of sight is in the front windshield area, that is, the display area of the head-up display.
- the head-up display can be automatically turned on by automatically transmitting a control command to the control chip of the in-vehicle display device, and automatically Turn off other monitors, such as smart mirror display, center console, and more.
- the control of the display in step 130 may not be limited to turning the display on and off, for example, may also include: dimming all unattended display screens, for example, if it is determined that at least one display is in focus (eg, from The working state enters the standby state), and the screen of the display of interest is illuminated (for example, from the standby state to the normal working state). This saves energy while avoiding the adverse effects on the life of the device due to frequent full on/off of the display.
- control methods may be employed for the display device that the driver is interested in.
- commonly used displays such as instrument panels, central control screens, etc.
- the switches are controlled in the manner described above.
- the smart rearview mirror and the head-up display if the driver's gaze point is alternately located in the display area for a short time, it can be determined that the driver pays attention to both the head-up display and the smart rearview mirror, and at the same time, both can be turned on at the same time. Avoid frequent opening and closing of the display device to damage its circuit.
- the gaze-tracking-based vehicle display device control method provided by the present invention can automatically recognize the driver's line of sight on the vehicle display by tracking the driver's line of sight (the front windshield area of the head-up display projection display, the smart rearview mirror) Or other display areas), which can automatically turn on the on-board display of the driver's attention, thereby avoiding the risk of driving safety caused by the driver manually turning on/off the display such as the head-up display and the smart mirror. It can also avoid the waste of power consumption caused by the simultaneous opening of the respective on-board displays.
- FIG. 2 illustrates a flow chart of a control method for an in-vehicle display device in accordance with further embodiments of the present disclosure.
- step S120 shown in FIG. 1 - the step of determining whether at least one of the plurality of displays is focused based on the acquired sequence of view images includes the following steps S221-S223.
- S221 Identify, by using an object recognition algorithm, whether a display area of at least one of the plurality of displays exists in the acquired sequence of view images;
- the object to be recognized that is, the display area of the in-vehicle display
- the object to be recognized may be identified or detected in the sequence of the visual field image.
- depth learning-based target detection algorithms such as Faster R-CNN, R-FCN, and SSD, can be used to identify whether there is a display area of the in-vehicle display in the field of view image.
- the depth learning-based target detection algorithm may be first selected, and the target display display area, such as a smart rearview mirror or a head-up display, is trained for the training sample, and the object recognition model is obtained, thereby being used for the field of view.
- the object of the image (the display area of the target display) is identified and detected.
- the relationship between the position of the fixation point and the position of the display area is further detected, that is, whether the fixation point falls into the display area If yes, it can be concluded that the display area is being followed by the driver.
- the detection of the positional relationship between the fixation point and the recognized display area can be realized simply by the planar geometry method to determine whether the coordinates of the fixation point position in the visual field image fall within the display area.
- the position of the display area of the in-vehicle display in the image sequence is determined by performing object recognition on the sequence of the view image including the fixation point (if the display area exists in the image), in fact
- the gaze point and the display area are placed in the same field of view image, so that it is very advantageous to determine whether the gaze point is located in the display area, thereby determining whether the display area is followed by the driver.
- an additional condition may be added on the basis of determining that the gaze point is on the display area, that is, the gaze point is in the display area.
- the continuous dwell time in the middle is sufficiently long that the display area is considered to be of interest to the driver only when both conditions are met (the fixation point is in the display area and the continuous dwell time is long enough). For example, after determining that the gaze point is in the display area, it is possible to detect whether the duration of the gaze point continuously staying in the display area reaches a desired duration by performing timing while capturing the sequence of the view image in real time, for example, whether the pre-existence is exceeded.
- the first threshold time is set, and if so, it is determined that the driver is actually paying attention to the display area; otherwise, it is determined that the driver is not paying attention to the display area.
- the first threshold time may be a predetermined time period, for example, the value may range from 1-2 seconds.
- the first threshold time can also adopt other ranges, for example, according to the driving habits of the driver or other environmental factors.
- FIG. 3 illustrates a flow chart of a control method for an in-vehicle display device in accordance with still further embodiments of the present disclosure.
- the embodiment of FIG. 3 mainly considers another case, that is, for various reasons, It is possible for the driver's gaze point to frequently switch between at least two display areas in a short time. For example, in the face of complex road conditions, drivers may need to focus on multiple displays at the same time, such as smart rearview mirrors and heads-up displays, to understand road conditions and vehicle conditions in all directions to drive the car flexibly and safely.
- the step S120 shown in FIG. 1 may further include: determining, according to the acquired sequence of the view image, whether the at least one of the plurality of displays is of interest:
- Step S321 identifying, by the object recognition algorithm, whether there is a display area of at least two of the plurality of displays in the acquired sequence of view images;
- Step S322 detecting, in the presence of the display area of at least two of the plurality of displays in the acquired sequence of view images, detecting whether the gaze points are in the at least two times in the second threshold time In the display area of the display;
- Step S323 determining that the at least two displays are all in focus in response to whether the gaze point is in the display area of the at least two displays multiple times within a second threshold time.
- the second threshold time may be a predetermined time period, for example, the value may range from 1-2 minutes. For example, if it is determined that the driver's gaze point is located at least two or more times in the front windshield region (ie, the display area of the head-up display) within one minute and at least two or more times in the smart mirror region, In a short period of time, the driver frequently alternately pays attention to the front windshield area and the smart mirror area, and it can be determined that both are concerned by the driver. At this time, both can be turned on at the same time to avoid frequent damage to the circuit caused by the display device.
- the second threshold time may also adopt other ranges, for example, according to the driving habits of the driver or other environmental factors.
- FIG. 4 illustrates a flow chart of a control method for an in-vehicle display device in accordance with further embodiments of the present disclosure.
- steps S410 and S420 are the same as steps S110 and S120 shown in FIG. 1, and step S130 shown in FIG. 1 - the step of controlling the plurality of displays in response to the determination result includes:
- Step S431 in response to the display area of at least one of the plurality of displays being focused, turning on the at least one display and turning off the other of the plurality of displays;
- Step S432 in response to the lack of attention of the display areas of the plurality of displays, the plurality of displays are turned off.
- an instruction can be issued to the in-vehicle display device through the control unit or the control module to control the opening and closing of the respective displays.
- all displays can be turned off to save energy; if it is determined that at least one display is of interest, it can be turned on only for the purpose of saving energy.
- the display that the driver is interested in while turning off all other displays that are not of interest. For example, during driving, it has been determined that the driver's line of sight is in the front windshield area, that is, the display area of the head-up display. At this time, the head-up display can be automatically turned on by automatically transmitting a control command to the control chip of the in-vehicle display device, and automatically Turn off other monitors, such as smart mirror display, center console, and more.
- the present disclosure also provides a computer readable storage medium having stored thereon a computer program that, when executed, implements a control method for an in-vehicle display device in accordance with some embodiments of the present disclosure.
- Figure 5a illustrates a control device for an in-vehicle display device including a plurality of displays, in accordance with some embodiments of the present disclosure.
- a control method for an in-vehicle display device according to some embodiments of the present disclosure may be completed by the control device illustrated in FIG. 5a.
- control device 500 includes:
- a gaze tracker 510 configured to acquire a sequence of view images including a gaze point of the driver in real time
- the determining unit 520 is configured to determine whether at least one of the plurality of displays is focused according to the acquired sequence of view images
- the control unit 530 is configured to control the plurality of displays according to the result of the determination.
- the control device for the in-vehicle display device based on the line of sight tracking can automatically recognize the in-vehicle display screen of the driver's line of sight by tracking the driver's line of sight (the front windshield area of the head-up display projection display, after the smart The mirror or other display area) can automatically turn on the on-board display of the driver's attention, thus avoiding the driving safety caused by the driver manually turning on/off the display such as the head-up display and the smart mirror.
- the risk can avoid the waste of power generated by the simultaneous opening of the respective car display.
- the control device 500 may be made into a head mounted device, and thus the gaze tracker 510, the determining unit 520, and the control unit 530 may be disposed, for example, in the head mounted device, and by wired and wireless (eg, WIFI, Bluetooth, etc. are connected to the in-vehicle display device to be controlled.
- the determining unit 520 and the control unit 530 may include: a central processing unit (CPU), a read only memory (ROM) for storing programs executed by the CPU and data used in the programs; random access memory (RAM), Temporarily stores the data used in executing these programs. These components cooperate to perform the functions of the decision unit and/or control unit 322. It will be understood that these functions can be implemented by software, hardware or a combination thereof.
- FIG. 5b illustrates a structural block diagram of a determination unit in a control device for an in-vehicle display device, in accordance with some embodiments of the present disclosure.
- the determining unit 520 includes:
- a first identification sub-unit 521 configured to identify, by the object recognition algorithm, whether a display area of at least one of the plurality of displays exists in the acquired sequence of view images
- a first detecting sub-unit 522 configured to detect whether the gaze point is in a display area of the at least one display in response to a display area of at least one of the plurality of displays being present in the acquired sequence of view images And lasts longer than the first threshold time;
- the first decision sub-unit 523 is configured to determine that the at least one display is in focus in response to the gaze point being in the display area of the at least one display for a duration exceeding a first time threshold.
- FIG. 5c illustrates a structural block diagram of a determination unit in a control device for an in-vehicle display device according to further embodiments of the present disclosure.
- the determining unit 520 is further configured to:
- a second identification subunit 521' configured to identify, by the object recognition algorithm, whether a display area of at least two of the plurality of displays exists in the acquired sequence of view images
- a second detecting sub-unit 522' configured to detect whether the gaze point is multiple times in a second threshold time in response to a display area of at least two of the plurality of displays being present in the acquired sequence of view images In a display area of the at least two displays;
- the second determining sub-unit 523' is configured to determine that the at least two displays are all in focus in response to whether the gazing point is in the display area of the at least two displays multiple times within a second threshold time.
- FIG. 5b illustrates a structural block diagram of a control unit in a control device for an in-vehicle display device, in accordance with some embodiments of the present disclosure.
- the control unit 530 includes:
- the first control sub-unit 531 is configured to turn on the at least one display and turn off other ones of the plurality of displays in response to the display area of at least one of the plurality of displays being of interest.
- the control unit 520 may further include:
- the second control sub-unit 532 is configured to turn off the plurality of displays in response to lack of attention in the display areas of the plurality of displays.
- FIG. 6 schematically illustrates a block diagram of an in-vehicle display system in accordance with some embodiments of the present disclosure.
- an in-vehicle display system 600 according to some embodiments of the present disclosure includes:
- An in-vehicle display device 610 that includes a plurality of displays, and
- a control device 620 for controlling the in-vehicle display device 610 comprising:
- a gaze tracker 621 configured to acquire a sequence of visual field images including a gaze point of the driver in real time
- the determining unit 622 is configured to determine whether at least one of the plurality of displays is followed according to the acquired sequence of view images
- the control unit 623 is configured to control the plurality of displays according to the result of the determination.
- control device 620 can correspond to control device 500 for an in-vehicle display device shown in Figure 5a.
- the determining unit 622 and the control unit 623 in the control device 620 may also correspond to the determining unit 520 and the control unit 530 shown in FIGS. 5b-5d, respectively.
- the orientation or positional relationship of the terms “upper”, “lower” and the like is based on the orientation or positional relationship shown in the drawings, and is merely for convenience of description of the present disclosure and simplified description. It is not intended to be a limitation or limitation of the invention.
- the terms “mounted,” “connected,” and “connected” are used in a broad sense, and may be, for example, a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection, It can also be an electrical connection; it can be directly connected, or it can be connected indirectly through an intermediate medium, which can be the internal connection of two components.
- the specific meanings of the above terms in the present disclosure can be understood by those skilled in the art on a case-by-case basis.
- a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with such an instruction execution system, apparatus, or device.
- the computer readable medium may include, for example, the following: an electrical connection (electronic device) having one or more wires, a portable computer disk cartridge (magnetic device), a random access memory (Random Access Memory), Read Only Memory, Erasable Programmable Read Only Memory or Flash Memory, Fiber Optic Devices, and Compact Disc Read Only Memory.
- the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
- portions of the present disclosure can be implemented in hardware, software, firmware, or a combination thereof.
- multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
- a suitable instruction execution system For example, if implemented in hardware, it can be implemented by any one or combination of the following techniques well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, with suitable combinations Logic gate circuit ASIC, Programmable Gate Array, Field Programmable Gate Array, and the like.
- each functional unit in various embodiments of the present disclosure may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
- the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
- the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Instrument Panels (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
一种用于车载显示设备的控制方法、控制设备、车载显示***以及计算机可读存储介质,其中所述车载显示设备包括多个显示器,所述方法包括:通过视线追踪,实时获取包含注视点的视野图像序列;根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及根据所述判定的结果,控制所述多个显示器;所述控制方法可以减小功耗以及降低行车危险性。
Description
相关申请
本申请要求2018年3月26日提交的申请号为201810249971.8的中国专利申请的优先权,该专利申请的所有内容通过引用合并于此。
本公开涉及显示技术领域。更具体地,涉及一种用于车载显示设备的控制方法及控制设备。
随着汽车在生活中的日益普及,人们对驾驶体验的要求也日益提高。抬头显示器(HUD)和智能后视镜都可以实现驾驶员在行车过程中不需要低头即可查看车辆状况之类的驾驶员关心的信息。
然而,目前,抬头显示器只具有显示功能,而无法直接实现与驾驶员的交互;另一方面,具有触摸屏幕的智能后视镜便于界面交互的操作,但由于位置和屏幕尺寸的限制,智能后视镜的显示功能的局限性较大。目前,两者的协同显示方案包括以下两种:第一、两者同时显示,这种方案虽提升了便利性及用户体验,但双屏同时显示会增加功耗;第二、两者切换显示,但是这时需要驾驶员进行手动切换,增加了驾驶员在行车过程中危险性。
发明内容
本公开的目的在于提供一种基于视线追踪的车载显示设备的控制设备及控制方法。
根据本公开的第一方面,提供一种用于车载显示设备的控制方法,所述车载显示设备包括多个显示器,所述方法包括:
通过视线追踪,实时获取包含的注视点的视野图像序列;
根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及
根据所述判定的结果,控制所述多个显示器。
在根据本公开的一些实施例中,所述根据所获取的视野图像序列 判定所述多个显示器中至少一个显示器是否被关注的步骤包括:
通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;
响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;
响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
在根据本公开的一些实施例中,所述根据所获取的视野图像序列判定所述多个显示器中至少一个显示器是否被关注的步骤包括:
通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;
响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;以及
响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
在根据本公开的一些实施例中,所述响应于所述判定结果控制所述多个显示器的步骤包括:
响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器;以及
响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
在根据本公开的一些实施例中,所述多个显示器包括抬头显示器、智能后视镜。
在根据本公开的一些实施例中,所述第一阈值时间的取值范围为1-2秒。
在根据本公开的一些实施例中,所述第二阈值时间的取值范围为1-2分钟。
根据本公开的第二方面,提供一种用于车载显示设备的控制设备,所述车载显示设备包括多个显示器,所述控制设备包括:
视线追踪器,配置成实时获取包含注视点的视野图像序列;
判定单元,配置成根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及
控制单元,配置成根据所述判定的结果,控制所述多个显示器。
在根据本公开的一些实施例中,所述判定单元包括:
第一识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;
第一检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;以及
第一判定子单元,配置成响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
在根据本公开的一些实施例中,所述判定单元包括:
第二识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;
第二检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;以及
第二判定子单元,配置成响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
在根据本公开的一些实施例中,所述控制单元包括:
第一控制子单元,配置成响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器;以及
第二控制子单元,配置成响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
根据本公开的第三方面,提供一种车载显示***,包括:车载显 示设备,其包括多个显示器,以及根据公开一些实施例的用于控制车载显示设备的控制设备。
在根据本公开的车载显示***的一些实施例中,所述判定单元包括:
第一识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;
第一检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;以及
第一判定子单元,配置成响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
在根据本公开的车载显示***的一些实施例中,所述判定单元包括:
第二识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;
第二检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;以及
第二判定子单元,配置成响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
在根据本公开的车载显示***的一些实施例中,所述控制单元包括:
第一控制子单元,配置成响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器;以及
第二控制子单元,配置成响应于所述多个显示器的显示区域都缺 乏关注,关闭所述多个显示器。
根据本公开的第三方面,提出一种计算机可读存储介质,其上存储有计算机程序,该计算机程序在执行时实现根据本公开一些实施例所述的用于车载显示设备的控制方法。
图1示出根据本公开一些实施例的用于车载显示设备的控制方法的流程图;
图2示出根据本公开另一些实施例的用于车载显示设备的控制方法的流程图;
图3示出根据本发明又一些实施例的用于车载显示设备的控制方法的流程图;
图4示出根据本发明另外又一些实施例的用于车载显示设备的控制方法的流程图;
图5a示出根据本发明一些实施例的用于车载显示设备的控制设备的结构框图;
图5b示出根据本发明一些实施例的用于车载显示设备的控制设备中判定单元的结构框图;
图5c示出根据本发明另一些实施例的用于车载显示设备的控制设备中判定单元的结构框图;
图5d示出根据本发明一些实施例的用于车载显示设备的控制设备中控制单元的结构框图;以及
图6示出根据本发明一些实施例的车载显示***的结构框图。
为了更清楚地说明本公开,下面结合优选实施例和附图对本公开做进一步的说明。附图中相似的部件以相同的附图标记进行表示。本领域技术人员应当理解,下面所具体描述的内容是说明性的而非限制性的,不应以此限制本公开的保护范围。
图1示出根据本公开一些实施例的用于车载显示设备的控制方法的流程图。车载显示设备可以包括多个显示器,例如抬头显示器、智能后视镜、中控显示屏、仪表盘显示屏等等,其显示的内容既可包括 车速、转速、胎压、水温、故障提示等车辆相关信息,也可包括车内/外温度等环境信息,甚至可包括由车载导航设备或外部独立导航设备提供的行驶路线信息。在根据本公开一些实施例的用于车载显示设备的控制方法,通过视线跟踪技术自动识别驾驶员所关注的车载显示屏,并据此控制各个显示器。如图1所示,根据本公开一些实施例的用于车载显示设备的控制方法包括如下步骤S110-S130。
步骤S110,通过视线追踪,实时获取包含注视点的视野图像序列。
视线追踪技术也称为眼动追踪技术,是指利用软件算法、机械、电子、光学等各种检测手段获取受试者当前视觉注视方向或注视点的技术,它广泛应用于人机交互、辅助驾驶、心理研究、虚拟现实和军事等多个领域。一般地,视线可以通过视线(或眼动)追踪设备来实现,视线追踪设备主要包括专用的视线追踪器以及非专用设备,如电脑或手机上的摄像头,在软件的支持下也可以实现眼球跟踪,但是在准确性、速度和稳定性上各有差异。
在本公开的一些实施例中,可以采用视线(或眼动)追踪器来对驾驶员的视线进行实时追踪,以利用其中的图像采集构件实时捕获驾驶员的视野图像或视野范围,该视野图像包括当前驾驶员的注视点。这样,通过使用视线追踪器,可以获得驾驶员任一时刻的视野图像,从而得到在一段时间内包含注视点的视野图像序列。随后,可以通过分析视野图像序列中注视点的位置来判断驾驶员是否正在关注车载显示设备。
在一些实施例中,步骤S110中的注视点通常是视线***佩戴者的注视点。视线***的佩戴者通常是驾驶员,当然也可以是车上的其他人员,例如副驾驶等。一般地,注视点是指视知觉过程中,视线对准的对象的某一点。此外步骤S110中的视野图像序列是指通过视线追踪器实时连续获取的多个视野图像,例如通过视线追踪器中的摄像机以较高速率连续记录的多个视野图像,例如每秒记录不少于24帧图像。
步骤S120,根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注。
一般地,可以简单地通过判断某个时刻所获取的驾驶员注视点是否位于至少一个显示器的显示区域中来判定该显示区域是否被驾驶员 关注。例如注视点如果处于该显示区域中,则可以判定该显示器或显示区域正被驾驶员关注;如果注视点没有处于该显示区域中,则可判定该显示区域未被驾驶员关注。可选地,为了避免错误地将驾驶员的非有意的瞬时视线转移判定为对显示区域的关注,可以在判定注视点处于显示区域的基础上,添加一个附加条件,即注视点在该显示区域中的连续停留时间足够长,只有同时满足这两个条件(注视点处于显示区域且连续停留时间足够长)时,才认为该显示区域被驾驶员关注。例如,可以在确定了注视点处于显示区域中之后,检测该注视点连续停留在该显示区域中的持续时间是否达到预期的时长,例如是否超过预先设定第一时间阈值,如果是,则判定驾驶员确实在关注该显示区域;否则,判定驾驶员并未关注该显示区域。
在一些实施例中,关于注视点与车载显示设备中显示器的显示区域之间的位置关系的判定,可以采用基于深度学习的目标检测算法对象识别方法来实现,即:首先,在视野图像序列中利用上述对象识别方法检测其中是否存在车载显示设备中各个显示器的显示区域,随后确定注视点与检测到的显示区域之间的位置关系,最后根据注视点是否处于显示区域中且持续时间超过阈值时间来判定该区域是否被关注。上述详细步骤请参见图2。可选地,当然也可以通过其他方式来判定注视点与车载显示设备中显示器的显示区域之间的位置关系,例如可以通过将包含注视点的视野图像与各个显示器的显示区域的图像的比较来实现。
步骤S130,根据所述判定的结果,控制所述多个显示器。
在确定了驾驶员所关注的显示区域之后,可以根据判定结果,通过控制单元向车载显示设备发出指令以控制各个显示器。在一些实施例中,步骤130中对显示器的控制可以包括控制显示器的开启和关闭。例如,如果判定所述多个显示器都未被关注,则可以将所有显示器关闭,以节约能耗;如果判定存在至少一个显示器被关注,则为了节约能耗的目的,可以仅开启驾驶员所关注的显示器,同时关闭所有未被关注的其他显示器。例如,在行驶过程中,已经判定驾驶员视线在关注前挡风玻璃区域,即抬头显示器的显示区域,这时可以通过向车载显示设备的控制芯片发送控制指令来使抬头显示器自动开启,同时自动关闭其他显示器,例如智能后视镜显示屏、中控屏等。可选地,步 骤130中对显示器的控制可以不限于开启和关闭显示器,例如还可以包括:例如在判定存在至少一个显示器被关注的情况下,使所有未被关注的显示器屏幕变暗(例如从工作状态进入待机状态),而将所关注的显示器的屏幕点亮(例如从待机状态恢复成正常工作状态)。这样在节约能耗的同时,避免因频繁完全开启/关断显示器对设备寿命造成的不良影响。
可选地,对于驾驶员所关注的显示设备,也可以采取其他控制方式。例如对于常用的显示器,如仪表盘、中控屏等,可以保持始终开启;而仅对不太常用的显示器,如智能后视镜或抬头显示器,采用上述方式控制其开关。对于智能后视镜和抬头显示器,若驾驶员的注视点短时间内交替位于二者显示区域中,则可以判定驾驶员同时关注抬头显示器和智能后视镜,这时可以同时开启二者,以避免频繁开闭显示设备对其电路造成损害。
本公开提供的基于视线追踪的车载显示设备的控制方法,可通过对驾驶员的视线追踪,自动识别驾驶员视线关注的车载显示屏(抬头显示器投影显示的前挡风玻璃区域、智能后视镜、或其他显示区域),进而可自动开启驾驶员视线关注的车载显示屏进行显示,从而避免了因驾驶员手动开启/关闭抬头显示器和智能后视镜等显示器所带来的行车安全性风险,又可以避免各自车载显示器同时开启带来的功耗浪费。
图2示出根据本公开另一些实施例的用于车载显示设备的控制方法的流程图。如图2所示,图1所示的步骤S120-根据所获取的视野图像序列判定所述多个显示器中至少一个显示器是否被关注的步骤包括下述步骤S221-S223。
S221,通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;
如上文所述,可以通过判断注视点是否位于车载显示设备的显示器的显示区域中来判定驾驶员是否在关注该显示区域。具体地,如图2所示,在经过视线跟踪获得了包含注视点的视野图像之后,首先,可以在视野图像序列中识别或检测想要识别的对象,即车载显示器的显示区域,是否存在于视野图像中。例如,可以采用基于深度学习的目标检测算法,如Faster R-CNN、R-FCN和SSD,识别视野图像中是否存在车载显示器的显示区域。更具体地,可以首先选定基于深度学习 的目标检测算法,针对以目标显示器显示区域,例如智能后视镜或抬头显示器,为训练样本,进行模型训练,得到对象识别模型,从而用于对视野图像的对象(目标显示器的显示区域)进行识别和检测。
S222,响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;以及
S223,响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
当在视野图像中检测到或识别出显示区域时,即视野图像序列中存在车载显示器的显示区域,进一步检测注视点位置与该显示区域的位置之间的关系,即注视点是否落入显示区域中,如果是,则可以断定该显示区域正被驾驶员关注。一般地,关于注视点与识别出的显示区域之间的位置关系的检测,可以简单地通过平面几何学方法来判断注视点位置在视野图像中的坐标是否落在显示区域中来实现。
在本公开的上述实施例中,通过对包含注视点的视野图像序列进行对象识别来确定车载显示器的显示区域在该图像序列中的位置(如果该显示区域存在于图像中的话),事实上可以将注视点和显示区域置于同一视野图像中,从而非常有利于判定注视点是否位于该显示区域中,进而判断该显示区域是否被驾驶员关注。
此外,考虑到为避免错误地将驾驶员的非有意的瞬时视线转移判定为对显示区域的关注,可以在判定注视点处于显示区域的基础上,添加一个附加条件,即注视点在该显示区域中的连续停留时间足够长,只有同时满足这两个条件(注视点处于显示区域且连续停留时间足够长)时,才认为该显示区域被驾驶员关注。例如,可以在确定了注视点处于显示区域中之后,通过在实时捕获视野图像序列的同时进行计时来检测该注视点连续停留在该显示区域中的持续时间是否达到预期的时长,例如是否超过预先设定第一阈值时间,如果是,则判定驾驶员确实在关注该显示区域;否则,判定驾驶员并未关注该显示区域。
在一些实施例中,第一阈值时间可以是预先设定一个时间段,例如其取值范围可以为1-2秒。当然,第一阈值时间也可以采用其他范围,例如可以根据驾驶员的驾驶习惯或其他环境因素进行设定。
图3示出根据本公开又一些实施例的用于车载显示设备的控制方 法的流程图。与图2所示的利用注视点停留在某显示区域达预定时长来判断该显示区域被关注的实施例相比,在图3的实施例主要考虑另一种情况,即出于各种原因,驾驶员注视点有可能在短时间内频繁地在至少两个显示区域之间切换。例如,面对复杂的路况,驾驶员可能需要同时关注多个显示器,如智能后视镜和抬头显示器,以了解各个方向的路况和车况情况,以灵活且安全地驾驶汽车。这时,在判断驾驶员所关注的显示器时,需要考虑至少两个显示器在视野图像序列中的位置以及注视点是否在预定时长,例如第二时间阈值期间频繁地在二者之间切换,即是否分别多次处于是这两个显示器的显示区域中。
具体地,如图3所示,图1所示的步骤S120-根据所获取的视野图像序列判定所述多个显示器中至少一个显示器是否被关注的步骤也可以包括:
步骤S321,通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;
步骤S322,响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;
步骤S323,响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
在一些实施例中,第二阈值时间可以是预先设定一个时间段,例如其取值范围可以为1-2分钟。例如若判断驾驶员的注视点在1分钟内至少两次或更多次位于前挡风玻璃区域(即抬头显示器的显示区域)且至少两次或更多次位于智能后视镜区域,则说明在短时间内驾驶员频繁地交替关注前挡风玻璃区域和智能后视镜区域,可以判定二者都被驾驶员关注。这时可以同时开启二者,以避免频繁开闭显示设备对其电路造成损害。当然,第二阈值时间也可以采用其他范围,例如可以根据驾驶员的驾驶习惯或其他环境因素进行设定。
图4示出根据本公开另外一些实施例的用于车载显示设备的控制方法的流程图。如图4所示,步骤S410和S420与图1所示的步骤S110和S120相同,而图1所示的步骤S130-所述响应于所述判定结果控制所述多个显示器的步骤包括:
步骤S431,响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器;以及
步骤S432,响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
如上所述,在确定了驾驶员所关注的显示区域之后,可以通过控制单元或控制模块向车载显示设备发出指令以控制各个显示器的开启和关闭。如图4所示,如果判定所述多个显示器都未被关注,则可以将所有显示器关闭,以节约能耗;如果判定存在至少一个显示器被关注,则为了节约能耗的目的,可以仅开启驾驶员所关注的显示器,同时关闭所有未被关注的其他显示器。例如,在行驶过程中,已经判定驾驶员视线在关注前挡风玻璃区域,即抬头显示器的显示区域,这时可以通过向车载显示设备的控制芯片发送控制指令来使抬头显示器自动开启,同时自动关闭其他显示器,例如智能后视镜显示屏、中控屏等。
相应地,本公开还提供一种计算机可读存储介质,其上存储有计算机程序,该计算机程序执行时实现根据本公开一些实施例的用于车载显示设备的控制方法。
图5a示出了根据本公开一些实施例的用于包括多个显示器的车载显示设备的控制设备。根据本公开一些实施例的用于车载显示设备的控制方法可以通过图5a所示的控制设备完成。
如图5a所示,在一些实施例中,该控制设备500包括:
视线追踪器510,配置成实时获取包含驾驶员的注视点的视野图像序列;
判定单元520,配置成根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及
控制单元530,配置成根据所述判定的结果,控制所述多个显示器。
本公开提供的基于视线追踪的用于车载显示设备的控制设备,可通过对驾驶员的视线追踪,自动识别驾驶员视线关注的车载显示屏(抬头显示器投影显示的前挡风玻璃区域、智能后视镜、或其他显示区域),进而可自动开启驾驶员视线关注的车载显示屏进行显示,从而避免了因驾驶员手动开启/关闭抬头显示器和智能后视镜等显示器所带来的行 车安全性风险,又可以避免各自车载显示器同时开启带来的功耗浪费。
在具体实施时,根据本公开的控制设备500可以被制成头戴设备,因而视线追踪器510、判定单元520和控制单元530例如可以设置于该头戴设备中,并且通过有线和无线(如WIFI、蓝牙)等方式与要被控制的车载显示设备通信连接。判定单元520和控制单元530可以包括:中央处理单元(CPU)、只读存储器(ROM),用于存储由CPU执行的程序和在这些程序中所用的数据;随机存取存储器(RAM),用于暂时存储在执行这些程序中所用的数据。这些组成部件协同操作以完成判定单元和/或控制单元322的功能。将理解的是,这些功能可以由软件、硬件或其组合实现。
图5b示出了根据本公开一些实施例的用于车载显示设备的控制设备中判定单元的结构框图。在一些实施例中,参照图5b,所述判定单元520包括:
第一识别子单元521,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;
第一检测子单元522,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;以及
第一判定子单元523,配置成响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
图5c示出了根据本公开另一些实施例的用于车载显示设备的控制设备中判定单元的结构框图。在一些实施例中,参照图5c,所述判定单元520进一步配置成:
第二识别子单元521′,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;
第二检测子单元522′,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域 中;
第二判定子单元523′,配置成响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
图5b示出了根据本公开一些实施例的用于车载显示设备的控制设备中控制单元的结构框图。在一些实施例中,参照图5d,所述控制单元530包括:
第一控制子单元531,配置成响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器。可选地,如图5c所示,控制单元520可以进一步包括:
第二控制子单元532,配置成响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
图6示意性示出了根据本公开一些实施例的车载显示***的结构图。如图6所示,根据本公开一些实施例的车载显示***600包括:
车载显示设备610,其包括多个显示器,以及
用于控制车载显示设备610的控制设备620,其包括:
视线追踪器621,配置成实时获取包含驾驶员的注视点的视野图像序列;
判定单元622,配置成根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及
控制单元623,配置成根据所述判定的结果,控制所述多个显示器。
在一些实施例中,控制设备620可以对应于图5a所示的用于车载显示设备的控制设备500。相应地,控制设备620中的判定单元622、控制单元623也可以分别对应于图5b-5d所示的判定单元520、控制单元530。
在本公开的描述中,需要说明的是,术语“上”、“下”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本公开和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本公开的限制。除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一 体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本公开中的具体含义。
还需要说明的是,在本公开的描述中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个......”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
显然,本公开的上述实施例仅仅是为清楚地说明本公开所作的举例,而并非是对本公开的实施方式的限定,对于本领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式的变化或变动,这里无法对所有的实施方式予以穷举,凡是属于本公开的技术方案所引伸出的显而易见的变化或变动仍处于本公开的保护范围之列。
在本说明书的描述中,术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点被包含于本公开的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本公开的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序(包括根据所涉及的功能按基本同时的方式或按相反的顺序)来执行功能,这应 被本公开的实施例所属技术领域的技术人员所理解。
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行***、装置或设备(如基于计算机的***、包括处理器的***或其他可以从指令执行***、装置或设备取指令并执行指令的***)使用,或结合这些指令执行***、装置或设备而使用。就本说明书而言,“计算机可读介质”可以是任何可以包含、存储、通信、传播或传输程序以供指令执行***、装置或设备或结合这些指令执行***、装置或设备而使用的装置。计算机可读介质的更具体的示例可以例如包括以下各项:具有一个或多个布线的电连接部(电子装置)、便携式计算机盘盒(磁装置)、随机存取存储器(Random Access Memory)、只读存储器(Read Only Memory),可擦除可编辑只读存储器(Erasable Programmable Read Only Memory)或闪速存储器、光纤装置、以及便携式光盘只读存储器(Compact Disc Read Only Memory)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。
应当理解,本公开的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行***执行的软件或固件来实现。例如,如果用硬件来实现,则可用本领域公知的下列技术中的任一项或它们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路、具有合适的组合逻辑门电路的专用集成电路、可编程门阵列(Programmable Gate Array)、现场可编程门阵列(Field Programmable Gate Array)等。
本技术领域的普通技术人员可以理解上述实施例方法的全部或部分步骤可以通过程序指令相关的硬件完成,所述程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括执行方法实施例的步骤之一或其组合。
此外,在本公开各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单 元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。
Claims (16)
- 一种用于车载显示设备的控制方法,所述车载显示设备包括多个显示器,所述方法包括:通过视线追踪,实时获取包含注视点的视野图像序列;根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及根据所述判定的结果,控制所述多个显示器。
- 根据权利要求1所述的方法,其中根据所获取的视野图像序列判定所述多个显示器中至少一个显示器是否被关注的步骤包括:通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
- 根据权利要求1所述的方法,其中根据所获取的视野图像序列判定所述多个显示器中至少一个显示器是否被关注的步骤包括:通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;以及响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
- 根据权利要求1-3中任一项所述的方法,其中所述响应于所述判定结果控制所述多个显示器的步骤包括:响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器;以及响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
- 根据权利要求1-4中任一项所述的方法,其中所述多个显示器包括抬头显示器和智能后视镜。
- 根据权利要求2所述的方法,其中所述第一阈值时间的取值范围为1-2秒。
- 根据权利要求3所述的方法,其中所述第二阈值时间的取值范围为1-2分钟。
- 一种用于车载显示设备的控制设备,所述车载显示设备包括多个显示器,所述控制设备包括:视线追踪器,配置成实时获取包含注视点的视野图像序列;判定单元,配置成根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及控制单元,配置成根据所述判定的结果,控制所述多个显示器。
- 根据权利要求8所述的控制设备,其中所述判定单元包括:第一识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;第一检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;以及第一判定子单元,配置成响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
- 根据权利要求8所述的控制设备,其中所述判定单元包括:第二识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;第二检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;以及第二判定子单元,配置成响应于在第二阈值时间内所述注视点是 否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
- 根据权利要求8-10中任一项所述的控制设备,其中所述控制单元包括:第一控制子单元,配置成响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器;以及第二控制子单元,配置成响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
- 一种车载显示***,包括:车载显示设备,其包括多个显示器,以及控制设备,其配置成控制所述车载显示设备,并且包括:视线追踪器,配置成实时获取包含注视点的视野图像序列;判定单元,配置成根据所获取的视野图像序列,判定所述多个显示器中至少一个显示器是否被关注;以及控制单元,配置成根据所述判定的结果,控制所述多个显示器。
- 根据权利要求12所述的***,其中所述判定单元包括:第一识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少一个显示器的显示区域;第一检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少一个显示器的显示区域,检测所述注视点是否处在所述至少一个显示器的显示区域中且持续时间超过第一阈值时间;以及第一判定子单元,配置成响应于所述注视点处在所述至少一个显示器的显示区域中且持续时间超过第一时间阈值,确定所述至少一个显示器被关注。
- 根据权利要求12所述的***,其中所述判定单元包括:第二识别子单元,配置成通过对象识别算法,在所获取的视野图像序列中识别是否存在所述多个显示器中至少两个显示器的显示区域;第二检测子单元,配置成响应于在所获取的视野图像序列中存在所述多个显示器中至少两个显示器的显示区域,检测在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中;以及第二判定子单元,配置成响应于在第二阈值时间内所述注视点是否分别多次处在所述至少两个显示器的显示区域中,确定所述至少两个显示器都被关注。
- 根据权利要求12-14中任一项所述的***,其中所述控制单元包括:第一控制子单元,配置成响应于所述多个显示器中至少一个的显示区域被关注,开启所述至少一个显示器且关闭所述多个显示器中的其他显示器,以及第二控制子单元,配置成响应于所述多个显示器的显示区域都缺乏关注,关闭所述多个显示器。
- 一种计算机可读存储介质,其上存储有计算机程序,该计算机程序在执行时实现权利要求1-7中任意一项所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/647,808 US11524578B2 (en) | 2018-03-26 | 2019-03-25 | Control method and control device for vehicle display device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810249971.8A CN108501809A (zh) | 2018-03-26 | 2018-03-26 | 基于视线追踪的车载显示控制装置、显示***及显示方法 |
CN201810249971.8 | 2018-03-26 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019184837A1 true WO2019184837A1 (zh) | 2019-10-03 |
Family
ID=63378385
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/079441 WO2019184837A1 (zh) | 2018-03-26 | 2019-03-25 | 车载显示设备的控制方法及控制设备 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11524578B2 (zh) |
CN (1) | CN108501809A (zh) |
WO (1) | WO2019184837A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2021108187A (ja) * | 2020-05-29 | 2021-07-29 | ベイジン バイドゥ ネットコム サイエンス テクノロジー カンパニー リミテッドBeijing Baidu Netcom Science Technology Co., Ltd. | スマートバックミラーを制御するための方法、装置、電子機器及び記憶媒体 |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108501809A (zh) | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | 基于视线追踪的车载显示控制装置、显示***及显示方法 |
CN109968979B (zh) * | 2019-03-14 | 2021-12-07 | 阿波罗智联(北京)科技有限公司 | 车载投射处理方法、装置、车载设备及存储介质 |
CN110962746B (zh) * | 2019-12-12 | 2022-07-19 | 上海擎感智能科技有限公司 | 一种基于视线检测的辅助驾驶方法、***及介质 |
CN111694424A (zh) * | 2020-04-20 | 2020-09-22 | 上汽大众汽车有限公司 | 一种唤醒车载智能语音功能的***和方法 |
CN112026652A (zh) * | 2020-08-13 | 2020-12-04 | 启明信息技术股份有限公司 | 一种基于眼球识别激光成像的后视图像抬头显示*** |
CN111923835A (zh) * | 2020-08-13 | 2020-11-13 | 启明信息技术股份有限公司 | 一种基于车辆后视显示方法 |
CN111951454B (zh) * | 2020-10-16 | 2021-01-05 | 兰和科技(深圳)有限公司 | 智能门禁的指纹生物识别开锁装置及其判断方法 |
CN112959939A (zh) * | 2021-03-17 | 2021-06-15 | 新阳荣乐(重庆)汽车电子有限公司 | 一种加强型智能车灯控制方法 |
CN113492756A (zh) * | 2021-07-01 | 2021-10-12 | 中汽创智科技有限公司 | 一种车外信息展示方法、装置、设备及存储介质 |
CN114690989B (zh) * | 2022-06-01 | 2022-09-13 | 江苏泽景汽车电子股份有限公司 | 跟随图标的显示方法、装置、抬头显示器及存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130097557A1 (en) * | 2011-10-12 | 2013-04-18 | Visteon Global Technologies, Inc. | Method of controlling a display component of an adaptive display system |
CN104866089A (zh) * | 2014-02-26 | 2015-08-26 | 威斯通全球技术公司 | 基于检测到的方位调节显示器 |
CN105301774A (zh) * | 2015-10-10 | 2016-02-03 | 青岛歌尔声学科技有限公司 | 一种车载抬头显示终端和控制其显示亮度的方法 |
CN106926698A (zh) * | 2015-12-29 | 2017-07-07 | 福特全球技术公司 | 包括透明显示器和镜子显示器的车辆通知*** |
CN108501809A (zh) * | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | 基于视线追踪的车载显示控制装置、显示***及显示方法 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10540008B2 (en) * | 2012-01-04 | 2020-01-21 | Tobii Ab | System for gaze interaction |
EP3040809B1 (en) * | 2015-01-02 | 2018-12-12 | Harman Becker Automotive Systems GmbH | Method and system for controlling a human-machine interface having at least two displays |
GB2535544B (en) | 2015-02-23 | 2018-10-03 | Jaguar Land Rover Ltd | Display control apparatus and method |
EP3249497A1 (en) * | 2016-05-24 | 2017-11-29 | Harman Becker Automotive Systems GmbH | Eye tracking |
KR20170141484A (ko) * | 2016-06-15 | 2017-12-26 | 엘지전자 주식회사 | 차량용 제어장치 및 그것의 제어방법 |
CN106740581A (zh) * | 2017-01-03 | 2017-05-31 | 青岛海信移动通信技术股份有限公司 | 一种车载设备的控制方法、ar装置及ar*** |
-
2018
- 2018-03-26 CN CN201810249971.8A patent/CN108501809A/zh active Pending
-
2019
- 2019-03-25 US US16/647,808 patent/US11524578B2/en active Active
- 2019-03-25 WO PCT/CN2019/079441 patent/WO2019184837A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130097557A1 (en) * | 2011-10-12 | 2013-04-18 | Visteon Global Technologies, Inc. | Method of controlling a display component of an adaptive display system |
CN104866089A (zh) * | 2014-02-26 | 2015-08-26 | 威斯通全球技术公司 | 基于检测到的方位调节显示器 |
CN105301774A (zh) * | 2015-10-10 | 2016-02-03 | 青岛歌尔声学科技有限公司 | 一种车载抬头显示终端和控制其显示亮度的方法 |
CN106926698A (zh) * | 2015-12-29 | 2017-07-07 | 福特全球技术公司 | 包括透明显示器和镜子显示器的车辆通知*** |
CN108501809A (zh) * | 2018-03-26 | 2018-09-07 | 京东方科技集团股份有限公司 | 基于视线追踪的车载显示控制装置、显示***及显示方法 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2021108187A (ja) * | 2020-05-29 | 2021-07-29 | ベイジン バイドゥ ネットコム サイエンス テクノロジー カンパニー リミテッドBeijing Baidu Netcom Science Technology Co., Ltd. | スマートバックミラーを制御するための方法、装置、電子機器及び記憶媒体 |
JP7230093B2 (ja) | 2020-05-29 | 2023-02-28 | 阿波▲羅▼智▲聯▼(北京)科技有限公司 | スマートバックミラーを制御するための方法、装置、電子機器及び記憶媒体 |
Also Published As
Publication number | Publication date |
---|---|
CN108501809A (zh) | 2018-09-07 |
US11524578B2 (en) | 2022-12-13 |
US20200269691A1 (en) | 2020-08-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019184837A1 (zh) | 车载显示设备的控制方法及控制设备 | |
EP3040809B1 (en) | Method and system for controlling a human-machine interface having at least two displays | |
US8542129B2 (en) | Parking aid system | |
US9522633B2 (en) | Driver customizable blind spot display method and apparatus | |
US8115811B2 (en) | Vehicle surrounding area display device | |
US20160207539A1 (en) | Method for executing vehicle function using wearable device and vehicle for carrying out the same | |
WO2017134876A1 (ja) | ヘッドアップディスプレイ装置及びその表示制御方法 | |
US20120093358A1 (en) | Control of rear-view and side-view mirrors and camera-coordinated displays via eye gaze | |
US20190096359A1 (en) | Display control device, display device, in-vehicle display system, and display control method | |
JP2014229997A (ja) | 車両用表示装置 | |
US10710503B2 (en) | Systems and methods for streaming video from a rear view backup camera | |
JP2016103249A (ja) | 運転支援装置および運転支援方法 | |
US10061995B2 (en) | Imaging system to detect a trigger and select an imaging area | |
US9443426B1 (en) | Method and device for sensing traffic flow and notifying motor vehicle drivers of the same | |
TWI522257B (zh) | 車用安全系統及其運作方法 | |
JP2008013070A (ja) | 車両用表示装置 | |
EP3157233A1 (en) | Handheld device, method for operating the handheld device and computer program | |
US11858424B2 (en) | Electronic device for displaying image by using camera monitoring system (CMS) side display mounted in vehicle, and operation method thereof | |
CN104627074A (zh) | 车辆中的光学的播放及识别*** | |
EP2985648A1 (en) | Techniques for automated blind spot viewing | |
KR100811499B1 (ko) | 자동차의 차선이탈경보 장치 및 그 방법 | |
US11807264B2 (en) | Driving assistance apparatus, driving assistance method, and medium | |
RU2679103C2 (ru) | Способ и устройство для регистрации и контролирования окружения транспортных средств, в частности грузовых автомобилей | |
KR101896778B1 (ko) | 아웃사이드 미러를 이용한 차선 표시 장치 및 그 방법 | |
JP5182567B2 (ja) | 乗員監視装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19774850 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 25/01/2021) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19774850 Country of ref document: EP Kind code of ref document: A1 |