CN110774996B - Method, device and system for adjusting environment in vehicle - Google Patents

Method, device and system for adjusting environment in vehicle Download PDF

Info

Publication number
CN110774996B
CN110774996B CN201911060333.2A CN201911060333A CN110774996B CN 110774996 B CN110774996 B CN 110774996B CN 201911060333 A CN201911060333 A CN 201911060333A CN 110774996 B CN110774996 B CN 110774996B
Authority
CN
China
Prior art keywords
user
vehicle
state
environment
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911060333.2A
Other languages
Chinese (zh)
Other versions
CN110774996A (en
Inventor
高文敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Xiaopeng Motors Technology Co Ltd
Original Assignee
Guangzhou Xiaopeng Motors Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Xiaopeng Motors Technology Co Ltd filed Critical Guangzhou Xiaopeng Motors Technology Co Ltd
Priority to CN201911060333.2A priority Critical patent/CN110774996B/en
Publication of CN110774996A publication Critical patent/CN110774996A/en
Application granted granted Critical
Publication of CN110774996B publication Critical patent/CN110774996B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The embodiment of the application provides a method, a device and a system for regulating an in-vehicle environment, computer equipment and a storage medium, and relates to the technical field of intelligent vehicle-mounted devices, wherein the method for regulating the in-vehicle environment comprises the steps of acquiring vital sign data of a user through detection equipment when the user exists in a vehicle; matching the vital sign data with pre-configured sign comparison data to determine whether the user is in a specified sign state; and when the user is in the designated physical sign state, determining a corresponding target environment mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode. This technical scheme can be according to user's vital sign data automatically regulated car internal environment to make the equipment control parameter setting of car internal environment more accurate, the user's of laminating actual demand has more improved the intelligent degree of car.

Description

Method, device and system for adjusting environment in vehicle
Technical Field
The application relates to the technical field of intelligent vehicle-mounted, in particular to a method, a device and a system for adjusting an in-vehicle environment, a computer device and a storage medium.
Background
Along with the improvement of living standard of people, the possession of the automobile is more and more, and along with the development of intellectualization, people not only put forward higher requirements to the performance of the automobile, but also put forward higher requirements to the intellectualization and the man-machine interaction of the automobile.
When the environment in the vehicle does not meet the actual requirements of the user, the operation is usually that the user manually adjusts the parameters of the devices in the vehicle, such as the light and the air conditioner, so as to adjust the environment in the vehicle. However, in actual operation, when the user is in some physical sign states, such as physiological period, a special in-car environment is required to improve the comfort of the user, however, the device control parameters manually adjusted by the user cannot accurately meet the actual requirements of the user.
Disclosure of Invention
The object of the present application is to solve at least one of the above technical drawbacks, in particular the problem of low accuracy of setting of control parameters for the regulation of the environment inside a vehicle.
In a first aspect, an embodiment of the present application provides a method for adjusting an in-vehicle environment, including the following steps:
when a user exists in a vehicle, acquiring vital sign data of the user through detection equipment;
matching the vital sign data with pre-configured sign comparison data to determine whether the user is in a designated sign state;
and when the user is in the designated physical sign state, determining a corresponding target environment mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode.
In an embodiment, the step of acquiring vital sign data of the user by the detection device includes:
carrying out face recognition on the user by using face recognition detection equipment, and determining vital sign data of the user according to face state parameters obtained by face recognition; or the like, or, alternatively,
detecting vital sign data of the user with a contactless or contact sensing device.
In an embodiment, the designated physical sign state includes a physiological period state, the vital sign data includes body temperature data, and the physical sign comparison data is the vital sign data corresponding to the physiological period state.
In an embodiment, matching the vital sign data with pre-configured sign comparison data, the step of determining whether the user is in a specified sign state comprises:
and if the vital sign data is matched with pre-configured physiological period state sign comparison data, determining that the user is in a physiological period state.
In one embodiment, the method further comprises the following steps:
detecting historical vital sign data of the user in a physiological period state through wearable equipment, and taking the historical vital sign data as physiological period state sign comparison data.
In an embodiment, the step of determining the corresponding target environmental mode when the user is in the designated sign state includes:
calling a corresponding relation table between a preset designated physical sign state and a target environment mode;
and finding out a target environment mode corresponding to the specified sign state according to the relation table, and displaying the target environment mode to the user.
In an embodiment, before presenting to the user, the method further comprises the following steps:
acquiring the number of passengers in the vehicle;
if the number of passengers is one, playing a first prompt voice to the user through voice, and if the number of passengers is multiple, playing a second prompt voice to the user through voice;
the first prompt voice and the second prompt voice are the user-defined playing contents.
In an embodiment, when the user is in the designated physical sign state, the method for adjusting the in-vehicle environment further includes:
asking the user whether to turn on the physiological period comfort mode;
and if the user determines to start, determining that the corresponding target environment mode is a physiological period comfort mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the physiological period comfort mode.
In an embodiment, before the step of acquiring vital sign data of the user by a detection device, the method further includes:
acquiring historical physiological period state sign data of a historical record;
predicting the physiological period time range of the user according to the historical physiological period state sign data;
and when the current time is in the physiological period time range, executing the step of acquiring the vital sign data of the user through the detection device.
In one embodiment, the control parameters corresponding to the target environment mode include:
and the control parameters correspond to at least one of an in-vehicle environment adjusting device in the in-vehicle atmosphere lamp, the in-vehicle audio playing device, the seat waist hot air device and the temperature adjusting device.
In a second aspect, an embodiment of the present application provides a device for adjusting an environment in a vehicle, including:
the vital sign data acquisition module is used for acquiring vital sign data of a user through detection equipment when the user exists in the vehicle;
a designated sign state determination module, configured to match the vital sign data with preconfigured sign comparison data, and determine whether the user is in a designated sign state;
and the in-vehicle environment adjusting module is used for determining a corresponding target environment mode when the user is in a specified physical sign state, and adjusting the in-vehicle environment according to the control parameters corresponding to the target environment mode.
In a third aspect, an embodiment of the present application provides a system for regulating an environment in a vehicle, including: the system comprises a detection device, an on-board system and a control device;
the detection device is used for detecting vital sign data of a user in the vehicle,
the vehicle-mounted system is used for executing the method for regulating the environment in the vehicle according to any embodiment of the first aspect;
the control equipment is used for controlling the in-vehicle environment regulating equipment to operate according to the corresponding control parameters so as to regulate the in-vehicle environment.
In an embodiment, the control device comprises at least one of a light control device, a temperature control device and a sound control device.
In a fourth aspect, an embodiment of the present application provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the processor implements the steps of the method for adjusting an in-vehicle environment according to any one of the embodiments of the first aspect.
In a fifth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions for performing the steps of the method for regulating an in-vehicle environment according to the first aspect when executed by a computer processor.
According to the method, the device and the system for regulating the environment in the vehicle, the computer equipment and the storage medium provided by the embodiment, when the user exists in the vehicle, the detection equipment acquires vital sign data of the user; matching the vital sign data with pre-configured sign comparison data to determine whether the user is in a specified sign state; when the user is in the appointed sign state, the corresponding target environment mode is determined, the in-vehicle environment is adjusted according to the control parameters corresponding to the target environment mode, the in-vehicle environment is automatically adjusted according to the vital sign data of the user, the equipment control parameters of the in-vehicle environment are set more accurately, the actual requirements of the user are met more, and the intelligent degree of the vehicle is improved.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of a method for regulating an in-vehicle environment according to an embodiment;
FIG. 2 is a flow diagram of a method for determining a target environment mode provided by an embodiment;
FIG. 3 is a flow chart for regulating an in-vehicle environment based on a physiological phase state, according to an embodiment;
FIG. 4 is a schematic structural diagram of a device for regulating an environment in a vehicle according to an embodiment;
fig. 5 is a schematic structural diagram of a system for regulating an in-vehicle environment according to an embodiment.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative only and should not be construed as limiting the invention.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Fig. 1 is a flowchart of a method for adjusting an in-vehicle environment according to an embodiment, where the method for adjusting an in-vehicle environment is applicable to a case where an in-vehicle environment is intelligently adjusted according to vital sign data of a human body, and may be executed in an in-vehicle system of an automobile.
Specifically, as shown in fig. 1, the method for regulating the environment in the vehicle may include the following steps:
s110, when a user exists in the vehicle, obtaining vital sign data of the user through detection equipment.
In an embodiment, whether a user is present in a vehicle may be detected by a sensor or the like, for example, a thermal infrared life detector installed in a vehicle, which is used to determine whether a user is present by sensing a temperature difference. When the user is determined to be in the vehicle, the detection equipment is started to acquire vital sign data of the user, such as body temperature, heart rate, blood pressure, pulse, brain wave, skin electricity and the like.
The user in this embodiment may be a user in a driver seat or a user in a non-driver seat. The detection device may be a contact sensor, for example, a pressure sensor mounted on a seat may detect vital sign data of a user, such as pulse, heart rate, etc.; the body temperature of the user can be quickly detected by a non-contact sensor, such as a non-contact infrared human body thermometer arranged in a vehicle; the system can also be a face recognition device, and vital sign data and the like of the user can be analyzed by detecting the micro-expression of the face of the user.
In an embodiment, the detection device may also be a device for receiving data transmitted by a wearable device worn by a user, for example, the detection device may be a bluetooth receiving device. The user wears the intelligent bracelet, and utilizes the intelligent bracelet to detect the multiple vital sign data of user in real time. When the user enters the vehicle, the Bluetooth receiving equipment is automatically connected with the Bluetooth sending equipment in the intelligent bracelet to acquire vital sign data of the user.
S120, matching the vital sign data with pre-configured sign comparison data, and determining whether the user is in a specified sign state.
The sign comparison data may be vital sign data of the user in different specified sign states. In an embodiment, the designated sign states may include a physiological phase state, a fatigue state, a sick state, an excited state, a vital state, a normal state, and the like. The physiological state refers to a state when the user is in a physiological state, the fatigue state refers to a state when the user is in fatigue, the ill state refers to a state when the user is in a fever and cold, the excited state refers to a state when the user is in a state of being excited, the angry state refers to a state when the user is in an angry state, the normal state refers to a state when the user is in a healthy and normal state, and the like.
As the user is in different specified sign states, there may be differences in the multiple vital sign data. For example, the body temperature of a normal female changes with the change of the physiological cycle, and the body temperature of a female user in the physiological state is lower than that in the normal state, and is about 36.2 ℃ to 36.5 ℃. When the user is in a fatigue state, the heart rate is higher than that in a normal state; when the user is in a sick state, the body temperature, the pulse and the blood pressure are all higher than those in a normal state.
In an embodiment, one or more vital sign data of the user is matched with the preconfigured vital sign comparison data, and if the one or more vital sign data of the user is consistent with the preconfigured vital sign comparison data, it can be determined that the user is in the specified vital sign state. It should be noted that, the user may be in a designated physical sign state, such as only detecting that the user is in a normal state; the user can also be in various specified physical sign states at the same time, for example, when the current body temperature of the user is detected to be low, the body temperature is matched with the preconfigured physiological period state physical sign comparison data, the heart rate of the user is detected to be high, and the heart rate is matched with the preconfigured fatigue state physical sign comparison data, then the user is determined to be in the physiological period state and the fatigue state at the same time.
And S130, when the user is in the designated physical sign state, determining a corresponding target environment mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode.
In an embodiment, a target environment mode may correspond to a single device adjustment mode, such as a light adjustment mode only, a music adjustment mode, or a temperature adjustment mode, or may correspond to a combination of multiple device adjustment modes, such as a combination of a light adjustment mode and a music adjustment mode, or a combination of a light adjustment mode, a music adjustment mode, and a temperature adjustment mode. The device adjustment mode is a mode corresponding to the adjustment of the environment by the in-vehicle environment adjustment device, and the in-vehicle environment adjustment device may include a light adjustment device such as an in-vehicle atmosphere lamp, a temperature adjustment device such as an air conditioner and a fan, a sound adjustment device such as a sound device, and the like.
The control parameters for the same device adjustment mode may be different in different target ambient modes. For example, in the target environment mode corresponding to the physiological period state, the corresponding music adjustment mode is to play a relaxing light music, and in the target environment mode corresponding to the fatigue state, the corresponding music adjustment mode is to play a fast tempo music, and the like.
Optionally, the control parameters of each device adjustment mode corresponding to the target environment mode may include: the control parameter that at least one kind of in-vehicle environment regulating device corresponds in interior atmosphere lamp, in-vehicle audio playback equipment, seat waist hot-blast equipment and the thermoregulation device, wherein, control parameter can include: the brightness and the color of an atmosphere lamp in the automobile, the sound loudness and the music type of audio playing equipment in the automobile, the working temperature of seat waist hot air equipment, the temperature, the wind direction and the running mode of an air conditioner and the like.
Further, in the embodiment, each device adjusting mode may be customized by the user according to the actual hobbies and interests, for example, in the target environment mode corresponding to the physiological period state, the atmosphere lamp in the vehicle is softened, for example, a light purple light is emitted; playing relaxing light music in the car; automatically starting seat waist hot air equipment to emit hot air; adjusting the air outlet direction of the air conditioner to prevent the wind direction from directly facing a user; the warm air mode is automatically started in winter, and the air conditioner is automatically started for cooling in summer. In one embodiment, the device adjustment modes may also be set by default for the in-vehicle system.
According to the method for adjusting the environment in the vehicle, when a user exists in the vehicle, the detection device is started to obtain the vital sign data of the user, the vital sign data and the pre-configured sign comparison data are matched, whether the user is in the specified sign state is determined, when the user is in the specified sign state, the corresponding target environment mode is determined, the environment in the vehicle is adjusted according to the control parameters corresponding to the target environment mode, the purpose that the environment in the vehicle is adjusted according to the target environment mode through automatic selection of the target environment mode according to the vital sign data of the user is achieved, the device control parameters of the environment in the vehicle are set more accurately, the actual requirements of the user are met more, and the intelligent degree of the vehicle is improved.
In order to make the technical scheme of the present invention clearer and easier to understand, specific implementation processes and modes of each step in the technical scheme are described in detail below.
In an embodiment, the scheme of acquiring vital sign data of the user through the detection device in step S110 may include the following cases: the method comprises the steps of obtaining vital sign data through non-sensor equipment such as face recognition detection equipment, obtaining the vital sign data through the sensor equipment, and obtaining the vital sign data through the non-sensor equipment and the sensor equipment.
Specifically, in the first case, step S110 includes:
s1101, carrying out face recognition on the user by using face recognition detection equipment, and determining vital sign data of the user according to face state parameters obtained by face recognition.
In an embodiment, the camera may be installed on a front window of a vehicle, the face of the user is acquired through the camera, and the face image is transmitted to the face recognition detection device. The face recognition detection equipment automatically recognizes the face area of the user, obtains face state parameters corresponding to the micro-expression of the face of the user through an image processing technology and a signal processing algorithm, such as state parameters of the face, facial muscles, eyelids, eyes, eyebrows, mouth and the like, and obtains vital sign data of the user according to the face state parameters. It should be noted that the picture processing technique and the signal processing algorithm used in the present embodiment can be implemented according to the existing method, and are not described in detail here.
For example, when the user is in a physiological state, the face color is pale, when the user enters the vehicle, the face recognition device automatically performs face recognition on the user, and the degree of the pale face color of the user is determined according to parameters such as color distribution of each region of the face obtained by face recognition.
Specifically, in the second case, step S110 includes:
and S1102, detecting vital sign data of the user by using a non-contact or contact sensing device.
In an embodiment, when the user enters the detection range of the non-contact type sensing device in the vehicle, the non-contact type sensing device is automatically triggered to detect the vital sign data of the user, for example, a non-contact type infrared human body thermometer may be installed in the vehicle, when the user is located in the seat, the non-contact type infrared human body thermometer enters the detection range of the non-contact type infrared human body thermometer, the non-contact type infrared human body thermometer is automatically triggered to work, and when the user leaves the seat, the non-contact type infrared human body thermometer is automatically turned off.
In another embodiment, when the user touches the touch sensing device, the touch sensing device is automatically triggered to detect vital sign data of the user, optionally, the pressure sensing device is mounted on a seat, such as a cushion, a backrest, or a headrest, and when the user is located on the seat, the pressure sensor obtains the vital sign data of the user, such as pulse, heart rate, etc., by detecting a change in pressure.
It should be noted that the vital sign data of the user may be acquired by one or more combinations of a face recognition detection device, a non-contact sensing device and a contact sensing device.
Fig. 2 is a flowchart of a method for determining a target environmental mode according to an embodiment, and as shown in fig. 2, when the user is in a designated sign state, determining a corresponding target environmental mode may include the following steps:
s1301, calling a corresponding relation table between the preset designated physical sign state and the target environment mode.
Before the step is executed, a corresponding relation table between the designated sign state and the target environment mode can be preset, and as shown in the following table 1, in the physiological period state, the atmosphere lamp in the vehicle emits purple soft light and plays soothing music; playing the light music in a fatigue state; in a sick state, the atmosphere lamp in the automobile emits orange soft light, and the temperature of the air conditioner is increased; under normal state, the atmosphere lamp in the vehicle emits yellow soft light and the like.
Table 1. relationship table for specifying correspondence between physical sign state and target environment mode
Specifying a state of a physical sign Target environment mode
Physiological phase state Purple soft light and relaxing music
Fatigue state Light music
State of illness Orange soft light for raising air conditioner temp
Normal state Yellow soft light
S1302, finding out a target environment mode corresponding to the specified sign state according to the relation table, and displaying the target environment mode to the user.
In an embodiment, when the vehicle-mounted system detects that the user is in the specified sign state, the target environment mode corresponding to the specified sign state is obtained through query according to the corresponding relation table between the specified sign state and the target environment mode, and the target environment mode is displayed to the user to confirm whether the user needs to start the target environment mode or whether the control parameter of the target environment mode needs to be adjusted.
In an embodiment, when the user is in the designated physical sign state, the method for adjusting the environment in the vehicle may further include the following steps:
s101, inquiring whether the user wants to start the physiological period comfort mode.
In the embodiment, the target environment mode and the related control parameters thereof are displayed on a display screen of the vehicle-mounted system, a user is asked whether to open the target environment mode, if yes, confirmation operation is performed, if yes, confirmation can be performed by clicking the related button of the electronic screen, if not, cancellation operation is performed, and similarly, cancellation can be performed by clicking the related button of the electronic screen. In one embodiment, the target environment mode can be started after the vehicle-mounted system receives the voice of the user through voice confirmation, if the voice of the user is output to be on; and if the user voice output is 'off', closing the target environment mode. In another embodiment, the determination may also be through motion, such as when the user performs a head nodding motion, the target environment mode is turned on, when the user performs a head nodding motion, the target environment mode is turned off, and the like.
Further, the user may be asked whether to turn on the physiological period comfort mode. The physiological period comfort mode can be a configuration of obtaining the comfort mode according to the historical setting data of the user in the physiological period state, and can also be a configuration customized by the user. For example, in the physiological period comfort mode, the light in the vehicle is purple soft light, the relaxing music is played, the hot air function of the waist of the seat is automatically started, if the air conditioner is turned on in summer, the wind direction does not need to directly blow towards the human body, and if the air conditioner is turned on in winter, the hot air mode is automatically started, and the like.
And S102, if the user confirms to start the vehicle, determining that the corresponding target environment mode is the physiological period comfort mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the physiological period comfort mode.
And receiving an instruction of a user for confirming to start the physiological period comfort mode, wherein the target environment mode is the physiological period comfort mode, and calling control parameters corresponding to the physiological period comfort mode, such as control parameters corresponding to in-vehicle environment adjusting equipment, such as an in-vehicle atmosphere lamp, in-vehicle audio playing equipment, seat waist hot air equipment, temperature adjusting equipment and the like, and adjusting the in-vehicle environment according to the control parameters.
Optionally, when the target environment mode is displayed to the user, the vehicle-mounted system does not receive the operation of the user within a preset time, and then the target environment mode is automatically started.
According to the in-vehicle environment adjusting method provided by the embodiment, whether the physiological period comfort mode is started or not is inquired by the user when the user is determined to be in the specified physical sign state, and the in-vehicle environment is adjusted according to the physiological period comfort mode after the confirmation operation of the user is received, so that the in-vehicle environment is adjusted to be more suitable for the actual requirements of the user, and the use experience of the user is provided.
In an embodiment, before the step of acquiring vital sign data of the user through the detection device in step S110, the following steps may be further included:
s1001, obtaining historical physiological period state sign data of a historical record.
S1002, predicting the physiological period time range of the user according to the historical physiological period state sign data.
S1003, when the current time is in the physiological period time range, the step of obtaining the vital sign data of the user through the detection equipment is executed.
Because the physiological period of the user is regular, the period is generally 28-30 days. In an embodiment, historical physiological period state sign data recorded through a wearable device history is obtained, or historical physiological period state sign data recorded by a user through a third-party application is obtained, and a future physiological period time range of the user is predicted according to the historical physiological period state sign data and the regularity of a physiological period. If the current time is within the physiological period time range, executing the step of acquiring the vital sign data of the user through the detection equipment; and if the current time is not in the physiological period time range, not starting to acquire the vital sign data of the user through the detection equipment so as to avoid resource waste caused by long-time work of the detection equipment.
In an embodiment, before the presenting the target environment mode to the user in step S1302, the method further includes the following steps:
s201, acquiring the number of passengers in the vehicle.
In this embodiment, the in-vehicle image may be acquired through an intelligent camera, a face recognition device, and the like, and the number of the in-vehicle members may be counted according to the number of faces in the image.
S202, if the number of passengers is one, a first prompt voice can be played to the user through voice, and if the number of passengers is multiple, a second prompt voice can be played to the user through voice.
The first prompt voice and the second prompt voice are the user-defined playing contents.
Specifically, when only one person in the vehicle is detected, such as a driver, a voice playing device installed in the vehicle, such as the small intelligent robot, plays a first prompting voice, such as "today is a special day and the comfort mode is started for you", and when a plurality of persons are detected in the vehicle, the small intelligent robot plays a second prompting voice, such as "the comfort mode is automatically started for you". According to the embodiment, different prompt voices are automatically selected to be played according to the number of passengers, so that the intelligent degree of the automobile is further improved.
To more clearly illustrate the solution of the present application, the following description is made with reference to fig. 3 by taking the example of regulating the environment in the vehicle according to the physiological phase state, and fig. 3 is a flow chart of regulating the environment in the vehicle according to the physiological phase state provided by an embodiment.
In this embodiment, the designated physical sign state is a physiological state, the vital sign data includes body temperature data, and the physical sign comparison data is the vital sign data corresponding to the physiological state. Of course, in other embodiments, the vital sign data may also be heart rate, sweat, pale complexion, and the like. In order to more accurately represent the physiological period state, optionally, whether the user is in the physiological period state or not can be determined according to the multiple vital sign data.
S301, when a user exists in the vehicle, starting detection equipment to obtain vital sign data of the user.
In this embodiment, the body temperature data of the user is detected by the non-contact infrared human body thermometer as the vital sign data.
S302, if the vital sign data is matched with pre-configured physiological period state sign comparison data, determining that the user is in a physiological period state.
Illustratively, historical vital sign data of a user in a physiological state can be detected through a wearable device, such as a smart watch, a smart bracelet, and the like, and the historical vital sign data is used as physiological state sign comparison data of the user. Optionally, the preconfigured physiological period state sign comparison data can be updated according to the acquired historical vital sign data of the user in the physiological period state last time, so that the physiological period state sign comparison data is more accurate, and the matching accuracy is improved.
In an embodiment, the physiological cycle data of the user can also be obtained by inputting the physiological cycle data of the individual on the vehicle-mounted system by the user, or by obtaining the physiological cycle data input on a third-party Application (APP) by the user, for example, by obtaining the physiological data of the user through the APP installed on the mobile terminal for recording the physiological data, and analyzing the physiological cycle data of the user.
In this embodiment, the body temperature data of the user obtained by the non-contact infrared human body thermometer is compared with the pre-configured body temperature data in the physiological period state, and if the body temperature data of the user at this time is consistent with the pre-configured body temperature data in the physiological period state, it is determined that the user is in the physiological period state.
Of course, the vital sign data used for comparison may be different in other specified vital sign states. Since the heart rate of the human body is high in the fatigue state, in an embodiment, if the heart rate data in the vital sign data matches the fatigue state sign comparison data, it is determined that the user is in the fatigue state.
When the detected data corresponding to the body temperature, the pulse and the blood pressure are matched with the body temperature, the pulse and the blood pressure data in the pre-configured sick state, the user is determined to be in the sick state.
And if all the vital sign data of the user are normal and are matched with the pre-configured normal state sign comparison data, determining that the user is in a normal state.
S303, calling a preset corresponding relation table between the designated physical sign state and the target environment mode, finding out the target environment mode corresponding to the physiological period state, and displaying the target environment mode to the user.
In an embodiment, the target environmental mode in the physiological period state can be found according to the relationship table between the designated sign state and the target environmental mode shown in table 1. Because the target environment mode comprises the light adjusting mode and the music adjusting mode, the light adjusting mode and the music adjusting mode are displayed in a voice playing mode, or a display screen display mode, or a voice playing mode and a display screen display mode. For example, by voice broadcast: turning on purple soft light and playing relaxing music; displaying on a display screen of the in-vehicle system: "light: the color is purple and soft; music: ease, "etc.
And S304, adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode.
When the target environment mode is started, the environment in the vehicle is adjusted according to control parameters corresponding to the target environment mode, such as the type and color of light, the type of music and the like.
In the method for adjusting an in-vehicle environment provided by this embodiment, for example, the in-vehicle environment is adjusted according to the physiological period state, when a user is present in the vehicle, the detection device obtains vital sign data of the user, if the vital sign data matches the pre-configured comparison data of the physiological period state and the physical sign, it is determined that the user is in the physiological period state, a pre-configured relationship table corresponding to the specified physical sign state and the target environment mode is called, the target environment mode corresponding to the physiological period state is found, the in-vehicle environment is adjusted according to the corresponding control parameter, it is implemented that whether the user is in the physiological period state is automatically detected, the in-vehicle environment is adjusted according to the target environment mode corresponding to the pre-configured physiological period state, and the degree of intelligence of the vehicle is improved.
The following provides a detailed explanation of a related embodiment of the regulating device for an in-vehicle environment.
Fig. 4 is a schematic structural diagram of a device for regulating an in-vehicle environment according to an embodiment, and as shown in fig. 4, the device for regulating an in-vehicle environment includes: a vital sign data acquisition module 110, a specified vital sign state determination module 120 and an in-vehicle environment regulation module 130;
the vital sign data acquisition module 110 is configured to acquire vital sign data of a user through a detection device when the user is present in a vehicle;
a designated sign state determination module 120, configured to match the vital sign data with preconfigured sign comparison data, and determine whether the user is in a designated sign state;
and the in-vehicle environment adjusting module 130 is configured to determine a corresponding target environment mode when the user is in the specified physical sign state, and adjust the in-vehicle environment according to the control parameter corresponding to the target environment mode.
The adjusting device of the in-car environment that this embodiment provided, when there is the user through in the car through vital sign data acquisition module, check out test set acquires user's vital sign data, appointed sign state determination module compares data with this vital sign data and the sign of pre-configuration and matches, it is in appointed sign state to confirm the user, in-car environment adjustment module is when the user is in appointed sign state, confirm the target environment mode that corresponds, and adjust the in-car environment according to the control parameter that target environment mode corresponds, realize adjusting the in-car environment according to user's vital sign data automatic selection target environment mode, so that the equipment control parameter setting of in-car environment is more accurate, the actual demand of the user of laminating more, improve the intelligent degree of car.
In an embodiment, the vital signs data acquisition module 110 is configured to: carrying out face recognition on the user by using face recognition detection equipment, and determining vital sign data of the user according to face state parameters obtained by face recognition; or, detecting vital sign data of the user by using a non-contact or contact sensing device.
In an embodiment, the designated physical sign state includes a physiological period state, the vital sign data includes body temperature data, and the physical sign comparison data is the vital sign data corresponding to the physiological period state.
In an embodiment, the designated sign state determination module 120 is configured to determine that the user is in the physiological period state if the vital sign data matches the preconfigured physiological period state sign comparison data.
In one embodiment, the device for regulating the environment in the vehicle further comprises a comparison data detection module; the comparison data detection module is used for detecting historical vital sign data of the user in a physiological period state through wearable equipment, and taking the historical vital sign data as the sign comparison data.
In one embodiment, the in-vehicle environmental conditioning module 130 includes: a target environment pattern search unit for searching for a target environment pattern,
the target environment mode searching unit is used for calling a corresponding relation table between the preset specified sign state and the in-vehicle environment mode, searching the target environment mode corresponding to the specified sign state, and displaying the target environment mode to the user.
In one embodiment, the in-vehicle environmental regulation module 130 further includes: the device comprises a passenger number acquisition unit and a voice playing unit;
the device comprises a passenger number acquisition unit, a passenger number acquisition unit and a control unit, wherein the passenger number acquisition unit is used for acquiring the number of passengers in the vehicle; the voice playing unit plays a first prompting voice to the user through voice if the number of passengers is one, and plays a second prompting voice to the user through voice if the number of passengers is multiple; the first prompt voice and the second prompt voice are the user-defined playing contents.
In one embodiment, the apparatus for adjusting an environment in a vehicle further includes: an inquiry module and a confirmation module;
the inquiry module is used for inquiring whether the user wants to start the physiological period comfort mode; and the confirming module is used for confirming that the corresponding target environment mode is the physiological period comfort mode if the user confirms to start the vehicle, and regulating the environment in the vehicle according to the control parameters corresponding to the physiological period comfort mode.
In one embodiment, the apparatus for adjusting an environment in a vehicle further includes: the physiological period prediction system comprises a historical data acquisition module, a physiological period prediction module and a starting execution module;
the historical data acquisition module is used for acquiring historical physiological period state sign data of a historical record; the physiological period prediction module is used for predicting the physiological period time range of the user according to the historical physiological period state sign data; and the starting execution module is used for executing the step of acquiring the vital sign data of the user through the detection equipment when the current time is in the physiological period time range.
In one embodiment, the control parameters corresponding to the target environment mode include: and the control parameters correspond to one or more of an in-vehicle atmosphere lamp, in-vehicle audio playing equipment, seat waist hot air equipment and temperature adjusting equipment.
When the adjusting device for the environment in the vehicle performs the adjusting method for the environment in the vehicle provided by any of the embodiments, the adjusting device for the environment in the vehicle has corresponding functions and beneficial effects.
Fig. 5 is a schematic structural diagram of a regulation system of an in-vehicle environment according to an embodiment, and as shown in fig. 5, the regulation system 20 of the in-vehicle environment includes: a detection device 201, an in-vehicle system 202, and a control device 203;
the detection device 201 is used for detecting vital sign data of a user in the vehicle;
the on-board system 202 is configured to execute the method for regulating the environment in the vehicle according to any of the embodiments;
the control device 203 is used for controlling the operation of the in-vehicle environment regulating device according to the corresponding control parameter so as to regulate the in-vehicle environment.
In this embodiment, the detecting device 201 may be a contact sensor, for example, a pressure sensor installed on a seat may detect vital sign data of a user, such as pulse, heart rate, etc.; the body temperature of the user can be quickly detected by a non-contact sensor, such as a non-contact infrared body temperature sensor arranged in a vehicle; the system can also be a face recognition device, and vital sign data and the like of the user can be analyzed by detecting the micro-expression of the face of the user.
In an embodiment, the detection device 201 may also be a device for receiving data transmitted by a wearable device worn by a user, for example, the detection device 201 may be a bluetooth receiving device. The user wears wearable equipment, such as intelligent bracelet, utilizes intelligent bracelet real-time detection user's multinomial vital sign data. When the user enters the vehicle, the Bluetooth receiving equipment is automatically connected with the Bluetooth sending equipment in the intelligent bracelet to acquire vital sign data of the user.
The in-vehicle system 202 is a system provided in an automobile, and can implement various in-vehicle services related to navigation, security, vehicle, life, and business. The in-vehicle system 202 incorporates a processor, a memory, a display screen, an input device, an output device, a communication device, and the like. The processor, memory, display, input devices, output devices, and communication devices may be connected by a bus or other means. The memory is a computer readable storage medium, and can be used for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the in-vehicle environment adjusting method according to any embodiment of the present application (for example, the vital sign data acquiring module 110, the specific sign state determining module 120, and the in-vehicle environment adjusting module 130). The processor executes various functional applications and data processing of the device by executing software programs, instructions and modules stored in the memory, that is, the method for adjusting the environment in the vehicle is realized.
The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network.
Generally, the display screen is used for displaying data according to the instruction of the processor, receiving touch operation acting on the display screen and sending corresponding signals to the processor or other devices.
The communication device is used for establishing communication connection with other equipment, such as a smart bracelet, a smart watch and the like, and can be a wired communication device and/or a wireless communication device.
The input means may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer device, and may be a camera for acquiring images and a sound pickup device for acquiring audio data. The output device may include an audio device such as a speaker. It should be noted that the specific composition of the input device and the output device can be set according to actual conditions.
In one embodiment, the control apparatus includes: at least one of a light control device, a temperature control device, a sound control device.
Specifically, the light control equipment controls the color and brightness of the atmosphere lamp in the vehicle, such as purple soft light; the temperature control device controls the wind direction and temperature of an air conditioner or a fan in the vehicle, the sound control device controls audio equipment in the vehicle, and different music or voice prompts are played.
The embodiment of the present application further provides a computer device, such as an in-vehicle system, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the method for adjusting the environment in the vehicle as in any one of the above embodiments.
When the computer device provided by the above embodiment executes the method for adjusting the environment in the vehicle, the computer device has corresponding functions and beneficial effects.
Embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a method of regulating an in-vehicle environment, comprising:
when a user exists in a vehicle, acquiring vital sign data of the user through detection equipment;
matching the vital sign data with pre-configured sign comparison data to determine whether the user is in a designated sign state;
and when the user is in the designated physical sign state, determining a corresponding target environment mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode.
Of course, the storage medium containing the computer-executable instructions provided by the embodiments of the present invention is not limited to the operation of the method for adjusting the in-vehicle environment described above, and may also perform related operations in the method for adjusting the in-vehicle environment provided by any embodiments of the present invention, and has corresponding functions and advantages.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method for adjusting an in-vehicle environment according to any embodiment of the present invention.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a partial embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (12)

1. A method for regulating an in-vehicle environment, comprising the steps of:
when a user exists in the vehicle, acquiring historical physiological period state sign data of a historical record;
predicting the physiological period time range of the user according to the historical physiological period state sign data;
when the current time is within the physiological period time range, acquiring vital sign data of the user through detection equipment, wherein the vital sign data comprises body temperature data;
matching the vital sign data with pre-configured sign comparison data to determine whether the user is in a specified sign state, wherein the specified sign state comprises a physiological period state, and the sign comparison data is the vital sign data corresponding to the physiological period state;
when the user is in a specified sign state, determining a corresponding target environment mode;
acquiring the number of passengers in the vehicle;
if the number of the passengers is one, playing a first prompt voice to the user through voice, and if the number of the passengers is multiple, playing a second prompt voice to the user through voice; the first prompt voice and the second prompt voice are user-defined playing contents; the first prompt voice and the second prompt voice are used for showing a target environment mode corresponding to the specified sign state to a user;
and adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode.
2. The method for regulating an in-vehicle environment according to claim 1, wherein the step of obtaining vital sign data of the user by means of a detection device comprises:
carrying out face recognition on the user by using face recognition detection equipment, and determining vital sign data of the user according to face state parameters obtained by face recognition; or the like, or, alternatively,
detecting vital sign data of the user with a contactless or contact sensing device.
3. The method of claim 1, wherein the step of matching the vital sign data with pre-configured sign comparison data to determine whether the user is in a designated sign state comprises:
and if the vital sign data is matched with pre-configured physiological period state sign comparison data, determining that the user is in a physiological period state.
4. The method for regulating an in-vehicle environment according to claim 3, further comprising the steps of:
detecting historical vital sign data of the user in a physiological period state through wearable equipment, and taking the historical vital sign data as physiological period state sign comparison data.
5. The method for adjusting an in-vehicle environment according to claim 1, wherein the step of determining a corresponding target environment mode when the user is in a designated physical sign state comprises:
calling a corresponding relation table between a preset designated physical sign state and a target environment mode;
and finding out a target environment mode corresponding to the specified sign state according to the relation table, and displaying the target environment mode to the user.
6. The method for regulating an in-vehicle environment according to any one of claims 1 to 5, further comprising the steps of, when the user is in a designated physical sign state:
asking the user whether to turn on the physiological period comfort mode;
and if the user confirms to start, determining that the corresponding target environment mode is the physiological period comfort mode, and adjusting the environment in the vehicle according to the control parameters corresponding to the physiological period comfort mode.
7. The in-vehicle environment regulation method according to any one of claims 1 to 5, wherein the control parameter corresponding to the target environment mode includes:
and the control parameters correspond to at least one of an in-vehicle environment adjusting device in the in-vehicle atmosphere lamp, the in-vehicle audio playing device, the seat waist hot air device and the temperature adjusting device.
8. A device for regulating an environment in a vehicle, comprising:
the historical data module is used for acquiring historical physiological period state sign data of a historical record when a user exists in the vehicle;
the physiological period prediction module is used for predicting the physiological period time range of the user according to the historical physiological period state sign data;
the vital sign data acquisition module is used for acquiring vital sign data of a user through detection equipment when the current time is within a physiological period time range of the user, wherein the vital sign data comprises body temperature data;
a designated sign state determination module, configured to match the vital sign data with preconfigured sign comparison data, and determine whether the user is in a designated sign state, where the designated sign state includes a physiological period state, and the sign comparison data is the vital sign data corresponding to the physiological period state;
the in-vehicle environment adjusting module is used for determining a corresponding target environment mode and acquiring the number of passengers in the vehicle when the user is in a specified sign state; if the number of the passengers is one, playing a first prompt voice to the user through voice, and if the number of the passengers is multiple, playing a second prompt voice to the user through voice; the first prompt voice and the second prompt voice are user-defined playing contents; the first prompt voice and the second prompt voice are used for showing a target environment mode corresponding to the specified sign state to a user; and adjusting the environment in the vehicle according to the control parameters corresponding to the target environment mode.
9. A system for regulating an environment in a vehicle, comprising: the system comprises a detection device, an on-board system and a control device;
the detection device is used for detecting vital sign data of a user in the vehicle,
the on-board system is configured to execute the method for adjusting the in-vehicle environment according to any one of claims 1 to 7;
the control equipment is used for controlling the in-vehicle environment regulating equipment to operate according to the corresponding control parameters so as to regulate the in-vehicle environment.
10. The system for regulating an in-vehicle environment according to claim 9, wherein the control device includes at least one of a light control device, a temperature control device, and a sound control device.
11. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the program, carries out the steps of the method for regulating the environment in a vehicle according to any one of claims 1 to 7.
12. A storage medium containing computer-executable instructions for performing the steps of the method for regulating an in-vehicle environment according to any one of claims 1 to 7 when executed by a computer processor.
CN201911060333.2A 2019-11-01 2019-11-01 Method, device and system for adjusting environment in vehicle Active CN110774996B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911060333.2A CN110774996B (en) 2019-11-01 2019-11-01 Method, device and system for adjusting environment in vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911060333.2A CN110774996B (en) 2019-11-01 2019-11-01 Method, device and system for adjusting environment in vehicle

Publications (2)

Publication Number Publication Date
CN110774996A CN110774996A (en) 2020-02-11
CN110774996B true CN110774996B (en) 2021-10-12

Family

ID=69388436

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911060333.2A Active CN110774996B (en) 2019-11-01 2019-11-01 Method, device and system for adjusting environment in vehicle

Country Status (1)

Country Link
CN (1) CN110774996B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111452747A (en) * 2020-04-03 2020-07-28 宁波吉利汽车研究开发有限公司 Vehicle-mounted health monitoring method and monitoring system
FR3113218B1 (en) * 2020-07-28 2022-06-24 Psa Automobiles Sa Personalized interior atmosphere
CN111942307A (en) * 2020-08-12 2020-11-17 华人运通(上海)云计算科技有限公司 Scene generation method, device, system, equipment and storage medium
CN112061057B (en) * 2020-09-07 2022-03-01 华人运通(上海)云计算科技有限公司 Scene triggering method, device, equipment and storage medium
CN115071605B (en) * 2022-06-30 2024-05-14 阿维塔科技(重庆)有限公司 In-vehicle intelligent body care method and device and automobile

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9972184B2 (en) * 2014-07-24 2018-05-15 State Farm Mutual Automobile Insurance Company Systems and methods for monitoring a vehicle operator and for monitoring an operating environment within the vehicle
CN105667433A (en) * 2016-01-12 2016-06-15 戴姆勒股份公司 Regulating system and method for devices in vehicle
CN107757295A (en) * 2017-09-13 2018-03-06 北汽福田汽车股份有限公司 On-board air conditioner control method, device and vehicle
CN109131167A (en) * 2018-08-03 2019-01-04 百度在线网络技术(北京)有限公司 Method for controlling a vehicle and device

Also Published As

Publication number Publication date
CN110774996A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
CN110774996B (en) Method, device and system for adjusting environment in vehicle
CN105015445B (en) Driver used for vehicles carries out the method and system of auxiliary relevant to people
CN105373219B (en) Wearable device and its operating method
CN107791893B (en) Vehicle seat
US10917259B1 (en) Computing device interaction with surrounding environment
EP2945133B1 (en) Driver rest recommendation
US10606226B2 (en) Method for controlling an external device and an electronic device therefor
JP5265141B2 (en) Portable electronic device, program and information storage medium
US10206573B2 (en) Method of obtaining biometric information in electronic device and electronic device for the same
CN107264390B (en) Method of operating an environmental control system
US20180359112A1 (en) Home device control device and operation method thereof
CN110996796B (en) Information processing apparatus, method, and program
CN108569233A (en) The method of the sleeping aid of vehicle including the system of sleeping aid and the sleep auxiliary of vehicle
JP2008310680A (en) Control system, program, and information storage medium
US11623065B2 (en) Vehicle and method for controlling the same
CN105674504B (en) Adjust the method, apparatus and terminal electronic device of air-conditioner temperature
US11260879B2 (en) Vehicle and method for controlling the same
KR20180102870A (en) Electronic device and method for controlling the same
US11240058B2 (en) System and method to view occupant status and manage devices of building
CN114543313B (en) Air conditioner control method, server, air conditioner and user terminal
KR20200029663A (en) Emotion recognition apparatus and control method THEREOF
JP7296626B2 (en) Information processing device and program
US20230129746A1 (en) Cognitive load predictor and decision aid
US11687049B2 (en) Information processing apparatus and non-transitory computer readable medium storing program
KR102675289B1 (en) Vehicle And Control Method Thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant