US20160245949A1 - System and method for modeling advanced automotive safety systems - Google Patents
System and method for modeling advanced automotive safety systems Download PDFInfo
- Publication number
- US20160245949A1 US20160245949A1 US15/146,402 US201615146402A US2016245949A1 US 20160245949 A1 US20160245949 A1 US 20160245949A1 US 201615146402 A US201615146402 A US 201615146402A US 2016245949 A1 US2016245949 A1 US 2016245949A1
- Authority
- US
- United States
- Prior art keywords
- sensor
- memory
- state
- track
- estimate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
- G01V13/00—Manufacturing, calibrating, cleaning, or repairing instruments or devices covered by groups G01V1/00 – G01V11/00
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
- G01V11/00—Prospecting or detecting by methods combining techniques covered by two or more of main groups G01V1/00 - G01V9/00
- G01V11/002—Details, e.g. power supply systems for logging instruments, transmitting or recording data, specially adapted for well logging, also if the prospecting method is irrelevant
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/15—Vehicle, aircraft or watercraft design
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
Definitions
- This invention relates generally to statistical modeling and analysis of automotive safety systems, sensors and application requirements for both performance and cost tradeoffs.
- This invention relates specifically to the process of designing, building, testing and analyzing system data in a hierarchy of statistical models, driven by the need to implement advanced safety features for the transportation industry.
- Next generation automotive systems will include numerous electronic systems such as; passive safety systems for airbag deployment and anti-skid braking features; active safety for collision warning and collision avoidance features; and convenience features for Blind Spot Detection (BSD) and Adaptive Cruise Control (ACC).
- BSD Blind Spot Detection
- ACC Adaptive Cruise Control
- non-contact sensor a new class of sensor
- non-contact sensors like radar, optical, laser, ultrasonic, etc.
- These non-contact sensors will generate data about the environment including range measurements and target classification.
- sensors required to support the features identified above are to some extent common; an optical sensor that supports one optical application could be used for a second optical application; two sensors could be used for one application. In either case, simply sharing data from sensors or other sources to improve knowledge of the environment is incorrectly termed “sensor-fusion” or “multi sensor-fusion” by the transportation industry suppliers.
- sensor-fusion is the art of combining sensory data or data derived from disparate sources such that the resulting information is in some sense “better” than would be possible when these sources were used individually. This process is predicated on the covariance (or the measure of how much two variables vary together) of non-independent sources.
- the term “better” in the case above can mean more accurate, more complete, more dependable, or refer to the result of an emerging view or state estimation.
- the data sources for a fusion process are not specified to originate from identical sources or sensors which may or may not be spatially and temporally aligned. Further one can distinguish direct fusion, indirect fusion and fusion of the outputs of the former two.
- Direct fusion is the fusion of sensor data from a set of heterogeneous or homogeneous sensors, soft sensors, and history values of sensor data, while indirect fusion uses information sources like a prior knowledge about the environment and human input.
- Sensor fusion is also known as “multi-sensor data fusion” and is a subset of information fusion through an implementation of the probability theory.
- Probability theory is the mathematical study of phenomena characterized by randomness or uncertainty. More precisely, probability is used for modeling situations when the result of a measurement, realized under the same circumstances, produces different results.
- State Estimation takes all the data obtained and uses it to determine the underlying behavior of the system at any point in time. It includes fault detection, isolation and continuous system state estimation.
- the overall approach is to use a model to predict the behavior of the system in a particular state, and then compare that behavior with the actual measurements from the instruments to determine which state or states is the most likely to produce the observed system behavior.
- This patent describes a system and methods necessary to implement a design methodology that will facilitate and support advanced safety systems design, test, verification, and validation; with emphasis on reliable fault tolerant operation.
- the implementation of this system and methods is termed “Algorithm Prototyping Analysis and Test” or APAT.
- a system and methods are disclosed for providing an Algorithm Prototyping, Analysis and Test (APAT) through an integrated framework for dynamic data modeling and application development.
- the system provides a data model that first extends the capabilities of the physical data model and then translates, gates, optimizes, fuses, filters and manages the physical representation of the logical model into a state estimation of the situation around the vehicle; this is known as Situation Awareness (SA); the implementation of this core is called SACore (Situation Awareness Core).
- SACore Situation Awareness Core
- the application framework is integrated with SACore, once the user configures the data model, the features and benefits of the application framework become automatically available to the developer as part of the decision process for cost-performance optimization.
- the data-modeling framework of APAT enables a user to define a data model or version of SACore by using a series of graphical user interfaces (GUI).
- GUI graphical user interfaces
- APAT and SACore provide functionality that physical databases cannot provide by dynamically translating the asynchronous data generated into a corresponding state estimation. Users can utilize the GUI to modify the data model by adjusting expected error, rate or core operation, and the system output is automatically adjusted to accommodate the changes.
- the APAT system and methods shields both the application developer and the sensor supplier from the complexities, limitations and costs of single sensor systems.
- n-by-n square matrix wherein the number of sensors, and number of sensor reports are variable
- n-by-n matrices are used to represent linear transformations from an n-dimensional vector space to itself.
- Defining and coding a 2-by 2 square matrix then changing the square matrix to a 3-by-3 or n-by-n is tedious and probably beyond the skill set of the automotive system designer, therefore methods are presented as the objects of the invention that allow rapid prototyping and auto-code generation for the development, modeling, implementation and testing of advanced automotive safety systems.
- It is an objective of the invention to describe methods for rapidly defining or redefining an automotive multi-sensor data fusion system comprising at least one of a vehicle, sensors, a system model of expected behaviors of targets with consideration for system variables, system error and measurement tolerances.
- the underlying system is based on an n-scalable, asynchronous, measurement oriented, measurement to track, variable structure, interacting multiple model estimation filter, utilizing a nearest neighbor joint probabilistic data association filter using optimal routines, with two dynamic switchable data association filters in place of the optimal JPDA using sub-optimal routines including one of cheap JPDA and sub-optimal JPDA; the system is implemented with consideration for out-of-sequence measurements, a track management system and a reporting system based on polar coordinates and a method for executing a debiased conversion, translation and rotation into a uniform Cartesian Coordinate system.
- Another object of the invention is to define the modeling framework including identifying the system variables by group, wherein the first group comprises sensor parameters and includes such parameters as the number of sensors in the system; the relationship of the sensor frames to the vehicle reference; the expected report limits; report outputs; 1-sigma covariance terms.
- Another object of the invention is to define the second group of modeling variables as the target maneuver accelerations that will be acceptable in measurement reports, wherein the modeling environment is at least two dimensional, and wherein at least three models are anticipated and they comprise near constant velocity, cross range acceleration, and down range acceleration, and the values are in terms of expected acceleration g's of maneuver and these accelerations are introduced into the filter structure as noise values.
- Another object of the invention is to describe a method for reducing processing complexity, when desired, by setting the number of filters implemented on any pairings of sensors, by identifying number of possibilities, with subsequent values set as noise for each option chosen.
- Another object of the invention is to describe the filter setup comprising at least one of housekeeping in nature; values set that define the function of the model values that set the starting uncertainty covariance terms expected from each sensor with respect to the dimensional states identified which further defined down range and cross range values for position, acceleration and velocity.
- noun, term, or phrase is intended to be further characterized, specified, or narrowed in some way, then such noun, term, or phrase will expressly include additional adjectives, descriptive terms, or other modifiers in accordance with the normal precepts of English grammar. Absent the use of such adjectives, descriptive terms, or modifiers, it is the intent that such nouns, terms, or phrases be given their plain, and ordinary English meaning to those skilled in the applicable arts as set forth above.
- FIG. 1 Block diagram of the IMM for two APAT and SACore models
- FIG. 2 Validation region for two tracks and five measurements
- FIG. 3 Feasible joint association events for FIG. 2
- FIG. 4 APAT Overview
- FIG. 5 APAT Model
- FIG. 6 APAT Process
- FIG. 7 APAT Process
- FIG. 8 Radar/Vision—10 Hz/0 Hz CrossRange & Down Range Error
- FIG. 9 Radar/Vision—10 Hz/3 Hz CrossRange & Down Range Error
- FIG. 10 Radar/Vision—10 Hz/10 Hz CrossRange & Down Range Error
- FIG. 11 Radar/Vision—10 Hz/25 Hz CrossRange & Down Range Error
- FIG. 12 Performance Improvements Aggregated
- FIG. 13 Performance Improvement
- FIG. 14 Performance Optimization
- FIG. 15 .- FIG. 30 Performance Predictions
- APAT models include both the deterministic variety, where the output is a point estimate, and the stochastic type; where some measure of uncertainty characterizes the model outputs whose behavior is non-deterministic in that a state does not fully determine its next state.
- APAT Process this figure describes the system level implementation APAT. APAT is divided into four main parts;
- r_sigma_sensor11 .005;% range error as a percent of the range for relevant target 23.
- r_sigma_sensor(1) .01;% range error as a percent of the range 24.
- r_sigma_sensor(2) .10;% range error as a percent of the range 25.
- r_sigma_sensor(3) .01;% range error as a percent of the range 26.
- Rx(2) posx_sigma_init_sensor(2) * posx_sigma_init_sensor(2); 74.
- vely_sigma_init_sensor(2) 2.0; 77.
- Rvx(2) velx_sigma_init_sensor(2) * velx_sigma_init_sensor(2); 78.
- Rax(2) accx_sigma_init_sensor(2) * accx_sigma_init_sensor(2); 82.
- Ray(2) accy_sigma_init_sensor(2) * accy_sigma_init_sensor(2); 83.
- Rx(3) posx_sigma_init_sensor(3) * posx_sigma_init_sensor(3); 86.
- Rvx(3) velx_sigma_init_sensor(3) * velx_sigma_init_sensor(3); 90.
- Rax(3) accx_sigma_init_sensor(3) * accx_sigma_init_sensor(3); 94.
- Ray(3) accy_sigma_init_sensor(3) * accy_sigma_init_sensor(3); .
- sensor parameters above are those values (variables) that represent the desired sensor system to be modeled. They include such parameters as the number of sensors in the system ⁇ 1>; the relationship of the sensor frames to the vehicle reference plane ⁇ 2-9> for the subsequent translation and rotation of axes; the expected report limits in terms of down range (meters) and cross range (degrees) ⁇ 10-15>; report outputs from the sensor interface in terms of the number of tracks expected to be report for each sensor ⁇ 16-18>; 1-sigma (mean of tested actual population with 1 standard deviation) covariance terms for cross range and down range error and linear error expectations ⁇ 19-25>.
- the sensor values set in ⁇ 1-25> can be adjusted during the modeling process for performance optimization and analysis of the output.
- the value can be opened to an expected error of ⁇ 3° and run again and compared to the first; the value can be closed to an expected error of ⁇ 10 and run again and compared to the other two; or the value can be opened to an expected error of ⁇ 3° of sensor 1 and closed on sensor 2 ⁇ 20> to an expected error of ⁇ 0.1° and run again and compared.
- This ability allows the user to choose and model hardware and sensor pairing scenarios against cost and capability at an integrated systems level, this will be discussed further below in the Performance Analysis section.
- the filter setup is identified as items ⁇ 41-94>; some items are housekeeping in nature ⁇ 41,42>; items ⁇ 43-58> are values set as a function of the model described below.
- Items ⁇ 59-94 set the starting uncertainty covariance terms expected from each sensor with respect the 2 dimensional states identified in ⁇ 52> 6 which defined down range and cross range values for position (2), acceleration (2) and velocity (2).
- ⁇ 59, 63, 67> set the expected error of the values of sensor 1 in terms of down range/cross range (x/y) position, velocity and acceleration measurements, the cases are:
- the APAT/SACore state estimation system is based on efficient recursive filter techniques which estimate the state of a dynamic system from a series of incomplete and noisy measurements. As time progresses, a measurement is made and reported. This measurement must be within the expectation of the next measurement. Therefore, the Kalman filter is based on linear dynamical systems discretized in the time domain. They are modeled on a Markov chain built on linear operators perturbed by Gaussian noise. The state of the system is represented as a vector of real numbers. At each discrete time increment, a linear operator is applied to the state to generate the new state, with some noise mixed in, and optionally some information from the controls on the system if they are known. Then, another linear operator mixed with more noise generates the visible outputs from the hidden state.
- the Kalman filter may be regarded as analogous to the hidden Markov model, with the key difference that the hidden state variables are continuous (as opposed to being discrete in the hidden Markov model). Additionally, the hidden Markov model can represent an arbitrary distribution for the next value of the state variables, in contrast to the Gaussian noise model that is used for the Kalman filter. There is a strong duality between the equations of the Kalman Filter and those of the hidden Markov model. A review of this and other models is given in Roweis and Ghahramani (1999).
- the scenario blocks ( 60 , 70 ) represent the setup of controlled scenarios for either synthetic or controlled target measurements. These scenarios and trajectories represent absolute ( 80 ) or controlled ( 90 ) “truth” with respect to position, velocity and acceleration of the host vehicle and targets observed. Scenarios can include any kinematic scenario such as over taking targets, meeting targets, observing target behavior to include spawning and merging targets, etc. Each of the scenarios can further include conditions such as degraded environment, degraded sensor operation, clutter, skipped reports, or any host of non-linear or un-expected errors that can and do occur in the environment.
- the sensor output blocks FIG. 7 ( 110 ) or ( 120 ) are fed into the DA through block ( 140 ). Additional discussion for blocks ( 160 , 180 , 190 ) are described in the section below.
- a second file representing target truth are sent to ( 200 ) for the analysis of performance.
- the instrument measurements are passed to the tracking and data fusion algorithms, which will attempt to produce tracks for each of the targets.
- the SACore is the tracking and fusion filter for integrating multi-sensor data to improve the track file of target vehicles.
- the problem of accurate reporting of measurements on a target is made more difficult because of the presence of clutter and the fact that the target can maneuver with no prior information.
- the tracking and sensor data fusion filter consists of four main parts:
- IMM Interacting Multiple Model
- a Kalman Filter can be used to estimate the target state, position, velocity and possibly acceleration.
- the problem is, to accurately estimate the state, the model in the filter must accurately match the maneuvering of the target. Since the movement of the target is not known ahead of time, an accurate model cannot be designed so errors in the state estimation will occur. Adding process noise to model the target maneuvers or using a maneuver detector to adapt the filter has been used in the art, but detection delays and large estimation errors during maneuvers are still a problem. It is generally accepted that the Interacting Multiple Model (IMM) estimator provides superior tracking performance compared to a single Kalman Filter.
- IMM Interacting Multiple Model
- the IMM is based on using several models in parallel to estimate the maneuvering target's states.
- Each Kalman Filter, or another estimation filter uses a different model for each maneuver, one models a constant velocity target, another models an acceleration in the longitudinal axis while another models an acceleration in the lateral axis. Switching between these models during each sample period is determined probabilistically.
- the IMM uses all filters.
- the overall state estimate output is a weighted combination of the estimates from the individual filters. The weighting is based on the likelihood that a filter model is the correct maneuvering target model.
- the IMM estimator is a state estimation algorithm that uses Markovian switching coefficients.
- a system with these coefficients is described by r models, M 1 , M 2 , . . . , M r , and given probabilities of switching between these models.
- the event that model j (M j ) is in effect during the sampling period ending at time tk, (t k ⁇ 1 , t k ] will be denoted by M j (k).
- the dynamics and measurement for a linear system are given by
- x ( k ) ⁇ j ( k,k ⁇ 1) x ( k ⁇ 1)+ G j ( k,k ⁇ 1) w j ( k ⁇ 1), (1)
- x(k) is the system state at time t k
- z(k) is the measurement vector at time t k
- ⁇ j (k,k ⁇ 1) is the state-transition matrix from time t k ⁇ 1 to time t k for M j (k)
- G j (k,k ⁇ 1) is the noise input matrix
- H j (k) is the observation matrix for M j (k).
- the process noise vector w j (k ⁇ 1) and the measurement noise vector v j (k) are mutually uncorrelated zero-mean white Gaussian processes with covariance matrices Q j (k ⁇ 1) and R j (k) respectively.
- the model switching probabilities, ⁇ ij are assumed known and an example is
- FIG. 1 A block diagram of the IMM estimator with only two models, for simplicity, is shown in FIG. 1 .
- the inputs to the IMM estimator are ⁇ circumflex over (x) ⁇ 1 (k ⁇ 1
- k ⁇ 1) is the state estimate from filter 1 at time t k ⁇ 1 using measurements from time t k ⁇ 1
- k ⁇ 1) is the corresponding state covariance matrix.
- Each of the filters use a different mixture of ⁇ circumflex over (x) ⁇ 1 (k ⁇ 1
- this mixing allows the model-conditioned estimates in the current cycle to be computed using r filters rather than r 2 filters, which greatly decreases the computational burden.
- k ⁇ 1), and the corresponding covariance matrices are computed in the Interaction (Mixing) block.
- conditional model probability is
- k - 1 ) ⁇ Pr ⁇ ⁇ M i ⁇ ( k - 1 )
- M j ⁇ ( k ) , Z 1 k - 1 ⁇ ⁇ 1 ⁇ j ⁇ ( k
- k - 1 ) Pr ⁇ ⁇ M j ⁇ ( k )
- k ⁇ 1) ⁇ j ( k,k ⁇ 1) ⁇ circumflex over (x) ⁇ 0j ( k
- K j ( k ) P j ( k
- k ⁇ 1) is the predicted state estimate under M j (k)
- k ⁇ 1) is the corresponding prediction covariance
- v j (k) is the residual
- S j (k) is the residual covariance matrix
- K j (k) is the Kalman gain matrix
- k) is the updated state estimate under M j (k)
- k) is the updated covariance matrix.
- ⁇ j ⁇ ( k ) 1 det ⁇ [ 2 ⁇ ⁇ ⁇ ⁇ S j ⁇ ( k ) ] ⁇ exp ⁇ ⁇ - 1 2 ⁇ [ v j ⁇ ( k ) ] T ⁇ [ S j ⁇ ( k ) ] - 1 ⁇ v j ⁇ ( k ) ⁇ . ( 15 )
- k ) Pr ⁇ ⁇ M j ⁇ ( k )
- Z 1 k ⁇ 1 c ⁇ ⁇ j ⁇ ( k
- k), is the best estimate of the target state and P(k
- This section deals with the problem of taking a target measurement from a sensor and either associating it to an existing track, possibly rejecting the measurement because it is clutter, or sending it to the track management process to start a new track.
- the process is to first define a validation region for each track and to identify all sensor measurements that fall within that region.
- the validation region for a track is constructed around the predicted measurement for the track.
- the predicted measurement is computed by propagating this state to the time of the next measurement. This predicted measurement is the center of the validation region. If the measurement falls within this validation region, then it is considered as a candidate for association to the track; otherwise, it is rejected.
- the residual, v(k), is the difference between the actual measurement, z(k), and the predicted measurement and is
- the residual statistics are Gaussian with zero-mean and the M-dimensional residual density f(v(k)) is
- the normalized distance d 2 is a chi-square variant, ⁇ M 2 , with M degrees of freedom.
- a measurement will be in the validation region if
- g is the threshold that insures that the measurement falls in the validation region with a probability of P G .
- the threshold g is referred to as the number of sigmas or standard deviations for the gate, and g is determined from a ⁇ M 2 table.
- FIG. 2 shows an example of two elliptical validation regions for a system with two tracks and four measurements.
- T 1 and T 2 are the centers of validated regions 1 and 2 respectively and represent the predicted measurements for tracks 1 and 2 .
- Measurements M 1 and M 2 are valid measurements for track 1 while measurements M 2 and M 3 are valid measurements for track 2 .
- Measurement M 4 is not a valid measurement for either track. In both cases there is more than one measurement valid for each track and a procedure is needed to determine which measurements will be used to update the track state.
- a coarse gating procedure of testing individual components of the residual vector may be used using rectangular gates. That is, a measurement z(k) falls inside the coarse gate region provided that
- k ⁇ 1) are the i th components of z(k) and ⁇ circumflex over (z) ⁇ (k
- S ii (k) is the i th variance in the residual covariance matrix.
- the rectangular gating eliminates unlikely measurements-to-track pairing and the ellipsoidal gating is used for the measurements that fall in the rectangular gates.
- the data association filter that is used for V2.1 is the nearest-neighbor joint probabilistic data association filter (NNJPDAF).
- NNJPDAF nearest-neighbor joint probabilistic data association filter
- JPDAF complex joint probabilistic data association filter
- the PDAF is a Bayesian approach that computes the probability that each measurement in a track's validation region is the correct measurement and the probability that none of the validated measurements is the correct measurement.
- the non-parametric version of the filter will be used since it does not require prior knowledge of the special density of the clutter.
- V is the hypervolume of the validated region at t k
- P D is the detection probability (assumed known)
- P G is the probability of the target originated measurement falling inside the validated region (usually set to at least 0.95).
- the term b accounts for the possibility that none of the validated measurements is target originated and that the target-originated measurement was not detected, or fell outside of the validated region.
- the state in the PDAF is updated using all of the measurements and the combined residual v(k) as follows:
- v j (k) is the residual for the j th validated measurement
- the JPDAF is used.
- First all feasible joint association events ⁇ in the current scan are determined.
- a feasible event is a set of non-conflicting validated measurement-to-track pairings in which a measurement can originate from only one source, and at most one measurement can originate from a target. Any number of measurements can originate from clutter.
- Table 1 lists the eight feasible joint association events ⁇ for FIG. 2 .
- the ⁇ tj 's are the single events making up a joint event ⁇ .
- the quantity ⁇ is the number of measurements originating from clutter in ⁇ .
- V is the volume of the surveillance region.
- the normalized constant c is the sum of the eight ⁇ 's in Table 1 and is given by
- Z i k ⁇ are computed by dividing the ⁇ 's in Table 1 by c.
- the marginal association probabilities, ⁇ tj 's are then computed using equation (41). As an example, the marginal association probabilities for T 1 are
- the marginal association probabilities for target T 2 can be found in a similar manner.
- ⁇ tj ⁇ tj T t + M j - ⁇ tj + B ( 49 )
- T 1 is the sum of all likelihoods for target t, which is given by
- the quantity B is a bias to account for clutter and for non-unity probability of detection. Also
- partial joint events were introduced by Roecker and Phillis to develop the suboptimal JPDA.
- a partial joint event considers at most two track-to-measurement pairings. That is, a partial joint event consists of(at most) two single events. Also, it assumes the probability of detection for each track is near unity so that all of the targets are detected and all of the joint events have the same number of measurements assigned to clutter. The computational requirement is more than the cheap JPDA, but less than the optimal JPDA.
- the association probabilities in the suboptimal JPDA are computed using the following steps:
- ⁇ tj D tj B + ⁇ I ⁇ A t ⁇ D tl , ( 59 )
- B is a bias to account for clutter density
- N sj max k ⁇ A s , k ⁇ j ⁇ ⁇ ⁇ sk ⁇ . ( 61 )
- T 1 , M 1 , etc, are denoted by 1.
- the association probabilities for T 1 are computed below.
- a similar procedure can be used to compute the probabilities for T 2 .
- the N sj 's needed in these computations are obtained using (61).
- Equation (60) is then used to compute the D tj 's:
- ⁇ 13 ⁇ D 13 B + ⁇ l ⁇ A 1 ⁇ t ⁇ D 1 ⁇ l
- the nearest-neighbor JPDAF is used instead of the optimal JPDAF. Instead of using equations (32) to (37) to compute the state estimate and covariance matrix, the NNJPDAF looks for the maximum value of ⁇ tj for each measurement-track pair. The corresponding measurement is then used to update the corresponding track. If the maximum ⁇ tj corresponds to track 0 , which is clutter, no track is updated. When a track is updated by a measurement, both the track and measurement are no longer used. The procedure is repeated until all associations have been made.
- the above techniques are valid for measurements that are in sequence. Different techniques can be used to handle the OOSM. One is to hold the sensor measurements in a buffer and when the OOSM arrives then process it and the stored measurements in the proper sequence. The problem with this technique is that the current track data can get old and is not properly updated until the OOSM arrives. Another technique is to run the filter as if there are no OOSMs which will keep the track data current and then if an OOSM arrives, go back to the OOSM's time and reprocess the filter tracks from this time forward using the OOSM and any measurements after the OOSM. The problem with this technique is that a lot of data must be stored so that the filter can be restarted from the OOSM time and it takes a lot of process time.
- the technique used in this filter is to run the filter normally with all current data measurements and store only the track covariance matrices at each measurement time. Then when an OOSM arrives, propagate the track state and covariance back in time to the OOSM time, verify its association to a track and then perform the update with the OOSM. Next propagate this updated track state and covariance matrix to the current time.
- the retrodiction of the state x i of model i to ⁇ from k is
- k) is the backward transition matrix of mode i to ⁇ from k.
- the covariances associated with the state retrodiction are calculated as follows.
- the covariance of the cumulative effect of the process noise to k from ⁇ in mode i is
- Equation (77) is the key to reducing the i-step lag OOSM problem to the 1-step lag problem while keeping the solution nearly optimal.
- S* i (k) is the covariance of the “equivalent measurement” at k that summarizes, for model i, all the measurements from k ⁇ l+1 to k. To compute this it is necessary to have stored past state covariances P i (k ⁇ l
- k ⁇ 1) P i ( k
- k ⁇ l ) F i ( k
- k ) F i ( ⁇
- k) for filter model i of the IMM estimator is calculated based on (73) for each of the r filter models.
- the retrodicted OOSM for model i is
- the likelihood function of each mode at time ⁇ is evaluated based on the OOSM and the corresponding retrodiction from the current time.
- the likelihood function of mode i based on the OOSM from time ⁇ is
- ⁇ i ( ⁇ )
- the IMM estimator To perform the data association for an OOSM, it is required to have the IMM estimator's overall likelihood function at time ⁇ .
- the mode-conditioned likelihood functions (82) are used, which rely on the mode-conditioned retrodicted measurement and its covariance, and the retrodicted mode probabilities from the current time k to ⁇ .
- the mode probabilities at time k (before the OOSM) are given by the vector
- k ) ⁇ ( k
- Z k ) [ ⁇ l ( k
- Z k is the cumulative data at k (not including the OOSM z( ⁇ ))
- ⁇ ij (k 2 , k 1 ) be the Markov chain transition probability matrix between the modes to time t k 2 from time t k 1 .
- the elements of this transition matrix are
- the transition probability matrix to time t k 2 from time t k 1 is
- ⁇ ⁇ ( k 2 , k 1 ) 1 ⁇ 1 + ⁇ 2 ⁇ [ ⁇ 2 + ⁇ 1 ⁇ ⁇ - ( ⁇ 1 + ⁇ 2 ) ⁇ T ⁇ 1 - ⁇ 1 ⁇ ⁇ - ( ⁇ 1 + ⁇ 2 ) ⁇ T ⁇ 2 - ⁇ 2 ⁇ ⁇ - ( ⁇ 1 + ⁇ 2 ) ⁇ T ⁇ 1 + ⁇ 2 ⁇ ⁇ - ( ⁇ 1 + ⁇ 2 ) ⁇ T ] ( 88 )
- the IMM estimator's overall likelihood function for the OOSM is
- the filter gain used for the update is
- a procedure is needed to determine when to initiate a new track and when to drop a track that is no longer being detected by the sensors. Under normal operations, measurements from the sensors are assigned to tracks and are used to update the tracks. If a new measurement is reported by a sensor and it is not associated to an existing track, it may be used to start a new tentative track.
- a sensor To become a tentative track a sensor must report the same measurement for X number of consecutive scans. The value of X will be determined from real time tests, but initially it is set to 2. If during the next sensor scan the sensor again reports the measurement for the tentative track, the tentative track now becomes a firm track and can be updated by any sensor measurement. If during the next sensor scan the sensor does not report a measurement that corresponds to the tentative track, the tentative track is dropped.
- a new firm track is given the lowest integer that has not already been assigned to a firm track. For example, if there are three firm tracks present that have been assigned numbers 1, 2, and 3 then the next firm track will be assigned number 4. If there are three tracks present and they are assigned numbers 1, 4, and 7 then the next firm track will be assigned number 2.
- Track Management process Another function of the Track Management process is to determine if an existing track should be dropped.
- the Track Management process keeps track of which sensor updates the firm tracks. If all sensors do not update a firm track for at least Y scans, then the firm track is dropped. The value of Y will be determined from real time tests, but initially it is set to 2 for optical sensors and 3 for ranging sensors. As long as one sensor is updating a firm track it will not be dropped.
- the sensors usually report their target measurements in a polar reference frame, range and azimuth or bearing.
- the tracking estimator usually computes its Firm Target File in a Cartesian reference frame because it is easier to understand and visualize. Therefore, the sensor data must be converted to the Cartesian reference frame before it is used by the tracking filter.
- x dc and y dc are the final downrange and cross range debiased conversion coordinates of the sensor target and
- the covariance matrix, R a for the downrange and cross range coordinates are
- R a 11 var( ⁇ tilde over (x) ⁇
- r m , ⁇ m ) r m 2 e ⁇ 2 ⁇ ⁇ 2 [cos 2 ⁇ m (cos h 2 ⁇ ⁇ 2 ⁇ cos h ⁇ ⁇ 2 )+sin 2 ⁇ m (sin h 2 ⁇ ⁇ 2 ⁇ sin h ⁇ ⁇ 2 )]+ ⁇ r 2 e ⁇ 2 ⁇ ⁇ 2 [cos 2 ⁇ m (2 cos h 2 ⁇ ⁇ 2 ⁇ cos h ⁇ ⁇ 2 )+sin 2 ⁇ m (2 sin h 2 ⁇ ⁇ 2 ⁇ sin ⁇ ⁇ 2 )], (106)
- R a 22 var( ⁇ tilde over (y) ⁇
- r m , ⁇ m ) r m 2 e ⁇ 2 ⁇ ⁇ 2 [sin 2 ⁇ m (cos h 2 ⁇ ⁇ 2 ⁇ cos h ⁇ ⁇ 2 )+sin 2 ⁇ m (sin h 2 ⁇ ⁇ 2 ⁇ sin h ⁇ ⁇ 2 )]+ ⁇ r 2 e ⁇ 2 ⁇ ⁇ 2 [sin 2 ⁇ m (2 cos h 2 ⁇ ⁇ 2 ⁇ cos h ⁇ ⁇ 2 )+sin 2 ⁇ m (2 sin h 2 ⁇ ⁇ 2 ⁇ sin ⁇ ⁇ 2 )], (107)
- R a 12 cov ( ⁇ tilde over (x) ⁇ , ⁇ tilde over (y) ⁇ ,
- r m , ⁇ m ) sin ⁇ m cos ⁇ m e ⁇ 4 ⁇ ⁇ 2 [ ⁇ r 2 +( r m 2 + ⁇ r 2 )(1 ⁇ e ⁇ ⁇ 2 )], (108)
- ⁇ r 2 and ⁇ ⁇ 2 are the variances of the range and bearing, respectively, in the sensor polar reference frame.
- the down range measurement, xm, and the cross range measurement, ym are as follows:
- FIG. 16 Assume you have two sensors that take different time intervals to process the raw data.
- the slide sensor 1 could be a radar sensor that process the raw data faster and, therefore, has a faster output rate.
- Sensor 2 could be an optical sensor that takes longer to process the raw data.
- Both sensors get the raw data at time t 1 .
- Sensor 1 takes the time from t 1 to t 2 to process its data and then sends it to the filter. Since the process time is known, a time tag can then be applied to the data which was received at t 2 with the time t 1 which is more accurately the time of the data. For the data received from sensor 1 at t 3 , the time tag of t 2 is given. This is a way to compensate for the sensor latency. Now look at sensor 2 which takes a longer time to process its data than sensor 1 . When the data packet arrives at time t 2 it is actually given the time stamp of t 1 since that more accurately reflects the time of the data.
- FIG. 17 JPDA is a technique to deal with the problem of taking measurement data and either associating it with an existing track, rejecting it because it may be clutter, or possibly starting a new track.
- a validation region is generated for each track about the predicted measurement point and all measurements that fall in these regions are considered.
- the probabilities for all possible combinations of valid measurements to tracks are computed and the highest probabilities are used to match up the measurements and tracks.
- this approach is used, which is the nearest-neighbor JPDA filter instead of the true optimal JPDA filter which requires more computations.
- FIG. 18 Instead of one Kalman Filter to estimate the position, velocity and acceleration of the targets, three filters are proposed, a constant velocity filter, down range acceleration filter, and a cross range acceleration filter. All three filters run at the same time and their outputs are weighted based on what the IMM thinks is the best filter for the trajectory. This allows the constant velocity filter to estimate the target trajectory when the target is not accelerating, the down range acceleration filter to estimate the trajectory when the target is accelerating straight ahead, and the cross range filter to estimate the trajectory when the target is in a turn. Since the best filter is operating during its part of the trajectory, the estimate errors are smaller. Also if the target is accelerating straight ahead and turning, then both the down range and cross range filters may be equally heavily weighted.
- FIG. 19 The IMM filters starts off with all three filters (constant velocity, down range acceleration, and cross range acceleration) weighted equally. The IMM switching soon determines that the target is moving at a constant velocity and weights this filter much heavier than the two acceleration filters.
- FIG. 20 In this trajectory both vehicles perform a 90 degree constant rate turn to the right. However, the target vehicle is about 25 meters ahead of the host vehicle and one lane to the left so it starts the turn earlier. The start on the plots indicates the starting position.
- FIG. 21 show the relative position, velocity and acceleration of the target vehicle to the host vehicle. Note the acceleration curve which shows the lateral acceleration due to the turning of the vehicles. The spikes occur due to one vehicle turning while the other is not.
- FIG. 22 This shows that again initially the three filters start off equally, but when one vehicle turns and the other does not, the filter that looks for cross range acceleration filter is weighted much heavier during the acceleration spike, but decreases gradually after the spike.
- FIG. 23 Typical radar values expected
- FIG. 24 Typical maneuver scenario
- FIG. 25 This shows the relative position of the target vehicle with respect to the host vehicle.
- the relative velocity is ⁇ 50 m/sec in the X axis and 0 in the Y axis.
- FIG. 26 This shows the relative position and velocity charts for the X (down range) and Y (cross range) axes.
- FIG. 27 Using the long range and medium range sensor characteristic data shown in slide 12 raw sensor data is generated.
- the upper left plot shows the error in the generated down range position for the long range radar and the upper right plots shows the error for the medium range radar.
- the magenta and yellow lines show the 1-sigma standard deviation values for the noisy data.
- the maximum range and horizontal FOV determines the start and stop times of the plots.
- the bottom plots show the improvement in the position data using the sensor fusion filter.
- the bottom left plot shows the result of the fusion filter using only position updates.
- the bottom tight plot uses position and velocity, range-rate, updates.
- the magenta lines are the true errors since the true track is known.
- the blue and yellow lines give the filter 1-sigma standard deviation values of the filter error.
- the decrease in these uncertainty curves for the no velocity update plot is a result of the medium range radar coming into play at about 4.6 seconds. The small bump up after this drop is due to the long range radar dropping out due to FOV. If range-rate updates are available, then the medium range radar does not improve the performance much as shown in the bottom right plot.
- FIG. 28 These plots show the filter down range velocity and acceleration error plots when not using velocity updates and when using velocity updates. Again it shows that the filter is not optimally tuned and with tuning the performance should improve slightly.
- FIG. 29 This shows the same data as slide 17 except this is for the cross range position instead of the down range position.
- the decrease in the uncertainty curves is a result of the fact that the cross range errors is equal to the range times the angle uncertainty. As the target approaches the host, the range decreases, and therefore, the cross range error decreases.
- FIG. 30 This shows the same as slide 18 except for the cross range values instead of the down range values.
- the bump up in the bottom right plot is because the inventors did not have the initial covariance values large enough for the acceleration.
- the systems described above can use dedicated processor systems, micro controllers, programmable logic devices, or microprocessors that perform some or all of the operations. Some of the operations described above may be implemented in software and other operations may be implemented in hardware.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Geophysics (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Aviation & Aerospace Engineering (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Optimization (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Automation & Control Theory (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Manufacturing & Machinery (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- The present application is a continuation application of U.S. patent application Ser. No. 12/776,137, filed May 7, 2010 that claims priority to U.S. Provisional Patent Application Ser. No. 61/176,681, filed May 8, 2009 and to Provisional Patent Application Ser. No. 61/177,015, filed May 11, 2009 which are all incorporated by reference in their entirety.
- This application further incorporates by reference U.S. patents:
- U.S. Pat. No. 6,629,033 Issued Sep. 30, 2003 Titled—OPEN COMMUNICATION SYSTEM FOR REAL-TIME MULTIPROCESSOR APPLICATIONS;
- U.S. Pat. No. 6,771,208 Issued Aug. 3, 2004 Titled—MULTI SENSOR SYSTEM;
- U.S. Pat. No. 7,146,260 Issued Dec. 5, 2006 Titled—METHOD AND APPARATUS FOR DYNAMIC CONFIGURATION OF MULTIPROCESSOR SYSTEM;
- U.S. Pat. No. 6,792,351 Issued Sep. 14, 2004 Titled—METHOD AND APPARATUS FOR MULTI-VEHICLE COMMUNICATION;
- U.S. Pat. No. 6,778,073 Issued Aug. 17, 2004 Titled—METHOD AND APPARATUS FOR MANAGING AUDIO DEVICES;
- U.S. Pat. No. 6,615,137 Issued Sep. 2, 2003 Titled—METHOD AND APPARATUS FOR TRANSFERRING INFORMATION BETWEEN VEHICLES;
- U.S. Pat. No. 7,178,049 Issued Feb. 13, 2007 Titled—METHOD FOR MULTI-TASKING MULTIPLE JAVA VIRTUAL MACHINES;
- U.S. Pat. No. 7,337,650 Issued Mar. 4, 2008 Titled—SYSTEM AND METHOD FOR ALIGNING SENSORS ON A VEHICLE.
- Contained herein is material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the United States Patent and Trademark Office patent file or records, but otherwise reserves all rights to the copyright whatsoever. The following notice applies to the software, screenshots and data as described below and in the drawings hereto and All Rights Reserved.
- This invention relates generally to statistical modeling and analysis of automotive safety systems, sensors and application requirements for both performance and cost tradeoffs. This invention relates specifically to the process of designing, building, testing and analyzing system data in a hierarchy of statistical models, driven by the need to implement advanced safety features for the transportation industry.
- Next generation automotive systems will include numerous electronic systems such as; passive safety systems for airbag deployment and anti-skid braking features; active safety for collision warning and collision avoidance features; and convenience features for Blind Spot Detection (BSD) and Adaptive Cruise Control (ACC). Today the transportation industry is rapidly moving toward solutions that support and enable these systems and new features with the ultimate goal of profitably and developing a more survivable vehicle at costs their customers are willing to pay.
- These new systems will require information about the environment, targets in the environment and our relationship to them. This information will be generated from multiple sources to include data from a new class of sensor, termed non-contact sensor, and include non-contact sensors like radar, optical, laser, ultrasonic, etc. These non-contact sensors will generate data about the environment including range measurements and target classification. These systems are similar to those found on advanced tactical fighter aircraft today.
- The process of manufacturing a vehicle is not much different today then is was 50 years ago; features are specified for a desired model and year; parts designed; competitively purchased; assembled; and shipped as a complete vehicle. If another feature is desired, it is integrated into the design and bolted on as a complete feature; this approach is referred to as “federated” systems. A key tenant to low cost systems in the future will be a deliberate movement away from federated features and systems, to fully integrated systems design and integrated systems.
- Now with a focus on active safety systems, the sensors required to support the features identified above are to some extent common; an optical sensor that supports one optical application could be used for a second optical application; two sensors could be used for one application. In either case, simply sharing data from sensors or other sources to improve knowledge of the environment is incorrectly termed “sensor-fusion” or “multi sensor-fusion” by the transportation industry suppliers.
- Those skilled in the art of state estimation, robotics, advanced defense avionics understand academically that sensor-fusion is the art of combining sensory data or data derived from disparate sources such that the resulting information is in some sense “better” than would be possible when these sources were used individually. This process is predicated on the covariance (or the measure of how much two variables vary together) of non-independent sources. The term “better” in the case above can mean more accurate, more complete, more dependable, or refer to the result of an emerging view or state estimation.
- The data sources for a fusion process are not specified to originate from identical sources or sensors which may or may not be spatially and temporally aligned. Further one can distinguish direct fusion, indirect fusion and fusion of the outputs of the former two. Direct fusion is the fusion of sensor data from a set of heterogeneous or homogeneous sensors, soft sensors, and history values of sensor data, while indirect fusion uses information sources like a prior knowledge about the environment and human input. Sensor fusion is also known as “multi-sensor data fusion” and is a subset of information fusion through an implementation of the probability theory.
- Probability theory is the mathematical study of phenomena characterized by randomness or uncertainty. More precisely, probability is used for modeling situations when the result of a measurement, realized under the same circumstances, produces different results.
- Mathematicians and actuaries think of probabilities as numbers in the closed interval from 0 to 1 assigned to “events” whose occurrence or failure to occur is random. Two crucial concepts in the theory of probability are those of a random variable and of the probability distribution of a random variable.
- Implementing the features described above with affordable instruments requires reliable real-time estimates of system state. Unfortunately, the complete state is not always observable. State Estimation takes all the data obtained and uses it to determine the underlying behavior of the system at any point in time. It includes fault detection, isolation and continuous system state estimation.
- There are two parts to state estimation: modeling and algorithms. The overall approach is to use a model to predict the behavior of the system in a particular state, and then compare that behavior with the actual measurements from the instruments to determine which state or states is the most likely to produce the observed system behavior.
- This is not well understood or currently implemented in the transportation industry; the approach understood and practiced is logical decisions in linear and deterministic systems. If use cases require higher confidences in measurements, instrument specifications are tightened resulting in the undesired effect of cost and schedule increases. The environment we live and operate in is neither linear nor deterministic; use cases are infinite; and the perverse variability of the targets and potential maneuvers cannot be modeled. The variability of the problem identified above includes aspects other than just spatial (i.e. range and bearing to a target); temporal relationships are part of the fundamental intellectual structure (together with space and number) within which events must be sequenced, quantify the duration of events, quantify the intervals between them, and compare the kinematics of objects.
- The automotive industry today implements features in such a way that all aspects are contained within the system (federated) and therefore reasonably controlled. Sharing information like target reports with other features is anticipated and desired; however measurements reported with respect to the integrated system will be historical in nature and received asynchronously. Timing errors can induce more error in the system than a bad measurement. These and other issues can be addressed with the introduction of a suite of modeling tools based on re-thinking the approach of federated systems and focusing on an integrated systems solution based on state estimation.
- Central to the successful implementation of the advanced safety systems discussed above is ensuring ability for the system to cope with and recover from emergency situations. If one or more emergency conditions arise, systems of the future must quickly initiate and successfully execute procedures to mitigate the condition and then recover; these procedures must be performed under tight timing constraints, e.g., pre-crash systems.
- This patent describes a system and methods necessary to implement a design methodology that will facilitate and support advanced safety systems design, test, verification, and validation; with emphasis on reliable fault tolerant operation. The implementation of this system and methods is termed “Algorithm Prototyping Analysis and Test” or APAT.
- As it stands today, there is much art published documenting the research and development in the area of procedure analysis and design. However, there are no systematic and rigorous methodologies for designing procedures to be used in advanced safety systems for the transportation industry. This is currently viewed as a serious shortcoming, since these high-risk and complex systems employ procedures and action sequences that can and do impact life or death results.
- In the future it will be the responsibility of the onboard computers to automatically initiate and execute procedures and recovery sequences. Therefore modeling, analysis, verification, and design of these highly critical methods, procedures and recovery sequences are required and are thus the focus of this patent.
- In a discussion of Prior Art, U.S. Pat. No. 7,006,950, Statistical Modeling and Performance Characterization of a Real-time Dual Camera Surveillance System, Greiffenhagen, et al.; the invention relates to a method for visually detecting and tracking an object through a space. The method derives statistical models for errors, including quantifying an indexing step performed by an indexing module, and tuning system parameters. Further the method applies a likelihood model for candidate hypothesis evaluation and object parameters estimation for locating the object. This invention relates specifically to computer vision systems, more particularly to a system having computationally efficient real-time object detection, tracking, and zooming capabilities. The need arises for methods of modeling more than 1 data source against features that require an infinitely variable combination of instruments and measurements.
- In a discussion of Prior Art, U.S. Pat. No. 6,028,548, Vehicle Collision Radar with Randomized FSK Waveform, Farmer; describes an automotive radar for improved immunity to jamming from other automotive radars utilizing common modeling methods such as Auto Regressive Modeling (ARMA) and Minimum Variance Spectral Estimation which are just two such methods that would be applicable. It is recognized in the art that modeling sequences implemented as tools or embedded systems will yield desired results. As with U.S. Pat. No. 7,006,950, the modeling sequences identified are based on the improvement of federated devices.
- In a discussion of Prior Art, U.S. Pat. No. 7,079,993, Automated Generator of Optimal Models for the Statistical Analysis of Data, Stephenson, et al; describes an automated process for producing accurate statistical models from sample data tables designed to solve for optimal parameters of each statistical model considered, computes test statistics and degrees of freedom in the model, and uses these test statistics and degrees of freedom to establish a complete ordering of the statistical models. Stephenson further describes how the process arrives at a statistical model that is highest in the ordering and is thus deemed most suitable to model the sample data table. These techniques are basically described in the general art of data or information fusion and modeling. It would not be obvious that general and well published statistical techniques should be applied to the art of automotive safety systems design.
- Therefore, a need exists for a system and method for modeling sensor system inputs in a synthetic environment against truth tables to achieve optimal performance and cost parameters for the design and implementation of advanced automotive safety systems.
- Although the best understanding of the present invention will be had from a through reading of the specification and claims presented below, this summary is provided in order to acquaint the reader with some of the new and useful features of the present invention. Of course, this summary is not intended to be a complete litany of all of the features of the present invention, nor is it intended in any way to limit the breadth of the claims, which are presented at the end of the detailed description of this application.
- In the preferred embodiment, a system and methods are disclosed for providing an Algorithm Prototyping, Analysis and Test (APAT) through an integrated framework for dynamic data modeling and application development. The system provides a data model that first extends the capabilities of the physical data model and then translates, gates, optimizes, fuses, filters and manages the physical representation of the logical model into a state estimation of the situation around the vehicle; this is known as Situation Awareness (SA); the implementation of this core is called SACore (Situation Awareness Core). And because the application framework is integrated with SACore, once the user configures the data model, the features and benefits of the application framework become automatically available to the developer as part of the decision process for cost-performance optimization.
- The data-modeling framework of APAT enables a user to define a data model or version of SACore by using a series of graphical user interfaces (GUI). APAT and SACore provide functionality that physical databases cannot provide by dynamically translating the asynchronous data generated into a corresponding state estimation. Users can utilize the GUI to modify the data model by adjusting expected error, rate or core operation, and the system output is automatically adjusted to accommodate the changes. The APAT system and methods shields both the application developer and the sensor supplier from the complexities, limitations and costs of single sensor systems.
- Therefore methods need to be developed to allow automotive system designers the ability to characterize numerous sensor types and sensor suppliers within a specific type as to the actual capability of the sensor in terms of measured variances in the reports. Second the methods need to allow the designers the freedom to place the sensor on the vehicle with other sensors of like type or different types; these may have coincident, mostly coincident, or non-coincident fields of view. Further these methods need to allow the designer the ability to specify tolerances of the dynamic system, such as target maneuver expectations. It would be desirable to the system designer if methods could be presented that allowed all system variables to be extracted into a single file allowing the designer the flexibility of changing any variable in a complex system of variables and structured filters without the tedious need of hand coding the changes. In an n-scalable system, wherein the number of sensors, and number of sensor reports are variable, the resulting identity matrix or unit matrix of size n is represented by the n-by-n square matrix, where n-by-n matrices are used to represent linear transformations from an n-dimensional vector space to itself. Defining and coding a 2-by 2 square matrix then changing the square matrix to a 3-by-3 or n-by-n is tedious and probably beyond the skill set of the automotive system designer, therefore methods are presented as the objects of the invention that allow rapid prototyping and auto-code generation for the development, modeling, implementation and testing of advanced automotive safety systems.
- It is an objective of the invention to describe methods for rapidly defining or redefining an automotive multi-sensor data fusion system comprising at least one of a vehicle, sensors, a system model of expected behaviors of targets with consideration for system variables, system error and measurement tolerances. The underlying system is based on an n-scalable, asynchronous, measurement oriented, measurement to track, variable structure, interacting multiple model estimation filter, utilizing a nearest neighbor joint probabilistic data association filter using optimal routines, with two dynamic switchable data association filters in place of the optimal JPDA using sub-optimal routines including one of cheap JPDA and sub-optimal JPDA; the system is implemented with consideration for out-of-sequence measurements, a track management system and a reporting system based on polar coordinates and a method for executing a debiased conversion, translation and rotation into a uniform Cartesian Coordinate system.
- Another object of the invention is to define the modeling framework including identifying the system variables by group, wherein the first group comprises sensor parameters and includes such parameters as the number of sensors in the system; the relationship of the sensor frames to the vehicle reference; the expected report limits; report outputs; 1-sigma covariance terms.
- Another object of the invention is to define the second group of modeling variables as the target maneuver accelerations that will be acceptable in measurement reports, wherein the modeling environment is at least two dimensional, and wherein at least three models are anticipated and they comprise near constant velocity, cross range acceleration, and down range acceleration, and the values are in terms of expected acceleration g's of maneuver and these accelerations are introduced into the filter structure as noise values.
- Another object of the invention is to describe a method for reducing processing complexity, when desired, by setting the number of filters implemented on any pairings of sensors, by identifying number of possibilities, with subsequent values set as noise for each option chosen.
- Another object of the invention is to describe the filter setup comprising at least one of housekeeping in nature; values set that define the function of the model values that set the starting uncertainty covariance terms expected from each sensor with respect to the dimensional states identified which further defined down range and cross range values for position, acceleration and velocity.
- Other features of the present invention will be apparent from the accompanying drawings and from the detailed description that follows.
- Aspects and applications of the invention presented here are described below in the drawings and detailed description of the invention. Unless specifically noted, it is intended that the words and phrases in the specification and the claims be given their plain, ordinary, and accustomed meaning to those of ordinary skill in the applicable arts. The inventors are fully aware that they can be their own lexicographers if desired. The inventors expressly elect, as their own lexicographers, to use only the plain and ordinary meaning of terms in the specification and claims unless they clearly state otherwise and then further, expressly set forth the “special” definition of that term and explain how it differs from the plain and ordinary meaning. Absent such clear statements of intent to apply a “special” definition, it is the inventors' intent and desire that the simple, plain and ordinary meaning to the terms be applied to the interpretation of the specification and claims.
- The inventors are also aware of the normal precepts of English grammar. Thus, if a noun, term, or phrase is intended to be further characterized, specified, or narrowed in some way, then such noun, term, or phrase will expressly include additional adjectives, descriptive terms, or other modifiers in accordance with the normal precepts of English grammar. Absent the use of such adjectives, descriptive terms, or modifiers, it is the intent that such nouns, terms, or phrases be given their plain, and ordinary English meaning to those skilled in the applicable arts as set forth above.
- Further, the inventors are fully informed of the standards and application of the special provisions of 35 U.S.C. §112, 6. Thus, the use of the words “function,” “means” or “step” in the Detailed Description or Description of the Drawings or claims is not intended to somehow indicate a desire to invoke the special provisions of 35 U.S.C. §112, 6, to define the invention. To the contrary, if the provisions of 35 U.S.C. §112, 6 are sought to be invoked to define the inventions, the claims will specifically and expressly state the exact phrases “means for” or “step for, and will also recite the word “function” (i.e., will state “means for performing the function of [insert function]”), without also reciting in such phrases any structure, material or act in support of the function. Thus, even when the claims recite a “means for performing the function of . . . ” or “step for performing the function of . . . ”, if the claims also recite any structure, material or acts in support of that means or step, or that perform the recited function, then it is the clear intention of the inventors not to invoke the provisions of 35 U.S.C. §112, 6. Moreover, even if the provisions of 35 U.S.C. §112, 6 are invoked to define the claimed inventions, it is intended that the inventions not be limited only to the specific structure, material or acts that are described in the preferred embodiments, but in addition, include any and all structures, materials or acts that perform the claimed function as described in alternative embodiments or forms of the invention, or that are well known present or later-developed, equivalent structures, material or acts for performing the claimed function.
- A more complete understanding of the present invention may be derived by referring to the detailed description when considered in connection with the following illustrative figures. In the figures, like-reference numbers refer to like-elements or acts throughout the figures.
-
FIG. 1 . Block diagram of the IMM for two APAT and SACore models -
FIG. 2 . Validation region for two tracks and five measurements -
FIG. 3 . Feasible joint association events forFIG. 2 -
FIG. 4 . APAT Overview -
FIG. 5 . APAT Model -
FIG. 6 . APAT Process -
FIG. 7 . APAT Process -
FIG. 8 . Radar/Vision—10 Hz/0 Hz CrossRange & Down Range Error -
FIG. 9 . Radar/Vision—10 Hz/3 Hz CrossRange & Down Range Error -
FIG. 10 . Radar/Vision—10 Hz/10 Hz CrossRange & Down Range Error -
FIG. 11 . Radar/Vision—10 Hz/25 Hz CrossRange & Down Range Error -
FIG. 12 . Performance Improvements Aggregated -
FIG. 13 . Performance Improvement -
FIG. 14 . Performance Optimization -
FIG. 15 .-FIG. 30 . Performance Predictions - In the following description, and for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the various aspects of the invention. It will be understood, however, by those skilled in the relevant arts, that the present invention may be practiced without these specific details. In other instances, known structures and devices are shown or discussed more generally in order to avoid obscuring the invention. In many cases, a description of the operation is sufficient to enable one to implement the various forms of the invention, particularly when the operation is to be implemented in software. It should be noted that there are many different and alternative configurations, devices and technologies to which the disclosed inventions may be applied. The full scope of the inventions is not limited to the examples that are described below.
- In one application of the invention, a system and methods are presented to model fully integrated systems in an Algorithm Prototyping and Analysis and Test tool, hereafter referred to as APAT
FIGS. 4-7 . APAT models include both the deterministic variety, where the output is a point estimate, and the stochastic type; where some measure of uncertainty characterizes the model outputs whose behavior is non-deterministic in that a state does not fully determine its next state. - With respect now to
FIG. 7 . APAT Process, this figure describes the system level implementation APAT. APAT is divided into four main parts; -
- User Interface (UI) and test setup (10-40; 100, 130, 150, 170);
- Target Generation (TG);
- synthetic truth scenarios (60) for the controlled generation of true target trajectories (80); resulting in controlled synthetic sensor reports (110) with no error
- ground truth scenarios (70) for the controlled generation of ground truth target trajectories (90); resulting in controlled ground truth reports with known error
- Situation Awareness Core (SACore) (180) data aggregation engine (DA)
- Performance Analysis (PA) (200) and Monte Carlo Analysis (50)
- Variables that can be set as fusion global parameters as referenced in the text below as <n>:
-
- <1-25> Set sensor parameters
FIG. 7 (100) - <26-40> Set filter noise values for target maneuver
FIG. 7 (130) - <41-94> Set filter operational parameters
FIG. 7 (170)
- <1-25> Set sensor parameters
-
Begin Variables That Can Be Set... <SetFusionGlobals> 1. num_sensors = 3; 2. sensor_zaxis = zeros(1,num_sensors); % Z position of sensor(meters) with respect to center of vehicle 3. sensor_xaxis = zeros(1,num_sensors);% X position of sensor(meters) with respect to center of vehicle 4. sensor_xaxis = [0, 0, 0]; 5. sensor_yaxis = zeros(1,num_sensors); % Y position of sensor(meters) with respect to center of vehicle 6. sensor_yaxis = [0, 0, 0]; 7. sensor_boresight = zeros(1,num_sensors); % Angle of sensor centerline (°) with respect to vehicle X axis 8. sensor_boresight = [0, 0, 0]; 9. sensor_boresight_corr = zeros(1,num_sensors);% Boresight correction wrt sensor centerline(degrees) 10. range_max(1) = 150; 11. range_max(2) = 150; 12. range_max(3) = 150; 13. angle_max(1) = 20; 14. angle_max(2) = 40; 15. angle_max(3) = 20; 16. total_sensor_tracks(1) = 5;FROM SENSOR 17. total_sensor_tracks(2) = 5; 18. total_sensor_tracks(3) = 5; 19. angle_sigma_sensor_deg(1) = 2.0;COVARIANCE TERMS 20. angle_sigma_sensor_deg(2) = .25; 21. angle_sigma_sensor_deg(3) = 2.0; 22. r_sigma_sensor11 = .005;% range error as a percent of the range for relevant target 23. r_sigma_sensor(1) = .01;% range error as a percent of the range 24. r_sigma_sensor(2) = .10;% range error as a percent of the range 25. r_sigma_sensor(3) = .01;% range error as a percent of the range 26. if filters == 1 27. q(1,1) = .5; 28. q(2,1) = .5; 29. elseif filters == 2 30. q(1,1) = .01; 31. q(1,2) = .5; 32. q(2,1) = .01; 33. q(2,2) = .5; 34. elseif filters == 3 35. q(1,1) = .01; 36. q(1,2) = .5; 37. q(1,3) = .01; 38. q(2,1) = .01; 39. q(2,2) = .01; 40. q(2,3) = .5; 41. deg2rad = pi/180; 42. rad2deg = 180/pi; 43. pass_criteria = 12; 44. filters = 3 45. sensor_measurements = 2;2 dim pos 46. rejectmax(1) = 3; 47. rejectmax(2) = 2; 48. rejectmax(3) = 3; 49. newtrack(1) = 2; 50. newtrack(2) = 2; 51. newtrack(3) = 2; 52. states = 6;2 DIM OUTPUT, POS/VEL/ACCEL 53. sensor_track_length = 14; 54. sensor_raw_number = 15; 55. tent_track_length = 8; 56. firm_tracks = 0; 57. for i = 1:num_sensors 58. firm_tracks = firm_tracks + total_sensor_tracks(i); 59. posx_sigma_init_sensor(1) = 2.0;STARTING UNCERTAINTY INITIALIZING COVARIANCE TERM 60. posy_sigma_init_sensor(1) = 5.0; 61. Rx(1) = posx_sigma_init_sensor(1) * posx_sigma_init_sensor(1); 62. Ry(1) = posy_sigma_init_sensor(1) * posy_sigma_init_sensor(1); 63. velx_sigma_init_sensor(1) = 4.0; 64. vely_sigma_init_sensor(1) = 4.0; 65. Rvx(1) = velx_sigma_init_sensor(1) * velx_sigma_init_sensor(1); 66. Rvy(1) = vely_sigma_init_sensor(1) * vely_sigma_init_sensor(1); 67. accx_sigma_init_sensor(1) = 1.0; 68. accy_sigma_init_sensor(1) = 1.0; 69. Rax(1) = accx_sigma_init_sensor(1) * accx_sigma_init_sensor(1); 70. Ray(1) = accy_sigma_init_sensor(1) * accy_sigma_init_sensor(1); 71. posx_sigma_init_sensor(2) = 5.0; 72. posy_sigma_init_sensor(2) = 1.5; 73. Rx(2) = posx_sigma_init_sensor(2) * posx_sigma_init_sensor(2); 74. Ry(2) = posy_sigma_init_sensor(2) * posy_sigma_init_sensor(2); 75. velx_sigma_init_sensor(2) = 2.0; 76. vely_sigma_init_sensor(2) = 2.0; 77. Rvx(2) = velx_sigma_init_sensor(2) * velx_sigma_init_sensor(2); 78. Rvy(2) = vely_sigma_init_sensor(2) * vely_sigma_init_sensor(2); 79. accx_sigma_init_sensor(2) = 1.0; 80. accy_sigma_init_sensor(2) = 1.0; 81. Rax(2) = accx_sigma_init_sensor(2) * accx_sigma_init_sensor(2); 82. Ray(2) = accy_sigma_init_sensor(2) * accy_sigma_init_sensor(2); 83. posx_sigma_init_sensor(3) = 2.0; 84. posy_sigma_init_sensor(3) = 5.0; 85. Rx(3) = posx_sigma_init_sensor(3) * posx_sigma_init_sensor(3); 86. Ry(3) = posy_sigma_init_sensor(3) * posy_sigma_init_sensor(3); 87. velx_sigma_init_sensor(3) = 4.0; 88. vely_sigma_init_sensor(3) = 4.0; 89. Rvx(3) = velx_sigma_init_sensor(3) * velx_sigma_init_sensor(3); 90. Rvy(3) = vely_sigma_init_sensor(3) * vely_sigma_init_sensor(3); 91. accx_sigma_init_sensor(3) = 1.0; 92. accy_sigma_init_sensor(3) = 1.0; 93. Rax(3) = accx_sigma_init_sensor(3) * accx_sigma_init_sensor(3); 94. Ray(3) = accy_sigma_init_sensor(3) * accy_sigma_init_sensor(3); .....End of variables that can be set - Now with respect to the variables; sensor parameters above are those values (variables) that represent the desired sensor system to be modeled. They include such parameters as the number of sensors in the system <1>; the relationship of the sensor frames to the vehicle reference plane <2-9> for the subsequent translation and rotation of axes; the expected report limits in terms of down range (meters) and cross range (degrees) <10-15>; report outputs from the sensor interface in terms of the number of tracks expected to be report for each sensor <16-18>; 1-sigma (mean of tested actual population with 1 standard deviation) covariance terms for cross range and down range error and linear error expectations <19-25>. The sensor values set in <1-25> can be adjusted during the modeling process for performance optimization and analysis of the output.
- As an example <19> sets the
sensor 1 covariance term of angular accuracy as ±2° tested and measure over the range of the sensor, the value can be opened to an expected error of ±3° and run again and compared to the first; the value can be closed to an expected error of ±10 and run again and compared to the other two; or the value can be opened to an expected error of ±3° ofsensor 1 and closed onsensor 2 <20> to an expected error of ±0.1° and run again and compared. This ability allows the user to choose and model hardware and sensor pairing scenarios against cost and capability at an integrated systems level, this will be discussed further below in the Performance Analysis section. - To those skilled in the art of targeting it is well known that it is impossible to model the absolute expected error of a maneuvering target, therefore an Interacting Multiple Model is implemented as discussed below. As modeling variables that can be set as inputs to the model run are the target maneuver accelerations willing to be accepted in measurement reports. A two dimensional environment is modeled, therefore anticipate three models, near constant velocity; cross range acceleration; and down range acceleration <26-40>. These q values are in terms of g's maneuver and are introduced into the IMM filter structure as noise values. Further, it is desired to not always model the most complex models, therefore the number of filters wished to be implemented can be set on any pairings of sensors, as an example <26, 29, 34> identify the three possibilities, with subsequent values set as noise for each option chosen. For the discussion below, the latter is selected to be described in detail as it represents the most complex case.
- Now with respect to the SetFusionGlobals above and the SACore filter setup; the filter setup is identified as items <41-94>; some items are housekeeping in nature <41,42>; items <43-58> are values set as a function of the model described below. Items <59-94 set the starting uncertainty covariance terms expected from each sensor with respect the 2 dimensional states identified in <52> 6 which defined down range and cross range values for position (2), acceleration (2) and velocity (2). As example, <59, 63, 67> set the expected error of the values of
sensor 1 in terms of down range/cross range (x/y) position, velocity and acceleration measurements, the cases are: -
- <59/60 >; <2 meters/5 meters>
- <63/64>; <4 meters/sec/4 meters/sec>
- <67/68>; <1 meter/sec2/1 meter/sec2>
Sensor (2) and sensor (3) are represented in <71-94> in the same manner.
- The APAT/SACore state estimation system is based on efficient recursive filter techniques which estimate the state of a dynamic system from a series of incomplete and noisy measurements. As time progresses, a measurement is made and reported. This measurement must be within the expectation of the next measurement. Therefore, the Kalman filter is based on linear dynamical systems discretized in the time domain. They are modeled on a Markov chain built on linear operators perturbed by Gaussian noise. The state of the system is represented as a vector of real numbers. At each discrete time increment, a linear operator is applied to the state to generate the new state, with some noise mixed in, and optionally some information from the controls on the system if they are known. Then, another linear operator mixed with more noise generates the visible outputs from the hidden state. The Kalman filter may be regarded as analogous to the hidden Markov model, with the key difference that the hidden state variables are continuous (as opposed to being discrete in the hidden Markov model). Additionally, the hidden Markov model can represent an arbitrary distribution for the next value of the state variables, in contrast to the Gaussian noise model that is used for the Kalman filter. There is a strong duality between the equations of the Kalman Filter and those of the hidden Markov model. A review of this and other models is given in Roweis and Ghahramani (1999).
- In order to use the Kalman filter to estimate the internal state of a process given only a sequence of noisy observations, one must model the process in accordance with the framework of the Kalman filter.
- The scenario blocks (60, 70) represent the setup of controlled scenarios for either synthetic or controlled target measurements. These scenarios and trajectories represent absolute (80) or controlled (90) “truth” with respect to position, velocity and acceleration of the host vehicle and targets observed. Scenarios can include any kinematic scenario such as over taking targets, meeting targets, observing target behavior to include spawning and merging targets, etc. Each of the scenarios can further include conditions such as degraded environment, degraded sensor operation, clutter, skipped reports, or any host of non-linear or un-expected errors that can and do occur in the environment. The sensor output blocks
FIG. 7 (110) or (120) are fed into the DA through block (140). Additional discussion for blocks (160, 180, 190) are described in the section below. A second file representing target truth are sent to (200) for the analysis of performance. - The instrument measurements are passed to the tracking and data fusion algorithms, which will attempt to produce tracks for each of the targets. Each time a track is altered (update, rate aid, track deletion etc.) it sends a track message to the performance analysis routines, which are used to compile statistics on the performance of the tracking algorithms. This is achieved by comparing the track messages with the target's true position, speed etc.
- The SACore is the tracking and fusion filter for integrating multi-sensor data to improve the track file of target vehicles. The problem of accurate reporting of measurements on a target is made more difficult because of the presence of clutter and the fact that the target can maneuver with no prior information. The tracking and sensor data fusion filter consists of four main parts:
- Interacting Multiple Model (IMM) Estimation Filter:
- To estimate the target state, position, velocity and possibly acceleration, a Kalman Filter can be used. The problem is, to accurately estimate the state, the model in the filter must accurately match the maneuvering of the target. Since the movement of the target is not known ahead of time, an accurate model cannot be designed so errors in the state estimation will occur. Adding process noise to model the target maneuvers or using a maneuver detector to adapt the filter has been used in the art, but detection delays and large estimation errors during maneuvers are still a problem. It is generally accepted that the Interacting Multiple Model (IMM) estimator provides superior tracking performance compared to a single Kalman Filter.
- The IMM is based on using several models in parallel to estimate the maneuvering target's states. Each Kalman Filter, or another estimation filter, uses a different model for each maneuver, one models a constant velocity target, another models an acceleration in the longitudinal axis while another models an acceleration in the lateral axis. Switching between these models during each sample period is determined probabilistically. Unlike maneuver detection systems where only one filter model is used at a time, the IMM uses all filters. The overall state estimate output is a weighted combination of the estimates from the individual filters. The weighting is based on the likelihood that a filter model is the correct maneuvering target model.
- The IMM estimator is a state estimation algorithm that uses Markovian switching coefficients. A system with these coefficients is described by r models, M1, M2, . . . , Mr, and given probabilities of switching between these models. The event that model j (Mj) is in effect during the sampling period ending at time tk, (tk−1, tk] will be denoted by Mj(k). The dynamics and measurement for a linear system are given by
-
x(k)=Φj(k,k−1)x(k−1)+G j(k,k−1)w j(k−1), (1) -
and -
z(k)=H j(k)x(k)+νj(k), (2) - where x(k) is the system state at time tk, z(k) is the measurement vector at time tk, Φj(k,k−1) is the state-transition matrix from time tk−1 to time tk for Mj(k), Gj(k,k−1) is the noise input matrix, and Hj(k) is the observation matrix for Mj(k). The process noise vector wj(k−1) and the measurement noise vector vj(k) are mutually uncorrelated zero-mean white Gaussian processes with covariance matrices Qj(k−1) and Rj(k) respectively. The initial conditions for the system state under each model j are Gaussian random variables with mean
x j(0) and covariance Pj(0). These prior statistics are assumed known, as also is μj(0)=Pr{Mj(0)}, which is the initial probability of model j at t0. - The model switching is governed by a finite-state Markov chain according to the probability πij=Pr{Mj(k)|Mi(k−1)} of switching from Mi(k−1) to Mj(k). The model switching probabilities, πij, are assumed known and an example is
-
- A block diagram of the IMM estimator with only two models, for simplicity, is shown in
FIG. 1 . - The inputs to the IMM estimator are {circumflex over (x)}1(k−1|k−1), {circumflex over (x)}2(k−1|k−1), P1(k−1|k−1), P2(k−1|k−1), and μi|j(k−1|k−1), all from the sampling period ending at tk−1. Where {circumflex over (x)}1(k−1|k−1) is the state estimate from
filter 1 at time tk−1 using measurements from time tk−1 and P1(k−1|k−1) is the corresponding state covariance matrix. Each of the filters use a different mixture of {circumflex over (x)}1(k−1|k−1) and {circumflex over (x)}2(k−1|k−1) for their input, For r models, this mixing allows the model-conditioned estimates in the current cycle to be computed using r filters rather than r2 filters, which greatly decreases the computational burden. The inputs to the filters, {circumflex over (x)}02(k−1|k−1), {circumflex over (x)}02(k−1|k−1), and the corresponding covariance matrices are computed in the Interaction (Mixing) block. - For the filter matched to Mj(k), the inputs are
-
- where the conditional model probability is
-
- and the predicted model probability is
-
- Using the measurements, z(k), for the filter matched to Mj(k), the updates are computed using the familiar Kalman Filter equations
-
{circumflex over (x)} j(k|k−1)=Φj(k,k−1){circumflex over (x)} 0j(k|k−1), (8) -
P j(k|k−1)=Φj(k,k−1)P 0j(k|k−1)[Φj(k,k−1)]T +G j(k,k−1)Q j(k−1)[G j(k,k−1)]T, (9) -
v j(k)=z(k)−H j(k){circumflex over (x)} j(k|k−1), (10) -
S j(k)=H j(k)P j(k|k−1)[H j(k)]T +R j(k), (11) -
K j(k)=P j(k|k−1)[H j(k)]T [S j(k)]−1, (12) -
{circumflex over (x)} j(k|k)={circumflex over (x)} j(k|k−1)+K j(k)v j(k), (13) -
P j(k|k)=[I−K j(k)H j(k)]P j(k|k−1), (14) - where {circumflex over (x)}j(k|k−1) is the predicted state estimate under Mj(k), Pj(k|k−1) is the corresponding prediction covariance, vj(k) is the residual, Sj(k) is the residual covariance matrix, Kj(k) is the Kalman gain matrix, {circumflex over (x)}j(k|k) is the updated state estimate under Mj(k), and Pj(k|k) is the updated covariance matrix.
- The likelihood of the filter matched to Mj(k) is defined by Λj(k)=f[z(k)|Mj(k),Z1 k−1], where f[•|•] denotes a conditional density. Using the assumption of Gaussian statistics, the filter residual and the residual covariance, the likelihood is
-
- The probability for Mj(k) is
-
- where the normalization factor c is
-
- These computations are performed in the Model Probability Update block.
- Finally the combined state estimate {circumflex over (x)}(k|k) and the corresponding state error covariance for the IMM are given by
-
- The final state estimate, i(k|k), is the best estimate of the target state and P(k|k) is the error covariance matrix for this optimal state estimate.
- Nearest Neighbor Joint Probabilistic Data Association Filter:
- This section deals with the problem of taking a target measurement from a sensor and either associating it to an existing track, possibly rejecting the measurement because it is clutter, or sending it to the track management process to start a new track.
- The process is to first define a validation region for each track and to identify all sensor measurements that fall within that region. For the two-dimensional case the validation region for a track is constructed around the predicted measurement for the track. Using the previous track state, the predicted measurement is computed by propagating this state to the time of the next measurement. This predicted measurement is the center of the validation region. If the measurement falls within this validation region, then it is considered as a candidate for association to the track; otherwise, it is rejected.
- The predicted measurement {circumflex over (z)}(k|k−1) is
-
{circumflex over (z)}(k|k−1)=H(k){circumflex over (x)}(k|k−1), (20) -
where -
{circumflex over (x)}(k|k−1)=Φ(k,k−1){circumflex over (x)}(k−1|k−1). (21) - The residual, v(k), is the difference between the actual measurement, z(k), and the predicted measurement and is
-
v(k)=z(k)−{circumflex over (z)}(k|k−1)=z(k)−H(k){circumflex over (x)}(k|k−1). (22) - The residual covariance S(k) is
-
S(k)=H(k)P(k|k−1)H T(k)+R(k). (23) - The residual statistics are Gaussian with zero-mean and the M-dimensional residual density f(v(k)) is
-
- where the normalized (squared) distance d2 is defined as
-
d 2 =v T(k)S −1(k)v(k). (25) - The normalized distance d2 is a chi-square variant, χM 2, with M degrees of freedom.
- A measurement will be in the validation region if
-
[ρ−{circumflex over (z)}(k|k−1)]T S −1(k)[ρ−{circumflex over (z)}(k|k−1)]≦g 2, (26) - where g is the threshold that insures that the measurement falls in the validation region with a probability of PG. The threshold g is referred to as the number of sigmas or standard deviations for the gate, and g is determined from a χM 2 table.
-
FIG. 2 shows an example of two elliptical validation regions for a system with two tracks and four measurements. T1 and T2 are the centers of validatedregions tracks track 1 while measurements M2 and M3 are valid measurements fortrack 2. Measurement M4 is not a valid measurement for either track. In both cases there is more than one measurement valid for each track and a procedure is needed to determine which measurements will be used to update the track state. - To save computation time, a coarse gating procedure of testing individual components of the residual vector may be used using rectangular gates. That is, a measurement z(k) falls inside the coarse gate region provided that
-
|z i(k)−{circumflex over (z)} i(k|k−1)≦g√{square root over (S ii(k))}, (27) - for each i=1, . . . , M, where zi(k) and {circumflex over (z)}i(k|k−1) are the ith components of z(k) and {circumflex over (z)}(k|k−1), respectively, and Sii(k) is the ith variance in the residual covariance matrix. The rectangular gating eliminates unlikely measurements-to-track pairing and the ellipsoidal gating is used for the measurements that fall in the rectangular gates.
- The data association filter that is used for V2.1 is the nearest-neighbor joint probabilistic data association filter (NNJPDAF). To help explain what the NNJPDAF is, the probabilistic data association filter (PDAF) for the single target case will be discussed first. Next the more complex joint probabilistic data association filter (JPDAF), which is used for multiple targets, will be discussed, and then the nearest-neighbor JPDA.
- The PDAF is a Bayesian approach that computes the probability that each measurement in a track's validation region is the correct measurement and the probability that none of the validated measurements is the correct measurement. The non-parametric version of the filter will be used since it does not require prior knowledge of the special density of the clutter.
- For m measurements falling inside the validation region at time tk, the probability that the jth validated measurement zj(k) is target originated, denoted βj, is
-
- while the probability that none of the measurements is target originated, denoted by β0, is
-
- The term ej is given by
-
e j=exp{−½v j T(k)S −1 v j(k)}, (30) - where vj(k) is the residual for the jth validated measurement and S(k) is the residual covariance for the measurements. The term b is given by
-
- where V is the hypervolume of the validated region at tk, PD is the detection probability (assumed known), and PG is the probability of the target originated measurement falling inside the validated region (usually set to at least 0.95). The term b accounts for the possibility that none of the validated measurements is target originated and that the target-originated measurement was not detected, or fell outside of the validated region.
- The state in the PDAF is updated using all of the measurements and the combined residual v(k) as follows:
-
- and vj(k) is the residual for the jth validated measurement,
-
v j(k)=z j(k)−H(k){circumflex over (x)}(k|k−1). (34) - The updated covariance is given by
-
P(k|k)=β0 P(k|k−1)+[1−β0 ]P C(k)+{tilde over (P)}(k), (35) -
where -
P C(k)=P(k|k−1)−K(k)S(k)K T(k), (36) - and
-
- To extend to the multi-target case, the JPDAF is used. First all feasible joint association events θ in the current scan are determined. A feasible event is a set of non-conflicting validated measurement-to-track pairings in which a measurement can originate from only one source, and at most one measurement can originate from a target. Any number of measurements can originate from clutter. Table 1 lists the eight feasible joint association events θ for
FIG. 2 . The θtj's are the single events making up a joint event θ. θtj denotes a single event that measurement j (=1, . . . , m) originated from target t (t=1, . . . , N), where m is the total number of measurements in the current scan, N is the total number of targets, and t=0 indicates that the measurement is a clutter detection. In the above example m=3 and N=2. For example, the joint event θ=7 is made up of θ11 (T1 originates M1), θ02 (M2 originates from clutter), and θ23 (T2 originates from M3). The binary target detection indicator δt for target t (t=1, . . . , N) has a value of one if a measurement is assigned to target t in θ, and it is zero otherwise. The binary measurement association indicator τj for measurement j has a value of one if measurement j is assigned to a target t (t=1, . . . , N) in θ, and is zero otherwise. The quantity φ is the number of measurements originating from clutter in θ. - The joint association event probabilities are given by
-
- where the normalized constant c is
-
- where
-
- and V is the volume of the surveillance region.
- The marginal probability of target t (1=0, 1, . . . , N) originating the measurement j, denoted βij, is obtained by summing over all feasible joint events θ in which the single event θtj occurs, and is given by
-
- Once the marginal association probabilities βtj are computed, they are used in equations (32) to (37) to update the state for
target 1. - For the above example, the normalized constant c is the sum of the eight γ's in Table 1 and is given by
-
c=P D 2(Λ11Λ22+Λ11Λ23+Λ12Λ23)V+2!P D(1−P D)(Λ11+Λ12+Λ22+Λ23)/V 2+3!(1−P D)2/V 3 (42) - The eight joint association probabilities Pr({θ|Zi k} are computed by dividing the γ's in Table 1 by c. The marginal association probabilities, βtj's are then computed using equation (41). As an example, the marginal association probabilities for T1 are
-
- where β13=0 because θ13 does not occur in any of the eight joint events θ; that is, M3 is not validated by T1 in
FIG. 2 . To obtain the probability β10 of no measurement originating from T1, all joint events in which no measurements are assigned to T1 (i.e., joint events in which δ1=0) are obtained from Table 1. These joint events are θ=1, 4, 5, so that -
β10 =Pr{θ=1|Z 1 k }+Pr={θ=4|Z 1 k }+Pr{θ=5|Z 1 k}. (46) - Since Σjβtj=ΣφPr{θ|Z1 k}=1 for each target t, β10 can be computed more easily using
-
- In particular, Br0 is given by
-
β10=1−(β11+β12+β13). (48) - The marginal association probabilities for target T2 can be found in a similar manner.
- The technique described above to compute the marginal association probabilities, βtj's, can only be used when there are few tracks and/or measurements because of the large amount of computation time required. With large numbers of tracks and measurements, a suboptimal method must be used. Two techniques are described in [1]. They are the Cheap JPDA and the Suboptimal JPDA and both techniques, along with the optimal JPDA, are programmed into this filter version. The choice as to which technique to use can be determined at the beginning of the filter run.
- The cheap JPDA was developed by Fitzgerald [4]. The probability βtj of track t associating with measurement j is approximated by
-
- The quantity T1 is the sum of all likelihoods for target t, which is given by
-
- and Mj, which is the sum of all likelihoods for measurement j, is
-
- The quantity B is a bias to account for clutter and for non-unity probability of detection. Also
-
- For the example in
FIG. 2 , the quantities Mj (j=1, 2, 3) and Tt (t=1,2) are given by, -
M 1=Λ11 T 1=Λ11+Λ12 -
M 2=Λ12+Λ22 T 2=Λ22+Λ23 -
M 3=Λ23 (53) - The association probabilities for T1 are
-
- The association probabilities for T2 can be found in a similar manner. Fitzgerald stated that when clutter was significant, a fixed value of B was adequate. Otherwise he found that a value of B=0 gave satisfactory performance.
- Although the cheap JPDA is easy to implement and requires much less computational resources, Roecker and Phillis [2] documented some defects in the cheap JPDA. For example, the association probabilities for a given track may not add up to 1. They showed that this may cause a target track to be drawn off by a nearby target track or a nearby false track. To remove some of these defects, the Suboptimal JPDA was developed by Roecker and Phillis [2].
- The concept of partial joint events were introduced by Roecker and Phillis to develop the suboptimal JPDA. A partial joint event considers at most two track-to-measurement pairings. That is, a partial joint event consists of(at most) two single events. Also, it assumes the probability of detection for each track is near unity so that all of the targets are detected and all of the joint events have the same number of measurements assigned to clutter. The computational requirement is more than the cheap JPDA, but less than the optimal JPDA.
- The association probabilities in the suboptimal JPDA are computed using the following steps:
-
- 1. For each track t, form At, which is the list of all indices of the validated measurements for track t.
- 2. For each measurement j, form Cj, which is the list of indices of the tracks which validate measurement j.
- 3. For each track t, form the union of all track index lists from all of the measurements that are validated by track t while excluding the index of track t. This list of track indices, denoted by Lt, is given by
-
-
- 4. The probability βtj of track t associating with measurement j is given by
-
- where B is a bias to account for clutter density and
-
D tj=Λtj if L t=φ -
D ij=ΛijΣSεLt N sj if L t≠φ (60) - where φ is the empty set, and
-
- The probability of no measurements originating from track t is
-
- For the example in
FIG. 2 , the lists of validated measurements for each track are A1={1,2} and A2={2,3}, and the list of tracks validating each measurement are C1={1}, C21={1,2} and C31={2}. Here T1, M1, etc, are denoted by 1. The track lists L1 and L2 are L1={2} and L2={1}. The association probabilities for T1 are computed below. A similar procedure can be used to compute the probabilities for T2. The Nsj's needed in these computations are obtained using (61). -
- Equation (60) is then used to compute the Dtj's:
-
- Finally, (59) and (62) are used to compute the probabilities for T1:
-
- To reduce the number of computations required, the nearest-neighbor JPDAF is used instead of the optimal JPDAF. Instead of using equations (32) to (37) to compute the state estimate and covariance matrix, the NNJPDAF looks for the maximum value of βtj for each measurement-track pair. The corresponding measurement is then used to update the corresponding track. If the maximum βtj corresponds to track 0, which is clutter, no track is updated. When a track is updated by a measurement, both the track and measurement are no longer used. The procedure is repeated until all associations have been made.
- Out-of-Sequence-Measurements (OOSM):
- It is very possible that when the measurements are received by the filter from multiple sensors that the measurements do not arrive in the proper time sequence. One reason that this may occur is that the time delay in getting the data from different sensors is not the same. Another reason, and it is probably the major one, is that if the sensor process time, time from obtaining the raw data to the time the sensor data is transmitted, is subtracted from the sensor time, lower frequency sensors will appear out of sequence. Subtracting the process time may be necessary to get the actual time the measurement is valid.
- The above techniques are valid for measurements that are in sequence. Different techniques can be used to handle the OOSM. One is to hold the sensor measurements in a buffer and when the OOSM arrives then process it and the stored measurements in the proper sequence. The problem with this technique is that the current track data can get old and is not properly updated until the OOSM arrives. Another technique is to run the filter as if there are no OOSMs which will keep the track data current and then if an OOSM arrives, go back to the OOSM's time and reprocess the filter tracks from this time forward using the OOSM and any measurements after the OOSM. The problem with this technique is that a lot of data must be stored so that the filter can be restarted from the OOSM time and it takes a lot of process time. The technique used in this filter is to run the filter normally with all current data measurements and store only the track covariance matrices at each measurement time. Then when an OOSM arrives, propagate the track state and covariance back in time to the OOSM time, verify its association to a track and then perform the update with the OOSM. Next propagate this updated track state and covariance matrix to the current time.
- The procedure is described in FIGS. [5], [6] and [7]. The algorithm to compute the current state and covariance terms using the OOSM is divided into seven steps
-
- 1. State Retrodiction (propagating the state backwards in time to the OOSM time)
- 2. Measurement Retrodiction
- 3. Mode Likelihood Functions
- 4. Data Association
- 5. State Update within each Filter Model
- 6. Update of the Current Mode Probabilities
- 7. Update of the Current Combined Estimate and Covariance
- State Retrodiction:
- The state in each model i of the IMM, i=1, . . . , r, is retrodicted to the time τ of the OOSM, denoted in discrete time as κ. The time τ is l steps lagged, i.e., tk−l<τ=tk<tk−l+1, where tk is the current time. The retrodiction of the state xi of model i to κ from k is
-
{circumflex over (x)} i(κ|k)=F i(κ|k){circumflex over (x)} i(k|k) (73) - where Fi(κ|k) is the backward transition matrix of mode i to κ from k. The covariances associated with the state retrodiction are calculated as follows. The covariance of the cumulative effect of the process noise to k from κ in mode i is
-
P vv i(k,κ|k)=Q i(k,κ) (74) - For a piecewise constant Wiener process acceleration model, or Discrete Wiener Process Acceleration (DWPA) model, the covariance of the process noise multiplied by the gain matrix Γ is
-
- with T=tk−tκ=tk−τ r and σv 2 the covariance of the process noise.
- The cross-covariance between the state at k and the process noise to k from κ in mode i is
-
P xv i(k,κ|k)=Q i(k,κ)−P i(k|k−1)S* i(k)−1 Q i(k|κ) (76) -
where -
S* i(k)−1 =P i(k|k−1)−1 −P i(k|k−1)−1 P i(k|k)P i(k|k−1)−1 (77) - Equation (77) is the key to reducing the i-step lag OOSM problem to the 1-step lag problem while keeping the solution nearly optimal. S*i(k) is the covariance of the “equivalent measurement” at k that summarizes, for model i, all the measurements from k−
l+ 1 to k. To compute this it is necessary to have stored past state covariances Pi(k−l|k−l) for calculation of Pi(k|k−1) for I up to a maximum delay lmax. To compute Pi(k|k−1): -
P i(k|k−1)=P i(k|k−l)=F i(k|k−l)P i(k−l|k−l)F i(k|k−l)T +Q(k|k−l) (78) - where Fi(k|k−l) is the state transition matrix from k−l to k and Q(k|k−l) is the noise contribution as calculated in (75) with T=tk−tk−l. The covariance for the state retrodiction is
-
P i(κ|k)=F i(κ|k)[P i(k|k)+P vv i(k,κ|k)−P xv i(k,κ|k)−P xv i(k,κ|k)T ]F i(κ,k)T (79) - Measurement Retrodiction:
- The retrodicted measurement {circumflex over (z)}i(κ|k) for filter model i of the IMM estimator is calculated based on (73) for each of the r filter models. The retrodicted OOSM for model i is
-
{circumflex over (z)} i(κ|k)=H{circumflex over (x)} i(κ|k) (80) - The corresponding covariance of the innovation is
-
S i(κ|k)=HP i(κ|k)H T +R(κ) (81) - Mode Likelihood Functions:
- The likelihood function of each mode at time κ is evaluated based on the OOSM and the corresponding retrodiction from the current time. The likelihood function of mode i based on the OOSM from time τ is
-
κi(κ)=|2πS i(κ|k)|−1/2exp{−½[z(κ)−{circumflex over (z)} i(κ)]T S i(κ|k)−1 [z(κ)−{circumflex over (z)} i(κ|k)]} (82) - The resulting vector consisting of all the likelihood functions of the system modes i=1, . . . , r in the IMM estimator at time κ as
-
Λ(x)=[Λl(κ), . . . ,Λr(κ)]T (83) - Data Association:
- To perform the data association for an OOSM, it is required to have the IMM estimator's overall likelihood function at time κ. For this the mode-conditioned likelihood functions (82) are used, which rely on the mode-conditioned retrodicted measurement and its covariance, and the retrodicted mode probabilities from the current time k to κ. The mode probabilities at time k (before the OOSM) are given by the vector
-
μ(k|k)=μ(k|Z k)=[μl(k|k), . . . ,μr(k|k)]T (84) - where Zk is the cumulative data at k (not including the OOSM z(κ)) and
-
μi(k|k)=Pr{M(k)=i|Z k} (85) - Let Πij(k2, k1) be the Markov chain transition probability matrix between the modes to time tk
2 from time tk1 . The elements of this transition matrix are -
Πij(k 2 ,k 1)=Pr{M(k 2)=j|m(k 1)=i} (86) - And the mode probability vector evolves according to
-
μ(k 2 |k)=Π(k 2 ,k 1)Tμ(k 1 |k) (87) - The transition probability matrix to time tk
2 from time tk1 is -
- where T=|tk
2 −tk1 | and -
- are the sojourn times in
modes -
μ(κ|k)=Π(κ|k)Tμ(k|k) (89) - The IMM estimator's overall likelihood function for the OOSM is
-
- where Λi(x) are given in (82) and μi(κ|k) follows from (89). This is to be used in the data association to select the delayed measurements to be used in the track update.
- State Update within Each Filter Model:
- This shows the update of the state at the current time tk in each model of the IMM using the selected OOSM. The covariance between the state at k and this measurement is calculated as
-
P xz i(k,κ|k)=[P i(k|k)−P xv i(k,κ|k)]F i(κ|k)T H T. (91) - The filter gain used for the update is
-
W i(k,κ)=P xz i(k,κ|k)S i(κ)−1 (92) - Then update of the most recent state estimate {circumflex over (x)}(k|k) with the OOSM z(κ) is given by
-
- where the predicted OOSM is given in (80) and the gain is given in (92). The filter-calculated covariance for the updated state estimate is
-
P i(k|κ)=P i(k|k)−P xz i(k,κ|k)S i(κ)−1 P xz i(k,κ|k)T (94) - Update of the Current Mode Probabilities:
- This shows how the mode probabilities are updated at the current time. The conditional mode probabilities at time k (before the OOSM), given by the vector
-
μ(k|k)=[μl(k|k), . . . ,μr(k|k)]T (95) -
are to be updated with the OOSM into -
μ(k|κ)=[μl(k|κ), . . . ,μr(k|κ)]T (96) - according to
-
- where the normalized constant is
-
- Update of the Current Combined Estimate and Covariance:
- Finally the new combined estimate, after the OOSM, is
-
- and its covariance is
-
P(k|k)=Σμj(k|κ){P j(k|κ)+[{circumflex over (x)} j(k|κ)−(k|κ)]×[{circumflex over (x)} j(k|κ)−{circumflex over (x)}(k|κ)]T} (100) - Track Management:
- A procedure is needed to determine when to initiate a new track and when to drop a track that is no longer being detected by the sensors. Under normal operations, measurements from the sensors are assigned to tracks and are used to update the tracks. If a new measurement is reported by a sensor and it is not associated to an existing track, it may be used to start a new tentative track.
- To become a tentative track a sensor must report the same measurement for X number of consecutive scans. The value of X will be determined from real time tests, but initially it is set to 2. If during the next sensor scan the sensor again reports the measurement for the tentative track, the tentative track now becomes a firm track and can be updated by any sensor measurement. If during the next sensor scan the sensor does not report a measurement that corresponds to the tentative track, the tentative track is dropped.
- A new firm track is given the lowest integer that has not already been assigned to a firm track. For example, if there are three firm tracks present that have been assigned
numbers number 4. If there are three tracks present and they are assignednumbers number 2. - Another function of the Track Management process is to determine if an existing track should be dropped. The Track Management process keeps track of which sensor updates the firm tracks. If all sensors do not update a firm track for at least Y scans, then the firm track is dropped. The value of Y will be determined from real time tests, but initially it is set to 2 for optical sensors and 3 for ranging sensors. As long as one sensor is updating a firm track it will not be dropped.
- Sensor Data Conversion:
- The sensors usually report their target measurements in a polar reference frame, range and azimuth or bearing. The tracking estimator usually computes its Firm Target File in a Cartesian reference frame because it is easier to understand and visualize. Therefore, the sensor data must be converted to the Cartesian reference frame before it is used by the tracking filter.
- The standard conversion from the polar to the Cartesian reference frame is:
-
x m =r m cos θm and y m =r m sin θm, (101) - where rm and θm are the range and bearing, respectively, of the sensor target in the polar reference frame and xm and ym are the downrange and cross range coordinates, respectively, in the converted Cartesian reference frame. However, when dealing with the statistics of the measurements, mean and variance, one cannot use the above equations to transform from the polar to the Cartesian frames. The uncertainty in the range and the bearing is not a perfect ellipsoid so there needs to be debiased correction terms subtracted from (101) to get a better value for the downrange and cross range measurements and their variances.
- The following equations give the debiased conversion from a polar coordinate frame to a Cartesian reference frame:
-
x dc =r m cos θm −E[{tilde over (x)}|r m,θm], (102) -
y dc =r m sin θm −E[{tilde over (y)}|r m,θm], (103) - where
- xdc and ydc are the final downrange and cross range debiased conversion coordinates of the sensor target and
-
E[{tilde over (x)}|r m,θm ]=r m cos θm(e −σ −e −σθ 2 /2), (104) -
E[{tilde over (y)}|r m,θm ]=r m sin θm(e −σ −e −σθ 2 /2). (105) - The covariance matrix, Ra, for the downrange and cross range coordinates are
-
R a 11=var({tilde over (x)}|r m,θm)=r m 2 e −2σθ 2[cos2 θm(cos h 2σθ 2−cos h σ θ 2)+sin2 θm(sin h 2σθ 2−sin h σ θ 2)]+σr 2 e −2σθ 2 [cos2 θm(2 cos h 2σθ 2−cos h σ θ 2)+sin2 θm(2 sin h 2σθ 2−sin σθ 2)], (106) -
R a 22=var({tilde over (y)}|r m,θm)=r m 2 e −2σθ 2[sin2 θm(cos h 2σθ 2−cos h σ θ 2)+sin2 θm(sin h 2σθ 2−sin h σ θ 2)]+σr 2 e −2σθ 2 [sin2 θm(2 cos h 2σθ 2−cos h σ θ 2)+sin2 θm(2 sin h 2σθ 2−sin σθ 2)], (107) -
R a 12 =cov({tilde over (x)},{tilde over (y)},|r m,θm)=sin θm cos θm e −4σθ 2 [σr 2+(r m 2+σr 2)(1−e σθ 2 )], (108) - where
- σr 2 and σθ 2 are the variances of the range and bearing, respectively, in the sensor polar reference frame.
-
FIG. 15 . A sensor that provides range, r, and angle, θ, can be converted to the Cartesian coordinates of down range, x, and cross range, y, by using x=r cos(θ) and y=r sin(θ). However, r=rt+re and θ=θt+θe, where rt stands for true range and re stands for the range error. The same applies to the angle. This means that the down range measurement, xm, and the cross range measurement, ym, are as follows: -
xm=xt+xe=(rt+re)cos(θt+θe) and ym=yt+ye=(rt+re)sin(θt+θe). - Expanding these out can give you the error means and covariances, however, it requires knowing the true range, rt, and angle, θt, which are not known. Therefore, the expected values and covariances must be computed based on the measure values of range and angle and not the true values. When this is done the expected value, mean, and covariance of the down range error, xe, and cross range error, ye, give a correction terms for the range and angle terms.
-
FIG. 16 . Assume you have two sensors that take different time intervals to process the raw data. In theslide sensor 1 could be a radar sensor that process the raw data faster and, therefore, has a faster output rate.Sensor 2 could be an optical sensor that takes longer to process the raw data. - Both sensors get the raw data at time t1.
Sensor 1 takes the time from t1 to t2 to process its data and then sends it to the filter. Since the process time is known, a time tag can then be applied to the data which was received at t2 with the time t1 which is more accurately the time of the data. For the data received fromsensor 1 at t3, the time tag of t2 is given. This is a way to compensate for the sensor latency. Now look atsensor 2 which takes a longer time to process its data thansensor 1. When the data packet arrives at time t2 it is actually given the time stamp of t1 since that more accurately reflects the time of the data. You can see that this will cause a sequence problem if the data rates of the sensors are not the same.Sensor 2's data at its time t2 is tagged as t1 which comes earlier in real time thansensor 1's data at t3 that is tagged as t2. This data is now out of sequence because the filter has processes data fromsensor 1 for time t2 and now it gets data fromsensor 2 with a time tag of t1. This is where the filter's OOSM (out-of-sequence-measurements) algorithms come into play. -
FIG. 17 JPDA is a technique to deal with the problem of taking measurement data and either associating it with an existing track, rejecting it because it may be clutter, or possibly starting a new track. A validation region is generated for each track about the predicted measurement point and all measurements that fall in these regions are considered. The probabilities for all possible combinations of valid measurements to tracks are computed and the highest probabilities are used to match up the measurements and tracks. Presently this approach is used, which is the nearest-neighbor JPDA filter instead of the true optimal JPDA filter which requires more computations. -
FIG. 18 . Instead of one Kalman Filter to estimate the position, velocity and acceleration of the targets, three filters are proposed, a constant velocity filter, down range acceleration filter, and a cross range acceleration filter. All three filters run at the same time and their outputs are weighted based on what the IMM thinks is the best filter for the trajectory. This allows the constant velocity filter to estimate the target trajectory when the target is not accelerating, the down range acceleration filter to estimate the trajectory when the target is accelerating straight ahead, and the cross range filter to estimate the trajectory when the target is in a turn. Since the best filter is operating during its part of the trajectory, the estimate errors are smaller. Also if the target is accelerating straight ahead and turning, then both the down range and cross range filters may be equally heavily weighted. -
FIG. 19 . The IMM filters starts off with all three filters (constant velocity, down range acceleration, and cross range acceleration) weighted equally. The IMM switching soon determines that the target is moving at a constant velocity and weights this filter much heavier than the two acceleration filters. -
FIG. 20 . In this trajectory both vehicles perform a 90 degree constant rate turn to the right. However, the target vehicle is about 25 meters ahead of the host vehicle and one lane to the left so it starts the turn earlier. The start on the plots indicates the starting position. -
FIG. 21 . These show the relative position, velocity and acceleration of the target vehicle to the host vehicle. Note the acceleration curve which shows the lateral acceleration due to the turning of the vehicles. The spikes occur due to one vehicle turning while the other is not. -
FIG. 22 . This shows that again initially the three filters start off equally, but when one vehicle turns and the other does not, the filter that looks for cross range acceleration filter is weighted much heavier during the acceleration spike, but decreases gradually after the spike. -
FIG. 23 . Typical radar values expected -
FIG. 24 . Typical maneuver scenario -
FIG. 25 . This shows the relative position of the target vehicle with respect to the host vehicle. The relative velocity is −50 m/sec in the X axis and 0 in the Y axis. -
FIG. 26 . This shows the relative position and velocity charts for the X (down range) and Y (cross range) axes. -
FIG. 27 . Using the long range and medium range sensor characteristic data shown inslide 12 raw sensor data is generated. The upper left plot shows the error in the generated down range position for the long range radar and the upper right plots shows the error for the medium range radar. The magenta and yellow lines show the 1-sigma standard deviation values for the noisy data. The maximum range and horizontal FOV determines the start and stop times of the plots. - The bottom plots show the improvement in the position data using the sensor fusion filter. The bottom left plot shows the result of the fusion filter using only position updates. The bottom tight plot uses position and velocity, range-rate, updates. The magenta lines are the true errors since the true track is known. The blue and yellow lines give the filter 1-sigma standard deviation values of the filter error. The decrease in these uncertainty curves for the no velocity update plot is a result of the medium range radar coming into play at about 4.6 seconds. The small bump up after this drop is due to the long range radar dropping out due to FOV. If range-rate updates are available, then the medium range radar does not improve the performance much as shown in the bottom right plot.
- Properly tuning the filter should improve the results since the true error points outside the 1-sigma curves are much less than 32%.
-
FIG. 28 . These plots show the filter down range velocity and acceleration error plots when not using velocity updates and when using velocity updates. Again it shows that the filter is not optimally tuned and with tuning the performance should improve slightly. - The increased values of the uncertainty curves when velocity data is used are a result of the long range radar dropping out due to the target reaching its FOV limits.
-
FIG. 29 . This shows the same data as slide 17 except this is for the cross range position instead of the down range position. The decrease in the uncertainty curves is a result of the fact that the cross range errors is equal to the range times the angle uncertainty. As the target approaches the host, the range decreases, and therefore, the cross range error decreases. - The small bump up in the filter—no velocity updates uncertainty curves is a result of the long rang radar dropping out due to the FOV restriction.
-
FIG. 30 . This shows the same as slide 18 except for the cross range values instead of the down range values. The bump up in the bottom right plot is because the inventors did not have the initial covariance values large enough for the acceleration. - The systems described above can use dedicated processor systems, micro controllers, programmable logic devices, or microprocessors that perform some or all of the operations. Some of the operations described above may be implemented in software and other operations may be implemented in hardware.
- For the sake of convenience, the operations are described as various interconnected functional blocks or distinct software modules. This is not necessary, however, and there may be cases where these functional blocks or modules are equivalently aggregated into a single logic device, program or operation with unclear boundaries. In any event, the functional blocks and software modules or described features can be implemented by themselves, or in combination with other operations in either hardware or software.
- Having described and illustrated the principles of the invention in a preferred embodiment thereof, it should be apparent that the invention may be modified in arrangement and detail without departing from such principles. Claim is made to all modifications and variation coming within the spirit and scope of the following claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/146,402 US20160245949A1 (en) | 2009-05-08 | 2016-05-04 | System and method for modeling advanced automotive safety systems |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17668109P | 2009-05-08 | 2009-05-08 | |
US17701509P | 2009-05-11 | 2009-05-11 | |
US12/776,137 US9358924B1 (en) | 2009-05-08 | 2010-05-07 | System and method for modeling advanced automotive safety systems |
US15/146,402 US20160245949A1 (en) | 2009-05-08 | 2016-05-04 | System and method for modeling advanced automotive safety systems |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/776,137 Continuation US9358924B1 (en) | 2009-05-08 | 2010-05-07 | System and method for modeling advanced automotive safety systems |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160245949A1 true US20160245949A1 (en) | 2016-08-25 |
Family
ID=56082995
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/776,137 Active 2031-10-16 US9358924B1 (en) | 2009-05-08 | 2010-05-07 | System and method for modeling advanced automotive safety systems |
US15/146,402 Abandoned US20160245949A1 (en) | 2009-05-08 | 2016-05-04 | System and method for modeling advanced automotive safety systems |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/776,137 Active 2031-10-16 US9358924B1 (en) | 2009-05-08 | 2010-05-07 | System and method for modeling advanced automotive safety systems |
Country Status (1)
Country | Link |
---|---|
US (2) | US9358924B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109177982A (en) * | 2018-10-31 | 2019-01-11 | 吉林大学 | Consider the vehicle driving Hazard degree assessment method of driving style |
WO2019083513A1 (en) * | 2017-10-24 | 2019-05-02 | Nissan North America, Inc. | Localization determination for vehicle operation |
CN113139299A (en) * | 2021-05-13 | 2021-07-20 | 深圳市道通科技股份有限公司 | Sensor fusion verification method and device and electronic equipment |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10678240B2 (en) * | 2016-09-08 | 2020-06-09 | Mentor Graphics Corporation | Sensor modification based on an annotated environmental model |
US11110895B2 (en) * | 2018-04-09 | 2021-09-07 | Cisco Technology, Inc. | Vehicle network intrusion detection system (IDS) using vehicle state predictions |
Family Cites Families (365)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2995318A (en) | 1957-04-26 | 1961-08-08 | Chance Vought Corp | Optical data transfer system |
US3768074A (en) | 1972-05-12 | 1973-10-23 | Burroughs Corp | Multiprocessing system having means for permissive coupling of different subsystems |
US4303978A (en) | 1980-04-18 | 1981-12-01 | The Boeing Company | Integrated-strapdown-air-data sensor system |
GB2097563B (en) | 1981-03-07 | 1985-10-16 | British Aerospace | Serial bus interface unit |
DE3125161A1 (en) | 1981-06-26 | 1983-01-20 | Norbert 6500 Mainz Hinkel | System for providing motor vehicles with early warning of emergency service vehicles |
JPS5987597A (en) | 1982-11-11 | 1984-05-21 | 日産自動車株式会社 | Obstacle detector for vehicle |
JPS59230313A (en) | 1983-06-14 | 1984-12-24 | Honda Motor Co Ltd | Audio system for car |
US4591976A (en) | 1983-06-17 | 1986-05-27 | The United States Of America As Represented By The Secretary Of The Air Force | Multiple task oriented processor |
US4735274A (en) | 1985-11-22 | 1988-04-05 | Good Warren T | Automatic parallel parking system |
US4835537A (en) | 1986-07-16 | 1989-05-30 | Manion James H | Telemetry burst collision avoidance system |
US4829434A (en) | 1987-04-29 | 1989-05-09 | General Motors Corporation | Adaptive vehicle |
ATE158886T1 (en) | 1987-05-09 | 1997-10-15 | Koninkl Philips Electronics Nv | FACILITY FOR RECEIVING AND PROCESSING STREET NEWS REPORTS |
US5031330A (en) | 1988-01-20 | 1991-07-16 | Kaiser Aerospace & Electronics Corporation | Electronic boresight |
US4931930A (en) | 1988-04-19 | 1990-06-05 | Industrial Technology Research Institute | Automatic parking device for automobile |
DE3816918C1 (en) | 1988-05-18 | 1989-07-27 | Adam Opel Ag, 6090 Ruesselsheim, De | |
US4959800A (en) * | 1988-05-20 | 1990-09-25 | Hughes Aircraft Company | Method and apparatus for determining the position and velocity of a target in inertial space |
US5045937A (en) | 1989-08-25 | 1991-09-03 | Space Island Products & Services, Inc. | Geographical surveying using multiple cameras to obtain split-screen images with overlaid geographical coordinates |
US5610815A (en) | 1989-12-11 | 1997-03-11 | Caterpillar Inc. | Integrated vehicle positioning and navigation system, apparatus and method |
US5648901A (en) | 1990-02-05 | 1997-07-15 | Caterpillar Inc. | System and method for generating paths in an autonomous vehicle |
GB9002951D0 (en) | 1990-02-09 | 1990-04-04 | Bowman Nigel J | Crash warning system |
US5008678A (en) | 1990-03-02 | 1991-04-16 | Hughes Aircraft Company | Electronically scanning vehicle radar sensor |
US5245909A (en) | 1990-05-07 | 1993-09-21 | Mcdonnell Douglas Corporation | Automatic sensor alignment |
US5111401A (en) | 1990-05-19 | 1992-05-05 | The United States Of America As Represented By The Secretary Of The Navy | Navigational control system for an autonomous vehicle |
JP2915080B2 (en) | 1990-05-25 | 1999-07-05 | 株式会社日立製作所 | Data processing method in multiprocessor system |
US5115245A (en) | 1990-09-04 | 1992-05-19 | Hughes Aircraft Company | Single substrate microwave radar transceiver including flip-chip integrated circuits |
JP3198514B2 (en) | 1990-12-27 | 2001-08-13 | 株式会社デンソー | GPS receiver for vehicles |
US5440644A (en) | 1991-01-09 | 1995-08-08 | Square D Company | Audio distribution system having programmable zoning features |
US6247144B1 (en) | 1991-01-31 | 2001-06-12 | Compaq Computer Corporation | Method and apparatus for comparing real time operation of object code compatible processors |
US6484080B2 (en) | 1995-06-07 | 2002-11-19 | Automotive Technologies International Inc. | Method and apparatus for controlling a vehicular component |
US6738697B2 (en) | 1995-06-07 | 2004-05-18 | Automotive Technologies International Inc. | Telematics system for vehicle diagnostics |
US5303297A (en) | 1991-07-25 | 1994-04-12 | Motorola, Inc. | Dynamic pricing method and apparatus for communication systems |
US5243640A (en) | 1991-09-06 | 1993-09-07 | Ford Motor Company | Integrated cellular telephone and vehicular audio system |
FR2682202B1 (en) | 1991-10-03 | 1994-03-11 | Sextant Avionique | METHOD AND DEVICE FOR REAL-TIME MANAGEMENT OF A SYSTEM COMPRISING AT LEAST ONE PROCESSOR CAPABLE OF MANAGING MULTIPLE FUNCTIONS. |
JP3197307B2 (en) | 1991-10-14 | 2001-08-13 | マツダ株式会社 | Travel control device for mobile vehicles |
DE4219678A1 (en) | 1992-06-16 | 1994-01-05 | Eduard Kuehnert | Method and arrangement for securing people or objects |
IL100175A (en) | 1991-11-27 | 1994-11-11 | State Of Isreal Ministry Of De | Collision warning apparatus for a vehicle |
US6009330A (en) | 1992-01-27 | 1999-12-28 | Highwaymaster Communications, Inc. | Method and apparatus for call delivery to a mobile unit |
US5287199A (en) | 1992-02-27 | 1994-02-15 | At&T Bell Laboratories | Facsimile message processing and routing system |
US5450325A (en) * | 1992-03-09 | 1995-09-12 | Rodriguez; Angel L. | Route directions display system |
US5438361A (en) | 1992-04-13 | 1995-08-01 | Hughes Aircraft Company | Electronic gimbal system for electronically aligning video frames from a video sensor subject to disturbances |
DE69333543T2 (en) | 1992-09-30 | 2005-06-02 | Hitachi, Ltd. | Support system for the driver of a vehicle and vehicle equipped therewith |
DE4237987B4 (en) | 1992-11-11 | 2004-07-22 | Adam Opel Ag | Electronic device |
US5339086A (en) | 1993-02-22 | 1994-08-16 | General Electric Co. | Phased array antenna with distributed beam steering |
JPH0717347A (en) | 1993-07-07 | 1995-01-20 | Mazda Motor Corp | Obstacle detecting device for automobile |
US5983161A (en) | 1993-08-11 | 1999-11-09 | Lemelson; Jerome H. | GPS vehicle collision avoidance warning and control system and method |
US6553130B1 (en) | 1993-08-11 | 2003-04-22 | Jerome H. Lemelson | Motor vehicle warning and control system and method |
JP3197403B2 (en) | 1993-09-07 | 2001-08-13 | 富士通株式会社 | Control method of computer system when application program failure occurs |
DE4334595C1 (en) | 1993-10-11 | 1995-04-27 | Siemens Ag | Control for a motor vehicle |
US6421429B1 (en) | 1993-12-29 | 2002-07-16 | At&T Corporation | Network-based system enabling image communications |
US5581462A (en) | 1994-01-06 | 1996-12-03 | Fairchild Space And Defense Corporation | Vehicle computer system and method |
US5500794A (en) | 1994-03-31 | 1996-03-19 | Panasonic Technologies, Inc. | Distribution system and method for menu-driven user interface |
US5787246A (en) | 1994-05-27 | 1998-07-28 | Microsoft Corporation | System for configuring devices for a computer system |
US5440726A (en) | 1994-06-22 | 1995-08-08 | At&T Corp. | Progressive retry method and apparatus having reusable software modules for software failure recovery in multi-process message-passing applications |
US5948040A (en) | 1994-06-24 | 1999-09-07 | Delorme Publishing Co. | Travel reservation information and planning system |
US5572201A (en) | 1994-08-05 | 1996-11-05 | Federal Signal Corporation | Alerting device and system for abnormal situations |
US5661811A (en) | 1994-08-25 | 1997-08-26 | Delco Electronics Corporation | Rear seat audio control with multiple media |
JP3336777B2 (en) * | 1994-10-25 | 2002-10-21 | 株式会社エクォス・リサーチ | Hybrid vehicle and hybrid vehicle control method |
US5532706A (en) | 1994-12-05 | 1996-07-02 | Hughes Electronics | Antenna array of radiators with plural orthogonal ports |
US6167253A (en) | 1995-01-12 | 2000-12-26 | Bell Atlantic Network Services, Inc. | Mobile data/message/electronic mail download system utilizing network-centric protocol such as Java |
US5577100A (en) | 1995-01-30 | 1996-11-19 | Telemac Cellular Corporation | Mobile phone with internal accounting |
KR960032262A (en) | 1995-02-09 | 1996-09-17 | 배순훈 | Vehicle safety system |
US5915214A (en) | 1995-02-23 | 1999-06-22 | Reece; Richard W. | Mobile communication service provider selection system |
JP3270801B2 (en) | 1995-04-11 | 2002-04-02 | 富士通株式会社 | Attenuator unit, step attenuator having the same, and electronic apparatus having step attenuator |
US5943427A (en) | 1995-04-21 | 1999-08-24 | Creative Technology Ltd. | Method and apparatus for three dimensional audio spatialization |
US5786998A (en) | 1995-05-22 | 1998-07-28 | Automated Monitoring And Control International, Inc. | Apparatus and method for tracking reporting and recording equipment inventory on a locomotive |
US6405132B1 (en) | 1997-10-22 | 2002-06-11 | Intelligent Technologies International, Inc. | Accident avoidance system |
US7426437B2 (en) | 1997-10-22 | 2008-09-16 | Intelligent Technologies International, Inc. | Accident avoidance systems and methods |
CN1137455C (en) | 1995-08-09 | 2004-02-04 | 丰田自动车株式会社 | Travel plan preparing device |
US5859878A (en) | 1995-08-31 | 1999-01-12 | Northrop Grumman Corporation | Common receive module for a programmable digital radio |
JPH09142236A (en) | 1995-11-17 | 1997-06-03 | Mitsubishi Electric Corp | Periphery monitoring method and device for vehicle, and trouble deciding method and device for periphery monitoring device |
US5794164A (en) | 1995-11-29 | 1998-08-11 | Microsoft Corporation | Vehicle computer system |
JP3656301B2 (en) | 1995-12-28 | 2005-06-08 | 株式会社デンソー | Obstacle warning device for vehicles |
US5951620A (en) | 1996-01-26 | 1999-09-14 | Navigation Technologies Corporation | System and method for distributing information for storage media |
US6489884B1 (en) | 1996-01-30 | 2002-12-03 | Skf Condition Monitoring | Apparatus and method for the remote monitoring of machine condition |
US20030212996A1 (en) | 1996-02-08 | 2003-11-13 | Wolzien Thomas R. | System for interconnection of audio program data transmitted by radio to remote vehicle or individual with GPS location |
DE19646226A1 (en) | 1996-03-19 | 1998-05-14 | Bayerische Motoren Werke Ag | Operating device for menu-controlled functions of a vehicle |
US6343313B1 (en) | 1996-03-26 | 2002-01-29 | Pixion, Inc. | Computer conferencing system with real-time multipoint, multi-speed, multi-stream scalability |
US6028505A (en) | 1996-03-27 | 2000-02-22 | Clifford Electronics, Inc. | Electronic vehicle security system with remote control |
US6179489B1 (en) | 1997-04-04 | 2001-01-30 | Texas Instruments Incorporated | Devices, methods, systems and software products for coordination of computer main microprocessor and second microprocessor coupled thereto |
US5754123A (en) | 1996-05-06 | 1998-05-19 | Ford Motor Company | Hybrid ultrasonic and radar based backup aid |
JPH09301068A (en) | 1996-05-13 | 1997-11-25 | Niles Parts Co Ltd | Electronic flasher device |
GB2313256B (en) | 1996-05-17 | 2000-08-23 | Motorola Ltd | Method and apparatus for system selection |
US5907293A (en) | 1996-05-30 | 1999-05-25 | Sun Microsystems, Inc. | System for displaying the characteristics, position, velocity and acceleration of nearby vehicles on a moving-map |
US5742141A (en) | 1996-06-04 | 1998-04-21 | Ford Motor Company | Semi-autonomous parking control system for a vehicle providing tactile feedback to a vehicle operator |
US6028537A (en) | 1996-06-14 | 2000-02-22 | Prince Corporation | Vehicle communication and remote control system |
US5793366A (en) | 1996-11-12 | 1998-08-11 | Sony Corporation | Graphical display of an animated data stream between devices on a bus |
JP3528440B2 (en) | 1996-07-17 | 2004-05-17 | 日産自動車株式会社 | In-vehicle information communication device |
JPH1076115A (en) | 1996-09-04 | 1998-03-24 | Shinei Sangyo Kk | Ceramic water purifying method |
US5966658A (en) | 1996-09-26 | 1999-10-12 | Highwaymaster Communications, Inc. | Automated selection of a communication path |
US6523696B1 (en) | 1996-10-15 | 2003-02-25 | Kabushiki Kaisha Toshiba | Communication control device for realizing uniform service providing environment |
US5959536A (en) | 1996-10-15 | 1999-09-28 | Philips Electronics North America Corporation | Task-driven distributed multimedia consumer system |
FR2756680B1 (en) | 1996-11-29 | 1999-02-12 | Sgs Thomson Microelectronics | HIGH DYNAMIC, LOW NOISE TRANSCONDUCTANCE AMPLIFIER |
US7506020B2 (en) | 1996-11-29 | 2009-03-17 | Frampton E Ellis | Global network computers |
DE19650808A1 (en) | 1996-12-06 | 1998-06-10 | Bosch Gmbh Robert | Parking device for a motor vehicle |
US5957985A (en) | 1996-12-16 | 1999-09-28 | Microsoft Corporation | Fault-resilient automobile control system |
US5923280A (en) | 1997-01-17 | 1999-07-13 | Automotive Systems Laboratory, Inc. | Vehicle collision radar with randomized FSK wave form |
US6240365B1 (en) | 1997-01-21 | 2001-05-29 | Frank E. Bunn | Automated vehicle tracking and service provision system |
US6009355A (en) | 1997-01-28 | 1999-12-28 | American Calcar Inc. | Multimedia information and control system for automobiles |
DE19703517C2 (en) | 1997-01-31 | 2001-05-31 | Daimler Chrysler Ag | Method for displaying the control interventions for parking a motor vehicle or method for carrying out the control interventions for parking a motor vehicle and device for carrying out the method |
US6243772B1 (en) | 1997-01-31 | 2001-06-05 | Sharewave, Inc. | Method and system for coupling a personal computer with an appliance unit via a wireless communication link to provide an output display presentation |
US6282714B1 (en) | 1997-01-31 | 2001-08-28 | Sharewave, Inc. | Digital wireless home computer system |
US6764012B2 (en) | 1997-02-10 | 2004-07-20 | Symbol Technologies, Inc. | Signaling arrangement for and method of signaling in a wireless local area network |
KR100265711B1 (en) | 1997-02-14 | 2000-09-15 | 윤종용 | Plug and play controls for isa peripheral devices |
JP3870983B2 (en) | 1997-02-17 | 2007-01-24 | ソニー株式会社 | Electronic device control apparatus and method, and electronic device |
JP3898264B2 (en) | 1997-02-21 | 2007-03-28 | 本田技研工業株式会社 | Vehicle network system |
SE509328C2 (en) * | 1997-02-27 | 1999-01-11 | Celsiustech Syst Ab | Procedure for track initiation in multi-target tracking using at least two passive sensors |
US6175728B1 (en) | 1997-03-05 | 2001-01-16 | Nec Corporation | Direct conversion receiver capable of canceling DC offset voltages |
US6157921A (en) | 1998-05-01 | 2000-12-05 | Barnhill Technologies, Llc | Enhancing knowledge discovery using support vector machines in a distributed network environment |
US5909559A (en) | 1997-04-04 | 1999-06-01 | Texas Instruments Incorporated | Bus bridge device including data bus of first width for a first processor, memory controller, arbiter circuit and second processor having a different second data width |
US6298370B1 (en) | 1997-04-04 | 2001-10-02 | Texas Instruments Incorporated | Computer operating process allocating tasks between first and second processors at run time based upon current processor load |
US6105119A (en) | 1997-04-04 | 2000-08-15 | Texas Instruments Incorporated | Data transfer circuitry, DSP wrapper circuitry and improved processor devices, methods and systems |
US6247079B1 (en) | 1997-05-13 | 2001-06-12 | Micron Electronics, Inc | Apparatus for computer implemented hot-swap and hot-add |
US6408174B1 (en) | 1997-05-13 | 2002-06-18 | Telefonaktiebolaget Lm Ericsson (Publ) | Communication method, system, and device for reducing processor load at tariff switch |
US7164662B2 (en) | 1997-05-19 | 2007-01-16 | Airbiquity, Inc. | Network delay identification method and apparatus |
AU753409B2 (en) | 1997-05-19 | 2002-10-17 | Airbiquity Inc. | System and method to communicate time stamped, 3-axis geo-position data within telecommunication networks |
US6771629B1 (en) | 1999-01-15 | 2004-08-03 | Airbiquity Inc. | In-band signaling for synchronization in a voice communications network |
US6493338B1 (en) | 1997-05-19 | 2002-12-10 | Airbiquity Inc. | Multichannel in-band signaling for data communications over digital wireless telecommunications networks |
US6690681B1 (en) | 1997-05-19 | 2004-02-10 | Airbiquity Inc. | In-band signaling for data communications over digital wireless telecommunications network |
US5956025A (en) | 1997-06-09 | 1999-09-21 | Philips Electronics North America Corporation | Remote with 3D organized GUI for a home entertainment system |
US6133853A (en) | 1998-07-30 | 2000-10-17 | American Calcar, Inc. | Personal communication and positioning system |
US6148261A (en) | 1997-06-20 | 2000-11-14 | American Calcar, Inc. | Personal communication system to send and receive voice data positioning information |
US7103834B1 (en) | 1997-06-25 | 2006-09-05 | Samsung Electronics Co., Ltd. | Method and apparatus for a home network auto-tree builder |
CN1117462C (en) | 1997-06-25 | 2003-08-06 | 三星电子株式会社 | Method and apparatus for home network auto-tree builder |
JP4121157B2 (en) | 1997-07-01 | 2008-07-23 | マネスマン ファウデーオー アーゲー | Vehicle navigation system |
US6275231B1 (en) | 1997-08-01 | 2001-08-14 | American Calcar Inc. | Centralized control and management system for automobiles |
EP0905960A1 (en) | 1997-08-07 | 1999-03-31 | Siemens Aktiengesellschaft | Method for billing for communications services |
US6707421B1 (en) | 1997-08-19 | 2004-03-16 | Siemens Vdo Automotive Corporation | Driver information system |
US6680694B1 (en) * | 1997-08-19 | 2004-01-20 | Siemens Vdo Automotive Corporation | Vehicle information system |
JPH1165436A (en) | 1997-08-21 | 1999-03-05 | Toyota Motor Corp | Data selection support device, and map data processing system and processor including same support device |
WO1999010876A1 (en) | 1997-08-21 | 1999-03-04 | Valeo Schalter Und Sensoren Gmbh | Sleeve for receiving a sensor, connected to the bumper of an automobile |
US5964822A (en) | 1997-08-27 | 1999-10-12 | Delco Electronics Corp. | Automatic sensor azimuth alignment |
US6154123A (en) | 1997-09-05 | 2000-11-28 | Breed Automotive Technology, Inc. | Driver alertness monitoring system |
US6118860A (en) | 1997-09-12 | 2000-09-12 | Nortel Networks Corporation | Public communications services vending method and apparatus |
DE19741631B4 (en) | 1997-09-20 | 2013-08-14 | Volkswagen Ag | Method and device for avoiding and / or minimizing conflict situations in road traffic |
JPH11110700A (en) | 1997-09-29 | 1999-04-23 | Toyota Motor Corp | Intersection information providing system and on-vehicle information transmitter applied to the system |
US6243645B1 (en) | 1997-11-04 | 2001-06-05 | Seiko Epson Corporation | Audio-video output device and car navigation system |
US6163711A (en) | 1997-12-01 | 2000-12-19 | Nokia Mobile Phones, Ltd | Method and apparatus for interfacing a mobile phone with an existing audio system |
US6032089A (en) | 1997-12-01 | 2000-02-29 | Chrysler Corporation | Vehicle instrument panel computer interface node |
US6295541B1 (en) | 1997-12-16 | 2001-09-25 | Starfish Software, Inc. | System and methods for synchronizing two or more datasets |
US6032202A (en) | 1998-01-06 | 2000-02-29 | Sony Corporation Of Japan | Home audio/video network with two level device control |
US6038625A (en) | 1998-01-06 | 2000-03-14 | Sony Corporation Of Japan | Method and system for providing a device identification mechanism within a consumer audio/video network |
US7085710B1 (en) | 1998-01-07 | 2006-08-01 | Microsoft Corporation | Vehicle computer system audio entertainment system |
US6054950A (en) | 1998-01-26 | 2000-04-25 | Multispectral Solutions, Inc. | Ultra wideband precision geolocation system |
US6252544B1 (en) | 1998-01-27 | 2001-06-26 | Steven M. Hoffberg | Mobile communication device |
US6389340B1 (en) | 1998-02-09 | 2002-05-14 | Gary A. Rayner | Vehicle data recorder |
US5898392A (en) | 1998-02-10 | 1999-04-27 | Prince Corporation | System and method for remote control of an in-vehicle voice recorder and other electrical accessories |
DE19806557C2 (en) | 1998-02-17 | 2000-08-17 | Ericsson Telefon Ab L M | Display of charge information using the USSD mechanism |
US6374286B1 (en) | 1998-04-06 | 2002-04-16 | Rockwell Collins, Inc. | Real time processor capable of concurrently running multiple independent JAVA machines |
SE514332C2 (en) | 1998-04-30 | 2001-02-12 | Ehpt Sweden Ab | Procedure and apparatus for payment in a computer network |
JPH11321598A (en) | 1998-05-07 | 1999-11-24 | Honda Motor Co Ltd | Safety device for running of vehicle |
DE69933130T2 (en) | 1998-06-05 | 2007-03-08 | British Telecommunications P.L.C. | Billing in a communication network |
AU4690899A (en) | 1998-06-18 | 2000-01-05 | Kline & Walker Llc | Automated devices to control equipment and machines with remote control and accountability worldwide |
US6292657B1 (en) | 1998-07-13 | 2001-09-18 | Openwave Systems Inc. | Method and architecture for managing a fleet of mobile stations over wireless data networks |
US6195760B1 (en) | 1998-07-20 | 2001-02-27 | Lucent Technologies Inc | Method and apparatus for providing failure detection and recovery with predetermined degree of replication for distributed applications in a network |
US6185491B1 (en) | 1998-07-31 | 2001-02-06 | Sun Microsystems, Inc. | Networked vehicle controlling attached devices using JavaBeans™ |
US6377860B1 (en) | 1998-07-31 | 2002-04-23 | Sun Microsystems, Inc. | Networked vehicle implementing plug and play with javabeans |
US6061709A (en) | 1998-07-31 | 2000-05-09 | Integrated Systems Design Center, Inc. | Integrated hardware and software task control executive |
US7103646B1 (en) | 1998-08-07 | 2006-09-05 | Hitachi, Ltd. | Distributed control system and information processing system |
US6199136B1 (en) | 1998-09-02 | 2001-03-06 | U.S. Philips Corporation | Method and apparatus for a low data-rate network to be represented on and controllable by high data-rate home audio/video interoperability (HAVi) network |
DE19843564A1 (en) | 1998-09-23 | 2000-03-30 | Bosch Gmbh Robert | Warning device for a motor vehicle |
US5977906A (en) | 1998-09-24 | 1999-11-02 | Eaton Vorad Technologies, L.L.C. | Method and apparatus for calibrating azimuth boresight in a radar system |
US6434447B1 (en) | 1998-10-02 | 2002-08-13 | Koninklijke Philips Electronics N.V. | Control property is mapped modally compatible GUI element |
US6060989A (en) | 1998-10-19 | 2000-05-09 | Lucent Technologies Inc. | System and method for preventing automobile accidents |
SE513210C2 (en) | 1998-10-30 | 2000-07-31 | Ericsson Telefon Ab L M | Procedure for determining movement data for objects |
BR9908762A (en) | 1998-11-02 | 2004-02-25 | Integrated Data Communications | Geospatial Internet Protocol Addressing |
US6748541B1 (en) | 1999-10-05 | 2004-06-08 | Aladdin Knowledge Systems, Ltd. | User-computer interaction method for use by a population of flexibly connectable computer systems |
US7047532B1 (en) | 1998-11-13 | 2006-05-16 | The Chase Manhattan Bank | Application independent messaging system |
US6522875B1 (en) | 1998-11-17 | 2003-02-18 | Eric Morgan Dowling | Geographical web browser, methods, apparatus and systems |
US6150961A (en) | 1998-11-24 | 2000-11-21 | International Business Machines Corporation | Automated traffic mapping |
US6567069B1 (en) | 1998-11-25 | 2003-05-20 | Alliedsignal Inc. | Integrated display and yoke mechanism |
US6169894B1 (en) | 1998-11-25 | 2001-01-02 | Lucent Technologies, Inc. | Apparatus, method and system for mobile broadcast of information specific to a geographic region |
US6321344B1 (en) | 1998-12-10 | 2001-11-20 | Lucent Technologies Inc. | Reliable distributed processing system |
US6754485B1 (en) | 1998-12-23 | 2004-06-22 | American Calcar Inc. | Technique for effectively providing maintenance and information to vehicles |
CA2322007C (en) | 1998-12-23 | 2009-02-10 | American Calcar Inc. | Technique for effective communications with, and provision of global positioning system (gps) based advertising information to, automobiles |
US6574734B1 (en) | 1998-12-28 | 2003-06-03 | International Business Machines Corporation | Method and apparatus for securing access to automotive devices and software services |
US6806977B1 (en) | 1998-12-31 | 2004-10-19 | Automated Business Companies | Multiple integrated machine system |
US6445308B1 (en) | 1999-01-12 | 2002-09-03 | Toyota Jidosha Kabushiki Kaisha | Positional data utilizing inter-vehicle communication method and traveling control apparatus |
JP3555476B2 (en) | 1999-01-12 | 2004-08-18 | トヨタ自動車株式会社 | Travel control device for vehicles |
US6487717B1 (en) | 1999-01-15 | 2002-11-26 | Cummins, Inc. | System and method for transmission of application software to an embedded vehicle computer |
US6198996B1 (en) | 1999-01-28 | 2001-03-06 | International Business Machines Corporation | Method and apparatus for setting automotive performance tuned preferences set differently by a driver |
DE19909157A1 (en) | 1999-03-02 | 2000-09-21 | Daimler Chrysler Ag | Distributed vehicle information processing and control system |
US6161071A (en) | 1999-03-12 | 2000-12-12 | Navigation Technologies Corporation | Method and system for an in-vehicle computing architecture |
US6968513B1 (en) | 1999-03-18 | 2005-11-22 | Shopntown.Com, Inc. | On-line localized business referral system and revenue generation system |
JP4258585B2 (en) | 1999-03-19 | 2009-04-30 | 株式会社エクォス・リサーチ | Destination setting device |
US6097285A (en) | 1999-03-26 | 2000-08-01 | Lucent Technologies Inc. | Automotive auditory feedback of changing conditions outside the vehicle cabin |
US6181994B1 (en) | 1999-04-07 | 2001-01-30 | International Business Machines Corporation | Method and system for vehicle initiated delivery of advanced diagnostics based on the determined need by vehicle |
US6233468B1 (en) | 1999-04-09 | 2001-05-15 | E. Lead Electronic Co., Ltd. | Hand-free system capable of preventing a vehicle's automatic antenna from random operation |
SE514264C2 (en) | 1999-05-07 | 2001-01-29 | Ericsson Telefon Ab L M | A communication system |
DE19922608A1 (en) | 1999-05-17 | 2000-11-23 | Media Praesent Ursula Nitzsche | Wireless emergency signal transmission, especially to or between vehicles, involves using predefined coded RDS format message at low power in VHF radio band, preferably using free frequency |
US7257426B1 (en) | 1999-05-26 | 2007-08-14 | Johnson Controls Technology Company | Wireless communications systems and method |
DE60010080T3 (en) | 1999-06-01 | 2009-10-08 | Continental Automotive Systems US, Inc., Auburn Hills | PORTABLE INFORMATION DEVICE FOR DRIVERS |
US6182006B1 (en) | 1999-06-01 | 2001-01-30 | Navigation Technologies Corporation | Navigation system remote control unit with data caddy functionality |
US6266617B1 (en) | 1999-06-10 | 2001-07-24 | Wayne W. Evans | Method and apparatus for an automatic vehicle location, collision notification and synthetic voice |
US6892230B1 (en) | 1999-06-11 | 2005-05-10 | Microsoft Corporation | Dynamic self-configuration for ad hoc peer networking using mark-up language formated description messages |
US6754183B1 (en) | 1999-06-14 | 2004-06-22 | Sun Microsystems, Inc. | System and method for integrating a vehicle subnetwork into a primary network |
US6370449B1 (en) | 1999-06-14 | 2002-04-09 | Sun Microsystems, Inc. | Upgradable vehicle component architecture |
US6430164B1 (en) | 1999-06-17 | 2002-08-06 | Cellport Systems, Inc. | Communications involving disparate protocol network/bus and device subsystems |
US6571136B1 (en) | 1999-06-19 | 2003-05-27 | International Business Machines Corporation | Virtual network adapter |
JP3515926B2 (en) | 1999-06-23 | 2004-04-05 | 本田技研工業株式会社 | Vehicle periphery monitoring device |
DE19931161A1 (en) | 1999-07-06 | 2001-01-11 | Volkswagen Ag | Distance-sensitive, speed-controlled motor-vehicle road travel method, involves evaluation of predictive data about road conditions |
AU6346400A (en) | 1999-07-15 | 2001-02-05 | Richard B. Himmelstein | Communication device for efficiently accessing internet resources |
US7272637B1 (en) | 1999-07-15 | 2007-09-18 | Himmelstein Richard B | Communication system and method for efficiently accessing internet resources |
EP1071228B1 (en) | 1999-07-20 | 2009-04-15 | Texas Instruments Inc. | Wireless network with steerable antenna calibration over independent control path |
US6166627A (en) | 1999-07-20 | 2000-12-26 | Reeley; Ronald B. | Mobile detection and alert system |
US8648692B2 (en) | 1999-07-23 | 2014-02-11 | Seong Sang Investments Llc | Accessing an automobile with a transponder |
US6952155B2 (en) | 1999-07-23 | 2005-10-04 | Himmelstein Richard B | Voice-controlled security system with proximity detector |
US6496107B1 (en) | 1999-07-23 | 2002-12-17 | Richard B. Himmelstein | Voice-controlled vehicle control system |
US7080050B1 (en) | 1999-08-05 | 2006-07-18 | Barter Securities | Electronic bartering system |
US6429789B1 (en) | 1999-08-09 | 2002-08-06 | Ford Global Technologies, Inc. | Vehicle information acquisition and display assembly |
JP3788203B2 (en) | 1999-08-10 | 2006-06-21 | 日産自動車株式会社 | Hand-free telephone equipment for automobiles |
US6297732B2 (en) | 1999-09-08 | 2001-10-02 | Precision Navigation, Inc. | Radar/laser detection device with multi-sensing and reporting capability |
US6647270B1 (en) | 1999-09-10 | 2003-11-11 | Richard B. Himmelstein | Vehicletalk |
US6754690B2 (en) | 1999-09-16 | 2004-06-22 | Honeywell, Inc. | Method for time partitioned application scheduling in a computer operating system |
US7904569B1 (en) | 1999-10-06 | 2011-03-08 | Gelvin David C | Method for remote access of vehicle components |
JP2003529054A (en) | 1999-10-19 | 2003-09-30 | アメリカン カルカー インコーポレイティド | Effective navigation technology based on user preferences |
US6574610B1 (en) | 1999-10-19 | 2003-06-03 | Motorola, Inc. | Trusted elements within a distributed bandwidth system |
US6614349B1 (en) | 1999-12-03 | 2003-09-02 | Airbiquity Inc. | Facility and method for tracking physical assets |
DE69942507D1 (en) | 1999-12-06 | 2010-07-29 | Ericsson Telefon Ab L M | Intelligent production of piconets |
US7024363B1 (en) | 1999-12-14 | 2006-04-04 | International Business Machines Corporation | Methods and apparatus for contingent transfer and execution of spoken language interfaces |
US6611755B1 (en) * | 1999-12-19 | 2003-08-26 | Trimble Navigation Ltd. | Vehicle tracking, communication and fleet management system |
US6559773B1 (en) | 1999-12-21 | 2003-05-06 | Visteon Global Technologies, Inc. | Reconfigurable display architecture with spontaneous reconfiguration |
JP2001195699A (en) | 2000-01-14 | 2001-07-19 | Yazaki Corp | Vehicle circumference monitor device and recording medium for stored with vehicle collision danger judgement processing program |
US6526335B1 (en) | 2000-01-24 | 2003-02-25 | G. Victor Treyz | Automobile personal computer systems |
GB2358766B (en) | 2000-01-26 | 2004-03-31 | Hewlett Packard Co | Cost-sensitive control of data transfer involving a mobile entity |
US6326903B1 (en) | 2000-01-26 | 2001-12-04 | Dave Gross | Emergency vehicle traffic signal pre-emption and collision avoidance system |
EP1264464A2 (en) | 2000-02-03 | 2002-12-11 | Openwave Systems (ROI) Limited | A network-based billing method and system |
IT1319895B1 (en) | 2000-02-08 | 2003-11-12 | Bottero Spa | GROUP FOR THE CLASSIFICATION AND TRANSFER OF GLASS SHEETS. |
US7483964B1 (en) | 2000-02-25 | 2009-01-27 | Nortel Networks, Limited | System, device, and method for providing personalized services in a communication system |
US6748278B1 (en) | 2000-03-13 | 2004-06-08 | Microsoft Corporation | Remote controlled system with computer-based remote control facilitator |
ATE468726T1 (en) | 2000-03-21 | 2010-06-15 | Airbiquity Inc | VOICE FREQUENCY BAND MODEM FOR DATA TRANSMISSION OVER DIGITAL WIRELESS NETWORKS |
US6876642B1 (en) | 2000-03-27 | 2005-04-05 | Delphi Technologies, Inc. | In-vehicle wireless local area network |
US7187947B1 (en) | 2000-03-28 | 2007-03-06 | Affinity Labs, Llc | System and method for communicating selected information to an electronic device |
US6980092B2 (en) | 2000-04-06 | 2005-12-27 | Gentex Corporation | Vehicle rearview mirror assembly incorporating a communication system |
US6937732B2 (en) | 2000-04-07 | 2005-08-30 | Mazda Motor Corporation | Audio system and its contents reproduction method, audio apparatus for a vehicle and its contents reproduction method, portable audio apparatus, computer program product and computer-readable storage medium |
US6785551B1 (en) | 2000-04-07 | 2004-08-31 | Ford Motor Company | Method of providing dynamic regionally relevant data to a mobile environment |
JP3747734B2 (en) | 2000-04-11 | 2006-02-22 | マツダ株式会社 | SOUND DEVICE, MUSIC DATA REPRODUCING METHOD, AUTOMOTIVE SOUND SYSTEM, AND ITS PROGRAM STORAGE MEDIUM |
US7216347B1 (en) | 2000-04-17 | 2007-05-08 | International Business Machines Corporation | Method and apparatus for prioritizing print jobs from multiple printer input channels |
US6292747B1 (en) | 2000-04-20 | 2001-09-18 | International Business Machines Corporation | Heterogeneous wireless network for traveler information |
US7000469B2 (en) | 2000-04-21 | 2006-02-21 | Intersense, Inc. | Motion-tracking |
US20020144010A1 (en) | 2000-05-09 | 2002-10-03 | Honeywell International Inc. | Communication handling in integrated modular avionics |
US20020012329A1 (en) | 2000-06-02 | 2002-01-31 | Timothy Atkinson | Communications apparatus interface and method for discovery of remote devices |
US6765495B1 (en) | 2000-06-07 | 2004-07-20 | Hrl Laboratories, Llc | Inter vehicle communication system |
US7006950B1 (en) | 2000-06-12 | 2006-02-28 | Siemens Corporate Research, Inc. | Statistical modeling and performance characterization of a real-time dual camera surveillance system |
US6417782B1 (en) | 2000-06-22 | 2002-07-09 | Larry Dean Darnall | Driver's emergency alert system |
US7089206B2 (en) | 2000-06-30 | 2006-08-08 | Ubs Ag | Trade allocation |
US6445983B1 (en) * | 2000-07-07 | 2002-09-03 | Case Corporation | Sensor-fusion navigator for automated guidance of off-road vehicles |
US7375728B2 (en) | 2001-10-01 | 2008-05-20 | University Of Minnesota | Virtual mirror |
US6725031B2 (en) | 2000-07-21 | 2004-04-20 | Telemac Corporation | Method and system for data rating for wireless devices |
US6816458B1 (en) | 2000-09-13 | 2004-11-09 | Harris Corporation | System and method prioritizing message packets for transmission |
US7610331B1 (en) | 2000-09-13 | 2009-10-27 | Lightsurf Technologies, Inc. | System and method for dynamic uploading and execution of applications and drivers between devices |
US7158956B1 (en) | 2000-09-20 | 2007-01-02 | Himmelstein Richard B | Electronic real estate bartering system |
US6362748B1 (en) | 2000-09-27 | 2002-03-26 | Lite Vision Corporation | System for communicating among vehicles and a communication system control center |
US6580973B2 (en) * | 2000-10-14 | 2003-06-17 | Robert H. Leivian | Method of response synthesis in a driver assistance system |
JP3834463B2 (en) | 2000-10-13 | 2006-10-18 | 株式会社日立製作所 | In-vehicle failure alarm reporting system |
US6449541B1 (en) | 2000-10-17 | 2002-09-10 | Microsoft Corporation | Application-to-component communications helper in a vehicle computer system |
US6756998B1 (en) | 2000-10-19 | 2004-06-29 | Destiny Networks, Inc. | User interface and method for home automation system |
JP3837282B2 (en) | 2000-10-24 | 2006-10-25 | 株式会社ケーヒン | Fuel injection valve |
US7493645B1 (en) | 2000-10-27 | 2009-02-17 | Audiovox Corporation | Console with monitor and wireless receiver |
US6678892B1 (en) | 2000-10-27 | 2004-01-13 | Audivox Corporation | Multimedia entertainment unit for use in a vehicle |
USD448366S1 (en) | 2000-10-31 | 2001-09-25 | Airbiquity Inc. | Accessory module for a cellular telephone handset |
US20020086706A1 (en) | 2000-11-15 | 2002-07-04 | Ming-Feng Chen | Mobile device server |
US20020105423A1 (en) | 2000-12-05 | 2002-08-08 | Rast Rodger H. | Reaction advantage anti-collision systems and methods |
US20020070852A1 (en) | 2000-12-12 | 2002-06-13 | Pearl I, Llc | Automobile display control system |
US20020083143A1 (en) | 2000-12-13 | 2002-06-27 | Philips Electronics North America Corporation | UPnP architecture for heterogeneous networks of slave devices |
JP2002189075A (en) | 2000-12-20 | 2002-07-05 | Fujitsu Ten Ltd | Method for detecting stationary on-road object |
US6801994B2 (en) | 2000-12-20 | 2004-10-05 | Microsoft Corporation | Software management systems and methods for automotive computing devices |
EP1216899A1 (en) | 2000-12-22 | 2002-06-26 | Ford Global Technologies, Inc. | Communication system for use with a vehicle |
US7165109B2 (en) | 2001-01-12 | 2007-01-16 | Microsoft Corporation | Method and system to access software pertinent to an electronic peripheral device based on an address stored in a peripheral device |
JP4399987B2 (en) | 2001-01-25 | 2010-01-20 | 株式会社デンソー | Fail-safe system for vehicle integrated control |
US6799092B2 (en) | 2001-02-21 | 2004-09-28 | Ford Global Technologies, Llc | Rollover stability control for an automotive vehicle using rear wheel steering and brake control |
US8849242B2 (en) | 2001-02-23 | 2014-09-30 | Alcatel Lucent | System and method for charging for directed provisioning of user applications on limited-resource devices |
US7171189B2 (en) | 2001-02-28 | 2007-01-30 | Nortel Networks Limited | Location based billing of data services in a mobile telecommunication system |
US6734799B2 (en) | 2001-03-01 | 2004-05-11 | Trw Inc. | Apparatus and method for responding to the health and fitness of a driver of a vehicle |
US6542814B2 (en) | 2001-03-07 | 2003-04-01 | Horizon Navigation, Inc. | Methods and apparatus for dynamic point of interest display |
US7120129B2 (en) | 2001-03-13 | 2006-10-10 | Microsoft Corporation | System and method for achieving zero-configuration wireless computing and computing device incorporating same |
US6708100B2 (en) | 2001-03-14 | 2004-03-16 | Raytheon Company | Safe distance algorithm for adaptive cruise control |
US7073044B2 (en) | 2001-03-30 | 2006-07-04 | Intel Corporation | Method and apparatus for sharing TLB entries |
US6895238B2 (en) | 2001-03-30 | 2005-05-17 | Motorola, Inc. | Method for providing entertainment to a portable device |
US6496117B2 (en) | 2001-03-30 | 2002-12-17 | Koninklijke Philips Electronics N.V. | System for monitoring a driver's attention to driving |
US6629033B2 (en) | 2001-04-24 | 2003-09-30 | Medius, Inc. | Open communication system for real-time multiprocessor applications |
US7146260B2 (en) | 2001-04-24 | 2006-12-05 | Medius, Inc. | Method and apparatus for dynamic configuration of multiprocessor system |
US6721658B2 (en) * | 2001-06-14 | 2004-04-13 | The Johns Hopkins University | Integrated navigation and communication system for use in distributed spacecraft systems |
WO2002103316A2 (en) | 2001-06-15 | 2002-12-27 | Carcheckup, Llc | Auto diagnosis method and device |
US6973030B2 (en) | 2001-06-20 | 2005-12-06 | Motorola, Inc. | Method and apparatus for controlling multiple logical data flow in a variable data rate environment |
US7283567B2 (en) | 2001-06-22 | 2007-10-16 | Airbiquity Inc. | Network delay identification method and apparatus |
US6615137B2 (en) | 2001-06-26 | 2003-09-02 | Medius, Inc. | Method and apparatus for transferring information between vehicles |
US6778073B2 (en) | 2001-06-26 | 2004-08-17 | Medius, Inc. | Method and apparatus for managing audio devices |
US6792351B2 (en) | 2001-06-26 | 2004-09-14 | Medius, Inc. | Method and apparatus for multi-vehicle communication |
US6641087B1 (en) | 2001-10-09 | 2003-11-04 | Cubic Defense Systems, Inc. | Anti-hijacking system operable in emergencies to deactivate on-board flight controls and remotely pilot aircraft utilizing autopilot |
US7283904B2 (en) | 2001-10-17 | 2007-10-16 | Airbiquity, Inc. | Multi-sensor fusion |
US7099796B2 (en) * | 2001-10-22 | 2006-08-29 | Honeywell International Inc. | Multi-sensor information fusion technique |
US7480501B2 (en) | 2001-10-24 | 2009-01-20 | Statsignal Ipc, Llc | System and method for transmitting an emergency message over an integrated wireless network |
US8489063B2 (en) | 2001-10-24 | 2013-07-16 | Sipco, Llc | Systems and methods for providing emergency messages to a mobile device |
US7215965B2 (en) | 2001-11-01 | 2007-05-08 | Airbiquity Inc. | Facility and method for wireless transmission of location data in a voice channel of a digital wireless telecommunications network |
US6778924B2 (en) | 2001-11-06 | 2004-08-17 | Honeywell International Inc. | Self-calibrating inertial measurement system method and apparatus |
US20030158614A1 (en) | 2002-02-18 | 2003-08-21 | Friel Joseph T | Audio system for vehicle with battery-backed storage |
WO2003077583A1 (en) | 2002-03-13 | 2003-09-18 | Nokia Coporation | Method and apparatus for performing handover in a bluetooth radiocommunication system |
DE10217294A1 (en) | 2002-04-18 | 2003-11-06 | Sick Ag | sensor orientation |
US7178049B2 (en) | 2002-04-24 | 2007-02-13 | Medius, Inc. | Method for multi-tasking multiple Java virtual machines in a secure environment |
US6771208B2 (en) | 2002-04-24 | 2004-08-03 | Medius, Inc. | Multi-sensor system |
US6829568B2 (en) * | 2002-04-26 | 2004-12-07 | Simon Justin Julier | Method and apparatus for fusing signals with partially known independent error components |
US7269188B2 (en) | 2002-05-24 | 2007-09-11 | Airbiquity, Inc. | Simultaneous voice and data modem |
US6782315B2 (en) | 2002-06-19 | 2004-08-24 | Ford Global Technologies, Llc | Method and apparatus for compensating misalignments of a sensor system used in a vehicle dynamic control system |
US20040029545A1 (en) | 2002-08-09 | 2004-02-12 | Anderson Jon J. | Method and system for leaving a communication channel in a wireless communications system |
USD479228S1 (en) | 2002-09-03 | 2003-09-02 | Airbiquity Inc. | Hands-free kit for mounting a wireless device in a vehicle |
GB0227672D0 (en) | 2002-11-27 | 2003-01-08 | Ricardo Consulting Eng | Improved engine management |
US7379707B2 (en) | 2004-08-26 | 2008-05-27 | Raysat Antenna Systems, L.L.C. | System for concurrent mobile two-way data communications and TV reception |
US20040123113A1 (en) | 2002-12-18 | 2004-06-24 | Svein Mathiassen | Portable or embedded access and input devices and methods for giving access to access limited devices, apparatuses, appliances, systems or networks |
MXPA05008702A (en) | 2003-02-21 | 2005-10-05 | Gentex Corp | Automatic vehicle exterior light control system assemblies. |
US7239949B2 (en) | 2003-02-26 | 2007-07-03 | Ford Global Technologies, Llc | Integrated sensing system |
US6906619B2 (en) | 2003-02-27 | 2005-06-14 | Motorola, Inc. | Visual attention influenced condition indicia apparatus and method |
JP3928571B2 (en) | 2003-03-14 | 2007-06-13 | トヨタ自動車株式会社 | Vehicle driving assistance device |
US7263332B1 (en) | 2003-04-09 | 2007-08-28 | Cool & Useful Products, Llc | Methods and apparatus for communicating in a vehicle and other radio environments |
US7079993B2 (en) | 2003-04-29 | 2006-07-18 | Daniel H. Wagner Associates, Inc. | Automated generator of optimal models for the statistical analysis of data |
US7343160B2 (en) | 2003-09-29 | 2008-03-11 | Broadcom Corporation | System and method for servicing communications using both fixed and mobile wireless networks |
US20050070221A1 (en) | 2003-09-30 | 2005-03-31 | Upton Michael P. | Vehicular repeater multi-unit system and method for allowing the first vehicular repeater unit on-scene to remain priority |
US7689321B2 (en) * | 2004-02-13 | 2010-03-30 | Evolution Robotics, Inc. | Robust sensor fusion for mapping and localization in a simultaneous localization and mapping (SLAM) system |
ES2238936B1 (en) * | 2004-02-27 | 2006-11-16 | INSTITUTO NACIONAL DE TECNICA AEROESPACIAL "ESTEBAN TERRADAS" | SYSTEM AND METHOD OF FUSION OF SENSORS TO ESTIMATE POSITION, SPEED AND ORIENTATION OF A VEHICLE, ESPECIALLY AN AIRCRAFT. |
US7289906B2 (en) | 2004-04-05 | 2007-10-30 | Oregon Health & Science University | Navigation system applications of sigma-point Kalman filters for nonlinear estimation and sensor fusion |
US7526103B2 (en) | 2004-04-15 | 2009-04-28 | Donnelly Corporation | Imaging system for vehicle |
US7260501B2 (en) * | 2004-04-21 | 2007-08-21 | University Of Connecticut | Intelligent model-based diagnostics for system monitoring, diagnosis and maintenance |
US20050260984A1 (en) | 2004-05-21 | 2005-11-24 | Mobile Satellite Ventures, Lp | Systems and methods for space-based use of terrestrial cellular frequency spectrum |
US7614055B2 (en) | 2004-06-14 | 2009-11-03 | Alcatel-Lucent Usa Inc. | Selecting a processor to run an executable of a distributed software application upon startup of the distributed software application |
US7664315B2 (en) | 2004-11-03 | 2010-02-16 | Tyzx, Inc. | Integrated image processor |
US7337650B1 (en) | 2004-11-09 | 2008-03-04 | Medius Inc. | System and method for aligning sensors on a vehicle |
US7183969B2 (en) * | 2004-12-22 | 2007-02-27 | Raytheon Company | System and technique for calibrating radar arrays |
EP1851565B1 (en) * | 2005-01-18 | 2009-10-14 | Marinvent Corporation | Method and apparatus for performing a sensor fusion to provide a position of a target-of-interest |
US7508810B2 (en) | 2005-01-31 | 2009-03-24 | Airbiquity Inc. | Voice channel control of wireless packet data communications |
US8014942B2 (en) | 2005-06-15 | 2011-09-06 | Airbiquity, Inc. | Remote destination programming for vehicle navigation |
US8254301B2 (en) | 2005-11-22 | 2012-08-28 | Telcordia Technologies, Inc. | Group-header based method to organize local peer group of vehicles for inter-vehicle communication |
US8554920B2 (en) | 2005-11-22 | 2013-10-08 | Telcordia Technologies, Inc. | Linked equivalent cell header-based approach and protocol for organizing an ad-hoc network |
US7924934B2 (en) | 2006-04-07 | 2011-04-12 | Airbiquity, Inc. | Time diversity voice channel data communications |
US20070260373A1 (en) | 2006-05-08 | 2007-11-08 | Langer William J | Dynamic vehicle durability testing and simulation |
US20070260372A1 (en) | 2006-05-08 | 2007-11-08 | Langer William J | Dynamic vehicle suspension system testing and simulation |
US8108092B2 (en) | 2006-07-14 | 2012-01-31 | Irobot Corporation | Autonomous behaviors for a remote vehicle |
GB2441802A (en) * | 2006-09-13 | 2008-03-19 | Marine & Remote Sensing Soluti | Safety system for a vehicle |
US7979858B2 (en) | 2006-10-03 | 2011-07-12 | Sas Institute Inc. | Systems and methods for executing a computer program that executes multiple processes in a multi-processor environment |
US7579942B2 (en) * | 2006-10-09 | 2009-08-25 | Toyota Motor Engineering & Manufacturing North America, Inc. | Extra-vehicular threat predictor |
US9217868B2 (en) | 2007-01-12 | 2015-12-22 | Kopin Corporation | Monocular display device |
DE102007007266B4 (en) * | 2007-02-14 | 2016-02-25 | Airbus Defence and Space GmbH | Method for evaluating sensor measured values |
CA2695841C (en) * | 2007-08-06 | 2016-11-08 | Trx Systems, Inc. | Locating, tracking, and/or monitoring personnel and/or assets both indoors and outdoors |
US20090090592A1 (en) | 2007-10-05 | 2009-04-09 | Gm Global Technology Operations, Inc. | High-Frequency Anti-Lock Clutch System and Method |
US8374783B2 (en) * | 2007-10-10 | 2013-02-12 | Leica Geosystems Ag | Systems and methods for improved position determination of vehicles |
MX2010003700A (en) | 2007-10-20 | 2010-04-21 | Airbiquity Inc | Wireless in-band signaling with in-vehicle systems. |
US8636670B2 (en) * | 2008-05-13 | 2014-01-28 | The Invention Science Fund I, Llc | Circulatory monitoring systems and methods |
AU2009200855B2 (en) * | 2008-03-04 | 2014-05-15 | Technological Resources Pty. Limited | Method and system for exploiting information from heterogeneous sources |
EP2107503A1 (en) * | 2008-03-31 | 2009-10-07 | Harman Becker Automotive Systems GmbH | Method and device for generating a real time environment model for vehicles |
US8345889B2 (en) | 2008-04-29 | 2013-01-01 | Oliver Joen-An Ma | Wireless transmission-AV system of outdoor furniture |
US20090319063A1 (en) | 2008-06-23 | 2009-12-24 | Yang Pan | Splittable portable media player as remote control |
US8260515B2 (en) * | 2008-07-24 | 2012-09-04 | GM Global Technology Operations LLC | Adaptive vehicle control system with driving style recognition |
US8165728B2 (en) * | 2008-08-19 | 2012-04-24 | The United States Of America As Represented By The Secretary Of The Navy | Method and system for providing a GPS-based position |
US7983310B2 (en) | 2008-09-15 | 2011-07-19 | Airbiquity Inc. | Methods for in-band signaling through enhanced variable-rate codecs |
US8063347B1 (en) * | 2009-01-19 | 2011-11-22 | Lockheed Martin Corporation | Sensor independent engagement decision processing |
US8244408B2 (en) * | 2009-03-09 | 2012-08-14 | GM Global Technology Operations LLC | Method to assess risk associated with operating an autonomic vehicle control system |
US8073440B2 (en) | 2009-04-27 | 2011-12-06 | Airbiquity, Inc. | Automatic gain control in a personal navigation device |
WO2011011544A1 (en) | 2009-07-21 | 2011-01-27 | Scott Ferrill Tibbitts | Method and system for controlling a mobile communication device in a moving vehicle |
US8838332B2 (en) | 2009-10-15 | 2014-09-16 | Airbiquity Inc. | Centralized management of motor vehicle software applications and services |
US8204927B1 (en) * | 2010-03-15 | 2012-06-19 | California Institute Of Technology | System and method for cognitive processing for data fusion |
US20110238308A1 (en) * | 2010-03-26 | 2011-09-29 | Isaac Thomas Miller | Pedal navigation using leo signals and body-mounted sensors |
US9117190B2 (en) * | 2011-03-31 | 2015-08-25 | United Parcel Service Of America, Inc. | Calculating speed and travel times with travel delays |
US9070100B2 (en) * | 2011-03-31 | 2015-06-30 | United Parcel Service Of America, Inc. | Calculating speed and travel times with travel delays |
US8996287B2 (en) * | 2011-03-31 | 2015-03-31 | United Parcel Service Of America, Inc. | Calculating speed and travel times with travel delays |
CA2811831A1 (en) | 2012-04-09 | 2013-10-09 | Odm Technology Inc. | System and method for portable instrumentation |
US8948995B2 (en) * | 2012-06-28 | 2015-02-03 | Toyota Motor Engineering & Manufacturing North America, Inc. | Preceding vehicle state prediction |
US9020755B1 (en) * | 2013-12-17 | 2015-04-28 | GM Global Technology Operations LLC | AD-HOC differential GPS referencing using parked vehicles |
-
2010
- 2010-05-07 US US12/776,137 patent/US9358924B1/en active Active
-
2016
- 2016-05-04 US US15/146,402 patent/US20160245949A1/en not_active Abandoned
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019083513A1 (en) * | 2017-10-24 | 2019-05-02 | Nissan North America, Inc. | Localization determination for vehicle operation |
JP2021503404A (en) * | 2017-10-24 | 2021-02-12 | ニッサン ノース アメリカ,インク | Positioning determination for vehicle movement |
US11112259B2 (en) * | 2017-10-24 | 2021-09-07 | Nissan North America, Inc. | Localization determination for vehicle operation |
CN109177982A (en) * | 2018-10-31 | 2019-01-11 | 吉林大学 | Consider the vehicle driving Hazard degree assessment method of driving style |
CN113139299A (en) * | 2021-05-13 | 2021-07-20 | 深圳市道通科技股份有限公司 | Sensor fusion verification method and device and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
US9358924B1 (en) | 2016-06-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8417490B1 (en) | System and method for the configuration of an automotive vehicle with modeled sensors | |
US20170060810A1 (en) | System and method for the operation of an automotive vehicle system with modeled sensors | |
US20160245949A1 (en) | System and method for modeling advanced automotive safety systems | |
Khaleghi et al. | Multisensor data fusion: A review of the state-of-the-art | |
US20220289218A1 (en) | Performance testing for robotic systems | |
Yi et al. | Distributed multi-sensor fusion of PHD filters with different sensor fields of view | |
Llinas | Assessing the performance of multisensor fusion processes | |
US8781992B2 (en) | System and method for scaled multinomial-dirichlet bayesian evidence fusion | |
Hernández-Romero et al. | A probabilistic approach to measure aircraft conflict severity considering wind forecast uncertainty | |
Wang et al. | Detection-guided multi-target Bayesian filter | |
Granström et al. | A tutorial on multiple extended object tracking | |
Kreucher et al. | Adaptive multi-modality sensor scheduling for detection and tracking of smart targets | |
Nguyen et al. | Classification and tracking of moving ground vehicles | |
Appriou | Situation assessment based on spatially ambiguous multisensor measurements | |
Fantacci et al. | Multiple-model algorithms for distributed tracking of a maneuvering target | |
Li et al. | A generalized labelled multi-Bernoulli filter for extended targets with unknown clutter rate and detection profile | |
Giza et al. | Entropy-based space object data association using an adaptive Gaussian sum filter | |
Zhang et al. | A real-time multiple vehicle tracking method for traffic congestion identification | |
Shi et al. | Multisensor distributed out-of-sequence-tracks fusion with track origin uncertainty | |
Altendorfer et al. | A confidence measure for vehicle tracking based on a generalization of Bayes estimation | |
Katsilieris et al. | Threat-based sensor management for joint target tracking and classification | |
CN115220002A (en) | Multi-target data association tracking method and related device for fixed single station | |
Bertsimas et al. | Multitarget tracking via mixed integer optimization | |
Maurer et al. | Sensor fusion architectures for ballistic missile defense | |
Koch | Advanced target tracking techniques |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: EAGLE HARBOR HOLDINGS, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PRESTON, DAN ALAN;PRESTON, JOSEPH;SCHOFIELD, KENNETH;AND OTHERS;SIGNING DATES FROM 20100526 TO 20100617;REEL/FRAME:038818/0071 |
|
AS | Assignment |
Owner name: CLAROVIA TECHNOLOGIES, LLC, WASHINGTON Free format text: SECURITY INTEREST;ASSIGNOR:EAGLE HARBOR HOLDINGS, LLC;REEL/FRAME:041565/0469 Effective date: 20170127 |
|
AS | Assignment |
Owner name: EAGLE HARBOR HOLDINGS, LLC, WASHINGTON Free format text: CORRECTING IMPROPER SECURITY INTEREST;ASSIGNOR:EAGLE HARBOR HOLDINGS, LLC;REEL/FRAME:041651/0884 Effective date: 20170207 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |