CN108859966A - Panorama reverse image control method, server-side and client - Google Patents
Panorama reverse image control method, server-side and client Download PDFInfo
- Publication number
- CN108859966A CN108859966A CN201810900941.9A CN201810900941A CN108859966A CN 108859966 A CN108859966 A CN 108859966A CN 201810900941 A CN201810900941 A CN 201810900941A CN 108859966 A CN108859966 A CN 108859966A
- Authority
- CN
- China
- Prior art keywords
- control
- module
- data
- information
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000013480 data collection Methods 0.000 claims abstract description 28
- 238000006243 chemical reaction Methods 0.000 claims abstract description 26
- 238000012544 monitoring process Methods 0.000 claims abstract description 7
- 238000000605 extraction Methods 0.000 claims description 21
- 230000008569 process Effects 0.000 claims description 16
- 238000012546 transfer Methods 0.000 claims description 15
- 239000000284 extract Substances 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 13
- 230000003993 interaction Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 8
- 230000000694 effects Effects 0.000 description 6
- 230000002618 waking effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/806—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for aiding parking
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Mechanical Engineering (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
A kind of panorama reverse image control method, interaction end and control terminal, including：When monitoring control display triggering information, association voice characteristics information and command information obtain voice recognition data；Reversing control voice data is obtained, data conversion is carried out to reversing voice control data according to voice recognition data, obtains control decision information；Control decision information is converted into control instruction information according to panorama control protocol；Control CAN message is converted to control instruction information data, control CAN message is sent to data collection facility by vehicle CAN bus.The present invention, which solves, exists in the prior art that the reverse image adaptability of technology is lower, usage mode and the more single technical problem of image control function.
Description
Technical field
The present invention relates to a kind of reversing control methods, more particularly to a kind of panorama reverse image control method, server-side
And client.
Background technique
With the continuous development of social and economic level, person, which uses, to be driven to become as trip mode more and more frequently, due to
The technology attention level of parking of automobile orientation is increasingly improved, it is embedding in photoelectric sensor, video processing technique and automobile
Enter the continuous fast development of formula software development technique, reverse image technology gradually obtains in each middle conventional passenger vehicle universal
Installation and use, for driver in schedule with important technology and safety guarantee is provided in vehicle docking process, due to city vapour
The number of elements of vehicle ownership is promoted, and parking stall setting is crowded, and accuracy and safety to driver's shut-down operation propose higher
It is required that often inevitably being needed due to the narrow equal reality factors in parking stall using reversing shadow in stopping routine operating process
It is existing to assist driver that the view modes such as side mirror and rearview mirror is combined to coordinate reversing orientation and specific angle as technology
Reverse image technical functionality is single, needs to rely on the different vehicle-mounted camera of driver's manual switching.Reduce vehicle parking
Efficiency and effect of parking form serious restriction to electric vehicle trip is driven.It is parking simultaneously as often there is driver
It cannot be considered in terms of in the process and manually adjust switching camera and steering wheel operation, the inconvenience for causing safety problem and car owner to be parked.
To sum up, the prior art have the characteristics that rely on manually handover operation, automatization level it is low, deposit in the prior art
It is lower in the reverse image adaptability of technology, usage mode and the more single technical problem of image control function.
Summary of the invention
The shortcomings that in view of the above prior art, the purpose of the present invention is to provide a kind of panorama reverse image control method,
Server-side and client, applied in the start-up course of motor vehicles, to solve reverse image technology existing in the prior art
Applicability is lower, and usage mode and the more single technical problem of image control function, the present invention provide the control of panorama reverse image
Method, server-side and client processed, a kind of panorama reverse image control method, interaction end and control terminal, including：
When monitoring control display triggering information, association voice characteristics information and command information obtain speech recognition number
According to；
Reversing control voice data is obtained, data conversion is carried out to reversing voice control data according to voice recognition data,
Obtain control decision information；
Control decision information is converted into control instruction information according to panorama control protocol；
Control CAN message is converted to control instruction information data, control CAN message is sent out by vehicle CAN bus
It send to data collection facility.
In one embodiment of the present invention, monitor control display triggering information when, association voice characteristics information with
Command information obtains voice recognition data, specifically includes：
Receive display triggering information；
Voice characteristics information is preset according to practical operation type, saves voice characteristics information；
The acquisition instruction information from input record；
It is associated with voice characteristics information and command information, extracts the instruction features in command information；
Matching voice recognition data and instruction features obtain voice recognition data.
In one embodiment of the present invention, reversing control voice data is obtained, according to voice recognition data to reversing language
Sound control data carry out data conversion, obtain control decision information, specifically include：
Obtain operation audio file；
Parsing operation audio file, obtains operational attribute data；
Voice recognition data, matching operation attribute data and voice recognition data are obtained, instructions match information is obtained；
Voice control data are converted into control decision information according to instructions match information.
In one embodiment of the present invention, a kind of panorama reverse image control terminal, including：Speech recognition module, system
Decision-making module, instruction conversion module and instruction sending module；Speech recognition module, for monitoring control display triggering information,
When having control display triggering information, association voice characteristics information and command information obtain voice recognition data；System decision-making module,
For obtaining control voice data of moving backward, data conversion is carried out to reversing voice control data according to voice recognition data, is obtained
Control decision information, system decision-making module are connect with speech recognition module；Conversion module is instructed, for according to panorama control protocol
Control decision information is converted into control instruction information, instruction conversion module is connect with system decision-making module；Instruction sending module,
For converting to obtain control CAN message to control instruction information data, control CAN message is sent to number by vehicle CAN bus
According to collecting device, instruction sending module is connect with instruction conversion module.
In one embodiment of the present invention, speech recognition module includes：Triggering obtains module, type preserving module, refers to
Enable logging modle, instruction features extraction module and voice recognition data module；Triggering obtains module, for receiving display triggering letter
Breath；Type preserving module saves voice characteristics information for presetting voice characteristics information according to practical operation type；Instruction note
Module is recorded, for the acquisition instruction information from input record；Instruction features extraction module, for being associated with voice characteristics information and referring to
Information is enabled, the instruction features in command information are extracted, instruction features extraction module is connect with type preserving module, and instruction features mention
Modulus block is connect with instruction logging modle；Voice recognition data module is obtained for matching voice recognition data with instruction features
Voice recognition data, voice recognition data module are connect with instruction features extraction module.
In one embodiment of the present invention, system decision-making module includes：Audio interception module, refers to operational attribute module
Enable matching module and decision data module；Audio interception module, for obtaining operation audio file；Operational attribute module, is used for
Parsing operation audio file, obtains operational attribute data, operational attribute module is connect with audio interception module；Instructions match mould
Block obtains instructions match information, instructs for obtaining voice recognition data, matching operation attribute data and voice recognition data
Matching module is connect with operational attribute module；Decision data module, for being turned voice control data according to instructions match information
It is changed to control decision information, decision data module is connect with instructions match module.
In one embodiment of the present invention, a kind of panorama reverse image control data collection facility implementation method, application
In a data collection facility, method includes：
Data collection facility is opened, control display triggering information is sent；
Vehicle body image data is obtained by vehicle-mounted camera；
The control CAN message transmitted from vehicle CAN bus is received, corresponding vehicle body image is transferred according to control CAN message
Data are referred to for reversing process.
In one embodiment of the present invention, the control CAN message transmitted from vehicle CAN bus is received, according to control CAN
Message is transferred corresponding vehicle body image data and is referred to for reversing process, further includes：
Obtain control CAN message；
The image extracted in control CAN message transfers command information；
Command information is transferred according to image, and image is transferred into vehicle body image data on command information corresponding direction for display.
In one embodiment of the present invention, a kind of panorama reverse image control data collection facility, including：Trigger mode
Block, image acquiring module and control message receiving module；Trigger module is used to open data collection facility, sends control display
Trigger information；Image acquiring module, for obtaining vehicle body image data by vehicle-mounted camera；Control message receiving module, is used for
The control CAN message transmitted from vehicle CAN bus is received, corresponding vehicle body image data is transferred for falling according to control CAN message
The reference of vehicle process, control message receiving module are connect with image acquiring module.
In one embodiment of the present invention, control message receiving module includes：Control message obtains module, transfers instruction
Extraction module and image control module；Control message obtains module, for obtaining control CAN message；Instruction extraction module is transferred,
Command information is transferred for extracting the image in control CAN message, instruction extraction module is transferred and control message obtains module and connects
It connects；Image is transferred vehicle body shadow on command information corresponding direction for transferring command information according to image by image control module
For display, image control module is connect picture data with instruction extraction module is transferred.
As described above, a kind of panorama reverse image control method, server-side and client provided by the invention, have following
Beneficial effect：A kind of panorama reverse image control method provided by the invention, reply in stopping routine operating process often by
In the narrow equal reality factors in parking stall, it can be automatically controled reverse image and be mounted on the camera of vehicle body all directions to assist driving
Sail people and coordinate reversing orientation and specific angle in conjunction with the view modes such as side mirror and rearview mirror, can voice switch different vehicle-mounted take the photograph
As head.It improves the efficiency of vehicle parking and effect of parking, facilitates shut-down operation when driver drives to go on a journey.Meanwhile by
It can propose that a kind of voice exempts to wake up by driver's voice control, this programme in complete set reverse image control method provided by the invention
The method for controlling panorama reverse image, without passing through voice real-time control shadow on the basis of changing full-view image control protocol
It as display, exits and view angle switch, avoids in parking process existing in the prior art and cannot be considered in terms of and manually adjust switching
Camera and steering wheel operation, the inconvenience for causing safety problem and car owner to be parked.
To sum up, the present invention solve it is existing in the prior art rely on manually handover operation, automatization level are low
Feature, exists in the prior art that the reverse image adaptability of technology is lower, usage mode and the more single skill of image control function
Art problem.
Detailed description of the invention
Fig. 1 is shown as panorama reverse image control method step schematic diagram of the invention.
Fig. 2 is shown as the specific flow chart of step S1 in one embodiment in Fig. 1.
Fig. 3 is shown as the specific flow chart of step S2 in one embodiment in Fig. 1.
Fig. 4 is shown as panorama reverse image console module schematic diagram of the invention.
Fig. 5 is shown as the specific module diagram of speech recognition module 11 in one embodiment in Fig. 4.
Fig. 6 is shown as the specific module diagram of system decision-making module 12 in one embodiment in Fig. 4.
Fig. 7 is shown as panorama reverse image control data collection facility implementation method step schematic diagram of the invention.
Fig. 8 is shown as the specific flow chart of step S4 ' in one embodiment in Fig. 6.
Fig. 9 is shown as panorama reverse image control data collection facility module diagram of the invention.
Figure 10 is shown as the specific module diagram of control message receiving module 14 ' in one embodiment in Fig. 9.
Component label instructions
1 panorama reverse image control terminal
11 speech recognition modules
12 system decision-making modules
13 instruction conversion modules
14 instruction sending modules
111 triggerings obtain module
112 type preserving modules
113 instruction logging modles
114 instruction features extraction modules
115 voice recognition data modules
121 audio interception modules
122 operational attribute modules
123 instructions match modules
124 decision data modules
1 ' panorama reverse image controls data collection facility
11 ' trigger modules
12 ' image acquiring modules
13 ' control message receiving modules
141 ' control messages obtain module
142 ' transfer instruction extraction module
143 ' image control modules
Step numbers explanation
Fig. 1 S1~S4
Fig. 2 S11~S15
Fig. 3 S21~S24
Fig. 7 S1 '~S3 '
Fig. 8 S41 '~S43 '
Specific embodiment
Embodiments of the present invention are illustrated by particular specific embodiment below, those skilled in the art can be by this explanation
Content disclosed by book is understood other advantages and efficacy of the present invention easily.
Fig. 1 is please referred to Fig. 8, it should however be clear that this specification structure depicted in this specification institute accompanying drawings, only to cooperate specification institute
The content of announcement is not intended to limit the invention enforceable qualifications so that those skilled in the art understands and reads,
Therefore not having technical essential meaning, the modification of any structure, the change of proportionate relationship or the adjustment of size are not influencing this reality
It can be contained under novel the effect of can be generated and the purpose that can reach, should all still fall in disclosed technology contents
In the range of lid.Meanwhile in this specification it is cited such as " on ", " under ", " left side ", " right side ", " centre " and " one " term,
It is merely convenient to being illustrated for narration, rather than to limit the scope of the invention, relativeness is altered or modified,
It is changed under technology contents without essence, when being also considered as the enforceable scope of the present invention.
Referring to Fig. 1, panorama reverse image control method step schematic diagram of the invention is shown as, as shown in Figure 1, a kind of
Panorama reverse image control method, including：
S1, monitor control display triggering information when, association voice characteristics information and command information obtain speech recognition
Data by what common instruction was included there is the feature for instructing meaning and the original input data for including in command information to carry out
Association, identifies the command information for including in the voice document of user；
S2, reversing control voice data is obtained, data is carried out to reversing voice control data according to voice recognition data and are turned
It changes, obtains control decision information, voice control data are subjected to serializing and are treated as control decision information, judge current panorama
When the display state of image is that foreground is shown, a series of semantic control instructions can be registered to speech recognition module；
S3, control decision information is converted to by control instruction information according to panorama control protocol, parses control decision information
Specific control instruction information is obtained to control for reverse image；
S4, control CAN message is converted to control instruction information data, control CAN message is total by vehicle CAN
Line is sent to data collection facility, and user, which hangs reverse gear or advances, activates panorama controller when turning to, panorama controller can be sent
Request the CAN message of display to vehicle CAN bus, when full-view image exits, system decision-making module will receive instruction modulus of conversion
Then the image exit message that block issues executes to speech recognition module and nullifies operation, nullify a series of of full-view image control
It is semantic.In this way, at non-panoramic image interface, even if user says these semantemes, full-view image and vehicle-mounted system will not be influenced
Other functions of system.
Referring to Fig. 2, it is shown as the specific flow chart of step S1 in one embodiment in Fig. 1, as shown in Fig. 2, step S2,
When monitoring control display triggering information, association voice characteristics information and command information obtain voice recognition data, specific to wrap
It includes：
S11, display triggering information is received, onboard system transfers to instruction conversion module after receiving can message, by original can
Message parses and is converted into unified message, is sent to system decision-making module；
S12, voice characteristics information is preset according to practical operation type, saves voice characteristics information, by a series of semantic controls
System instruction is registered to speech recognition module, such as：Front, rear, left and right, front, back, the left side, the right, headstock, the tailstock, left side,
Right side is exited；
S13, the acquisition instruction information from input record；
S14, association voice characteristics information and command information, extract the instruction features in command information, at this point, user only needs
It is semantic to say these controls, speech recognition module is parsed and sent instructions to by natural language technology identification user language
System decision-making module；
S15, matching voice recognition data and instruction features obtain voice recognition data.
Referring to Fig. 3, Fig. 3 is shown as the specific flow chart of step S3 in one embodiment in Fig. 1, as shown in figure 3, step
S2, reversing control voice data is obtained, data conversion is carried out to reversing voice control data according to voice recognition data, is controlled
Decision information processed, specifically includes：
S21, obtain operation audio file, by real-time recording function obtain that user issues in real time comprising voice control number
According to operation audio file；
S22, parsing operation audio file, obtain operational attribute data, system decision-making module is issued according to different instructions
Different control commands to instruction conversion module；
S23, voice recognition data, matching operation attribute data and voice recognition data are obtained, obtains instructions match information；
S24, voice control data are converted to by control decision information according to instructions match information, by instruction modulus of conversion root tuber
Control command is converted into specific can message according to panorama control protocol, and is sent in vehicle can bus network.
Referring to Fig. 4, panorama reverse image console module schematic diagram of the invention is shown as, referring to Fig. 4, a kind of complete
Scape reverse image control terminal 1, including：Speech recognition module 11, system decision-making module 12, instruction conversion module 13 and instruction are sent
Module 14；Speech recognition module 11, when there is control display triggering information, is associated with language for monitoring control display triggering information
Sound characteristic information and command information obtain voice recognition data, by common instruction included have the feature of instruction meaning with
The original input data for including in command information is associated, and is known to the command information for including in the voice document of user
Not；System decision-making module 12, for obtaining reversing control voice data, according to voice recognition data to reversing voice control data
Data conversion is carried out, control decision information is obtained, voice control data are subjected to serializing and are treated as control decision information, are sentenced
When the display state of disconnected current panorama image is that foreground is shown, a series of semantic control instructions can be registered to speech recognition mould
Block, system decision-making module 12 are connect with speech recognition module 11；Conversion module 13 is instructed, for that will control according to panorama control protocol
Decision information processed is converted to control instruction information, and parsing control decision information obtains specific control instruction information for reverse image
Control, instruction conversion module 13 are connect with system decision-making module 12；Instruction sending module 14, for control instruction information data
Convert to obtain control CAN message, control CAN message by vehicle CAN bus be sent to data collection facility, user's extension reverse gear or
Person, which advances, activates panorama controller when turning to, panorama controller can send the CAN message of request display to vehicle CAN bus, when
When full-view image exits, system decision-making module will receive the image exit message that instruction conversion module issues, and then know to voice
Other module, which executes, nullifies operation, nullifies a series of semantemes of full-view image control.In this way, being used at non-panoramic image interface
These semantemes are said at family, will not influence other functions of full-view image and onboard system, instruction sending module 14 and instruction
Conversion module 13 connects.
Referring to Fig. 5, being shown as the specific module diagram of speech recognition module 11 in one embodiment, such as Fig. 5 in Fig. 4
Shown, speech recognition module 11 includes：Triggering obtains module 111, type preserving module 112, instruction logging modle 113, instruction
Characteristic extracting module 114 and voice recognition data module 115；Triggering obtains module 111, for receiving display triggering information, vehicle
Loading system transfers to instruction conversion module after receiving can message, parses and is converted into unified message for original can message, be sent to
System decision-making module；It is special to save voice for presetting voice characteristics information according to practical operation type for type preserving module 112
A series of semantic control instructions are registered to speech recognition module by reference breath, such as：Front, rear, left and right, front, back, a left side
Side, headstock, the tailstock, left side, right side, is exited the right；Logging modle 113 is instructed, for the acquisition instruction letter from input record
Breath；Instruction features extraction module 114, for being associated with voice characteristics information and command information, the instruction extracted in command information is special
Sign, at this point, user only needs to say, these controls are semantic, and speech recognition module identifies user language by natural language technology,
System decision-making module is parsed and sends instructions to, instruction features extraction module 114 is connect with type preserving module 112, and instruction is special
Sign extraction module 114 is connect with instruction logging modle 113；Voice recognition data module 115, for match voice recognition data with
Instruction features obtain voice recognition data, and voice recognition data module 115 is connect with instruction features extraction module 114.
Referring to Fig. 6, being shown as the specific module diagram of system decision-making module 12 in one embodiment, such as Fig. 6 in Fig. 4
Shown, system decision-making module 12 includes：Audio interception module 121, operational attribute module 122, instructions match module 123 and decision
Data module 124；It is real-time to obtain user by real-time recording function for obtaining operation audio file for audio interception module 121
The operation audio file comprising voice control data issued；Operational attribute module 122 is obtained for parsing operation audio file
Operational attribute data are obtained, system decision-making module issues different control commands to instruction conversion module, behaviour according to different instructions
Make attribute module 122 to connect with audio interception module 121；Instructions match module 123 is matched for obtaining voice recognition data
Operational attribute data and voice recognition data obtain instructions match information, instructions match module 123 and operational attribute module 122
Connection；Decision data module 124, for voice control data to be converted to control decision information according to instructions match information, by
It instructs conversion module that control command is converted into specific can message according to panorama control protocol, and is sent to vehicle can bus
On network, decision data module 124 is connect with instructions match module 123.
Referring to Fig. 7, being shown as panorama reverse image control data collection facility implementation method step signal of the invention
Figure is applied to a data collection facility, side as shown in fig. 7, a kind of panorama reverse image controls data collection facility implementation method
Method includes：
S1 ', data collection facility is opened, sends control display triggering information, adjusts the display effect of image in real time.It abandons
The mode that traditional manual switches, clicks manually；
S2 ', vehicle body image data is obtained by vehicle-mounted camera, vehicle-mounted camera is mounted on vehicle body front, rear, left and right everywhere；
The control CAN message that S3 ', reception are transmitted from vehicle CAN bus transfers corresponding vehicle body according to control CAN message
Image data is referred to for reversing process, and full-view image controller receives can message, completes corresponding movement.In this way, with
Family, without using waking up word, can easily pass through voice control panorama reverse image when full-view image is shown.
Referring to Fig. 8, be shown as the specific flow chart of step S4 ' in one embodiment in Fig. 6, as shown in figure 8, S3 ', connecing
The control CAN message transmitted from vehicle CAN bus is received, corresponding vehicle body image data is transferred for reversing according to control CAN message
Process refers to, and further includes：
S41 ', control CAN message is obtained, treated control CAN message is obtained by CAN bus；
S42 ', the image extracted in control CAN message transfer command information, filter in user's operation audio file content with
Full-view image controls unrelated information, filters out image and transfers command information；
S43 ', command information is transferred according to image image is transferred into vehicle body image data on command information corresponding direction and supply
Display transfers vehicle body image data according to the specific control data transferred in command information and image corresponding with instruction is concentrated to believe
Breath.
Referring to Fig. 9, being shown as panorama reverse image control data collection facility module diagram of the invention, such as Fig. 9
Shown, panorama reverse image controls data collection facility 1 ', including：Trigger module 11 ', image acquiring module 12 ' and control disappear
Cease receiving module 13 '；Trigger module 11 ' is used to open data collection facility, sends control display triggering information, adjusts in real time
The display effect of image.Discard tradition manual switching, the mode clicked manually；Image acquiring module 12 ', for by vehicle-mounted pick-up
Head obtains vehicle body image data, and vehicle-mounted camera is mounted on vehicle body front, rear, left and right everywhere；Control message receiving module 13 ' is used
In the control CAN message that reception is transmitted from vehicle CAN bus, corresponding vehicle body image data is transferred according to control CAN message and is supplied
Reversing process reference, full-view image controller receive can message, complete corresponding movement.In this way, which user can be complete
When scape image is shown, without using waking up word, easily pass through voice control panorama reverse image, control message receiving module
13 ' connect with image acquiring module 12 '.
Referring to Fig. 10, being shown as the specific module signal of control message receiving module 14 ' in one embodiment in Fig. 9
Figure, as shown in Figure 10, control message receiving module 14 ' includes：Control message obtains module 141 ', transfers instruction extraction module
142 ' and image control module 143 '；Control message obtains module 141 ', for obtaining control CAN message, is obtained by CAN bus
Take treated control CAN message；Instruction extraction module 142 ' is transferred, is transferred for extracting the image in control CAN message
Command information filters in user's operation audio file content and controls unrelated information with full-view image, filters out image and transfer finger
Information is enabled, instruction extraction module 142 ' is transferred and is connect with control message acquisition module 141 '；Image control module 143 ' is used for root
Command information is transferred according to image image is transferred into the vehicle body image data on command information corresponding direction and shown, according to transferring instruction
Specific control data in information transfer vehicle body image data and concentrate image information corresponding with instruction, image control module
143 ' connect with instruction extraction module 142 ' is transferred.
In conclusion a kind of panorama reverse image control method, server-side and client provided by the invention, have following
Beneficial effect：A kind of panorama reverse image control method provided by the invention, reply in stopping routine operating process often by
In the narrow equal reality factors in parking stall, it can be automatically controled reverse image and be mounted on the camera of vehicle body all directions to assist driving
Sail people and coordinate reversing orientation and specific angle in conjunction with the view modes such as side mirror and rearview mirror, can voice switch different vehicle-mounted take the photograph
As head, this programme proposes that a kind of voice exempts from the method for waking up control panorama reverse image, without changing full-view image control association
It on the basis of view, shown, exited and view angle switch by voice real-time control image.It improves the efficiency of vehicle parking and parks
Effect facilitates shut-down operation when driver drives to go on a journey.Simultaneously as complete set reverse image controlling party provided by the invention
Method can be avoided in parking process existing in the prior art and cannot be considered in terms of and manually adjusted switching and take the photograph by driver's voice control
As head and steering wheel operation, the inconvenience for causing safety problem and car owner to be parked.
To sum up, the present invention solve it is existing in the prior art rely on manually handover operation, automatization level are low
Feature, exists in the prior art that the reverse image adaptability of technology is lower, usage mode and the more single skill of image control function
Art problem has very high commercial value and practicability.
Claims (10)
1. a kind of panorama reverse image control method is applied to a control terminal, which is characterized in that the method includes：
When monitoring control display triggering information, association voice characteristics information and command information obtain voice recognition data；
Reversing control voice data is obtained, data are carried out to the reversing voice control data according to the voice recognition data and are turned
It changes, obtains control decision information；
The control decision information is converted into control instruction information according to panorama control protocol；
Control CAN message is converted to the control instruction information data, the control CAN message is total by vehicle CAN
Line is sent to data collection facility.
2. according to claim 1 be based on stroke Vehicular charging planing method, which is characterized in that described to monitor to control
When display triggering information, association voice characteristics information and command information obtain voice recognition data, specifically include：
Receive the display triggering information；
Voice characteristics information is preset according to practical operation type, saves the voice characteristics information；
The acquisition instruction information from input record；
It is associated with the voice characteristics information and described instruction information, extracts the instruction features in described instruction information；
It matches the voice recognition data and described instruction feature obtains voice recognition data.
3. according to claim 1 be based on stroke Vehicular charging planing method, which is characterized in that the acquisition reversing control
Voice data carries out data conversion to the reversing voice control data according to the voice recognition data, obtains control decision
Information specifically includes：
Obtain operation audio file；
The operation audio file is parsed, operational attribute data are obtained；
The voice recognition data is obtained, the operational attribute data and the voice recognition data is matched, obtains instructions match
Information；
The voice control data are converted into control decision information according to instructions match information.
4. a kind of panorama reverse image control terminal, which is characterized in that including：Speech recognition module, system decision-making module, instruction turn
Change the mold block and instruction sending module；
The speech recognition module, for monitoring control display triggering information, when there is the control display triggering information, association
Voice characteristics information and command information obtain voice recognition data；
The system decision-making module, for obtaining reversing control voice data, according to the voice recognition data to the reversing
Voice control data carry out data conversion, obtain control decision information；
Described instruction conversion module, for the control decision information to be converted to control instruction letter according to panorama control protocol
Breath；
Described instruction sending module, for converting to obtain control CAN message to the control instruction information data, by the control
CAN message is sent to data collection facility by vehicle CAN bus.
5. panorama reverse image control terminal according to claim 4, which is characterized in that the speech recognition module includes：
Triggering obtains module, type preserving module, instruction logging modle, instruction features extraction module and voice recognition data module；
The triggering obtains module, for receiving the display triggering information；
The type preserving module saves the phonetic feature letter for presetting voice characteristics information according to practical operation type
Breath；
Described instruction logging modle, for the acquisition instruction information from input record；
Described instruction characteristic extracting module extracts described instruction for being associated with the voice characteristics information and described instruction information
Instruction features in information；
The voice recognition data module obtains speech recognition number for matching the voice recognition data and described instruction feature
According to.
6. panorama according to claim 4 reversing influences control terminal, which is characterized in that the system decision-making module includes：
Audio interception module, operational attribute module, instructions match module and decision data module；
The audio interception module, for obtaining operation audio file；
The operational attribute module obtains operational attribute data for the parsing operation audio file；
Described instruction matching module matches the operational attribute data and the voice for obtaining the voice recognition data
It identifies data, obtains instructions match information；
The decision data module, for the voice control data to be converted to control decision letter according to instructions match information
Breath.
7. a kind of panorama reverse image controls data collection facility implementation method, it is applied to a data collection facility, feature exists
In, the method includes：
Data collection facility is opened, control display triggering information is sent；
Vehicle body image data is obtained by vehicle-mounted camera；
The control CAN message transmitted from vehicle CAN bus is received, the corresponding vehicle body is transferred according to the control CAN message
Image data is referred to for reversing process.
8. panorama reverse image according to claim 7 controls data collection facility implementation method, which is characterized in that described
The control CAN message transmitted from vehicle CAN bus is received, the corresponding vehicle body image is transferred according to the control CAN message
Data are referred to for reversing process, further include：
Obtain control CAN message；
The image extracted in the control CAN message transfers command information；
Command information is transferred according to the image, and the image is transferred to the vehicle body image number on command information corresponding direction
According to for display.
9. a kind of panorama reverse image controls data collection facility, which is characterized in that including：Trigger module, image acquiring module
With control message receiving module；
The trigger module is used to open data collection facility, sends control display triggering information；
The image acquiring module, for obtaining vehicle body image data by vehicle-mounted camera；
The control message receiving module, for receiving the control CAN message transmitted from vehicle CAN bus, according to the control
CAN message is transferred the corresponding vehicle body image data and is referred to for reversing process.
10. panorama reverse image according to claim 9 controls data collection facility, which is characterized in that the control disappears
Ceasing receiving module includes：Control message obtains module, transfers instruction extraction module and image control module；
The control message obtains module, for obtaining control CAN message；
It is described to transfer instruction extraction module, command information is transferred for extracting the image in the control CAN message；
The image is transferred command information counterparty for transferring command information according to the image by the image control module
The upward vehicle body image data is for display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810900941.9A CN108859966A (en) | 2018-08-09 | 2018-08-09 | Panorama reverse image control method, server-side and client |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810900941.9A CN108859966A (en) | 2018-08-09 | 2018-08-09 | Panorama reverse image control method, server-side and client |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108859966A true CN108859966A (en) | 2018-11-23 |
Family
ID=64318493
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810900941.9A Pending CN108859966A (en) | 2018-08-09 | 2018-08-09 | Panorama reverse image control method, server-side and client |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108859966A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113246861A (en) * | 2021-06-08 | 2021-08-13 | 北京福田戴姆勒汽车有限公司 | Control method of vehicle-mounted image system, vehicle-mounted image system and vehicle |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001077952A (en) * | 1999-09-06 | 2001-03-23 | Canon Inc | Image-forming system and control method therefor, image-forming device and control method therefor, and recording medium |
| CN102514528A (en) * | 2011-12-15 | 2012-06-27 | 奇瑞汽车股份有限公司 | Automobile and panoramic visible system thereof |
| CN103287362A (en) * | 2013-06-25 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Vehicle-mounted voice control system and method and electric automobile |
| CN203331999U (en) * | 2013-06-19 | 2013-12-11 | 旺普科技有限公司 | Automatic switching display device for automobile electronic equipment |
| KR20140098443A (en) * | 2013-01-31 | 2014-08-08 | 주식회사 에이피엑스 | Smart parking assist system with integrated camera and atuomatic parking method thereof |
| CN105150937A (en) * | 2015-09-25 | 2015-12-16 | 武汉华安科技股份有限公司 | Intelligent parking auxiliary system and auxiliary method thereof |
| CN105187717A (en) * | 2015-08-10 | 2015-12-23 | 四川长虹电器股份有限公司 | Shooting method and system capable of controlling television camera via voice |
| CN205468811U (en) * | 2016-02-24 | 2016-08-17 | 深圳嘟嘟智能科技有限公司 | Intelligence rear -view mirror and control system thereof |
| CN107901857A (en) * | 2017-09-26 | 2018-04-13 | 上海思致汽车工程技术有限公司 | A kind of automobile sound control camera system and control method |
| CN107972584A (en) * | 2017-11-23 | 2018-05-01 | 广东菲柯特电子科技有限公司 | Driving assistance system based on wireless radar and panoramic image |
| CN108279839A (en) * | 2017-01-05 | 2018-07-13 | 阿里巴巴集团控股有限公司 | Voice-based exchange method, device, electronic equipment and operating system |
-
2018
- 2018-08-09 CN CN201810900941.9A patent/CN108859966A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001077952A (en) * | 1999-09-06 | 2001-03-23 | Canon Inc | Image-forming system and control method therefor, image-forming device and control method therefor, and recording medium |
| CN102514528A (en) * | 2011-12-15 | 2012-06-27 | 奇瑞汽车股份有限公司 | Automobile and panoramic visible system thereof |
| KR20140098443A (en) * | 2013-01-31 | 2014-08-08 | 주식회사 에이피엑스 | Smart parking assist system with integrated camera and atuomatic parking method thereof |
| CN203331999U (en) * | 2013-06-19 | 2013-12-11 | 旺普科技有限公司 | Automatic switching display device for automobile electronic equipment |
| CN103287362A (en) * | 2013-06-25 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Vehicle-mounted voice control system and method and electric automobile |
| CN105187717A (en) * | 2015-08-10 | 2015-12-23 | 四川长虹电器股份有限公司 | Shooting method and system capable of controlling television camera via voice |
| CN105150937A (en) * | 2015-09-25 | 2015-12-16 | 武汉华安科技股份有限公司 | Intelligent parking auxiliary system and auxiliary method thereof |
| CN205468811U (en) * | 2016-02-24 | 2016-08-17 | 深圳嘟嘟智能科技有限公司 | Intelligence rear -view mirror and control system thereof |
| CN108279839A (en) * | 2017-01-05 | 2018-07-13 | 阿里巴巴集团控股有限公司 | Voice-based exchange method, device, electronic equipment and operating system |
| CN107901857A (en) * | 2017-09-26 | 2018-04-13 | 上海思致汽车工程技术有限公司 | A kind of automobile sound control camera system and control method |
| CN107972584A (en) * | 2017-11-23 | 2018-05-01 | 广东菲柯特电子科技有限公司 | Driving assistance system based on wireless radar and panoramic image |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113246861A (en) * | 2021-06-08 | 2021-08-13 | 北京福田戴姆勒汽车有限公司 | Control method of vehicle-mounted image system, vehicle-mounted image system and vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105599679B (en) | Vehicle front information display control apparatus and method | |
| CN105501112B (en) | People's vehicle and vehicle vehicle interaction control device and exchange method | |
| CN111439271A (en) | Auxiliary driving method and auxiliary driving equipment based on voice control | |
| CN105691293B (en) | A kind of automatic control system of automobile steering indicating light and method | |
| CN206938606U (en) | A kind of vehicle panoramic looks around auxiliary image system | |
| JP2002513969A (en) | Handwriting and voice control of vehicle components | |
| CN202721760U (en) | Vehicle reversing video rapid display system | |
| CN106292367A (en) | A kind of automotive electronics tele-control system | |
| CN110580046B (en) | Control method and system for unmanned sightseeing vehicle | |
| CN107953854A (en) | A kind of intelligent vehicle-carried auxiliary system and method based on recognition of face | |
| CN108859966A (en) | Panorama reverse image control method, server-side and client | |
| CN204695557U (en) | Based on the parking lot gateway control system of Quick Response Code recognition technology | |
| CN109109790A (en) | 360 ° of panoramic parking assist systems of one kind and its sound control method | |
| CN111009147A (en) | Vehicle remote entrusted designated driving system and application method thereof | |
| CN104943612A (en) | Method and device for achieving perspective of automotive column-A dead zone through lens | |
| CN109274566A (en) | A method of realizing that the data communication of different CAN baud rates completes EPS with the data interaction of VCU based on gateway | |
| CN103295273A (en) | Method and system for charging in park | |
| CN108859973A (en) | A kind of vehicle mirrors automatic regulating system | |
| CN110400568A (en) | Awakening method, intelligent voice system and the vehicle of intelligent voice system | |
| CN204340877U (en) | A kind of vehicular rear mirror box with read-out | |
| CN204340880U (en) | A kind of vehicular rear mirror box with anti-glare screen | |
| CN209218250U (en) | A kind of image system | |
| CN111661227A (en) | Control system of electric scooter and control method of electric scooter applying control system | |
| CN209036541U (en) | A kind of detection assistant's robot system | |
| CN113192352A (en) | Automatic driving method and system for receiving instructions of traffic management personnel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |