CN111261191A - Automatic detection method and system for sound splicing and soundless of vehicle-mounted multimedia system - Google Patents
Automatic detection method and system for sound splicing and soundless of vehicle-mounted multimedia system Download PDFInfo
- Publication number
- CN111261191A CN111261191A CN201911153389.2A CN201911153389A CN111261191A CN 111261191 A CN111261191 A CN 111261191A CN 201911153389 A CN201911153389 A CN 201911153389A CN 111261191 A CN111261191 A CN 111261191A
- Authority
- CN
- China
- Prior art keywords
- audio
- frequency
- time interval
- detection
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 claims abstract description 14
- 238000012360 testing method Methods 0.000 claims abstract description 8
- 230000002950 deficient Effects 0.000 claims description 18
- 238000012544 monitoring process Methods 0.000 claims description 12
- 230000007547 defect Effects 0.000 claims description 7
- 101000878595 Arabidopsis thaliana Squalene synthase 1 Proteins 0.000 claims description 3
- 238000010295 mobile communication Methods 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 4
- 210000005069 ears Anatomy 0.000 description 4
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/72—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for transmitting results of analysis
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
The invention aims to provide a method and a system for automatically detecting sound splicing and soundlessness of a vehicle-mounted multimedia system, and particularly, the soundless or splicing condition of the audio is automatically detected through judging the zero crossing time of single-frequency sound of the audio, so that whether the sound of a vehicle-mounted audio and video entertainment system is complete or not is quickly and accurately detected, the detection on the soundless and splicing abnormal conditions of the sound is realized, the detection precision is improved, the vehicle-mounted audio and video entertainment system can work for a long time, and the product quality is guaranteed. The human detection is further replaced, the testing efficiency is improved, and human resources are released.
Description
Technical Field
The invention relates to a vehicle-mounted audio-video entertainment system, in particular to a method and a system for automatically detecting sound splicing and soundless of a vehicle-mounted multimedia system.
Background
At present, the application of vehicle-mounted multimedia is more and more extensive, people have higher and higher requirements on performance and quality of the vehicle-mounted multimedia, in the process of playing music by using the vehicle-mounted multimedia daily by a user, the problem of splicing front and back when no sound is generated or part of the sound is lost often occurs, at present, whether the sound output by a loudspeaker is normal or not is judged through ears of the user, but the problem is slight, people can feel tired, the problems of being concentrated in listening all the time and being discovered by ears continuously for a long time are very difficult, the efficiency is extremely low, even abnormal audio frequency in units of milliseconds occurs, the ears of the user are also very difficult to identify and record, the problem audio frequency band can be accurately found through repeated confirmation, and the quality of products is seriously influenced.
Aiming at the existing technical problems and problems, the invention aims to provide an automatic detection method and system for sound splicing and silence of a vehicle-mounted multimedia system, which can quickly and accurately detect whether the sound of the vehicle-mounted audio and video entertainment system is complete or not, can monitor and find defect audio in real time and process the defect audio in time by automatic detection, and greatly improves the performance and user experience of vehicle-mounted multimedia.
Disclosure of Invention
The invention provides a method and a system for automatically detecting sound splicing and soundless of a vehicle-mounted multimedia system, which comprises the following specific implementation steps.
SS 1: initializing a prototype to be tested, importing the audio into a player of the prototype to be tested, and playing a single audio.
SS 2: the audio acquisition card collects and records the single audio, generates a single-frequency audio file according to a preset waveform type, a time value and amplitude modulation, and transmits the single-frequency audio file to the detection center for monitoring.
SS 3: judging whether the zero crossing time interval of the audio file is a set time threshold value or not; if yes, continuously keeping monitoring; otherwise, the audio file is marked as a defective audio, and the detection result is returned to the control center.
Further, the audio file comprises fundamental frequency parameters, modulation parameters, frequency modulation parameters, waveform types, periods and amplitude modulation of defective audio of a single audio.
Further, the fundamental frequency parameter, the modulation parameter and the frequency modulation parameter are preset threshold values, the waveform type is set to be a sine waveform, and the period time value is a time difference value of two zero-crossing points before and after the period time value is taken;
preferably, the fundamental frequency parameter is 1000, the modulation parameter is 0Hz, the frequency modulation parameter is 0Hz, the waveform type is set to be a sinusoidal waveform, and the period duration is 1 ms.
Further, judging whether the zero crossing time interval of the audio file is a set time threshold, further comprising: the reference time threshold is f =1/T, the single audio is 1kHz, the single audio period and the reference time interval of the zero crossing point corresponding to the single audio period are calculated, whether the time interval of the single audio to be detected is the reference time interval or not is judged, and if the time interval is larger than or smaller than the reference time interval, the single audio is marked as a defective audio.
Wherein the defective audio includes: silent audio or spliced audio.
Further, the amplitude of the band of the silent audio is 0.
Preferably, the spliced audio is a single audio cycle in which more than 2 peaks or troughs appear.
The integrity of the sound of the vehicle-mounted multimedia system is identified by comparing the difference between the normal single-frequency sound waveform and the waveform when the sound is absent and the waveform when the splicing is lost.
In addition, the invention also provides an automatic sound splicing and soundless detection system of the vehicle-mounted multimedia system, which specifically comprises the following steps.
A model machine module to be tested: after the testing machine is initialized, the audio is led into a player of the testing machine, and a single audio is played;
the audio acquisition module: the single-frequency file generating device is used for collecting and recording the single frequency, generating a single-frequency file according to a preset waveform type, a time value and amplitude modulation, and transmitting the single-frequency file to a detection center for monitoring.
A detection module: the time interval judging module is used for judging whether the zero crossing point time interval of the audio file is a set time threshold value or not; if yes, continuously keeping monitoring; otherwise, the audio file is marked as a defective audio, and the detection result is returned to the control center.
The control center: and the detection unit is used for receiving the detection result sent by the detection unit and storing the detection result in the storage unit.
Preferably, the audio includes music, sound recordings, dubbing in videos.
Preferably, the control center is a PC terminal or a mobile communication device, and visually presents waveform amplitude modulation corresponding to a defective audio in the detection result.
The automatic detection method and the system for sound splicing and soundless of the vehicle-mounted multimedia system mainly judge the continuity detection of the sound through the time interval of the zero crossing point of the single-frequency sound file of the sound of the vehicle-mounted multimedia system, so that abnormal waveforms during soundless or sound splicing are found, the defect audio frequency of the vehicle-mounted audio-video entertainment system is further determined, and meanwhile, the marking is carried out, so that a user can check and confirm the defect audio frequency, the detection efficiency of the defect audio frequency is greatly improved, the accuracy of the audio frequency detection is also greatly improved, and the millisecond-level audio frequency problem which cannot be judged by human ears is met.
Drawings
Fig. 1 is a schematic view illustrating an automatic sound splicing and silence detection process of a vehicle-mounted multimedia system according to an embodiment.
Fig. 2 is a schematic diagram of an automated sound splicing and silence detection system of the vehicle-mounted multimedia system of fig. 1.
FIG. 3 is a diagram of a normal single-frequency tone waveform in an embodiment.
Fig. 4 is a waveform diagram illustrating the occurrence of silence in one embodiment.
FIG. 5 is a waveform diagram illustrating the occurrence of a missing splice in one embodiment.
Detailed Description
The following describes the automatic detection method and system for sound splicing and silence of the vehicle-mounted multimedia system in further detail with reference to specific embodiments and the accompanying drawings.
As shown in fig. 1 and fig. 2, in a preferred embodiment, the method for automatically detecting sound splicing and silence in a vehicle-mounted multimedia system according to the present invention is schematically illustrated in a flow chart.
An automatic detection method for sound splicing and silence of a vehicle-mounted multimedia system comprises the specific implementation steps.
SS 1: initializing a prototype to be tested, importing the audio into a player of the prototype to be tested, and playing a single audio.
SS 2: the audio acquisition card collects and records the single audio, generates a single-frequency audio file according to a preset waveform type, a time value and amplitude modulation, and transmits the single-frequency audio file to the detection center for monitoring.
SS 3: judging whether the zero crossing time interval of the audio file is a set time threshold value or not; if yes, continuously keeping monitoring; otherwise, the audio file is marked as a defective audio, and the detection result is returned to the control center.
Further, the audio file comprises fundamental frequency parameters, modulation parameters, frequency modulation parameters, waveform types, periods and amplitude modulation of defective audio of a single audio.
Further, the fundamental frequency parameter, the modulation parameter and the frequency modulation parameter are preset threshold values, the waveform type is set to be a sine waveform, and the period time value is a time difference value of two zero-crossing points before and after the period time value is taken;
preferably, the fundamental frequency parameter is 1000, the modulation parameter is 0Hz, the frequency modulation parameter is 0Hz, the waveform type is set to be a sinusoidal waveform, and the period duration is 1 ms.
Further, judging whether the zero crossing time interval of the audio file is a set time threshold, further comprising: the reference time threshold is f =1/T, the single audio is 1kHz, the single audio period and the reference time interval of the zero crossing point corresponding to the single audio period are calculated, whether the time interval of the single audio to be detected is the reference time interval or not is judged, and if the time interval is larger than or smaller than the reference time interval, the single audio is marked as a defective audio.
Wherein the defective audio includes: silent audio or spliced audio.
Further, the amplitude of the band of the silent audio is 0.
Preferably, the spliced audio is a single audio cycle in which more than 2 peaks or troughs appear.
The integrity of the sound of the vehicle-mounted multimedia system is identified by comparing the difference between the normal single-frequency sound waveform and the waveform when the sound is absent and the waveform when the splicing is lost.
In addition, the invention also provides an automatic sound splicing and soundless detection system of the vehicle-mounted multimedia system, which specifically comprises the following steps.
A model machine module to be tested: after the testing machine is initialized, the audio is led into a player of the testing machine, and a single audio is played;
the audio acquisition module: the single-frequency file generating device is used for collecting and recording the single frequency, generating a single-frequency file according to a preset waveform type, a time value and amplitude modulation, and transmitting the single-frequency file to a detection center for monitoring.
A detection module: the time interval judging module is used for judging whether the zero crossing point time interval of the audio file is a set time threshold value or not; if yes, continuously keeping monitoring; otherwise, the audio file is marked as a defective audio, and the detection result is returned to the control center.
The control center: and the detection unit is used for receiving the detection result sent by the detection unit and storing the detection result in the storage unit.
Preferably, the audio includes music, sound recordings, dubbing in videos.
Preferably, the control center is a PC terminal or a mobile communication device, and visually presents waveform amplitude modulation corresponding to a defective audio in the detection result.
As another preferred embodiment, as can be seen from the above formula, f =1/T, the period of a single-frequency tone at 1kHz is 1ms, so the time interval of the zero-crossing point is 0.5ms, and the time interval of the zero-crossing point when the single-frequency tone at 1kHz is normally played is also 0.5ms, so the time of the zero-crossing point when silence occurs (as shown in fig. 4) or splicing occurs (as shown in fig. 5) becomes longer, i.e. the time interval of a single-frequency tone is greater than the reference time interval (as shown in fig. 3), thereby the occurrence of silence or splicing of sound can be detected, in order to further check the amplitude modulation condition of the defective audio, the defective audio is marked and sent to the PC, and the specific condition needs to be confirmed by looking at the waveform of the audio file.
In conclusion, the automatic detection method and system for sound splicing and soundless of the vehicle-mounted multimedia system, provided by the invention, realize detection of soundless sound and abnormal splicing conditions, improve the detection precision, can work for a long time and guarantee the product quality. Furthermore, the technical effects that people can be replaced for detection, the testing efficiency is improved, and human resources are released are achieved.
While the invention has been described in conjunction with the specific embodiments set forth above, it is evident that many alternatives, modifications, and variations will be apparent to those skilled in the art in light of the foregoing description. Accordingly, it is intended to embrace all such alternatives, modifications, and variations that fall within the spirit and scope of the appended claims.
Claims (10)
1. An automatic detection method for sound splicing and silence of a vehicle-mounted multimedia system is characterized by comprising the following steps:
SS 1: initializing a prototype to be tested, importing the audio into a player of the prototype to be tested, and playing a single audio;
SS 2: the audio acquisition card collects and records the single audio, generates a single-frequency audio file according to a preset waveform type, a time value and amplitude modulation, and transmits the single-frequency audio file to the detection center for monitoring;
SS 3: judging whether the zero crossing time interval of the audio file is a set time threshold value or not; if yes, continuously keeping monitoring; otherwise, the audio file is marked as a defective audio, and the detection result is returned to the control center.
2. The method of claim 1, wherein the audio file comprises fundamental frequency parameters, modulation parameters, frequency modulation parameters, waveform type, period of a mono audio, and amplitude modulation of a defective audio.
3. The method according to claim 2, wherein the fundamental frequency parameter, the modulation parameter and the frequency modulation parameter are preset threshold values, the waveform type is set as a sine waveform, and the period value is a time difference between two zero-crossing points.
4. The method of claim 1, wherein determining whether the zero-crossing time interval of the audio file is a set time threshold further comprises: the reference time threshold is f =1/T, the single audio is 1kHz, the single audio period and the reference time interval of the zero crossing point corresponding to the single audio period are calculated, whether the time interval of the single audio to be detected is the reference time interval or not is judged, and if the time interval is larger than or smaller than the reference time interval, the single audio is marked as a defective audio.
5. The method of claim 4, wherein the defect audio comprises: silent audio or spliced audio.
6. The method of claim 5, wherein the voiceless audio has a band amplitude of 0.
7. The method of claim 5, wherein the spliced audio is a single audio cycle with more than 2 peaks or troughs.
8. An automatic detection system for sound splicing and silence of a vehicle multimedia system applying the method of any one of claims 1 to 7, comprising:
a model machine module to be tested: after the testing machine is initialized, the audio is led into a player of the testing machine, and a single audio is played;
the audio acquisition module: the single-frequency file generating device is used for collecting and recording the single frequency, generating a single-frequency file according to a preset waveform type, a time value and amplitude modulation, and transmitting the single-frequency file to a detection center for monitoring;
a detection module: the time interval judging module is used for judging whether the zero crossing point time interval of the audio file is a set time threshold value or not; if yes, continuously keeping monitoring; otherwise, marking the audio file as a defective audio and returning a detection result to the control center;
the control center: and the detection unit is used for receiving the detection result sent by the detection unit and storing the detection result in the storage unit.
9. The system of claim 8, wherein the audio comprises music, a recording, or dubbing in a video.
10. The system of claim 8, wherein the control center is a PC or a mobile communication device, and visually presents the waveform amplitude modulation corresponding to the defect audio in the detection result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911153389.2A CN111261191A (en) | 2019-11-22 | 2019-11-22 | Automatic detection method and system for sound splicing and soundless of vehicle-mounted multimedia system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911153389.2A CN111261191A (en) | 2019-11-22 | 2019-11-22 | Automatic detection method and system for sound splicing and soundless of vehicle-mounted multimedia system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111261191A true CN111261191A (en) | 2020-06-09 |
Family
ID=70946705
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911153389.2A Pending CN111261191A (en) | 2019-11-22 | 2019-11-22 | Automatic detection method and system for sound splicing and soundless of vehicle-mounted multimedia system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111261191A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5780759A (en) * | 1995-01-12 | 1998-07-14 | Blue Chip Music Gmbh | Method for pitch recognition, in particular for musical instruments which are excited by plucking or striking |
| JP2000003188A (en) * | 1998-06-15 | 2000-01-07 | Yamaha Corp | Device and method for voice analysis and storage medium which records voice analysis program |
| US20080077262A1 (en) * | 2006-09-08 | 2008-03-27 | Apple Computer, Inc | Distortion free stitching of digital media files |
| CN101247622A (en) * | 2008-03-03 | 2008-08-20 | 中兴通讯股份有限公司 | Testing method and device of audio communication system |
| CN101740079A (en) * | 2009-11-27 | 2010-06-16 | 深圳市同洲电子股份有限公司 | Method for automatically testing audio output function based on interval tolerance method |
| CN202221451U (en) * | 2011-07-29 | 2012-05-16 | 惠州市德赛西威汽车电子有限公司 | Parameter automatic test system for vehicle-mounted entertainment system |
| CN102539955A (en) * | 2012-03-22 | 2012-07-04 | 深圳市金凯博自动化测试有限公司 | Automation testing system of vehicle-mounted multimedia |
| CN105676045A (en) * | 2016-01-08 | 2016-06-15 | 苏州工业园区博亨电子有限公司 | Vehicle-mounted multimedia performance automation testing method |
| CN106197650A (en) * | 2016-08-30 | 2016-12-07 | 陕西千山航空电子有限责任公司 | A kind of method judging that audio signal is noiseless |
| CN106791825A (en) * | 2016-12-23 | 2017-05-31 | 深圳创维数字技术有限公司 | A kind of audio automated testing method and terminal |
| CN106941008A (en) * | 2017-04-05 | 2017-07-11 | 华南理工大学 | It is a kind of that blind checking method is distorted based on Jing Yin section of heterologous audio splicing |
-
2019
- 2019-11-22 CN CN201911153389.2A patent/CN111261191A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5780759A (en) * | 1995-01-12 | 1998-07-14 | Blue Chip Music Gmbh | Method for pitch recognition, in particular for musical instruments which are excited by plucking or striking |
| JP2000003188A (en) * | 1998-06-15 | 2000-01-07 | Yamaha Corp | Device and method for voice analysis and storage medium which records voice analysis program |
| US20080077262A1 (en) * | 2006-09-08 | 2008-03-27 | Apple Computer, Inc | Distortion free stitching of digital media files |
| CN101247622A (en) * | 2008-03-03 | 2008-08-20 | 中兴通讯股份有限公司 | Testing method and device of audio communication system |
| CN101740079A (en) * | 2009-11-27 | 2010-06-16 | 深圳市同洲电子股份有限公司 | Method for automatically testing audio output function based on interval tolerance method |
| CN202221451U (en) * | 2011-07-29 | 2012-05-16 | 惠州市德赛西威汽车电子有限公司 | Parameter automatic test system for vehicle-mounted entertainment system |
| CN102539955A (en) * | 2012-03-22 | 2012-07-04 | 深圳市金凯博自动化测试有限公司 | Automation testing system of vehicle-mounted multimedia |
| CN105676045A (en) * | 2016-01-08 | 2016-06-15 | 苏州工业园区博亨电子有限公司 | Vehicle-mounted multimedia performance automation testing method |
| CN106197650A (en) * | 2016-08-30 | 2016-12-07 | 陕西千山航空电子有限责任公司 | A kind of method judging that audio signal is noiseless |
| CN106791825A (en) * | 2016-12-23 | 2017-05-31 | 深圳创维数字技术有限公司 | A kind of audio automated testing method and terminal |
| CN106941008A (en) * | 2017-04-05 | 2017-07-11 | 华南理工大学 | It is a kind of that blind checking method is distorted based on Jing Yin section of heterologous audio splicing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105227939B (en) | Inter-vehicle information system testboard bay and test method | |
| CN111933108B (en) | Automatic testing method for intelligent voice interaction system of intelligent network terminal | |
| CN108091352B (en) | Audio file processing method and device, storage medium and terminal equipment | |
| CN104936098B (en) | A kind of audio setting devices and methods therefor, play system and its method | |
| CN109195090B (en) | Method and system for testing electroacoustic parameters of microphone in product | |
| CN104707331A (en) | Method and device for generating game somatic sense | |
| CN103905925A (en) | Method and terminal for repeatedly playing program | |
| JP2003177784A (en) | Method and device for extracting sound turning point, method and device for sound reproducing, sound reproducing system, sound delivery system, information providing device, sound signal editing device, recording medium for sound turning point extraction method program, recording medium for sound reproducing method program, recording medium for sound signal editing method program, sound turning point extraction method program, sound reproducing method program, and sound signal editing method program | |
| CN107086039A (en) | A kind of acoustic signal processing method and device | |
| CN111785298A (en) | Acoustic performance testing method and device, electronic equipment and computer readable medium | |
| CN109195089A (en) | Test method and system for loudspeaker electro mechanical parameter in product | |
| CN112119456A (en) | Arbitrary signal insertion method and arbitrary signal insertion system | |
| CN111261191A (en) | Automatic detection method and system for sound splicing and soundless of vehicle-mounted multimedia system | |
| EP2328143B1 (en) | Human voice distinguishing method and device | |
| TW201409227A (en) | Testing device and testing method of the Disc-Player timbre | |
| CN115731943A (en) | Plosive detection method, plosive detection system, storage medium and electronic equipment | |
| CN109658955B (en) | Plosive detection method and device | |
| CN105096982A (en) | Music switching method and device | |
| CN106534964B (en) | Method and device for adjusting speech rate | |
| KR101382356B1 (en) | Apparatus for forgery detection of audio file | |
| CN104332166B (en) | Can fast verification recording substance accuracy, the method for synchronism | |
| CN106201420A (en) | Audio-frequency processing method and device | |
| CN112769645A (en) | Terminal testing method and device, terminal equipment and storage medium | |
| KR20210042851A (en) | audio recognition method, audio recognition apparatus, electronic equipment, computer readable storage medium and computer program | |
| JP2023526285A (en) | Test method and apparatus for full-duplex voice interaction system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200609 |
|
| RJ01 | Rejection of invention patent application after publication |