WO2002093552A1 - Estimating signal power in compressed audio - Google Patents
Estimating signal power in compressed audio Download PDFInfo
- Publication number
- WO2002093552A1 WO2002093552A1 PCT/IB2002/001561 IB0201561W WO02093552A1 WO 2002093552 A1 WO2002093552 A1 WO 2002093552A1 IB 0201561 W IB0201561 W IB 0201561W WO 02093552 A1 WO02093552 A1 WO 02093552A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- audio signal
- signal
- scale factors
- compressed audio
- sub
- Prior art date
Links
- 230000005236 sound signal Effects 0.000 claims abstract description 37
- 238000001514 detection method Methods 0.000 claims description 29
- 238000000034 method Methods 0.000 claims description 13
- 230000003044 adaptive effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 238000013179 statistical model Methods 0.000 description 4
- 230000007423 decrease Effects 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 238000010606 normalization Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000006837 decompression Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000000344 soap Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
- H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/21—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being power information
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
- H04N5/602—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for digital sound signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
Definitions
- the invention relates to estimating signal power in a compressed audio signal.
- the invention further relates to silence detection and to a receiver using such a silence detection.
- WO 96/3271 Al discloses a system for compression and decompression of audio signals for digital transmission, wherein ancillary data may be multiplexed and encoded with audio data and transmitted in such a way that it may be decoded.
- This document discloses on page 159 the calculation of a minimum scale factor value to look for in another channel to see if audio is present.
- the invention provides a method and a device for estimating a signal power, a silence detector and a receiver as defined in the independent claims.
- Advantageous embodiments are defined in the dependent claims.
- a signal power is estimated in a compressed audio signal comprising blocks of quantized samples, wherein a given block is provided with a set of scale factors.
- the set of scale factors is extracted from the compressed audio signal, and the signal power is estimated in the given block based on a combination of the scale factors.
- the given block may be one or more audio frames or part of an audio frame.
- Scale factors can easily be extracted from the compressed audio signal. The invention is based on the insight that a scale factor represents the maximum possible value of the samples it relates to.
- a combination of the scale factors e.g. a sum of the squared scale factors, therefore gives a rough estimation of the signal power, only requiring limited computational load. The rough estimation is quite sufficient for some applications such as e.g. silence detection in commercial detectors.
- only a sub-set of the scale factors is used.
- the computational load is further reduced. This may result in a lower accuracy, but this is acceptable for some applications like silence detection in commercial detectors etc.
- Forming a sub-set of scale factors may be performed by omitting scale factors in time direction and/or in frequency direction.
- the sub-set may only include a sub-set of a plurality of narrow band sub-signals available in the compressed audio signal, the sub-set preferably including the scale factors of a number of lower frequency sub-signals.
- the compressed audio signal is a stereo or multi-channel signal
- only a subset of the available channels may be used.
- Fig. 1 shows a receiver according to an embodiment of the invention
- Fig. 2 shows an exemplary audio frame including 32 sub-bands, each sub-band being sub-divided in 3 blocks, each block being including 12 quantized samples and being provided with a scale factor;
- Fig. 3 shows the exemplary audio frame of Fig. 2 wherein for each sub-band a maximum scale factor is selected, a possible selection is highlighted in gray;
- Fig. 4 shows an exemplary diagram wherein circles represent local signal powers of detected silences and wherein crosses represent an average of these local signal powers;
- Fig. 5 shows an exemplary likelihood function related to Fig. 4.
- the drawings only show those elements that are helpful to understand the embodiments of the invention.
- Fig. 1 shows a receiver 1 according to an embodiment of the invention for receiving a compressed audio signal [A].
- the receiver 1 comprises an input 10 for obtaining the compressed audio signal [A].
- the input 10 may be an antenna, a network connection, a reading device, etc.
- the receiver 1 further comprises a silence detector 11 for detecting silences in the compressed audio signal, and an influencing block 12 for influencing the audio signal depending on the detection of the silences.
- the block 12 may e.g. be a decoder for decoding the compressed audio signal, wherein the decoding depends on the detected silences.
- the block 12 may also be a skipping block for skipping parts of the compressed audio depending on the detected silences.
- the silence detector 11 may be enhanced to form a commercial detector.
- Detected commercials may be skipped during decoding.
- the influenced audio signal A decoded or still compressed, can be outputted to output 13.
- the output 13 may be a network connection, a reproduction device or a recording device.
- the compressed audio signal [A] may be included in a program stream, which program stream further includes a video signal.
- the program signal may be influenced in block 12 at least partly depending on the silences detected in the compressed audio signal.
- An advantageous application is a storage device, which stores only non-commercial content. Embodiments of the invention are described in the context of silence detection for use in e.g. commercial detection.
- EP 1 006 685 A2 discloses a method and apparatus for processing a television signal, and for detecting the presence of commercials in the television signal.
- a commercial candidate section detector detects a commercial candidate section on the basis of a quiet section and a scene change point.
- a commercial characteristic quantity detector judges whether the commercial candidate section has various characteristics of commercials, and adds a predetermined value to a commercial characteristic value on the basis of the judgment result.
- the commercial characteristics quantity detector compares the final commercial characteristic value with a predetermined threshold value, and judges on the basis of the comparison result whether the commercial candidate section is a commercial section.
- a quiet section detector compares the level of a digitized audio signal with a threshold value to detect quiet sections, and outputs the comparison result to a scene change detector. Further reference is made to EP 1 087 557 A2.
- a commercial detector automatically detects commercial blocks in audiovisual streams. This allows to skip commercials during any kind of processing such as key-frame extraction, editing or playback.
- local statistics are measured on a sliding window and compared to a statistical model of commercials. By this comparison a normalized likelihood function is derived which tells how the audio signal is locally similar to commercials.
- the likelihood function can be properly triggered for the commercial detection.
- the statistical window is chosen in order to be both detailed in the local analysis and robust against local irregularities and fluctuations, which do not affect the detection.
- the algorithm is adaptive to some conditions, which can vary along a single stream or between one stream and another.
- the algorithm is video independent. Video analysis can nevertheless be included to enhance or extend the classification.
- the algorithm can be applied to several kinds of storage systems.
- Many audio coders e.g. MPEG-1 Layer 1/2/3, MPEG-2 Layer 1/2/3, MPEG-2 AAC, MPEG-4 AAC, AC-3) are frequency domain coders. They split the source spectrum into a number of narrow band sub-signals and quantize each frequency component or sample separately. Frequency components or samples are quantized according to a scale factor and according to a bit allocation. These scale factors can be regarded as indicators of the maximum value of frequency components or samples.
- the narrow band sub-signals are divided in groups of 12 quantized samples, where each group has a corresponding scale factor.
- This scale factor corresponds to the maximum value of the samples it relates to.
- the detection algorithm preferably uses a subset of the scale factors. In all or a subset of the narrow band sub-signals an upper bound of the signal power is calculated by squaring the scale factors.
- An embodiment using MPEG audio compression is described in more detail now.
- the audio signal is divided in time intervals of 24 msec, 26.1 msec or 36 msec for a sampling rate of 48 kHz, 44.1 kHz or 32 kHz respectively. In each of these intervals the signal is encoded in a frame. Referring to Fig.l, each frame interval is divided in three parts and the signal is decomposed in 32 subband components.
- each subband component and each third of a frame 12 samples are quantized according to a scale factor and according to a number of bits properly chosen.
- the scale factor gives an upper bound estimate of the absolute value of the 12 samples. This estimate may not be very accurate, but this is not required for the commercial detection.
- the scale factors can be extracted from each audio frame with negligible computational load, as they are directly available in the frame as pseudo logarithmic indexes. Only some limited frame header decoding is required. No decompression is necessary.
- each channel has its own 96 scale factors per frame.
- the detection algorithm selects only the maximum scale factor in each subband of the left or right channel (see Fig. 2): 32 values are buffered and converted to the linear (not logarithmic) format. For instance, for a 48kHz audio sampling rate, only subbands 0...26 are used according to the standard: this gives 27 samples every 24 msec that is 1125 samples/sec, a very modest input data rate for the commercial detector.
- the squares of the buffered scale factors are calculated to obtain an upper bound on the subband signal powers. These are then used as follows: (1) their sum gives an upper bound on the total short time power;
- the summation is to be performed over the number of sub-bands at a given time instance.
- the summation has to be performed over the total number of sub-bands or the number of used sub-bands depending on the application.
- Silence detection is based on nested thresholds on: 1) local signal power level, by using e.g. Framejpower as indicated above 2) silence duration; and at least one of the following parameters:
- the silence detector is preferably adaptive. Therefore, in order to be adaptive, local power level related parameters (i.e. 1), 3) and/or 4) ) are compared with their average values in time.
- a typical threshold for the local signal power is 0.01, i.e. the local signal power should be less than one percent of the time average of the signal power.
- the time average is calculated by using an adaptation window with length w frames.
- the silence duration is the duration that the local signal power level is below a given fixed or adaptive threshold power level.
- the linear deviation is a summation of (frame power minus mean frame power) over at least part of the silence duration. The linear deviation and fall/rise rate are used to filter part of the silences, which may be perceptual but are not relevant for the commercial detection.
- the local signal power level is preferably determined by using the scale factors as described above, for example per audio frame or part of an audio frame.
- a practical range for silence duration breaks between commercials in a commercial block is 3/25 sec to 20/25 sec.
- silence beginning time The values of silence beginning time, silence duration and silence local power level are buffered for the statistical calculations mentioned below.
- the commercials are characterized with a local statistical model of the following features:
- the local bandwidth of an audio frame j may be calculated from the scale factors in the following manner: used subbands- ⁇ ( sed subbands-l
- a 0.5 -normalised likelihood function is obtained, with values between 0 and 1. It represents how much the local statistics of this feature are similar to those of commercials.
- the different likelihood functions are then combined with different weights to obtain a global likelihood function, still 0.5 normalized, which exploits all the information at a time.
- the global likelihood function is calculated in each point of the time axis, which was buffered as a silence beginning instant.
- the value 0.5 means basically "total uncertainty" or "0.5 probability of being inside a commercial block”.
- the likelihood function can be used in different ways. It can be properly triggered to detect commercial boundaries. It can be used (as a normalized soft classification between commercials and non-commercials) by algorithms that make further analysis and classifications, exploiting optionally also video features.
- Video features of different levels can be statistically analyzed together with audio features applying the same likelihood method or other methods.
- the triggered commercial detection with refilling has been developed and tested, based on the previously described audio analysis.
- a sequence of commercials is only detected if it lasts at least 60 sec. If only for a short interval inferior to 45 sec the likelihood function goes below 0.5, Q(t) is set to 1. This procedure has been called “internal refilling". The internal refilling eliminates sporadic internal missing detections. An “external refilling" is applied at the beginning and end of the commercials. For instance if: tj , ti + i, ..., tj +N j — is a sequence of instants in which detected silences start and
- the external refilling is effective in avoiding the systematic miss of the first and last spots. This fact is related to windowing details.
- the external and internal refilling can be considered as a special non-linear filtering, upper driven.
- a general-purpose statistical model of commercial blocks may be used. It is possible to refine the statistical detail, using different commercial block models for the different times of the day and/or the different kind of programs (soaps, talk shows, football matches, etc.) and/or the different channels. Although this is not necessary to obtain satisfying performances, it may of course improve them. It is a matter of trade off between the complexity of the target system and its performance. Adaptability of the detection is preferred as the conditions change in time for a single channel. Moreover adaptability to channel switching is preferred.
- the local minimum noise level may change in time for a single channel and can change a lot from one channel to another: this is critical for silence detection.
- adaptability in the statistical model of commercial blocks is not critical but useful.
- the system may be implemented as a fully self-training (adaptive) on the local minimum noise level. The only constraint is applying a reset of the algorithm every time the channel is switched. This is because the adaptability is fast in the initial period and slower in the following, for matters of trade off between adaptability and precision. If the algorithm is made fast adaptive at any time, the precision of the detection will decrease because inside the commercial blocks a relatively fast adaptation will decrease the precision. In a practical embodiment, the switch-adaptability is valid only in the first minutes (i.e.
- Low false detection is more relevant in the case of a simple playback.
- the value of the bandwidth is required with a low sampling rate on a two minutes (other values may be chosen) symmetric sliding window. Therefore it can be estimated for instance by the average of successive short interval FFT's with a low number of points.
- a practical implementation is based on product combination term by term or globally with renormalization.
- the product is basically a Boolean AND extended from the Boolean set ⁇ 0, 1 ⁇ to the continuous interval [0, 1]. It ensures good selectivity.
- the current implementation is based on product combination with renormalization.
- the product is basically a Boolean AND extended from the Boolean set ⁇ 0, 1 ⁇ to the continuous interval [0, 1]. It ensures good selectivity.
- a semi-sum is a sort of extension of the Boolean OR, which does however not ensure sufficient selectivity.
- the algorithm detects commercial blocks in audio-visual material and marks their boundaries. Commercial blocks can then be skipped during any kind of processing like browsing, automatic trailer creation, editing or simple playback.
- This functionality can be integrated in several kinds of storage systems, with very low additional cost. It can be applied either in real time during acquisition of the data or offline to stored material.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Stereo-Broadcasting Methods (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
- Television Systems (AREA)
- Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
- Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
- Signal Processing Not Specific To The Method Of Recording And Reproducing (AREA)
- Air Bags (AREA)
- Control Of Stepping Motors (AREA)
- Amplifiers (AREA)
- Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE60217484T DE60217484T2 (en) | 2001-05-11 | 2002-05-08 | ESTIMATING THE SIGNAL POWER IN A COMPRESSED AUDIO SIGNAL |
JP2002590144A JP4365103B2 (en) | 2001-05-11 | 2002-05-08 | Estimation of signal power in compressed audio |
KR1020037000456A KR100916959B1 (en) | 2001-05-11 | 2002-05-08 | Estimating signal power in compressed audio |
EP02726366A EP1393301B1 (en) | 2001-05-11 | 2002-05-08 | Estimating signal power in compressed audio |
US10/476,965 US7356464B2 (en) | 2001-05-11 | 2002-05-08 | Method and device for estimating signal power in compressed audio using scale factors |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP01201730.7 | 2001-05-11 | ||
EP01201730 | 2001-05-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2002093552A1 true WO2002093552A1 (en) | 2002-11-21 |
Family
ID=8180284
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2002/001561 WO2002093552A1 (en) | 2001-05-11 | 2002-05-08 | Estimating signal power in compressed audio |
PCT/IB2002/001639 WO2002093801A2 (en) | 2001-05-11 | 2002-05-10 | Silence detection |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2002/001639 WO2002093801A2 (en) | 2001-05-11 | 2002-05-10 | Silence detection |
Country Status (8)
Country | Link |
---|---|
US (2) | US7356464B2 (en) |
EP (2) | EP1393301B1 (en) |
JP (2) | JP4365103B2 (en) |
KR (2) | KR100916959B1 (en) |
CN (3) | CN100380441C (en) |
AT (1) | ATE438968T1 (en) |
DE (2) | DE60217484T2 (en) |
WO (2) | WO2002093552A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9525897B2 (en) | 2014-05-28 | 2016-12-20 | Exaget Oy | Insertion of a content item to a media stream |
Families Citing this family (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7469206B2 (en) | 2001-11-29 | 2008-12-23 | Coding Technologies Ab | Methods for improving high frequency reconstruction |
SE0202770D0 (en) * | 2002-09-18 | 2002-09-18 | Coding Technologies Sweden Ab | Method of reduction of aliasing is introduced by spectral envelope adjustment in real-valued filterbanks |
US20040088723A1 (en) * | 2002-11-01 | 2004-05-06 | Yu-Fei Ma | Systems and methods for generating a video summary |
US7116716B2 (en) * | 2002-11-01 | 2006-10-03 | Microsoft Corporation | Systems and methods for generating a motion attention model |
US7260261B2 (en) * | 2003-02-20 | 2007-08-21 | Microsoft Corporation | Systems and methods for enhanced image adaptation |
EP1531478A1 (en) * | 2003-11-12 | 2005-05-18 | Sony International (Europe) GmbH | Apparatus and method for classifying an audio signal |
US8014882B2 (en) * | 2004-04-06 | 2011-09-06 | Panasonic Corporation | Particular program detection device, method, and program |
CN1934650A (en) * | 2004-06-18 | 2007-03-21 | 松下电器产业株式会社 | AV content processing device, AV content processing method, av content processing program, and integrated circuit used in av content processing device |
US9053754B2 (en) | 2004-07-28 | 2015-06-09 | Microsoft Technology Licensing, Llc | Thumbnail generation and presentation for recorded TV programs |
US7986372B2 (en) * | 2004-08-02 | 2011-07-26 | Microsoft Corporation | Systems and methods for smart media content thumbnail extraction |
JPWO2007039998A1 (en) * | 2005-09-30 | 2009-04-16 | パイオニア株式会社 | Non-Body scene extraction device and program thereof |
US20070112811A1 (en) * | 2005-10-20 | 2007-05-17 | Microsoft Corporation | Architecture for scalable video coding applications |
US8180826B2 (en) * | 2005-10-31 | 2012-05-15 | Microsoft Corporation | Media sharing and authoring on the web |
US7773813B2 (en) | 2005-10-31 | 2010-08-10 | Microsoft Corporation | Capture-intention detection for video content analysis |
US8196032B2 (en) * | 2005-11-01 | 2012-06-05 | Microsoft Corporation | Template-based multimedia authoring and sharing |
US7599918B2 (en) | 2005-12-29 | 2009-10-06 | Microsoft Corporation | Dynamic search with implicit user intention mining |
JP4698453B2 (en) * | 2006-02-28 | 2011-06-08 | 三洋電機株式会社 | Commercial detection device, video playback device |
TWI312981B (en) * | 2006-11-30 | 2009-08-01 | Inst Information Industr | Voice detection apparatus, method, computer program product, and computer readable medium for adjusting a window size dynamically |
GB2447985B (en) | 2007-03-30 | 2011-12-28 | Wolfson Microelectronics Plc | Pattern detection circuitry |
GB2482444B (en) * | 2007-03-30 | 2012-08-01 | Wolfson Microelectronics Plc | Pattern detection circuitry |
US8081313B2 (en) * | 2007-05-24 | 2011-12-20 | Airbus Operations Limited | Method and apparatus for monitoring gas concentration in a fluid |
JP2008009442A (en) * | 2007-07-23 | 2008-01-17 | Video Research:Kk | Voice data processing method |
CN101393744B (en) * | 2007-09-19 | 2011-09-14 | 华为技术有限公司 | Method for regulating threshold of sound activation and device |
KR20100006492A (en) | 2008-07-09 | 2010-01-19 | 삼성전자주식회사 | Method and apparatus for deciding encoding mode |
GB0813715D0 (en) * | 2008-07-28 | 2008-09-03 | Airbus Uk Ltd | A monitor and a method for measuring oxygen concentration |
PA8847501A1 (en) * | 2008-11-03 | 2010-06-28 | Telefonica Sa | METHOD AND REAL-TIME IDENTIFICATION SYSTEM OF AN AUDIOVISUAL AD IN A DATA FLOW |
WO2010103422A2 (en) | 2009-03-10 | 2010-09-16 | Koninklijke Philips Electronics N.V. | Apparatus and method for rendering content |
US20100319015A1 (en) * | 2009-06-15 | 2010-12-16 | Richard Anthony Remington | Method and system for removing advertising content from television or radio content |
US8340964B2 (en) * | 2009-07-02 | 2012-12-25 | Alon Konchitsky | Speech and music discriminator for multi-media application |
US8606569B2 (en) * | 2009-07-02 | 2013-12-10 | Alon Konchitsky | Automatic determination of multimedia and voice signals |
US10116902B2 (en) * | 2010-02-26 | 2018-10-30 | Comcast Cable Communications, Llc | Program segmentation of linear transmission |
US9047878B2 (en) * | 2010-11-24 | 2015-06-02 | JVC Kenwood Corporation | Speech determination apparatus and speech determination method |
CN105741835B (en) * | 2016-03-18 | 2019-04-16 | 腾讯科技(深圳)有限公司 | A kind of audio-frequency information processing method and terminal |
CN108665657B (en) * | 2017-03-30 | 2019-12-10 | 国基电子(上海)有限公司 | sensor and monitoring system using same |
CN107424620B (en) * | 2017-07-27 | 2020-12-01 | 苏州科达科技股份有限公司 | Audio decoding method and device |
CN116417015B (en) * | 2023-04-03 | 2023-09-12 | 广州市迪士普音响科技有限公司 | Silence detection method and device for compressed audio |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4672669A (en) * | 1983-06-07 | 1987-06-09 | International Business Machines Corp. | Voice activity detection process and means for implementing said process |
EP0450631A2 (en) * | 1990-04-06 | 1991-10-09 | Kabushiki Kaisha Video Research | Automatic commercial message recognition device |
WO1996032710A1 (en) * | 1995-04-10 | 1996-10-17 | Corporate Computer Systems, Inc. | System for compression and decompression of audio signals for digital transmission |
EP0944036A1 (en) * | 1997-04-30 | 1999-09-22 | Nippon Hoso Kyokai | Method and device for detecting voice sections, and speech velocity conversion method and device utilizing said method and device |
EP1073209A2 (en) * | 1999-07-26 | 2001-01-31 | Matsushita Electric Industrial Co., Ltd. | Subband encoding and decoding system for data compression and decompression |
Family Cites Families (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4696039A (en) * | 1983-10-13 | 1987-09-22 | Texas Instruments Incorporated | Speech analysis/synthesis system with silence suppression |
JPS63118197A (en) * | 1986-11-06 | 1988-05-23 | 松下電器産業株式会社 | Voice detector |
JPH0636158B2 (en) * | 1986-12-04 | 1994-05-11 | 沖電気工業株式会社 | Speech analysis and synthesis method and device |
JPH03253899A (en) * | 1990-03-05 | 1991-11-12 | Ricoh Co Ltd | Voice section detection system |
WO1996003271A1 (en) | 1993-01-25 | 1996-02-08 | Jean Alphonse David | Method for filament winding fabrication of box structures having multicellular walls made of thermal settable composite materials |
US5334947A (en) * | 1993-07-06 | 1994-08-02 | Aphex Systems, Ltd. | Logic enhanced noise gate |
JPH07225593A (en) * | 1994-02-10 | 1995-08-22 | Fuji Xerox Co Ltd | Sound processor |
JPH0854895A (en) * | 1994-08-11 | 1996-02-27 | Matsushita Electric Ind Co Ltd | Reproducing device |
JPH08237135A (en) * | 1994-10-28 | 1996-09-13 | Nippon Steel Corp | Coding data decodr and video audio multiplex data decoder using the decoder |
KR0171840B1 (en) * | 1995-02-04 | 1999-04-15 | 김광호 | Circuit for separating scale factor |
JPH09152894A (en) * | 1995-11-30 | 1997-06-10 | Denso Corp | Sound and silence discriminator |
US5890109A (en) * | 1996-03-28 | 1999-03-30 | Intel Corporation | Re-initializing adaptive parameters for encoding audio signals |
GB9606680D0 (en) * | 1996-03-29 | 1996-06-05 | Philips Electronics Nv | Compressed audio signal processing |
JPH1055150A (en) * | 1996-08-12 | 1998-02-24 | Syst Works:Kk | Method and device for voice interruption |
CN1189664A (en) * | 1997-01-29 | 1998-08-05 | 合泰半导体股份有限公司 | Sub-voice discrimination method of voice coding |
EP0867856B1 (en) * | 1997-03-25 | 2005-10-26 | Koninklijke Philips Electronics N.V. | Method and apparatus for vocal activity detection |
US6324188B1 (en) * | 1997-06-12 | 2001-11-27 | Sharp Kabushiki Kaisha | Voice and data multiplexing system and recording medium having a voice and data multiplexing program recorded thereon |
JP2000029486A (en) * | 1998-07-09 | 2000-01-28 | Hitachi Ltd | Speech recognition system and method therefor |
US6801895B1 (en) * | 1998-12-07 | 2004-10-05 | At&T Corp. | Method and apparatus for segmenting a multi-media program based upon audio events |
CN1094280C (en) * | 1998-08-17 | 2002-11-13 | 英业达股份有限公司 | Method for detecting squelch of IP telephone |
JP2000165806A (en) | 1998-11-30 | 2000-06-16 | Sony Corp | Information processing unit, its method and providing medium |
JP2000172283A (en) * | 1998-12-01 | 2000-06-23 | Nec Corp | System and method for detecting sound |
JP2000214872A (en) * | 1999-01-20 | 2000-08-04 | Matsushita Electric Ind Co Ltd | Voice-detecting device |
GB9912577D0 (en) * | 1999-05-28 | 1999-07-28 | Mitel Corp | Method of detecting silence in a packetized voice stream |
US6658027B1 (en) * | 1999-08-16 | 2003-12-02 | Nortel Networks Limited | Jitter buffer management |
EP1087557A3 (en) | 1999-09-22 | 2005-01-19 | Matsushita Electric Industrial Co., Ltd. | Apparatus for transmitting digital audio data and receiving apparatus for receiving the digital audio data |
JP3697967B2 (en) * | 1999-09-22 | 2005-09-21 | 松下電器産業株式会社 | Audio transmitting apparatus and audio receiving apparatus |
US6993245B1 (en) * | 1999-11-18 | 2006-01-31 | Vulcan Patents Llc | Iterative, maximally probable, batch-mode commercial detection for audiovisual content |
JP4300697B2 (en) * | 2000-04-24 | 2009-07-22 | ソニー株式会社 | Signal processing apparatus and method |
JP2001344905A (en) * | 2000-05-26 | 2001-12-14 | Fujitsu Ltd | Data reproducing device, its method and recording medium |
-
2002
- 2002-05-08 WO PCT/IB2002/001561 patent/WO2002093552A1/en active IP Right Grant
- 2002-05-08 CN CNB028015509A patent/CN100380441C/en not_active Expired - Fee Related
- 2002-05-08 DE DE60217484T patent/DE60217484T2/en not_active Expired - Lifetime
- 2002-05-08 JP JP2002590144A patent/JP4365103B2/en not_active Expired - Fee Related
- 2002-05-08 US US10/476,965 patent/US7356464B2/en not_active Expired - Fee Related
- 2002-05-08 KR KR1020037000456A patent/KR100916959B1/en active IP Right Grant
- 2002-05-08 EP EP02726366A patent/EP1393301B1/en not_active Expired - Lifetime
- 2002-05-10 CN CNB2004100956810A patent/CN100348034C/en not_active Expired - Fee Related
- 2002-05-10 DE DE60233223T patent/DE60233223D1/en not_active Expired - Lifetime
- 2002-05-10 WO PCT/IB2002/001639 patent/WO2002093801A2/en active Application Filing
- 2002-05-10 JP JP2002590554A patent/JP4560269B2/en not_active Expired - Fee Related
- 2002-05-10 CN CNB028015444A patent/CN1244900C/en not_active Expired - Fee Related
- 2002-05-10 EP EP02727889A patent/EP1393480B1/en not_active Expired - Lifetime
- 2002-05-10 AT AT02727889T patent/ATE438968T1/en not_active IP Right Cessation
- 2002-05-10 US US10/476,967 patent/US7617095B2/en not_active Expired - Fee Related
- 2002-05-10 KR KR10-2003-7000454A patent/KR20030027938A/en not_active Application Discontinuation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4672669A (en) * | 1983-06-07 | 1987-06-09 | International Business Machines Corp. | Voice activity detection process and means for implementing said process |
EP0450631A2 (en) * | 1990-04-06 | 1991-10-09 | Kabushiki Kaisha Video Research | Automatic commercial message recognition device |
WO1996032710A1 (en) * | 1995-04-10 | 1996-10-17 | Corporate Computer Systems, Inc. | System for compression and decompression of audio signals for digital transmission |
EP0944036A1 (en) * | 1997-04-30 | 1999-09-22 | Nippon Hoso Kyokai | Method and device for detecting voice sections, and speech velocity conversion method and device utilizing said method and device |
EP1073209A2 (en) * | 1999-07-26 | 2001-01-31 | Matsushita Electric Industrial Co., Ltd. | Subband encoding and decoding system for data compression and decompression |
Non-Patent Citations (1)
Title |
---|
BOSI M ET AL: "ISO/IEC MPEG-2 ADVANCED AUDIO CODING", JOURNAL OF THE AUDIO ENGINEERING SOCIETY, AUDIO ENGINEERING SOCIETY. NEW YORK, US, vol. 45, no. 10, 1 October 1997 (1997-10-01), pages 789 - 812, XP000730161, ISSN: 0004-7554 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9525897B2 (en) | 2014-05-28 | 2016-12-20 | Exaget Oy | Insertion of a content item to a media stream |
Also Published As
Publication number | Publication date |
---|---|
KR20030027938A (en) | 2003-04-07 |
US7617095B2 (en) | 2009-11-10 |
KR20030015385A (en) | 2003-02-20 |
CN100348034C (en) | 2007-11-07 |
DE60233223D1 (en) | 2009-09-17 |
US20040125961A1 (en) | 2004-07-01 |
JP2004531766A (en) | 2004-10-14 |
EP1393301A1 (en) | 2004-03-03 |
DE60217484T2 (en) | 2007-10-25 |
JP4560269B2 (en) | 2010-10-13 |
KR100916959B1 (en) | 2009-09-14 |
EP1393480A2 (en) | 2004-03-03 |
CN1244900C (en) | 2006-03-08 |
DE60217484D1 (en) | 2007-02-22 |
EP1393301B1 (en) | 2007-01-10 |
JP2004520627A (en) | 2004-07-08 |
US7356464B2 (en) | 2008-04-08 |
US20040138880A1 (en) | 2004-07-15 |
WO2002093801A3 (en) | 2003-01-30 |
CN1612607A (en) | 2005-05-04 |
ATE438968T1 (en) | 2009-08-15 |
CN100380441C (en) | 2008-04-09 |
CN1462426A (en) | 2003-12-17 |
JP4365103B2 (en) | 2009-11-18 |
CN1462427A (en) | 2003-12-17 |
EP1393480B1 (en) | 2009-08-05 |
WO2002093801A2 (en) | 2002-11-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1393301B1 (en) | Estimating signal power in compressed audio | |
US7050980B2 (en) | System and method for compressed domain beat detection in audio bitstreams | |
US7346517B2 (en) | Method of inserting additional data into a compressed signal | |
US8620644B2 (en) | Encoder-assisted frame loss concealment techniques for audio coding | |
US7451091B2 (en) | Method for determining time borders and frequency resolutions for spectral envelope coding | |
JP5440051B2 (en) | Content identification method, content identification system, content search device, and content use device | |
US20060031075A1 (en) | Method and apparatus to recover a high frequency component of audio data | |
US6680753B2 (en) | Method and apparatus for skipping and repeating audio frames | |
Wang et al. | A compressed domain beat detector using MP3 audio bitstreams | |
EP2198424B1 (en) | A method and an apparatus for processing a signal | |
Doets et al. | On the comparison of audio fingerprints for extracting quality parameters of compressed audio | |
Pfeiffer et al. | Formalisation of MPEG-1 compressed domain audio features | |
EP2026482A1 (en) | Method for controlling the playback of a radio program | |
MXPA06003935A (en) | Methods and apparatus to extract codes from a plurality of channels. | |
US20040133420A1 (en) | Method of analysing a compressed signal for the presence or absence of information content | |
US20200265846A1 (en) | Audio Decoder Supporting a Set of Different Loss Concealment Tools | |
Shieh | Audio content based feature extraction on subband domain |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): CN JP KR US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 028015509 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020037000456 Country of ref document: KR |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2002726366 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 1020037000456 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10476965 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2002726366 Country of ref document: EP |
|
WWG | Wipo information: grant in national office |
Ref document number: 2002726366 Country of ref document: EP |