CN103760974B - Music modulation processing method for modular force sense interactive device - Google Patents

Music modulation processing method for modular force sense interactive device Download PDF

Info

Publication number
CN103760974B
CN103760974B CN201410000980.5A CN201410000980A CN103760974B CN 103760974 B CN103760974 B CN 103760974B CN 201410000980 A CN201410000980 A CN 201410000980A CN 103760974 B CN103760974 B CN 103760974B
Authority
CN
China
Prior art keywords
signal
interactive device
sampled digital
separating
force sense
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410000980.5A
Other languages
Chinese (zh)
Other versions
CN103760974A (en
Inventor
王党校
徐牧
张玉茹
杨潇潇
杨高峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN201410000980.5A priority Critical patent/CN103760974B/en
Publication of CN103760974A publication Critical patent/CN103760974A/en
Application granted granted Critical
Publication of CN103760974B publication Critical patent/CN103760974B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a kind of music modulation processing method for modular force sense interactive device, belong to the driving field of force sense interactive device, the method includes: receive the data signal of audio frequency;The data signal of audio frequency is carried out signal extraction process, obtains sampled digital signal;Sampled digital signal is carried out separating treatment;If obtaining separating signal after separating treatment, then will separate the signal output respective modules to modular force sense interactive device.The method is by carrying out signal extraction process to the data signal of audio frequency, achieve and music signal is carried out resampling, and ensure that the signal after employing is closer to original audio signal, undistorted, the signal of the output driving each module of modular force sense interactive device that can be correct after sampled digital signal being separated by separating treatment, realize exporting different vibrations sensations and power sense, at utmost improve the experience effect of user.

Description

Music modulation processing method for modular force sense interactive device
Technical field
The present invention relates to the control field of force sense interactive device, particularly relate to a kind of for modularization dynamic sensing interexchanging The music modulation processing method of equipment.
Background technology
In 10 years of past, haptic technology is applied to mobile device and is always a much-talked-about topic.Such as, Poupyrev et al. develops a kind of high performance haptic device, is named as Touch Engine, and this device employs Multilayer piezoelectric ceramic, it is provided that abundant vibrations sense of touch feedback.But force sense interactive device based on piezoelectric ceramics Cost is high, can only have a module job, it is impossible to export diversified power sense.
Inwook Hwang has presided over a research, and this research introduces one can produce synchronous vibration in real time Musical instruments is moved in the double frequency-band sense of touch of sense of touch.This sense of touch is moved musical instruments and be have employed brand-new miniature double mode Driver, two main frequencies needed for vibration can be produced and run and vibrate generating algorithm in real time, can play from The two-band vibration information (bass and high pitch) extracted in music file.Musical instruments controlling party is moved in this sense of touch Formula at least has the disadvantage in that and can not meet the desired diversified oscilloreception of user.And also cannot meet, Experience it is intended that the abundant power of the multiple points obtained on the human body of very high surface area is felt.
Texas Instruments (Texas Instruments) releases the driving of a DRV2605 in June, 2013 Device, can be directly accessed audio signal, drives a vibrating motor.Its advantage is that user can obtain and music One vibration signal of signal correction;Shortcoming is, can only control a motor simultaneously, or control several motor Export same power sense.Many kinds of force sense cannot be exported simultaneously.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind of music for modular force sense interactive device and modulates Processing method, can be modulated music signal processing, and output drives multimode force sense interactive device disparate modules Signal, thus solve existing signal processing method and can only export single power and feel control signal, power sense is single, The problem that can not meet Consumer's Experience very well.
For solving above-mentioned technical problem, the present invention provides a kind of music for modular force sense interactive device to modulate Processing method, including:
Receive the data signal of audio frequency;
The data signal of described audio frequency is carried out signal extraction process, obtains sampled digital signal;
Described sampled digital signal is carried out separating treatment;
If obtaining separating signal after separating treatment, then described separation signal is exported to modular force sense interactive device Respective modules.
The invention have the benefit that by the data signal of audio frequency is carried out signal extraction process, it is achieved that right Music signal carries out resampling, and ensure that the signal after employing closer to original audio signal, undistorted, logical Cross and can export as driving each mould of modular force sense interactive device after sampled digital signal is separated by separating treatment The signal of block, it is achieved export different vibrations sensations and abundant power sense, at utmost improves the experience effect of user Really.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, required in embodiment being described below The accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only some of the present invention Embodiment, from the point of view of those of ordinary skill in the art, on the premise of not paying creative work, also may be used To obtain other accompanying drawings according to these accompanying drawings.
The schematic diagram of the music modulation processing method that Fig. 1 provides for the embodiment of the present invention;
The schematic diagram of the music modulation processing method that Fig. 2 provides for the embodiment of the present invention;
The schematic diagram of the music modulation processing method that Fig. 3 provides for the embodiment of the present invention.
Detailed description of the invention
Below the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described Embodiment is only a part of embodiment of the present invention rather than whole embodiments.Based on embodiments of the invention, The every other embodiment that those of ordinary skill in the art are obtained under not making creative work premise, all Belong to protection scope of the present invention.
Fig. 1 show the embodiment of the present invention and provides a kind of music modulation treatment for modular force sense interactive device Method, can be that the Wearable haptic interaction equipment being made up of modular force feedback component provides driving signal, should Method includes:
Receive the data signal of audio frequency;
The data signal of described audio frequency is carried out signal extraction process, obtains sampled digital signal;
Described sampled digital signal is carried out separating treatment;
If obtaining separating signal after separating treatment, then described separation signal is exported to modular force sense interactive device Respective modules.
As in figure 2 it is shown, in above-mentioned processing method, the data signal of audio frequency is carried out signal extraction process, obtains Sampled digital signal includes:
Step 1, counting and the time of the data signal of calculating audio frequency;
Step 2, counts and data signal after the time carries out wavelet transformation to calculating;Db4 specifically can be used little Wave conversion algorithm carries out multi-level wavelet transform;More traditional Fourier transformation, in terms of music signal compression, more can Retaining the authenticity of audio signal, the signal after conversion is closer to original audio signal.Due to audio signal 1s There are several ten thousand points, carry out wavelet transformation and can reduce the point of half.Signal only carries out repeatedly small echo become Change, the minimizing certain limit of counting within 1s (could be met the motor of the module of modular force sense interactive device Response time), thus improve treatment effeciency.
Step 3, signal is split into high-frequency sub-band energy and low frequency coefficient two parts, often by after wavelet transformation The frequency of a part of signal is original half, obtains high-frequency sub-band energy the data signal after wavelet transformation Amount, utilizes high-frequency sub-band energy high-frequency sub-band former to the data signal energy obtained to be updated;
Step 4, after updating the high-frequency sub-band energy of data signal, it may be judged whether reaches sampling standard and (judges mark Standard is: the signal frequency after sampling is 10Hz);If the determination result is YES, then step 5 is carried out, if judging knot Fruit is no, then carry out step 6,
Step 5, is sampled data signal, and is taken out as signal by the sampled digital signal obtained after sampling Take the sampled digital signal after process, carry out step 7;
Step 6, carry out step 2;
Step 7, terminates this signal extraction carrying out the data signal of audio frequency and processes.
The above-mentioned data signal to audio frequency carries out signal extraction process, and audio frequency extraction uses the mode pair of wavelet transformation Music signal has carried out resampling, particularly wavelet transformation and has used the multi-level wavelet transform of db4 algorithm, more traditional Fourier extraction signal, closer to primary signal.Signal extraction is avoided to process the distortion caused.
As it is shown on figure 3, in above-mentioned processing method, sampled digital signal is carried out separating treatment and includes:
Step 21, calculates mean μ and standard deviation delta of sampled digital signal,
Step 22, relatively sampled digital signal x (t) in a certain moment and mean μ and standard deviation delta, if x (t) Less than the value (i.e. x (t) < μ-0.8 × delta) of standard deviation delta that mean μ deducts 0.8 times, carry out step 23; If x (t) deducts the value of standard deviation delta of 0.8 times and x (t) less than mean μ plus the standard of 0.8 times more than mean μ Value (i.e. μ-0.8 × delta) < x (t) < μ+0.8 × delta of difference delta), carry out step 24;If x (t) More than mean μ plus value x (t) (i.e. x (t) > μ+0.8 × delta) of standard deviation delta of 0.8 times, carry out Step 25;
Step 23, without separating signal output, corresponding, do not drive each module of modular force sense interactive device, Carry out step 26;
Step 24, construct by random number y(of Gaussian Profile its to be uniformly distributed interval be 0~1, construct random number Seed seed be 0, if y is more than 0 and less than or equal to 3/1(that is 0 < y≤1/3), the separation signal of output As separating signal one;If y is more than 1/3rd and less than or equal to 3/2(that is 1/3 < y≤2/3), output Separate signal as separating signal two;If y is more than 2/3rds and less than or equal to 1(that is 2/3 < y≤1), output Separation signal as separating signal three, corresponding, separate signal one and can be used as driving modularization dynamic sensing interexchanging to set The driving signal of standby module one, separation signal two can be used as the module two of driving modular force sense interactive device Drive signal, separate signal three and can be used as driving the driving signal of the module three of modular force sense interactive device, enter Row step 26;
Step 25, using whole signals as separating signal output, corresponding, separate signal and drive modular force to feel Whole modules of interactive device, carry out step 26;
Step 26, terminates this separating treatment carrying out sampled digital signal.
Above-mentioned separating treatment, the data signal that signal extraction processes extraction carries out statistical analysis and random place Reason, formed can the separation signal of modules of discrete control module force sense interactive device, thus realize output Different vibrations sensations and power sense, it is achieved that drive modular force sense interactive device at utmost to improve the body of user Test effect.
In sum, the processing method of the present invention, control motor the most without distortions with music signal defeated Go out the control processing method of many kinds of force sense, can be modulated music signal processing, in terms of music signal extraction, The control signal extracted can reflect the authenticity of music signal very well, can after the separated process of signal of extraction Drive modular force sense interactive device modules (motor as in modules) with output, thus realize driving The vibrations that the modules output of dynamic modularization force sense interactive device is different are felt and enrich power sense, improve user's Experience.
The above, the only present invention preferably detailed description of the invention, but protection scope of the present invention not office Being limited to this, any those familiar with the art, in the technical scope of present disclosure, can think easily The change arrived or replacement, all should contain within protection scope of the present invention.Therefore, protection scope of the present invention Should be as the criterion with the protection domain of claims.

Claims (3)

1. the music modulation processing method for modular force sense interactive device, it is characterised in that including:
Receive the data signal of audio frequency;
The data signal of described audio frequency is carried out signal extraction process, obtains sampled digital signal;
Described sampled digital signal is carried out separating treatment;Described described sampled digital signal carried out separating treatment include:
Step 21, calculates mean μ and standard deviation delta of described sampled digital signal;
Step 22, relatively described mean μ deduct the value sampled digital letter less than a certain moment of described standard deviation delta of 0.8 times Number x (t), carries out step 23;If relatively the value of described standard deviation delta that described mean μ deducts 0.8 times is equal to x (t), carry out Step 24;If relatively described mean μ is plus the value of described standard deviation delta of 0.8 times more than x (t), carry out step 25;
Step 23, without separating signal output, carries out step 26;
Step 24, structure is by random number y of Gaussian Profile, and the interval that is uniformly distributed of y is 0~1, the seed of structure random number Seed is 0, if y is more than 0 and less than or equal to 1/3rd, the separation signal of output is as separating signal one;If y more than 3/ 1 and less than or equal to 2/3rds, the separation signal of output is as separating signal two;If y is more than 2/3rds and less than or equal to 1, defeated The separation signal gone out, as separating signal three, carries out step 26;
Step 25, using whole signals as separating signal output, carries out step 26;
Step 26, terminates this and described sampled digital signal is carried out separating treatment;
If obtaining separating signal after separating treatment, then by the correspondence of described separation signal output to modular force sense interactive device Module.
Music modulation processing method for modular force sense interactive device the most according to claim 1, its feature exists In, the described data signal to described audio frequency carries out signal extraction process, obtains sampled digital signal and includes:
Step 1, calculates the counting and the time of data signal of described audio frequency;
Step 2, counts and described data signal after the time carries out wavelet transformation to calculating;
Step 3, obtains high frequency coefficient the described data signal after wavelet transformation, utilize the high frequency coefficient obtained to described Former high frequency coefficient in data signal is updated;
Step 4, after updating the former high frequency coefficient of described data signal, it may be judged whether reach sampling standard;If judged result is It is then to carry out step 5, if judged result is no, then carries out step 6,
Step 5, is sampled described signal, and will after sampling the described sampled digital signal that obtains as at signal extraction Sampled digital signal after reason, carries out step 7;
Step 6, carry out step 2;
Step 7, terminates this signal extraction carrying out the data signal of described audio frequency and processes.
Music modulation processing method for modular force sense interactive device the most according to claim 2, its feature exists In, the criterion reaching sampling standard that judges whether of described step 4 is: the signal 1s after sampling counts less than 10 Individual.
CN201410000980.5A 2014-01-02 2014-01-02 Music modulation processing method for modular force sense interactive device Active CN103760974B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410000980.5A CN103760974B (en) 2014-01-02 2014-01-02 Music modulation processing method for modular force sense interactive device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410000980.5A CN103760974B (en) 2014-01-02 2014-01-02 Music modulation processing method for modular force sense interactive device

Publications (2)

Publication Number Publication Date
CN103760974A CN103760974A (en) 2014-04-30
CN103760974B true CN103760974B (en) 2016-09-07

Family

ID=50528226

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410000980.5A Active CN103760974B (en) 2014-01-02 2014-01-02 Music modulation processing method for modular force sense interactive device

Country Status (1)

Country Link
CN (1) CN103760974B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1582465A (en) * 2001-11-01 2005-02-16 伊梅森公司 Method and apparatus for providing tactile feedback sensations
CN102640095A (en) * 2009-10-02 2012-08-15 新型转换器有限公司 Touch sensitive device generating a haptic feedback that simulates a click feeling
CN102664014A (en) * 2012-04-18 2012-09-12 清华大学 Blind audio watermark implementing method based on logarithmic quantization index modulation
CN103235642A (en) * 2013-03-17 2013-08-07 浙江大学 6-dimentional sensory-interactive virtual instrument system and realization method thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2754705A1 (en) * 2009-03-10 2010-09-16 Bayer Materialscience Ag Electroactive polymer transducers for tactile feedback devices
DE102010007486A1 (en) * 2010-02-09 2011-08-11 Continental Automotive GmbH, 30165 operating device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1582465A (en) * 2001-11-01 2005-02-16 伊梅森公司 Method and apparatus for providing tactile feedback sensations
CN102640095A (en) * 2009-10-02 2012-08-15 新型转换器有限公司 Touch sensitive device generating a haptic feedback that simulates a click feeling
CN102664014A (en) * 2012-04-18 2012-09-12 清华大学 Blind audio watermark implementing method based on logarithmic quantization index modulation
CN103235642A (en) * 2013-03-17 2013-08-07 浙江大学 6-dimentional sensory-interactive virtual instrument system and realization method thereof

Also Published As

Publication number Publication date
CN103760974A (en) 2014-04-30

Similar Documents

Publication Publication Date Title
JP6250985B2 (en) A system to convert sound into haptic effect using mapping
EP3040810B1 (en) Audio enhanced simulation of high bandwidth haptic effects
CN104423707B (en) Use segmentation and combined haptic conversion
JP6416460B2 (en) Sound-to-haptic effect conversion system using multiple actuators
TWI437470B (en) Touch sensitive device
CN112506341B (en) Vibration effect generation method and device, terminal equipment and storage medium
JP6881459B2 (en) Information processing equipment, information processing method and recording medium
CN110413118A (en) Use the haptic conversion of frequency displacement
CA3190346A1 (en) Method and apparatus for compressing and decompressing a higher order ambisonics representation
US20100158271A1 (en) Method for separating source signals and apparatus thereof
CN109901066A (en) Motor system discrimination method
CN107705776A (en) The System and method for that a kind of intelligent piano or so keyboard subregion uses
CN104935347B (en) D/A converting means, D/A transform methods and electronic musical instrument
CN110070884A (en) Audio originates point detecting method and device
CN109885173A (en) A kind of noiseless exchange method and electronic equipment
CN103760974B (en) Music modulation processing method for modular force sense interactive device
KR102212409B1 (en) Method and apparatus for generating audio signal and vibration signal based on audio signal
Won et al. Automatic music tagging with harmonic cnn
CN103167376A (en) Directional loudspeaker and signal processing method thereof
JP4119112B2 (en) Mixed sound separator
CN109088601A (en) Unidirectional acoustics frequency mixer based on Meta Materials
Hasegawa et al. Analysis of spectral and temporal waveforms of piano-string vibration
HOU PASSIVE ACOUSTIC EAVESDROPPING
WO2021120057A1 (en) Signal production method, signal production apparatus, vibration motor, and touch screen device
CN117396830A (en) Haptic transmission system, haptic transmission device, haptic transmission program, and haptic transmission method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant