WO2016183980A1 - 图像传输方法及装置、终端设备 - Google Patents

图像传输方法及装置、终端设备 Download PDF

Info

Publication number
WO2016183980A1
WO2016183980A1 PCT/CN2015/089739 CN2015089739W WO2016183980A1 WO 2016183980 A1 WO2016183980 A1 WO 2016183980A1 CN 2015089739 W CN2015089739 W CN 2015089739W WO 2016183980 A1 WO2016183980 A1 WO 2016183980A1
Authority
WO
WIPO (PCT)
Prior art keywords
feature data
sequence
preset
rule
sound
Prior art date
Application number
PCT/CN2015/089739
Other languages
English (en)
French (fr)
Inventor
周呈祺
王�泓
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US15/124,578 priority Critical patent/US10547392B2/en
Publication of WO2016183980A1 publication Critical patent/WO2016183980A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B11/00—Transmission systems employing sonic, ultrasonic or infrasonic waves
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G10H1/0025—Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058—Transmission between separate instruments or between individual components of a musical system
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00095—Systems or arrangements for the transmission of the picture signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/64—Systems for the transmission or the storage of the colour picture signal; Details therefor, e.g. coding or decoding means therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234336—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/056—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for extraction or identification of individual instrumental parts, e.g. melody, chords, bass; Identification or separation of instrumental parts by their characteristic voices or timbres
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/061—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for extraction of musical phrases, isolation of musically relevant segments, e.g. musical thumbnail generation, or for temporal structure analysis of a musical piece, e.g. determination of the movement sequence of a musical work
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/066—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/101—Music Composition or musical creation; Tools or processes therefor
    • G10H2210/145—Composing rules, e.g. harmonic or musical rules, for use in automatic composition; Rule generation algorithms therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/571—Chords; Chord sequences
    • G10H2210/576—Chord progression
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments

Definitions

  • Embodiments of the present invention relate to an image transmission method and apparatus, and a terminal device.
  • image transmission between electronic devices is usually performed based on electromagnetic waves of a fixed band, such as Bluetooth, Wi-Fi, and infrared transmission.
  • some products in the prior art can transmit data through sound waves, and the audio signals used are usually sound waves with extremely low frequency or very high frequency, which are basically sounds or harsh ears that are barely heard by the human ear.
  • the rustling sound may be annoying after a long time.
  • long-term exposure to a large number of electromagnetic waves, ultrasonic waves or infrasound waves in the scene of communication has a certain degree of harm to the human body, and the sound waves in a certain band that can be heard by the human ear, because of the human being The ear causes direct effects and is prone to noise and is rarely used.
  • an image transmission method for performing image transmission using sound waves that can be heard by a human ear can be realized.
  • an image transmission method including:
  • the first device converts the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule
  • the first device respectively arranges each of the plurality of sets of feature data corresponding to a piece of music element according to a preset arrangement rule, and obtains a piece of music that conforms to the tone rule;
  • the first device plays the music to a second device.
  • the second device may extract the set of feature data from the music elements in the music according to the preset arrangement rule, and press the plurality of sets of feature data according to the The rule corresponding to the preset conversion rule is converted into the image to be transmitted.
  • the music element in the music piece comprises at least one of the following:
  • a sequence consisting of the strength of each pitch in a sequence of pitches of a sound of any one of the tones.
  • the data start point and/or the intermediate node and/or the end point of any of the set of feature data are identified by at least one preset sound feature in the music.
  • the at least one preset sound feature comprises at least one of: a fade-in, a fade-out, a chord, a decorative sound, a percussion sound, and a predetermined melody.
  • the step of the first device arranging each of the plurality of sets of feature data corresponding to one of the music elements in the music piece according to the preset arrangement rule comprises:
  • the third predetermined rule in the preset arrangement rule fills the first data sequence with the sequence of sound lengths as a note to form a first preset timbre corresponding to the preset arranging rule in the music piece.
  • the first melody
  • different feature data corresponding to the same ternary number is distinguished by performing a combination of up, down, or invariant alignment of the three notes corresponding to the ternary number in the music.
  • the step of the first device arranging each of the plurality of sets of feature data corresponding to one of the music elements in the music piece according to the preset arrangement rule further includes include:
  • the second melody corresponds to the second preset timbre in the preset arranging rule.
  • the step of the first device converting the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule comprises:
  • the sequence of chrominance values of the image to be transmitted is converted into a third set of feature data, the third set of feature data being a sequence of chrominance values of the image after size reduction.
  • an image transmission method including:
  • the second device receives the music piece played by the first device
  • the second device extracts, according to a preset arrangement rule, a plurality of sets of feature data from music elements in the music piece that conform to the tone rule;
  • the second device converts the plurality of sets of feature data into corresponding images according to a rule corresponding to a preset conversion rule.
  • the music piece converts an image to be transmitted into the plurality of sets of feature data according to the preset conversion rule, and separates each of the plurality of sets of feature data A music piece conforming to the tone rule obtained after the arrangement is performed according to the preset arrangement rule corresponding to a piece of music.
  • the corresponding image converted by the second device corresponds to the image to be transmitted.
  • the music element in the music piece comprises at least one of the following:
  • a sequence consisting of the strength of each pitch in a sequence of pitches of a sound of any one of the tones.
  • the data start point and/or the intermediate node and/or the end point of any of the set of feature data are identified by at least one preset sound feature in the music.
  • the at least one preset sound feature comprises at least one of: a fade-in, a fade-out, a chord, a decorative sound, a percussion sound, and a predetermined melody.
  • the step of the second device extracting the group of feature data from the music elements in the music piece according to the preset arrangement rule includes:
  • Each of the first data sequence is a ternary number having a preset number of digits, and the three digits of the ternary number respectively correspond to one of a lowest, a second, and a highest pitch of the triad;
  • different feature data corresponding to the same ternary number is distinguished by performing a combination of up, down, or invariant alignment of the three notes corresponding to the ternary number in the music.
  • the step of the second device extracting the plurality of sets of feature data from the music elements in the music piece according to the preset arrangement rule further includes:
  • the step of the second device converting the group of feature data into a corresponding image according to a rule corresponding to the preset conversion rule includes:
  • an image transmission apparatus including:
  • a conversion module configured to convert the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule
  • a arranging module configured to respectively arrange each of the plurality of sets of feature data obtained by the conversion module corresponding to a piece of music element according to a preset arrangement rule to obtain a piece of music that conforms to the tone rule;
  • a playing module configured to play the music obtained by the music programming module to the second device.
  • the music element in the music piece comprises at least one of the following:
  • the data start point and/or the intermediate node and/or the end point of any of the set of feature data are identified by at least one preset sound feature in the music.
  • the at least one preset sound feature comprises at least one of: a fade-in, a fade-out, a chord, a decorative sound, a percussion sound, and a predetermined melody.
  • the arranger module includes:
  • a first conversion unit configured to convert the first set of feature data of the plurality of sets of feature data obtained by the conversion module into a first data sequence according to a first predetermined rule in the preset arrangement rule, the first Each data in the data sequence is a ternary number with a preset number of bits;
  • a second conversion unit configured to convert the second set of feature data of the plurality of sets of feature data obtained by the conversion module into a sequence of sound lengths according to a second predetermined rule in the preset arrangement rule
  • a arranging unit for causing three numbers of the ternary number to correspond to one of the lowest, second and highest pitch of the three chords respectively, and having a preset chord progression in the preset arrangement rule
  • the first data sequence obtained by the first converting unit and the sound length sequence obtained by the second converting unit are filled into notes according to a third predetermined rule in the preset arrangement rule to form a musical piece.
  • different feature data corresponding to the same ternary number is distinguished by performing a combination of up, down, or invariant alignment of the three notes corresponding to the ternary number in the music.
  • the arranger module further includes:
  • a third conversion unit configured to convert, according to a fourth predetermined rule in the preset arrangement rule, a third set of feature data of the plurality of sets of feature data obtained by the conversion module into a sound intensity sequence
  • a generating unit configured to generate, according to a fifth predetermined rule in the preset arrangement rule, a second melody that matches the first melody, the sound intensity of each note in the second melody And setting according to the sequence of sound intensity obtained by the third conversion unit; the second melody corresponding to the second preset timbre in the preset arrangement rule.
  • the conversion module includes:
  • a fourth conversion unit configured to convert a sequence of grayscale values of the image to be transmitted into a first set of feature data and a second set of feature data, wherein the first set of feature data is represented by a first gray of the grayscale value sequence a step value and all gray scale values different from a previous gray scale value, wherein the second set of feature data is from a corresponding position of each gray scale value in the first set of feature data in the gray scale value sequence Consisting of the number of consecutive occurrences;
  • a fifth conversion unit configured to convert the sequence of chroma values of the image to be transmitted into a third set of feature data, wherein the third set of feature data is a sequence of chroma values of the image after size compression.
  • an image transmission apparatus including:
  • a receiving module configured to receive a music piece played by the first device
  • An extracting module configured to extract, according to a preset arrangement rule, a plurality of sets of feature data from music elements in the music tune according to the music rule obtained by the receiving module;
  • a conversion module configured to convert the plurality of sets of feature data obtained by the extraction module into corresponding images according to a rule corresponding to the preset conversion rule.
  • the music element in the music piece comprises at least one of the following:
  • a sequence consisting of the strength of each pitch in a sequence of pitches of a sound of any one of the tones.
  • the data start point and/or the intermediate node and/or the end point of any of the set of feature data are identified by at least one preset sound feature in the music.
  • the at least one preset sound feature comprises at least one of: a fade-in, a fade-out, a chord, a decorative sound, a percussion sound, and a predetermined melody.
  • the extraction module includes:
  • a first extracting unit configured to extract, according to a feature of the first preset timbre in the preset arranging rule, a first melody corresponding to the first preset timbre from a music piece obtained by the receiving module;
  • a acquiring unit configured to combine a musical score having a preset chord progression in the preset arrangement rule, and according to a third predetermined rule in the preset arrangement rule, according to the first melody obtained by the first extraction unit a note in the first data sequence and a sequence of lengths;
  • each of the data of the first data sequence is a ternary number having a preset number of bits, and the three numbers of the ternary number respectively correspond to the lowest of the three chords One of the sound, the subwoofer, and the highest sound;
  • a first conversion unit configured to convert, according to a first predetermined rule in a preset arrangement rule, a first data sequence obtained by the acquiring unit into a first group of feature data of the plurality of sets of feature data, according to the pre-predetermined And setting a second predetermined rule in the arrangement rule to convert the sequence of the sound length obtained by the obtaining unit into the second set of feature data of the plurality of sets of feature data.
  • different feature data corresponding to the same ternary number is distinguished by performing a combination of up, down, or invariant alignment of the three notes corresponding to the ternary number in the music.
  • the extracting module further includes:
  • a second extracting unit configured to extract, according to a feature of the second preset timbre in the preset arranging rule, a second melody corresponding to the second preset timbre from the music piece obtained by the receiving module,
  • the second melody and the first melody match each other;
  • a third extracting unit configured to extract a sound intensity sequence according to a sound intensity of each note in the second melody obtained by the second extracting unit according to a fifth predetermined rule in the preset arranging rule;
  • a second converting unit configured to convert, according to a fourth predetermined rule in the preset arrangement rule, a sound intensity sequence obtained by the third extraction unit into a third group of feature data of the plurality of sets of feature data.
  • the conversion module includes:
  • a third converting unit configured to convert the first set of feature data and the second set of feature data of the plurality of sets of feature data obtained by the extracting module into a grayscale value sequence of the corresponding image, where
  • the first set of feature data is composed of a first grayscale value in the grayscale value sequence and all grayscale values different from the previous grayscale value
  • the second set of feature data is composed of the first set of features
  • Each grayscale value in the data consists of the number of consecutive occurrences at corresponding positions in the sequence of grayscale values
  • a fourth conversion unit configured to convert a third set of feature data of the plurality of sets of feature data obtained by the extraction module into a sequence of chroma values of the corresponding image, wherein the third set of feature data is the size compressed A sequence of chroma values for the image.
  • a terminal device including:
  • the above technical solution can realize image transmission between the first device and the second device through playing and listening of the music, not only allowing the user to intuitively feel the entire transmission process, but also generating various aesthetics according to the difference of the transmitted images.
  • Music is very useful for scenes where data speed is not critical, such as entertainment, education, advertising, etc.
  • FIG. 1 is a flow chart showing the steps of an image transmission method in an embodiment of the present invention.
  • FIG. 2 is a flow chart showing the steps of an image transmission method according to still another embodiment of the present invention.
  • FIG. 3 is a flow chart showing the steps of arranging according to a preset arrangement rule according to an embodiment of the present invention
  • FIG. 4 is a flow chart showing the steps of extracting a plurality of sets of feature data from a music piece in an embodiment of the present invention
  • FIG. 5 is a structural block diagram of an image transmission apparatus according to an embodiment of the present invention.
  • Figure 6 is a block diagram showing the structure of an image transmission apparatus in still another embodiment of the present invention.
  • the terms “mounted,” “connected,” and “connected” are used in a broad sense, and may be, for example, a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection, It can also be an electrical connection; it can be directly connected, or it can be connected indirectly through an intermediate medium, which can be the internal connection of two components.
  • the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.
  • FIG. 1 is a flow chart showing the steps of an image transmission method in an embodiment of the present invention. Referring to Figure 1, the method includes:
  • Step 101 The first device converts the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule.
  • Step 102 The first device respectively arranges each of the plurality of sets of feature data corresponding to a piece of music elements according to a preset arrangement rule, and obtains a piece of music that conforms to the tone rule;
  • Step 103 The first device plays the music piece to the second device.
  • the first device and the second device respectively refer to a transmitting device and a receiving device of an image to be transmitted.
  • the second device may extract the plurality of sets of feature data from the music elements in the music piece according to the preset arrangement rule, and convert the set of feature data according to a rule corresponding to the preset conversion rule to The image to be transmitted.
  • the preset conversion rule is understood as a rule for converting an image into a plurality of sets of data features
  • the rule corresponding to the preset conversion rule may be understood as being used for the groups
  • the data features are converted to rules of the image.
  • the image to be transmitted may be stored in the first device in any format.
  • the plurality of sets of feature data in step 101 should have the data format specified in the preset conversion rule, for example, the order of each set of feature data should be determined, and have a clear starting point and ending point.
  • the above-mentioned preset conversion rule should include all information necessary for mutual conversion (lossy conversion or lossless conversion) between the image to be transmitted and several sets of feature data, and at least includes the image to be transmitted and The correspondence between several sets of feature data. Therefore, after the format of the image to be transmitted and the format of the plurality of sets of feature data are specified in the preset conversion rule, a person skilled in the art may use various methods to implement the image to be transmitted to several sets of feature data in combination with the prior art.
  • bitmap image is subjected to any one or more operations of compression, noise reduction, sampling, and segmentation, and is converted into a set of luminance value data and two sets of chrominance value data, which is not limited by the present invention.
  • the music element specifically refers to various elements constituting the music, such as the height of the sound, the length of the sound, the strength of the sound, the tone, the rhythm, the tune, the harmony, the intensity, the speed, the tone, the style, the texture. Etc., or a combination of any of the above.
  • the arrangement process in step 102 is performed according to a preset arrangement rule, that is, at least the corresponding relationship between each set of feature data and each music element is given in the preset arrangement rule, and each The correspondence between the feature data and an element in the music.
  • the above-mentioned preset arrangement rule should include all the information necessary for the conversion (lossy conversion or lossless conversion) between the set of feature data and the music. It can be understood that any element that is allowed to exist in the music does not correspond to any feature data, and therefore can be combined with the above preset arrangement rules.
  • the tone rules set these elements appropriately so that the resulting music matches the tone rules as much as possible.
  • the step 103 needs to implement the conversion of the music of the second device to the image to be transmitted, the second device and the first device need to use the same preset arrangement rule and use the first device during the transmission.
  • the rules corresponding to the above-mentioned preset conversion rules are used to perform conversion of several sets of feature data to images.
  • the above method is equivalent to the first device encoding the image as a music piece, and the second device decoding the music piece into an image. Therefore, the operations and rules in the embodiments of the present invention need to conform to the corresponding communication principle, and this is It will be easily inferred by those skilled in the art in conjunction with the prior art and will not be described herein.
  • the embodiment of the present invention can realize image transmission between the first device and the second device by playing and listening to the music, not only allowing the user to intuitively feel the entire transmission process, but also according to the transmitted image.
  • Differently produced a variety of beautiful music it is very practical for scenes with low data speed requirements, such as entertainment, education, advertising and other specific scenes.
  • FIG. 2 is a flow chart showing the steps of an image transmission method in still another embodiment of the present invention. Referring to Figure 2, the method includes:
  • Step 201 The second device receives a music piece played by the first device, where the music piece converts the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule, and each of the plurality of sets of feature data a set of music corresponding to a musical tone rule obtained by arranging a music element according to a preset arrangement rule;
  • Step 202 The second device extracts the group of feature data from the music elements in the music piece according to the preset arrangement rule.
  • Step 203 The second device converts the group of feature data into the image to be transmitted according to a rule corresponding to the preset conversion rule.
  • step 201, step 202, and step 203 in the image transmission method of the embodiment of the present invention correspond to step 103, step 102, and step 101 in FIG. 1 respectively, and details are not described herein again.
  • the embodiment of the present invention can realize image transmission between the first device and the second device by playing and listening to the music, which can not only make the user intuitively Feel the entire transmission process, and can also generate a variety of beautiful music according to the different images transmitted, which is very practical for scenes with low data speed requirements, such as entertainment, education, advertising and other specific scenes.
  • the music elements utilized may include at least one of the following:
  • a sequence consisting of the strength of each pitch in a sequence of pitches of a sound of any one of the tones.
  • the pitch sequence of the note may correspond to a set of feature data
  • the sequence of the note length may correspond to another set of feature data
  • the intensity sequence of the note may correspond to another set of feature data.
  • the combination of the pitch sequence of the first half of the note and the sequence of the second half of the note may correspond to a set of feature data
  • the sequence of the first half of the note and the second half of the note may correspond to another set of feature data. Therefore, the modulation and demodulation of the sounds of different timbres with relatively independent pitch, length and intensity can be conveniently realized in combination with the prior art, and can effectively ensure the transmission reliability while making the arrangement of the music. Very flexible.
  • the data start point and/or the intermediate node and/or the end point of any set of feature data are identified by at least one preset sound feature in the music piece.
  • the preset sound feature may be a single piece of special sound, or may be a variation feature on some notes.
  • the at least one preset sound feature includes at least one of the following: a fade-in, a fade-out, a chord, a decorative sound, a percussion sound, and a predetermined melody.
  • a fade-in tone can be used as the identification of the starting point of the data of a set of feature data, and the occurrence of a predetermined melody is used as the identifier of the data termination point (of course, this predetermined melody should not correspond to several sets of feature data).
  • Music elements cause interference). Based on this, the reliability of image transmission can be guaranteed.
  • the transmission of various communication signaling may be implemented by using various predetermined elements or a combination thereof in the music, which is not limited by the present invention.
  • the first device performs step 102 of arranging according to a preset arrangement rule by respectively assigning each of the plurality of sets of feature data to a music element in the music piece.
  • step 102 of arranging according to a preset arrangement rule by respectively assigning each of the plurality of sets of feature data to a music element in the music piece.
  • Step 102a Convert the first set of feature data of the plurality of sets of feature data into a first data sequence according to a first predetermined rule in a preset arrangement rule, where each data in the first data sequence has a preset The ternary number of digits;
  • Step 102b Convert the second set of feature data of the plurality of sets of feature data into a sequence of sound lengths according to a second predetermined rule in the preset arrangement rule.
  • Step 102c The three numbers of the ternary number are respectively corresponding to one of the lowest, the second and the highest of the three chords, and in the score with the preset chord progression in the preset arrangement rule, Filling the first data sequence with the sound length sequence as a note according to a third predetermined rule in the preset preset arrangement rule to form a first one of the music pieces corresponding to the first preset sound color in the preset music arrangement rule melody.
  • the step 202 of the second device extracting the plurality of sets of feature data from the music elements in the music according to the preset arrangement rule may specifically include, for example, The following step flow shown in Figure 4:
  • Step 202a Extract a first melody corresponding to the first preset timbre from the music piece according to a feature of the first preset timbre in the preset arranging rule;
  • Step 202b Combine the scores with preset chord progressions in the preset arrangement rules, and obtain the first data sequence and the sequence of sounds according to the notes in the first melody according to the third predetermined rule in the preset arrangement rules.
  • Each of the data of the first data sequence is a ternary number having a preset number of digits, and the three digits of the ternary number respectively correspond to one of a lowest pitch, a lower bass, and a highest pitch of the triad;
  • Step 202c Convert the first data sequence into the first group of feature data of the plurality of sets of feature data according to a first predetermined rule in the preset arrangement rule, according to a second predetermined rule in the preset arrangement rule Converting the above sequence of sound lengths into the above several sets of feature numbers According to the second set of characteristic data.
  • the score of the preset arranging rule having the preset chord progression may be as shown in Table 1 below:
  • Am, G, and Dm are all the marks of the three chords.
  • the Am chord is a minor chord composed of la, do, mi (short marks marked as 6, 1, 3) three-tone overlap.
  • the flow of steps of the above steps 102a to 102c is specifically shown:
  • the first set of feature data includes 121, 71, 81, and 1 gray scale value data data ranging from 1 to 256 at the positions of the plurality of consecutive bars, so that the first
  • the conversion rule of the first set of feature data to the first data sequence may be agreed in the predetermined rule: first, each digit in the ternary number includes 0, A, B from small to large; second, 1 ⁇ 256 is equally divided into 26 groups according to the order from small to large. Each group includes at most 10 grayscale values, and each group corresponds to 26 three-digit ternary numbers from small to large: 000, 00A, 00B, 0A0. , 0AA, 0AB, ..., BB0, BBA.
  • the first predetermined rule may also include other content depending on the specific application scenario.
  • the above four gray scale value data 121, 71, 81, 1 can be in accordance with the above first
  • the predetermined rule is converted into four ternary numbers AA0, 0BA, 0BB, 000.
  • each data corresponds to a three-digit quaternary number of each digit from 0 to a, b, c, and data 1 to 64 respectively correspond to a quaternary number 000 to ccc; Two, 0, a, b, and c correspond to a quarter note length, a half note length, a three-quarter note length, and a full note, respectively.
  • the above four data 1, 32, 63, 15 can be converted into four three-digit quaternary numbers 000, acc, ccb, 0cb according to the second predetermined rule, and 12 can be obtained according to the above correspondence.
  • the first predetermined rule may be agreed that: 0, A, and B of each of the first and third ternary numbers respectively correspond to the lowest, the second, and the highest in the triad.
  • the Am chord do, mi, and la (ie, 1, 3, and 6);
  • second convert the digit order of each digit of the ternary number into the pitch of the note, and combine the second set of feature data in order.
  • the converted sequence of lengths is filled with notes in the above-mentioned scores with a preset chord progression; third, when the sum of the lengths of the notes in a measure does not conform to the rule, the rest is filled with a rest.
  • sequence of the sequence of pitches corresponding to the above four ternary numbers AA0, 0BA, 0BB, 000 is: 331, 163, 166, 111, combined with the sequence of sound lengths 000, acc, ccb, 0cb, in the setting Several consecutive sections of the Am chord can be specifically filled with the first melody shown below (assuming the score is 4/4 beat, notation):
  • the pitch sequence in this part of the music can represent the first set of feature data
  • the sequence of sound lengths can represent the second set of feature data.
  • the foregoing steps 202a to 202c may specifically include the following corresponding step processes:
  • the second device since the second device also stores the same preset arrangement rule, the plurality of consecutive bars set to the Am chord can be found by the above-mentioned score with the preset chord progression, so that the above-mentioned first can be locked.
  • the first melody is the first preset timbre in the preset arranging rule, the first melody can be extracted in the part of the melody.
  • the second device may obtain the pitch sequence of the first melody according to the frequency feature of the note in combination with the first preset timbre, and obtain the first melody by sampling the note duration. The length of the sequence. Further, based on the first predetermined rule described above, the first data sequence consisting of three ternary numbers can be obtained according to the pitch sequence conversion.
  • the value interval in which each feature data of the first group of feature data is obtained according to the first data sequence is in the range of 21 to 30. This value range).
  • the feature data eg, averaging or random value
  • the sequence of lengths a sequence consisting of a plurality of three-digit quaternary numbers can be obtained according to the second predetermined rule, thereby converting the second set of feature data.
  • the embodiment of the present invention can transmit the first set of feature data and the second set of feature data in the sound of one tone in the music by the tone intensity sequence and the tone length sequence, respectively. Based on the above examples, the above method can also achieve transmission of more efficient parallel transmission.
  • the data in the first set of feature data does not need to be in one-to-one correspondence with the data in the second set of feature data, for example, when the pitch sequence has been transmitted and the sequence of the sound length has not been transmitted yet,
  • the sequence of notes can be transmitted using a combination of notes corresponding to the ternary number "BBB", or the melody that has appeared before can be repeated to transmit the length of the sound.
  • Sequence, etc. for example, when the length sequence has been transmitted and the pitch sequence has not been transmitted, the length of each note can be automatically set in an appropriate manner.
  • these settings or settings need to be recorded in the preset preset rules.
  • different feature data corresponding to the same ternary number may be separately up, down, or unchanged by three notes corresponding to the ternary number in the music piece. Sort and combine to distinguish.
  • the sound can be specified as "the frequency is increased by 3%”, and the sound reduction can be specified as "the frequency is reduced by 5%”. Therefore, in the case where the mark is "#”, the sound is "b”, and the " ⁇ " is not changed, the specific value in each of the above 26 groups can be up, down, or unchanged.
  • Table 3 The arrangement of the array is represented as shown in Table 3 below:
  • the arrangement of the corresponding lifting sounds can be simultaneously obtained as “b ⁇ ” according to Table 3, so “00B” In the corresponding note "116", the first note “1” is played during playback (frequency reduction 5%), second note “1” and third note “6” during playback. Not changing. Therefore, in the step flow of step 202a to step 202c, by detecting the rising and falling sound of each note, the combination of the lifting sounds corresponding to the ternary number "00B” is "b ⁇ ", and then The characteristic data in the numerical sections 21 to 30 in which the feature data is located is determined to be "23".
  • the embodiment of the present invention can implement the lossless transmission of the first set of feature data.
  • the first device respectively associates each of the plurality of sets of feature data with a piece of music elements in the music piece according to
  • the step 102 of arranging the preset arrangement rules may further include the following step flow not shown in the drawings:
  • Step 102d Convert a third set of feature data of the plurality of sets of feature data into a sound intensity sequence according to a fourth predetermined rule in the preset preset arrangement rule;
  • Step 102e generating a second melody that matches the first melody according to the fifth predetermined rule in the preset preset arrangement rule, wherein the sound intensity of each note in the second melody is set according to the sound intensity sequence;
  • the second melody corresponds to the second preset timbre in the preset preset arrangement rule.
  • the step 202 of the second device extracting the plurality of sets of feature data from the music elements in the music according to the preset arrangement rule may further include The following steps are not shown in the figure:
  • Step 202d Extract a second melody corresponding to the second preset timbre from the music piece according to the feature of the second preset timbre in the preset arranging rule, and the second melody and the first melody match each other;
  • Step 202e extract a sound intensity sequence according to a sound intensity of each note in the second melody according to a fifth predetermined rule in the preset preset arrangement rule;
  • Step 202f Convert the sound intensity sequence into a third group of feature data of the plurality of sets of feature data according to a fourth predetermined rule in the preset preset arrangement rule.
  • the fourth predetermined rule used in the foregoing step 102d may specify a one-to-one correspondence between the data and the sound intensity in the third set of feature data, so that the step 102e may pass the fifth predetermined rule.
  • the tone intensity sequence modulates a second melody that matches the first melody described above and has a second predetermined timbre.
  • the second melody may be extracted in a manner similar to the extraction of the first melody, and the sound intensity sequence may be extracted by signal amplitude sampling according to the fifth predetermined rule in the above step 202e.
  • the sound intensity sequence may be converted into the third group of feature data of the plurality of sets of feature data by using a one-to-one correspondence between the data and the sound intensity in the third set of feature data according to a fourth predetermined rule.
  • the embodiment of the present invention can use the second melody to add aesthetics to the music (such as a chord melody corresponding to the main melody), and set a set of feature data. (for example, the chrominance value data of the image) is included in the second melody as the sequence of the sound intensity, which is advantageous for further improving the transmission efficiency of the data and the aesthetics of the music.
  • the step 101 of converting, by the first device, the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule may specifically include the following steps not shown in the drawing:
  • Step 101a Convert a grayscale value sequence of the image to be transmitted into a first set of feature data and a second set of feature data, wherein the first set of feature data is represented by the first grayscale value in the grayscale value sequence and all a gray scale value having a different gray scale value, wherein the second set of feature data is composed of the number of consecutive occurrences of each gray scale value in the first set of feature data at corresponding positions in the gray scale value sequence ;
  • Step 101b Convert the sequence of chroma values of the image to be transmitted into a third set of feature data, and the third set of feature data is a sequence of chroma values of the image after size reduction.
  • the step 203 of the second device converting the plurality of sets of feature data into the image to be transmitted according to the rule corresponding to the preset conversion rule may specifically include the following steps not shown in the figure:
  • Step 203a Convert the first set of feature data and the second set of feature data of the plurality of sets of feature data into a grayscale value sequence of the image to be transmitted, where the first set of feature data is the first of the grayscale value sequences a grayscale value and all grayscale values different from the previous grayscale value, wherein the second set of feature data is corresponding to each grayscale value in the first set of feature data in the grayscale value sequence The number of consecutive occurrences;
  • Step 203b Convert a third set of feature data of the plurality of sets of feature data into a sequence of chroma values of the image to be transmitted, wherein the third set of feature data is a sequence of chroma values of the image after size compression.
  • the sequence of grayscale values in the above step 101a may be 140, 140, 140, 39, 237, 237, 1, 1, 1, 1, 1, 1, 140, 140, so that the grayscale value sequence is The first grayscale value is 140, and all grayscale values different from the previous grayscale value include 39, 237, 1, 140 in sequence, so that 140, 39, 237, 1, 140 constitute the first set of features described above. data.
  • the corresponding bits in the sequence of grayscale values of 140, 39, 237, 1, 140 The number of consecutive occurrences of the placement is 3, 1, 2, 6, and 2, respectively, so that 3, 1, 2, 6, and 2 constitute the second set of characteristic data.
  • the grayscale value sequence 140 can be converted according to the first set of feature data 140, 39, 237, 1, 140 and the second set of feature data 3, 1, 2, 6, and 2. , 140, 140, 39, 237, 237, 1, 1, 1, 1, 1, 1, 140, 140.
  • the original image may be first divided into an image composed of a plurality of 2 ⁇ 2 pixel blocks, and an average value of the chromaticity values of each 2 ⁇ 2 pixel block is obtained.
  • the third set of feature data (equivalent to size compression of the original image).
  • the average value of the chrominance values of each 2 ⁇ 2 pixel block can be directly used as the chromaticity value of each of the pixels, and although the partial chromaticity value data of the original image is lost, the data can be reduced. The amount of transmission and the speed of transmission.
  • the chrominance value of the original image may be losslessly compressed by using a certain compression algorithm, and the third set of feature data may be formed, so that the corresponding decompression algorithm can be used to pass the third group in the above 203b.
  • the feature data gives the chrominance value of the original image.
  • the embodiment of the present invention uses the first group and the second group of feature data to represent the grayscale value sequence of the image to be transmitted, so that the data with high repetition rate can have a good data compression effect;
  • the third set of feature data is used to represent the chrominance value sequence of the image to be transmitted, and the image with relatively uniform color has good data compression effect.
  • FIG. 5 is a block diagram showing the structure of an image transmission apparatus in an embodiment of the present invention. Based on the same inventive concept, an embodiment of the present invention provides an image transmission apparatus. Referring to Figure 5, the device includes:
  • the converting module 51 is configured to convert the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule
  • the arranging module 52 is configured to arrange each of the plurality of sets of feature data obtained by the conversion module 51 corresponding to a piece of music elements according to a preset music arrangement rule to obtain a music piece that conforms to the tone rule;
  • the playing module 53 is configured to play the music obtained by the above-mentioned arranger module 52 to the second device.
  • the second device may extract the plurality of sets of feature data from the music elements in the music according to the preset arrangement rule, and set the plurality of sets of feature data according to the preset conversion rule.
  • the rule is converted to the image to be transmitted as described above.
  • the embodiment of the present invention can realize image transmission between the first device and the second device by playing and listening to the music, which not only allows the user to intuitively feel the entire transmission process, but also generates more according to the difference of the transmitted images.
  • An aesthetically pleasing piece of music is very useful for scenes where data speed is not critical, such as entertainment, education, advertising, etc.
  • the arrangement module 52 may specifically include the following structure not shown in the drawings:
  • the first conversion unit 52a is configured to convert the first set of feature data of the plurality of sets of feature data obtained by the conversion module 51 into a first data sequence according to a first predetermined rule in a preset arrangement rule, the first data sequence Each of the data is a ternary number with a preset number of bits;
  • the second conversion unit 52b is configured to convert the second set of feature data of the plurality of sets of feature data obtained by the conversion module 51 into a sequence of sound lengths according to a second predetermined rule in the preset arrangement rule;
  • the arranging unit 52c is configured to respectively make the three numbers of the ternary number correspond to one of the lowest, the second and the highest of the three chords, and have a preset chord progression in the preset arrangement rule.
  • the first data sequence obtained by the first converting unit 52a is combined with the sound length sequence obtained by the second converting unit 52b as a note according to a third predetermined rule in the preset arrangement rule to form a musical piece.
  • the first melody of the first preset timbre in the preset preset arranging rule Corresponding to the first melody of the first preset timbre in the preset preset arranging rule.
  • the different feature data corresponding to the same ternary number can be respectively performed by accelerating, descending or invariantly arranging three notes corresponding to the ternary number in the music piece. Combine to distinguish.
  • arranger module 52 may further include the following structure not shown in the drawings:
  • the third converting unit 52d is configured to convert the third set of feature data of the plurality of sets of feature data obtained by the converting module 51 into a sound intensity sequence according to a fourth predetermined rule in the preset preset arrangement rule;
  • a generating unit 52e configured to generate a second melody that matches the first melody according to a fifth predetermined rule in the preset arranging rule, wherein a sound intensity of each of the second melody follows the third converting unit 52d The obtained sequence of sound intensity is set; the second melody corresponds to the second preset timbre in the preset arrangement rule.
  • the conversion module 51 may specifically include the following structure not shown in the drawing:
  • a fourth converting unit 51a configured to convert a grayscale value sequence of the image to be transmitted into a first set of feature data and a second set of feature data, wherein the first set of feature data is represented by the first gray of the grayscale value sequence
  • the order value is composed of all gray scale values different from the previous gray scale value, and the second set of feature data continuously appears from the corresponding position of the gray scale value sequence in each of the first set of feature data. Composed of the number of times;
  • the fifth converting unit 51b is configured to convert the sequence of chroma values of the image to be transmitted into a third set of feature data, and the third set of feature data is a sequence of chroma values of the image after size compression.
  • each of the foregoing units or modules corresponds to one step in the foregoing embodiment of the image transmission method, so that the same technical problem can be solved and the corresponding technical effects are achieved, and details are not described herein again.
  • FIG. 6 is a block diagram showing the structure of an image transmission apparatus in still another embodiment of the present invention. Based on the same inventive concept, an embodiment of the present invention provides an image transmission apparatus. Referring to Figure 6, the apparatus includes:
  • the receiving module 61 is configured to receive a music piece played by the first device, where the music piece converts the image to be transmitted into a plurality of sets of feature data according to a preset conversion rule, and each set of the plurality of sets of feature data Corresponding to a music element to follow the preset a piece of music that is arranged in accordance with the tone rules after the arrangement of the arrangement;
  • the extracting module 62 is configured to extract the plurality of sets of feature data from the music elements in the music piece obtained by the receiving module 61 according to the preset preset arrangement rule;
  • the conversion module 63 is configured to convert the plurality of sets of feature data obtained by the extraction module 62 into the image to be transmitted according to a rule corresponding to the preset conversion rule.
  • the receiving module 61, the extracting module 62, and the converting module 63 can be used to perform step 201, step 202, and step 203 in FIG. 2, respectively, and those skilled in the art can infer the possible structure according to the function.
  • the embodiments of the invention are not described herein again.
  • the embodiment of the present invention can realize image transmission between the first device and the second device by playing and listening to the music, which not only allows the user to intuitively feel the entire transmission process, but also generates more according to the difference of the transmitted images.
  • An aesthetically pleasing piece of music is very useful for scenes where data speed is not critical, such as entertainment, education, advertising, etc.
  • the extraction module 62 may specifically include the following structure not shown in the drawings:
  • the first extracting unit 62a is configured to extract a first melody corresponding to the first preset timbre from the music piece obtained by the receiving module 61 according to the feature of the first preset timbre in the preset arranging rule;
  • the acquiring unit 62b is configured to combine the music scores with the preset chord progressions in the preset arrangement rules, according to the third predetermined rule in the preset arrangement rules, according to the first melody obtained by the first extraction unit 62a.
  • the note acquires a first data sequence and a sequence of lengths; each of the data of the first data sequence is a ternary number having a preset number of bits, and the three numbers of the ternary number correspond to the lowest note of the third chord, respectively One of the bass and the highest sound;
  • the first converting unit 62c is configured to convert the first data sequence obtained by the acquiring unit 62b into the first group of feature data of the plurality of sets of feature data according to the first predetermined rule in the preset arrangement rule, according to the preset
  • the second predetermined rule in the arrangement rule converts the sequence of sound lengths obtained by the obtaining unit 62b into the second set of feature data of the plurality of sets of feature data.
  • the different feature data corresponding to the same ternary number can be distinguished by performing a combination of up, down, or invariant alignment on the three notes corresponding to the ternary number in the music.
  • extraction module 62 may further include the following structure not shown in the drawings:
  • a second extracting unit 62d configured to extract a second melody corresponding to the second preset timbre from the music piece obtained by the receiving module 61 according to the feature of the second preset timbre in the preset arranging rule, the first The second melody matches the first melody described above;
  • a third extracting unit 62e configured to extract a sound intensity sequence according to a sound intensity of each of the second melody obtained by the second extracting unit 62d according to a fifth predetermined rule in the preset preset arrangement rule;
  • the second converting unit 62f is configured to convert the sound intensity sequence obtained by the third extracting unit 62e into the third group of feature data of the plurality of sets of feature data according to a fourth predetermined rule in the preset preset arrangement rule.
  • the conversion module 63 may specifically include the following structure not shown in the drawings:
  • a third converting unit 63a configured to convert the first set of feature data and the second set of feature data of the plurality of sets of feature data obtained by the extracting module 62 into a grayscale value sequence of the image to be transmitted, the first set of feature data Forming, by the first grayscale value in the grayscale value sequence, all grayscale values different from the previous grayscale value, wherein the second set of feature data is represented by each grayscale value in the first set of feature data The number of consecutive occurrences at corresponding positions in the sequence of grayscale values;
  • the fourth converting unit 63b is configured to convert the third set of feature data of the plurality of sets of feature data obtained by the extracting module 62 into a sequence of chrominance values of the image to be transmitted, wherein the third set of feature data is size-compressed A sequence of chrominance values for the above image.
  • each of the foregoing units or modules corresponds to one step in the foregoing embodiment of the image transmission method, so that the same technical problem can be solved and the corresponding technical effects are achieved, and details are not described herein again.
  • the musical elements in the musical piece in the embodiment may include at least one of the following: a pitch sequence of sounds having any one of the timbres in the music; each pitch in the pitch sequence of the sound having any of the timbre in the musical composition A sequence consisting of the length of the pitch; the sequence of the intensity of each pitch in the sequence of pitches of the sound of any of the tones in the music.
  • the data start point and/or the intermediate node and/or the end point of any of the above set of feature data may be identified by at least one preset sound feature in the music.
  • the at least one preset sound feature includes at least one of the following: a fade-in, a fade-out, a chord, a decorative sound, a percussion sound, and a predetermined melody.
  • an embodiment of the present invention provides a terminal device, where the terminal device includes any of the foregoing image transmission devices that can play music to a second device, and/or any one of the foregoing may receive the first The image transmission device of the music played by the device.
  • the terminal device in the embodiment of the present invention may be any such as a personal computer (such as a desktop computer, a notebook computer, a tablet computer, an all-in-one computer), a smart phone, an e-book, a smart TV, a digital photo frame, a smart navigation device, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Auxiliary Devices For Music (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

本发明的实施例涉及图像传输方法及装置。一种图像传输方法包括：第一设备将待传输的图像按照预设转换规则转换为若干组特征数据；所述第一设备将所述若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；所述第一设备向第二设备播放所述乐曲。根据本发明的实施例，可以实现一种利用人耳可以听到的声波进行图像传输的图像传输方式。

Description

图像传输方法及装置、终端设备 技术领域
本发明的实施例涉及图像传输方法及装置、终端设备。
背景技术
现有技术中，电子设备间的图像传输通常是基于固定波段的电磁波来进行的，例如蓝牙、Wi-Fi和红外线传输等等。除此之外，现有技术中的一些产品可以通过声波来传输数据，其所使用的音频信号通常是频率极低或者极高的声波，这些声波基本是人耳基本听不到的声音或者刺耳的沙沙声，长时间过后可能会使人感到厌烦。总的来说，长时间暴露在使用大量电磁波、超声波或者次声波进行通信的场景下对人体均存在着一定程度的危害，而对于人耳可以听到的一定波段内的声波，则由于可对人耳造成直接影响、容易带来噪声的原因而很少被利用。
发明内容
根据本发明的实施例，可以实现一种利用人耳可以听到的声波进行图像传输的图像传输方式。
根据本发明实施例的第一方面，提供了一种图像传输方法，包括：
第一设备将待传输的图像按照预设转换规则转换为若干组特征数据；
所述第一设备将所述若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；
所述第一设备向第二设备播放所述乐曲。
根据本发明的实施例，所述第二设备可以按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据，并将所述若干组特征数据按照与所述预设转换规则对应的规则转换为所述待传输的图像。
可选地，所述乐曲中的音乐要素包括下述的至少一项：
乐曲中具有任一种音色的声音的音高序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
可选地，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
可选地，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
可选地，所述第一设备将所述若干组特征数据中的每一组分别对应于乐曲中的一项音乐要素来按照预设编曲规则进行编曲的步骤包括：
将所述若干组特征数据中的第一组特征数据按照所述预设编曲规则中的第一预定规则转换为第一数据序列，所述第一数据序列中的每一个数据均为具有预设位数的三进制数；
将所述若干组特征数据中的第二组特征数据按照所述预设编曲规则中的第二预定规则转换为音长序列；
使三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个，在所述预设编曲规则中的具有预设和弦级数走向的乐谱中，按照所述预设编曲规则中的第三预定规则将所述第一数据序列结合所述音长序列填充为音符，以形成乐曲中对应于所述预设编曲规则中的第一预设音色的第一旋律。
可选地，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
可选地，所述第一设备将所述若干组特征数据中的每一组分别对应于乐曲中的一项音乐要素来按照预设编曲规则进行编曲的步骤还包 括：
按照所述预设编曲规则中的第四预定规则将所述若干组特征数据中的第三组特征数据转换为音强序列；
按照所述预设编曲规则中的第五预定规则生成与所述第一旋律相互匹配的第二旋律，所述第二旋律中每一音符的音强按照所述音强序列进行设置；所述第二旋律与所述预设编曲规则中的第二预设音色相对应。
可选地，所述第一设备将待传输的图像按照预设转换规则转换为若干组特征数据的步骤包括：
将待传输的图像的灰阶值序列转换为第一组特征数据和第二组特征数据，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
将待传输的图像的色度值序列转换为第三组特征数据，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
根据本发明实施例的第二方面，提供了一种图像传输方法，包括：
第二设备接收第一设备播放的乐曲；
所述第二设备按照预设编曲规则从符合乐音规则的该乐曲中的音乐要素中提取出若干组特征数据；
所述第二设备将所述若干组特征数据按照与预设转换规则对应的规则转换为相应图像。
根据本发明的实施例，该乐曲为所述第一设备将待传输的图像按照所述预设转换规则转换为所述若干组特征数据，并将所述若干组特征数据中的每一组分别对应于一项音乐要素来按照所述预设编曲规则进行编曲后得到的符合乐音规则的乐曲。相应地，由所述第二设备转换得到的相应图像对应于所述待传输的图像。
可选地，所述乐曲中的音乐要素包括下述的至少一项：
乐曲中具有任一种音色的声音的音高序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
可选地，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
可选地，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
可选地，所述第二设备按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据的步骤包括：
根据所述预设编曲规则中的第一预设音色的特征从所述乐曲中提取出对应于所述第一预设音色的第一旋律；
结合所述预设编曲规则中具有预设和弦级数走向的乐谱，按照所述预设编曲规则中的第三预定规则根据所述第一旋律中的音符获取第一数据序列和音长序列；所述第一数据序列的每一个数据均为具有预设位数的三进制数，三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个；
按照预设编曲规则中的第一预定规则将所述第一数据序列转换为所述若干组特征数据中的第一组特征数据，按照所述预设编曲规则中的第二预定规则将所述音长序列转换为所述若干组特征数据中的第二组特征数据。
可选地，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
可选地，所述第二设备按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据的步骤还包括：
根据所述预设编曲规则中的第二预设音色的特征从所述乐曲中提 取出对应于所述第二预设音色的第二旋律，所述第二旋律与所述第一旋律相互匹配；
按照所述预设编曲规则中的第五预定规则根据所述第二旋律中每一音符的音强提取出音强序列；
按照所述预设编曲规则中的第四预定规则将所述音强序列转换为所述若干组特征数据中的第三组特征数据。
可选地，所述第二设备将所述若干组特征数据按照与所述预设转换规则对应的规则转换为相应图像的步骤包括：
将所述若干组特征数据中的第一组特征数据和第二组特征数据转换为相应图像的灰阶值序列，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
将所述若干组特征数据中的第三组特征数据转换为相应图像的色度值序列，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
根据本发明实施例的第三方面，提供了一种图像传输装置，包括：
转换模块，用于将待传输的图像按照预设转换规则转换为若干组特征数据；
编曲模块，用于将所述转换模块得到的若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；
播放模块，用于向第二设备播放所述编曲模块得到的乐曲。
可选地，所述乐曲中的音乐要素包括下述的至少一项：
乐曲中具有任一种音色的声音的音高序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组 成的序列。
可选地，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
可选地，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
可选地，所述编曲模块包括：
第一转换单元，用于将所述转换模块得到的若干组特征数据中的第一组特征数据按照所述预设编曲规则中的第一预定规则转换为第一数据序列，所述第一数据序列中的每一个数据均为具有预设位数的三进制数；
第二转换单元，用于将所述转换模块得到的若干组特征数据中的第二组特征数据按照所述预设编曲规则中的第二预定规则转换为音长序列；
编曲单元，用于使三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个，在所述预设编曲规则中的具有预设和弦级数走向的乐谱中，按照所述预设编曲规则中的第三预定规则将所述第一转换单元得到的第一数据序列结合所述第二转换单元得到的音长序列填充为音符，以形成乐曲中对应于所述预设编曲规则中的第一预设音色的第一旋律。
可选地，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
可选地，所述编曲模块还包括：
第三转换单元，用于按照所述预设编曲规则中的第四预定规则将所述转换模块得到的若干组特征数据中的第三组特征数据转换为音强序列；
生成单元，用于按照所述预设编曲规则中的第五预定规则生成与所述第一旋律相互匹配的第二旋律，所述第二旋律中每一音符的音强 按照所述第三转换单元得到的音强序列进行设置；所述第二旋律与所述预设编曲规则中的第二预设音色相对应。
可选地，所述转换模块包括：
第四转换单元，用于将待传输的图像的灰阶值序列转换为第一组特征数据和第二组特征数据，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
第五转换单元，用于将待传输的图像的色度值序列转换为第三组特征数据，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
根据本发明实施例的第四方面，提供了一种图像传输装置，包括：
接收模块，用于接收第一设备播放的乐曲；
提取模块，用于按照预设编曲规则从所述接收模块得到的符合乐音规则的乐曲中的音乐要素中提取出若干组特征数据；
转换模块，用于将所述提取模块得到的若干组特征数据按照与预设转换规则对应的规则转换为相应图像。
可选地，所述乐曲中的音乐要素包括下述的至少一项：
乐曲中具有任一种音色的声音的音高序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
可选地，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
可选地，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
可选地，所述提取模块包括：
第一提取单元，用于根据所述预设编曲规则中的第一预设音色的特征从所述接收模块得到的乐曲中提取出对应于所述第一预设音色的第一旋律；
获取单元，用于结合所述预设编曲规则中具有预设和弦级数走向的乐谱，按照所述预设编曲规则中的第三预定规则根据所述第一提取单元得到的第一旋律中的音符获取第一数据序列和音长序列；所述第一数据序列的每一个数据均为具有预设位数的三进制数，三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个；
第一转换单元，用于按照预设编曲规则中的第一预定规则将所述获取单元得到的第一数据序列转换为所述若干组特征数据中的第一组特征数据，按照所述预设编曲规则中的第二预定规则将所述获取单元得到的音长序列转换为所述若干组特征数据中的第二组特征数据。
可选地，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
可选地，所述提取模块还包括：
第二提取单元，用于根据所述预设编曲规则中的第二预设音色的特征从所述接收模块得到的乐曲中提取出对应于所述第二预设音色的第二旋律，所述第二旋律与所述第一旋律相互匹配；
第三提取单元，用于按照所述预设编曲规则中的第五预定规则根据所述第二提取单元得到的第二旋律中每一音符的音强提取出音强序列；
第二转换单元，用于按照所述预设编曲规则中的第四预定规则将所述第三提取单元得到的音强序列转换为所述若干组特征数据中的第三组特征数据。
可选地，所述转换模块包括：
第三转换单元，用于将所述提取模块得到的若干组特征数据中的第一组特征数据和第二组特征数据转换为相应图像的灰阶值序列，所 述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
第四转换单元，用于将所述提取模块得到的若干组特征数据中的第三组特征数据转换为相应图像的色度值序列，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
根据本发明实施例的第五方面，提供了一种终端设备，包括：
上述任意一种可以向第二设备播放乐曲的图像传输装置，
和/或，
上述任意一种可以接收第一设备播放的乐曲的图像传输装置。
上述技术方案可以通过乐曲的播放和收听而实现第一设备与第二设备间的图像传输，不仅可以使用户直观地感受到整个传输过程，还可以根据所传输图像的不同产生多种富有美感的乐曲，对于数据速度要求不高的场景，如娱乐、教育、广告等具体场景而言非常实用。
附图说明
为了更清楚地说明本发明实施例的技术方案，下面将对实施例的附图作简单的介绍。显而易见地，下面描述中的附图仅仅涉及本发明的一些实施例，而非对本发明的限制。对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明一个实施例中一种图像传输方法的步骤流程示意图；
图2是本发明又一实施例中一种图像传输方法的步骤流程示意图；
图3是本发明一个实施例中按照预设编曲规则进行编曲的步骤流程示意图；
图4是本发明一个实施例中从乐曲中提取出若干组特征数据的步骤流程示意图；
图5是本发明一个实施例中一种图像传输装置的结构框图；
图6是本发明又一实施例中一种图像传输装置的结构框图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
在本发明的描述中需要说明的是，术语“上”、“下”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本发明的限制。除非另有明确的规定和限定，术语“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以根据具体情况理解上述术语在本发明中的具体含义。
此外，在对本发明实施例的描述中，除非另有说明，“若干”的含义是一个或多个。
图1是本发明一个实施例中一种图像传输方法的步骤流程示意图。参见图1，该方法包括：
步骤101：第一设备将待传输的图像按照预设转换规则转换为若干组特征数据；
步骤102：第一设备将上述若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；
步骤103：第一设备向第二设备播放上述乐曲。
需要说明的是，第一设备与第二设备分别指的是待传输的图像的发送设备与接收设备。第二设备可以按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据，并将所述若干组特征数据按照与所述预设转换规则对应的规则转换为所述待传输的图像。值得注意的是，如果将所述预设转换规则理解为用于将图像转换为若干组数据特征的规则，那么可以将与所述预设转换规则对应的规则理解为用于将所述若干组数据特征转换为所述图像的规则。在步骤101之前，待传输的图像可以是以任意格式存储在第一设备中的。应理解的是，步骤101中的若干组特征数据应具有预设转换规则中所规定的数据格式，比如每一组特征数据的顺序应是确定的，而且具有明确的起始点和终止点。还应理解的是，上述预设转换规则应可以包括待传输的图像与若干组特征数据之间相互转换(有损转换或者无损转换)所必要的全部信息，并至少包含了待传输的图像与若干组特征数据之间的对应关系。由此，在预设转换规则中规定了待传输的图像的格式与若干组特征数据的格式后，本领域技术人员可以结合现有技术采用多种方式来实现待传输的图像到若干组特征数据的转换，比如将位图图像经过压缩、降噪、采样、分割中的任意一项或多项操作后转换为一组亮度值数据和两组色度值数据，本发明对此不作限制。
上述步骤102中，音乐要素具体指构成乐曲的各种元素，比如音的高低，音的长短，音的强弱、音色、节奏，曲调，和声，力度，速度，调式，曲式，织体等，或者上述任意多项的组合。在步骤102的编曲过程均是按照预设编曲规则来进行的，也就是说预设编曲规则中至少要给出每一组特征数据与每一项音乐要素的对应关系，以及每一特征数据与乐曲中的一个元素之间的对应关系。并且，上述预设编曲规则应包括若干组特征数据与乐曲之间相互转换(有损转换或者无损转换)所必要的全部信息。可以理解的是，乐曲中允许存在任意多项元素不对应于任一特征数据，因此可以结合上述预设编曲规则来按照 乐音规则对这部分元素进行适当的设置，以使得到的乐曲能尽可能符合乐音规则。
还应理解的是，由于步骤103需要实现第二设备的乐曲到待传输图像的转换，因此传输过程中第二设备与第一设备需要使用同样的预设编曲规则、并使用与第一设备所使用的上述预设转换规则对应的规则进行若干组特征数据到图像的转换。总体上，上述方法相当于第一设备将图像编码为乐曲，第二设备再将乐曲解码为图像，因此本发明实施例中的各项操作与规则均需要符合相应的通信原理，而其是本领域技术人员结合现有技术容易推知的，在此不再赘述。
由上述技术方案可知，本发明实施例可以通过乐曲的播放和收听而实现第一设备与第二设备间的图像传输，不仅可以使用户直观地感受到整个传输过程，还可以根据所传输图像的不同产生多种富有美感的乐曲，对于数据速度要求不高的场景，如娱乐、教育、广告等具体场景而言非常实用。
图2是本发明又一实施例中一种图像传输方法的步骤流程示意图。参见图2，该方法包括：
步骤201：第二设备接收第一设备播放的乐曲，该乐曲为所述第一设备将待传输的图像按照预设转换规则转换为若干组特征数据，并将所述若干组特征数据中的每一组分别对应于一项音乐要素按照预设编曲规则进行编曲后得到的符合乐音规则的乐曲；
步骤202：第二设备按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据；
步骤203：第二设备将所述若干组特征数据按照与所述预设转换规则对应的规则转换为所述待传输的图像。
可以理解的是，本发明实施例的图像传输方法中的步骤201、步骤202和步骤203分别与图1中的步骤103、步骤102和步骤101相互对应，在此不再赘述。同样地，本发明实施例可以通过乐曲的播放和收听而实现第一设备与第二设备间的图像传输，不仅可以使用户直观地 感受到整个传输过程，还可以根据所传输图像的不同产生多种富有美感的乐曲，对于数据速度要求不高的场景，如娱乐、教育、广告等具体场景而言非常实用。
在上述图1所示的步骤流程与图2所示的步骤流程中，所利用的音乐要素可以包括下述的至少一项：
乐曲中具有任一种音色的声音的音高序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
比如，乐曲中钢琴所演奏的旋律部分，音符的音高序列可以对应于一组特征数据，音符的音长序列可以对应于另一组特征数据，音符的强度序列可以对应于又一组特征数据。再如，乐曲中吉他所演奏的旋律部分，前半段音符的音高序列与后半段音符的音长序列的组合可以对应于一组特征数据，前半段音符的音强序列与后半段音符的音高序列的组合可以对应于另一组特征数据。由此，不同音色的声音相对独立的音高、音长和音强的调制与解调都可以结合现有技术很方便地实现，可以在有效保障传输可靠性的同时，又可以使得乐曲的编曲具有很高的灵活性。
在上述图1所示的步骤流程与图2所示的步骤流程中，任一组特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。其中的预设声音特征可以是单独的一段特殊声音，也可以是一些音符上的变化特征等。举例来说，上述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。比如，可以使用一个渐强音作为一组特征数据的数据起始点的标识，并使用一段预定旋律的出现作为其数据终止点的标识(当然，这段预定旋律不应对若干组特征数据所对应的音乐要素造成干扰)。基于此，可以保障图像传输的可靠性。类 似地，可以利用乐曲中各种预定的元素或其组合来实现各种通信信令的传输，本发明对此不做限制。
在上述图1所示的步骤流程的基础上，第一设备将上述若干组特征数据中的每一组分别对应于乐曲中的一项音乐要素来按照预设编曲规则进行编曲的步骤102可以具体包括如图3所示的下述步骤流程：
步骤102a：将上述若干组特征数据中的第一组特征数据按照预设编曲规则中的第一预定规则转换为第一数据序列，上述第一数据序列中的每一个数据均为具有预设位数的三进制数；
步骤102b：将上述若干组特征数据中的第二组特征数据按照上述预设编曲规则中的第二预定规则转换为音长序列；
步骤102c：使三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个，在上述预设编曲规则中的具有预设和弦级数走向的乐谱中，按照上述预设编曲规则中的第三预定规则将上述第一数据序列结合上述音长序列填充为音符，以形成乐曲中对应于上述预设编曲规则中的第一预设音色的第一旋律。
与之对应的，在上述图2所示的步骤流程的基础上，第二设备按照上述预设编曲规则从该乐曲中的音乐要素中提取出上述若干组特征数据的步骤202可以具体包括如图4所示的下述步骤流程：
步骤202a：根据上述预设编曲规则中的第一预设音色的特征从上述乐曲中提取出对应于上述第一预设音色的第一旋律；
步骤202b：结合上述预设编曲规则中具有预设和弦级数走向的乐谱，按照上述预设编曲规则中的第三预定规则根据上述第一旋律中的音符获取第一数据序列和音长序列；上述第一数据序列的每一个数据均为具有预设位数的三进制数，三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个；
步骤202c：按照预设编曲规则中的第一预定规则将上述第一数据序列转换为上述若干组特征数据中的第一组特征数据，按照上述预设编曲规则中的第二预定规则将上述音长序列转换为上述若干组特征数 据中的第二组特征数据。
举例来说，上述预设编曲规则中具有预设和弦级数走向的乐谱可以如下面的表1所示：
表1具有预设和弦级数走向的乐谱示例
Figure PCTCN2015089739-appb-000001
其中，Am、G、Dm均是三和弦的标记符合，比如Am和弦是由la、do、mi(简谱标记为6、1、3)三音重叠构成的小三和弦。下面以乐曲中设定为Am和弦的若干个连续小节为例，具体展示上述步骤102a至步骤102c的步骤流程：
上述步骤102a中，假设在上述若干个连续小节的位置处第一组特征数据包括121、71、81、1四个取值范围在1～256之间的灰阶值数据数据，从而上述第一预定规则中可以约定由第一组特征数据到第一数据序列的转换规则：第一，三进制数中的每一位数字包括从小到大的0、A、B；第二，将1～256按照从小到大的顺序平均分为26个组，每组最多包括10个灰阶值，每一组分别对应于从小到大的26个三位三进制数：000、00A、00B、0A0、0AA、0AB、......、BB0、BBA。
当然，与本文中的其他预定规则相同，根据具体的应用场景的不同，第一预定规则还可以包括其他内容。
具体地，如下面的表2所示：
表2灰阶值与三进制数的对应关系表
Figure PCTCN2015089739-appb-000002
由此，上面的四个灰阶值数据121、71、81、1可以按照上述第一 预定规则转换为四个三进制数AA0、0BA、0BB、000。
上述步骤102b中，假设在上述若干个连续小节的位置处第二组特征数据包括1、32、63、15四个取值范围在1～64之间的数据，从而上述第二预定规则中可以约定转换规则：第一，每一个数据对应于每一位数字从小到大为0、a、b、c的三位四进制数，数据1～64分别对应四进制数000～ccc；第二，0、a、b、c分别对应于四分之一音符长度、二分之一音符长度、四分之三音符长度和全音符。由此，上面的四个数据1、32、63、15可以按照上述第二预定规则转换为四个三位的四进制数000、acc、ccb、0cb，并按照上述对应关系可以得到12个音符长度组成的音长序列。
上述步骤102c中，上述第一预定规则中可以约定：第一，三进制数每一位中从小到大的0、A、B分别对应于三和弦中的最低音、次低音、最高音，在Am和弦中具体为do、mi、la(即1、3、6)；第二，将三进制数每一位的数字顺序转换为音符的音高、并按顺序结合第二组特征数据转换得到的音长序列在上述具有预设和弦级数走向的乐谱中填充音符；第三，当一个小节中音符长度的总和不符合规则时，采用休止符填充。
由此，上面的四个三进制数AA0、0BA、0BB、000所对应的简谱音高序列为：331、163、166、111，结合音长序列000、acc、ccb、0cb，在设定为Am和弦的若干个连续小节内可以具体填充为如下所示的第一旋律(假设乐谱为4/4拍，简谱)：
Figure PCTCN2015089739-appb-000003
可以看出，这部分乐曲中音高序列可以代表第一组特征数据，而音长序列可以代表第二组特征数据。当然，可以对这部分乐曲进行修饰，比如添加连音线、为部分音符添加装饰音等等；并可以在此基础 上在乐曲中添加其他的元素以配合这段旋律，比如设置合适的第一预设音色、增加具有另一种音色的和弦旋律、添加打击乐器的配合等等。
对应于上述步骤102a至步骤102c的步骤流程，上述步骤202a至步骤202c可以具体包括下述相应的步骤流程：
上述步骤202a中，由于第二设备也存储由同一预设编曲规则，因而可以通过上述具有预设和弦级数走向的乐谱找到上述设定为Am和弦的若干个连续小节，因而可以锁定上述第一旋律在乐曲中的位置。而且，由于上述第一旋律是预设编曲规则中具有第一预设音色的，因而可以在这部分乐曲中将第一旋律提取出来。
上述步骤202b中，按照第三预定规则，第二设备可以结合上述第一预设音色根据音符的频率特征得到第一旋律的音高序列，并可以通过对音符持续时间的采样得到第一旋律的音长序列。进一步地，基于上述第一预定规则，可以根据由音高序列转换得到由三位三进制数组成的第一数据序列。
上述步骤202c中，根据第一数据序列可以得到第一组特征数据中每一个特征数据所处的数值区间(例如通过对表2的查询得到三进制数00B所对应的特征数据处于21～30这一数值区间)。在允许有损传输的应用场景中，可以直接根据特征数据所处的数值区间估计特征数据(例如求平均值或者随机取值)，从而得到传输后的第一组特征数据。另一方面，根据音长序列可以按照第二预定规则得到由多个三位四进制数组成的序列，从而转换得到上述第二组特征数据。
自此，本发明实施例可以分别通过音强序列和音长序列在乐曲中一个音色的声音中传输第一组特征数据和第二组特征数据。基于上述示例，上述方法还可以实现传输更高效率的并行传输。
需要说明的是，上述第一组特征数据中的数据并不需要与上述第二组特征数据中的数据一一对应，比如在音高序列已经传输完成、而音长序列还没有传输完成时，可以采用对应于三进制数“BBB”的音符组合来传输音长序列，或者重复前面已经出现过的旋律来传输音长 序列等；再比如在音长序列已经完成传输、而音高序列还没有传输完成时，可以采用适当的方式对每一个音符的长度进行自动设置。当然，这些设置或设定需要在上述预设编曲规则中记录。
在本发明的另一实施例中，对应于相同三进制数的不同特征数据可以通过在上述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
比如，在上述第一预定规则中，升音可以规定为“频率增加3％”、降音可以规定为“频率降低5％”。从而，在标记升音为“#”、降音为“b”、不变为“～”的情况下，上述26个组中每一组内的具体数值可以由升音、降音或不变的排列组合来表示，如下面的表3所示：
表3组内数值与升降音排列组合的对应关系表
Figure PCTCN2015089739-appb-000004
举例来说，当特征数据“23”在上述步骤102a中转换为三进制数“00B”时，根据表3可以同时得到其对应的升降音的排列组合为“b～～”，因此“00B”所对应的音符“116”中，第一个音符“1”在播放时进行降音(频率降低5％)、第二个音符“1”和第三个音符“6”在播放时的频率都不变。从而在步骤202a至步骤202c的步骤流程中，可以通过检测每一个音符的升降音情况，得到三进制数“00B”所对应的升降音排列组合为“b～～”，进而通过表3在特征数据所处的数值区间21～30中确定该特征数据为“23”。
基于此，本发明实施例可以实现上述第一组特征数据的无损传输。
另一方面，在上述图1所示的步骤流程的基础上，第一设备将上述若干组特征数据中的每一组分别对应于乐曲中的一项音乐要素按照 预设编曲规则进行编曲的步骤102可以还包括附图中未示出的下述步骤流程：
步骤102d：按照上述预设编曲规则中的第四预定规则将上述若干组特征数据中的第三组特征数据转换为音强序列；
步骤102e：按照上述预设编曲规则中的第五预定规则生成与上述第一旋律相互匹配的第二旋律，上述第二旋律中每一音符的音强按照上述音强序列进行设置；上述第二旋律与上述预设编曲规则中的第二预设音色相对应。
与之对应的，在上述图2所示的步骤流程的基础上，第二设备按照上述预设编曲规则从该乐曲中的音乐要素中提取出上述若干组特征数据的步骤202可以还包括附图中未示出的下述步骤流程：
步骤202d：根据上述预设编曲规则中的第二预设音色的特征从上述乐曲中提取出对应于上述第二预设音色的第二旋律，上述第二旋律与上述第一旋律相互匹配；
步骤202e：按照上述预设编曲规则中的第五预定规则根据上述第二旋律中每一音符的音强提取出音强序列；
步骤202f：按照上述预设编曲规则中的第四预定规则将上述音强序列转换为上述若干组特征数据中的第三组特征数据。
举例来说，上述步骤102d中所使用的第四预定规则可以规定了第三组特征数据中的数据与音强之间的一一对应关系，从而上述步骤102e中可以按照第五预定规则通过该音强序列调制与上述第一旋律相互匹配、并具有第二预设音色的第二旋律。相对应地，上述步骤202d中可以通过与提取第一旋律类似的方式提取第二旋律，并可以在上述步骤202e中按照第五预定规则藉由信号幅值采样提取出音强序列。最后，上述步骤202f中可以按照第四预定规则利用上述第三组特征数据中的数据与音强之间的一一对应关系将音强序列转换为上述若干组特征数据中的第三组特征数据。本发明实施例可以利用第二旋律为乐曲增添美感(比如设置为与主旋律对应的和弦旋律)，并将一组特征数据 (例如图像的色度值数据)作为音强序列包含在第二旋律中，有利于进一步提升数据的传输效率以及乐曲的美感。
在上述任意一种可能的实施方式的基础上，第一设备将待传输的图像按照预设转换规则转换为若干组特征数据的步骤101可以具体包括附图中未示出的下述步骤：
步骤101a：将待传输的图像的灰阶值序列转换为第一组特征数据和第二组特征数据，上述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，上述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
步骤101b：将待传输的图像的色度值序列转换为第三组特征数据，上述第三组特征数据为经过尺寸压缩后的上述图像的色度值序列。
与之对应的，第二设备将上述若干组特征数据按照与上述预设转换规则对应的规则转换为上述待传输的图像的步骤203可以具体包括附图中未示出的下述步骤：
步骤203a：将上述若干组特征数据中的第一组特征数据和第二组特征数据转换为待传输的图像的灰阶值序列，上述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，上述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
步骤203b：将上述若干组特征数据中的第三组特征数据转换为待传输的图像的色度值序列，上述第三组特征数据为经过尺寸压缩后的上述图像的色度值序列。
举例来说，上述步骤101a中的灰阶值序列可以为140、140、140、39、237、237、1、1、1、1、1、1、140、140，从而该灰阶值序列中的第一个灰阶值为140，所有与上一个灰阶值不同的灰阶值依次包括39、237、1、140，从而140、39、237、1、140就组成了上述第一组特征数据。对应地，140、39、237、1、140在灰阶值序列中的对应位 置处连续出现的次数分别为3、1、2、6、2，从而3、1、2、6、2就组成了上述第二组特征数据。与之对应的，上述步骤203a中，根据第一组特征数据140、39、237、1、140与第二组特征数据3、1、2、6、2就可以转换得到上述灰阶值序列140、140、140、39、237、237、1、1、1、1、1、1、140、140。
同时，对于上述步骤101b中的第三组特征数据，可以先将原始图像划分为若干个2×2像素块所组成的图像，并求得每个2×2像素块的色度值的平均值，以组成上述第三组特征数据(相当于对原始图像进行了尺寸压缩)。而在上述步骤203b中，可以直接将每个2×2像素块的色度值的平均值作为其中每一个像素的色度值，虽然损失了原始图像的部分色度值数据，但是可以减少数据传输量、提升传输速度。或者，在上述步骤101b中可以采用一定的压缩算法对原始图像的色度值进行无损压缩，并组成上述第三组特征数据，从而在上述203b中就可以利用对应的解压缩算法通过第三组特征数据得到原始图像的色度值。
可以理解的是，本发明实施例采用第一组和第二组特征数据表征待传输的图像的灰阶值序列，因而可以对重复程度较高的图像有很好的数据压缩效果；本发明实施例采用第三组特征数据表征待传输的图像的色度值序列，对颜色较为均匀的图像有很好的数据压缩效果。
图5是本发明一个实施例中一种图像传输装置的结构框图。基于同样的发明构思，本发明实施例提供一种图像传输装置。参见图5，该装置包括：
转换模块51，用于将待传输的图像按照预设转换规则转换为若干组特征数据；
编曲模块52，用于将上述转换模块51得到的若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；
播放模块53，用于向第二设备播放上述编曲模块52得到的乐曲。 根据本发明的实施例，第二设备可以按照上述预设编曲规则从该乐曲中的音乐要素中提取出上述若干组特征数据，并将上述若干组特征数据按照与上述预设转换规则对应的规则转换为上述待传输的图像。
可以看出，上述转换模块51、编曲模块52和播放模块53可以分别用于执行图1中的步骤101、步骤102和步骤103，本领域技术人员可以根据功能推知其所可能具有的结构，本发明实施例在此不再赘述。
同样地，本发明实施例可以通过乐曲的播放和收听而实现第一设备与第二设备间的图像传输，不仅可以使用户直观地感受到整个传输过程，还可以根据所传输图像的不同产生多种富有美感的乐曲，对于数据速度要求不高的场景，如娱乐、教育、广告等具体场景而言非常实用。
在图5所示的图像传输装置的基础上，编曲模块52可以具体包括附图中未示出的下述结构：
第一转换单元52a，用于将上述转换模块51得到的若干组特征数据中的第一组特征数据按照预设编曲规则中的第一预定规则转换为第一数据序列，上述第一数据序列中的每一个数据均为具有预设位数的三进制数；
第二转换单元52b，用于将上述转换模块51得到的若干组特征数据中的第二组特征数据按照上述预设编曲规则中的第二预定规则转换为音长序列；
编曲单元52c，用于使三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个，在上述预设编曲规则中的具有预设和弦级数走向的乐谱中，按照上述预设编曲规则中的第三预定规则将上述第一转换单元52a得到的第一数据序列结合上述第二转换单元52b得到的音长序列填充为音符，以形成乐曲中对应于上述预设编曲规则中的第一预设音色的第一旋律。
其中，对应于相同三进制数的不同特征数据可以通过在上述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列 组合来加以区分。
进一步地，上述编曲模块52可以还包括附图中未示出的下述结构：
第三转换单元52d，用于按照上述预设编曲规则中的第四预定规则将上述转换模块51得到的若干组特征数据中的第三组特征数据转换为音强序列；
生成单元52e，用于按照上述预设编曲规则中的第五预定规则生成与上述第一旋律相互匹配的第二旋律，上述第二旋律中每一音符的音强按照上述第三转换单元52d得到的音强序列进行设置；上述第二旋律与上述预设编曲规则中的第二预设音色相对应。
另一方面，在图5所示的图像传输装置的基础上，转换模块51可以具体包括附图中未示出的下述结构：
第四转换单元51a，用于将待传输的图像的灰阶值序列转换为第一组特征数据和第二组特征数据，上述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，上述第二组特征数据由上述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
第五转换单元51b，用于将待传输的图像的色度值序列转换为第三组特征数据，上述第三组特征数据为经过尺寸压缩后的上述图像的色度值序列。
可以看出，上述各单元或模块均对应于上述图像传输方法实施例中的一个步骤，因而可以解决同样的技术问题，达到相应的技术效果，在此不再赘述。
图6是本发明又一实施例中一种图像传输装置的结构框图。基于同样的发明构思，本发明实施例提供一种图像传输装置。参见图6，该装置包括：
接收模块61，用于接收第一设备播放的乐曲，该乐曲为上述第一设备将待传输的图像按照预设转换规则转换为若干组特征数据，并将上述若干组特征数据中的每一组分别对应于一项音乐要素来按照预设 编曲规则进行编曲后得到的符合乐音规则的乐曲；
提取模块62，用于按照上述预设编曲规则从上述接收模块61得到的乐曲中的音乐要素中提取出上述若干组特征数据；
转换模块63，用于将上述提取模块62得到的若干组特征数据按照与上述预设转换规则对应的规则转换为上述待传输的图像。
可以看出，上述接收模块61、提取模块62和转换模块63可以分别用于执行图2中的步骤201、步骤202和步骤203，本领域技术人员可以根据功能推知其所可能具有的结构，本发明实施例在此不再赘述。
同样地，本发明实施例可以通过乐曲的播放和收听而实现第一设备与第二设备间的图像传输，不仅可以使用户直观地感受到整个传输过程，还可以根据所传输图像的不同产生多种富有美感的乐曲，对于数据速度要求不高的场景，如娱乐、教育、广告等具体场景而言非常实用。
在图6所示的图像传输装置的基础上，提取模块62可以具体包括附图中未示出的下述结构：
第一提取单元62a，用于根据上述预设编曲规则中的第一预设音色的特征从上述接收模块61得到的乐曲中提取出对应于上述第一预设音色的第一旋律；
获取单元62b，用于结合上述预设编曲规则中具有预设和弦级数走向的乐谱，按照预设编曲规则中的第三预定规则根据上述第一提取单元62a得到的第一旋律中的音符获取第一数据序列和音长序列；上述第一数据序列的每一个数据均为具有预设位数的三进制数，三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个；
第一转换单元62c，用于按照预设编曲规则中的第一预定规则将上述获取单元62b得到的第一数据序列转换为上述若干组特征数据中的第一组特征数据，按照上述预设编曲规则中的第二预定规则将上述获取单元62b得到的音长序列转换为上述若干组特征数据中的第二组特征数据。
其中，对应于相同三进制数的不同特征数据可以通过在上述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
进一步地，上述提取模块62可以还包括附图中未示出的下述结构：
第二提取单元62d，用于根据上述预设编曲规则中的第二预设音色的特征从上述接收模块61得到的乐曲中提取出对应于上述第二预设音色的第二旋律，上述第二旋律与上述第一旋律相互匹配；
第三提取单元62e，用于按照上述预设编曲规则中的第五预定规则根据上述第二提取单元62d得到的第二旋律中每一音符的音强提取出音强序列；
第二转换单元62f，用于按照上述预设编曲规则中的第四预定规则将上述第三提取单元62e得到的音强序列转换为上述若干组特征数据中的第三组特征数据。
另一方面，在图6所示的图像传输装置的基础上，转换模块63可以具体包括附图中未示出的下述结构：
第三转换单元63a，用于将上述提取模块62得到的若干组特征数据中的第一组特征数据和第二组特征数据转换为待传输的图像的灰阶值序列，上述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，上述第二组特征数据由上述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
第四转换单元63b，用于将上述提取模块62得到的若干组特征数据中的第三组特征数据转换为待传输的图像的色度值序列，上述第三组特征数据为经过尺寸压缩后的上述图像的色度值序列。
可以看出，上述各单元或模块均对应于上述图像传输方法实施例中的一个步骤，因而可以解决同样的技术问题，达到相应的技术效果，在此不再赘述。
在上述任意一种装置的基础上，与上文所描述的一致，本发明实 施例中的乐曲中的音乐要素可以包括下述的至少一项：乐曲中具有任一种音色的声音的音高序列；乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。而且，任一组上述特征数据的数据起始点和/或中间节点和/或终止点可以由乐曲中的至少一个预设声音特征来标识。进一步地，上述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
基于同样的发明构思，本发明实施例提供了一种终端设备，该终端设备包括：上述任意一种可以向第二设备播放乐曲的图像传输装置，和/或，上述任意一种可以接收第一设备播放的乐曲的图像传输装置。
需要说明的是，本发明实施例中的终端设备可以是如个人计算机(如台式机、笔记本电脑、平板电脑、一体机)、智能手机、电子书、智能电视、数码相框、智能导航仪等任意一种包括存储介质和处理器的设备。由于该终端设备包括上述图像传输装置，同样能够达成利用乐曲传输图像的技术效果。
本发明的说明书中，说明了大量具体细节。然而，能够理解，本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中，并未详细示出公知的方法、结构和技术，以便不模糊对本说明书的理解。
类似地，应当理解，为了精简本发明公开并帮助理解各个发明方面中的一个或多个，在上面对本发明的示例性实施例的描述中，本发明的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而，并不应将该公开的方法解释呈反映如下意图：即所要求保护的本发明技术方案要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说，如下面的权利要求书所反映的那样，发明方面在于少于前面公开的单个实施例的所有特征。因此，遵循具体实施方式的权利要求书由此明确地并入该具体实施方式，其中每个权利要求 本身都作为本发明的单独实施例。
应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制，并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中，不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中，这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围，其均应涵盖在本发明的权利要求和说明书的范围当中。
本申请要求于2015年5月19日递交的中国专利申请第201510257491.2号的优先权，在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。

Claims (33)

  1. 一种图像传输方法，包括：
    第一设备将待传输的图像按照预设转换规则转换为若干组特征数据；
    所述第一设备将所述若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；
    所述第一设备向第二设备播放所述乐曲。
  2. 根据权利要求1所述的方法，其中，所述乐曲中的音乐要素包括下述的至少一项：
    乐曲中具有任一种音色的声音的音高序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
  3. 根据权利要求1或2所述的方法，其中，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
  4. 根据权利要求3所述的方法，其中，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
  5. 根据权利要求1至4中任意一项所述的方法，其中，所述第一设备将所述若干组特征数据中的每一组分别对应于乐曲中的一项音乐要素来按照预设编曲规则进行编曲的步骤包括：
    将所述若干组特征数据中的第一组特征数据按照所述预设编曲规则中的第一预定规则转换为第一数据序列，所述第一数据序列中的每一个数据均为具有预设位数的三进制数；
    将所述若干组特征数据中的第二组特征数据按照所述预设编曲规 则中的第二预定规则转换为音长序列；
    使三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个，在所述预设编曲规则中的具有预设和弦级数走向的乐谱中，按照所述预设编曲规则中的第三预定规则将所述第一数据序列结合所述音长序列填充为音符，以形成乐曲中对应于所述预设编曲规则中的第一预设音色的第一旋律。
  6. 根据权利要求5所述的方法，其中，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
  7. 根据权利要求5或6所述的方法，其中，所述第一设备将所述若干组特征数据中的每一组分别对应于乐曲中的一项音乐要素来按照预设编曲规则进行编曲的步骤还包括：
    按照所述预设编曲规则中的第四预定规则将所述若干组特征数据中的第三组特征数据转换为音强序列；
    按照所述预设编曲规则中的第五预定规则生成与所述第一旋律相互匹配的第二旋律，所述第二旋律中每一音符的音强按照所述音强序列进行设置；所述第二旋律与所述预设编曲规则中的第二预设音色相对应。
  8. 根据权利要求1至7中任意一项所述的方法，其中，所述第一设备将待传输的图像按照预设转换规则转换为若干组特征数据的步骤包括：
    将待传输的图像的灰阶值序列转换为第一组特征数据和第二组特征数据，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
    将待传输的图像的色度值序列转换为第三组特征数据，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
  9. 一种图像传输方法，包括：
    第二设备接收第一设备播放的乐曲；
    所述第二设备按照预设编曲规则从符合乐音规则的该乐曲中的音乐要素中提取出若干组特征数据；
    所述第二设备将所述若干组特征数据按照与预设转换规则对应的规则转换为相应图像。
  10. 根据权利要求9所述的方法，其中，所述乐曲中的音乐要素包括下述的至少一项：
    乐曲中具有任一种音色的声音的音高序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
  11. 根据权利要求9或10所述的方法，其中，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
  12. 根据权利要求11所述的方法，其中，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
  13. 根据权利要求9至12中任意一项所述的方法，其中，所述第二设备按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据的步骤包括：
    根据所述预设编曲规则中的第一预设音色的特征从所述乐曲中提取出对应于所述第一预设音色的第一旋律；
    结合所述预设编曲规则中具有预设和弦级数走向的乐谱，按照所述预设编曲规则中的第三预定规则根据所述第一旋律中的音符获取第一数据序列和音长序列；所述第一数据序列的每一个数据均为具有预设位数的三进制数，三进制数的三个数字分别对应于三和弦的最低音、 次低音和最高音中的一个；
    按照预设编曲规则中的第一预定规则将所述第一数据序列转换为所述若干组特征数据中的第一组特征数据，按照所述预设编曲规则中的第二预定规则将所述音长序列转换为所述若干组特征数据中的第二组特征数据。
  14. 根据权利要求13所述的方法，其中，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
  15. 根据权利要求13或14所述的方法，其中，所述第二设备按照所述预设编曲规则从该乐曲中的音乐要素中提取出所述若干组特征数据的步骤还包括：
    根据所述预设编曲规则中的第二预设音色的特征从所述乐曲中提取出对应于所述第二预设音色的第二旋律，所述第二旋律与所述第一旋律相互匹配；
    按照所述预设编曲规则中的第五预定规则根据所述第二旋律中每一音符的音强提取出音强序列；
    按照所述预设编曲规则中的第四预定规则将所述音强序列转换为所述若干组特征数据中的第三组特征数据。
  16. 根据权利要求9至15中任意一项所述的方法，其中，所述第二设备将所述若干组特征数据按照与所述预设转换规则对应的规则转换为相应图像的步骤包括：
    将所述若干组特征数据中的第一组特征数据和第二组特征数据转换为相应图像的灰阶值序列，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
    将所述若干组特征数据中的第三组特征数据转换为相应图像的色度值序列，所述第三组特征数据为经过尺寸压缩后的所述图像的色度 值序列。
  17. 一种图像传输装置，包括：
    转换模块，用于将待传输的图像按照预设转换规则转换为若干组特征数据；
    编曲模块，用于将所述转换模块得到的若干组特征数据中的每一组分别对应于一项音乐要素来按照预设编曲规则进行编曲，得到符合乐音规则的乐曲；
    播放模块，用于向第二设备播放所述编曲模块得到的乐曲。
  18. 根据权利要求17所述的装置，其中，所述乐曲中的音乐要素包括下述的至少一项：
    乐曲中具有任一种音色的声音的音高序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
  19. 根据权利要求17或18所述的装置，其中，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
  20. 根据权利要求19所述的装置，其中，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
  21. 根据权利要求17至20中任意一项所述的装置，其中，所述编曲模块包括：
    第一转换单元，用于将所述转换模块得到的若干组特征数据中的第一组特征数据按照所述预设编曲规则中的第一预定规则转换为第一数据序列，所述第一数据序列中的每一个数据均为具有预设位数的三进制数；
    第二转换单元，用于将所述转换模块得到的若干组特征数据中的 第二组特征数据按照所述预设编曲规则中的第二预定规则转换为音长序列；
    编曲单元，用于使三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个，在所述预设编曲规则中的具有预设和弦级数走向的乐谱中，按照所述预设编曲规则中的第三预定规则将所述第一转换单元得到的第一数据序列结合所述第二转换单元得到的音长序列填充为音符，以形成乐曲中对应于所述预设编曲规则中的第一预设音色的第一旋律。
  22. 根据权利要求21所述的装置，其中，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
  23. 根据权利要求21或22所述的装置，其中，所述编曲模块还包括：
    第三转换单元，用于按照所述预设编曲规则中的第四预定规则将所述转换模块得到的若干组特征数据中的第三组特征数据转换为音强序列；
    生成单元，用于按照所述预设编曲规则中的第五预定规则生成与所述第一旋律相互匹配的第二旋律，所述第二旋律中每一音符的音强按照所述第三转换单元得到的音强序列进行设置；所述第二旋律与所述预设编曲规则中的第二预设音色相对应。
  24. 根据权利要求17至23中任意一项所述的装置，其中，所述转换模块包括：
    第四转换单元，用于将待传输的图像的灰阶值序列转换为第一组特征数据和第二组特征数据，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所组成；
    第五转换单元，用于将待传输的图像的色度值序列转换为第三组 特征数据，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
  25. 一种图像传输装置，包括：
    接收模块，用于接收第一设备播放的乐曲；
    提取模块，用于按照预设编曲规则从所述接收模块得到的符合乐音规则的乐曲中的音乐要素中提取出若干组特征数据；
    转换模块，用于将所述提取模块得到的若干组特征数据按照与预设转换规则对应的规则转换为相应图像。
  26. 根据权利要求25所述的装置，其中，所述乐曲中的音乐要素包括下述的至少一项：
    乐曲中具有任一种音色的声音的音高序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的长短所组成的序列；
    乐曲中具有任一种音色的声音的音高序列中每一音高的强弱所组成的序列。
  27. 根据权利要求25或26所述的装置，其中，任一组所述特征数据的数据起始点和/或中间节点和/或终止点由乐曲中的至少一个预设声音特征来标识。
  28. 根据权利要求27所述的装置，其中，所述至少一个预设声音特征包括下述的至少一项：渐强音、渐弱音、和弦外音、装饰音、打击乐器音以及一段预定旋律。
  29. 根据权利要求25至28中任意一项所述的装置，其中，所述提取模块包括：
    第一提取单元，用于根据所述预设编曲规则中的第一预设音色的特征从所述接收模块得到的乐曲中提取出对应于所述第一预设音色的第一旋律；
    获取单元，用于结合所述预设编曲规则中具有预设和弦级数走向的乐谱，按照所述预设编曲规则中的第三预定规则根据所述第一提取 单元得到的第一旋律中的音符获取第一数据序列和音长序列；所述第一数据序列的每一个数据均为具有预设位数的三进制数，三进制数的三个数字分别对应于三和弦的最低音、次低音和最高音中的一个；
    第一转换单元，用于按照预设编曲规则中的第一预定规则将所述获取单元得到的第一数据序列转换为所述若干组特征数据中的第一组特征数据，按照所述预设编曲规则中的第二预定规则将所述获取单元得到的音长序列转换为所述若干组特征数据中的第二组特征数据。
  30. 根据权利要求29所述的装置，其中，对应于相同三进制数的不同特征数据通过在所述乐曲中对与该三进制数对应的三个音符分别进行升音、降音或不变的排列组合来加以区分。
  31. 根据权利要求29或30所述的装置，其中，所述提取模块还包括：
    第二提取单元，用于根据所述预设编曲规则中的第二预设音色的特征从所述接收模块得到的乐曲中提取出对应于所述第二预设音色的第二旋律，所述第二旋律与所述第一旋律相互匹配；
    第三提取单元，用于按照所述预设编曲规则中的第五预定规则根据所述第二提取单元得到的第二旋律中每一音符的音强提取出音强序列；
    第二转换单元，用于按照所述预设编曲规则中的第四预定规则将所述第三提取单元得到的音强序列转换为所述若干组特征数据中的第三组特征数据。
  32. 根据权利要求25至31中任意一项所述的装置，其中，所述转换模块包括：
    第三转换单元，用于将所述提取模块得到的若干组特征数据中的第一组特征数据和第二组特征数据转换为相应图像的灰阶值序列，所述第一组特征数据由该灰阶值序列中的第一个灰阶值和所有与上一个灰阶值不同的灰阶值所组成，所述第二组特征数据由所述第一组特征数据中每一灰阶值在该灰阶值序列中的对应位置处连续出现的次数所 组成；
    第四转换单元，用于将所述提取模块得到的若干组特征数据中的第三组特征数据转换为相应图像的色度值序列，所述第三组特征数据为经过尺寸压缩后的所述图像的色度值序列。
  33. 一种终端设备，包括：
    如权利要求17至24中任意一项所述的图像传输装置，
    和/或，
    如权利要求25至32中任意一项所述的图像传输装置。
PCT/CN2015/089739 2015-05-19 2015-09-16 图像传输方法及装置、终端设备 WO2016183980A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/124,578 US10547392B2 (en) 2015-05-19 2015-09-16 Terminal device, apparatus and method for transmitting an image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510257491.2 2015-05-19
CN201510257491.2A CN104918059B (zh) 2015-05-19 2015-05-19 图像传输方法及装置、终端设备

Publications (1)

Publication Number Publication Date
WO2016183980A1 true WO2016183980A1 (zh) 2016-11-24

Family

ID=54086703

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/089739 WO2016183980A1 (zh) 2015-05-19 2015-09-16 图像传输方法及装置、终端设备

Country Status (3)

Country Link
US (1) US10547392B2 (zh)
CN (1) CN104918059B (zh)
WO (1) WO2016183980A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018187890A1 (zh) * 2017-04-09 2018-10-18 格兰比圣（深圳）科技有限公司 一种根据图片生成音乐的方法和装置
CN107239482B (zh) * 2017-04-12 2019-11-15 中国科学院光电研究院 一种将图像转换为音乐的处理方法及服务器
CN108960250B (zh) * 2018-05-07 2020-08-25 广东数相智能科技有限公司 图像至旋律的转换方法、装置与计算机可读存储介质
US10734709B2 (en) * 2018-09-28 2020-08-04 Qualcomm Incorporated Common-radiator multi-band antenna system
CN112686966B (zh) * 2020-12-18 2023-06-06 深圳智慧林网络科技有限公司 图像无损压缩方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1287320A (zh) * 1999-09-03 2001-03-14 北京航空航天大学 一种将图像信息转换成音乐的方法
CN1750118A (zh) * 2004-09-15 2006-03-22 仁宝电脑工业股份有限公司 将影像数据转换为音乐的方法
TWI292133B (en) * 2003-12-04 2008-01-01 Compal Electronics Inc Method for arranging music by image data
CN101409070A (zh) * 2008-03-28 2009-04-15 徐开笑 基于运动图像解析的音乐重构方法
CN102289778A (zh) * 2011-05-10 2011-12-21 南京大学 一种图像至音乐的转换方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110121049A (ko) * 2010-04-30 2011-11-07 주식회사 지육공팔컨설팅그룹 이미지를 이용한 음원 생성 시스템 및 방법
GB2484140B (en) * 2010-10-01 2017-07-12 Asio Ltd Data communication system
CN103581672B (zh) * 2012-08-06 2018-09-04 深圳市腾讯计算机***有限公司 一种数据传输方法及设备
CN103928036A (zh) * 2013-01-14 2014-07-16 联想(北京)有限公司 一种根据图像生成音频文件的方法及装置
US9226119B2 (en) * 2013-11-20 2015-12-29 Qualcomm Incorporated Using sensor data to provide information for proximally-relevant group communications

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1287320A (zh) * 1999-09-03 2001-03-14 北京航空航天大学 一种将图像信息转换成音乐的方法
TWI292133B (en) * 2003-12-04 2008-01-01 Compal Electronics Inc Method for arranging music by image data
CN1750118A (zh) * 2004-09-15 2006-03-22 仁宝电脑工业股份有限公司 将影像数据转换为音乐的方法
CN101409070A (zh) * 2008-03-28 2009-04-15 徐开笑 基于运动图像解析的音乐重构方法
CN102289778A (zh) * 2011-05-10 2011-12-21 南京大学 一种图像至音乐的转换方法

Also Published As

Publication number Publication date
US20180091234A1 (en) 2018-03-29
CN104918059B (zh) 2018-07-20
CN104918059A (zh) 2015-09-16
US10547392B2 (en) 2020-01-28

Similar Documents

Publication Publication Date Title
WO2016183980A1 (zh) 图像传输方法及装置、终端设备
CN101252801B (zh) 一种灯光控制方法及装置
CN100588279C (zh) 输出音频数据和乐谱图像的方法和设备
US10170090B2 (en) Music information generating device, music information generating method, and recording medium
CN106409282B (zh) 一种音频合成***、方法及其电子设备和云服务器
TW200946193A (en) Visual feedback in electronic entertainment system
KR20150112048A (ko) 모바일 앱 기반의 실시간 영상의 배경음악 생성방법
US9979766B2 (en) System and method for reproducing source information
CN113573442A (zh) 音频控制场景的方法、设备和计算机可读存储介质
JP5132413B2 (ja) 歌唱採点結果に応じた歌唱者画像合成表示システム
US20060120225A1 (en) Apparatus and method for synchronizing audio with video
JP2011095437A (ja) カラオケ採点システム
CN106875932B (zh) 一种带有声交互功能的数码键盘式乐器及其实现方法
CN107704230A (zh) 一种麦序控制方法及控制设备
CN104768106B (zh) 一种终端音效的转换方法及装置
CN104506588A (zh) 一种实现乐队的移动排练的方法及装置
JP2012078526A (ja) カラオケシステム
JP5803956B2 (ja) カラオケシステム及びカラオケ装置
TWI242180B (en) Music data compression method and program for executing the same
JP2006221253A (ja) 画像処理装置および画像処理プログラム
KR100725033B1 (ko) 다양한 기능을 구비한 가라오케 칩 및 이를 채용한가라오케 시스템
CN203813917U (zh) 电子乐器插卡多功能音箱
JP5800247B2 (ja) カラオケシステム及びカラオケ装置
TWM482827U (zh) 音聲自主編輯系統
WO2023130956A1 (zh) 一种增强振动提示方法及电子设备

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 15124578

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15892358

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15892358

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.04.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15892358

Country of ref document: EP

Kind code of ref document: A1