EP3316251B1

EP3316251B1 - Display control device, display control method, and display control program

Info

Publication number: EP3316251B1
Application number: EP15896324.9A
Authority: EP
Inventors: Shiro Suzuki; Takayoshi Kumakura; Toshihisa SABI
Original assignee: AlphaTheta Corp
Current assignee: AlphaTheta Corp
Priority date: 2015-06-24
Filing date: 2015-06-24
Publication date: 2023-05-10
Anticipated expiration: 2035-06-24
Also published as: JP6426843B2; EP3316251A4; WO2016208002A1; JPWO2016208002A1; EP3316251A1

Description

TECHNICAL FIELD

The present invention relates to a display controller, a display control method, and a display control program.

BACKGROUND ART

There has been typically known an arrangement of switching a first music piece, which is being reproduced (hereinafter referred to as a "preceding music piece"), to a second music to be reproduced after the preceding music piece (hereinafter referred to as a "subsequent music piece") (see, for instance, Patent Literature 1).
In the arrangement disclosed in Patent Literature 1, in order to switch the preceding music piece to the subsequent music piece by cross-fade, a music player acquires a beat timing X immediately before a start timing of fade-out of the preceding music piece and acquires a beat timing Y immediately after a finish timing of fade-in of the subsequent music piece. The music player advances the start of reproducing the subsequent music piece during the reproduction of the preceding music piece so that the beat timing X coincides with the beat timing Y. This operation enables a user, who is performing an exercise and the like to rhythm of music, to reproduce the music in a switching manner without disturbing rhythm of the exercise and the like.
Non-patent literature XP055157301 (Anonymous, "Rapid Evolution - Wikipedia, the free encyclopedia") and XP032549685 (AW MAUREEN S Y ET AL, "SmartDJ: An interactive music player for music discovery by similarity comparison", 2013 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA,) each disclose a display controller comprising: a sound detector configured to detect a certain sound component in a plurality of music pieces, and a display control unit configured to display a detection result obtained by the noise detector on a display unit, the display control unit comprising: a result display configured to display the detection result in association with time information about each of the plurality of music pieces; a choice detector configured to detect that a predetermined section is chosen in a first music piece of the plurality of music pieces; and a display changer configured to change a display state of the detection result of at least one of the plurality of music pieces other than the first music piece according to the detection result of the noise component in the chosen section.

CITATION LIST

PATENT LITERATURE(S)

Patent Literature 1: JP2008-242287A

SUMMARY OF THE INVENTION

PROBLEM(S) TO BE SOLVED BY THE INVENTION

The aforementioned cross-fade is one mixing method in a DJ performance, for which such processing as disclosed in Patent Literature 1 may be used.
However, such processing as disclosed in Patent Literature 1, which only allows the preceding music piece and the subsequent music piece to coincide with each other in terms of the beat timing, may cause discords to occur when both of the preceding music piece and the subsequent music piece are being reproduced. For this reason, it is necessary for the DJ to listen to the preceding music piece and the subsequent music piece in advance and predetermine a position of each of the preceding music piece and the subsequent music piece, where no discord occur and which the preceding music piece and the subsequent music piece are compatible with each other in mixing. Such a preparation is troublesome.
An object of the invention is to provide a display controller, a display control method, and a display control program which are capable of supporting a favorable mixing of music pieces.

MEANS FOR SOLVING THE PROBLEM(S)

According to an aspect of the invention, a display controller includes the features as claimed in the attached claim 1.
According to another aspect of the invention, a display control method of a display controller comprises the features as claimed in the attached claim 7.
According to still another aspect of the invention, a display control program controls a display controller to perform the display control method according to the above aspect of the invention.

BRIEF DESCRIPTION OF DRAWING(S)

Fig. 1 is a block diagram schematically showing a music piece reproduction apparatus according to an exemplary embodiment of the invention.
Fig. 2 shows a compatibility setting table.
Fig. 3A is a diagram schematically showing a display screen of a detection result of noise components, which expresses a state of the display screen before a predetermined section of a preceding music piece is chosen.
Fig. 3B is a diagram schematically showing a display screen of the detection result of noise components, which expresses a state of the display screen after the predetermined section of the preceding music piece is chosen.
Fig. 4 is a flowchart showing a music piece analysis processing to be performed by the music piece reproduction apparatus.
Fig. 5 is a flowchart showing a music piece analysis processing subsequent to the processing shown in fig. 4.
Fig. 6 is an illustration showing a detection processing of a harmonic structure component.
Fig. 7 is an illustration showing a processing of detecting a repetition component having the same pitch in the harmonic structure component.
Fig. 8 is a flowchart showing a music piece information display processing to be performed by the music piece reproduction apparatus.
Fig. 9A is a diagram schematically showing a display screen of a detection result of noise components in a modification of the invention, which expresses a state of the display screen before a predetermined section of a preceding music piece is chosen.
Fig. 9B shows a state of the display screen after the predetermined section of the preceding music piece is chosen in the state shown in Fig. 9A.
Fig. 10 shows another state of the display screen after the predetermined section of the preceding music piece is chosen in the state shown in Fig. 9A.

DESCRIPTION OF EMBODIMENT(S)

Exemplary embodiment(s) of the invention will be described below with reference to the attached drawings.

Arrangement of Music Piece Reproduction Apparatus

Firstly, an arrangement of a music piece reproduction apparatus according to an exemplary embodiment of the invention will be described with reference to Figs. 1, 2, 3A and 3B.
As shown in Fig. 1, a music piece reproduction apparatus 1 is a system for DJ performance such as mixing (e.g., cross-fade) and scratching (i.e., an operation for a user to create special sounds by forward and backward switching a reproduction direction of a music piece).
Cross-fade between noise and noise has been known for a favorable compatibility with each other since occurrence of discords is unlikely during the cross-fade. Cross-fade between harmonic sounds and harmonic sounds has been known for a poor compatibility with each other since occurrence of discords is likely during the cross-fade. It should be noted that harmonic sounds mean high pitch sounds having a harmonic structure including harmonics and fundamentals. Noise mean sounds other than the harmonic sounds, in other words, no pitch sounds having no harmonic structure. Examples of the harmonic sounds include voices and sounds of a piano, a guitar and a bass guitar. Examples of the noise include sounds of a drum, percussion and scratching.
The music piece reproduction apparatus 1 supports favorable cross-fade of music pieces in a manner to avoid occurrence of discords as described above or to reduce apparent discords (i.e., occurrence of discords for a user not to feel uneasy). The music piece reproduction apparatus 1 includes a first storage 2, a second storage 3, an operation unit 4, a display unit 5, an audio processor 6, and a display controller 7.
The first storage 2 is configured to store music piece data 21 and the like. The music piece data 21 may be stored in an external device or an external server capable of communicating with the audio processor 6 and the display controller 7.
The second storage 3 is configured to store a display control program and various data such as a compatibility setting table as shown in Fig. 2 to be used in the display controller 7.
The operation unit 4 includes a key board, a mouse, a touch panel and the like (which are not shown).
The display unit 5 includes a liquid crystal display and the like.
The audio processor 6 is configured to apply a signal processing (e.g., cross-fade) to the music piece data 21 stored in the first storage 2 on a basis of an operation of a jog dial, a pitch controller (not shown) and the like, thereby outputting a processed audio signal to the audio output unit 8.
The display controller 7 includes a noise detector 71, a display control unit 72, a first memory 73, and a second memory 74. The noise detector 71 and the display control unit 72 are configured to process the display control program and data stored in the second storage 3 using CPU (Central Processing Unit).
The noise detector 71 is configured to detect a noise component and a harmonic sound component contained in each of a plurality of music pieces. The noise detector 71 includes a section divider 711, a component detector 712, a ratio calculator 713, and a section attribute judging unit 714.
The section divider 711 is configured to acquire the music piece data 21 from the first storage 2 in response to the operation of the operation unit 4. The section divider 711 divides the music piece data 21 per a predetermined unit and acquires the divided section data. Although the music piece data 21 is divided per measure in the exemplary embodiment, for instance, the music piece data 21 may be divided per beat or may be divided per development after analyzing the development of the music piece in advance.
The component detector 712 is configured to detect a noise component contained in each section of the music piece on a basis of the section data acquired by the section divider 711.
The ratio calculator 713 is configured to calculate a ratio of the noise component contained in each section on a basis of the detection result obtained by the component detector 712 and store the calculation result in the first memory 73.
The section attribute judging unit 714 is configured to judge whether each section is a noise section or a harmonic section on the basis of the calculation result obtained by the ratio calculator 713 and store the judgment result in the second memory 74.
The display control unit 72 displays the detection result obtained by the noise detector 71 on the display unit 5. The display control unit 72 includes a result display 721, a choice detector 722, and a display changer 723.
The result display 721 is configured to associate the detection result obtained by the noise detector 71 with time information of the preceding music piece and the subsequent music piece and display the obtained information on the display unit 5. Specifically, as shown in Fig. 3A, the result display 721 displays preceding music piece information 50 about the preceding music piece and subsequent music piece information 55 about the subsequent music piece on the display unit 5.
The preceding music piece information 5 includes a waveform 501 of the preceding music piece and sound component information 502 of the preceding music piece. The sound component information 502 includes a plurality of section bars 503. As shown in Fig. 3A, the preceding music piece corresponding to one of the section bars 503 is reproduced and then the preceding music piece corresponding to the rightward adjacent one of the section bars 503 is reproduced. The result display 721 is configured to set a color of each of the section bars 503 according to the detection result obtained by the noise detector 71. The subsequent music piece information 55 has the same structure as that of the preceding music piece information 50 and includes a waveform 551 and sound component information 552 including a plurality of section bars 553.
The choice detector 722 is configured to detect that a part of the time information of the preceding music piece is chosen by the operation unit 4. The choice detector 722 detects that a predetermined one of the section bars 503 of the preceding music piece information 50 is chosen, when a choice is determined while a cursor CR is displayed on the predetermined one of the section bars 503 as shown by a chain double-dashed line in Fig. 3A.
The display changer 723 is configured to change a display state of the detection result of the subsequent music piece according to the detection result of the noise component in the chosen section. The display changer 723 is configured to set compatibility between the chosen section and each of the sections of the subsequent music piece on the basis of a compatibility setting table stored in the second storage 3 and data stored in the first memory 73 and the second memory 74. The display changer 723 is configured to display compatibility information 554 expressing the compatibility over the corresponding section bars 553 as shown in Fig. 3B. The display changer 723 is configured to display noise ratio information 555 expressing a ratio of a noise component below the corresponding section bars 553.
It should be noted that the display positions of the compatibility information 554 and the noise ratio information 555 are not limited to the aforementioned positions but may be any positions clearly indicating correspondence of the compatibility information 554 and the noise ratio information 555 to the section bars 553.

Operation of Music Piece Reproduction Apparatus

Next, a music piece analysis processing and a music piece information display processing will be described as operations of the music piece reproduction apparatus 1.
Firstly, the music piece analysis processing will be described with reference to Figs. 4 to 7.
As shown in Fig. 4, when detecting that the music piece analysis processing to a predetermined music piece is started in response to a user's operation of the operation unit 4, the section divider 711 of the display controller 7 acquires the music piece data 21 of the predetermined music piece from the first storage 2 (Step S1). Subsequently, the section divider 711 sets a section number M at 1 (Step S2) and acquires the section data of the M^th single measure (Step S3).
Next, the component detector 712 analyzes the section data to measure power spectra shown in Fig. 6 (Step S4). The power spectra are results obtained by the component detector 712 obtaining intensities of frequencies at every predetermined time (e.g., at every 0.1 seconds) and averaging the obtained intensities per frequency. The power spectra are also results obtained by measuring intensities of each in one to four octaves of 12 notes (i.e., C, D b , E b , E, F, G b , G, A b , A, B b , B, in which
stands for "flat"). Each set of a plurality of power spectra consecutively aligned in a direction of the abscissa axis expresses every note. Specifically, in a plurality of power spectra corresponding to the same note, the leftmost power spectrum expresses the fundamentals. For instance, if four power spectra correspond to the same note, the 2^nd, 3^rd and 4^th power spectra from the leftmost power spectrum respectively express sounds in a pitch higher by 1, 2 and 4 octaves than the fundamentals (i.e., 2^nd, 4^th, and 8^th harmonics).
Subsequently, as shown in Fig. 4, the ratio calculator 713 sums all the power spectra measured by the component detector 712 to calculate a total amount (Psa) of the sound component (Step S5).
The component detector 712 detects a harmonic structure component (Pgr) (i.e., a harmonic sound component) from the power spectra (Step S6). Specifically, when at least two of the four power spectra corresponding to the same note are equal to or more than a harmonic sound recognition threshold Lm, in other words, when the same note is expressed by sound in at least two octaves, the component detector 712 judges that the sound component of this note is the harmonic structure component. On the other hand, when no or a single power spectrum is equal to or more than the harmonic sound recognition threshold Lm, the component detector 712 judges that the sound component of this note is not the harmonic structure component. For instance, in the power spectra as shown in Fig. 6, since two power spectra of each of the sound components of "C," "E
" and "F" are equal to or more than the sound recognition threshold Lm, the component detector 712 judges that the sound components of "C," "E
" and "F" are the harmonic structure components and the other sound components are not the harmonic structure components.
Since cross-fade between harmonic sounds is likely to generate discords as described above, it is not favorable to propose this combination to a user as a good cross-fade compatibility. However, for instance, rapping (i.e., a musical form of vocal delivery to sing like a rhythmic speech with less melody while rhyming, for instance, at an end of a measure), in which harmonic sounds are repeated with the same pitch, is less likely to generate discords during cross-fade with other harmonic sounds than harmonic sounds without repeating the same pitch. Accordingly, in the exemplary embodiment, the harmonic sounds of rapping and the like with the same pitch repeated are regarded as noise. In order to propose the harmonic sounds of rapping to the user as sounds that are less likely to generate discords during cross-fade with other harmonic sounds, the following processing is performed at Step S7 and S8.
As shown in Fig. 4, the component detector 712 detects a repetition component (Pgrex) having the same pitch in the harmonic structure component detected in Step S6 (Step S7). Specifically, the component detector 712 judges that the harmonic structure component is the repetition component when the same component as the harmonic structure component detected in Step S6 are continuously detected in a plurality of sections (e.g., at least four sections) including the section in which the harmonic structure component is detected. For instance, when power spectra of the consecutive four sections ((M-3)^th, (M-2)^th, (M-1)^th and M^th sections) are detected as shown in Fig. 7, since the harmonic structure components of "C," "E
" and "F" are contained in all the four sections, the component detector 712 judges that the harmonic structure components are the repetition components having the same pitch.
In this processing at Step S7, the component detector 712 detects the harmonic sound component recognizable as the noise component.
Subsequently, as shown in Fig. 4, the ratio calculator 713 subtracts the repetition component (Pgrex) having the same pitch from the harmonic structure component (Pgr). The ratio calculator 713 sums the power spectra forming the remaining harmonic structure components after the above subtraction, thereby calculating an amount (Pss) of the harmonic sound component (Step S8). For instance, when there are four harmonic structure components (16 spectra) and three (12 spectra) of those are the repetition components, the ratio calculator 713 conducts the processing of summing the power spectra of the remaining one harmonic structure component (4 spectra) that is not the repetition component.
In this processing at Step S8, the sound component recognizable as the noise component is excluded from the power spectra regarded as the sound component in terms of the component structure, thereby calculating the sound component amount.
Next, as shown in Fig. 5, the ratio calculator 713 calculates a noise component ratio (Rs) according to a formula (1) below (Step S9), and stores the total amount of the sound component and the noise component ratio in the first memory 73 in association with the music piece and the section number M (Step S10). $Rs (%) = (1 - sound component amount/total sound component amount) \times 100$
Subsequently, the section attribute judging unit 714 judges whether or not the noise component is equal to or more than the noise recognizable threshold (e.g., 51%) (Step S11). When judging that the conditions of Step S11 are satisfied, the section attribute judging unit 714 recognizes the M^th section as the noise section and stores a noise section flag in the second memory 74 in association with the music piece and the section number M (Step S12). On the other hand, when judging that the conditions of Step S11 are not satisfied, the section attribute judging unit 714 stores a harmonic section flag indicating the harmonic section in the second memory 74 in association with the music piece and the section number M (Step S13).
After the section attribute judging unit 714 conducts the processing of Step S12 or Step S13, the section divider 711 increments the section number M by 1 (Step S14). The section attribute judging unit 714 judges whether analysis of the last section of the music piece is finished (Step S15). When the analysis is not finished yet, the processing of Step S3 is conducted. When judging that the analysis is finished, the music piece analysis processing ends.
When the same harmonic structure component is detected in the consecutive four sections in the processing of Steps S7 to S9 as described above, the harmonic structure component at the latest section is regarded as the noise component and the noise component ratio is calculated. However, although the harmonic structure components of three sections previous to the latest section can be regarded as the noise components, in some cases of the processing of each of the three sections, the noise component ratio is calculated without including the harmonic structure components of the three sections as the noise components, since the same harmonic structure component is not yet consecutively detected in the four sections. In these cases, it is optionally conducted to re-calculate the noise component ratio with the harmonic structure component of the above three sections as the noise component, to update data in the first memory 73, and to update the section flags in the second memory 74 based on the re-calculation result of the noise component ratio.
Next, the music piece information display processing will be described with reference to Figs. 3A, 3B and 8.
The music piece information display processing follows the music piece analysis processing conducted to a plurality of music pieces.
Firstly, the user operates the operation unit 4 to choose a preceding music piece and a subsequent music piece for cross-fade. As shown in Fig. 8, when the result display 721 of the display controller 7 detects that the preceding music piece and the subsequent music piece are chosen (Steps S21 and S22), the result display 721 acquires the music piece data 21 of the preceding music piece and the subsequent music piece from the first storage 2 (Step S23).
Although a case where a single music piece is chosen for each of the preceding music piece and the subsequent music piece is described in the exemplary embodiment, the same processing is also conducted in a case where at least two music pieces are chosen for at least one of the preceding music piece and the subsequent music piece.
The result display 721 acquires from the first memory 73 and the second memory 74 the total sound component amount, the noise component ratio and the section flags (i.e., the noise section flag or the harmonic section flag) about each of the sections of the preceding music piece and the subsequent music piece (Step S24). Subsequently, the result display 721 displays the preceding music piece information 50 and the subsequent music piece information 55 on the display unit 5 (Step S25). At this time, the result display 721 may display the preceding music piece information 50 and the subsequent music piece information 55 of all the sections of the music pieces at the same time. Alternatively, the result display 721 may display the preceding music piece information 50 and the subsequent music piece information 55 about a part of the sections and update with the preceding music piece information 50 and the subsequent music piece information 55 of the remaining sections by operating the operation unit 4.
The result display 721 displays the waveforms 501, 551 based on the music piece data. The result display 721 also displays the sound component information 502, 552 based on the total sound component amount and each section flag. Specifically, the result display 721 sets a color of the section bar 503 in each of the sections forming the preceding music piece based on Table 1 below, and displays the sound component information 502, in which the section bars 503 are aligned in a sequence for reproducing the sections, below the waveform 501. Also as for the subsequent music piece, the result display 721 sets a color of each of the section bars 553 and displays the sound component information 552 below the waveform 551.

By visually checking the section bars 503, 553 whose colors are set according to Table 1, the user can recognize both of the attribute of each section (whether each section is the noise section) and the sound intensities of all the sections.

Table 1

Section Flag	Total Sound Compount Amount	Color	Characteristics
Noise Section	equal to or more than intensity threshold	Red	Section with high noise ratio and high intensity
Noise Section	less than intenisty threshold	Orange	Section with high noise ratio and low intensity
Harmonic Section	equal to or more than intensity threshold	Blue	Section with low noise ratio and high intensity
Harmonic Section	less than intenisty threshold	Light Blue	Section with low noise ratio and low intensity

After the preceding music piece information 50 and the subsequent music piece information 55 are displayed on the display unit 5 as shown in Fig. 3A by the above processing, the user operates the operation unit 4 to move the cursor CR and choose a predetermined section of the preceding music piece as a candidate section for cross-fade.
When the choice detector 722 detects that the predetermined section of the preceding music piece is chosen (Step S26), the display changer 723 sets compatibility between the chosen section and each section of the subsequent music piece according to the compatibility setting table shown in Fig. 2 (Step S27). At this time, the display changer 723 refers to the compatibility setting table after rounding off the noise component ratio between the chosen section and each section of the subsequent music piece to a value by a unit of 1%. For instance, when the noise component ratio of the chosen section is 20% in Fig. 3B, the display changer 723 sets compatibilities of the chosen section relative to the sections whose noise component ratios are 30%, 40%, 70% and 90% to be respectively at scores of 35, 40, 55 and 100.
The compatibility setting table shows the scores of 70 or more expressing a good compatibility when both of a section of the preceding music piece and a section of the subsequent music piece are noise sections (Rs ≥ noise recognizable threshold (51%)). The compatibility setting table also shows the scores of less than 70 expressing a poor compatibility when both the sections of the preceding music piece and the subsequent music piece are harmonic sections (Rs < noise recognizable threshold). Further, the compatibility setting table shows scores expressing a good compatibility when one of the sections of the preceding music piece and the subsequent music piece is the noise section and the other of the sections is the harmonic section. Furthermore, the compatibility setting table shows that the scores expressing the compatibilities between the chosen sections of the preceding music piece and the corresponding sections of the subsequent music piece are increased according to an increase in the noise component ratios of the corresponding sections of the subsequent music piece. The higher score expressing the compatibility means less generation of discords, leading to the better compatibility.
As shown in Fig. 3B, the display changer 723 displays the noise ratio information 555 of the subsequent music piece and the compatibility information 554 on the display unit 5 by characters (Steps S28, S29) to finish the music piece information display processing.
Subsequently, the user sets a combination of sections for cross-fade on the basis of the display of the display unit 5, whereby the audio processor 6 functions according to the combination. For instance, the audio processor 6 starts reproducing the preceding music piece and then performs cross-fade between a chosen section of the preceding music piece and a chosen section of the subsequent music piece, thereby finishing reproducing the preceding music piece and starting reproducing the subsequent music piece.
During the cross-fade, the user may operate a jog dial and the like to fade out the preceding music piece and fade in the subsequent music piece or adjust volumes of the music pieces. This processing may be automatically performed by the audio processor 6 based on the user's setting.
When the user sets a section of the preceding music piece for cross-fade using the operation unit 4, the audio processor 6 detects this setting and sets the section as a section for cross-fade. Simultaneously, the audio processor 6 can set one of all sections of the subsequent music piece favorably compatible with the set section of the preceding music piece as a section suitable for cross-fade, while setting one of the sections of the subsequent music piece poorly compatible with the set section of the preceding music piece as an unsettable section. For instance, when the set section of the preceding music piece is the harmonic section, the audio processor 6 can set a noise section of the subsequent music piece as a section for cross-fade and set a harmonic section as an unsettable section based on the section flags of the second memory 74. Similarly, when the set section of the preceding music piece is the noise section, the audio processor 6 can set all the sections of the subsequent music piece as the sections suitable for cross-fade.

Advantage(s) of Exemplary Embodiment(s)

As described above, the display controller 7 detects the noise components of a plurality of music pieces and displays on the display unit 5 the detection result in association with the time information corresponding to the plurality of music pieces. When the display controller 7 detects that a predetermined section of a single music piece (preceding music piece) is chosen from the plurality of music pieces, the display controller 7 changes a display state of the detection result of the other music piece (subsequent music piece) according to the detection result of the noise component in the predetermined section.
This operation enables the user to easily discern a section for cross-fade (mixing) well compatible with the chosen section of the preceding music piece based on the display state of the detection result on the subsequent music piece. Accordingly, the display controller 7 capable of supporting favorable cross-fade of the music pieces can be provided.
Since the time information of the music pieces is expressed particularly with the section bars 503, 553 in the exemplary embodiment, the user can intuitively understand the detection result of noise in each of the time information as compared with when the time information is expressed only with characters such as a "section 1."
The display controller 7 also changes the display state of the detection result of the subsequent music piece by displaying the compatibility information 554 expressing the compatibility for the cross-fade with the chosen section of the preceding music piece.
This operation enables the user to easily recognize the compatibility for cross-fade by visually checking the compatibility information 554.
Since the compatibility information 554 is expressed particularly with the characters in the exemplary embodiment, the user can more easily recognize the compatibility for cross-fade than when the compatibility information 554 is displayed in colors other than the characters.
In the exemplary embodiment, when the chosen section of the preceding music piece is the harmonic section, the compatibility information 554 expressing a good compatibility for cross-fade between the noise section of the subsequent music piece and the chosen section is displayed. When the chosen section is the noise section, the compatibility information 554 expressing a good compatibility for cross-fade between all the sections of the subsequent music piece and the chosen section is displayed. This operation enables the user to more easily recognize the compatibility for cross-fade by visually checking the compatibility information 554 expressing a favorably compatible section.
The display controller 7 also displays the compatibility information 554 at a position where the compatibility information 554 is not superimposed on the sound component information 552.
This operation enables the user to more easily recognize the compatibility for cross-fade than when the sound component information 552 is displayed while being superimposed on the compatibility information 554, for instance, when the compatibility information 554 is displayed within the section bars 553.

Modification(s)

The scope of the invention is not limited only to the above exemplary embodiments but can include various improvement and design modification compatible with the invention.
For instance, although the result display 721 displays on the display unit 5 the sound component information 502 and 552 each expressing both of the attribute and the sound intensities of the sections in the above exemplary embodiment, the result display 721 may display on the display unit 5 sound component information 502A and 552A each expressing the attribute and the sound intensities of the sections individually as shown in Fig. 9A.
The sound component information 502A includes: noise ratio information 505A including a plurality of section bars 506A; and sound intensity information 507A including a plurality of section bars 508A. The sound component information 552A, which has a structure similar to that of the sound component information 502A, includes noise ratio information 555A including a plurality of section bars 556A and sound intensity information 557A including a plurality of section bars 558A.
The noise ratio information 505A and 555A shows the noise component ratios of the sections. The section bars 506A and 556A of the respective noise ratio information 505A and 555A are displayed in a blue color at the noise component ratio being less than 25%, in a light blue color at the noise component ratio ranging from 25% to less than 50%, in an orange color at the noise component ratio ranging from 50% to less than 75%, and in a red color at the noise component ratio being 75% or more.
The sound intensity information 507A and 557A represents the sound intensities of the sections. The section bars 508A and 558A of the respective sound intensity information 507A and 557A are displayed in a green color at the total sound component amount being less than a first intensity threshold, in a light green color at the total sound component amount ranging from the first intensity threshold to less than a second intensity threshold, in a yellow green color at the total sound component amount ranging from the second intensity threshold to less than a third intensity threshold, and in a yellow color at the total sound component amount being equal to or more than the third intensity threshold. The sound intensity information 507A and 557A is not necessarily displayed.
When a predetermined section is chosen by the cursor CR shown in a chain double-dashed line in a state shown in Fig. 9A, the display changer 723 sets compatibility between the predetermined section and each section of the subsequent music piece in the same manner as in the above exemplary embodiment, and displays the compatibility information 554 as shown in Fig. 9B.
At this time, when the noise section is chosen as a section for cross-fade with the harmonic section, discords are less likely to be generated. It is expected that the higher noise ratio of the noise section generates less discords.
Displaying the noise ratio information 505A and 555A only indicating the noise component ratios on the display unit 5 as shown in Fig. 9A enables the user to choose as the section suitable for cross-fade the section in which discords are further less likely to be generated. In addition, displaying the sound intensity information 507A and 557A only indicating the intensities of the sounds at different positions from those of the noise ratio information 505A and 555A enables the user to recognize the noise ratio independently of the sound intensity in each section.
When the predetermined section of the preceding music piece is chosen in the state shown in Fig. 9A, the display changer 723 may display compatibility information 554B in place of the sound component information 552A as shown in Fig. 10. The compatibility information 554B includes a plurality of section bars 559B. Each of the section bars 559B is displayed in a black color at the score representing the compatibility being 0 or 10, in a gray color at the score ranging from 20 to 50, in a light gray color at the score ranging from 60 to 80, and in a white color at the score being 90 or 100.
The colors of the section bars 503, 553, 506A, 556A and 559B shown in Figs. 3A, 9A and 10 may be other colors. The thresholds used for setting the colors are not limited to the aforementioned values and may be any values.
The result display 721 and the display changer 723 may set predetermined colors respectively for colors of the waveforms 501 and 551 per se corresponding to the sections, colors of frames surrounding the waveforms 501 and 551 or colors inside the frames to a predetermined color, thereby displaying the noise ratio (detection result) and the sound intensity or the compatibility.
Moreover, the result display 721 and the display changer 723 may change a size of the section bars 503, 553, 506A, 556A and 559B and the compatibility information 554 and 554B or may flash the section bars 503, 553, 506A, 556A and 559B and the compatibility information 554 and 554B, thereby displaying the noise ratio (detection result) and the sound intensity or the compatibility.
Alternatively, the result display 721 and the display changer 723 may display the noise ratio and the sound intensity or the compatibility with a figure such as a circle or a triangle or with characters such as "high (noise component ratio)," "strong sound" and "good (compatibility)."
Although expressing the time information of the music pieces with the section bars 503, 553, 506A, 556A and 559B, the result display 721 and the display changer 723 may express the time information with characters such as "section 1" and "section with a reproduction time ranging from 1 minute 0 seconds to 1 minute 5 seconds." In this case, the noise ratio and the sound intensity or the compatibility may be displayed above and/or below or on the left and/or right sides of the characters expressing the time information. Alternatively, the noise ratio and the sound intensity or the compatibility may be expressed by setting a color, a size and the like of the characters expressing the time information.
When two or more music pieces are chosen as at least one of the preceding music piece and the subsequent music piece, the result display 721 and the display changer 723 may display the sound component information and the compatibility information about the two or more chosen music pieces at the same time.
Alternatively, the result display 721 and the display changer 723 each may include a plurality of display units and display the information about the preceding music piece on one(s) of the display units and the information about the subsequent music piece on the rest of the display units.
The display changer 723 may superimpose the sound component information on the compatibility information about the music pieces, for instance, by displaying characters expressing the compatibility within the section bars 553 shown in Fig. 3A.
When the chosen section of the preceding music piece is the harmonic section, the display changer 723 may only display the compatibility information 554 about the noise section of the subsequent music piece without displaying the compatibility information 554 about the harmonic section. In other words, the display changer 723 may display the compatibility information 554 only about a section having a good compatibility for cross-fade with the chosen section.
When the chosen section of the preceding music piece is the harmonic section, the display changer 723 may only display the compatibility information 554 about the harmonic section of the subsequent music piece without displaying the compatibility information 554 about the noise section. When the chosen section of the preceding music piece is the noise section, the display changer 723 does not necessarily display the compatibility information 554 about all the sections of the subsequent music piece. In other words, the display changer 723 may display the compatibility information 554 only about a section having a poor compatibility for cross-fade with the chosen section.
The display changer 723 may display the compatibility information of the preceding music piece when a predetermined section of the subsequent music piece is chosen.
The noise detector 71 may include no section divider 711. Instead, the component detector 712 may consecutively acquire the music piece data 21 from the first storage 2 and process unanalyzed data among the acquired music piece data in the same manner as in Steps S4, S6 and S7 at every predetermined time.
The ratio calculator 713 may calculate the noise component ratio (Rs) based on the number of the power spectra forming the harmonic structure component.
For instance, when the power spectra are measured as shown in Fig. 6, in which the power spectra includes six power spectra of "C," "mi
" and "fa" being the harmonic structure component and the total number of the power spectra is 48, the ratio calculator 713 may calculate the noise component ratio (Rs) to be 88% (=(48-6)/48 × 100).
The display controller of the invention may be used in products other than a DJ device such as a music player as disclosed in Patent Literature 1.

EXPLANATION OF CODE(S)

7...display controller, 71.. .noise detector, 72...display control unit, 552...sound component information, 554,554B...compatibility information, 712... component detector, 713...ratio calculator, 721...result display, 722... choice detector, 723...display changer.

Claims

A display controller (7) comprising:
a noise detector (71) configured to detect a noise component in a plurality of music pieces, and

a display control unit (72) configured to display a detection result obtained by the noise detector (71) on a display unit,

the display control unit (72) comprising:
a result display (721) configured to display the detection result in association with time information about each of the plurality of music pieces;

a choice detector (722) configured to detect that a predetermined section is chosen in a first music piece of the plurality of music pieces; and

a display changer (723) configured to change a display state of the detection result of at least one of the plurality of music pieces other than the first music piece according to the detection result of the noise component in the chosen section,

characterized in that
the noise component is no pitch sounds having no harmonic structure.
The display controller (7) according to claim 1, wherein
the display changer (723) is configured to change the display state by displaying compatibility information (554) expressing compatibility for mixing between a predetermined section of the at least one of the plurality of music pieces other than the first music piece and the chosen section.
The display controller (7) according to claim 2, wherein
the noise detector (71) comprises:
a component detector (712) configured to detect a noise component contained in a predetermined section of each of the plurality of music pieces; and

a ratio calculator (713) configured to calculate a ratio of the noise component contained in the predetermined section of each of the plurality of music pieces, and

when the ratio of the chosen section is less than a threshold, the display changer (723) displays the compatibility information (554) expressing a high compatibility for mixing between the chosen section and a section in which the ratio is equal to or more than the threshold in the at least one of the plurality of music pieces other than the first music piece.
The display controller (7) according to claim 2 or 3, wherein
the noise detector (71) comprises:
a component detector (712) configured to detect a noise component contained in a predetermined section of each of the plurality of music pieces; and

a ratio calculator (713) configured to calculate a ratio of the noise component contained in the predetermined section of each of the plurality of music pieces, and

when the ratio of the chosen section is equal to or more than a threshold, the display changer (723) displays the compatibility information (554) expressing a high compatibility for mixing between the chosen section and all sections of the at least one of the plurality of music pieces other than the first music piece.
The display controller (7) according to claim 3 or 4, wherein
the component detector (712) is further configured to detect a repetition component having a same pitch in the harmonic structure component and regard the repetition component as further noise component.
The display controller (7) according to claim 3 or 4, wherein
the result display (721) is configured to display sound component information (522) expressing whether or not the ratio of the noise component contained in each of the sections of the plurality of music pieces is equal to or more than the threshold, and

the display changer (723) displays the compatibility information (554) at a position where the compatibility information (554) is not superimposed on the sound component information (522).
A display control method of a display controller (7) for displaying information about a sound component of a music piece on a display unit, the method being performed by the display controller (7) and comprising:
detecting a noise component in a plurality of music pieces;

displaying a detection result of the detecting in association with time information about each of the plurality of music pieces;

detecting that a predetermined section is chosen in a first music piece of the plurality of music pieces; and

changing a display state of the detection result of at least one of the music pieces other than the first music piece according to the detection result of the noise component in the chosen section ;
characterized in that
the noise component is no pitch sounds having no harmonic structure.
A display control program controlling a display controller (7) to perform the display control method according to claim 7.