KR102013577B1 - Apparatus and method for designing choreography - Google Patents

Apparatus and method for designing choreography Download PDF

Info

Publication number
KR102013577B1
KR102013577B1 KR1020160002743A KR20160002743A KR102013577B1 KR 102013577 B1 KR102013577 B1 KR 102013577B1 KR 1020160002743 A KR1020160002743 A KR 1020160002743A KR 20160002743 A KR20160002743 A KR 20160002743A KR 102013577 B1 KR102013577 B1 KR 102013577B1
Authority
KR
South Korea
Prior art keywords
choreography
search
attribute
information
motion
Prior art date
Application number
KR1020160002743A
Other languages
Korean (ko)
Other versions
KR20170032146A (en
Inventor
김도형
김재홍
윤영우
장민수
박천수
신성웅
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to US15/059,946 priority Critical patent/US20170076629A1/en
Publication of KR20170032146A publication Critical patent/KR20170032146A/en
Application granted granted Critical
Publication of KR102013577B1 publication Critical patent/KR102013577B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Software Systems (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)

Abstract

Choreography concept support technology is disclosed that can search existing choreography easily and systematically through various interfaces, and to check the simulation of the searched choreography. To this end, the choreography planning support apparatus according to an embodiment of the present invention comprises a choreography operation DB that stores the motion capture data for each of the plurality of choreography operations; Choreography attribute DB for storing biomechanical information for each of the plurality of choreographed movements; A search unit which receives a search target choreography by at least one of section motion search and choreography attribute search from a user and searches the choreography motion DB and choreography attribute DB based on similarity determination; And an output unit for displaying the choreography motion DB searched on the basis of the similarity determined by the search unit and the choreography data of the choreography attribute DB to the user.

Figure R1020160002743

Description

Choreography Concept Supporting Device and Method {APPARATUS AND METHOD FOR DESIGNING CHOREOGRAPHY}

The present invention relates to an apparatus and method for supporting choreographing, and more particularly, to an apparatus and method for supporting choreographing, which can easily and systematically search for an existing choreography through various interfaces and check a simulation of the found choreography. It is about.

K-POP is the core content of the Korean wave and the killer content that leads the growth of the Korean wave. The driving force of K-POP's worldwide spread is K-POP dance. It is no exaggeration to say that the key to the popularity of K-POP is dance as it changes from listening music to watching music. Overseas media define K-POP as dance music by Korean idol singers and groups. K-POP dance is contributing to the improvement of the Korean wave and the creation of national wealth, as the cover dance craze is spreading around South America and the world.

Despite the global popularity of K-POP dance, no research has been made to secure IT-based technologies and data related to K-POP dance. Development of scientific and systematic IT technology is urgently needed for the continuous spread of the K-POP Dance Korean Wave and the development and growth of the K-POP Dance contents industry.

The present invention relates to a technique for supporting choreography creation work of K-POP dance choreographers using IT technology as part of this necessity.

The process of creating K-POP dance choreography, which I learned through interviews with K-POP dance choreographers, is as follows. First, we devise choreography moves that match the target K-POP dance song. For planning purposes, the choreographer may randomly search for similar dance videos on YouTube, etc., or share opinions with fellow choreographers to remind them of the dance moves they know or to get ideas. The initial choreographing phase requires numerous trials and errors, and it is expensive to sketch the composition of the whole choreography. When the initial sketch of the choreography is completed, each choreography is refined and the final choreography is born.

Currently, there is no device and method for supporting choreographic initiatives to support K-POP dance choreography creation.

There are many motion capture search systems for searching various motion capture data such as action motions, sports and dances, but all of them are set as search motions to search for motion capture data in the DB that shows similar posture and motion. It is a method for doing so. Therefore, there is a big difference from the present invention composed of a search / input / output UI specialized in choreography creation.

Motion capture refers to an animation generation technique of acquiring, by a computer, movement information of a marker position generated according to a human's movement by attaching a marker or a sensor to a human to express a natural movement of the character.

In this regard, Korean Patent Laid-Open No. 2011-0083329 discloses a performance choreography production system and a performance choreography production method.

An object of the present invention is to support choreographer's choreography creation. That is, an object of the present invention is to easily search for a choreographer having an operation and an attribute to be searched by the choreographer.

In addition, an object of the present invention is to support an early choreography design step in creating a dance choreography. That is, the present invention allows the choreographer to easily and quickly and systematically search for similar choreographies that have been previously created through various interfaces, and to quickly identify initial sketches through editing and simulation of the searched choreography.

In addition, in the search for choreography, an object of the present invention is not only to search a choreography by querying an operation, but also to enable a search of a similar choreography as an attribute of the choreography. In addition, an object of the present invention is to enable the accurate simulation of the choreograph motion through the omnidirectional 3D viewer for the searched choreography.

A choreography planning support apparatus according to an embodiment of the present invention for achieving the above object comprises a choreography operation DB for storing motion capture data for each of a plurality of choreography operations; Choreography attribute DB for storing biomechanical information for each of the plurality of choreographed movements; A search unit which receives a search target choreography from at least one of section motion search and choreography attribute search from a user and searches the choreography motion DB and the choreography attribute DB based on a similarity determination; And an output unit configured to display choreography data of the choreography operation DB and the choreography attribute DB retrieved based on the similarity determined by the search unit.

In this case, the section motion search is a search based on at least one of a video file and a camera photographed image input by the user, and the choreography attribute search is based on at least one of a query for an attribute of a choreography and an audio file. It can be one search.

At this time, the search unit, a similar motion search module for performing a search based on the similarity determination in the choreography operation DB when the search target choreography input from the user to the interval motion search; And a choreography attribute search module for performing a search based on a similarity determination in the choreography attribute DB when the search target choreography is input from the user to the choreography attribute search.

At this time, the similar motion search module, the skeleton information extraction unit for extracting a skeleton information sequence consisting of the position information of each joint through the extraction of the skeleton of the body from the search target choreography of the video file and the camera-photographed image input by the user ; A feature description unit for extracting a feature descriptor for specifying a posture of the search choreography target based on the skeleton information sequence; A feature matching unit for comparing and matching the feature descriptor with the motion capture data stored in the choreography motion DB to output a matching distance matrix; And a dynamic matching search unit configured to calculate a similarity between the search target choreography and the motion capture data based on the matching distance matrix.

In this case, when the search target choreography is input to the section motion search and the choreography attribute search, the search unit may be configured to give weights to the section motion search and the choreography attribute search when determining similarity.

In this case, the biomechanical information may be at least one of kinematic information, kinematic information and energy consumption.

In this case, the kinematics information is composed of the angle information of each joint as information about the body position and movement, the kinematic information includes ground reaction force and moment information as information on the force affecting the movement of the body, The energy consumption is data estimated based on the heart rate measured by the heart rate measuring device and the muscle expression amount which is a biosignal extracted from the EMG sensor. The energy consumption may be information on the total energy consumption and energy consumption by body parts.

At this time, in the search unit, the choreography attribute search may be performed based on a query for at least one of the speed, power, flexibility, complexity, space utilization, difficulty, and concentration of the choreography operation from the user.

In this case, the output unit may provide the user with an omnidirectional viewing function for the choreography data through an input device.

At this time, the output unit, the choreograph data, may display the biomechanical information by different colors for each level.

In addition, choreography planning support method according to an embodiment of the present invention for achieving the above object comprises the steps of storing the motion capture data for each of the plurality of choreographed operations in the choreography operation DB; Storing biomechanical information for each of the plurality of choreography operations in a choreography attribute DB; Receiving a search target choreography from at least one method of section motion search and choreography attribute search from a user; Searching based on the similarity determination in the choreography operation DB and the choreography attribute DB; And displaying choreography data of the choreography operation DB and the choreography attribute DB searched based on the similarity determined in the searching step to the user.

In this case, the section motion search is a search based on at least one of a video file and a camera photographed image input by the user, and the choreography attribute search is based on at least one of a query for an attribute of a choreography and an audio file. It can be one search.

In this case, the searching may include: a similar motion searching step of performing a search based on a similarity determination in the choreography motion DB when the search target choreography is input from the user in the step of receiving the input by the interval motion search; And a choreography attribute searching step of performing a search based on a similarity determination in the choreography attribute DB when the search target choreography is input from the user in the receiving step by the choreography attribute search.

In this case, the step of searching for similar motions may include: extracting a skeleton information sequence composed of position information of each joint through skeletal extraction of a body from a search target choreography of a video file and a camera photographed image input by the user; Extracting a feature descriptor specifying a posture of the search choreography target based on the skeletal information sequence; Comparing and matching the feature descriptor with the motion capture data stored in the choreography motion DB and outputting a matching distance matrix; And calculating a similarity degree between the search target choreography and the motion capture data based on the matching distance matrix.

In this case, the receiving step may be configured to give weights to the segment motion search and the choreography attribute search when determining the similarity when the search target choreography is input to the segment motion search and the choreography attribute search. have.

In this case, the biomechanical information may be at least one of kinematic information, kinematic information and energy consumption.

In this case, the kinematics information is composed of the angle information of each joint as information about the body position and movement, the kinematic information includes ground reaction force and moment information as information on the force affecting the movement of the body, The energy consumption is data estimated based on the heart rate measured by the heart rate measuring device and the muscle expression amount which is a biosignal extracted from the EMG sensor. The energy consumption may be information on the total energy consumption and energy consumption by body parts.

At this time, in the receiving step, the choreography attribute search may be performed based on a query for at least one of the speed, power, flexibility, complexity, space utilization, difficulty, and concentration of the choreography operation from the user.

At this time, in the displaying step, it is possible to provide the user with an omnidirectional viewing function for the choreography data through an input device.

In this case, the displaying may include displaying biomechanical information in different colors for each level in the choreography data.

According to the present invention, choreographers can support choreography creation. That is, the present invention can easily search for choreographers having an operation and a property that the choreographer wants to search.

In addition, the present invention may support an early choreography planning stage in creating a dance choreography. That is, the present invention allows the choreographer to easily and quickly and systematically search for similar choreographies that have been previously created through various interfaces, and quickly check initial sketches through editing and simulation of the searched choreography.

In addition, in the present invention, the choreography can be searched by an operation query as well as a choreography search. In addition, the present invention has a feature that can be accurately simulated choreographed motion through the omnidirectional 3D viewer for the searched choreography.

1 is a block diagram showing the configuration of a choreograph initiative support apparatus according to an embodiment of the present invention.
2 illustrates an example of items of biomechanical information stored in a choreography attribute DB in the apparatus for supporting choreographing according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a similar motion search module in the apparatus for choreography planning according to an embodiment of the present invention.
4 is a diagram illustrating an example of a display of an output unit in a choreography conception support apparatus according to an embodiment of the present invention.
5 is a view showing another example of the display of the output unit in the choreograph initiative support apparatus according to an embodiment of the present invention.
6 is a flowchart for explaining a choreography conception method according to an embodiment of the present invention.
7 is a flowchart for explaining in detail the step of searching in the choreography conception method according to an embodiment of the present invention.
8 is a flowchart for explaining in detail the step of searching in the choreography operation DB in the choreography conception method according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. Here, the repeated description, well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention, and detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more completely describe the present invention to those skilled in the art. Accordingly, the shape and size of elements in the drawings may be exaggerated for clarity.

Hereinafter, the configuration and operation of a choreograph initiative support apparatus according to an embodiment of the present invention will be described.

1 is a block diagram showing the configuration of a choreograph initiative support apparatus according to an embodiment of the present invention. 2 illustrates an example of items of biomechanical information stored in a choreography attribute DB in the apparatus for supporting choreographing according to an embodiment of the present invention. 3 is a block diagram showing the configuration of a similar motion search module in the apparatus for choreography planning according to an embodiment of the present invention. 4 is a diagram illustrating an example of a display of an output unit in a choreography conception support apparatus according to an embodiment of the present invention. 5 is a view showing another example of the display of the output unit in the choreograph initiative support apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the apparatus for supporting choreography planning according to an embodiment of the present invention includes a choreography operation DB 110, a choreography attribute DB 120, a search unit 130, and an output unit 140.

The choreography operation DB 110 stores motion capture data for each of the plurality of choreography operations.

The choreography attribute DB 120 stores biomechanical information for each of the plurality of choreography operations. In this case, the biomechanical information may be at least one of kinematic information, kinematic information and energy consumption. Kinematics information is information about the body position and movement may be composed of the angle information of each joint. Kinematic information is information about the force affecting the movement of the body may include ground reaction force and moment information. The energy consumption is data estimated based on the heart rate measured by the heart rate measuring device and the muscle expression amount, which is a biosignal extracted from the EMG sensor, and may be information on total energy consumption and energy consumption by body parts. An example tree of biomechanical information is shown in FIG. 2.

The search unit 130 receives a search target choreography by at least one of section motion search and choreography attribute search from the user, and searches the choreography motion DB 110 and the choreography attribute DB 120 based on the similarity determination. In detail, the search unit 130 may include a search UI unit 131, an input UI unit 132, a similar motion search module 133, and a choreography attribute search module 134.

The search UI unit 131 may determine whether the section motion search or the choreography attribute search is performed based on the search means input from the user. One of the section motion search and the choreography attribute search may be selected to proceed with the subsequent procedure, and the section motion search and the choreography attribute search may be selected together to proceed with the subsequent procedure. In this case, when a search target choreography is input to the section motion search and the choreography attribute search, the weight may be assigned to the section motion search and the choreography attribute search when determining similarity. For example, if the choreographer gives a weight to the motion search, the motion is similar to the overall similarity among the similarity lists provided by the similar motion search module 133 and the choreography attribute search module 134 described later. Similar choreography will be located at the top of the search results list. If the weights are the same, the motion and attribute similarity share the same weight in the overall similarity.

The input UI unit 132 may receive at least one of a video file (ex; 2D video file) and a camera photographed image (ex: 2D video sequence, 3D video sequence) input by the user as a means of section motion search. . That is, the choreographer may search the choreography operation DB 110 for an operation similar to the query operation suggested by the choreographer through the section motion search. For example, the 2D video file is a method of searching for a similar motion by inputting a choreography video file of another person obtained from YouTube or the like. The 2D / 3D video sequence is an intuitive input method in which the choreographer dances his or her own dance directly in front of the 2D / 3D camera.

The input UI unit 132 may receive at least one of a query for an attribute of a choreography and an audio file as a means of choreography attribute search. In this case, the query may be at least one of the speed, power, flexibility, complexity, space utilization, difficulty, and concentration of the choreography operation.

When the similar motion search module 133 receives a search target choreography by the section motion search from a user, the choreography motion DB 110 performs a search based on the similarity determination.

The similar motion searching module 133 is configured to include a skeleton information extracting unit 133a, a feature description unit 133b, a feature matching unit 133c, and a dynamic matching search unit 133d, referring to FIG. Can be.

The skeletal information extracting unit 133a extracts a skeletal information sequence composed of position information of each joint through skeletal extraction of a body from a search target choreography of a video file and a camera photographed image input by the user. The feature description unit 133b extracts a feature descriptor that specifies a pose of the search choreography target based on the skeletal information sequence. The feature matching unit 133c compares and matches the feature descriptor with the motion capture data stored in the choreography operation DB 110 and outputs a matching distance matrix. The dynamic matching search unit 133d calculates a similarity degree between the search target choreography and the motion capture data based on the matching distance matrix.

The choreography attribute search module 134 performs a search based on the similarity determination in the choreography attribute DB 120 when the choreography attribute search is input from the user.

Choreography attribute search module is a module that searches the choreography attribute DB for attributes similar to the input attribute query sheet and audio file and outputs similar attribute choreography list sorted by attribute similarity. The method of extracting the information included in the aforementioned attribute query sheet is as follows.

1) the speed of choreography

: Calculate linear velocity of each joint in biomechanical kinematic information

2) the power of choreography

: Calculate the amount of ground reaction force and moment in biomechanical kinematic information

3) Flexibility of choreography

: Calculation of the shape and angular velocity / angular acceleration of each joint in biomechanical kinematic information

4) complexity of choreography

Calculation of Complexity and Motion Repeatability of Each Joint in Biomechanical Kinematic Information

5) Space utilization of choreography

: Volume calculation of space based on the trajectory of each joint among biomechanical kinematic information

6) Difficulty of Choreography

: Calculation of relative position and biomechanical energy consumption of each joint based on body model

7) concentrated areas of choreography (upper body, torso, lower body, whole body)

: Calculate the velocity / trajectory of each joint in the relative biomechanical kinematics

The output unit 140 displays the choreography data of the choreography operation DB 110 and the choreography attribute DB 120 retrieved based on the similarity determined by the search unit to the user. The output unit 140 may provide a user with a omnidirectional viewing function for the choreography data through an input device. In addition, the output unit 140 may display biomechanical information with different colors for each level in the choreography data. Referring to FIG. 4, the screen displayed by the output unit 140 may display the input section motion search and the choreography attribute search on one side, and the choreograph list searched on the other side may be displayed in the order of similarity. . Referring to FIG. 5, an example in which a particular choreography is represented by the output unit 140 is illustrated. The biomechanical data information window 10 may be displayed on one side. The biomechanical data information window 10 is a window that converts and displays biomechanical data information configured in a tabular form, and may display angular velocity, linear velocity, and heart rate for each body part. The screen may include a color guide 20 for each biomechanical data level, a first part display unit 30, and a second part display unit 40. Although the color guide 20 for each biomechanical data level is expressed in black and white light and shade in FIG. 5, it is a guide bar for grasping biomechanical data for each part as color. For example, the guide bar may be configured to represent a high value in red color and a low value in green color. As an example of the first site display unit 30, an arm is represented. According to the movement of the arm, it is possible to give a trail effect by using the biomechanical information of the corresponding frame, to express the corresponding data in color, and the actual biomechanical information can be expressed together with the numerical value. In FIG. 5, the foot is represented as an example of the second site display unit 40. According to the movement of the foot, a circular particle effect can be given using the biomechanical information of the corresponding frame, the corresponding data can be expressed in color, and the actual biomechanical information can be expressed together with the numerical value.

Hereinafter, a choreographing method according to an embodiment of the present invention will be described.

6 is a flowchart for explaining a choreography conception method according to an embodiment of the present invention. 7 is a flowchart for explaining in detail the step of searching in the choreography conception method according to an embodiment of the present invention. 8 is a flowchart for explaining in detail the step of searching in the choreography operation DB in the choreography conception method according to an embodiment of the present invention.

Referring to FIG. 6, in the choreography planning method according to an embodiment of the present invention, first, motion capture data for each of the plurality of choreography operations is stored in the choreography operation DB (S100).

The biomechanical information for each of the plurality of choreography operations is stored in the choreography attribute DB (S200). In this case, the biomechanical information may be at least one of kinematic information, kinematic information and energy consumption. Kinematics information is information about the body position and movement may be composed of the angle information of each joint. Kinematic information is information about the force affecting the movement of the body may include ground reaction force and moment information. The energy consumption is data estimated based on the heart rate measured by the heart rate measuring device and the muscle expression amount, which is a biosignal extracted from the EMG sensor, and may be information on total energy consumption and energy consumption by body parts.

Then, the user receives input of the search target choreography by at least one method of section motion search and choreography attribute search (S300). In this case, the section motion search is a search based on at least one of a video file and a camera photographed image input by the user, and the choreography attribute search is based on at least one of a query for an attribute of a choreography and an audio file. May be a search. The choreography attribute search may consist of a query for at least one of the speed, power, flexibility, complexity, space utilization, difficulty, and concentration of the choreography operation from the user. In addition, when the search target choreography is input by the section motion search and the choreography attribute search, it may be configured to give weights to the section motion search and the choreography attribute search when determining similarity.

Thereafter, a search is performed based on the similarity determination in the choreography operation DB and the choreography attribute DB (S400). In step S400, when the search target choreography is input to the section motion search from the user in step S300, the similar motion search step (S410) and the user in step S300 performs a search based on the similarity determination in the choreography motion DB. When the search target choreography is input to the choreography attribute search from the, the choreography attribute search step (S420) for performing a search based on the similarity determination in the choreography attribute DB.

At this time, step S410, the step of extracting the skeleton information sequence consisting of the position information of each joint through the extraction of the skeleton of the body from the search target choreography of the video file and the camera-photographed image input by the user (S411), the skeleton Extracting a feature descriptor specifying a posture of the search choreography target based on the information sequence (S412), comparing the feature descriptor with the motion capture data stored in the choreography motion DB, and outputting a matching distance matrix; And calculating a similarity degree between the search target choreography and the motion capture data based on the matching distance matrix (S414).

After step S400, the choreography operation DB and the choreography data of the choreography attribute DB retrieved based on the similarity determined in step S400 may be displayed to the user (S500). In operation S500, an omnidirectional viewing function for the choreography data may be provided to the user. In operation S500, the biomechanical information may be displayed with different colors for each level in the choreography data.

The choreography planning support method according to the present invention can be implemented in the form of program instructions that can be executed by various computer means can be recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and any type of hardware device specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The teachings of the present principles can be implemented as a combination of hardware and software. In addition, the software may be implemented as an application program that is actually implemented on the program storage unit. The application can be uploaded to and executed by a machine that includes any suitable architecture. Preferably, the machine may be implemented on a computer platform having hardware such as one or more central processing units (CPU), computer processor, random access memory (RAM), and input / output (I / O) interfaces. . In addition, the computer platform may include an operating system and micro instruction code. The various processes and functions described herein may be part of micro instruction code or part of an application program, or any combination thereof, and they may be executed by various processing apparatus including a CPU. In addition, various other peripheral devices such as additional data storage and printers may be connected to the computer platform.

Since some of the configuration system components and methods shown in the accompanying drawings are preferably implemented in software, the actual connections between the system components or process functional blocks may vary depending on how the principles of the invention are programmed. It should be further understood. Given the teachings herein, one of ordinary skill in the pertinent art will be able to contemplate these and similar implementations or configurations of the present principles.

As described above, the apparatus and method for supporting choreographing according to the present invention is not limited to the configuration and method of the embodiments described as described above, but the embodiments may be modified in various ways so that various modifications can be made. All or part may be optionally combined.

100; Choreography Concept Support Device
110; Choreography Move DB
120; Choreography Attribute DB
130; Search
131; Search UI section
132; Input UI part
133; Similar Action Search Module
134; Choreography Attribute Search Module
140; Output

Claims (20)

A choreography operation DB for storing motion capture data for each of the plurality of choreography operations;
Choreography attribute DB for storing biomechanical information for each of the plurality of choreographed movements;
Receives a choreography to be searched by at least one of section motion search and choreography attribute search from a user, and searches based on the similarity determination in the choreography motion DB and the choreography attribute DB; A search unit for performing the similarity determination by weighting the section motion search and the choreography attribute search when the search target choreography is input; And
Choreographed data of the choreography operation DB and the choreography attribute DB retrieved based on the similarity determined by the search unit to the user, and if the weight is given to the choreograph data of the choreography operation DB and choreography of the choreography attribute DB And an output unit for displaying the choreography data of the DB, which has a higher weight among the data, to be located above the search result list.
The choreography attribute search device is choreographed visual support device, characterized in that made of a query for at least one of the speed, power, flexibility, complexity, space utilization, difficulty, and concentration of the choreography operation from the user.
The method according to claim 1,
The section motion search is a search based on at least one of a video file and a camera photographed image input by the user, and the choreography attribute search is a search based on at least one of a query for an attribute of a choreography and an audio file. Choreography concept supporting device,
The method according to claim 2,
The search unit,
A similar motion search module for performing a search based on a similarity determination in the choreography motion DB when the search target choreography is input from the user to the interval motion search; And
Choreography attribute support device comprising a choreography attribute search module for performing a search based on the similarity determination in the choreography attribute DB, if the search target choreography input from the user to the choreography attribute search.
The method according to claim 3,
The similar motion search module,
A skeletal information extracting unit for extracting a skeletal information sequence composed of position information of each joint through skeletal extraction of a body from a search target choreography of a video file and a camera photographed image input by the user;
A feature description unit for extracting a feature descriptor specifying a posture of the search target choreography based on the skeletal information sequence;
A feature matching unit for comparing and matching the feature descriptor with the motion capture data stored in the choreography motion DB to output a matching distance matrix; And
And a dynamic matching search unit for calculating a similarity between the search target choreography and the motion capture data based on the matching distance matrix.
delete The method according to claim 1,
The biomechanical information is choreotropic visualization support device, characterized in that at least one of the information kinematics, kinetics and energy consumption information.
The method according to claim 6,
The kinematics information is information on the body position and movement is composed of the angle information of each joint, the kinematics information includes the ground reaction and the moment information as the information on the force affecting the body movement, the energy consumption Is a data estimated based on the heart rate measured by the heart rate measurement device and the muscle expression amount, which is a biosignal extracted from the EMG sensor, and is a total energy consumption and energy consumption information for each body part.
delete The method according to claim 1,
The output unit,
A choreography planning apparatus, characterized in that for providing the omnidirectional viewing function for the choreograph data through the input device to the user.
The method according to claim 1,
The output unit,
The choreography concept support apparatus, characterized in that for displaying the biomechanical information in different colors for each level.
Storing motion capture data for each of the plurality of choreography operations in a choreography operation DB;
Storing biomechanical information for each of the plurality of choreography operations in a choreography attribute DB;
Receiving a search target choreography from at least one method of section motion search and choreography attribute search from a user;
The choreography motion DB and the choreography attribute DB are searched based on the similarity judgment, and when the search target choreography is input through the segment motion search and the choreography attribute search, weights are applied to the segment motion search and the choreography attribute search, respectively. Performing the similarity determination; And
And displaying choreography data of the choreography operation DB and the choreography attribute DB retrieved based on the determined similarity to the user,
The displaying step,
When the weight is assigned, the choreograph data of the searched choreography operation DB and the choreography data of the choreography attribute DB are displayed such that the choreograph data of the DB with a higher weight is positioned above the search result list,
The choreography attribute search method is choreographed support method, characterized in that made by the user to query at least one of the speed, power, flexibility, complexity, space utilization, difficulty, and concentration of the choreography operation.
delete delete delete delete delete delete delete delete delete
KR1020160002743A 2015-09-14 2016-01-08 Apparatus and method for designing choreography KR102013577B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/059,946 US20170076629A1 (en) 2015-09-14 2016-03-03 Apparatus and method for supporting choreography

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20150129618 2015-09-14
KR1020150129618 2015-09-14

Publications (2)

Publication Number Publication Date
KR20170032146A KR20170032146A (en) 2017-03-22
KR102013577B1 true KR102013577B1 (en) 2019-08-23

Family

ID=58497246

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160002743A KR102013577B1 (en) 2015-09-14 2016-01-08 Apparatus and method for designing choreography

Country Status (1)

Country Link
KR (1) KR102013577B1 (en)

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210109846A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography content
KR20210109822A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing supplementary services based on choreography content
KR20210109828A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing supplementary services based on choreography content
KR20210109848A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography content
KR20210109841A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing supplementary services based on choreography content
KR20210109821A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Method
KR20210109825A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Medium
KR20210109829A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Medium
KR20210109837A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing supplementary services based on choreography content
KR20210109849A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing choreography content service
KR20210109843A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing supplementary services based on choreography content
KR20210109850A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210109836A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing choreography content service
KR20210109840A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography content
KR20210109832A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing supplementary services based on choreography content
KR20210109833A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Medium
KR20210120625A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120606A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120623A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120598A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120600A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120592A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120643A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing choreography content service
KR20210120596A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120617A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus or providing supplementary services based on choreography contents
KR20210120653A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing choreography content service
KR20210120632A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120639A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210120591A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120638A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210120636A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120640A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210120616A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus or providing supplementary services based on choreography contents
KR20210120595A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120648A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing choreography content service
KR20210120634A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120613A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus or providing supplementary services based on choreography contents
KR20210120607A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120590A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20220027402A (en) * 2020-08-27 2022-03-08 유중경 Exercise system for providing revenue through exercise
KR20230146829A (en) 2022-04-13 2023-10-20 공주대학교 산학협력단 System and method for providing choreography creation platform service

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022050739A1 (en) * 2020-09-03 2022-03-10 장은주 Method for making coordinate choreography video by using coordinate/coordinate moving average line, and method for searching for choreography/choreography plagiarism/choreography copyright by using same
CN115712739B (en) * 2022-11-17 2024-03-26 腾讯音乐娱乐科技(深圳)有限公司 Dance motion generation method, computer device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120143358A1 (en) * 2009-10-27 2012-06-07 Harmonix Music Systems, Inc. Movement based recognition and evaluation
US20140278218A1 (en) * 2013-03-15 2014-09-18 Dc Shoes, Inc. Capturing and Analyzing Boardsport Maneuver Data
US20150099252A1 (en) * 2013-10-03 2015-04-09 Autodesk, Inc. Enhancing movement training with an augmented reality mirror

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120143358A1 (en) * 2009-10-27 2012-06-07 Harmonix Music Systems, Inc. Movement based recognition and evaluation
US20140278218A1 (en) * 2013-03-15 2014-09-18 Dc Shoes, Inc. Capturing and Analyzing Boardsport Maneuver Data
US20150099252A1 (en) * 2013-10-03 2015-04-09 Autodesk, Inc. Enhancing movement training with an augmented reality mirror

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210109846A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography content
KR20210109822A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing supplementary services based on choreography content
KR20210109828A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing supplementary services based on choreography content
KR20210109848A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography content
KR20210109841A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing supplementary services based on choreography content
KR20210109821A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Method
KR20210109825A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Medium
KR20210109829A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Medium
KR20210109837A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing supplementary services based on choreography content
KR20210109849A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing choreography content service
KR20210109843A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Method for providing supplementary services based on choreography content
KR20210109850A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210109836A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing choreography content service
KR20210109840A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography content
KR20210109832A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Program for providing supplementary services based on choreography content
KR20210109833A (en) 2020-02-28 2021-09-07 주식회사 안무공장 Recording Medium
KR20210120625A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120606A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120623A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120598A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120600A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120592A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120643A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing choreography content service
KR20210120596A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120617A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus or providing supplementary services based on choreography contents
KR20210120653A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing choreography content service
KR20210120632A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120639A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210120591A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120638A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210120636A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120640A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing choreography content service
KR20210120616A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus or providing supplementary services based on choreography contents
KR20210120595A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120648A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing choreography content service
KR20210120634A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus for providing supplementary services based on choreography contents
KR20210120613A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Apparatus or providing supplementary services based on choreography contents
KR20210120607A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20210120590A (en) 2020-03-27 2021-10-07 주식회사 안무공장 Method for providing supplementary services based on choreography contents
KR20220027402A (en) * 2020-08-27 2022-03-08 유중경 Exercise system for providing revenue through exercise
KR102428457B1 (en) * 2020-08-27 2022-08-01 유중경 Exercise system for providing revenue through exercise
KR20230146829A (en) 2022-04-13 2023-10-20 공주대학교 산학협력단 System and method for providing choreography creation platform service

Also Published As

Publication number Publication date
KR20170032146A (en) 2017-03-22

Similar Documents

Publication Publication Date Title
KR102013577B1 (en) Apparatus and method for designing choreography
CN105830092B (en) For digit synthesis and/or the system of retrieval, method and apparatus
CN106355153B (en) A kind of virtual objects display methods, device and system based on augmented reality
US20170076629A1 (en) Apparatus and method for supporting choreography
CN104508709B (en) Animation is carried out to object using human body
CN102915112B (en) For the system and method for closely motion tracking
KR101919831B1 (en) Object Recognition Apparatus, Classification Tree Learning Apparatus and Method thereof
CN100407798C (en) Three-dimensional geometric mode building system and method
Gourgari et al. Thetis: Three dimensional tennis shots a human action dataset
CN103503030A (en) Image processing device for specifying depth of object present in real space by performing image processing, stereoscopic viewing device, integrated circuit, and program
KR101902192B1 (en) Method for searching similar choreography based on three dimensions and apparatus using the same
JP2017534940A (en) System and method for reproducing an object in a 3D scene
CN106951561A (en) Electronic map system based on virtual reality technology and GIS data
Inamoto et al. Intermediate view generation of soccer scene from multiple videos
Laielli et al. Labelar: a spatial guidance interface for fast computer vision image collection
CN103413018B (en) Method for providing dynamic exercise content
Calvert Approaches to the representation of human movement: notation, animation and motion capture
TWI361093B (en) Measuring object contour method and measuring object contour apparatus
Wang et al. Using automatic generation of Labanotation to protect folk dance
US11908058B2 (en) Character animations in a virtual environment based on reconstructed three-dimensional motion data
KR101861096B1 (en) Method and apparatus for controlling information displayed on screen by recognizing hand gesture of user
Putro et al. Development of Application Based on Augmented Reality as A Learning of History and Culture in Architecture Case Study Pathok Negoro Mosques Yogyakarta
Pantuwong A tangible interface for 3D character animation using augmented reality technology
JP5210401B2 (en) Efficient styling of motion databases based on examples
Andriluka et al. Benchmark datasets for pose estimation and tracking

Legal Events

Date Code Title Description
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment
X701 Decision to grant (after re-examination)
GRNT Written decision to grant