KR20120102275A - Virtual service system for hair and method thereof, and device supporting the same - Google Patents

Virtual service system for hair and method thereof, and device supporting the same Download PDF

Info

Publication number
KR20120102275A
KR20120102275A KR1020110020305A KR20110020305A KR20120102275A KR 20120102275 A KR20120102275 A KR 20120102275A KR 1020110020305 A KR1020110020305 A KR 1020110020305A KR 20110020305 A KR20110020305 A KR 20110020305A KR 20120102275 A KR20120102275 A KR 20120102275A
Authority
KR
South Korea
Prior art keywords
hair
user
model data
terminal
image
Prior art date
Application number
KR1020110020305A
Other languages
Korean (ko)
Inventor
나승원
Original Assignee
에스케이플래닛 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 에스케이플래닛 주식회사 filed Critical 에스케이플래닛 주식회사
Priority to KR1020110020305A priority Critical patent/KR20120102275A/en
Publication of KR20120102275A publication Critical patent/KR20120102275A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/16Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

PURPOSE: A system for a virtual hair application service and a method thereof, and a supporting terminal are provided to easily apply various hair objects to a 3D model and generate the 3D model based on a head of a user, thereby observing a virtual hair object application of various angles. CONSTITUTION: A connection device(301) receives a user image from a terminal, and transmits 3D model data corresponding to the user image and a hair object to the terminal. A 3D model generation device(305) transmits to the connection device by generating the 3D model data for the user based on the user image. A hair object support device(303) provides the hair object of a 3D type applying the 3D model data to the connection device. [Reference numerals] (200) Network; (300) Virtual hair applying device; (301) Connection device; (303) Hair object support device; (305) 3D model generation device

Description

Virtual hair service system and method and a terminal supporting the same {Virtual Service System For Hair and Method about, and Device supporting the same}

The present invention relates to a virtual hair applying service, and in particular, to perform a 3D rendering of the user's head (face and hair) to generate a 3D model, to apply a specific hair object to the 3D model, as well as to the rotation of the head Accordingly, the present invention relates to a virtual hair applying service system and method for supporting a reference to a specific hairstyle from various angles by rotating a 3D model and a hair object, and a terminal supporting the same.

Recently, thanks to the remarkable development of information and communication technology and semiconductor technology, the spread and use of portable terminals is increasing rapidly. In particular, recent portable terminals have reached the stage of mobile convergence that encompasses the range of other terminals instead of staying in their own traditional areas. In the case of a mobile communication terminal, in addition to general communication functions such as voice call and message transmission and reception, a TV viewing function (for example, a mobile broadcast such as Digital Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)) and a music playback function (for example, MP3 (MPEG Audio Layer-3), picture taking function, Internet connection, and other features are being added.

Meanwhile, due to the development and expansion of communication networks, the Internet population is rapidly increasing, and with the growth of the Internet, various contents including e-commerce, portals, and the like are appearing. In addition, recently, the boundary between the online and offline domains has been broken, replacing the existing offline service with an online service. As the standard of living improves, the quality of life and personality are becoming more important, and the desire and interest in the management of hairstyles is greatly increased.

However, in the real life, the choice or management of hair style is not systematic and inconvenient, so it goes through many difficulties and trial and error in selecting and maintaining the hairstyle that suits oneself. In fact, it was difficult to identify the hairstyle that suits you before the hairdressing process because the hair salon user selects his hairstyle through a magazine provided by a beauty association or a photograph of a popular celebrity or decides his own hairstyle through the advice of a hairdresser. . In addition, even if you find a hair style that suits you, there is a problem that it is difficult to maintain the desired hairstyle when changing the hair salon or hairdresser because there is a difference in hairdressing methods and techniques according to the hairdresser.

In order to improve this problem, some hair shops have introduced a technology that captures the face of a customer who visits a hair shop with a digital camera, and inputs the image data into a computer. There was a simulation system that matched the hairstyle to the customer's face image.

However, the conventional simulation system for providing a hairstyle has a disadvantage in that it does not provide accurate information on the shape of the overall hairstyle of the user because it provides only information on the hairstyle in the front based on the 2D image.

Therefore, the present invention was devised to solve the above-mentioned problems of the prior art, and an object of the present invention is to apply a 3D-based virtual hair to support a virtual application of a specific hair object based on a 3D model related to a user. A service system and method and a terminal supporting the same are provided.

In addition, an object of the present invention is to support the user to store and provide the user information on the virtual hair applying device so that the user can apply a variety of hairstyles to the user's desired 3D model at the desired place or time regardless of a specific hair salon The present invention provides a 3D-based virtual hair application service system and method, and a terminal supporting the same.

As a means for solving the above problems, the virtual hair applying service system according to a preferred embodiment of the present invention, collects the image of the user including the face, and transmits the collected image to the virtual hair applying apparatus, Receive and output the 3D model data generated from the user's image as a 3D model and at least one hair object of the 3D type to be applied to the 3D model data from the virtual hair applying apparatus, combining the 3D model data and one hair object, A terminal for controlling the output surface of the hair object applied to the 3D model data and the 3D model data according to a user's movement; And a virtual hair applying device that receives the user's image from the terminal, generates 3D model data for the user, and transmits at least one hair object to be applied to the 3D model data and the generated 3D model data to the terminal. Is done.

In addition, the virtual hair applying apparatus according to an embodiment of the present invention, a connection device for receiving an image of the user from the terminal, and transmits 3D model data and at least one hair object corresponding to the image of the user to the terminal; A 3D model generation device generating 3D model data of the corresponding user based on the received image of the user, and transmitting the generated 3D model data to the access device; And a hair object support device providing the connection device with at least one hair object of a 3D type to be applied to the 3D model data as the connection device.

In the virtual hair applying apparatus according to the preferred embodiment of the present invention, the connection device may store and manage 3D model data delivered by the 3D model generating apparatus and at least one hair object delivered by the hair object support apparatus.

In the virtual hair applying apparatus according to the preferred embodiment of the present invention, the hair object support apparatus may provide a terminal with a web page on which an image related to at least one hair object is disposed.

In the virtual hair applying apparatus according to the preferred embodiment of the present invention, when the terminal changes the hair object, the hair object supporting apparatus may receive the changed hair object and register it as a new hair object.

In the apparatus for applying a virtual hair according to the preferred embodiment of the present invention, the hair object supporting apparatus receives the motion information of the user from the terminal, determines the output surface of the hair object based on the received motion information, and determines the determined hair object. Data corresponding to the output surface of the terminal may be provided.

In the apparatus for applying a virtual hair according to the preferred embodiment of the present invention, when the 3D model generating apparatus receives the motion information of the user from the terminal, the output surface of the 3D model data is determined based on the received motion information. Data corresponding to the output surface of the determined 3D model data may be provided to the terminal.

In the apparatus for applying a virtual hair according to an exemplary embodiment of the present invention, at least one of a connection device, a hair object support device, and a 3D model generation device may be implemented as one or more servers operating on a cloud computing basis.

In addition, as another means for solving the above problems, the terminal according to an embodiment of the present invention, the camera for collecting the user's image; Generates 3D model data corresponding to the user based on the collected user's image, controls to apply and output the hair object to the generated 3D model data, and outputs the 3D model data and the output surface of the hair object according to the user's movement A control unit for controlling; And a display unit configured to output a screen to which the hair object is applied to the 3D model data under the control of the controller.

In the terminal according to an embodiment of the present invention, the control unit, 3D model generation unit for generating 3D model data based on the user's image; 3D model reproducing unit for outputting 3D model data to the display unit; And a hair object processing unit which applies the hair object to the 3D model data and outputs it to the display unit.

In the terminal according to an exemplary embodiment of the present invention, the controller further includes an image analyzer extracting a reference value by recognizing a face from the image of the user and extracting motion information of the user based on a change of the extracted reference value. The 3D model reproducing unit and the hair object processing unit may change and output the output surfaces of the 3D model data and the hair object output when the motion information is received from the image analyzer to correspond to the motion information.

The terminal according to an exemplary embodiment of the present invention may further include a storage unit for storing 3D model data and at least one hair object of 3D type to be applied to the 3D model data under the control of the controller.

According to an embodiment of the present invention, the terminal further includes a communication unit forming a communication channel with the hair object support apparatus, wherein the control unit is at least one of a 3D type to be applied to user-related 3D model data or 3D model data through the communication unit. The hair object may be received from the hair object support device.

In addition, as another means for solving the above problems, a virtual hair applying service method according to a preferred embodiment of the present invention, the terminal, collecting a user image including a face and hair; Generating 3D model data based on the collected user image; Applying a 3D type specific hair object to the 3D model data; Outputting 3D model data to which a hair object is applied; And changing the output surface of the 3D model data and the hair object according to the user's movement by extracting the user's movement by performing face recognition based on the image.

In the virtual hair applying service method according to an embodiment of the present invention, the collecting step is characterized in that the collecting of the image of the user photographed from at least two angles.

In the virtual hair application service method according to an embodiment of the present invention, outputting a plurality of 3D type hair object to be applied to the 3D model data to receive a selection of one hair object; the application step, the application step, And applying the hair object to the 3D model data.

In the virtual hair application service method according to an embodiment of the present invention, the changing step may include extracting a reference value according to face recognition; And confirming a user's movement in at least one direction of a certain direction according to the change of the extracted reference value.

In the virtual hair application service method according to an embodiment of the present invention, the changing step includes the steps of rotating the direction, angle and distance of the hair object according to the direction and angle and distance moved by the user; And rotating the direction, angle, and distance of the 3D model data according to the direction, angle, and distance the user moves.

According to an aspect of the present invention, there is provided a virtual hair applying service method, including: editing a hair object according to user control; And receiving a hair object from an external device. The method may further include at least one step.

In addition, as another means for solving the above problems, a virtual hair applying service method according to an embodiment of the present invention, the terminal, collecting at least one user image; Transmitting the collected at least one user image to the virtual hair applying apparatus; Receiving a 3D type hair object to be applied to the 3D model data and the 3D model data generated based on the image collected from the virtual hair applying apparatus; And extracting motion information of the user and adjusting and outputting the received 3D model data and the output surface of the hair object according to the motion information.

In addition, as another means for solving the above problems, a virtual hair applying service method according to a preferred embodiment of the present invention, the virtual hair applying apparatus, receiving at least one user image from the terminal; Generating 3D model data corresponding to a user based on the received user image; And transmitting the hair object to be applied to the 3D model data and the 3D model data to the terminal.

The present invention also provides a computer readable recording medium having recorded thereon a program for executing the above-described method for applying a virtual hair application service.

As described above, according to the virtual hair applying service system and method and a terminal supporting the same, the present invention generates a 3D model based on the head of the user, and various hair objects on the 3D model. It allows you to easily apply and to observe the application of a virtual hair object from various angles by rotating the 3D model and hair object according to the head rotation.

In addition, the present invention provides a 3D model-based virtual hair application service, so that time and space can be viewed more accurately and more accurately from a variety of hairstyles that best suits the user's current state at any point in time and environment. It can help you meet your needs.

1 is a view schematically showing the configuration of a 3D-based virtual hair application service system according to an embodiment of the present invention.
2 is a view showing in more detail the configuration of a terminal according to an embodiment of the present invention.
3 is a view showing in more detail the control unit of the terminal configuration of the present invention.
4 is a flowchart illustrating a 3D-based virtual hair application method of the terminal according to an embodiment of the present invention.
5 is a diagram illustrating a signal flow between components according to a 3D-based virtual hair application method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference numerals as possible. Further, the detailed description of known functions and configurations that may obscure the gist of the present invention will be omitted.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of the present invention in order to facilitate the understanding of the present invention and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

1 is a diagram schematically showing the configuration of a 3D-based virtual hair application service system according to an embodiment of the present invention.

Referring to FIG. 1, a virtual hair applying service system 10 according to an exemplary embodiment of the present invention includes a configuration of a terminal 100 and a virtual hair applying apparatus 300, and the terminal 100 and the virtual hair applying apparatus. 300 is connected via the network 200.

The virtual hair applying service system 10 of the present invention having such a configuration collects an image of at least one side of a specific part of the user 50, for example, the head of the user 50, by using the terminal 100. The collected tofu images are provided to the virtual hair applying apparatus 300 through the network 200. Then, the virtual hair applying apparatus 300 may generate a 3D model based on the head image, and may transmit the hair object 153 of various styles to be applied to the 3D model to the terminal 100 along with the 3D model data. . The terminal 100 synthesizes and outputs the 3D model and the hair object 153 delivered by the virtual hair applying apparatus 300 so that the user can check which hair object 153 fits well and the 3D model according to the head rotation. And by rotating the hair object 153, the application state of the hair object 153 can be observed from various angles. Hereinafter, each configuration of the virtual hair applying service system 10 will be described in more detail.

The user 50 may be a head including a face and a head of a human body having eyes, a nose, and a mouth as reference values. The user 50 may be disposed spaced apart from the camera 170 mounted on the terminal 100 under a user's control, and the image may be at least one angle to the head of the user under the control of the camera 170. You can shoot. In addition, the user 50 may rotate a predetermined angle, for example, a predetermined angle in the left and right directions and a predetermined angle in the vertical direction, under the control of the user.

The terminal 100 collects an image of the user 50 for generating a 3D model using the mounted camera 170, and transfers the collected image to the virtual hair applying apparatus 300 or analyzes the output to the display unit. You can collect data. In particular, the terminal 100 may receive 3D model data from the virtual hair applying apparatus 300 by collecting images from various angles of the user 50 using the camera 170 and transferring the images to the virtual hair applying apparatus 300. Can be. In addition, the terminal 100 may support to apply and output the hair object 153 when the 3D model is output after downloading the hair object 153 of various styles from the virtual hair applying apparatus 300 supporting the virtual hair application of the present invention. Can be. At this time, the terminal 100 maintains the activation of the camera 170 and calculates the rotation angle of the user 50 by using a reference value, for example, eyes, nose, mouth, or ear, through face recognition of the user 50. In addition, the 3D model and the hair object 153 may be rotated and output according to the calculated angle. Accordingly, the terminal 100 allows the user to observe how the hair object 153 is applied from various angles so that the user can search for the hair object 153 having the most appropriate form. The application of the virtual hair of the terminal 100 will be described in more detail with reference to FIGS. 2 and 3. As the terminal 100, the mobile terminal has been exemplified in the present embodiment, but the present invention is not limited thereto. For example, the terminal 100 includes all mobile communication terminals operating based on communication protocols corresponding to various communication systems, including a portable multimedia player (PMP), a digital broadcasting player, and a PDA. (Personal Digital Assistant), music player (e.g. MP3 player), mobile game terminal, smart phone, notebook, PC and handheld PC, all information communication devices and multimedia devices and applications thereof It may include.

The network 200 enables communication between the terminal 100 and the virtual hair applying apparatus 300 by forming a communication channel with the terminal 100. The network 200 is, for example, an IP network that provides a data transmission / reception service and a disconnected data service through an internet protocol (IP), which is an IP network structure integrating different networks based on IP. 3G mobile network including all IP network, wired network, Wibro (Wireless Broadband) network, WCDMA, High Speed Downlink Packet Access (HSDPA) network and LTE network, 3.5G mobile network including LTE network, 4G mobile including LTE advanced It may include at least one of a wireless LAN including a communication network, a satellite communication network and a Wi-Fi network.

The virtual hair applying apparatus 300 supports a 3D-based virtual hair applying service requested by the terminal 100. The virtual hair application device 300 may include a connection device 301, a hair object support device 303, and a 3D model generation device 305 to support virtual hair application.

The access device 301 is connected to the network 200 and performs data transmission and reception with the terminal 100, storage and history management of the data to support the virtual hair application. In addition, the connection device 301 may transfer the data received from the terminal 100 to the 3D model generation device 305 and the hair object support device 303. In more detail, when the terminal 100 attempts to access the connection device 301, the access device 301 may check whether the corresponding terminal 100 is a virtual hair application service subscriber through verification of authentication information. When the terminal 100 is a valid terminal, the access device 301 may transmit an image transmitted from the terminal 100 to the 3D model generating apparatus 305 and the hair object support apparatus 303. In addition, the connection device 301 may transmit the 3D model data delivered by the 3D model generation device 305 and at least one hair object 153 delivered by the hair object support device 303 to the terminal 100. In this case, the access device 301 may store 3D model data transmitted to the terminal 100, and may store specific object information selected by the terminal 100. And when the terminal 100 is connected later, the access device 301 may control to transmit previously stored 3D model data to the terminal 100 without generating new 3D model data. In addition, the connection device 301 may preferentially transmit the hair object 153 of the hairstyle similar to the hair object 153 selected by the user of the previous terminal 100 to the terminal 100 with respect to the hair object 153. Can support

The hair object supporting apparatus 303 classifies and stores various hair objects 153 and provides specific hair objects 153 requested by the terminal 100 through the connection device 301. To this end, the hair object supporting apparatus 303 may provide the terminal 100 with a web page for viewing various hair objects 153. The hair object support apparatus 303 may also support not only the hair object 153 support but also the editing function of the provided hair object 153 on the web. When the specific hair object 153 is changed to a predetermined value or more by the terminal 100, the hair object supporting apparatus 303 may support to automatically register the changed hair object 153 as a new style hair object 153. Can be. The hair object support apparatus 303 may include a database for storing the hair object 153 of various styles updated by the manager.

The 3D model generating apparatus 305 is a component that generates a 3D model based on an image related to the user 50 transmitted by the terminal 100 through the access device 301. The 3D model generating apparatus 305 may extract depth information from an image related to the user 50, and may perform 3D modeling of the captured image based on the depth information. To this end, the 3D model generating apparatus 305 may store various algorithms for 3D rendering support, and may perform 3D modeling of a user image by applying each algorithm. The 3D model generating apparatus 305 may request a user image of various angles from the terminal 100 for 3D modeling of the user 50. Can be created with Depth information extraction may be obtained through the contrast information of the corresponding image or may be obtained from the terminal 100 when the camera 170 of the terminal 100 has a function of collecting depth information. The 3D model data generated by the 3D model generating apparatus 305 may be temporarily stored in the access device 301, and may be transferred to the terminal 100 through the access device 301.

Meanwhile, in the above description, the terminal 100 stores and outputs the 3D model data while controlling the change of the 3D model data and the hair object 153 based on the user's movement, but the present invention is not limited thereto. That is, the 3D model data may be received and output from the virtual hair applying apparatus 300, in particular, the 3D model generating apparatus 305 in real time. Accordingly, the terminal 100 may transmit the reference value change information of the user to the 3D model generator 305, and the 3D model generator 305 may transmit the 3D model data based on the reference value change received from the terminal 100. One side of the output can be determined. That is, the 3D model generating apparatus 305 rotates the 3D model data by applying the change of movement of the user 50 to the 3D model data according to the change of the reference value, and provides the terminal 100 with information about the rotated surface and outputs it. Can support Similarly, the hair object supporting apparatus 303 also receives motion information corresponding to a reference value change according to face recognition of the user 50 from the terminal 100 and outputs the hair object 153 output to the terminal 100. The output surface according to the rotation may be determined, and data about the determined output surface may be provided to the terminal 100. This structure may correspond to a case in which the terminal 100 is operated based on the virtual hair applying apparatus 300 without performing a separate data operation for screen configuration.

As described above, the virtual hair applying service system 10 of the present invention transfers the user-related image captured by the terminal 100 to the virtual hair applying apparatus 300 to apply 3D model data and various 3D models. It supports to receive and output the hair object 153. Accordingly, the virtual hair application service system 10 of the present invention can reduce the burden of the terminal 100 performing 3D model generation by allowing the virtual hair application apparatus 300 to process 3D model generation requiring a high-speed engine. In addition, the hair object 153 of various hairstyles may be received from the virtual hair applying apparatus 300 and may be applied to the 3D model. In particular, the virtual hair application service system 10 of the present invention detects the rotational angle of the head through the face recognition of the user 50 during the process of receiving and outputting the 3D model data by the terminal 100, the detected rotation angle Accordingly, the output direction of the 3D model may be determined and the rotation angle of the hair object 153 applied to the 3D model may be determined so that the user may observe the application state of the hair object 153 at various angles.

2 is a block diagram schematically showing the configuration of a terminal 100 according to an embodiment of the present invention.

Referring to FIG. 2, the terminal 100 of the present invention includes a communication unit 110, an input unit 120, an audio processor 130, a display unit 140, a storage unit 150, a camera 170, and a controller 160. It may include the configuration of.

The terminal 100 having the above-described configuration collects images of various angles with respect to the user 50 by operating the camera 170, and transfers the collected images to the virtual hair applying apparatus 300 through the network 200. do. The terminal 100 may receive the 3D model data and the at least one hair object 153 from the virtual hair applying apparatus 300 and output the corresponding data to the display unit 140. At this time, the terminal 100 detects a change in the reference value of the user 50 and adjusts the output angles of the 3D model and the hair object 153 according to the change in the reference value. Hereinafter, roles and functions of the components of the virtual hair application service supported by the terminal 100 of the present invention will be described in detail.

The communication unit 110 performs the formation of a communication channel for supporting a call function of the terminal 100 and the formation of a communication channel for data transmission under the control of the controller 160. That is, the communication unit 110 may form a voice call channel, a data communication channel, a video call channel, and the like with various devices through the network 200. In particular, the communication unit 110 forms a data communication channel with the virtual hair applying apparatus 300 through the network 200. In particular, the communication unit 110 according to the present invention may form a communication channel capable of transmitting at least one image data for the user 50 to the access device 301. In addition, the communication unit 110 may receive 3D model data and at least one hair object 153 from the virtual hair applying apparatus 300. The received data may be transferred to the controller 160.

The input unit 120 may receive numeric or various character information, and may include input keys and function keys for setting various functions and controlling functions of the terminal 100. In particular, the input unit 120 may include an input signal related to camera control for collecting an image of the user 50, an input signal for controlling the storage and transmission of at least one collected user image, and a connection device according to an embodiment of the present disclosure. A communication channel may be formed with the 301 and an input signal for receiving the 3D model data and the hair object 153 may be generated from the access device 301. Each input signal generated by the input unit 120 may be transferred to the controller 160 and may be converted into commands for performing a function corresponding to the input signal. The input unit 120 may include input devices such as a touch pad, a touch screen, a button keypad of a general key arrangement, a button keypad of a qwerty method, etc. according to the form of the terminal 100. It may be formed of any one or a combination thereof.

The audio processor 130 controls the speaker SPK and the microphone MIC in order to output various audio data generated during the operation of the terminal 100 and to collect audio data necessary for supporting the call function of the terminal 100. It may include. The audio processor 130 may output an effect sound necessary for the operation of the camera 170 through the speaker SPK, and output an effect sound related to the output of the 3D model and the hair object 153. The sound effect output function may be omitted according to a user's selection.

The display unit 140 displays information input by the user or information provided to the user, including various menus of the terminal 100. That is, the display unit 140 may provide various screens according to the use of the terminal 100, for example, a standby screen, a menu screen, a message writing screen, a call screen, and the like. In particular, the display unit 140 according to an exemplary embodiment of the present invention may output a screen related to the camera 170 that is activated to collect an image of the user 50, for example, a preview image output screen of the user 50. have. In addition, the display unit 140 may output a screen to which the 3D model generated based on the user image and the hair object 153 to be applied to the 3D model are applied. In addition, the 3D model and the hair object 153 output to the display unit 140 may be rotated at a predetermined angle according to the movement of the user, and the output surface may be changed. Here, the hair object 153 is a form applied to the 3D model and may also be data modeled using the same 3D type. The display unit 140 may be implemented by various display devices, for example, a liquid crystal display (LCD), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AMOLED), or the like. Can be. In particular, when the display unit 140 is formed as a touch screen, the functions of the display unit 140 and the input unit 120 may be combined.

The storage unit 150 is a means for storing various data and programs necessary for the operation of the terminal 100. The storage unit 150 includes an operating system (OS) of the terminal 100 and other option functions such as a sound reproduction function. , Application programs, user data, and data transmitted and received required for image or video playback functions. In particular, the storage unit 150 according to the present invention may store a camera control program supporting the user's image collection for the 3D modeling of the present invention, the 3D model data 151 received from the virtual hair applying apparatus 300 And hair object 153.

The camera control program collects at least one image of the user 50 based on the activated camera 170. The routine controls to activate the camera 170 when an input signal is generated for operating the virtual hair applying service of the present invention. It may include a photographing routine to control to control, and a transmission control routine to control to transmit the photographed user image to the virtual hair applying apparatus 300 through the communication unit 110. Here, the photographing routine may include subroutines that support image capturing of various angles with respect to the user 50 so as to generate appropriate 3D model data based on the corresponding image when capturing the image of the user 50. For example, the photographing routine may include a subroutine that controls image collection for the front of the user 50 and a subroutine that controls image collection for the right and left sides of the user 50. Here, the subroutines of the shooting routine may acquire reference values such as eyes, nose, mouth, etc. through face recognition, and guide the collection of images of the front, right, and left sides of the user 50 according to the change of the reference values. have. That is, when the distance between the reference values is within a certain value, the camera control program may recognize the user 50 in front of the user, and until the values corresponding to the right side or left side images of the face are collected, the reference faces are converted. A guide sound or a guide message for guiding rotation can be output to the display unit 140.

The 3D model data 151 stored in the storage 150 may be data generated and transmitted by the virtual hair applying apparatus 300. The 3D model data 151 may be newly received and updated from the virtual hair applying apparatus 300 whenever the image of the user 50 is transferred to the virtual hair applying apparatus 300. Since the face may change due to a change in the user's body, for example, an increase in weight or various shaping or accidents, it may be desirable to update the 3D model data 151 at regular intervals.

The hair object 153 may be data received and stored from the hair object support apparatus 303 of the virtual hair applying apparatus 300. The terminal 100 may provide a hair object editor, and the user may perform a simple style change or color change on the hair object 153 using the hair object 153 editor. The changed style of the hair object 153 may be stored in the storage unit 150 according to a user's request, and may be transmitted to the corresponding device at the request of the hair object supporting device 303.

The camera 170 captures an image of the user 50. The camera 170 may include an image sensor and an image processor. An image sensor is a sensor that converts a user into an electrical video signal. The image sensor may be a complementary metal oxide semiconductor (CMOS) type or a charge coupled device (CCD) type image sensor. The image processor is a device for processing and outputting an image input from an image sensor. That is, the image processing unit resizes the image input from the image sensor, moves between memories, converts RGB signals, converts A / D, removes noise, digital zooms, rotates, encodes, etc. The image processing function of the can be performed. In particular, the camera 170 according to an embodiment of the present invention may capture at least one image of the user 50. The captured image may be transmitted to the controller 160.

The controller 160 may control an overall operation of the terminal 100 and a signal flow between internal blocks of the terminal 100, and may perform a data processing function for processing data. In particular, the controller 160 according to the present invention may support a 3D virtual hair application service function based on the virtual hair application apparatus 300. In more detail, the controller 160 may control activation of the camera 170 when an input signal for selecting a menu for operating the virtual hair applying service is generated. To this end, the controller 160 may provide a menu including an item for operating a virtual hair application service through the display unit 140. After activating the camera 170, the controller 160 performs image capturing control on the user 50. In this case, the controller 160 may perform face recognition of the user 50 based on the collected user image and control to collect images of various angles necessary for proper 3D modeling based on the change of reference values. That is, the controller 160 recognizes the movement of the user 50 based on the change of the reference values, and guides the user to collect images of various angles such as the front and the side. When the image of the user 50 is collected, the controller 160 may control the image to be transmitted to the virtual hair applying apparatus 300 through the communication unit 110. The controller 160 receives and stores the 3D model data 151 related to the user 50 and at least one hair object 153 to be applied to the 3D model data 151 from the virtual hair applying apparatus 300. Can be stored at 150.

Meanwhile, the controller 160 controls to output the 3D model data 151 to the display unit 140, while at least one hair object 153 is placed at a predetermined position of the 3D model data 151, for example, a position where the hair is arranged. Control to apply and output. In this case, the controller 160 may control to apply the specific hair object 153 selected by the user to the 3D model data 151 by outputting multiple images of the various hair objects 153 to the display unit 140. The controller 160 may adjust the output size of the 3D model data 151 according to the distance between the user 50 and the camera 170. For example, the controller 160 controls the output of the 3D model data 151 as the distance between the user 50 and the camera 170 increases, and as the distance increases, the controller 160 of the 3D model data 151 It can be controlled to reduce the size and output. In addition, the controller 160 may control to adjust the size of the hair object 153 and output the same according to the change in the size of the 3D model data 151. The controller 160 may control the maximum size value and the minimum size value with respect to the size change of the 3D model data 151 and the hair object 153 so as not to be displayed above or below a predetermined size.

In particular, the controller 160 of the present invention may extract reference values such as eyes, nose, mouth, etc. through face recognition of the user 50, and detect the change of the reference values to determine the rotation of the user 50. . When a reference value indicating that the user 50 is rotated by an angle is detected, the controller 160 controls the 3D model data 151 and the hair object 153 to adjust the rotation angle to be output. For example, the controller 160 may control the 3D model data 151 and the hair object 153 to be rotated to the right by a predetermined angle when the user 50 rotates to the right by a certain angle.

As described above, the terminal 100 of the present invention collects an image of the user 50 using the camera 170, transmits the corresponding image to the virtual hair applying apparatus 300, and the virtual hair applying apparatus 300. By operating to receive and output the 3D model data 151 and the hair object 153 from), it is possible to provide an environment in which the hair object 153 can be applied without the burden of generating the 3D model. In addition, the terminal 100 detects the rotation of the user 50 and controls the rotation of the 3D model data 151 and the hair object 153 to real-time one surface of the 3D model data 151 and the hair object 153 at various angles. It can help the user to check easily.

Meanwhile, the virtual hair applying apparatus 300 configured as described above may be implemented as one or more servers operating in a server-based computing method or a cloud computing method. In more detail, the virtual hair applying apparatus 300 may be implemented as one or more servers in which the connection apparatus 301, the 3D model generating apparatus 305, and the hair object support apparatus 303 are each independent, or the plurality of apparatuses. It may be implemented as a plurality of servers including (301 to 305). In addition, the virtual hair applying apparatus 300 may provide a virtual hair applying service to the terminal 100 in a cloud computing manner.

Here, cloud computing refers to on-demand virtualized IT resources, for example, hardware (server, storage, network, etc.), software (database, security, web server, etc.), services, data, etc. using Internet technology. ) Means technology that serves in a way. That is, the virtual hair applying apparatus 300 provides the terminal 100 with computing resources including at least one of hardware, software, services, and data required to provide a 3D modeling-based virtual hair applying service according to the present invention. . For example, the virtual hair applying apparatus 300 provides a virtual computing space in which the 3D model data 151 and the hair object 153 are distributed to the terminal 100, and the computing space is provided with various hair objects 153. According to the exchange and sharing of), more various hair objects 153 may be serviced to the terminal 100. In addition, the virtual hair applying apparatus 300 may provide a storage space for storing data and / or software related to 3D model data, and perform the above-described function through the storage space.

Meanwhile, the terminal 100 configured as described above has disclosed an example of storing at least one hair object of a 3D type to be applied to the user-related 3D model-related data and the 3D model data in the storage 150, but is not limited thereto. It is not. For example, the terminal 100 transmits at least one hair object of the 3D type to be applied to the user-related 3D model-related data and the 3D model data to the hair object support apparatus 303 of the virtual hair applying apparatus 300 through the communication unit 100. Can be stored.

Meanwhile, in another embodiment of the present invention, the terminal 100 may generate a 3D model for the user without the help of the virtual hair applying apparatus 300.

3 is a view showing in more detail the configuration of the controller 160 for explaining the operation of the terminal 100 according to another embodiment of the present invention.

Referring to FIG. 3, in the terminal 100 according to another exemplary embodiment of the present disclosure, the controller 160 may include a 3D model generator 161, a 3D model playback unit 163, a hair object processor 165, and an image. The analysis unit 167 may be included. The terminal 100 of the present invention having such a configuration does not need to use the 3D model generation support of the virtual hair applying apparatus 300 by substantially processing the 3D model generation in the terminal itself.

The 3D model generator 161 generates a 3D model based on the images of the user 50 collected and transmitted by the camera 170. The 3D model generator 161 may substantially play a role similar to that of the 3D model generator 305. However, depending on the characteristics of the terminal 100, the operation speed may be relatively slow compared to the 3D model generating apparatus 305. In order to compensate for this, the 3D model generator 161 has a relatively small number of reference points or depth information compared to the 3D model generator 305 while rendering the 3D model from the user images captured by the camera 170. You can set it to a number. In addition, when the 3D model data 151 is generated, the 3D model generator 161 may support data compression or data filtering for faster motion application during the operation of the generated 3D model data 151. . The 3D model generator 161 may control to store the generated 3D model data 151 in the storage 150.

The 3D model reproducing unit 163 is configured to support 3D model data 151 stored in the storage unit 150 on the display unit 140. The 3D model reproducing unit 163 may operate a high speed graphics engine for outputting the 3D rendered 3D model data 151. Meanwhile, when the 3D model reproducing unit 163 of the present invention receives information on a specific reference value change from the image analyzer 167, the 3D model reproducing unit 163 is output to the display unit 140 according to the reference value change. Can be controlled to change the output plane. For example, when the user 50 transmits a reference value change corresponding to the case in which the user 50 is rotated by a predetermined angle from the image analyzer 167, the 3D model reproducing unit 163 outputs the 3D model data 151 being output. The output surface of the control panel can be controlled to be adjusted to correspond to the rotation angle. In addition, the 3D model playback unit 163 may support to change the size of the 3D model data 151 output according to the distance change between the user 50 and the camera 170.

The hair object processor 165 is configured to apply the at least one hair object 153 stored in the storage 150 to the 3D model data 151 and to output the same. The hair object 153 substantially applied to the 3D model data 151 may be information composed of 3D. The hair object processing unit 165 may support to output the screen including the multi-images of various hair objects 153 to the display unit 140 so that a user may select a specific item desired. When the user selects a specific hair object 153, the hair object processor 165 may control to apply the selected hair object 153 to the 3D model data 151. At this time, the hair object processing unit 165 acquires the size information of the 3D model data 151 and changes the size of the hair object 153 according to the size information so that the 3D model data 151 has the appropriate size of the hair object 153. ) Can be output in the applied form. The hair object processor 165 receives a reference value change corresponding to the movement of the user 50 from the image analyzer 167, similar to the 3D model playback unit 163, and according to the reference value change, the hair object 153. Control to adjust the output surface. In addition, the hair object processor 165 may control the size change of the hair object 153 according to a change in the distance value between the user 50 and the camera 170. Here, the 3D model playback unit 163 and the hair object processing unit 165 may control the size change of the 3D model data 151 and the hair object 153 according to the distance change of the user 50 through the change of the reference value. have. Meanwhile, the hair object processing unit 165 accesses the hair object support device 303 according to a user request or a predetermined cycle, receives various hair objects 153 provided by the hair object support device 303, and stores the storage 150. Can be controlled to save to. In addition, the hair object processing unit 165 may provide a hair object editor to support a user to change or adjust the specific hair object 153 according to a user's style.

The image analyzer 167 performs face recognition on an image or a preview image collected by the camera 170, and detects reference values of the user 50, such as eyes, noses, mouths, and ears, and detects reference values. It is the structure that observes change. That is, the image analyzer 167 detects whether the user 50 moves left, right, up, down, before, after, etc. through the change of the reference value. When the reference value change is detected according to the movement of the user 50, the image analyzer 167 may transmit the corresponding result value to the 3D model playback unit 163 and the hair object processing unit 165. At this time, the image analyzer 167 calculates the direction, the direction angle and the distance according to the change of the reference value to distribute the calculation amount of the 3D model playback unit 163 and the hair object processing unit 165, and calculates the result of the calculation of the 3D model playback unit. 163 and the hair object processing unit 165 may be transferred.

As described above, the virtual hair application service according to another embodiment of the present invention supports the creation of the 3D model and the application of the hair object 153 based on the terminal 100, thereby assisting device access by utilizing a separate device connection. It can be provided to support certain virtual hair application services in the region.

In the above, the components of the virtual hair applying service system 10 and the roles of the components have been described. Hereinafter, the method of applying the virtual hair of the terminal 100 and the method of providing the virtual hair application service of the virtual hair application service system 10 will be described in more detail with reference to the accompanying drawings.

4 is a flowchart illustrating a method of operating a terminal for supporting a virtual hair application service according to an embodiment of the present invention.

Referring to FIG. 4, in a method of operating a terminal according to an embodiment of the present invention, when power is first supplied to the terminal 100, the controller 160 controls to initialize each component of the terminal 100 using the supplied power. do. When the initialization process is completed, the controller 160 may control to output the standby screen to the display unit 140 as in step 401 according to preset schedule information.

Next, when an input signal is generated from the input unit 120, the controller 160 branches to step 403 to check whether the corresponding input signal is an input signal for activating the virtual hair function. In this step, if the corresponding input signal is not an input signal for activating the virtual hair function, the controller 160 branches to step 405 to support a user function of the terminal 100 corresponding to the input signal, for example, whether the terminal 100 is supported. In accordance with the present invention, a file play function, a file search function, a broadcast reception function, a call function, and the like may be controlled.

If an input signal for activating the virtual hair function is generated in step 403, the controller 160 branches to step 407 to perform 3D model generation. In more detail, the controller 160 may first control the camera 170 to be activated. The controller 160 may collect at least one image of the user 50 based on the camera 170 and perform rendering for generating 3D model data 151. In this case, the controller 160 may guide the collection of a plurality of images in order to generate appropriate 3D model data 151, and the user may follow the guide output through the display unit 140 or the audio processor 130. Can collect images for various aspects of. When a plurality of images are collected, the controller 160 combines a boundary area of the corresponding images, extracts depth information of each image, extracts depth information, color information of the corresponding image, and the like, based on the face outline and the face color. And 3D model data 151 may be generated. When the 3D model data 151 is generated, the controller 160 may support to store the 3D model data 151 in the storage 150.

Next, the controller 160 may control the output to the display unit 140 by applying the specific hair object 153 to the 3D model in step 409. To this end, the terminal 100 pre-stores at least one hair object 153 in the storage unit 150 so that the user can select it, or accesses the hair object supporting apparatus 303 which provides the hair object 153. The specific hair object 153 requested by the user may be received. The received hair object 153 may be temporarily or semi-permanently stored in the storage 150 under the control of the controller 160, and applied to the generated 3D model data 151 and output to the display 140. At this time, the controller 160 automatically changes the size of the hair object 153 based on the head size information in the 3D model data 151 and applies the automatically changed size of the hair object 153 to the 3D model data 151. Can be output to the display unit 140.

In operation 411, the controller 160 may analyze an image of the user 50. That is, the controller 160 may control to collect reference values including at least one of an eye, a nose, a mouth, and an ear of the user 50 in real time or at a predetermined cycle. In addition, the controller 160 determines whether the reference values collected in step 413 are changed. If the reference values are changed, the controller 160 branches to step 415 and rotates the 3D model data 151 and the hair object 153 according to the reference value change to control the other surface of the corresponding data to be output to the display unit 140. can do. For example, the controller 160 obtains motion information including the changed direction, angle, and distance according to the change of the reference value, and controls the output surfaces of the 3D model data 151 and the hair object 153 based on the motion information. You can decide. On the other hand, if there is no change in the reference value in step 413, the controller 160 may immediately branch to step 417 described below.

After that, the control unit 160 branches to step 417 to check whether there is an input signal generation for ending the virtual hair function, and if there is no end input signal, branches to step 409 and controls to continuously service the virtual hair function. have. On the other hand, when there is an end input signal, the controller 160 may terminate the virtual hair function and branch to step 401 to perform the following process repeatedly.

FIG. 5 schematically illustrates a signal flow between representative components of the virtual hair applying service system 10 for explaining a virtual hair applying service method according to an exemplary embodiment of the present invention.

Referring to FIG. 5, in the method of operating a system for applying a virtual hair of the present invention, first, the terminal 100 performs an image collection process in step 501. In more detail, the user of the terminal 100 may generate an input signal for activating the virtual hair applying function provided by the terminal 100 in order to use the virtual hair applying service. When an input signal for activating the virtual hair application function is generated, the terminal 100 may control to automatically activate the camera 170 to support the corresponding function. The terminal 100 supports collecting at least one image of the user 50 under user control. To this end, the terminal user may operate to collect images of various angles with respect to the user 50 using the camera 170.

When the image of the user 50 is collected, the terminal 100 transmits the image collected in step 503 to the virtual hair applying apparatus 300. To this end, the terminal 100 may establish a communication channel through the network 200 and access the access device 301. In addition, the terminal 100 may perform a user authentication process for checking whether the terminal 100 is a normal user in some cases. If the user is a normal user or a separate user authentication is not required, the terminal 100 transmits the corresponding image to the access device 301. The access device 301 may store the received user image and transmit the corresponding image to the 3D model generating apparatus 305 to generate 3D model data based on the image. When the 3D model generating apparatus 305 receives the user image from the access device 301 in step 505, the 3D model generating apparatus 305 may perform a rendering process for generating the 3D model based on the corresponding image. When the connection device 301 receives the image information for generating the 3D model from the specific terminal 100, the connection device 301 may transfer the corresponding information to the hair object supporting device 303. Then, the hair object supporting apparatus 303 may establish a communication channel with the terminal 100 to provide an environment in which the user can select a specific hair object 153. For example, the hair object supporting apparatus 303 may provide the terminal 100 with a web page on which an image related to at least one hair object 153 is disposed.

Next, the virtual hair applying apparatus 300 may transmit the 3D model data 151 and the hair object 153 generated in step 507 to the terminal 100. In particular, the user of the terminal 100 transmits a signal for requesting the reception of a specific hair object 153 or the hair object 153 together with the 3D model data 151 according to the policy of the hair object supporting apparatus 303. ) May be sent.

When the 3D model data 151 and the hair object 153 are received from the virtual hair applying apparatus 300, the terminal 100 displays the 3D model data 151 and the hair object 153 on the display unit 140 in step 509. Control the output. In this process, the terminal 100 may control to store the received 3D model data 151 and the hair object 153 in the storage 150. In addition, the terminal 100 may output the 3D model data 151 to the display unit 140 in an arbitrary size, and adjust the size according to the distance between the user 50 and the camera 170. In addition, the terminal 100 may adjust the size of the hair object 153 according to the size of the 3D model by the 3D model data 151. Here, the terminal 100 first outputs the 3D model data 151 on the display unit 140 and then supports to output the hair object 153 by adjusting it to fit the 3D model data 151, or before outputting the 3D model. The data 151 and the hair object 153 may be synthesized and output to the display unit 140 as an image having a constant output surface.

In operation 511, the terminal 100 may perform image analysis to control the 3D model data 151 and the hair object 153 to rotate according to a change in the reference value of the user 50. To this end, the terminal 100 continuously maintains the camera 170 and performs image analysis on the head images of the user 50 collected by the camera 170 to extract reference values for face recognition. Can be. In addition, the terminal 100 extracts motion information including a rotation direction, a distance, and an angle of the user 50 according to the extracted reference values. The terminal 100 extracts the motion information from the 3D model data 151 and the hair object 153. In this case, the 3D model data 151 corresponding to the movement of the user 50 and a predetermined surface of the hair object 153 may be controlled to be output to the display unit 140.

As described above, the virtual hair applying service method of the present invention may support the virtual hair applying service using the terminal 100 or may support the virtual hair applying service in association with the device. In addition, the service method of the present invention supports various types of hair objects 153 according to the user's preference to 3D models similar to their heads, thereby observing appropriate hairstyles suitable for them.

On the other hand, the virtual hair application service method according to the embodiment of the present invention described above is implemented in the form of program instructions that can be executed by various computer means may be recorded in a computer-readable recording medium. In this case, the computer-readable recording medium may include program instructions, data files, data structures, and the like, alone or in combination. On the other hand, the program instructions recorded on the recording medium may be those specially designed and configured for the present invention or may be available to those skilled in the art of computer software.

Computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CD-ROMs and DVDs, and magnetic disks such as floppy disks. Magnetic-Optical Media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. In addition, program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention.

In the above description with respect to the operation of the identification code according to an embodiment of the present invention has been described with reference to the preferred embodiments through the specification and drawings, although specific terms are used, this is only to easily explain the technical details of the present invention and help the understanding of the invention It is only used in a general sense for this purpose, the present invention is not limited to the above-described embodiment. That is, it is apparent to those skilled in the art that various embodiments based on the technical idea of the present invention are possible.

The present invention relates to a system and method for applying a 3D-based virtual hair, and a terminal supporting the same, to generate a 3D model based on the head of a user, and to easily apply various hair objects to the corresponding 3D model. By rotating the 3D model and hair object according to the head rotation, it is possible to observe the application of the virtual hair object from various angles, and by providing the virtual hair application service based on the 3D model, time and space are limited. It is possible to meet the needs of users by enabling them to more accurately observe various hairstyles that best fit the current state of the user at the desired time and environment.

100: terminal 110: wireless communication unit 120: input unit
130: audio processing unit 140: display unit 150: storage unit
151: 3D model data 153: Hair object 160: Control unit
161: 3D model generation unit 163: 3D model playback unit
165: hair object processing unit 167: image analyzer 170: camera
200: network 300: virtual hair applying device
301: connection device 303: hair object support device
305: 3D model generator

Claims (22)

Collects the image of the user including the face, transmits the collected image to the virtual hair applying device, 3D to be applied to the 3D model data and 3D model data generated by the user's image as a 3D model from the virtual hair applying device Receiving at least one hair object of the type, and outputs the combined 3D model data and one hair object, the output surface of the hair object applied to the 3D model data and the 3D model data according to the user's movement terminal; And
Applying the virtual hair to receive the user's image from the terminal to generate the 3D model data for the user, and to transmit the at least one hair object to the 3D model data and the generated 3D model data to the terminal Device;
Virtual hair applying service system comprising a.
A connection device receiving an image of a user from a terminal and transmitting 3D model data and at least one hair object corresponding to the image of the user to the terminal;
A 3D model generation device for generating 3D model data of the user based on the image of the user received by the access device and transferring the 3D model data to the access device;
A hair object support device for providing the connection device with at least one hair object of a 3D type to be applied to the 3D model data to the connection device;
Virtual hair applying device comprising a.
The method of claim 2,
The connecting device
And storing and managing 3D model data delivered by the 3D model generation device and at least one hair object delivered by the hair object support device.
The method of claim 2,
The hair object support device
And providing the terminal with a web page on which an image related to at least one hair object is placed.
The method of claim 4, wherein
The hair object support device
And when the terminal changes the hair object, receives the changed hair object and registers it as a new hair object.
The method of claim 2,
The hair object support device
Receiving the motion information of the user from the terminal, determining the output surface of the hair object based on the received motion information, and providing data corresponding to the determined output surface of the hair object to the terminal Applicable device.
The method of claim 2,
The 3D model generating device
When receiving the motion information of the user from the terminal, the output surface of the 3D model data is determined based on the received motion information, and provides data corresponding to the output surface of the determined 3D model data to the terminal Virtual hair applying device.
8. The method according to any one of claims 2 to 7,
And at least one of the access device, the hair object support device, and the 3D model generation device is implemented as one or more servers operating on a cloud computing basis.
A camera collecting an image of the user;
Generates 3D model data corresponding to the user based on the collected user's image, and controls to apply and output the hair object to the generated 3D model data, the 3D model data and the hair according to the user's movement A control unit controlling an output surface of the object; And
A display unit configured to output a screen to which the hair object is applied to the 3D model data under the control of the controller;
Terminal supporting a virtual hair applying service, comprising a.
10. The method of claim 9,
The control unit
A 3D model generator for generating 3D model data based on the image of the user;
A 3D model reproducing unit configured to output the 3D model data to the display unit; And
A hair object processing unit for applying the hair object to the 3D model data and outputting the hair object to the display unit;
Terminal supporting a virtual hair applying service, comprising a.
The method of claim 10,
The control unit
The apparatus may further include an image analyzer configured to extract a reference value by recognizing a face from the image of the user, and extract motion information of the user based on a change of the extracted reference value.
The 3D model playback unit and hair object processing unit
And receiving the motion information from the image analyzer and changing the output surfaces of the 3D model data and the hair object so as to correspond to the motion information.
The method of claim 10,
A storage unit for storing at least one hair object of a 3D type to be applied to the 3D model data and the 3D model data under the control of the controller;
Terminal supporting a virtual hair applying service, characterized in that it further comprises.
10. The method of claim 9,
Further comprising: a communication unit for forming a communication channel with the hair object support device,
The controller supports a virtual hair application service, wherein the control unit receives and stores at least one hair object of a 3D type to be applied to the 3D model data or the 3D model data related to the user from the hair object support apparatus. Terminal.
A collection step of collecting, by the terminal, a user image including a face and a head;
Generating 3D model data based on the collected user image;
Applying a 3D type specific hair object to the 3D model data;
Outputting 3D model data to which the hair object is applied;
A change step of extracting a user's movement by performing face recognition based on the image and changing an output surface of the 3D model data and the hair object according to the user's movement;
Virtual hair application service method comprising a.
15. The method of claim 14,
The collecting step
And collecting the image of the user photographed from at least two angles.
15. The method of claim 14,
And outputting a plurality of 3D type hair objects to be applied to the 3D model data and selecting one hair object.
The application step is
And applying the selected hair object to the 3D model data.
15. The method of claim 14,
The change step
Extracting a reference value according to the face recognition;
Confirming a user's movement in at least one direction of a predetermined direction according to the change of the extracted reference value;
Virtual hair application service method comprising a.
15. The method of claim 14,
The change step
Rotating the direction, angle, and distance of the hair object according to the direction, angle, and distance the user moves;
Rotating the direction, angle, and distance of the 3D model data according to the direction, angle, and distance the user moves;
Virtual hair application service method comprising a.
15. The method of claim 14,
Editing the hair object according to user control; And
Receiving the hair object from an external device;
The method of claim 1, further comprising at least one step.
Collecting, by the terminal, at least one user image;
Transmitting the collected at least one user image to the virtual hair applying apparatus;
Receiving 3D model data generated based on the collected image and a 3D type hair object to be applied to the 3D model data from the virtual hair applying apparatus;
An output step of extracting motion information of a user and adjusting and outputting the received 3D model data and an output surface of the hair object according to the motion information;
Virtual hair application service method comprising a.
Receiving, by the apparatus for applying a virtual hair, at least one user image from the terminal;
Generating 3D model data corresponding to a user based on the received user image; And
Transmitting the 3D model data and the hair object to be applied to the 3D model data to the terminal;
Virtual hair application service method comprising a.
A computer-readable recording medium storing a program for executing the virtual hair applying service method according to any one of claims 14 to 21.
KR1020110020305A 2011-03-08 2011-03-08 Virtual service system for hair and method thereof, and device supporting the same KR20120102275A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020110020305A KR20120102275A (en) 2011-03-08 2011-03-08 Virtual service system for hair and method thereof, and device supporting the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020110020305A KR20120102275A (en) 2011-03-08 2011-03-08 Virtual service system for hair and method thereof, and device supporting the same

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020160140452A Division KR20160128272A (en) 2016-10-26 2016-10-26 Virtual Service System For Hair and Method thereof, and Device supporting the same

Publications (1)

Publication Number Publication Date
KR20120102275A true KR20120102275A (en) 2012-09-18

Family

ID=47110842

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020110020305A KR20120102275A (en) 2011-03-08 2011-03-08 Virtual service system for hair and method thereof, and device supporting the same

Country Status (1)

Country Link
KR (1) KR20120102275A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9846804B2 (en) 2014-03-04 2017-12-19 Electronics And Telecommunications Research Institute Apparatus and method for creating three-dimensional personalized figure
KR102334030B1 (en) 2021-03-02 2021-12-03 (주)내스타일 Method for dyeing hair by using computer device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9846804B2 (en) 2014-03-04 2017-12-19 Electronics And Telecommunications Research Institute Apparatus and method for creating three-dimensional personalized figure
KR102334030B1 (en) 2021-03-02 2021-12-03 (주)내스타일 Method for dyeing hair by using computer device

Similar Documents

Publication Publication Date Title
CN109874021B (en) Live broadcast interaction method, device and system
KR101768980B1 (en) Virtual video call method and terminal
CN109819313B (en) Video processing method, device and storage medium
KR101987749B1 (en) Method and apparatus for virtual hair styling service
WO2018153267A1 (en) Group video session method and network device
CN110738595A (en) Picture processing method, device and equipment and computer storage medium
CN104782120A (en) Facial movement based avatar animation
CN111539882A (en) Interactive method for assisting makeup, terminal and computer storage medium
JP6563580B1 (en) Communication system and program
WO2021190625A1 (en) Image capture method and device
US20220385808A1 (en) Selfie setup and stock videos creation
KR20120009710A (en) Virtual experience server and method based on face recognition
CN109559288A (en) Image processing method, device, electronic equipment and computer readable storage medium
KR20210081082A (en) Server, method and user device for providing avatar contents based on motion data of object
KR102409103B1 (en) Method for editing image
KR20120102275A (en) Virtual service system for hair and method thereof, and device supporting the same
KR102140077B1 (en) Master device, slave device and control method thereof
CN112449098B (en) Shooting method, device, terminal and storage medium
KR101820503B1 (en) Service systembased on face recognition inference, and face recognition inference method and storage medium thereof
KR102058190B1 (en) Apparatus for providing character service in character service system
KR20130142315A (en) Character service system and character service providing method thereof
KR20160128272A (en) Virtual Service System For Hair and Method thereof, and Device supporting the same
CN108600614B (en) Image processing method and device
KR20120037712A (en) Imaginary beauty experience service system and method
KR20120119244A (en) Method for producing contents, system thereof and terminal thereof

Legal Events

Date Code Title Description
N231 Notification of change of applicant
A201 Request for examination
E902 Notification of reason for refusal
A107 Divisional application of patent
AMND Amendment
E601 Decision to refuse application
AMND Amendment