The present application is a divisional application of chinese patent application entitled "method and system for generating content through cooperation between users" filed on 17/6/2016 under application number 201610439313.6. The priority date of the parent application was 2015, 6, 19.
Detailed Description
Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.
Fig. 1 is a diagram illustrating an example of an action environment of a system for secondary content generation according to one embodiment of the present invention. FIG. 1 illustrates a plurality of electronic devices 110, 120, 130, 140, as one example of an action environment; a plurality of servers 150, 160; and a network 170.
The electronic devices 110, 120, 130, 140 may be fixed type terminals or mobile type terminals implemented as computer systems. Examples of the electronic devices 110, 120, 130, 140 may be a smart phone (smart phone), a mobile phone, a navigation, a computer, a notebook, a terminal for Digital broadcasting, a Personal Digital Assistant (PDA), a Portable Multimedia Player (PDA), a tablet computer, and the like. Each of these electronic devices 110, 120, 130, 140 may communicate with other electronic devices and/or servers 150, 160 over network 170 using wireless or wired communication.
The communication method is not limited, and may include not only a communication method using a communication network (as an example, a mobile communication network, a wired network, a wireless network, or a broadcast network) which the network 170 can include, but also short-range wireless communication between devices. For example, the Network 170 may include any one or more of Personal Area Network (PAN), Local Area Network (LAN), Campus Area Network (CAN), Metropolitan Area Network (metro Area Network), Wide Area Network (WAN), Broadband Network (BBN), internet, and the like. The Network 170 may include one or more Network topologies including a Bus Network (Bus Network), a Star Network (Star Network), a Ring Network (Ring Network), a Mesh Network (Mesh Network), a Star-Bus Network, a tree Network, a hierarchical Network, and the like, but is not limited thereto.
Each of the servers 150, 160 communicates through the electronic devices 110, 120, 130, 140 and the network 170, and in turn may be implemented as a device or devices that provide content for a service. As an example, the servers 150 and 160 may provide the electronic devices 110, 120, 130, and 140 with codes that can configure screens of the electronic devices 110, 120, 130, and 140 according to requests of users through the electronic devices 110, 120, 130, and 140, and the electronic devices 110, 120, 130, and 140 may configure the screens to represent the screens by using the codes provided by programs (e.g., browsers or specific applications) included in the electronic devices 110, 120, 130, and 140, and may provide the users with contents.
Also, in another embodiment, the electronic devices 110, 120, 130, 140 may download and receive data required for service provision in advance through the servers 150, 160 for storage, and may generate content for the service to provide to the user by themselves using the stored data and data of the electronic devices 110, 120, 130, 140 (e.g., data input by the user or data measured by the electronic devices 110, 120, 130, 140).
Fig. 2 is a block diagram for explaining internal constitutions of an electronic device and a server according to an embodiment of the present invention.
Electronic device 110 and server 150 may include memory 211, 221; processors 212, 222; communication modules 213, 223; and input/ output interfaces 214, 224. The memories 211 and 221 may include a Random Access Memory (RAM), a Read Only Memory (ROM), and a Permanent Mass Storage Device (disk drive) as a computer-readable recording medium. Also, the memories 211, 221 may store an operating system and at least one program code (e.g., code provided in the electronic device 110 for driving an application). Such software components can be downloaded from a different computer-readable recording medium from the memories 211 and 221 by a drive device (drive mechanism). Such other computer-readable recording media include floppy disk drives, magnetic disks, magnetic tapes, DVD/CD-ROM drives, memory cards, and other computer-readable recording media. In another embodiment, the software constituent elements are downloadable to the memory 211, 221 through the communication module 213, 223 instead of the computer-readable recording medium. For example, a program set by at least one program based on a file provided by a developer through the network 170 may be downloaded to the memories 211, 221.
The processors 212, 222 may be configured to process the commands of a computer program by performing basic arithmetic, logical, and input/output computations. The commands may be provided to the processors 212, 222 according to the memory 211, 221 or the communication module 213, 223. The processors 212, 222 may be configured to execute program code stored in the recording devices of the memories 211, 221.
The communication modules 213, 223 may provide functionality for the electronic device 110 and the server 150 to communicate with each other and may provide functionality for the electronic device 110 or the server 150 to communicate with other electronic devices or other servers via the network 170. For example, according to the control of the user, a request message generated in the processor 212 of the electronic device 110 may be transmitted to the server 150 through the network 170 according to the control of the communication module 213. Conversely, content provided by the processor 222 of the server 150 is received by the communication module 213 of the electronic device 110 via the communication module 223 and the network 170, and may also be transmitted to the processor 212 or the memory 211.
The input/ output interfaces 214, 224 may be means for interfacing with a variety of input devices, output devices. For example, the input device may include a device such as a keyboard or mouse, and the output device may include an application and a device for representing a display of a communication session (session) of the application. As another example, the input/ output interfaces 214, 224 may also be a means of interfacing with a device such as a touch screen for combining input and output functions.
More specifically, the processor 212 of the electronic device 110 may realize that a service screen 215 configured by using data provided by the server 150 is displayable on a display through the input/output interface 214 when processing commands of a computer program downloaded to the memory 211.
Also, in another embodiment, the electronic device 110 and the server 150 may also include more components than those of fig. 2. However, it is not necessary to explicitly illustrate most of the components of the prior art. For example, the electronic device 110 may further include other components such as a display or a transceiver (transceiver) of a touch screen, a Global Positioning System (GPS) module, and a camera.
Fig. 3 is a diagram generally illustrating a process of generating secondary content according to one embodiment of the present invention. Fig. 3 shows the server 150 and the plurality of electronic devices 310, and a process of generating the secondary content is briefly explained in the viewpoint of the server 150.
In process 1, the server 150 may set items. For example, the server 150 may generate an item for the generation of the secondary content, and such an item may include information related to the primary content to be generated by the user for the generation of the secondary content. The server 150 may set (or generate) items according to a request of a specific user, and may also automatically set (or generate) by analyzing contents received by the server 150.
For example, the server 150 includes a content database 320 and thus directly manages or communicates with a network through the in-memory database 320 constructed outside the server 150 so that information related to the content stored in the content database 320 can be acquired. The respective contents received from the plurality of electronic devices 310 in such a content database 320 and the locations associated with the generation thereof may be stored in correspondence with each other. For example, an application associated with a service provided by the server 150 may be provided in each of the plurality of electronic devices 310. When the plurality of electronic devices 310 generate contents according to the control of the application and transmit the contents to the server 150, the application confirms the GPS coordinate information of the electronic device at the time of generating the contents and transmits the information to the server 150 together with the contents. The server 150 correlates the received content and the GPS coordinate information to each other and may be stored in the content database 320. At this time, the server 150 analyzes the content stored in association with the specific location, and can generate an item related to the location. For example, in the case of a photograph area of a famous tourist attraction, many users upload photographs of a famous subject (such as a bronze photograph) to the SNS server, and the SNS server can transmit items or tasks instructing photographing of the subject at different angles to each other to the users (for example, 10) passing by the periphery thereof at regular intervals of time using a chat conversation window or the like based on such information.
As another example, the server 150 receives a user's item setting request, and may also generate an item according to the received item setting request. An application provided at each of the plurality of electronic devices 310 to be driven may control the plurality of electronic devices 310 to provide a user interface for inputting or selecting conditions set for an item. Based on the user input or selection condition using such a user interface, the electronic device may transmit a project setting request to the server 150 according to the control of the application program.
In process 2, the server 150 may provide the item. As one example, the server 150 may provide the set items to the electronic devices of the user (the "first electronic device", "third electronic device", and "nth electronic device" in the example of fig. 3) related to the set items.
The user providing the item may be selected in a number of ways. For example, the server 150 may provide items to users selected in various ways, such as a user who selects a set item, a user who the server 150 selects (e.g., a user who selects a user located in the same place based on location information provided by an electronic device), a user who mutually sets an acquaintance relationship in a Service related to the server 150 (e.g., Social Network Service), or a user who mutually communicates through one communication session (e.g., a chat conversation window) in a Service related to the server 150.
In process 3, the server 150 may receive the content once. For example, content is generated once from the item at the electronic device providing the item (in the example of fig. 3, "first electronic device", "third electronic device", and "nth electronic device") and may be transmitted to the server 150. At this time, the server 150 may receive the primary content transmitted by each electronic device.
More specifically, the item may include information related to a specific place or a specific subject, and the one-time content may include an image taken at such a place or an image taken including the specific subject. At this time, the server 150 may provide items to the selected user and then request (task provision) to photograph an image related to a specific location or a specific subject. The user takes a video requested by an item as primary content and transmits the video to the server 150 via the electronic device.
In process 4, the server 150 may generate secondary content. For example, the server 150 may generate a three-dimensional video (or animation video) or a panorama, etc. related to the specific location or the specific object as the secondary content by synchronizing the video received as the primary content. For example, when multiple cameras are maneuvered to take a particular building at various angles simultaneously and/or at different times, the various photographs taken in synchronization can create a three-dimensional image that gives the effect of a video that appears to rotate 360 degrees around the building. When a crowd shoots a mountain located far away at different angles, the mountains can be connected to generate a panoramic photograph. Here, the project requests the project to be performed in all angles in a specific place alone by one person, and there is no need to simultaneously perform a plurality of tasks (photo/video shooting, etc.) assigned at arbitrary timing in the angles indicated in the positions respectively given to the tasks. Also, when the friend goes to a specific place for amusement, the respective request items may perform photographing in the photographing place and the respective positions allocated to receive the respective photographing angles and the like. Also, when photographing is performed after the assignment of the reception task, a User Interface (UI) that represents the respective photographing positions in the form of an object on the display can be implemented in the screen. The primary content may include a picture or text information directly drawn by the user, in addition to the photographed image (including video). For example, a secondary content may be generated by connecting a picture directly drawn by a user or a file describing a specific technology or an object may be generated as the secondary content. When the primary content is a still image (photograph), a plurality of photographs may be synthesized together or other types of primary content, i.e., sound sources (background music, sound, etc.) may be added. For example, in the case of background music, the server 150 may select the background music by one party, add the background music using a sound source selected by the user, and generate secondary content. At this time, the item may include information that guides the user to draw a specific part of the entire picture or to transmit text information included in a description related to a specific technology or thing to the server 150.
When a plurality of users shoot images simultaneously, shooting patterns of other users can be displayed according to a small picture. At this time, the photographing position of the other user may be indicated in the screen window or a map representing the current position and the target position of the counterpart may be displayed.
In this way, the server 150 can set an item related to the secondary content to be generated, and distribute the item in the form of a task and provide the item to the selected user, and by generating the secondary content from the primary content generated by such an item, the result to be generated can be predicted in advance, and in order to generate one secondary content, it is not necessary to analyze all the contents received by the server 150, and the secondary content can be generated using the primary content received from the corresponding item, so that unnecessary calculation can be reduced.
FIG. 4 is a diagram illustrating a first example of assigning tasks to users, according to one embodiment of the invention. The server 150 may be configured to maintain a plurality of items 410. At this time, the first electronic device 420 may receive information related to the plurality of items 410 from the server 150 according to control of an application program driven by the first electronic device 420, and may select a desired item therein. For example, a user of the first electronic device 420 may select a "first item" as the desired item among the plurality of items 410. At this point, the server 150 provides the selected "first item" to the first electronic device 420, which in turn may direct the user to generate a content for delivery. At this time, the "first item" may include primary content for guiding the user to generate a deficiency of secondary content to be generated through the "first item". For example, when a three-dimensional image related to a specific manufactured object is generated, but there is no image of a specific angle, information for guiding a user to generate an image in the angle may be included in the "first item". That is, information for requesting to provide content insufficient in the item selected by the user may be included in the item.
FIG. 5 is a diagram illustrating a second example of assigning tasks to users, according to one embodiment of the invention. In fig. 4, after the first electronic device 420 selects the "first item", it is assumed that the second electronic device 510 also selects the "first item" in the same way. At this time, the server 150 connects the communication session between the first electronic device 420 and the second electronic device 510, and thus the user of the first electronic device 420 and the user of the second electronic device 510 can be combined with each other by a group for performing the same item. For example, the server 150 may enable a user of the first electronic device 420 to generate a chat meeting window in which a user of the second electronic device 150 participates so that a chat service between the two users may be provided. To this end, the application program provided to the first electronic device 420 and the application program provided to the second electronic device 510 include at least a function for providing a chat service.
In case, when the "first item" is selected through another electronic device, a group chat service for a new user may be provided.
Also, the user may select items that are different from each other or not select items. For example, when another electronic device selects "second item", the server 150 may recommend "first item" selected by a plurality of users. As another example, recommending a plurality of user-selected "first items" by the electronic device of the user who has not yet selected the items may support collaboration of the user for the "first items".
FIG. 6 is a diagram illustrating a third example of assigning tasks to users, according to one embodiment of the invention. Fig. 6 illustrates an example of providing a chat service through a conversation window 610 to a first electronic device 420, a second electronic device 510, and a third electronic device 620 connected to the conversation window 610 through one communication meeting connection.
At this time, the server 150 sets items for the users of the first electronic device 420, the second electronic device 510, and the third electronic device 620, and can provide the items to the first electronic device 420, the second electronic device 510, and the third electronic device 620. The user generates the contents of the item, and the contents are uploaded to the server 150 through the dialog window 610, and the server 150 generates the secondary contents using the contents uploaded through the drawing window 610.
As another example, the server 150 collects content uploaded by the user on-purpose dialog window 610, and may generate secondary content. For example, the server 150 may set an item to generate secondary content using the content uploaded to the dialog window 610 through the dialog window 610. At this time, items including guide information related to such automatic generation of secondary content may be provided to the first electronic device 420, the second electronic device 510, and the third electronic device 620 through the dialog window 610. At this time, even if the user does not have a separate intention to generate the second content, the server 150 automatically generates the secondary content using the content uploaded through the dialog window 610, and can provide the user (the first electronic device 420, the second electronic device 510, and the third electronic device 620) through the dialog window 610. For example, friends traveling together to return share travel-related topics in a chat conversation window, and may simultaneously communicate photos taken at tourist attractions to each other. At this time, the server 150 automatically generates secondary contents such as a slide show or a moving picture in order to transmit the hybrid uploaded photo, so that the secondary contents can be provided to the user through the chat conversation window.
In another embodiment, the item may include information for confirming from the user whether or not to receive the automatically generated permission of such secondary content. At this time, when the user connected to the dialog window 610 permits automatic generation of the secondary content, the secondary content may be automatically generated using the content uploaded to the dialog window 610.
FIG. 7 is a diagram illustrating a fourth example of assigning tasks to users, according to one embodiment of the invention. The server 150 may provide the content uploaded through the first electronic device 420 to the second electronic device 510 when the user of the first electronic device 420 has an acquaintance relationship, such as a friend, with the user of the second electronic device 510. For example, when the user of the first electronic device 420 uploads a picture taken at location a to the server 150, and then the user of the second electronic device 510 accesses location a to determine the current location of the second electronic device 420 as location a, the server 150 may provide the picture taken at location a by the user of the first electronic device 420 to the second electronic device 510. That is, the user of the second electronic device 510 may be informed that the user of the first electronic device 420 visited the venue (venue a) and where what photos were taken.
As another example, the server 150 may provide the content uploaded through the first electronic device 420 through a dialog window in which the user of the first electronic device 420 connects with the user of the second electronic device 510. By this, both users can be guided to conduct a conversation related to the same place (place a).
If necessary, it is also preferable to perform a program for acquiring a license from the user of the first electronic device 420 as to whether or not the content uploaded through the first electronic device 420 should be provided to the second electronic device 510 and then shared.
In this way, the server 150 can provide a service that enables sharing of content uploaded by the user participating in an activity such as a project with other users among users who have set an interpersonal relationship with each other such as friends.
Also, even if there is no particular interpersonal relationship, the server 150 may recommend a location to be photographed by the user while providing the user with primary or secondary content generated from other users in the location to be photographed by the user.
FIG. 8 is a diagram illustrating a fifth example of assigning tasks to users, according to one embodiment of the invention. The user of the first electronic device 420 can directly set the items through the functions provided by the application program driven by the first electronic device 420. The server 150 may request registration of a project set by a user of the first electronic device 420, and provide the project to the user in conformity with a condition of the set project to participate in a task.
For example, the user of the first electronic device 420 may register a certain event or accident (event, holiday, natural disaster, traffic accident, etc.) in the server 150 by sighting it and generating an item for capturing an image related to the event or accident. At this time, the item may include a location related to a specific event or accident. At this time, the server 150 may request other users (the user of the second electronic device 510 and the user of the second electronic device 620) existing at the place of the location included in the item to provide the item, so that the other users take the image related to the event or accident and upload the image to the server 150. As another example, not only the image but also the input of text information related to a specific event or accident may be requested according to the setting of the item.
If the contents are uploaded from the second electronic device 510 and the third electronic device 620, the server 150 generates secondary contents using the contents of the first electronic device 420, the second electronic device 510, and the third electronic device 620.
FIG. 9 is a diagram illustrating a sixth example of assigning tasks to users, according to one embodiment of the invention. Fig. 9 shows an example of requesting participation of the server 150 in an item from users (users of the first electronic device 420, the second electronic device 510, and the third electronic device 620) who uploaded content via the server 150 in a particular venue represented by the dotted oval 910. At this time, the server 150 sets a communication session between users who are permitted to participate in the project (as an example, connects the users to one session window), generates secondary content using content uploaded by users connected through such a communication session, and provides the generated secondary content to users connected through the set communication session.
For example, when images are generated by a plurality of users at the time and place of a specific event or accident and are further uploaded to the server 150, the server 150 connects such users with one dialog window, and generates secondary content related to the event or accident using the images uploaded by the users and can be further distributed through the dialog window. In case that the primary contents such as video and character information are insufficient, the primary contents which are insufficient in request can be added to other users in the place or users in the conversation window. That is, the server 150 sets an item (an item for insufficient primary content) based on the uploaded content and the location, and provides the item to a user who communicates through one communication session (a session window) or a user selected by the server 150, so that generation and provision of insufficient primary content (upload to the server 150) can be requested.
Fig. 10 is a diagram illustrating an example of a process of editing a project according to one embodiment of the present invention. The server 150 may provide the first electronic device 420 with a plurality of items 1010 set similarly to what is illustrated by fig. 4. The user of the first electronic device 420 may select an item (e.g., the first item) desired by the user. At this time, the user of the first electronic device 420 may edit the selected item using the function of the application program set to be driven in the first electronic device. The edited project may be provided to the server 150 to be registered as a new project. In this case, the user can more conveniently set a customized item by editing an already set item than creating and registering an item by planning the item from the beginning.
For example, with respect to items in which 10 users take images of one subject at different angles to generate secondary content, editing in which the condition of 10 users is increased to 15 users, or the subject is changed to another subject, or the like can be performed.
When a user edits a project, the server 150 generates desired content for the edited project for transmission to the first electronic device 420. Such desired content may be generated from content extracted by server 150 extracting content that meets the terms of the project from a content database (e.g., content database 320 of fig. 3). For example, when specific secondary contents shot and generated in a specific position are stored in the server 150, they are provided to project participants in a preview form, and each can be used with reference materials related to which position/angle the picture is taken as good, or with reference to edit the project itself in conformity with its orientation.
The desired content may also be generated when the user generates content once for the item. For example, when the user of the first electronic device 420 generates primary content according to an item and transmits the generated primary content to the server 150, the server 150 may generate and provide desired content using other content (which meets the condition of the item) of the content database and the first content even if the content for the generation of secondary content is insufficient.
Hereinafter, an example of generating secondary content using video uploaded as primary content will be described. In this example, although the explanation related to the electronic device of the user is omitted, the communication of the user with the server 150 can be realized by the electronic device of the user.
As an example, the user a takes a first picture including the subject designated by the item and the user B, and the user B takes a second picture including the subject designated by the item and the user a, which may be uploaded to the server 150, respectively. At this time, the server 150 synthesizes the first video and the second video, and generates a third video including the user a and the user B and the subject as secondary content. At this time, the user a and the user B can acquire a video (third video) including both the persons even if the other persons do not take both the persons.
As another example, the server 150 may also generate a third picture, in which the user a or the user B is replaced by the user C, as the secondary content, using a first picture including the user a and the user B and a second picture including the user C.
As another example, for users who gather in the same place, a specific user is set as a subject, and an item to guide a specific action (e.g., jumping) may be provided to the specific user who decides to be the subject. At this time, the items may further include information for guiding the remaining users to photograph the specific user designated as the photographed object in mutually different angles or positions. At this time, if images of a specific user photographed in mutually different angles or positions are uploaded to the server 150, the server 150 can generate secondary contents related to the user set as a photographed object using the uploaded images.
The server 150 may provide the user with a function of correcting camera settings for correcting click synchronization (Tick) when the user simultaneously photographs objects, or automatic zoom-in (zoom-in) when the distances between the objects and the user are different from each other. At this time, such a function that the application driven in the user's electronic device controls the electronic device can be processed according to the command provided by the server 150.
For example, in a task in which a user simultaneously photographs objects, if the user directly performs a photographing operation in the electronic device (if the user presses a photographing button), it is difficult to simultaneously photograph the objects. Accordingly, the server 150 may transmit a command for synchronization of photographing time points to the electronic devices so that the electronic devices of the users can start photographing at the same time (e.g., a difference within 0.01 second). At this time, the electronic device can acquire an image of the object captured at the same time by capturing images at the same time in response to the command received from the server 150. Also, for users participating in the task, videos may be photographed in the respective decided positions. At this time, the server 150 may control the electronic device, and the still image extracted at a specific time point in the video is provided to the server 150.
The server 150 can measure an azimuth or a position by image recognition, synchronize a time between primary contents by a voice recognition function or an image recognition function, and correct blur (blu) or generate a three-dimensional sound source according to object movement recognition, and include the blur in secondary contents.
The video may be used not only as a still image but also as primary content, and the secondary content related to the video may be a video reflecting hand shake correction, High Dynamic Range (HDR), 60fps video, GIF animation, 360-degree camera video, zooming, camera rotation effect, and the like. For example, images that are shaken due to hand shake are corrected by similar other images or at least a portion of the video captured by multiple cameras is combined with frames to provide a slow video effect. In addition, the prediction and the supplement of the intermediate frame of the empty position/angle which is not shot may include the completed content, and may also include the case of merging the images with different attributes at the time of shooting. For example, in the case of night shooting, a background with a light is dark and shot with a low exposure, a subject is shot with a high exposure, and the respective images shot clearly are combined to create a secondary content (HDR effect), and a secondary content in which a person is highlighted from the background can be created according to a difference in aperture. In addition, the secondary content can be created by combining the videos shot by the plurality of cameras, wherein the secondary content is played at the slow video in the beginning part and the original speed in the rear part of the video. When shooting is performed by cameras of different types, correction can be performed in accordance with the mutual characteristics. In addition, other images may be used to remove obstacles contained in the image or to correct a blurred portion.
A functional example of an application program that is provided in the electronic device of the user and driven will be described below.
As one example, when the item includes a task related to shooting in a particular angle or position, the application may include functionality for providing information that a user can capture such angle or position. That is, the user may be provided with information (indicating a direction or a target, etc. on the camera screen) showing how the user moves along which side.
As another example, the application may provide information related to an angle or position to be photographed next when the user generates a picture by photographing in a specific angle or position.
As another example, the application may provide information related to what content may be generated if added to the content currently uploaded by the end. For example, among items required to photograph ten images of a subject in ten angles different from each other, when there is no image of the subject in one angle, the application may direct the user to photograph the subject in the angle.
Also, as previously described, the application program may further include a function of providing a chat service or the like with other users or a social network service through the conversation window. The chat service or social network service may be provided through the server 150.
Fig. 11 is a block diagram illustrating a processor included in a server according to one embodiment of the present invention, and fig. 12 is a flowchart showing a method performed by the server according to one embodiment of the present invention. As shown in fig. 11, the processor 222 included in the server 150 may include a content management unit 1110, an item setting unit 1120, an item providing unit 1130, and a secondary content generating unit 1140. Such constituent elements of the processor 222 may be configured to perform the steps (1210 to 1240) included in the method of fig. 12 by means of an operating system and at least one program code included in the memory 221.
In step 1210, the content management part 1110 may store and manage information including content received by the server 150 from the user's electronic device and a location related to the generation of the content in a content database. For example, the primary content received according to the previously set item is associated with a location related to the generation of the primary content (for example, GPS coordinates of the electronic apparatus at the time of the generation of the primary content) and thus may be stored in the content database. As already explained, the content database may be configured to be included in the server 150, and may also be configured to communicate with the server 150 outside the server 150.
In step 1220, the item setting part 1120 may set an item for the generation of the secondary content based on a location stored in the content database or an item generation request based on a user. For example, the project may be automatically generated by the server 150 or may be generated at the request of the user.
In step 1230, the item providing part 1130 may provide the item to the electronic device of at least one of the user who requests the generation of the item, the user who selects the item, and the user who selects based on the location in the server 150.
For example, a user selecting an item may include a user selecting the same item in the items provided by server 150. Also, the server 150 may select a user of the electronic device located at a specific location based on the location. At this time, the server 150 may select a user based on the position of the user (the position of the electronic device of the user) among users who have set mutual relationships (for example, friendships in a social network service) in a service (for example, a social network service) associated with the server 150, or among users who communicate with each other through one communication session (for example, a chat session window) in a service (for example, a chat service) associated with the server 150 (for example, users who connect to the same session window to conduct a chat). The project providing unit 1130 can provide a project by a wide variety of users according to the nature of the project.
In step 1240, the secondary content generating part 1140 may generate secondary content related to the item using the received primary content generated in the electronic device based on the item. That is, if the user generates the primary content by the electronic device according to the item and transmits the generated primary content, the secondary content generating unit may generate the secondary content using the transmitted primary content.
For example, the primary content may include a video related to a place contained in the item or a photographed object specified by the item. In this case, the secondary content generator 1140 may generate at least one of a panoramic image, a three-dimensional image, and a moving image as the secondary content in the synchronized image. Also, at least one of the primary contents may further include an audio source or information related to the audio source. At this time, the secondary content generating unit 1140 synchronizes the videos, and adds a received sound source or a sound source acquired by information on the received sound source to at least one of the generated videos, thereby generating a secondary content. The server 150 can select a specific sound source and add the selected sound source to the video even if the sound source or the information related to the sound source is not provided for one content.
In another embodiment, the secondary content generating part 1140 may generate the secondary content using the content retrieved in the content database and the primary content through the location related to the generation of the primary content in step 1240. For example, for one item, content generated at other points in time may be stored in the content database, and similar content may be uploaded and stored in the content database in advance by other items than the item. Therefore, the secondary content generating section 1140 can generate secondary content by further using the content stored in such a content database.
Services related to the server 150, such as the above-described chat service or social network service, may be provided to the user through an application (e.g., a chat application or an SNS application, etc.) driven in the electronic device. At this time, the item can be pushed (push) to the electronic device through such an application or provided to the electronic device connected to the communication session through the communication session (e.g., a session window of a chat service) according to the control of the application.
As another example, the project utilizes content stored in a content database, which may include tasks for generating insufficient content when generating secondary content. At this time, the item providing part 1130 transmits the item to the electronic device of the first user who selects the item, and may request the generation of insufficient content in step 1230. For example, the item according to the present embodiment may be information requesting the user for content further required for generating secondary content in the current content database. More specifically, when selecting the type of a work (secondary media) that the user desires to create, the server 150 searches for a part (content) that is insufficient when creating the work by using the content (content uploaded by the reference user) stored in the database, and can distribute the part (content) to the user a for each task.
As another embodiment, the item provider 1130 provides an item to the electronic devices of the users who selected the same item in step 1230, and may connect a communication session between the electronic devices of the users who selected the same item. For example, when the user a and the user B select the same item to produce the same kind of works, the server 150 provides the item to the electronic device of the user a and the electronic device of the user B, and opens a conversation window for the user a and the user B, so that both users can be connected. In this way, the server 150 can support users who are not aware of each other by creating a dialog window and connecting the users to each other for users who want to perform the same project, and can easily cooperate with each other for the same project.
As another example, the method of FIG. 12 may further include the following two steps: it is decided whether the primary content of the first user receiving the first item is content required for receiving a second user providing the second item (not shown), and when the primary content of the first user is content required for the second user, the primary content of the first user is provided to the electronic device of the second user to be shared as content for the second item (not shown). The processor 222 may further include a content sharing part (not shown) that may perform the steps not shown according to the present embodiment. In this way, even if the contents are generated by users who perform different items, the users can share the contents necessary for each other.
As another example, content uploaded through one communication session by users communicating with each other through one communication session is utilized so that the project may further include tasks for generating secondary content. At this time, the secondary content generating unit 1140 may generate secondary content using the content uploaded through one communication session as the first content in step 1240. For example, when a user a, a user B, and a user C who return to travel together or are currently traveling together are uploaded in a conversation window to share a travel photo, the server may generate secondary content using the content uploaded by the participants of the conversation window. At this time, the uploaded travel photos, even though not the photos related to each other, are mixed with the photos shared in the dialogue window, and secondary contents such as a travel story can be generated and provided.
As another example, the primary content may include a first picture that together includes the subject specified by the item and the first user, and a second picture that together includes the subject and the second user. At this time, the secondary content generator 1140 may generate a third image including the subject, the first user, and the second user as the secondary content by combining the first image and the second image in step 1240. For example, a first user and a second user who have taken the same subject and photograph may provide a composite photograph as secondary content as if they had traveled together by traveling different from each other.
As another example, the primary content may include a first image including the subject specified by the item and a second image including the photographer of the first image. In this case, the secondary content generator 1140 may generate a third image including the subject and the photographer by combining the first image and the second image in step 1240. For example, when the first user generates an image for photographing an object and the second user generates an image for photographing the first user, the secondary content generating unit 1140 may synthesize the two images and generate an image including all of the object and the first user.
As another example, the item may include information related to a place for photographing or a photographed object, and the one-time content may include an image photographed at the place or an image photographed the photographed object. At this time, the method of fig. 12 may further include the following steps (not shown): and generating information of a recommended shooting position or a recommended shooting angle related to the place or the object to be shot based on the content stored in the content database, and further transmitting the information to the user receiving the item. For example, the user may be provided with recommendation information at which position or angle the user shot better based on the existing generated primary content or secondary content in the same position as the position where the user is located. The memory 222 further includes a recommendation information providing part (not shown) that can perform the not shown stage according to the present embodiment.
As another example, the method of FIG. 12 may further include the steps of: extracting content (not shown) in a content database based on a location associated with the generation of the primary content received from the first user; and generating desired content related to the secondary content using the extracted content and the primary content, and providing the desired content to the first user (not shown). For example, when a user generates a content, the server 150 can predict a result using a reference content, and provide the user with a function such as a preview. The predicted content generating part (not shown) that the memory 222 may further include may perform the steps not shown according to the present embodiment.
As another example, the item may include secondary content generated with the participation of the first user. At this time, the item providing part 1130 may provide the item to the second user set to have an acquaintance relationship with the first user in the service associated with the server 150 in step 1230. At this time, the second user may be provided with the secondary content generated by the participation of the first user.
As another example, the primary content may include a first picture including the first user and the second user and a second picture including the third user. In this case, the secondary content generator 1140 may generate a third video for changing the first user or the second user to the third user by combining the first video and the second video in step 1240.
As another embodiment, the item setting part 1120 receives an item generation request including a location associated with the content of the first user and the generation of the content of the first user from the electronic device of the first user, thereby enabling setting of an item. At this time, the item providing unit 1130 may provide the selected user with an item based on the position related to the generation of the content of the first user. For example, when a user takes an image related to a specific event or accident and requests the generation of an item, the user at a location related to the event or accident may request the generation of the image related to the event or accident.
As another example, a project may include information requesting task participation from a user uploading content within a certain time of the same venue. In this case, the secondary content generating unit 1140 may generate the secondary content by responding to the information requesting the task participation in step 1240 and using the content received from the electronic device of the user permitted to participate in the task as the primary content. For example, when a user uploads content at a similar point in time at the location according to a particular event or incident, secondary content related to the event or incident may be generated using the uploaded content.
As another example, the primary content may include images of a photographed object specified by a place or item included in the item photographed in mutually different positions or mutually different angles. At this time, in the method of fig. 12, when the image of the position required for the generation of the secondary content or the image of the angle required for the generation of the secondary content is not present or insufficient, a new item including information about the required position or the required angle is transmitted to the electronic device located at the place to request the image, or a new item is transmitted to the electronic device of the user participating in the communication session of the service related to the server 150 to request the image (not shown). In this manner, when the material for generation of the secondary content (primary content) is insufficient, the user can be requested to generate the material and provide it. The memory 222 may further include an image requesting unit (not shown) that may perform the steps not shown according to the present embodiment.
As another example, the item providing part 1130 may transfer the item to the electronic device located at the same place based on the current location of the electronic device among the electronic devices of the users who set an actual relationship with each other in the service connected to the server 150 in step 1230. At this time, the transferred items may include: information for designating at least one of users of electronic devices located in the same place as a subject; action information requested from a user who is specified as a subject; and angle or position-related information of the remaining user who shot the user designated as the shot object. For example, an item for acquiring a picture taken with a specific user as a subject among users in the same place may be provided to the user. As another example, a user designated as a photographed object may also provide a task at the moment of performing a pre-designated action (e.g., jumping) so that the remaining users photograph the user designated as a photographed object at the same time. For this reason, information on the position, the shooting angle, and the like of the remaining user can be provided to the user through the items, with the subject as the subject.
As another example, the function for editing the item may be provided by an application driven in each of the electronic devices. At this time, the item setting part 1120 receives the item edited in the electronic device of the first user through the function in step 1220, and may set a new item. Also, the method of fig. 12 may further include the following steps (not shown): and extracting the content corresponding to the new content from the content database to generate the expected content, and providing the generated expected content to the electronic equipment of the first user. In this manner, a user editing a reference item may generate a new item, and the server 150 may provide the user with results related to the edited item in a preview modality. The memory 222 may further include a desired content generating part (not shown) that may perform steps not shown according to the present embodiment.
As another embodiment, the item may include a task of photographing one photographed object at the same time point. At this time, the method of fig. 12 may further include the following steps (not shown): and providing a shooting command with synchronous shooting time points to the electronic equipment of the users participating in the task. At this time, the electronic device can generate a video in which the subject is photographed at the same time by performing photographing at the synchronized photographing time point according to the photographing command received from the server 150. The photographing command providing part (not shown) that the memory 222 may further include may perform the not-shown steps according to the present embodiment.
Fig. 13 is a diagram illustrating an example of photographing a background at the same location according to an embodiment of the present invention, and fig. 14 is a diagram illustrating an example of generating a panorama (panorama) picture using photographs photographed at the same location according to an embodiment of the present invention.
Fig. 13 shows an example in which three smartphones 1310, 1320, 1330 take a background in the same location. The three smartphones 1310, 1320, 1330 may photograph the background at the same time as each other according to the task provided by the same project, or may photograph the background at different times (different time, date, week, month, year from each other). Further, the background may be individually photographed regardless of the item.
Fig. 14 shows an example of three smartphones 1310, 1320, 1330 taking photos 1410, 1420, 1430 uploading to the server 150 and using the photos 1410, 1420, 1430 uploaded to the server 150 to generate one panoramic photo 1440. Such a panoramic photograph 1440 may be generated as secondary content related to an item when the photographs 1410, 1420, 1430 are associated with the item. And, even if it is not the secondary content of the specific item, it can be generated with reference (the intended content provided to other users of the place) to be provided to other users.
Fig. 15 is a diagram illustrating a photographing example for three-dimensional picture generation according to an embodiment of the present invention. Fig. 15 shows a pattern in which a plurality of smart phones 1521 to 1528 photograph one photographed object 1510 at a certain angle. As one example, items provided by the plurality of smartphones 1521 to 1528 may include a task of photographing the subject 1510 and may also include information on a position (angle) at which the subject 1510 is to be photographed. Specifically, eight pieces of location information for eight users may be included in the item. At this time, the photographing position for each user may be previously designated according to the server 150, and the individual photographing position may also be determined by an agreement between users. The pictures taken by the plurality of smartphones 1521 to 1528 may be transmitted to the server 150 as primary contents, and the server 150 may generate secondary contents such as a three-dimensional image related to the photographed object 1510 using the transmitted pictures.
As already described, when a plurality of smartphones 1521 to 1528 simultaneously photograph a subject 1510, if the user directly executes a shutter (operation (screen touch or the like) for photographing of the smartphones 1521 to 1528), it is difficult to simultaneously photograph the subject 1510. Accordingly, the server 150 may control to transmit a command for synchronization of photographing time to the plurality of smartphones 1521 to 1528, and thus photograph the subject 1510 at the same time by the plurality of smartphones 1521 to 1528 at the synchronized time.
Fig. 16 is a diagram illustrating an example of guiding a user to a photographing position according to an embodiment of the present invention. For example, the server 150 may guide the user to move to a photographing position using position information (e.g., GPS coordinates) received from the user's terminal. For example, the server 150 may transmit information for guiding the user to move to a photographing position to the user's terminal. At this time, the application provided at the user terminal may control the terminal to display the information received from the server 150 through the display of the terminal as shown in the first dotted line box 1610. In case of being located at a photographing position intended by the user, the server 150 may transmit information for guiding photographing to be performed at a corresponding position, such as the second dotted frame 1620, to the terminal of the user. Similarly, an application provided in the user terminal may control the terminal to display information received from the server 150 through the display of the terminal as displayed in a second dotted box 1620.
At this time, the position of the user can be confirmed by using information input through a camera of the terminal in addition to the GPS coordinates. For example, the image of the object photographed by the camera of the terminal photographed by the user may be transmitted to the server 150 according to the control of the application program. At this time, the image of the subject transmitted from the analysis server 150 can determine whether or not the image of the subject at another angle is necessary. In case that the image of the subject in another angle is requested for the generation of the secondary contents, the server 150 may guide the movement of the user so that the user photographs the subject in the corresponding angle.
The technique of guiding the user to the shooting position can also flexibly utilize map information and the like similar to navigation.
Fig. 17 is a diagram illustrating an example of guiding task participation of a user through a chat room, according to one embodiment of the invention. Fig. 17 shows a screen example 1700 of guiding participation in a shooting task to a user connected to the group conversation window through the group conversation window. That is, fig. 17 shows one example of transferring items to users communicating through the same communication session. At this time, when there is a user having a shooting intention, the server 150 may provide the user with specific information for the progress of such items. If the user having the shooting intention is insufficient to generate the secondary content for the item, the user may request a plurality of primary contents from the same user, and may further additionally select another user and guide participation in the item.
As described above, according to the embodiments of the present invention, the generated item is provided to the specific user based on the item generated according to the request of the user or the received content, and the user can be guided to generate the content based on the item, and the user generates the secondary content by the content generated in association with the item, and the calculation amount required for generating the result that may be previously specified in the setting process of the item can be minimized.
The apparatus described above can be realized by hardware components, software components, and/or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented by one or more computers or special purpose computers, such as a Processor, a controller, an Arithmetic Logic Unit (ALU), a Digital Signal Processor (Digital Signal Processor), a microcomputer, a Field Programmable Array (FPA), a Programmable Logic Unit (PLU), a microprocessor, or any other device capable of executing commands and responding. The processing device may execute an Operating System (OS) and one or more software applications executed in the operating system. And, the processing device responds to the execution of the software, and may access, store, manipulate, process, and generate data. Although the processing device is described as using one for ease of understanding, one having ordinary knowledge in the related art may know that the processing device may include a plurality of processing elements and/or a plurality of types of processing elements. For example, the processing device may include multiple processors, or one processor and one controller. And may also be constituted by other processes such as parallel processors (parallel processors).
The software may comprise a computer program (computer program), code, commands, or a combination of more than one of them, and may constitute the processing means, either alone or in combination (collectively) command processing means, as desired. Software and/or data may be embodied permanently or temporarily in any type of machine, component, physical device, virtual device (virtual equipment), computer storage medium or device, or transmitted signal wave (signal wave) based on the processing device being interpreted or for the purpose of providing commands or data to the processing device. The software is distributed in computer systems connected to a network, and may be stored or executed in a distributed manner. The software and data may be stored in more than one computer readable and writable recording medium.
The method according to the embodiment may be implemented in the form of program commands executable by various computer apparatuses and may be recorded in a computer readable and writable medium. The computer readable and writable medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded in the above-mentioned medium may be specially designed and constructed for the embodiments or may be used as known to those skilled in the computer software arts. Examples of the computer readable and writable recording medium may include magnetic media (magnetic media) such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROM, DVD; magneto-optical media such as floptical disk (floptical disk); and hardware devices such as ROM, RAM and flash memory (flash memory) that are specially constructed to store and execute program commands. Examples of the program command include not only machine language code written by a programmer but also high-level language code that is executable according to a computer using an interpreter (interpreter) or the like. The hardware devices may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.
As described above, although the embodiments and the drawings defined by the embodiments have been described, it is apparent to those skilled in the art that various modifications and variations can be made from the above description. For example, the present invention may be carried out in a different order from the method described in the technology described, or may be combined or combined in a different manner from the method described for the constituent elements such as the system, the structure, the device, the circuit, and the like described, or may be replaced or substituted with other constituent elements or equivalents.
Accordingly, other implementations, embodiments, and equivalents to the scope of the claims are intended to be within the scope of the claims.
The present invention can also be realized by the following embodiments.
Embodiment 1, a computer-implemented method, comprising the steps of:
storing and managing information including content received by a server from an electronic device of a user and a location associated with generation of the content in a content database;
setting an item for generation of secondary content based on the location stored in the content database or based on a user's item generation request;
providing the item to an electronic device of at least one of a user requesting generation of the item, a user selecting the item, and a user selected from the server based on the location; and
generating secondary content related to the item using the received primary content generated in the electronic device based on the item.
Embodiment 2 of the computer-implemented method according to embodiment 1, wherein the primary content includes a video related to a place included in the item or a subject specified by the item,
the step of generating the secondary content includes:
and synchronizing the images to further generate at least one image of the panoramic image, the three-dimensional image and the animation image as the secondary content.
Embodiment 3 the computer-implemented method of embodiment 2, wherein at least one of the primary content further comprises an audio source or information related to the audio source,
the step of generating the secondary content includes:
and synchronizing the images, and adding the sound source to the at least one generated image to further generate the secondary content.
Embodiment 4 is the computer-implemented method according to embodiment 1, wherein at least one user is selected from the users selected by the server based on the location, the users having a relationship with each other set by the service associated with the server, and the users communicating through a communication session in the service associated with the server, based on the location.
Embodiment 5 the computer-implemented method of embodiment 1, wherein the step of generating the secondary content comprises:
generating the secondary content using the content retrieved in the content database and the primary content through a location associated with the generation of the primary content.
Embodiment 6 the computer-implemented method of embodiment 1, wherein the item is pushed to the electronic device by an application driven in the electronic device, or provided to an electronic device connected to the communication session through the communication session of the service associated with the server according to control of the application.
Embodiment 7 the computer-implemented method of embodiment 1, wherein the item comprises a task for generating insufficient content when generating the secondary content using the content stored in the content database,
the step of providing the item includes: transmitting the item to an electronic device of a first user that selects the item, thereby requesting generation of the insufficient content.
Embodiment 8, the computer-implemented method of embodiment 1, wherein the step of providing an item comprises: the items are provided to electronic devices of users who select the same item, and a communication session is connected between the electronic devices of the users who select the same item.
Embodiment 9, the computer-implemented method of embodiment 1, further comprising the steps of:
determining whether primary content of a first user who receives a first item is content required by a second user who receives a second item; and
and when the primary content of the first user is the content required by the second user, providing the primary content of the first user to the electronic equipment of the second user to be shared as the content for the second item.
Embodiment 10, the computer-implemented method of embodiment 1, wherein the item includes a task for generating the secondary content using content uploaded through a communication session by users communicating with each other through the communication session by a server associated with the server,
the step of generating the secondary content includes: and using the content uploaded through the communication session as the primary content, and further generating the secondary content.
Embodiment 11 the computer-implemented method of embodiment 1, wherein the primary content comprises a first image containing both the subject and the first user specified by the item and a second image containing both the subject and the second user,
the step of generating the secondary content includes: and synthesizing the first image and the second image to generate a third image including the object to be shot, the first user and the second user as the secondary content.
Embodiment 12 the computer-implemented method according to embodiment 1, wherein the primary content includes a first image including the subject specified by the item and a second image including a photographer of the first image,
the step of generating the secondary content includes: and synthesizing the first image and the second image to generate a third image including the object to be shot and the photographer.
Embodiment 13, the computer-implemented method according to embodiment 1, wherein the item includes information related to a place for shooting or a subject, the primary content includes an image shot at the place or an image shot of the subject,
and, the method further comprises the steps of:
generating information related to a recommended photographing position or recommended photographing angle with respect to the place or the photographed object based on the contents stored in the contents database, and further providing the information to the user who receives the item.
Embodiment 14, the computer-implemented method of embodiment 1, further comprising the steps of:
extracting content in the content database based on a location associated with the generation of the primary content received from the first user; and
and generating expected content related to the secondary content by using the extracted content and the primary content, and further providing the expected content for the first user.
Embodiment 15, the computer-implemented method of embodiment 1, wherein the item comprises secondary content generated by participation of a first user,
the step of providing the item includes: providing the item to a second user having an acquaintance relationship set with the first user in a service associated with the server.
Embodiment 16 the computer-implemented method of embodiment 1, wherein the primary content comprises a first image comprising a first user and a second image comprising a third user,
the generating of the second content includes: and synthesizing the first image and the second image to generate a third image for changing the first user or the second user into the third user.
Embodiment 17, the computer-implemented method of embodiment 1, wherein the step of setting the items comprises: receiving an item generation request including content of a first user and a location related to generation of the content of the first user from the electronic device of the first user, thereby setting the item,
the step of providing the item includes: providing the item to the user selected by the server based on the location associated with the generation of the content by the first user.
Embodiment 18, the computer-implemented method of embodiment 1, wherein,
the item includes information for requesting task participation from a user who uploads content at the same place for a certain time,
the step of generating the secondary content includes: and generating the secondary content by using, in response to the information for requesting the task participation, the content received from the electronic device of the user permitted to participate in the task as the primary content.
Embodiment 19, the computer-implemented method according to embodiment 1, wherein the primary content includes taking images of places included in the item or objects specified by the item at positions different from each other or angles different from each other,
and, further comprising the steps of: when the image for the position required for the generation of the secondary content or the image for the angle required for the generation of the secondary content is not present or insufficient, transmitting a new item including information related to the required position or the required angle to the electronic device located at the place to request the image, or transmitting the new item to the electronic device of the user participating in the communication session of the service related to the server to request the image.
Embodiment 20, the computer-implemented method of embodiment 1, wherein the step of providing the item comprises: transmitting an item to an electronic device located in the same place based on a current position of the electronic device among electronic devices of users who have an acquaintance relationship mutually set in a service connected with the server, the item including: information for designating at least one of users of electronic devices located at the same place as a subject; action information requested from a user designated as the subject; and information related to an angle or position at which the remaining users shot the user designated as the shot object.
Embodiment 21 the computer-implemented method of embodiment 1, wherein the function for editing the item is provided by an application driven in the electronic device,
the setting of the items includes:
through the function, an item edited in the electronic device of the first user is received, thereby setting a new item.
Embodiment 22, the computer-implemented method of embodiment 21, further comprising the steps of:
and extracting the content corresponding to the new item from the content database, further generating expected content, and providing the generated expected content to the electronic equipment of the first user.
Embodiment 23, the computer-implemented method of embodiment 1, wherein the items include a task of photographing an object at the same time point,
and the method further comprises the steps of: providing a photographing command synchronized with a photographing time point to the electronic device of the user participating in the task,
and the electronic device performs photographing at the synchronized photographing time point according to the photographing command.
Embodiment 24, a system comprising one or more processors, wherein the one or more processors comprise:
a content management unit that stores and manages content received from an electronic device of a user and information including a position related to generation of the content in a content database;
an item setting unit that sets an item for generating secondary content based on the location stored in the content database or an item generation request by a user;
an item providing unit that provides the item to an electronic device of at least one of a user who requests generation of the item, a user who selects the item, and a user who is selected based on the location; and
and a secondary content generation unit configured to generate a secondary content related to the item based on the item using the received primary content generated in the electronic device.
Embodiment 25 of the system according to embodiment 24, wherein the primary content includes an image related to a place where the item is included or a subject specified by the item,
the secondary content generating unit is further configured to synchronize the videos, and further generate at least one of a panoramic video, a three-dimensional video, and an animated video as the secondary content.
Embodiment 26 and the system according to embodiment 24, wherein at least one user is selected based on the location from among the user selected based on the location, the user having a relationship with each other set by the service associated with the server, and the user communicating in the service associated with the server through one communication session, and the item is pushed to the electronic device by an application driven in the electronic device, or the item is provided to the electronic device connected to the communication session through the communication session of the service associated with the server according to control of the application.
Embodiment 27 the system of embodiment 24, wherein the secondary content generating section is configured to generate the secondary content using the content retrieved in the content database and the primary content through a location associated with the generation of the primary content.