WO2016106494A1 - 一种实现媒体对象显示的方法、装置及*** - Google Patents

一种实现媒体对象显示的方法、装置及*** Download PDF

Info

Publication number
WO2016106494A1
WO2016106494A1 PCT/CN2014/095306 CN2014095306W WO2016106494A1 WO 2016106494 A1 WO2016106494 A1 WO 2016106494A1 CN 2014095306 W CN2014095306 W CN 2014095306W WO 2016106494 A1 WO2016106494 A1 WO 2016106494A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
media object
collection
media
video
Prior art date
Application number
PCT/CN2014/095306
Other languages
English (en)
French (fr)
Inventor
林家荣
赵丛
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201480083242.XA priority Critical patent/CN107079144B/zh
Priority to PCT/CN2014/095306 priority patent/WO2016106494A1/zh
Publication of WO2016106494A1 publication Critical patent/WO2016106494A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • G06F16/444Spatial browsing, e.g. 2D maps, 3D or virtual spaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B29/00Maps; Plans; Charts; Diagrams, e.g. route diagram
    • G09B29/10Map spot or coordinate position indicators; Map reading aids

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a method, device, and system for implementing display of a media object.
  • media objects such as images and videos, etc.
  • media objects are generally displayed in the order of time or file name.
  • the media objects recorded by the aerial photography of the drone are mainly based on photos and videos, and it is difficult for the user to determine by photo or video content. Aerial location.
  • the present invention provides a method, an apparatus, and a system for implementing display of a media object, so as to solve the technical problem that the display of the media object in the prior art is not intuitive and difficult to find.
  • a method of implementing display of a media object comprising:
  • the step of determining the display object that meets the preset condition from the media object and acquiring the location information corresponding to the display object further includes:
  • the image set is divided into at least one subset, and if the number of the images in the subset of the image set is greater than a quantity threshold, the image in the subset that meets the preset condition is Determined to be the display object;
  • the media object is a video
  • the media segment that meets the preset condition is selected from the video as a display object, and the collection location information corresponding to the display object is acquired.
  • the determining, by the media object, the display object that meets the preset condition, and acquiring the location information corresponding to the display object includes:
  • the media object is an image set
  • all the images in the subset are determined as display objects.
  • the method further includes:
  • the range of the subset is determined according to the collection location of the image collection and the distribution density of the image.
  • the method further includes:
  • the determining, by the media object, the display object that meets the preset condition, and acquiring the collection location information corresponding to the display object includes:
  • the media object is an image set
  • the image set is divided into at least one subset according to the collected trajectory, and an image that satisfies a preset condition in the subset is determined as a display object;
  • the media segment that meets the preset condition is selected from the video as a display object and the collection location information corresponding to the display object is acquired.
  • the determining, by the media object, the display object that meets the preset condition is obtained Taking the collection location information corresponding to the display object, including:
  • an image with the largest acquisition stability parameter is selected as a display object in each of the subsets;
  • a video segment is intercepted every preset time in the video or a video frame is determined as a display object every preset time in the video, and the display object is the The media object with the highest stability parameter in the preset time.
  • the stability parameter is determined according to the inertial measurement unit data in the collection posture information corresponding to the media object.
  • the determining, by the media object, the display object that meets the preset condition, and acquiring the collection location information corresponding to the display object includes:
  • the media object is an image set
  • the media object is a video
  • a video segment is intercepted every preset time in the video or a video frame is determined as a display object every preset time in the video
  • the display object is the a preset time stability parameter and a media object with the highest weighted summation of the point of interest parameter
  • the point of interest parameter is determined according to the collection location of the media object, the collection orientation of the media object, and the location of the point of interest.
  • the collection orientation of the media object is determined according to the collection posture information corresponding to the media object.
  • the point of interest location is obtained by receiving a location of the point of interest input by the user.
  • the method further includes:
  • the display object and other media objects within a preset range from the display object are displayed or played.
  • the method further includes:
  • the media object whose collection location is consistent with the point location information is acquired from the server for display or playback.
  • the method further includes: sharing the display location corresponding to the display object and the display object.
  • the displaying the acquisition track further includes: receiving a user modification instruction, and modifying the collection track.
  • An apparatus for implementing display of a media object characterized in that the apparatus comprises:
  • a determining module configured to determine, from the media object, a display object that meets a preset condition, and acquire collection location information corresponding to the display object
  • the first display module is configured to invoke the map data, and display the display object on the map according to the collection location of the display object.
  • the determining module comprises:
  • a first selecting unit configured to divide the image set into at least one subset when the media object is an image set
  • a second selecting unit configured to determine an image that meets a preset condition in the subset as a display object, or when the media object is a video, if the number of the images in the subset of the image set is greater than a quantity threshold A media segment that meets a preset condition is selected from the video as a display object and acquisition location information corresponding to the display object is acquired.
  • the determining module further includes:
  • a third selecting unit configured to determine, when the media object is an image set, all the images in the subset as the display object if the number of the images in the subset is less than or equal to a quantity threshold.
  • the device further comprises:
  • the second display module is configured to acquire the collected track information, invoke the map data, and display the collected track on the map according to the collected track information.
  • the first selecting unit is configured to: when the media object is an image set, divide the image set into at least one subset according to the collected track;
  • the second selecting unit is specifically configured to meet a preset bar in the subset of the image set
  • the image of the piece is determined as a display object, or when the media object is a video, a media segment that meets the preset condition is selected from the video as a display object and the collection location information corresponding to the display object is acquired.
  • the second selecting unit is specifically configured to:
  • an image with the largest acquisition stability parameter is selected as a display object in each of the subsets;
  • a video segment is intercepted every preset time in the video or a video frame is determined as a display object every preset time in the video, and the display object is the The media object with the highest stability parameter in the preset time.
  • the stability parameter is determined according to the inertial measurement unit data in the collection posture information corresponding to the media object.
  • the second selecting unit is specifically configured to:
  • the media object is an image set
  • the media object is a video
  • a video segment is intercepted every preset time in the video or a video frame is determined as a display object every preset time in the video
  • the display object is the a preset time stability parameter and a media object with the highest weighted summation of the point of interest parameter
  • the point of interest parameter is determined according to the collection location of the media object, the collection orientation of the media object, and the location of the point of interest.
  • the collection orientation of the media object is determined according to the collection posture information corresponding to the media object.
  • the point of interest location is obtained by receiving a location of the point of interest input by the user.
  • the device further comprises:
  • the third display module is configured to display or play the display object and other media objects within a preset range from the display object after receiving a display trigger signal input by the user by clicking the display object.
  • the device further comprises:
  • An uploading module configured to upload the media object and a corresponding collection location to a server
  • a fourth display module configured to: when the user clicks on any point on the map, obtain, from the server, a media object whose acquisition location is consistent with the location information of the point for display or play.
  • the uploading module is configured to upload and share the collection location corresponding to the display object and the display object.
  • a system for implementing display of a media object comprising:
  • the media object collection device is configured to record the collection track information, collect the media object, record the collection location corresponding to the media object, and collect the posture information; and the collection track information, the media object, and the media object corresponding to the collection object The collection location and the collection attitude information are transmitted to the display terminal;
  • the display terminal is the above device for realizing display of a media object.
  • the embodiment of the present invention analyzes the collection position and the collected posture information by acquiring the media object and the corresponding collection position and the collected posture information, and screens out the image or video frame with a certain interval of the collection position and is stable. Displayed on the corresponding position of the map, the user can visually see the relationship between the media object and the geographical location when viewing the media object, and the display is intuitive, and the position of the search content can be determined more quickly by displaying the index of the object, which is greatly convenient. User review.
  • FIG. 1 is a flowchart of Embodiment 1 of a method for displaying a media object according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of collecting media objects in an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of implementing a media object display result according to an embodiment of the present invention.
  • Embodiment 4 is a flowchart of Embodiment 2 of a method for displaying a media object according to an embodiment of the present invention
  • FIG. 5 is a flowchart of Embodiment 3 of a method for displaying a media object according to an embodiment of the present disclosure
  • FIG. 6 is a flowchart of Embodiment 4 of a method for displaying a media object according to an embodiment of the present invention
  • FIG. 7 is a schematic diagram of Embodiment 1 of implementing a media object display apparatus according to an embodiment of the present disclosure
  • FIG. 8 is a schematic diagram of an embodiment of implementing a media object display system according to an embodiment of the present invention.
  • the method, the device and the system for implementing the display of the media object provided by the embodiment of the present invention are directed to the technical problem that the display of the media object in the prior art is not intuitive and difficult to find, and it is proposed to record the corresponding collection location and the collection when collecting the media object.
  • the posture information can be selected according to the collection position of the media object and the acquisition posture, and the stable image or video frame in each region can be displayed and displayed on the corresponding position of the map to achieve better media object presentation effect.
  • the method for implementing the display of the media object according to the embodiment of the present invention will be described from the perspective of the device for displaying the media object.
  • the device for displaying the media object may be integrated into the client, and the client may be loaded in the terminal.
  • the client may be loaded in the terminal.
  • it can be a smart phone, a tablet computer, an e-book reader, a MP3 (Moving Picture Experts Group Audio Layer III) player, and an MP4 (Moving Picture Experts Group Audio Layer IV). Standard audio level 4) Players, laptops and desktop computers, etc.
  • FIG. 1 it is a first embodiment of a method for implementing display of a media object provided in an embodiment of the present invention, which may include the following steps:
  • Step 101 Acquire the collected media object, and obtain the collection location corresponding to the media object and the collection posture information.
  • the media object includes a combination of any one or more of image, video, and audio. And obtaining the collected media object, the acquisition location corresponding to the media object and the collection posture information may also be acquired.
  • the collection position of the media object can be recorded, and the collection location can be
  • the GPS (Global Positioning System) information is used for identification, and the collection attitude information of the media object can be recorded.
  • the acquisition posture information can be inertial measurement unit data, and the inertial measurement unit data can include the collection device when collecting the media object.
  • the three-axis attitude angle, or angular rate, and acceleration are used to represent the acquisition pose of the media object.
  • the collecting posture information may further include information such as an acquisition orientation, a collection height, and the like. It can be understood that when the media object is an image, each image may have a corresponding collection position and acquisition posture information; when the media object is a video, each video frame in the video may have a corresponding collection position and Collect gesture information.
  • the collected track information in the process of collecting media objects, may also be recorded, and the collected track information refers to the motion track of the media object collecting device, that is, the collected track, and the collection position of each media object may be understood. On the acquisition track.
  • the aerial equipment can generate a track file, record a series of time, GPS information and inertial measurement unit data. If the media object is collected, At the same time, the recorded GPS information and the inertial measurement unit data are written into the attribute information of the media object, for example, an Exif (Exchangeable Image File) information of the image is written, and the Exif information may be included in the shooting process.
  • Exif Exchangeable Image File
  • the aerial equipment shown in Figure 2 is only It is indicative of, but not limited to, such aerial photography equipment.
  • the client When the user needs to browse the media object by using the client loaded on the display terminal, the client needs to first obtain the collected media object and the collection location and the collection posture information corresponding to the media object, so as to analyze the collection location of the media object by the subsequent steps. Collecting gesture information selects some media objects for display.
  • Step 102 Determine a display object that meets a preset condition from the media object and acquire collection location information corresponding to the display object.
  • the display area of the display terminal is limited, and if the number of media objects is large, there is no The method is displayed at the same time, so that when the media object is displayed on the client, the media object needs to be filtered, and an image or a video frame with a certain interval of the collection position and a stable acquisition posture is selected as the selected presentation, and the stable posture of the collection generally represents the image quality. better.
  • the image set is divided into at least one subset, and if the number of the images in the subset of the image set is greater than a quantity threshold, the image in the subset that meets the preset condition is Determining to be a display object; if the number of the images in the sub-set is less than or equal to a quantity threshold, determining all of the images in the subset as display objects.
  • the range of the subset may be determined according to the collection location of the image collection and the distribution density of the image. If the number of images in a certain area is large, that is, the image density is large, several sub-sets are divided, and correspondingly, the area with a small image density is divided into several sub-sets.
  • the media object is an image collection
  • the number of each sub-set image is small, and the collection locations of the images are relatively scattered, that is, the number of images is less than or equal to the number threshold, and the difference between the collection positions of the images is If the distance is greater than or equal to the threshold, all the images can be directly selected for display. Otherwise, the image that meets the preset condition in the subset is determined as the display object.
  • the quantity threshold and the distance threshold may be set according to actual conditions, which is not limited in the present invention.
  • the media object is a video
  • the video frame can be directly selected from the video for display.
  • the media segment that meets the preset condition may be selected from the video as a display object and the collection location information corresponding to the display object may be acquired.
  • the media segment may be a video segment or a video frame.
  • the collected track information may be acquired, the map data is invoked, and the collected track is displayed on the map according to the collected track information.
  • the image set is divided into at least one subset according to the collected trajectory, and an image that satisfies a preset condition in the subset is determined as a display object.
  • the media object is a video
  • the media segment that meets the preset condition is selected from the video as a display object and the collection location information corresponding to the display object is acquired.
  • the display object in order to ensure that the determined display object has better The effect is displayed, and the display object needs to meet a preset condition.
  • the media object is an image set
  • the image with the largest stability parameter or the stability parameter and the image with the largest weighted sum of the interest point parameters are selected as the image.
  • Display object When the media object is a video, a video segment may be intercepted every preset time in the video or a video frame may be determined as a display object at the preset time in the video, where the display object is the The media object with the highest stability parameter or the stability parameter and the point of interest parameter are weighted and summed to the largest media object in the preset time.
  • Step 103 Invoke the map data, and display the display object on the map according to the collection position of the display object.
  • the display object is selected from the media object, that is, the display object has a corresponding collection position. Further, in the embodiment of the present invention, the display position of the display object is displayed on the map according to the collection position of the display object. Consistent with the collection location of the display object, the user can intuitively obtain the collection location of the media object.
  • the collection location corresponding to the display object and the display object can be uploaded to a sharing platform such as the cloud, so that other users can view it, and it is also convenient to view display objects shared by other users in the same place.
  • the collected track information may also be acquired, the map data is invoked, and the collected track is displayed on the map according to the collected track information. Displaying the acquisition trajectory on the map may be performed before any of steps 101, 102, and 103, which is not limited thereto.
  • the collected trajectory displayed on the map may be modified to present a form desired by the user, such as changing the length and route of the collected trajectory.
  • the object collection device is an unmanned aerial camera device.
  • the map API Application Programming Interface
  • the recorded GPS data draws the flight trajectory on the map, and then reads the media objects such as images and their Exif data. If the number of images is small and the locations are scattered, the thumbnails of the images are inserted into the corresponding map points. If the number of pictures is large or concentrated, you can choose to disperse and have the highest stability when shooting, that is, pictures with higher picture quality are placed on the map. Allows users to visually see the content of an image or video and its specific location on the map for optimal rendering.
  • the display object and other media objects within a preset range from the display object may also be displayed or played after receiving the display trigger signal input by the user by clicking the display object.
  • Displayed on the map is a selected media object, the user can click on the media object, ie click on the display object, to trigger the display object and other media objects within a preset range from the media object.
  • the preset range may be a preset range from the distance of the display object space, or may be a preset range on the shooting time of the display object, and the preset range may be flexibly set according to actual conditions.
  • the embodiment of the present invention analyzes the collected position and the collected posture information by acquiring the media object and the corresponding collection position and the collected posture information, and screens out the image or video frame with a certain interval of the collection position and is stable. Select and display on the corresponding position of the map, so that when viewing the media object, the user can visually see the relationship between the media object and the geographical location, and the display is intuitive, and the position of the search content can be determined more quickly by displaying the index of the object, which is very convenient. User review.
  • the method for realizing the display of the media object provided in the embodiment of the present invention is described below by using three different embodiments, and the focus is on how to select the display object from the media object.
  • FIG. 4 it is a second embodiment of the method for implementing media object display according to the embodiment of the present invention.
  • the media object is an image
  • the following steps may be included:
  • Step 401 Acquire an acquired image set.
  • Step 402 Divide the image set into at least one subset.
  • the corresponding collection position of the image set may be an area, and dividing the image set into at least one subset according to the collection position of the image collection and the distribution density of the image, if a certain area is collected If the number of images is large, that is, the image density is large, several sub-sets are divided, and correspondingly, the regions with smaller image densities are divided into several sub-sets.
  • the selection condition of the subset may be to ensure that the media object needs to be included in the subset.
  • the number of sub-sets and the shape and area of the sub-sets can be set according to actual conditions, which is not limited by the present invention.
  • Step 403 When only the stability parameter is acquired, an image with the largest acquisition stability parameter is selected as a display object in each subset.
  • Step 404 When obtaining the stability parameter and the point of interest parameter, select, in each subset, an image that is weighted and maximized by the stability parameter and the point of interest parameter as the display object.
  • step 403 and step 404 There is an "or" relationship between step 403 and step 404, that is, the two steps are two different embodiments for selecting display objects from within each subset. You can flexibly choose to obtain only the stability parameters or obtain the stability parameters and the parameters of the points of interest according to the actual situation. It can be understood that only the calculation parameters of the stability parameters are small, and the two parameters of the stability parameters and the points of interest are used together. Display object selection, the selected display object is closer to the user's needs.
  • the stability parameter is determined according to the collection posture information corresponding to the media object.
  • the stability parameter may be determined according to the inertial measurement unit data included in the collection posture information corresponding to the media object, and the inertial measurement unit data represents the collection of the media object.
  • the angular velocity or acceleration it can be understood that the smaller the angular velocity or acceleration of the media object acquisition device is, the higher the stability is when the media object is collected.
  • the high acquisition stability under the same definition condition means that the collected media object has better quality. .
  • the collection orientation of the media object may be determined according to the collection posture information corresponding to the media object; the location of the interest point input by the user is received; according to the collection location of the media object, the collection orientation of the media object, and the point of interest
  • the location calculates the point of interest parameters of the media object. That is, the point of interest parameter may be determined according to the collection location of the media object, the collection orientation of the media object, and the location of the point of interest, and the collection orientation of the media object may be according to the corresponding object of the media object.
  • the acquisition attitude information is determined, and the location of the interest point can be obtained by receiving the location of the point of interest input by the user.
  • the user's interest point position is point B. If the acquisition orientation is from point A to point B, the probability of collecting the image of the point of interest is very large, that is, the parameter of the point of interest is Big.
  • the collection position of the media object and the position of the interest point form a line segment, and the collection position of the media object is used as a starting point to generate a ray along the acquisition direction, and the line segment and the ray are The smaller the angle between less than 180 degrees, the larger the point of interest parameter, and the point of interest parameter may also be determined according to the distance between the collection location and the point of interest.
  • the point of interest parameter may represent the possibility of including user interest point information in the content of the media object.
  • the image with the largest stability parameter in each sub-set can be selected as the display object; the stability parameter of each image can be weighted and summed with the parameter of the interest point, and two different indicators are integrated in each sub-input.
  • the image with the largest weighted summation is selected as the display object in the set.
  • Step 405 Invoking the map data, displaying the display object on the map according to the collection position of the display object, so that the display position of the display object on the map is consistent with the collection position of the display object, or the display position of the display object on the map is The distance between the collection positions of the display objects is within the preset range.
  • This step is similar to step 103 and will not be described here.
  • FIG. 5 it is a third embodiment of the method for implementing media object display according to the embodiment of the present invention.
  • the media object is an image
  • the following steps may be included:
  • Step 501 Acquire the collected image set.
  • Step 502 Divide the image set into at least one subset according to the collected trajectory.
  • the corresponding collection position of the image set may be an area, and dividing the image set into at least one subset according to the collection position of the image collection and the distribution density of the image, if a certain area is collected If the number of images is large, that is, the image density is large, then Multiple sub-sets are divided, and correspondingly, areas with smaller image densities are divided into fewer sub-sets.
  • the selection condition of the subset may be to ensure that the media object needs to be included in the subset.
  • the number of sub-sets and the shape and area of the sub-sets can be set according to actual conditions, which is not limited by the present invention.
  • Step 503 When only the stability parameter is acquired, an image with the largest acquisition stability parameter is selected as a display object in each subset.
  • Step 504 When the stability parameter and the point of interest parameter are acquired, an image with the largest weighted summation by the stability parameter and the point of interest parameter is selected as a display object in each subset.
  • step 503 and step 504 There is an "or" relationship between step 503 and step 504, that is, the two steps are two different embodiments for selecting display objects from within each interval. You can flexibly choose to obtain only the stability parameters or obtain the stability parameters and the parameters of the points of interest according to the actual situation. It can be understood that only the calculation parameters of the stability parameters are small, and the two parameters of the stability parameters and the points of interest are used together. Display object selection, the selected display object is closer to the user's needs.
  • the image with the largest stability parameter in each interval may be selected as the display object, and the stability parameter and the interest point parameter of each image may also be selected.
  • the weighted summation is combined with two different indicators, and the image with the largest weighted summation is selected as the display object in each interval.
  • Step 505 Calling the map data, displaying the display object on the map according to the collection position of the display object, so that the display position of the display object on the map is consistent with the collection position of the display object, or the display position of the display object on the map is The distance between the collection positions of the display objects is within the preset range.
  • This step is similar to step 103 and will not be described here.
  • the method for implementing the display of the media object is provided in the embodiment of the present invention.
  • the media object is a video
  • the following steps may be included:
  • Step 601 Acquire the collected video.
  • Step 602 When only the stability parameter is acquired, according to the stability parameter, a video segment or a video frame is intercepted as a display object every preset time in the video. That is, each pre Set the time to select a video clip with the largest stability parameter or a video frame with the largest stability parameter.
  • Step 603 When obtaining the stability parameter and the point of interest parameter, according to the stability parameter and the point of interest parameter, a video segment or a video frame is intercepted as a display object every preset time in the video. That is, for each preset time, a piece of stability parameter and a point of interest parameter are selected to weight the summed video segment or a stability parameter and a point of interest parameter to weight the summed video frame.
  • For video you need to select key video clips or video frames from the video as display objects. You can capture a small video in a preset time period or capture a video frame every preset time period.
  • the preset time can be Set according to the actual situation.
  • step 602 and step 603 There is an "or" relationship between step 602 and step 603, that is, the two steps are two different embodiments for selecting a display object from each video segment.
  • the video frame with the largest stability parameter in each video segment can be selected as the display object, and the stability parameters of each video frame can also be
  • the point of interest parameter is weighted and summed, and two different indicators are integrated, and the video frame with the largest weighted summation is selected as the display object in each video segment.
  • Step 604 Calling the map data, displaying the display object on the map according to the collection position of the display object, so that the display position of the display object on the map is consistent with the collection position of the display object, or the display position of the display object on the map is The distance between the collection positions of the display objects is within the preset range.
  • This step is similar to step 103 and will not be described here.
  • the collected trajectory information input by the user and/or the collection location corresponding to the media object may also be received and saved.
  • the user can change the collection location and/or the acquisition track of the media object according to his or her preference. And save forever, the next time you open the client, you can display the media object according to the user's changed collection location information and the collection track. For example, the user can change the heart-shaped collection track to express your love and make the media object display more. Flexible and diverse.
  • the media object and the corresponding collection location may also be uploaded to the server; when the user clicks on any point on the map, the collection location and the media object corresponding to the location information are acquired from the server for display or playback.
  • Users can also choose to upload their favorite image media objects to the cloud server, share them with other users, and also see the media objects uploaded by other users to achieve a role in promoting communication.
  • the embodiment of the present invention analyzes the collected position and the collected posture information by acquiring the media object and the corresponding collection position and the collected posture information, and screens out the image or video frame with a certain interval of the collection position and is stable. Select and display on the corresponding position of the map, so that when viewing the media object, the user can visually see the relationship between the media object and the geographical location, and the display is intuitive, and the position of the search content can be determined more quickly by displaying the index of the object, which is great. It is convenient for users to check.
  • the first embodiment of the apparatus for implementing display of a media object provided in the embodiment of the present invention may include:
  • the device for implementing media object display includes an obtaining module 701, a determining module 702, and a first display module 703.
  • the obtaining module 701 can be configured to obtain the collected media object.
  • the collection location corresponding to the media object and the collection posture information may also be acquired.
  • the collection location of the media object can be recorded, and the collection location can be identified by using GPS information, and can be recorded at the same time.
  • the collected attitude information of the media object may be inertial measurement unit data, and the inertial measurement unit data may include an attitude angle of the three axes of the acquisition device, or an angular rate, and an acceleration, which is used to represent the collection of the media object. attitude.
  • the collecting posture information may further include information such as an acquisition orientation, a collection height, and the like. Understandably, when the media object is an image set In time, each image can have corresponding acquisition position and acquisition posture information; when the media object is video, each video frame in the video and the video frame in each video segment can have a corresponding collection position and Collect gesture information.
  • the collected track information in the process of collecting media objects, may also be recorded, and the collected track information refers to the motion track of the media object collecting device, that is, the collected track, and the collection position of each media object may be understood. On the acquisition track.
  • the acquiring module may first acquire the collected media object and the collection location and the collection posture information corresponding to the media object.
  • the determining module 702 is configured to determine a display object that meets the preset condition from the media object and obtain the collection location information corresponding to the display object, including: a first selecting unit 7021 and a second selecting unit 7022;
  • the first selecting unit 7021 may be configured to divide the image set into at least one subset when the media object is an image set.
  • the range of the subset may be determined according to the collection location of the image in the image collection and the distribution density of the image. If the number of images in a certain area is large, that is, the image density is large, several sub-sets are divided, and correspondingly, the area with a small image density is divided into several sub-sets.
  • the media object is an image collection
  • the number of each sub-set image is small, and each image collection location is relatively scattered, that is, the number of images is less than or equal to the number threshold, and the difference between the collection positions of the images is If the distance is greater than or equal to the threshold, all the images can be directly selected for display. Otherwise, the image that meets the preset condition in the subset is determined as the display object.
  • the quantity threshold and the distance threshold may be set according to actual conditions, which is not limited in the present invention.
  • the second selecting unit 7022 may be configured to determine, if the number of the images in the subset of the image set is greater than a quantity threshold, an image that meets a preset condition in the subset, as a display object, or Selecting a media segment that satisfies a preset condition from the video To display an object and obtain collection location information corresponding to the display object.
  • the media segments selected from the video may be video clips or video frames.
  • the determining module 702 may further include a third selecting unit, configured to: when the media object is an image set, and the number of images in the subset of the image set is less than or equal to a quantity threshold, All images are determined as display objects.
  • the media object is an image set
  • the image with the largest stability parameter or the stability parameter and the image with the largest weighted sum of the interest point parameters are selected as the image.
  • Display object When the media object is a video, a video segment may be intercepted every preset time in the video or a video frame may be determined as a display object at the preset time in the video, where the display object is the The media object with the highest stability parameter or the stability parameter and the point of interest parameter are weighted and summed to the largest media object in the preset time.
  • the first display module 703 can be configured to invoke the map data, and display the display object on the map according to the collection location of the display object.
  • the display object is selected from the media object, that is, the display object has a corresponding collection position. Further, in the embodiment of the present invention, the display position of the display object is displayed on the map according to the collection position of the display object.
  • the collection position of the display object is consistent, or the distance between the display position of the display object on the map and the collection position of the display object is within a preset range, so that the user can intuitively obtain the collection position of the media object or the range of the collection position.
  • the second display module may be further configured to acquire the collected track information, invoke the map data, and display the collected track on the map according to the collected track information.
  • the third display module is configured to display or play the display object and other media objects within a preset range from the display object after receiving the display trigger signal input by the user by clicking the display object.
  • the second embodiment of the device for displaying the media object provided in the embodiment of the present invention may include: when the media object is an image,
  • the obtaining module 701 is specifically configured to acquire the collected image set, and acquire the collection location corresponding to the image and the collected posture information.
  • the first selecting unit 7021 may be configured to select at least two subsets including the image in an area formed by the collection position of the image, where a distance between each of the subsets is greater than a distance threshold.
  • the corresponding collection position of the image set may be an area, and dividing the image set into at least one subset according to the collection position of the image collection and the distribution density of the image, if a certain area is collected If the number of images is large, that is, the image density is large, several sub-sets are divided, and correspondingly, the regions with smaller image densities are divided into several sub-sets.
  • the selection condition of the subset may be to ensure that the media object needs to be included in the subset.
  • the number of sub-sets and the shape and area of the sub-sets can be set according to actual conditions, which is not limited by the present invention.
  • the second selecting unit 7022 may be specifically configured to select, in each subset, an image with the largest acquisition stability parameter as the display object when only the stability parameter is acquired.
  • the second selecting unit 7022 may be specifically configured to select, in each subset, an image that is weighted and maximized by the stability parameter and the point of interest parameter as a display object when the stability parameter and the point of interest parameter are acquired.
  • the point of interest parameter may be determined according to the collection location of the media object, the collection orientation of the media object, and the location of the point of interest.
  • the collection orientation of the media object may be determined according to the collection posture information corresponding to the media object, and the location of the interest point may receive the interest input by the user. Point location acquisition.
  • the stability parameter may be determined according to the inertial measurement unit data included in the collection posture information corresponding to the media object, and the collection stability is high under the same definition condition, and the quality of the collected media object is better.
  • the point of interest parameter may represent the possibility of including user point of interest information in the content of the media object. In this way, when selecting a media object, the maximum stability parameter in each sub-collection can be selected.
  • the image As the display object, the image may also be weighted and summed with the stability parameter of each image and the parameter of the interest point, and two different indicators are integrated, and the image with the largest weighted summation is selected as the display object in each sub-set.
  • the first display module 703 can be used to call the map data, and display the display object on the map according to the collection position of the display object, so that the display position of the display object on the map is consistent with the collection position of the display object, or the display object is The distance between the display position on the map and the collection position of the display object is within a preset range.
  • the third embodiment of the device for implementing the display of the media object provided in the embodiment of the present invention may include: when the media object is an image,
  • the obtaining module 701 is specifically configured to acquire the collected image set, and acquire the collection location corresponding to the image and the collected posture information.
  • the first selecting unit 7021 divides the image set into at least one subset according to the collected trajectory.
  • the corresponding collection position of the image set may be an area, and dividing the image set into at least one subset according to the collection position of the image collection and the distribution density of the image, if a certain area is collected If the number of images is large, that is, the image density is large, several sub-sets are divided, and correspondingly, the regions with smaller image densities are divided into several sub-sets.
  • the selection condition of the subset may be to ensure that the media object needs to be included in the subset.
  • the number of sub-sets and the shape and area of the sub-sets can be set according to actual conditions, which is not limited by the present invention.
  • the second selecting unit 7022 may be specifically configured to select, in each subset, an image with the largest acquisition stability parameter as the display object when only the stability parameter is acquired.
  • the stability parameter may be determined according to the inertial measurement unit data in the collection posture information corresponding to the media object.
  • the second selecting unit 7022 may also be configured to select, in each subset, an image whose weighting is maximized by the stability parameter and the point of interest parameter as the display object.
  • the point of interest parameter may be based on the location of the media object, the location of the media object, and The point of interest location calculation determines that the collection orientation of the media object can be determined according to the collection gesture information corresponding to the media object, and the location of the interest point can be obtained by receiving the location of the point of interest input by the user.
  • the image with the largest stability parameter in each interval can be selected as the display object, or the stability parameter of each image and the parameter of the interest point can be weighted and summed, and two different indicators are integrated in each interval.
  • the image with the largest weighted summation is selected as the display object.
  • the first display module 703 can be used to call the map data, and display the display object on the map according to the collection position of the display object, so that the display position of the display object on the map is consistent with the collection position of the display object, or the display object is The distance between the display position on the map and the collection position of the display object is within a preset range.
  • the fourth embodiment of the device for implementing the display of the media object may include: when the media object is a video,
  • the obtaining module 701 is specifically configured to acquire the collected video, and acquire the collection location corresponding to the video and the collected posture information.
  • the first selecting unit 7021 can be specifically configured to intercept a video segment at a preset time in the video.
  • the preset time can be set according to the actual situation. Generally, it can meet the distance of the selected video clip.
  • the threshold is such that the display object selected from within each video segment can satisfy the dispersive condition.
  • the second selecting unit 7022 may be specifically configured to: when only the stability parameter is acquired, intercept a video segment or a video frame as a display object at the preset time in the video according to the stability parameter.
  • the stability parameter may be determined according to the inertial measurement unit data in the collection posture information corresponding to the media object.
  • the second selecting unit 7022 may be specifically configured to intercept a video segment or a video frame as a display object every preset time in the video according to the stability parameter and the point of interest parameter.
  • the point of interest parameter may be based on the location of the media object, the location of the media object, and The point of interest location calculation determines that the collection orientation of the media object can be determined according to the collection gesture information corresponding to the media object, and the location of the interest point can be obtained by receiving the location of the point of interest input by the user.
  • the video frame with the highest stability parameter in each video segment can be selected as the display object, and the stability parameters of each video frame and the parameter of the interest point can be weighted and summed, and two different indicators are integrated.
  • the video frame with the largest weighted summation is selected as the display object in the segment video segment.
  • the first display module 703 can be configured to invoke the map data, and display the display object on the map according to the collection position of the display object, so that the display position of the display object on the map is consistent with the collection position of the display object.
  • the acquiring module may be specifically configured to acquire the collected posture information of the collected media object and the media object, and receive and save the collection location corresponding to the media object input by the user; It can also be specifically used to receive and save the collected track information input by the user, call the map data, and display the collected track on the map according to the collected track information.
  • the user can change the collection location and/or the collection track of the media object according to his or her preference, and save the trajectory permanently.
  • the media object can be presented according to the user's changed collection location information and the collection trajectory.
  • the user can change A heart-shaped collection trajectory to express your love, making the display of media objects more flexible and diverse.
  • the apparatus for implementing display of a media object may further include:
  • An uploading module configured to upload the media object and the corresponding collection location to the server
  • the fourth display module is configured to: when the user clicks on any point on the map, obtain, from the server, a media object whose collection location is consistent with the location information of the point for display or play.
  • Users can choose to upload their favorite image media objects to the cloud server, share them with other users, and also see media objects uploaded by other users to achieve a role of promoting communication.
  • FIG. 8 it is a system embodiment for implementing media object display provided in the embodiment of the present invention, which may include:
  • the media object collection device 801 is configured to record the collection track information, collect the media object, record the collection location corresponding to the media object, and collect the posture information; and transmit the collection track information, the media object, the collection location corresponding to the media object, and the collection posture information to the display. terminal.
  • the display terminal 802 may be an apparatus embodiment for implementing media object display provided in the above embodiments.
  • the embodiment of the present invention analyzes the collected position and the collected posture information by acquiring the media object and the corresponding collection position and the collected posture information, and screens out the image or video frame with a certain interval of the collection position and is stable. Select and display on the corresponding position of the map, so that when viewing the media object, the user can visually see the relationship between the media object and the geographical location, and the display is intuitive, and the position of the search content can be determined more quickly by displaying the index of the object, which is great. It is convenient for users to check.
  • the steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented directly in hardware, a software module executed by a processor, or a combination of both.
  • the software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, A register, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Instructional Devices (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明提供一种实现媒体对象显示的方法、装置及***,该方法包括:获取采集得到的媒体对象;从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息;调用地图数据,根据所述显示对象的采集位置,将所述显示对象显示在地图上。

Description

一种实现媒体对象显示的方法、装置及*** 技术领域
本发明涉及计算机技术领域,具体涉及一种实现媒体对象显示的方法、装置及***。
背景技术
随着拍摄设备以及存储技术的发展,更多的媒体对象(例如图像以及视频等)在采集之后被保存在存储器中,供用户后续翻阅和浏览。在现有技术中,媒体对象一般以时间或文件名为顺序进行显示。
但是,用户在翻阅浏览媒体对象的过程中,如果想查看某一拍摄对象时,需要频繁切换图像,或者完整播放视频才能找到想要的内容,尤其是媒体对象数量较多时,查找内容困难,耗时较长;且很多时候难以通过媒体对象的内容回想起拍摄时的位置,显示不直观,例如无人机航拍所记录的媒体对象主要以照片和视频为主,用户难以通过照片或视频内容确定航拍地点。
发明内容
有鉴于此,本发明提供一种实现媒体对象显示的方法、装置及***,以解决现有技术中媒体对象显示不直观、查找困难的技术问题。
为解决上述问题,本发明提供的技术方案如下:
一种实现媒体对象显示的方法,所述方法包括:
获取采集得到的媒体对象;
从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息;
调用地图数据,根据所述显示对象的采集位置,将所述显示对象显示 在地图上。
相应的,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的位置信息步骤还包括:
在所述媒体对象为图像集合时,将所述图像集合划分为至少一个子集合,若所述图像集合的子集合中所述图像的数量大于数量阈值,将子集合中满足预设条件的图像确定为显示对象;
在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
相应的,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的位置信息,包括:
在所述媒体对象为图像集合时,若子集合中所述图像的数量小于或等于数量阈值,将子集合中全部所述图像确定为显示对象。
相应的,在从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息步骤之前,还包括:
当所述媒体对象为图像集合时,根据所述图像集合的采集位置及图像的分布密度确定出子集合的范围。
相应的,所述方法还包括:
获取采集轨迹信息,调用所述地图数据,根据所述采集轨迹信息在所述地图上显示采集轨迹。
相应的,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息,包括:
当所述媒体对象为图像集合时,根据所述采集轨迹将所述图像集合划分为至少一个子集合,将所述子集合中满足预设条件的图像确定为显示对象;
当所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
相应的,所述从所述媒体对象中确定出满足预设条件的显示对象并获 取所述显示对象对应的采集位置信息,包括:
当所述媒体对象为图像集合时,在每个所述子集合内选取采集稳定性参数最大的图像作为显示对象;
当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数最大的媒体对象。
相应的,所述稳定性参数是根据所述媒体对象对应的采集姿态信息中的惯性测量单元数据确定的。
相应的,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息,包括:
当所述媒体对象为图像集合时,在每个所述子集合内选取由所述稳定性参数以及兴趣点参数加权求和最大的媒体对象作为显示对象;
当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数以及所述兴趣点参数加权求和最大的媒体对象;
所述兴趣点参数根据所述媒体对象的采集位置、所述媒体对象的采集朝向以及兴趣点位置计算确定的,所述媒体对象的采集朝向是根据所述媒体对象对应的采集姿态信息确定的,所述兴趣点位置是通过接收用户输入的兴趣点位置获取的。
相应的,在将所述显示对象显示在地图上之后,所述方法还包括:
在接收用户通过点击所述显示对象而输入的显示触发信号后,显示或播放所述显示对象以及在距所述显示对象的预设范围内的其他媒体对象。
相应的,所述方法还包括:
将所述媒体对象以及对应的采集位置上传到服务器;
在用户点击所述地图上任一点时,从所述服务器获取采集位置与该点位置信息一致的媒体对象进行显示或播放。
相应的,所述方法还包括:共享所述显示对象和所述显示对象所对应的采集位置。
相应的,所述显示采集轨迹,还包括:接收用户修改指令,修改所述采集轨迹。
一种实现媒体对象显示的装置,其特征在于,所述装置包括:
获取模块,用于获取采集得到的媒体对象;
确定模块,用于从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息;
第一显示模块,用于调用地图数据,根据所述显示对象的采集位置,将所述显示对象显示在地图上。
相应的,所述确定模块,包括:
第一选取单元,用于在所述媒体对象为图像集合时,将所述图像集合划分为至少一个子集合;
第二选取单元,用于若所述图像集合的子集合中所述图像的数量大于数量阈值,将子集合中满足预设条件的图像确定为显示对象,或在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
相应的,所述确定模块还包括:
第三选取单元,用于在所述媒体对象为图像集合时,若子集合中所述图像的数量小于或等于数量阈值,将子集合中全部所述图像确定为显示对象。
相应的,所述装置还包括:
第二显示模块,用于获取采集轨迹信息,调用所述地图数据,根据所述采集轨迹信息在所述地图上显示采集轨迹。
相应的,所述第一选取单元,具体用于在所述媒体对象为图像集合时,根据所述采集轨迹将所述图像集合划分为至少一个子集合;
所述第二选取单元,具体用于将所述图像集合的子集合中满足预设条 件的图像确定为显示对象,或在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
相应的,所述第二选取单元,具体用于:
当所述媒体对象为图像集合时,在每个所述子集合内选取采集稳定性参数最大的图像作为显示对象;
当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数最大的媒体对象。
相应的,所述稳定性参数是根据所述媒体对象对应的采集姿态信息中的惯性测量单元数据确定的。
相应的,所述第二选取单元,具体用于:
当所述媒体对象为图像集合时,在每个所述子集合内选取由所述稳定性参数以及兴趣点参数加权求和最大的媒体对象作为显示对象;
当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数以及所述兴趣点参数加权求和最大的媒体对象;
所述兴趣点参数根据所述媒体对象的采集位置、所述媒体对象的采集朝向以及兴趣点位置计算确定的,所述媒体对象的采集朝向是根据所述媒体对象对应的采集姿态信息确定的,所述兴趣点位置是通过接收用户输入的兴趣点位置获取的。
相应的,所述装置还包括:
第三显示模块,用于在接收用户通过点击所述显示对象而输入的显示触发信号后,显示或播放所述显示对象以及在距所述显示对象的预设范围内的其他媒体对象。
相应的,所述装置还包括:
上传模块,用于将所述媒体对象以及对应的采集位置上传到服务器;
第四显示模块,用于在用户点击所述地图上任一点时,从所述服务器获取采集位置与该点位置信息一致的媒体对象进行显示或播放。
相应的,所述上传模块,用于将所述显示对象和显示对象所对应的采集位置上传并共享。
一种实现媒体对象显示的***,所述***包括:
媒体对象采集设备以及显示终端;
所述媒体对象采集设备,用于记录采集轨迹信息,采集媒体对象,记录所述媒体对象对应的采集位置以及采集姿态信息;将所述采集轨迹信息、所述媒体对象、所述媒体对象对应的采集位置以及采集姿态信息传输给所述显示终端;
所述显示终端,是上述的实现媒体对象显示的装置。
本发明实施例通过获取媒体对象以及对应的采集位置以及采集姿态信息,对采集位置以及采集姿态信息进行分析,筛选出采集位置有一定间隔,且采集姿态比较稳定的图像或视频帧作为精选并在地图相应位置上显示,使用户在查看媒体对象时,可以直观看到媒体对象与地理位置的关系,显示直观,且通过显示对象的索引可以更快确定查找内容的位置,极大了方便了用户查阅。
附图说明
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:
图1为本发明实施例提供的实现媒体对象显示方法实施例一的流程图;
图2为本发明实施例中采集媒体对象的示意图;
图3为本发明实施例提供的实现媒体对象显示结果的示意图;
图4为本发明实施例提供的实现媒体对象显示方法实施例二的流程图;
图5为本发明实施例提供的实现媒体对象显示方法实施例三的流程图;
图6为本发明实施例提供的实现媒体对象显示方法实施例四的流程图;
图7为本发明实施例提供的实现媒体对象显示装置实施例一的示意图;
图8为本发明实施例提供的实现媒体对象显示***实施例的示意图。
具体实施方式
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本发明实施例作进一步详细的说明。
本发明实施例提供的实现媒体对象显示的方法、装置及***,是针对现有技术中媒体对象显示不直观且查找困难的技术问题,提出在采集媒体对象时,记录下对应的采集位置以及采集姿态信息,在客户端呈现时,可以根据媒体对象的采集位置以及采集姿态选取各区域中稳定的图像或视频帧并在地图相应位置上显示,达到更优的媒体对象呈现效果。
本发明实施例提供的实现媒体对象显示的方法将从实现媒体对象显示的装置角度进行描述,该实现媒体对象显示的装置具体可以集成在客户端中,该客户端可以装载在终端中,该终端具体可以为智能手机、平板电脑、电子书阅读器、MP3(Moving Picture Experts Group Audio Layer III,动态影像专家压缩标准音频层面3)播放器、MP4(Moving Picture Experts Group Audio Layer IV,动态影像专家压缩标准音频层面4)播放器、膝上型便携计算机和台式计算机等等。
参见图1所示,是本发明实施例中提供的实现媒体对象显示的方法实施例一,可以包括以下步骤:
步骤101:获取采集得到的媒体对象,并获取媒体对象对应的采集位置以及采集姿态信息。
其中,所述媒体对象包括图像、视频及音频中的任意一种或多种的组合。且在获取采集到的媒体对象的同时,还可以一并获取媒体对象对应的采集位置以及采集姿态信息。
在使用媒体对象采集设备采集媒体对象的过程中,例如使用无人机航拍图片和/或视频的过程中,可以记录下媒体对象的采集位置,采集位置可 以使用GPS(Global Positioning System,全球定位***)信息进行标识,同时可以记录下媒体对象的采集姿态信息,采集姿态信息可以为惯性测量单元数据,惯性测量单元数据可以包括采集媒体对象时,采集设备三轴的姿态角,或角速率,以及加速度,用于代表媒体对象的采集姿态。进一步的,采集姿态信息还可以包括采集朝向、采集高度等信息。可以理解的是,当媒体对象为图像时,每一幅图像均可以有对应的采集位置与采集姿态信息;当媒体对象为视频时,则视频中每一视频帧均可以有对应的采集位置与采集姿态信息。
在本发明的一些实施例中,采集媒体对象的过程中,还可以记录采集轨迹信息,采集轨迹信息是指媒体对象采集设备的运动轨迹即采集轨迹,可以理解每个媒体对象的采集位置均分布在采集轨迹上。
请再参见图2所示,以无人机航拍为例,航拍设备在拍摄过程中,可以生成轨迹文件,记录一系列的时间、GPS信息以及惯性测量单元数据,如果进行媒体对象的采集,则同时把记录的GPS信息以及惯性测量单元数据写入到媒体对象的属性信息中,例如写入图像的Exif(Exchangeable Image File,可交换图像文件)信息,Exif信息中可以包括在拍摄过程中采集的一系列信息,Exif(信息可以嵌入到JPEG(Joint Photographic Experts Group,联合图像专家小组)/TIFF(Tagged Image File Format,标签图像文件格式)图像文件的头部。图2所示的航拍设备仅为示意作用,但不限定于此种航拍设备。
当用户需要使用装载在显示终端的客户端浏览媒体对象时,客户端需要首先获取采集得到的媒体对象以及媒体对象对应的采集位置和采集姿态信息,以便于后续步骤通过分析媒体对象的采集位置和采集姿态信息精选出一些媒体对象进行展示。
步骤102:从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息。
一般来说,显示终端的显示区域有限,如果媒体对象的数量较多则无 法同时全部显示,这样在客户端显示媒体对象时,则需要对媒体对象进行筛选,选取采集位置有一定间隔且采集姿态比较稳定的图像或视频帧作为精选呈现,采集姿态稳定一般代表图像质量更好。
其中,若媒体对象为图像集合时,将所述图像集合划分为至少一个子集合,若所述图像集合的子集合中所述图像的数量大于数量阈值,将子集合中满足预设条件的图像确定为显示对象;若所述若子集合中所述图像的数量小于或等于数量阈值,将子集合中全部所述图像确定为显示对象。
具体地,可以根据所述图像集合的采集位置及图像的分布密度确定出子集合的范围。若某区域采集位置的图像数量较多,即图像密度较大,则多划分几个子集合,相应地,图像密度较小的区域则少划分几个子集合。
具体的,即当媒体对象为图像集合时,如果每个子集合图像数量较少,且各图像的采集地点比较分散,即图像数量小于或等于数量阈值,且各图像之间的采集位置距离差值大于或等于距离阈值,则可以直接选择全部图像进行显示,否则,则需要将子集合中满足预设条件的图像确定为显示对象。其中,数量阈值以及距离阈值可以根据实际情况进行设定,本发明对此不进行限定。当媒体对象为视频时,则可以直接从视频中选取视频帧进行显示。
若所述媒体对象为视频时,可以从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。其中,所述媒体片段可以为视频片段或视频帧。
此外,还可以获取采集轨迹信息,调用所述地图数据,根据所述采集轨迹信息在所述地图上显示采集轨迹。
当所述媒体对象为图像集合时,根据所述采集轨迹将所述图像集合划分为至少一个子集合,将所述子集合中满足预设条件的图像确定为显示对象。当所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
在本发明的一些实施例中,为了保证所确定出的显示对象具有较好的 显示效果,所述显示对象需满足预设条件。
具体的,当媒体对象为图像集合时,若所述图像集合的每一子集合上图像数目大于数量阈值,选取稳定性参数最大的图像或稳定性参数和兴趣点参数加权求和最大的图像作为显示对象。当媒体对象为视频时,即可以在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数最大的媒体对象或稳定性参数和兴趣点参数加权求和最大的媒体对象。
针对媒体对象为图像集合或视频等不同情况,在后续实施例中会对如何选取显示对象进行详细说明。
这样,可以从大量媒体对象中,选取分散且图像质量更好的图像或视频帧进行显示。
步骤103:调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上。
显示对象是从媒体对象中选取获得的,即显示对象有对应的采集位置,进一步的,本发明实施例根据显示对象的采集位置在地图上的相应位置进行显示,显示对象在地图上的显示位置与显示对象的采集位置一致,使用户可以直观获得媒体对象的采集位置。
此外,还可以将显示对象和显示对象所对应的采集位置上传到云端等共享平台,以便其他用户可以查看,同时也便于查看同一地点其他用户共享的显示对象。
在本发明的一些实施例中,还可以获取采集轨迹信息,调用地图数据,根据采集轨迹信息在地图上显示采集轨迹。在地图上显示采集轨迹可以在步骤101、102、103任一步骤之前执行,对此不进行限定。
另,还可以对所述地图上显示的采集轨迹进行修改,使其呈现用户需要的形式,如改变采集轨迹的长短、路线等。
参见图3所示,是本发明实施例的一个显示结果示意图,使用的媒体 对象采集设备为无人机航拍设备,当用户使用客户端浏览媒体对象时,会读取轨迹文件里面的GPS信息,然后调用地图API(Application Programming Interface,应用程序接口)获取当前地图数据,根据轨迹文件记录的GPS数据将飞行轨迹在地图上绘制出来,然后读取媒体对象例如图像及其Exif数据,如果图像数量不多而且地点较为分散,那么就将图像的缩略图***对应的地图点上显示,如果图片数量较多或者比较集中,则可以选取分散且拍摄时的稳定性最高,即图片质量更高的图片安插在地图上显示。让用户可以直观看到图像或视频的内容及其在地图上的具***置,达到最佳的呈现效果。
另外,在本发明的一些实施例中,还可以在接收用户通过点击显示对象而输入的显示触发信号后,显示或播放显示对象以及在距显示对象的预设范围内的其他媒体对象。在地图上显示的是精选后的媒体对象,用户可以通过点击该媒体对象,即点击显示对象,来触发显示对象以及在距该媒体对象预设范围内的其他媒体对象。其中,预设范围可以是距离显示对象空间距离上的预设范围,也可以是距离显示对象拍摄时间上的预设范围,预设范围可以根据实际情况灵活设置。
这样,本发明实施例通过获取媒体对象以及对应的采集位置以及采集姿态信息,对采集位置以及采集姿态信息进行分析,筛选出采集位置有一定间隔,且采集姿态比较稳定的图像或视频帧作为精选并在地图相应位置上显示,使用户在查看媒体对象时,可以直观看到媒体对象与地理位置的关系,显示直观,且通过显示对象的索引可以更快确定查找内容的位置,极大方便了用户查阅。
以下通过三个不同的实施例,再对本发明实施例中提供的实现媒体对象显示的方法进行说明,其中重点说明如何从媒体对象中选取显示对象。
参见图4所示,是本发明实施例中提供的实现媒体对象显示的方法实施例二,当媒体对象为图像时,可以包括以下步骤:
步骤401:获取采集得到的图像集合。
步骤402:将所述图像集合划分为至少一个子集合。
在本实施例中仅对需要从媒体对象中选取显示对象的情况进行说明。 获取采集得到的图像集合,此图像集合对应的采集位置可以组成一个区域,根据所述图像集合的采集位置及图像的分布密度将所述图像集合划分为至少一个子集合,若某区域采集位置的图像数量较多,即图像密度较大,则多划分几个子集合,相应地,图像密度较小的区域则少划分几个子集合。所述子集合的选择条件可以为保证子集合中需要包括媒体对象。这里的子集合的数量以及子集合的形状、面积可以根据实际情况设定,本发明对此不进行限定。
步骤403:在仅获取到稳定性参数时,在每个子集合中选取采集稳定性参数最大的图像作为显示对象。
步骤404:在获取到稳定性参数以及兴趣点参数时,在每个子集合中选取由稳定性参数以及兴趣点参数加权求和最大的图像作为显示对象。
步骤403与步骤404之间是“或者”的关系,即这两个步骤是从每个子集合内选取显示对象的两种不同的实施方式。可以根据实际应该情况灵活选择仅获取稳定性参数,或获取稳定性参数以及兴趣点参数,可以理解的是,仅获取稳定性参数计算量小,而采用稳定性参数以及兴趣点两个参数共同参与显示对象的选择,选取的显示对象更贴近用户需求。
其中,稳定性参数是根据媒体对象对应的采集姿态信息确定的,具体的,稳定性参数可以根据媒体对象对应的采集姿态信息中包括的惯性测量单元数据确定,惯性测量单元数据代表采集媒体对象时的角速度或加速度,可以理解的是,在采集媒体对象时媒体对象采集设备的角速度或加速度越小则稳定性越高,在同等清晰度条件下采集稳定性高代表采集到的媒体对象质量更好。
而在本发明的一些实施例中,还可以根据媒体对象对应的采集姿态信息确定媒体对象的采集朝向;接收用户输入的兴趣点位置;根据媒体对象的采集位置、媒体对象的采集朝向以及兴趣点位置计算媒体对象的兴趣点参数。即兴趣点参数可以根据媒体对象的采集位置、媒体对象的采集朝向以及兴趣点位置计算确定,媒体对象的采集朝向可以根据媒体对象对应的 采集姿态信息确定,而兴趣点位置可以通过接收用户输入的兴趣点位置获取。
例如某图像采集位置为A点,用户设置的兴趣点位置为B点,如果此时采集朝向是由A点朝向B点,则采集到兴趣点图像的可能性很大,即为兴趣点参数较大。在实际应用中,兴趣点参数的计算方式很多,例如媒体对象的采集位置与兴趣点位置构成一条线段,由媒体对象的采集位置为起点沿采集朝向生成一条射线,则这条线段与这条射线之间小于180度的角度越小则兴趣点参数越大,另外还可以根据采集位置与兴趣点之间的距离确定兴趣点参数。总之,兴趣点参数可以代表媒体对象的内容中包括用户兴趣点信息的可能。
这样,在选取媒体对象时可以选取每个子集合内稳定性参数最大的图像作为显示对象;也可以将各个图像的稳定性参数与兴趣点参数加权求和,综合两个不同的指标,在每个子集合内选取加权求和最大的图像作为显示对象。
步骤405:调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上,使显示对象在地图上的显示位置与显示对象的采集位置一致,或使显示对象在地图上的显示位置与显示对象的采集位置之间的距离在预设范围之内。
本步骤与步骤103类似,在此不再赘述。
参见图5所示,是本发明实施例中提供的实现媒体对象显示的方法实施例三,当媒体对象为图像时,可以包括以下步骤:
步骤501:获取采集得到的图像集合。
步骤502:根据所述采集轨迹将所述图像集合划分为至少一个子集合。
在本实施例中仅对需要从媒体对象中选取显示对象的情况进行说明。获取采集得到的图像集合,此图像集合对应的采集位置可以组成一个区域,根据所述图像集合的采集位置及图像的分布密度将所述图像集合划分为至少一个子集合,若某区域采集位置的图像数量较多,即图像密度较大,则 多划分几个子集合,相应地,图像密度较小的区域则少划分几个子集合。所述子集合的选择条件可以为保证子集合中需要包括媒体对象。这里的子集合的数量以及子集合的形状、面积可以根据实际情况设定,本发明对此不进行限定。
步骤503:在仅获取到稳定性参数时,在每个子集合中选取采集稳定性参数最大的图像作为显示对象。
步骤504:在获取到稳定性参数以及兴趣点参数时,在每个子集合中选取由稳定性参数以及兴趣点参数加权求和最大的图像作为显示对象。
步骤503与步骤504之间是“或者”的关系,即这两个步骤是从每个区间内选取显示对象的两种不同的实施方式。可以根据实际应该情况灵活选择仅获取稳定性参数,或获取稳定性参数以及兴趣点参数,可以理解的是,仅获取稳定性参数计算量小,而采用稳定性参数以及兴趣点两个参数共同参与显示对象的选择,选取的显示对象更贴近用户需求。
稳定性参数与兴趣点参数的确定可以参见上述实施例,则在选取媒体对象时可以选取每个区间内稳定性参数最大的图像作为显示对象,也可以将各个图像的稳定性参数与兴趣点参数加权求和,综合两个不同的指标,在每个区间内选取加权求和最大的图像作为显示对象。
步骤505:调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上,使显示对象在地图上的显示位置与显示对象的采集位置一致,或使显示对象在地图上的显示位置与显示对象的采集位置之间的距离在预设范围之内。
本步骤与步骤103类似,在此不再赘述。
参见图6所示,是本发明实施例中提供的实现媒体对象显示的方法实施例四,当媒体对象为视频时,可以包括以下步骤:
步骤601:获取采集得到的视频。
步骤602:在仅获取到稳定性参数时,根据稳定性参数,在所述视频中每隔预设时间截取一段视频片段或一个视频帧作为显示对象。即每个预 设时间,选取一段稳定性参数最大的视频片段或一个稳定性参数最大的视频帧。
步骤603:在获取到稳定性参数以及兴趣点参数时,根据稳定性参数和兴趣点参数,在所述视频中每隔预设时间截取一段视频片段或一个视频帧作为显示对象。即每个预设时间,选取一段稳定性参数和兴趣点参数加权求和最大的视频片段或一个稳定性参数和兴趣点参数加权求和最大的视频帧。
对于视频来说,需要从视频中选取关键的视频片段或视频帧作为显示对象,可以每隔预设时间段,截取预设时间段中的一小段视频,或截取一个视频帧,预设时间可以根据实际情况设定。
步骤602与步骤603之间是“或者”的关系,即这两个步骤是从每段视频片段中选取显示对象的两种不同的实施方式。可以根据实际应该情况灵活选择仅获取稳定性参数,或获取稳定性参数以及兴趣点参数,可以理解的是,仅获取稳定性参数计算量小,而采用稳定性参数以及兴趣点两个参数共同参与显示对象的选择,选取的显示对象更贴近用户需求。
稳定性参数与兴趣点参数的确定可以参见上述实施例,则在选取媒体对象时可以选取每段视频片段中稳定性参数最大的视频帧作为显示对象,也可以将各个视频帧的稳定性参数与兴趣点参数加权求和,综合两个不同的指标,在每段视频片段中选取加权求和最大的视频帧作为显示对象。
步骤604:调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上,使显示对象在地图上的显示位置与显示对象的采集位置一致,或使显示对象在地图上的显示位置与显示对象的采集位置之间的距离在预设范围之内。
本步骤与步骤103类似,在此不再赘述。
另外,在本发明的一些实施例中,还可以接收并保存用户输入的采集轨迹信息和/或媒体对象对应的采集位置。
即用户可以根据自己的喜好,更改媒体对象的采集位置和/或采集轨迹, 并永久保存,下次再打开客户端的时候可以按照用户更改的采集位置信息以及采集轨迹呈现媒体对象,例如用户可以改成心形的采集轨迹,以表达自己的爱意,使媒体对象显示更为灵活多样。
在本发明的一些实施例中,还可以将媒体对象以及对应的采集位置上传到服务器;在用户点击地图上任一点时,从服务器获取采集位置及该位置信息所对应的媒体对象进行显示或播放。
用户还可以选择将自己所喜爱的图媒体对象上传到云端服务器,和其他用户分享,也可以看到其他用户上传的媒体对象,达到一种促进交流的作用。
这样,本发明实施例通过获取媒体对象以及对应的采集位置以及采集姿态信息,对采集位置以及采集姿态信息进行分析,筛选出采集位置有一定间隔,且采集姿态比较稳定的图像或视频帧作为精选并在地图相应位置上显示,使用户在查看媒体对象时,可以直观看到媒体对象与地理位置的关系,显示直观,且通过显示对象的索引可以更快确定查找内容的位置,极大了方便了用户查阅。
相应的,参见图7所示,是本发明实施例中提供的实现媒体对象显示的装置实施例一,可以包括:
所述实现媒体对象显示的装置包括获取模块701、确定模块702及第一显示模块703。
获取模块701,可以用于获取采集得到的媒体对象。
在获取采集到的媒体对象的同时,还可以一并获取媒体对象对应的采集位置以及采集姿态信息。在使用媒体对象采集设备采集媒体对象的过程中,例如使用无人机航拍图片和/或视频的过程中,可以记录下媒体对象的采集位置,采集位置可以使用GPS信息进行标识,同时可以记录下媒体对象的采集姿态信息,采集姿态信息可以为惯性测量单元数据,惯性测量单元数据可以包括采集媒体对象时,采集设备三轴的姿态角,或角速率,以及加速度,用于代表媒体对象的采集姿态。进一步的,采集姿态信息还可以包括采集朝向、采集高度等信息。可以理解的是,当媒体对象为图像集 合时,每一幅图像均可以有对应的采集位置与采集姿态信息;当媒体对象为视频时,则视频中每一视频帧均及每一视频片段中的视频帧可以有对应的采集位置与采集姿态信息。
在本发明的一些实施例中,采集媒体对象的过程中,还可以记录采集轨迹信息,采集轨迹信息是指媒体对象采集设备的运动轨迹即采集轨迹,可以理解每个媒体对象的采集位置均分布在采集轨迹上。
当用户需要使用装载在显示终端的客户端浏览媒体对象时,获取模块可以首先获取采集得到的媒体对象以及媒体对象对应的采集位置和采集姿态信息。
确定模块702,可以用于从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息,包括:第一选取单元7021以及第二选取单元7022;
第一选取单元7021,可以用于在所述媒体对象为图像集合时,将所述图像集合划分为至少一个子集合。
具体地,可以根据所述图像集合中图像的采集位置及图像的分布密度确定出子集合的范围。若某区域采集位置的图像数量较多,即图像密度较大,则多划分几个子集合,相应地,图像密度较小的区域则少划分几个子集合。
具体的,即当媒体对象为图像集合时,如果每个子集合图像数量较少,且各幅图像采集地点比较分散,即图像数量小于或等于数量阈值,且各个图像之间的采集位置距离差值大于或等于距离阈值,则可以直接选择全部图像进行显示,否则,则需要将子集合中满足预设条件的图像确定为显示对象。其中,数量阈值以及距离阈值可以根据实际情况进行设定,本发明对此不进行限定。
第二选取单元7022,可以用于若所述图像集合的子集合中所述图像的数量大于数量阈值,将子集合中满足预设条件的图像确定为显示对象,或在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作 为显示对象并获取所述显示对象所对应的采集位置信息。从所述视频中选取的媒体片段可以为视频片段或视频帧。
在本发明的一些实施例中,确定模块702还可以包括第三选取单元,用于当媒体对象为图像集合,且图像集合的子集合中图像的数量小于或等于数量阈值时,将子集合中全部图像确定为显示对象。
具体的,当媒体对象为图像集合时,若所述图像集合的每一子集合上图像数目大于数量阈值,选取稳定性参数最大的图像或稳定性参数和兴趣点参数加权求和最大的图像作为显示对象。当媒体对象为视频时,即可以在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数最大的媒体对象或稳定性参数和兴趣点参数加权求和最大的媒体对象。
这样,可以从大量媒体对象中,选取分散且图像质量更好的图像或视频帧进行显示。
第一显示模块703,可以用于调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上。
显示对象是从媒体对象中选取获得的,即显示对象有对应的采集位置,进一步的,本发明实施例根据显示对象的采集位置在地图的相应位置进行显示,显示对象在地图上的显示位置与显示对象的采集位置一致,或使显示对象在地图上的显示位置与显示对象的采集位置之间的距离在预设范围之内,使用户可以直观获得媒体对象的采集位置或采集位置的范围。
在本发明的一些实施例中,还可以包括第二显示模块,用于获取采集轨迹信息,调用地图数据,根据采集轨迹信息在地图上显示采集轨迹。第三显示模块,用于在接收用户通过点击显示对象而输入的显示触发信号后,显示或播放显示对象以及在距显示对象的预设范围内的其他媒体对象。
以下通过三个不同的实施例,再对本发明实施例中提供的实现媒体对象显示的装置进行说明。
本发明实施例中提供的实现媒体对象显示的装置实施例二,当媒体对象为图像时,可以包括:
获取模块701,可以具体用于获取采集得到的图像集合,并获取图像对应的采集位置以及采集姿态信息。
第一选取单元7021,可以具体用于在所述图像的采集位置组成的区域内选取至少两个包括所述图像的子集合,各个所述子集合之间的距离大于距离阈值。
在本实施例中仅对需要从媒体对象中选取显示对象的情况进行说明。获取采集得到的图像集合,此图像集合对应的采集位置可以组成一个区域,根据所述图像集合的采集位置及图像的分布密度将所述图像集合划分为至少一个子集合,若某区域采集位置的图像数量较多,即图像密度较大,则多划分几个子集合,相应地,图像密度较小的区域则少划分几个子集合。所述子集合的选择条件可以为保证子集合中需要包括媒体对象。这里的子集合的数量以及子集合的形状、面积可以根据实际情况设定,本发明对此不进行限定。
第二选取单元7022,可以具体用于在仅获取到稳定性参数时,在每个子集合中选取采集稳定性参数最大的图像作为显示对象。
第二选取单元7022,也可以具体用于在获取到稳定性参数以及兴趣点参数时,在每个子集合中选取由稳定性参数以及兴趣点参数加权求和最大的图像作为显示对象。
兴趣点参数可以根据媒体对象的采集位置、媒体对象的采集朝向以及兴趣点位置计算确定,媒体对象的采集朝向可以根据媒体对象对应的采集姿态信息确定,而兴趣点位置可以通过接收用户输入的兴趣点位置获取。
稳定性参数可以根据媒体对象对应的采集姿态信息中包括的惯性测量单元数据确定,在同等清晰度条件下采集稳定性高代表采集到的媒体对象质量更好。兴趣点参数可以代表媒体对象的内容中包括用户兴趣点信息的可能。这样,在选取媒体对象时可以选取每个子集合内稳定性参数最大的 图像作为显示对象,也可以将各个图像的稳定性参数与兴趣点参数加权求和,综合两个不同的指标,在每个子集合内选取加权求和最大的图像作为显示对象。
第一显示模块703,可以用于调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上,使显示对象在地图上的显示位置与显示对象的采集位置一致,或使显示对象在地图上的显示位置与显示对象的采集位置之间的距离在预设范围之内。
本发明实施例中提供的实现媒体对象显示的装置实施例三,当媒体对象为图像时,可以包括:
获取模块701,可以具体用于获取采集得到的图像集合,并获取图像对应的采集位置以及采集姿态信息。
第一选取单元7021,根据所述采集轨迹将所述图像集合划分为至少一个子集合。
在本实施例中仅对需要从媒体对象中选取显示对象的情况进行说明。获取采集得到的图像集合,此图像集合对应的采集位置可以组成一个区域,根据所述图像集合的采集位置及图像的分布密度将所述图像集合划分为至少一个子集合,若某区域采集位置的图像数量较多,即图像密度较大,则多划分几个子集合,相应地,图像密度较小的区域则少划分几个子集合。所述子集合的选择条件可以为保证子集合中需要包括媒体对象。这里的子集合的数量以及子集合的形状、面积可以根据实际情况设定,本发明对此不进行限定。
第二选取单元7022,可以具体用于在仅获取到稳定性参数时,在每个子集合中选取采集稳定性参数最大的图像作为显示对象。。稳定性参数可以根据媒体对象对应的采集姿态信息中惯性测量单元数据确定。
第二选取单元7022,也可以用于在每个子集合中选取由稳定性参数以及兴趣点参数加权求和最大的图像作为显示对象。
兴趣点参数可以根据媒体对象的采集位置、媒体对象的采集朝向以及 兴趣点位置计算确定,媒体对象的采集朝向可以根据媒体对象对应的采集姿态信息确定,而兴趣点位置可以通过接收用户输入的兴趣点位置获取。
在选取媒体对象时可以选取每个区间内稳定性参数最大的图像作为显示对象,也可以将各个图像的稳定性参数与兴趣点参数加权求和,综合两个不同的指标,在每个区间内选取加权求和最大的图像作为显示对象。
第一显示模块703,可以用于调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上,使显示对象在地图上的显示位置与显示对象的采集位置一致,或使显示对象在地图上的显示位置与显示对象的采集位置之间的距离在预设范围之内。
本发明实施例中提供的实现媒体对象显示的装置实施例四,当媒体对象为视频时,可以包括:
获取模块701,可以具体用于获取采集得到的视频,并获取视频对应的采集位置以及采集姿态信息。
第一选取单元7021,可以具体用于在视频中每隔预设时间截取一段视频片段。
对于视频来说,需要从视频中选取关键帧作为显示对象,可以每隔预设时间截取一段视频片段,预设时间可以根据实际情况设定,一般可以满足选取的视频片段的采集位置距离大约距离阈值,以保证再从每个视频片段内选取的显示对象可以满足分散性条件。
第二选取单元7022,可以具体用于在仅获取到稳定性参数时,根据稳定性参数,在所述视频中每隔预设时间截取一段视频片段或一个视频帧作为显示对象。稳定性参数可以根据媒体对象对应的采集姿态信息中惯性测量单元数据确定。
第二选取单元7022,也可以具体用于根据稳定性参数和兴趣点参数,在所述视频中每隔预设时间截取一段视频片段或一个视频帧作为显示对象。
兴趣点参数可以根据媒体对象的采集位置、媒体对象的采集朝向以及 兴趣点位置计算确定,媒体对象的采集朝向可以根据媒体对象对应的采集姿态信息确定,而兴趣点位置可以通过接收用户输入的兴趣点位置获取。
在选取媒体对象时可以选取每段视频片段中稳定性参数最大的视频帧作为显示对象,也可以将各个视频帧的稳定性参数与兴趣点参数加权求和,综合两个不同的指标,在每段视频片段中选取加权求和最大的视频帧作为显示对象。
第一显示模块703,可以用于调用地图数据,根据显示对象的采集位置,将显示对象显示在地图上,使显示对象在地图上的显示位置与显示对象的采集位置一致。
另外,在本发明的一些实施例中,获取模块,还可以具体用于获取采集得到的媒体对象以及媒体对象的采集姿态信息,接收并保存用户输入的媒体对象对应的采集位置;第二显示模块,还可以具体用于接收并保存用户输入的采集轨迹信息,调用地图数据,根据采集轨迹信息在地图上显示采集轨迹。
即用户可以根据自己的喜好,更改媒体对象的采集位置和/或采集轨迹,并永久保存,下次再打开客户端的时候可以按照用户更改的采集位置信息以及采集轨迹呈现媒体对象,例如用户可以改成心形的采集轨迹,以表达自己的爱意,使媒体对象显示更为灵活多样。
在本发明的一些实施例中,本发明实施例提供的实现媒体对象显示的装置还可以包括:
上传模块,用于将媒体对象以及对应的采集位置上传到服务器;
第四显示模块,用于在用户点击地图上任一点时,从服务器获取采集位置与该点位置信息一致的媒体对象进行显示或播放。
用户可以选择将自己所喜爱的图媒体对象上传到云端服务器,和其他用户分享,也可以看到其他用户上传的媒体对象,达到一种促进交流的作用。
相应的,参见图8所示,是本发明实施例中提供的实现媒体对象显示的***实施例,可以包括:
媒体对象采集设备801以及显示终端802。
媒体对象采集设备801,用于记录采集轨迹信息,采集媒体对象,记录媒体对象对应的采集位置以及采集姿态信息;将采集轨迹信息、媒体对象、媒体对象对应的采集位置以及采集姿态信息传输给显示终端。
显示终端802可以是上述实施例中提供的实现媒体对象显示的装置实施例。
这样,本发明实施例通过获取媒体对象以及对应的采集位置以及采集姿态信息,对采集位置以及采集姿态信息进行分析,筛选出采集位置有一定间隔,且采集姿态比较稳定的图像或视频帧作为精选并在地图相应位置上显示,使用户在查看媒体对象时,可以直观看到媒体对象与地理位置的关系,显示直观,且通过显示对象的索引可以更快确定查找内容的位置,极大了方便了用户查阅。
需要说明的是,本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的***或装置而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。
还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块,或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、 寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。
对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。

Claims (25)

  1. 一种实现媒体对象显示的方法,其特征在于,所述方法包括:
    获取采集得到的媒体对象;
    从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息;
    调用地图数据,根据所述显示对象的采集位置,将所述显示对象显示在地图上。
  2. 如权利要求1所述的实现媒体对象显示的方法,其特征在于,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的位置信息,包括:
    在所述媒体对象为图像集合时,将所述图像集合划分为至少一个子集合,若所述图像集合的子集合中所述图像的数量大于数量阈值,将子集合中满足预设条件的图像确定为显示对象;
    在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
  3. 根据权利要求2所述的实现媒体对象显示的方法,其特征在于,从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的位置信息,包括:
    在所述媒体对象为图像集合时,若子集合中所述图像的数量小于或等于数量阈值,将子集合中全部所述图像确定为显示对象。
  4. 根据权利要求2或3所述的实现媒体对象显示的方法,其特征在于,在从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息步骤之前,还包括:
    当所述媒体对象为图像集合时,根据所述图像集合的采集位置及图像的分布密度确定出子集合的范围。
  5. 根据权利要求1所述的实现媒体对象显示的方法,其特征在于,所述方法还包括:
    获取采集轨迹信息,调用所述地图数据,根据所述采集轨迹信息在所述地图上显示采集轨迹。
  6. 根据权利要求5所述的实现媒体对象显示的方法,其特征在于,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息,包括:
    当所述媒体对象为图像集合时,根据所述采集轨迹将所述图像集合划分为至少一个子集合,将所述子集合中满足预设条件的图像确定为显示对象;
    当所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
  7. 根据权利要求2或3或6所述的实现媒体对象显示的方法,其特征在于,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息,包括:
    当所述媒体对象为图像集合时,在每个所述子集合内选取采集稳定性参数最大的图像作为显示对象;
    当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数最大的媒体对象。
  8. 根据权利要求6所述的实现媒体对象显示的方法,其特征在于,所述稳定性参数是根据所述媒体对象对应的采集姿态信息中的惯性测量单元数据确定的。
  9. 根据权利要求2或3或6所述的实现媒体对象显示的方法,其特征在于,所述从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息,包括:
    当所述媒体对象为图像集合时,在每个所述子集合内选取由所述稳定性参数以及兴趣点参数加权求和最大的媒体对象作为显示对象;
    当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频 片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数以及所述兴趣点参数加权求和最大的媒体对象;
    所述兴趣点参数根据所述媒体对象的采集位置、所述媒体对象的采集朝向以及兴趣点位置计算确定的,所述媒体对象的采集朝向是根据所述媒体对象对应的采集姿态信息确定的,所述兴趣点位置是通过接收用户输入的兴趣点位置获取的。
  10. 根据权利要求1所述的实现媒体对象显示的方法,其特征在于,在将所述显示对象显示在地图上之后,所述方法还包括:
    在接收用户通过点击所述显示对象而输入的显示触发信号后,显示或播放所述显示对象以及在距所述显示对象的预设范围内的其他媒体对象。
  11. 根据权利要求1所述的实现媒体对象显示的方法,其特征在于,所述方法还包括:
    将所述媒体对象以及对应的采集位置上传到服务器;
    在用户点击所述地图上任一点时,从所述服务器获取采集位置与该点位置信息一致的媒体对象进行显示或播放。
  12. 如权利要求11所述的实现媒体对象显示的方法,其特征在于,所述方法还包括:
    共享所述显示对象和所述显示对象所对应的采集位置。
  13. 如权利要求5所述的实现媒体对象显示的方法,其特征在于,所述显示采集轨迹,还包括:
    接收用户修改指令,修改所述采集轨迹。
  14. 一种实现媒体对象显示的装置,其特征在于,所述装置包括:
    获取模块,用于获取采集得到的媒体对象;
    确定模块,用于从所述媒体对象中确定出满足预设条件的显示对象并获取所述显示对象对应的采集位置信息;
    第一显示模块,用于调用地图数据,根据所述显示对象的采集位置, 将所述显示对象显示在地图上。
  15. 根据权利要求14所述的实现媒体对象显示的装置,其特征在于,所述确定模块,包括:
    第一选取单元,用于在所述媒体对象为图像集合时,将所述图像集合划分为至少一个子集合。
    第二选取单元,用于若所述图像集合的子集合中所述图像的数量大于数量阈值,将子集合中满足预设条件的图像确定为显示对象,或在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
  16. 根据权利要求15所述的实现媒体对象显示的装置,其特征在于,所述确定模块还包括:
    第三选取单元,用于在所述媒体对象为图像集合时,若子集合中所述图像的数量小于或等于数量阈值,将子集合中全部所述图像确定为显示对象。
  17. 根据权利要求14所述的实现媒体对象显示的装置,其特征在于,所述装置还包括:
    第二显示模块,用于获取采集轨迹信息,调用所述地图数据,根据所述采集轨迹信息在所述地图上显示采集轨迹。
  18. 根据权利要求17所述的实现媒体对象显示的装置,其特征在于,
    所述第一选取单元,具体用于在所述媒体对象为图像集合时,根据所述采集轨迹将所述图像集合划分为至少一个子集合;
    所述第二选取单元,具体用于将所述图像集合的子集合中满足预设条件的图像确定为显示对象,或在所述媒体对象为视频时,从所述视频中选取满足预设条件的媒体片段作为显示对象并获取所述显示对象所对应的采集位置信息。
  19. 根据权利要求15、16或18所述的实现媒体对象显示的装置,其特征在于,所述第二选取单元,具体用于:
    当所述媒体对象为图像集合时,在每个所述子集合内选取采集稳定性参数最大的图像作为显示对象;
    当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数最大的媒体对象。
  20. 根据权利要求19所述的实现媒体对象显示的方法,其特征在于,所述稳定性参数是根据所述媒体对象对应的采集姿态信息中的惯性测量单元数据确定的。
  21. 根据权利要求15、16或18所述的实现媒体对象显示的装置,其特征在于,所述第二选取单元,具体用于:
    当所述媒体对象为图像集合时,在每个所述子集合内选取由所述稳定性参数以及兴趣点参数加权求和最大的媒体对象作为显示对象;
    当所述媒体对象为视频时,在所述视频中每隔预设时间截取一段视频片段或在所述视频中每隔预设时间确定出一个视频帧作为显示对象,所述显示对象为所述预设时间内稳定性参数以及所述兴趣点参数加权求和最大的媒体对象;
    所述兴趣点参数根据所述媒体对象的采集位置、所述媒体对象的采集朝向以及兴趣点位置计算确定的,所述媒体对象的采集朝向是根据所述媒体对象对应的采集姿态信息确定的,所述兴趣点位置是通过接收用户输入的兴趣点位置获取的。
  22. 根据权利要求14所述的实现媒体对象显示的装置,其特征在于,所述装置还包括:
    第三显示模块,用于在接收用户通过点击所述显示对象而输入的显示触发信号后,显示或播放所述显示对象以及在距所述显示对象的预设范围内的其他媒体对象。
  23. 根据权利要求14所述的实现媒体对象显示的装置,其特征在于,所述装置还包括:
    上传模块,用于将所述媒体对象以及对应的采集位置上传到服务器;
    第四显示模块,用于在用户点击所述地图上任一点时,从所述服务器获取采集位置与该点位置信息一致的媒体对象进行显示或播放。
  24. 根据权利要求23所述的实现媒体对象显示的装置,其特征在于,
    所述上传模块,用于将所述显示对象和显示对象所对应的采集位置上传并共享。
  25. 一种实现媒体对象显示的***,其特征在于,所述***包括:
    媒体对象采集设备以及显示终端;
    所述媒体对象采集设备,用于记录采集轨迹信息,采集媒体对象,记录所述媒体对象对应的采集位置以及采集姿态信息;将所述采集轨迹信息、所述媒体对象、所述媒体对象对应的采集位置以及采集姿态信息传输给所述显示终端;
    所述显示终端,是权利要求14-24任一项所述的实现媒体对象显示的装置。
PCT/CN2014/095306 2014-12-29 2014-12-29 一种实现媒体对象显示的方法、装置及*** WO2016106494A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201480083242.XA CN107079144B (zh) 2014-12-29 2014-12-29 一种实现媒体对象显示的方法、装置及***
PCT/CN2014/095306 WO2016106494A1 (zh) 2014-12-29 2014-12-29 一种实现媒体对象显示的方法、装置及***

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/095306 WO2016106494A1 (zh) 2014-12-29 2014-12-29 一种实现媒体对象显示的方法、装置及***

Publications (1)

Publication Number Publication Date
WO2016106494A1 true WO2016106494A1 (zh) 2016-07-07

Family

ID=56283784

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/095306 WO2016106494A1 (zh) 2014-12-29 2014-12-29 一种实现媒体对象显示的方法、装置及***

Country Status (2)

Country Link
CN (1) CN107079144B (zh)
WO (1) WO2016106494A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111680238B (zh) * 2019-03-11 2023-07-14 腾讯科技(深圳)有限公司 信息分享方法、装置和存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007129407A (ja) * 2005-11-02 2007-05-24 Hitachi Advanced Digital Inc カメラシステム、地図情報表示システム
US20080045138A1 (en) * 2006-05-01 2008-02-21 Microsoft Corporation Context information communications via a mobile device
CN102419171A (zh) * 2011-08-10 2012-04-18 王桥生 一种基于无人机航拍的灾害监测电子勾绘***
CN103747230A (zh) * 2013-12-11 2014-04-23 深圳先进技术研究院 动态定位视频电子地图投影***和方法
CN103959288A (zh) * 2011-11-30 2014-07-30 诺基亚公司 用于基于web的增强现实应用查看器的方法和装置
CN104035446A (zh) * 2014-05-30 2014-09-10 深圳市大疆创新科技有限公司 无人机的航向生成方法和***

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007129407A (ja) * 2005-11-02 2007-05-24 Hitachi Advanced Digital Inc カメラシステム、地図情報表示システム
US20080045138A1 (en) * 2006-05-01 2008-02-21 Microsoft Corporation Context information communications via a mobile device
CN102419171A (zh) * 2011-08-10 2012-04-18 王桥生 一种基于无人机航拍的灾害监测电子勾绘***
CN103959288A (zh) * 2011-11-30 2014-07-30 诺基亚公司 用于基于web的增强现实应用查看器的方法和装置
CN103747230A (zh) * 2013-12-11 2014-04-23 深圳先进技术研究院 动态定位视频电子地图投影***和方法
CN104035446A (zh) * 2014-05-30 2014-09-10 深圳市大疆创新科技有限公司 无人机的航向生成方法和***

Also Published As

Publication number Publication date
CN107079144B (zh) 2020-03-17
CN107079144A (zh) 2017-08-18

Similar Documents

Publication Publication Date Title
US10664510B1 (en) Displaying clusters of media items on a map using representative media items
US10846324B2 (en) Device, method, and user interface for managing and interacting with media content
US8212784B2 (en) Selection and display of media associated with a geographic area based on gesture input
US20180005040A1 (en) Event-based image classification and scoring
US8611678B2 (en) Grouping digital media items based on shared features
KR101557297B1 (ko) 장치에 내장된 3d 콘텐츠 집계
WO2019120068A1 (zh) 缩略图显示控制方法及移动终端
US10430456B2 (en) Automatic grouping based handling of similar photos
US11315340B2 (en) Methods and systems for detecting and analyzing a region of interest from multiple points of view
US20180132006A1 (en) Highlight-based movie navigation, editing and sharing
US20180357316A1 (en) Arrangement and related method for provision of video items
ES2914124T3 (es) Focalización multimedia
JP6555026B2 (ja) 情報提供システム
Kim et al. Design and implementation of geo-tagged video search framework
KR20160016574A (ko) 영상 제공 방법 및 이를 위한 장치
TW201608385A (zh) 用於媒體共同作業群組之方法及系統
TW201608398A (zh) 用於基於影像搜尋之方法及系統
JP6617547B2 (ja) 画像管理システム、画像管理方法、プログラム
JP6115113B2 (ja) 所定領域管理システム、所定領域管理方法、及びプログラム
WO2016106494A1 (zh) 一种实现媒体对象显示的方法、装置及***
US20180189602A1 (en) Method of and system for determining and selecting media representing event diversity
US20140324921A1 (en) Electronic device, method, and storage medium
FI129291B (en) Systems and procedure for providing videos
Kim et al. Preference-customizable clustering system for smartphone photographs

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14909307

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14909307

Country of ref document: EP

Kind code of ref document: A1