CN108124104B

CN108124104B - Method and system for customizing and modifying acquired data and mobile terminal

Info

Publication number: CN108124104B
Application number: CN201711487308.3A
Authority: CN
Inventors: 爨庚雷; 管帅朝; 王海腾; 杨博
Original assignee: Beijing Anyun Century Technology Co Ltd
Current assignee: Beijing Anyun Century Technology Co Ltd
Priority date: 2017-12-29
Filing date: 2017-12-29
Publication date: 2021-02-23
Anticipated expiration: 2037-12-29
Also published as: CN108124104A

Abstract

The invention discloses a method, a system and a mobile terminal for customizing and modifying acquired data, wherein the method comprises the following steps: acquiring to-be-processed acquisition data by using a data acquisition service; determining a target area needing to be customized and modified in the acquired data to be processed; performing image recognition on the data in the target area, determining a custom modified subject classification based on the result of the image recognition, determining additional information associated with the acquired data to be processed, and determining a custom modified content classification based on the additional information; determining a customization profile for the customization modification based on the topic classification and the content classification, selecting default customization data associated with the customization modification from a customization database based on the customization profile; and customizing and modifying the acquired data to be processed according to the default customized data, and taking the acquired data generated through the customization and modification as basic data of the data acquisition service.

Description

Method and system for customizing and modifying acquired data and mobile terminal

Technical Field

The present invention relates to the field of data processing technology, and more particularly, to a method, a system and a mobile terminal for customizing and modifying acquired data.

Background

At present, with the rapid development of intelligent terminals and related technologies, terminal devices have become more and more popular in people's lives, which greatly facilitates people's lives, entertainment and study, and common terminal devices include mobile terminals such as mobile phones, notebook computers, tablet computers and wearable intelligent devices, or non-mobile terminals such as televisions and desktop computers. With the popularization of terminals, people can more conveniently carry out video communication or transmit pictures.

With the image modification technology becoming mature, people have more and more demands on modifying pictures or videos shot by mobile terminals. Various types of beauty, beauty and beauty applications have been approved by users. However, the current beauty applications, beauty applications and beauty applications can only perform default beauty options or default decoration schemes for default beauty settings or profiles, and cannot set the default decoration schemes according to dynamic information of the mobile terminal or the user equipment.

Disclosure of Invention

In order to solve the above problem, there is provided a method for customized modification of acquired data, the method comprising:

acquiring to-be-processed acquisition data by using a data acquisition service;

determining a target area needing to be customized and modified in the acquired data to be processed;

performing image recognition on the data in the target area, determining a custom modified subject classification based on the result of the image recognition, determining additional information associated with the acquired data to be processed, and determining a custom modified content classification based on the additional information;

determining a customization profile for the customization modification based on the topic classification and the content classification, selecting default customization data associated with the customization modification from a customization database based on the customization profile; and

and customizing and modifying the acquired data to be processed according to the default customized data, and taking the acquired data generated through customization and modification as basic data of the data acquisition service.

The data acquisition service acquires acquired data to be processed by using a camera device of user equipment, and the acquired data to be processed is video data.

And taking each data frame of the acquired data to be processed as an image to be processed, and determining a target area needing to be customized and modified in the image to be processed by using an area identification technology.

And the target area which needs to be customized and modified in the acquired data to be processed is formed by the target area which needs to be customized and modified of each data frame.

Wherein image recognizing the data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points.

The determining a custom modified topic classification based on the result of the image recognition comprises: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points.

The topic classification includes: a subject category, an age rating, a skin color rating, and/or a smoothness rating.

The additional information is location information and determining a custom modified content classification based on the location information comprises: determining a current location of the user device based on the location information, and obtaining a content classification of the customization data associated with the current location.

The content classification includes: country, scenic spot, region, land, sea, lake, beach or bridge.

The additional information is temporal information, and determining a custom modified content classification based on the temporal information comprises: and determining the current time of the user equipment based on the time information, and acquiring the content classification of the customization data associated with the current time.

The content classification includes: season, date or time.

Wherein determining the custom modified custom profile based on the topic classification and the content classification comprises: summary information for custom modification of the collected data is determined based on the topic classification and the content classification, and a custom profile is generated based on the summary information.

Wherein selecting default customization data associated with the customization modification from a customization database based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to select a weight value, and searching a customization database based on the weight value to select default customization data associated with the customization modification.

The type of the custom data is single-frame image data, and the acquired data to be processed is customized and modified according to the default custom data in an image suspension fusion mode marked by real-time information.

The type of the custom data is video data, and the acquired data to be processed is customized and modified according to the default custom data in a real-time moving image suspension fusion mode.

The type of the customization data is decoration data for modifying a part or all of pixels of the first base image data.

The customizing and modifying the collected data to be processed according to the default customizing data comprises the following steps: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel.

After the acquired data generated through the customized modification is used as the basic data of the data acquisition service, the acquired data acquired by all the applications is the acquired data generated through the customized modification but not the original acquired data.

According to one aspect of the present invention, there is provided a method for customized modification of acquired data, the method comprising:

acquiring to-be-processed acquisition data by using a data acquisition service;

determining a customization profile for the customization modification based on the topic classification and the content classification, ordering customization data associated with the customization modification in a customization database based on the customization profile; and

and customizing and modifying the acquired data to be processed according to the customized data sequenced at the head, and taking the acquired data generated by customization and modification as the basic data of the data acquisition service.

And each data frame of the acquired data to be processed is used as an image to be processed, and a target area needing to be customized and modified is determined in the image to be processed through an area identification technology.

The content classification includes: season, date or time.

Wherein ordering customization data in a customization database associated with the customization modification based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to obtain a weighted value, and ordering customization data associated with the customization modification in a customization database based on the weighted value.

The type of the custom data is single-frame image data, and the acquired data to be processed is customized and modified according to the custom data sequenced at the head through an image suspension fusion mode marked by real-time information.

The type of the custom data is video data, and the acquired data to be processed is customized and modified according to the ordered first custom data in a real-time moving image suspension fusion mode.

The customizing and modifying the collected data according to the customizing data sequenced at the head comprises the following steps: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel.

And when the user does not select the customized data sorted at the top, displaying the fixed number data according to the sorting for the user to select.

According to one aspect of the present invention, there is provided a system for customized modification of acquired data, the system comprising:

an acquisition unit that acquires acquired data to be processed by using a data acquisition service;

the determining unit is used for determining a target area needing to be customized and modified in the to-be-processed collected data;

an identification unit which performs image identification on the data in the target area, determines a customized modified subject classification based on the result of the image identification, determines additional information associated with the acquired data to be processed, and determines a customized modified content classification based on the additional information;

a selection unit for determining a custom profile for the custom modification based on the topic classification and the content classification, and for selecting default custom data associated with the custom modification from a custom database based on the custom profile; and

and the customizing unit customizes and modifies the acquired data to be processed according to the default customizing data, and takes the acquired data generated through customization and modification as the basic data of the data acquisition service.

The acquisition unit acquires, by using the data acquisition service, the acquired data to be processed by using an image pickup device of the user equipment, and the acquired data to be processed is video data.

The determining unit takes each data frame of the acquired data to be processed as an image to be processed, and determines a target area needing to be customized and modified in the image to be processed through an area identification technology.

The determining unit makes the target area of each data frame which needs to be customized and modified into the target area which needs to be customized and modified in the acquired data to be processed.

The identification unit performs image identification on the data in the target area by taking each data frame of the acquired data to be processed as a unit so as to determine the related characteristic identification point.

The identification unit determines a subject classification for custom modification of the data in the target area based on the feature recognition points.

The additional information is location information, and the identification unit determines a current location of the user equipment based on the location information, acquires the customization modification and modifies a content classification of the customization data associated with the current location.

The additional information is time information, and the identifying unit determines a current time at which the user equipment is located based on the time information, and acquires the content classification of the customization data associated with the current time.

The content classification includes: season, date or time.

Wherein the selection unit determines summary information for custom modification of the collected data based on the subject classification and the content classification, and generates a custom profile based on the summary information.

Wherein the selection unit assigns a weight value to the summary information in the customization profile, weights the summary information based on the weight value to compute a weight, and searches a customization database based on the weight value to select default customization data associated with the customization modification.

The type of the custom data is single-frame image data, and the custom unit customizes and modifies the acquired data to be processed according to the default custom data in an image suspension fusion mode marked by real-time information.

The type of the customization data is video data, and the customization unit customizes and modifies the acquired data to be processed according to the default customization data in a real-time moving image suspension fusion mode.

The customization unit determines a modification position in the acquired data corresponding to the modification data, and fuses the modification data and the data at the modification position pixel by pixel.

According to an aspect of the invention, there is provided a mobile terminal comprising or adapted to carry out the system as described above.

a selection unit for determining a customization profile for the customization modification based on the subject classification and the content classification, and for ordering customization data associated with the customization modification in a customization database based on the customization profile; and

and the customizing unit customizes and modifies the acquired data to be processed according to the customizing data sequenced at the head, and takes the acquired data generated through customizing and modifying as the basic data of the data acquisition service.

The content classification includes: season, date or time.

Wherein the selection unit assigns a weight value to the summary information in the customization profile, weights the summary information based on the weight value to compute a weight value, and sorts the customization data associated with the customization modification in the customization database based on the weight value.

The type of the custom data is single-frame image data, and the custom unit customizes and modifies the acquired data to be processed according to the custom data sequenced at the head through an image suspension fusion mode marked by real-time information.

The type of the customization data is video data, and the customization unit customizes and modifies the acquired data to be processed according to the customization data sequenced at the head in a real-time moving image suspension fusion mode.

Drawings

A more complete understanding of exemplary embodiments of the present invention may be had by reference to the following drawings in which:

FIG. 1 is a flow chart of a method of custom modifying acquired data according to an embodiment of the present invention;

FIG. 2 is a flow diagram of a method for customized modification of collected data according to another embodiment of the present invention;

FIG. 3 is a schematic diagram of a customized modification of acquired data according to an embodiment of the invention;

FIG. 4 is a schematic illustration of a customized modification of acquired data according to another embodiment of the present invention;

FIG. 5 is a schematic diagram of a system for customized modification of collected data according to an embodiment of the present invention; and

fig. 6 is a schematic structural diagram of a system for customized modification of acquired data according to another embodiment of the present invention.

Detailed Description

The exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, however, the present invention may be embodied in many different forms and is not limited to the embodiments described herein, which are provided for complete and complete disclosure of the present invention and to fully convey the scope of the present invention to those skilled in the art. The terminology used in the exemplary embodiments illustrated in the accompanying drawings is not intended to be limiting of the invention. In the drawings, the same units/elements are denoted by the same reference numerals.

Unless otherwise defined, terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Further, it will be understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense.

FIG. 1 is a flow diagram of a method 100 for customized modification of acquired data in accordance with an embodiment of the present invention. The method comprises the steps of obtaining to-be-processed acquired data and determining a target area needing to be customized and modified in the to-be-processed acquired data. Image recognition is performed on the data within the target region, and a custom modified topic classification is determined based on the results of the image recognition. Additional information associated with the acquired data to be processed is determined, and a custom modified content classification is determined based on the additional information. The present application determines a customization profile for the customization modification based on the topic classification and the content classification, and selects default customization data associated with the customization modification from a customization database based on the customization profile. The method and the device perform customization modification on the acquired data to be processed according to the default customization data, and use the acquired data generated through customization modification as basic data of the data acquisition service

As shown in fig. 1, method 100 begins at step 101. In step 101, acquisition data to be processed is acquired using a data acquisition service. The data acquisition service acquires acquired data to be processed by using a camera device of user equipment, and the acquired data to be processed is video data. Wherein the data acquisition service may be a camera service within the user device and the acquisition data to be processed may be video data acquired by the camera service. In general, a camera service may acquire video data through a front camera or a rear camera of a user device. Typically, a user device initiates a data acquisition service in response to a user initiated initiation request for the data acquisition service.

In step 102, a target area requiring customized modification is determined in the acquired data to be processed. And taking each data frame of the acquired data to be processed as an image to be processed, and determining a target area needing to be customized and modified in the image to be processed by using an area identification technology. The target area is, for example, a human face or the like. Generally, when the acquired data to be processed is a single frame image, the target area to be custom-modified can be directly determined in the image to be processed by the area identification technology. When the to-be-processed collected data is multi-frame video data, the target area which needs to be customized and modified in the to-be-processed collected data is formed by the target area which needs to be customized and modified of each data frame. In this case, the target area may cause a position change according to the movement of the image pickup device of the user equipment (or the mobile terminal).

In step 103, image recognition is performed on the data within the target region. Wherein image recognizing the data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points. Determining a custom modified subject matter classification based on a result of the image recognition, determining additional information associated with the acquired data to be processed, and determining a custom modified content classification based on the additional information. The determining a custom modified topic classification based on the result of the image recognition comprises: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points. Wherein the topic classification may include: a subject category, an age rating, a skin color rating, and/or a smoothness rating. In order to be able to determine a dynamic scenario or a list of dynamic scenarios for customized modification of data within the target area, a target area (or target object) needs to be identified. Different dynamic scenarios or lists of dynamic scenarios are determined based on the subject category, age rating, skin color rating, and/or smoothness rating of the target area. In general, different subject categories (e.g., race), age ratings (children, adolescents, middle age, or elderly), skin color ratings (e.g., white skin color, yellow skin color, or black skin color), and/or smoothness ratings (e.g., smoothness of skin) may require different dynamic scenarios or lists of dynamic scenarios.

Wherein the additional information is location information and determining a custom modified content classification based on the location information comprises: determining a current location of the user device based on the location information, and obtaining a content classification of the customization data associated with the current location. The content classification includes: country, scenic spot, region, land, sea, lake, beach or bridge. Generally, when a user performs image acquisition at different locations using a user equipment (mobile terminal), different dynamic schemes or dynamic scheme lists may be required. For example, in a photograph taken by a Chinese adult, a facial effect with a panda icon may be desired.

Wherein the additional information is temporal information and determining a custom modified content classification based on the temporal information comprises: and determining the current time of the user equipment based on the time information, and acquiring the content classification of the customization data associated with the current time. The content classification includes: season, date or time. Generally, when a user performs image acquisition using a user equipment (mobile terminal) at different times, different dynamic scenarios or dynamic scenario lists may be required. For example, when taking a photograph in the evening of autumn, a rendering effect with gold fallen leaves may be required.

At step 104, a customization profile for the customization modification is determined based on the subject classification and the content classification, and default customization data associated with the customization modification is selected from a customization database based on the customization profile. Wherein determining the custom modified custom profile based on the topic classification and the content classification comprises: summary information for custom modification of the collected data is determined based on the topic classification and the content classification, and a custom profile is generated based on the summary information. Wherein selecting default customization data associated with the customization modification from a customization database based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to select a weight value, and searching a customization database based on the weight value to select default customization data associated with the customization modification.

In step 105, the collected data to be processed is customized and modified according to the default customized data, and the collected data generated through the customization and modification is used as the basic data of the data acquisition service. The type of the custom data is single-frame image data, and the acquired data to be processed is customized and modified according to the default custom data in an image suspension fusion mode marked by real-time information. The type of the custom data is video data, and the acquired data to be processed is customized and modified according to the default custom data in a real-time moving image suspension fusion mode. The type of the customization data is decoration data for modifying a part or all of pixels of the first base image data. The customizing and modifying the collected data to be processed according to the default customizing data comprises the following steps: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel. After the acquired data generated through the customized modification is used as the basic data of the data acquisition service, the acquired data acquired by all the applications is the acquired data generated through the customized modification but not the original acquired data.

FIG. 2 is a flow diagram of a method 200 for customized modification of acquired data according to another embodiment of the invention. The method comprises the steps of obtaining to-be-processed acquired data and determining a target area needing to be customized and modified in the to-be-processed acquired data. Image recognition is performed on the data within the target region, and a custom modified topic classification is determined based on the results of the image recognition. Additional information associated with the acquired data to be processed is determined, and a custom modified content classification is determined based on the additional information. The present application determines a customization profile for the customization modification based on the topic classification and the content classification, and selects default customization data associated with the customization modification from a customization database based on the customization profile. According to the data acquisition service processing method and device, customization modification is conducted on the acquired data to be processed according to the default customization data, and the acquired data generated through customization modification are used as basic data of the data acquisition service.

As shown in fig. 2, method 200 begins at step 201. In step 201, the data acquisition service is utilized to acquire the acquisition data to be processed. The data acquisition service acquires acquired data to be processed by using a camera device of user equipment, and the acquired data to be processed is video data. Wherein the data acquisition service may be a camera service within the user device and the acquisition data to be processed may be video data acquired by the camera service. In general, a camera service may acquire video data through a front camera or a rear camera of a user device. Typically, a user device initiates a data acquisition service in response to a user initiated initiation request for the data acquisition service.

In step 202, a target area requiring customized modification is determined in the acquired data to be processed. And taking each data frame of the acquired data to be processed as an image to be processed, and determining a target area needing to be customized and modified in the image to be processed by using an area identification technology. The target area is, for example, a human face or the like. Generally, when the acquired data to be processed is a single frame image, the target area to be custom-modified can be directly determined in the image to be processed by the area identification technology. When the to-be-processed collected data is multi-frame video data, the target area which needs to be customized and modified in the to-be-processed collected data is formed by the target area which needs to be customized and modified of each data frame. In this case, the target area may cause a position change according to the movement of the image pickup device of the user equipment (or the mobile terminal).

In step 203, image recognition is performed on the data within the target region. Wherein image recognizing the data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points. Determining a custom modified subject matter classification based on a result of the image recognition, determining additional information associated with the acquired data to be processed, and determining a custom modified content classification based on the additional information. The determining a custom modified topic classification based on the result of the image recognition comprises: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points. Wherein the topic classification may include: a subject category, an age rating, a skin color rating, and/or a smoothness rating. In order to be able to determine a dynamic scenario or a list of dynamic scenarios for customized modification of data within the target area, a target area (or target object) needs to be identified. Different dynamic scenarios or lists of dynamic scenarios are determined based on the subject category, age rating, skin color rating, and/or smoothness rating of the target area. In general, different subject categories (e.g., race), age ratings (children, adolescents, middle age, or elderly), skin color ratings (e.g., white skin color, yellow skin color, or black skin color), and/or smoothness ratings (e.g., smoothness of skin) may require different dynamic scenarios or lists of dynamic scenarios.

At step 204, a customization profile for the customization modification is determined based on the topic classification and the content classification, and customization data associated with the customization modification in a customization database is sorted based on the customization profile. Wherein determining the custom modified custom profile based on the topic classification and the content classification comprises: summary information for custom modification of the collected data is determined based on the topic classification and the content classification, and a custom profile is generated based on the summary information. Wherein ordering customization data in a customization database associated with the customization modification based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to obtain a weighted value, and ordering customization data associated with the customization modification in a customization database based on the weighted value.

In step 205, the collected data to be processed is customized and modified according to the customized data sorted at the head, and the collected data generated through the customization and modification is used as the basic data of the data acquisition service.

The type of the custom data is single-frame image data, and the acquired data to be processed is customized and modified according to the custom data sequenced at the head through an image suspension fusion mode marked by real-time information. The type of the custom data is video data, and the acquired data to be processed is customized and modified according to the ordered first custom data in a real-time moving image suspension fusion mode. The type of the customization data is decoration data for modifying a part or all of pixels of the first base image data. The customizing and modifying the collected data according to the customizing data sequenced at the head comprises the following steps: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel. And when the user does not select the customized data sorted at the top, displaying the fixed number data according to the sorting for the user to select. After the acquired data generated through the customized modification is used as the basic data of the data acquisition service, the acquired data acquired by all the applications is the acquired data generated through the customized modification but not the original acquired data.

FIG. 3 is a schematic diagram of customized modification of acquired data according to an embodiment of the invention. As shown in fig. 3, when a user wishes to perform dynamic skin-care or beauty via a user device (or mobile terminal), an application 301 installed in the user device may be selected to be run. When the application 301 is running, a menu 302 may be generated. In menu 302, the options include stickers, make-up, and special effects. The user can make a customized modification by selecting a corresponding function.

FIG. 4 is a schematic diagram of customized modification of acquired data according to another embodiment of the invention. As shown in fig. 4, a target area 402 is determined by acquiring acquisition data 401 to be processed and determining a customized modification required in the acquisition data 401 to be processed. Image recognition is performed on the data within the target area 402 and a custom modified topic classification is determined based on the results of the image recognition. Additional information associated with the acquired data to be processed is determined, and a custom modified content classification is determined based on the additional information. The present application determines a customization profile for the customization modification based on the topic classification and the content classification, and selects default customization data associated with the customization modification from a customization database based on the customization profile. According to the data acquisition service processing method and device, customization modification is conducted on the acquired data to be processed according to the default customization data, and the acquired data generated through customization modification are used as basic data of the data acquisition service.

At the lower end of the display area of the user device, the function menu 403 may determine the customization profile for the customization modification based on the topic classification and the content classification, and order the customization data associated with the customization modification in the customization database based on the customization profile. The collected data to be processed is customized and modified according to the first ordered customization data, and the ordered sequence is displayed, such as the three ordered customization data shown in the function menu 403. Further, the function menu 403 may determine a customization profile for the customization modification based on the topic classification and the content classification, and select default customization data associated with the customization modification from a customization database based on the customization profile. And performing customization modification on the acquired data to be processed according to the default customization data, and sequencing other customization data in addition to the default customization data to provide a sequenced customization data list.

Fig. 5 is a schematic structural diagram of a system 500 for customized modification of acquired data according to an embodiment of the present invention. The method comprises the steps of obtaining to-be-processed acquired data and determining a target area needing to be customized and modified in the to-be-processed acquired data. Image recognition is performed on the data within the target region, and a custom modified topic classification is determined based on the results of the image recognition. Additional information associated with the acquired data to be processed is determined, and a custom modified content classification is determined based on the additional information. The present application determines a customization profile for the customization modification based on the topic classification and the content classification, and selects default customization data associated with the customization modification from a customization database based on the customization profile. According to the data acquisition service processing method and device, customization modification is conducted on the acquired data to be processed according to the default customization data, and the acquired data generated through customization modification are used as basic data of the data acquisition service.

The system 500 includes: an acquisition unit 501, a determination unit 502, a recognition unit 503, a selection unit 504, and a customization unit 505. The acquisition unit 501 acquires acquired data to be processed using a data acquisition service. The data acquisition service acquires acquired data to be processed by using a camera device of user equipment, and the acquired data to be processed is video data. Wherein the data acquisition service may be a camera service within the user device and the acquisition data to be processed may be video data acquired by the camera service. In general, a camera service may acquire video data through a front camera or a rear camera of a user device. Typically, a user device initiates a data acquisition service in response to a user initiated initiation request for the data acquisition service.

The determining unit 502 determines a target area in the to-be-processed acquired data, which needs to be customized and modified. And taking each data frame of the acquired data to be processed as an image to be processed, and determining a target area needing to be customized and modified in the image to be processed by using an area identification technology. The target area is, for example, a human face or the like. Generally, when the acquired data to be processed is a single frame image, the target area to be custom-modified can be directly determined in the image to be processed by the area identification technology. When the to-be-processed collected data is multi-frame video data, the target area which needs to be customized and modified in the to-be-processed collected data is formed by the target area which needs to be customized and modified of each data frame. In this case, the target area may cause a position change according to the movement of the image pickup device of the user equipment (or the mobile terminal).

The recognition unit 503 performs image recognition on the data within the target region. Wherein image recognizing the data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points. Determining a custom modified subject matter classification based on a result of the image recognition, determining additional information associated with the acquired data to be processed, and determining a custom modified content classification based on the additional information. The determining a custom modified topic classification based on the result of the image recognition comprises: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points. Wherein the topic classification may include: a subject category, an age rating, a skin color rating, and/or a smoothness rating. In order to be able to determine a dynamic scenario or a list of dynamic scenarios for customized modification of data within the target area, a target area (or target object) needs to be identified. Different dynamic scenarios or lists of dynamic scenarios are determined based on the subject category, age rating, skin color rating, and/or smoothness rating of the target area. In general, different subject categories (e.g., race), age ratings (children, adolescents, middle age, or elderly), skin color ratings (e.g., white skin color, yellow skin color, or black skin color), and/or smoothness ratings (e.g., smoothness of skin) may require different dynamic scenarios or lists of dynamic scenarios.

The selection unit 504 determines a customization profile for the customization modification based on the topic classification and the content classification, and selects default customization data associated with the customization modification from a customization database based on the customization profile. Wherein determining the custom modified custom profile based on the topic classification and the content classification comprises: summary information for custom modification of the collected data is determined based on the topic classification and the content classification, and a custom profile is generated based on the summary information. Wherein selecting default customization data associated with the customization modification from a customization database based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to select a weight value, and searching a customization database based on the weight value to select default customization data associated with the customization modification.

The customizing unit 505 customizes and modifies the acquired data to be processed according to the default customization data, and uses the acquired data generated through customization and modification as the basic data of the data acquiring service. The type of the custom data is single-frame image data, and the acquired data to be processed is customized and modified according to the default custom data in an image suspension fusion mode marked by real-time information. The type of the custom data is video data, and the acquired data to be processed is customized and modified according to the default custom data in a real-time moving image suspension fusion mode. The type of the customization data is decoration data for modifying a part or all of pixels of the first base image data. The customizing and modifying the collected data to be processed according to the default customizing data comprises the following steps: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel. After the acquired data generated through the customized modification is used as the basic data of the data acquisition service, the acquired data acquired by all the applications is the acquired data generated through the customized modification but not the original acquired data.

Fig. 6 is a schematic diagram of a system 600 for customized modification of collected data according to another embodiment of the present invention. The method comprises the steps of obtaining to-be-processed acquired data and determining a target area needing to be customized and modified in the to-be-processed acquired data. Image recognition is performed on the data within the target region, and a custom modified topic classification is determined based on the results of the image recognition. Additional information associated with the acquired data to be processed is determined, and a custom modified content classification is determined based on the additional information. The present application determines a customization profile for the customization modification based on the topic classification and the content classification, and selects default customization data associated with the customization modification from a customization database based on the customization profile. According to the data acquisition service processing method and device, customization modification is conducted on the acquired data to be processed according to the default customization data, and the acquired data generated through customization modification are used as basic data of the data acquisition service.

The system 600 includes: an acquisition unit 601, a determination unit 602, a recognition unit 603, a selection unit 604, and a customization unit 605. The acquisition unit 601 acquires acquired data to be processed using a data acquisition service. The data acquisition service acquires acquired data to be processed by using a camera device of user equipment, and the acquired data to be processed is video data. Wherein the data acquisition service may be a camera service within the user device and the acquisition data to be processed may be video data acquired by the camera service. In general, a camera service may acquire video data through a front camera or a rear camera of a user device. Typically, a user device initiates a data acquisition service in response to a user initiated initiation request for the data acquisition service.

The determining unit 602 determines a target area in the to-be-processed acquired data, which needs to be customized and modified. And taking each data frame of the acquired data to be processed as an image to be processed, and determining a target area needing to be customized and modified in the image to be processed by using an area identification technology. The target area is, for example, a human face or the like. Generally, when the acquired data to be processed is a single frame image, the target area to be custom-modified can be directly determined in the image to be processed by the area identification technology. When the to-be-processed collected data is multi-frame video data, the target area which needs to be customized and modified in the to-be-processed collected data is formed by the target area which needs to be customized and modified of each data frame. In this case, the target area may cause a position change according to the movement of the image pickup device of the user equipment (or the mobile terminal).

The recognition unit 603 performs image recognition on the data within the target region. Wherein image recognizing the data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points. Determining a custom modified subject matter classification based on a result of the image recognition, determining additional information associated with the acquired data to be processed, and determining a custom modified content classification based on the additional information. The determining a custom modified topic classification based on the result of the image recognition comprises: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points. Wherein the topic classification may include: a subject category, an age rating, a skin color rating, and/or a smoothness rating. In order to be able to determine a dynamic scenario or a list of dynamic scenarios for customized modification of data within the target area, a target area (or target object) needs to be identified. Different dynamic scenarios or lists of dynamic scenarios are determined based on the subject category, age rating, skin color rating, and/or smoothness rating of the target area. In general, different subject categories (e.g., race), age ratings (children, adolescents, middle age, or elderly), skin color ratings (e.g., white skin color, yellow skin color, or black skin color), and/or smoothness ratings (e.g., smoothness of skin) may require different dynamic scenarios or lists of dynamic scenarios.

The selection unit 604 determines a customization profile for the customization modification based on the topic classification and the content classification, and orders customization data associated with the customization modification in a customization database based on the customization profile. Wherein determining the custom modified custom profile based on the topic classification and the content classification comprises: summary information for custom modification of the collected data is determined based on the topic classification and the content classification, and a custom profile is generated based on the summary information. Wherein ordering customization data in a customization database associated with the customization modification based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to obtain a weighted value, and ordering customization data associated with the customization modification in a customization database based on the weighted value.

The customizing unit 605 customizes and modifies the acquired data to be processed according to the customization data sorted at the head, and uses the acquired data generated through customization and modification as the basic data of the data acquiring service. The type of the custom data is single-frame image data, and the acquired data to be processed is customized and modified according to the custom data sequenced at the head through an image suspension fusion mode marked by real-time information. The type of the custom data is video data, and the acquired data to be processed is customized and modified according to the ordered first custom data in a real-time moving image suspension fusion mode. The type of the customization data is decoration data for modifying a part or all of pixels of the first base image data. The customizing and modifying the collected data according to the customizing data sequenced at the head comprises the following steps: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel. And when the user does not select the customized data sorted at the top, displaying the fixed number data according to the sorting for the user to select. After the acquired data generated through the customized modification is used as the basic data of the data acquisition service, the acquired data acquired by all the applications is the acquired data generated through the customized modification but not the original acquired data.

The application also relates to a mobile terminal comprising or being adapted to carry out the system as described above.

The invention has been described with reference to a few embodiments. However, other embodiments of the invention than the one disclosed above are equally possible within the scope of the invention, as would be apparent to a person skilled in the art from the appended patent claims.

Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to "a/an/the [ device, component, etc ]" are to be interpreted openly as referring to at least one instance of said device, component, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated.

Claims

1. A method for customized modification of acquired data, the method comprising:

acquiring to-be-processed acquisition data by using a data acquisition service;

determining summary information for custom modification of the collected data based on the subject classification and the content classification, and generating a custom profile based on the summary information, selecting default custom data associated with the custom modification from a custom database based on the custom profile; and

customizing and modifying the acquired data to be processed according to the default customized data, and taking the acquired data generated by the customization and modification as basic data of the data acquisition service;

wherein the additional information is location information and determining a custom modified content classification based on the location information comprises: determining a current location of the user device based on the location information, and obtaining a content classification of the customization data associated with the current location.

2. The method of claim 1, the data acquisition service acquiring the to-be-processed captured data by using a camera of the user device, and the to-be-processed captured data being video data.

3. The method according to claim 1 or 2, wherein each data frame of the acquired data to be processed is used as an image to be processed, and a target area needing to be customized and modified is determined in the image to be processed by a region identification technology.

4. The method of claim 3, wherein the target area of the to-be-processed acquired data that needs to be customized is composed of the target area of each data frame that needs to be customized.

5. The method of claim 1, wherein image recognizing data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points.

6. The method of claim 5, the determining a custom modified topic classification based on a result of the image recognition comprising: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points.

7. The method of claim 6, the topic classification comprising: a subject category, an age rating, a skin color rating, and/or a smoothness rating.

8. The method of claim 1, the content classification comprising: country, scenic spot, region, land, sea, lake, beach or bridge.

9. The method of claim 1, the additional information being temporal information, and determining a custom modified content classification based on the temporal information comprising: and determining the current time of the user equipment based on the time information, and acquiring the content classification of the customization data associated with the current time.

10. The method of claim 9, the content classification comprising: season, date or time.

11. The method of claim 1, wherein selecting default customization data associated with the customization modification from a customization database based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to select a weight value, and searching a customization database based on the weight value to select default customization data associated with the customization modification.

12. The method according to claim 1, wherein the type of the customized data is single frame image data, and the acquired data to be processed is customized and modified according to the default customized data in a real-time information labeled image suspension fusion manner.

13. The method according to claim 1, wherein the type of the customization data is video data, and the acquired data to be processed is customized and modified according to the default customization data in a real-time moving image suspension fusion manner.

14. The method of claim 1, the type of customization data being decoration data for modifying some or all pixels of the first base image data.

15. The method of claim 14, wherein custom modifying the acquisition data to be processed according to the default custom data comprises: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel.

16. The method of claim 1, wherein the acquired acquisition data for all applications is the custom modified generated acquisition data rather than the original acquisition data after the custom modified generated acquisition data is used as the base data for the data acquisition service.

17. A method for customized modification of acquired data, the method comprising:

acquiring to-be-processed acquisition data by using a data acquisition service;

determining summary information for custom modification of the collected data based on the subject classification and the content classification, and generating a custom profile based on the summary information, ordering custom data in a custom database associated with the custom modification based on the custom profile; and

customizing and modifying the acquired data to be processed according to the customized data sequenced at the head, and taking the acquired data generated by the customization and modification as basic data of the data acquisition service;

18. The method of claim 17, the data acquisition service acquiring the to-be-processed captured data by using a camera of the user device, and the to-be-processed captured data being video data.

19. The method according to claim 17 or 18, wherein each data frame of the acquired data to be processed is used as an image to be processed, and a target area needing to be customized and modified is determined in the image to be processed by an area identification technology.

20. The method of claim 19, wherein the target area of the to-be-processed acquired data that needs to be customized is composed of the target area of each data frame that needs to be customized.

21. The method of claim 17, wherein image recognizing data within the target region comprises: and performing image recognition on the data in the target area by taking each data frame of the to-be-processed acquired data as a unit to determine related feature recognition points.

22. The method of claim 21, the determining a custom modified topic classification based on a result of image recognition comprising: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points.

23. The method of claim 22, the topic classification comprising: a subject category, an age rating, a skin color rating, and/or a smoothness rating.

24. The method of claim 17, the content classification comprising: country, scenic spot, region, land, sea, lake, beach or bridge.

25. The method of claim 17, the additional information being temporal information, and determining a custom modified content classification based on the temporal information comprising: and determining the current time of the user equipment based on the time information, and acquiring the content classification of the customization data associated with the current time.

26. The method of claim 25, the content classification comprising: season, date or time.

27. The method of claim 17, wherein ordering customization data in a customization database associated with the customization modification based on the customization profile comprises: assigning a weight value to the summary information in the customization profile, weighting the summary information based on the weight value to obtain a weighted value, and ordering customization data associated with the customization modification in a customization database based on the weighted value.

28. The method according to claim 17, wherein the type of the custom data is single frame image data, and the acquired data to be processed is custom-modified according to the custom data sorted at the head by an image suspension fusion mode of real-time information annotation.

29. The method according to claim 17, wherein the type of the custom data is video data, and the acquired data to be processed is custom-modified according to the ordered first custom data in a real-time moving image suspension fusion manner.

30. The method of claim 17, the type of customization data being decoration data for modifying some or all pixels of the first base image data.

31. The method of claim 30, wherein the custom modifying the acquisition data according to the top ordered custom data comprises: determining a modification position in the acquired data corresponding to the modification data, and fusing the modification data and the data at the modification position pixel by pixel.

32. The method of claim 17, when the user does not select the first ordered customization data, presenting the customization data according to the ordering for selection by the user.

33. The method of claim 17, wherein the acquired acquisition data for all applications is the custom modified generated acquisition data rather than the original acquisition data after the custom modified generated acquisition data is used as the base data for the data acquisition service.

34. A system for customized modification of acquired data, the system comprising:

a selection unit that determines summary information for custom modification of the collected data based on the subject classification and the content classification, and generates a custom profile based on the summary information, and selects default custom data associated with the custom modification from a custom database based on the custom profile; and

the customization unit customizes and modifies the acquired data to be processed according to the default customization data, and takes the acquired data generated by customization and modification as the basic data of the data acquisition service;

wherein the additional information is location information, and the identifying unit determines a current location of the user equipment based on the location information, and acquires the content classification of the customization data associated with the current location.

35. The system according to claim 34, wherein the acquisition unit acquires the to-be-processed captured data by using an image pickup device of the user equipment by using the data acquisition service, and the to-be-processed captured data is video data.

36. The system according to claim 35, wherein the determining unit determines a target area in the image to be processed, which needs to be customized and modified, by using a region identification technology, with each data frame of the acquired data to be processed as the image to be processed.

37. The system of claim 36, wherein the determining unit combines the target area of each data frame that needs to be customized and modified into the target area of the to-be-processed acquired data that needs to be customized and modified.

38. The system of claim 35, the recognition unit performing image recognition on the data within the target area to determine the feature recognition points involved, in units of each data frame of the acquired data to be processed.

39. The system of claim 38, the recognition unit determines a subject classification for custom modification of data within the target region based on the feature recognition points.

40. The system of claim 39, the topic classification comprising: a subject category, an age rating, a skin color rating, and/or a smoothness rating.

41. The system of claim 34, the content classification comprising: country, scenic spot, region, land, sea, lake, beach or bridge.

42. The system of claim 34, wherein the additional information is time information, and the identifying unit determines a current time at which the user device is located based on the time information, and retrieves the content classification of the customization data associated with the current time.

43. The system of claim 42, the content classification comprising: season, date or time.

44. The system of claim 34, wherein the selection unit assigns a weight value to the summary information in the customization profile, weights the summary information based on a weighted calculation according to the weight value to a weighted value, searches a customization database based on the weighted value to select default customization data associated with the customization modification.

45. The system of claim 34, wherein the type of the customized data is single frame image data, and the customized unit performs customized modification on the acquired data to be processed according to the default customized data by an image suspension fusion mode of real-time information annotation.

46. The system of claim 34, wherein the type of customization data is video data, and the customization unit customizes and modifies the acquired data to be processed according to the default customization data by means of image suspension fusion moving in real time.

47. The system of claim 34, the type of customization data being decoration data for modifying some or all pixels of the first base image data.

48. The system according to claim 47, wherein the customizing unit determines a decoration position in the collected data corresponding to the decoration data, and performs pixel-by-pixel fusion of the decoration data and the data at the decoration position.

49. The system of claim 34, wherein after the custom modified generated acquisition data is used as the base data for the data acquisition service, the acquisition data acquired by all applications is the custom modified generated acquisition data rather than the original acquisition data.

50. A mobile terminal comprising or being adapted to carry out the system according to any of claims 34-49.

51. A system for customized modification of acquired data, the system comprising:

a selection unit which determines summary information for customizing the collected data based on the subject classification and the content classification, generates a customization profile based on the summary information, and sorts customization data associated with the customization modification in a customization database based on the customization profile; and

the customization unit customizes and modifies the acquired data to be processed according to the customization data sorted at the head, and takes the acquired data generated by customization and modification as the basic data of the data acquisition service;

52. The system according to claim 51, wherein the acquisition unit acquires the captured data to be processed by using an image pickup device of the user equipment by using the data acquisition service, and the captured data to be processed is video data.

53. The system according to claim 51 or 52, wherein the determining unit determines a target area needing customized modification in the image to be processed by using a region identification technology with each data frame of the acquired data to be processed as the image to be processed.

54. The system of claim 53, wherein the determining unit combines the target area of each data frame that needs to be customized and modified into the target area of the to-be-processed acquired data that needs to be customized and modified.

55. The system of claim 51, the recognition unit performing image recognition on the data within the target area to determine the feature recognition points involved, in units of each data frame of the acquired data to be processed.

56. The system of claim 55, the determining a custom modified topic classification based on a result of the image recognition comprising: and determining a subject classification for custom modification of the data in the target area based on the feature recognition points.

57. The system of claim 56, the topic classification comprising: a subject category, an age rating, a skin color rating, and/or a smoothness rating.

58. The system of claim 51, the content classification comprising: country, scenic spot, region, land, sea, lake, beach or bridge.

59. The system of claim 51, wherein the additional information is time information, and the identifying unit determines a current time at which the user device is located based on the time information, and retrieves the content classification of the customization data associated with the current time.

60. The system of claim 59, the content classification comprising: season, date or time.

61. The system of claim 51, wherein the selection unit assigns a weight value to the summary information in the customization profile, weights the summary information based on a weighted calculation according to the weight value to order customization data associated with the customization modification in a customization database based on the weight value.

62. The system of claim 51, wherein the type of the customized data is single frame image data, and the customized unit performs customized modification on the acquired data to be processed according to the first ordered customized data in an image suspension fusion mode marked by real-time information.

63. The system of claim 51, wherein the type of the customization data is video data, and the customization unit customizes and modifies the acquired data to be processed according to the customization data sorted at the head by means of image suspension fusion moving in real time.

64. The system of claim 51, the type of customization data being decoration data for modifying some or all pixels of first base image data.

65. The system according to claim 64, wherein the customization unit determines a modification position in the collected data corresponding to the modification data, and performs pixel-by-pixel fusion of the modification data and the data at the modification position.

66. A system as claimed in claim 51 or 65, wherein when the user does not select the customisation data ordered first, the customisation data is presented for selection by the user according to said ordering.

67. The system of claim 51, wherein the acquired acquisition data for all applications is the custom modified generated acquisition data rather than the original acquisition data after the custom modified generated acquisition data is used as the base data for the data acquisition service.

68. A mobile terminal comprising or being adapted to carry out the system according to any of claims 51-67.