CN111310866B - Data labeling method, device, system and terminal equipment - Google Patents

Data labeling method, device, system and terminal equipment Download PDF

Info

Publication number
CN111310866B
CN111310866B CN202010384137.7A CN202010384137A CN111310866B CN 111310866 B CN111310866 B CN 111310866B CN 202010384137 A CN202010384137 A CN 202010384137A CN 111310866 B CN111310866 B CN 111310866B
Authority
CN
China
Prior art keywords
terminal device
information
current picture
annotation
labeled
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010384137.7A
Other languages
Chinese (zh)
Other versions
CN111310866A (en
Inventor
马泽祥
赖伟彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alipay Hangzhou Information Technology Co Ltd
Original Assignee
Alipay Hangzhou Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alipay Hangzhou Information Technology Co Ltd filed Critical Alipay Hangzhou Information Technology Co Ltd
Priority to CN202010384137.7A priority Critical patent/CN111310866B/en
Publication of CN111310866A publication Critical patent/CN111310866A/en
Application granted granted Critical
Publication of CN111310866B publication Critical patent/CN111310866B/en
Priority to PCT/CN2021/092108 priority patent/WO2021227948A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/40Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Document Processing Apparatus (AREA)

Abstract

The embodiment of the specification provides a data annotation method, a device, a system and a terminal device, wherein in the data annotation method, a first terminal device receives a task packet to be annotated sent by an annotation platform server, then obtains a current picture to be annotated from the task packet to be annotated, and obtains an access link of the current picture to be annotated, the first terminal device displays the access link, so that a second terminal device obtains the current picture to be annotated according to the access link, and performs a description operation, thereby sending the picture which cannot be annotated on the first terminal device to the second terminal device, and performing accurate description on the outline of an annotation object in the picture. Then, the first terminal device obtains the drawing information of the second terminal device, numbers the drawing information and inputs text information corresponding to the drawing information, and therefore the labeling operation of the current picture to be labeled is completed.

Description

Data labeling method, device, system and terminal equipment
Technical Field
The embodiment of the specification relates to the technical field of internet, in particular to a data annotation method, device, system and terminal equipment.
Background
In the field of artificial intelligence, model training is often performed by using a machine learning algorithm, and machine learning is divided into supervised learning and unsupervised learning. The effect of unsupervised learning is not controllable and is often used for exploratory experiments. In practical applications, supervised learning is generally used, and the supervised machine learning requires labeled data as a priori experience.
In data annotation, there is an annotation scene that requires drawing a corresponding object outline on a picture and inputting text to describe the relevant object outline, similar to a common banding-box annotation, where the banding-box is an outline selected from a box when the picture is annotated.
However, the limitation of the banding-box labeling is that only a relatively regular block diagram can be rendered with a mouse, and the object contour cannot be rendered very accurately.
Therefore, it is desirable to provide a data annotation method, which can accurately describe the object contour and improve the accuracy and efficiency of data annotation.
Disclosure of Invention
The embodiment of the specification provides a data annotation method, a device, a system and a terminal device, so as to realize accurate description of an object outline and improve the accuracy and efficiency of data annotation.
In a first aspect, an embodiment of the present specification provides a data annotation method, including:
the method comprises the steps that a first terminal device receives a task packet to be annotated sent by an annotation platform server, wherein the task packet to be annotated comprises indication information that the task packet to be annotated supports multi-screen operation;
acquiring a current picture to be labeled from the task packet to be labeled, and acquiring an access link of the current picture to be labeled from the labeling platform server;
displaying the access link so that the second terminal equipment can obtain the current picture to be labeled according to the access link;
obtaining the description information of the second terminal device, wherein the description information is obtained after the second terminal device performs outline description on the labeled object in the current picture to be labeled;
numbering the description information and inputting text information corresponding to the description information so as to finish the labeling operation of the current picture to be labeled;
and sending the labeling result of the current picture to be labeled to the labeling platform server.
In the data annotation method, after a first terminal device requests an annotation task from an annotation platform server, a task packet to be annotated sent by the annotation platform server is received, then a current picture to be annotated is obtained from the task packet to be annotated, an access link of the current picture to be annotated is obtained, the access link is displayed by the first terminal device so that a second terminal device can obtain the current picture to be annotated according to the access link and perform a description operation, and therefore the picture which cannot be annotated on the first terminal device can be sent to the second terminal device, and the outline of an annotation object in the picture is accurately described. Then, the first terminal device obtains the description information of the second terminal device, numbers the description information and inputs the text information corresponding to the description information, so that the labeling operation of the current picture to be labeled is completed, the labeling operation of the current picture to be labeled is completed by cooperation of the first terminal device and the second terminal device, and the precision and the efficiency of data labeling are improved.
In one possible implementation manner, the obtaining of the description information of the second terminal device includes: and receiving the description information sent by the second terminal equipment.
In one possible implementation manner, the obtaining of the description information of the second terminal device includes: and receiving the description information sent by the annotation platform server, wherein the description information is sent to the annotation platform server by the second terminal device.
In one possible implementation manner, the numbering the description information and the inputting the text information corresponding to the description information includes:
selecting a contour included in the drawing information;
the selected contours are numbered and text information corresponding to the contours is entered.
In one possible implementation manner, before numbering the description information and inputting text information corresponding to the description information, the method further includes:
and displaying the drawing information.
In one possible implementation manner, the description information sent by the annotation platform server includes description information sent by at least two second terminal devices, and the description information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device;
the displaying the drawing information includes:
and displaying the drawing information according to the identification of the user.
In a second aspect, an embodiment of the present specification provides a data annotation method, including:
the second terminal equipment obtains a current picture to be marked according to the access link displayed by the first terminal equipment;
carrying out outline drawing on the marked object in the current picture to be marked to obtain drawing information;
and sending the description information for the first terminal equipment to acquire the description information, numbering the description information, inputting text information corresponding to the description information, and completing the labeling operation of the current picture to be labeled.
In the data labeling method, the second terminal device obtains the current picture to be labeled according to the access link displayed by the first terminal device, performs contour description on the labeled object in the current picture to be labeled to obtain the description information, and then sends the description information to the labeling platform server or the first terminal device, so that the first terminal device and the second terminal device can cooperate to complete the labeling operation of the current picture to be labeled, and the second terminal device is the electronic device with the touch screen, so that the contour of the labeled object can be accurately described, and the precision and the efficiency of data labeling are improved.
In a possible implementation manner, the sending the drawing information for the first terminal device to obtain the drawing information includes: and sending the drawing information to the first terminal equipment.
In a possible implementation manner, the sending the drawing information for the first terminal device to obtain the drawing information includes: and sending the drawing information to an annotation platform server for the annotation platform server to send the drawing information to the first terminal device.
In one possible implementation manner, the second terminal device includes at least two second terminal devices, and the description information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device.
In one possible implementation manner, the method further includes:
receiving the description information of other second terminal devices except the second terminal device, which is sent by the annotation platform server, wherein the description information of other second terminal devices is obtained after the other second terminal devices perform outline description on the annotation object in the current picture to be annotated and is sent to the annotation platform server;
and displaying or not displaying the drawing information of the other second terminal equipment.
In a third aspect, an embodiment of the present specification provides a data annotation device, which is disposed in a first terminal device, and includes:
the sending module is used for requesting the annotation platform server for the annotation task;
the receiving module is used for receiving a task packet to be annotated sent by the annotation platform server, wherein the task packet to be annotated comprises indication information that the task packet to be annotated supports multi-screen operation;
the acquisition module is used for acquiring the current picture to be labeled from the task packet to be labeled received by the receiving module and acquiring the access link of the current picture to be labeled from the labeling platform server;
the display module is used for displaying the access link acquired by the acquisition module so that the second terminal equipment can acquire the current picture to be marked according to the access link;
the obtaining module is further configured to obtain drawing information of the second terminal device, where the drawing information is obtained after the second terminal device performs contour drawing on a labeled object in the current picture to be labeled;
the marking module is used for numbering the drawing information received by the receiving module and inputting text information corresponding to the drawing information so as to finish the marking operation of the current picture to be marked;
the sending module is further configured to send the annotation result of the current picture to be annotated to the annotation platform server.
In one possible implementation manner, the obtaining module is specifically configured to receive the description information sent by the second terminal device.
In one possible implementation manner, the obtaining module is specifically configured to receive the description information sent by the annotation platform server, where the description information is sent to the annotation platform server by the second terminal device.
In one possible implementation manner, the apparatus further includes:
a selection submodule for selecting a contour included in the drawing information;
and the contour labeling submodule is used for numbering the contours selected by the selection submodule and inputting text information corresponding to the contours.
In one possible implementation manner, the apparatus further includes:
and the display module is used for displaying the drawing information before the marking module numbers the drawing information and inputs text information corresponding to the drawing information.
In one possible implementation manner, the description information sent by the annotation platform server includes description information sent by at least two second terminal devices, and the description information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device;
the display module is specifically configured to display the drawing information according to the identifier of the user.
In a fourth aspect, an embodiment of the present specification provides a data annotation device, which is disposed in a second terminal device, and includes:
the obtaining module is used for obtaining a current picture to be marked according to the access link displayed by the first terminal equipment;
the drawing module is used for carrying out outline drawing on the marked object in the current picture to be marked obtained by the obtaining module to obtain drawing information;
and the sending module is used for sending the description information so that the first terminal equipment can acquire the description information, numbering the description information and inputting text information corresponding to the description information to finish the labeling operation of the current picture to be labeled.
In one possible implementation manner, the sending module is specifically configured to send the description information to the first terminal device.
In one possible implementation manner, the sending module is specifically configured to send the description information to an annotation platform server, so that the annotation platform server sends the description information to the first terminal device.
In one possible implementation manner, the apparatus further includes:
a receiving module, configured to receive drawing information of other second terminal devices, which is sent by the annotation platform server and is other than the second terminal device, where the drawing information of the other second terminal devices is obtained after the other second terminal devices perform outline drawing on an annotation object in the current picture to be annotated, and is sent to the annotation platform server;
and the display module is used for displaying or not displaying the description information of the other second terminal equipment.
In a fifth aspect, an embodiment of the present specification provides a first terminal device, including:
at least one processor; and at least one memory communicatively coupled to the processor, wherein:
the memory stores program instructions executable by the processor, the processor calling the program instructions to be able to perform the method provided by the first aspect.
In a sixth aspect, an embodiment of the present specification provides a second terminal device, including:
at least one processor; and at least one memory communicatively coupled to the processor, wherein:
the memory stores program instructions executable by the processor, the processor calling the program instructions to be able to perform the method provided by the second aspect.
In a seventh aspect, an embodiment of the present specification provides a data annotation system, including: the first terminal device of the fifth aspect, the second terminal device of the sixth aspect and the annotation platform server.
In an eighth aspect, embodiments of the present specification provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the method provided in the first aspect.
In a ninth aspect, embodiments of the present specification provide a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method provided by the second aspect.
It should be understood that the third and fifth aspects of the embodiments in this specification are consistent with the technical solution of the first aspect of the embodiments in this specification, and similar beneficial effects are achieved in various aspects and corresponding possible implementation manners, and thus detailed description is omitted.
It should be understood that the fourth and sixth aspects of the embodiments in this specification are consistent with the technical solution of the second aspect of the embodiments in this specification, and the beneficial effects achieved by each aspect and the corresponding possible implementation are similar and will not be described again.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
FIG. 1 is a flow chart of one embodiment of a data annotation process of the present disclosure;
FIG. 2 is a schematic diagram of labeling a picture according to an embodiment of the present disclosure;
FIG. 3 is a flow chart of another embodiment of a data annotation process described herein;
FIG. 4 is a flow chart of yet another embodiment of a data annotation process described herein;
FIG. 5 is a flow chart of yet another embodiment of a data annotation process described herein;
FIG. 6 is a flow chart of yet another embodiment of a data annotation process described herein;
FIG. 7 is a flow chart of yet another embodiment of a data annotation process described herein;
FIG. 8 is a schematic structural diagram of an embodiment of a data annotation device of the present specification;
FIG. 9 is a schematic structural diagram of another embodiment of a data annotation device of the present specification;
FIG. 10 is a schematic structural diagram of a data annotation device according to another embodiment of the present disclosure;
FIG. 11 is a schematic structural diagram of a data annotation device according to another embodiment of the present disclosure;
fig. 12 is a schematic structural diagram of an embodiment of a first terminal device in this specification;
FIG. 13 is a schematic structural diagram of an embodiment of a data annotation system of the present specification.
Detailed Description
For better understanding of the technical solutions in the present specification, the following detailed description of the embodiments of the present specification is provided with reference to the accompanying drawings.
It should be understood that the described embodiments are only a few embodiments of the present specification, and not all embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments in the present specification without any inventive step are within the scope of the present specification.
The terminology used in the embodiments of the specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the specification. As used in the specification examples and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
In the prior art, there is a labeling scenario that requires a corresponding object contour to be traced on a picture and simultaneously inputs a text to describe the relevant object contour, similar to a common banding-box label, but the banding-box label has a limitation that only a relatively regular block diagram can be traced by a mouse, and the object contour cannot be traced very accurately.
Based on the above problems, embodiments of the present specification provide a data annotation method, which can accurately depict an object contour, and improve precision and efficiency of data annotation.
Fig. 1 is a flowchart of an embodiment of a data annotation method in the present specification, and as shown in fig. 1, the data annotation method may include:
102, receiving a task packet to be annotated sent by an annotation platform server by a first terminal device, wherein the task packet to be annotated comprises indication information that the task packet to be annotated supports multi-screen operation.
The first terminal device may be a Personal Computer (PC), and the PC may include an electronic device without a touch screen, such as a desktop computer, a notebook computer, a mini-notebook computer, or an ultrabook.
Specifically, the task package to be annotated is generated by the annotation platform server, and the task package to be annotated includes indication information that the task package to be annotated supports multi-screen operation, and further, the task package to be annotated may further include information such as an identifier of the task package and a user identifier, where the user identifier may be a user account registered on the annotation platform server by a user using the first terminal device.
During specific implementation, the first terminal device may request a tagging task from the tagging platform server, or the platform tagging server may push the tagging task to the first terminal device; and then the first terminal equipment receives the task packet to be annotated sent by the annotation platform server.
And 104, acquiring a current picture to be annotated from the task package to be annotated, and acquiring an access link of the current picture to be annotated from the annotation platform server.
Specifically, after the first terminal device obtains the current picture to be annotated from the task package to be annotated, the first terminal device may request the annotation platform server for an access link of the current picture to be annotated, and then receive the access link of the current picture to be annotated sent by the annotation platform server.
The access link may be a two-dimensional code, a barcode, or a Uniform Resource Locator (URL), and the specific form of the access link is not limited in this embodiment, but the embodiment takes the access link as an example of a two-dimensional code.
And 106, displaying the access link, so that the second terminal device can obtain the current picture to be marked according to the access link.
The second terminal device is a third-party device independent of the first terminal device and the annotation platform server, and the second terminal device may be: the present embodiment does not limit the specific type of the second terminal device, such as an electronic device with a touch screen, such as a smart phone or a tablet computer.
And step 108, obtaining drawing information of the second terminal device, where the drawing information is obtained after the second terminal device performs contour drawing on the marking object in the current picture to be marked.
Specifically, the obtaining of the drawing information of the second terminal device may be: receiving the description information sent by the second terminal equipment; or receiving the drawing information sent by the annotation platform server, wherein the drawing information is sent to the annotation platform server by the second terminal device.
That is, the second terminal device may directly send the drawing information to the first terminal device, or the second terminal device may also send the drawing information to the annotation platform server, and then the annotation platform server sends the drawing information to the first terminal device; therefore, the first terminal device acquires the description information of the second terminal device.
And 110, numbering the drawing information and inputting text information corresponding to the drawing information so as to finish the labeling operation of the current picture to be labeled.
Specifically, referring to fig. 2, fig. 2 is a schematic diagram of labeling a picture according to an embodiment of the present specification, a cloud-shaped outline shown on the left side of fig. 2 is the drawing information sent by the labeling platform server, after obtaining the drawing information, the first terminal device may number the drawing information as "object a", and input corresponding text information "a colorful cloud", as shown on the right side of fig. 2, so as to complete the labeling operation of the current picture to be labeled.
And 112, sending the labeling result of the current picture to be labeled to a labeling platform server.
In this embodiment, after the labeling operation of the current picture to be labeled is completed, the first terminal device may send the labeling result of the current picture to be labeled to the labeling platform server, and the labeling platform server stores the labeling result.
In the data annotation method, after a first terminal device requests an annotation task from an annotation platform server, a task packet to be annotated sent by the annotation platform server is received, then a current picture to be annotated is obtained from the task packet to be annotated, an access link of the current picture to be annotated is obtained, the access link is displayed by the first terminal device so that a second terminal device can obtain the current picture to be annotated according to the access link and perform a description operation, and therefore the picture which cannot be annotated on the first terminal device can be sent to the second terminal device, and the outline of an annotation object in the picture is accurately described. Then, the first terminal device obtains the description information of the second terminal device, numbers the description information and inputs the text information corresponding to the description information, so that the labeling operation of the current picture to be labeled is completed, the labeling operation of the current picture to be labeled is completed by cooperation of the first terminal device and the second terminal device, and the precision and the efficiency of data labeling are improved.
Fig. 3 is a flowchart of another embodiment of a data annotation method in this specification, as shown in fig. 3, in this embodiment shown in fig. 1 of this specification, step 110 may include:
in step 302, the outline included in the above-mentioned drawing information is selected.
Step 304, numbering the selected outline and inputting the text information corresponding to the outline.
When the description information only comprises the outline of one labeling object, the first terminal device selects the outline, numbers the selected outline and inputs text information corresponding to the outline, namely, the labeling operation of the current picture to be labeled is completed, and then the first terminal device sends the labeling result of the current picture to be labeled to the labeling platform server.
When the drawing information includes a plurality of outlines of the labeled object, the first terminal device may select one of the outlines in the drawing information, complete numbering and input corresponding text information, and then send a labeling result of the outline to the labeling platform server. And then the first terminal equipment continues to select the next outline in the drawing information until the plurality of outlines in the drawing information are marked.
Fig. 4 is a flowchart of a further embodiment of the data annotation method in this specification, as shown in fig. 4, in the embodiment shown in fig. 1 in this specification, before step 110, the method may further include:
in step 402, the first terminal device displays the drawing information.
Fig. 5 is a flowchart of a further embodiment of the data annotation method in this specification, in this embodiment, the description information sent by the annotation platform server may include description information sent by at least two second terminal devices, where the description information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device;
thus, as shown in fig. 5, in the embodiment shown in fig. 4 of this specification, step 402 may be:
step 502, displaying the drawing information according to the user identification.
Specifically, the identifier of the user using the second terminal device may be the same as or different from the identifier of the user using the first terminal device, so that the first terminal device may select to display the drawing information sent by the second terminal device having the same user identifier according to the identifier of the user when displaying the drawing information, or the first terminal device may also select to display the drawing information sent by the second terminal device having the same and different user identifiers.
Fig. 6 is a flowchart of a data annotation method according to another embodiment of the present disclosure, and as shown in fig. 6, the data annotation method may include:
step 602, the second terminal device obtains the current picture to be labeled according to the access link displayed by the first terminal device.
The first terminal device may be a PC, and the PC may include an electronic device without a touch screen, such as a desktop, a notebook, a mini-notebook, or a super-notebook, and the specific type of the first terminal device is not limited in this embodiment;
the second terminal device may be: the embodiment does not limit the specific type of the second terminal device;
the access link may be a two-dimensional code, a barcode, a URL, or the like, and the specific form of the access link is not limited in this embodiment, but the embodiment is described by taking the access link as a two-dimensional code as an example.
Specifically, the second terminal device may scan the two-dimensional code displayed by the first terminal device to obtain the current picture to be labeled.
Step 604, performing outline drawing on the marked object in the current picture to be marked to obtain drawing information.
Specifically, the second terminal device can perform contour drawing on the labeled object in the current picture to be labeled through the picture labeling control installed on the second terminal device.
In this embodiment, the second terminal device is an electronic device with a touch screen, so that the outline of the annotation object can be accurately drawn.
Step 606, sending the drawing information for the first terminal device to obtain the drawing information, numbering the drawing information, inputting text information corresponding to the drawing information, and completing the labeling operation of the current picture to be labeled.
Specifically, the sending of the drawing information for the first terminal device to acquire the drawing information may be: sending the drawing information to a first terminal device; or, the drawing information is sent to a labeling platform server, so that the labeling platform server sends the drawing information to the first terminal device.
That is, the second terminal device may directly send the drawing information to the first terminal device, or the second terminal device may also send the drawing information to the annotation platform server, and then the annotation platform server sends the drawing information to the first terminal device; therefore, the first terminal device can acquire the description information of the second terminal device, and then the first terminal device can number the description information and input the text information corresponding to the description information, so as to complete the labeling operation of the current picture to be labeled.
In the data labeling method, the second terminal device obtains the current picture to be labeled according to the access link displayed by the first terminal device, performs contour description on the labeled object in the current picture to be labeled to obtain the description information, and then sends the description information to the labeling platform server or the first terminal device, so that the first terminal device and the second terminal device can cooperate to complete the labeling operation of the current picture to be labeled, and the second terminal device is the electronic device with the touch screen, so that the contour of the labeled object can be accurately described, and the precision and the efficiency of data labeling are improved.
In the embodiment shown in fig. 7 of this specification, the second terminal device may be at least two second terminal devices, and the drawing information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device. That is to say, the multiple second terminal devices may scan the two-dimensional code displayed by the first terminal device to obtain the current picture to be labeled, and then the multiple second terminal devices may perform outline drawing on the labeled object in the current picture to be labeled, without mutual influence, after the drawing is completed, the multiple second terminal devices respectively send the drawing information to the labeling platform server or the first terminal device, and the drawing information sent by the multiple second terminal devices includes the identifier of the user using the second terminal device.
Furthermore, the second terminal device may further receive drawing information of other second terminal devices, which is sent by the annotation platform server and is other than the second terminal device, where the drawing information of other second terminal devices is obtained after the other second terminal devices perform outline drawing on the annotation object in the current picture to be annotated, and is sent to the annotation platform server; then, the second terminal device displays or does not display the drawing information of the other second terminal device.
That is to say, when a plurality of second terminal devices outline the annotation object in the same picture to be annotated, the annotation platform server may synchronize the depiction information of each second terminal device to other second terminal devices.
Then, after the second terminal device receives the drawing information of the second terminal device other than itself, the drawing information of the second terminal device other than itself may be displayed. The drawing information of the other second terminal device is displayed, and the second terminal device itself is not affected in drawing the outline of the annotation object in the current to-be-annotated picture.
Of course, the second terminal device may not display the drawing information of the other second terminal devices, which is not limited in this embodiment.
Fig. 7 is a flowchart of a data annotation method according to another embodiment of the present specification, where in this embodiment, a first terminal device is a PC, and a second terminal device is a smartphone, as shown in fig. 7, the data annotation method may include:
step 702, after the task is initialized, the PC requests the annotation task from the annotation platform server.
And 704, the annotation platform server generates a task packet to be annotated and sends the task packet to the PC.
The task package to be annotated includes indication information that the task package to be annotated supports multi-screen operation, and further, the task package to be annotated may further include information such as an identifier of the task package and a user identifier, where the user identifier may be a user account registered on the annotation platform server by a user using the first terminal device.
For example, the task packet to be annotated may be an Optical Character Recognition (OCR) task packet to be annotated, where the OCR task packet to be annotated includes indication information that the task packet supports a dual-screen operation.
Step 706, after the PC obtains the task package to be labeled, the PC obtains the current picture to be labeled from the task package to be labeled.
In step 708, the PC requests the annotation platform server for the two-dimensional code of the current picture to be annotated.
Step 710, the annotation platform server generates a two-dimensional code of the current picture to be annotated, and sends the two-dimensional code of the current picture to be annotated to the PC.
The current picture to be marked corresponds to the two-dimensional code one to one, so that the uniqueness of multi-screen display can be ensured.
In step 712, the smart phone scans the two-dimensional code displayed on the PC to obtain the current picture to be labeled.
In a specific implementation, the number of smart phones which scan the two-dimensional code to obtain the current picture to be labeled is not limited, and multiple smart phones can be supported to scan the two-dimensional code to obtain the current picture to be labeled.
And 714, carrying out outline drawing on the marked object in the current picture to be marked by the smart phone to obtain drawing information.
In step 716, the smart phone uploads the description information to the annotation platform server.
In step 718, the annotation platform server sends the rendering information to the PC.
And 720, numbering the drawing information by the PC and inputting text information corresponding to the drawing information so as to finish the labeling operation of the current picture to be labeled.
In step 722, the PC uploads the annotation result of the current picture to be annotated to the annotation platform server.
The data annotation method provided by the embodiment of the specification supports the cooperation of the first terminal device and the second terminal device to complete the annotation operation of the current picture to be annotated, and the second terminal device is an electronic device with a touch screen, so that the outline of the annotation object can be accurately depicted, and the accuracy and efficiency of data annotation are improved.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
Fig. 8 is a schematic structural diagram of an embodiment of a data annotation device in this specification, where the data annotation device may be disposed in a first terminal device, and as shown in fig. 8, the data annotation device may include: a sending module 81, a receiving module 82, an obtaining module 83, a display module 84 and a labeling module 85;
the receiving module 82 is used for receiving a task packet to be annotated sent by an annotation platform server, wherein the task packet to be annotated comprises indication information that the task packet to be annotated supports multi-screen operation;
an obtaining module 83, configured to obtain a current picture to be annotated from the task package to be annotated received by the receiving module 82, and obtain an access link of the current picture to be annotated from the annotation platform server;
the display module 84 is configured to display the access link acquired by the acquisition module 83, so that the second terminal device obtains a current picture to be labeled according to the access link;
the obtaining module 83 is further configured to obtain drawing information of the second terminal device, where the drawing information is obtained after the second terminal device performs contour drawing on a labeling object in a current to-be-labeled picture.
In this embodiment, the obtaining module 83 is specifically configured to receive the description information sent by the second terminal device; or, the obtaining module 83 is specifically configured to receive drawing information sent by the annotation platform server, where the drawing information is sent by the second terminal device to the annotation platform server.
The labeling module 85 is configured to number the drawing information received by the receiving module 82 and input text information corresponding to the drawing information, so as to complete a labeling operation on a current picture to be labeled;
and the sending module 81 is configured to send the annotation result of the current picture to be annotated to the annotation platform server.
The data annotation device provided in the embodiment shown in fig. 8 can be used to implement the technical solution of the method embodiment shown in fig. 1 in this specification, and the implementation principle and technical effect thereof can be further referred to the related description in the method embodiment.
Fig. 9 is a schematic structural diagram of another embodiment of the data annotation device of the present specification, which is different from the device shown in fig. 8 in that, in the device shown in fig. 9, the annotation module 85 may include: a selection sub-module 851 and a contouring sub-module 852;
a selection submodule 851 for selecting contours included in the drawing information;
the outline labeling sub-module 852 is configured to number the outlines selected by the selection sub-module 851 and input text information corresponding to the outlines.
Further, the above apparatus may further include: a display module 86;
and a display module 86 for displaying the drawing information before the labeling module 85 numbers the drawing information and inputs text information corresponding to the drawing information.
In this embodiment, the description information sent by the annotation platform server includes description information sent by at least two second terminal devices, and the description information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device;
the display module 86 is specifically configured to display the drawing information according to the user identifier.
The data annotation device provided in the embodiment shown in fig. 9 may be used to execute the technical solutions of the method embodiments shown in fig. 2 to fig. 5 in this specification, and the implementation principle and the technical effects may further refer to the related descriptions in the method embodiments.
Fig. 10 is a schematic structural diagram of a data annotation device according to still another embodiment of the present disclosure, where the data annotation device may be disposed in a second terminal device, and as shown in fig. 10, the data annotation device may include: an obtaining module 1001, a rendering module 1002, and a sending module 1003;
the obtaining module 1001 is configured to obtain a current picture to be labeled according to an access link displayed by the first terminal device;
a drawing module 1002, configured to perform outline drawing on the labeled object in the current to-be-labeled picture obtained by the obtaining module 1001, so as to obtain drawing information;
a sending module 1003, configured to send the drawing information, so that the first terminal device obtains the drawing information, numbers the drawing information, inputs text information corresponding to the drawing information, and completes a labeling operation on a current picture to be labeled.
In this embodiment, the sending module 1003 is specifically configured to send the drawing information to the first terminal device; or, the sending module 1003 is specifically configured to send the drawing information to the annotation platform server, so that the annotation platform server sends the drawing information to the first terminal device.
The data annotation device provided in the embodiment shown in fig. 10 can be used to implement the technical solution of the method embodiment shown in fig. 6 in this specification, and the implementation principle and technical effect thereof can be further referred to the related description in the method embodiment.
Fig. 11 is a schematic structural diagram of a further embodiment of the data annotation device of the present specification, which is different from the device shown in fig. 10 in that the device shown in fig. 11 may further include: a receiving module 1004 and a display module 1005;
a receiving module 1004, configured to receive drawing information of other second terminal devices, which is sent by the annotation platform server and is other than the second terminal device, where the drawing information of the other second terminal devices is obtained after the other second terminal devices perform outline drawing on an annotation object in a current picture to be annotated, and is sent to the annotation platform server;
a display module 1005, configured to display or not display the drawing information of the other second terminal device.
The data annotation device provided in the embodiment shown in fig. 11 can be used to implement the technical solution of the method embodiment shown in fig. 6 in this specification, and the implementation principle and technical effect thereof can be further referred to the related description in the method embodiment.
Fig. 12 is a schematic structural diagram of an embodiment of a first terminal device in this specification, where, as shown in fig. 12, the first terminal device may include at least one processor; and at least one memory communicatively coupled to the processor, wherein: the memory stores program instructions executable by the processor, and the processor calls the program instructions to execute the data annotation method provided by the embodiments shown in fig. 1 to 5 in the present specification.
The first terminal device may be a PC, and the PC may include an electronic device without a touch screen, such as a desktop, a notebook, a mini-notebook, or a super-notebook.
Fig. 12 shows a block diagram of an exemplary first terminal device suitable for use in implementing embodiments of the present specification. The first terminal device shown in fig. 12 is only an example, and should not bring any limitation to the functions and the range of use of the embodiments of the present specification.
As shown in fig. 12, the first terminal device is represented in the form of a general-purpose computing device. The components of the first terminal device may include, but are not limited to: one or more processors 410, a communication interface 420, a memory 430, and a communication bus 440 that connects the various components (including the memory 430, the communication interface 420, and the processing unit 410).
Communication bus 440 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, or a local bus using any of a variety of bus architectures. For example, communication bus 440 may include, but is not limited to, an Industry Standard Architecture (ISA) bus, a micro channel architecture (MAC) bus, an enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
The first terminal device typically includes a variety of computer system readable media. These media may be any available media that can be accessed by the first terminal device and includes both volatile and nonvolatile media, removable and non-removable media.
Memory 430 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) and/or cache memory. Memory 430 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of the embodiments described herein with respect to fig. 1-5.
A program/utility having a set (at least one) of program modules, including but not limited to an operating system, one or more application programs, other program modules, and program data, may be stored in memory 430, each of which examples or some combination may include an implementation of a network environment. The program modules generally perform the functions and/or methods of the embodiments described in FIGS. 1-5 herein.
The processor 410 executes programs stored in the memory 430 to execute various functional applications and data processing, for example, to implement the data annotation method provided in the embodiments shown in fig. 1 to 5 of the present specification.
An embodiment of this specification further provides a second terminal device, where the second terminal device may include: at least one processor; and at least one memory communicatively coupled to the processor, wherein: the memory stores program instructions executable by the processor, and the processor calls the program instructions to execute the data annotation method provided by the embodiment shown in fig. 6 in the present specification.
The second terminal device may be: the present embodiment does not limit the specific type of the second terminal device, such as an electronic device with a touch screen, such as a smart phone or a tablet computer.
In a specific implementation, the second terminal device may be implemented by using the structure shown in fig. 12, and details are not described here.
Fig. 13 is a schematic structural diagram of an embodiment of a data annotation system in this specification, where the data annotation system may include a first terminal device, a second terminal device, and an annotation platform server.
In a specific implementation, the first terminal device may be implemented by the structure shown in fig. 12, and the second terminal device may also be implemented by the structure shown in fig. 12.
The first terminal device may be a PC, and the PC may include an electronic device without a touch screen, such as a desktop, a notebook, a mini-notebook, or a super-notebook.
The second terminal device may be: in the present embodiment, specific types of the second terminal device are not limited, but the second terminal device is taken as an example for explanation, where the second terminal device is an electronic device with a touch screen, such as a smart phone or a tablet computer.
As shown in fig. 13, the data annotation system may include a PC1301, a smart phone 1302, and an annotation platform server 1303;
the PC1301 and the annotation platform server 1303 may be connected by a websocket, and the smart phone 1302 and the annotation platform server 1303 may be connected by a websocket, so as to ensure that data can be synchronized in time.
In one implementation of this embodiment, the PC1301 may be connected to the smartphone 1302, which is not shown in fig. 13, so that the PC1301 may receive the drawing information sent by the smartphone 1302. Specifically, the PC1301 may be connected to the smart phone 1302 through bluetooth, may also be connected to the smart phone 1302 through a wireless network (WiFi), or may also be connected to the smart phone 1302 through a WiFi hotspot, and the connection manner between the PC1301 and the smart phone 1302 is not limited in this embodiment.
The embodiment of the present specification provides a non-transitory computer readable storage medium, which stores computer instructions, and the computer instructions cause the computer to execute the data annotation method provided by the embodiment shown in fig. 1 to 5 of the present specification.
Embodiments of the present description provide a non-transitory computer-readable storage medium storing computer instructions that cause the computer to perform the data annotation method provided by the embodiment shown in fig. 6 of the present description.
The non-transitory computer readable storage medium described above may take any combination of one or more computer readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM) or flash memory, an optical fiber, a portable compact disc read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, Radio Frequency (RF), etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present description may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
In the description of the specification, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the specification. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present specification, "a plurality" means at least two, e.g., two, three, etc., unless explicitly defined otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present description in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present description.
The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It should be noted that the terminal referred to in the embodiments of the present specification may include, but is not limited to, a personal computer (personal computer, first terminal device), a Personal Digital Assistant (PDA), a wireless handheld device, a tablet computer (tablet computer), a mobile phone, an MP3 player, an MP4 player, and the like.
In the several embodiments provided in this specification, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions in actual implementation, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present description may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods described in the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only a preferred embodiment of the present disclosure, and should not be taken as limiting the present disclosure, and any modifications, equivalents, improvements, etc. made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims (26)

1. A method of data annotation, comprising:
the method comprises the steps that a first terminal device receives a task packet to be annotated sent by an annotation platform server, wherein the task packet to be annotated comprises indication information that the task packet to be annotated supports multi-screen operation;
acquiring a current picture to be labeled from the task packet to be labeled, and acquiring an access link of the current picture to be labeled from the labeling platform server;
displaying the access link so that the second terminal equipment can obtain the current picture to be labeled according to the access link;
obtaining the description information of the second terminal device, wherein the description information is obtained after the second terminal device performs outline description on the labeled object in the current picture to be labeled; the second terminal device carries out outline description on the labeled object in the current picture to be labeled through a picture labeling control installed on the second terminal device, and the second terminal device is an electronic device with a touch screen;
numbering the description information and inputting text information corresponding to the description information so as to finish the labeling operation of the current picture to be labeled;
and sending the labeling result of the current picture to be labeled to the labeling platform server.
2. The method of claim 1, wherein the obtaining of the profile information of the second terminal device comprises:
and receiving the description information sent by the second terminal equipment.
3. The method of claim 1, wherein the obtaining of the profile information of the second terminal device comprises:
and receiving the description information sent by the annotation platform server, wherein the description information is sent to the annotation platform server by the second terminal device.
4. The method of claim 1, wherein the numbering the drawing information and entering text information corresponding to the drawing information comprises:
selecting a contour included in the drawing information;
the selected contours are numbered and text information corresponding to the contours is entered.
5. The method of any of claims 1-4, further comprising, prior to numbering the depiction information and entering text information corresponding to the depiction information:
and displaying the drawing information.
6. The method of claim 5, wherein the description information sent by the annotation platform server comprises description information sent by at least two second terminal devices, and the description information sent by the at least two second terminal devices comprises identifications of users using the second terminal devices;
the displaying the drawing information includes:
and displaying the drawing information according to the identification of the user.
7. A method of data annotation, comprising:
the second terminal equipment obtains a current picture to be marked according to the access link displayed by the first terminal equipment;
carrying out outline drawing on the marked object in the current picture to be marked to obtain drawing information; the second terminal device carries out outline description on the labeled object in the current picture to be labeled through a picture labeling control installed on the second terminal device, and the second terminal device is an electronic device with a touch screen;
and sending the description information for the first terminal equipment to acquire the description information, numbering the description information, inputting text information corresponding to the description information, and completing the labeling operation of the current picture to be labeled.
8. The method of claim 7, wherein the sending the rendering information for the first terminal device to obtain the rendering information comprises:
and sending the drawing information to the first terminal equipment.
9. The method of claim 7, wherein the sending the rendering information for the first terminal device to obtain the rendering information comprises:
and sending the drawing information to an annotation platform server for the annotation platform server to send the drawing information to the first terminal device.
10. The method according to any of claims 7-9, wherein the second terminal device comprises at least two second terminal devices, and the at least two second terminal devices transmit the description information including an identification of a user using the second terminal device.
11. The method of claim 9, further comprising:
receiving the description information of other second terminal devices except the second terminal device, which is sent by the annotation platform server, wherein the description information of other second terminal devices is obtained after the other second terminal devices perform outline description on the annotation object in the current picture to be annotated and is sent to the annotation platform server;
and displaying or not displaying the drawing information of the other second terminal equipment.
12. A data annotation apparatus provided in a first terminal device, the apparatus comprising:
the system comprises a receiving module, a marking platform server and a marking module, wherein the receiving module is used for receiving a task packet to be marked sent by the marking platform server, and the task packet to be marked comprises indication information of supporting multi-screen operation of the task packet to be marked;
the acquisition module is used for acquiring the current picture to be labeled from the task packet to be labeled received by the receiving module and acquiring the access link of the current picture to be labeled from the labeling platform server;
the display module is used for displaying the access link acquired by the acquisition module so that the second terminal equipment can acquire the current picture to be marked according to the access link;
the obtaining module is further configured to obtain drawing information of the second terminal device, where the drawing information is obtained after the second terminal device performs contour drawing on a labeled object in the current picture to be labeled; the second terminal device carries out outline description on the labeled object in the current picture to be labeled through a picture labeling control installed on the second terminal device, and the second terminal device is an electronic device with a touch screen;
the marking module is used for numbering the drawing information received by the receiving module and inputting text information corresponding to the drawing information so as to finish the marking operation of the current picture to be marked;
and the sending module is used for sending the marking result of the current picture to be marked to the marking platform server.
13. The apparatus of claim 12, wherein,
the obtaining module is specifically configured to receive the drawing information sent by the second terminal device.
14. The apparatus of claim 12, wherein,
the obtaining module is specifically configured to receive the description information sent by the annotation platform server, where the description information is sent to the annotation platform server by the second terminal device.
15. The apparatus of claim 12, wherein the annotation module comprises:
a selection submodule for selecting a contour included in the drawing information;
and the contour labeling submodule is used for numbering the contours selected by the selection submodule and inputting text information corresponding to the contours.
16. The apparatus of any of claims 12-15, further comprising:
and the display module is used for displaying the drawing information before the marking module numbers the drawing information and inputs text information corresponding to the drawing information.
17. The apparatus according to claim 16, wherein the description information sent by the annotation platform server includes description information sent by at least two second terminal devices, and the description information sent by the at least two second terminal devices includes an identifier of a user using the second terminal device;
the display module is specifically configured to display the drawing information according to the identifier of the user.
18. A data annotation apparatus provided in a second terminal device, the apparatus comprising:
the obtaining module is used for obtaining a current picture to be marked according to the access link displayed by the first terminal equipment;
the drawing module is used for carrying out outline drawing on the marked object in the current picture to be marked obtained by the obtaining module to obtain drawing information; the second terminal device carries out outline description on the labeled object in the current picture to be labeled through a picture labeling control installed on the second terminal device, and the second terminal device is an electronic device with a touch screen;
and the sending module is used for sending the description information so that the first terminal equipment can acquire the description information, numbering the description information and inputting text information corresponding to the description information to finish the labeling operation of the current picture to be labeled.
19. The apparatus of claim 18, wherein,
the sending module is specifically configured to send the drawing information to the first terminal device.
20. The apparatus of claim 18, wherein,
the sending module is specifically configured to send the drawing information to an annotation platform server, so that the annotation platform server sends the drawing information to the first terminal device.
21. The apparatus of claim 20, further comprising:
a receiving module, configured to receive drawing information of other second terminal devices, which is sent by the annotation platform server and is other than the second terminal device, where the drawing information of the other second terminal devices is obtained after the other second terminal devices perform outline drawing on an annotation object in the current picture to be annotated, and is sent to the annotation platform server;
and the display module is used for displaying or not displaying the description information of the other second terminal equipment.
22. A first terminal device comprising:
at least one processor; and
at least one memory communicatively coupled to the processor, wherein:
the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of any of claims 1 to 6.
23. A second terminal device comprising:
at least one processor; and
at least one memory communicatively coupled to the processor, wherein:
the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of any of claims 7 to 11.
24. A data annotation system comprising: the first terminal device of claim 22, the second terminal device of claim 23 and the annotation platform server.
25. A non-transitory computer-readable storage medium storing computer instructions that cause the computer to perform the method of any of claims 1-6.
26. A non-transitory computer readable storage medium storing computer instructions that cause the computer to perform the method of any of claims 7 to 11.
CN202010384137.7A 2020-05-09 2020-05-09 Data labeling method, device, system and terminal equipment Active CN111310866B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010384137.7A CN111310866B (en) 2020-05-09 2020-05-09 Data labeling method, device, system and terminal equipment
PCT/CN2021/092108 WO2021227948A1 (en) 2020-05-09 2021-05-07 Data annotation method, apparatus and system, and terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010384137.7A CN111310866B (en) 2020-05-09 2020-05-09 Data labeling method, device, system and terminal equipment

Publications (2)

Publication Number Publication Date
CN111310866A CN111310866A (en) 2020-06-19
CN111310866B true CN111310866B (en) 2020-08-25

Family

ID=71148509

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010384137.7A Active CN111310866B (en) 2020-05-09 2020-05-09 Data labeling method, device, system and terminal equipment

Country Status (2)

Country Link
CN (1) CN111310866B (en)
WO (1) WO2021227948A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111310866B (en) * 2020-05-09 2020-08-25 支付宝(杭州)信息技术有限公司 Data labeling method, device, system and terminal equipment
CN112182048A (en) * 2020-09-11 2021-01-05 南方科技大学 Data labeling method, network equipment, terminal, system and storage medium
CN112711483A (en) * 2020-12-10 2021-04-27 广州广电运通金融电子股份有限公司 High-concurrency method, system and equipment for processing big data annotation service
CN113254221A (en) * 2021-07-09 2021-08-13 武汉精创电子技术有限公司 Task execution system and method for defect labeling
CN115904575A (en) * 2022-10-27 2023-04-04 中科星图数字地球合肥有限公司 Multi-terminal plotting method, device, equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108829652A (en) * 2018-04-28 2018-11-16 河海大学 A kind of picture labeling system based on crowdsourcing
CN110310028A (en) * 2019-06-25 2019-10-08 阿里巴巴集团控股有限公司 Method and apparatus for crowdsourcing

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008305009A (en) * 2007-06-05 2008-12-18 Seiko Epson Corp Print data providing server
IN2014CN03530A (en) * 2011-11-08 2015-07-03 Vidinoti Sa
CN111310866B (en) * 2020-05-09 2020-08-25 支付宝(杭州)信息技术有限公司 Data labeling method, device, system and terminal equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108829652A (en) * 2018-04-28 2018-11-16 河海大学 A kind of picture labeling system based on crowdsourcing
CN110310028A (en) * 2019-06-25 2019-10-08 阿里巴巴集团控股有限公司 Method and apparatus for crowdsourcing

Also Published As

Publication number Publication date
CN111310866A (en) 2020-06-19
WO2021227948A1 (en) 2021-11-18

Similar Documents

Publication Publication Date Title
CN111310866B (en) Data labeling method, device, system and terminal equipment
US11875437B2 (en) Image drawing method based on target template image, apparatus, readable medium and electronic device
CN109308681B (en) Image processing method and device
CN109472852B (en) Point cloud image display method and device, equipment and storage medium
CN110059623B (en) Method and apparatus for generating information
CN112883966B (en) Image character recognition method, device, medium and electronic equipment
CN112487871B (en) Handwriting data processing method and device and electronic equipment
CN107818323B (en) Method and apparatus for processing image
CN112488095A (en) Seal image identification method and device and electronic equipment
CN111784712A (en) Image processing method, device, equipment and computer readable medium
CN113553123B (en) Data processing method, device, electronic equipment and storage medium
CN114417782A (en) Display method and device and electronic equipment
CN115495175A (en) Picture display method and device, terminal equipment and computer medium
CN117576388A (en) Image processing method and device, storage medium and electronic equipment
CN112445394B (en) Screenshot method and screenshot device
CN112231023A (en) Information display method, device, equipment and storage medium
CN115731319A (en) Graph drawing method, device, equipment and storage medium
CN113191257B (en) Order of strokes detection method and device and electronic equipment
CN111401182B (en) Image detection method and device for feeding rail
CN110334763B (en) Model data file generation method, model data file generation device, model data file identification device, model data file generation apparatus, model data file identification apparatus, and model data file identification medium
CN108834202B (en) Information display method and equipment
CN115756452A (en) Target page code generation method, device, storage medium and program product
CN109857838B (en) Method and apparatus for generating information
CN111563939A (en) Method and device for generating pictorial graphic posture and electronic equipment
CN111460334A (en) Information display method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant