CN116887785A

CN116887785A - Data processing apparatus and data processing method

Info

Publication number: CN116887785A
Application number: CN202280016657.XA
Authority: CN
Inventors: 李东勋; 宋命愚
Original assignee: Medit Corp
Current assignee: Medit Corp
Priority date: 2021-02-26
Filing date: 2022-02-23
Publication date: 2023-10-13

Abstract

The disclosed data processing method includes the following steps: displaying the three-dimensional scan data, and altering the display of the three-dimensional scan data in response to a remote control signal received from the scanner; the remote control signal includes a signal for controlling a virtual camera for acquiring an image of the three-dimensional scan data.

Description

Data processing apparatus and data processing method

Technical Field

Various embodiments disclosed relate to a data processing apparatus and a data processing method, and more particularly, to a data processing apparatus remotely controlled according to a control command from a scanner and an operation method thereof.

Background

The scanner may acquire two-dimensional scan data by scanning the object. A data processing device such as a PC connected to a scanner can generate a three-dimensional virtual model by using two-dimensional scan data acquired by the scanner and output the model to a screen.

The user may need to operate the data processing apparatus during the scanning process. For example, the user may want to change options or settings related to the scan, or change the scan step, or confirm whether the three-dimensional virtual model was successfully generated. At this time, the user may operate the data processing apparatus to perform the corresponding function.

However, scanners and data processing devices are generally physically separated from each other, and thus, it is difficult for a user to operate the data processing device remote from the scanner during the execution of a scanning action using the scanner. In addition, it is difficult for a user to confirm scan data in real time in detail through a screen of a data processing apparatus remote from the user while performing a scan operation. In addition, in an environment where sanitation is important, for example, when the subject is a patient's oral cavity, there is a problem that sanitation is poor by operating the data processing apparatus while scanning the oral cavity.

Disclosure of Invention

Problems to be solved by the invention

Various embodiments are directed to a data processing apparatus and a data processing method that are remotely controlled according to a control command from a scanner.

Various embodiments are directed to a data processing apparatus and a data processing method that change the display of three-dimensional scan data in response to a control command from a scanner.

Means for solving the problems

The data processing method performed by the data processing apparatus according to the embodiment may include the steps of: displaying three-dimensional scan data and changing the display of the three-dimensional scan data in response to a remote control signal received from a scanner; the remote control signal includes a signal for controlling a virtual camera for acquiring an image of the three-dimensional scan data.

Drawings

Fig. 1 is a diagram for explaining a data processing system according to an embodiment.

Fig. 2 is a diagram for explaining a method of acquiring surface data by a scanner according to an embodiment.

Fig. 3 is a diagram for explaining a user input section included in the scanner according to the embodiment.

Fig. 4 is a diagram for comparing and explaining a screen output when the data processing apparatus operates in the basic mode with a screen output when operates in the remote control mode according to the embodiment.

Fig. 5 is an example of a detailed block diagram of a data processing system including a scanner and a data processing device.

Fig. 6 is a diagram showing a data processing apparatus outputting a remote scan screen according to an embodiment.

Fig. 7 is a diagram showing that the data processing apparatus outputs a remote scan data viewing screen according to an embodiment.

Fig. 8 is a diagram for explaining a user controlling three-dimensional scan data included in a remote scan data viewing screen using a scanner according to an embodiment.

Fig. 9 is a diagram for explaining generation of a screen for controlling three-dimensional scan data by the data processing apparatus according to the embodiment.

Fig. 10 is a diagram showing a screen in which the data processing apparatus outputs accessible various control settings according to the embodiment.

Fig. 11 is a diagram showing an option setting information screen output by the data processing apparatus according to the embodiment.

Fig. 12 is a diagram showing the data processing apparatus outputting a remote scanning step selection screen according to an embodiment.

Fig. 13 is a flowchart illustrating a method in which a data processing apparatus operates in a remote control mode according to control of a scanner according to an embodiment.

Fig. 14 is a flowchart illustrating a method of a data processing apparatus outputting a remote scan data viewing screen according to control of a scanner according to an embodiment.

Fig. 15 is a flowchart showing a method of changing a scanning step in a remote control mode according to control of a scanner by the data processing apparatus according to the embodiment.

Fig. 16 is a flowchart showing the data processing apparatus operating in a remote control mode according to the control of the scanner according to the embodiment.

Detailed Description

In an embodiment, the remote control signal may further include a signal indicating that a remote control mode screen is output.

In an embodiment, the method may further comprise the steps of: a remote scan screen is output in response to receiving a scan start signal from the scanner.

In an embodiment, the remote scan screen may include the three-dimensional scan data and a live view image, which may be a two-dimensional image of the subject acquired by the scanner.

In an embodiment, the method may further comprise the steps of: receiving the remote control signal from the scanner; the step of receiving the remote control signal from the scanner may include the steps of: a user input signal for selecting a control button provided to the scanner is received as the remote control signal.

In an embodiment, the remote control mode screen and the basic mode screen may be different from each other in at least one of a coordinate system, an output data type, and an output data size.

In an embodiment, the method may further comprise the steps of: receiving a signal for indicating to output a basic mode picture; the receiving of the signal for instructing the output of the basic mode picture may include receiving at least one of a user input signal for selecting the output of the basic mode picture in a menu output to the remote control mode picture through a control button provided to the scanner in the course of outputting the remote control mode picture and an input part sensing the input signal of the data processing apparatus.

In an embodiment, the method may further comprise the steps of: outputting a remote scanning step selection screen in response to receiving a user input signal from the scanner, the user input signal being input by pressing a scan button provided to the scanner for a long time, and changing a scanning step according to the user input signal being input by a control button provided to the scanner; the step of altering the scanning step may comprise the steps of: the data generated in the previous scanning step is completed.

In an embodiment, the method may further comprise the steps of: a remote scan data view screen is output in response to receiving a scan end signal from the scanner.

In an embodiment, the method may further comprise the steps of: receiving a user input signal from the scanner, the user input signal for selecting a control type for the three-dimensional scan data included in the remote scan data view screen; the control type for the three-dimensional scan data includes at least one of movement, rotation, and size change of the three-dimensional scan data.

In an embodiment, the signal for controlling the virtual camera may include a signal according to the selected control type and an input of a control button provided to the scanner, and the step of changing the display of the three-dimensional scan data may include the steps of: capturing the three-dimensional scan data with the virtual camera controlled according to a signal for controlling the virtual camera, and outputting the acquired image.

The data processing apparatus according to an embodiment may include: a display; a communication unit for transmitting and receiving information to and from the scanner, and a processor for executing one or more instructions; the processor performs the following by executing the one or more instructions: displaying three-dimensional scan data by the display, changing the display of the three-dimensional scan data in response to a remote control signal received from a scanner; the remote control signal includes a signal for controlling a virtual camera for acquiring an image of the three-dimensional scan data.

According to an embodiment, a scanner may include: a communication unit for transmitting and receiving information to and from the data processing device, a user input unit, and a processor for executing one or more instructions; the processor executes the one or more instructions to transmit a remote control signal corresponding to the user input inputted through the user input unit to the data processing apparatus, thereby controlling the data processing apparatus to change the display of the three-dimensional scan data.

The present specification describes the principles of the present invention and discloses embodiments to clarify the scope of the claims of the invention and to enable one skilled in the art to practice the invention. The disclosed embodiments may be implemented in various forms.

Throughout the specification, like reference numerals refer to like constituent elements. The disclosed embodiments do not illustrate all elements of the embodiments, and repetition of the common content or embodiments within the technical field of the invention is omitted. The term "part" used in the specification may be implemented by software or hardware, and according to an embodiment, a plurality of "parts" may be implemented as one element, or one "part" may include a plurality of elements. The principle of action and embodiments of the present invention are described below with reference to the drawings.

In this specification, a subject body (object) as a photographing object may be a part of a body, or may include a model that models a part of a body. For example, the subject body may include various body parts of a human or animal, such as ears, nose, mouth, etc., or models of such parts.

In this specification, an image may include an image representing a subject body. In the present specification, the image may include at least one tooth, or an oral cavity including at least one tooth, or an image representing a plaster model of an oral cavity (hereinafter referred to as an "oral cavity image").

In addition, in the present specification, the oral image may include a two-dimensional image with respect to the subject body or a three-dimensional oral image showing the subject body stereoscopically. The three-dimensional oral cavity image may be generated by three-dimensional modeling (modeling) of the structure of the oral cavity from raw data, and thus may be referred to as a three-dimensional oral cavity model. In addition, the three-dimensional oral cavity model may also be referred to as a three-dimensional scan model or three-dimensional scan data. Hereinafter, in the present specification, an oral cavity image is used in a meaning of a model or an image representing an oral cavity in a general manner in two or three dimensions.

However, in the present specification, the image is not limited to the oral image, and may include images on various kinds of subject bodies such as ears or nose, depending on the kind of subject body and body parts.

In this specification, the data may refer to information required for displaying the object in two or three dimensions, for example, raw data (raw data) acquired by at least one camera.

Specifically, the raw data is data acquired for generating an image, and may be data (for example, two-dimensional data) acquired in at least one image sensor included in a three-dimensional scanner when the object is scanned with the three-dimensional scanner. Raw data acquired in a three-dimensional scanner may also be referred to as two-dimensional image data. The raw data may refer to two-dimensional images of different perspectives acquired by a plurality of cameras while scanning the object with the three-dimensional scanner.

In the above, the original data is explained as the two-dimensional image, but not limited thereto, the original data may also be three-dimensional image data.

There is a problem in that it is difficult for a user to operate a data processing apparatus remote from a scanner in the course of performing a scanning action using the scanner, or to confirm data output from the data processing apparatus in real time while performing the scanning action. In addition, if the scanner is a hand-held scanner, the hand-held scanner is also inserted into the oral cavity or the ears, nose, or the like, so that there is a problem that the user operates the data processing apparatus while scanning the subject using the hand-held scanner.

In order to overcome the above-described problems, the disclosed embodiments aim to provide a data processing apparatus and a data processing method that are remotely controlled according to a control command using a scanner.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

Referring to FIG. 1, a data processing system may include: a scanner 100; and a data processing device 120 coupled to the scanner 100 via the communication network 110.

The scanner 100 may be a medical device that acquires an image of a subject.

In an embodiment, the scanner 100 may be a hand-held scanner that a user holds and moves the scanner with his hand while scanning a subject. The scanner 100 may be inserted into an ear or nose to contactlessly scan the interior of the ear or nose. The scanner 100 may acquire images of at least one of an oral cavity or ear, nose, artificial structure, or a plaster model that models the oral cavity or ear, nose, artificial structure. Or the scanner 100 may be an oral scanner that inserts into the oral cavity and scans teeth to obtain an oral image of the oral cavity including at least one tooth. Hereinafter, for convenience of explanation, the case where the scanner 100 is an oral scanner will be described as an example, but is not limited thereto.

The scanner 100 may include a body 101 and a tip 103. The body 101 may include: a light irradiation section (not shown) for transmitting light; and a camera (not shown) for capturing an image of the subject.

The tip 103 may be provided in a detachable structure to the body 101 as a portion to be inserted into the oral cavity. The tip 103 includes an optical path changing device that directs light irradiated from the main body 101 toward the subject body and directs light received from the subject body toward the main body 101.

In order to image the surface of at least one of teeth, gums, and intraoral artificial structures (e.g., orthodontic devices including brackets and wires, etc., implant teeth, artificial teeth, intraoral corrective aids, etc.), the scanner 100 may acquire surface information about a subject body as raw data.

The scanner 100 may transmit the acquired raw data to the data processing device 120 through the communication network 110.

In an embodiment, the scanner 100 may include: a communication unit for transmitting and receiving information to and from the data processing device 120; a user input unit; and a processor executing one or more instructions. In an embodiment, the processor may remotely control the data processing apparatus 120 operating in the remote control mode by executing one or more instructions, and transmitting a control signal corresponding to a user input inputted through the user input section to the data processing apparatus 120 through the communication section.

In an embodiment, the user input included in the scanner 100 may include a scan button and a control button.

In an embodiment, the scan button may be a button for controlling a scanning action of the scanner 100. Scanner 100 may receive user input via a scan button and begin or end a scan action in response to the user input. In addition, the scanner 100 may transmit a control signal corresponding to a user input of the scan button to the data processing apparatus 120 to inform the data processing apparatus 120 of an operation state of the scanner 100, thereby causing the data processing apparatus 120 to perform a corresponding operation according thereto.

In an embodiment, the control button may be a button for controlling the data processing device 120. The scanner 100 may receive user input through the control buttons and transmit control signals corresponding to the user input to the data processing device 120 to control the actions of the data processing device 120.

The data processing device 120 may be connected to the scanner 100 via a wired or wireless communication network 110. The data processing device 120 may be all electronic devices that receive raw data from the scanner 100 and generate, process, display, and/or transmit oral images from the received raw data. For example, the data processing device 120 may be a computing device such as a smart phone (smart phone), a notebook computer, a desktop computer, a PDA, a tablet computer, etc., but is not limited thereto. The data processing device 120 may be in the form of a server (or a server device) or the like for processing an oral cavity image.

In an embodiment, the data processing device 120 may also send control signals to the scanner 100 to control the operation of the scanner 100 or inform the operation state of the data processing device 120. In an embodiment, the control signal transmitted to the scanner 100 by the data processing apparatus 120 may include a control signal of at least one of a power on/off command for the scanner 100, a scan mode change of the scanner 100, information of whether the data processing apparatus 120 operates in a basic mode or a remote control mode.

In an embodiment, the data processing device 120 may include a display 125, a communication section that communicates information with the scanner 100, and a processor that executes one or more instructions. In an embodiment, the processor may receive user input requesting to operate in the remote control mode by executing one or more instructions, and operate in the remote control mode according to a control command received from the scanner 100 through the communication part in response to receiving the user input requesting to operate in the remote control mode. In an embodiment, the processor acting in the remote control mode may include controlling the display 125 to output a remote control mode screen.

In an embodiment, the data processing method performed by the data processing apparatus 120 may include the steps of: receiving user input requesting to act in a remote control mode; in response to receiving a user input requesting to act in a remote control mode, to act in a remote control mode that is remotely controlled in accordance with a control command of scanner 100.

In an embodiment, the step of acting in the remote control mode may comprise the steps of: and outputting a remote control mode screen.

In an embodiment, the user input requesting to act in the remote control mode may include at least one of a user input entered through a control button provided to the scanner 100 and a user input selecting the remote control mode through the data processing apparatus 120.

In an embodiment, the data processing method may further include the steps of: receiving a scanning execution command; the step of outputting the remote control mode screen may include the steps of: the remote scan screen is output in response to receiving the scan execution command.

In an embodiment, the remote scan screen may include three-dimensional scan data and a live view image including a two-dimensional image about the subject acquired by the scanner 100.

In an embodiment, the data processing method may further include a step of receiving a scan end command, and the step of outputting the remote control mode screen may further include a step of outputting a remote scan data viewing screen in response to receiving the scan end command.

In an embodiment, the data processing method may further include a step of receiving a user input for selecting a control type for the three-dimensional scan data included in the remote scan data viewing screen, the control type for the three-dimensional scan data including at least one of movement, rotation, and size change of the three-dimensional scan data.

In an embodiment, the step of outputting the remote control mode screen may further include the steps of: based on the selected control type and the inputs of four direction keys provided to the control buttons of the scanner 100, a screen for controlling three-dimensional scan data is output.

In an embodiment, the step of outputting a screen for controlling the three-dimensional scan data may include a step of outputting an image acquired by photographing the three-dimensional scan data with a virtual camera that operates in response to input of the selected control type and four direction keys provided to control buttons of the scanner 100.

In an embodiment, the data processing method may further include a step of receiving a screen before the request to output the three-dimensional scan data is controlled, and the step of outputting the remote control mode screen may further include the steps of: in response to receiving a request to output a screen before the three-dimensional scan data is controlled, a remote scan data viewing screen output in response to receiving a scan end command is output again.

In an embodiment, the data processing method may further include a step of receiving a user input requesting option setting information, and the step of outputting the remote control mode screen may include the steps of: in response to receiving a user input requesting option setting information, a screen including an option setting information screen is output.

In an embodiment, the option setting information screen may be directed to a setting menu including at least one of scan settings, scanner settings, data settings, and control settings.

In an embodiment, the step of outputting the remote control mode screen may include a step of outputting a remote scanning step selection screen according to a long press input to a scan button provided to the scanner 100, and the data processing method may further include a step of changing the scanning step according to a user input through four direction keys provided to the control button of the scanner 100, the step of changing the scanning step including a step of completing (completing) scan data generated in a previous scanning step.

In an embodiment, the data processing method may further include the steps of: the base mode is operated based on the user input requesting to operate in the remote control mode not being received or the user input requesting to operate in the base mode being received from the user during the operation in the remote control mode. The step of acting in the basic mode includes a step of outputting a basic mode screen, and the remote control mode screen and the basic mode screen may be different from each other in at least one of a coordinate system, an output data type, and an output data size.

In an embodiment, receiving a user input requesting to operate in the basic mode may include at least one of selecting to switch to the basic mode in a menu output to a screen through a control button provided to the scanner 100 during operation in the remote control mode; and an input portion provided to the data processing apparatus 120 senses a user input signal. For example, when a user operates a mouse or a keyboard, a keypad, or the like of the data processing apparatus 120, the data processing apparatus 120 may receive these user's operations as control signals commanding the operation in the basic mode, and perform the operation by switching from the remote control mode to the basic mode according thereto.

The data processing device 120 may process the two-dimensional image data from the two-dimensional image data received from the scanner 100 to generate a three-dimensional oral cavity image, or to generate additional information. The data processing device 120 may display the three-dimensional oral image and/or additional information via the display 125 or output or transmit it to an external device.

As yet another example, the scanner 100 acquires raw data by oral scanning, and processes the acquired raw data to generate three-dimensional data, which is transmitted to the data processing device 120.

The scanner 100 irradiates (project) pattern light onto a subject and scans the subject irradiated with the pattern light, thereby acquiring three-dimensional data representing the shape of the subject by using the principle of triangulation due to pattern deformation.

In an embodiment, the scanner 100 may also acquire three-dimensional data of the object using a confocal (confocal) method. The confocal method is a non-destructive optical imaging technique for measuring three-dimensional surfaces, and can acquire optical cross-sectional images with high spatial resolution using a pinhole structure. The scanner 100 can obtain three-dimensional data by stacking (stack) acquired two-dimensional images in an axial direction.

However, this is an example, and the scanner 100 may acquire three-dimensional data from raw data using various ways other than the above-described method and transmit it to the data processing apparatus 120. The data processing device 120 may analyze, process, display, and/or transmit the received three-dimensional data.

Fig. 2 is a diagram for explaining acquisition of three-dimensional data by photographing a subject by the scanner 100 illustrated in fig. 1.

In embodiments, the scanner 100 may acquire three-dimensional data about the object using a variety of methods. For example, the scanner 100 may acquire three-dimensional data about the object using a confocal approach. The confocal system acquires three-dimensional information of the object based on the position of a point detected by the maximum intensity of reflected light, based on the refractive index of a lens through which light irradiated onto the object passes. The scanner 100 may acquire an optical cross-sectional image with high spatial resolution using a pinhole structure. The scanner 100 can obtain three-dimensional data by stacking the acquired two-dimensional images in the axial direction.

Alternatively, in another embodiment, the scanner 100 may also acquire three-dimensional information of the object using optical triangulation (triangulation technique). The optical triangulation method is a technique of acquiring three-dimensional information of a subject by triangulation using a triangle formed by a light source, the subject irradiated with light from the light source, and an image sensor that inputs light reflected from the subject. However, this is an example, and the scanner 100 may acquire three-dimensional data by various means other than the confocal means or the optical triangulation means.

Next, as an example, a mode in which the scanner 100 acquires three-dimensional data on the object by using the optical triangulation method will be described in more detail.

In an embodiment, the scanner 100 may acquire an image using at least one camera and acquire three-dimensional data based on the acquired image.

In fig. 2, the scanner 100 may be an optical three-dimensional scanner. The scanner 100 may use a binocular structured light (structured light with stereo vision) method to acquire three-dimensional data on the surface of the object 210.

The scanner 100 may include more than two cameras 230, 240 and a projector 220 that may transmit structured light 225.

The scanner 100 may transmit structured light 225 to the object 210 and acquire an L image 235 corresponding to a left field of view and an R image 245 corresponding to a right field of view from an L camera 230 corresponding to a left field of view (left Field of View) and an R camera 240 corresponding to a right field of view (Right Field of View), respectively. The L image 235 and the R image 245 may be reconstructed into a three-dimensional image frame representing the surface of the object 210.

The scanner 100 may continuously acquire two-dimensional image frames including an L image 235 and an R image 245 of the subject 210. The scanner 100 or the data processing apparatus 120 may acquire a three-dimensional image frame representing the surface shape of the object 210 from two-dimensional image frames including the L image 235 and the R image 245. In fig. 2, the scanner 100 is illustrated as acquiring three-dimensional data from two images acquired with two cameras 230, 240, but this is an embodiment, the scanner 100 may also acquire images with only either of the two cameras 230, 240.

The scanner 100 may scan around the object 210 at intervals (e.g., 10-30 frames per second) to obtain a plurality of two-dimensional frames. The scanner 100 or the data processing device 120 may acquire a plurality of three-dimensional image frames from a plurality of two-dimensional image frames.

The data processing apparatus 120 may obtain a three-dimensional oral model of the entire subject body 210 by merging (merge) or position alignment (align) multiple three-dimensional image frames.

Fig. 3 shows a scanner body. The tip may be detachably fastened to one end of the scanner body. If the scanner is a wired scanner, the other end of the scanner body may be provided with a cable or the like for connecting the data processing apparatus, but is not limited thereto, and the scanner may be implemented as a wireless scanner.

Hereinafter, the scanner body shown in fig. 3 will be referred to as a scanner 300.

Referring to fig. 3, a frame or housing surrounding a scanner 300 may include user inputs. The user input may receive user input for controlling the scanner 300 and/or a data processing device connected to the scanner 300. The user input may also be referred to as a user interface. The user may control various functions of the scanner 300 and/or the data processing apparatus using user inputs provided to the scanner 300.

In an embodiment, the user input provided to the scanner 300 may include a scan button 310 and a control button 320.

In response to a user selecting the scan button 310 and/or the control button 320 included in the user input section, the scanner 300 may acquire a command corresponding to the user input based on the type of button selected by the user and the number of input buttons. The scanner 300 may send a control signal including a command to the data processing device.

In an embodiment, the control signal transmitted from the scanner 300 to the data processing apparatus may include at least one of information about an operation state of the scanner 300 and control information for controlling the data processing apparatus. The information about the operation state may include at least one of information about whether the power of the scanner 300 is turned on or off, whether the scanner 300 operates in the scan mode or the standby mode, and information identifying the scan mode. The control information for controlling the data processing apparatus may comprise a remote control signal. The remote control signal may include a signal for changing the display of the three-dimensional scan data. The remote control signal may include a signal indicating that the remote control mode screen is output.

The data processing device may receive control signals from the scanner 300 and identify the operational status of the scanner 300 accordingly. In addition, the data processing device may act in response to control signals from the scanner 300.

In an embodiment, the scan button 310 and/or the control button 320 may be implemented in the form of physical keys or buttons that receive a push operation by a user, touch buttons displayed on a touch pad (touchpad) that senses a touch, or the like. However, this is one embodiment, and the scan button 310 and/or the control button 320 may be implemented in various forms such as a microphone that can receive a user's voice, a sensor that can recognize a user's motion as an input, a wheel that receives a user's rotational operation, a keyboard (key board), a dome switch (dome switch), and the like, in addition to keys or buttons.

In an embodiment, the scanner 300 may operate in a scan mode (scan mode) or a standby mode (standby mode) according to whether or not the constituent elements included in the scanner 300 operate in a power-on state.

In an embodiment, scanner 300 may operate in a scanning mode. The scan mode may refer to a mode in which all the constituent elements of the scanner 300 are activated and normally operate. A user of a dentist or the like can acquire raw data or acquire three-dimensional oral images by scanning the patient's oral cavity during the operation of the scanner 300 in a scanning mode.

In an embodiment, the scanner 300 may operate in a standby mode. The standby mode may refer to the scanner 300 itself being powered on, but a part of the constitution (e.g., the optical section) included in the scanner 300 is in an inactive state. In the standby mode, the optical portion is in a standby state, and other constituent elements other than the optical portion may be in an activated state. In the standby mode, a communication module (not shown) may perform a network function, and thus may transmit and receive a control signal to and from an external device (e.g., a data processing device) or transmit information about an operation state of the scanner 300 to the data processing device. The standby mode may also be referred to as an idle mode.

In an embodiment, scan button 310 may include a key. Scan button 310 may receive user input for controlling the scanning action of scanner 300.

In an embodiment, the scanning actions that can be controlled using the scanning button 310 can include at least one of a scan start, a scan end, a scan mode change, and other function execution related to the scanning actions that are preset by a user.

In an embodiment, the scanning action may be initiated when a user input for scan button 310 is received during the scanner 300 is operating in the standby mode. For example, if the user clicks the scan button 310 while the scanner 300 is in the standby mode, the scanner 300 may recognize a user input for the scan button 310 as a command requesting to perform a scanning action and start the scanning action. The scanner 300 may cause a light source included in the projector to emit light and a camera included in the optical module to acquire a two-dimensional image of the object body. The scanner 300 may transmit the acquired two-dimensional image to a data processing device.

In an embodiment, the scanning action being performed may be stopped when user input for the scan button 310 is received during the operation of the scanner 300 in the scanning mode. For example, if the user clicks the scan button 310 while the scanner 300 performs scanning, the scanner 300 may recognize a user input for the scan button 310 as a command requesting to stop the scanning action, and stop the scanning action.

In an embodiment, scan button 310 may receive user input for changing the scan mode of scanner 300. The scan pattern may be information for causing the scanner 300 to recognize a scanned object. The scan mode may be one of an upper jaw scan mode, a lower jaw scan mode, and a bite scan mode according to the scanned object.

The data processing device cannot distinguish whether the data received from the scanner 300 is data of scanned upper jaw, data of scanned lower jaw, or data of scanned upper jaw and lower jaw bite. Therefore, the user needs to set the scan mode by using the data processing apparatus before performing the scan. In addition, after finishing scanning the object, the user needs to operate the data processing apparatus to input that the scanning of the object has been completed (completed). The data processing apparatus performs post-processing of three-dimensional scan data upon receiving a user input of completion of scanning.

However, each time the user wants to change the scanning mode, the scanning mode needs to be changed by operating the data processing apparatus or the scanning completion needs to be inputted by operating the data processing apparatus, which has a problem of inconvenience and insanitation.

In an embodiment, the user may change the scan mode by using the scan button 310. For example, the user may make an input by pressing a long-pressed scan button 310 to change the scan mode. The scanner 300 may change the scan mode according to a preset sequence in response to the scan button 310 being long-pressed. For example, the scanner 300 may change the scan mode in the order of the upper jaw scan mode, the lower jaw scan mode, and the bite scan mode, but is not limited thereto. If the user scans the jaw after scanning the upper jaw of the patient's mouth, the user may press the scan button 310 for a long time to input to change the scan mode from the upper jaw scan mode to the lower jaw scan mode.

In an embodiment, the scanner 300 transmits information requesting completion of scan data according to a current scan mode (e.g., a jaw scan mode) and a control signal informing that the scan mode has been changed to a next scan mode, i.e., a jaw scan mode, to the data processing apparatus in response to input of the user by pressing the scan button 310 for a long time.

In an embodiment, the data processing apparatus may perform post-processing of the upper jaw scan data according to the control signal received from the scanner 300, and generate the lower jaw scan data based on the raw data acquired from the scanner 300 after receiving the control signal.

Therefore, according to the embodiment, when the user wants to end the scanning in the predetermined scanning mode during the scanning, the user can perform the scanning operation according to the current scanning mode by pressing the scanning button 310 for a long time without additionally inputting the information that the scanning has been completed by operating the data processing apparatus. In addition, the user can easily change the scan mode by using the scanner 300.

The scanner 300 photographs a subject to acquire two-dimensional image data, and the data processing apparatus acquires three-dimensional scan data from the two-dimensional image and outputs it to a screen may be performed by performing various settable options or various functions. The various options or functions may include, for example, scan depth, scan resolution, scan data filtering execution, metal scanning execution or not, and the like. Various functions may be performed according to a value set as default. For example, when a default value of a scanning depth when the scanner 300 performs scanning is set to 12mm, a scanning resolution is set to SD (640×480), and metal scanning execution is set to off, the scanner 300 may perform scanning at 12mm, and the data processing apparatus collects and outputs scanning data at the resolution of SD. In addition, metal scanning is not performed.

Depending on the circumstances, a user may wish to act at a value desired by the user, rather than a default value, when the scanner 300 and/or the data processing apparatus processes the scan data. For example, the user may wish to scan a depth of 15mm and a scan resolution of HD (1280×720). In addition, the user may wish to perform a metal scan.

In an embodiment, regarding the scanning action and/or the data processing action, the user may set the setting value for executing the option or function to a desired value in advance. For example, the user may set in advance using the data processing apparatus to perform metal scanning with a scanning depth of 15mm and a scanning resolution of HD (1280×720).

In an embodiment, the setting value set by the user for performing the option or function may be matched with and stored in the scan button 310 provided to the scanner 300. The scanner 300 and/or the data processing apparatus may perform a scanning action and/or a data processing action according to a set value for performing an option and/or a function set in advance by a user when the user clicks the scan button 310 a prescribed number of times (e.g., double-click). In the above example, when the user double-clicks the scan button 310 to make an input, the scanner 300 may perform scanning at a depth of 15mm set by the user instead of 12mm as a default value, and the data processing apparatus collects scan data at a resolution of HD instead of SD, when performing a scanning action. In addition, the data processing apparatus may perform metal scanning that automatically processes the metal surface.

In an embodiment, the data processing apparatus may be operated in one of a basic mode and a remote control mode.

In an embodiment, the data processing apparatus may operate in a remote control mode (remote control mode). The remote control mode may refer to the data processing apparatus being operated in a remotely controllable form according to a control command through the scanner 300. In the remote control mode, the data processing apparatus can change the display of the three-dimensional scan data in accordance with a control signal from the scanner 300. In the remote control mode, the data processing apparatus may output a remote control mode screen.

In an embodiment, the basic mode may be an action mode when the data processing apparatus does not act in the remote control mode. The data processing apparatus may operate in the basic mode by default when no user input requesting operation in the remote control mode is received. Alternatively, the data processing apparatus may switch to the basic mode when receiving a user input requesting to operate in the basic mode during operation in the remote control mode.

In an embodiment, control buttons 320 may receive user input for controlling the data processing apparatus. The user may cause the data processing apparatus to act in a remote control mode by using the control button 320. In addition, the user can control the remote control mode screen output by the data processing apparatus by using the control button 320.

In an embodiment, control button 320 may be in an inactive state when scanner 300 is operating in a scan mode. In an embodiment, scanner 300 may receive user input to control button 320 only when operating in the standby mode. Therefore, even if the user inputs the control button 320 during the scanning performed by the scanner 300, an action according to the input of the control button 320 is not performed.

In an embodiment, control buttons 320 may include a plurality of keys. As shown in fig. 3, the control button 320 may include four direction keys 321, 322, 323, 324 and an intermediate key 325.

In an embodiment, when the scanner 300 is operating in the standby mode, the scanner 300 may receive user input for the control buttons 320. The scanner 300 may transmit a control signal corresponding to the user input to the data processing apparatus.

In an embodiment, the control signals sent by the scanner 300 to the data processing device may include remote control signals. The remote control signal may be a signal for remotely controlling the data processing apparatus. The remote control signal may include a signal for controlling three-dimensional scan data output from the data processing apparatus. More specifically, the remote control signal may include a signal for controlling a virtual camera that acquires an image of the three-dimensional scan data. In addition, the remote control signal may include a signal indicating that the remote control mode screen is output.

The data processing apparatus may output a remote control screen in response to receiving a remote control signal from the scanner 300.

Alternatively, the user may cause the data processing apparatus to output a remote control screen by operating the data processing apparatus.

In an embodiment, when the data processing apparatus outputs the remote scan data viewing screen, the user may select a control type for the three-dimensional scan data included in the remote scan data viewing screen using the control button 320. In an embodiment, the remote scan data view screen as one of remote control mode screens output by the data processing apparatus may refer to a screen including three-dimensional scan data output in response to the scanner 300 operating in the standby mode. In an embodiment, the remote scan data view screen may include information regarding the type of control that a user may control using scanner 300. For example, the user may select a control type for the three-dimensional scan data by selecting the middle key 325 among the plurality of keys included in the control button 320. The control type for the three-dimensional scan data may include at least one of movement, rotation, size change such as enlargement or reduction, and the like of the three-dimensional scan data.

The control type for the three-dimensional scan data included in the remote scan data viewing screen may be changed every time the user inputs the middle key 325 provided to the control button 320 of the scanner 300.

The user may input the four direction keys 321, 322, 323, 324 in response to outputting the remote scan data viewing screen including information about a desired control type, thereby controlling the three-dimensional scan data included in the remote scan data viewing screen according to the control type.

In an embodiment, when the user wants to see a screen before the three-dimensional scan data is controlled, the middle key 325 of the control button 320 may be input a prescribed number of times. The data processing apparatus may output the remote scan data viewing screen again, which was output before the control of the three-dimensional scan data was performed, according to the input of the user.

In an embodiment, the user may enter by long pressing the middle key 325 of the control button 320. The data processing apparatus may output a screen including an option setting information screen in response to a user input. The option setting information screen may include setting items regarding at least one of scan settings, scanner settings, data settings, and control settings. The user can select and/or change an item to be set using the four direction keys 321, 322, 323, 324 and the middle key 325 included in the control button 320.

Referring to fig. 4, the data processing apparatus may operate in a basic mode or in a remote control mode according to an operation mode.

In an embodiment, the screen output by the data processing apparatus in the basic mode may be different from the screen output in the remote control mode. Hereinafter, a screen output by the data processing apparatus in the basic mode will be referred to as a basic mode screen, and a screen output by the data processing apparatus in the remote control mode will be referred to as a remote control mode screen.

In an embodiment, the remote control mode screen may include at least one of a remote scan screen, a remote scan data view screen, an accessible control setting screen, an option setting information screen, and a remote scan step selection screen.

Fig. 4 (a) is a diagram showing a basic mode screen outputted when the data processing apparatus operates in the basic mode. The basic mode screen 410 shown on the left side of fig. 4 (a) is a screen when the data processing apparatus executes scanning-related software in conjunction with the scanner. The basic mode screen 420 shown on the right side of fig. 4 (a) is a screen that outputs three-dimensional scan data 423 acquired from two-dimensional image data received from a scanner.

As shown in fig. 4 (a), the basic mode screen may include a menu bar 411 and a menu bar 421 including various menus. The menu bar 411 and the menu bar 421 may include at least one of operation-related information and a User Interface (UI). The operation-related information may include information for guiding a shortcut key or a data operation-related key, which may be input through a keyboard provided to the data processing apparatus. For example, the operation-related information may be information informing what shortcut key needs to be operated in order to enlarge or rotate or move the three-dimensional scan data 423 included in the screen. The user interface comprises commands or techniques for operating the data processing device and may be implemented in the form of icons or text, images. The user interface may include various toolsets for editing or altering scan data using a data processing apparatus. For example, the user interface may include menus including zoom-in, zoom-out, full-screen views, previous image views, angle or position changes, etc. of the scan data. Alternatively, the user interface may display whether the scan mode is an upper jaw scan mode, a lower jaw scan mode, or a bite scan mode, or include a menu for selecting the scan mode. Alternatively, the user interface may include a menu for completing the scan mode.

Fig. 4 (b) is a diagram showing a remote control mode screen outputted when the data processing apparatus operates in the remote control mode. The remote control mode screen 430 shown on the left side of fig. 4 (b) is a screen output by the data processing apparatus when the scan-related software is executed, and the remote control mode screen 440 shown on the right side of fig. 4 (b) is a screen output three-dimensional scan data 443 acquired from two-dimensional image data received from the scanner.

Comparing fig. 4 (a) and 4 (b), the basic mode screen and the remote control mode screen may be different from each other in at least one of a coordinate system, an output data type, and an output data size.

The coordinate system is a system for determining coordinates of a position of a point on a display space, and refers to a collective term of an origin and a reference length, a reference axis, or a reference line. Since the basic mode screen includes various menu fields 411 and 421, a space in which the three-dimensional scan data 423 can be output is limited. When the area including the three-dimensional scan data 423 is referred to as a scan information area, the basic mode screen has a smaller scan information area than the remote control mode screen.

If a reference point at which the scan information area starts in the basic mode screen and the remote control mode screen is expressed as an origin having (0, 0) coordinate values, the position of the origin of the remote control mode screen is located on the left side thereof than the position of the origin of the basic mode screen. Accordingly, the remote control mode screen may include a scan information area larger than that of the basic mode screen.

When the data processing apparatus outputs the three-dimensional scan data 423 through the basic mode screen, as shown in the right side of fig. 4 (a), the position, the size, and the like of the scan information area where the three-dimensional scan data 423 can be output are limited due to various menu fields 411 and 421, and thus the three-dimensional scan data 423 is output with a certain size or less. Therefore, it is difficult for a user operating the scanner remote from the data processing apparatus to easily recognize the three-dimensional scan data 423 of the screen output to the data processing apparatus from a remote place.

Unlike this, since the remote control mode screen does not include the menu bar 411 and the menu bar 421 included in the basic mode screen, a wider scan information area may be included, and the scan information area may include the three-dimensional scan data 443 of a larger size than the basic mode screen. In addition, since the remote control mode screen includes only information necessary in the current screen in a large size, such as information representing the current scan mode or the control type 431 and control type 441 for the scan data output to the screen, etc., the user can easily recognize the current scan mode or the control type for the scan data also at a remote place.

Alternatively, in an embodiment, the remote control mode screen may include a screen including the scan information area in a pop-up (pop up) form. When the data processing apparatus outputs the three-dimensional scan data 443 during operation in the remote control mode, the data processing apparatus may output a scan information area as an area including the three-dimensional scan data 443 in another pop-up screen different from the original screen. For example, in the case where the data processing apparatus is to output three-dimensional scan data 443 in the course of outputting a basic mode screen as shown in fig. 4 (a), only the scan information area including the three-dimensional scan data 443 may be output to the basic mode screen in a separate pop-up screen. Alternatively, as shown in fig. 4 (a), in the process of operating in the remote control mode, the data processing apparatus may output only the option setting information screen as a separate pop-up screen to the basic mode screen in the process of outputting the basic mode screen.

In addition, although not shown in fig. 4, the remote control mode screen may include a live view (live view) image in addition to the three-dimensional scan data 443 in the scan information area. For example, when the user performs scanning using the scanner during the operation of the data processing apparatus in the remote control mode, the data processing apparatus may output a live view image to the remote control mode screen in addition to the three-dimensional scanning data 443. In the course of the data processing apparatus operating in the remote control mode, the three-dimensional scan data 443 and/or the live view image are output in a large size, and therefore, a user operating a scanner remote from the data processing apparatus can easily recognize the three-dimensional scan data 443 and the live view image of the screen output to the data processing apparatus even at a remote place.

However, this is an embodiment, and the data processing apparatus can output the same screen without distinguishing the modes. The data processing apparatus may output the same screen without a separate distinction between when the control signal is not received from the scanner 300 and when the control signal is received from the scanner 300 and controlled according thereto. That is, the data processing apparatus may output a screen having the same coordinate system, output data type, and output data size when receiving a user input to operate a keyboard, a mouse, or the like provided to the data processing apparatus and performing an operation according to the operation thereof and according to a remote control signal from the scanner 300. For example, when the data processing apparatus receives a user input through an operation button provided to the data processing apparatus and operates in accordance with the input, the data processing apparatus may output a screen having the same coordinate system, output data type, and output data size as those in the case of the remote control mode screen described above.

In an embodiment, a data processing system may include a scanner 510, a data processing device 520, and a communication network 530.

The scanner 510 may acquire raw data by scanning a subject body. The subject body may include, for example, but is not limited to, a patient's mouth or dental model, and the like. The scanner 510 may transmit the acquired raw data to the data processing apparatus 520 through the communication network 530, or generate a three-dimensional virtual model by processing the raw data and transmit it to the data processing apparatus 520.

Scanner 510 may include a processor 511, a memory 512, an optical portion 513, a communication module 515, and a user input 516.

Memory 512 may store more than one instruction. In addition, the memory 512 may store more than one instruction for execution by the processor 511. In addition, the memory 512 may store at least one program executed by the processor 511.

The optical part 513 may include an optical module and a projector. The optical part 513 may include a light source, a projector that projects light from the light source, and a camera that receives at least one of light reflected from the object. The optical portion 513 may project pattern light, structured light, or the like. The optical part 513 may irradiate light with a light source and form a pattern by controlling each Micro mirror included in a Digital Micro-mirror Device (DMD). The optical section 513 may irradiate light by turning on or off a mirror included in the control DMD. The optical unit 513 can acquire three-dimensional data representing the shape of the object by irradiating light to the object and scanning the object irradiated with the light.

The communication module 515 may perform communication with the data processing device 520 through a wired or wireless communication network.

In an embodiment, the communication module 515 may send the control signal to the data processing device 520. In addition, the communication module 515 may transmit information about the operation state of the scanner 510, etc., to the data processing device 520. In addition, the communication module 515 may transmit the raw data acquired by the optical part 513 to the data processing device 520.

The communication module 515 may include: at least one short-range communication module that performs communication according to a communication standard of bluetooth, wi-Fi, bluetooth low energy (Bluetooth Low Energy, BLE), NFC/RFID, wi-Fi direct, UWB, ZIGBEE, or the like; a remote communication module that performs communication with a server for supporting remote communication according to a remote communication standard; and at least one port connected to an external electronic device through a wired cable for wired communication.

The user input 516 may receive user input for controlling the scanner 510. The user input 516 may also be referred to as a user interface.

The user input portion 516 may include a touch panel that senses a touch of a user, a button that receives a pressing operation of the user, a voice recognition device including a microphone, and the like. Alternatively, the user input 516 may further include at least one of a wheel or dome switch receiving a user's rotational operation, and a sensor (not shown) recognizing movement.

In an embodiment, the user input 516 may include a scan button that receives user input for a scan action and a control button that receives user input for remotely controlling the data processing device 520.

In an embodiment, the user may change the operation mode of the scanner 510 from the standby mode to the scan mode or from the scan mode to the standby mode by selecting a scan button included in the user input 516. In addition, the user may use a scan button to select the type of scan mode of the scanner 510. The scanner 510 may transmit a control signal including an operation mode of the scanner 510 and identification information for a current scan mode to the data processing device 520 according to a user input for the scan button.

In an embodiment, the user may control the remote control mode screen output to the data processing apparatus 520 by selecting a control button included in the user input part 516.

In an embodiment, a user may use control buttons to control the data processing device 520, which is operated in a basic mode, to operate in a remote control mode.

In an embodiment, when the remote scan data viewing screen is output to the data processing apparatus 520, the user may select a control type for the three-dimensional scan data using an intermediate key included in the control button. The control of the three-dimensional scan data may include control of at least one of movement, rotation, size change such as enlargement or reduction, and the like of the three-dimensional scan data.

In an embodiment, the user may control the remote scan data to view the three-dimensional scan data included in the screen using four direction keys included in the control buttons.

In an embodiment, when the user wants to see a screen before the three-dimensional scan data is controlled, the middle key of the control button may be input a prescribed number of times. The data processing apparatus 520 may output the remote scan data viewing screen output before performing the control of the three-dimensional scan data again according to the input of the user.

In an embodiment, the user may cause the data processing apparatus 520 to output a screen including an option setting information screen according to the middle key input of the long press control button. The option setting information screen may include a setting menu for at least one of scan settings, scanner settings, data settings, and control settings.

The processor 511 may control the entire scanner 510. The processor 511 may control at least one constituent element included in the inside of the scanner 510 so as to perform a desired action. Therefore, even if a case where the processor 511 performs a prescribed operation is described as an example, this may refer to the processor 511 controlling the constitution of at least one included inside the scanner 510 so as to perform the prescribed operation. The processor 511 may control the optical section 513 to acquire three-dimensional data of the subject body.

In an embodiment, the processor 511 may acquire a control signal according to a user input through the user input part 516 or receive a control signal from the data processing device 520 and control the scanner 510 according to the control signal.

In an embodiment, the processor 511 may send information about the operational status of the scanner 510, etc., to the data processing device 520 in real time over the communication network 530.

In an embodiment, the processor 511 may generate a control signal corresponding to a user input through the user input part 516 and transmit it to the data processing device 520 to control the data processing device 520.

In an embodiment, the processor 511 may obtain a command corresponding to a user input received through the user input 516. The processor 511 may acquire a command corresponding to the user input based on at least one of the type of button selected by the user, the type of key included in the selected button, the button, or the number of times the key is input. The processor 511 generates a control signal including a command and transmits the control signal to the data processing device 520 through the communication module 515, thereby informing the data processing device 520 of the operation state of the scanner 510 or controlling the data processing device 520 to operate according to the control command.

In an embodiment, the processor 511 may control the scanner 510 to cause the scanner 510 to operate in a scan mode or in a standby mode in response to a user selecting a scan button included in the user input 516. In addition, the processor 511 may alter the scan mode in response to user input to the scan button. For example, if the current scan mode is the palate scan mode, the processor 511 may complete the palate scan mode in response to user input to the scan button and control the scanner 510 to cause the scanner 510 to operate in the next scan mode, i.e., the chin scan mode.

In an embodiment, the processor 511 may send a control signal corresponding to the control button selection to the data processing device 520 in response to the user selecting the control button to cause the data processing device 520 to operate in a remote control mode.

In an embodiment, if the data processing apparatus 520 outputs a remote scan data viewing screen, the processor 511 may transmit a control signal corresponding to the control button to the data processing apparatus 520 in response to a user selecting an intermediate key included in the control button so as to select a control type for three-dimensional scan data.

In an embodiment, the processor 511 may transmit control signals corresponding to four direction key inputs to the data processing device 520 in response to a user selecting four direction keys included in the control buttons, so as to control the remote scan data to view three-dimensional scan data included in the screen.

In an embodiment, the processor 511 may transmit a control signal corresponding to the control button to the data processing device 520 in response to the user inputting the intermediate key of the control button a prescribed number of times, so that the data processing device 520 outputs the remote scan data viewing screen output before performing the control of the three-dimensional scan data again.

Hereinafter, the data processing device 520 will be described. The data processing device 520 may also be referred to as an oral image processing device.

The data processing device 520 may include a processor 521, a memory 522, a user input 523, a communication module 524, a display 525, and an image processing 526.

The user input part 523 may receive a user input for controlling the data processing apparatus 520. The user input part 523 may include a touch panel sensing a touch of a user, a button receiving a pressing operation of the user, a mouse or a keyboard for designating or selecting one point on a user input part screen, etc., and may further include a voice recognition device for recognizing a voice, a motion sensor for recognizing a motion, etc.

In an embodiment, the user input 523 may receive a command entered by a user to cause the data processing apparatus 520 to operate in a remote control mode.

The communication module 524 may perform communication with at least one external electronic device via a wired or wireless communication network. The communication module 524 may perform communication with the scanner 510 according to the control of the processor 521.

In particular, the communication module 524 may include at least one short-range communication module that performs communication according to a communication standard such as Bluetooth, wi-Fi, bluetooth Low energy, NFC/RFID, wi-Fi direct, UWB, or ZIGBEE. In addition, the communication module 524 may also include a remote communication module that performs communication with a server for supporting remote communication according to a remote communication standard.

In addition, the communication module 524 may include at least one port for connecting with external electronic devices (e.g., scanner 510, etc.) via a wired cable.

In an embodiment, the communication module 524 may send control signals to the scanner 510. The control signal transmitted to the scanner 510 may include at least one of a power-on command or a power-off command of the scanner 510, a command requesting the scanner 510 to enter a scan mode, or a command to enter a standby mode.

In an embodiment, the communication module 524 may receive information from the scanner 510 regarding the current status of the scanner 510, etc. The information on the current state of the scanner 510 and the like may include at least one of information on whether the scanner 510 is in a scan mode or a standby mode, and information on which step of the scan mode to operate in.

In an embodiment, the communication module 524 may receive control signals from the scanner 510. In an embodiment, the control signals received from the scanner 510 may include commands that require the data processing device 520 to operate in a remote control mode.

In an embodiment, the control signal received from the scanner 510 may include a signal for user selection corresponding to the remote control mode screen.

The display 525 may display a prescribed screen according to the control of the processor 521. The display 525 may output a user interface screen for user input. The display 525 may display a screen including an oral image generated from data acquired by scanning the patient's oral cavity or a plaster model of the oral cavity by the scanner 510. In addition, the display 525 may output a three-dimensional oral model generated from the two-dimensional image data received from the scanner 510.

In an embodiment, the display 525 may output a basic mode screen in response to the data processing device 520 acting in a basic mode and a remote control mode screen in response to the data processing device 520 acting in a remote control mode.

In an embodiment, the basic mode screen and the remote control mode screen have different coordinate systems. Since the remote control mode screen is different from the basic mode screen, various menu bars are not included, and thus the size of the scan information area thereof is larger than that of the basic mode screen. When the reference point at which the scan information area starts in the remote control mode screen is expressed as the origin having the (0, 0) coordinate value, the position of the origin of the remote control mode screen is located at the left and/or upper side thereof than the position of the origin of the basic mode screen to include a larger scan information area in the screen.

In an embodiment, the basic mode picture and the remote control mode picture are different from each other in at least one of an output data type and an output data size. The remote control mode screen does not include a menu bar included in the basic mode screen, and in addition, may include three-dimensional scan data having a size larger than that of the basic mode screen. In addition, during the operation of the scanner 510 in the scan mode, the remote control mode screen output by the data processing device 520 may include three-dimensional scan data and a live view image received from the scanner 510.

The user can recognize the operation state of the scanner 510 or the data processing device 520 at a remote place using the remote control mode screen outputted through the display 525, and can remotely control the data processing device 520 according thereto.

The video processing unit 526 may perform operations for generating and/or processing images. Specifically, the image processing section 526 may receive raw data acquired from the scanner 510 and generate a three-dimensional virtual model from the received data.

Memory 522 may store at least one instruction. In addition, the memory 522 may store instructions for at least one of the processor's execution. In addition, the memory may store at least one program executed by the processor 521. In addition, the memory 522 may store data received from the scanner 510 (e.g., raw data acquired by oral scanning, etc.). Alternatively, the memory may store three-dimensional oral images of the oral cavity. According to an embodiment, the memory 522 may include one or more instructions for acquiring a three-dimensional oral model from two-dimensional image data.

The processor 521 executes instructions stored in at least one of the memories 522 to control the execution of desired actions. Wherein at least one instruction may be stored in an internal memory included in the processor 521 or a memory 522 included in a data processing device separate from the processor 521.

In an embodiment, the processor 521 may send control signals to the scanner 510 by executing one or more instructions stored in the memory 522, thereby controlling the scanner 510 according to the control signals. The processor 521 may be responsive to a remote control mode screen output through the display 525 to act according to a control signal input by a user through the scanner 510.

In an embodiment, the processor 521 may control the display 525 according to a control signal from the scanner 510 to cause the display 525 to output a remote control mode screen.

In an embodiment, the processor 521 may output a remote scan data viewing screen, which may control the three-dimensional scan data, through the display 525 according to a control signal from the scanner 510.

In an embodiment, the processor 521 may receive a selection of a control type for the three-dimensional scan data based on a control signal from the scanner 510.

In an embodiment, the processor 521 may rotate or move the three-dimensional scan data included in the remote scan data viewing screen or change its size according to a control signal from the scanner 510.

In an embodiment, the processor 521 may output a remote scan data viewing screen before the three-dimensional scan data is controlled through the display 525 according to a control signal from the scanner 510.

According to an embodiment, the actions of the processor 521 to perform "extract", "acquire", "generate", and the like may include not only a case where the processor 521 executes one or more instructions to directly perform the above actions, but also a case where other constituent elements are controlled so as to perform the above actions.

To implement the embodiments described in the present disclosure, the scanner 510 and the data processing device 520 may include only a part of the constituent elements shown in fig. 5, or may include more constituent elements than those shown in fig. 5.

In addition, the data processing device 520 may store and execute specialized software that is in linkage with the scanner 510. Where the specialized software may be referred to as a specialized program, specialized tool, or specialized application. When the data processing device 520 and the scanner 510 are interlocked and operated, dedicated software stored in the data processing device 520 may be connected to the scanner 510 to receive data acquired through oral scanning in real time.

In addition, dedicated software may transceive control signals with scanner 510 and also perform actions for at least one of acquiring, processing, storing, and/or transmitting an oral image. Wherein the dedicated software may be stored in the processor. In addition, dedicated software may provide a remote control mode screen. Among them, according to the disclosed embodiment, the remote control mode screen provided by the dedicated software may include a screen for selecting a control signal or a screen for outputting a live view image and/or three-dimensional scan data acquired by the scanner 510.

In an embodiment, the data processing apparatus may be operated in a remote control mode.

In an embodiment, the data processing device may act in a remote control mode based on user input through control buttons provided to the scanner. Alternatively, in an embodiment, the data processing apparatus may operate in the remote control mode based on selection of operation in the remote control mode through a user input provided to the data processing apparatus.

In an embodiment, the data processing apparatus may output a remote control mode screen during the operation in the remote control mode.

In an embodiment, the user may issue a command to start a scanning action using a scan button provided to the scanner during the operation of the data processing apparatus in the remote control mode. For example, while the scanner is operating in the standby mode, the user issues a command to start the scanning operation by clicking a scan button provided to the scanner.

The scanner may generate a control signal corresponding to a user command requesting to start a scanning action and transmit it to the data processing apparatus.

In addition, the scanner may operate in a scanning mode according to a user command requesting to start a scanning operation. The scanner may acquire a live view image by transmitting light to the subject body and receiving light reflected from the subject body using the camera. The scanner may transmit the live view image of the subject acquired using the camera to the data processing apparatus. In addition, the scanner may acquire raw data of the object body or three-dimensional data representing the shape of the object body and transmit it to the data processing apparatus.

In an embodiment, the data processing apparatus may output the remote scan screen in response to a control signal including a scan execution command when the control signal is received from the scanner during the operation in the remote control mode.

In the embodiment, the remote scan screen as one of remote control mode screens outputted during the operation of the data processing apparatus in the remote control mode may refer to a screen in which data acquired from a scanner operating in the scan mode is outputted in a large size so that a user can easily recognize.

In an embodiment, the data acquired from the scanner may include two-dimensional images and three-dimensional scan data of the subject body. That is, in an embodiment, the remote scanning screen may include a two-dimensional image of the subject body, i.e., a live view image, acquired by the scanner in real time with respect to the subject body. In addition, in an embodiment, the remote scan screen may include three-dimensional scan data acquired based on raw data acquired by a scanner.

Referring to fig. 6, fig. 6 (a) and 6 (b) are diagrams showing remote scanning screens.

In an embodiment, as shown in fig. 6 (a), the data processing apparatus may output the three-dimensional scan data 613 and the live view image 615 to one remote scan screen 610 at the same time. In the three-dimensional scan data 613, an area of the object body on which the scanner is currently performing scanning may be displayed in a frame shape or the like. The region of the subject body in which the scanner is currently performing scanning may be the same as the region displayed as the live view image 615.

In an embodiment, the live view image 615 and the three-dimensional scan data 613 included in the remote scan screen 610 may be resized. The user can operate the data processing apparatus in advance to set the size of the live view image included in the remote scanning screen to a desired size. As the size of the live view image increases, the size of the three-dimensional scan data may relatively decrease. Therefore, the user can set the size of the live view image in the remote scan screen so that the size of the live view image is within a prescribed range. For example, the user can adjust the size of the live view image to a desired size in the range of 1/4 to 1/2 of the lateral and longitudinal lengths of the remote control mode screen.

When the size of the live view image is adjusted, the position and size of the three-dimensional scan data included in the remote scan screen are also adjusted accordingly. For example, in the remote scan screen, the center of the three-dimensional scan data is located at the center of the other lateral length than the lateral length of the live view image, and the three-dimensional scan data is adjusted to a size that does not overlap with the live view image.

In an embodiment, as shown in fig. 6 (b), the remote scan screen output by the data processing apparatus may also be output through the window 620 and the window 630. The data processing apparatus may output the three-dimensional scan data 613 and the live view image 615 through the window 620 and the window 630, respectively.

Alternatively, in an embodiment, although not shown in fig. 6, the remote scan screen output by the data processing apparatus may also be output through two monitors. For example, when the data processing apparatus has dual monitors, the data processing apparatus may also output three-dimensional scan data through one monitor and output a live view image through the other monitor.

The user can set in advance whether to output the remote scanning screen in one window, the remote scanning screen in two windows, or the three-dimensional scanning data and the live view image through separate monitors using the dual monitor.

Since the remote scan screen does not include a menu bar or the like for scan data editing, three-dimensional scan data of a large size and a live view image can be included. Therefore, even when the user performs scanning at a position remote from the data processing apparatus, the user can view the live view image in a large size through the remote scanning screen output by the data processing apparatus, so that it is possible to easily identify which portion of the object the current user scanned position is. In addition, since the user can view the three-dimensional scan data in a large size through the remote scan screen, it is possible to easily confirm whether or not the scanning operation with respect to the object is performed smoothly.

In an embodiment, the data processing apparatus may receive a scan end command from the user in outputting the remote scan screen. For example, the data processing device may receive a control signal from the scanner requesting the end of the scan. During the operation of the scanner in the scanning mode, the user selects a scanning button provided in the scanner to input a user command for ending the scanning.

In an embodiment, the data processing apparatus may output the remote scan data viewing screen in response to receiving the scan end command.

In an embodiment, the remote scan data viewing screen as one of remote control mode screens output during the data processing apparatus operating in the remote control mode may refer to a screen output in response to the scanner operating in the standby mode.

During the operation of the data processing apparatus in the remote control mode, when the scanning operation is ended, a remote scanning data viewing screen may be output so as to provide the user with more detailed three-dimensional scanning data.

Fig. 7 is a diagram showing a remote scan data view screen 710. Referring to fig. 7, it can be seen that the remote scan data viewing screen 710 includes three-dimensional scan data 730 in a large size at the center of the screen.

In an embodiment, unlike the remote scan screen, the remote scan data viewing screen 710 may not include a live view image but include only three-dimensional scan data 730. Accordingly, the three-dimensional scan data 730 included in the remote scan data viewing screen 710 is located at the center of the screen, and may be output in a size larger than the three-dimensional scan data included in the remote scan screen.

The user can check the screen 710 using the remote scan data to confirm whether the scan is performed smoothly. More specifically, the user can view the three-dimensional scan data 730 in detail by controlling the three-dimensional scan data 730 included in the remote scan data viewing screen 710 using the scanner.

For a user to control three-dimensional scan data using a scanner, description will be made with reference to fig. 8.

The scanner 300 shown in fig. 8 is the same as the scanner 300 shown in fig. 3, and therefore the same reference numerals are given thereto. Hereinafter, description of the contents overlapping with those described in fig. 3 will be omitted.

During operation of scanner 300 in the scan mode, the user may end the scan operation by selecting scan button 310.

In an embodiment, the data processing apparatus may output the remote scan data viewing screen when the scan operation is ended during the operation in the remote control mode. The remote scan data viewing screen may include three-dimensional scan data in a scan end state.

In an embodiment, when the data processing apparatus outputs the remote scan data viewing screen, the user may select a control type for the three-dimensional scan data included in the remote scan data viewing screen. For example, the user may select a control type for the three-dimensional scan data by selecting the middle key 325 among the plurality of keys included in the control button 320.

In an embodiment, the control type for the three-dimensional scan data included in the remote scan data viewing screen may include at least one of movement of the three-dimensional scan data, rotation of the three-dimensional scan data, and size change of the three-dimensional scan data.

In an embodiment, the remote scan data view screen may include information regarding the type of control that a user may control using scanner 300.

In an embodiment, in response to the data processing apparatus outputting the remote scan data viewing screen, the data processing apparatus may change the control type for the three-dimensional scan data included in the remote scan data viewing screen each time the user inputs the middle key 325 provided to the control button 320 of the scanner 300. The user may select a desired control type by inputting the middle key 325 of the control button 320 a prescribed number of times.

Fig. 8 (a) is a diagram showing movement of the three-dimensional scan data 811 according to user input when the control type for the three-dimensional scan data 811 is Pan (Pan), according to an embodiment.

Referring to fig. 8 (a), the remote scan data viewing screen 810 may include control type information 812 indicating that the control type for the three-dimensional scan data 811 is a pan. The user can learn that the control type is movement of the three-dimensional scan data 811 using the control type information 812.

The data processing apparatus may output a screen in which the three-dimensional scan data 811 moves rightward, leftward, upward, or downward from the current position in response to the user inputting four direction keys 321, 322, 323, 324 included in the control button 320 of the scanner 300. For example, when the user selects the right direction key 324 of the four direction keys 321, 322, 323, 324 while viewing the remote scan data viewing screen 810 on the left side of fig. 8 (a), the data processing apparatus may output the remote scan data viewing screen 815 including the three-dimensional scan data 813 that moves more rightward than the original position as shown on the right side of fig. 8 (a).

When the user presses the right direction key 324 a plurality of times, the data processing apparatus may output a screen on which the three-dimensional scan data 813 continues to move to the right. When the user continues to press the right direction key 324, the data processing apparatus may output a screen on which the three-dimensional scan data 813 continues to move to the right until it is no longer possible to move to the right.

In an embodiment, in a state where the data processing apparatus outputs the remote scan data viewing screen 810 shown in the left side of fig. 8 (a), when the user changes the control type for the three-dimensional scan data 811 from panning to rotating (Rotate) by selecting the middle key 325 provided to the control button 320 of the scanner 300, the data processing apparatus may output the remote scan data viewing screen 820 shown in fig. 8 (b).

Fig. 8 (b) is a diagram showing that the three-dimensional scan data 821 is rotated according to user input when the control type for the three-dimensional scan data 821 is rotation according to the embodiment.

Referring to fig. 8 (b), the remote scan data viewing screen 820 may include control type information 822 indicating that the control type for the three-dimensional scan data 821 is rotation.

The data processing apparatus may output a screen in which the three-dimensional scan data 821 is rotated right, left, up, or down in response to a user inputting four direction keys 321, 322, 323, 324 included in the control button 320 of the scanner 300. For example, when the user selects the right direction key 324 of the four direction keys 321, 322, 323, 324 while viewing the remote scan data viewing screen 820 on the left side of fig. 8 (b), as the remote scan data viewing screen 825 shown on the right side of fig. 8 (b), the data processing apparatus may output the remote scan data viewing screen 825 including the three-dimensional scan data 823 rotated more rightward than the original direction.

In an embodiment, in a case where the user selects the middle key 325 provided to the control button 320 of the scanner 300 in a process in which the data processing apparatus outputs the remote scan data viewing screen 820 shown in the left side of fig. 8 (b), the control type for the three-dimensional scan data 821 is changed from rotation to Zoom (Zoom), and the data processing apparatus may output the remote scan data viewing screen 830 shown in fig. 8 (c).

Fig. 8 (c) is a diagram for explaining that the three-dimensional scan data 831 is enlarged or reduced according to user input when the control type for the three-dimensional scan data 831 is zoom according to the embodiment.

Referring to fig. 8 (c), the remote scan data viewing screen 830 may include control type information 832 indicating that the control type for the three-dimensional scan data 831 is scaled.

The data processing apparatus may further enlarge or further reduce the three-dimensional scan data 831 and then output the same in response to a user selecting the upper direction key 321 or the lower direction key 323 of the four direction keys 321, 322, 323, 324 included in the control button 320 of the scanner 300. For example, when the data processing apparatus outputs the remote scan data viewing screen 830 of the left side of fig. 8 (c), in the case where the user selects the up direction key 321 of the four direction keys 321, 322, 323, 324, as shown on the right side of fig. 8 (c), the data processing apparatus may output the remote scan data viewing screen 835 including the three-dimensional scan data 833 which is more enlarged than the original size.

In an embodiment, after controlling the three-dimensional scan data included in the remote scan data viewing screen according to the control of the user, the user may cause the data processing apparatus to output the remote scan data viewing screen again before the three-dimensional scan data is controlled by inputting the middle key 325 included in the control button 320 of the scanner 300 a prescribed number of times.

For example, in the case where the user double-clicks the middle key 325 included in the control button 320 of the scanner 300 after selecting the right direction key 324 of the four direction keys 321, 322, 323, 324 while viewing the remote scan data viewing screen 810 on the left side of fig. 8 (a) to cause the data processing apparatus to output the remote scan data viewing screen 815 including the three-dimensional scan data 813 moved more rightward than the original position as shown on the right side of fig. 8 (a), the data processing apparatus may output the remote scan data viewing screen 810 on the left side of fig. 8 (a) again with the three-dimensional scan data 811 located at the original position before being controlled, that is, in the center of the screen.

In an embodiment, the data processing apparatus may output a screen in which the three-dimensional scan data 811 is controlled in response to the user inputting four direction keys 321, 322, 323, 324 included in the control button 320 of the scanner 300, and then output a remote scan screen previously output and then suspended again in response to the user inputting the scan button 310 of the scanner 300. That is, the data processing apparatus may output the previously output remote scan screen again at a point of time when the remote scan screen is output in response to the user performing the scan action using the scanner 300 and then the scan action is stopped in response to the user's scan suspension command. The re-outputted remote scan screen may include both three-dimensional scan data and a live view image. The user can continue the scanning operation previously stopped while viewing the remote scanning screen output by the data processing apparatus.

In an embodiment, the data processing apparatus may use a virtual camera to generate a screen in which three-dimensional scan data included in the remote scan data viewing screen is controlled.

In an embodiment, the virtual camera may act in response to a control type and user input to four directional keys provided to a control button of the scanner.

In an embodiment, the virtual camera may acquire an image of three-dimensional scan data by photographing three-dimensional scan data captured at a position of the camera while rotating or moving or enlarging or reducing the three-dimensional scan data according to a control type and a user input to a control button.

In an embodiment, the data processing apparatus may output an image of the three-dimensional scan data acquired through the virtual camera by remotely scanning the data viewing screen, thereby generating a screen controlling the three-dimensional scan data.

For example, assume that the data processing apparatus outputs a remote scan data viewing screen and the control type is movement. The user can move the three-dimensional scan data in up, down, left, and right directions by inputting a key in a desired direction among four direction keys provided to a control button of the scanner while viewing a remote scan data viewing screen output to the data processing apparatus. At this time, it appears to the user that the three-dimensional scan data is moved according to the input of the four direction keys of the control button, but actually, not the three-dimensional scan data but a virtual camera that captures the three-dimensional scan data may be moving.

In an embodiment, the virtual camera may be moved in a virtual coordinate system based on user input through the scanner. The virtual camera may acquire an image of the three-dimensional scan data by photographing right, left, upper, lower, etc. sides of the fixed three-dimensional scan data while moving in the virtual coordinate system. For example, when the user inputs the right direction key of the four direction keys, the virtual camera may capture three-dimensional scan data while the virtual coordinate system is moved to the left to acquire an image of the three-dimensional scan data. The data processing device can view the picture through the remote scanning data, and output the image of the three-dimensional scanning data acquired while the virtual camera moves leftwards. In this case, it appears to the user that the three-dimensional scan data moves to the right in response to the input of the right direction key of the four direction keys.

For example, assume that the data processing apparatus outputs a remote scan data viewing screen, the control type is rotation, and the user rotates three-dimensional scan data using four direction keys of the control buttons.

In an embodiment, the virtual camera may rotate in a virtual coordinate system in response to user input using the scanner.

The virtual camera may acquire a rotated image of the three-dimensional scan data by photographing the front, side, back, top, bottom, etc. of the fixed three-dimensional scan data while rotating in the virtual coordinate system. The data processing device can view the picture through the remote scanning data and output the image of the three-dimensional scanning data acquired by the virtual camera. In this case, it appears to the user that the three-dimensional scan data is rotated according to the input of the four direction keys of the control button, but in reality, the three-dimensional scan data is not being rotated, but the virtual camera that captures the three-dimensional scan data is rotated in the opposite direction to the input of the four direction keys.

Fig. 9 is a diagram for comparing and explaining an image of three-dimensional scan data acquired using a virtual camera and an image of three-dimensional scan data output through a screen of the data processing apparatus.

In the diagram shown on the left side of fig. 9 (a), a bounding box 915 surrounding the three-dimensional scan data 910 is shown. The bounding box 915 may be a virtual box generated according to the size of the three-dimensional scan data 910, and may be a box having a size corresponding to the length in the X-axis, the length in the Y-axis, and the length in the Z-axis of the three-dimensional scan data 910. For example, the bounding box 915 may be a hexahedral box having the same length as the maximum length in the X-axis, Y-axis, Z-axis of the three-dimensional scan data 910 as the edges of the X-axis, Y-axis, Z-axis.

The center of the three-dimensional scan data 910 may be the center of the bounding box 915. When the control type is rotation and the user performs user input for rotating three-dimensional scan data using four direction keys provided to a control button of the scanner, the scanner may generate a remote control signal for rotating three-dimensional scan data and transmit it to the data processing apparatus. The data processing device can control the virtual camera according to the remote control signal. The data processing apparatus may cause the virtual camera to capture the three-dimensional scan data 910 while rotating the outside of a virtual sphere (sphere) created by connecting the bounding box 915 with the center of the bounding box 915 as a reference.

In an embodiment, when there are a plurality of spaced three-dimensional scan data, the bounding box may be a box that entirely includes the plurality of three-dimensional scan data and has a hexahedral shape of a minimum length surrounding the plurality of three-dimensional scan data. The virtual camera may be rotated outside the bounding box with a center point of one of the plurality of three-dimensional scan data as a reference, and simultaneously capture the plurality of three-dimensional scan data.

Fig. 9 (a), 9 (b), and 9 (c) are diagrams for explaining three-dimensional scan data captured by a virtual camera in a virtual coordinate system. The three-dimensional scan data 910 is fixed, and the virtual camera can be made to shoot the three-dimensional scan data 910 while being operated. In the diagrams shown on the left side of fig. 9 (a), 9 (b), 9 (c), the first box 920 may represent a virtual area captured by the lens of the virtual camera.

The diagram shown on the left side of fig. 9 (a) shows a composition of the front face of the virtual camera capturing three-dimensional scan data. The diagram shown on the left side of fig. 9 (b) shows a composition when the virtual camera photographs three-dimensional scan data in a state where the camera lens is tilted to the lower right of the three-dimensional scan data. The diagram shown on the left side of fig. 9 (c) shows a composition when the virtual camera photographs three-dimensional scan data in a state where the lens is tilted to the lower left of the three-dimensional scan data.

The diagrams shown on the right side of fig. 9 (a), 9 (b), and 9 (c) are diagrams showing three-dimensional scan data output from the data processing apparatus. In the diagrams shown on the right side of fig. 9 (a), 9 (b), 9 (c), a second frame 930 surrounding the three-dimensional scan data 910 may represent an output area output by a display of the data processing apparatus. Since the user views the output area outputted from the data processing apparatus, the three-dimensional scan data 910 is recognized to operate as shown on the right side of fig. 9 (a), 9 (b), and 9 (c).

The data processing device can adjust the three-dimensional scanning data acquired by the virtual camera and output the three-dimensional scanning data in a matching mode with the picture of the data processing device. The data processing apparatus may adjust and output the area captured by the lens of the virtual camera, i.e., the direction or angle, position, etc., of the first frame 920, in match with the second frame 930, which is the output area of the display of the data processing apparatus. More specifically, as shown in the left side of fig. 9 (a), 9 (b), 9 (c), the data processing apparatus may match coordinate values on the X, Y, Z axis of the three-dimensional scan data 910 included in the virtual first frame 920 with coordinate values on the X ', Y ', Z ' axis of the second frame 930 output through the display of the data processing apparatus, and output the three-dimensional scan data through the display.

At this time, the three-dimensional scan data outputted through the screen of the data processing apparatus appears to be in reverse motion opposite to the motion of the virtual camera. That is, it appears to the user that the three-dimensional scan data is inclined downward and leftward as shown on the right side of fig. 9 (b), and that the three-dimensional scan data is inclined downward and rightward as shown on the right side of fig. 9 (c).

In an embodiment, during the operation of the data processing apparatus in the remote control mode, input is made in response to a user pressing a middle key of a control button provided to the scanner for a long time, and as shown in fig. 10, a screen 1010 of accessible control settings may be output.

In an embodiment, the screen 1010 in which the control settings can be accessed may be one of remote control mode screens, including various setting information. The setting information may include at least one of setting information 1011 for instructing the data processing apparatus to switch to the basic mode to perform an operation, setting information 1013 for canceling a current screen, exiting the current screen and returning to a screen output before, and option setting information 1015 for changing a setting value related to a scanner or scanning, data processing, or the like.

The user can move to desired setting information among setting information included in the screen 1010 of the accessible control setting using four direction keys provided to a control button of the scanner in response to the screen 1010 of the data processing apparatus outputting the accessible control setting. The user can select desired setting information by inputting an intermediate key provided to a control button of the scanner. The data processing apparatus may act in response to the setting information selected by the user, or output a screen according to the setting information selected by the user.

In an embodiment, the data processing apparatus may output the option setting information screen 1110 shown in fig. 11 (a) in response to the user selecting the option setting information 1015 in the screen 1010 of the accessible control settings shown in fig. 10.

In an embodiment, the option setting information screen 1110 may be one of remote control mode screens, including items in which options can be set. The item of settable options may be included in the option setting information screen 1110 in the form of an image of a large-sized font or icon or the like. Therefore, the user can also view the option setting information screen 1110 of the screen output to the data processing apparatus at a location remote from the data processing apparatus, and easily select a desired item using the scanner.

In an embodiment, the items included in the option setting information screen 1110 may include at least one item of a scan option, a scanner option, a data option, and other jog options.

In an embodiment, the option setting information picture 1110 may further include three-dimensional scan data obtained based on raw data acquired by a scanner performing a scanning action in a part of the picture, but is not limited thereto.

The user can move to a desired item or select a desired item among items included in the option setting information screen 1110 using four direction keys and an intermediate key provided to a control button of the scanner.

Fig. 11 (b) is a diagram showing a scan option setting information screen 1120 that is output when a scan option item among items included in the option setting information screen 1110 is selected.

The scan option setting information screen 1120 may include an item for setting various options related to scanning. For example, the Scan option setting information screen 1120 may include an intelligent Scan filter (Smart Scan Filtering) item, an intelligent color filter (Smart Color Filtering) item, a high resolution Scan (HD Scan), a Metal Scan (Metal Scan), and the like. However, the items included in the scan option setting information screen 1120 are one example, and the scan option setting information screen 1120 may include other items than the above items or exclude a part of the above items.

In an embodiment, the intelligent scan filter item may be an item for automatically deleting soft tissue that is not needed in the scan. When a user makes a setting to apply the intelligent scanning filter item, the data processing apparatus may automatically remove soft tissue during execution of the scanning action.

In an embodiment, the intelligent color filter item may be an item for filtering a particular color during a scan. When a user makes settings to apply intelligent color scan filter items, the data processing apparatus may filter and remove specific colors during execution of the scan action.

In an embodiment, the high resolution scan item may be an item for collecting high resolution scan data for all or a specific region. The data processing apparatus may collect and output high-resolution scan data when a user makes a setting to apply a high-resolution scan item.

In an embodiment, the metal scan item may be an item for automatically sensing and processing a metal surface. The data processing apparatus may sense and process the metal surface when a user makes a setting to apply the metal scan item.

Fig. 11 (c) is a diagram showing a scanner option setting information screen 1130 that is output when a scanner option item among items included in the option setting information screen 1110 is selected.

The scanner option setting information screen 1130 may include items for setting various options related to the scanner. For example, the scanner option setting information screen 1130 may include a scan depth item, a scan illumination item, and the like.

In an embodiment, the scan depth item is an item for setting a scan depth, which a user can set to one of, for example, 12mm, 15mm, 18mm, and 21 mm.

In an embodiment, the scanning illumination item may be an item for changing an illumination color of the scanner. The user may set the scanning illumination item to one of blue light and white light according to the object body.

Although not shown in fig. 11, in an embodiment, when the user selects a data option item among items included in the option setting information screen 1110, the data processing apparatus may output a screen including various options related to data processing, such as a texture display mode of data, data deletion, scan data alignment and noise deletion, other multi-bite related items, and the like.

In an embodiment, when the user selects a click option item among items included in the option setting information screen 1110, the data processing apparatus may output a screen including an item or the like for changing the sensitivity of the data control or the resolution of the remote control mode screen.

In an embodiment, the remote scanning step selection screen may refer to a screen for selecting and/or changing a scanning mode.

In an embodiment, the scan mode is information for the scanner to identify the object to be scanned, and may be one of an upper jaw scan mode, a lower jaw scan mode, and a bite scan mode.

In an embodiment, the user may change the scanning mode when the data processing apparatus is operated in the remote control mode. For example, the user can input by pressing a scan button provided to the scanner for a long time to change the scan mode.

In an embodiment, the data processing apparatus may output the remote scanning step selection screen 1210 in response to a user's long-pressing of the scan button for input.

In an embodiment, the remote scanning step selection screen 1210 may include at least one of a previous step scanning mode 1211, a current scanning mode 1213, and a next step scanning mode 1215.

For example, when the user wants to scan the chin after performing the upper jaw scan, the user can press the scan button input for a long time to output the remote scan step selection screen 1210. The user can check the remote scanning step selection screen 1210 and confirm the current scanning step, or can change the scanning mode to the chin scanning mode by inputting four direction keys and an intermediate key provided to a control button of the scanner.

In an embodiment, the data processing apparatus may complete a scanning action according to a current scanning mode (e.g., an upper jaw scanning mode) in response to receiving a control signal requesting a change of a scanning step from a user in outputting the remote scanning step selection screen 1210, to perform post-processing of the scanning data acquired in the current scanning mode, and generate the scanning data of the lower jaw based on the raw data received later through the scanner.

Therefore, according to the embodiment, when the user wants to perform scanning in a prescribed scanning mode and then end the scanning of the scanning mode, and perform scanning according to the scanning mode of the next step, the scanning mode can be easily changed using the scanning button and the control button provided to the scanner.

In an embodiment, scanner 1310 may receive a remote control mode selection from a user (step 1311). For example, the scanner 1310 may receive input from a user for selecting a control button once while operating in a standby mode. The scanner 1310 may send a control signal including a command corresponding to a user input to the control button to the data processing apparatus 1320.

In an embodiment, the data processing device 1320 may act in a remote control mode based on control signals received from the scanner 1310. In an embodiment, the data processing apparatus 1320 may output the remote control mode screen during the operation in the remote control mode (step 1321). In an embodiment, the remote control mode screen is a screen controllable using the scanner 1310, and may refer to a screen different from a basic mode screen normally output by the data processing apparatus 1320 in at least one of a coordinate system, an output data type, and an output data size.

In an embodiment, during operation of the data processing apparatus 1320 in the remote control mode, the scanner 1310 may receive a scan execution command from a user (step 1313). For example, scanner 1310 may receive user input for a scan button from a user. Scanner 1310 may perform a scanning action in response to a user selecting a scan button. Further, the scanner 1310 may transmit a control signal corresponding to a user input to the scan button to the data processing apparatus 1320.

In an embodiment, the data processing apparatus 1320 outputs a remote scan screen in response to receiving a control signal to perform scanning from the scanner 1310 during an operation in the remote control mode (step 1323). In an embodiment, the remote scan screen is one of remote control mode screens output during the operation of the data processing apparatus 1320 in the remote control mode, and may refer to a screen for outputting three-dimensional scan data in a large size and for an image of a subject acquired from the scanner 1310 operating in the scan mode so that a user can easily recognize.

The user can perform a scanning action using the scanner 1310 while viewing a remote scanning screen output by the data processing apparatus 1320.

When the user wants to end the scanning operation during the operation of the scanner 1310 in the scanning mode, the scan button provided to the scanner 1310 may be selected again. Scanner 1310 may receive a scan end command from a user (step 1315). Scanner 1310 may end the scanning action and change from scan mode to standby mode in response to receiving a user input for a scan button. Further, the scanner 1310 may transmit a control signal corresponding to a user input to the scan button to the data processing apparatus 1320.

In an embodiment, the data processing apparatus 1320 may output a remote scan data view screen based on the control signal received from the scanner 1310 (step 1325). In an embodiment, the remote scan data view screen is one of remote control mode screens output during the operation of the data processing apparatus 1320 in the remote control mode, and may be a screen output during the operation of the scanner 1310 in the standby mode in order to provide the user with larger and more detailed three-dimensional scan data.

Referring to fig. 14, the data processing apparatus 1420 may output a remote scan data view screen in response to the scanner 1410 changing from the scan mode to the standby mode during the remote control mode operation (step 1421). In an embodiment, the remote scan data viewing screen may include three-dimensional scan data in a large size in the center of the screen, without including a live view image.

In an embodiment, the user may select a control type using the scanner 1410 in response to the data processing apparatus 1420 outputting a remote scan data view screen (step 1411). The control type may refer to a method of controlling the remote scan data to view the three-dimensional scan data included in the screen. The control type may include at least one of movement, rotation, enlargement or reduction of the three-dimensional scan data, and the like. The user can select a method of controlling three-dimensional scan data included in the remote scan data viewing screen by inputting an intermediate key of a control button provided to the scanner 1410.

In an embodiment, the control type may be changed when the data processing apparatus 1420 receives a control signal corresponding to a control button from the scanner 1410 in outputting a remote scan data viewing screen. The control type may be displayed included in a remote scan data viewing screen. The user may input control buttons provided to the scanner 1410 until a desired control type is displayed on the remote scan data viewing screen.

In an embodiment, the data processing apparatus 1420 may output a remote scan data view screen on which the selected control type is displayed (step 1423).

In an embodiment, the user may issue a three-dimensional scan data control command to the scanner 1410 by inputting four direction keys provided to control buttons of the scanner 1410 (step 1413). The scanner 1410 may cause the data processing apparatus 1420 to output a screen in which three-dimensional scan data is controlled according to a control type and four direction key inputs by transmitting a control signal corresponding to a three-dimensional scan data control command to the data processing apparatus 1420 (step 1425).

In an embodiment, the user may issue a command requesting to output a screen before control by inputting a middle key provided to a control button of the scanner 1410 a prescribed number of times (step 1415). The data processing apparatus 1420 may output a remote scan data viewing screen before the three-dimensional scan data is controlled upon receiving a control signal requesting the screen before the output control from the scanner 1410 (step 1427).

Referring to fig. 15, a user can change a scan mode using a scan button provided to the scanner 1510. For example, when the user presses the scan button input for a long time, the scanner 1510 may issue a command requesting to output a menu screen for selecting a scan step according to the user input (step 1511). In an embodiment, the data processing device 1520 may output a remote scanning step selection screen according to a control signal from the scanner 1510 (step 1521).

The user may input four direction keys and a middle key of a control button provided to the scanner 1510 in response to the data processing apparatus 1520 outputting a remote scanning step selection screen. The scanner 1510 may generate control signals based on these user inputs and issue a scan step selection command by sending the control signals to the data processing device 1520 (step 1513).

In an embodiment, the data processing device 1520 may complete the scan according to the current scan mode in response to receiving a command from the scanner 1510 requesting a change of the scan step, and change the scan step by the scan mode selected by the user (step 1523).

Referring to fig. 16, the data processing apparatus may receive a user input requesting to act in a remote control mode (step 1610).

For example, a control signal corresponding to a user input to a control button provided to the scanner may be received while the scanner is operating in the standby mode. The control signal corresponding to the user input to the control button provided to the scanner may include a remote control signal. The remote control signal may include a signal for changing the display of the three-dimensional scan data. In addition, the remote control signal may include a signal indicating that the remote control mode screen is output. The data processing device can operate in a remote control mode according to the control signal.

Alternatively, the data processing apparatus may receive a direct user selection to operate in the remote control mode via a user input section provided to the data processing apparatus, for example, a mouse, a keyboard, or the like.

The data processing apparatus may act in the remote control mode in response to receiving a user input requesting to act in the remote control mode (step 1620).

In an embodiment, the data processing apparatus may output the remote control mode screen during the remote control mode action. The user can easily remotely control the data processing apparatus by viewing a remote control mode screen output to the data processing apparatus at a position remote from the data processing apparatus and performing user input through the scanner.

The data processing method according to an embodiment of the present disclosure may be implemented in the form of program commands that can be executed by various computer devices, and may be recorded in a computer-readable medium. In addition, an embodiment of the present disclosure may be a computer-readable storage medium having recorded thereon one or more programs including at least one instruction to perform a data processing method.

In addition, the data processing method according to the embodiment of the present disclosure described may be implemented as a computer program product including a computer-readable recording medium recorded with a program for implementing the data processing method, the data processing method including the steps of: displaying three-dimensional scan data and changing the display of the three-dimensional scan data in response to a remote control signal received from a scanner; the remote control signal includes a signal for controlling a virtual camera for acquiring an image of the three-dimensional scan data.

The computer readable storage medium may include program commands, data files, data structures, etc. alone or in combination. Examples of the computer readable storage medium include magnetic media (such as hard disk, floppy disk, and magnetic tape), optical recording media (such as CD-ROM, DVD), and magneto-optical media (such as floppy disk, and hardware devices configured to store and execute program commands, such as read-only memory (ROM), random Access Memory (RAM), and flash memory.

Wherein the machine-readable storage medium may be provided in the form of a non-transitory (non-transitory) storage medium. Where "non-transitory storage medium" means that the storage medium is a real (tangible) device. In addition, a "non-transitory storage medium" may include a buffer that temporarily stores data.

While the embodiments have been described in detail, the scope of the invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concepts of the invention as defined in the claims are also within the scope of the invention.

Claims

1. A data processing method, comprising the steps of:

displaying three-dimensional scan data, and

changing a display of the three-dimensional scan data in response to a remote control signal received from a scanner;

the remote control signal includes a signal for controlling a virtual camera for acquiring an image of the three-dimensional scan data.

2. The data processing method according to claim 1, wherein,

the remote control signal further includes a signal indicating that a remote control mode screen is output.

3. The data processing method according to claim 2, further comprising the step of:

A remote scan screen is output in response to receiving a scan start signal from the scanner.

4. A data processing method according to claim 3, wherein,

the remote scan screen includes the three-dimensional scan data and a live view image,

the live view image is a two-dimensional image of the subject acquired by the scanner.

5. The data processing method according to claim 1, further comprising the step of:

receiving the remote control signal from the scanner;

the step of receiving the remote control signal from the scanner comprises the steps of: a user input signal for selecting a control button provided to the scanner is received as the remote control signal.

6. The data processing method according to claim 2, wherein,

the remote control mode screen and the basic mode screen are different from each other in at least one of a coordinate system, an output data type, and an output data size.

7. The data processing method according to claim 2, further comprising the step of:

receiving a signal for indicating to output a basic mode picture;

the step of receiving a signal for instructing to output the basic mode picture includes receiving at least one of a user input signal for selecting to output the basic mode picture in a menu output to the remote control mode picture through a control button provided to the scanner in outputting the remote control mode picture and an input section of the data processing apparatus sensing the input signal.

8. The data processing method according to claim 2, further comprising the step of:

outputting a remote scanning step selection screen in response to receiving a user input signal from the scanner, the user input signal being input by pressing a scan button provided to the scanner for a long time, and

changing a scanning step according to a user input signal inputted through a control button provided to the scanner;

the step of altering the scanning step comprises the steps of: the data generated in the previous scanning step is completed.

9. The data processing method according to claim 2, further comprising the step of:

a remote scan data view screen is output in response to receiving a scan end signal from the scanner.

10. The data processing method according to claim 9, further comprising the step of:

receiving a user input signal from the scanner, the user input signal for selecting a control type for the three-dimensional scan data included in the remote scan data view screen;

the control type for the three-dimensional scan data includes at least one of movement, rotation, and size change of the three-dimensional scan data.

11. The data processing method according to claim 1, wherein,

the signals for controlling the virtual camera include signals according to the selected control type and inputs of control buttons provided to the scanner,

the step of changing the display of the three-dimensional scan data includes the steps of: capturing the three-dimensional scan data with the virtual camera controlled according to a signal for controlling the virtual camera, and outputting the acquired image.

12. A data processing apparatus, comprising:

a display;

a communication part for transmitting and receiving information with the scanner, and

a processor executing one or more instructions;

the processor performs the following by executing the one or more instructions:

three-dimensional scan data is displayed by the display,

13. A scanner, comprising:

a communication unit for transmitting and receiving information to and from the data processing device,

user input part, and

A processor executing one or more instructions;

the processor executes the one or more instructions to transmit a remote control signal corresponding to the user input inputted through the user input unit to the data processing apparatus, thereby controlling the data processing apparatus to change the display of the three-dimensional scan data.