WO2022222385A1 - 一种触摸数据处理方法及交互平板 - Google Patents

一种触摸数据处理方法及交互平板 Download PDF

Info

Publication number
WO2022222385A1
WO2022222385A1 PCT/CN2021/122176 CN2021122176W WO2022222385A1 WO 2022222385 A1 WO2022222385 A1 WO 2022222385A1 CN 2021122176 W CN2021122176 W CN 2021122176W WO 2022222385 A1 WO2022222385 A1 WO 2022222385A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
infrared
elastic wave
processing device
touch data
Prior art date
Application number
PCT/CN2021/122176
Other languages
English (en)
French (fr)
Inventor
陈玉香
Original Assignee
广州创知科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110436301.9A external-priority patent/CN114692580A/zh
Priority claimed from CN202110436274.5A external-priority patent/CN114690853B/zh
Application filed by 广州创知科技有限公司 filed Critical 广州创知科技有限公司
Publication of WO2022222385A1 publication Critical patent/WO2022222385A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/169Annotation, e.g. comment data or footnotes

Definitions

  • the embodiments of the present disclosure relate to the technical field of electronic device control, and in particular, to a touch data processing method and an interactive tablet.
  • the infrared touch frame is an infrared touch sensor installed around the operation panel of the interactive tablet - infrared transmitter and infrared receiver
  • the touch operation on the operation panel is recognized by the infrared transmitter and the infrared receiver to identify the contact area, position, moving speed, etc. of the touch object on the operation panel, and the corresponding infrared touch data is obtained and sent to the interactive flat.
  • the interactive tablet performs corresponding operations according to the infrared touch data, for example, according to the movement track of the touch object, the corresponding writing track is displayed on the operation panel of the interactive tablet.
  • the response to the touch operation is basically only based on the specific input judgment of the touch track, such as track input based on the touch track or simple command reception.
  • the target control needs to be achieved according to the combination of multiple touch inputs. For example, for the writing process, when setting the display properties of the writing track, a more complex combination of touch operations is required to achieve the setting target, and the operation is relatively Cumbersome and less efficient.
  • Embodiments of the present disclosure provide a touch data processing method and an interactive tablet, so as to solve the technical problems in the prior art that the interactive tablet requires a complex combination of touch operations to achieve a setting target, the operations are cumbersome, and the efficiency is low.
  • an embodiment of the present disclosure provides a touch data processing method, applied to an interactive tablet, where the interactive tablet includes an operation panel, an infrared touch sensor, a first processing device, and a second processing device, the infrared touch A control sensor is arranged on at least one edge of the operation panel to form a touch detection area of the interactive tablet, the interactive tablet further includes an elastic wave sensor, and both the elastic wave sensor and the infrared touch sensor are connected to the The second processing device is connected, and the method includes:
  • the infrared touch sensor When the touch object performs a touch operation in the touch detection area, the infrared touch sensor starts to generate an infrared sensing signal from the first moment, and sends it to the second processing device;
  • the second processing device starts to acquire the elastic wave signal generated by the elastic wave sensor after the first time, the elastic wave signal is generated when the touch object contacts the operation panel;
  • the second processing device calculates and obtains the first infrared touch data corresponding to the first moment according to the infrared sensing signal, and determines the touch object corresponding to the first infrared touch data and the elastic wave signal according to the first infrared touch data and the elastic wave signal.
  • medium type wherein the first infrared touch data includes touch position information of the touch object;
  • the second processing device sends the second infrared touch data to the first processing device from a second time; wherein the second time is after the time when the elastic wave signal is received;
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the infrared touch sensor detects the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet, and after the first moment when the infrared sensing signal starts to be detected, the elastic wave sensor detects the The elastic wave signal generated when the touch object touches the operation panel, the medium type corresponding to the touch object is determined according to the first infrared touch data corresponding to the first moment and the elastic wave signal, and the medium type is determined by combining the elastic wave signal and the first infrared touch data , to improve the recognition accuracy of the touch object, and improve the recognition accuracy of the touch object.
  • the elastic wave signal collected by the elastic wave sensor is acquired, and the medium type is determined according to the elastic wave signal and the first infrared touch data, and the The media type is sent to the first processing device, so that starting from the second moment, after the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device, the first processing device can , different response operations are performed on the second infrared touch data, the response speed of the touch operation is improved, the operation is simple, and the efficiency is high.
  • an embodiment of the present disclosure provides a touch data processing method, which is applied to an interactive tablet, where the interactive tablet includes an operation panel, an infrared touch sensor, a first processing device, and a second processing device, the infrared touch A control sensor is arranged on at least one edge of the operation panel to form a touch detection area of the interactive tablet, the interactive tablet further includes an elastic wave detection device, the elastic wave detection device includes an elastic wave sensor, and the method includes :
  • the infrared touch sensor When the touch object performs a touch operation in the touch detection area of the interactive tablet, the infrared touch sensor starts to generate an infrared sensing signal from the first moment, and sends it to the second processing device;
  • the elastic wave detection device receives an elastic wave signal generated by the elastic wave sensor, and the elastic wave signal is generated when the touch object contacts the operation panel;
  • the second processing device calculates and obtains first infrared touch data corresponding to the first moment according to the infrared sensing signal; wherein, the first infrared touch data includes touch position information of the touch object;
  • the elastic wave detection device After receiving the first infrared touch data, the elastic wave detection device determines the medium type corresponding to the touch object according to the first infrared touch data and the elastic wave signal; wherein, the first infrared touch data is sent to the elastic wave detection device by the second processing device, or forwarded to the elastic wave detection device by the first processing device;
  • the elastic wave detection device sends medium type information to the first processing device, where the medium type information includes a medium type corresponding to the touch object;
  • the second processing device sends second infrared touch data to the first processing device from a second time; wherein the second time is after the first time;
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the infrared touch sensor detects the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet, and sends the infrared sensing signal to the first time after the infrared sensing signal is detected at the first moment.
  • the second processing device calculates the first infrared touch data sent to the elastic wave detection device according to the infrared sensing signal, detects the elastic wave signal generated when the touch object touches the operation panel through the elastic wave detection device, and according to the first The first infrared touch data corresponding to the moment and the elastic wave signal determine the medium type corresponding to the touch object, and by combining the elastic wave signal and the first infrared touch data to determine the medium type, the recognition accuracy of the touch object is improved, and the recognition accuracy of the touch object is improved. recognition accuracy.
  • the elastic wave detection device collects the elastic wave signal, judges the medium type according to the elastic wave signal and the first infrared touch data, and sends the medium type
  • the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device from the second moment
  • the first processing device can, according to different media types
  • the second infrared touch data performs different response operations, which improves the response speed of the touch operation, and has simple operation and high efficiency.
  • an embodiment of the present disclosure provides an interactive tablet including an operation panel, an infrared touch sensor, a first processing device, and a second processing device, wherein the infrared touch sensor is disposed on at least one of the operation panels an edge to form a touch detection area of the interactive tablet, the interactive tablet further includes an elastic wave sensor, and both the elastic wave sensor and the infrared touch sensor are connected to the second processing device;
  • the infrared touch sensor is used to generate an infrared sensing signal from the first moment when a touch object performs a touch operation in the touch detection area, and send it to the second processing device;
  • the second processing device configured to start to acquire the elastic wave signal generated by the elastic wave sensor after the first time, the elastic wave signal is generated when the touch object contacts the operation panel;
  • the medium type corresponding to the touch object is determined according to the first infrared touch data and the elastic wave signal, wherein, the first infrared touch data includes touch position information of the touch object;
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the infrared touch sensor detects the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet, and after the first moment when the infrared sensing signal starts to be detected, the elastic wave sensor detects the The elastic wave signal generated when the touch object touches the operation panel, the medium type corresponding to the touch object is determined according to the first infrared touch data corresponding to the first moment and the elastic wave signal, and the medium type is determined by combining the elastic wave signal and the first infrared touch data , to improve the recognition accuracy of the touch object, and improve the recognition accuracy of the touch object.
  • the elastic wave signal collected by the elastic wave sensor is acquired, and the medium type is determined according to the elastic wave signal and the first infrared touch data, and the The media type is sent to the first processing device, so that starting from the second moment, after the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device, the first processing device can , different response operations are performed on the second infrared touch data, the response speed of the touch operation is improved, the operation is simple, and the efficiency is high.
  • an embodiment of the present disclosure provides an interactive tablet, including an operation panel, an infrared touch sensor, a first processing device, and a second processing device, wherein the infrared touch sensor is disposed on at least one of the operation panels an edge to form a touch detection area of the interactive tablet, the interactive tablet further includes an elastic wave detection device, and the elastic wave detection device includes an elastic wave sensor;
  • the infrared touch sensor is used to generate an infrared sensing signal from the first moment when a touch object performs a touch operation in the touch detection area of the interactive tablet, and send it to the second processing equipment;
  • the second processing device calculates and obtains first infrared touch data corresponding to the first moment according to the infrared sensing signal; wherein, the first infrared touch data includes touch position information of the touch object; and
  • the elastic wave detection device is configured to receive an elastic wave signal generated by the elastic wave sensor, and the elastic wave signal is generated when the touch object contacts the operation panel;
  • the medium type corresponding to the touch object is determined according to the first infrared touch data and the elastic wave signal; wherein, the first infrared touch data is generated by the first infrared touch data.
  • the second processing device sends to the elastic wave detection device, or is forwarded by the first processing device to the elastic wave detection device;
  • the media type information includes a media type corresponding to the touch object
  • the first processing device is configured to respond to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the infrared touch sensor detects the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet, and sends the infrared sensing signal to the first time after the infrared sensing signal is detected at the first moment.
  • the second processing device calculates the first infrared touch data sent to the elastic wave detection device according to the infrared sensing signal, detects the elastic wave signal generated when the touch object touches the operation panel through the elastic wave detection device, and according to the first The first infrared touch data corresponding to the moment and the elastic wave signal determine the medium type corresponding to the touch object, and by combining the elastic wave signal and the first infrared touch data to determine the medium type, the recognition accuracy of the touch object is improved, and the recognition accuracy of the touch object is improved. recognition accuracy.
  • the elastic wave detection device collects the elastic wave signal, judges the medium type according to the elastic wave signal and the first infrared touch data, and sends the medium type
  • the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device from the second moment
  • the first processing device can, according to different media types
  • the second infrared touch data performs different response operations, which improves the response speed of the touch operation, and has simple operation and high efficiency.
  • FIG. 1 is a schematic structural diagram of an interactive tablet provided by an embodiment of the present disclosure
  • FIG. 2 is a flowchart of a touch data processing method provided by an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a detection principle of an infrared touch sensor provided by an embodiment of the present disclosure
  • FIG. 4 is a schematic flowchart of a medium type determination process provided by an embodiment of the present disclosure
  • FIG. 5 is a schematic flowchart of determining a medium type by using a feature database according to an embodiment of the present disclosure
  • FIG. 6 is a schematic flowchart of a second infrared touch data determination process provided by an embodiment of the present disclosure
  • FIG. 7 is a schematic diagram of a response flow of a touch operation provided by an embodiment of the present disclosure.
  • FIG. 8 is a schematic diagram of a hardware structure of an interactive tablet provided by an embodiment of the present disclosure.
  • FIG. 9 is a schematic diagram of a second infrared touch data update process provided by an embodiment of the present disclosure.
  • FIG. 10 is a logic diagram of a touch data processing provided by an embodiment of the present disclosure.
  • FIG. 11 is an operation schematic diagram of a touch operation provided by an embodiment of the present disclosure.
  • FIG. 12 is a schematic diagram showing a writing track provided by an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram of an interactive tablet provided by an embodiment of the present disclosure.
  • 15 is a schematic diagram of an elastic wave signal receiving process according to an embodiment of the present disclosure.
  • FIG. 16 is a schematic flowchart of determining a medium type provided by an embodiment of the present disclosure.
  • FIG. 17 is a schematic flowchart of determining a medium type by using a feature database according to an embodiment of the present disclosure
  • FIG. 18 is a schematic flowchart of a second infrared touch data determination process provided by an embodiment of the present disclosure.
  • FIG. 19 is a schematic diagram of a hardware structure of an interactive tablet provided by an embodiment of the present disclosure.
  • FIG. 20 is a schematic diagram of a second infrared touch data update process provided by an embodiment of the present disclosure.
  • FIG. 21 is a logic diagram of a touch data processing provided by an embodiment of the present disclosure.
  • 22 is a structural block diagram of an interactive tablet provided by an embodiment of the present disclosure.
  • FIG. 23 is a structural block diagram of an interactive tablet provided by an embodiment of the present disclosure.
  • first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply these Entities or operations or objects precede any such actual relationship or order.
  • first and second for a first media type and a second media type are used to distinguish two different media types, such as the tip and tail of a writing pen.
  • the specific meanings of the above terms in the present disclosure can be understood according to specific situations.
  • plural means two or more.
  • the embodiment takes the interactive tablet as the actual carrier, and exemplarily describes the detailed process of detecting the touch operation, judging the touch operation, and displaying the response of the touch operation when the touch data processing method is implemented.
  • the interactive tablet it can be an integrated device that controls the content displayed on the display panel and realizes human-computer interaction through touch technology. one or more functions.
  • FIG. 1 shows a schematic structural diagram of an interactive tablet provided in this embodiment.
  • the interactive tablet 100 includes at least one operation panel 500 , and in addition, the interactive tablet 100 further includes a first processing device 200 and a second processing device 200 .
  • the device 300 , the infrared touch sensor 400 and the elastic wave sensor 600 , and the elastic wave sensor 600 and the infrared touch sensor 400 are all connected in communication with the second processing device 300 .
  • the operation panel may be a glass panel covering the display screen of the interactive tablet.
  • the interactive tablet may be a smart blackboard.
  • the smart blackboard includes an ordinary blackboard and a display screen.
  • the infrared touch sensor 400 is disposed on at least one edge of the interactive tablet 100 (may be around the interactive tablet 100 or two sides of the interactive tablet 100. If the infrared touch sensor 400 is a reflective sensor, the infrared touch The sensor 400 may also be disposed on one side of the interactive tablet 100 ) to form a touch detection area of the interactive tablet 100 .
  • the four sides of the interactive tablet 100 refer to the four sides of the interactive tablet 100 .
  • the touch detection area is an area used to detect touch operations on the interactive tablet 100 , and is an area in a physical sense.
  • the infrared touch sensor 400 can be regarded as being disposed at a corresponding position around the operation panel 500 . In a specific application, the position of the infrared touch sensor 400 can be set according to the area that actually needs to be detected, and it can be only disposed on the operation panel 500 .
  • the surrounding area may also be arranged around the entire interactive tablet 100 .
  • the infrared touch sensor 400 can detect that a touch object performs a touch operation at any position on the touch detection area, and generates an infrared sensing signal.
  • the second processing device 300 may calculate and obtain infrared touch data according to the infrared sensing signal, and the second processing device 300 is connected in communication with the first processing device 200 .
  • the first processing device 200 and the second processing device 300 provided by the present disclosure may be implemented by independent chips respectively, or may be implemented simultaneously by an integrated chip, that is, the first processing device 200 and the second processing device 300
  • the processing device 300 is integrated in one chip. For example, when the integrated chip has sufficient processing capability (meeting the processing performance requirements of the first processing device 200 and the second processing device 300 ), one integrated chip can be used to implement the first processing device 200 and the second processing device 300 in the present disclosure corresponding function.
  • the user can use a finger or a writing pen as a touch object to touch the operation panel to realize the touch operation.
  • the infrared touch sensor 400 detects the touch operation of the touch object in the touch detection area of the interactive tablet 100, and generates infrared light.
  • Sensing signal the second processing device 300 calculates and obtains infrared touch data according to the infrared sensing signal, and sends it to the first processing device 200 . position to respond to touch functionality.
  • the interactive tablet is installed with at least one operating system, wherein the operating system includes, but is not limited to, an Android system, a Linux system, and a Windows system. Further, at least one application program with a writing function can be installed on the interactive tablet.
  • the application program may be an application program that comes with the operating system, and at the same time, an application program downloaded from a third-party device or server is also installed.
  • the application program also has other editing functions, such as inserting a table, inserting a picture, illustrating a graph, drawing a table, drawing a graph, and the like.
  • the graphic interface displayed in the operation panel of the interactive tablet corresponds to the projected area of the touch detection area for detecting user operations on the operation panel (ie, the touch detection area is in front of the graphic interface).
  • the infrared touch sensor 400 can sense the change of infrared light, and obtain a touch signal containing the coordinates of the touch position and the touch signal According to the coordinates of the touch position and the trigger time of the touch signal, the infrared touch data reflecting the writing track input from the writing pen or the user's finger each time it falls into the writing process and is lifted to stop writing can be obtained.
  • the graphical interface of the operation panel displays the writing track input by the user in real time.
  • the writing process is not limited to writing, and any input process implemented on the operation panel of the interactive tablet for displaying the operation track can be regarded as a writing process.
  • the touch operation may respond to operations such as clicking, dragging, and the like by the user.
  • the underlying coordinate processing methods of these different response methods are the same, which will eventually lead to the change of the screen displayed in the operation panel visually.
  • various interactive display designs of the interactive tablet can be realized.
  • a whiteboard application refers to an application for users to perform operations such as writing and displaying. It can be used to generate handwriting according to the user's writing operation (touch operation) on the interface of the whiteboard application, and can also be used in the interface of the whiteboard application. Insert and display multimedia elements, which may include graphics, images, tables, documents, audio files, and/or video files.
  • users can implement operations such as writing, drawing, and erasing similar to the physical blackboard, and further have better digital functions such as moving, saving, zooming, inserting pictures, color adjustment, and stroke thickness setting.
  • whiteboard applications can also be named as writing applications, electronic whiteboard applications, collaborative whiteboard applications, etc. No matter how the names are changed, as long as the applications used to implement the above functions are equivalent to the whiteboard applications of the present disclosure.
  • the elastic wave sensor provided by this solution is arranged on the operation panel, and is used to detect the elastic wave signal generated when the touch object touches the operation panel of the interactive tablet.
  • a piezoelectric elastic wave sensor is installed at the frame of the operation panel or inside the cover. When the touch object touches the operation panel, a characteristic elastic wave signal will be generated. The elastic wave signal starts from the contact point and runs along the spread around the operation panel, or spread to the inside of the operation panel.
  • the piezoelectric elastic wave sensor located at the frame of the operation panel or the inner side of the cover can convert the original elastic wave signal into a voltage signal, and send the voltage signal to the second processing device.
  • Amplification processing is performed in the IC chip of the compensation circuit, and is converted into a digital elastic wave signal by an analog-to-digital conversion circuit.
  • a capacitive elastic wave sensor can also be used.
  • the capacitive elastic wave sensor located at the frame of the operation panel or the inner side of the cover can convert the original elastic wave signal into an electrical signal (represented here as a change in capacitance) , and send the electrical signal to the second processing device, the second processing device transmits the electrical signal to an IC chip with a temperature compensation circuit for amplification, and converts it into a digital elastic wave signal through an analog-to-digital conversion circuit.
  • this solution does not specifically limit the location of the elastic wave detection device, as long as the elastic wave signal generated by the touch object touching the display screen of the interactive tablet can be detected.
  • the elastic wave sensor For the mechanical vibration below the audio frequency, the sound in the audio frequency range, and the ultrasonic wave beyond the audio frequency, these are all wave phenomena of gas, liquid, solid and other media. Compared with light and electromagnetic waves, this wave phenomenon is called elastic wave.
  • the elastic wave sensor is used to complete the elastic wave sensor.
  • the elastic wave sensor is specifically installed in a position where the vibration generated by the operation panel can be transmitted, so as to realize the event that the touch object on the operation panel touches the operation panel without necessarily being installed. where the vibration occurs.
  • elastic wave sensors can be arranged at the four corners of the operation panel. Of course, other arrangements are also possible. For example, they can be arranged at the midpoint of each side of the rectangular frame of the operation panel.
  • the number can also be other numbers, such as 2, 5
  • the specific number of arrangements can be set according to the size and detection accuracy of the operation panel.
  • the size of the operation panel The larger the detection accuracy, the higher the number of elastic wave sensor settings.
  • the elastic wave sensor can be directly installed on the surface of the operation panel, for example, directly installed on the upper surface of the operation panel or the lower surface of the operation panel, so as to receive the vibration transmitted by the operation panel and improve the accuracy of touch detection.
  • the elastic wave sensor can also be installed in the frame of the operation panel, reducing the impact on the internal mechanism and reducing the common mode noise interference from the operation panel.
  • the elastic wave sensor may also be mounted on other components in contact with the operation panel, and receive vibrations occurring on the operation panel through transmission of the other components.
  • the source of elastic waves includes various noise-generating components (such as motors, speakers, fans, etc.)
  • the interactive tablet will generate elastic waves that are not intended by the user to control.
  • the noise generated by the speaker mainly comes from the elastic wave generated in the overall medium of the interactive flat panel when it emits sound.
  • the elastic wave sensor it can be detected at any time. to various elastic wave signals, but many of them are not from the touch operation itself.
  • FIG. 2 shows a flowchart of a touch data processing method provided by an embodiment of the present disclosure.
  • the touch data processing method provided by an embodiment of the present disclosure is applied to an interactive tablet, and the interactive tablet may be composed of two or more physical entities. It can also be a physical entity.
  • the interactive tablet can be a mobile phone, a conference tablet, a teaching tablet, an industrial control computer, etc., for realizing content display and interactive response in the process of human-computer interaction.
  • the touch data processing method provided in this embodiment includes:
  • the interactive tablet includes an operation panel, an infrared touch sensor, a first processing device, a second processing device, and an elastic wave sensor, wherein the elastic wave sensor and the infrared touch sensor are both connected to the second processing device, and the first processing device is connected to the second processing device.
  • the second processing device is connected to the first processing device.
  • the infrared touch sensor is used to generate an infrared sensing signal when a touch object performs a touch operation in the touch detection area of the interactive tablet.
  • the infrared sensing signal generated by the infrared touch sensor will be a continuous signal. Continuous here does not mean completely uninterrupted in timing.
  • the duration of the signal is 1s
  • the expression is in the form of multiple signal values at certain time intervals.
  • the sensor signal value every 1ms.
  • the 1s and 1ms are just examples, in fact, they are determined according to the operation duration of the touch operation and the working characteristics of the infrared touch sensor.
  • the elastic wave sensor is used to generate elastic wave signals when the touch object contacts the operation panel of the interactive tablet.
  • the infrared sensing signal may actually be an infrared blocking signal (detected by an infrared touch sensor) or an infrared reflection signal (detected by a reflective infrared sensor).
  • the present disclosure takes the infrared blocking signal as an example for description.
  • infrared touch sensors are arranged around the surface of the operation panel. When the touch object touches the operation panel, the infrared touch sensor scans the touch object through optical signals. When the touch detection area of the tablet performs a touch operation, the infrared touch sensor generates an infrared sensing signal.
  • the infrared touch sensor includes an infrared transmitter and an infrared receiver, the infrared transmitter is used for emitting infrared light, and the infrared receiver is used for receiving infrared light, and a beam grid is formed by densely distributed infrared light in different directions to locate the touch point.
  • M infrared transmitters are arranged on one side of the horizontal direction of the operation panel, and N infrared emitters are arranged on one side of the vertical direction.
  • M infrared receivers are arranged on the other side in the horizontal direction, and N infrared receivers are arranged on the other side in the vertical direction.
  • the infrared transmitter emits infrared light at a certain frequency
  • the corresponding infrared receiver receives infrared light at a certain frequency.
  • the touch object touches the operation panel
  • the touch object will completely or partially block one or more vertical and horizontal infrared lights, and then an M*N infrared light intensity pixel map is obtained.
  • the first light intensity threshold represents a real and effective touch, rather than noise or when the object is close to but not completely touched, it is measured when the infrared light is partially blocked.
  • the actual touch position is the touch position when the touch object is in contact with the operation panel.
  • the second light intensity threshold is greater than the noise value, which can represent the extension of the real touch area
  • the adjacent area of the real touch position is greater than
  • the position of the second light intensity threshold is marked as an effective touch area, and the area of the touch area is the contact position of the touch object and the operation panel.
  • the third light intensity threshold represents the maximum light intensity when out of touch. Understandably, when the user touches the operation panel through the touch object, the infrared light transmission path between the infrared transmitter and the infrared receiver installed on the operation panel will be blocked by the touch object, and the infrared touch sensor will output the corresponding infrared transmission path.
  • the second processing device can measure the contact area between the touch object and the operation panel and the movement of the touch object on the operation panel according to the infrared sensing signal Speed and touch position when the touch object is in contact with the operation panel, and obtain the corresponding infrared touch data.
  • the infrared touch data includes touch state information (including TOUCH state, DOWN state, MOVE state and UP state), touch position information and/or touch parameter information. It should be noted that, in the process of calculating the touch position information and touch parameter information according to the infrared sensing signal, each infrared sensing signal will have a flag, which can be combined with the flag to obtain touch state information.
  • the touch state at this time is the TOUCH state; after the flag bit changes from the original 00 to 01, when the flag bits of the infrared sensing signal of the continuous set number of frames (two or three frames) are all 01, it indicates that there is For a valid touch operation, the touch state at this time is the DOWN state (from the DOWN state, the infrared touch data is reported to the first processing device for processing and response); the subsequent flag bits remain at 01, and the touch state is the MOVE state; finally, when When the infrared sensing signal is no longer detected, the flag bit changes from the original 01 to 00, and the touch state at this time is the UP state. Finally, infrared touch data is generated based on the touch state
  • Figure 3 shows a schematic diagram of the detection principle of an infrared touch sensor. It needs to be explained that there has always been a long-term technical problem in the industry to realize the touch function of the interactive tablet through the infrared touch sensor, that is, zero Writing highly technical questions.
  • the so-called zero writing height means that when a touch object (such as a hand or a writing pen) writes on the display screen, the writing track is generated when the touch object touches the surface of the display screen, and the touch object is in contact with the surface of the display screen when the writing produces handwriting.
  • the spacing is zero. In order to better understand the zero writing height, it is further explained in conjunction with FIG.
  • the infrared touch sensor 400 transmits or receives light signals in a certain height range, so that a touch detection area is formed in the vertical direction relative to the operation panel 500 . , and its height is H.
  • H its height
  • the touch object In a touch operation, the touch object will go through states 131-137 in FIG. 3 , wherein the state 131 , state 132 to state 133 describe the process of the touch object from starting the touch operation to starting to contact the operation panel 500 .
  • state 131 the touch object just begins to enter the touch detection area, and the second processing device detects the first frame of infrared touch data according to the infrared sensing signal generated by the infrared touch sensor.
  • the touch state of the touch object is the touch trigger state
  • the second processing device detects the first frame of infrared touch data according to the infrared sensing signal generated by the infrared touch sensor, and the touch state of the touch object at this time
  • the touch falling state before state 131, the touch object is above the touch detection area, and no infrared touch data is generated.
  • the touch object is in the touch detection area, but does not touch the operation.
  • infrared touch data On the surface of the panel 500, infrared touch data will be generated (in this process, when two or three consecutive frames of valid infrared sensing signals are detected, the next frame of infrared touch data is determined as the first frame of infrared touch data), in the state In step 133, the touch object is in the touch detection area and has touched the operation panel 500, and infrared touch data is generated.
  • state 134 to state 135, describe the process that the touch object touches the operation panel 500 and moves on the operation panel 500.
  • the touch state of the touch object is always the touch movement state.
  • the touch movement state the touch The object continues to touch the operation panel 500, and at the same time, infrared touch data is generated.
  • state 136 to state 137 the process of lifting the touch object from the operation panel 500 to leaving the touch detection area is described.
  • state 136 to state 137 when the touch object just leaves the touch detection area, the second processing device The last frame of infrared touch data is detected according to the infrared sensing signal generated by the infrared touch sensor, and the touch state of the touch object at this time is the touch-up state.
  • state 136 the touch object is in the touch detection area and has not been touched. When touching the operation panel 500, infrared touch data will be generated.
  • state 137 the touch object is above the touch detection area, and infrared touch data will not be generated.
  • the infrared touch data generated during the process from state 132 to state 136 is continuous infrared touch data.
  • the infrared touch data between the first frame of infrared touch data and the last frame of infrared touch data is intermediate touch data.
  • the infrared touch sensor When the touch object performs a touch operation in the touch detection area of the interactive tablet, the infrared touch sensor will generate an infrared sensing signal, so as to calculate according to the infrared sensing signal, and then send the infrared touch data to the corresponding infrared touch data.
  • the infrared touch data generated by the infrared touch sensor is continuous data, which is embodied as data including multiple frames.
  • the infrared touch data provided in this embodiment includes touch state information, touch position information, and touch parameter information.
  • the touch state information is used to represent the touch state of the corresponding touch object in the current touch operation
  • the touch state includes the touch trigger state (TOUCH), the touch drop state (DOWN), the touch movement state (MOVE) and the touch state.
  • the touch position information is used to reflect the touch position of the touch object on the operation panel, which can be represented by the XY coordinate points on the operation panel
  • the touch parameter information at least reflects the touch object when it touches the operation panel.
  • the touch area can be represented by the width and height corresponding to the touch area, or by the radius or diameter corresponding to the touch area.
  • the data format of the infrared touch data can be determined according to the communication method between the second processing device and the first processing device and/or the elastic wave detection device, for example, through USB communication.
  • the data format of the infrared touch data is shown in Table 1:
  • the point state represents the touch state in the infrared touch data.
  • the infrared touch data generated in one touch operation includes the first frame of infrared touch data, the first frame of infrared touch data, the middle touch data and the last frame of infrared touch data, and the first frame of infrared touch data is the first frame of infrared touch data corresponding to the first moment.
  • An infrared touch data touch state information indicates that the touch state of the touch object is a touch trigger state
  • the touch state information in the first frame of infrared touch data indicates that the touch state of the touch object is a touch fall state
  • the touch state information in the middle touch data indicates that the touch The touch state of the object is the touch movement state
  • the touch state information in the infrared touch data of the last frame indicates that the touch state of the touch object is the touch lift state.
  • the second processing device After the first time, the second processing device starts to acquire the elastic wave signal generated by the elastic wave sensor, and the elastic wave signal is generated when the touch object contacts the operation panel.
  • the moment when the second processing device starts to detect the infrared sensor signal is defined as the first moment, and the second processing device starts to acquire the elastic wave signal generated by the elastic wave sensor after the first moment.
  • the first time is within a certain time interval after the first time, for example, within 3 ms or within 2 ms or 5 ms after the first time.
  • the elastic wave signal starts to be acquired, so as to prepare for the subsequent processing steps.
  • the elastic wave signal it can be that the elastic wave sensor is always in the working state and will always generate signals, but the second processing device starts to obtain the elastic wave signal generated by the elastic wave sensor after receiving the infrared sensor signal.
  • the elastic wave signal generated by the elastic wave sensor can be received, or before receiving the infrared sensing signal, the elastic wave signal generated by the elastic wave sensor can also be received but not Perform any response processing or discard the elastic wave signal, and only obtain the elastic wave signal generated by the elastic wave sensor after receiving the infrared sensor signal. It can also be that the elastic wave sensor is usually in a non-working state.
  • the second processing device triggers the elastic wave sensor to start working, so that when the touch object touches the operation panel of the interactive tablet, the elastic wave sensor starts to generate Elastic wave signal.
  • the second processing device calculates and obtains the first infrared touch data corresponding to the first moment according to the infrared sensing signal, and determines the medium type corresponding to the touched object according to the first infrared touch data and the elastic wave signal.
  • the first infrared touch data includes touch position information of the touch object.
  • the response of the interactive tablet to the user's touch operation is associated with the medium type of the touch object used by the user, therefore, the medium type of the touch object needs to be accurately identified.
  • How to accurately identify the medium type of the touching object based on the elastic wave signal is a long-standing technical problem in the industry. Type recognition accuracy.
  • various interference sources may exist, resulting in a relatively large noise signal in the elastic wave signal detected by the elastic wave detection device.
  • the recognition accuracy can be improved to a certain extent, this method still directly uses the elastic wave signal to identify the medium type of the touched object.
  • the noise signal has a great influence on the elastic wave signal, the high The accurate identification algorithm may also cause errors in the identified medium type, which affects the response effect of the interactive panel.
  • the interactive tablet specifically converts the audio signal into an acoustic signal through the speaker.
  • the speaker makes its paper cone or diaphragm vibrate and resonate with the surrounding air through electromagnetic, piezoelectric or electrostatic effects.
  • the elastic wave signal detected by the elastic wave sensor will be the actual elastic wave signal of the touch operation of the touch object. And the superimposed signal of the vibration signal caused by the audio playback.
  • the elastic wave signal detected by the elastic wave sensor has a large noise signal, and the existing solution only recognizes the medium type of the touched object based on the elastic wave signal, which makes it difficult for even high-precision recognition algorithms to accurately recognize the touch. the medium type of the object.
  • the present invention proposes a method for identifying the medium type of the touch object with higher accuracy in combination with the specific usage scenario of the interactive tablet, adding the first infrared touch data as a parameter for identifying the medium type of the touch object, and by combining the first infrared touch data Using touch data to identify the medium type of the touch object can reduce the influence of noise signals on the recognition result and improve the recognition accuracy of the medium type of the touch object.
  • the second processing device When the second processing device starts to detect the infrared sensing signal, it calculates the first infrared touch data corresponding to the first moment according to the infrared sensing signal.
  • the first infrared touch data provided by the present disclosure includes at least touch position information, and in addition, the first infrared touch data may further include touch parameter information and/or touch state information.
  • the second processing device After calculating the first infrared touch data corresponding to the first moment, the second processing device determines the medium type corresponding to the touch object according to the touch position information and/or touch parameter information of the first infrared touch data and the elastic wave signal.
  • the first infrared touch data is the first frame of infrared touch data calculated and obtained by the second processing device.
  • the touch object when the touch object performs a touch operation in the touch detection area of the interactive tablet, first the infrared touch sensor detects that it is blocked, and then a corresponding conversion calculation needs to be performed, and the specific touch position information, Touch parameter information such as touch area.
  • the second processing device receives the elastic wave signal detected by the elastic wave sensor, and then determines the corresponding touch object according to the elastic wave signal and the touch position information and/or touch parameter information of the calculated first infrared touch data. media type.
  • the second processing device starts to collect elastic wave signals (ie, the aforementioned TOUCH state) after detecting the presence of an infrared sensor signal, and receives the first infrared touch data at the first moment. After that, work on material identification begins.
  • elastic wave signals ie, the aforementioned TOUCH state
  • infrared touch data is added as a parameter for identifying the medium type of the touch object, and the medium type of the touch object can be identified by combining the infrared touch data.
  • the influence of the noise signal on the recognition result is reduced, and the recognition accuracy of the medium type of the touched object is improved.
  • the second processing device converts the infrared sensor signal into infrared touch data with a delay process. In order to avoid false responses caused by foreign objects such as dust, the second processing device does not calculate and obtain the first frame of infrared touch data.
  • the data will be reported to the first processing device for processing, but after two or three consecutive frames of infrared touch data are obtained by calculation, the infrared touch data will be reported to the first processing device, and the infrared touch data will be reported to the first processing device.
  • the first frame of data is referred to as the first frame of touch data (the touch state information is DOWN).
  • the time for the second processing device to obtain each frame of infrared touch data according to the infrared sensing signal is about 10ms.
  • the infrared touch data reporting mechanism when the second processing device reports the infrared touch data to the first processing device, it indicates that there is a valid touch control operation, and then to identify the media type of the touching object, it needs to be at least 20-30ms after the first moment when the infrared sensing signal is generated. There is a delay process, and the media type Identification also requires an additional 13-20ms of time. If this method is adopted, although the recognition accuracy of the medium type can be improved, there is a large delay from the generation of the infrared sensor signal to the final acquisition of the medium type, which will reduce the response speed of the interactive tablet and bring adverse effects to users. experience.
  • the acquisition of the elastic wave signal is performed at the first moment when the first frame of infrared touch data is detected, so that the medium type of the touched object is performed after the first infrared touch data corresponding to the first moment is received. Identify, instead of waiting to report infrared touch data to the first processing device (two to three frames of infrared touch data need to be detected continuously, and it takes 20-30ms), and it is determined that there is an effective touch operation before the medium type identification, which at least saves The waiting time between the detection of the infrared sensing signal and the reporting of the infrared touch data to the first processing device.
  • the first processing device when it receives the second infrared touch data reported by the second processing device, it may have already received the medium type of the touched object, or only need to wait a few milliseconds to receive the medium type of the touched object, thereby combining The media type of the touch object responds to the second infrared touch data, which can reduce the delay and improve the response speed.
  • the starting point of the elastic wave signal can be determined according to the touch position information of the first infrared touch data, and the material identification signal used for identifying the medium type can be determined according to the starting point.
  • the medium type corresponding to the touch object is determined in this embodiment, including steps S1031-S1034:
  • the elastic wave sensor that is closest to the touch position can be determined according to the touch position information in the first infrared touch data, because the signal intensity generated by it is the highest, The signal-to-noise ratio of the generated signal is the largest, and the elastic wave signal generated by the elastic wave sensor can be used to detect the vibration point.
  • the touch position information is used to represent the position information of the touch point corresponding to the touch operation, which can be represented by X and Y coordinate values
  • the touch parameter information includes information used to represent the area of the touch point corresponding to the touch operation, which can be It is represented by the width value and height value of the contact area or contact point.
  • the elastic wave detection device identifies the medium type corresponding to the touch object: after acquiring the first infrared touch data, it first combines the information in the time domain and frequency domain of the elastic wave signal, and the information includes the time domain exceeding the set signal-to-noise ratio.
  • the method of judging the starting point may be a threshold method (determining whether the signal-to-noise ratio or signal quantity exceeds a preset threshold), or a zero-crossing rate (determining whether the signal is a non-random vibration signal).
  • the elastic wave detection device when the elastic wave detection device uses multiple elastic wave sensors to detect the elastic wave signal, the elastic wave detection device can determine or calculate to obtain an effective signal according to the touch position information and/or touch parameter information of the first infrared touch data.
  • the elastic wave signal (signal used for medium identification) is used to determine the starting point of the effective elastic wave signal.
  • the elastic wave sensor that is closest to the touch point can be determined according to the touch position information in the infrared touch data. Since the signal intensity it generates is the highest and the signal-to-noise ratio of the signal it generates is the largest, the elastic wave sensor generated by the elastic wave sensor has the highest signal-to-noise ratio. wave signal as an effective elastic wave signal.
  • weighting processing can also be performed on the elastic wave signals of each elastic wave sensor according to the touch position information of the infrared touch data, and the result obtained by the weighting processing can be regarded as an effective elastic wave signal, and the corresponding weight of each elastic wave sensor can be a predetermined value.
  • the set value can also be a function that is negatively related to the distance of the touch position, for example, the weight is the reciprocal of the distance or the square of the reciprocal, etc.
  • S1032 Determine noise information according to the elastic wave signal before the vibration point.
  • S1033 According to the noise information, determine the material identification signal from the elastic wave signal after the starting point.
  • S1034 The touch position information and the material identification signal of the first infrared touch data are used to determine the medium type and confidence interval corresponding to the touch object.
  • the signal before the starting point is analyzed and obtained, and the signal before the starting point is used as the noise estimation value, and the signal after the starting point is identified accordingly, and the signal after the starting point is identified as the elastic wave material.
  • identification signal As an embodiment, signal processing is performed on the identification signal.
  • the signal processing includes algorithms such as time-frequency conversion, windowing and smoothing, multi-channel fusion, noise reduction, etc., to obtain a fused elastic wave frequency domain signal, and the elastic wave frequency
  • the domain signal is placed in the setting algorithm (including statistical learning, machine learning, deep learning and other model algorithms, or eigenvalue comparison algorithms) to obtain the ID of the material and its confidence interval, and report the material ID and confidence interval to the Handling equipment.
  • the determined media type needs to be corrected according to the comparison between the confidence interval and the preset confidence threshold.
  • the ID of the material type is 01
  • the confidence interval is 85%
  • the confidence threshold is set to 80. %
  • the confidence interval is 75%
  • the medium type needs to be corrected, and the correction can be performed by referring to various methods described later in the present disclosure.
  • the infrared touch data provided in this embodiment includes touch state information, touch position information, and touch parameter information.
  • the second processing device After receiving the first infrared touch data, the second processing device reads out the touch position information in the first infrared touch data.
  • the touch position information can be understood as the touch position of the touch object on the operation panel.
  • step S1034 is specifically: input the touch position information and the material recognition signal into the trained feature recognition model, and obtain the corresponding touch object. Media type and confidence interval.
  • the second processing device collects the elastic wave signal through the elastic wave sensor, it determines the material identification signal corresponding to the elastic wave signal, and inputs the material identification signal into the trained feature identification model, and the feature identification model performs the processing on the material identification signal. Analyze, process and output the media type and confidence interval corresponding to the touching object.
  • the feature recognition model can be constructed by means of a neural network, which can analyze and process the touch position information and the material recognition signal, and output the medium type and confidence interval corresponding to the touch object.
  • a feature recognition model is built based on a neural network, and the touch position information and material recognition signal are used as input, and the medium type is used as output to train the feature recognition model.
  • Add touch position information and/or touch parameter information as features to the feature recognition model for training which can be the most original input feature of the feature recognition model, or it can be an additional feature of a certain layer in the network of the feature recognition model , and the recognition results are directly output by the feature recognition model.
  • S1034 can also input the touch parameter information, touch position information and elastic wave signal into the trained feature recognition model to obtain the medium type corresponding to the touch object, so that the touch parameter information is also used as the feature recognition model an identification parameter of .
  • the feature recognition model can perform feature recognition on the material recognition signal, and determine the medium type and confidence interval corresponding to the touched object according to the feature recognition result and the touch position information.
  • step S1034 includes:
  • S10341 Fusion processing the material identification signals corresponding to the multiple elastic wave signals to obtain a preprocessing signal; input the touch position information and the preprocessing signal into the trained feature recognition model to obtain the medium type and confidence level corresponding to the touching object interval.
  • the feature recognition model can be built by means of a neural network, which can analyze and process the touch position information and the preprocessing signal obtained by fusing multiple material recognition signals, and output the medium type corresponding to the touch object and the confidence interval.
  • a feature recognition model is built based on a neural network, and the touch position information and preprocessing signals corresponding to multiple material recognition signals are used as input and the medium type is used as output to train the feature recognition model.
  • the feature recognition model may perform feature recognition on the preprocessed signal, and determine the medium type and confidence interval corresponding to the touched object according to the feature recognition result and the touch position information.
  • the second processing device collects multiple elastic wave signals through multiple elastic wave sensors, it determines a material identification signal corresponding to each elastic wave signal, and performs fusion processing on the multiple material identification signals to obtain a preprocessed signal. Further, the preprocessed signal is input into the trained feature recognition model, and the feature recognition model analyzes and processes the preprocessed signal and outputs the medium type and confidence interval corresponding to the touching object.
  • An implementation of the fusion process is: based on the position information of multiple elastic wave sensors, and according to the touch position information, calculate the distances S1, S2, . . . Sn (n is the touch point represented by the touch position information and different elastic wave sensors) Natural numbers), and then based on the calculated distances, the elastic wave signals collected by multiple elastic wave sensors are fused to obtain a preprocessing result.
  • a possible implementation case is that after weighting the signal of each sensor by 1/(Sn) ⁇ 2, the weighted result is used as the preprocessing result.
  • the second processing device When the second processing device obtains the medium type of the touching object through the feature recognition model, it also obtains a confidence interval corresponding to the medium type.
  • the media types determined by the second processing device may be one or more types.
  • a medium type is uniquely determined according to the first infrared touch data and the material identification signal, and the confidence interval of the medium type is higher than the set confidence threshold, it can be directly determined that the medium type is the medium type corresponding to the touch object.
  • the media type is used as the media type corresponding to the touch object.
  • step S1034 includes:
  • S10342 After the feature extraction is performed on the material identification signal, modify the material identification signal according to the touch position information in the first infrared touch data.
  • a feature database is preset in the second processing device, and the feature database records the correspondence between preset features and preset media types.
  • the corresponding relationship between the preset feature and the preset medium type may be recorded in the form of a key-value pair.
  • the second processing device performs feature extraction on the material identification signal.
  • the touch position information in the first infrared touch data is determined, and the extracted features are corrected according to the touch position information.
  • the corrected features are matched and compared in the preset feature database, and when the preset features that are consistent or the similarity reaches the set similarity requirement are matched, the preset features correspond to the preset features.
  • the preset media type is determined as the media type corresponding to the touch object.
  • the second processing device obtains a confidence interval corresponding to the media type while obtaining the media type of the touching object through the feature database.
  • the media types determined by the second processing device may be one or more types.
  • a medium type is uniquely determined according to the first infrared touch data and the material identification signal, and the confidence interval of the medium type is higher than the set confidence threshold, it can be directly determined that the medium type is the medium type corresponding to the touch object.
  • the media type is used as the media type corresponding to the touch object.
  • the touch data processing method in the step of obtaining the media type and confidence interval corresponding to the touch object, at least two media types are obtained, and the confidence interval corresponding to each media type is lower than the set confidence threshold. Based on this, the touch data processing method provided in this embodiment further includes:
  • S1035 Determine one of at least two medium types as the medium type corresponding to the touch object according to the touch parameter information of the first infrared touch data.
  • S1035 is performed by the second processing device.
  • S1035 is performed by the elastic wave detection device.
  • the second processing device directly sends the first infrared touch data to the elastic wave detection device, or after the second processing device sends the first infrared touch data to the first processing device, the first processing device sends the first infrared touch data to the elastic wave detection device.
  • the touch data is sent to the elastic wave detection device.
  • the medium type is corrected according to touch parameter information (eg, touch area) in the first infrared touch data, and the medium type corresponding to the touch object is determined according to the matching degree between the touch parameter information and each medium type.
  • touch parameter information eg, touch area
  • the second processing device or the elastic wave detection device records the area ranges corresponding to different media types, and the obtained media types are at least two and the confidence interval corresponding to each media type is low.
  • the second processing device or the elastic wave detection device determines the area range corresponding to each medium type, and acquires the touch parameter information in the first infrared touch data to determine the touch area of the current touch object touching the operation panel, according to The matching degree or area difference between the touch area and each area range is determined, and the area range closer to the touch area and the corresponding medium type are determined, and the medium type is used as the medium type corresponding to the touch object. For example, set the confidence threshold to 90%. When the confidence interval of the media type is greater than 90%, the media type can be used as the media type corresponding to the touch object.
  • the area range corresponding to material 1 and material 2 is obtained. Touch the area, confirm that the touch area is closer to the area range of material 1, then determine the medium type determined after correction as material 1, and use material 1 as the medium type corresponding to the touch object. More specifically, when the user operates with a finger on the display screen of the interactive tablet, the medium types identified by the elastic wave detection device may be: finger, with a confidence interval of 51%; brush, with a confidence interval of 49%.
  • the confidence interval of the finger and the brush are both set with a confidence threshold of 90%, it is necessary to obtain the touch area in the touch parameter information.
  • the obtained touch area represented by the width value and the height value
  • the preset area range of the finger is (6 ⁇ 2, 6 ⁇ 2)
  • the preset area range of the brush is (5 ⁇ 1, 4 ⁇ 1.5)
  • the area range is (6 ⁇ 2, 6 ⁇ 2), so the finger is used as the medium type corresponding to the touch object.
  • This embodiment corrects the obtained medium type through the first infrared touch data to determine the medium type corresponding to the touched object, reduces the deviation caused by the interference source to determine the medium type, and ensures the accuracy of the medium type determination.
  • the touch data processing method in the step of obtaining the media type corresponding to the touch object and the confidence interval, the obtained confidence interval of the media type is lower than the set confidence threshold.
  • the touch data processing method provided in this embodiment further includes:
  • the first processing device determines, according to the touch position information of the infrared touch data, whether the current touch operation is associated with the last lifted touch operation, and if so, obtains the media type corresponding to the last touch operation, The medium type corresponding to the touch object.
  • the first processing device determines the medium type corresponding to the touch object according to whether the current touch operation is associated with the previous touch operation. For example, the first processing device determines whether the time and distance thresholds between the start point of the current touch operation and the end point of the previous touch operation are within the set time and distance thresholds; associated with a lift touch action.
  • the first processing device obtains the touch position information in the infrared touch data of the current touch operation, and according to the touch position information is the pen drop position of the current touch operation, and calculates the corresponding time of the first frame of infrared touch data.
  • the poke is used as the pen-down time, and the touch position information in the infrared touch data when it is lifted in the last touch operation is obtained.
  • the touch position information is the pen-lift position of the last touch operation, and the corresponding infrared touch data Timestamp as the pen lift time.
  • the time and distance thresholds include a time threshold T0 and a distance threshold S0, and the time threshold T0 and the distance threshold S0 may be two fixed values or values with a linear or non-linear relationship.
  • the medium type corresponding to the last touch operation is acquired as the medium type corresponding to the touch object.
  • the corresponding writing track can be displayed on the operation panel directly according to the infrared touch data, without using the medium type to update the second infrared touch data. It can be understood that, when the confidence interval of the medium type is lower than the set confidence threshold, the first processing device does not The wrong connection result is sent to the elastic wave detection device to improve the data processing efficiency.
  • errors are corrected for the medium type according to the relationship between the current touch operation and the touch operation that was lifted last time, and the medium type corresponding to the touch object is determined, so as to reduce the deviation caused by the interference source to determine the medium type, and ensure the medium type. the degree of accuracy of the determination.
  • the touch position information of the first infrared touch data and the material identification signal are used to determine the medium type corresponding to the touch object, and the corresponding medium type information is fed back to the first processing device. Accurately determine the media types corresponding to different touch positions, and can respond differently to touch operations at the corresponding touch positions for different media types, enriching the interactive experience of the interactive tablet.
  • the second processing device sends media type information to the first processing device, where the media type information includes a media type corresponding to the touch object.
  • the second processing device After determining the medium type corresponding to the touch object according to the first infrared touch data and the elastic wave signal, the second processing device generates medium type information including the medium type according to the medium type corresponding to the touch object, and sends the information to the first processing device Media type information.
  • the second processing device after determining the medium type, reports the medium type to the first processing device, and after successfully reporting the medium type, suspends receiving the elastic wave signal generated by the elastic wave sensor until the second The processing device detects the last frame of infrared touch data in the infrared touch data.
  • the second processing device determines whether the last frame of infrared touch data is detected according to the touch state information in the infrared touch data, and determines that the last frame of infrared touch data is detected when the touch state information indicates that the touch state of the touch object is a touch-up state.
  • the second processing device After the second processing device successfully reports the medium type, it no longer receives or processes the newly generated elastic wave signal, filters the influence of the interference signal, avoids unnecessary processing steps performed by the elastic wave detection device, improves processing efficiency, and detects the end of the detection. After the frame of infrared touch data, clear the buffered elastic wave signal and continue to work, so as to avoid unnecessary influence on the determination of the next medium type and ensure the accuracy of medium type identification.
  • the second processing device calculates and obtains the second infrared touch data sent to the first processing device according to the infrared sensing signal.
  • the infrared touch sensor When the touch object performs a touch operation in the touch detection area of the interactive tablet, the infrared touch sensor generates an infrared sensing signal, and sends the infrared sensing signal to the second processing device. After receiving the infrared sensing signals, the second processing device calculates and obtains corresponding second infrared touch data according to the infrared sensing signals. These second infrared touch data are used for sending to the first processing device for processing and response. In one embodiment, the second infrared touch data is from the Nth frame of touch data to the last frame of infrared touch data calculated and obtained by the second processing device, where N is a natural number greater than 1.
  • the second processing device calculates and obtains multiple frames of touch data according to the infrared sensing signal, wherein the first frame of touch data is the first infrared touch data, and the Nth frame and subsequent touch data are the second infrared touch data.
  • step S105 includes:
  • the second processing device calculates and obtains corresponding infrared touch data according to the infrared sensing signal.
  • S1052 According to the infrared touch data obtained by calculation, confirm the first frame of infrared touch data corresponding to the touch operation, and obtain the first frame of infrared touch data and every subsequent frame of infrared touch data as the second infrared touch data; in the first frame of infrared touch data
  • the touch state information of the touch object indicates that the touch state of the touch object is the touch drop state.
  • the touch state information TOUCH, DOWN, MOVE or UP
  • the frame data whose touch state information is DOWN is the first frame of infrared touch data, so as to determine the second infrared touch data.
  • the second processing device receives the infrared sensing signal generated by the infrared touch sensor, and calculates and obtains corresponding infrared touch data according to the infrared sensing signal. After determining the first frame of infrared touch data as a valid touch (frame data whose touch state information is DOWN), the first frame of infrared touch data is used as the starting point of the second infrared touch data, and the infrared touch data after the first frame of infrared touch data are used as The subsequent second infrared touch data, that is, the first frame of infrared touch data and every subsequent frame of infrared touch data are regarded as the second infrared touch data.
  • the touch state information in the first frame of infrared touch data in this embodiment indicates that the touch state of the touch object is the touch down state (DOWN), that is, the touch state information in the infrared touch data indicates that the touch state of the touch object is DOWN.
  • the touch falls into the state, it can be determined that the frame of infrared touch data is the first frame of infrared touch data.
  • the second processing device sends the second infrared touch data to the first processing device starting from the second time, wherein the second time is after the time when the elastic wave signal is received.
  • the second processing device sends the second infrared touch data to the first processing device.
  • the second infrared touch data provided by the present disclosure includes at least touch position information, and in addition, the second infrared touch data may further include touch parameter information and/or touch state information.
  • the second time provided in this embodiment is after the first time when the infrared sensing signal starts to be detected.
  • the second processing device has determined the medium type corresponding to the touch object according to the first infrared touch data and the elastic wave signal, ensuring that The second infrared touch data sent to the first processing device is caused by the touch object touching the operation panel, which reduces unnecessary data processing performed by the first processing device and improves data processing efficiency.
  • the second processing device first obtains the first infrared touch data corresponding to the first moment. Determines whether a valid touch occurs. For the second infrared touch data sent to the first processing device, the first processing device will respond to the received second infrared touch data and the medium type. In order to avoid false responses, it is necessary to determine that the infrared touch is generated by a valid touch. Data, that is, the second infrared touch data is the first frame of infrared touch data and every subsequent frame of infrared touch data. The confirmation of the first frame of infrared touch data requires continuous detection of two to three frames of infrared touch data, resulting in the second time lag behind. first moment.
  • the media type information can be packaged in the second infrared touch data and sent to the first processing device, that is, the second processing device sends the second infrared touch data containing the media type information to the first processing device.
  • step S104 and step S106 are combined into one step:
  • the second processing device starts from the second moment, and the second processing device sends the second infrared touch data including the medium type information to the first processing device, where the medium type information includes the medium type corresponding to the touch object, wherein the second moment is at the receiving elastic After the moment of the wave signal.
  • the second processing device determines the medium type corresponding to the touch object according to the first infrared touch data and the elastic wave signal, and calculates and obtains the second infrared touch data sent to the first processing device, according to the medium corresponding to the touch object. type, generating media type information including the media type, adding the media type information to the second infrared touch data, and sending the media type information to the first processing device. In this way, one communication between the second processing device and the first processing device can be reduced.
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the first processing device After the first processing device receives the medium type information sent by the second processing device and the second infrared touch data sent from the second moment, according to the medium type corresponding to the touch object and the second infrared touch data, touches the touch object. response to the control operation.
  • the first processing device determines the medium type corresponding to the touch object according to the medium type information, and, according to the determined medium type, performs a Touch data to respond.
  • the response to the second infrared touch data may be to update the subsequently received second infrared touch data according to the medium type and respond accordingly (for example, to display the corresponding writing track according to the medium type), or it may be according to the medium type.
  • the type responds to the second infrared touch data received subsequently (for example, performing a click operation, a long press operation, etc. according to the medium type), that is, after the medium type is received, the second infrared touch data received will be processed. response.
  • the first processing device processes and responds to the second infrared touch data after receiving the medium type, ignores the infrared touch data generated before the touch object contacts the operation panel, and only processes the infrared touch data generated after the touch object contacts the operation panel,
  • the timing of processing and responding to infrared touch data is consistent with the position and timing of the touch object touching the operation panel, and the user's touch operation gets more accurate feedback, such as displaying the position of the writing track and the timing and the position of the touch object touching the operation panel Be consistent with the timing and achieve zero height of writing.
  • the first processing device performs a touch operation on the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the response includes steps S1071-S1072:
  • the first processing device updates the second infrared touch data according to the medium type corresponding to the touch object.
  • the first processing device After receiving the medium type information, the first processing device updates the subsequently received second infrared touch data according to the medium type indicated by the medium type information. For example, if the time when the medium type is received is t1, the second infrared touch data received after the time t1 is updated. In the specific implementation process, it may be processed by recording the receiving time. It is also possible to update the data of a preset flag bit after receiving the medium type, for example, from 00 to 01, so that in subsequent processing, as long as the flag bit is 01, the second read data will be IR touch data is updated.
  • the first processing device displays the corresponding writing track on the operation panel of the interactive tablet according to the updated second infrared touch data.
  • the first processing device After receiving the medium type information, the first processing device starts to cache the received second infrared touch data; and sequentially reads the cached second infrared touch data, updates the second infrared touch data according to the medium type, and updates the second infrared touch data according to the updated The second infrared touch data, the corresponding writing track is displayed on the operation panel. Specifically, after receiving the medium type information reported by the second processing device, the first processing device starts to cache the second infrared touch data sent by the second processing device. Optionally, after determining that the media type reported by the second processing device is received, the first processing device notifies the second processing device that the media type has been successfully received.
  • the first processing device starts to cache the second infrared touch data after receiving the medium type information, and ignores the infrared touch data generated before the touch object contacts the operation panel (when these infrared touch data are generated, the touch object just enters the touch detection area, without touching the operation panel), only the infrared touch data (second infrared touch data) generated after the touch object touches the operation panel is processed, and the position and timing of displaying the writing track are consistent with the position and timing of the touch object touching the operation panel, so as to realize Zero height for writing. Moreover, the infrared touch data generated before the touch object touches the operation panel is not cached, which saves the processing resources of the first processing device. In the updating process of this step, the first processing device sequentially reads the buffered second infrared touch data in a first-in, first-out order, and updates the read second infrared touch data according to the medium type.
  • the corresponding writing track is drawn according to the updated second infrared touch data, and displayed on the operation panel, for example, according to the display attributes (thickness, color, line type, etc.) represented by the updated second infrared touch data ) to draw the corresponding writing track and display it on the operation panel.
  • FIG. 8 provides a schematic diagram of the hardware structure of an interactive tablet.
  • the first processing device 200 is provided with a system layer and an application layer, wherein the system layer is used to perform data processing at the data level, for example, when receiving
  • the application layer is used to perform data processing at the application level, such as analysis and processing according to application task requirements.
  • the system layer sends the data processing results to the application layer through the data interface. It is then distributed to specific applications through the data interface, and further processed by the specific applications.
  • the step of updating the second infrared touch data received subsequently is processed at the system layer, and according to the updated second infrared touch data, in the interaction
  • the step of displaying the corresponding writing track on the operation panel 500 of the tablet is processed at the application layer. That is, after completing the update of the second infrared touch data, the system layer reports the updated second infrared touch data to the application layer, and the application layer distributes the updated second infrared touch data to the whiteboard application, which is executed by the whiteboard application.
  • the next step is to display the writing track.
  • the system layer can run the driver program of the first processing device 200, and the application layer can run the application programs installed by the first processing device 200, including the aforementioned whiteboard application, interactive tablet annotation application or other writing applications.
  • the driver reads the cached second infrared touch data in sequence according to the first-in-first-out order, updates the read second infrared touch data according to the medium type, and sends the updated second infrared touch data to the application layer.
  • the layer then sends the updated second infrared touch data to the application program.
  • the application program receives the updated second infrared touch data, it responds, draws a corresponding writing track, and displays it on the operation panel 500 .
  • corresponding standard touch parameter information (including standard touch height information and standard touch width information) is determined in advance for different media types.
  • a second infrared touch data update process is provided in FIG. 9 .
  • the first processing device updates the second infrared touch data according to the medium type corresponding to the touch object, which specifically includes steps S10711-S10712:
  • the first processing device determines standard touch parameter information of the medium type according to the medium type corresponding to the touch object.
  • S10712 Update touch parameter information of the second infrared touch data to standard touch parameter information to obtain updated second infrared touch data.
  • the first processing device determines the medium type indicated by the medium type information, determines the standard touch parameter information corresponding to the medium type, and stores the second infrared touch data obtained from the cache in the second infrared touch data.
  • the touch parameter information is updated to the standard touch parameter information, for example, the height information and width information in the touch parameter information are replaced with the standard touch height information and standard touch width information in the standard touch parameter information, so as to obtain the updated second infrared touch data.
  • the medium type can be subsequently determined according to the standard touch parameter information, so as to display the corresponding handwriting or perform the corresponding operation.
  • the first processing device updates the second infrared touch data according to the media type corresponding to the touch object, which specifically includes step S10713:
  • the first processing device writes the media type corresponding to the touch object into a data packet of the second infrared touch data that is subsequently received to obtain updated second infrared touch data.
  • IDs corresponding to different media types are recorded in the first processing device, and the IDs are used to represent different media types.
  • the first processing device After receiving the media type, the first processing device obtains the ID corresponding to the media type, reads the cached second infrared touch data, and writes the ID into the second infrared touch data to update the second infrared touch data.
  • the system layer in the first processing device sends the updated second infrared touch data to the application layer, and the application layer can read the ID in the second infrared touch data to determine the corresponding medium type , so as to display the corresponding handwriting or perform corresponding operations, such as drawing the corresponding handwriting through the preset display attributes (color, handwriting thickness, line type, etc.) of the medium type associated with the ID.
  • the ID corresponding to the medium type into the infrared touch data, there is no need to update the touch parameter information, that is, the touch area of the second infrared touch data is retained, but an ID is added to represent the medium type.
  • the second infrared touch data displays the writing track, handwriting with corresponding attributes can be drawn according to the actual touch area, and the display of the writing track is more accurate.
  • the display attribute of the writing track may be determined based on the second infrared touch data.
  • the first processing device displays the corresponding second infrared touch data on the operation panel of the interactive tablet according to the updated second infrared touch data.
  • Writing track which specifically includes step S10721:
  • the first processing device reads the touch state information, touch position information and touch parameter information of each frame of data of the updated second infrared touch data, and when the touch state information indicates that the touch state is a touch movement state, according to the touch parameter information
  • the corresponding display attribute displays the corresponding writing track at the position indicated by the touch position information.
  • display attributes corresponding to different touch parameters are recorded in the application layer, and the display attributes include the thickness, color, and line type (dotted line, solid line, style, etc.) corresponding to the writing track when drawing and displaying the writing track.
  • the system layer reports the updated second infrared touch data to the application layer that needs to use the second infrared touch data to display the writing track.
  • the application layer continuously reads the updated second infrared touch data, and determines the touch state information, touch position information and touch parameter information of each frame of data in the second infrared touch data, so as to write according to the display attribute corresponding to the touch parameter information drawing of the trajectory.
  • Different touch parameter information is generated by different media types, the display properties of the writing track can be quickly determined, and the display properties can be set quickly by touching objects of different media types. The operation process is simple and efficient, and the interaction efficiency of the interactive tablet is improved.
  • step S10722 after the first processing device touches the position indicated by the position information and displays the corresponding writing track, it further includes step S10722:
  • the first processing device After receiving the second medium type sent by the elastic wave detection device, the first processing device sequentially reads the cached infrared touch data, updates the second infrared touch data according to the second medium type, and updates the second infrared touch data according to the updated second infrared touch data. number to erase the writing track corresponding to the infrared touch data.
  • the interactive tablet provided in this embodiment is configured with a writing pen
  • the writing pen includes a pen tip and a pen tail
  • the media type of the pen tip is the first media type
  • the media type of the pen tail is the second media type.
  • the touch operation performed with the tip of the pen is a writing operation performed on the operation panel
  • the touch operation performed with the tail of the pen is an erasing operation performed on the operation panel.
  • the second processing device determines the medium type corresponding to the touch object according to the first infrared touch data and the elastic wave signal.
  • the medium type sent by the second processing device to the first processing device is the first medium type, and the foregoing step S10721 is executed.
  • the medium type sent by the device is the second medium type, and step S10722 is executed.
  • the first processing device After the first processing device receives the first media type sent by the second processing device, it will update the second infrared touch data according to the first media type, and display the corresponding writing track on the operation panel according to the updated second infrared touch data .
  • the first processing device After receiving the second media type sent by the second processing device, sequentially reads the cached infrared touch data, updates the second infrared touch data according to the second media type, and updates the second infrared touch data according to the updated second infrared touch number. , erase the writing track corresponding to the infrared touch data on the operation panel.
  • different touch parameter information is associated with different display attributes. When the pen tail is writing, it can be understood that the display attribute is to eliminate handwriting. By presetting the standard touch parameter information of the pen tail and setting it in the application layer , the application layer will correspondingly erase the corresponding handwriting when receiving the infrared touch data representing the operation of the pen tail.
  • the head and tail of the writing pen are respectively made of materials corresponding to different types of touch media. Based on different media types in different parts, the operation of a writing pen at different positions can directly complete the corresponding touch operation in some cases, without the need to operate the function control multiple times in the touch detection area to hit the desired Triggered control action.
  • the media types of the pen head and the pen tail are respectively corresponding to different touch operations.
  • the second medium type characterizing the end of the pen corresponds to an erasing operation that corrects the existing writing track.
  • the pen head and the pen tail can also correspond to touch control operations.
  • the writing track is displayed according to the continuously acquired second infrared touch data until no infrared touch data is acquired.
  • the first processing device according to the updated second infrared touch data, performs The corresponding writing track is displayed on the operation panel of the , which specifically includes:
  • the first processing device continuously acquires the updated second infrared touch count, and displays the corresponding writing track on the operation panel according to the updated second infrared touch count, until it is confirmed that the second infrared touch data is not obtained.
  • the system layer reports the updated second infrared touch data to the application layer that needs to use the infrared touch data to display the writing track.
  • the application layer continues to acquire the updated second infrared touch data, and displays the corresponding writing track on the operation panel according to the updated second infrared touch data, until it is determined that the second infrared touch data is not acquired, and the touch operation is determined this time. completed.
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data, including:
  • the first processing device obtains the operation characteristics of the touch operation of the touch object according to the medium type corresponding to the touch object, and responds to the touch operation of the touch object according to the position information represented by the second infrared touch data.
  • the first processing device pre-records operation characteristics corresponding to different media types, and different operation characteristics correspond to different response modes, and the first processing device determines the operation characteristics corresponding to the media type according to the media type corresponding to the touch object , so as to determine the operation characteristic corresponding to the touch object that triggers this touch operation. Further, according to the position information represented by the second infrared touch data, the touch operation of the touch object is responded to at the position information represented by the second infrared touch data according to the response mode corresponding to the operation characteristic.
  • the touch button icon can be clicked by touching objects of different media types, so as to call up different interactive interfaces, for example, associate material 1 with operation characteristic 1, and associate material 2 with operation characteristic 2
  • a touch operation based on operation characteristic 1 will bring up interface 1
  • a touch operation based on operation characteristic 2 will bring up interface 2.
  • the touch operation through different media types of touch objects can quickly determine the operation characteristics of the touch operation, and the operation characteristics can be set quickly through the touch objects of different media types.
  • the operation process is simple and efficient, and the interaction efficiency of the interactive tablet is improved. .
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data, including: after the first processing device receives the medium type information, according to The second infrared touch data determines the control operated by the touch object, and responds to the control in combination with the medium type of the touch object.
  • the second infrared touch data indicates that the touch position is an annotation control, and when the processing device presets touch objects of different media types to click the annotation control, different annotation programs are invoked. Then, when the infrared touch data feedbacks the touch object to click on the annotation control, the processing device responds according to the medium type of the touch object, and calls the corresponding annotation program.
  • FIG. 10 shows a touch data processing logic diagram provided by an embodiment of the present disclosure, as shown in FIG. 10 , where T is the time span of the touch operation, from TOUCH (time T1) to DOWN (time T3):
  • T is the time span of the touch operation, from TOUCH (time T1) to DOWN (time T3):
  • the second processing device detects the elastic wave signal through the elastic wave sensor, and the second processing device generates the first infrared touch data according to the infrared sensing signal at time T1, which is represented by TOUCH in the figure
  • the time point when the touch object first enters the touch detection area, and DOWN is the time point when the second processing device detects the first frame of infrared touch data after the touch object enters the touch detection area.
  • the second processing device obtains the medium type according to the elastic wave signal and the first infrared touch data at time T2, and sends it to the first processing device.
  • the second processing device starts to report the second infrared touch data (the first frame of infrared touch data and subsequent infrared touch data) to the first processing device at time T3. From DOWN to UP, the second processing device will continue to send the second infrared touch data to the first processing device.
  • the second processing device calculates and obtains the first frame of infrared touch data It will not be reported immediately (to avoid noise points such as dust), but will report the second infrared touch data after continuous calculation of more than two frames of infrared touch data, and it is determined that there is a real touch operation.
  • the first second frame of infrared touch data reported to the first processing device is called the first frame of infrared touch data, that is, the first frame of infrared touch data may be the second frame, the third frame and the third frame calculated by the second processing device.
  • the frame or the fourth frame of infrared touch data, and which frame is specifically reported, is determined by the working characteristics of the second processing device or the infrared touch sensor.
  • the moment T2 is before T3, but it can actually be after T3, depending on the reporting time of the infrared touch data.
  • the first processing device When receiving the second infrared touch data, the first processing device updates the second infrared touch data (time T4 in the figure) according to the medium type, and displays the corresponding writing track on the operation panel according to the updated second infrared touch data . Finally, after the second processing device detects the infrared touch data of the last frame (time T5 in the figure), it is determined that the touch operation is completed.
  • the second processing device actually needs a certain delay from detecting and reporting the DOWN state. There is a finger touching the operation panel, but the second processing device has not yet reported the DOWN state to the first processing device. Case. In this case, the first processing device needs to receive the DOWN state before triggering the identification of the elastic wave data, resulting in a large delay in identifying the medium type. From the perspective of the time axis, this solution is equivalent to starting to collect elastic wave signals in the TOUCH state, then calculating the first infrared touch data at the TOUCH position, and using the elastic wave signals and the first infrared touch data to identify the medium type, effectively reducing The recognition delay for the media type is increased.
  • FIG. 11 is an operation schematic diagram of a touch operation provided by an embodiment of the present disclosure
  • FIG. 12 is a schematic display diagram of a writing track provided by an embodiment of the present disclosure.
  • a touch operation is performed on the operation panel with a writing pen as a touch object
  • the direction of the arrow in Fig. 11 is the moving direction of the writing pen.
  • trigger events, pen down events, writing events and pen up events will occur in sequence, corresponding to the touch trigger state (TOUCH), touch down state (DOWN) and touch movement state ( MOVE) and touch up state (UP).
  • the track A in Fig. 12 is the operation track of the writing pen.
  • the operation track is divided into A1, A2 and A3 according to the moving direction of the writing pen, respectively corresponding to the touch drop state of the writing pen on the operation panel (corresponding to the DOWN point in Fig. 10) , the touch movement state corresponds to the DOWN point in FIG. 10 to the UP point) and the touch lift state corresponds to the UP point in FIG. 10 ), where A0 corresponds to the touch trigger state (corresponds to the TOUCH point in FIG. 10 ).
  • the writing pen did not touch the operation panel, and the elastic wave sensor failed to detect the touching operation of the writing pen on the operation panel.
  • the writing pen touched the operation panel, and the elastic wave detection device detected to the elastic wave signal.
  • the infrared touch sensor can detect infrared touch data during the entire process of pen down, move and up.
  • the second processing device detects the elastic wave signal through the elastic wave sensor at point A0, and the device calculates and obtains the first infrared touch data corresponding to the first moment.
  • the medium type corresponding to the touch object is determined, and sent to the first processing device. Meanwhile, the second processing device calculates and obtains the second infrared touch data sent to the first processing device according to the infrared sensing signal.
  • stage A2 the second processing device sends the second infrared touch data to the first processing device, and the first processing device updates the second infrared touch data received subsequently according to the medium type corresponding to the touch object, and according to the updated
  • the second infrared touch data displays the corresponding writing track on the operation panel of the interactive tablet.
  • the first processing device receives the touch data of the last frame sent by the second processing device, and the touch operation is completed.
  • the writing track displayed on the operation panel is shown as track B in FIG. 12 , wherein track B is divided into B2 and B3, corresponding to A2 and A3 respectively.
  • the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch sensor, and the touch detected by the elastic wave sensor is received after the first moment when the infrared sensing signal is detected.
  • the elastic wave signal generated when the object touches the operation panel, the media type corresponding to the touched object is determined according to the first infrared touch data corresponding to the first moment and the elastic wave signal, and the media type is determined by combining the elastic wave signal and the first infrared touch data to improve the The recognition accuracy of the touch object is improved, and the recognition accuracy of the touch object is improved.
  • the elastic wave signal collected by the elastic wave sensor is acquired, and the medium type is determined according to the elastic wave signal and the first infrared touch data, and the The media type is sent to the first processing device, so that starting from the second moment, after the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device, the first processing device can , different response operations are performed on the second infrared touch data, the response speed of the touch operation is improved, the operation is simple, and the efficiency is high.
  • the first processing device after the first processing device receives the second infrared touch data sent by the second processing device or sends the first infrared touch data to the elastic wave detection device, the first processing device waits within a preset time threshold After receiving the medium type information, correspondingly, the touch data processing method further includes step S1081:
  • the first processing device determines that the medium type information sent by the elastic wave detection device has not been received within the preset time threshold, and directly displays the corresponding writing track on the operation panel according to the second infrared touch data.
  • the first processing device waits for the elastic wave detection device to send the medium type information to it.
  • the elastic wave detection device receives the first infrared touch data, it takes 13-20ms to obtain the medium type in combination with the first infrared touch data and the elastic wave signal and report it to the first processing device. Therefore, a preset time can be set.
  • the time threshold (for example, 20 ms) is used as the time to wait for feedback from the elastic wave detection device.
  • the first processing device determines that the medium type sent by the elastic wave detection device is not received within a preset time threshold (for example, 20ms), it is considered that the elastic wave signal is generated by an interference source, a false alarm event caused by a false touch, or If there is an abnormality in the system or communication, the corresponding writing track is displayed on the operation panel directly according to the infrared touch data, that is, the step of updating the second infrared touch data according to the medium type is not performed, but the original second infrared touch data is The corresponding writing track is displayed on the operation panel.
  • a preset time threshold for example, 20ms
  • step S107 is executed, the second infrared touch data is updated according to the medium type, and the corresponding second infrared touch data is displayed on the operation panel according to the updated second infrared touch count.
  • Writing track When the first processing device does not receive the medium type sent by the elastic wave detection device within the preset time threshold, it directly displays the writing track on the operation panel according to the infrared touch data, so as to avoid false alarm events, system or communication abnormalities caused by If the writing track cannot be displayed, the user's writing experience is guaranteed.
  • the touch data processing method further includes step S1082:
  • the first processing device determines that the medium type information sent by the elastic wave detection device has not been received within the preset time threshold, obtains the medium type information sent by the elastic wave detection device last time, and updates the second infrared touch data according to the medium type information , and display the corresponding writing track on the operation panel according to the updated second infrared touch count.
  • the first processing device waits for the elastic wave detection device to send the medium type information to it. If the first processing device determines that the medium type information sent by the elastic wave detection device has not been received within a preset time threshold (for example, 20ms), and considers that a false alarm event has occurred in the elastic wave detection device or the system or communication is abnormal, the elastic wave detection device is considered to be abnormal.
  • the medium type information sent by the wave detection device last time, the second infrared touch data is updated according to the last medium type information, and the corresponding writing track is displayed on the operation panel according to the updated second infrared touch data.
  • the writing track The display properties of the are the same as the display properties of the last touch operation. If the first processing device determines that the medium type is received within the preset time threshold, step S107 is executed, the second infrared touch data is updated according to the medium type information, and the corresponding number of infrared touches is displayed on the operation panel according to the updated second infrared touch number. writing track.
  • the first processing device does not receive the medium type information sent by the elastic wave detection device within the preset time threshold, it displays the writing track on the operation panel according to the infrared touch data and the last medium type information to avoid false alarm events , The system or communication is abnormal and the writing track cannot be displayed, so as to ensure the user's writing experience.
  • the touch data processing method provided by the embodiment of the present disclosure further includes:
  • the first processing device Before receiving the medium type information, the first processing device responds to the received infrared touch data.
  • the first processing device Before receiving the medium type sent by the elastic wave detection device, the first processing device does not process the subsequent second infrared touch data, but directly responds to the received second infrared touch data, for example, directly obtains the cached second infrared touch data.
  • touch data before receiving the medium type sent by the elastic wave detection device, it is not necessary to update the second infrared touch data, but directly display the corresponding writing track on the operation panel according to the second infrared touch data until the medium is received. Type, and then update the second infrared touch according to the medium type to ensure the normal response to the second infrared touch data, and realize the error correction of the failure to display the writing track normally when the communication between the elastic wave detection devices is abnormal.
  • the second processing device after detecting the last frame of infrared touch data in the infrared touch data, the second processing device continues to confirm the time to start collecting the elastic wave signal according to the detected infrared sensing signal. Specifically, the second processing device will always detect the infrared sensing signal generated by the infrared touch sensor, so that the time of collecting the elastic wave signal can be confirmed according to the infrared sensing signal corresponding to the next touch operation, so as to ensure that the next touch The response timing of the control operation is improved, the response speed to the touch operation is provided, and the response delay is reduced.
  • the infrared touch sensor detects the infrared sensor signal generated when the touch object touches the touch detection area of the interactive tablet, and receives the touch object detected by the elastic wave sensor after the first moment of detecting the infrared sensor signal.
  • the elastic wave signal generated when operating the panel determines the medium type corresponding to the touch object according to the first infrared touch data corresponding to the first moment and the elastic wave signal.
  • the recognition accuracy of the touch object improves the recognition accuracy of the touch object.
  • the elastic wave signal collected by the elastic wave sensor is acquired, and the medium type is determined according to the elastic wave signal and the first infrared touch data, and the The media type is sent to the first processing device, so that starting from the second moment, after the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device, the first processing device can , different response operations are performed on the second infrared touch data, the response speed of the touch operation is improved, the operation is simple, and the efficiency is high.
  • the response to the second infrared touch data is performed only after the medium type is determined, so that false touches occur when the touch object has not yet touched the operation panel.
  • the displayed writing track is closer to the actual touch track of the touch object on the operation panel.
  • the writing track is displayed, it is determined that the touch object has contacted the operation panel to achieve zero writing height of the writing operation, and the writing track can be quickly determined by the medium type.
  • the display properties of the interactive tablet can be quickly achieved by touching objects of different media types, the operation process is simple and efficient, and the interactive efficiency of the interactive tablet is improved.
  • FIG. 13 shows a schematic structural diagram of an interactive tablet provided in this embodiment.
  • the interactive tablet 100 includes at least one operation panel 500 , and in addition, the interactive tablet 100 further includes a first processing device 200 and a second processing device 200 .
  • the device 300 , the infrared touch sensor 400 and the elastic wave detection device 700 , and the infrared touch sensor 400 is connected in communication with the second processing device 300 , and both the second processing device 300 and the elastic wave detection device 700 are connected in communication with the first processing device 200 .
  • the difference between the interactive tablet provided in this embodiment and the interactive tablet provided in FIG. 1 is that the interactive tablet in this embodiment detects an elastic wave signal through an elastic wave detection device.
  • the elastic wave detection device detects an elastic wave signal through one or more elastic waves.
  • the sensor detects one or more elastic wave signals generated when the touch object touches the operation panel of the interactive tablet.
  • the interactive tablet For other settings of the interactive tablet, reference may be made to the interactive tablet provided in the foregoing embodiment, which is not repeated in this embodiment.
  • the second processing device 300 is connected in communication with the elastic wave detection apparatus 700 .
  • the second processing device 300 and the elastic wave detection device 700 are connected in communication with the first processing device 200 .
  • the elastic wave detection device provided in this solution is on the operation panel, and is used to detect the elastic wave signal generated when the touch object touches the operation panel of the interactive tablet.
  • FIG. 14 shows a flowchart of a touch data processing method provided by an embodiment of the present disclosure.
  • the touch data processing method provided by the embodiment of the present disclosure is applied to an interactive tablet.
  • the interactive tablet includes an operation panel, an elastic wave detection device, and an infrared touch panel.
  • a sensor, a first processing device and a second processing device, the infrared touch sensor is arranged on at least one edge of the operation panel to form a touch detection area of the interactive tablet, the interactive tablet further includes an elastic wave detection device, and the elastic wave detection device includes an elastic wave detection device.
  • the wave sensor, the elastic wave detection device and the infrared touch sensor are all connected in communication with the first processing device.
  • the infrared touch sensor is used to generate an infrared sensing signal when a touch object performs a touch operation in the touch detection area of the interactive tablet.
  • the elastic wave detection device is used for generating elastic wave signals when the touch object performs a touch operation in the touch detection area of the interactive tablet.
  • the difference between the touch data processing method provided in this embodiment and the touch data processing method provided in FIG. 2 is that in this embodiment, the elastic wave collection signal is collected by the elastic wave detection device after receiving the notification information, that is, the elastic wave
  • the detection device collects the elastic wave signal through the elastic wave sensor, and the notification information is generated by the second processing device at the first moment when the infrared sensor signal is detected.
  • the step of determining the medium type corresponding to the touch object is performed in the elastic wave detection device.
  • This embodiment mainly describes the difference from the touch data processing method provided in the above-mentioned embodiment. For other steps, reference may be made to the touch data processing method provided in the above-mentioned embodiment, which is not repeated in this embodiment.
  • the touch data processing method provided in this embodiment includes:
  • the elastic wave detection device receives the elastic wave signal generated by the elastic wave sensor, and the elastic wave signal is generated when the touch object contacts the operation panel.
  • the elastic wave detection device receives the elastic wave signal generated by the elastic wave sensor, including:
  • the elastic wave detection device After receiving the notification information, the elastic wave detection device starts to acquire the elastic wave signal generated by the elastic wave sensor.
  • the notification information is sent to the elastic wave detection device by the second processing device, or forwarded to the elastic wave detection device by the first processing device.
  • the second processing device When the second processing device starts to detect the first moment of the infrared sensing signal, it generates notification information and sends it to the elastic wave detection device to notify the elastic wave detection device to collect the elastic wave signal for material identification, which can reduce the delay and improve the response. speed.
  • the notification information is sent to the elastic wave detection device by the second processing device, or forwarded to the elastic wave detection device by the first processing device.
  • the second processing device can directly send notification information to the elastic wave detection device, and when the second processing device is not communicatively connected to the elastic wave detection device, the second processing device , the first processing device sends notification information, and then the first processing device forwards the notification information to the elastic wave detection device.
  • the elastic wave detection device After receiving the notification information sent by the second processing device or the first processing device, the elastic wave detection device starts to collect and buffer the elastic wave signal.
  • the second processing device calculates and obtains first infrared touch data corresponding to the first moment according to the infrared sensing signal; wherein, the first infrared touch data includes touch position information of the touch object.
  • the elastic wave detection device After receiving the first infrared touch data, the elastic wave detection device determines the medium type corresponding to the touched object according to the first infrared touch data and the elastic wave signal.
  • the first infrared touch data is sent to the elastic wave detection device by the second processing device, or forwarded to the elastic wave detection device by the first processing device.
  • the elastic wave detection device After receiving the first infrared touch data corresponding to the first moment, the elastic wave detection device determines the medium type corresponding to the touched object according to the touch position information and/or touch parameter information of the first infrared touch data and the elastic wave signal.
  • the starting point of the elastic wave signal can be determined according to the touch position information of the first infrared touch data, and the material identification signal used for identifying the medium type can be determined according to the starting point.
  • the medium type corresponding to the touch object is determined according to the first infrared touch data and the elastic wave signal provided in this embodiment, including steps S2041-S2044:
  • S2042 Determine noise information according to the elastic wave signal before the vibration point.
  • S2044 The touch position information and the material identification signal of the first infrared touch data are used to determine the medium type and confidence interval corresponding to the touch object.
  • the medium type corresponding to the touch object is determined according to the first infrared touch data and the elastic wave signal.
  • the specific determination method of the medium type refer to the touch data processing method provided in the above embodiment, and this embodiment does not Repeat.
  • step S2044 is specifically: input the touch position information and the material recognition signal into the trained feature recognition model, and obtain the corresponding touch object. Media type and confidence interval.
  • Step S2044 includes:
  • S20441 Fusion processing the material identification signals corresponding to the multiple elastic wave signals to obtain a preprocessed signal; input the touch position information and the preprocessed signal into the trained feature recognition model to obtain the media type and confidence corresponding to the touch object interval.
  • step S2044 includes:
  • S20442 After the feature extraction is performed on the material identification signal, modify the material identification signal according to the touch position information in the first infrared touch data.
  • a feature database is preset in the elastic wave detection device, and the feature database records the correspondence between preset features and preset medium types.
  • the corresponding relationship between the preset feature and the preset media type may be recorded in the form of a key-value pair.
  • the elastic wave detection device performs feature extraction on the material identification signal.
  • the touch position information in the first infrared touch data is determined, and the extracted features are corrected according to the touch position information.
  • the corrected features are matched and compared in the preset feature database, and when the preset features that are consistent or the similarity reaches the set similarity requirement are matched, the preset features correspond to the preset features.
  • the preset media type is determined as the media type corresponding to the touch object.
  • the touch data processing method in the step of obtaining the media type and confidence interval corresponding to the touch object, at least two media types are obtained, and the confidence interval corresponding to each media type is lower than the set confidence threshold. Based on this, the touch data processing method provided in this embodiment further includes:
  • the elastic wave detection device After correcting at least two medium types according to the first infrared touch data, the elastic wave detection device determines one of the medium types as the medium type corresponding to the touch object.
  • the elastic wave detection device obtains two or more medium types through the feature identification model or feature database, and when the confidence interval corresponding to each medium type is lower than the set confidence threshold, these medium types are corrected, and one of them is determined.
  • media type as the media type corresponding to the touch object.
  • the touch data processing method in the step of obtaining the media type corresponding to the touch object and the confidence interval, the obtained confidence interval of the media type is lower than the set confidence threshold.
  • the touch data processing method provided in this embodiment further includes:
  • the first processing device determines, according to the touch position information of the infrared touch data, whether the current touch operation is associated with the last lifted touch operation, and if so, obtains the media type corresponding to the last touch operation, The medium type corresponding to the touch object.
  • the first processing device determines the medium type corresponding to the touch object according to whether the current touch operation is associated with the previous touch operation.
  • the method before the elastic wave detection device receives the first infrared touch data, the method further includes:
  • the elastic wave detection device preprocesses the elastic wave signal to obtain a preprocessing result.
  • the elastic wave detection device determines the medium type corresponding to the touched object according to the first infrared touch data and the elastic wave signal, specifically:
  • the elastic wave detection device After receiving the first infrared touch data, the elastic wave detection device determines the medium type corresponding to the touch object according to the first infrared touch data and the preprocessing result.
  • the elastic wave detection apparatus sends medium type information to the first processing device, where the medium type information includes a medium type corresponding to the touch object.
  • the elastic wave detection device After determining the medium type corresponding to the touch object according to the first infrared touch data and the elastic wave signal, the elastic wave detection device generates medium type information including the medium type according to the medium type corresponding to the touch object, and sends the information to the first processing device. Media type information.
  • the second processing device calculates and obtains the second infrared touch data sent to the first processing device according to the infrared sensing signal.
  • Step S206 includes:
  • the second processing device calculates and obtains corresponding infrared touch data according to the infrared sensing signal.
  • S2062 According to the infrared touch data obtained by calculation, confirm the first frame of infrared touch data corresponding to the touch operation, and obtain the first frame of infrared touch data and each subsequent frame of infrared touch data as the second infrared touch data; in the first frame of infrared touch data
  • the touch state information of the touch object indicates that the touch state of the touch object is the touch drop state.
  • the touch data processing method provided in this embodiment further includes:
  • the elastic wave detection device After calibrating at least two medium types according to the first infrared touch data, the elastic wave detection device determines one of the medium types as the medium type corresponding to the touch object.
  • the second processing device starts from the second time and sends the second infrared touch data to the first processing device; wherein the second time is after the first time.
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data, including steps S2081-S2082:
  • the first processing device updates the second infrared touch data according to the medium type corresponding to the touch object.
  • the first processing device displays the corresponding writing track on the operation panel of the interactive tablet according to the updated second infrared touch data.
  • FIG. 19 provides a schematic diagram of the hardware structure of an interactive tablet.
  • the first processing device 200 is provided with a system layer and an application layer, wherein the system layer is used to perform data processing at the data level, such as receiving
  • the application layer is used to perform data processing at the application level, such as analysis and processing according to application task requirements.
  • the system layer sends the data processing results to the application layer through the data interface. It is then distributed to specific applications through the data interface, and further processed by the specific applications.
  • the step of updating the second infrared touch data received subsequently is processed at the system layer, and according to the updated second infrared touch data, in the interaction
  • the step of displaying the corresponding writing track on the operation panel 500 of the tablet is processed at the application layer. That is, after completing the update of the second infrared touch data, the system layer reports the updated second infrared touch data to the application layer, and the application layer distributes the updated second infrared touch data to the whiteboard application, which is executed by the whiteboard application.
  • the next step is to display the writing track.
  • the system layer can run the driver program of the first processing device 200, and the application layer can run the application programs installed by the first processing device 200, including the aforementioned whiteboard application, interactive tablet annotation application or other writing applications.
  • the driver reads the cached second infrared touch data in sequence according to the first-in-first-out order, updates the read second infrared touch data according to the medium type, and sends the updated second infrared touch data to the application layer.
  • the layer then sends the updated second infrared touch data to the application program.
  • the application program receives the updated second infrared touch data, it responds, draws a corresponding writing track, and displays it on the operation panel 500 .
  • corresponding standard touch parameter information (including standard touch height information and standard touch width information) is determined in advance for different media types.
  • a second infrared touch data update process is provided in FIG. 20 .
  • the first processing device updates the second infrared touch data according to the medium type corresponding to the touch object, which specifically includes steps S20811-S20812:
  • the first processing device determines standard touch parameter information of the medium type according to the medium type corresponding to the touch object.
  • S20812 Update touch parameter information of the second infrared touch data to standard touch parameter information to obtain updated second infrared touch data.
  • the first processing device updates the second infrared touch data according to the media type corresponding to the touch object, which specifically includes step S20813:
  • the first processing device writes the media type corresponding to the touch object into the data packet of the second infrared touch data to obtain updated second infrared touch data.
  • the display attribute of the writing track may be determined based on the second infrared touch data.
  • the first processing device displays the corresponding second infrared touch data on the operation panel of the interactive tablet according to the updated second infrared touch data.
  • Writing track which specifically includes step S20821:
  • the first processing device reads the touch state information, touch position information and touch parameter information of each frame of data of the updated second infrared touch data, and when the touch state information indicates that the touch state is a touch movement state, according to the touch parameter information
  • the corresponding display attribute displays the corresponding writing track at the position indicated by the touch position information.
  • the writing track is displayed according to the continuously acquired second infrared touch data until no infrared touch data is acquired.
  • the first processing device according to the updated second infrared touch data, performs The corresponding writing track is displayed on the operation panel of the , which specifically includes:
  • S20822 The first processing device continues to obtain the updated second infrared touch count, and displays the corresponding writing track on the operation panel according to the updated second infrared touch count, until it is confirmed that the second infrared touch data is not obtained.
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data, including:
  • the first processing device obtains the operation characteristic of the touch operation of the touch object according to the medium type corresponding to the touch object, and responds to the touch operation of the touch object according to the position information represented by the second infrared touch data.
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data, including: after the first processing device receives the medium type information, according to The second infrared touch data determines the control operated by the touch object, and responds to the control in combination with the medium type of the touch object.
  • FIG. 21 shows a logic diagram of touch data processing provided by an embodiment of the present disclosure.
  • T is the time span of the touch operation, from TOUCH (time T1) to DOWN (time T3):
  • the second processing device starts to detect the infrared sensing signal, and the second processing device sends notification information to the elastic wave detection device at time T1' to notify the elastic wave detection device that the detection elastic wave signal, and the second processing device generates first infrared touch data according to the infrared sensing signal, and sends it to the elastic wave detection device.
  • TOUCH in the figure represents the time point when the touch object first enters the touch detection area
  • DOWN is the time point when the second processing device detects the first frame of infrared touch data after the touch object enters the touch detection area.
  • the elastic wave detection device obtains the medium type according to the elastic wave signal and the first infrared touch data at time T2, and sends it to the first processing device.
  • the second processing device starts to report the second infrared touch data (the first frame of infrared touch data and subsequent infrared touch data) to the first processing device at time T3. From DOWN to UP, the second processing device will continue to send the second infrared touch data to the first processing device.
  • the second processing device In actual processing, there will be a time gap of several frames of infrared touch data between the second processing device detects the first frame of infrared touch data and reports the second infrared touch data. After the second processing device calculates and obtains the first frame of infrared touch data It will not be reported immediately (to avoid noise points such as dust), but will report the second infrared touch data after continuous calculation of more than two frames of infrared touch data, and it is determined that there is a real touch operation.
  • the first second frame of infrared touch data reported to the first processing device is called the first frame of infrared touch data, that is, the first frame of infrared touch data may be the second frame, the third frame and the third frame calculated by the second processing device.
  • the frame or the fourth frame of infrared touch data, and which frame is specifically reported, is determined by the working characteristics of the second processing device or the infrared touch sensor.
  • the first processing device When receiving the second infrared touch data, the first processing device updates the second infrared touch data (time T10 in the figure) according to the medium type, and displays the corresponding writing track on the operation panel according to the updated second infrared touch data (starting from time T11 in the figure). Finally, after the second processing device detects the infrared touch data of the last frame (time T12 in the figure), it is determined that the touch operation is completed.
  • the second processing device after detecting the last frame of infrared touch data in the infrared touch data, the second processing device continues to confirm the time to start collecting the elastic wave signal according to the detected infrared sensing signal. Specifically, the second processing device will always detect the infrared sensing signal generated by the infrared touch sensor, so that the time of collecting the elastic wave signal can be confirmed according to the infrared sensing signal corresponding to the next touch operation, so as to ensure that the next touch The response timing of the control operation is improved, the response speed to the touch operation is provided, and the response delay is reduced.
  • the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch sensor, and the infrared sensing signal is sent to the second processing unit after the first moment when the infrared sensing signal is detected.
  • the second processing device calculates the first infrared touch data sent to the elastic wave detection device according to the infrared sensing signal, detects the elastic wave signal generated when the touch object touches the operation panel through the elastic wave detection device, and corresponds to the first time according to the first time.
  • the first infrared touch data and the elastic wave signal of the device determine the medium type corresponding to the touch object, and by combining the elastic wave signal and the first infrared touch data to determine the medium type, the recognition accuracy of the touch object is improved, and the recognition accuracy of the touch object is improved.
  • the elastic wave detection device collects the elastic wave signal, judges the medium type according to the elastic wave signal and the first infrared touch data, and sends the medium type
  • the first processing device can, according to different media types
  • the second infrared touch data performs different response operations, which improves the response speed of the touch operation, and has simple operation and high efficiency.
  • the response to the second infrared touch data is performed only after the medium type is determined, so that false touches occur when the touch object has not yet touched the operation panel.
  • the displayed writing track is closer to the actual touch track of the touch object on the operation panel.
  • the writing track is displayed, it is determined that the touch object has contacted the operation panel to achieve zero writing height of the writing operation, and the writing track can be quickly determined by the medium type.
  • the display properties of the interactive tablet can be quickly achieved by touching objects of different media types, the operation process is simple and efficient, and the interactive efficiency of the interactive tablet is improved.
  • FIG. 22 is a structural block diagram of an interactive tablet provided by an embodiment of the present disclosure.
  • the interactive tablet can be used to execute the touch data processing method provided by any of the above-mentioned embodiments.
  • the interactive tablet includes an operation panel, an infrared touch sensor, a first processing device and a second processing device, and the infrared touch sensor is arranged at At least one edge of the panel is operated to form a touch detection area of the interactive tablet, wherein the interactive tablet further includes an elastic wave sensor, and both the elastic wave sensor and the infrared touch sensor are connected to the second processing device.
  • an infrared touch sensor which is used to generate an infrared sensing signal from the first moment when the touch object performs a touch operation in the touch detection area, and send it to the second processing device;
  • the second processing device is configured to start to acquire the elastic wave signal generated by the elastic wave sensor after the first time, the elastic wave signal is generated when the touch object contacts the operation panel;
  • the medium type corresponding to the touch object is determined according to the first infrared touch data and the elastic wave signal, wherein the first infrared touch data includes the touch of the touch object location information;
  • the medium type information includes the medium type corresponding to the touch object
  • the second infrared touch data is sent to the first processing device; wherein the second moment is after the moment of receiving the elastic wave signal;
  • the first processing device responds to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch sensor, and the touch detected by the elastic wave sensor is received after the first moment when the infrared sensing signal is detected.
  • the elastic wave signal generated when the object touches the operation panel, the media type corresponding to the touched object is determined according to the first infrared touch data corresponding to the first moment and the elastic wave signal, and the media type is determined by combining the elastic wave signal and the first infrared touch data to improve the The recognition accuracy of the touch object is improved, and the recognition accuracy of the touch object is improved.
  • the elastic wave signal collected by the elastic wave sensor is acquired, and the medium type is determined according to the elastic wave signal and the first infrared touch data, and the The media type is sent to the first processing device, so that starting from the second moment, after the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device, the first processing device can , different response operations are performed on the second infrared touch data, the response speed of the touch operation is improved, the operation is simple, and the efficiency is high.
  • the foregoing embodiments for example, the touch data processing method in the embodiment of FIG. 2 ), which will not be repeated in this disclosure.
  • FIG. 23 is a structural block diagram of an interactive tablet provided by an embodiment of the present disclosure.
  • the interactive tablet can be used to execute the touch data processing method provided in any of the above-mentioned embodiments.
  • the interactive tablet includes an operation panel, an infrared touch sensor, a first processing device and a second processing device, and the infrared touch sensor is arranged at At least one edge of the panel is operated to form a touch detection area of the interactive tablet, wherein the interactive tablet further includes an elastic wave detection device, and the elastic wave detection device includes an elastic wave sensor.
  • an infrared touch sensor used for when the touch object performs a touch operation in the touch detection area of the interactive tablet, the infrared touch sensor starts to generate an infrared sensing signal from the first moment, and sends it to the second processing device;
  • the second processing device calculates and obtains first infrared touch data corresponding to the first moment according to the infrared sensing signal; wherein the first infrared touch data includes touch position information of the touch object; and
  • the second infrared touch data is sent to the first processing device; wherein, the second moment is after the first moment;
  • an elastic wave detection device for receiving an elastic wave signal generated by an elastic wave sensor, and the elastic wave signal is generated when a touch object touches an operation panel;
  • the medium type corresponding to the touch object is determined according to the first infrared touch data and the elastic wave signal; wherein, the first infrared touch data is sent by the second processing device to the elastic wave detection device, or the first infrared touch data is sent to the elastic wave detection device by the first processing device forwards to the elastic wave detection device; and
  • the first processing device is configured to respond to the touch operation of the touch object according to the medium type corresponding to the touch object and the second infrared touch data.
  • the infrared sensing signal generated when the touch object touches the touch detection area of the interactive tablet is detected by the infrared touch sensor, and the infrared sensing signal is sent to the second processing unit after the first moment when the infrared sensing signal is detected.
  • the second processing device calculates the first infrared touch data sent to the elastic wave detection device according to the infrared sensing signal, detects the elastic wave signal generated when the touch object touches the operation panel through the elastic wave detection device, and corresponds to the first time according to the first time.
  • the first infrared touch data and the elastic wave signal of the device determine the medium type corresponding to the touch object, and by combining the elastic wave signal and the first infrared touch data to determine the medium type, the recognition accuracy of the touch object is improved, and the recognition accuracy of the touch object is improved.
  • the elastic wave detection device collects the elastic wave signal, judges the medium type according to the elastic wave signal and the first infrared touch data, and sends the medium type
  • the second processing device reports the second infrared touch data representing the valid touch operation to the first processing device from the second moment
  • the first processing device can, according to different media types
  • the two infrared touch data perform different response operations, which improves the response speed of the touch operation, and the operation is simple and efficient.
  • Embodiments of the present disclosure also provide a readable storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to execute the touch data processing method provided by the above embodiments.
  • storage medium any of various types of memory devices or storage devices.
  • storage medium is intended to include: installation media, such as CD-ROMs, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc.
  • the storage medium may also include other types of memory or combinations thereof.
  • the storage medium may be located in the first computer system in which the program is executed, or may be located in a second, different computer system connected to the first computer system through a network such as the Internet.
  • the second computer system may provide program instructions to the first computer for execution.
  • storage medium may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network).
  • the storage medium may store program instructions (eg, embodied as a computer program) executable by one or more processors.
  • a readable storage medium containing computer-executable instructions provided by an embodiment of the present disclosure is not limited to the touch data processing method provided above, and the computer-executable instructions can also execute the touch data provided by any embodiment of the present disclosure.
  • the related operations in the processing method are not limited to the touch data processing method provided above, and the computer-executable instructions can also execute the touch data provided by any embodiment of the present disclosure. The related operations in the processing method.
  • the interactive tablet and storage medium provided in the above embodiments can perform the touch data processing method provided by any embodiment of the present disclosure.
  • touch data provided by any embodiment of the present disclosure. Approach.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Quality & Reliability (AREA)
  • Human Computer Interaction (AREA)
  • Manufacturing & Machinery (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种触摸数据处理方法及交互平板,通过在开始检测到红外传感信号的第一时刻之后,就开始接收获取所述弹性波传感器所产生的弹性波信号,根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,并根据红外传感信号计算获得发送给第一处理设备的第二红外触摸数据,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,在开始检测到红外传感信号后,就利用弹性波信号并进行介质类型的识别,有效减少对弹性波信号进行识别所带来的延时,提高对触控操作的响应速度。

Description

一种触摸数据处理方法及交互平板 技术领域
本公开实施例涉及电子设备控制技术领域,尤其涉及一种触摸数据处理方法及交互平板。
背景技术
利用红外触摸框在操作面板上进行触控操作,是交互平板常用的触控方式之一,红外触摸框是通过安装在交互平板的操作面板四周的红外触控传感器——红外发射器和红外接收器,由红外发射器和红外接收器识别在操作面板上进行的触控操作,以识别触摸物在操作面板上的接触面积、位置、移动速度等,得到相应的红外触摸数据,并发送至交互平板。交互平板根据红外触摸数据执行相应的操作,例如根据触摸物的移动轨迹在交互平板的操作面板上显示对应的书写轨迹。
交互平板在使用过程中,对触控操作的响应基本只有基于触控轨迹的具体输入判断,例如基于触控轨迹的轨迹输入或简单指令接收,当要改变触控轨迹的输入效果或实现较为复杂的控制指令时,需要根据多个触控输入的组合才能实现目标控制,例如对于书写过程来说,进行书写轨迹的显示属性设置时,需要较为复杂的触控操作组合才能实现设置目标,操作较为繁琐,效率较低。
发明内容
本公开实施例提供一种触摸数据处理方法及交互平板,以解决现有技术中交互平板需要较为复杂的触控操作组合才能实现设置目标,操作较为繁琐,效率较低的技术问题。
在第一方面,本公开实施例提供了一种触摸数据处理方法,应用于交互平板,所述交互平板包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,所述交互平板还包括弹性波传感器,所述弹性波传感器、所述红外触控传感器均与所述第二处理设备连接,所述方法包括:
当触摸物在所述触控检测区域进行触控操作时,所述红外触控传感器从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
所述第二处理设备从第一时刻之后,开始获取所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;
所述第二处理设备根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型,其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;
所述第二处理设备向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;
所述第二处理设备从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在接收所述弹性波信号的时刻之后;
所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
本公开实施例通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,就接收弹性波传感器检测到的触摸物接触操作面板时产生的弹性波信号,根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,就开始获取弹性波传感器所采集的弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。
在第二方面,本公开实施例提供了一种触摸数据处理方法,应用于交互平板,所述交互平板包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,所述交互平板还包括弹性波检测装置,所述弹性波检测装置包括弹性波传感器,所述方法包括:
当触摸物在所述交互平板的触控检测区域进行触控操作时,所述红外触控传感器从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
所述弹性波检测装置接收所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;
所述第二处理设备根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据;其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;
所述弹性波检测装置接收到所述第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型;其中,所述第一红外触摸数据由所述第二 处理设备发送至所述弹性波检测装置,或者由所述第一处理设备转发至所述弹性波检测装置;
所述弹性波检测装置向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;
所述第二处理设备从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在所述第一时刻之后;
所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
本公开实施例通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,发送红外传感信号给第二处理设备,由第二处理设备根据红外传感信号计算发送给弹性波检测装置的第一红外触摸数据,通过弹性波检测装置检测触摸物接触操作面板时产生的弹性波信号,并根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,弹性波检测装置就采集弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。
在第三方面,本公开实施例提供了一种交互平板,包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,所述交互平板还包括弹性波传感器,所述弹性波传感器、所述红外触控传感器均与所述第二处理设备连接;
所述红外触控传感器,用于当触摸物在所述触控检测区域进行触控操作时,从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
所述第二处理设备,用于从第一时刻之后,开始获取所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;以及
根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型,其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;以及
向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;以及
从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在接收所述弹性波信号的时刻之后;
所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
本公开实施例通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,就接收弹性波传感器检测到的触摸物接触操作面板时产生的弹性波信号,根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,就开始获取弹性波传感器所采集的弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。
在第四方面,本公开实施例提供了一种交互平板,包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,所述交互平板还包括弹性波检测装置,所述弹性波检测装置包括弹性波传感器;
所述红外触控传感器,用于当触摸物在所述交互平板的触控检测区域进行触控操作时,所述红外触控传感器从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
所述第二处理设备,根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据;其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;以及
从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在所述第一时刻之后;
所述弹性波检测装置,用于接收所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;以及
在接收到所述第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型;其中,所述第一红外触摸数据由所述第二处理设备发送至所述弹性波检测装置,或者由所述第一处理设备转发至所述弹性波检测装置;以及
向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;
所述第一处理设备用于根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
本公开实施例通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,发送红外传感信号给第二处理设备,由第二处理设备根据红外传感信号计算发送给弹性波检测装置的第一红外触摸数据,通过弹性波检测装置检测触摸物接触操作面板时产生的弹性波信号,并根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,弹性波检测装置就采集弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。
附图说明
图1是本公开实施例提供的一种交互平板的结构示意图;
图2是本公开实施例提供的一种触摸数据处理方法的流程图;
图3是本公开实施例提供的一种红外触控传感器的检测原理示意图;
图4是本公开实施例提供的一种介质类型的确定流程示意图;
图5是本公开实施例提供的一种利用特征数据库确定介质类型的流程示意图;
图6是本公开实施例提供的一种第二红外触摸数据确定流程示意图;
图7是本公开实施例提供的一种提供的一种触控操作响应流程示意图;
图8是本公开实施例提供的一种交互平板的硬件结构示意图;
图9是本公开实施例提供的一种第二红外触摸数据更新流程示意图;
图10是本公开实施例提供的一种触摸数据处理逻辑图;
图11是本公开实施例提供的一种触控操作的操作示意图;
图12是本公开实施例提供的一种书写轨迹的显示示意图;
图13是本公开实施例提供的一种交互平板的结构示意图;
图14是本公开实施例提供的一种触摸数据处理方法的流程图;
图15是本公开实施例提供的一种弹性波信号接收流程示意图;
图16是本公开实施例提供的一种介质类型的确定流程示意图;
图17是本公开实施例提供的一种利用特征数据库确定介质类型的流程示意图;
图18是本公开实施例提供的一种第二红外触摸数据确定流程示意图;
图19是本公开实施例提供的一种交互平板的硬件结构示意图;
图20是本公开实施例提供的一种第二红外触摸数据更新流程示意图;
图21是本公开实施例提供的一种触摸数据处理逻辑图;
图22是本公开实施例提供的一种交互平板的结构框图;
图23是本公开实施例提供的一种交互平板的结构框图。
具体实施方式
为了使本公开的目的、技术方案和优点更加清楚,下面结合附图对本公开具体实施例作进一步的详细描述。可以理解的是,此处所描述的具体实施例仅仅用于解释本公开,而非对本公开的限定。为了便于描述,附图中仅示出了与本公开相关的部分而非全部内容。在更加详细地讨论示例性实施例之前应当提到的是,一些示例性实施例被描述成作为流程图描绘的处理或方法。虽然流程图将各项操作(或步骤)描述成顺序的处理,但是其中的许多操作可以被并行地、并发地或者同时实施。此外,各项操作的顺序可以被重新安排。当其操作完成时所述处理可以被终止,但是还可以具有未包括在附图中的附加步骤。所述处理可以对应于方法、函数、规程、子例程、子程序等等。
需要说明的是,在本公开中,诸如第一和第二之类的关系术语仅仅用来将一个实体或操作或对象与另一个实体或操作或对象区分开来,而不一定要求或者暗示这些实体或操作或对象之前存在任何这种实际的关系或顺序。例如,第一介质类型和第二介质类型的“第一”和“第二”用来区分两个不同介质类型,例如书写笔的笔尖和笔尾。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本公开中的具体含义。此外,在本公开的描述中,除非另有说明,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
为了便于理解,实施例中以交互平板为实际载体,示例性描述触摸数据处理方法实施时触控操作的检测、触控操作的判断和触控操作的响应显示的详细过程。对于交互平板可以是通过触控技术对显示在显示平板上的内容进行操控和实现人机交互操作的一体化设备,其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。
图1给出了本实施例提供的一种交互平板的结构示意图,如图1所示,交互平板100包 括至少一块操作面板500,另外,交互平板100还包括第一处理设备200、第二处理设备300、红外触控传感器400和弹性波传感器600,并且弹性波传感器600、红外触控传感器400均与第二处理设备300通信连接。其中,操作面板可以是覆盖在交互平板的显示屏上的玻璃面板,可选的,交互平板可以是智慧黑板,智慧黑板包括普通黑板和显示屏,操作面板500下方可以没有显示屏,而是一块传统的普通黑板,通过设置红外触控传感器400,在黑板书写的数据,可以通过显示屏显示。另外,操作面板500下方也可以是显示屏。红外触控传感器400设置于交互平板100的至少一个边缘(可以是交互平板100的四周,也可以是交互平板100的其中两个侧边,如果红外触控传感器400是反射式传感器,红外触控传感器400也可以设置在交互平板100的一侧边)以形成交互平板100的触控检测区域。交互平板100的四周是指交互平板100的四边。触控检测区域是用于检测发生在交互平板100上的触控操作的区域,是一个物理意义上的区域,如果交互平板100的边框比较窄,操作面板500靠近交互平板100的边框处,则红外触控传感器400可看做是设置在操作面板500的四周的相应位置,具体应用中,可以根据实际需要检测的区域来设置红外触控传感器400的位置,可以是只设置在操作面板500的周围,也可以是设置在整个交互平板100的周围。红外触控传感器400可检测到触摸物在触控检测区域上的任何位置进行触控操作,并所产生红外传感信号。第二处理设备300可根据红外传感信号计算获得红外触摸数据,第二处理设备300与第一处理设备200通信连接。可以理解的是,本公开提供的第一处理设备200和第二处理设备300可以是分别通过独立的芯片来实现,也可以是通过一个集成芯片来同时实现,即将第一处理设备200和第二处理设备300集成在一个芯片中。例如在集成芯片具备足够的处理能力(满足第一处理设备200和第二处理设备300的处理性能要求)时,可采用一个集成芯片来实现本公开中第一处理设备200和第二处理设备300对应的功能。
用户可以通过手指或书写笔等作为触摸物触控操作面板的方式实现触控操作,相应的,红外触控传感器400检测到触摸物在交互平板100的触控检测区域的触控操作,产生红外传感信号,第二处理设备300根据红外传感信号,计算获得红外触摸数据,并发送到第一处理设备200,第一处理设备200接收到红外触摸数据后,根据红外触摸数据表征的触控位置进行响应,以实现触控功能。典型的,交互平板安装有至少一种操作***,其中,操作***包括但不限定于安卓***、Linux***及Windows***。进一步的,交互平板可以安装至少一个具有书写功能的应用程序。其中,该应用程序可以为操作***自带的应用程序,同时,也安装有从第三方设备或者服务器中下载的应用程序。可选的,应用程序除具备基于触控操作的书写功能外,还具有其他编辑功能,如***表格、***图片、插图图形、绘制表格、绘制图形等功能。
交互平板的操作面板中显示的图形界面,对应于检测用户操作的触控检测区域在操作面板上的投射区域(即触控检测区域在图形界面的前方)。在触控检测区域进行触控操作时,如通过书写笔或手指接触交互平板的操作面板,红外触控传感器400可以感应到红外光的变化,得到含有触摸位置的坐标的触摸信号以及该触摸信号的触发时间,根据触摸位置的坐标以及触摸信号的触发时间,可以得到反映书写笔或用户手指每次落入书写至抬起停止书写过程中输入的书写轨迹的红外触摸数据,根据红外触摸数据在操作面板的图形界面实时显示用户输入的书写轨迹。当然,书写过程不限于写字,在交互平板的操作面板实现的任何用于显示操作轨迹的录入过程均可视为书写过程。此外根据触摸操作的发生位置的显示元素的不同,触摸操作可以响应为用户的点击、拖拽等操作。这些不同的响应方式在底层的坐标处理方式是相同的,最终从视觉上会导致操作面板中显示的画面的变化。基于触摸和显示等基本功能的硬件实现,可以实现交互平板的各种交互显示设计。
以在白板应用使用过程中呈现的图形界面,即白板应用的界面中进行的触控操作为示例进行阐述。如前所述,白板应用指供用户进行书写、展示等操作的应用,可以用于根据用户在白板应用的界面的书写操作(触控操作)生成书写笔迹,也可以用于在白板应用的界面***和显示多媒体元素,多媒体元素可以包括图形、图像、表格、文档、音频文件和/或视频文件。在白板应用的界面中,用户可以实现与实体黑板类似的写、画、擦除等操作,并进一步有更好的移动、保存、缩放、***图片、颜色调整、笔画粗细设置等数字化功能。在实际应用中,白板应用也可以命名为书写应用、电子白板应用、协同白板应用等名称,不管名称如何改变,只要用于实现上述功能的应用,均等同于本公开的白板应用。
本方案提供的弹性波传感器设置在操作面板上,用于检测触摸物在触碰交互平板的操作面板时生成的弹性波信号。例如,在操作面板边框处或盖板内侧安装压电式的弹性波传感器,当触摸物在操作面板上触碰时,会产生具有特征的弹性波信号,该弹性波信号从接触点开始,沿着操作面板向四周传播,或者向操作面板内侧传播。位于操作面板边框处或盖板内侧的压电式弹性波传感器可以将原始弹性波信号转换为电压信号,并将电压信号发送给第二处理设备,通过第二处理设备将电压信号传输至具有温度补偿电路的IC芯片中进行放大处理,并通过模数转换电路转换为数字的弹性波信号。另外,也可以采用电容式弹性波传感器,这种实施方式中,位于操作面板边框处或盖板内侧的电容式弹性波传感器可以将原始弹性波信号转换为电信号(这里体现为电容的变化),并将电信号发送给第二处理设备,通过第二处理设备将电信号传输至具有温度补偿电路的IC芯片中进行放大处理,并通过模数转换电路转换为数字的弹性波信号。需要说明的是,本方案对弹性波检测装置设置的位置不做具体的限定,只要能够实现检测触摸物触摸交互平板的显示屏产生的弹性波信号即可。
对于音频以下的机械振动,音频范围的声音,超过音频的超声波,这些都是气体、液体、固体等介质的波动现象,相对于光和电磁波来说,这种波动现象叫做弹性波。对于弹性波信号的检测,通过弹性波传感器完成,弹性波传感器具体安装在可以传递操作面板发生的振动的位置,从而实现对操作面板上触控物体触碰到操作面板的事件,而不一定安装在发生振动的位置。例如可以在操作面板的4个角布置弹性波传感器,当然也可以有其它的布置方式,例如在操作面板的矩形边框每条边的中点设置,数量也可以是其它数量,例如2个、5个,只要弹性波传感器能够检测到触控操作过程中触摸物与操作面板接触时的振动,具体布置的数量可以根据操作面板的尺寸和检测精度进行针对性设置,一般来说,操作面板的尺寸越大,检测精度要求越高,弹性波传感器设置的数量越多。弹性波传感器可以直接安装在操作面板的表面,例如直接安装在操作面板的上表面或者操作面板的下表面,从而接收由操作面板传递的振动,提高触碰检测的精确度。弹性波传感器还可以安装在操作面板的边框内,减少对内部机构的影响,同时减少来自操作面板的共模噪声干扰。当然,弹性波传感器也可以安装在与操作面板相接触的其他部件上,通过其他部件的传递接收发生在操作面板的振动。
从弹性波产生的源头而言,包括交互平板内各种产生噪声的元件(如马达、喇叭、风扇等)和交互平板外部产生噪声的设备(如室内空调、电视等),这些元件在使用的过程中,会导致交互平板产生非用户控制本意的弹性波。通过元件的类别,可以确认该元件产生噪声的方式,例如,喇叭所产生的噪声主要来自于其发出声音时所导致的交互平板整体介质中产生弹性波,对于弹性波传感器而言,可以随时检测到各种弹性波信号,但是其中有很多并不是来自于触控操作本身。
图2给出了本公开实施例提供的一种触摸数据处理方法的流程图,本公开实施例提供的触摸数据处理方法应用于交互平板,该交互平板可以是两个或多个物理实体构成,也可以是一个物理实体构成。例如交互平板可以是手机、会议平板、教学平板、工业控制计算机等,用于实现对人机交互过程中的内容显示和交互响应。
参考图2,本实施例提供的触摸数据处理方法包括:
S101:当触摸物在触控检测区域进行触控操作时,红外触控传感器从第一时刻开始产生红外传感信号,并发送给第二处理设备。
在本实施例中,交互平板包括操作面板、红外触控传感器、第一处理设备、第二处理设备和弹性波传感器,其中,弹性波传感器、红外触控传感器均与第二处理设备连接,第二处理设备与第一处理设备连接。红外触控传感器用于在触摸物在交互平板的触控检测区域进行触控操作时,产生红外传感信号。当触摸物在交互平板的触控检测区域进行触控操作时,红外触控传感器所产生的红外传感信号将会是一个连续的信号,这里的连续,并不是指在时序 上完全不间断,而是指按照时序关系存在多个信号。例如,信号的时长为1s,表现形式为每隔一定时间间隔的多个信号值。例如,每间隔1ms的传感信号值。这里的1s和1ms仅是示例,实际上分别是根据触控操作的操作时长、红外触控传感器的工作特性而定。弹性波传感器用于在触摸物接触交互平板的操作面板时,产生弹性波信号。
其中,红外传感信号实可以是红外阻挡信号(通过红外触控传感器检测),也可以是红外反射信号(通过反射式红外传感器检测),本公开以红外阻挡信号为例进行描述。示例性的,为实现操作面板的触控功能,在操作面板表面的四周设置红外触控传感器,当触摸物触碰操作面板时,红外触控传感器通过光信号扫描触摸物,当触摸物在交互平板的触控检测区域进行触控操作时,红外触控传感器产生红外传感信号。具体的,红外触控传感器包括红外发射器与红外接收器,红外发射器用于发射红外光,红外接收器用于接收红外光,利用不同方向上密布的红外光线形成光束栅格来定位触摸点。示例性的,操作面板水平方向一侧设置M个红外发射器,垂直方向一侧设置N个红外发射器,对应的,水平方向另一侧设置M个红外接收器,垂直方向另一侧设置N个红外接收器,红外发射器以一定频率发射红外光,对应的红外接收器以一定频率接收红外光。当触摸物触碰操作面板时,触摸物会完全或部分遮挡一个或多个垂直水平的红外光,然后得到一张M*N的红外光强像素图。首先,在红外光强像素图上找到大于第一光强阈值的位置,第一光强阈值表示真实有效的触碰,而非噪声或者物体接近而未完全触碰时半遮挡红外光时测得的光强,真实触碰位置即为触摸物与操作面板接触时的接触位置。进一步的,找到真实触碰位置的临近区域中大于第二光强阈值的位置,第二光强阈值大于噪声值,其可以表示真实触碰区的延伸,将真实触碰位置的临近区域中大于第二光强阈值的位置标记为有效的触摸区域,触摸区域的面积即为触摸物与操作面板接触的接触位置。当触摸物在操作面板上移动时,多帧时间连续的红外光强像素图记录有触摸物在操作面板上的接触位置和接触面积,通过连续帧中记录的接触位置和接触面积可得到触摸物在操作面板上的移动速度。当触摸物离开操作面板时,触摸物对红外光的遮挡变小,如果上一帧红外光强像素图中的接触位置,在当前红外光强像素图中的相对位置以及邻近区域内均没有超过第三光强阈值的像素,则确定此时触摸物与操作面板的关系为脱离触碰,第三光强阈值表示脱离触碰时的最大光强。可理解的,当用户通过触摸物触碰操作面板时,操作面板上安装的红外发射器和红外接收器之间的红外光线传输路径会被触摸物阻挡,红外触控传感器将输出对应的红外传感信号(红外受阻信号),并将红外传感信号发送给第二处理设备,第二处理设备根据红外传感信号可测得触摸物与操作面板的接触面积、触摸物在操作面板上的移动速度和触摸物与操作面板接触时的触控位置,并得到相应的红外触摸数据。其中,红外触摸数据包括触摸状态信息(包括TOUCH状态、DOWN状态、MOVE状态和UP状态)、触摸 位置信息和/或触摸参数信息。需要进行说明的是,第二处理设备在根据红外传感信号计算触摸位置信息和触摸参数信息的过程中,每个红外传感信号都会有一个标志位,可结合标志位得到触摸状态信息。一般的,第二处理设备确定收集到有效的红外传感信号时,标志位为01,确定未接收到有效的红外传感信号时,标志位为00,在标志位从原来的00变为01时,此时的触摸状态为TOUCH状态;在标志位从原来的00变为01后,连续设定帧数(两帧或三帧)的红外传感信号的标志位都是01时,表明存在有效的触控操作,此时的触摸状态为DOWN状态(从DOWN状态开始上报红外触摸数据到第一处理设备进行处理及响应);后续标志位保持为01,触摸状态为MOVE状态;最后,当不再检测到红外传感信号时,标志位从原来的01变为00,此时的触摸状态为UP状态。最后,基于触摸状态信息、触摸位置信息和触摸参数信息生成红外触摸数据。
图3给出了一种红外触控传感器的检测原理示意图,需要进行解释的是,对于通过红外触控传感器来实现交互平板的触控功能,在本行业中一直存在长期的技术难题,即零书写高度技术问题。所谓零书写高度是指:触摸物(例如手或书写笔)在显示屏上书写时,触摸物触碰到显示屏的表面时,才产生书写轨迹,触摸物在书写产生笔迹时与显示屏表面的间距为零。为了更好的理解零书写高度,结合图3作进一步的说明,红外触控传感器400发射或接收光信号是存在一定高度范围的,从而在相对于操作面板500的垂直方向上形成触控检测区域,其高度为H,在触摸物落入、抬起的过程中,会存在触摸物位于该触控检测区域内、但并未接触到操作面板500表面的情况,此时依然会检测到红外触摸数据。
在一次触控操作中,触摸物会经历图3中的状态131-137,其中从状态131、状态132至状态133描述触摸物从开始进行触控操作到开始接触到操作面板500的过程,在状态131中,触摸物刚开始进入触控检测区域,第二处理设备根据红外触控传感器产生的红外传感信号检测到第一帧红外触摸数据,此时,触摸物的触摸状态为触摸触发状态,在状态131到状态132之间触摸物刚进入触控检测区域时,第二处理设备根据红外触控传感器产生的红外传感信号检测到首帧红外触摸数据,并且此时触摸物的触摸状态为触摸落入状态,在状态131之前,触摸物处于触控检测区域之上,并不会产生红外触摸数据,在状态132中,触摸物处于触控检测区域中,但并未触碰到操作面板500表面,会产生红外触摸数据(在这过程中,在检测到连续的两帧或三帧有效的红外传感信号时,将下一帧红外触摸数据确定为首帧红外触摸数据),在状态133中,触摸物处于触控检测区域中,已触碰到操作面板500,会产生红外触摸数据。
从状态133、状态134至状态135描述触摸物接触到操作面板500并在操作面板500上移动的过程,在这过程中,触摸物的触摸状态始终为触摸移动状态,在触摸移动状态中,触 摸物持续触碰到操作面板500,同时产生红外触摸数据。
从状态135、状态136至状态137描述触摸物从操作面板500上抬起至离开触控检测区域的过程,在状态136到状态137之间触摸物刚离开触控检测区域时,第二处理设备根据红外触控传感器产生的红外传感信号检测到末帧红外触摸数据,并且此时触摸物的触摸状态为触摸抬起状态,在状态136中,触摸物处于触控检测区域中,并未触碰到操作面板500,会产生红外触摸数据,在状态137中,触摸物处于触控检测区域之上,并不会产生红外触摸数据。可以理解的是,在一次触控操作中,状态132至状态136过程中产生的红外触摸数据为连续的红外触摸数据。在首帧红外触摸数据和末帧红外触摸数据之间的红外触摸数据为中间触摸数据。
触摸物在交互平板的触控检测区域进行触控操作时,红外触控传感器将会产生红外传感信号,从而根据红外传感信号进行计算,对应生成红外触摸数据后,将红外触摸数据发送至处理设备。这里,红外触控传感器生成的红外触摸数据是一个连续的数据,具体表现为包括多个帧的数据。
进一步的,本实施例提供的红外触摸数据包括触摸状态信息、触摸位置信息和触摸参数信息。可以理解的是,触摸状态信息用于表示对应触摸物在当前触控操作中的触摸状态,触摸状态包括触摸触发状态(TOUCH)、触摸落入状态(DOWN)、触摸移动状态(MOVE)和触摸抬起状态(UP),触摸位置信息用于反映触摸物在操作面板上的触摸位置,其可通过在操作面板上的XY坐标点进行表示,触摸参数信息至少反映触摸物在接触操作面板时的触摸面积,其可通过触摸面积对应的宽度和高度进行表示,也可以通过触摸面积对应的半径或直径来表示。红外触摸数据的数据格式可根据第二处理设备与第一处理设备和/或弹性波检测装置的通信方式进行确定,例如通过USB通信方式进行通信,红外触摸数据的数据格式如表1所示:
表1
字节号 作用
0 报文ID
1 点ID
2 点状态
3 点的X坐标低字节数据
4 点的X坐标高字节数据
5 点的Y坐标低字节数据
6 点的Y坐标高字节数据
7 触摸面积W低字节数据
8 触摸面积W高字节数据
9 触摸面积H低字节数据
10 触摸面积H高字节数据
... ...
上表中,点状态表示红外触摸数据中的触摸状态。另外,在一次触控操作中产生的红外触摸数据包括第一帧红外触摸数据、首帧红外触摸数据、中间触摸数据和末帧红外触摸数据,第一帧红外触摸数据为第一时刻对应的第一红外触摸数据触摸状态信息指示触摸物的触摸状态为触摸触发状态,首帧红外触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸落入状态,中间触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸移动状态,末帧红外触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸抬起状态。
S102:第二处理设备从第一时刻之后,开始获取弹性波传感器所产生的弹性波信号,弹性波信号由触摸物接触操作面板时产生。
本公开实施例将第二处理设备在开始检测到红外传感信号的时刻定义为第一时刻,并且第二处理设备从第一时刻后,开始获取弹性波传感器所产生的弹性波信号。这里,第一时刻后是在第一时刻之后的一定时间间隔内,例如第一时刻之后的3ms内或者2ms、5ms内等。在检测到红外传感信号后,开始获取弹性波信号,从而为后续的处理步骤做准备。这里的,接收弹性波信号,可以是弹性波传感器一直处于工作状态,一直会产生信号,但是第二处理设备在接收到红外传感信号后,才开始获取弹性波传感器所产生的弹性波信号,具体可以是在接收到红外传感信号后,开始接收弹性波传感器所产生的弹性波信号,也可以是在接收到红外传感信号前,也会接收弹性波传感器所产生的弹性波信号但不进行任何响应处理或者将弹性波信号进行丢弃,在接收到红外传感信号后,才获取弹性波传感器所产生的弹性波信号。也可以是弹性波传感器平时处于不工作状态,第二处理设备在接收到红外传感信号后,触发弹性波传感器开始工作,从而在触摸物触碰交互平板的操作面板时,弹性波传感器开始产生弹性波信号。
S103:第二处理设备根据红外传感信号计算得到第一时刻对应的第一红外触摸数据,根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型。其中,第一红外触摸数据包括触摸物的触摸位置信息。
在本发明实施例中,为了使得交互平板对用户的触控操作的响应实现多样化,可以设计基于触摸物的不同介质类型,实现与该介质类型相对应的响应或实现方式。本公开实施例中, 交互平板对用户的触控操作的响应与用户所使用的触摸物的介质类型相关联,因此,需要精准的识别触摸物的介质类型。而如何基于弹性波信号精确地识别触摸物的介质类型是行业中长期存在的一个技术难题,在过去的技术发展过程中,一致致力于通过各种各样的识别算法来提高对触摸物的介质类型的识别精度。但是,在交互平板的应用场景中,可能会存在各种干扰源,导致弹性波检测装置所检测到的弹性波信号存在较大的噪声信号。仅通过对识别算法进行改进,虽然能在一定程度上提高识别精度,但是这种方式仍然是直接利用弹性波信号识别触摸物的介质类型,当噪声信号对弹性波信号造成较大影响时,高精度的识别算法也可能出现识别得到的介质类型出错的情况,影响交互平板的响应效果。例如,交互平板在播放音视频的过程中,具体通过扬声器将音频信号转换成声信号,具体是扬声器通过电磁、压电或静电效应,使其纸盆或膜片振动并与周围的空气产生共振(共鸣)而发出声音,也就是说,扬声器发声的过程中,也会产生振动信号,弹性波传感器也会采集到该振动信号。因此当交互平板在播放音视频时,若用户使用触摸物在交互平板的显示屏上进行触控操作,弹性波传感器所检测到的弹性波信号将是触摸物的触控操作的实际弹性波信号以及音频播放导致的振动信号的叠加信号。此时,弹性波传感器所检测到的弹性波信号存在较大的噪声信号,现有方案仅基于弹性波信号基于来识别触摸物的介质类型,导致再高精度的识别算法也难以精确识别得到触摸物的介质类型。因此,本发明结合交互平板的具体使用场景,提出了一种更高精度的识别触摸物的介质类型的方法,增加第一红外触摸数据作为识别触摸物的介质类型的参数,通过结合第一红外触摸数据来识别触摸物的介质类型,可以降低噪声信号对识别结果的影响,提高对触摸物的介质类型的识别精度。
第二处理设备在开始检测到红外传感信号时,根据红外传感信号计算第一时刻对应的第一红外触摸数据。本公开提供的第一红外触摸数据至少包括触摸位置信息,另外,第一红外触摸数据还可包括触摸参数信息和/或触摸状态信息。在计算得到第一时刻对应的第一红外触摸数据后,第二处理设备根据第一红外触摸数据的触摸位置信息和/或触摸参数信息,以及弹性波信号,确定触摸物对应的介质类型。在一个实施例中,第一红外触摸数据为第二处理设备计算获得的第一帧红外触摸数据。
具体的,当触摸物在交互平板的触控检测区域进行触控操作时,首先红外触控传感器检测到被遮挡,然后需要进行相应的转换计算,根据被遮挡情况计算出具体的触摸位置信息、触摸面积等触摸参数信息。在这个过程中,第二处理设备接收弹性波传感器检测到的弹性波信号,进而根据弹性波信号以及计算得到的第一红外触摸数据的触摸位置信息和/或触摸参数信息,确定触摸物对应的介质类型。
可以理解的是,本实施例提供的第二处理设备在检测到有红外传感信号后就开始采集弹 性波信号(即前述的TOUCH状态),并在接收到第一时刻的第一红外触摸数据后就开始进行工作进行材质识别。
本公开实施例中,为了提高介质类型的识别精度,结合交互平板的具体使用场景,增加红外触摸数据作为识别触摸物的介质类型的参数,通过结合红外触摸数据来识别触摸物的介质类型,可以降低噪声信号对识别结果的影响,提高对触摸物的介质类型的识别精度。在实际应用过程中,第二处理设备将红外传感信号转换成红外触摸数据有一个延时过程,为了避免灰尘等异物带来的误响应,第二处理设备并不是计算获得第一帧红外触摸数据就会上报给第一处理设备进行处理,而是会在计算获得连续两帧或三帧红外触摸数据后,才开始上报红外触摸数据给第一处理设备,上报给第一处理设备的红外触摸数据中,本实施例将其第一帧数据称为首帧触摸数据(其触摸状态信息为DOWN)。第二处理设备根据红外传感信号计算获得每帧红外触摸数据的时间大约为10ms,如果基于红外触摸数据上报的机制,在第二处理设备向第一处理设备上报红外触摸数据时表示存在有效触控操作,此时再进行触摸物的介质类型的识别,则需要在红外传感信号产生的第一时刻之后的至少20-30ms才进行介质类型的识别,存在一个延时过程,而且介质类型的识别还需要额外的13-20ms的时间。如果采用这种方式,虽然能提高介质类型的识别精度,但是从产生红外传感信号到最终得到介质类型,存在一个较大的延时,会降低交互平板的响应速度,给用户带来不好的体验。因此,本实施例中,在检测到第一帧红外触摸数据的第一时刻就进行弹性波信号的采集,从而在接收到第一时刻对应的第一红外触摸数据后就进行触摸物的介质类型识别,而不是等待向第一处理设备上报红外触摸数据(需要连续检测两帧到三帧的红外触摸数据,需要经过20-30ms),确定存在有效触控操作才进行介质类型识别,至少节约了从检测到红外传感信号到向第一处理设备上报红外触摸数据之间的等待时间。后续,第一处理设备在接收到第二处理设备上报的第二红外触摸数据时,可能已经接收到触摸物的介质类型,或者只需等待几毫秒就能接收到触摸物的介质类型,从而结合触摸物的介质类型对第二红外触摸数据进行响应操作,可以减少延时,提高响应速度。
在具体实现本方案时,可根据第一红外触摸数据的触摸位置信息确定弹性波信号的起振点,并根据起振点确定用于进行介质类型识别的材质识别信号。基于此,如图4提供的一种介质类型的确定流程示意图所示,本实施例提供的根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型,包括步骤S1031-S1034:
S1031:根据弹性波信号的时域频域信息,确认弹性波信号的起振点。
其中,对于步骤S1031用于进行起振点的判断的弹性波信号,可以是根据第一红外触摸数据中的触摸位置信息,确定距离触摸位置最近的弹性波传感器,由于其产生的信号强度最 高,其产生信号的信噪比最大,可利用该弹性波传感器产生的弹性波信号做起振点检测。
示例性的,触摸位置信息用于表征触控操作对应的触摸点的位置信息,可以通过X、Y坐标值表示,触摸参数信息包括用于表征触控操作对应的触摸点的面积的信息,可以通过接触面积或接触点的宽度值、高度值表示。弹性波检测装置识别触摸物对应的介质类型时具体为:在获取第一红外触摸数据后,首先结合弹性波信号的时域、频域的信息,这些信息包括时域上超过设定信噪比阈值的时间点,得到小波段时频分析中特征频点处的能量绝对值与相对值,并据此来判断弹性波信号的起振点。判断起振点的方法可以是通过阈值方法(判断信噪比或信号量是否超过预设阈值),也可以是通过过零率(判断信号是否为非随机振动信号)进行。
其中,当弹性波检测装置采用多个弹性波传感器进行弹性波信号检测时,弹性波检测装置可以根据第一红外触摸数据的触摸位置信息和/或触摸参数信息等,来判断或者计算获得有效的弹性波信号(用于进行介质识别的信号),从而再判断该有效的弹性波信号的起振点。具体的,可以是根据红外触摸数据中的触摸位置信息,确定距离触摸点最近的弹性波传感器,由于其产生的信号强度最高,其产生信号的信噪比最大,将该弹性波传感器产生的弹性波信号作为有效的弹性波信号。另外,也可根据红外触摸数据的触摸位置信息,对于各弹性波传感器的弹性波信号进行加权处理,将加权处理得到的结果作为有效的弹性波信号,各弹性波传感器对应的权重可以是一个预设的数值,也可以是一个与触摸位置的距离负相关的函数,如权重为距离的倒数或倒数的平方等。
S1032:根据起振点前的弹性波信号,确定噪声信息。
S1033:根据噪声信息,从起振点后的弹性波信号中确定材质识别信号。
S1034:第一红外触摸数据的触摸位置信息和材质识别信号,确定触摸物对应的介质类型以及置信区间。
在确定起振点后,分析得到起振前的信号,并将起振前的信号作为噪声估计值,并据此识别起振点后的信号,将起振点后的信号作为弹性波材质识别的识别信号。作为一种实施方式,对识别信号进行信号处理,信号处理包括时频转化、加窗平滑、多通道融合、降噪等算法,得出融合后的弹性波频域信号,并且将该弹性波频域信号置入设定算法(包括统计学习、机器学习、深度学习等模型算法,或者特征值比对算法),得出材质的ID,以及其置信区间,并将该材质ID与置信区间上报给处理设备。可选的,可根据置信区间与预设的设定置信阈值的比较情况确定是否需要对确定的介质类型进行修正,例如材质类型的ID为01,置信区间为85%,设定置信阈值为80%,则表示材质01是触摸物对应的介质类型。相反如果置信区间是75%,则需进对介质类型行修正,具体可以参照本公开后续描述的多种方式进行修正。
本实施例提供的红外触摸数据包括触摸状态信息、触摸位置信息和触摸参数信息,第二处理设备在接收到第一红外触摸数据后,读取出第一红外触摸数据中的触摸位置信息,该触摸位置信息可理解为触摸物在操作面板上的触摸位置。
在具体实现本方案时,可利用特征识别模型进行介质类型的确定,对应的,步骤S1034具体为:将触摸位置信息和材质识别信号,输入到训练好的特征识别模型中,获得触摸物对应的介质类型以及置信区间。
第二处理设备通过弹性波传感器采集到弹性波信号后,确定该弹性波信号对应的材质识别信号,并将材质识别信号输入到训练好的特征识别模型中,由特征识别模型对材质识别信号进行分析处理并输出触摸物对应的介质类型以及置信区间。
在一个实施例中,特征识别模型可通过神经网络的方式进行搭建,可将触摸位置信息和材质识别信号进行分析处理,并输出触摸物对应的介质类型以及置信区间。例如,基于神经网络搭建得到特征识别模型,并将触摸位置信息和材质识别信号作为输入、介质类型作为输出,对特征识别模型进行训练。将触摸位置信息和/或触摸参数信息作为特征添加到特征识别模型中进行训练,该特征可以是特征识别模型最原始的输入特征,也可以是在特征识别模型的网络中某一层的额外特征,并由特征识别模型直接输出识别结果。在一个实施例中,S1034也可以将触摸参数信息、触摸位置信息和弹性波信号,输入到训练好的特征识别模型中,获得触摸物对应的介质类型,从而将触摸参数信息也作为特征识别模型的一个识别参数。在一个实施例中,特征识别模型可对材质识别信号进行特征识别,并根据特征识别结果和触摸位置信息确定触摸物对应的介质类型以及置信区间。
在一个实施例中,弹性波传感器的数量为多个,弹性波信号为多个,步骤S1034包括:
S10341:对多个弹性波信号对应的材质识别信号进行融合处理,得到预处理信号;将触摸位置信息和预处理信号,输入到训练好的特征识别模型中,获得触摸物对应的介质类型以及置信区间。
在一个实施例中,特征识别模型可通过神经网络的方式进行搭建,可将触摸位置信息和对多个材质识别信号融合后得到的预处理信号进行分析处理,并输出触摸物对应的介质类型以及置信区间。例如,基于神经网络搭建得到特征识别模型,并将触摸位置信息和多个材质识别信号对应的预处理信号作为输入、介质类型作为输出,对特征识别模型进行训练。在一个实施例中,特征识别模型可对预处理信号进行特征识别,并根据特征识别结果和触摸位置信息确定触摸物对应的介质类型以及置信区间。
第二处理设备通过多个弹性波传感器采集到多个弹性波信号后,确定每个弹性波信号对应的材质识别信号,并对多个材质识别信号进行融合处理,得到预处理信号。进一步的,将 预处理信号输入到训练好的特征识别模型中,由特征识别模型对预处理信号进行分析处理并输出触摸物对应的介质类型以及置信区间。
融合处理的一种实施方式为:基于多个弹性波传感器的位置信息,根据触摸位置信息,计算该触摸位置信息所表征的触摸点与不同弹性波传感器的距离S1,S2,…Sn(n为自然数),进而基于计算得到的距离对多个弹性波传感器采集的弹性波信号进行融合处理,获得预处理结果。例如一种可能的实施案例是,以1/(Sn)^2将每个传感器的信号进行加权后,将加权得到的结果作为预处理结果。
第二处理设备通过特征识别模型获得触摸物的介质类型的同时,会得到介质类型对应的置信区间。其中,第二处理设备确定的介质类型可以是一种或多种。在根据第一红外触摸数据和材质识别信号唯一确定一个介质类型,且该介质类型的置信区间高于设定置信阈值时,可直接确定该介质类型为触摸物对应的介质类型。在获得两种或以上的介质类型时,若存在置信区间高于设定置信阈值的介质类型,则将该介质类型作为触摸物对应的介质类型。
在具体实现本方案时,还可利用特征数据库进行介质类型的确定,对应的,如图5提供的一种利用特征数据库确定介质类型的流程示意图所示,步骤S1034包括:
S10342:对材质识别信号进行特征提取后,根据第一红外触摸数据中的触摸位置信息,对材质识别信号进行修正。
S10343:根据修正后的特征,与预设的特征数据库进行比对,获得触摸物对应的介质类型以及置信区间。
本实施例中,在第二处理设备中预先设置有特征数据库,该特征数据库中记录有预设特征和预设介质类型之间的对应关系。其中,预设特征和预设介质类型之间的对应关系可通过键值对的方式进行记录。
具体的,第二处理设备在确定材质识别信号后,对材质识别信号进行特征提取。在对材质识别信号进行特征提取后,确定第一红外触摸数据中的触摸位置信息,根据触摸位置信息对提取得到的特征进行修正。在完成对特征的修正后,将修正后的特征在预设的特征数据库中进行匹配比对,在匹配到一致或相似度达到设定相似度要求的预设特征时,将该预设特征对应的预设介质类型确定为触摸物对应的介质类型。
在一个实施例中,第二处理设备通过特征数据库获得触摸物的介质类型的同时,会得到介质类型对应的置信区间。其中,第二处理设备确定的介质类型可以是一种或多种。在根据第一红外触摸数据和材质识别信号唯一确定一个介质类型,且该介质类型的置信区间高于设定置信阈值时,可直接确定该介质类型为触摸物对应的介质类型。在获得两种或以上的介质类型时,若存在置信区间高于设定置信阈值的介质类型,则将该介质类型作为触摸物对应的 介质类型。
在一个可能的实施例中,获得触摸物对应的介质类型以及置信区间的步骤中,获得的介质类型为至少两种,且每种介质类型对应的置信区间均低于设定置信阈值。基于此,本实施例提供的触摸数据处理方法还包括:
S1035:根据第一红外触摸数据的触摸参数信息,确定至少两种介质类型中的其中一种作为触摸物对应的介质类型。
S1035由第二处理设备来执行。在其它实施例中,当第二处理设备只用于执行红外触摸数据的计算,而设置单独的弹性波检测装置来进行介质类型的识别时,S1035由弹性波检测装置执行。此时,由第二处理设备将第一红外触摸数据直接发送给弹性波检测装置,或者第二处理设备将第一红外触摸数据发送给第一处理设备后,由第一处理设备将第一红外触摸数据发送至弹性波检测装置。
具体的,本实施例根据第一红外触摸数据中的触摸参数信息(例如触摸面积)对介质类型进行修正,根据触摸参数信息与各介质类型的匹配程度确定触摸物对应的介质类型。以触摸参数信息为触摸面积信息为例,第二处理设备或弹性波检测装置记录有不同介质类型对应的面积范围,在获得的介质类型为至少两种并且每种介质类型对应的置信区间均低于设定置信阈值时,第二处理设备或弹性波检测装置确定各个介质类型对应的面积范围,并获取第一红外触摸数据中的触摸参数信息,确定当前触摸物接触操作面板的触摸面积,根据该触摸面积与各个面积范围的匹配程度或面积差距,确定与触摸面积更接近的面积范围以及对应的介质类型,并将该介质类型作为触摸物对应的介质类型。例如将设定置信阈值设置为90%,在介质类型的置信区间大于90%时,可将该介质类型作为触摸物对应的介质类型,在获得两种介质类型,并且两种类型为:材质1,置信区间为51%,材质2,置信区间为49%,两种介质类型的置信区间均低于设定置信阈值,则获取材质1和材质2对应的面积范围,假设结合触摸参数信息中的触摸面积,确认触摸面积更接近材质1的面积范围,则确定修正后确定的介质类型为材质1,将材质1作为触摸物对应的介质类型。更具体的,当用户用手指在交互平板的显示屏上进行操作时,弹性波检测装置识别获得的介质类型可能是:手指,置信区间为51%;毛笔,置信区间为49%。由于手指和毛笔的置信区间均设定置信阈值90%,因此,需要获取触摸参数信息中的触摸面积,假设获取得到的触摸面积(用宽度值、高度值表示)为(7,7),而手指的预设的面积范围为(6±2,6±2),毛笔的预设的面积范围为(5±1,4±1.5),则判断(7,7)更接近手指的预设的面积范围(6±2,6±2),因此将手指作为触摸物对应的介质类型。本实施例通过第一红外触摸数据对获得的介质类型进行修正,确定触摸物对应的介质类型,减少干扰源对介质类型确定造成的偏差,保证介质类型确定的准确程度。
在一个可能的实施例中,获得触摸物对应的介质类型以及置信区间的步骤中,所获得的介质类型的置信区间低于设定置信阈值,本实施例提供的触摸数据处理方法还包括:
S1036:第一处理设备根据红外触摸数据的触摸位置信息,判断当前的触控操作与上一次抬起的触控操作是否相关联,若相关联,则获取上一次触控操作对应的介质类型,作为触摸物对应的介质类型。
在弹性波检测装置获得的介质类型的置信区间低于设定置信阈值时,第一处理设备根据本次触控操作与上一次触控操作是否关联来确定触摸物对应的介质类型。例如,第一处理设备判断本次触控操作的起点与上一次触控操作的终点之间的时间与距离阈值是否在设定时间与距离阈值内,若是则认为当前的触控操作与上一次抬起的触控操作相关联。
具体的,第一处理设备获取本次触控操作的红外触摸数据中的触摸位置信息,根据该触摸位置信息即为本次触控操作的落笔位置,并将首帧红外触摸数据的对应的时间戳作为落笔时间,并获取上一次触控操作中抬起时的红外触摸数据中的触摸位置信息,该触摸位置信息即为上一次触控操作的抬笔位置,并将红外触摸数据的对应的时间戳作为抬笔时间。进一步的,计算落笔位置与抬笔位置之间的距离间隔ΔS,以及抬笔时间之间的时间距离ΔT,判断落笔位置是否在上一次触控操作的抬笔位置附近,以及落笔时间是否在上一次触控操作的落笔时间附近,即判断(ΔS,ΔT)是否在时间与距离阈值(S0,T0)以内,若在时间与距离阈值内,则判定当前的触控操作与上一次抬起的触控操作相关联。其中时间与距离阈值包括时间阈值T0和距离阈值S0,时间阈值T0和距离阈值S0可以是两个固定的值,也可以是有线性或非线性关系的值。
进一步的,在确定当前的触控操作与上一次抬起的触控操作相关联时,获取上一次触控操作对应的介质类型,作为触摸物对应的介质类型。在确定当前的触控操作与上一次抬起的触控操作不关联时,可直接根据红外触摸数据,在操作面板上显示相应的书写轨迹,而不利用介质类型更新第二红外触摸数据。可以理解的是,在介质类型的置信区间低于设定置信阈值时,第一处理设备根据当前的触控操作与上一次抬起的触控操作的关联关系进行介质类型的纠错后,无需将接错结果发送给弹性波检测装置,提高数据处理效率。本实施例通过当前的触控操作与上一次抬起的触控操作的关联关系对介质类型进行纠错,确定触摸物对应的介质类型,减少干扰源对介质类型确定造成的偏差,保证介质类型确定的准确程度。
本公开实施例通过第一红外触摸数据的触摸位置信息,以及材质识别信号,确定触摸物对应的介质类型,并向第一处理设备反馈对应的介质类型信息,在存在多个触摸物时,可准确判断在不同触摸位置所对应的介质类型,并可针对不同介质类型,对相应触摸位置的触控操作进行不同的响应,丰富交互平板的交互体验。
S104:第二处理设备向第一处理设备发送介质类型信息,介质类型信息包括触摸物对应的介质类型。
第二处理设备在根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型后,根据触摸物对应的介质类型,生成包括该介质类型的介质类型信息,并向第一处理设备发送介质类型信息。
在一个可能的实施例中,第二处理设备在确定介质类型后,向第一处理设备上报该介质类型,并在成功上报介质类型后,暂停接收弹性波传感器产生的弹性波信号,直至第二处理设备检测红外触摸数据中的末帧红外触摸数据。第二处理设备根据红外触摸数据中的触摸状态信息确定是否检测到末帧红外触摸数据,在触摸状态信息指示触摸物的触摸状态为触摸抬起状态时,确定检测到末帧红外触摸数据。第二处理设备在成功上报介质类型后,不再接收或处理新产生的弹性波信号,过滤干扰信号的影响,避免弹性波检测装置进行不必要的处理步骤,提高处理效率,并在检测到末帧红外触摸数据之后,清除缓存的弹性波信号后继续工作,以避免对下一次介质类型的确定造成不必要的影响,保证介质类型识别的准确度。
S105:第二处理设备根据红外传感信号,计算获得发送给第一处理设备的第二红外触摸数据。
当触摸物在交互平板的触控检测区域进行触控操作时,红外触控传感器产生红外传感信号,并将红外传感信号发送给第二处理设备。第二处理设备在接收到红外传感信号后,根据这些红外传感信号,计算获得相应的第二红外触摸数据。这些第二红外触摸数据用于发送给第一处理设备进行处理和响应。在一个实施例中,第二红外触摸数据为第二处理设备计算获得的第N帧触摸数据至最后一帧红外触摸数据,其中,N为大于1的自然数。也就是说,第二处理设备根据红外传感信号计算得到多帧触摸数据,其中第一帧触摸数据为第一红外触摸数据,第N帧及之后的触摸数据为第二红外触摸数据。
在具体实现本方案时,红外触摸数据中的首帧红外触摸数据是第二红外触摸数据的起始点,其触摸状态信息为DOWN状态,基于此,如图6提供的一种第二红外触摸数据确定流程示意图所示,步骤S105包括:
S1051:第二处理设备根据红外传感信号,计算获得相应的红外触摸数据。
S1052:根据计算获得的红外触摸数据,确认触控操作对应的首帧红外触摸数据,获得首帧红外触摸数据及其之后的每帧红外触摸数据作为第二红外触摸数据;首帧红外触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸落入状态。如前所述,根据红外传感信号计算获得触摸数据时,将会基于红外传感数据得到触摸数据的触摸状态信息(TOUCH、DOWN、MOVE或UP),因此,可以根据计算获得的触摸数据,确认触摸状态信息为DOWN的帧数 据为这里的首帧红外触摸数据,从而确定第二红外触摸数据。
第二处理设备接收红外触控传感器产生的红外传感信号,并根据红外传感信号计算获得相应的红外触摸数据。在确定作为有效触摸的首帧红外触摸数据(触摸状态信息为DOWN的帧数据)后,将首帧红外触摸数据作为第二红外触摸数据的起点,在首帧红外触摸数据以后的红外触摸数据作为后续的第二红外触摸数据,即将首帧红外触摸数据及其之后的每帧红外触摸数据作为第二红外触摸数据。
可以理解的是,本实施例中首帧红外触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸落入状态(DOWN),即红外触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸落入状态时,可确定该帧红外触摸数据为首帧红外触摸数据。
S106:第二处理设备从第二时刻开始,向第一处理设备发送第二红外触摸数据;其中,第二时刻在接收弹性波信号的时刻之后。
从第二时刻开始,第二处理设备向第一处理设备发送第二红外触摸数据。本公开提供的第二红外触摸数据至少包括触摸位置信息,另外,第二红外触摸数据还可包括触摸参数信息和/或触摸状态信息。其中,本实施例提供的第二时刻在开始检测到红外传感信号的第一时刻之后,此时第二处理设备已经根据第一红外触摸数据和弹性波信号确定触摸物对应的介质类型,保证向第一处理设备发送的第二红外触摸数据是由触摸物触控操作面板引起的,减少第一处理设备进行不必要的数据处理,提高数据处理效率。
可以理解的是,第二处理设备在检测到红外传感信号的第一时刻,先获得第一时刻对应的第一红外触摸数据,该第一红外触摸数据用于介质类型的确定,不需要先确定是否产生有效触摸。而向第一处理设备发送的第二红外触摸数据,第一处理设备将会对接收到的第二红外触摸数据和介质类型进行响应,为了避免误响应,需要确定是有效触摸下产生的红外触摸数据,即第二红外触摸数据是首帧红外触摸数据及其之后的每帧红外触摸数据,首帧红外触摸数据的确认需要连续检测两帧到三帧的红外触摸数据,导致第二时刻落后于第一时刻。
在具体实现本方案时,可将介质类型信息在第二红外触摸数据中打包并发送给第一处理设备,即第二处理设备向第一处理设备发送包含介质类型信息的第二红外触摸数据。基于此,步骤S104和步骤S106合并为一个步骤:
第二处理设备从第二时刻开始,第二处理设备向第一处理设备发送包含介质类型信息的第二红外触摸数据,介质类型信息包括触摸物对应的介质类型,其中,第二时刻在接收弹性波信号的时刻之后。
具体的,第二处理设备在根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型,并计算获得发送给第一处理设备的第二红外触摸数据后,根据触摸物对应的介质类型, 生成包括该介质类型的介质类型信息,将介质类型信息添加到第二红外触摸数据中,并向第一处理设备发送介质类型信息。通过本方式,可以减少一次第二处理设备与第一处理设备之间的通信。
S107:第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应。
第一处理设备接收到第二处理设备发送的介质类型信息,以及从第二时刻开始发送的第二红外触摸数据后,根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应。
具体的,第一处理设备在接收到第二处理设备返回的介质类型信息和第二红外触摸数据后,根据介质类型信息确定触摸物对应的介质类型,并根据确定的介质类型,对第二红外触摸数据进行响应。其中,对第二红外触摸数据进行响应,可以是根据介质类型对后续接收到的第二红外触摸数据进行更新以及进行相应的响应(例如根据介质类型显示相应的书写轨迹),也可以是根据介质类型对后续接收到的第二红外触摸数据进行触摸响应(例如根据介质类型来执行点击操作、长按操作等),即在接收到介质类型后,才会对接收到的第二红外触摸数据进行响应。第一处理设备在接收到介质类型之后才对第二红外触摸数据进行处理及响应,忽略在触摸物接触操作面板之前产生的红外触摸数据,只处理触摸物接触操作面板之后产生的红外触摸数据,对红外触摸数据进行处理及响应的时机与触摸物接触操作面板的位置与时机保持一致,用户的触控操作得到更准确的反馈,例如显示书写轨迹的位置及时机与触摸物接触操作面板的位置与时机保持一致,实现书写的零高度。
在一个可能的实施例中,如图7提供的一种触控操作响应流程示意图所示,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,包括步骤S1071-S1072:
S1071:第一处理设备根据触摸物对应的介质类型,对第二红外触摸数据进行更新。
第一处理设备在接收到介质类型信息后,根据介质类型信息指示的介质类型,对后续接收到的第二红外触摸数据进行更新。例如,接收到介质类型的时刻为t1,则对t1时刻之后接收到的第二红外触摸数据进行更新。具体实现过程中,可以是通过记录接收时刻来处理。也可以是在接收到介质类型后,将预设的一个标志位的数据进行更新,例如从00更新为01,从而后续进行处理时,只要该标志位是01,则将读取到的第二红外触摸数据进行更新。
S1072:第一处理设备根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹。
第一处理设备接收到介质类型信息后,开始对接收到的第二红外触摸数据进行缓存;并 依次读取缓存的第二红外触摸数据,根据介质类型更新第二红外触摸数据,并根据更新后的第二红外触摸数据,在操作面板上显示相应的书写轨迹。具体的,第一处理设备在接收到第二处理设备上报的介质类型信息后,开始对第二处理设备发送的第二红外触摸数据进行缓存。可选的,第一处理设备在确定接收到第二处理设备上报的介质类型后,通知第二处理设备已成功接收介质类型。第一处理设备在接收到介质类型信息之后才开始缓存第二红外触摸数据,忽略在触摸物接触操作面板之前产生的红外触摸数据(产生这些红外触摸数据时,触摸物只是进入触控检测区域,并未接触到操作面板),只处理触摸物接触操作面板之后产生的红外触摸数据(第二红外触摸数据),显示书写轨迹的位置与时机与触摸物接触操作面板的位置与时机保持一致,实现书写的零高度。而且对触摸物接触操作面板之前产生的红外触摸数据不进行缓存处理,节约了第一处理设备的处理资源。本步骤的更新过程中,第一处理设备按照先进先出的顺序,依次读取缓存的第二红外触摸数据,根据介质类型更新读取出的第二红外触摸数据。
本步骤中,根据更新后的第二红外触摸数据绘制相应的书写轨迹,并在操作面板上进行显示,例如按照更新后的第二红外触摸数据所表征的显示属性(粗细、颜色、线型等)绘制相应的书写轨迹,并在操作面板上进行显示。
图8提供了一种交互平板的硬件结构示意图,如图8所示,在第一处理设备200中设置有***层和应用层,其中***层用于执行数据层面的数据处理,例如对接收到的传感数据的分析处理,应用层用于执行应用层面的数据处理,例如根据应用任务需求进行分析处理,***层在完成数据处理后,通过数据接口将数据处理结果发送给应用层,应用层再通过数据接口分发给具体的应用,由具体应用进行进一步的处理。对应的,本实施例中根据触摸物对应的介质类型,对后续接收到的第二红外触摸数据进行更新的步骤是在***层进行处理的,而根据更新后的第二红外触摸数据,在交互平板的操作面板500上显示相应的书写轨迹的步骤是在应用层进行处理的。即***层在完成对第二红外触摸数据的更新后,将更新后的第二红外触摸数据上报到应用层中,应用层将更新后的第二红外触摸数据分发给白板应用,由白板应用执行后续的显示书写轨迹的步骤。更具体的,***层可运行第一处理设备200的驱动程序,应用层可运行第一处理设备200安装的应用程序,包括前述的白板应用、交互平板的批注应用或者其它书写应用等。驱动程序按照先进先出的顺序,依次读取缓存的第二红外触摸数据,根据介质类型更新读取出的第二红外触摸数据,并将更新后的第二红外触摸数据发送至应用层,应用层再将更新后的第二红外触摸数据发送给应用程序,应用程序接收到更新后的第二红外触摸数据后,进行响应,绘制相应的书写轨迹,并在操作面板500上进行显示。
在具体实现本方案时,预先针对不同的介质类型确定对应的标准触摸参数信息(包括标 准触摸高度信息和标准触摸宽度信息),相应的,如图9提供的一种第二红外触摸数据更新流程示意图所示,第一处理设备根据触摸物对应的介质类型,对第二红外触摸数据进行更新,具体包括步骤S10711-S10712:
S10711:第一处理设备根据触摸物对应的介质类型,确定介质类型的标准触摸参数信息。
S10712:将第二红外触摸数据的触摸参数信息更新为标准触摸参数信息,得到更新后的第二红外触摸数据。
具体的,第一处理设备在接收到介质类型信息后,确定该介质类型信息所指示的介质类型,并确定该介质类型对应的标准触摸参数信息,并将从缓存获取的第二红外触摸数据中的触摸参数信息更新为标准触摸参数信息,例如将触摸参数信息中的高度信息和宽度信息替换为标准触摸参数信息中的标准触摸高度信息和标准触摸宽度信息,从而得到更新后的第二红外触摸数据。通过将第二红外触摸数据中的触摸参数信息更新为介质类型的标准触摸参数信息,后续根据标准触摸参数信息即可确定介质类型,从而显示对应的笔迹或执行相应操作。
在具体实现本方案时,可根据不同的介质类型设定不同的ID,相应的,第一处理设备根据触摸物对应的介质类型,对第二红外触摸数据进行更新,具体包括步骤S10713:
S10713:第一处理设备将触摸物对应的介质类型,写入到后续接收到的第二红外触摸数据的数据包中,得到更新后的第二红外触摸数据。
具体的,在第一处理设备中记录有不同介质类型所对应的ID,利用ID来表征不同的介质类型。第一处理设备在接收到介质类型后,获取该介质类型对应的ID,读取出缓存的第二红外触摸数据后,将ID写入第二红外触摸数据中,以更新第二红外触摸数据。第一处理设备中的***层在更新第二红外触摸数据后,将更新后的第二红外触摸数据发送给应用层,应用层可读取第二红外触摸数据中的ID来确定对应的介质类型,从而显示对应的笔迹或执行相应操作,例如通过预先设定的与该ID关联的介质类型的显示属性(颜色、笔迹粗细、线条种类等)绘制相应的笔迹。通过将介质类型对应的ID写入红外触摸数据的方式,不需要对触摸参数信息进行更新,即保留第二红外触摸数据的触摸面积,而是新增ID来表征介质类型,在根据更新后的第二红外触摸数据显示书写轨迹时,可根据实际的触摸面积来绘制相应属性的笔迹,书写轨迹的显示更加精确。
在一个可能的实施例中,书写轨迹的显示属性可基于第二红外触摸数据进行确定,相应的,第一处理设备根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹,其具体包括步骤S10721:
S10721:第一处理设备读取更新后的第二红外触摸数据的每帧数据的触摸状态信息、触摸位置信息和触摸参数信息,当触摸状态信息指示触摸状态为触摸移动状态时,根据触摸参 数信息对应的显示属性,在触摸位置信息指示的位置,显示相应的书写轨迹。
具体的,在应用层中记录有不同的触摸参数所对应的显示属性,显示属性包括在绘制显示书写轨迹时,书写轨迹对应的粗细、颜色、线条种类(虚线、实线、样式等)。***层在根据介质类型更新第二红外触摸数据后,将更新后的第二红外触摸数据上报给需要利用第二红外触摸数据进行书写轨迹的显示的应用层。应用层持续读取更新后的第二红外触摸数据,并确定第二红外触摸数据中每帧数据的触摸状态信息、触摸位置信息和触摸参数信息,从而根据触摸参数信息对应的显示属性,进行书写轨迹的绘制。通过不同介质类型产生不同的触摸参数信息,可快速确定书写轨迹的显示属性,通过不同介质类型的触摸物即可快速实现显示属性的设置,操作过程简洁高效,提高了交互平板的交互效率。
在一个可能的实施例中,第一处理设备在触摸位置信息指示的位置,显示相应的书写轨迹之后,还包括步骤S10722:
S10722:第一处理设备接收到弹性波检测装置发送的第二介质类型后,依次读取缓存的红外触摸数据,根据第二介质类型更新第二红外触摸数据,并根据更新后的第二红外触摸数,擦除红外触摸数据对应的书写轨迹。
具体的,本实施例提供的交互平板配置有书写笔,该书写笔包括笔尖和笔尾,其中笔尖的介质类型为第一介质类型,笔尾的介质类型为第二介质类型。一般的,可认为利用笔尖进行的触控操作为在操作面板上进行的书写操作,而利用笔尾进行的触控操作为在操作面板上进行的擦除操作。
第二处理设备根据第一红外触摸数据和弹性波信号确定触摸物对应的介质类型。在触摸物为书写笔的笔尖时,第二处理设备向第一处理设备发送的介质类型为第一介质类型,执行前述步骤S10721,在触摸物为书写笔的笔笔尾时,向第一处理设备发送的介质类型为第二介质类,执行步骤S10722。
第一处理设备接收到第二处理设备发送的第一介质类型后,将根据第一介质类型更新第二红外触摸数据,并根据更新后的第二红外触摸数据在操作面板上显示相应的书写轨迹。而第一处理设备接收到第二处理设备发送的第二介质类型后,依次读取缓存的红外触摸数据,根据第二介质类型更新第二红外触摸数据,并根据更新后的第二红外触摸数,擦除操作面板上红外触摸数据对应的书写轨迹。对于应用层来说,不同的触摸参数信息关联不同的显示属性,笔尾进行书写时,可以理解成显示属性为消除笔迹,通过预先设定笔尾的标准触摸参数信息并在应用层进行设定,则应用层在接收到表征笔尾的操作的红外触摸数据时,将对应擦除相应的书写笔迹。
书写笔的笔头和笔尾分别由不同的触碰介质类型对应的材料制成。基于不同部位的不同 介质类型,一支书写笔的不同位置的操作可以在某些情况下直接完成对应的触控操作,而不需要通过在触控检测区域通过对功能控件多次操作才能命中需要触发的控制操作。适应于用户纸质书写时的操作习惯,在本方案中将笔头和笔尾的介质类型分别对应为不同的触控操作,例如表征笔头的第一介质类型对应为书写轨迹同步输入的书写操作,表征笔尾的第二介质类型对应为对已有书写轨迹进行修正的擦除操作。当然,通过特定轨迹的触控操作或对特定区域的触控操作,笔头和笔尾也可以对应为触控控制操作。
在一个可能的实施例中,根据持续获取到的第二红外触摸数据显示书写轨迹,直至未获取到红外触摸数据,相应的,第一处理设备根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹,其具体包括:
S10723:第一处理设备持续获取更新后的第二红外触摸数,并根据更新后的第二红外触摸数,在操作面板上显示相应的书写轨迹,直至确认未获取到第二红外触摸数据。
具体的,***层在根据介质类型更新第二红外触摸数据后,将更新后的第二红外触摸数据上报给需要利用红外触摸数据进行书写轨迹的显示的应用层。应用层持续获取更新后的第二红外触摸数据,并根据更新后的第二红外触摸数据在操作面板上显示相应的书写轨迹,直至确定未获取到第二红外触摸数据,确定本次触控操作已完成。
在一个可能的实施例中,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,包括:
S1073:第一处理设备根据触摸物对应的介质类型,获得触摸物的触控操作的操作特性,并根据第二红外触摸数据表征的位置信息,对触摸物的触控操作进行响应。
其中,第一处理设备预先记录有不同的介质类型所对应的操作特性,并且不同的操作特性对应不同的响应方式,第一处理设备根据触摸物对应的介质类型,确定该介质类型对应的操作特性,从而确定触发本次触控操作的触摸物对应的操作特性。进一步的,根据第二红外触摸数据表征的位置信息,按照操作特性对应的响应方式,在第二红外触摸数据表征的位置信息处对触摸物的触控操作进行响应。其中,对于一个触控按键图标,可通过不同介质类型的触摸物点击触控按键图标,从而唤出不同的交互界面,例如,将材质1与操作特性1进行关联,将材质2与操作特性2进行关联,基于操作特性1进行的触控操作,将唤出界面1,基于操作特性2进行的触控操作,将唤出界面2。通过不同介质类型的触摸物进行触控操作,可快速确定触控操作的操作特性,通过不同介质类型的触摸物即可快速实现操作特性的设置,操作过程简洁高效,提高了交互平板的交互效率。
在一个可能的实施例中,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,包括:第一处理设备接收到介质类型信息后,根据第二红外 触摸数据确定触摸物所操作的控件,并结合触摸物的介质类型,对控件进行响应操作。例如第二红外触摸数据表征触控位置为批注控件,且处理设备预设设置了不同介质类型的触摸物点击批注控件时,调用不同的批注程序。则红外触摸数据反馈触摸物点击批注控件时,处理设备根据触摸物的介质类型进行响应,调用相应的批注程序。
图10给出了本公开实施例提供的一种触摸数据处理逻辑图,如图10所示,其中T为触控操作的时间跨度,从TOUCH(T1时刻)到DOWN(T3时刻)之间为触摸物向操作面板接近的时间,在T1时刻,第二处理设备通过弹性波传感器检测到弹性波信号,第二处理设备根据T1时刻的红外传感信号生成第一红外触摸数据,图中TOUCH表示触摸物刚开始进入触控检测区域的时间点,DOWN为触摸物进入触控检测区域后,第二处理设备检测到首帧红外触摸数据的时间点。第二处理设备在T2时刻根据弹性波信号和第一红外触摸数据得到介质类型,并向第一处理设备发送。第二处理设备在T3时刻开始向第一处理设备上报第二红外触摸数据(首帧红外触摸数据以及后续的红外触摸数据)。从DOWN到UP之间,第二处理设备将持续向第一处理设备发送第二红外触摸数据。在实际处理中,第二处理设备检测到第一帧红外触摸数据与上报第二红外触摸数据之间会有若干帧红外触摸数据的时间间隙,第二处理设备计算得到第一帧红外触摸数据后并不会马上上报(避免是灰尘等噪声点),而是会在持续计算得到两帧以上的红外触摸数据后,确定存在真实的触控操作,才会上报第二红外触摸数据。本实施例将上报给第一处理设备的第一个第二帧红外触摸数据称作首帧红外触摸数据,即首帧红外触摸数据有可能是第二处理设备计算获得的第二帧、第三帧或第四帧红外触摸数据,具体上报哪一帧,由第二处理设备或红外触控传感器的工作特性确定。图中T2时刻在T3之前,实际上也可以在T3之后,取决于红外触摸数据的上报时间。
第一处理设备在接收到第二红外触摸数据时,根据介质类型更新第二红外触摸数据(图中T4时刻),并根据更新后的第二红外触摸数据,在操作面板上显示相应的书写轨迹。最后,第二处理设备检测到末帧红外触摸数据后(图中T5时刻),确定触控操作完成。
可以理解的是,现有方案中,第二处理设备从检测到上报DOWN状态实际是需要一定延时的,存在手指接触操作面板了,但是第二处理设备还没向第一处理设备上报DOWN状态的情况。这种情况下,第一处理设备需要接收到DOWN状态才触发对弹性波数据的识别,导致对介质类型的识别延时较大。从时间轴上来看,本方案相当于在TOUCH状态就开始采集弹性波信号,然后计算TOUCH位置的第一红外触摸数据,利用弹性波信号和第一红外触摸数据来进行介质类型的识别,有效降低了对介质类型的识别延时。
图11给出了本公开实施例提供的一种触控操作的操作示意图,图12给出了本公开实施例提供的一种书写轨迹的显示示意图。如图11所示,假设以书写笔作为触摸物在操作面板上 进行触控操作,图11中箭头方向为书写笔的移动方向。在本次书写操作中,会依次发生触发事件、落笔事件、书写事件和抬笔事件,对应书写笔在操作面板上的触摸触发状态(TOUCH)、触摸落入状态(DOWN)、触摸移动状态(MOVE)和触摸抬起状态(UP)。图12中轨迹A为书写笔的操作轨迹,操作轨迹按照书写笔的移动方向划分为A1、A2和A3,分别对应书写笔在操作面板上的触摸落入状态(对应图10中的DOWN点)、触摸移动状态对应图10中的DOWN点到UP点)和触摸抬起状态对应图10中的UP点),其中A0对应触摸触发状态(对应图10中的TOUCH点)。在落笔的过程中,书写笔未接触到操作面板,弹性波传感器未能检测到书写笔对操作面板的触碰操作,而在进入书写阶段时,书写笔接触到操作面板,弹性波检测装置检测到弹性波信号。在落笔、移动和抬笔的整个过程中,红外触控传感器均能检测到红外触摸数据。第二处理设备在A0点通过弹性波传感器检测弹性波信号,并设备计算得到第一时刻对应的第一红外触摸数据,在A1阶段,第二处理设备根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型,并发送给第一处理设备。同时第二处理设备根据红外传感信号,计算获得发送给第一处理设备的第二红外触摸数据。在A2阶段,第二处理设备向第一处理设备发送第二红外触摸数据,第一处理设备根据触摸物对应的介质类型,对后续接收到的第二红外触摸数据进行更新,并根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹。在A3阶段,第一处理设备接收到第二处理设备发送的末帧触摸数据,触控操作完成。最后在操作面板上显示的书写轨迹如图12中轨迹B所示,其中轨迹B划分为B2和B3,分别对应于A2和A3。
上述,通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,就接收弹性波传感器检测到的触摸物接触操作面板时产生的弹性波信号,根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,就开始获取弹性波传感器所采集的弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。
在一个可能的实施例中,在第一处理设备接收第二处理设备发送的第二红外触摸数据或向弹性波检测装置发送第一红外触摸数据之后,第一处理设备在预设时间阈值内等待接收介质类型信息,相应的,触摸数据处理方法还包括步骤S1081:
S1081:第一处理设备确定在预设时间阈值内,未接收到弹性波检测装置发送的介质类型信息,直接根据第二红外触摸数据,在操作面板上显示相应的书写轨迹。
具体的,第一处理设备接收第二处理设备发送的第二红外触摸数据或向弹性波检测装置发送第一红外触摸数据之后,等待弹性波检测装置向其发送介质类型信息。一般来说,弹性波检测装置接收到第一红外触摸数据后,结合第一红外触摸数据以及弹性波信号获得介质类型并上报到第一处理设备的时间为13-20ms,因此可以设置一个预设时间阈值(例如20ms)作为等待弹性波检测装置反馈的时间。若第一处理设备确定在预设时间阈值(例如20ms)内,未接收到弹性波检测装置发送的介质类型,认为该弹性波信号是由干扰源产生的、由于误触产生的误报事件或者是***或通信出现异常,则直接根据红外触摸数据,在操作面板上显示相应的书写轨迹,即不执行根据介质类型更新第二红外触摸数据的步骤,而是根据原始的第二红外触摸数据在操作面板上显示相应的书写轨迹。若第一处理设备确定在预设时间阈值内接收到介质类型,则执行步骤S107,根据介质类型更新第二红外触摸数据,并根据更新后的第二红外触摸数,在操作面板上显示相应的书写轨迹。第一处理设备在预设时间阈值内未收到弹性波检测装置发送的介质类型时,直接根据红外触摸数据在操作面板上显示书写轨迹,以避免由于误报事件、***或通信出现异常而导致无法显示书写轨迹的情况,保证用户的书写体验。
在一个可能的实施例中,在第一处理设备接收第二处理设备发送的红外触摸数据或向弹性波检测装置发送第一红外触摸数据之后,第一处理设备在预设时间阈值内等待接收介质类型,相应的,触摸数据处理方法还包括步骤S1082:
S1082:第一处理设备确定在预设时间阈值内,未接收到弹性波检测装置发送的介质类型信息,获取弹性波检测装置上一次发送的介质类型信息,根据介质类型信息更新第二红外触摸数据,并根据更新后的第二红外触摸数,在操作面板上显示相应的书写轨迹。
具体的,第一处理设备接收第二处理设备发送的第二红外触摸数据或向弹性波检测装置发送第一红外触摸数据之后,等待弹性波检测装置向其发送介质类型信息。若第一处理设备确定在预设时间阈值(例如20ms)内,未接收到弹性波检测装置发送的介质类型信息,认为弹性波检测装置发生误报事件或者是***或通信出现异常,则获取弹性波检测装置上一次发送的介质类型信息,根据上一次的介质类型信息更新第二红外触摸数据,并根据更新后的第二红外触摸数据,在操作面板上显示相应的书写轨迹,此时书写轨迹的显示属性与上一次触控操作的显示属性相同。若第一处理设备确定在预设时间阈值内接收到介质类型,则执行步骤S107,根据介质类型信息更新第二红外触摸数据,并根据更新后的第二红外触摸数,在操作面板上显示相应的书写轨迹。第一处理设备在预设时间阈值内未收到弹性波检测装置发送 的介质类型信息时,根据红外触摸数据以及上一次的介质类型信息,在操作面板上显示书写轨迹,以避免由于误报事件、***或通信出现异常而导致无法显示书写轨迹的情况,保证用户的书写体验。
在一个可能的实施例中,本公开实施例提供的触摸数据处理方法还包括:
S109:第一处理设备接收到介质类型信息之前,对接收到的红外触摸数据进行响应。
第一处理设备在接收到弹性波检测装置发送的介质类型之前,不对后续第二红外触摸数据进行处理,而是直接对接收到的第二红外触摸数据进行响应,例如直接获取缓存的第二红外触摸数据,在接收到弹性波检测装置发送的介质类型之前,不需要对第二红外触摸数据进行更新,而是直接根据第二红外触摸数据在操作面板上显示相应的书写轨迹,直至接收到介质类型,再根据介质类型对第二红外触摸进行更新,保证对第二红外触摸数据的正常响应,实现对弹性波检测装置之间的通信异常时,无法正常显示书写轨迹的纠错。
在一个可能的实施例中,第二处理设备在检测到红外触摸数据中的末帧红外触摸数据后,继续根据检测到的红外传感信号确认开始采集弹性波信号的时刻。具体的,第二处理设备会一直检测红外触控传感器所产生的红外传感信号,从而可以根据下一次触控操作对应的红外传感信号来确认采集弹性波信号的时刻,保证对下一次触控操作的响应时机,提供对触控操作的响应速度,降低响应时延。
通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,就接收弹性波传感器检测到的触摸物接触操作面板时产生的弹性波信号,根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,就开始获取弹性波传感器所采集的弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。另外,在确定介质类型后才对第二红外触摸数据进行响应,避免了在触摸物还未接触到操作面板时就发生误触。显示的书写轨迹与触摸物在操作面板上的实际触摸轨迹更接近,同时,在显示书写轨迹时确定触摸物已经接触操作面板,实现书写操作的零书写高度,并且通过介质类型可快速确定书写轨迹的显示属性,通过不同介质类型的触摸物即可快速实现设置目标,操作过程简洁高效,提高了交互平板的交互效率。
图13给出了本实施例提供的一种交互平板的结构示意图,如图13所示,交互平板100包括至少一块操作面板500,另外,交互平板100还包括第一处理设备200、第二处理设备300、红外触控传感器400和弹性波检测装置700,并且红外触控传感器400与第二处理设备300通信连接,第二处理设备300和性波检测装置700均与第一处理设备200通信连接。本实施例提供的交互平板与图1提供的交互平板的区别在于,本实施例的交互平板通过弹性波检测装置进行弹性波信号的检测,具体的,弹性波检测装置通过一个或多个弹性波传感器检测触摸物在触碰交互平板的操作面板时生成的一个或多个弹性波信号。交互平板的其他设置可参照上述实施例提供的交互平板,本实施例不再赘述。
可选的,第二处理设备300与弹性波检测装置700通信连接。第二处理设备300和弹性波检测装置700与第一处理设备200通信连接。本方案提供的弹性波检测装置在操作面板上,用于检测触摸物在触碰交互平板的操作面板时生成的弹性波信号。
图14给出了本公开实施例提供的一种触摸数据处理方法的流程图,本公开实施例提供的触摸数据处理方法应用于交互平板,交互平板包括操作面板、弹性波检测装置、红外触控传感器、第一处理设备和第二处理设备,红外触控传感器设置在操作面板的至少一个边缘以形成交互平板的触控检测区域,交互平板还包括弹性波检测装置,该弹性波检测装置包括弹性波传感器,弹性波检测装置和红外触控传感器均与第一处理设备通信连接。红外触控传感器用于在触摸物在交互平板的触控检测区域进行触控操作时,产生红外传感信号。弹性波检测装置用于在触摸物在交互平板的触控检测区域进行触控操作时,产生弹性波信号。本实施例提供的触摸数据处理方法与图2提供的触摸数据处理方法的区别在于,本实施例中弹性波采集信号是由弹性波检测装置在接收到通知信息后进行采集的,即由弹性波检测装置通过弹性波传感器采集弹性波信号,通知信息是由第二处理设备在开始检测到红外传感信号的第一时刻生成的。并且,本实施例根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型的步骤是在弹性波检测装置中进行的。本实施例主要针对与上述实施例提供的触摸数据处理方法的区别进行阐述,其他步骤可参照上述实施例提供的触摸数据处理方法,本实施例不再赘述。
参考图14,本实施例提供的触摸数据处理方法包括:
S201:当触摸物在交互平板的触控检测区域进行触控操作时,红外触控传感器从第一时刻开始产生红外传感信号,并发送给第二处理设备。
S202:弹性波检测装置接收弹性波传感器所产生的弹性波信号,弹性波信号由触摸物接触操作面板时产生。
在一个实施例中,如图15提供的一种弹性波信号接收流程示意图所示,弹性波检测装置 接收弹性波传感器所产生的弹性波信号,包括:
S2021:第二处理设备在开始获取到红外传感信号之后,生成通知信息。
S2022:弹性波检测装置接收到通知信息后,开始获取弹性波传感器所产生的弹性波信号。其中,通知信息由第二处理设备发送至弹性波检测装置,或者由第一处理设备转发至弹性波检测装置。
第二处理设备在开始检测到红外传感信号的第一时刻时,生成通知信息并向弹性波检测装置发送,以通知弹性波检测装置采集弹性波信号进行材质识别,可以减少延时,提高响应速度。
其中,通知信息由第二处理设备发送至弹性波检测装置,或者由第一处理设备转发至弹性波检测装置。在第二处理设备与弹性波检测装置通信连接时,第二处理设备可直接向弹性波检测装置发送通知信息,在第二处理设备与弹性波检测装置未通信连接时,第二处理设备先向,第一处理设备发送通知信息,再由第一处理设备向弹性波检测装置转发通知信息。弹性波检测装置在接收到第二处理设备或第一处理设备发送的通知信息后,开始采集并缓存弹性波信号。
S203:第二处理设备根据红外传感信号计算得到第一时刻对应的第一红外触摸数据;其中,第一红外触摸数据包括触摸物的触摸位置信息。
S204:弹性波检测装置接收到第一红外触摸数据后,根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型。其中,第一红外触摸数据由第二处理设备发送至弹性波检测装置,或者由第一处理设备转发至弹性波检测装置。
在接收到第一时刻对应的第一红外触摸数据后,弹性波检测装置根据第一红外触摸数据的触摸位置信息和/或触摸参数信息,以及弹性波信号,确定触摸物对应的介质类型。
在具体实现本方案时,可根据第一红外触摸数据的触摸位置信息确定弹性波信号的起振点,并根据起振点确定用于进行介质类型识别的材质识别信号。基于此,如图16提供的一种介质类型的确定流程示意图所示,本实施例提供的根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型,包括步骤S2041-S2044:
S2041:根据第一红外触摸数据的触摸位置信息,确认弹性波信号的起振点。
S2042:根据起振点前的弹性波信号,确定噪声信息。
S2043:根据噪声信息,从起振点后的弹性波信号中确定材质识别信号。
S2044:第一红外触摸数据的触摸位置信息和材质识别信号,确定触摸物对应的介质类型以及置信区间。
本实施例在弹性波检测装置中根据第一红外触摸数据和弹性波信号确定触摸物对应的介 质类型,介质类型的具体确定方式可参照上述实施例提供的触摸数据处理方法,本实施例不再赘述。
在具体实现本方案时,可利用特征识别模型进行介质类型的确定,对应的,步骤S2044具体为:将触摸位置信息和材质识别信号,输入到训练好的特征识别模型中,获得触摸物对应的介质类型以及置信区间。
在一个实施例中,弹性波检测装置中弹性波传感器的数量为多个,弹性波信号为多个,步骤S2044包括:
S20441:对多个弹性波信号对应的材质识别信号进行融合处理,得到预处理信号;将触摸位置信息和预处理信号,输入到训练好的特征识别模型中,获得触摸物对应的介质类型以及置信区间。
在具体实现本方案时,还可利用特征数据库进行介质类型的确定,对应的,如图17提供的一种利用特征数据库确定介质类型的流程示意图所示,步骤S2044包括:
S20442:对材质识别信号进行特征提取后,根据第一红外触摸数据中的触摸位置信息,对材质识别信号进行修正。
S20443:根据修正后的特征,与预设的特征数据库进行比对,获得触摸物对应的介质类型以及置信区间。
在弹性波检测装置中预先设置有特征数据库,该特征数据库中记录有预设特征和预设介质类型之间的对应关系。其中,预设特征和预设介质类型之间的对应关系可通过键值对的方式进行记录。
具体的,弹性波检测装置在确定材质识别信号后,对材质识别信号进行特征提取。在对材质识别信号进行特征提取后,确定第一红外触摸数据中的触摸位置信息,根据触摸位置信息对提取得到的特征进行修正。在完成对特征的修正后,将修正后的特征在预设的特征数据库中进行匹配比对,在匹配到一致或相似度达到设定相似度要求的预设特征时,将该预设特征对应的预设介质类型确定为触摸物对应的介质类型。
在一个可能的实施例中,获得触摸物对应的介质类型以及置信区间的步骤中,获得的介质类型为至少两种,且每种介质类型对应的置信区间均低于设定置信阈值。基于此,本实施例提供的触摸数据处理方法还包括:
S2045:弹性波检测装置根据第一红外触摸数据,对至少两种介质类型进行修正后,确定其中一种介质类型作为触摸物对应的介质类型。
弹性波检测装置通过特征识别模型或特征数据库获得两种或以上的介质类型,且每种介质类型对应的置信区间均低于设定置信阈值时,则对这些介质类型进行修正后,确定其中一 种介质类型作为触摸物对应的介质类型。
在一个可能的实施例中,获得触摸物对应的介质类型以及置信区间的步骤中,所获得的介质类型的置信区间低于设定置信阈值,本实施例提供的触摸数据处理方法还包括:
S2046:第一处理设备根据红外触摸数据的触摸位置信息,判断当前的触控操作与上一次抬起的触控操作是否相关联,若相关联,则获取上一次触控操作对应的介质类型,作为触摸物对应的介质类型。
在弹性波检测装置获得的介质类型的置信区间低于设定置信阈值时,第一处理设备根据本次触控操作与上一次触控操作是否关联来确定触摸物对应的介质类型。
在一个可能的实施例中,在弹性波检测装置接收到第一红外触摸数据之前,还包括:
S2047:弹性波检测装置对弹性波信号进行预处理,得到预处理结果。
相应的,弹性波检测装置接收到第一红外触摸数据后,根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型,具体为:
弹性波检测装置接收到第一红外触摸数据后,根据第一红外触摸数据和预处理结果,确定触摸物对应的介质类型。
S205:弹性波检测装置向第一处理设备发送介质类型信息,介质类型信息包括触摸物对应的介质类型。
弹性波检测装置在根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型后,根据触摸物对应的介质类型,生成包括该介质类型的介质类型信息,并向第一处理设备发送介质类型信息。
S206:第二处理设备根据红外传感信号,计算获得发送给第一处理设备的第二红外触摸数据。
在具体实现本方案时,可以是根据红外触摸数据中的首帧红外触摸确定第二红外触摸数据的起始点,基于此,如图18提供的一种第二红外触摸数据确定流程示意图所示,步骤S206包括:
S2061:第二处理设备根据红外传感信号,计算获得相应的红外触摸数据。
S2062:根据计算获得的红外触摸数据,确认触控操作对应的首帧红外触摸数据,获得首帧红外触摸数据及其之后的每帧红外触摸数据作为第二红外触摸数据;首帧红外触摸数据中的触摸状态信息指示触摸物的触摸状态为触摸落入状态。
对应的,确定触摸物对应的介质类型的步骤中,获得的介质类型为至少两种,且每种介质类型对应的置信区间均低于设定阈值。基于此,本实施例提供的触摸数据处理方法还包括:
弹性波检测装置根据第一红外触摸数据,对至少两种介质类型进行校准后,确定其中一 种介质类型作为触摸物对应的介质类型。
S207:第二处理设备从第二时刻开始,向第一处理设备发送第二红外触摸数据;其中,第二时刻在第一时刻之后。
S208:第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应。
在一个可能的实施例中,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,包括步骤S2081-S2082:
S2081:第一处理设备根据触摸物对应的介质类型,对第二红外触摸数据进行更新。
S2082:第一处理设备根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹。
图19提供了一种交互平板的硬件结构示意图,如图19所示,在第一处理设备200中设置有***层和应用层,其中***层用于执行数据层面的数据处理,例如对接收到的传感数据的分析处理,应用层用于执行应用层面的数据处理,例如根据应用任务需求进行分析处理,***层在完成数据处理后,通过数据接口将数据处理结果发送给应用层,应用层再通过数据接口分发给具体的应用,由具体应用进行进一步的处理。对应的,本实施例中根据触摸物对应的介质类型,对后续接收到的第二红外触摸数据进行更新的步骤是在***层进行处理的,而根据更新后的第二红外触摸数据,在交互平板的操作面板500上显示相应的书写轨迹的步骤是在应用层进行处理的。即***层在完成对第二红外触摸数据的更新后,将更新后的第二红外触摸数据上报到应用层中,应用层将更新后的第二红外触摸数据分发给白板应用,由白板应用执行后续的显示书写轨迹的步骤。更具体的,***层可运行第一处理设备200的驱动程序,应用层可运行第一处理设备200安装的应用程序,包括前述的白板应用、交互平板的批注应用或者其它书写应用等。驱动程序按照先进先出的顺序,依次读取缓存的第二红外触摸数据,根据介质类型更新读取出的第二红外触摸数据,并将更新后的第二红外触摸数据发送至应用层,应用层再将更新后的第二红外触摸数据发送给应用程序,应用程序接收到更新后的第二红外触摸数据后,进行响应,绘制相应的书写轨迹,并在操作面板500上进行显示。
在具体实现本方案时,预先针对不同的介质类型确定对应的标准触摸参数信息(包括标准触摸高度信息和标准触摸宽度信息),相应的,如图20提供的一种第二红外触摸数据更新流程示意图所示,第一处理设备根据触摸物对应的介质类型,对第二红外触摸数据进行更新,具体包括步骤S20811-S20812:
S20811:第一处理设备根据触摸物对应的介质类型,确定介质类型的标准触摸参数信息。
S20812:将第二红外触摸数据的触摸参数信息更新为标准触摸参数信息,得到更新后的 第二红外触摸数据。
在具体实现本方案时,可根据不同的介质类型设定不同的ID,相应的,第一处理设备根据触摸物对应的介质类型,对第二红外触摸数据进行更新,具体包括步骤S20813:
S20813:第一处理设备将触摸物对应的介质类型,写入到第二红外触摸数据的数据包中,得到更新后的第二红外触摸数据。
在一个可能的实施例中,书写轨迹的显示属性可基于第二红外触摸数据进行确定,相应的,第一处理设备根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹,其具体包括步骤S20821:
S20821:第一处理设备读取更新后的第二红外触摸数据的每帧数据的触摸状态信息、触摸位置信息和触摸参数信息,当触摸状态信息指示触摸状态为触摸移动状态时,根据触摸参数信息对应的显示属性,在触摸位置信息指示的位置,显示相应的书写轨迹。
在一个可能的实施例中,根据持续获取到的第二红外触摸数据显示书写轨迹,直至未获取到红外触摸数据,相应的,第一处理设备根据更新后的第二红外触摸数据,在交互平板的操作面板上显示相应的书写轨迹,其具体包括:
S20822:第一处理设备持续获取更新后的第二红外触摸数,并根据更新后的第二红外触摸数,在操作面板上显示相应的书写轨迹,直至确认未获取到第二红外触摸数据。
在一个可能的实施例中,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,包括:
S2083:第一处理设备根据触摸物对应的介质类型,获得触摸物的触控操作的操作特性,并根据第二红外触摸数据表征的位置信息,对触摸物的触控操作进行响应。
在一个可能的实施例中,第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应,包括:第一处理设备接收到介质类型信息后,根据第二红外触摸数据确定触摸物所操作的控件,并结合触摸物的介质类型,对控件进行响应操作。
图21给出了本公开实施例提供的一种触摸数据处理逻辑图,如图21所示,其中T为触控操作的时间跨度,从TOUCH(T1时刻)到DOWN(T3时刻)之间为触摸物向操作面板接近的时间,在T1时刻,第二处理设备开始检测到红外传感信号,第二处理设备在T1’时刻向弹性波检测装置发送通知信息,以通知弹性波检测装置检测到弹性波信号,并且第二处理设备根据红外传感信号生成第一红外触摸数据,并发送给弹性波检测装置。图中TOUCH表示触摸物刚开始进入触控检测区域的时间点,DOWN为触摸物进入触控检测区域后,第二处理设备检测到首帧红外触摸数据的时间点。弹性波检测装置在T2时刻根据弹性波信号和第一红外触摸数据得到介质类型,并向第一处理设备发送。第二处理设备在T3时刻开始向第一 处理设备上报第二红外触摸数据(首帧红外触摸数据以及后续的红外触摸数据)。从DOWN到UP之间,第二处理设备将持续向第一处理设备发送第二红外触摸数据。在实际处理中,第二处理设备检测到第一帧红外触摸数据与上报第二红外触摸数据之间会有若干帧红外触摸数据的时间间隙,第二处理设备计算得到第一帧红外触摸数据后并不会马上上报(避免是灰尘等噪声点),而是会在持续计算得到两帧以上的红外触摸数据后,确定存在真实的触控操作,才会上报第二红外触摸数据。本实施例将上报给第一处理设备的第一个第二帧红外触摸数据称作首帧红外触摸数据,即首帧红外触摸数据有可能是第二处理设备计算获得的第二帧、第三帧或第四帧红外触摸数据,具体上报哪一帧,由第二处理设备或红外触控传感器的工作特性确定。
第一处理设备在接收到第二红外触摸数据时,根据介质类型更新第二红外触摸数据(图中T10时刻),并根据更新后的第二红外触摸数据,在操作面板上显示相应的书写轨迹(从图中T11时刻开始)。最后,第二处理设备检测到末帧红外触摸数据后(图中T12时刻),确定触控操作完成。
在一个可能的实施例中,第二处理设备在检测到红外触摸数据中的末帧红外触摸数据后,继续根据检测到的红外传感信号确认开始采集弹性波信号的时刻。具体的,第二处理设备会一直检测红外触控传感器所产生的红外传感信号,从而可以根据下一次触控操作对应的红外传感信号来确认采集弹性波信号的时刻,保证对下一次触控操作的响应时机,提供对触控操作的响应速度,降低响应时延。
上述,通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,发送红外传感信号给第二处理设备,由第二处理设备根据红外传感信号计算发送给弹性波检测装置的第一红外触摸数据,通过弹性波检测装置检测触摸物接触操作面板时产生的弹性波信号,并根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,弹性波检测装置就采集弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。另外,在确定介质类型后才对第二红外触摸数据进行响应,避免了在触摸物还未接触到操作面板时就发生误触。显示的书写轨迹与触摸物在操作面板上的实际触摸轨迹更接近,同时,在显示书写轨迹时确定触摸物已经 接触操作面板,实现书写操作的零书写高度,并且通过介质类型可快速确定书写轨迹的显示属性,通过不同介质类型的触摸物即可快速实现设置目标,操作过程简洁高效,提高了交互平板的交互效率。
图22给出了本公开实施例提供的一种交互平板的结构框图。该交互平板可用于执行上述任一实施例提供的触摸数据处理方法,参考图22,该交互平板包括操作面板、红外触控传感器、第一处理设备和第二处理设备,红外触控传感器设置在操作面板的至少一个边缘以形成交互平板的触控检测区域,其中,交互平板还包括弹性波传感器,弹性波传感器、红外触控传感器均与第二处理设备连接。
红外触控传感器,用于当触摸物在触控检测区域进行触控操作时,从第一时刻开始产生红外传感信号,并发送给第二处理设备;
第二处理设备,用于从第一时刻之后,开始获取弹性波传感器所产生的弹性波信号,弹性波信号由触摸物接触操作面板时产生;以及
根据红外传感信号计算得到第一时刻对应的第一红外触摸数据后,根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型,其中,第一红外触摸数据包括触摸物的触摸位置信息;以及
向第一处理设备发送介质类型信息,介质类型信息包括触摸物对应的介质类型;以及
从第二时刻开始,向第一处理设备发送第二红外触摸数据;其中,第二时刻在接收弹性波信号的时刻之后;
第一处理设备根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应。
上述,通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,就接收弹性波传感器检测到的触摸物接触操作面板时产生的弹性波信号,根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,就开始获取弹性波传感器所采集的弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作,提高了触控操作的响应速度,而且操作简单,效率较高。本方案提供的交互平板的具体技术细节和技术效 果可参照前述实施例(例如图2实施例中的触摸数据处理方法),本公开不再赘述。
图23给出了本公开实施例提供的一种交互平板的结构框图。该交互平板可用于执行上述任一实施例提供的触摸数据处理方法,参考图23,该交互平板包括操作面板、红外触控传感器、第一处理设备和第二处理设备,红外触控传感器设置在操作面板的至少一个边缘以形成交互平板的触控检测区域,其中,交互平板还包括弹性波检测装置,该弹性波检测装置包括弹性波传感器。
红外触控传感器,用于当触摸物在交互平板的触控检测区域进行触控操作时,红外触控传感器从第一时刻开始产生红外传感信号,并发送给第二处理设备;
第二处理设备,根据红外传感信号计算得到第一时刻对应的第一红外触摸数据;其中,第一红外触摸数据包括触摸物的触摸位置信息;以及
从第二时刻开始,向第一处理设备发送第二红外触摸数据;其中,第二时刻在第一时刻之后;
弹性波检测装置,用于接收弹性波传感器所产生的弹性波信号,弹性波信号由触摸物接触操作面板时产生;以及
在接收到第一红外触摸数据后,根据第一红外触摸数据和弹性波信号,确定触摸物对应的介质类型;其中,第一红外触摸数据由第二处理设备发送至弹性波检测装置,或者由第一处理设备转发至弹性波检测装置;以及
向第一处理设备发送介质类型信息,介质类型信息包括触摸物对应的介质类型;
第一处理设备用于根据触摸物对应的介质类型和第二红外触摸数据,对触摸物的触控操作进行响应。
上述,通过红外触控传感器检测触摸物触摸交互平板的触控检测区域时产生的红外传感信号,并在开始检测到红外传感信号的第一时刻后,发送红外传感信号给第二处理设备,由第二处理设备根据红外传感信号计算发送给弹性波检测装置的第一红外触摸数据,通过弹性波检测装置检测触摸物接触操作面板时产生的弹性波信号,并根据第一时刻对应的第一红外触摸数据以及弹性波信号确定触摸物对应的介质类型,通过结合弹性波信号和第一红外触摸数据判断介质类型,提高了对触摸物的识别精度,提高了对触摸物的识别精度。而且在开始检测到红外传感信号的预设时间阈值内的第一时刻,弹性波检测装置就采集弹性波信号,并根据弹性波信号和第一红外触摸数据判断介质类型,并将介质类型发送到第一处理设备,从而从第二时刻开始,第二处理设备向第一处理设备上报代表有效触控操作的第二红外触摸数据后,第一处理设备就可以根据不同的介质类型,对第二红外触摸数据执行不同的响应操作, 提高了触控操作的响应速度,而且操作简单,效率较高。本方案提供的交互平板的具体技术细节和技术效果可参照前述实施例(例如图14实施例中的触摸数据处理方法),本公开不再赘述。
本公开实施例还提供一种包含计算机可执行指令的可读存储介质,计算机可执行指令在由计算机处理器执行时用于执行如上述实施例提供的触摸数据处理方法。
存储介质——任何的各种类型的存储器设备或存储设备。术语“存储介质”旨在包括:安装介质,例如CD-ROM、软盘或磁带装置;计算机***存储器或随机存取存储器,诸如DRAM、DDR RAM、SRAM、EDO RAM,兰巴斯(Rambus)RAM等;非易失性存储器,诸如闪存、磁介质(例如硬盘或光存储);寄存器或其它相似类型的存储器元件等。存储介质可以还包括其它类型的存储器或其组合。另外,存储介质可以位于程序在其中被执行的第一计算机***中,或者可以位于不同的第二计算机***中,第二计算机***通过网络(诸如因特网)连接到第一计算机***。第二计算机***可以提供程序指令给第一计算机用于执行。术语“存储介质”可以包括可以驻留在不同位置中(例如在通过网络连接的不同计算机***中)的两个或更多存储介质。存储介质可以存储可由一个或多个处理器执行的程序指令(例如具体实现为计算机程序)。
当然,本公开实施例所提供的一种包含计算机可执行指令的可读存储介质,其计算机可执行指令不限于如上提供的触摸数据处理方法,还可以执行本公开任意实施例所提供的触摸数据处理方法中的相关操作。
上述实施例中提供的交互平板及存储介质可执行本公开任意实施例所提供的触摸数据处理方法,未在上述实施例中详尽描述的技术细节,可参见本公开任意实施例所提供的触摸数据处理方法。
上述仅为本公开的较佳实施例及所运用的技术原理。本公开不限于这里提供的特定实施例,对本领域技术人员来说能够进行的各种明显变化、重新调整及替代均不会脱离本公开的保护范围。因此,虽然通过以上实施例对本公开进行了较为详细的说明,但是本公开不仅仅限于以上实施例,在不脱离本公开构思的情况下,还可以包括更多其他等效实施例,而本公开的范围由权利要求的范围决定。

Claims (20)

  1. 一种触摸数据处理方法,应用于交互平板,所述交互平板包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,其中,所述交互平板还包括弹性波传感器,所述弹性波传感器、所述红外触控传感器均与所述第二处理设备连接,所述方法包括:
    当触摸物在所述触控检测区域进行触控操作时,所述红外触控传感器从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
    所述第二处理设备从第一时刻之后,开始获取所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;
    所述第二处理设备根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型,其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;
    所述第二处理设备向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;
    所述第二处理设备从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在接收所述弹性波信号的时刻之后;
    所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
  2. 一种触摸数据处理方法,应用于交互平板,所述交互平板包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,其中,所述交互平板还包括弹性波检测装置,所述弹性波检测装置包括弹性波传感器,所述方法包括:
    当触摸物在所述交互平板的触控检测区域进行触控操作时,所述红外触控传感器从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
    所述弹性波检测装置接收所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;
    所述第二处理设备根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据;其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;
    所述弹性波检测装置接收到所述第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型;其中,所述第一红外触摸数据由所述第二处理设备发送至所述弹性波检测装置,或者由所述第一处理设备转发至所述弹性波检测装置;
    所述弹性波检测装置向所述第一处理设备发送介质类型信息,所述介质类型信息包括所 述触摸物对应的介质类型;
    所述第二处理设备从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在所述第一时刻之后;
    所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
  3. 根据权利要求1或2所述的触摸数据处理方法,其中,
    所述第一红外触摸数据为所述第二处理设备计算获得的第一帧红外触摸数据;
    所述第二红外触摸数据为所述第二处理设备计算获得的第N帧触摸数据至最后一帧红外触摸数据,其中,N为大于1的自然数。
  4. 根据权利要求1所述的触摸数据处理方法,其中,所述第二处理设备向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型的步骤,其具体为:
    所述第二处理设备向所述第一处理设备发送包含介质类型信息的第二红外触摸数据,所述介质类型信息包括所述触摸物对应的介质类型。
  5. 根据权利要求2所述的触摸数据处理方法,其中,所述弹性波检测装置接收所述弹性波传感器所产生的弹性波信号,包括:
    所述第二处理设备在开始获取到所述红外传感信号之后,生成通知信息;
    所述弹性波检测装置接收到所述通知信息后,开始获取所述弹性波传感器所产生的弹性波信号;其中,所述通知信息由所述第二处理设备发送至所述弹性波检测装置,或者由所述第一处理设备转发至所述弹性波检测装置。
  6. 根据权利要求2所述的触摸数据处理方法,其中,所述弹性波检测装置接收到所述第一红外触摸数据之前,还包括步骤:
    所述弹性波检测装置对所述弹性波信号进行预处理,得到预处理结果;
    所述弹性波检测装置接收到所述第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型,具体为:
    所述弹性波检测装置接收到所述第一红外触摸数据后,根据所述第一红外触摸数据和所述预处理结果,确定所述触摸物对应的介质类型。
  7. 根据权利要求1或2所述的触摸数据处理方法,其中,所述根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型,包括:
    根据所述弹性波信号的时域频域信息,确认所述弹性波信号的起振点;
    根据所述起振点前的所述弹性波信号,确定噪声信息;
    根据所述噪声信息,从所述起振点后的所述弹性波信号中确定材质识别信号;
    根据所述第一红外触摸数据的触摸位置信息和所述材质识别信号,确定所述触摸物对应的介质类型以及置信区间。
  8. 根据权利要求7所述的触摸数据处理方法,其中,所述根据所述第一红外触摸数据的触摸位置信息和所述材质识别信号,确定所述触摸物对应的介质类型以及置信区间,包括:
    将所述第一红外触摸数据的触摸位置信息和所述材质识别信号,输入到训练好的特征识别模型中,获得所述触摸物对应的介质类型以及置信区间。
  9. 根据权利要求7所述的触摸数据处理方法,其中,所述弹性波信号为多个,所述根据所述第一红外触摸数据的触摸位置信息和所述材质识别信号,确定所述触摸物对应的介质类型以及置信区间,包括:
    对多个弹性波信号对应的材质识别信号进行融合处理,得到预处理信号;
    将所述第一红外触摸数据的触摸位置信息和所述预处理信号,输入到训练好的特征识别模型中,获得所述触摸物对应的介质类型以及置信区间。
  10. 根据权利要求7所述的触摸数据处理方法,其中,所述根据所述第一红外触摸数据的触摸位置信息和所述材质识别信号,确定所述触摸物对应的介质类型以及置信区间,包括:
    对所述材质识别信号进行特征提取后,获得第一特征;
    根据所述第一红外触摸数据中的触摸位置信息,对所述第一特征进行修正;
    根据修正后的所述第一特征,与预设的特征数据库进行比对,获得所述触摸物对应的介质类型以及置信区间。
  11. 根据权利要求8至10任一项所述的触摸数据处理方法,其中,所述第一红外触摸数据还包括触摸参数信息,所述获得所述触摸物对应的介质类型以及置信区间的步骤中,获得的介质类型为至少两种,且每种介质类型对应的置信区间均低于设定置信阈值;所述方法还包括:
    根据所述第一红外触摸数据的触摸参数信息,确定所述至少两种介质类型中的其中一种作为所述触摸物对应的介质类型。
  12. 根据权利要求11所述的触摸数据处理方法,其中,所述根据所述第一红外触摸数据的触摸参数信息,确定所述至少两种介质类型中的其中一种作为所述触摸物对应的介质类型,具体为:
    获取所述第一红外触摸数据中的触摸参数信息;
    获得所述至少两种介质类型对应的预设阈值区间;所述预设阈值区间用于表征介质类型的触摸参数的数值范围;
    确定各所述预设阈值区间中,与所述触摸参数信息最接近的第一预设阈值区间;
    将所述第一预设阈值区间对应的介质类型,作为所述触摸物对应的介质类型。
  13. 根据权利要求11所述的触摸数据处理方法,其中,所述触摸参数信息包括用于表征所述触控操作对应的触摸点的面积的信息。
  14. 根据权利要求8至10任一项所述的触摸数据处理方法,其中,所述获得所述触摸物对应的介质类型以及置信区间的步骤中,所获得的介质类型的置信区间低于设定置信阈值,所述方法还包括:
    所述第一处理设备根据所述第二红外触摸数据的触摸位置信息,判断当前的触控操作与上一次抬起的触控操作是否相关联,若相关联,则获取上一次触控操作对应的介质类型,作为所述触摸物对应的介质类型。
  15. 根据权利要求1或2所述的触摸数据处理方法,其中,所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应,包括:
    所述第一处理设备根据所述触摸物对应的介质类型,对所述第二红外触摸数据进行更新;
    所述第一处理设备根据更新后的所述第二红外触摸数据,在所述交互平板的显示屏上显示相应的书写轨迹。
  16. 根据权利要求15所述的触摸数据处理方法,其中,所述第一处理设备根据所述触摸物对应的介质类型,对所述第二红外触摸数据进行更新,具体为:
    所述第一处理设备根据所述触摸物对应的介质类型,确定所述介质类型的标准触摸参数信息;
    将所述第二红外触摸数据的触摸参数信息更新为所述标准触摸参数信息,得到更新后的第二红外触摸数据。
  17. 根据权利要求15所述的触摸数据处理方法,其中,所述第一处理设备根据所述触摸物对应的介质类型,对所述第二红外触摸数据进行更新,其具体为:
    所述第一处理设备将所述触摸物对应的介质类型,写入到所述第二红外触摸数据的数据包中,得到更新后的第二红外触摸数据。
  18. 根据权利要求15所述的触摸数据处理方法,所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应,包括:
    所述第一处理设备接收到所述介质类型信息后,根据所述第二红外触摸数据确定所述触摸物所操作的控件,并结合所述触摸物的介质类型,对所述控件进行响应操作。
  19. 一种交互平板,包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区 域,其中,所述交互平板还包括弹性波传感器,所述弹性波传感器、所述红外触控传感器均与所述第二处理设备连接;
    所述红外触控传感器,用于当触摸物在所述触控检测区域进行触控操作时,从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
    所述第二处理设备,用于从第一时刻之后,开始获取所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;以及
    根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型,其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;以及
    向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;以及
    从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在接收所述弹性波信号的时刻之后;
    所述第一处理设备根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
  20. 一种交互平板,包括操作面板、红外触控传感器、第一处理设备和第二处理设备,所述红外触控传感器设置在所述操作面板的至少一个边缘以形成所述交互平板的触控检测区域,其中,所述交互平板还包括弹性波检测装置,所述弹性波检测装置包括弹性波传感器;
    所述红外触控传感器,用于当触摸物在所述交互平板的触控检测区域进行触控操作时,所述红外触控传感器从第一时刻开始产生红外传感信号,并发送给所述第二处理设备;
    所述第二处理设备,根据所述红外传感信号计算得到所述第一时刻对应的第一红外触摸数据;其中,所述第一红外触摸数据包括所述触摸物的触摸位置信息;以及
    从第二时刻开始,向所述第一处理设备发送第二红外触摸数据;其中,所述第二时刻在所述第一时刻之后;
    所述弹性波检测装置,用于接收所述弹性波传感器所产生的弹性波信号,所述弹性波信号由所述触摸物接触所述操作面板时产生;以及
    在接收到所述第一红外触摸数据后,根据所述第一红外触摸数据和所述弹性波信号,确定所述触摸物对应的介质类型;其中,所述第一红外触摸数据由所述第二处理设备发送至所述弹性波检测装置,或者由所述第一处理设备转发至所述弹性波检测装置;以及
    向所述第一处理设备发送介质类型信息,所述介质类型信息包括所述触摸物对应的介质类型;
    所述第一处理设备用于根据所述触摸物对应的介质类型和所述第二红外触摸数据,对所述触摸物的触控操作进行响应。
PCT/CN2021/122176 2021-04-22 2021-09-30 一种触摸数据处理方法及交互平板 WO2022222385A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202110436301.9A CN114692580A (zh) 2021-04-22 2021-04-22 批注控制方法和交互平板
CN202110436274.5 2021-04-22
CN202110436301.9 2021-04-22
CN202110436274.5A CN114690853B (zh) 2021-04-22 2021-04-22 交互方法和交互平板

Publications (1)

Publication Number Publication Date
WO2022222385A1 true WO2022222385A1 (zh) 2022-10-27

Family

ID=83723530

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2021/122176 WO2022222385A1 (zh) 2021-04-22 2021-09-30 一种触摸数据处理方法及交互平板
PCT/CN2021/122175 WO2022222384A1 (zh) 2021-04-22 2021-09-30 触摸数据处理方法及交互平板

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/122175 WO2022222384A1 (zh) 2021-04-22 2021-09-30 触摸数据处理方法及交互平板

Country Status (1)

Country Link
WO (2) WO2022222385A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105094464A (zh) * 2015-08-05 2015-11-25 深圳市华星光电技术有限公司 红外触控装置
CN106291192A (zh) * 2016-08-22 2017-01-04 青岛海信电器股份有限公司 一种交互式红外触摸一体机响应时延的测试方法和装置
CN110308824A (zh) * 2019-07-04 2019-10-08 深圳市康冠商用科技有限公司 一种红外触摸数据的处理方法、***及相关组件
CN110413188A (zh) * 2018-04-28 2019-11-05 北京钛方科技有限责任公司 智能设备控制方法及装置
CN112327783A (zh) * 2020-11-17 2021-02-05 深圳Tcl新技术有限公司 设备的控制方法、装置、终端和计算机可读存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102011114535A1 (de) * 2011-09-29 2013-04-04 Eads Deutschland Gmbh Datenhandschuh mit taktiler Rückinformation und Verfahren
CN106775005A (zh) * 2016-11-23 2017-05-31 广州视源电子科技股份有限公司 交互设备、激活方法及装置
CN111443820B (zh) * 2019-01-17 2021-09-21 北京钛方科技有限责任公司 触控板的按压冲量识别方法及***
CN112558803A (zh) * 2019-09-26 2021-03-26 北京钛方科技有限责任公司 一种车载触控装置及控制方法、汽车

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105094464A (zh) * 2015-08-05 2015-11-25 深圳市华星光电技术有限公司 红外触控装置
CN106291192A (zh) * 2016-08-22 2017-01-04 青岛海信电器股份有限公司 一种交互式红外触摸一体机响应时延的测试方法和装置
CN110413188A (zh) * 2018-04-28 2019-11-05 北京钛方科技有限责任公司 智能设备控制方法及装置
CN110308824A (zh) * 2019-07-04 2019-10-08 深圳市康冠商用科技有限公司 一种红外触摸数据的处理方法、***及相关组件
CN112327783A (zh) * 2020-11-17 2021-02-05 深圳Tcl新技术有限公司 设备的控制方法、装置、终端和计算机可读存储介质

Also Published As

Publication number Publication date
WO2022222384A1 (zh) 2022-10-27

Similar Documents

Publication Publication Date Title
US10877581B2 (en) Detecting touch input force
US7486281B2 (en) Coordinate input apparatus, control method thereof, and program
US9785281B2 (en) Acoustic touch sensitive testing
TW201537444A (zh) 防止誤觸發邊緣滑動手勢之方法及手勢觸發方法
CN111208917B (zh) 触摸数据处理方法、装置、智能设备和存储介质
CN114690853B (zh) 交互方法和交互平板
CN113791700A (zh) 基于弹性波的交互方法、装置、交互平板和存储介质
CN114690930A (zh) 一种书写笔迹处理方法、装置、交互平板及存储介质
WO2022222385A1 (zh) 一种触摸数据处理方法及交互平板
CN113608661A (zh) 一种人机交互方法及其交互平板、存储介质
WO2024103488A1 (zh) 接触式红外触控方法、设备及存储介质
CN113608662A (zh) 触控响应方法、装置、终端设备和存储介质
CN116795231A (zh) 一种基于弹性波的书写材质识别方法及交互平板
CN114690931A (zh) 基于触点跟踪的防误触方法、装置、交互平板和存储介质
CN114690967A (zh) 一种触摸操作处理方法、装置、交互平板及存储介质
US10545725B1 (en) Method and apparatus for processing data based on touch events on a touch sensitive device
WO2023016430A1 (zh) 一种书写效果处理方法、装置、设备及存储介质
WO2023231731A1 (zh) 书写模式切换方法、装置、交互平板和存储介质
CN110989844A (zh) 一种基于超声波的输入方法、手表、***及存储介质
CN114690976B (zh) 基于弹性波的***首页界面交互操作方法及装置
EP4345588A1 (en) Touch-originating sound profile sensing systems and methods
WO2022222982A1 (zh) 触控信号的校验、人机交互、笔迹的显示方法及相关装置
CN114690933A (zh) 一种虚拟笔应用控制方法、装置、交互平板及存储介质
CN114690977B (zh) 一种基于弹性波的交互唤起方法及装置
US11061514B2 (en) Touch operated surface

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21937607

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21937607

Country of ref document: EP

Kind code of ref document: A1