WO2021068368A1 - 智能交互平板的操作方法、装置、终端设备和存储介质 - Google Patents

智能交互平板的操作方法、装置、终端设备和存储介质 Download PDF

Info

Publication number
WO2021068368A1
WO2021068368A1 PCT/CN2019/119998 CN2019119998W WO2021068368A1 WO 2021068368 A1 WO2021068368 A1 WO 2021068368A1 CN 2019119998 W CN2019119998 W CN 2019119998W WO 2021068368 A1 WO2021068368 A1 WO 2021068368A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
display window
display
application interface
file display
Prior art date
Application number
PCT/CN2019/119998
Other languages
English (en)
French (fr)
Inventor
夏李玮
Original Assignee
广州视源电子科技股份有限公司
广州视臻信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视臻信息科技有限公司 filed Critical 广州视源电子科技股份有限公司
Priority to EP19948393.4A priority Critical patent/EP3982237A4/en
Priority to JP2021576584A priority patent/JP7320634B2/ja
Priority to KR1020217038982A priority patent/KR102643017B1/ko
Priority to AU2019469487A priority patent/AU2019469487B2/en
Publication of WO2021068368A1 publication Critical patent/WO2021068368A1/zh
Priority to US17/531,787 priority patent/US11620047B2/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/986Document structures and storage, e.g. HTML extensions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483Interaction with page-structured environments, e.g. book metaphor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/203Drawing of straight lines or curves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04806Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Definitions

  • the embodiments of the present invention relate to the technical field of smart interactive tablets, for example, to operation methods, devices, terminal devices, and storage media of smart interactive tablets.
  • the intelligent interactive tablet is one of the representative integrated devices, which is suitable for group interaction occasions such as conferences, teaching, and commercial exhibitions. This kind of equipment integrates multiple functions such as projectors and video conferences.
  • the whiteboard application is a very frequently used application on the smart interactive tablet.
  • This application refers to the user interface presented during the use of the whiteboard application as the whiteboard Application interface
  • the whiteboard application can be used to obtain the operation of the user's finger or writing pen on the whiteboard application interface, and obtain multiple touch points according to the user's operation, and generate the user's writing handwriting based on the touch points. It can also be used on the whiteboard application interface Insert graphics, pictures, tables and other multimedia elements. In the process of using the whiteboard application, the display between different types of files is often involved.
  • This application provides an operating method, device, terminal device, and storage medium of an intelligent interactive tablet to solve the complicated technical problem of file display interaction during the use of related technical whiteboard applications.
  • an embodiment of the present invention provides an operating method of a smart interactive tablet, including:
  • Open a file display window display the file selected according to the file display operation in the file display window, and the file display window is placed on the whiteboard application interface;
  • a writing trajectory is generated on the whiteboard application interface.
  • the content displayed in the file display window includes file preview data and a preview control control.
  • the file preview data is generated corresponding to the file selected by the file display operation and its file type.
  • the preview control control and the file type are correspondingly generated.
  • the file type corresponding to the file selected by the file display operation.
  • the preview control control includes a page turning control
  • the operation method further includes the following steps:
  • a touch click operation on the page turning control is received, and the currently displayed page of the document file in the file display window is changed.
  • the preview control control includes a screenshot control
  • the operation method also includes:
  • a touch click operation on the screenshot control is received, and a screenshot of the screen currently displayed in the file display window is displayed in a setting area in the whiteboard application interface.
  • the file preview data is image data generated from a screenshot of the document file in page order
  • the file preview data is a webpage page obtained by visiting the original webpage of the webpage file.
  • the opening the file display window, displaying the file selected according to the file display operation in the file display window, after the file display window is placed on the whiteboard application interface further includes:
  • the opening the file display window, displaying the file selected according to the file display operation in the file display window, after the file display window is placed on the whiteboard application interface further includes:
  • the opening the file display window, displaying the file selected according to the file display operation in the file display window, after the file display window is placed on the whiteboard application interface further includes:
  • the file display window is restored to be displayed in the whiteboard application interface.
  • the opening the file display window, displaying the file selected according to the file display operation in the file display window, after the file display window is placed on the whiteboard application interface further includes:
  • the zoom operation is a hot zone operation or a multi-finger zoom operation.
  • the opening the file display window, displaying the file selected according to the file display operation in the file display window, after the file display window is placed on the whiteboard application interface further includes:
  • the file display window In response to a window activation operation occurring in the file display window, the file display window enters a selected state, the file display window is covered with a mask in the selected state, and all preview control controls enter a disabled state.
  • the opening the file display window, displaying the file selected according to the file display operation in the file display window, after the file display window is placed on the whiteboard application interface further includes:
  • the operation method further includes:
  • the maximized displayed file covers the whiteboard application interface.
  • an embodiment of the present invention also provides an operating method of a smart interactive tablet, including:
  • a file display window is added on the whiteboard application interface, and the file selected by the file display operation instruction is displayed in the file display window;
  • a writing trajectory corresponding to the writing operation instruction is generated on the whiteboard application interface.
  • the content displayed in the file display window includes file preview data and a preview control control.
  • the file preview data is generated according to the file selected by the file display operation instruction and its file type.
  • the file shows the corresponding file type of the file selected by the operation instruction.
  • the adding a file display window on the whiteboard application interface includes:
  • the writing track is displayed on an original layer, and touch events of the original layer and the top layer are isolated from each other.
  • the operation method further includes:
  • a screenshot operation in the file display window is detected, a screenshot of the displayed content in the file display window is saved to the screenshot buffer area, and the newly added screenshot data in the screenshot buffer area is displayed in the original layer Preset area.
  • the file preview data is correspondingly generated according to the file selected by the file display operation instruction and its file type, including:
  • the file selected by the file display operation instruction is a document file
  • the file selected by the file display operation instruction is a web page file
  • read the original URL of the web file access the original URL to obtain the corresponding web page data to obtain the file preview data, and save the original URL to a preset Show folder;
  • the file selected by the file display operation instruction is an audio and video file
  • the audio and video file is backed up and copied to obtain file preview data and saved to a preset display folder.
  • the corresponding preview control control includes a page turning control
  • the method further includes:
  • the file display window When the file display window displays a document file, it receives a touch click operation on the page turning control, and correspondingly changes the current picture data of the document file in the file display window in the order of screenshots.
  • the operation method further includes:
  • the operation method further includes:
  • the judging the type of the touch operation instruction includes:
  • a touch event that triggers a file display control is monitored in the toolbar of the whiteboard application interface, and a touch event that selects at least one file is monitored in the file list interface popped up in response to triggering the file display control, then it is determined
  • the touch operation instruction is a file display operation instruction, and the file selected in the file list interface is the file selected by the file display operation instruction;
  • the touch operation instruction is a writing operation instruction.
  • an embodiment of the present invention also provides an operating device for a smart interactive tablet, including:
  • the window adding unit is configured to receive file display operations that occur on the whiteboard application interface
  • the file display unit is configured to open a file display window, display the file selected according to the file display operation in the file display window, and the file display window is placed on the whiteboard application interface;
  • a writing receiving unit configured to receive writing operations that occur on the whiteboard application interface
  • the writing display unit is configured to generate a writing track on the whiteboard application interface according to the writing operation.
  • the content displayed in the file display window includes file preview data and a preview control control.
  • the file preview data is generated corresponding to the file selected by the file display operation and its file type.
  • the preview control control and the file type are correspondingly generated.
  • the file type corresponding to the file selected by the file display operation.
  • the preview control control includes a page turning control
  • the operating device further includes:
  • the document page turning unit is configured to receive a touch click operation on the page turning control when the document display window displays a document file, and change the current display page of the document file in the document display window.
  • the preview control control includes a screenshot control
  • the operating device further includes:
  • the window screenshot unit is configured to receive a touch click operation on the screenshot control, and display a screenshot of the screen currently displayed in the file display window to a setting area in the whiteboard application interface.
  • the file preview data is image data generated from a screenshot of the document file in page order
  • the file preview data is a webpage page obtained by accessing the original webpage of the webpage file.
  • the operating device further includes:
  • the display adjustment unit is configured to receive a display adjustment operation that occurs in the whiteboard application interface, change the display position of the display element whose display level is lower than the file display window in the whiteboard application interface, and keep the file display The display position of the window.
  • the operating device further includes:
  • the page adding unit is configured to receive a page adding operation that occurs in the whiteboard application interface, add a blank page to the whiteboard application interface and keep the file display window displayed on top, and the blank page covers the existing page To display.
  • the operating device further includes:
  • the window moving unit is configured to receive a moving operation that occurs in the file display window, and move the display position of the file display window accordingly.
  • the file display window is restored to be displayed in the whiteboard application interface.
  • the operating device further includes:
  • the window zooming unit is configured to receive a zooming operation that occurs in the file display window, and follow the zooming operation to change the display size of the file display window.
  • the zoom operation is a hot zone operation or a multi-finger zoom operation.
  • the operating device further includes:
  • the window activation unit is configured to respond to a window activation operation occurring in the file display window, the file display window enters a selected state, the file display window is covered with a mask in the selected state, and all preview control controls enter Disabled state.
  • the operating device further includes:
  • the file saving unit is configured to receive a window saving operation when saving a whiteboard file, and save the file preview data to the whiteboard file.
  • the operating device further includes:
  • the maximized display unit is configured to receive a maximize operation of the file display window, and maximize the display of the file displayed in the file display window;
  • the window annotation unit is configured to perform an annotation operation on the maximized displayed file
  • the maximized displayed file covers the whiteboard application interface.
  • an embodiment of the present invention also provides an operating device for a smart interactive tablet, including:
  • the touch monitoring unit is configured to monitor touch operation instructions of the whiteboard application interface
  • the instruction judgment unit is configured to judge the type of the touch operation instruction
  • the window display unit is configured to, when it is determined that the touch operation instruction is a file display operation instruction, add a file display window on the whiteboard application interface, and display the file selected by the file display operation instruction in the file display window ;
  • the track display unit is configured to generate a writing track corresponding to the writing operation instruction on the whiteboard application interface when it is determined that the touch operation instruction is a writing operation instruction.
  • the content displayed in the file display window includes file preview data and a preview control control.
  • the file preview data is generated according to the file selected by the file display operation instruction and its file type.
  • the file shows the corresponding file type of the file selected by the operation instruction.
  • the adding a file display window on the whiteboard application interface includes:
  • the writing track is displayed on an original layer, and touch events of the original layer and the top layer are isolated from each other.
  • the operating device further includes:
  • the screenshot display unit is configured to, when a screenshot operation in the file display window is detected, save a screenshot of the displayed content in the file display window to the screenshot buffer area, and display the newly added screenshot data in the screenshot buffer area To the preset area of the original layer.
  • the file preview data is correspondingly generated according to the file selected by the file display operation instruction and its file type, including:
  • the file selected by the file display operation instruction is a document file
  • the file selected by the file display operation instruction is a web page file
  • read the original URL of the web file access the original URL to obtain the corresponding web page data to obtain the file preview data, and save the original URL to a preset Show folder;
  • the file selected by the file display operation instruction is an audio and video file
  • the audio and video file is backed up and copied to obtain file preview data and saved to a preset display folder.
  • the corresponding preview control control includes a page turning control
  • the operating device also includes:
  • the page turning display unit is configured to receive a touch click operation on the page turning control when the document display window displays a document file, and correspondingly change the current picture data of the document file in the document display window in the order of screenshots .
  • the operating device further includes:
  • the data saving unit is configured to save the file preview data in the display folder to the whiteboard file when a window saving operation is detected when saving the whiteboard file.
  • the operating device further includes:
  • the data deletion unit is configured to delete the file preview data in the display folder when the whiteboard application interface is closed.
  • the instruction judgment unit includes:
  • the first judgment module is configured to listen to the touch event triggering the file display control in the toolbar of the whiteboard application interface, and listen to the selection of at least one in the file list interface popped up in response to triggering the file display control A touch event of a file, it is determined that the touch operation instruction is a file display operation instruction, and the file selected in the file list interface is the file selected by the file display operation instruction;
  • the second judgment module is configured to monitor the touch event of the continuous movement of the touch point on the whiteboard application interface, and then judge that the touch operation instruction is a writing operation instruction.
  • an embodiment of the present invention also provides a terminal device, including:
  • One or more processors are One or more processors;
  • Memory used to store one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors implement the operation method of the smart interactive tablet according to any one of the first aspect and the second aspect.
  • an embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the smart interactive tablet according to any one of the first aspect and the second aspect is implemented. Method of operation.
  • the above-mentioned operation method, device, terminal device and storage medium of the smart interactive tablet receive the file display operation that occurs on the whiteboard application interface; open the file display window, and display the file selected according to the file display operation in the file display window ,
  • the file display window is placed on the whiteboard application interface; the writing operation that occurs on the whiteboard application interface is received; and the writing track is generated on the whiteboard application interface according to the writing operation.
  • the quick and convenient browsing of other types of files in the application interface simplifies the complicated operation process when browsing other files during the use of the whiteboard, reduces the operating time cost of the user in the process of using the whiteboard, and improves the fluency of information transmission.
  • the file display window is placed on the whiteboard application interface, which is isolated from the operations of other display elements in the whiteboard application interface, allowing users to use the writing and inserting elements of the whiteboard application to continuously display the files displayed in the file display window. Achieve the focus and continuity of content display.
  • FIG. 1 is a flowchart of a method for operating a smart interactive tablet according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic diagram of a touch input interface of a smart interactive tablet according to Embodiment 1 of the present invention
  • FIG. 3 is a schematic diagram of a file display operation provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a file display window provided by an embodiment of the present invention.
  • FIG. 5 is a flowchart of a method for operating a smart interactive tablet according to Embodiment 2 of the present invention.
  • FIG. 6 is a schematic diagram of a screenshot of a file display window provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a file display window moving according to an embodiment of the present invention.
  • FIG. 8 is a flowchart of a method for operating a smart interactive tablet according to Embodiment 3 of the present invention.
  • FIG. 9 is a schematic structural diagram of an operating device for an intelligent interactive tablet according to Embodiment 4 of the present invention.
  • FIG. 10 is a schematic structural diagram of an operating device for a smart interactive tablet according to Embodiment 5 of the present invention.
  • FIG. 11 is a schematic structural diagram of a terminal device according to Embodiment 6 of the present invention.
  • a technical feature is recorded: the dragged file is a file of another format, and it can also be confirmed as a file display operation at this time, and the file corresponding to the drag operation is confirmed as the file display operation selected
  • another technical feature is recorded: when the maximized preview control control is triggered, the file display window fills the entire whiteboard application interface. Since the above two technical features are not inconsistent with each other, those skilled in the art should be able to think of after reading the specification of this application that the implementation with these two features at the same time is also an optional implementation, that is, drag and drop the file to open the file display After the window, the file display window can fill the entire whiteboard application interface by triggering the maximized preview control control.
  • Embodiment 2 it is recorded in Embodiment 2 that when a screenshot is taken after the screenshot control is triggered, the identification box of the screenshot range can be adjusted to adjust the screenshot range.
  • this feature is not described.
  • the operation method of the smart interactive tablet provided in Embodiment 1 and Embodiment 3 may also include this feature, that is, when there is a file display window for display, Trigger the screenshot control to take a screenshot.
  • FIG. 1 is a flowchart of a method for operating a smart interactive tablet according to Embodiment 1 of the present invention.
  • the operating method of the smart interactive tablet provided in the embodiment can be executed by the operating device of the smart interactive tablet.
  • the operating device of the smart interactive tablet can be implemented by software and/or hardware.
  • the operating device of the smart interactive tablet can be two Or it can be composed of multiple physical entities, or it can be composed of one physical entity.
  • the operating device of the smart interactive tablet can be a mobile phone, an industrial control computer, and so on.
  • the smart interactive tablet is used as the actual carrier to exemplarily describe the detailed process of adjusting target selection, association, and response adjustment when the operation method of the smart interactive tablet is implemented.
  • the smart interactive tablet can be an integrated device that controls the content displayed on the display tablet through touch technology and realizes human-computer interaction. It integrates a projector, an electronic whiteboard, a screen, a sound, a TV, and a video conference. One or more functions such as a terminal.
  • the smart interactive tablet 1 includes at least one display screen.
  • the smart interactive tablet 1 is equipped with a display screen with touch function, and the display screen may be a capacitive screen, a resistive screen or an electromagnetic screen.
  • a smart interactive tablet is provided.
  • the user can implement touch operations by touching the display screen with a finger or a stylus.
  • the smart interactive tablet detects the touch position, and Respond according to the touch position to realize the touch function.
  • at least one operating system is installed on the smart interactive tablet, where the operating system may include an Android system, a Linux system, and a Windows system.
  • the smart interactive tablet can install at least one application with writing function.
  • the application program may be an application program that comes with the operating system, and at the same time, an application program downloaded from a third-party device or server is also installed.
  • the application also has other editing functions, such as inserting tables, inserting pictures, illustration graphics, drawing tables, and drawing graphics.
  • the drawn table or figure is a standard element drawn by the computer.
  • Computer-drawn standard elements can be understood as printed standard elements drawn by the intelligent interactive tablet, which are different from the elements written by the user.
  • the touch screen can sense changes in current, voltage, or magnetic flux (corresponding to the setting type of capacitive touch screen, resistive touch screen or electromagnetic touch screen), and get the touch signal containing the coordinates of the touch position and
  • the trigger time of the touch signal can obtain the trajectory data of the writing trajectory input during each time the stylus or the user's finger presses and writes to lift and stops writing, according to the trajectory data
  • the writing trajectory input by the user is displayed in the writing area of the touch screen in real time.
  • the writing process can be writing, and any input process for displaying the operation track implemented on the touch screen of the smart handwriting device can be regarded as the writing process.
  • the touch operation can respond to the user's click, drag, and other operations. These different response methods are the same in the underlying coordinate processing.
  • the area where the touch writing occurs overlaps the area where the display is located, that is, the display area 2 shown in FIG. 2.
  • the functions of the whiteboard application can be implemented on the smart interactive tablet.
  • the embodiments of this solution are the implementation of the whiteboard application.
  • the operation method of the smart interactive tablet may include:
  • Step S101 Receive a file display operation that occurs on the whiteboard application interface.
  • Application interface refers to an interactive interface used by an application to receive and/or display information, such as a video playback application, whose interactive interface is mainly used to display changing video images; for real-time communication applications, its interactive interface is mainly used to receive recent information.
  • the content input by the end user and the content input by the remote user are displayed;
  • the interactive interface of the file editing application is mainly used to receive and display the content input by the user;
  • the interactive interface of the browser application is mainly used to receive the user input And display the content of the webpage based on the keyword.
  • the targeted application interface refers to the user interface presented during the use of the whiteboard application, that is, the whiteboard application interface.
  • the whiteboard application refers to the application for users to write, display and other operations. It can be used to generate writing handwriting based on the user's writing track on the whiteboard application interface, and can also be used to insert graphics, pictures, and pictures on the whiteboard application interface. Other multimedia elements such as tables.
  • users can implement operations such as writing, drawing, and erasing similar to a physical blackboard, and have better digital functions such as moving, saving, zooming, inserting pictures, color adjustment, and stroke thickness setting.
  • the writing-based operation in the whiteboard application is the realization of related technologies, and will not be described in detail in this solution.
  • the whiteboard application can also be named as writing application, electronic whiteboard application, collaborative whiteboard application, etc. No matter how the name is changed, as long as the application is used to realize the above functions, it is equivalent to the whiteboard application of this application.
  • the whiteboard application In the process of using the whiteboard application, the whiteboard application is usually displayed in full screen, that is, the whiteboard application will fill the display area 2 of the smart interactive tablet 1 in FIG. 2.
  • the subsequent drawings only illustrate the display change of the display area 2.
  • the content displayed in the whiteboard application interface 20 in addition to writing added content and inserting the displayed content during use, there are also various tool controls corresponding to the above content. These tool controls are in the whiteboard application interface
  • the normal state in 20 is displayed on the toolbar 21.
  • the toolbar 21 In the example description of this solution, the toolbar 21 is displayed at the bottom of the whiteboard application interface 20. In the actual layout, it can also be on the left and/or right, or even the left and right sides. And the integrated display at the bottom.
  • Some tool controls in the toolbar 21 correspond to the digital realization of the physical blackboard functions, such as writing, erasing, turning pages (only available on some physical blackboards), etc., and some tool controls are functional supplementary controls implemented on the basis of the whiteboard application, such as cancel Input, restore input, handwriting selection, insert, etc.
  • the file display operation in this embodiment selects at least one file and determines to open the selected file in the whiteboard application interface, that is, the file display operation is a combined operation.
  • the file display operation can be a combined operation based on the toolbar 21.
  • a file opening tool control is set in the toolbar 21.
  • a file list interface 23 pops up.
  • the file list interface 23 displays the default folder or the last opened file.
  • For files and subfolders in the folder when a file is selected, confirm that the file display operation has been received.
  • the selected file in the file list interface 23 can be a selected operation of a certain file (including the icon area and the file name area) in the file list interface 23, such as single-finger touch click, multi-finger touch click, etc.; It may be that the file is dragged from the file list interface 23 to an area outside the file list interface 23 in the whiteboard application interface 20.
  • FIG. 3 illustrates the way of dragging and selecting. That is to say, the file display operation implemented in the whiteboard application interface 20 is a combination of multiple actions, including at least triggering the file opening control to pop up the file list interface 23 and the selection of a file in the file list interface 23.
  • This is also the main implementation method determined by the use characteristics of the whiteboard application, because the operation requirements of the smart interactive tablet generally appear during the use of the whiteboard application. What is needed is that the whiteboard application interface 20 is displayed while the whiteboard application interface 20 is not required. Switch or adjust to quickly display other files.
  • the shortcut icon of the whiteboard application can also be regarded as a part of the whiteboard application interface.
  • the shortcut icon of the whiteboard application when it is detected that a file is dragged to the shortcut icon of the whiteboard application, it is also regarded as a file display operation on the whiteboard application interface.
  • the dragged file is a file in the format generated by the whiteboard application.
  • the response at this time is to directly open the whiteboard application and open the file in the complete whiteboard application interface of the whiteboard application; the second is that the dragged file is other Format files can also be confirmed as the occurrence of the file display operation at this time.
  • the file corresponding to the drag operation is confirmed as the file selected by the file display operation.
  • Step S102 Open a file display window, display the file selected according to the file display operation in the file display window, and the file display window is placed on the whiteboard application interface.
  • the file display window is a display area on the whiteboard application interface, and the display area is used to display the file selected according to the file display operation.
  • the area of the file display window is smaller than the area of the whiteboard application interface.
  • the area of the file display window is less than a quarter of the area of the whiteboard application interface, so as to reserve enough blank space
  • the area is for users to write, insert element display and other operations.
  • the display level can be fixed to the top display.
  • the file display window displayed on the whiteboard application interface will not cause the file display window to change the display level due to operations on other display elements displayed outside the file display window, making the file display window in During its existence period, it can only be obscured by other file display windows, and will not be affected by display elements of other types (such as writing track, inserted picture, inserted table) outside the file display window.
  • a file display window 22 is added to the whiteboard application interface 20.
  • the file list interface 23 will be closed at the same time. The state at this time is shown in Figure 4 .
  • the application scenarios of the whiteboard application are mainly scenarios that emphasize human-computer interaction such as meetings, teaching, and brainstorming.
  • the demand for file editing is relatively weak or the content of the file itself is not changed, so
  • the file display window only the basic display elements required for viewing the file are retained, and may include file preview data for presenting the content of the file and preview control controls for controlling the viewing process.
  • different types of files have different content features and viewing features.
  • the content of document files (common such as PPT documents, WORD documents, and EXCEL documents) are mainly static content
  • the preview content is mainly composed of text, symbols, and pictures.
  • multimedia files are mainly dynamic content
  • the preview content is continuous picture playback, continuous sound playback, or a combination of the two.
  • the two types of files have obvious differences in preview requirements.
  • the information transmission of the former content is relatively abstract, and it takes a certain time for the audience to receive the information, which requires the presentation of the content to be mainly static display; the information of the latter content
  • the transmission is relatively intuitive, and the transmission of visual and/or auditory information is relatively fast and continuous, which requires content presentation to be based on dynamic continuous playback.
  • the file content is usually not directly obtained and displayed in the file display window, but the file content is processed to a certain extent and presented in a manner suitable for previewing.
  • the types of preview control controls also have corresponding simplifications.
  • the display of various editing tools is cancelled during the document file preview process, and only the most basic page turning, file page number and other browsing controls are retained, multimedia
  • the display of the playlist and playback mode is cancelled, and only controls such as fast forward, fast reverse, pause, volume adjustment and so on are used to control the playback of a single multimedia file.
  • the corresponding file name will be displayed synchronously in the file display window, for example, it can be displayed in the same area of the preview control control, or it can be displayed floating in the upper left corner of the file display window.
  • the type of the file can be confirmed according to the suffix of the file.
  • Different types of files have different file preview data generation methods, such as the file selected by the file display operation.
  • the corresponding file preview data is essentially image data.
  • the file preview data is picture data generated from a screenshot of the document file in page order.
  • the file preview control control is related to the file browsing mode.
  • the preview control control of the page number status is used to display the page number status of the file displayed in the file display window 22.
  • the current display in Figure 4 is the first page of a total of 11 pages. Click the preview control of the page number status by touching it
  • the control can also perform page preview of the file displayed in the file display window 22, for example, the file display window 22 previews the 11 pages of the file shown in FIG. 4.
  • the file displayed in the file display window 22 is maximized Display and display the annotation function control on the maximized file, where the maximized file covers the entire whiteboard application interface; when the closed preview control control is triggered, the corresponding file display window 22 is closed, and the corresponding file is ended Preview.
  • the maximized and closed preview control controls are used for overall control of the display state of the file display window 22, and have nothing to do with the preview control of the content.
  • gesture operations can also be defined in the file display window 22. For example, when sliding up and down in the file display window 22, the content displayed in the file display window 22 slides up and down, sliding left and right in the file display window 22, and the file display window 22 The display content in the page turns back and forth.
  • the file preview data is a webpage page obtained by accessing the original webpage of the webpage file.
  • the file preview data is accessed from the original web page of the web page file to get the web page. That is to say, the web page preview is actually the data obtained by accessing the web address of the web page. Saved web page file.
  • files such as video and audio, which can be backed up locally and played in the corresponding file display window.
  • the file display windows mentioned in this solution are not exactly the same for all types of files.
  • the file display windows corresponding to different types of files only have the same basic design style.
  • the file display window corresponding to the document file the core of which encapsulates the image browsing control
  • web file Corresponding file display window its core encapsulates web browser controls
  • video file corresponding file display window its core encapsulates video player control
  • audio file corresponding file display window its core encapsulates audio player Controls
  • the same design style plus different preview control controls are used to obtain file display windows suitable for different types of files.
  • the file display windows corresponding to different types of files have their own initial size and/or aspect ratio, such as PPT files.
  • the aspect ratio of the file display window is usually 16:9; another example is a video file.
  • the aspect ratio of the file display window is compatible with the aspect ratio of the video content, but the minimum width is set, for example, 300 pixels.
  • Step S103 Receive a writing operation that occurs on the whiteboard application interface.
  • Step S104 Generate a writing track on the whiteboard application interface according to the writing operation.
  • the writing operation that occurs on the whiteboard application interface in this embodiment is similar to the overall implementation of the conventional writing operation in the whiteboard application in the related art, and the parts can be adaptively adjusted for the file display window. For example, if the starting point of the writing track corresponding to a writing operation is not in the file display window, confirm that the writing operation is valid and generate the writing track accordingly. If the writing track overlaps with the file display window, the overlapping part will be generated in the file display window To adapt to the top display of the document display window, the original overlapping writing track can only be displayed after the document display window is moved or the writing track is moved.
  • the starting point of the writing track corresponding to a certain writing operation is within the document display window, it is confirmed that the writing operation is invalid and the writing track is not generated; or it is confirmed that the writing track corresponds to the writing behavior in the document display window, which is displayed in the document display window.
  • the writing track overlapping with the file display window is generated in the window, and the part where the writing operation does not overlap with the file display window is not generated and displayed.
  • the file preview in the file display window and the generation of the writing track are not two independent operations and simple integration, but an overall design for the application scenario during the actual use of the whiteboard application.
  • one or more existing files will be prepared as the focus of the activity.
  • the existing files will be displayed through the file display window on the whiteboard application interface.
  • the display content is recorded in the whiteboard application interface, taking notes, opinions, outlines, etc., and finally a complete activity record can be generated.
  • the presentation of the meeting focus and the generation of meeting records are realized on the same interface.
  • the information transmission process and the record generation process have good continuity, avoiding the mutual switching of the information windows of the two processes. Display interruption, when implementing activities that require existing files as the focus of activities, it can bring a smooth activity experience at the device operation level.
  • the display of the file and the recording of the content generated in the activity are all done in the whiteboard application interface.
  • the operation of the file only needs to trigger the preview control control.
  • the display of the file and the recording of the activity process can be smoothly performed, avoiding the page
  • the activity process caused by the switch is interrupted, and the display of the file and the recording of the activity process are completed in the whiteboard application interface.
  • the display and transfer of the file information and the generation of the activity record have a high degree of integration, and the user experience is better.
  • the file display window is displayed on the whiteboard application interface, and is isolated from other display element operations in the whiteboard application interface, allowing users to use the writing and inserting elements of the whiteboard application to continuously display the files displayed in the file display window.
  • FIG. 5 is a flowchart of a method for operating a smart interactive tablet according to Embodiment 2 of the present invention. This embodiment is modified on the basis of the above-mentioned embodiment.
  • the operation method of the smart interactive tablet provided in this embodiment may include:
  • Step S201 Receive a file display operation that occurs on the whiteboard application interface.
  • Step S202 Open a file display window, display the file selected according to the file display operation in the file display window, and the file display window is placed on the whiteboard application interface.
  • the display of the file display window on the whiteboard application interface is not only the display state when it is first displayed, but can continue to have the highest display level during the entire duration of the file display window, that is, the top display.
  • the top display mentioned in this embodiment is not absolutely placed on top of all existing display elements, but relatively placed on top of display elements input in real time in the whiteboard application interface.
  • the new file display operation will add a file display window to the top of the existing file display window.
  • this addition is only a partial coverage, at least the existing file display is retained A certain width and/or certain height of the window are displayed normally.
  • the first file display window that appears appears in the default position, and the subsequent file display windows take the partially covered set standard as a reference to confirm the display position.
  • the new file display operation can be to display a file currently displayed in a file display window, or it can be a file that has not been displayed yet.
  • the file currently displayed can be displayed because the actual file displayed in the file display window is not the original file, but derived data based on the original file, and the derived data exists independently of the original file.
  • a file can be displayed unlimited times, and it has been displayed. Some displays are not affected by changes in the status of the original file. For example, the original file is stored in a mobile storage device. If the file has been displayed in the file display window, even if the mobile storage device is unplugged, the file will be displayed in the file display window. Still unaffected, proceed as normal.
  • step S101 In addition to opening one by one and finally forming multiple file display windows, you can also refer to the operation in step S101, but each operation selects multiple files for corresponding confirmation or dragging, and finally multiple file display windows can be opened. .
  • Step S203 Receive the writing operation that occurs on the whiteboard application interface.
  • Step S204 Generate a writing track on the whiteboard application interface according to the writing operation.
  • file display operations and writing operations may be triggered at any time. For example, after the whiteboard application is opened, the file display window may be opened first, or writing may be received first
  • the operation generates writing trajectory, which may record notes for the display of a certain file, and may also open a new file for display after the display of a certain file is completed. Therefore, between the file display operation and the writing operation in this solution There is no strict execution order, and file display operations and writing operations can be executed interleaved. As long as a certain operation trigger is received, the corresponding display change will be performed.
  • the file display window is displayed on the whiteboard application interface, which is isolated from other display element operations in the whiteboard application interface, allowing users to use the writing and inserting elements of the whiteboard application to continuously display the files displayed in the file display window.
  • this embodiment includes:
  • Step S205 Receive the touch click operation on the screenshot control, and display the screenshot currently displayed in the file display window to the setting area in the whiteboard application interface.
  • the screenshot effect is shown in FIG. 6.
  • the setting area may be a fixed position in the whiteboard application interface 20, or a relatively fixed position using the file display window 22 as a reference, or a relatively fixed position using an existing screenshot as a reference.
  • the final effect is that the screen obtained by the screenshot does not completely cover the screen obtained by the existing screenshot.
  • the screenshot process is triggered.
  • the screenshot is displayed on the whiteboard application interface 20. In the upper right corner, if the file display window 22 is on the right side of the whiteboard application interface 20, the screenshot can be displayed on the left or upper left corner of the whiteboard application interface 20.
  • the execution purpose of this operation is equivalent to adding part of the content originally belonging to the display file to the whiteboard application to participate in the current interaction.
  • the content currently displayed in the file display window 22 needs to be discussed.
  • a screenshot of the currently displayed content can be completed by triggering the screenshot control.
  • the screenshot can be performed on the file preview data in the entire file display window 22 by default.
  • the screenshot of the screen displayed in the whiteboard application interface belongs to the display element generated in real time during the use of the whiteboard application. Its display level is not at the same level as the file display window, but at the same level as the writing track. In other words, if there is an operation in step S206 after the screenshot, the screenshot will pan or zoom following the display adjustment operation, but the file display window 22 will not respond. After the screenshot is completed, you can annotate, circle, highlight the key and other common operations of the whiteboard application on the whiteboard application interface. Based on the screenshot operation, you can quickly add the material in the target file to the whiteboard application interface without switching the application software, opening the target file separately, and without modifying the target file. The operation is simple and accurate.
  • the screenshot can be a full-page file preview data directly as a screenshot (such as a PPT document, a WORD document, a PDF document) according to the way the file is displayed, or it can be a screenshot composed of two pages of file preview data.
  • WORD document, PDF document if it is a web page file, the screenshot should be generated based on the screenshot of the current display range; if it is a video file, the screenshot should be a frame of picture.
  • this embodiment includes:
  • Step S206 Receive the display adjustment operation that occurs in the whiteboard application interface, change the display position of the display element whose display level is lower than the file display window in the whiteboard application interface, and keep the display position of the file display window.
  • the display adjustment operations that occur in the whiteboard application interface are mainly to adjust the display position, size ratio, display page switching, etc. in the whiteboard application interface.
  • the adjustment objects are mainly the display elements generated in the whiteboard application interface in real time during the use of the whiteboard application. (For example, the input writing track, the inserted picture and the table, etc.).
  • there are operations such as zooming, moving, and page turning on the display elements.
  • the existing real-time generation The file display window does not respond to the adjustment of the display position of the display element of the file, that is, this adjustment only changes the display position or display content of the display element outside the file display window.
  • the display level of other display elements is lower than the file display window.
  • Some display elements are adjusted away from the file display window, leaving more blank areas for users to write. For example, multi-finger zoom to adjust the size and proportion (change the display range), multi-finger drag to adjust the display position (change the display position), etc. Directly use the existing whiteboard application experience to adapt to the adjustment of the file display window. The process is simple.
  • the display of the file display window remains unchanged, and the user can maintain the file display window when there is insufficient blank space for writing operations in the whiteboard application interface
  • the blank area is expanded through the display adjustment operation, and the operation of expanding the blank area is simple and accurate without affecting the display of the file display window.
  • part or all of the writing handwriting can be moved out of the display area of the smart interactive tablet, thereby leaving more blank areas for writing notes.
  • this embodiment includes:
  • Step S207 Receive a page addition operation that occurs in the whiteboard application interface, add a blank page to the whiteboard application interface and keep the file display window on top for display, and the blank page covers the existing page for display.
  • the file display window displayed on the top has the highest display level.
  • the page addition operation (triggered by the page addition control in the toolbar) that occurs in the whiteboard application interface triggers a new blank page, according to the display level of the file display window and the status of the existing page. Display the hierarchical relationship between the levels, the blank page covers the existing page for display, and the existing file display window is displayed on the top of the blank page and keeps the original display position unchanged.
  • the page addition operation can quickly enter the next activity focus or the related records of the discussion focus, and for different activity focuses Or the discussion key corresponds to the way of recording in different pages, and the generated activity records are clearly organized and easy to follow up.
  • this embodiment includes:
  • Step S208 Receive the moving operation that occurs in the file display window, and follow the display position of the moving file display window.
  • the purpose of the display can be to compare and explain with the display elements entered in real time in the whiteboard application interface or the preview of the previously opened file, and the file display window may just cover the objects that need to be compared.
  • the display position of the file display window can be adjusted by moving the file display window.
  • the file display window can be adjusted in exactly the same display position following the movement track of the mobile operation, that is, part of the file display window may not be displayed in the whiteboard application interface; it can also be the file display window following the movement of the mobile operation.
  • the trajectory is adjusted within a certain constrained range. For example, the file display window can move up to the border of the whiteboard application interface following the movement trajectory, and the movement component of the movement trajectory in this direction will not follow the movement of the file display window to maintain the file display. The complete display of the window.
  • the file display window 22b when the file display window 22b initially appears, it is set to cover most of the file display window 22a. In response to the moving operation, the file display window 22a moves to the right side of the whiteboard application interface 20.
  • the file display window follows the movement track to perform the same display position adjustment, but when the boundary of the file display window moves to the set boundary of the whiteboard application interface.
  • restoring the file display window to the whiteboard application interface for display can add action effects to the restoring process, such as bounce, move, etc.
  • this embodiment includes:
  • Step S209 Receive a zoom operation that occurs in the file display window, and follow the zoom operation to change the display size of the file display window.
  • the initial size of the file display window is the default. If the range of this default display is too large, it may affect the display of the content outside the file display window. If the range is too small, it may affect the content of the file display window. Normal display. Based on this, it is necessary to adjust the size of the file display window according to actual display requirements, that is, to perform a zoom operation.
  • the zooming operation can be achieved through hot zone operations.
  • one or more corners of the file display window are set as zoom hotspots.
  • the length and width of the file display window are zoomed in the same proportion, and the display content in the file display window is also zoomed in the same proportion.
  • the adjustment mechanism is the same as the hot zone operation, and the difference lies in the trigger mode and The zoom center is different.
  • the smart interactive tablet also supports mouse operations, zooming and panning operations can also be achieved through the mouse.
  • this embodiment includes:
  • Step S210 In response to the window activation operation occurring in the file display window, the file display window enters a selected state, the file display window is covered with a mask in the selected state, and all preview control controls enter a disabled state.
  • the window activation operation can be realized by touch and long press, continuous click, etc.
  • the file display window enters the only operable state, and all other display elements (including other file display windows) stop responding to any Operational feedback.
  • the file display window sill is covered with a mask, and the related preview control controls are also in the disabled state.
  • the file display window In the activated state, the file display window only supports zooming, moving, deleting and other operations corresponding to the file display window itself.
  • the definition of this action makes the file display window have the same operation definition as other real-time generated display elements in the whiteboard application interface.
  • the operating experience has better consistency, and the user's interactive experience is better.
  • this embodiment includes:
  • Step S211 Receive the window save operation when saving the whiteboard file, and save the file preview data to the whiteboard file.
  • the file display window can be opened synchronously and the file preview is displayed. data.
  • the file display operation is usually a temporary operation, and the purpose of the operation is only for temporary comparison and display of files. If it is really necessary to add content, screenshots will be added to the whiteboard application interface, so files related to file display operations It is usually not necessary to save, especially for video files, which usually take up a relatively large storage space. The file transfer after saving the video file will be more troublesome, so the user needs to confirm whether it needs to be saved. Therefore, when receiving the saved whiteboard file, A pop-up prompts the user whether to save the window content, and after receiving the window save operation, save the file preview data to the whiteboard file.
  • this embodiment includes:
  • S212 Receive a maximization operation of the file display window, and maximize the display of the file displayed in the file display window; the maximization operation is used to maximize the display of the file displayed in the file display window, in some embodiments
  • the maximize operation can be a set touch action, or a maximize control can be set in the file display window, and the maximize operation can be triggered by touching the maximize control.
  • the remark operation may include operations such as writing handwriting, inserting graphics, and pictures.
  • the maximized displayed file covers the whiteboard application interface.
  • the window After the window is maximized, it supports freezing screen annotations for the content currently displayed in the file display window. That is, the current page no longer supports sliding or page turning after starting the annotation, and the video is also paused, and the original state is restored after exiting the annotation.
  • the annotation function introduces simple writing, erasing and sharing, which is convenient for users to operate. It can maximize and continuously display the current display screen when the current display content is emphasized, which improves the display effect and makes the information audience's attention highly concentrated.
  • step S201, step S202, step S203, step S204, step S205, step S206, step S207, step S208, step S209, step S210, step S211, step S212-S213 do not have a particularly strict execution order.
  • the order of numbering and description is only to adapt to the expression in Figure 5.
  • step S201 and step S202 are executed in sequence
  • step S203 and step S204 are executed in sequence. As long as a file display window is currently open, any of these steps can be executed at any time.
  • an operation only affects the file display window corresponding to the operation. It should be understood that in all the above operations, an operation only affects one file display window, that is, one file display window. The operation in the file only affects the file display window, and will not give feedback to the operation through other file display windows.
  • subsequent operations on the file display window and/or the whiteboard application interface can adjust the display state of the display elements in the whiteboard application interface while the file display window maintains the display state, so that the whiteboard application interface
  • the display elements in the file are adapted to the normal display of the file display window during the activity, and make simple and precise adjustments; it can also adjust the display state of the file display window while maintaining the normal display state of the display elements in the whiteboard application interface to make the file display
  • the window is adapted to the normal display of other file display windows or display elements, and performs simple and precise adjustments to realize convenient interaction when the needs of information transmission and process recording change randomly during the activity.
  • FIG. 8 is a flowchart of a method for operating a smart interactive tablet according to Embodiment 3 of this application.
  • the operation method of the smart interactive tablet provided in this embodiment is applied in the same scenario as the operation method of the smart interactive tablet provided in the foregoing embodiment.
  • the operation method of the smart interactive tablet provided in this embodiment includes:
  • Step S301 Monitor the touch operation instruction on the whiteboard application interface.
  • touch events can be monitored on the whiteboard application interface. For example, the triggering of any tool control in the toolbar 21 in Figure 3 will generate a corresponding response. In this embodiment, if it corresponds to the whiteboard application interface in Figure 3 The monitoring of 20 touch events describes the subsequent response to the triggering of the file display tool control.
  • Step S302 Determine the type of the touch operation instruction.
  • the type of touch operation instruction can be confirmed according to the parameters obtained by touch detection such as the location, duration, and movement distance of the touch event.
  • the file display operation instruction and the writing operation instruction are mainly judged and subsequent responses are made.
  • the acquisition of parameters such as position, duration, and movement distance can be a conventional implementation of touch technology, and will not be elaborated here.
  • determining the type of the touch operation instruction includes:
  • a touch event that triggers a file display control is monitored in the toolbar of the whiteboard application interface, and a touch event that selects at least one file is monitored in the file list interface popped up in response to triggering the file display control, then it is determined
  • the touch operation instruction is a file display operation instruction, and the file selected in the file list interface is the file selected by the file display operation instruction;
  • the touch operation instruction is a writing operation instruction.
  • a touch event in which a touch point moves continuously is judged as a writing operation instruction.
  • Step S303 When it is determined that the touch operation instruction is a file display operation instruction, a file display window is added on the whiteboard application interface, and the file selected by the file display operation instruction is displayed in the file display window.
  • the file display window is a control that is displayed on top of the display elements generated in real time during the use of all whiteboard applications.
  • the display process of all display elements is actually the drawing process, and each display element is stacked Sequence, mobile operations, etc., are all realized through hierarchical management.
  • at least one top layer is defined for the whiteboard application interface.
  • the top layer is dedicated to managing file display windows. All file display windows are added to the top layer. All file display windows in the top layer are relative to each other. It has the highest display level at other levels, that is, it is displayed on the display elements of all other levels.
  • the file display windows in the top layer have the same display level.
  • the file display window with the most recently detected operation is displayed in all files. The top display in the window.
  • the top layer there is also an original layer defined.
  • the original layer is used to draw the display elements generated in real time during the use of the whiteboard application.
  • the display elements in the original layer basically interact with each other according to the order of addition. Confirmation of drawing levels.
  • the settings of the top layer and the original layer are not only used for the management of image drawing during the display process, but also for the management of touch event response. On the whole, the touch events before the two levels are isolated from each other. In some embodiments, for touch events that start from a display element in the top layer, only the display element of the top layer responds; for touch events that start from a display element in the original layer, only the original layer The display element responds.
  • the level of the top layer is defined relative to the original layer. If there is no file display window, there can be no top layer in the whiteboard application interface. That is, the drawing of the file display window in the top layer needs to confirm whether there is a top layer.
  • the content displayed in the file display window includes file preview data and a preview control control.
  • the file preview data is generated corresponding to the file selected by the file display operation instruction and its file type.
  • the preview control control corresponds to the file display operation
  • the file type of the file selected by the instruction corresponds to.
  • the content displayed in the file display window can be determined by the file type:
  • the file selected by the file display operation is a document file
  • the file selected by the file display operation is a web page file
  • read the original URL of the web file access the original URL to obtain the corresponding web page data to obtain the file preview data, and save the original URL to a preset Show folder
  • the file selected by the file display operation is an audio and video file
  • the audio and video file is backed up and copied to obtain file preview data and saved to a preset display folder.
  • the preview control control and the control that may appear in the process of file editing and production, and it only needs to meet the needs of preview.
  • the display of various editing tools is cancelled, and only the most basic page turning, file page number and other controls for browsing are retained.
  • the multimedia file is cancelled during the preview process of the playlist and playback mode. Display, only the controls for controlling the playback of a single multimedia file, such as fast forward, rewind, pause, volume adjustment, etc. are retained.
  • the corresponding file name will be displayed synchronously in the file display window, for example, it can be displayed in the same area of the preview control control, or it can be displayed floating in the upper left corner of the file display window.
  • Step S304 When it is determined that the touch operation instruction is a writing operation instruction, a writing track generated corresponding to the writing operation instruction is generated on the whiteboard application interface.
  • the initial generation and display of the writing trajectory may not be exactly the same.
  • the starting point of the writing trajectory corresponding to a certain writing operation is not within the file display window, confirm that the writing operation is valid, and generate the writing trajectory accordingly. If the writing trajectory is consistent with the file display window If there is overlap, the overlapped part is generated under the file display window to adapt to the top display of the file display window. Only after the file display window is moved, the original overlapping writing track can be displayed.
  • the starting point of the writing track corresponding to a certain writing operation is within the document display window, it is confirmed that the writing operation is invalid and the writing track is not generated; or it is confirmed that the writing track corresponds to the writing behavior in the document display window, which is displayed in the document display window.
  • the writing track overlapping with the file display window is generated in the window, and the part where the writing operation does not overlap with the file display window is not generated and displayed.
  • This embodiment realizes independent display of the file display window in the whiteboard application interface through monitoring and type judgment of touch operation instructions, and the file display window and the original layer in the whiteboard application interface respond to touch events independently, thereby achieving It can quickly and conveniently browse other types of files in the whiteboard application interface, simplify the complicated operation process when browsing other files during the use of the whiteboard, reduce the operating time cost of the user in the process of using the whiteboard, and improve the fluency of information transmission .
  • the file display window is displayed on the whiteboard application interface, and is isolated from other display element operations in the whiteboard application interface, allowing users to use the writing and inserting elements of the whiteboard application to continuously display the files displayed in the file display window. The focus and coherence of the content presentation.
  • this solution can include:
  • Step S305 When detecting the screenshot operation in the file display window, save a screenshot of the displayed content in the file display window in the screenshot buffer area, and display the newly added screenshot data in the screenshot buffer area in the original image The preset area of the layer.
  • the file display window of the top layer first responds to the screenshot operation, saves the screenshot of the current display content to the screenshot buffer area, and then the original layer responds to the data changes in the screenshot buffer area, which The newly added screenshot data is displayed in the preset area of the original layer.
  • the response can be a response to a screenshot operation, or a data update detection to the screenshot buffer area.
  • the corresponding preview control control includes a page turning control
  • step S303 it also includes:
  • Step S306 When the file display window displays a document file, receive a touch click operation on the page turning control, and correspondingly change the current picture data of the document file in the file display window in the order of screenshots.
  • this solution can include:
  • Step S307 When a window save operation is detected when saving the whiteboard file, save the file preview data in the display folder to the whiteboard file.
  • the preservation of the file preview data is helpful for the subsequent collation of meeting materials and the tracing of the meeting process.
  • Save the file preview data and the whiteboard file In some embodiments, it may be packaged in the whiteboard file as a display element of the whiteboard file, or it may be saved to a default folder and establish and save the association with the whiteboard file.
  • it may further include:
  • Step S308 When closing the whiteboard application interface, delete the file preview data in the display folder.
  • the file preview data generated each time is of no value to other meetings, and for video files, the corresponding file preview data is actually a copy of the original file, which will take up a lot of storage space.
  • the whiteboard application interface is closed, it can be understood as the end of the meeting or At the end of the current agenda, deleting the file preview data can effectively avoid unnecessary storage space usage.
  • the independent display of the file display window in the whiteboard application interface is realized.
  • the file display window and the original layer in the whiteboard application interface respond to touch events independently, thereby achieving
  • the quick and convenient browsing of other types of files in the whiteboard application interface simplifies the complicated operation process when browsing other files during the use of the whiteboard, reduces the operating time cost of the user in the process of using the whiteboard, and improves the fluency of information transmission.
  • the independent operation of the file display window and other display elements in the whiteboard application interface also improves the accuracy of the operation in the window adjustment process, realizes the normal display of the content in the file display window, and improves the accuracy of content display. It is based on the file display window.
  • the touch event monitoring and response on the above realizes convenient interaction when the demand for information transmission and process recording changes randomly and diversely during the activity.
  • FIG. 9 is a schematic structural diagram of an operating device for a smart interactive tablet according to Embodiment 4 of the present invention.
  • the operation device of the smart interactive tablet includes: a window adding unit 401, a file display unit 402, a writing receiving unit 403, and a writing display unit 404.
  • the window adding unit 401 is configured to receive the file display operation that occurs on the whiteboard application interface;
  • the file display unit 402 is configured to open the file display window, and display the file selected according to the file display operation in the file display window File, the file display window is placed on the whiteboard application interface;
  • the writing receiving unit 403 is configured to receive writing operations that occur on the whiteboard application interface;
  • the writing display unit 404 is configured to follow the writing operations , Generate a writing trajectory on the whiteboard application interface.
  • the content displayed in the file display window includes file preview data and preview control controls.
  • the file preview data is generated according to the file selected by the file display operation and its file type.
  • the preview control corresponds to the file type of the file selected by the file display operation.
  • the preview control control includes a page turning control
  • the operating device further includes:
  • the document page turning unit is configured to receive a touch click operation on the page turning control when the document display window displays a document file, and change the current display page of the document file in the document display window.
  • the preview control control includes a screenshot control
  • the operating device further includes:
  • the window screenshot unit is configured to receive a touch click operation on the screenshot control, and display a screenshot of the screen currently displayed in the file display window to a setting area in the whiteboard application interface.
  • the file preview data is image data generated from a screenshot of the document file in page order
  • the file preview data is a webpage page obtained by accessing the original webpage of the webpage file.
  • the operating device further includes:
  • the display adjustment unit is configured to receive a display adjustment operation that occurs in the whiteboard application interface, change the display position of the display element whose display level is lower than the file display window in the whiteboard application interface, and keep the file display The display position of the window.
  • the operating device further includes:
  • the page adding unit is configured to receive a page adding operation that occurs in the whiteboard application interface, add a blank page to the whiteboard application interface and keep the file display window displayed on top, and the blank page covers the existing page To display.
  • the operating device further includes:
  • the window moving unit is configured to receive a moving operation that occurs in the file display window, and move the display position of the file display window accordingly.
  • the operating device further includes:
  • the window zooming unit is configured to receive a zooming operation that occurs in the file display window, and follow the zooming operation to change the display size of the file display window.
  • the zoom operation is a hot zone operation or a multi-finger zoom operation.
  • the operating device further includes:
  • the window activation unit is configured to respond to a window activation operation occurring in the file display window, the file display window enters a selected state, the file display window is covered with a mask in the selected state, and all preview control controls enter Disabled state.
  • the operating device further includes:
  • the file saving unit is configured to receive a window saving operation when saving a whiteboard file, and save the file preview data to the whiteboard file.
  • the operating device further includes:
  • the maximized display unit is configured to receive a maximize operation of the file display window, and maximize the display of the file displayed in the file display window;
  • the window annotation unit is configured to perform an annotation operation on the maximized displayed file
  • the maximized displayed file covers the whiteboard application interface.
  • the operation device of the smart interactive tablet provided by the embodiment of the present invention is included in the operation device of the smart interactive tablet, and can be used to execute any of the operation methods of the smart interactive tablet provided in the first and second embodiments above, and has corresponding functions And beneficial effects.
  • FIG. 10 is a schematic structural diagram of an operating device for a smart interactive tablet according to Embodiment 5 of the present invention.
  • the operation device of the smart interactive tablet includes: a touch monitoring unit 501, an instruction judgment unit 502, a window display unit 503, and a track display unit 504.
  • the touch monitoring unit 501 is configured to monitor touch operation instructions of the whiteboard application interface; the instruction determining unit 502 is configured to determine the type of the touch operation instruction; the window display unit 503 is configured to The touch operation instruction is a file display operation instruction, a file display window is added on the whiteboard application interface, and the file selected by the file display operation instruction is displayed in the file display window; the track display unit 504 is configured to It is determined that the touch operation instruction is a writing operation instruction, and a writing trajectory corresponding to the writing operation instruction is generated on the whiteboard application interface.
  • the content displayed in the file display window includes file preview data and preview control controls.
  • the file preview data is generated according to the file selected by the file display operation instruction and its file type.
  • the preview The control control corresponds to the file type of the file selected by the file display operation instruction.
  • the adding a file display window on the whiteboard application interface includes:
  • the writing track is displayed on the original layer, and the touch events of the original layer and the top layer are isolated from each other.
  • the operating device further includes:
  • the screenshot display unit is configured to, when a screenshot operation in the file display window is detected, save a screenshot of the displayed content in the file display window to the screenshot buffer area, and display the newly added screenshot data in the screenshot buffer area To the preset area of the original layer.
  • the file preview data is correspondingly generated according to the file selected by the file display operation instruction and its file type, including:
  • the file selected by the file display operation instruction is a document file
  • the file selected by the file display operation instruction is a web page file
  • read the original URL of the web file access the original URL to obtain the corresponding web page data to obtain the file preview data, and save the original URL to a preset Show folder;
  • the file selected by the file display operation instruction is an audio and video file
  • the audio and video file is backed up and copied to obtain file preview data and saved to a preset display folder.
  • the corresponding preview control control includes a page turning control
  • the operating device also includes:
  • the page turning display unit is configured to receive a touch click operation on the page turning control when the document display window displays a document file, and correspondingly change the current picture data of the document file in the document display window in the order of screenshots .
  • the operating device further includes:
  • the data saving unit is configured to save the file preview data in the display folder to the whiteboard file when a window saving operation is detected when saving the whiteboard file.
  • the operating device further includes:
  • the data deletion unit is configured to delete the file preview data in the display folder when the whiteboard application interface is closed.
  • the instruction judgment unit 502 includes:
  • the first judgment module is configured to listen to the touch event that triggers the file display control in the toolbar of the whiteboard application interface, and listen to the selection of at least one in the file list interface that pops up in response to triggering the file display control A touch event of a file, it is determined that the touch operation instruction is a file display operation instruction, and the file selected in the file list interface is the file selected by the file display operation instruction;
  • the second judgment module is configured to monitor the touch event of the continuous movement of the touch point on the whiteboard application interface, and then judge that the touch operation instruction is a writing operation instruction.
  • the operating device of the smart interactive tablet provided by the embodiment of the present invention is included in the operating device of the smart interactive tablet, and can be used to execute any of the operation methods of the smart interactive tablet provided in the third embodiment above, and has corresponding functions and beneficial effects.
  • the units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding function can be realized;
  • the specific names of the functional units are only used to facilitate distinguishing from each other, and are not used to limit the protection scope of the present invention.
  • FIG. 11 is a schematic structural diagram of a terminal device according to Embodiment 6 of the present invention.
  • the terminal device is a hardware presentation solution of the operation device of the smart interactive tablet described above.
  • the terminal device includes a processor 610, a memory 620, an input device 630, an output device 640, and a communication device 650; the number of processors 610 in the terminal device can be one or more.
  • the processor 610 is taken as an example; the processor 610, the memory 620, the input device 630, the output device 640, and the communication device 650 in the terminal device may be connected by a bus or other means. In FIG. 11, the connection by a bus is taken as an example.
  • the memory 620 can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the operation method of the smart interactive tablet in the embodiment of the present invention (for example, the smart interactive tablet The touch monitoring unit 501, the instruction judgment unit 502, the window display unit 503 and the track display unit 504 in the operating device).
  • the processor 610 executes various functional applications and data processing of the terminal device by running the software programs, instructions, and modules stored in the memory 620, that is, realizes the above-mentioned operation method of the smart interactive tablet.
  • the memory 620 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the terminal device.
  • the memory 620 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices.
  • the memory 620 may include a memory remotely provided with respect to the processor 610, and these remote memories may be connected to the terminal device through a network. Examples of the aforementioned network may include the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the input device 630 can be used to receive inputted numeric or character information, and generate key signal input related to user settings and function control of the terminal device.
  • the output device 640 may include a display device such as a display screen.
  • the above-mentioned terminal equipment includes an operating device for an intelligent interactive tablet, which can be used to execute any operation method of an intelligent interactive tablet, and has corresponding functions and beneficial effects.
  • the embodiment of the present invention also provides a storage medium containing computer-executable instructions, when the computer-executable instructions are executed by a computer processor, they are used to execute the related operations in the smart interactive tablet operating method provided in any embodiment of the present application. Operation, and has corresponding functions and beneficial effects.
  • this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.
  • this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (which may include disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • This application is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to embodiments of this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions.
  • These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • the computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • the memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM).
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash memory
  • Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology.
  • the information can be computer-readable instructions, data structures, program modules, or other data.
  • Examples of computer storage media may include phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM) ), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical storage, magnetic cartridges Type magnetic tape, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by computing devices.
  • computer-readable media does not include transitory media, such as modulated data signals and carrier waves.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)

Abstract

一种智能交互平板的操作方法、装置、终端设备和存储介质。该方法包括:接收在白板应用界面发生的文件展示操作(S101);开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上(S102);接收在所述白板应用界面发生的书写操作(S103);根据所述书写操作,在所述白板应用界面生成书写轨迹(S104)。在白板应用界面中添加文件展示窗口,并在文件展示窗口内做适应于预览需求的文件内容展示,实现了在白板应用界面中对其他类型文件的快速和便捷浏览,简化了白板使用过程中浏览其他文件时复杂的操作过程,降低了用户使用白板过程中的操作时间成本,提高了信息传递的流畅度。

Description

智能交互平板的操作方法、装置、终端设备和存储介质
本公开要求在2019年10月09日提交中国专利局、申请号为201910953579.6的中国专利申请的优先权,以上申请的全部内容通过引用结合在本公开中。
技术领域
本发明实施例涉及智能交互平板技术领域,例如涉及智能交互平板的操作方法、装置、终端设备和存储介质。
背景技术
随着智能化技术的发展,日常生活中人们接触的电子产品种类日益丰富,其中基于触控技术实现的交互类电子产品,因为良好的人机交互体验呈现越来全面的功能集成趋势。智能交互平板是其中一种具有代表性的一体化设备,适应于会议、教学、商业展示等群体交互场合,这种设备集成了投影机、视频会议等多种功能。
基于智能交互平板在不同的应用场景下有各种丰富的应用开发,其中白板应用是智能交互平板上一种使用频率相当高的应用,本申请将白板应用使用过程中呈现的用户界面称为白板应用界面,白板应用可以用于获取用户的手指或书写笔在白板应用界面上的操作,并根据用户的操作获取多个触摸点,根据触摸点生成用户的书写笔迹,也可以在白板应用界面上***图形、图片、表格等其他多媒体元素。在白板应用的使用过程中,还经常涉及到不同类型文件之间的展示,这种情况下需要最小化或退出白板应用,然后进入待展示的文件的存储目录,打开对应的文件进行展示,展示完了之后再恢复到白板应用的显示,多个文件进行展示和切换的操作复杂,多个文件展示过程中信息向受众的传递不流畅。
发明内容
本申请提供了一种智能交互平板的操作方法、装置、终端设备和存储介质,以解决相关技术白板应用使用过程中文件展示交互复杂的技术问题。
第一方面,本发明实施例提供了一种智能交互平板的操作方法,包括:
接收在白板应用界面发生的文件展示操作;
开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;
接收在所述白板应用界面发生的书写操作;
根据所述书写操作,在所述白板应用界面生成书写轨迹。
可选地,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作选中的文件的文件类型对应。
可选地,所述文件类型为文档文件时,所述预览控制控件包括翻页控件;
所述文件展示窗口展示的是文档文件时,所述操作方法还包括以下步骤:
接收对所述翻页控件的触摸点击操作,改变所述文档文件在所述文件展示窗口中的当前显示页面。
可选地,所述预览控制控件包括截图控件;
所述操作方法还包括:
接收对所述截图控件的触摸点击操作,将所述文件展示窗口中当前显示的画面截图显示到所述白板应用界面中的设定区域。
可选地,所述文件展示操作选中的文件为文档文件时,所述文件预览数据为从所述文档文件中按页顺序截图生成的图片数据;
所述文件展示操作选中的文件为网页文件时,所述文件预览数据为访问所述网页文件的 原始网页得到的网页页面。
可选地,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,还包括:
接收在所述白板应用界面中发生的显示调整操作,改变所述白板应用界面中显示层级低于所述文件展示窗口的显示元素的显示位置,并保持所述文件展示窗口的显示位置。
可选地,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,还包括:
接收在所述白板应用界面中发生的页面增加操作,在所述白板应用界面中新增空白页面并保持所述文件展示窗口在空白页面上置顶显示,所述空白页面覆盖已有页面进行显示。
可选地,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,还包括:
接收在所述文件展示窗口发生的移动操作,跟随移动所述文件展示窗口的显示位置。
可选地,当所述文件展示窗口的边界移动到白板应用界面的设定边界之外,在所述移动操作结束后,将所述文件展示窗口恢复到所述白板应用界面内显示。
可选地,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,还包括:
接收在所述文件展示窗口发生的缩放操作,跟随所述缩放操作改变所述文件展示窗口的显示大小。
可选地,所述缩放操作为热区操作或多指缩放操作。
可选地,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,还包括:
响应于在所述文件展示窗口发生的窗口激活操作,所述文件展示窗口进入选中状态,所述文件展示窗口在选中状态下覆盖有蒙层,且所有预览控制控件进入禁用状态。
可选地,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,还包括:
接收保存白板文件时的窗口保存操作,将所述文件预览数据保存到所述白板文件。
可选地,所述操作方法还包括:
接收对所述文件展示窗口的最大化操作,将所述文件展示窗口中展示的文件最大化显示;
在所述最大化显示的文件上执行批注操作;
其中,所述最大化显示的文件覆盖所述白板应用界面。
第二方面,本发明实施例还提供了一种智能交互平板的操作方法,包括:
监听对白板应用界面的触控操作指令;
判断所述触控操作指令的类型;
当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件;
当判断所述触控操作指令为书写操作指令,在所述白板应用界面生成所述书写操作指令对应生成的书写轨迹。
可选地,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作指令选中的文件的文件类型对应。
可选地,所述在所述白板应用界面之上添加文件展示窗口,包括:
当所述白板应用界面当前不存在文件展示窗口,在所述白板应用界面添加置顶图层,在 所述置顶图层绘制文件展示窗口;
当所述白板应用界面当前存在文件展示窗口,在所述置顶图层绘制新增文件展示窗口。
可选地,所述书写轨迹显示于原始图层,所述原始图层与所述置顶图层的触控事件互相隔离。
可选地,所述操作方法,还包括:
检测到所述文件展示窗口中的截图操作时,将所述文件展示窗口中的显示内容截图保存到截图缓存区,将所述截图缓存区中最新添加的截图数据显示到所述原始图层的预设区域。
可选地,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,包括:
若所述文件展示操作指令选中的文件为文档文件,读取所述文档文件并按页顺序截图得到至少一张图片数据,将所述图片数据按截图顺序组织得到文件预览数据并保存到预设的展示文件夹;
若所述文件展示操作指令选中的文件为网页文件,读取所述网页文件的原始网址,访问所述原始网址获得对应的网页页面数据得到文件预览数据,并将所述原始网址保存到预设的展示文件夹;
若所述文件展示操作指令选中的文件为音视频文件,将所述音视频文件备份复制得到文件预览数据并保存到预设的展示文件夹。
可选地,所述文件类型为文档文件时,对应的预览控制控件包括翻页控件;
所述当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件之后,还包括:
所述文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操作,按截图顺序对应改变所述文档文件在所述文件展示窗口中的当前图片数据。
可选地,所述操作方法,还包括:
在保存白板文件时检测到窗口保存操作时,将所述展示文件夹中的文件预览数据保存到所述白板文件。
可选地,所述操作方法,还包括:
关闭所述白板应用界面时,删除所述展示文件夹中的文件预览数据。
可选地,所述判断所述触控操作指令的类型,包括:
在所述白板应用界面的工具栏中监听到触发文件展示控件的触控事件,且在响应于触发所述文件展示控件弹出的文件列表界面中监听到选择至少一个文件的触控事件,则判断触控操作指令为文件展示操作指令,所述文件列表界面中选择的文件为所述文件展示操作指令选中的文件;
在所述白板应用界面监听到触摸点连续移动的触控事件,则判断触控操作指令为书写操作指令。
第三方面,本发明实施例还提供了一种智能交互平板的操作装置,包括:
窗口添加单元,被配置为接收在白板应用界面发生的文件展示操作;
文件显示单元,被配置为开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;
书写接收单元,被配置为接收在所述白板应用界面发生的书写操作;
书写显示单元,被配置为根据所述书写操作,在所述白板应用界面生成书写轨迹。
可选地,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作选中的文件及其文件类型对应生成,所述预览控制控件与所述 文件展示操作选中的文件的文件类型对应。
可选地,所述文件类型为文档文件时,所述预览控制控件包括翻页控件;
所述操作装置,还包括:
文档翻页单元,被配置为文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操作,改变所述文档文件在所述文件展示窗口中的当前显示页面。
可选地,所述预览控制控件包括截图控件;
所述操作装置,还包括:
窗口截图单元,被配置为接收对所述截图控件的触摸点击操作,将所述文件展示窗口中当前显示的画面截图显示到所述白板应用界面中的设定区域。
可选地,所述文件展示操作选中的文件为文档文件时,所述文件预览数据为从所述文档文件中按页顺序截图生成的图片数据;
所述文件展示操作选中的文件为网页文件时,所述文件预览数据为访问所述网页文件的原始网页得到的网页页面。
可选地,所述操作装置,还包括:
显示调整单元,被配置为接收在所述白板应用界面中发生的显示调整操作,改变所述白板应用界面中显示层级低于所述文件展示窗口的显示元素的显示位置,并保持所述文件展示窗口的显示位置。
可选地,所述操作装置,还包括:
页面增加单元,被配置为接收在所述白板应用界面中发生的页面增加操作,在所述白板应用界面中新增空白页面并保持所述文件展示窗口置顶显示,所述空白页面覆盖已有页面进行显示。
可选地,所述操作装置,还包括:
窗口移动单元,被配置为接收在所述文件展示窗口发生的移动操作,跟随移动所述文件展示窗口的显示位置。
可选地,当所述文件展示窗口的边界移动到白板应用界面的设定边界之外,在所述移动操作结束后,将所述文件展示窗口恢复到所述白板应用界面内显示。
可选地,所述操作装置,还包括:
窗口缩放单元,被配置为接收在所述文件展示窗口发生的缩放操作,跟随所述缩放操作改变所述文件展示窗口的显示大小。
可选地,所述缩放操作为热区操作或多指缩放操作。
可选地,所述操作装置,还包括:
窗口激活单元,被配置为响应于在所述文件展示窗口发生的窗口激活操作,所述文件展示窗口进入选中状态,所述文件展示窗口在选中状态下覆盖有蒙层,且所有预览控制控件进入禁用状态。
可选地,所述操作装置,还包括:
文件保存单元,被配置为接收保存白板文件时的窗口保存操作,将所述文件预览数据保存到所述白板文件。
可选地,所述操作装置,还包括:
最大化显示单元,被配置为接收对所述文件展示窗口的最大化操作,将所述文件展示窗口中展示的文件最大化显示;
窗口批注单元,被配置为在所述最大化显示的文件上执行批注操作;
其中,所述最大化显示的文件覆盖所述白板应用界面。
第四方面,本发明实施例还提供了一种智能交互平板的操作装置,包括:
触控监听单元,被配置为监听白板应用界面的触控操作指令;
指令判断单元,被配置为判断所述触控操作指令的类型;
窗口显示单元,被配置为当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件;
轨迹显示单元,被配置为当判断所述触控操作指令为书写操作指令,在所述白板应用界面生成所述书写操作指令对应生成的书写轨迹。
可选地,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作指令选中的文件的文件类型对应。
可选地,所述在所述白板应用界面之上添加文件展示窗口,包括:
当所述白板应用界面当前不存在文件展示窗口,在所述白板应用界面添加置顶图层,在所述置顶图层绘制文件展示窗口;
当所述白板应用界面当前存在文件展示窗口,在所述置顶图层绘制新增文件展示窗口。
可选地,所述书写轨迹显示于原始图层,所述原始图层与所述置顶图层的触控事件互相隔离。
可选地,所述操作装置,还包括:
截图显示单元,被配置为检测到所述文件展示窗口中的截图操作时,将所述文件展示窗口中的显示内容截图保存到截图缓存区,将所述截图缓存区中最新添加的截图数据显示到所述原始图层的预设区域。
可选地,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,包括:
若所述文件展示操作指令选中的文件为文档文件,读取所述文档文件并按页顺序截图得到至少一张图片数据,将所述图片数据按截图顺序组织得到文件预览数据并保存到预设的展示文件夹;
若所述文件展示操作指令选中的文件为网页文件,读取所述网页文件的原始网址,访问所述原始网址获得对应的网页页面数据得到文件预览数据,并将所述原始网址保存到预设的展示文件夹;
若所述文件展示操作指令选中的文件为音视频文件,将所述音视频文件备份复制得到文件预览数据并保存到预设的展示文件夹。
可选地,所述文件类型为文档文件时,对应的预览控制控件包括翻页控件;
操作装置,还包括:
翻页显示单元,被配置为文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操作,按截图顺序对应改变所述文档文件在所述文件展示窗口中的当前图片数据。
可选地,所述操作装置,还包括:
数据保存单元,被配置为在保存白板文件时检测到窗口保存操作时,将所述展示文件夹中的文件预览数据保存到所述白板文件。
可选地,所述操作装置,还包括:
数据删除单元,被配置为关闭所述白板应用界面时,删除所述展示文件夹中的文件预览数据。
可选地,所述指令判断单元,包括:
第一判断模块,被配置为在所述白板应用界面的工具栏中监听到触发文件展示控件的触 控事件,且在响应于触发所述文件展示控件弹出的文件列表界面中监听到选择至少一个文件的触控事件,则判断触控操作指令为文件展示操作指令,所述文件列表界面中选择的文件为所述文件展示操作指令选中的文件;
第二判断模块,被配置为在所述白板应用界面监听到触摸点连续移动的触控事件,则判断触控操作指令为书写操作指令。
第五方面,本发明实施例还提供了一种终端设备,包括:
一个或多个处理器;
存储器,用于存储一个或多个程序;
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如第一方面和第二方面任一所述的智能交互平板的操作方法。
第六方面,本发明实施例还提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如第一方面和第二方面任一所述的智能交互平板的操作方法。
上述智能交互平板的操作方法、装置、终端设备和存储介质,通过接收在白板应用界面发生的文件展示操作;开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;接收在所述白板应用界面发生的书写操作;根据所述书写操作,在所述白板应用界面生成书写轨迹。在白板应用界面中添加文件展示窗口,并在文件展示窗口内做适应于预览需求的文件内容展示,解决了相关技术中需要最小化或者退出白板应用才能打开文件进行展示的问题,实现了在白板应用界面中对其他类型文件的快速和便捷浏览,简化了白板使用过程中浏览其他文件时复杂的操作过程,降低了用户使用白板过程中的操作时间成本,提高了信息传递的流畅度。
而且,文件展示窗口置于白板应用界面上,与白板应用界面中其他显示元素的操作相互隔离,可以供用户使用白板应用的书写、***元素等功能对文件展示窗口内显示的文件进行持续展示,实现内容展示的聚焦效果和连贯性。
附图说明
图1为本发明实施例一提供的一种智能交互平板的操作方法的流程图;
图2为本发明实施例一提供的一种智能交互平板的触控输入的界面示意图;
图3为本发明实施例提供的文件展示操作的示意图;
图4为本发明实施例提供的文件展示窗口的示意图;
图5为本发明实施例二提供的一种智能交互平板的操作方法的流程图;
图6为本发明实施例提供的文件展示窗口截图的示意图;
图7为本发明实施例提供的文件展示窗口移动的示意图;
图8为本发明实施例三提供的一种智能交互平板的操作方法的流程图;
图9为本发明实施例四提供的一种智能交互平板的操作装置的结构示意图;
图10为本发明实施例五提供的一种智能交互平板的操作装置的结构示意图;
图11为本发明实施例六提供的一种终端设备的结构示意图。
具体实施方式
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是,此处所描述的具体实施例用于解释本申请,而非对本申请的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本申请相关的部分而非全部结构。
需要注意的是,由于篇幅所限,本申请说明书没有穷举所有可选的实施方式,本领域技术人员在阅读本申请说明书后,应该能够想到,只要技术特征不互相矛盾,那么技术特征的任意组合均可以构成可选的实施方式。
例如,在实施例一的一个实施方式中,记载了一个技术特征:拖拽的文件是其他格式的文件,此时也可以确认为文件展示操作,拖拽操作对应的文件确认为文件展示操作选中的文件,在实施例一的另一个实施方式中,记载了另一个技术特征:最大化的预览控制控件被触发时,文件展示窗口填充整个白板应用界面。由于以上两个技术特征不互相矛盾,本领域技术人员在阅读本申请说明书后,应该能够想到,同时具有这两个特征的实施方式也是一种可选的实施方式,即拖拽文件打开文件展示窗口之后,该文件展示窗口可以通过触发最大化的预览控制控件填充整个白板应用界面。
记载在不同实施例中的不互相矛盾的技术特征也可以任意组合,构成可选的实施方式。
例如,实施例2中记载了:在触发截图控件之后进行截图时,可以调整截图范围的标识框对截图范围进行调整。为了控制本申请说明书的篇幅,在实施例1和实施例3中,并没有记载这个特征。但是本领域技术人员在阅读本申请说明书后,应该能够想到,实施例1和实施例3所提供的智能交互平板的操作方法也可以包括该特征,即,在有文件展示窗口进行显示时,可以触发截图控件进行截图,截图时可以调整截图范围的标识框对截图范围进行调整。
下面对各实施例进行详细说明。
实施例一
图1为本发明实施例一提供的一种智能交互平板的操作方法的流程图。实施例中提供的智能交互平板的操作方法可以由智能交互平板的操作设备执行,该智能交互平板的操作设备可以通过软件和/或硬件的方式实现,该智能交互平板的操作设备可以是两个或多个物理实体构成,也可以是一个物理实体构成。例如,智能交互平板的操作设备可以是手机、工业控制计算机等。
为了便于理解,实施例中以智能交互平板为实际载体,示例性描述智能交互平板的操作方法实施时调整目标选中、关联和调整响应的详细过程。其中,智能交互平板可以是通过触控技术对显示在显示平板上的内容进行操控和实现人机交互操作的一体化设备,其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。
一般而言,如图2所示,智能交互平板1包括至少一块显示屏。例如,智能交互平板1配置有一块具有触摸功能的显示屏,且该显示屏可以是电容屏、电阻屏或者电磁屏。在本实施例中,提供了一种智能交互平板,在一些实施例中,用户可以通过手指或触控笔触控显示屏的方式实现触控操作,相应的,智能交互平板检测触控位置,并根据触控位置进行响应,以实现触控功能。典型的,智能交互平板安装有至少一种操作***,其中,操作***可以包括安卓***、Linux***及Windows***。在一些实施例中,智能交互平板可以安装至少一个具有书写功能的应用程序。其中,该应用程序可以为操作***自带的应用程序,同时,也安装有从第三方设备或者服务器中下载的应用程序。可选的,应用程序除具备书写功能外,还具有其他编辑功能,如***表格、***图片、插图图形、绘制表格、绘制图形等功能。其中,绘制得到的表格或图形为计算机绘制标准元素。计算机绘制标准元素可以理解为由智能交互平板绘制的印刷体标准元素,其区别于用户书写的元素。
在电子白板、电子黑板、数位板、智能会议平板等智能手写设备配置的触摸屏上,设置有用于响应用户的书写操作来显示输入内容的书写区域,在该书写区域进行书写时,如通过触控笔或手指接触触摸屏,触摸屏可以感应到电流的变化、电压的变化或磁通量的变化(对应于电容式触摸屏、电阻式触摸屏或电磁式触摸屏的设置类型),得到含有触摸位置的坐标的触摸信号以及该触摸信号的触发时间,根据触摸位置的坐标以及触摸信号的触发时间,可以得到触控笔或用户手指每次按下书写至抬起停止书写过程中输入的书写轨迹的轨迹数据,根据轨迹数据在触摸屏的书写区域实时显示用户输入的书写轨迹。当然,书写过程可以为写字, 在智能手写设备的触摸屏实现的任何用于显示操作轨迹的录入过程均可视为书写过程。此外根据触摸操作的发生位置的显示元素的不同,触摸操作可以响应为用户的点击、拖拽等操作。这些不同的响应方式在底层的坐标处理方式是相同的。通常来说,触摸书写发生的区域与显示所在的区域重合,即为图2中所示的显示区域2。基于触摸和显示等基本功能的硬件实现,在智能交互平板上可以实现白板应用的功能,本方案各实施例即为白板应用的方案实现。
参考图1,该智能交互平板的操作方法可以包括:
步骤S101、接收在白板应用界面发生的文件展示操作。
应用界面指一个应用用于接收和/或展示信息的交互界面,例如视频播放类的应用,其交互界面主要用于展示变化的视频画面;实时通信类的应用,其交互界面主要用于接收近端用户输入的内容和展示远端用户输入的内容;文件编辑类的应用,其交互界面主要用于接收用户输入的内容并进行展示;浏览器类的应用,其交互界面主要用于接收用户输入的关键字并展示基于该关键字得到的网页内容。
在本实施例中,针对的应用界面是指白板应用使用过程中呈现的用户界面,即白板应用界面。如前所述,白板应用指供用户进行书写、展示等操作的应用,可以用于根据用户在白板应用界面上的书写轨迹生成书写笔迹,也可以用于在白板应用界面上***图形、图片、表格等其他多媒体元素。在白板应用界面中,用户可以实现与实体黑板类似的写、画、擦除等操作,并有更好的移动、保存、缩放、***图片、颜色调整、笔画粗细设置等数字化功能。在白板应用中基于书写的操作是相关技术的实现,在本方案中不做详细说明。在实际应用中,白板应用也可以命名为书写应用、电子白板应用、协同白板应用等名称,不管名称如何改变,只要用于实现上述功能的应用,均等同于本申请的白板应用。
在使用白板应用的过程中,白板应用通常全屏显示,即白板应用会填满图2中智能交互平板1的显示区域2,为表现清楚,后续附图中只示意显示区域2的显示变化。请参考图3,在白板应用界面20中显示的内容除了使用过程中书写添加的内容和***显示的内容,还有对应各种对以上的内容进行操作的工具控件,这些工具控件在白板应用界面20中常态显示在工具栏21,本方案的示例描述中,工具栏21显示在白板应用界面20的底部,在实际布局时也可以在左侧和/或右侧,甚至是左侧、右侧和底部的综合显示。工具栏21中有些工具控件对应实体黑板功能的数字化实现,例如书写、擦除、翻页(部分实体黑板才有)等,还有些工具控件是在白板应用基础上实现的功能补充控件,例如取消输入、还原输入、笔迹选中、***等。
本实施例中的文件展示操作至少选中一个文件并确定将选中的文件在白板应用界面中打开,也就是说文件展示操作是一个组合操作。
在本方案中,文件展示操作可以是基于工具栏21实现的组合操作。如图3所示,在工具栏21中设置有文件打开的工具控件,当文件打开的工具控件被触发时,弹出文件列表界面23,文件列表界面23中展示有默认的文件夹或最近一次打开的文件夹中的文件和子文件夹,当其中有文件被选中时,确认接收到文件展示操作。文件列表界面23中的文件被选中可以是文件列表界面23中某个文件(包括图标区域和文件名区域)发生设定的选中操作,例如单指触控点击、多指触控点击等;还可以是该文件发生从文件列表界面23中拖拽到白板应用界面20中文件列表界面23之外的区域,图3中示意的是拖拽选中的方式。也就是说,在白板应用界面20中实现的文件展示操作是多个动作的组合,至少包括对文件打开控件的触发以弹出文件列表界面23以及在文件列表界面23中对某个文件的选择。这也是白板应用的使用特征所决定了主要实现方式,因为智能交互平板的操作需求一般在白板应用的使用过程中出现,需要的就是在白板应用界面20显示的同时,不用进行白板应用界面20的切换或调整即可快 速对其他文件进行展示。
除了基于工具栏实现的文件展示操作,为适应少部分应用场景,除了从白板应用界面中通过组合动作选中文件作为文件展示操作之外,还可以将白板应用的快捷图标视为白板应用界面的一种呈现方式,当检测到有文件拖拽到白板应用的快捷图标时,也视为在白板应用界面发生文件展示操作,此时可能会有两种不同的响应结果。第一种是拖拽的文件是白板应用生成的格式的文件,此时的响应是直接打开白板应用并在白板应用完整的白板应用界面中打开该文件;第二种是拖拽的文件是其他格式的文件,此时也可以确认为文件展示操作的发生,对于第二种方式,拖拽操作对应的文件确认为文件展示操作选中的文件。
步骤S102、开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上。
其中,文件展示窗口是在白板应用界面上的一个显示区域,该显示区域用于显示根据文件展示操作选中的文件。文件展示窗口的面积小于白板应用界面的面积,可选的,为了结合文件展示窗口更好地进行展示,文件展示窗口的面积小于白板应用界面的面积的四分之一,从而预留足够的空白区域供用户进行书写、***元素展示等操作。
对于文件展示窗口而言,可以将其显示层级固定为置顶显示。在一些实施例中,在白板应用界面之上显示的文件展示窗口,不会因为对其它显示于文件展示窗口之外的显示元素的操作,而导致文件展示窗口改变显示层级,使得文件展示窗口在其存在周期内,只能被其它文件展示窗口遮挡,而不会被文件展示窗口之外的其他类(例如书写轨迹、***的图片、***的表格)显示元素影响其显示。基于工具栏21实现的文件展示操作,在确认选中的文件之后,即在白板应用界面20之上添加文件展示窗口22,当然,同时会关闭文件列表界面23,此时的状态如图4所示。
如果是直接将文件拖拽到白板应用的快捷图标,则需要打开白板应用,并在白板应用界面中添加文件展示窗口。
在一些实施例中,白板应用的应用场景主要是会议、教学、头脑风暴等注重人机交互的场景,在这种场景下,对文件编辑的需求较为薄弱或者希望不对文件本身内容进行更改,因此在文件展示窗口中,仅保留查看文件所需的基本显示元素,可包括用于呈现文件内容的文件预览数据和控制查看过程的预览控制控件。事实上,不同类型的文件存在不同的内容特征和查看特征,例如文档文件(常见的例如PPT文档、WORD文档、EXCEL文档)的内容以静态内容为主,预览内容主要是由文字、符号、图片或者多种的组合构成;多媒体文件(常见的例如不同格式的视频文件、音频文件)以动态内容为主,预览内容是连续画面播放、连续声音播放或二者的结合构成。这两类文件就有着明显的预览需求的区别,前一种内容的信息传递相对抽象,受众对信息的接收需要一定的时间,进而要求内容的呈现以静态显示为主;后一种内容的信息传递相对直观,基于视觉和/或听觉的信息传递相对较快并具有延续性,进而要求内容呈现以动态连续播放为主。因此,基于实际的预览需求和文件的预览特征,在文件展示窗口中通常不是直接获取文件内容进行展示,而是对文件内容进行一定程度的处理后以适应于预览的方式呈现。对应的,预览控制控件的类型也有着对应的简化,例如文档文件在预览过程中就取消了各种编辑工具的显示,仅保留最基本的翻页、文件页数等用于浏览的控件,多媒体文件在预览过程中就取消了播放列表、播放方式的显示,仅保留快进、快退、暂停、音量调节等用于单个多媒体文件播放控制的控件。此外,在文件展示窗口会同步展示对应的文件名,例如可以显示在预览控制控件同一区域,也可以悬浮显示在文件展示窗口的左上角。
在一些实施例中,在确认文件展示操作选择的文件之后,根据该文件的后缀名即可确认 该文件的类型,不同类型的文件有不同的文件预览数据生成方式,例如文件展示操作选中的文件为文档文件时,并不会直接以文档编辑状态下的显示方式进行呈现(即不会以文字和***的内容作为基本显示单元),对应的文件预览数据实质是图片数据,在一些实施例中,所述文件预览数据为从所述文档文件中按页顺序截图生成的图片数据。文件的预览控制控件与文件的浏览方式相关,在文档文件的浏览过程中,通常只需要翻页,并且在翻页过程中需要显示当前的页面状态,所以如图4,在文件展示窗口22中对应于预览内容操作的只有向前翻页、向后翻页以及页码状态三个预览控制控件。图4中,页码状态的预览控制控件用于展示对文件展示窗口22显示的文件的页码状态,图4中当前显示的是总共11页中的第1页,通过触摸点击该页码状态的预览控制控件,还可以对文件展示窗口22显示的文件进行页面预览,例如在文件展示窗口22预览图4中展示文件的11页的情况。当然,还有全屏和关闭的预览控制控件,这是针对整个文件展示窗口22的操作,在一些实施例中,在全屏的预览控制控件被触发时,将文件展示窗口22中展示的文件最大化显示,并在最大化显示的文件上显示批注功能控件,其中,最大化显示的文件覆盖整个白板应用界面;在关闭的预览控制控件被触发时,对应的文件展示窗口22关闭,结束对应的文件的预览。最大化和关闭的预览控制控件用于对文件展示窗口22显示状态的整体控制,与内容的预览控制无关。此外,也可以在文件展示窗口22中定义手势操作,例如在文件展示窗口22中上下滑动时,文件展示窗口22中的显示内容上下跟随滑动,在文件展示窗口22中左右滑动,文件展示窗口22中的显示内容前后翻页。
所述文件展示操作选中的文件为网页文件时,所述文件预览数据为访问所述网页文件的原始网页得到的网页页面。
如果文件展示操作选中的文件是网页文件,则文件预览数据访问网页文件的原始网页得到网页页面,也就是说,网页的预览实际上是对网页的网址访问得到的数据,当然,也可以选择打开保存的网页文件。对应可以上下滑动进行网页内容的上下调整,滑动可以在文件展示窗口中任意进行,也可以设定在侧边显示的控制条上进行。
此外,还有视频和音频等文件,可以将其进行本地备份后,在对应的文件展示窗口进行播放。
因此,本方案中所说的文件展示窗口不是所有类型的文件对应的文件展示窗口都完全相同。不同类型文件对应的文件展示窗口只是基本的设计风格相同,在实现上,有多种对应不同类型文件的底层实现,例如文档文件对应的文件展示窗口,其核心封装的是图片浏览控件;网页文件对应的文件展示窗口,其核心封装的是网页浏览器控件;视频文件对应的文件展示窗口,其核心封装的是视频播放器控件;音频文件对应的文件展示窗口,其核心封装的是音频播放器控件;在各个核心封装的基础,用相同的设计风格加上不同的预览控制控件,即得到适应于不同类型文件的文件展示窗口。在文件展示窗口的基本显示属性上,不同类型文件对应的文件展示窗口有着各自初始大小和/或长宽比,例如PPT文件,文件展示窗口的长宽比通常为16:9;又例如视频文件,文件展示窗口的长宽比与视频内容的长宽比相适应,但是设定最小宽度,例如300像素。
步骤S103:接收在所述白板应用界面发生的书写操作。
步骤S104:根据所述书写操作,在所述白板应用界面生成书写轨迹。
本实施例中在白板应用界面发生的书写操作与相关技术中白板应用中的常规书写操作的整体实现相似,局部可以针对文件展示窗口进行适应性调整。例如某次书写操作对应的书写轨迹的起点不在文件展示窗口之内,则确认该书写操作有效,并对应生成书写轨迹,如果书写轨迹与文件展示窗口有重叠,则将重叠部分生成在文件展示窗口之下,以适应文件展示窗口的置顶显示,只有文件展示窗口移开之后或者将书写轨迹进行移动后,原有重叠的书写轨 迹才能显示出来。又例如某次书写操作对应的书写轨迹的起点在文件展示窗口之内,则确认该书写操作无效,不生成书写轨迹;或者确认该书写轨迹是对应于文件展示窗口中的书写行为,在文件展示窗口中生成与文件展示窗口重叠的书写轨迹,对于该书写操作与文件展示窗口不重叠的部分,则不进行生成显示。
需要特别说明的是,在本方案中,文件展示窗口中的文件预览与书写轨迹的生成不是两个互相独立操作简单集成,而是在实际使用白板应用的过程中针对应用场景的整体设计。例如某些会议、教学或研讨等活动过程前,会准备一个或多个已有文件作为活动焦点,实际进行活动时,在白板应用界面通过文件展示窗口展示已有文件,同时在活动过程中针对展示内容在白板应用界面记录笔记、观点、纲要等,并最终可以生成完整的活动记录。基于本方案进行的活动,会议焦点的呈现与会议记录的生成在同一界面实现,信息的传递过程与记录的生成过程有良好的延续性,避免了实现两个过程的信息窗口互相切换带来的显示中断,实施需要已有文件作为活动焦点的活动时,可以在设备操作层面带来流畅的活动体验。
如果以文档文件作为活动焦点,则可以在白板应用界面添加文件展示窗口展示对应的文件预览数据(文档文件按页截图的数据)和预览控制控件(向前翻页、向后翻页以及页码状态),在活动过程中,直接在白板应用界面针对当前展示的页面生成的笔记、纲要、观点的进行手写输入。在当前展示的页面讨论完之后,直接白板应用界面操作预览控制控件进行翻页,并继续进行对应的活动记录。
如果需要对视频或音频中的内容进行分析收集信息时,例如查案时对监控视频进行分析,教学中对电影进行讨论,则以多媒体文件作为活动焦点,此时可以在白板应用界面添加文件展示窗口展示对应的文件预览数据(完整的视频、音频、动画等)和预览控制控件(快进、快退、暂停、音量调节、播放进度条)。在活动过程中,可以随时调整文件播放状态,例如根据快退控件或播放进度条的触发进行回放,以实现重复播放全面获取信息;又例如对当前画面暂停,以仔细分析画面中的细节,基于这些播放状态的调整,可以将获取到的信息或细节直接记录在白板应用界面。
以上操作中,文件的展示和活动中生成内容的记录都是在白板应用界面完成,对文件的操作只需要触发预览控制控件即可,文件的展示与活动过程的记录可以流畅进行,避免了页面切换带来的活动过程中断,并且文件的展示与活动过程的记录同在白板应用界面中完成,文件信息的显示传递与活动记录的生成具有高度的集成性,用户体验更佳。
上述,通过接收在白板应用界面发生的文件展示操作;开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;接收在所述白板应用界面发生的书写操作;根据所述书写操作,在所述白板应用界面生成书写轨迹。在白板应用界面中添加文件展示窗口,并在文件展示窗口内做适应于预览需求的文件内容展示,实现了在白板应用界面中对其他类型文件的快速和便捷浏览,简化了白板使用过程中浏览其他文件时复杂的操作过程,降低了用户使用白板过程中的操作时间成本,提高了信息传递的流畅度。而且,文件展示窗口显示在白板应用界面上,与白板应用界面中其他显示元素操作相互隔离,可以工用户使用白板应用的书写、***元素等功能对文件展示窗口内显示的文件进行持续展示,实现内容展示的聚焦效果和连贯性。
实施例二
图5为本发明实施例二提供的一种智能交互平板的操作方法的流程图。本实施例是在上述实施例的基础上进行改动。
参考图5,本实施例提供的智能交互平板的操作方法可以包括:
步骤S201、接收在白板应用界面发生的文件展示操作。
步骤S202、开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上。
文件展示窗口在白板应用界面之上的显示不仅是刚显示时的显示状态,可以延续为文件展示窗口整个存续期间具备最高显示层级,即置顶显示。本实施例中所说的置顶显示不是绝对置顶在所有已有显示元素之上,而是相对置顶在白板应用界面中实时输入的显示元素之上。换句话说,如果当前已经显示有文件展示窗口,新的文件展示操作会在已有的文件展示窗口上再置顶添加文件展示窗口,当然,这种添加只是部分覆盖,至少保留已有的文件展示窗口的一定宽度和/或一定高度正常显示。整体而言,第一个出现的文件展示窗口出现在默认的位置,后续出现的文件展示窗口以部分覆盖的设定标准为参考进行显示位置的确认。
新的文件展示操作可以是展示当前已经展示在某个文件展示窗口中的文件,也可以是尚未展示的文件。可以展示当前已经展示的文件是因为在文件展示窗口中展示的实际并不是原文件,而是基于原文件的衍生数据,该衍生数据独立于原文件存在。
因为在文件展示窗口中打开的文件实际并不是文件展示操作选中的原始文件,而是基于原始文件为实现文件展示衍生出的文件,因此,理论上可以对一个文件做无限次的展示,并且已有的展示并不受原文件的状态变化影响,例如原文件保存于移动存储设备,如果已经在文件展示窗口中展示该文件,那么即使移动存储设备拔出,文件展示窗口中对该文件的展示依然不受影响,正常进行。
除了逐个打开并最终形成多个文件展示窗口的方式,还可以参考步骤S101中的操作,只是每次操作选中多个文件进行对应的确定或拖拽,最终也可以实现多个文件展示窗口的打开。
步骤S203、接收在白板应用界面发生的书写操作。
步骤S204、根据书写操作,在白板应用界面生成书写轨迹。
在一次基于白板应用实施的活动(可以包括教学、会议、研讨)过程中,文件展示操作和书写操作都随时有可能触发,例如在白板应用开启之后可能先打开文件展示窗口,也可能先接收书写操作生成书写轨迹,可能针对某个文件的展示进行笔记记录,还可能在针对某个文件的展示完成笔记记录之后再打开新的文件进行展示,因此,本方案中文件展示操作和书写操作之间没有严格的执行顺序,文件展示操作和书写操作可以交错执行,只要接收到某个操作触发,即进行对应的显示变化。
本实施例通过接收在白板应用界面发生的文件展示操作;开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;接收在所述白板应用界面发生的书写操作;根据所述书写操作,在所述白板应用界面生成书写轨迹,从而实现在白板应用界面中添加文件展示窗口,并在文件展示窗口内做适应于预览需求的文件内容展示,实现了在白板应用界面中对其他类型文件的快速和便捷浏览,简化了白板使用过程中浏览其他文件时复杂的操作过程,降低了用户使用白板过程中的操作时间成本,提高了信息传递的流畅度。而且,文件展示窗口显示在白板应用界面上,与白板应用界面中其他显示元素操作相互隔离,可以供用户使用白板应用的书写、***元素等功能对文件展示窗口内显示的文件进行持续展示,实现内容展示的聚焦效果和连贯性。
可选的,本实施例包括:
步骤S205、接收对截图控件的触摸点击操作,将文件展示窗口中当前显示的画面截图显示到白板应用界面中的设定区域。
在一些实施例中,截图效果如图6所示。在实现时,设定区域可以是白板应用界面20中的固定位置,或者以文件展示窗口22为参考的相对固定位置,或者以已有截图为参考的相对固定位置。最终实现的效果是截图得到的画面不完全覆盖已有的截图得到的画面,当用户触 发文件展示窗口22中的截图控件时,触发截图过程,在图6中,截图显示于白板应用界面20的右上角,如果文件展示窗口22在白板应用界面20的右边,则可以将截图显示于白板应用界面20的左边或左上角。另外需要说明的是,该操作的执行目的相当于需要将本来属于展示文件中的一部分内容添加到白板应用中参与当前交互。例如在活动过程中,文件展示窗口22当前展示的内容需要重点讨论,此时可以通过触发截图控件完成对当前展示的内容的截图,截图可以默认是对整个文件展示窗口22中的文件预览数据进行截图,可以通过截图范围的标识框对截图范围进行调整,例如只需要对当前展示的内容中的某个表格进行重点讨论,可以调整截图范围为截取该表格,这一调整过程约束在文件展示窗口内。截图得到画面在白板应用界面中的显示属于白板应用使用过程中实时生成的显示元素,它的显示层级与文件展示窗口不在同一级,而是与书写轨迹在同一层级。也就是说,如果在截图后有步骤S206中的操作,截图会跟随显示调整操作进行平移或缩放,但是文件展示窗口22不会进行响应。在截图完成之后,可以在白板应用界面对得到的内容进行注释、圈选、突出重点等白板应用的常用操作。基于截图操作,可以在不切换应用软件、不单独打开目标文件以及不修改目标文件的情况下,把目标文件中的素材快速添加到白板应用界面,操作简单且精确。
从内容上,如果是文档文件,截图根据文件展示方式可以是一整页文件预览数据直接作为截图(例如PPT文档、WORD文档、PDF文档),也可以是来自两页文件预览数据拼成的截图(例如WORD文档、PDF文档);如果是网页文件,截图应该是基于当前显示范围的截图生成;如果是视频文件,截图应该是一帧画面。
可选的,本实施例包括:
步骤S206:接收在白板应用界面中发生的显示调整操作,改变白板应用界面中显示层级低于文件展示窗口的显示元素的显示位置,并保持文件展示窗口的显示位置。
在白板应用界面中发生的显示调整操作,主要是调整在白板应用界面中的显示位置、大小比例、显示页面切换等,调整的对象主要是白板应用使用过程中在白板应用界面实时生成的显示元素(例如输入的书写轨迹、***的图片和表格等),在相关技术中,已有对显示元素的缩放,移动,翻页等操作,在本实施例中需要强调的是,对已有实时生成的显示元素的显示位置的调整,文件展示窗口不做响应,即这个调整只改变文件展示窗口之外的显示元素的显示位置或显示内容,因文件展示窗口的置顶显示,因此设定其具有最高的显示层级,其它的显示元素的显示层级均低于文件展示窗口。通过这种操作方式,可以以文件展示窗口为参考,将需要对比说明的已有显示元素调整到该文件展示窗口相邻的位置,便于说明过程中信息受众直观感受比对双方,也可以将已有显示元素调整到远离文件展示窗口的位置,留出更多空白区域供用户进行书写。例如多指缩放实现大小比例的调整(改变显示范围)、多指拖动实现显示位置的调整(改变显示位置)等操作直接用已有的白板应用使用体验即可适应文件展示窗口的调整,操作过程简单。又例如,在对显示层级低于文件展示窗口的显示元素进行调整时,文件展示窗口的显示保持不变,用户可以在白板应用界面中供书写操作的空白区域不足的情况下,维持文件展示窗口的正常显示的同时,通过显示调整操作扩大空白区域,扩大空白区域的操作简洁精确且不影响文件展示窗口的显示。在一些实施例中,用户在白板应用界面中移动书写笔迹时,可以将部分或全部书写笔迹移出智能交互平板的显示区域外,从而留出更多空白区域进行书写注释。
可选的,本实施例包括:
步骤S207:接收在白板应用界面中发生的页面增加操作,在白板应用界面中新增空白页面并保持文件展示窗口置顶显示,空白页面覆盖已有页面进行显示。
置顶显示的文件展示窗口具有最高的显示等级,白板应用界面中发生的页面增加操作(通 过工具栏中的页面增加控件触发)触发新增空白页面,根据文件展示窗口的显示等级和已有页面的显示等级之间的等级关系,空白页面覆盖已有页面进行显示,已有的文件展示窗口置顶显示于空白页面之上并且保持原有的显示位置不变。在以文件展示窗口作为活动焦点进行活动记录的过程中,在活动焦点发生变化或讨论重点发生变化时,通过页面增加操作可以快速进入下一活动焦点或讨论重点的相关记录,并且针对不同活动焦点或讨论重点对应在不同页面中记录的方式,生成的活动记录条理清晰,便于后续查看。此外,对于同一活动焦点或讨论重点,如果有较多的内容需要记录,也可以通过新增空白页面的方式进行多页记录,避免单页中不断调整空白区域进行大范围的书写,也能带来活动记录查看的便利性。
可选的,本实施例包括:
步骤S208:接收在文件展示窗口发生的移动操作,跟随移动文件展示窗口的显示位置。
在实际进行文件展示时,展示目的可以是为了与白板应用界面中在先实时输入的显示元素或在先打开的文件预览进行比对说明,而文件展示窗口可能正好覆盖了需要对比说明的对象,此时可以通过在文件展示窗口的移动操作对文件展示窗口的显示位置进行调整。在调整过程中,可以是文件展示窗口跟随移动操作的移动轨迹进行完全相同的显示位置调整,即文件展示窗口的一部分可能无法在白板应用界面中显示;也可以是文件展示窗口跟随移动操作的移动轨迹进行一定约束范围内的调整,例如文件展示窗口最多跟随移动轨迹移动到与白板应用界面的边界相接触,移动轨迹再往该方向的移动分量,文件展示窗口不再跟随移动,以维持文件展示窗口的完整显示。
请参考图7,文件展示窗口22b在最初出现时,设定大部覆盖文件展示窗口22a,响应于移动操作,文件展示窗口22a移动到白板应用界面20的右侧。
此外,还可以实现跟随和完整显示的结合,在一些实施例中,文件展示窗口跟随移动轨迹进行完全相同的显示位置调整,但是当所述文件展示窗口的边界移动到白板应用界面的设定边界之外,在所述移动操作结束后,将所述文件展示窗口恢复到所述白板应用界面内显示,可以对恢复过程增加动作效果,例如弹回、移动等。
可选的,本实施例包括:
步骤S209:接收在所述文件展示窗口发生的缩放操作,跟随所述缩放操作改变所述文件展示窗口的显示大小。
文件展示窗口的初始大小是默认的,这种默认显示如果范围过大,可能会影响到该文件展示窗口之外的内容的显示,如果范围过小,可能会影响到该文件展示窗口中内容的正常显示,基于此,有必要根据实际的显示需求对文件展示窗口的大小进行调整,即进行缩放操作。
在缩放实现时,所述缩放操作可以通过热区操作实现,在一些实施例中,将文件展示窗口的一个或多个角落设置为缩放热区,当在缩放热区检测到拖拽操作时,文件展示窗口的长宽进行相同比例的缩放,文件展示窗口中的显示内容也进行相同比例的缩放。此外,也可以是在文件展示窗口进行多指缩放操作,根据多个手指间相对距离的变化状态进行对应的大小调整,在一些实施例中,调整机制与热区操作相同,区别在于触发方式和缩放中心不同。
另外,因为智能交互平板也支持鼠标操作,缩放和平移的操作也可以通过鼠标实现。
可选的,本实施例包括:
步骤S210:响应于在文件展示窗口发生的窗口激活操作,文件展示窗口进入选中状态,文件展示窗口在选中状态下覆盖有蒙层,且所有预览控制控件进入禁用状态。
窗口激活操作可以通过触摸长按、连续点击等方式实现,在检测到设定的窗口激活操作时,该文件展示窗口进入唯一可操作状态,其他所有显示元素(包括其他文件展示窗口)停止对任何操作的反馈。在选中状态下,文件展示窗台覆盖有蒙层,相关的预览控制控件也进 入禁用状态。在激活状态下,文件展示窗口仅支持缩放、移动、删除等对应于文件展示窗口本身的操作,该动作的定义使得文件展示窗口与白板应用界面中其他实时生成的显示元素具有相同的操作定义,操作体验具有更好的一致性,用户的交互体验更好。
可选的,本实施例包括:
步骤S211:接收保存白板文件时的窗口保存操作,将文件预览数据保存到白板文件。
如果在白板文件保存时有同时保存文件展示窗口中相关文件的指令,则将文件展示窗口中的文件预览数据保存到白板文件,白板文件在后续打开时,可以同步打开文件展示窗口并展示文件预览数据。
在实际使用白板应用的过程中,文件展示操作通常属于临时操作,操作目的仅用于临时对比展示文件,确实有必要增加的内容也会截图添加到白板应用界面中,所以文件展示操作相关的文件通常不是必须保存,尤其例如视频文件,通常会占用比较大的存储空间,保存视频文件后学的文件传输会比较麻烦,所以需要由用户确认是否需要保存,因此,在接收到保存白板文件时,弹出提示用户是否保存窗口内容,并在接收到窗口保存操作后,将文件预览数据保存到白板文件中。
可选的,本实施例包括:
S212、接收对所述文件展示窗口的最大化操作,将所述文件展示窗口中展示的文件最大化显示;最大化操作用于将文件展示窗口所展示的文件进行最大化显示,在一些实施例中,最大化操作可以是设定的触摸动作,也可以通过在文件展示窗口设置最大化控件,通过触摸该最大化控件触发最大化操作。
S213、在所述最大化显示的文件上执行批注操作;批注操作可包括书写笔迹、***图形、图片等操作。
其中,所述最大化显示的文件覆盖所述白板应用界面。
在最大化窗口后,支持对于文件展示窗口中当前显示内容的冻屏批注。即开始批注后当前页面不再支持滑动或翻页,视频也暂停播放,退出批注后恢复原有状态。批注功能引入简单书写擦除和分享,便于用户操作,可以在对当前显示内容进行重点说明时,最大化并持续显示当前的显示画面,提高显示效果并使得信息受众的注意力高度集中。
需要说明的是,步骤S201、步骤S202、步骤S203、步骤S204、步骤S205、步骤S206、步骤S207、步骤S208、步骤S209、步骤S210、步骤S211、步骤S212-S213没有特别严格的执行顺序,以上编号和描述顺序仅仅为适应图5中的表达。例如,实际上,在白板应用的一个完整使用周期中,只有步骤S201和步骤S202依次执行,步骤S203和步骤S204依次执行,只要当前有文件展示窗口打开,其中任何一个步骤可以随时执行。
在前文描述中并未特意强调某个操作只对该操作对应的文件展示窗口产生影响,应当理解,在以上所有的操作过程中,一个操作只对一个文件展示窗口产生影响,即一个文件展示窗口中发生的操作只对该文件展示窗口产生影响,而不会通过其他的文件展示窗口对该操作进行反馈。
上述,在文件展示窗口显示之后,对文件展示窗口和/或白板应用界面的后续操作,能够在文件展示窗口维持显示状态的同时,调整白板应用界面中的显示元素的显示状态,使得白板应用界面中的显示元素适应于活动过程中文件展示窗口的正常显示,进行简洁精确的调整;也能够在白板应用界面中的显示元素维持正常显示状态的同时,调整文件展示窗口的显示状态,使得文件展示窗口适应于其他文件显示窗口或显示元素的正常显示,进行简洁精确的调整,实现了在活动过程中信息传递和过程记录的需求随机多样变化时的便捷交互。
实施例三
图8为本申请实施例三提供的一种智能交互平板的操作方法的流程图。本实施例中提供的智能交互平板的操作方法与上述实施例提供的智能交互平板的操作方法应用在相同的场景中。参考图8,本实施例提供的智能交互平板的操作方法包括:
步骤S301:监听对白板应用界面的触控操作指令。
在白板应用界面可以监听到许多触控事件,例如对应于图3中工具栏21中任何一个工具控件的触发都会产生对应的响应,在本实施例中,如果是对应于图3中白板应用界面20的触控事件的监听,描述的是对其中文件展示工具控件被触发的后续响应。
步骤S302:判断所述触控操作指令的类型。
触控操作指令的类型可根据触控事件发生的位置、持续时间、移动距离等触控检测得到的参数确认,在本方案中,主要判断出文件展示操作指令和书写操作指令并进行后续响应,位置、持续时间和移动距离等参数的获得可以是触控技术的常规实现,在此不做深入阐述。在一些实施例中,判断所述触控操作指令的类型,包括:
在所述白板应用界面的工具栏中监听到触发文件展示控件的触控事件,且在响应于触发所述文件展示控件弹出的文件列表界面中监听到选择至少一个文件的触控事件,则判断触控操作指令为文件展示操作指令,所述文件列表界面中选择的文件为所述文件展示操作指令选中的文件;
在所述白板应用界面监听到触摸点连续移动的触控事件,则判断触控操作指令为书写操作指令。一般来说,一个触摸点连续移动的触控事件,判断为书写操作指令。
步骤S303:当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件。
在白板应用界面中,文件展示窗口是所有白板应用使用过程中实时生成的显示元素之上置顶显示的控件,在白板应用界面中,所有显示元素的显示过程实际就是绘制过程,各个显示元素的层叠顺序、移动操作等,都是通过层级管理实现。在本方案中,为白板应用界面至少定义一个置顶图层,置顶图层专用于管理文件展示窗口,所有文件展示窗口的添加都是添加到置顶图层,置顶图层内的所有文件展示窗口相对于其他层级具有最高显示等级,即显示于其他所有层级的显示元素之上,置顶图层内的文件展示窗口显示等级平等,在一些实施例中,最近检测到操作的文件展示窗口在所有文件展示窗口中置顶显示。
在实现过程中,对应于置顶图层,还定义有原始图层,原始图层用于绘制白板应用使用过程中实时生成的显示元素,原始图层中的显示元素基本根据添加顺序进行相互之间绘制层级的确认。置顶图层和原始图层的设定除了用于显示过程中图像绘制的管理,还可以用于触控事件响应的管理,整体而言,两个层级之前的触控事件互相隔离。在一些实施例中,对于从置顶图层中显示元素开始的触控事件,仅由置顶图层的显示元素进行响应;对于从原始图层中显示元素开始的触控事件,仅由原始图层的显示元素进行响应。
置顶图层的层级相对于原始图层进行定义,如果没有文件展示窗口,白板应用界面中可以没有置顶图层。即文件展示窗口在置顶图层中的绘制需要先确认是否有置顶图层存在。
当所述白板应用界面当前不存在文件展示窗口,在所述白板应用界面添加置顶图层,在所述置顶图层绘制文件展示窗口;
当所述白板应用界面当前存在文件展示窗口,在所述置顶图层绘制新增文件展示窗口。
所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作指令选中的文件的文件类型对应。
对于文件展示窗口中展示内容,可由文件类型确定:
若所述文件展示操作选中的文件为文档文件,读取所述文档文件并按页顺序截图得到至少一张图片数据,将所述图片数据按截图顺序组织得到文件预览数据并保存到预设的展示文件夹;
若所述文件展示操作选中的文件为网页文件,读取所述网页文件的原始网址,访问所述原始网址获得对应的网页页面数据得到文件预览数据,并将所述原始网址保存到预设的展示文件夹;
若所述文件展示操作选中的文件为音视频文件,将所述音视频文件备份复制得到文件预览数据并保存到预设的展示文件夹。
预览控制控件与文件编辑制作过程中可能出现的控件有很大的区别,只需要满足预览的需求即可。例如文档文件在预览过程中就取消了各种编辑工具的显示,仅保留最基本的翻页、文件页数等用于浏览的控件,多媒体文件在预览过程中就取消了播放列表、播放方式的显示,仅保留快进、快退、暂停、音量调节等用于单个多媒体文件播放控制的控件。此外,在文件展示窗口会同步展示对应的文件名,例如可以显示在预览控制控件同一区域,也可以悬浮显示在文件展示窗口的左上角。
步骤S304:当判断所述触控操作指令为书写操作指令,在所述白板应用界面生成所述书写操作指令对应生成的书写轨迹。
书写轨迹最初的生成与显示不一定完全一致,例如某次书写操作对应的书写轨迹的起点不在文件展示窗口之内,则确认该书写操作有效,并对应生成书写轨迹,如果书写轨迹与文件展示窗口有重叠,则将重叠部分生成在文件展示窗口之下,以适应文件展示窗口的置顶显示,只有文件展示窗口移开之后,原有重叠的书写轨迹才能显示出来。又例如某次书写操作对应的书写轨迹的起点在文件展示窗口之内,则确认该书写操作无效,不生成书写轨迹;或者确认该书写轨迹是对应于文件展示窗口中的书写行为,在文件展示窗口中生成与文件展示窗口重叠的书写轨迹,对于该书写操作与文件展示窗口不重叠的部分,则不进行生成显示。
本实施例通过对触控操作指令的监听和类型判断,在白板应用界面中实现了文件展示窗口的独立显示,文件展示窗口和白板应用界面中的原始图层各自独立响应触控事件,进而实现了在白板应用界面中对其他类型文件的快速和便捷浏览,简化了白板使用过程中浏览其他文件时复杂的操作过程,降低了用户使用白板过程中的操作时间成本,提高了信息传递的流畅度。而且,文件展示窗口显示在白板应用界面上,与白板应用界面中其他显示元素操作相互隔离,可以工用户使用白板应用的书写、***元素等功能对文件展示窗口内显示的文件进行持续展示,实现内容展示的聚焦效果和连贯性。
在以上步骤的基础上,本方案可以包括:
步骤S305:检测所述文件展示窗口中的截图操作时,将所述文件展示窗口中的显示内容截图保存到截图缓存区,将所述截图缓存区中最新添加的截图数据显示到所述原始图层的预设区域。
在原始图层和置顶图层这一层级设计的基础上,对截图的操作有两个层级之间的数据传输过程。检测到截图操作时,置顶图层的文件展示窗口先对截图操作做出响应,将当前显示内容截图保存到截图缓存区,再由原始图层对截图缓存区的数据变化做出响应,将其中最新添加的截图数据显示到原始图层的预设区域。响应可以是对截图操作的响应,也可以是对截图缓存区的数据更新检测。
在以上步骤的基础上,所述文件类型为文档文件时,对应的预览控制控件包括翻页控件;
对应在步骤S303之后,还包括:
步骤S306:所述文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操 作,按截图顺序对应改变所述文档文件在所述文件展示窗口中的当前图片数据。
在以上步骤的基础上,本方案可以包括:
步骤S307:在保存白板文件时检测到窗口保存操作时,将所述展示文件夹中的文件预览数据保存到所述白板文件。
文件预览数据的保存有助于后续对会议资料的整理以及对会议过程的追溯。将文件预览数据与白板文件进行保存,在一些实施例中,可以是作为白板文件的一个显示元素封装到白板文件中,也可以是保存到默认的文件夹并建立和保存与白板文件的关联。
在一些实施例中,还可以包括:
步骤S308:关闭所述白板应用界面时,删除所述展示文件夹中的文件预览数据。
每次产生的文件预览数据对其他会议没有价值,并且对于视频文件,其对应的文件预览数据实际就是原文件复制,会占用大量的存储空间,关闭白板应用界面时,可以理解为会议结束时或当前议题结束时,删除文件预览数据,可以有效避免不要的存储空间使用。
以上,通过对触控操作指令的监听和类型判断,在白板应用界面中实现了文件展示窗口的独立显示,文件展示窗口和白板应用界面中的原始图层各自独立响应触控事件,进而实现了在白板应用界面中对其他类型文件的快速和便捷浏览,简化了白板使用过程中浏览其他文件时复杂的操作过程,降低了用户使用白板过程中的操作时间成本,提高了信息传递的流畅度。文件展示窗口与白板应用界面中其他显示元素的独立操作也提高了窗口调整过程中操作的准确性,实现了文件展示窗口中内容的常态显示,提高了内容展示的精确性,在文件展示窗口基础上的触控事件监测和响应,实现了在活动过程中信息传递和过程记录的需求随机多样变化时的便捷交互。
实施例四
图9为本发明实施例四提供的一种智能交互平板的操作装置的结构示意图。参考图9,该智能交互平板的操作装置包括:窗口添加单元401、文件显示单元402、书写接收单元403和书写显示单元404。
其中,窗口添加单元401,被配置为接收在白板应用界面发生的文件展示操作;文件显示单元402,被配置为开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;书写接收单元403,被配置为接收在所述白板应用界面发生的书写操作;书写显示单元404,被配置为根据所述书写操作,在所述白板应用界面生成书写轨迹。
在上述实施例的基础上,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作选中的文件的文件类型对应。
在上述实施例的基础上,所述文件类型为文档文件时,所述预览控制控件包括翻页控件;
所述操作装置,还包括:
文档翻页单元,被配置为文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操作,改变所述文档文件在所述文件展示窗口中的当前显示页面。
在上述实施例的基础上,所述预览控制控件包括截图控件;
所述操作装置,还包括:
窗口截图单元,被配置为接收对所述截图控件的触摸点击操作,将所述文件展示窗口中当前显示的画面截图显示到所述白板应用界面中的设定区域。
在上述实施例的基础上,所述文件展示操作选中的文件为文档文件时,所述文件预览数据为从所述文档文件中按页顺序截图生成的图片数据;
所述文件展示操作选中的文件为网页文件时,所述文件预览数据为访问所述网页文件的原始网页得到的网页页面。
在上述实施例的基础上,所述操作装置,还包括:
显示调整单元,被配置为接收在所述白板应用界面中发生的显示调整操作,改变所述白板应用界面中显示层级低于所述文件展示窗口的显示元素的显示位置,并保持所述文件展示窗口的显示位置。
在上述实施例的基础上,所述操作装置,还包括:
页面增加单元,被配置为接收在所述白板应用界面中发生的页面增加操作,在所述白板应用界面中新增空白页面并保持所述文件展示窗口置顶显示,所述空白页面覆盖已有页面进行显示。
在上述实施例的基础上,所述操作装置,还包括:
窗口移动单元,被配置为接收在所述文件展示窗口发生的移动操作,跟随移动所述文件展示窗口的显示位置。
在上述实施例的基础上,当所述文件展示窗口的边界移动到白板应用界面的设定边界之外,在所述移动操作结束后,将所述文件展示窗口恢复到所述白板应用界面内显示。
在上述实施例的基础上,所述操作装置,还包括:
窗口缩放单元,被配置为接收在所述文件展示窗口发生的缩放操作,跟随所述缩放操作改变所述文件展示窗口的显示大小。
在上述实施例的基础上,所述缩放操作为热区操作或多指缩放操作。
在上述实施例的基础上,所述操作装置,还包括:
窗口激活单元,被配置为响应于在所述文件展示窗口发生的窗口激活操作,所述文件展示窗口进入选中状态,所述文件展示窗口在选中状态下覆盖有蒙层,且所有预览控制控件进入禁用状态。
在上述实施例的基础上,所述操作装置,还包括:
文件保存单元,被配置为接收保存白板文件时的窗口保存操作,将所述文件预览数据保存到所述白板文件。
在上述实施例的基础上,所述操作装置,还包括:
最大化显示单元,被配置为接收对所述文件展示窗口的最大化操作,将所述文件展示窗口中展示的文件最大化显示;
窗口批注单元,被配置为在所述最大化显示的文件上执行批注操作;
其中,所述最大化显示的文件覆盖所述白板应用界面。
本发明实施例提供的智能交互平板的操作装置包含在智能交互平板的操作设备中,且可用于执行上述实施例一和实施例二中提供的任一智能交互平板的操作方法,具备相应的功能和有益效果。
实施例五
图10为本发明实施例五提供的一种智能交互平板的操作装置的结构示意图。参考图10,该智能交互平板的操作装置包括:触控监听单元501、指令判断单元502、窗口显示单元503和轨迹显示单元504。
其中,触控监听单元501,被配置为监听白板应用界面的触控操作指令;指令判断单元502,被配置为判断所述触控操作指令的类型;窗口显示单元503,被配置为当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件;轨迹显示单元504,被配置为当判断所述触 控操作指令为书写操作指令,在所述白板应用界面生成所述书写操作指令对应生成的书写轨迹。
在上述实施例的基础上,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作指令选中的文件的文件类型对应。
在上述实施例的基础上,所述在所述白板应用界面之上添加文件展示窗口,包括:
当所述白板应用界面当前不存在文件展示窗口,在所述白板应用界面添加置顶图层,在所述置顶图层绘制文件展示窗口;
当所述白板应用界面当前存在文件展示窗口,在所述置顶图层绘制新增文件展示窗口。
在上述实施例的基础上,所述书写轨迹显示于原始图层,所述原始图层与所述置顶图层的触控事件互相隔离。
在上述实施例的基础上,所述操作装置,还包括:
截图显示单元,被配置为检测到所述文件展示窗口中的截图操作时,将所述文件展示窗口中的显示内容截图保存到截图缓存区,将所述截图缓存区中最新添加的截图数据显示到所述原始图层的预设区域。
在上述实施例的基础上,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,包括:
若所述文件展示操作指令选中的文件为文档文件,读取所述文档文件并按页顺序截图得到至少一张图片数据,将所述图片数据按截图顺序组织得到文件预览数据并保存到预设的展示文件夹;
若所述文件展示操作指令选中的文件为网页文件,读取所述网页文件的原始网址,访问所述原始网址获得对应的网页页面数据得到文件预览数据,并将所述原始网址保存到预设的展示文件夹;
若所述文件展示操作指令选中的文件为音视频文件,将所述音视频文件备份复制得到文件预览数据并保存到预设的展示文件夹。
在上述实施例的基础上,所述文件类型为文档文件时,对应的预览控制控件包括翻页控件;
操作装置,还包括:
翻页显示单元,被配置为文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操作,按截图顺序对应改变所述文档文件在所述文件展示窗口中的当前图片数据。
在上述实施例的基础上,所述操作装置,还包括:
数据保存单元,被配置为在保存白板文件时检测到窗口保存操作时,将所述展示文件夹中的文件预览数据保存到所述白板文件。
在上述实施例的基础上,所述操作装置,还包括:
数据删除单元,被配置为关闭所述白板应用界面时,删除所述展示文件夹中的文件预览数据。
在上述实施例的基础上,所述指令判断单元502,包括:
第一判断模块,被配置为在所述白板应用界面的工具栏中监听到触发文件展示控件的触控事件,且在响应于触发所述文件展示控件弹出的文件列表界面中监听到选择至少一个文件的触控事件,则判断触控操作指令为文件展示操作指令,所述文件列表界面中选择的文件为所述文件展示操作指令选中的文件;
第二判断模块,被配置为在所述白板应用界面监听到触摸点连续移动的触控事件,则判 断触控操作指令为书写操作指令。
本发明实施例提供的智能交互平板的操作装置包含在智能交互平板的操作设备中,且可用于执行上述实施例三中提供的任一智能交互平板的操作方法,具备相应的功能和有益效果。
值得注意的是,上述智能交互平板的操作装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。
实施例六
图11为本发明实施例六提供的一种终端设备的结构示意图,该终端设备是前文所述智能交互平板的操作设备的一种硬件呈现方案。如图11所示,该终端设备包括处理器610、存储器620、输入装置630、输出装置640以及通信装置650;终端设备中处理器610的数量可以是一个或多个,图11中以一个处理器610为例;终端设备中的处理器610、存储器620、输入装置630、输出装置640以及通信装置650可以通过总线或其他方式连接,图11中以通过总线连接为例。
存储器620作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本发明实施例中的智能交互平板的操作方法对应的程序指令/模块(例如,智能交互平板的操作装置中的触控监听单元501、指令判断单元502、窗口显示单元503和轨迹显示单元504)。处理器610通过运行存储在存储器620中的软件程序、指令以及模块,从而执行终端设备的各种功能应用以及数据处理,即实现上述的智能交互平板的操作方法。
存储器620可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作***、至少一个功能所需的应用程序;存储数据区可存储根据终端设备的使用所创建的数据等。此外,存储器620可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器620可包括相对于处理器610远程设置的存储器,这些远程存储器可以通过网络连接至终端设备。上述网络的实例可以包括互联网、企业内部网、局域网、移动通信网及其组合。
输入装置630可用于接收输入的数字或字符信息,以及产生与终端设备的用户设置以及功能控制有关的键信号输入。输出装置640可包括显示屏等显示设备。
上述终端设备包含智能交互平板的操作装置,可以用于执行任意智能交互平板的操作方法,具备相应的功能和有益效果。
实施例七
本发明实施例还提供一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行本申请任意实施例中提供的智能交互平板的操作方法中的相关操作,且具备相应的功能和有益效果。
本领域内的技术人员应明白,本申请的实施例可提供为方法、***、或计算机程序产品。
因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(可以包括磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。本申请是参照根据本申请实施例的方法、设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。这些计算 机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子可以包括,相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。

Claims (33)

  1. 一种智能交互平板的操作方法,包括:
    接收在白板应用界面发生的文件展示操作;
    开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;
    接收在所述白板应用界面发生的书写操作;
    根据所述书写操作,在所述白板应用界面生成书写轨迹。
  2. 根据权利要求1所述的操作方法,其中,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作选中的文件的文件类型对应。
  3. 根据权利要求2所述的操作方法,其中,所述文件类型为文档文件时,所述预览控制控件包括翻页控件;
    所述文件展示窗口展示的是文档文件时,所述操作方法还包括以下步骤:
    接收对所述翻页控件的触摸点击操作,改变所述文档文件在所述文件展示窗口中的当前显示页面。
  4. 根据权利要求2所述的操作方法,其中,所述预览控制控件包括截图控件;
    所述操作方法还包括:
    接收对所述截图控件的触摸点击操作,将所述文件展示窗口中当前显示的画面截图显示到所述白板应用界面中。
  5. 根据权利要求2所述的操作方法,其中,所述文件展示操作选中的文件为文档文件时,所述文件预览数据为从所述文档文件中按页顺序截图生成的图片数据;
    所述文件展示操作选中的文件为网页文件时,所述文件预览数据为访问所述网页文件的原始网页得到的网页页面。
  6. 根据权利要求1所述的操作方法,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,所述操作方法还包括:
    接收在所述白板应用界面中发生的显示调整操作,改变所述白板应用界面中显示层级低于所述文件展示窗口的显示元素的显示位置,并保持所述文件展示窗口的显示位置。
  7. 根据权利要求1所述的操作方法,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,所述操作方法还包括:
    接收在所述白板应用界面中发生的页面增加操作,在所述白板应用界面中新增空白页面并保持所述文件展示窗口显示在空白页面之上,所述空白页面覆盖已有页面进行显示。
  8. 根据权利要求1所述的操作方法,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,所述操作方法还包括:
    接收在所述文件展示窗口发生的移动操作,跟随移动所述文件展示窗口的显示位置。
  9. 根据权利要求8所述的操作方法,其中,当所述文件展示窗口的边界移动到白板应用界面的设定边界之外,在所述移动操作结束后,将所述文件展示窗口恢复到所述白板应用界面内显示。
  10. 根据权利要求1所述的操作方法,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,所述操作方法还包括:
    接收在所述文件展示窗口发生的缩放操作,跟随所述缩放操作改变所述文件展示窗口的显示大小。
  11. 根据权利要求10所述的操作方法,其中,所述缩放操作为热区操作或多指缩放操作。
  12. 根据权利要求1所述的操作方法,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,所述操作方法还包括:
    响应于在所述文件展示窗口发生的窗口激活操作,所述文件展示窗口进入选中状态,所述文件展示窗口在选中状态下覆盖有蒙层,且所有预览控制控件进入禁用状态。
  13. 根据权利要求1所述的操作方法,所述开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上之后,所述操作方法还包括:
    接收保存白板文件时的窗口保存操作,将所述文件预览数据保存到所述白板文件。
  14. 根据权利要求2所述的操作方法,所述操作方法还包括:
    接收对所述文件展示窗口的最大化操作,将所述文件展示窗口中展示的文件最大化显示;
    在所述最大化显示的文件上执行批注操作;
    其中,所述最大化显示的文件覆盖所述白板应用界面。
  15. 一种智能交互平板的操作方法,其中,包括:
    监听对白板应用界面的触控操作指令;
    判断所述触控操作指令的类型;
    当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件;
    当判断所述触控操作指令为书写操作指令,在所述白板应用界面生成所述书写操作指令对应生成的书写轨迹。
  16. 根据权利要求15所述的操作方法,其中,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作指令选中的文件的文件类型对应。
  17. 根据权利要求15或16所述的操作方法,其中,所述在所述白板应用界面之上添加文件展示窗口,包括:
    当所述白板应用界面当前不存在文件展示窗口,在所述白板应用界面添加置顶图层,在所述置顶图层绘制文件展示窗口;
    当所述白板应用界面当前存在文件展示窗口,在所述置顶图层绘制新增文件展示窗口。
  18. 根据权利要求17所述的操作方法,其中,所述书写轨迹显示于原始图层,所述原始图层与所述置顶图层的触控事件互相隔离。
  19. 根据权利要求18所述的操作方法,所述操作方法还包括:
    检测到所述文件展示窗口中的截图操作时,将所述文件展示窗口中的显示内容截图保存到截图缓存区,将所述截图缓存区中最新添加的截图数据显示到所述原始图层的预设区域。
  20. 根据权利要求16所述的操作方法,其中,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,包括:
    若所述文件展示操作指令选中的文件为文档文件,读取所述文档文件并按页顺序截图得到至少一张图片数据,将所述图片数据按截图顺序组织得到文件预览数据并保存到预设的展示文件夹;
    若所述文件展示操作指令选中的文件为网页文件,读取所述网页文件的原始网址,访问 所述原始网址获得对应的网页页面数据得到文件预览数据,并将所述原始网址保存到预设的展示文件夹;
    若所述文件展示操作指令选中的文件为音视频文件,将所述音视频文件备份复制得到文件预览数据并保存到预设的展示文件夹。
  21. 根据权利要求20所述的操作方法,其中,所述文件类型为文档文件时,对应的预览控制控件包括翻页控件;
    所述当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件之后,还包括:
    所述文件展示窗口展示的是文档文件时,接收对所述翻页控件的触摸点击操作,按截图顺序对应改变所述文档文件在所述文件展示窗口中的当前图片数据。
  22. 根据权利要求20所述的操作方法,所述操作方法还包括:
    在保存白板文件时检测到窗口保存操作时,将所述展示文件夹中的文件预览数据保存到所述白板文件。
  23. 根据权利要求20所述的操作方法,所述操作方法还包括:
    关闭所述白板应用界面时,删除所述展示文件夹中的文件预览数据。
  24. 根据权利要求16所述的操作方法,其中,所述判断所述触控操作指令的类型,包括:
    在所述白板应用界面的工具栏中监听到触发文件展示控件的触控事件,且在响应于触发所述文件展示控件弹出的文件列表界面中监听到选择至少一个文件的触控事件,则判断触控操作指令为文件展示操作指令,所述文件列表界面中选择的文件为所述文件展示操作指令选中的文件;
    在所述白板应用界面监听到触摸点连续移动的触控事件,则判断触控操作指令为书写操作指令。
  25. 一种智能交互平板的操作装置,包括:
    窗口添加单元,被配置为接收在白板应用界面发生的文件展示操作;
    文件显示单元,被配置为开启文件展示窗口,在所述文件展示窗口中显示根据所述文件展示操作选中的文件,所述文件展示窗口置于所述白板应用界面之上;
    书写接收单元,被配置为接收在所述白板应用界面发生的书写操作;
    书写显示单元,被配置为根据所述书写操作,在所述白板应用界面生成书写轨迹。
  26. 根据权利要求25所述的操作装置,所述操作装置还包括:
    显示调整单元,被配置为接收在所述白板应用界面中发生的显示调整操作,改变所述白板应用界面中显示层级低于所述文件展示窗口的显示元素的显示位置,并保持所述文件展示窗口的显示位置。
  27. 根据权利要求25所述的操作装置,所述操作装置还包括:
    页面增加单元,被配置为接收在所述白板应用界面中发生的页面增加操作,在所述白板应用界面中新增空白页面并保持所述文件展示窗口置顶显示,所述空白页面覆盖已有页面进行显示。
  28. 一种智能交互平板的操作装置,包括:
    触控监听单元,被配置为监听白板应用界面的触控操作指令;
    指令判断单元,被配置为判断所述触控操作指令的类型;
    窗口显示单元,被配置为当判断所述触控操作指令为文件展示操作指令,在所述白板应用界面之上添加文件展示窗口,在所述文件展示窗口显示所述文件展示操作指令选中的文件;
    轨迹显示单元,被配置为当判断所述触控操作指令为书写操作指令,在所述白板应用界 面生成所述书写操作指令对应生成的书写轨迹。
  29. 根据权利要求28所述的操作装置,其中,所述文件展示窗口显示的内容包括文件预览数据和预览控制控件,所述文件预览数据根据所述文件展示操作指令选中的文件及其文件类型对应生成,所述预览控制控件与所述文件展示操作指令选中的文件的文件类型对应。
  30. 根据权利要求28或29所述的操作装置,其中,所述在所述白板应用界面之上添加文件展示窗口,包括:
    当所述白板应用界面当前不存在文件展示窗口,在所述白板应用界面添加置顶图层,在所述置顶图层绘制文件展示窗口;
    当所述白板应用界面当前存在文件展示窗口,在所述置顶图层绘制新增文件展示窗口。
  31. 根据权利要求30所述的操作装置,其中,所述书写轨迹显示于原始图层,所述原始图层与所述置顶图层的触控事件互相隔离。
  32. 一种终端设备,包括:
    一个或多个处理器;
    存储器,用于存储一个或多个程序;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-24任一所述的智能交互平板的操作方法。
  33. 一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如权利要求1-24任一所述的智能交互平板的操作方法。
PCT/CN2019/119998 2019-10-09 2019-11-21 智能交互平板的操作方法、装置、终端设备和存储介质 WO2021068368A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP19948393.4A EP3982237A4 (en) 2019-10-09 2019-11-21 METHOD AND APPARATUS FOR OPERATING INTELLIGENT INTERACTION TABLET, TERMINAL DEVICE AND INFORMATION HOLDER
JP2021576584A JP7320634B2 (ja) 2019-10-09 2019-11-21 知能インタラクション・タブレットの操作方法、装置、端末機器及び記憶媒体
KR1020217038982A KR102643017B1 (ko) 2019-10-09 2019-11-21 스마트 인터랙티브 태블릿의 조작 방법, 장치, 단말 기기 및 저장 매체
AU2019469487A AU2019469487B2 (en) 2019-10-09 2019-11-21 Method and apparatus for operating intelligent interaction tablet, terminal device, and storage medium
US17/531,787 US11620047B2 (en) 2019-10-09 2021-11-21 Method, apparatus, terminal device, and storage medium for operating interactive white board

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910953579.6 2019-10-09
CN201910953579.6A CN110928460B (zh) 2019-10-09 2019-10-09 智能交互平板的操作方法、装置、终端设备和存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/531,787 Continuation US11620047B2 (en) 2019-10-09 2021-11-21 Method, apparatus, terminal device, and storage medium for operating interactive white board

Publications (1)

Publication Number Publication Date
WO2021068368A1 true WO2021068368A1 (zh) 2021-04-15

Family

ID=69849054

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/119998 WO2021068368A1 (zh) 2019-10-09 2019-11-21 智能交互平板的操作方法、装置、终端设备和存储介质

Country Status (7)

Country Link
US (1) US11620047B2 (zh)
EP (1) EP3982237A4 (zh)
JP (1) JP7320634B2 (zh)
KR (1) KR102643017B1 (zh)
CN (2) CN110928460B (zh)
AU (1) AU2019469487B2 (zh)
WO (1) WO2021068368A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113434064A (zh) * 2021-07-01 2021-09-24 掌阅科技股份有限公司 手写阅读器笔锋切换方法、电子设备和存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112462972A (zh) * 2020-11-25 2021-03-09 广州视源电子科技股份有限公司 白板页面新建方法、装置、交互平板和存储介质
CN113011140A (zh) * 2021-02-10 2021-06-22 北京字跳网络技术有限公司 视图展示方法、装置和电子设备
CN114997116A (zh) * 2021-03-01 2022-09-02 北京字跳网络技术有限公司 一种文档的编辑方法、装置、设备及存储介质
CN113626101B (zh) * 2021-08-04 2024-06-18 深圳市闪联信息技术有限公司 一种无痕退出的电子白板***及其无痕退出方法
CN116601597A (zh) * 2021-12-02 2023-08-15 广州视臻信息科技有限公司 交互实现方法、装置、交互平板及存储介质
CN114610188B (zh) * 2022-02-09 2024-02-13 广东能龙教育股份有限公司 一种界面笔迹书写方法及***、控制装置、存储介质
CN116755594A (zh) * 2023-08-11 2023-09-15 江苏中威科技软件***有限公司 一种基于文件底板的白板的实现装置及方法
CN117591484B (zh) * 2023-11-29 2024-07-09 广东保伦电子股份有限公司 一种白板内容数据的实时存储方法、设备及介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102830966A (zh) * 2012-07-31 2012-12-19 北京奇虎科技有限公司 一种信息展示***及方法
WO2015175589A1 (en) * 2014-05-14 2015-11-19 Microsoft Technology Licensing, Llc Presenting stored files in whiteboard application
CN106462679A (zh) * 2014-05-14 2017-02-22 微软技术许可有限责任公司 从虚拟白板主张数据

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3399401A (en) * 1964-06-29 1968-08-27 Army Usa Digital computer and graphic input system
JPH11327789A (ja) * 1998-03-12 1999-11-30 Ricoh Co Ltd カラー表示装置および電子黒板システム
US7318015B2 (en) * 2001-06-13 2008-01-08 Verizon Business Global Llc Method, system and program product for generating scenarios utilizing graphical objects representing hierarchically arranged elements of a modeled environment
JP2003323387A (ja) 2002-05-02 2003-11-14 Megafusion Corp 情報交換システムおよび情報交換プログラム
US8032482B2 (en) * 2004-09-30 2011-10-04 Microsoft Corporation Method, system, and apparatus for providing a document preview
US20060154227A1 (en) * 2005-01-07 2006-07-13 Rossi Deborah W Electronic classroom
TWI340342B (en) * 2005-05-04 2011-04-11 Era Digital Media Co Interactive multimedia system
KR20080026138A (ko) * 2005-06-02 2008-03-24 폴리 비젼 코포레이션 가상 플립 차트 방법 및 장치
US20080184115A1 (en) * 2007-01-29 2008-07-31 Fuji Xerox Co., Ltd. Design and design methodology for creating an easy-to-use conference room system controller
US9953392B2 (en) * 2007-09-19 2018-04-24 T1V, Inc. Multimedia system and associated methods
WO2012170913A1 (en) 2011-06-08 2012-12-13 Vidyo, Inc. Systems and methods for improved interactive content sharing in video communication systems
US8874657B2 (en) 2012-04-27 2014-10-28 Seiko Epson Corporation Method for securely distributing meeting data from interactive whiteboard projector
US9116596B2 (en) 2012-06-10 2015-08-25 Apple Inc. Sharing images and comments across different devices
JP6323986B2 (ja) * 2012-06-26 2018-05-16 シャープ株式会社 画像表示装置、それを含む画像表示システム、及びその制御方法
JP6070116B2 (ja) 2012-11-28 2017-02-01 株式会社リコー 画像処理装置、画像処理システム、画像処理方法及びプログラム
CN103077026A (zh) * 2012-12-28 2013-05-01 锐达互动科技股份有限公司 一种在操作***的桌面环境下进行书写的方法
CN103176741A (zh) * 2013-03-20 2013-06-26 广东国笔科技股份有限公司 人机交互的方法、终端和***
CN103309971A (zh) * 2013-06-08 2013-09-18 福州新锐同创电子科技有限公司 一种不同类型文件同屏预览的实现方法
CN104424237A (zh) * 2013-08-27 2015-03-18 鸿合科技有限公司 白板教学***附件预览方法及其白板教学***
US20150100552A1 (en) * 2013-10-07 2015-04-09 QQ Solutions Inc. Managing non-committed computerized workflows
JP6678375B2 (ja) 2013-11-18 2020-04-08 東京エレクトロン株式会社 情報処理装置、情報処理方法、および情報処理システム
KR20150126494A (ko) * 2014-05-02 2015-11-12 엘지전자 주식회사 이동 단말기 및 그 제어 방법
KR102298972B1 (ko) * 2014-10-21 2021-09-07 삼성전자 주식회사 전자 장치의 엣지에서 수행되는 제스처를 기반으로 하는 동작 수행
CN105808036A (zh) 2014-12-29 2016-07-27 鸿合科技有限公司 一种电子白板软件的资源快速交互方法和装置
GB2536275A (en) * 2015-03-12 2016-09-14 Kurt Isserstedt Robert Label apparatus
JP6290143B2 (ja) 2015-07-30 2018-03-07 シャープ株式会社 情報処理装置、情報処理プログラムおよび情報処理方法
CN105955802B (zh) * 2016-04-21 2020-06-12 青岛海信移动通信技术股份有限公司 一种移动终端的应用运行方法及移动终端
CN106126236B (zh) * 2016-06-24 2019-08-20 北京奇虎科技有限公司 终端屏幕的分屏显示方法、装置及终端
CN105933779A (zh) * 2016-06-27 2016-09-07 北京奇虎科技有限公司 利用寄生工具包实现的视频播放方法及装置
JP6668980B2 (ja) 2016-07-04 2020-03-18 富士通株式会社 送信制御プログラム、送信制御方法および情報処理装置
US10848483B2 (en) * 2016-12-08 2020-11-24 Ricoh Company, Ltd. Shared terminal, communication system, and display control method, and recording medium
CN106980441A (zh) * 2017-03-29 2017-07-25 杭州弗凡科技有限公司 车载导航终端的悬浮窗***互方法及车载导航终端
CN107315828A (zh) * 2017-07-05 2017-11-03 广州阿里巴巴文学信息技术有限公司 数据处理方法、装置和终端设备
JP2019117571A (ja) 2017-12-27 2019-07-18 シャープ株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
CN110058755A (zh) * 2019-04-15 2019-07-26 广州视源电子科技股份有限公司 一种演示文稿交互的方法、装置、终端设备和存储介质

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102830966A (zh) * 2012-07-31 2012-12-19 北京奇虎科技有限公司 一种信息展示***及方法
WO2015175589A1 (en) * 2014-05-14 2015-11-19 Microsoft Technology Licensing, Llc Presenting stored files in whiteboard application
CN106462679A (zh) * 2014-05-14 2017-02-22 微软技术许可有限责任公司 从虚拟白板主张数据

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"How to insert documents in whiteboards", 12 May 2019 (2019-05-12), XP009527349, Retrieved from the Internet <URL:https://jingyan.***.com/article/77b8dc7f5130eb6174eab6ea.html> *
See also references of EP3982237A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113434064A (zh) * 2021-07-01 2021-09-24 掌阅科技股份有限公司 手写阅读器笔锋切换方法、电子设备和存储介质

Also Published As

Publication number Publication date
EP3982237A1 (en) 2022-04-13
CN114217726A (zh) 2022-03-22
JP2022539335A (ja) 2022-09-08
EP3982237A4 (en) 2022-11-09
CN110928460A (zh) 2020-03-27
KR102643017B1 (ko) 2024-02-29
CN110928460B (zh) 2021-12-03
AU2019469487B2 (en) 2023-08-10
US20220083215A1 (en) 2022-03-17
AU2019469487A1 (en) 2022-02-10
KR20220002584A (ko) 2022-01-06
JP7320634B2 (ja) 2023-08-03
US11620047B2 (en) 2023-04-04
CN114217726B (zh) 2024-06-18

Similar Documents

Publication Publication Date Title
US11620047B2 (en) Method, apparatus, terminal device, and storage medium for operating interactive white board
CN110928468B (zh) 智能交互平板的页面显示方法、装置、设备和存储介质
WO2021218203A1 (zh) 智能交互平板的页面编辑方法、装置、设备和存储介质
WO2021068366A1 (zh) 智能交互平板的书写操作方法、装置、设备和存储介质
JP7345052B2 (ja) 知能インタラクティブパネルの制御方法及びその装置
CN111813302B (zh) 投屏显示方法、装置、终端设备和存储介质
WO2021068365A1 (zh) 智能交互平板的页面交互方法、装置、设备和存储介质
WO2020211368A1 (zh) 一种演示文稿交互的方法、装置、终端设备和存储介质
WO2021068412A1 (zh) 智能交互平板的交互方法、装置、终端设备和存储介质
CN110941382B (zh) 智能交互平板的显示操作方法、装置、设备和存储介质
CN111338538A (zh) 智能交互平板的页面操作方法、装置、设备和存储介质
WO2021258917A1 (zh) 智能交互方法及设备、存储介质
TWI485616B (zh) 記錄軌跡的方法及電子裝置
CN111580713B (zh) 一种显示交互***
WO2021068405A1 (zh) 元素传递方法、装置、设备及存储介质
WO2021068382A1 (zh) 多窗口操作控制方法、装置、设备及存储介质
JP6209868B2 (ja) 情報端末、情報処理プログラム、情報処理システム、及び情報処理方法
CN112462972A (zh) 白板页面新建方法、装置、交互平板和存储介质
WO2024040551A1 (zh) 墨水屏书写笔记编辑方法、终端设备和存储介质
TW201319912A (zh) 觸控簡報系統及其執行方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19948393

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20217038982

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2021576584

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2019948393

Country of ref document: EP

Effective date: 20220105

NENP Non-entry into the national phase

Ref country code: DE