WO2019105191A1 - 多元素交互方法、装置、设备和存储介质 - Google Patents

多元素交互方法、装置、设备和存储介质 Download PDF

Info

Publication number
WO2019105191A1
WO2019105191A1 PCT/CN2018/114337 CN2018114337W WO2019105191A1 WO 2019105191 A1 WO2019105191 A1 WO 2019105191A1 CN 2018114337 W CN2018114337 W CN 2018114337W WO 2019105191 A1 WO2019105191 A1 WO 2019105191A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
target
drag
target element
current
Prior art date
Application number
PCT/CN2018/114337
Other languages
English (en)
French (fr)
Inventor
刘少杰
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019105191A1 publication Critical patent/WO2019105191A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/957—Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents

Definitions

  • the present application relates to interactive technologies, for example, to a multi-element interaction method, apparatus, device, and storage medium.
  • the unit of rendering and event snooping in the browser is the Document Object Model (DOM) element, and the boundaries of any standard element are rectangles, when the interaction occurs outside the irregular element and When the DOM element is inside the bounding rectangle, and the user interaction event penetrates the element to directly interact with the lower layer element, in the process of implementing the present application, the inventor finds that at least the following situation exists in the related art: the browser DOM element event monitoring meeting Block the interaction, causing the underlying elements to fail to respond.
  • DOM Document Object Model
  • the multimedia video is rendered with the DOM element alone, but this brings another drawback. Since the multimedia video is rendered by the DOM element alone, the element must be located at all levels of the scalable vector. Above or below the Scalable Vector Graphics (SVG) sub-element, when the demand is that the hierarchical position of the video element is not topped or bottomed, the requirements are not met.
  • SVG Scalable Vector Graphics
  • the embodiment of the present application provides a multi-element interaction method, device, device, and storage medium.
  • the defect that only the rule element can be used and the lower layer element are not responded are avoided, and multiple elements are guaranteed. Normal interaction.
  • the embodiment of the present application provides a multi-element interaction method, the method includes: determining, in response to detecting that the current operation object is at least two elements having coincidence at a logical boundary, determining that the click operation is in the current operation object a position, whether it is in an active area of the element; in response to determining that the position of the click operation in the current operation object is in an active area of the element, determining a target element corresponding to the activation area according to the activation area; Setting a condition and controlling an operation of the target element to change a display state of the target element according to an editing instruction corresponding to the operation; wherein an active area of the element includes a boundary line of the element and An enclosed area formed by the boundary line, the logical boundary being a rectangular boundary displayed when the element is in a selected state.
  • the embodiment of the present application further provides a multi-element interaction device, where the device includes: a judging module, configured to determine that the click operation is performed if it is detected that the current operation object has at least two elements that overlap in the logical boundary.
  • the determining module is configured to determine the target corresponding to the activation area according to the activation area when the position of the click operation in the current operation object is in the active area of the element An element; a response module configured to, in response to satisfying a set condition and an operation for the target element, controlling the target element to change a display state of the target element according to an edit instruction corresponding to the operation; wherein, the element
  • the active area includes a boundary line of the element and a closed area formed by the boundary line, the logical boundary being a rectangular boundary displayed when the element is in a selected state.
  • the embodiment of the present application further provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor implements the program as implemented in the present application.
  • a computer device including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor implements the program as implemented in the present application.
  • the embodiment of the present application further provides a computer readable storage medium, where the computer program is stored, and the program is executed by the processor to implement the multi-element interaction method according to any one of the embodiments of the present application.
  • FIG. 1a is a flowchart of a multi-element interaction method in Embodiment 1 of the present application
  • FIG. 1b is a schematic diagram of hierarchical occlusion during rendering according to Embodiment 1 of the present application.
  • 1c is a schematic diagram of an elemental logical boundary when a relative position between elements is applied in the first embodiment of the present application
  • FIG. 1d is a schematic diagram of an element interaction process after using the solution in the first embodiment of the present application
  • FIG. 2a is a flowchart of a multi-element interaction method in Embodiment 2 of the present application.
  • 2b is a schematic diagram of determining a target element when a plurality of elements are applied in the second embodiment of the present application
  • FIG. 3a is a flowchart of a multi-element interaction method in Embodiment 3 of the present application.
  • FIG. 3b is a display diagram of a plurality of elements applicable in the non-operation state in the third embodiment of the present application.
  • 3c is a schematic diagram of the lower layer element being unoccluded after applying the scheme in the multi-element interaction applicable in the third embodiment of the present application;
  • FIG. 3d is a schematic diagram of determining multiple selection regions in a multiple selection mode applicable in Embodiment 3 of the present application;
  • FIG. 4 is a schematic structural diagram of a multi-element interaction apparatus in Embodiment 4 of the present application.
  • FIG. 5 is a schematic structural diagram of a computer device according to Embodiment 5 of the present application.
  • FIG. 1 is a flowchart of a multi-element interaction method according to Embodiment 1 of the present application.
  • the present embodiment is applicable to a multi-element interaction in a scenario of a browser, and the method may be a multi-element provided by the embodiment of the present application.
  • the interaction device is implemented, and the device can be implemented in at least one of software and hardware. Referring to FIG. 1a, the method may include step S110, step S120 and step S130.
  • step S110 if it is detected that the current operation object is at least two elements that overlap in the logical boundary, it is determined whether the position of the click operation in the current operation object is in the active area of the element, if the click operation is in the If the location in the current operation object is in the active area of the element, step S120 is performed.
  • the element refers to any display content, including pictures, text, multimedia audio and video, planar geometry and solid geometry, and the rule element refers to an element whose boundary is a rectangle.
  • the irregular element means that the boundary of the element is other than a rectangle.
  • the browser environment can refer to software such as Google Chrome (Sam), Safari, Firefox, IE, and Edge that can display markup language files.
  • multiple irregular elements of a multi-level, complex interactive scene may be elements such as shapes in a browser-based presentation (PowerPoint).
  • the active area of the element includes a boundary line of the element and a closed area formed by the boundary line, by acquiring a first coordinate position of the click operation in the current operation object, and the first coordinate The position is compared with the second coordinate position of the active area in the current display page. If the first coordinate position is located in the area range determined by the second coordinate position, it indicates that the position of the click operation in the current operation object is in the activation of the element. region.
  • the logical boundary is a rectangular boundary that is displayed when the element is in the selected state.
  • the coordinates of each element in the currently displayed page can be obtained separately, and the coincidence of the logical boundaries means that the coordinate ranges of the rectangular boundaries displayed by at least two elements in the selected state have coincidence.
  • the coordinate range of the logical boundary may be determined by determining the coordinates of the four vertices of the rectangular boundary displayed when the element is in the selected state.
  • the active area of the element includes a boundary line of the element and a closed area formed by the boundary line.
  • the active area of the triangular element includes three sides of a triangle and a closed triangle area formed by three sides.
  • the rendering boundary refers to the size of the rendered canvas, and the logical boundary is the rectangular boundary that is displayed when the element is in the selected state.
  • FIG. 1b shows a schematic diagram of hierarchical occlusion during rendering
  • 140 is a rectangular boundary of rectangle 1
  • 150 is a rectangular boundary of a right triangle 2
  • 160 is a rectangular boundary of an obtuse triangle 3, wherein a rectangular boundary 140.
  • the rectangular boundary 150 and the rectangular boundary 160 are unique attributes belonging to the element itself, and the rectangular boundary is not visible during the user's operation on the element and the interaction of the multiple elements.
  • the logical boundary is used for the display and actual storage of the handle, and the active boundary is the boundary of the element.
  • the activation boundaries are four sides of a rectangle 1, three sides of a right triangle 2, and three sides of an obtuse triangle 3, respectively.
  • Figure 1c shows a schematic diagram of the logical boundaries of the elements when the relative positions between the elements overlap.
  • Figure 1c is taken as an example to illustrate the specific meaning of the logical boundaries of the elements.
  • 170 is the logical boundary of the right triangle 4
  • 171 is the rendering boundary, that is, the size of the canvas actually rendered.
  • Figure 1d shows a schematic diagram of the element interaction process after using the scheme
  • 180 is the logical boundary of the rectangle 7
  • 181 is the rendering boundary.
  • the right triangle can be clicked. Point B at the blank directly operates on the rectangle 7 without being obscured by the right triangle 6.
  • step S120 a target element corresponding to the activation area is determined according to the activation area.
  • each element in Figure 1b is drawn by a single SVG, where there are three SVGs, respectively. Among them, three SVGs are respectively labeled with their corresponding elements (rectangle 1, right triangle 2 and obtuse triangle 3), and the hierarchical relationship of the three is: obtuse triangle 3> right triangle 2> rectangle 1, ie obtuse triangle 3 is placed at the most Top level.
  • the coincident region of the three is only obtuse triangle 3 visible but the user clicks point A, the user's demand is to activate the right triangle 2. If it is a DOM event, since the obtuse triangle 3 is at the topmost level, the obtuse triangle 3 is activated at this time, that is, unnecessary occlusion is generated.
  • the manner of determining the target element corresponding to the activation area may be obtained by querying the activation area and the corresponding list of elements, where the correspondence between the activation area and the element is stored. It is also possible to extract a boundary line in the active area and determine the target element according to the boundary line of the active area.
  • step S130 in response to the operation of satisfying the setting condition and for the operation of the target element, the target element is controlled to change the display state of the target element according to an editing instruction corresponding to the operation.
  • the operations include click, drag, zoom, rotate, and element customization.
  • the set condition may be that the target element is dragged from the point M to the point N, or the target element is rotated counterclockwise by 150 degrees or the like.
  • the zoom operation the corresponding edit command may be when the user right-clicks the target element, pops up the corresponding menu option, clicks “zoom” in the option, and specifically can add different fields by adding different fields to different operations.
  • the operation adds the corresponding function.
  • the specific operation is associated with the editing instruction, and the display state of the target element is changed according to the editing instruction, wherein the display state includes a rotation display and a drag display.
  • the position of the click operation in the current operation object is determined to be in an active area of the element; Determining, according to the activation area, a target element corresponding to the activation area; in response to satisfying a set condition and an operation for the target element, controlling the target element to change a display of the target element according to an edit instruction corresponding to the operation status.
  • the DOM element in the related scheme to render, only the rule elements such as text, image, multimedia audio and video, hyperlink, etc., and the interaction time of the blank area of the irregular element can be blocked and cannot penetrate to the lower layer.
  • FIG. 2a is a flowchart of a multi-element interaction method according to Embodiment 2 of the present application. On the basis of the foregoing embodiment, this embodiment performs "determining a target element corresponding to the activation area according to the activation area". Adjustment. Referring to FIG. 2a, the method may include steps S210 to S240.
  • step S210 if it is detected that the current operation object is at least two elements having overlapping logical boundaries, it is determined whether the corresponding position of the click operation in the current operation object is in an active area of the element, if the click operation is in the If the location in the current operation object is in the active area of the element, step S220 is performed.
  • step S220 an identification code of an element in the activation area is acquired according to the click operation.
  • an identification code of an element in an activation area is obtained according to a click operation, wherein each element corresponds to an identification code, and an element can be uniquely determined according to the identification code.
  • the identification code can be at least one of a number, a letter, and a symbol.
  • An activation code for multiple elements is stored in local storage or cloud storage.
  • the activation code of the plurality of elements is associated with the location of the click operation in the current display page, and the location code of the activation area is clicked to obtain the identification code of the corresponding element of the click operation in the active area.
  • step S230 the identification code of the element in the activation area is matched with the identification code in the pre-stored element list to determine the target element corresponding to the click operation.
  • the one-to-one correspondence between the element and the identification code is stored in the pre-stored element list.
  • one of the two parameters is known to obtain another parameter.
  • the search may be performed from the list of pre-stored elements, and the element corresponding to the identification code in the pre-stored element list is the target element.
  • FIG. 2b shows a schematic diagram when a plurality of elements interact to determine a target element.
  • the level of the rectangle 11 is located above the rectangle 8, the right triangle 9, the obtuse triangle 10, and is not filled at the center of the click rectangle 11.
  • the target element is a right-angled triangle 9, which can directly interact with the lower-angled right-angled triangle 9.
  • step S240 in response to the operation of satisfying the setting condition and for the operation of the target element, the target element is controlled to change the display state of the target element according to an editing instruction corresponding to the operation.
  • the identification code of the element in the activation area is obtained according to the clicking operation, and the identification code of the element is matched with the identification code in the pre-stored element list to determine the target element corresponding to the click operation. .
  • the target element is determined by the uniqueness of the element's identification code.
  • determining the target element corresponding to the activation area according to the activation area may also be implemented by: in response to detecting that a multi-selection instruction is generated during the occurrence of the click operation, And determining, by the matching code in the pre-stored element list, the identification code of the plurality of elements corresponding to the plurality of click operations in the time range of the multiple-selection instruction to determine the target element corresponding to the multiple click operations .
  • the set multi-selection command includes pressing the shift key on the keyboard during the click operation, or clicking a multi-select button or symbol on the touch screen to generate.
  • a multi-selection instruction is generated during the occurrence of the click operation, matching the identification code of the plurality of elements corresponding to the plurality of click operations within the time range of the multiple-selection instruction with the identification code in the pre-stored element list To determine the target element determined by multiple click actions.
  • the order of the generation time of the multi-selection instruction and the occurrence time of the click operation is not specifically limited, and may be generated by the click operation and the multi-selection instruction simultaneously, or the multi-selection instruction is generated in the process of the click operation, and is realized. Other operations such as selecting multiple elements at the same time.
  • FIG. 3 is a flowchart of a multi-element interaction method according to Embodiment 3 of the present application.
  • the thinning is performed to "change the display state of the target element according to the editing instruction corresponding to the operation in response to the operation of the target element and the operation of the target element".
  • the method may include steps S310 through S340.
  • step S310 when the current operation object is at least two elements having coincidence at the logical boundary, determining whether the position of the click operation in the current operation object is in an active area of the element, if the click operation is in the If the position in the current operation object is in the active area of the element, step S320 is performed.
  • step S320 a target element corresponding to the activation area is determined according to the activation area.
  • step S330 the drag device is used as the target point of the identifier displayed on the current page at the end of the drag operation.
  • the drag device refers to a component that can implement a drag function, such as a mouse, a stylus, or a finger.
  • the draggable device has a corresponding identifier on the current display page, such as a mouse displayed on the current page as a hollow arrow style, a stylus or a finger displayed on the current page as a stylus.
  • an identifier representing the drag operation appears on the currently displayed page, and the position of the identifier in the currently displayed page is continuously moved following the drag operation.
  • the end of the drag operation is detected, the position of the identifier displayed on the current page at this time is acquired as the target point.
  • the drag operation can be considered complete by detecting that the location of the identifier remains constant for a set time period.
  • the set time range can be more than 3 seconds.
  • the position can be obtained by the identifier on the horizontal and vertical coordinates of the currently displayed page.
  • step S340 in response to the drag operation from the drag start point of the position in the current operation object of the click operation to the target point, controlling the target element to correspond according to the drag operation
  • the edit instruction changes the display state of the target element.
  • the drag operation includes dragging the start point, dragging the path, and dragging the end point
  • the position of the click operation in the current operation object is the drag start point
  • the target point mentioned above is used as the drag end point to obtain the drag start point respectively.
  • the drag path is not specifically limited.
  • the trailing path can be pre-planned or randomly selected during the dragging process.
  • the target element can be dragged according to the line information; or there is no specific dragging path, if the subsequent dragging path needs to be analyzed, then in the dragging process
  • the coordinates of the points in the trajectory of the target element moving in the current display page during the dragging process are obtained in real time, and the trajectory curve corresponding to the dragging path is generated according to each coordinate, so as to analyze the dragging path.
  • the drag operation that moves to the target point in response to a drag start point of a position in the current operation object from the click operation.
  • the target element is controlled to change a display state according to an edit instruction corresponding to the operation.
  • the target element is controlled to respond from the click operation to the current operation object by using the position of the identifier displayed on the current page as the target point at the end of the drag operation.
  • the drag start point of the position moves to the target point in response to the drag operation. After the target point is determined, the dragging operation on the target element is realized.
  • controlling the target element according to the drag operation in response to moving from a drag start point of a position in the current operation object to the target point of the click operation
  • controlling the target element in response to moving from a drag start point of a position in the current operation object to the target point of the click operation
  • controlling the target element in response to moving from a drag start point of a position in the current operation object to the target point of the click operation
  • controlling the target element in response to moving from a drag start point of a position in the current operation object to the target point of the click operation
  • controlling the target element In the step of changing the display state of the target element by the editing instruction corresponding to the drag operation, when it is detected that the display identifier corresponding to the drag device is outside the current page display area, controlling the target element to maintain the current position With the display status.
  • the partial area belongs to the area outside the current display area.
  • taking the currently displayed page as a browser page as an example that is, taking a multi-element interaction under the browser as an example.
  • the display identifier corresponding to the drag device is detected to be 60%.
  • the browser displays outside the area it indicates that the drag operation has not been responded at this time, and the target element is kept at the current position and display state.
  • the current position and display state include a positional relationship and a hierarchical relationship with other elements of the target element, and the like. The embodiment can prevent the user from performing an invalid drag operation outside the currently displayed page, and only responds to the effective drag operation, thereby improving the efficiency of the interaction between the target elements or between the target element and other display backgrounds.
  • the coordinates of the boundary line between the current display page and the device screen display size may also be obtained.
  • the boundary line includes an upper boundary boundary line, a lower boundary boundary line, a left boundary boundary line, and a right boundary boundary line.
  • the device screen horizontally to the right is the X-axis positive direction
  • the device screen horizontally to the left is the X-axis negative direction
  • the device screen is vertically upward for the Y-axis positive direction
  • the device screen is vertically downward for the Y-axis negative direction. direction.
  • the area of the ordinate of the boundary line is the area outside the current page display area. Determining the display area of the current page does not respond to operations outside the display area, improving the efficiency of interaction between target elements or between target elements and other display backgrounds.
  • the method provided by the embodiment of the present application further includes: if the current operation object is in the multiple selection mode, determining multiple selection areas in the current operation object; dragging the location according to the user's drag operation The elements of the multiple selection area are described to the target location.
  • Figure 3b shows a display of a plurality of elements in a non-operating state, and Figure 3b includes a rectangle 12, a pentagon 13 and a five-pointed star 14.
  • Figure 3c shows a schematic diagram of the underlying elements not being occluded after applying the scheme in a multi-element interaction.
  • the figure 3c includes a rectangle 15, a pentagon 16 and a pentagonal star 17.
  • the 350 is a logical boundary of the rectangle 15 and the rectangle 15 is located at the bottom layer.
  • determining the multiple selection area in the current operation object may be implemented by determining, according to the start position and the end position of the display identifier corresponding to the drag device in the multiple selection mode, that the a rectangular area of the starting point and the ending point; determining an intersection area of the rectangular area and the plurality of element activation areas as a multiple selection area.
  • the dragging device takes a mouse as an example, draws a semi-transparent rectangle according to the starting position and the ending position of the display identifier corresponding to the mouse in the drag operation, and calculates the intersection of the semi-transparent rectangle and the active boundary when the mouse is released. In the case, find the elements that intersect with them, and calculate the common border of these elements, set the area of the border to multiple selection areas, and the elements in the multiple selection area can achieve multiple drag and drop functions.
  • the area corresponding to the semi-transparent rectangle is determined by calculating the coordinates of the four vertices of the semi-transparent rectangle, and the area of the currently displayed page determined by the activation boundary is the area composed of the points with the same coordinates in the two areas as the intersecting elements. Corresponding area.
  • the common borders of these elements are determined by analyzing the boundaries of the intersecting elements in the four directions of up, down, left, and right.
  • FIG. 3d shows a schematic diagram of determining multiple selection regions in a multiple selection mode, where 360 is a multiple selection region, and FIG. 3d includes a rectangle 18, a pentagon 19, and a pentagonal star 20, wherein the pentagon The 19 and the five-pointed star 20 are elements in the multiple selection area, and the pentagon 19 and the five-pointed star 20 can be simultaneously dragged.
  • the multiple selection area is determined by drawing a semi-transparent rectangle including a drag start point and a drag focus to realize a drag function in the multiple selection area.
  • the multiple drag function means that elements within the multiple selection area move with the mouse.
  • the device that performs the operation is an example of a mouse. After the operation of the target element ends, the display data of the element is modified when the mouse is released, and the rendering is performed again and displayed.
  • FIG. 4 is a schematic structural diagram of a multi-element interaction apparatus according to Embodiment 4 of the present application, which is suitable for performing a multi-element interaction method provided by an embodiment of the present application.
  • the apparatus may include a determination module 410, a determination module 420, and a response module 430.
  • the determining module 410 is configured to determine whether the position of the click operation in the current operation object is in an active area of the element if it is detected that the current operation object has at least two elements that overlap in the logical boundary.
  • the determining module 420 is configured to determine, according to the active area, a target element corresponding to the active area when the position of the click operation in the current operation object is in an active area of the element.
  • the response module 430 is configured to control the target element to change a display state of the target element according to an edit instruction corresponding to the operation, in response to satisfying a set condition and an operation for the target element.
  • the active area of the element includes a boundary line of the element and a closed area formed by the boundary line, and the logical boundary is a rectangular boundary displayed when the element is in a selected state.
  • the determining module 420 is configured to: obtain an identification code of an element in the activation area according to the click operation; and match an identification code of an element in the activation area with an identification code in a pre-stored element list. To determine the target element corresponding to the click operation.
  • the determining module 420 is configured to: in response to detecting that the multi-selection instruction is generated during the occurrence of the click operation, corresponding to the plurality of click operations within the time range of the multiple-selection instruction An identifier of the plurality of elements is matched with the identifier in the list of pre-stored elements to determine a target element corresponding to the plurality of click operations.
  • the operation of the target element that satisfies the set condition includes: a drag operation that satisfies the set condition and is directed to the target element.
  • the response module 430 is configured to: at the end of the drag operation, the position of the identifier displayed on the current page as the target point; in response to the dragging of the position in the current operation object from the click operation The dragging operation of moving the starting point to the target point, and controlling the target element to change a display state of the target element according to an editing instruction corresponding to the drag operation.
  • the method further includes: a control module configured to control the target element to maintain the current position and display when detecting that the display identifier corresponding to the drag device is outside the current browser page display area status.
  • the method further includes: a multiple selection area determining module, configured to determine a multiple selection area in the current operation object when the current operation object is in the multiple selection mode;
  • the multi-region drag module is configured to drag an element located in the multiple selection area to a target position according to a user's drag operation.
  • the multiple selection area determining module is configured to: determine a rectangle including the starting point and the ending point according to a starting position and an ending position of a display identifier corresponding to the drag device in the multiple selection mode a region; determining an intersection region of the rectangular region and the plurality of element activation regions as a multiple selection region.
  • the multi-element interaction device provided by the embodiment of the present application may perform the multi-element interaction method provided by any embodiment of the present application, and has a function module corresponding to the execution method.
  • FIG. 5 is a schematic structural diagram of a computer device according to Embodiment 5 of the present application.
  • FIG. 5 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present application.
  • the computer device 12 shown in FIG. 5 is merely an example and should not impose any limitation on the function and scope of use of the embodiments of the present application.
  • computer device 12 is embodied in the form of a general purpose computing device.
  • the components of computer device 12 may include, but are not limited to, at least one processor or processing unit 16, system memory 28, and bus 18 that connects different system components, including system memory 28 and processing unit 16.
  • Bus 18 represents at least one of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures.
  • these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA Bus, and the Video Electronics Standards. Association, VESA) Local Bus and Peripheral Component Interconnect (PCI) bus.
  • ISA Industry Standard Architecture
  • MAC Micro Channel Architecture
  • VESA Video Electronics Standards. Association
  • PCI Peripheral Component Interconnect
  • Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including both volatile and nonvolatile media, removable and non-removable media.
  • System memory 28 may include computer system readable media in the form of volatile memory, such as at least one of random access memory (RAM) 30 and cache memory 32.
  • Computer device 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media.
  • storage system 34 may be used to read and write non-removable, non-volatile magnetic media (not shown in Figure 5, commonly referred to as a "hard disk drive”).
  • a disk drive for reading and writing to a removable non-volatile disk for example, a "floppy disk”
  • a removable non-volatile disk such as a read-only disk (Compact Disc Read)
  • Memory 28 can include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of each embodiment of the present application.
  • a program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, at least one application, other program modules, and Program data, each of these examples or some combination may include an implementation of a network environment.
  • Program module 42 typically performs the functions and/or methods of the embodiments described herein.
  • the computer device 12 can also be in communication with at least one external device 14, such as a keyboard, pointing device, display 24, etc., and with at least one device that enables a user to interact with the computer device 12, and with the computer device 12 capable of at least Any device that communicates with other computing devices, such as a network card, modem, etc. This communication can take place via an input/output (I/O) interface 22.
  • the computer device 12 can also communicate with at least one network, such as at least one of a local area network (LAN), a wide area network (WAN), and a public network (eg, the Internet) through the network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be understood that although not shown in FIG.
  • At least one of other hardware and software modules may be utilized in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disks. Redundant Arrays of Independent Disks (RAID) systems, tape drives, and data backup storage systems.
  • the processing unit 16 executes a plurality of function applications and data processing by running a program stored in the system memory 28, for example, implementing the multi-element interaction method provided by the embodiment of the present application:
  • the processing unit executes the program, if it is detected that the current operation object is at least two elements with overlapping logical boundaries, it is determined whether the position of the click operation in the current operation object is in an active area of the element. If the position of the click operation in the current operation object is in an active area of the element, determining a target element corresponding to the activation area according to the activation area; and operating the target element in response to satisfying the setting condition; Controlling, by the target element, a display state according to an editing instruction corresponding to the operation; wherein an active area of the element includes a boundary line of the element and a closed area formed by the boundary line, and the logical boundary is the The bounding rectangle of the element when it is selected.
  • the sixth embodiment of the present application provides a computer readable storage medium, where a computer program is stored, and when executed by the processor, the multi-element interaction method provided by all the embodiments of the present invention is implemented:
  • the program when the program is executed by the processor, if it is detected that at least two elements that are coincident in the current operation object are logical boundaries, it is determined whether the position of the click operation in the current operation object is in an active area of the element; If the position of the click operation in the current operation object is in an active area of the element, determining a target element corresponding to the activation area according to the activation area; and responding to the operation of the target element satisfying the setting condition, Controlling the target element to change a display state according to an editing instruction corresponding to the operation; wherein an active area of the element includes a boundary line of the element and a closed area formed by the boundary line, and the logical boundary is the element The bounding rectangle that is displayed when it is selected.
  • the computer readable medium can be a computer readable signal medium or a computer readable storage medium.
  • the computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above.
  • a more specific example (non-exhaustive list) of computer readable storage media includes: an electrical connection having at least one wire, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (Read Only Memory, ROM) ), Erasable Programmable Read-Only Memory (EPROM) or flash memory, optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable The combination.
  • a computer readable storage medium can be any tangible medium that can contain or store a program, which can be used by or in connection with an instruction execution system, apparatus or device.
  • a computer readable signal medium may include a data signal that is propagated in the baseband or as part of a carrier, carrying computer readable program code. Such propagated data signals can take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer readable signal medium can also be any computer readable medium other than a computer readable storage medium, which can transmit, propagate, or transport a program for use by or in connection with the instruction execution system, apparatus, or device. .
  • Program code embodied on a computer readable medium can be transmitted by any suitable medium, including, but not limited to, wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination of the foregoing.
  • suitable medium including, but not limited to, wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination of the foregoing.
  • Computer program code for performing the operations of the present application can be written in at least one programming language, or a combination thereof, including an object oriented programming language - such as Java, Smalltalk, C++, and also includes conventional procedural Programming language - such as the "C" language or a similar programming language.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer, partly on the remote computer, or entirely on the remote computer or server.
  • the remote computer can be connected to the user computer via any kind of network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computer, for example using an Internet service provider. Internet connection.
  • LAN local area network
  • WAN wide area network
  • Internet service provider for example using an Internet service provider.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种多元素交互方法、装置、设备和存储介质，该方法包括：响应于检测到当前操作对象为在逻辑边界存在重合的至少两个元素，判断点击操作在所述当前操作对象中的位置是否处于元素的激活区域（S110）；响应于确定所述点击操作在所述当前操作对象中的位置处于元素的激活区域，根据所述激活区域确定所述激活区域对应的目标元素（S120）；响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变显示状态（S130）；其中，所述元素的激活区域包括所述元素的边界线以及所述边界线形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。

Description

多元素交互方法、装置、设备和存储介质
本申请要求在2017年11月29日提交中国专利局、申请号为201711230674.0的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本申请涉及交互技术，例如涉及一种多元素交互方法、装置、设备和存储介质。
背景技术
在浏览器环境中，浏览器中渲染和事件监听的单位是文档对象模型(Document Object Model，DOM)元素，而任何标准的元素的边界都是矩形，当交互发生在不规则元素之外且在DOM元素边界矩形之内时，并且用户交互事件穿透该元素直接与下层元素进行交互时，在实现本申请过程中，发明人发现相关技术中至少存在如下情况：浏览器的DOM元素事件监听会将该交互阻挡，导致下层元素无法响应。
针对这种情况，通常情况是将多媒体视频单独用DOM元素来渲染，但是这样会带来另一个缺陷，由于多媒体视频单独用DOM元素来渲染，因此该元素必将在层级上位于所有可伸缩矢量图形(Scalable Vector Graphics，SVG)子元素的上方或者下方，当需求是视频元素的层级位置不为置顶或置底时无法满足要求。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本申请实施例提供一种多元素交互方法、装置、设备和存储介质，在多元素交互过程中，避免了只能使用规则元素的缺陷以及下层元素不被响应的情况，保证了多个元素的正常交互。
第一方面，本申请实施例提供了一种多元素交互方法，该方法包括：响应于检测到当前操作对象为在逻辑边界有重合的至少两个元素，判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域；响应于确定所述点击操作在所述当前操作对象中的位置处于元素的激活区域，根据所述激活区域确 定所述激活区域对应的目标元素；响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态；其中，所述元素的激活区域包括所述元素的边界线以及所述边界线所形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。
第二方面，本申请实施例还提供了一种多元素交互装置，该装置包括：判断模块，设置为若检测到当前操作对象为逻辑边界存在重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域；确定模块，设置为在点击操作在当前操作对象中的位置处于元素的激活区域时，根据所述激活区域确定所述激活区域对应的目标元素；响应模块，设置为响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态；其中，所述元素的激活区域包括所述元素的边界线以及所述边界线所形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。
第三方面，本申请实施例还提供了一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如本申请实施例中任一所述的多元素交互方法。
第四方面，本申请实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本申请实施例中任一所述的多元素交互方法。
在阅读并理解了附图和详细描述后，可以明白其他方面。
附图说明
图1a是本申请实施例一中的一种多元素交互方法的流程图；
图1b是本申请实施例一中适用的一种渲染时的层级遮挡的示意图；
图1c是本申请实施例一中适用的一种元素之间相对位置有重合时的元素逻辑边界的示意图；
图1d是本申请实施例一中适用的一种使用本方案后的元素交互过程中的示意图；
图2a是本申请实施例二中的一种多元素交互方法的流程图；
图2b是本申请实施例二中适用的一种多个元素交互时确定目标元素时的示意图；
图3a是本申请实施例三中的一种多元素交互方法的流程图；
图3b是本申请实施例三中适用的一种多个元素在非操作状态的显示图；
图3c是本申请实施例三中适用的一种多元素交互时应用本方案后下层元素不被遮挡的示意图；
图3d是本申请实施例三中适用的一种多重选择模式下确定多重选择区域的示意图；
图4是本申请实施例四中的一种多元素交互装置的结构示意图；
图5是本申请实施例五中的一种计算机设备的结构示意图。
具体实施方式
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是，此处所描述的实施例仅仅用于解释本申请，而非对本申请的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本申请相关的部分而非全部结构。
实施例一
图1a为本申请实施例一提供的一种多元素交互方法的流程图，本实施例可适用于在浏览器的场景中多元素进行交互的情况，该方法可以由本申请实施例提供的多元素交互装置来执行，该装置可采用软件和硬件中至少一种的方式实现。参考图1a，该方法可以包括步骤S110，步骤S120和步骤S130。
在步骤S110中，若检测到当前操作对象为逻辑边界存在重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域，若所述点击操作在所述当前操作对象中的位置处于元素的激活区域，则执行步骤S120。
其中，元素是指任何显示内容，包括图片、文字、多媒体音视频、平面几何形状和立体几何等，规则元素是指边界为矩形的元素，不规则元素是指元素的边界为除了矩形之外的形状的元素。浏览器的环境可以是指谷歌浏览器(Chrome)、Safari、火狐浏览器(Firefox)、IE和Edge等可以显示标记语言文件的软件。在一个例子中，多个不规则元素多层级复杂交互的场景可以是基于浏览器的演示文稿(PowerPoint)中的形状等元素。
例如，在当前操作对象为逻辑边界有重合的至少两个元素时，判断点击操作在当前操作对象中的位置是否处于元素的激活区域。在一实施例中，所述元 素的激活区域包括所述元素的边界线以及所述边界线形成的封闭区域，通过获取点击操作在当前操作对象中的第一坐标位置，并将该第一坐标位置与激活区域在当前显示页面中的第二坐标位置进行比对，若第一坐标位置位于所述第二坐标位置确定的区域范围，则表明点击操作在当前操作对象中的位置处于元素的激活区域。所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。在一个例子中，可以通过分别获取每个元素在当前显示页面中的坐标，逻辑边界有重合是指至少两个元素在被选中状态时显示的矩形边界的坐标范围有重合。在一实施例中，可以通过确定元素在选中状态时显示的矩形边界的四个顶点的坐标来确定逻辑边界的坐标范围。
其中，元素的激活区域包括元素的边界线以及所述边界线形成的封闭区域。在一个例子中，以三角形为例，该三角形元素的激活区域包括三角形的三条边以及三条边形成的封闭三角形区域。渲染边界是指渲染画布的大小，逻辑边界为元素处于被选中状态时显示的矩形边界。
在一个例子中，图1b示出了一种渲染时的层级遮挡的示意图，140为矩形1的矩形边界，150为直角三角形2的矩形边界，160为钝角三角形3的矩形边界，其中，矩形边界140、矩形边界150与矩形边界160是属于元素本身的特有属性，其矩形边界在用户对元素的操作以及多个元素的交互过程中不可见。逻辑边界用于控制柄的显示和实际存储，激活边界即为元素的边界。参考图1b，激活边界分别为矩形1的四条边、直角三角形2的三条边以及钝角三角形3的三条边。
图1c示出了一种元素之间相对位置有重合时的元素逻辑边界的示意图，以图1c为例，说明元素的逻辑边界的具体含义。在图1c中，170为直角三角形4的逻辑边界，171为渲染边界，即实际渲染的画布的大小，在这种情况下，由于矩形5在直角三角形4的逻辑边界内，相关方案中通常无法对矩形5进行拖拽等操作。图1d示出了一种使用本方案后的元素交互过程中的示意图，180为矩形7的逻辑边界，181为渲染边界，通过图1d可以看出，通过使用本方案，可以通过点击直角三角形6空白处的B点对矩形7直接进行操作，而不被直角三角形6遮挡。
在步骤S120中，根据所述激活区域确定所述激活区域对应的目标元素。
例如，若点击操作在所述当前操作对象中的位置，处于元素的激活区域时，根据激活区域确定激活区域对应的目标元素。每个元素对应不同的层级，在一 个例子中，图1b中的每个元素是由一个单独的SVG绘制的，这里分别有三个SVG。其中，三个SVG分别与其对应的元素(矩形1、直角三角形2和钝角三角形3)一起标号，三者的层级关系是：钝角三角形3＞直角三角形2＞矩形1，即钝角三角形3置于最顶层。当三者的重合区域只有钝角三角形3可见但是用户点击A点时，用户的需求是激活直角三角形2。假如是DOM事件，由于钝角三角形3在最顶层，则此时会激活钝角三角形3，也就是产生了不必要的遮挡。
其中，确定激活区域对应的目标元素的方式可以通过查询激活区域和元素对应列表获得，该列表中存储了激活区域和元素的对应关系。还可以提取激活区域中的边界线，根据激活区域的边界线确定目标元素。
在步骤S130中，响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态。
例如，在确定了目标元素后，响应于满足设定条件且针对目标元素的操作。在一实施例中，该操作包括点击、拖动、缩放、旋转和元素自定义等。设定的条件可以是在将目标元素从点M拖动至点N，或者将目标元素逆时针旋转150度等。
不同的操作对应不同的编辑指令。例如是缩放操作，则对应的编辑指令可以是用户在右击操作目标元素时，弹出对应的菜单选项，点击选项中的“缩放”，而具体可以通过给多个操作添加不同的字段来给不同的操作添加对应的功能。而将具体的操作与编辑指令进行关联，根据编辑指令改变目标元素的显示状态，其中，显示状态包括旋转显示和拖动显示等。
本申请实施例中，通过若检测到当前操作对象为逻辑边界存在重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置是否处于元素的激活区域；若处于元素的激活区域，则根据所述激活区域确定所述激活区域对应的目标元素；响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变目标元素的显示状态。与相关方案中的使用DOM元素来渲染时，只能显示文字、图像、多媒体音视频、超链接等规则元素、对于不规则的元素的空白区域的交互时间被阻挡时无法穿透到达下层、将内容嵌套在单一的SVG这一个DOM元素中进行渲染的缺陷，在本方案中在多元素交互过程中，克服了只能使用规则元素的缺陷以及下层元素不被响应的缺陷，保证了多个元素的正常交互。
实施例二
图2a为本申请实施例二提供的一种多元素交互方法的流程图，本实施例在上述实施例的基础上，对“根据所述激活区域确定所述激活区域对应的目标元素”进行了调整。参考图2a，该方法可以包括步骤S210至步骤S240。
在步骤S210、若检测到当前操作对象为逻辑边界有重合的至少两个元素，则判断点击操作在所述当前操作对象中的对应位置，是否处于元素的激活区域，若所述点击操作在所述当前操作对象中的位置处于元素的激活区域，则执行步骤S220。
在步骤S220中，根据所述点击操作获取所述激活区域中的元素的标识码。
例如，根据点击操作获取激活区域中的元素的标识码，其中，每个元素对应一个标识码，根据该标识码可以唯一确定元素。在一实施例中，标识码可以是数字、字母以及符号中的至少一种。本地存储器或云端存储器中存储有多个元素的激活码。在一个例子中，将多个元素的激活码与点击操作在当前显示页面中的位置进行关联，通过点击操作在激活区域的位置，来获取点击操作在激活区域中的对应元素的标识码。
在步骤S230中，将所述激活区域中的元素的标识码与预存元素列表中的标识码进行匹配，来确定所述点击操作所对应的目标元素。
其中，预存元素列表中存储有元素与标识码的一一对应关系，对于元素和标识码这两个参量，知道二者中的其中一个参量便可获知另外一个参量。例如，若知道标识码，则可以从预存元素列表中进行查找，预存元素列表中该标识码对应的元素即为目标元素。
在一个例子中，图2b示出了一种多个元素交互时确定目标元素时的示意图，矩形11的层级位于矩形8、直角三角形9、钝角三角形10的上方，在点击矩形11的中心未填充的空白处C点时，确定目标元素为直角三角形9，可以与其下层的直角三角形9直接进行交互。
在步骤S240中，响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态。
本申请实施例中，根据所述点击操作获取所述激活区域中的元素的标识码，将所述元素的标识码与预存元素列表中的标识码进行匹配来确定所述点击操作对应的目标元素。通过元素的标识码的唯一性来确定目标元素。
在上述技术方案的基础上，根据所述激活区域确定所述激活区域对应的目 标元素还可以通过以下方式实现：响应于检测到发生所述点击操作的过程中有设定的多选指令产生，将所述多选指令存在时间范围内的多个点击操作对应的多个元素的标识码，与所述预存元素列表中的标识码进行匹配，来确定所述多个点击操作所对应的目标元素。
其中，设定的多选指令包括在点击操作时按下键盘上的shift键产生，或者点击了触控屏上的多选按钮或符号产生。响应于检测到发生点击操作的过程中有设定的多选指令产生，将多选指令存在时间范围内的多个点击操作对应的多个元素的标识码与预存元素列表中的标识码进行匹配，来确定多个点击操作确定的目标元素。需要说明的是，多选指令的产生时间与点击操作的发生时间的先后顺序不做具体限定，可以是点击操作和多选指令同时产生，也可是多选指令在点击操作的过程中产生，实现了对多个元素同时进行选中等其他操作。
实施例三
图3a为本申请实施例三提供的一种多元素交互方法的流程图，本实施例在上述实施例的基础上，在满足设定条件的对所述目标元素的操作为拖拽操作时，对“响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态”进行了细化。参考图3a，该方法可以包括步骤S310至步骤S340。
在步骤S310中，在当前操作对象为在逻辑边界有重合的至少两个元素时，判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域，若所述点击操作在所述当前操作对象中的位置处于元素的激活区域，则执行步骤S320。
在步骤S320中，根据所述激活区域确定所述激活区域对应的目标元素。
在步骤S330中，将拖拽设备在拖拽操作结束时，在当前页面上显示的标识符的位置作为目标点。
在一实施例中，拖拽设备是指可实现拖拽功能的部件，例如鼠标、书写笔或手指等。可拖拽设备在在当前显示页面上有对应的标识符，例如鼠标在当前页面上显示为空心箭头样式、书写笔或手指在当前页面上显示为书写笔的样式。在对目标元素进行拖拽过程中，当前显示页面上会出现表征拖拽操作的标识符，标识符在当前显示页面中的位置跟随拖拽操作的持续进行移动。在检测到拖拽操作结束时，获取此时在当前页面上显示的标识符的位置作为目标点。在一个 例子中，可以通过检测标识符的位置在设定的时间范围内保持不变，则认为拖拽操作结束。其中，设定的时间范围可以是3秒钟以上。可以通过标识符在当前显示页面的横纵坐标来获取其位置。
在步骤S340中，响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作，控制所述目标元素根据所述拖拽操作对应的编辑指令改变所述目标元素的显示状态。
例如，拖拽操作包括拖拽起点、拖拽路径以及拖拽终点，以点击操作在当前操作对象中的位置为拖拽起点，以上述提到的目标点作为拖拽终点，分别获取拖拽起点和拖拽终点在当前显示页面的坐标，拖拽路径不做具体限定。以满足用户的要求为准，拖拽路径可以是预先规划好的，也可以是在拖拽过程中随机选取的。在一个例子中，若拖拽路径为直线，则可以将目标元素按照直线信息进行拖拽；或者没有具体的拖拽路径，如果后续需要对具体的拖住路径进行分析，则在拖拽过程中，实时获取拖拽过程中目标元素在当前显示页面中移动的轨迹中的点的坐标，根据每个坐标生成拖拽路径对应的轨迹曲线，以供对拖拽路径进行分析。响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作。控制所述目标元素根据所述操作对应的编辑指令改变显示状态。
本申请实施例中，通过将拖拽设备在拖拽操作结束时在当前页面上显示的标识符的位置作为目标点，控制所述目标元素响应从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点来响应所述拖拽操作。在确定了目标点后实现了对目标元素的拖拽操作。
在一实施例中，在所述响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作，控制所述目标元素根据所述拖拽操作对应的编辑指令改变所述目标元素的显示状态的步骤中，当检测到所述拖拽设备对应的显示标识符位于当前页面显示区域之外时，控制所述目标元素保持当前的位置与显示状态。
例如，当前显示页面不是设备屏幕尺寸时，则部分区域属于当前显示区域之外的区域。在一个例子中，以当前显示页面为浏览器页面为例，也即，以浏览器下的多元素交互为例。例如，当前的浏览器显示页面占设备屏幕尺寸的60％，则另外40％为空闲区域，则在对目标元素拖拽的过程中，在检测到拖拽设备对应的显示标识符位于60％的浏览器显示区域之外时，则表明此时的拖拽操作已 经不被响应，则保持目标元素保持当前的位置与显示状态。在一实施例中，当前的位置与显示状态包括目标元素的与其他元素的位置关系与层级关系等。本实施例可以防止用户在当前显示页面之外的无效的拖拽操作，只响应有效的拖拽操作，提高了目标元素之间或目标元素与其他显示背景之间的交互的效率。
示例性的，还可以获取当前显示页面与设备屏幕显示尺寸交界线的坐标。其中，交界线包括上边界交界线、下边界交界线、左边界交界线和右边界交界线。以设备屏幕中心点作为坐标原点，设备屏幕水平向右为X轴正方向，设备屏幕水平向左为X轴负方向，设备屏幕垂直向上为Y轴正方向，设备屏幕垂直向下为Y轴负方向。在一实施例中，横坐标大于右边界交界线的横坐标的区域、横坐标小于左边界交界线的横坐标的区域、纵坐标大于上边界交界线的纵坐标的区域以及纵坐标小于下边界交界线的纵坐标的区域均为当前页面显示区域之外的区域。确定显示当前页面的显示区域，对在显示区域之外的操作不响应，提高了目标元素之间或目标元素与其他显示背景之间的交互的效率。
在上述技术方案的基础上，本申请实施例提供的方法还包括：若当前操作对象处于多重选择模式，则确定所述当前操作对象中的多重选择区域；根据用户的拖拽操作拖动位于所述多重选择区域的元素至目标位置。
例如，检测当前操作对象是否处于多重选择模式，若当前操作对象处于多重选择模式，则确定当前操作对象中的多重选择区域。其中，对于多重选择区域内的元素，可以同时对其进行操作。例如多重选择区域内包括两个元素，则这两个元素可以被同时进行拖动、编辑或自定义等操作。根据用户的拖拽操作拖动位于多重选择区域的元素至目标位置。在一个例子中，图3b示出了一种多个元素在非操作状态的显示图，图3b中包括矩形12、五边形13和五角星14。图3c示出了一种多元素交互时应用本方案后下层元素不被遮挡的示意图。其中，图3c包括矩形15、五边形16和五角星17。350为矩形15的逻辑边界，矩形15位于最底层，应用本申请实施例提供的方案后可以进行交互而不被其他元素遮挡。
在一实施例中，确定所述当前操作对象中的多重选择区域可以通过以下方式实现：根据所述多重选择模式下的拖拽设备对应的显示标识符的起点位置和终点位置，确定包括所述起点和所述终点的矩形区域；确定所述矩形区域与所述多个元素激活区域的相交区域为多重选择区域。
其中，拖拽设备以鼠标为例，根据拖拽操作中的鼠标对应的显示标识符的 起点位置和终点位置，绘制半透明矩形，并在鼠标释放时，计算该半透明矩形与激活边界的相交情况，找出与其相交的元素，并计算出这些元素的共有边框，将这个边框构成的区域设置为多重选择区域，多重选择区域内的元素可以实现多重拖拽功能。
例如，通过计算半透明矩形四个顶点的坐标确定该半透明矩形对应的区域，通过激活边界确定的当前显示页面的区域，则将这两个区域中坐标相同的点组成的区域为相交的元素对应的区域。通过分析相交的元素的在上、下、左、右四个方向的边界来确定这些元素的共有边框。
在一个例子中，图3d示出了一种多重选择模式下确定多重选择区域的示意图，其中，360为多重选择区域，图3d包括矩形18、五边形19和五角星20，其中五边形19和五角星20为多重选择区域内的元素，可以对五边形19和五角星20同时进行拖拽。
本申请实施例中通过绘制包括拖拽起点和拖拽重点的半透明矩形来确定多重选择区域，以实现多重选择区域内的拖拽功能。在一实施例中，多重拖拽功能是指多重选择区域内的元素跟随鼠标一起移动。在上述实施例中，执行操作的设备是鼠标为例，在对目标元素的操作结束后，则在鼠标释放时修改元素的显示数据，重新进行渲染并显示。
实施例四
图4是本申请实施例四提供的一种多元素交互装置的结构示意图，该装置适用于执行本申请实施例提供给的一种多元素交互方法。如图4所示，该装置可以包括判断模块410，确定模块420以及响应模块430。
判断模块410，设置为若检测到当前操作对象为逻辑边界存在重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域。
确定模块420，设置为在点击操作在当前操作对象中的位置处于元素的激活区域时，根据所述激活区域确定所述激活区域对应的目标元素。
响应模块430，设置为响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态。
其中，所述元素的激活区域包括所述元素的边界线以及所述边界线所形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。
在一实施例中，确定模块420设置为：根据所述点击操作获取所述激活区域中的元素的标识码；将所述激活区域中的元素的标识码与预存元素列表中的标识码进行匹配，来确定所述点击操作所对应的目标元素。
在一实施例中，确定模块420设置为：响应于检测到发生所述点击操作的过程中有设定的多选指令产生，将所述多选指令存在时间范围内的多个点击操作对应的多个元素的标识码，与所述预存元素列表中的标识码进行匹配，来确定所述多个点击操作所对应的目标元素。
在一实施例中，所述满足设定条件的对所述目标元素的操作包括：满足设定条件且针对所述目标元素的拖拽操作。
响应模块430设置为：将拖拽设备在拖拽操作结束时，在当前页面上显示的标识符的位置作为目标点；响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作，控制所述目标元素根据所述拖拽操作对应的编辑指令改变所述目标元素的显示状态。
在一实施例中，还包括：控制模块，设置为，当检测到所述拖拽设备对应的显示标识符位于当前浏览器页面显示区域之外时，控制所述目标元素保持当前的位置与显示状态。
在一实施例中，还包括：多重选择区域确定模块，设置为在当前操作对象处于多重选择模式时，确定所述当前操作对象中的多重选择区域；
多重区域拖拽模块，设置为根据用户的拖拽操作拖动位于所述多重选择区域的元素至目标位置。
在一实施例中，所述多重选择区域确定模块设置为：根据所述多重选择模式下的拖拽设备对应的显示标识符的起点位置和终点位置，确定包括所述起点和所述终点的矩形区域；确定所述矩形区域与多个元素激活区域的相交区域为多重选择区域。
本申请实施例提供的多元素交互装置可执行本申请任意实施例提供的多元素交互方法，具备执行方法相应的功能模块。
实施例五
图5为本申请实施例五提供的一种计算机设备的结构示意图。图5示出了适于用来实现本申请实施方式的示例性计算机设备12的框图。图5显示的计算机设备12仅仅是一个示例，不应对本申请实施例的功能和使用范围带来任何限制。
如图5所示，计算机设备12以通用计算设备的形式表现。计算机设备12的组件可以包括但不限于：至少一个处理器或者处理单元16，***存储器28，连接不同***组件(包括***存储器28和处理单元16)的总线18。
总线18表示几类总线结构中的至少一种，包括存储器总线或者存储器控制器，***总线，图形加速端口，处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说，这些体系结构包括但不限于工业标准体系结构(Industry Standard Architecture，ISA)总线，微通道体系结构(Micro Channel Architecture，MAC)总线，增强型ISA总线、视频电子标准协会(Video Electronics Standards Association，VESA)局域总线以及***组件互连(Peripheral Component Interconnect，PCI)总线。
计算机设备12典型地包括多种计算机***可读介质。这些介质可以是任何能够被计算机设备12访问的可用介质，包括易失性和非易失性介质，可移动的和不可移动的介质。
***存储器28可以包括易失性存储器形式的计算机***可读介质，例如随机存取存储器(Random Access Memory，RAM)30和高速缓存存储器32中的至少一种。计算机设备12可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机***存储介质。仅作为举例，存储***34可以用于读写不可移动的、非易失性磁介质(图5未显示，通常称为“硬盘驱动器”)。尽管图5中未示出，可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器，以及对可移动非易失性光盘，例如只读光盘(Compact Disc Read-Only Memory，CD-ROM)，数字视盘(Digital Video Disc-Read Only Memory，DVD-ROM)或者其它光介质读写的光盘驱动器。在这些情况下，每个驱动器可以通过至少一个数据介质接口与总线18相连。存储器28可以包括至少一个程序产品，该程序产品具有一组(例如至少一个)程序模块，这些程序模块被配置以执行本申请每个实施例的功能。
具有一组(至少一个)程序模块42的程序/实用工具40，可以存储在例如存储器28中，这样的程序模块42包括——但不限于——操作***、至少一个应用程序、其它程序模块以及程序数据，这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块42通常执行本申请所描述的实施例中的功能和/或方法。
计算机设备12也可以与至少一个外部设备14，例如键盘、指向设备、显示 器24等通信，还可与至少一个使得用户能与该计算机设备12交互的设备，和与使得该计算机设备12能与至少一个其它计算设备进行通信的任何设备，例如网卡，调制解调器等通信。这种通信可以通过输入/输出(I/O)接口22进行。并且，计算机设备12还可以通过网络适配器20与至少一个网络，例如局域网(Local Area Network，LAN)，广域网(Wide Area Network，WAN)和公共网络中的至少一种(例如因特网)通信。如图所示，网络适配器20通过总线18与计算机设备12的其它模块通信。应当明白，尽管图5中未示出，可以结合计算机设备12使用其它硬件和软件模块中的至少一种，包括但不限于：微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、磁盘阵列(Redundant Arrays of Independent Disks，RAID)***、磁带驱动器以及数据备份存储***等。
处理单元16通过运行存储在***存储器28中的程序，从而执行多种功能应用以及数据处理，例如实现本申请实施例所提供的多元素交互方法：
也即，所述处理单元执行所述程序时实现：若检测到当前操作对象为逻辑边界有重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置是否处于元素的激活区域；若述点击操作在所述当前操作对象中的位置处于元素的激活区域，则根据所述激活区域确定所述激活区域对应的目标元素；响应于满足设定条件的对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变显示状态；其中，所述元素的激活区域包括所述元素的边界线以及所述边界线形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。
实施例六
本申请实施例六提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本申请所有发明实施例提供的多元素交互方法：
也即，该程序被处理器执行时实现：若检测到在当前操作对象为逻辑边界有重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置是否处于元素的激活区域；若述点击操作在所述当前操作对象中的位置处于元素的激活区域，则根据所述激活区域确定所述激活区域对应的目标元素；响应于满足设定条件的对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变显示状态；其中，所述元素的激活区域包括所述元素的边界线以及所述边界线形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示 的矩形边界。
可以采用至少一个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的***、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：具有至少一个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(Read Only Memory，ROM)、可擦式可编程只读存储器(Erasable Programmable Read-Only Memory，EPROM)或闪存、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行***、装置或者器件使用或者与其结合使用。
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括——但不限于——电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行***、装置或者器件使用或者与其结合使用的程序。
计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括——但不限于——无线、电线、光缆、射频(Radio Frequency，RF)等，或者上述的任意合适的组合。
可以以至少一种程序设计语言或其组合来编写用于执行本申请操作的计算机程序代码，所述程序设计语言包括面向对象的程序设计语言-诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言-诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行，或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)-连接到用户计算机，或者，可以连接到外部计算机，例如利用因特网服务提供商来通过因特网连接。

Claims (16)

  1. 一种多元素交互方法，包括：
    响应于检测到当前操作对象为在逻辑边界存在重合的至少两个元素，判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域；
    响应于确定所述点击操作在所述当前操作对象中的位置处于元素的激活区域，根据所述激活区域确定所述激活区域对应的目标元素；
    响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态；
    其中，所述元素的激活区域包括所述元素的边界线以及所述边界线所形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。
  2. 根据权利要求1所述的方法，其中，所述根据所述激活区域确定所述激活区域对应的目标元素，包括：
    根据所述点击操作获取所述激活区域中的元素的标识码；
    将所述激活区域中的元素的标识码与预存元素列表中的标识码进行匹配来确定所述点击操作所对应的目标元素。
  3. 根据权利要求2所述的方法，所述根据所述激活区域确定所述激活区域对应的目标元素，还包括：
    响应于检测到发生所述点击操作的过程中有设定的多选指令产生，将所述多选指令存在时间范围内的多个点击操作对应的多个元素的标识码，与所述预存元素列表中的标识码进行匹配，来确定所述多个点击操作所对应的目标元素。
  4. 根据权利要求1所述的方法，其中，所述满足设定条件且针对所述目标元素的操作包括：满足设定条件且针对所述目标元素的拖拽操作；
    所述响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态，包括：
    将拖拽设备在拖拽操作结束时，在当前页面上显示的标识符的位置作为目标点；
    响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作，控制所述目标元素根据所述拖拽操作对应的编辑指令改变所述目标元素的显示状态。
  5. 根据权利要求4所述的方法，在所述响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作，控制所述目标元素根据所述拖拽操作对应的编辑指令改变所述目标元素的显示状态的步骤 中，
    当检测到所述拖拽设备对应的显示标识符位于当前页面显示区域之外时，控制所述目标元素保持当前的位置与显示状态。
  6. 根据权利要求4所述的方法，还包括：
    若当前操作对象处于多重选择模式，则确定所述当前操作对象中的多重选择区域；
    根据用户的拖拽操作拖动位于所述多重选择区域的元素至目标位置。
  7. 根据权利要求6所述的方法，其中，所述确定所述当前操作对象中的多重选择区域，包括：
    根据所述多重选择模式下的拖拽设备对应的显示标识符的起点位置和终点位置，确定包括所述起点和所述终点的矩形区域；
    确定所述矩形区域与所述元素激活区域的相交区域为多重选择区域。
  8. 一种多元素交互装置，包括：
    判断模块，设置为若检测到当前操作对象为逻辑边界存在重合的至少两个元素，则判断点击操作在所述当前操作对象中的位置，是否处于元素的激活区域；
    确定模块，设置为在点击操作在当前操作对象中的位置处于元素的激活区域时，根据所述激活区域确定所述激活区域对应的目标元素；
    响应模块，设置为响应于满足设定条件且针对所述目标元素的操作，控制所述目标元素根据所述操作对应的编辑指令改变所述目标元素的显示状态；
    其中，所述元素的激活区域包括所述元素的边界线以及所述边界线所形成的封闭区域，所述逻辑边界为所述元素处于被选中状态时显示的矩形边界。
  9. 根据权利要求8所述的装置，其中，所述确定模块设置为：
    根据所述点击操作获取所述激活区域中的元素的标识码；
    将所述激活区域中的元素的标识码与预存元素列表中的标识码进行匹配，确定所述点击操作所对应的目标元素。
  10. 根据权利要求9所述的装置，其中，所述确定模块设置为：响应于检测到发生所述点击操作的过程中有设定的多选指令产生，将所述多选指令存在时间范围内的多个点击操作对应的多个元素的标识码，与所述预存元素列表中的标识码进行匹配，确定所述多个点击操作所对应的目标元素。
  11. 根据权利要求8所述的装置，所述满足设定条件且针对所述目标元素 的操作包括：满足设定条件且针对所述目标元素的拖拽操作；
    所述响应模块，设置为将拖拽设备在拖拽操作结束时，在当前页面上显示的标识符的位置作为目标点；响应于从所述点击操作在所述当前操作对象中的位置的拖拽起点移动至所述目标点的所述拖拽操作，控制所述目标元素根据所述拖拽操作对应的编辑指令改变所述目标元素的显示状态。
  12. 根据权利要求11所述的装置，所述装置还包括：控制模块；
    所述控制模块设置为：当检测到所述拖拽设备对应的显示标识符位于当前浏览器页面显示区域之外时，控制所述目标元素保持当前的位置与显示状态。
  13. 根据权利要求11所述的装置，所述装置还包括：多重选择区域确定模块以及多重区域拖拽模块；
    所述多重选择区域确定模块，设置为在当前操作对象处于多重选择模式时，确定所述当前操作对象中的多重选择区域；
    所述多重区域拖拽模块，设置为根据用户的拖拽操作拖动位于所述多重选择区域的元素至目标位置。
  14. 根据权利要求13所述的装置，其中，所述多重选择区域确定模块设置为：
    根据所述多重选择模式下的拖拽设备对应的显示标识符的起点位置和终点位置，确定包括所述起点和所述终点的矩形区域；
    确定所述矩形区域与多个元素激活区域的相交区域为多重选择区域。
  15. 一种计算机设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如权利要求1-7中任一所述的方法。
  16. 一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如权利要求1-7中任一所述的方法。
PCT/CN2018/114337 2017-11-29 2018-11-07 多元素交互方法、装置、设备和存储介质 WO2019105191A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711230674.0A CN107885437A (zh) 2017-11-29 2017-11-29 多元素交互方法、装置、设备和存储介质
CN201711230674.0 2017-11-29

Publications (1)

Publication Number Publication Date
WO2019105191A1 true WO2019105191A1 (zh) 2019-06-06

Family

ID=61776204

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/114337 WO2019105191A1 (zh) 2017-11-29 2018-11-07 多元素交互方法、装置、设备和存储介质

Country Status (2)

Country Link
CN (1) CN107885437A (zh)
WO (1) WO2019105191A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107885437A (zh) * 2017-11-29 2018-04-06 广州视源电子科技股份有限公司 多元素交互方法、装置、设备和存储介质
CN109460543A (zh) * 2018-10-18 2019-03-12 北京字节跳动网络技术有限公司 一种逻辑表达式的录入方法、装置、电子设备及可读介质
CN109725802B (zh) * 2018-12-17 2021-02-23 浙江口碑网络技术有限公司 页面交互方法及装置
US11182136B1 (en) * 2020-08-20 2021-11-23 Ebay Inc. Control bar for element activation
CN111913637B (zh) * 2020-08-28 2024-01-02 平安国际智慧城市科技股份有限公司 组件操作控制方法、装置及存储介质
CN112506402A (zh) * 2020-11-25 2021-03-16 广州朗国电子科技有限公司 基于电子白板的图形操控方法、装置及存储介质
CN114327215B (zh) * 2022-03-15 2022-07-29 之江实验室 一种智能识别图表刷选目标的方法、装置和介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102368244A (zh) * 2011-09-08 2012-03-07 广州市动景计算机科技有限公司 页面内容对齐方法、装置及移动终端浏览器
EP2775396A1 (en) * 2012-10-29 2014-09-10 Huawei Technologies Co., Ltd Program execution method and apparatus
CN105786301A (zh) * 2014-12-23 2016-07-20 阿里巴巴集团控股有限公司 多窗口***下切换显示对象的方法及其装置
CN106066874A (zh) * 2016-05-27 2016-11-02 腾讯科技（深圳）有限公司 对象处理方法及终端
CN107885437A (zh) * 2017-11-29 2018-04-06 广州视源电子科技股份有限公司 多元素交互方法、装置、设备和存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5818672B2 (ja) * 2011-12-21 2015-11-18 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 情報処理装置、表示処理方法、プログラムおよび記録媒体
CN105208329B (zh) * 2015-09-06 2019-01-29 广东威创视讯科技股份有限公司 一种图像数据选择方法以及相关装置
CN106406693B (zh) * 2016-08-30 2018-04-27 腾讯科技（深圳）有限公司 图像选中方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102368244A (zh) * 2011-09-08 2012-03-07 广州市动景计算机科技有限公司 页面内容对齐方法、装置及移动终端浏览器
EP2775396A1 (en) * 2012-10-29 2014-09-10 Huawei Technologies Co., Ltd Program execution method and apparatus
CN105786301A (zh) * 2014-12-23 2016-07-20 阿里巴巴集团控股有限公司 多窗口***下切换显示对象的方法及其装置
CN106066874A (zh) * 2016-05-27 2016-11-02 腾讯科技（深圳）有限公司 对象处理方法及终端
CN107885437A (zh) * 2017-11-29 2018-04-06 广州视源电子科技股份有限公司 多元素交互方法、装置、设备和存储介质

Also Published As

Publication number Publication date
CN107885437A (zh) 2018-04-06

Similar Documents

Publication Publication Date Title
WO2019105191A1 (zh) 多元素交互方法、装置、设备和存储介质
TWI698122B (zh) 一種彈幕展示方法及客戶端
US11763067B2 (en) User interface for editing web content
US11698721B2 (en) Managing an immersive interface in a multi-application immersive environment
US9128605B2 (en) Thumbnail-image selection of applications
US10303325B2 (en) Multi-application environment
US20190073120A1 (en) Native overlay for rapid editing of web content
WO2018090893A1 (zh) 一种基于触摸屏的操控方法和装置
US9104440B2 (en) Multi-application environment
US10269164B1 (en) Creating custom stickers for use on a messaging system
US20120299968A1 (en) Managing an immersive interface in a multi-application immersive environment
JP6364893B2 (ja) 端末装置、電子ホワイトボードシステム、電子ホワイトボードの入力支援方法、及びプログラム
JP2017523515A (ja) アイコンサイズ変更
US20120304132A1 (en) Switching back to a previously-interacted-with application
CN105474160A (zh) 高性能触摸拖放
US10855481B2 (en) Live ink presence for real-time collaboration
CN110286971B (zh) 处理方法及***、介质和计算设备
US20170017632A1 (en) Methods and Systems of Annotating Local and Remote Display Screens
US20180300301A1 (en) Enhanced inking capabilities for content creation applications
US20210389849A1 (en) Terminal, control method therefor, and recording medium in which program for implementing method is recorded
US11157130B2 (en) Cursor-based resizing for copied image portions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18883307

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 300920)

122 Ep: pct application non-entry in european phase

Ref document number: 18883307

Country of ref document: EP

Kind code of ref document: A1