WO2021098460A1 - 截屏显示方法、装置和终端设备 - Google Patents

截屏显示方法、装置和终端设备 Download PDF

Info

Publication number
WO2021098460A1
WO2021098460A1 PCT/CN2020/124485 CN2020124485W WO2021098460A1 WO 2021098460 A1 WO2021098460 A1 WO 2021098460A1 CN 2020124485 W CN2020124485 W CN 2020124485W WO 2021098460 A1 WO2021098460 A1 WO 2021098460A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
screenshot
included angle
screenshot image
display screen
Prior art date
Application number
PCT/CN2020/124485
Other languages
English (en)
French (fr)
Inventor
余买林
叶筠
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP20890256.9A priority Critical patent/EP4047464A4/en
Priority to US17/778,642 priority patent/US20220413787A1/en
Priority to JP2022529748A priority patent/JP7361917B2/ja
Publication of WO2021098460A1 publication Critical patent/WO2021098460A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1641Details related to the display arrangement, including those related to the mounting of the display in the housing the display being formed by a plurality of foldable display components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1647Details related to the display arrangement, including those related to the mounting of the display in the housing including at least an additional display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1652Details related to the display arrangement, including those related to the mounting of the display in the housing the display being flexible, e.g. mimicking a sheet of paper, or rollable
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1675Miscellaneous details related to the relative movement between the different enclosures or enclosure parts
    • G06F1/1677Miscellaneous details related to the relative movement between the different enclosures or enclosure parts for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/0206Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
    • H04M1/0208Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings characterized by the relative motions of the body parts
    • H04M1/0214Foldable telephones, i.e. with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
    • H04M1/0216Foldable in one direction, i.e. using a one degree of freedom hinge
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/16Details of telephonic subscriber devices including more than one display unit

Definitions

  • This application belongs to the field of terminal technology, and in particular relates to a screenshot display method, device and terminal device based on an artificial intelligence (AI) terminal.
  • AI artificial intelligence
  • terminal devices with folding screens have gradually appeared on the market. Like traditional terminal devices, terminal devices with folding screens also have screen capture and screen recording functions. That is, users can use the screen capture or screen recording function to browse text, images and other content using terminal devices with folding screens. Capture or record the current display content in the display screen and save it to facilitate the user's subsequent viewing.
  • the embodiments of the present application provide a screenshot display method, device, and terminal device, which can solve the problem of poor screenshot display effect of the existing terminal device with a folding screen.
  • an embodiment of the present application provides a screenshot display method, which is applied to a terminal device with a folding screen, the folding screen includes a first display screen and a second display screen, and the screenshot display method may include:
  • a resistance sensor may be provided in the bendable area between the first display screen and the second display screen, so as to obtain the first display screen and the all the first display screen by the resistance change measured by the resistance sensor.
  • a gravity sensor/gyro sensor may be provided in the first display screen and the second display screen respectively to pass the gravity sensor/gyro sensor in the first display screen and the second display screen. The sensor measures the first included angle between the first display screen and the second display screen.
  • the screenshot operation of the current display content in the first display screen may be a screenshot operation of the entire content currently displayed on the first display screen, that is, it may be a screenshot of the entire screen of the first display screen. It may also be a screenshot operation on part of the content currently displayed on the first display screen, that is, it may also be a screenshot of a part of the first display screen.
  • the screenshot operation of the current display content in the second display screen may be a screenshot operation of all the content currently displayed on the second display screen, or it may be a screenshot operation of the part currently displayed on the second display screen. Take a screenshot of the content.
  • the displaying the first screenshot image and the second screenshot image according to the first included angle may include:
  • the first screenshot image is displayed in the first plane area
  • the second screenshot image is displayed in the second plane area.
  • the first plane area in the first plane may be determined according to the first screen size of the first display screen and the preset zoom ratio
  • the first plane area in the first plane may be determined according to the second screen size of the second display screen and the preset zoom ratio. It is assumed that the zoom ratio determines the second plane area in the second plane, wherein the first plane area is connected to the second plane area.
  • the displaying the first screenshot image in the first planar area and displaying the second screenshot image in the second planar area may include:
  • the first screenshot image is displayed in the first display position
  • the second screenshot image is displayed in the second display position.
  • first position information of the first screenshot image on the first display screen can be determined and recorded when the screenshot is taken.
  • second screenshot image is displayed on the second display screen.
  • the second location information in can also be determined and recorded during the screenshot.
  • the displaying the first screenshot image and the second screenshot image according to the first included angle may include:
  • the three-dimensional model including a first display area corresponding to the first display screen and a second display area corresponding to the second display screen, A third included angle between the first display area and the second display area is the same as the first included angle;
  • the three-dimensional model is displayed.
  • multiple three-dimensional models corresponding to the terminal device can be constructed in advance according to the folding angle that the folding screen of the terminal device may have, and the corresponding relationship between each constructed three-dimensional model and the folding angle can be established to capture the screen image.
  • the three-dimensional model corresponding to the first included angle can be obtained according to the corresponding relationship, and the three-dimensional display of the screenshot image can be performed through the three-dimensional model.
  • the displaying the three-dimensional model may include:
  • the display angle corresponding to the three-dimensional model is determined, and the three-dimensional model is displayed according to the display angle.
  • the angle facing the first display screen may be determined as the display angle, or the angle facing the second display screen may be determined as the display angle, or the angle facing the first display screen may be determined as the display angle.
  • the angle of the bendable area between a display screen and the second display screen is determined as the display angle.
  • the display angle may be determined according to a preset corresponding relationship between the three-dimensional model and the display angle.
  • the preset corresponding relationship may be established when the three-dimensional model is constructed. For example, when the three-dimensional model is constructed, it may be determined according to the user
  • the set correspondence relationship establishes the preset correspondence relationship; for example, when constructing a three-dimensional model, the preset correspondence relationship may be established according to the current display angle of the image in the terminal device.
  • the displaying the first screenshot image and the second screenshot image according to the first included angle may include:
  • a three-dimensional model corresponding to the terminal device is drawn according to the attribute information and the first included angle, and the three-dimensional model includes a first display area corresponding to the first display screen and a third display area corresponding to the second display screen.
  • the three-dimensional model is displayed.
  • a 3D rendering engine can be used to construct a three-dimensional model corresponding to the terminal device.
  • the attribute information may include information such as the shape of the first display screen and the second display screen in the terminal device, and the 3D rendering engine may draw the terminal device according to the attribute information and the first included angle The corresponding three-dimensional model.
  • the displaying the first screenshot image and the second screenshot image according to the first included angle may include:
  • an adjustment instruction is output according to the first included angle and the fifth included angle to instruct the user to view the first display screen and/or Adjust the second display screen.
  • the displaying the first screenshot image and the second screenshot image according to the first included angle may include:
  • the first screenshot image and the second screenshot image are displayed according to the first included angle.
  • the embodiment of the present application may display the screenshot image according to the current folding state of the terminal device. Specifically, when the current folding state of the terminal device is the same as the folding state when the screenshot operation is performed, the first screenshot image can be displayed directly on the first display screen of the terminal device, and the second screen image can be displayed directly on the second display screen of the terminal device.
  • the display of the second screenshot image in the display screen can directly realize the three-dimensional display of the screenshot image based on the terminal device itself, without the need to construct or obtain a three-dimensional model; and when the current folding state of the terminal device is compared with the screenshot When the folding state during operation is not the same, an adjustment instruction can be output to instruct the user to adjust the folding state of the terminal device, or to construct or acquire a three-dimensional model, and then perform a three-dimensional display of the screenshot image based on the three-dimensional model.
  • the screenshot display method may further include:
  • the displaying the first screenshot image and the second screenshot image according to the first included angle includes:
  • the time axis can also be constructed, that is, when the screenshot image and the first included angle are acquired, the first time axis corresponding to the first included angle and the screenshot image can also be constructed.
  • the first included angle corresponding to each frame of the screenshot image is respectively determined, so that the continuous three-dimensional display of each frame of the screenshot image can be performed according to the first included angle corresponding to each frame of the screenshot image.
  • an embodiment of the present application provides a screenshot display device, which is applied to a terminal device with a folding screen, the folding screen includes a first display screen and a second display screen, and the screenshot display device includes:
  • Screen capture module used to obtain the first included angle between the first display screen and the second display screen, and perform screen capture operations on the current display content of the first display screen and the second display screen respectively , Obtain a first screenshot image corresponding to the first display screen and a second screenshot image corresponding to the second display screen;
  • the display module is configured to display the first screenshot image and the second screenshot image according to the first included angle.
  • the display module includes:
  • the plane determining unit is configured to determine, according to the first included angle, a first plane corresponding to the first screenshot image and a second plane corresponding to the second screenshot image, one of the first plane and the second plane
  • the second included angle between is the same as the first included angle
  • An area determining unit configured to determine a first plane area in the first plane and a second plane area in the second plane according to the first display screen and the second display screen, respectively;
  • the first display unit is configured to display the first screenshot image in the first plane area, and display the second screenshot image in the second plane area.
  • the first display unit includes:
  • the first position determining subunit is configured to determine the first display position of the first screenshot image in the first display area according to the first position information of the first screenshot image in the first display screen;
  • a second position determining subunit configured to determine a second display position of the second screenshot image in the second plane area according to the second position information of the second screenshot image in the second display screen;
  • the first display sub-unit is configured to display the first screenshot image in the first display position and display the second screenshot image in the second display position.
  • the display module includes:
  • a model acquisition unit configured to acquire a three-dimensional model corresponding to the terminal device according to the first included angle, the three-dimensional model including a first display area corresponding to the first display screen and a first display area corresponding to the second display screen
  • the second display area, the third included angle between the first display area and the second display area is the same as the first included angle;
  • a first image rendering unit configured to render the first screenshot image to a first display area of the three-dimensional model, and render the second screenshot image to a second display area of the three-dimensional model;
  • the second display unit is used to display the three-dimensional model.
  • the second display unit is specifically configured to determine a display angle corresponding to the three-dimensional model, and display the three-dimensional model according to the display angle.
  • the display module includes:
  • An attribute information obtaining unit configured to obtain attribute information corresponding to the terminal device
  • a model construction unit configured to draw a three-dimensional model corresponding to the terminal device according to the attribute information and the first included angle, the three-dimensional model including a first display area corresponding to the first display screen and A second display area corresponding to the second display screen, where a fourth included angle between the first display area and the second display area is the same as the first included angle;
  • a second image rendering unit configured to render the first screenshot image to the first display area of the three-dimensional model, and render the second screenshot image to the second display area of the three-dimensional model
  • the third display unit is used to display the three-dimensional model.
  • the display module includes:
  • a first included angle acquiring unit configured to acquire a fifth included angle between the first display screen and the second display screen
  • the fourth display unit is configured to display the first screenshot image on the first display screen and display the first screenshot image on the second display screen if the fifth included angle is the same as the first included angle
  • the instruction output unit is configured to output an adjustment instruction according to the first included angle and the fifth included angle if the fifth included angle is different from the first included angle to instruct the user to The display screen and/or the second display screen are adjusted.
  • the display module includes:
  • a second included angle acquiring unit configured to acquire a fifth included angle between the first display screen and the second display screen
  • a fifth display unit configured to display the first screenshot image on the first display screen and display the first screenshot image on the second display screen if the fifth included angle is the same as the first included angle
  • the sixth display unit is configured to display the first screenshot image and the second screenshot image according to the first included angle if the fifth included angle is different from the first included angle.
  • the screenshot display device further includes:
  • the time axis construction module is used to construct a first time axis corresponding to the first included angle and a second time axis corresponding to the first screenshot image and the second screenshot image, wherein the first time axis and Corresponding to the second time axis;
  • the display module further includes:
  • the third included angle acquiring unit is configured to acquire the first screenshot image and the second screenshot image according to the second time axis, and acquire the first screenshot image and the first screenshot image according to the first time axis 2.
  • the seventh display unit is configured to display the first screenshot image and the second screenshot image according to the first included angle.
  • embodiments of the present application provide a terminal device, including a folding screen, a sensor, a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor executes
  • the computer program implements the screenshot display method according to any one of the above-mentioned first aspects.
  • an embodiment of the present application provides a computer-readable storage medium that stores a computer program that, when executed by a processor, implements any one of the above-mentioned aspects of the first aspect
  • the screenshot display method
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a terminal device, causes the terminal device to execute the screenshot display method described in any one of the above-mentioned first aspects.
  • the first included angle between the first display screen and the second display screen may be first obtained, and the first display screen and the second display screen may be separately adjusted.
  • Perform a screenshot operation on the current display content of the second display screen to obtain a first screenshot image corresponding to the first display screen and a second screenshot image corresponding to the second display screen;
  • the first screenshot image and the second screenshot image are, in the embodiment of the present application, when taking a screenshot, the first included angle between the first display screen and the second display screen can be simultaneously acquired, so that when the screenshot image is displayed, the first screenshot image and the first included angle can be performed according to the first included angle.
  • the three-dimensional display of the second screenshot image can fully reflect the folding and bending characteristics of the terminal device with a folding screen, realize the three-dimensional display of the screenshot image, and improve the display effect of the screenshot image.
  • FIG. 1 is a schematic structural diagram of a mobile phone to which the screenshot display method provided by an embodiment of the present application is applicable;
  • FIG. 2 is a schematic diagram of the software architecture of a mobile phone to which the screenshot display method provided by an embodiment of the present application is applicable;
  • FIG. 3 is a schematic flowchart of a screenshot display method provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of determining the first included angle in an application scenario by the screenshot display method provided by an embodiment of the present application;
  • FIG. 5a to 5c are schematic diagrams of screenshots in specific application scenarios of the screenshot display method provided by an embodiment of the present application.
  • FIG. 6a is a schematic diagram of a plane area determined in an application scenario of the screenshot display method provided by an embodiment of the present application
  • FIG. 6b is a schematic diagram of the screenshot display method provided in an embodiment of the present application for displaying the screenshot image in the plane area determined in FIG. 6a;
  • Figure 7a is a schematic diagram of an application scenario provided by an embodiment of the present application.
  • FIG. 7b is a schematic diagram of a screenshot display of the application scenario shown in FIG. 7a according to an embodiment of the present application;
  • FIG. 8 is a schematic structural diagram of a screenshot display device provided by an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.
  • the term “if” can be construed as “when” or “once” or “in response to determination” or “in response to detecting “.
  • the phrase “if determined” or “if detected [described condition or event]” can be interpreted as meaning “once determined” or “in response to determination” or “once detected [described condition or event]” depending on the context ]” or “in response to detection of [condition or event described]”.
  • the screenshot display method provided by the embodiments of this application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, and super mobile personal computers.
  • AR augmented reality
  • VR virtual reality
  • UMPC ultra-mobile personal computer
  • netbooks netbooks
  • PDA personal digital assistant
  • Fig. 1 shows a block diagram of a part of the structure of a mobile phone provided in an embodiment of the present application.
  • the mobile phone includes: a radio frequency (RF) circuit 110, a memory 120, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a wireless fidelity (WiFi) module 170, and a processor 180 , And power supply 190 and other components.
  • RF radio frequency
  • the structure of the mobile phone shown in FIG. 1 does not constitute a limitation on the mobile phone, and may include more or less components than those shown in the figure, or a combination of some components, or different component arrangements.
  • the RF circuit 110 can be used for receiving and sending signals during information transmission or communication. In particular, after receiving the downlink information of the base station, it is processed by the processor 180; in addition, the designed uplink data is sent to the base station.
  • the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like.
  • the RF circuit 110 may also communicate with the network and other devices through wireless communication.
  • the above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division) Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), Email, Short Messaging Service (SMS), etc.
  • GSM Global System of Mobile Communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • Email Short Messaging Service
  • the memory 120 may be used to store software programs and modules.
  • the processor 180 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 120.
  • the memory 120 may mainly include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc.
  • the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the input unit 130 may be used to receive inputted digital or character information, and generate key signal input related to user settings and function control of the mobile phone.
  • the input unit 130 may include a touch panel 131 and other input devices 132.
  • the touch panel 131 also known as a touch screen, can collect user touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 131 or near the touch panel 131. Operation), and drive the corresponding connection device according to the preset program.
  • the touch panel 131 may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 180, and can receive and execute the commands sent by the processor 180.
  • the touch panel 131 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the input unit 130 may also include other input devices 132.
  • the other input device 132 may include, but is not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick.
  • the display unit 140 may be used to display information input by the user or information provided to the user and various menus of the mobile phone.
  • the display unit 140 may include a display panel 141.
  • the display panel 141 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.
  • the touch panel 131 can cover the display panel 141. When the touch panel 131 detects a touch operation on or near it, it transmits it to the processor 180 to determine the type of the touch event, and then the processor 180 responds to the touch event. The type provides corresponding visual output on the display panel 141.
  • the touch panel 131 and the display panel 141 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 131 and the display panel 141 can be integrated. Realize the input and output functions of the mobile phone.
  • the display unit 140 may include 1 or N display screens, where N is a positive integer greater than 1.
  • the above-mentioned display screen may be bent.
  • the above-mentioned display screen can be bent means that the display screen can be bent to any angle along any axis at any position, and can be maintained at that angle, for example, the display screen can be folded in half from the middle. You can also fold up and down from the middle.
  • the bent display screen may be referred to as a folding screen.
  • the folding screen may be one screen, or a display screen formed by patching together multiple screens, which is not limited here.
  • the display screen can also be a flexible screen, which has the characteristics of strong flexibility and bendability, and can provide users with a new interactive mode based on bendable characteristics, which can meet more users' needs for folding screen mobile phones.
  • the folding screen on the mobile phone can be switched between the small screen in the folded form and the large screen in the unfolded form at any time.
  • the folding screen may include at least two physical forms: an expanded form and a folded form.
  • the unfolded form refers to the angle formed by the left and right ends of the middle bending part of the folding screen (if the folding screen is folded up and down, the upper and lower ends of the middle bending part of the folding screen) that can be folded in half from the left and right sides Between 180 degrees and the first angle, where the first angle is greater than 0 degrees and less than 180 degrees, for example, the first angle may be 90 degrees).
  • Folding form refers to the angle between the left and right ends of the middle bending part of the folding screen (if the folding screen is folded up and down, the upper and lower ends of the middle bending part of the folding screen) is between 0 degrees and the first Between angles.
  • the display area of the folding screen after entering the expanded form may be divided into a first display screen and a second display screen.
  • the folding screen In the unfolded configuration, the folding screen can be folded toward the direction facing the first display screen and the second display screen, and can also be folded toward the direction opposite to the first display screen and the second display screen.
  • the left and right ends of the middle bending part of the folding screen (if the folding screen is folded up and down, the upper and lower ends of the middle bending part of the folding screen) can form an angle between 0 degrees and +180. Between degrees.
  • the folding screen can be bent toward the direction facing the first display screen and the second display screen into a folded configuration with an included angle of 30 degrees, or it can face the first display screen and the second display screen opposite to each other. Bend in the opposite direction into a folded configuration with an included angle of 30 degrees.
  • the mobile phone can use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine whether the folding screen is in a folded form or an unfolded form.
  • the mobile phone can also detect the bending angle of the folding screen through a gravity sensor, an acceleration touch sensor and a gyroscope. Then, the mobile phone can determine whether the folding screen is in a folded state or unfolded according to the bending angle. form.
  • the mobile phone can also use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine the orientation of the folding screen in the folded state, and then determine the display area of the interface content output by the display system.
  • the mobile phone can display the interface content output by the display system on the first display screen.
  • the mobile phone can display the interface content output by the display system on the second display screen.
  • the mobile phone may further include an angle sensor (not shown in FIG. 1), and the angle sensor may be disposed at a bending part of the folding screen.
  • the mobile phone can measure the angle formed by the two ends of the folding part in the middle of the folding screen through an angle sensor (not shown in FIG. 1) arranged at the folding part of the folding screen.
  • an angle sensor not shown in FIG. 1 arranged at the folding part of the folding screen.
  • the mobile phone can also recognize whether the folding screen is in a folded form through a physical switch provided at the bending part of the folding screen. For example, when the mobile phone receives a user's folding operation of the folding screen, the physical switch provided on the mobile phone is triggered to open, and the mobile phone can determine that the folding screen is in a folded form. When the mobile phone receives the user's unfolding operation of the folding screen, the physical switch set on the mobile phone is triggered to close, and the mobile phone can determine that the folding screen is in the unfolded form.
  • a physical switch provided at the bending part of the folding screen For example, when the mobile phone receives a user's folding operation of the folding screen, the physical switch provided on the mobile phone is triggered to open, and the mobile phone can determine that the folding screen is in a folded form. When the mobile phone receives the user's unfolding operation of the folding screen, the physical switch set on the mobile phone is triggered to close, and the mobile phone can determine that the folding screen is in the unfolded form.
  • the mobile phone may also include at least one sensor 150, such as a light sensor, a motion sensor, a resistance sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor.
  • the ambient light sensor can adjust the brightness of the display panel 141 according to the brightness of the ambient light.
  • the proximity sensor can close the display panel 141 and/or when the mobile phone is moved to the ear. Or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three-axis), and can detect the magnitude and direction of gravity when it is stationary.
  • the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the mobile phone.
  • the audio circuit 160 can transmit the electrical signal converted from the received audio data to the speaker 161, which is converted into a sound signal for output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is then output by the audio circuit 160. After being received, it is converted into audio data, and then processed by the audio data output processor 180, and sent to, for example, another mobile phone via the RF circuit 110, or the audio data is output to the memory 120 for further processing.
  • WiFi is a short-distance wireless transmission technology.
  • the mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 170. It provides users with wireless broadband Internet access.
  • FIG. 1 shows the WiFi module 170, it is understandable that it is not a necessary component of a mobile phone, and can be omitted as needed without changing the essence of the invention.
  • the processor 180 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes by running or executing software programs and/or modules stored in the memory 120 and calling data stored in the memory 120. Various functions and processing data of the mobile phone can be used to monitor the mobile phone as a whole.
  • the processor 180 may include one or more processing units; preferably, the processor 180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, and application programs, etc. , The modem processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 180.
  • the mobile phone also includes a power source 190 (such as a battery) for supplying power to various components.
  • a power source 190 such as a battery
  • the power source can be logically connected to the processor 180 through a power management system, so that functions such as charging, discharging, and power management can be managed through the power management system.
  • the mobile phone may also include a camera.
  • the position of the camera on the mobile phone may be front or rear, which is not limited in the embodiment of the present application.
  • the mobile phone may include a single camera, a dual camera, or a triple camera, etc., which is not limited in the embodiment of the present application.
  • a mobile phone may include three cameras, of which one is a main camera, one is a wide-angle camera, and one is a telephoto camera.
  • the multiple cameras may be all front-mounted, or all rear-mounted, or partly front-mounted and some rear-mounted, which is not limited in the embodiment of the present application.
  • the mobile phone may also include a Bluetooth module, etc., which will not be repeated here.
  • Fig. 2 is a schematic diagram of the software structure of a mobile phone according to an embodiment of the present application.
  • the Android system is divided into four layers, namely the application layer, the application framework layer (framework, FWK), the system layer, and the hardware abstraction layer. Communication between layers is through software interface.
  • the application layer may include a series of application packages, which may include applications such as short message, calendar, camera, video, navigation, gallery, and call.
  • applications such as short message, calendar, camera, video, navigation, gallery, and call.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer may include some predefined functions, such as functions for receiving events sent by the application framework layer.
  • the application framework layer can include a window manager, a resource manager, and a notification manager.
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • the content provider is used to store and retrieve data and make these data accessible to applications.
  • the data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can disappear automatically after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, and so on.
  • the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.
  • the application framework layer can also include:
  • a view system the view system includes visual controls, such as controls that display text, controls that display pictures, and so on.
  • the view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.
  • the phone manager is used to provide the communication function of the mobile phone. For example, the management of the call status (including connecting, hanging up, etc.).
  • the system layer can include multiple functional modules. For example: sensor service module, physical state recognition module, 3D graphics processing library (for example: OpenGL ES), etc.
  • the sensor service module is used to monitor the sensor data uploaded by various sensors at the hardware layer to determine the physical state of the mobile phone;
  • Physical state recognition module used to analyze and recognize user gestures, faces, etc.
  • the 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the system layer can also include:
  • the surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the hardware abstraction layer is the layer between hardware and software.
  • the hardware abstraction layer can include display drivers, camera drivers, audio drivers, sensor drivers, etc., used to drive related hardware at the hardware layer, such as display screens, cameras, speakers, sensors, and so on.
  • the following embodiments can be implemented on a mobile phone having the above hardware structure/software structure.
  • the following embodiments will take a mobile phone as an example to illustrate the screenshot display method provided by the embodiments of the present application.
  • the screenshot display method provided by the embodiments of the present application can be applied to a mobile phone with a folding screen (hereinafter referred to as a folding screen mobile phone), and the folding screen can adopt an integrated flexible display, or two rigid screens and A display screen composed of a flexible screen located between two rigid screens.
  • the folding screen may include: a first display screen, a second display screen, and a bendable area connecting the first display screen and the second display screen.
  • the folding screen can be completely folded, that is, the angle between the first display screen and the second display screen is 0 degrees (it may not reach 0 degrees in practice, and the actual angle reported by the sensor in the mobile phone shall prevail. ), it can also be partially folded, that is, the angle between the first display screen and the second display screen is greater than 0 degrees and less than 180 degrees.
  • FIG. 3 shows a schematic flow chart of a screenshot display method provided by an embodiment of the present application.
  • the screenshot display method can be applied to the above-mentioned folding screen mobile phone, that is, when the folding screen mobile phone is in the folded state, the screenshot is taken
  • the first included angle between the first display screen and the second display screen can be recorded by the sensor in the folding screen mobile phone, and when the screenshot image is displayed, it can be realized according to the first included angle
  • the three-dimensional display of the screenshot image can fully reflect the folding and bending characteristics of the folding screen mobile phone, and improve the screen capture display effect of the folding screen mobile phone.
  • the screenshot display method may include:
  • the embodiment of the present application is preferably suitable for the screen capture display when the folding screen mobile phone is in the folded state, that is, when the folding screen mobile phone is unfolded to form a single screen mobile phone, the screen capture display function of the folding screen mobile phone can be compared with the traditional single screen mobile phone.
  • the screenshot display function of the screen mobile phone is the same, which is not limited in the embodiment of the present application.
  • the screenshot display method provided in the embodiments of the present application can also be an optional mode in the screenshot display mode of the folding screen mobile phone, that is, the 3D stereoscopic display mode for screenshot images can be set in advance in the folding screen mobile phone. For users to choose.
  • the folding screen mobile phone can obtain the first angle between the first display screen and the second display screen, and can separately Perform a screenshot operation on the current display content of the first display screen and the second display screen to obtain a first screenshot image corresponding to the first display screen and a second screenshot image corresponding to the second display screen, and
  • the folding screen mobile phone can perform the three-dimensional display of the first screenshot image and the second screenshot image according to the first included angle; if the user does not select the three-dimensional display mode, the Folding screen phones can directly screen and display content according to the conventional screen capture display mode.
  • the folding screen mobile phone may obtain the first included angle between the first display screen and the second display screen according to the detected screen capture instruction.
  • the screenshot instruction may be an instruction that triggers the generation of a preset button, an instruction that triggers the generation of a preset gesture, or an instruction that triggers the generation of a preset voice keyword, or it may be an instruction to start the screenshot function in the screenshot software.
  • the embodiment of this application does not impose any limitation on this instruction.
  • the screenshot software may be a mobile phone system software with a screenshot function or a third-party software with a screenshot function installed on the mobile phone.
  • the folding screen mobile phone can be preset to generate a screenshot instruction when the "volume +" button is triggered twice in a row, or it can be preset to generate a screenshot instruction when the "power on” button and the "home” button are triggered at the same time. Therefore, when the user continuously presses The "volume +" button twice, or when the user presses the "power on” button and the "home” button at the same time, the folding screen mobile phone can generate and obtain a screenshot command.
  • the folding screen mobile phone can also be preset to generate a screenshot instruction when a preset gesture such as a "C" gesture is collected.
  • the The folding screen mobile phone can generate and obtain the screen capture instruction.
  • the folding screen mobile phone can also be preset to generate a screenshot instruction when a preset voice keyword such as "screenshot” or “screenshot” is detected. Therefore, when the user input voice contains a preset such as "screenshot” or “screenshot”, etc.
  • the voice keyword is set, the folding screen mobile phone can generate and obtain the screen capture instruction.
  • the folding screen mobile phone detects that the user has opened the screenshot software and starts the screenshot function in the screenshot software, such as detecting that the screenshot button in the screenshot software is selected or clicked, the folding screen mobile phone can generate And get the screenshot instruction.
  • a resistance sensor may be provided in the bendable area between the first display screen and the second display screen, for example, a resistance sensor may be installed at the hinge of the bendable area , Calculate the first included angle between the first display screen and the second display screen based on the resistance change measured by the resistance sensor, or an angle sensor can be arranged at the hinge of the bendable area, The first angle between the first display screen and the second display screen is directly measured by the angle sensor.
  • the first included angle between the first display screen and the second display screen obtained by calculating the resistance change measured by the resistance sensor can be calculated by using an existing calculation method.
  • the embodiment of the present application There are no restrictions on this.
  • a gyroscope sensor may be provided in the first display screen and the second display screen respectively, so as to pass through the The gyro sensor measures the first included angle between the first display screen and the second display screen.
  • the direction vector z1 of the orientation of the first display screen can be obtained through the gyro sensor A provided in the first display screen (screen A shown in FIG. 4), and
  • the direction vector z2 of the orientation of the second display screen is obtained through the gyroscope sensor B provided in the second display screen (screen B shown in FIG. 4), and the direction vector z1 and the direction vector z2 can be calculated
  • the angle between ⁇ for example, can use the formula Calculate the angle ⁇ between the direction vector z1 and the direction vector z2.
  • the direction vector z1 of the orientation of the first display screen is perpendicular to the first display screen
  • the direction vector z1 and the direction vector z2 for obtaining the orientation of the second display screen in the coordinate system of the gyro sensor B can determine the first clip between the first display screen and the second display screen.
  • the origin of the coordinates of the gyro sensor A in the first display screen and the origin of the coordinates of the gyro sensor B in the second display screen do not overlap, that is, although the direction vector z1 and the direction vector z2 They are not in the same coordinate system, but because the coordinate system where the direction vector z1 is located is parallel to the axes of the coordinate system where the direction vector z2 is located, the formula can still be used
  • the included angle ⁇ between the direction vector z1 and the direction vector z2 is calculated, so that the first included angle ⁇ between the first display screen and the second display screen can be determined according to the included angle ⁇ .
  • a gravity sensor can also be provided in the first display screen and the second display screen respectively, that is, the gravity sensor A in the first display screen and the second display screen can be used.
  • the gravity sensor B in the measurement obtains the first included angle between the first display screen and the second display screen.
  • the foldable screen mobile phone can also set the first display screen and the second display screen respectively.
  • the current display content of the screen capture operation that is, the first display screen and the second display screen are captured separately, so as to obtain the first screen capture image corresponding to the first display screen and obtain the second display screen corresponding The second image.
  • the screenshot operation of the current display content in the first display screen may be a screenshot operation of all the content currently displayed on the first display screen, that is, it may be a screenshot of the entire content of the first display screen.
  • the screen may also be a screenshot operation of part of the content currently displayed on the first display screen, that is, it may also be a screenshot of a part of the screen of the first display screen.
  • the screenshot operation of the current display content in the second display screen may be a screenshot operation of all the content currently displayed on the second display screen, or it may be a screenshot operation of the part currently displayed on the second display screen. Take a screenshot of the content.
  • the screenshot area corresponding to the first display screen may be determined according to the screenshot frame corresponding to the first display screen, that is, the screenshot area corresponding to the first display screen may be determined according to the screenshot frame corresponding to the first display screen.
  • the size and position of the screenshot frame can be determined by the user, that is, the user can adjust the size and position of the screenshot frame.
  • a screenshot operation may be performed on part of the screen of the first display screen according to the screenshot frame A corresponding to the first display screen shown in FIG. 5a.
  • the screenshot area corresponding to the second display screen may be determined according to the screenshot frame corresponding to the second display screen, that is, the screenshot area corresponding to the second display screen may be determined according to the screenshot frame corresponding to the second display screen.
  • a screenshot operation can be performed on the entire screen of the second display screen according to the screenshot frame B corresponding to the second display screen shown in FIG.
  • the entire screen of the second display screen, and for the sake of clarity in Fig. 5a, the screenshot frame B only frames the area where the second display screen has display content.
  • the screenshot area corresponding to the first display screen and the screenshot area corresponding to the second display screen may also be determined respectively through the screenshot frames corresponding to the entire first display screen and the second display screen. That is, the screenshot area corresponding to the first display screen and the screenshot area corresponding to the second display screen can be determined according to the area selected by the screenshot frame in the first display screen and the second display screen respectively.
  • the entire screen of the first display screen and the entire screen of the second display screen may be captured according to the screenshot frame C shown in FIG. 5b.
  • a screenshot operation may be performed on a part of the screen of the first display screen according to the screenshot frame D shown in FIG. 5c, and a screenshot operation may be performed on the entire screen of the second display screen.
  • the screenshot area corresponding to the first display screen and the second display screen may also be determined by other existing methods, which is not limited in the embodiment of the present application.
  • the first screen capture image corresponding to the first display screen and the second screen capture image corresponding to the second display screen are obtained on the folding screen mobile phone, and the first screen capture image is obtained.
  • the screenshot image and the first included angle can be associated and saved. Specifically, when saving, the first screenshot image may be associated with the first display screen, the second screenshot image may be associated with the second display screen, and the first screenshot image may be associated with the second display screen.
  • the screenshot image is associated with the second screenshot image, and at the same time, the first included angle may be associated with the first screenshot image and/or the second screenshot image to perform three-dimensional display of the screenshot image.
  • the first screenshot image and/or the second screenshot image to be displayed can be obtained first, and then the first display screen corresponding to the first screenshot image, the second display screen corresponding to the second screenshot image, and the first screen image can be obtained according to the association relationship.
  • the first screenshot image, the second screenshot image, and the first included angle may be saved in the same file, and the first screenshot image and/or the second screenshot image and the The association relationship between the first included angles, and the display screens respectively associated with the first screenshot image and the second screenshot image are recorded at the same time.
  • the first screenshot image and the second screenshot image may be associated and saved in file A storing image information
  • the first angle may be saved in file B storing angle information
  • the first screenshot image may be saved in a file A that stores image information corresponding to the first display screen
  • the second screenshot image may be saved in a file that stores image information corresponding to the second display screen.
  • B save the first angle in file C storing angle information, and record the correlation between the image information in file A, the image information in file B, and the angle information in file C .
  • the screenshot display in the embodiment of the present application may also be a continuous screenshot display, for example, it may be a screen recording display.
  • the folding screen mobile phone can perform continuous screen capture operations on the current display content in the first display screen and the current display content in the second display screen, respectively, until the end of the screen recording is received So far.
  • the folding screen mobile phone can perform continuous screenshot operations on the current display content in the first display screen and the current display content in the second display screen respectively according to the preset video frame rate, and at the same time can be based on each video frame rate.
  • One screenshot of the screen corresponds to acquiring the first angle between the first display screen and the second display screen.
  • the acquisition frequency of the first angle needs to be consistent with the recorded video frame rate. That is to say, during the screen recording process, the first time axis corresponding to the first included angle and the second time axis corresponding to the first screenshot image and the second screenshot image can be constructed, and the first time The axis needs to be consistent with the second time axis.
  • the number of first included angles acquired within 1 second will also be 24, so that each video frame (including the first display screen)
  • the corresponding first screenshot image and the second screenshot image corresponding to the second display screen both have a corresponding first included angle, and the first time axis obtained by the first included angle and the second time axis of the video frame recording It needs to be consistent.
  • the acquisition time of the first angle corresponding to the first video frame is also T1
  • the recording time of the second video frame is T2
  • the acquisition time of the first angle corresponding to the second video frame is also T2
  • the recording time of the nth video frame is also Tn
  • the first angle corresponding to the nth video frame is acquired The time is also Tn.
  • the folding screen mobile phone when the folding screen mobile phone performs the associated storage of the video frame and the first angle, it can also perform the associated storage of the time axis, that is, the associated storage of the second time axis corresponding to the video frame and The first time axis corresponding to the first included angle, so that when the recorded video frame is displayed, the video frames to be displayed can be obtained according to the second time axis of the video frame, and the first time axis of the first included angle can be obtained.
  • a time axis respectively determines the first angle corresponding to each frame of video frame, so that the three-dimensional display of each frame of video frame can be performed according to the first angle corresponding to each frame of video frame, so as to fully reflect the folding and bending of the folding screen mobile phone Features to improve the screen recording display effect of folding screen mobile phones.
  • the folding screen mobile phone can display the screenshot image according to the detected display instruction.
  • the display instruction may be an instruction generated by clicking on the screenshot image, an instruction that triggers the generation of a preset button, an instruction that triggers the generation of a preset gesture, or an instruction that triggers the generation of a preset voice keyword Instructions, the embodiment of this application does not make any limitation on this.
  • the folding screen mobile phone when it receives a display instruction for the screenshot image, it can acquire the first screenshot image, the second screenshot image and the first angle associated therewith, and can compare the first screenshot image to the second screenshot image.
  • a screenshot image and the second screenshot image are displayed on the display screen of the folding screen mobile phone according to the first included angle.
  • the first screenshot image and the second screenshot image may be displayed on the first display screen of the folding screen mobile phone according to the first included angle, or the first screenshot image and the The second screenshot image is displayed on the second display screen of the folding screen mobile phone according to the first included angle.
  • the first screenshot image and the second screenshot image may be displayed on the first display screen and the second display screen of the folding screen mobile phone according to the first included angle.
  • the first display screen and the second display screen may be in an unfolded state or in a folded state, which is not limited in the embodiment of the present application.
  • the folding screen mobile phone may first determine the first plane corresponding to the first screenshot image and the second plane corresponding to the second screenshot image according to the first included angle, wherein the first plane The second included angle with the second plane is the same as the first included angle; then the first plane in the first plane can be determined according to the first display screen and the second display screen respectively Area and the second plane area in the second plane, that is, the first plane area in the first plane can be determined according to the first screen size of the first display screen and the preset zoom ratio and the first plane area in the first plane can be determined according to the first The second screen size of the second display screen and the preset zoom ratio determine the second plane area in the second plane, wherein the first plane area is connected to the second plane area, for example, according to The first included angle, the first display screen and the second display screen determine the first plane area and the second plane area as shown in FIG.
  • the first position information in the first display screen determines the first display position of the first screenshot image in the first display area, and the first screenshot image may be displayed in the first display position
  • the second display position of the second screenshot image in the second plane area can also be determined according to the second position information of the second screenshot image in the second display screen, and the second display position of the second screenshot image in the second plane area can be determined.
  • the second screenshot image is displayed in the second display position, so as to realize the three-dimensional display of the screenshot image. For example, in a specific application scenario, a three-dimensional display effect diagram as shown in FIG. 6b can be obtained.
  • first position information of the first screenshot image in the first display screen can be determined and recorded and saved when the screenshot is taken.
  • the second screenshot image is located in the second display screen.
  • the second location information can also be determined and recorded during screenshots.
  • the first location information and the second location information can be determined by existing location detection and/or determination methods. This does not make any restrictions.
  • multiple three-dimensional models corresponding to the folding screen mobile phone can be constructed in advance according to the folding angles that the folding screen of the folding screen mobile phone may have, and at the same time, the three-dimensional models constructed and the folding angles can be established.
  • the folding angle of the folding screen is the first included angle between the first display screen and the second display screen
  • the constructed three-dimensional model may include a first display screen corresponding to the first display screen.
  • the display area and the second display area corresponding to the second display screen, and the third included angle between the first display area and the second display area is the same as the folding angle corresponding to each three-dimensional model, that is,
  • the first included angle between the first display screen and the second display screen corresponding to each three-dimensional model is the same.
  • the folding angle of the folding screen is 10°
  • the 3D model A corresponding to the folding screen mobile phone can be constructed
  • the folding angle of the folding screen is 15°
  • the 3D model B corresponding to the folding screen mobile phone can be constructed
  • the folding angle is 80°
  • the three-dimensional model C corresponding to the folding screen mobile phone can be established corresponding to the three-dimensional model A corresponding to 10°, the three-dimensional model B corresponding to 15°, and the three-dimensional model C corresponding to 80°.
  • the three-dimensional model corresponding to the folding screen mobile phone can be constructed by the folding screen mobile phone or other terminal devices.
  • the constructed three-dimensional model can be stored in the storage of the folding screen mobile phone, or can be stored in The foldable screen mobile phone is connected to a cloud server or other terminal device.
  • the folding screen mobile phone or other terminal devices may use a 3D rendering engine (for example, Unity) to construct a three-dimensional model of the folding screen mobile phone at different folding angles.
  • a 3D rendering engine for example, Unity
  • the folding screen mobile phone or other terminal device can use the Mesh grid component in Unity to base the shape of the first display screen and the second display screen in the folding screen mobile phone and the first display screen and The first included angle between the second display screens is drawn to draw the first grid corresponding to the first display screen and the second display screen when the folding screen mobile phone is in the folded state of the first included angle
  • the included angle between the first grid and the second grid is the first included angle
  • the first grid and the second grid form The whole can be regarded as the three-dimensional model of the folding screen mobile phone at the first angle
  • the first grid may include the first display area described above
  • the second grid may include all the above The second display area described.
  • folding screen mobile phone or other terminal devices can also construct multiple three-dimensional models of the folding screen mobile phone at different folding angles through other existing construction methods corresponding to the 3D rendering engine. There are no restrictions.
  • the Angular obtains the three-dimensional model corresponding to the folding screen mobile phone, and then the first screenshot image can be rendered to the first display area of the three-dimensional model, and the second screenshot image can be rendered to the second display area of the three-dimensional model.
  • the display area, and finally the three-dimensional display of the screenshot image can be realized by displaying the three-dimensional model.
  • the first screenshot image can be rendered to the first display area of the three-dimensional model and the second screenshot image can be rendered to the first display area of the three-dimensional model through the image rendering function of the 3D rendering engine (for example, Unity).
  • the 3D rendering engine for example, Unity.
  • the dual display area is not limited in the embodiment of the application.
  • the folded state can be obtained first
  • the first included angle between the first display screen and the second display screen; the first included angle can then be obtained from the storage of the folding screen mobile phone or from a cloud server or other terminal device according to the first included angle.
  • the three-dimensional model corresponding to the first included angle; and then the first screenshot image captured from the first display screen can be rendered to the first display area of the acquired three-dimensional model, and from the second display screen
  • the captured second screenshot image is rendered to the second display area of the acquired three-dimensional model, and the display effect diagram as shown in FIG. 7b can be obtained by displaying the three-dimensional model.
  • the folding screen mobile phone may also directly save the first screenshot image and the second screenshot image in a three-dimensional mode. That is, during the screenshot process, when it is determined that the screenshot image needs to be three-dimensionally displayed, the folding screen mobile phone acquires the first screenshot image corresponding to the first display screen and the second screenshot image corresponding to the second display screen. And after the first included angle between the first display screen and the second display screen, the three-dimensional model corresponding to the first included angle can be directly obtained from the pre-built three-dimensional model according to the first included angle.
  • the first screenshot image can then be rendered to the first display area of the acquired three-dimensional model, and the second screenshot image can be rendered to the second display area of the acquired three-dimensional model, and then the
  • the three-dimensional model is stored in the storage of the folding screen mobile phone or the cloud server or other terminal equipment. Therefore, when the folding screen mobile phone or other terminal device receives a display instruction for the screenshot image, it can directly obtain the screenshot from the storage of the folding screen mobile phone, or from a cloud server or other terminal device in a wired or wireless manner.
  • the three-dimensional model corresponding to the image can then be displayed on the display screen of the folding screen mobile phone to increase the display speed of the three-dimensional display of the screenshot image and improve the user by acquiring the three-dimensional model and rendering the screenshot image in advance.
  • Experience is a display instruction for the screenshot image, it can directly obtain the screenshot from the storage of the folding screen mobile phone, or from a cloud server or other terminal device in a wired or wireless manner.
  • the three-dimensional model corresponding to the image can then be
  • the display angle corresponding to the three-dimensional model may be determined first, and the three-dimensional model may be displayed according to the display angle.
  • the angle facing the first display screen may be determined as the display angle
  • the angle facing the second display screen may be determined as the display angle
  • the angle facing the first display screen may be determined as the display angle
  • the angle of the bendable area between the display screen and the second display screen is determined as the display angle.
  • the display angle corresponding to the three-dimensional model may be determined according to a preset corresponding relationship between the three-dimensional model and the display angle, wherein the preset corresponding relationship may be established when the three-dimensional model is constructed, for example, When constructing a three-dimensional model, the preset corresponding relationship can be established according to the corresponding relationship set by the user; for example, when constructing a three-dimensional model, the preset corresponding relationship can be established according to the current display angle of the image in the folding screen mobile phone .
  • the display angle corresponding to the three-dimensional model can also be determined according to the display carrier (ie, terminal devices such as folding screen mobile phones) that the three-dimensional model is displayed at the time, that is, each terminal device such as a folding screen mobile phone itself Both can have a display angle for displaying the folded image, where the display angle can be customized by the user or can be defaulted by the terminal device system such as a folding screen mobile phone.
  • the display carrier ie, terminal devices such as folding screen mobile phones
  • the user can also adjust the viewing angle of viewing the screenshot image by sliding the screen up, down, left, and right, where the vertical, left, and right angles are both 360-degree rotatable viewing angles.
  • the folding screen mobile phone or other terminal device can construct the three-dimensional model corresponding to the folding screen mobile phone in real time, that is, in the process of displaying the screenshot image, the current folding screen mobile phone can be constructed in real time.
  • the corresponding three-dimensional model that is, the three-dimensional model of the folding screen mobile phone in the folding state when the screen capture operation is performed can be constructed in real time, so as to reduce the storage memory of the folding screen mobile phone or other terminal devices, reduce resource usage, and improve the folding screen The efficiency of the screenshot operation of the mobile phone.
  • the folding screen mobile phone or other terminal device may first obtain the attribute information corresponding to the folding screen mobile phone, where the attribute information may include the information of the first display screen and the second display screen in the folding screen mobile phone.
  • the shape and other information then the three-dimensional model corresponding to the folding screen mobile phone can be drawn according to the attribute information and the first included angle, wherein the drawn three-dimensional model can include a first display corresponding to the first display screen Area and a second display area corresponding to the second display screen, and the fourth included angle between the first display area and the second display area corresponds to that of the folding screen mobile phone when performing a screenshot operation
  • the folding angle is the same, that is, the fourth included angle is the same as the first included angle between the first display screen and the second display screen in the folding screen mobile phone when the screenshot operation is performed; finally, the The first screenshot image is rendered to the first display area of the three-dimensional model and the second screenshot image is rendered to the second display area of the three-dimensional model, and the three-dimensional stereoscopic image of the screenshot can be realized by
  • the folding screen mobile phone or other terminal devices can construct the current corresponding three-dimensional model of the folding screen mobile phone in real time through a 3D rendering engine (for example, Unity).
  • a 3D rendering engine for example, Unity
  • the folding screen mobile phone or other terminal device may first use the Mesh grid component in Unity to base on the attribute information corresponding to the folding screen mobile phone (for example, the shape of the first display screen and the second display screen in the attribute information) and The folding angle corresponding to the folding screen mobile phone during the screenshot operation is drawn, and the first grid corresponding to the first display screen and the second grid corresponding to the second display screen in the folding screen mobile phone at the folding angle are drawn.
  • Grid wherein the included angle between the first grid and the second grid is the same as the folding angle corresponding to the folding screen mobile phone during the screenshot operation, and the first grid may include the above
  • the second grid may include the second display area described above.
  • the first screenshot image can be rendered to the first display area of the three-dimensional model and the second screenshot image can be rendered to the second display area of the three-dimensional model through the image rendering function in Unity, and
  • the three-dimensional display of the screenshot image is performed by displaying the rendered three-dimensional model.
  • the display angle corresponding to the three-dimensional model may be determined first, and the three-dimensional model may be displayed according to the display angle.
  • the display angle is the same as the above-mentioned definition and determination method of the display angle, for the sake of brevity, it will not be repeated here.
  • the folding screen mobile phone may display a screenshot image according to the current folding state of the folding screen mobile phone.
  • the current folding state of the folding screen mobile phone is the same as the folding state when the screen capture operation is performed
  • the first screen shot image can be displayed directly on the first display screen of the folding screen mobile phone, and can be directly displayed in the first display screen of the folding screen mobile phone.
  • the second display screen of the folding screen mobile phone displays the second screenshot image, that is, the three-dimensional display of the screenshot image can be realized directly according to the folding screen mobile phone itself, without the need to construct or obtain a three-dimensional model;
  • an adjustment instruction can be output to instruct the user to adjust the folding state of the folding screen mobile phone, or to construct or obtain a three-dimensional model, and then based on the three-dimensional The model is used for the three-dimensional display of the screenshot image.
  • the folding screen mobile phone may first obtain the fifth included angle between the first display screen and the second display screen in the current folding state, and may determine the first display screen. Whether the fifth included angle is the same as the first included angle corresponding to the screenshot image; if the fifth included angle is the same as the first included angle corresponding to the screenshot image, the first included angle can be directly displayed on the first display screen.
  • a screenshot image, and the second screenshot image can be directly displayed on the second display screen; if the fifth included angle is not the same as the first included angle corresponding to the screenshot image, the screenshot image can be corresponded to The first included angle and the fifth included angle output an adjustment instruction to instruct the user to adjust the first display screen and/or the second display screen.
  • the fifth included angle and the fifth included angle may be adjusted according to the The first included angle outputs an adjustment instruction for adjusting the first display screen of the folding screen mobile phone in a clockwise direction or a counterclockwise direction to a preset angle to instruct the user to adjust the first display screen.
  • the folding screen mobile phone can continue to obtain the adjusted fifth angle between the first display screen and the second display screen. If the angle is the same as the first included angle corresponding to the screenshot image, the first screenshot image can be directly displayed on the first display screen, and the second screenshot image can be directly displayed on the second display screen ; If the adjusted fifth included angle is not the same as the first included angle corresponding to the screenshot image, the adjusted fifth included angle and the first included angle corresponding to the screenshot image can continue to output adjustment instructions to instruct the user to The first display screen and/or the second display screen are adjusted until the adjusted fifth included angle is the same as the first included angle corresponding to the screenshot image; or, if the adjusted fifth included angle is the same as the first included angle corresponding to the screenshot image; The first included angle corresponding to the screenshot image is not the same, then the three-dimensional model corresponding to the folding screen mobile phone in the folded state corresponding to the first included angle can be obtained or constructed, and then the screenshot image can be displayed on the folding screen mobile
  • the three-dimensional model is used to realize the three-dimensional display of the screenshot image, that is, the first screenshot image and the second screenshot image can be rendered in the first display area and the second display area of the three-dimensional model. , And then the three-dimensional model can be folded and displayed according to the current folding state of the folding screen mobile phone.
  • the embodiment of this application does not impose any limitation on the number of display screens of the folding screen mobile phone, that is, the embodiment of this application can not only be applied
  • the screenshot display when the folding screen mobile phone has two display screens can also be applied to the screenshot display when the folding screen mobile phone has three or more display screens.
  • the screen capture display principle when the folding screen mobile phone has three or more display screens is the same as the screen capture display principle when the folding screen mobile phone has two display screens.
  • the first included angle, and the screenshot images corresponding to the current display content in each display screen are respectively captured, and then each screenshot image can be displayed according to each included angle.
  • the three-dimensional model of the folding screen mobile phone during the screenshot operation can be obtained or constructed according to the included angles.
  • the three-dimensional model can include three or more display areas, and each screenshot image can be rendered to the three-dimensional model. In the display area corresponding to it, the three-dimensional model can then be displayed to realize the three-dimensional display of the screenshot image.
  • the first included angle between the first display screen and the second display screen may be first obtained, and the first display screen and the second display screen may be separately adjusted.
  • Perform a screenshot operation on the current display content of the second display screen to obtain a first screenshot image corresponding to the first display screen and a second screenshot image corresponding to the second display screen;
  • the first screenshot image and the second screenshot image are, in the embodiment of the present application, when taking a screenshot, the first included angle between the first display screen and the second display screen can be simultaneously acquired, so that when the screenshot image is displayed, the first screenshot image and the first included angle can be performed according to the first included angle.
  • the three-dimensional display of the second screenshot image can fully reflect the folding and bending characteristics of the terminal device with a folding screen, realize the three-dimensional display of the screenshot image, and improve the display effect of the screenshot image.
  • FIG. 8 shows a structural block diagram of a screenshot display device provided in an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.
  • the screenshot display device is applied to a terminal device with a folding screen, the folding screen includes a first display screen and a second display screen, and the screenshot display device may include:
  • the screenshot module 801 is used to obtain a first angle between the first display screen and the second display screen, and to take a screenshot of the current display content of the first display screen and the second display screen respectively Operate to obtain a first screenshot image corresponding to the first display screen and a second screenshot image corresponding to the second display screen;
  • the display module 802 is configured to display the first screenshot image and the second screenshot image according to the first included angle.
  • the display module 802 may include:
  • the plane determining unit is configured to determine, according to the first included angle, a first plane corresponding to the first screenshot image and a second plane corresponding to the second screenshot image, one of the first plane and the second plane
  • the second included angle between is the same as the first included angle
  • An area determining unit configured to determine a first plane area in the first plane and a second plane area in the second plane according to the first display screen and the second display screen, respectively;
  • the first display unit is configured to display the first screenshot image in the first plane area, and display the second screenshot image in the second plane area.
  • the first display unit may include:
  • the first position determining subunit is configured to determine the first display position of the first screenshot image in the first display area according to the first position information of the first screenshot image in the first display screen;
  • a second position determining subunit configured to determine a second display position of the second screenshot image in the second plane area according to the second position information of the second screenshot image in the second display screen;
  • the first display sub-unit is configured to display the first screenshot image in the first display position and display the second screenshot image in the second display position.
  • the display module 802 may include:
  • a model acquisition unit configured to acquire a three-dimensional model corresponding to the terminal device according to the first included angle, the three-dimensional model including a first display area corresponding to the first display screen and a first display area corresponding to the second display screen
  • the second display area, the third included angle between the first display area and the second display area is the same as the first included angle;
  • a first image rendering unit configured to render the first screenshot image to a first display area of the three-dimensional model, and render the second screenshot image to a second display area of the three-dimensional model;
  • the second display unit is used to display the three-dimensional model.
  • the second display unit is specifically configured to determine a display angle corresponding to the three-dimensional model, and display the three-dimensional model according to the display angle.
  • the display module 802 may further include:
  • An attribute information obtaining unit configured to obtain attribute information corresponding to the terminal device
  • a model construction unit configured to draw a three-dimensional model corresponding to the terminal device according to the attribute information and the first included angle, the three-dimensional model including a first display area corresponding to the first display screen and A second display area corresponding to the second display screen, where a fourth included angle between the first display area and the second display area is the same as the first included angle;
  • a second image rendering unit configured to render the first screenshot image to the first display area of the three-dimensional model, and render the second screenshot image to the second display area of the three-dimensional model
  • the third display unit is used to display the three-dimensional model.
  • the display module 802 may further include:
  • a first included angle acquiring unit configured to acquire a fifth included angle between the first display screen and the second display screen
  • the fourth display unit is configured to display the first screenshot image on the first display screen and display the first screenshot image on the second display screen if the fifth included angle is the same as the first included angle
  • the instruction output unit is configured to output an adjustment instruction according to the first included angle and the fifth included angle if the fifth included angle is different from the first included angle to instruct the user to The display screen and/or the second display screen are adjusted.
  • the display module 802 may further include:
  • a second included angle acquiring unit configured to acquire a fifth included angle between the first display screen and the second display screen
  • a fifth display unit configured to display the first screenshot image on the first display screen and display the first screenshot image on the second display screen if the fifth included angle is the same as the first included angle
  • the sixth display unit is configured to display the first screenshot image and the second screenshot image according to the first included angle if the fifth included angle is different from the first included angle.
  • the screenshot display device may further include:
  • the time axis construction module is used to construct a first time axis corresponding to the first included angle and a second time axis corresponding to the first screenshot image and the second screenshot image, wherein the first time axis and Corresponding to the second time axis;
  • the display module 802 may further include:
  • the third included angle acquiring unit is configured to acquire the first screenshot image and the second screenshot image according to the second time axis, and acquire the first screenshot image and the first screenshot image according to the first time axis 2.
  • the seventh display unit is configured to display the first screenshot image and the second screenshot image according to the first included angle.
  • FIG. 9 is a schematic structural diagram of a terminal device provided by an embodiment of the application.
  • the terminal device 9 of this embodiment includes: at least one sensor 93 (only one is shown in FIG. 9), a folding screen 94, at least one processor 90 (only one is shown in FIG. 9), and a memory 91 And a computer program 92 that is stored in the memory 91 and can run on the at least one processor 90, and the processor 90 implements the steps in any of the above-mentioned screenshot display method embodiments when the computer program 92 is executed.
  • the terminal device 9 may include, but is not limited to, a processor 90 and a memory 91.
  • FIG. 9 is only an example of the terminal device 9 and does not constitute a limitation on the terminal device 9. It may include more or less components than shown in the figure, or a combination of certain components, or different components. , For example, can also include input and output devices, network access devices, and so on.
  • the processor 90 may be a central processing unit (Central Processing Unit, CPU), and the processor 90 may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), and application specific integrated circuits (Application Specific Integrated Circuits). , ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the memory 91 may be an internal storage unit of the terminal device 9 in some embodiments, such as a hard disk or memory of the terminal device 9. In other embodiments, the memory 91 may also be an external storage device of the terminal device 9, such as a plug-in hard disk equipped on the terminal device 9, a smart media card (SMC), a secure digital (Secure Digital, SD) card, flash card (Flash Card), etc. Further, the memory 91 may also include both an internal storage unit of the terminal device 9 and an external storage device. The memory 91 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 91 can also be used to temporarily store data that has been output or will be output.
  • a boot loader BootLoader
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in each of the above-mentioned screenshot display method embodiments can be realized.
  • the embodiments of the present application also provide a computer program product.
  • the terminal device can implement the steps in the above-mentioned screenshot display method embodiments when the terminal device is executed.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the computer program can be stored in a computer-readable storage medium.
  • the computer program can be stored in a computer-readable storage medium.
  • the steps of the foregoing method embodiments can be implemented.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms.
  • the computer-readable storage medium may at least include: any entity or device capable of carrying computer program code to the device/terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), and random access memory (RAM, Random Access Memory), electric carrier signal, telecommunications signal and software distribution medium.
  • ROM read-only memory
  • RAM random access memory
  • electric carrier signal telecommunications signal and software distribution medium.
  • U disk mobile hard disk, floppy disk or CD-ROM, etc.
  • computer-readable storage media cannot be electrical carrier signals and telecommunication signals.
  • the disclosed device/terminal device and method may be implemented in other ways.
  • the device/terminal device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units.
  • components can be combined or integrated into another system, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本申请适用于终端技术领域,尤其涉及基于人工智能(Artificial Intelligence,AI)终端的截屏显示方法、装置和终端设备。所述截屏显示方法应用于具有折叠屏的终端设备,折叠屏包括第一显示屏和第二显示屏,所述截屏显示方法获取第一显示屏和第二显示屏之间的第一夹角,并分别对第一显示屏和第二显示屏的当前显示内容进行截屏操作,得到第一显示屏对应的第一截屏图像和第二显示屏对应的第二截屏图像;根据第一夹角显示第一截屏图像和第二截屏图像。通过在截屏时获取第一显示屏和第二显示屏之间的第一夹角,以使得可根据第一夹角进行第一截屏图像和第二截屏图像的三维立体显示,充分体现出具有折叠屏的终端设备的折叠、弯曲特性,提高截屏图像的显示效果。

Description

截屏显示方法、装置和终端设备
本申请要求于2019年11月22日提交国家知识产权局、申请号为201911155018.8、申请名称为“截屏显示方法、装置和终端设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请属于终端技术领域,尤其涉及基于人工智能(Artificial Intelligence,AI)终端的截屏显示方法、装置和终端设备。
背景技术
随着折叠屏技术的不断发展,具有折叠屏的终端设备开始逐渐面市。与传统的终端设备一样,具有折叠屏的终端设备也具有截屏、录屏的功能,即用户在使用具有折叠屏的终端设备进行文本、图像等内容的浏览时,可使用截屏或录屏功能来截取或录制显示屏中的当前显示内容并进行保存,以方便用户的后续查看。
现有的具有折叠屏的终端设备进行截屏或录屏时,往往分别截取各屏对应的图像,并根据各屏之间的连接关系将各屏对应的图像整合为一完整平面图像并进行保存,在进行截屏图像的显示时,则直接进行该完整平面图像的显示。现有的这种截屏显示方式并未充分体现出具有折叠屏的终端设备的显示特性,造成具有折叠屏的终端设备的截屏显示效果差。
发明内容
本申请实施例提供了一种截屏显示方法、装置和终端设备,可以解决现有的具有折叠屏的终端设备的截屏显示效果差的问题。
第一方面,本申请实施例提供了一种截屏显示方法,应用于具有折叠屏的终端设备,所述折叠屏包括第一显示屏和第二显示屏,所述截屏显示方法,可以包括:
获取所述第一显示屏和所述第二显示屏之间的第一夹角,并分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;
根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
需要说明的是,可以在所述第一显示屏和所述第二显示屏之间的可弯折区设置电阻传感器,以通过电阻传感器测得的电阻变化来得到所述第一显示屏和所述第二显示屏之间的第一夹角。或者,可以分别在所述第一显示屏和所述第二显示屏中设置一重力传感器/陀螺仪传感器,以通过所述第一显示屏和所述第二显示屏中的重力传感器/陀螺仪传感器测量得到所述第一显示屏和所述第二显示屏之间的第一夹角。
应理解,对所述第一显示屏中的当前显示内容进行截屏操作可以是对所述第一显示屏当前显示的全部内容进行截屏操作,即可以是截取所述第一显示屏的整个屏幕,也可以是对所述第一显示屏当前显示的部分内容进行截屏操作,即也可以是截取所述第一显示屏的部分屏幕。同样地,对所述第二显示屏中的当前显示内容进行截屏操作可以是对所述第二显示屏当前显示的全部内容进行截屏操作,也可以是对所述第二显示屏当前显示的部分内容进行截屏操作。
在第一方面的一种可能的实现方式中,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像,可以包括:
根据所述第一夹角确定所述第一截屏图像对应的第一平面和所述第二截屏图像对应的第二平面,所述第一平面和所述第二平面之间的第二夹角与所述第一夹角相同;
根据所述第一显示屏和所述第二显示屏分别确定所述第一平面中的第一平面区域和所述第二平面中的第二平面区域;
在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像。
示例的,可以根据所述第一显示屏的第一屏幕大小和预设缩放比例确定所述第一平面中的第一平面区域和根据所述第二显示屏的第二屏幕大小和所述预设缩放比例确定所述第二平面中的第二平面区域,其中,所述第一平面区域与所述第二平面区域相连接。
具体地,所述在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像,可以包括:
根据所述第一截屏图像在所述第一显示屏中的第一位置信息确定所述第一截屏图像在所述第一显示区域中的第一显示位置;
根据所述第二截屏图像在所述第二显示屏中的第二位置信息确定所述第二截屏图像在所述第二平面区域中的第二显示位置;
在所述第一显示位置中显示所述第一截屏图像,并在所述第二显示位置中显示所述第二截屏图像。
需要说明的是,所述第一截屏图像在所述第一显示屏中的第一位置信息可以在截屏时进行确定并记录保存,同样地,所述第二截屏图像在所述第二显示屏中的第二位置信息也可以在截屏时进行确定并记录保存。
在第一方面的一种可能的实现方式中,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像,可以包括:
根据所述第一夹角获取所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第三夹角与所述第一夹角相同;
将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
显示所述三维模型。
应理解,可事先根据终端设备的折叠屏可能具有的折叠角度构建该终端设备对应的多个三维模型,同时可以建立所构建的各三维模型与折叠角度之间的对应关系,以在进行截屏图像的显示时,可根据该对应关系获取与所述第一夹角对应的三维模型,并通过三维模型来进行截屏图像的三维立体显示。
具体地,所述显示所述三维模型,可以包括:
确定所述三维模型对应的显示角度,并根据所述显示角度显示所述三维模型。
示例的,可以将正对所述第一显示屏的角度确定为所述显示角度,或者可以将正对所述第二显示屏的角度确定为所述显示角度,还可以将正对所述第一显示屏和所述第二显示屏之间的可弯折区的角度确定为所述显示角度。
应理解,所述显示角度可根据三维模型与显示角度之间的预设对应关系确定,其中,所述预设对应关系可以在构建三维模型时建立,例如,在构建三维模型时,可以根据用户设定的对应关系建立所述预设对应关系;例如,在构建三维模型时,可以根据终端设备中图像的当前显示角度建立所述预设对应关系。
在第一方面的另一种可能的实现方式中,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像,可以包括:
获取所述终端设备对应的属性信息;
根据所述属性信息和所述第一夹角绘制所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第四夹角与所述第一夹角相同;
将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
显示所述三维模型。
需要说明的是,可以通过3D渲染引擎来构建终端设备对应的三维模型。其中,所述属性信息可以包括终端设备中所述第一显示屏和所述第二显示屏的外形等信息,3D渲染引擎可以根据所述属性信息和所述第一夹角来绘制该终端设备对应的三维模型。
在第一方面的一种可能的实现方式中,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像,可以包括:
获取所述第一显示屏与所述第二显示屏之间的第五夹角;
若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角和所述第五夹角输出调整指令,以指示用户对所述第一显示屏和/或所述第二显示屏进行调整。
在第一方面的另一种可能的实现方式中,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像,可以包括:
获取所述第一显示屏与所述第二显示屏之间的第五夹角;
若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
应理解,本申请实施例可以根据终端设备的当前折叠状态来进行截屏图像的显示。具体地,当终端设备的当前折叠状态与进行截屏操作时的折叠状态相同时,则可以直接在终端设备的第一显示屏中进行第一截屏图像的显示,并可以直接在终端设备的第二显示屏中进行第二截屏图像的显示,即可以直接依据终端设备本身来实现截屏图像的三维立体显示,而不需要再进行三维模型的构建或者获取;而当终端设备的当前折叠状态与进行截屏操作时的折叠状态不相同时,则可以输出调整指令来指示用户对终端设备进行折叠状态的调整,或者再进行三维模型的构建或获取,然后基于三维模型来进行截屏图像的三维立体显示。
可选地,所述截屏显示方法,还可以包括:
构建所述第一夹角对应的第一时间轴以及所述第一截屏图像和所述第二截屏图像对应的第二 时间轴,其中,所述第一时间轴和所述第二时间轴相对应;
所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
根据所述第二时间轴获取所述第一截屏图像和所述第二截屏图像,并根据所述第一时间轴获取所述第一截屏图像和所述第二截屏图像对应的第一夹角;
根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
需要说明的是,在连续截屏场景中,还可以进行时间轴的构建,即在进行截屏图像和第一夹角的获取时,还可以构建第一夹角对应的第一时间轴和截屏图像对应的第二时间轴,其中,第一时间轴与第二时间轴相一致,从而可以根据截屏图像对应的第二时间轴获取各帧截屏图像,并可根据第一夹角对应的第一时间轴分别确定各帧截屏图像对应的第一夹角,从而可以根据各帧截屏图像对应的第一夹角来进行各帧截屏图像连续的三维立体显示。
第二方面,本申请实施例提供了一种截屏显示装置,应用于具有折叠屏的终端设备,所述折叠屏包括第一显示屏和第二显示屏,所述截屏显示装置包括:
截屏模块,用于获取所述第一显示屏和所述第二显示屏之间的第一夹角,并分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;
显示模块,用于根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
在第二方面的一种可能的实现方式中,所述显示模块包括:
平面确定单元,用于根据所述第一夹角确定所述第一截屏图像对应的第一平面和所述第二截屏图像对应的第二平面,所述第一平面和所述第二平面之间的第二夹角与所述第一夹角相同;
区域确定单元,用于根据所述第一显示屏和所述第二显示屏分别确定所述第一平面中的第一平面区域和所述第二平面中的第二平面区域;
第一显示单元,用于在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像。
可选地,所述第一显示单元包括:
第一位置确定分单元,用于根据所述第一截屏图像在所述第一显示屏中的第一位置信息确定所述第一截屏图像在所述第一显示区域中的第一显示位置;
第二位置确定分单元,用于根据所述第二截屏图像在所述第二显示屏中的第二位置信息确定所述第二截屏图像在所述第二平面区域中的第二显示位置;
第一显示分单元,用于在所述第一显示位置中显示所述第一截屏图像,并在所述第二显示位置中显示所述第二截屏图像。
在第二方面的一种可能的实现方式中,所述显示模块包括:
模型获取单元,用于根据所述第一夹角获取所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第三夹角与所述第一夹角相同;
第一图像渲染单元,用于将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
第二显示单元,用于显示所述三维模型。
示例的,所述第二显示单元,具体用于确定所述三维模型对应的显示角度,并根据所述显示角度显示所述三维模型。
在第二方面的另一种可能的实现方式中,所述显示模块包括:
属性信息获取单元,用于获取所述终端设备对应的属性信息;
模型构建单元,用于根据所述属性信息和所述第一夹角绘制所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第四夹角与所述第一夹角相同;
第二图像渲染单元,用于将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
第三显示单元,用于显示所述三维模型。
在第二方面的一种可能的实现方式中,所述显示模块包括:
第一夹角获取单元,用于获取所述第一显示屏与所述第二显示屏之间的第五夹角;
第四显示单元,用于若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
指令输出单元,用于若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角和所述第五夹角输出调整指令,以指示用户对所述第一显示屏和/或所述第二显示屏进行调整。
在第二方面的另一种可能的实现方式中,所述显示模块包括:
第二夹角获取单元,用于获取所述第一显示屏与所述第二显示屏之间的第五夹角;
第五显示单元,用于若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
第六显示单元,用于若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
可选地,所述截屏显示装置还包括:
时间轴构建模块,用于构建所述第一夹角对应的第一时间轴以及所述第一截屏图像和所述第二截屏图像对应的第二时间轴,其中,所述第一时间轴和所述第二时间轴相对应;
相应地,所述显示模块,还包括:
第三夹角获取单元,用于根据所述第二时间轴获取所述第一截屏图像和所述第二截屏图像,并根据所述第一时间轴获取所述第一截屏图像和所述第二截屏图像对应的第一夹角;
第七显示单元,用于根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
第三方面,本申请实施例提供了一种终端设备,包括折叠屏、传感器、存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述第一方面中任一项所述的截屏显示方法。
第四方面,本申请实施例提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现上述第一方面中任一项所述的截屏显示方法。
第五方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在终端设备上运行时,使得终端设备执行上述第一方面中任一项所述的截屏显示方法。
可以理解的是,上述第二方面至第五方面的有益效果可以参见上述第一方面中的相关描述,在此不再赘述。
本申请实施例与现有技术相比存在的有益效果是:
本申请实施例中,在接收到截屏指令时,可以首先获取所述第一显示屏和所述第二显示屏之间的第一夹角,并可以分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作, 得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;然后可以根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。即本申请实施例在截屏时,可以同时获取第一显示屏和第二显示屏之间的第一夹角,使得在进行截屏图像的显示时可以根据第一夹角来进行第一截屏图像和第二截屏图像的三维立体显示,以充分体现出具有折叠屏的终端设备的折叠、弯曲特性,实现截屏图像的三维立体显示,提高截屏图像的显示效果。
附图说明
图1是本申请一实施例提供的截屏显示方法所适用于的手机的结构示意图;
图2是本申请一实施例提供的截屏显示方法所适用于的手机的软件架构示意图;
图3是本申请一实施例提供的截屏显示方法的流程示意图;
图4是本申请一实施例提供的截屏显示方法在一个应用场景下确定第一夹角的示意图;
图5a至图5c是本申请一实施例提供的截屏显示方法在具体应用场景下的截屏示意图;
图6a是本申请一实施例提供的截屏显示方法在一应用场景下所确定的平面区域的示意图;
图6b是本申请一实施例提供的截屏显示方法在图6a所确定的平面区域中进行截屏图像显示的示意图;
图7a是本申请一实施例提供的应用场景示意图;
图7b是本申请一实施例对图7a所示的应用场景进行截屏显示的示意图;
图8是本申请实施例提供的截屏显示装置的结构示意图;
图9是本申请实施例提供的终端设备的结构示意图。
具体实施方式
以下描述中,为了说明而不是为了限定,提出了诸如特定***结构、技术之类的具体细节,以便透彻理解本申请实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中,省略对众所周知的***、装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。
应当理解,当在本申请说明书和所附权利要求书中使用时,术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在,但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。
还应当理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。
如在本申请说明书和所附权利要求书中所使用的那样,术语“如果”可以依据上下文被解释为“当...时”或“一旦”或“响应于确定”或“响应于检测到”。类似地,短语“如果确定”或“如果检测到[所描述条件或事件]”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦检测到[所描述条件或事件]”或“响应于检测到[所描述条件或事件]”。
另外,在本申请说明书和所附权利要求书的描述中,术语“第一”、“第二”、“第三”等仅用于区分描述,而不能理解为指示或暗示相对重要性。
在本申请说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”,除非是 以其他方式另外特别强调。
本申请实施例提供的截屏显示方法可以应用于手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本、个人数字助理(personal digital assistant,PDA)等终端设备上,本申请实施例对终端设备的具体类型不作任何限制。
以所述终端设备为手机为例。图1示出的是与本申请实施例提供的手机的部分结构的框图。参考图1,手机包括:射频(Radio Frequency,RF)电路110、存储器120、输入单元130、显示单元140、传感器150、音频电路160、无线保真(wireless fidelity,WiFi)模块170、处理器180、以及电源190等部件。本领域技术人员可以理解,图1中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面结合图1对手机的各个构成部件进行具体的介绍:
RF电路110可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给处理器180处理;另外,将设计上行的数据发送给基站。通常,RF电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier,LNA)、双工器等。此外,RF电路110还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯***(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE))、电子邮件、短消息服务(Short Messaging Service,SMS)等。
存储器120可用于存储软件程序以及模块,处理器180通过运行存储在存储器120的软件程序以及模块,从而执行手机的各种功能应用以及数据处理。存储器120可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作***、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器120可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元130可用于接收输入的数字或字符信息,以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地,输入单元130可以包括触控面板131以及其他输入设备132。触控面板131,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板131上或在触控面板131附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,触控面板131可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器180,并能接收处理器180发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板131。除了触控面板131,输入单元130还可以包括其他输入设备132。具体地,其他输入设备132可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元140可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元140可包括显示面板141,可选的,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板141。进一步的, 触控面板131可覆盖显示面板141,当触控面板131检测到在其上或附近的触摸操作后,传送给处理器180以确定触摸事件的类型,随后处理器180根据触摸事件的类型在显示面板141上提供相应的视觉输出。虽然在图1中,触控面板131与显示面板141是作为两个独立的部件来实现手机的输入和输出功能,但是在某些实施例中,可以将触控面板131与显示面板141集成而实现手机的输入和输出功能。
在一些实施例中,显示单元140可以包括1个或N个显示屏,其中,N为大于1的正整数。
在一些实施例中,当显示面板采用OLED、AMOLED、FLED等材料时,上述显示屏可以被弯折。这里,上述显示屏可以被弯折是指显示屏可以在任意部位沿任意轴线被弯折到任意角度,并可以在该角度保持,例如,显示屏可以从中部左右对折。也可以从中部上下对折。本申请实施例中,可以将被弯折的显示屏称为折叠屏。其中,该折叠屏可以是一块屏幕,也可以是多块屏幕拼凑在一起组合成的显示屏,在此不做限定。显示屏还可以是一种柔性屏,具有柔韧性强和可弯曲的特点,可以给用户提供基于可弯折特性的新交互方式,可以满足用户对于折叠屏手机的更多需求。对于配置有折叠屏的手机而言,手机上的折叠屏可以随时在折叠形态下的小屏和展开形态下的大屏之间切换。
示例性的,折叠屏可以至少包括两种物理形态:展开形态和折叠形态。展开形态,即指可以从中部左右对折的该折叠屏的中间弯折部位的左右两端(如果折叠屏是上下折叠,则是折叠屏的中间弯折部位的上下两端)所成的夹角在180度和第一角度之间,其中,第一角度大于0度且小于180度,例如第一角度可以是90度)。折叠形态,即指该折叠屏的中间弯折部位的左右两端(如果折叠屏是上下折叠,则是折叠屏的中间弯折部位的上下两端)所成的夹角在0度和第一角度之间。本申请实施例中,进入展开形态后的该折叠屏的显示区域可以被划分为第一显示屏和第二显示屏。该折叠屏在展开形态下可以朝着第一显示屏和第二显示屏相面对的方向折叠,也可以朝着第一显示屏和第二显示屏相背对的方向折叠。在一些实施例中,折叠屏中部弯折部位的左右两端(如果折叠屏是上下折叠,则是折叠屏的中间弯折部位的上下两端)所成的夹角可以在0度到+180度之间。例如,折叠屏可以往朝着第一显示屏和第二显示屏相面对的方向弯折成夹角为30度的折叠形态,也可以往朝着第一显示屏和第二显示屏相背对的方向弯折成夹角30度的折叠形态。
在一些实施例中,该手机可以通过重力传感器、加速度传感器和陀螺仪中的一个或多个,判断该折叠屏处于折叠形态还是处于展开形态。该手机还可以通过重力传感器、加速度触感器和陀螺仪,检测该折叠屏的弯折的夹角,然后,该手机可以根据该弯折的夹角,判断出该折叠屏处于折叠形态还是处于展开形态。该手机还可以通过重力传感器、加速度传感器和陀螺仪中的一个或多个,判断折叠形态下,该折叠屏的朝向,进而确定出显示***所输出界面内容的显示区域。例如,当该折叠屏的第一显示屏相对于地面朝向上方时,该手机可以将显示***输出的界面内容,显示在第一显示屏上。当该折叠屏的第二显示屏相对于地面朝向上方时,该手机可以将显示***输出的界面内容,显示在第二显示屏上。
在一些实施例中,该手机还可以包括角度传感器(图1中未示出),该角度传感器可以设置在该折叠屏的弯折部位处。该手机可以通过设置在该折叠屏的弯折部位的角度传感器(图1中未示出),测量该折叠屏中间弯折部位两端所成的夹角,当该夹角大于或等于第一角度时,该手机可以通过角度传感器识别出该折叠屏进入展开状态。当该夹角小于或等于第一角度时,该手机可以通过角度传感器识别出该折叠屏进入折叠形态。
在其他一些实施例中,该手机也可以通过设置在该折叠屏的弯折部位的物理开关,识别出该 折叠屏是否处于折叠形态。例如,当手机接收到用户对该折叠屏的折叠操作,该设置在该手机上的物理开关被触发打开,该手机可以确定该折叠屏处于折叠形态。当该手机接收到用户对该折叠屏的展开操作,该设置在该手机上的物理开关被触发关闭,手机可以确定该折叠屏处于展开形态。上述示例仅仅用于解释本申请,不应构成限定。
手机还可包括至少一种传感器150,比如光传感器、运动传感器、电阻传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板141的亮度,接近传感器可在手机移动到耳边时,关闭显示面板141和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
音频电路160、扬声器161,传声器162可提供用户与手机之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号,传输到扬声器161,由扬声器161转换为声音信号输出;另一方面,传声器162将收集的声音信号转换为电信号,由音频电路160接收后转换为音频数据,再将音频数据输出处理器180处理后,经RF电路110以发送给比如另一手机,或者将音频数据输出至存储器120以便进一步处理。
WiFi属于短距离无线传输技术,手机通过WiFi模块170可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图1示出了WiFi模块170,但是可以理解的是,其并不属于手机的必须构成,完全可以根据需要在不改变发明的本质的范围内而省略。
处理器180是手机的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器120内的软件程序和/或模块,以及调用存储在存储器120内的数据,执行手机的各种功能和处理数据,从而对手机进行整体监控。可选的,处理器180可包括一个或多个处理单元;优选的,处理器180可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作***、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器180中。
手机还包括给各个部件供电的电源190(比如电池),优选的,电源可以通过电源管理***与处理器180逻辑相连,从而通过电源管理***实现管理充电、放电、以及功耗管理等功能。
尽管未示出,手机还可以包括摄像头。可选地,摄像头在手机的上的位置可以为前置的,也可以为后置的,本申请实施例对此不作限定。
可选地,手机可以包括单摄像头、双摄像头或三摄像头等,本申请实施例对此不作限定。
例如,手机可以包括三摄像头,其中,一个为主摄像头、一个为广角摄像头、一个为长焦摄像头。
可选地,当手机包括多个摄像头时,这多个摄像头可以全部前置,或者可以全部后置,或者可以一部分前置、另一部分后置,本申请实施例对此不作限定。
另外,尽管未示出,手机还可以包括蓝牙模块等,在此不再赘述。
图2是本申请实施例的手机的软件结构示意图。以手机的操作***为Android***为例,在一些实施例中,将Android***分为四层,分别为应用程序层、应用程序框架层(framework,FWK)、***层以及硬件抽象层,层与层之间通过软件接口通信。
如图2所示,所述应用程序层可以包括一系列应用程序包,应用程序包可以包括短信息,日历,相机,视频,导航,图库,通话等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层可以包括一些预先定义的函数,例如用于接收应用程序框架层所发送的事件的函数。
如图2所示,应用程序框架层可以包括窗口管理器、资源管理器以及通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在***顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
应用程序框架层还可以包括:
视图***,所述视图***包括可视控件,例如显示文字的控件,显示图片的控件等。视图***可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供手机的通信功能。例如通话状态的管理(包括接通,挂断等)。
***层可以包括多个功能模块。例如:传感器服务模块,物理状态识别模块,三维图形处理库(例如:OpenGL ES)等。
传感器服务模块,用于对硬件层各类传感器上传的传感器数据进行监测,确定手机的物理状态;
物理状态识别模块,用于对用户手势、人脸等进行分析和识别;
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
***层还可以包括:
表面管理器用于对显示子***进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
硬件抽象层是硬件和软件之间的层。硬件抽象层可以包括显示驱动,摄像头驱动,音频驱动,传感器驱动等,用于驱动硬件层的相关硬件,如显示屏、摄像头、扬声器、传感器等。
以下实施例可以在具有上述硬件结构/软件结构的手机上实现。以下实施例将以手机为例,对本申请实施例提供的截屏显示方法进行说明。
具体地,本申请实施例提供的截屏显示方法可以应用于具有折叠屏的手机(以下将简称为折叠屏手机),其折叠屏可以采用一个一体的柔性显示屏,也可以采用两个刚性屏以及位于两个刚性屏之间的一个柔性屏组成的显示屏。该折叠屏可以包括:第一显示屏、第二显示屏以及连接第一显示屏和第二显示屏的可弯折区。其中,该折叠屏可以完全折叠,即所述第一显示屏和所述第 二显示屏之间的夹角为0度(实际可能达不到0度,具体以手机中传感器实际上报角度为准),也可以部分折叠,即所说第一显示屏和所述第二显示屏之间的夹角大于0度且小于180度。
图3示出了本申请实施例提供的截屏显示方法的流程示意图,作为示例而非限定,所述截屏显示方法可以应用于上述的折叠屏手机,即当该折叠屏手机在折叠状态下进行截屏时,可通过该折叠屏手机中的传感器记录所述第一显示屏和所述第二显示屏之间的第一夹角,并在进行截屏图像的显示时,可以根据该第一夹角实现截屏图像的三维立体显示,以充分体现折叠屏手机的折叠、弯曲特性,提高折叠屏手机的截屏显示效果。具体地,如图3所示,所述截屏显示方法可以包括:
S301、获取所述第一显示屏和所述第二显示屏之间的第一夹角,并分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像。
应理解,本申请实施例优选适用于折叠屏手机处于折叠状态时的截屏显示,即当该折叠屏手机展开形成一单面屏手机时,该折叠屏手机的截屏显示功能则可以与传统单面屏手机的截屏显示功能相同,本申请实施例对此不作限定。
需要说明的是,本申请实施例提供的截屏显示方法也可以是折叠屏手机中截屏显示模式中的一种可选模式,即该折叠屏手机中可以事先设置进行截屏图像的三维立体显示模式来供用户选择。在进行截屏显示时,若用户选择三维立体显示模式,则在截屏过程中,该折叠屏手机可以获取所述第一显示屏和所述第二显示屏之间的第一夹角,并可以分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像,而在进行截屏图像的显示时,该折叠屏手机则可以根据该第一夹角来进行所述第一截屏图像和所述第二截屏图像的三维立体显示;若用户未选择三维立体显示模式,该折叠屏手机则可以直接根据常规的截屏显示模式进行内容截屏和显示。
具体地,该折叠屏手机可以根据检测到的截屏指令来获取所述第一显示屏和所述第二显示屏之间的第一夹角。其中,所述截屏指令可以是触发预设按键生成的指令,可以是触发预设手势生成的指令,也可以是触发预设语音关键词生成的指令,还可以是启动截屏软件中的截屏功能生成的指令,本申请实施例对此不作任何限定。应理解,截屏软件可以是带截屏功能的手机***软件或者是手机上安装的带截屏功能的第三方软件。
例如,该折叠屏手机中可以预先设置“音量+”按键连续触发两次时生成截屏指令,或者可以预先设置“开机”按键与“home”按键同时触发时生成截屏指令,因此,当用户连续按压“音量+”按键两次,或者当用户同时按压“开机”按键和“home”按键时,该折叠屏手机即可以生成并获取到截屏指令。又例如,该折叠屏手机中也可以预先设置采集到“C”形手势等预设手势时生成截屏指令,因此,当用户输入与“C”形手势等预设手势相匹配的手势时,该折叠屏手机即可以生成并获取到截屏指令。还例如,该折叠屏手机中还可以预先设置检测到“截屏”或“截图”等预设语音关键词时生成截屏指令,因此,当用户输入的语音中含有“截屏”或“截图”等预设语音关键词时,该折叠屏手机即可以生成并获取到截屏指令。再例如,当该折叠屏手机检测到用户打开了截屏软件,并启动了截屏软件中的截屏功能时,比如检测到截屏软件中的截屏按钮被选取或者被点击时,该折叠屏手机即可以生成并获取到截屏指令。
在一种可能的实现方式中,可以在所述第一显示屏和所述第二显示屏之间的可弯折区设置电阻传感器,例如,可以在该可弯折区的铰链处安装电阻传感器,以通过该电阻传感器测得的电阻变化来计算得到所述第一显示屏和所述第二显示屏之间的第一夹角,或者可以在该可弯折区的铰 链处设置角度传感器,以直接通过该角度传感器测量得到所述第一显示屏和所述第二显示屏之间的第一夹角。
需要说明的是,通过电阻传感器测得的电阻变化来计算得到所述第一显示屏和所述第二显示屏之间的第一夹角可以采用现有的计算方式进行计算,本申请实施例对此不作任何限定。
在另一种可能的实现方式中,可以分别在所述第一显示屏和所述第二显示屏中设置一陀螺仪传感器,以通过所述第一显示屏和所述第二显示屏中的陀螺仪传感器测量得到所述第一显示屏和所述第二显示屏之间的第一夹角。
具体地,如图4所示,可以通过设置在所述第一显示屏(图4中所示的A屏)中的陀螺仪传感器A获取所述第一显示屏的朝向的方向向量z1,可以通过设置在所述第二显示屏(图4中所示的B屏)中的陀螺仪传感器B获取所述第二显示屏的朝向的方向向量z2,并可以计算出方向向量z1和方向向量z2之间的夹角θ,例如,可以利用公式
Figure PCTCN2020124485-appb-000001
计算出方向向量z1和方向向量z2之间的夹角θ。
其中,
Figure PCTCN2020124485-appb-000002
如图4所示,所述第一显示屏的朝向的方向向量z1垂直于所述第一显示屏,所述第二显示屏的朝向的方向向量z2垂直于所述第二显示屏,因此,根据方向向量z1和方向向量z2之间的夹角θ可以得到所述第一显示屏和所述第二显示屏之间的第一夹角α=180°-θ。即通过在所述第一显示屏中设置陀螺仪传感器A和所述第二显示屏中设置陀螺仪传感器B,并通过获取所述第一显示屏在陀螺仪传感器A的坐标系中的朝向的方向向量zl和获取所述第二显示屏在陀螺仪传感器B的坐标系中的朝向的方向向量z2,便可以确定出所述第一显示屏和所述第二显示屏之间的第一夹角α。
需要说明的是,虽然所述第一显示屏中的陀螺仪传感器A的坐标原点与所述第二显示屏中的陀螺仪传感器B的坐标原点并不重叠,即虽然方向向量z1与方向向量z2并不在同一个坐标系,但因为方向向量z1所在的坐标系与方向向量z2所在的坐标系的各轴平行,因此,仍然可以通过公式
Figure PCTCN2020124485-appb-000003
来计算出方向向量z1和方向向量z2之间的夹角θ,从而可以根据夹角θ确定出所述第一显示屏和所述第二显示屏之间的第一夹角α。
本申请实施例中,还可以分别在所述第一显示屏和所述第二显示屏中设置一重力传感器,即可以通过所述第一显示屏中的重力传感器A和所述第二显示屏中的重力传感器B测量得到所述第一显示屏和所述第二显示屏之间的第一夹角。
应理解,在获取所述第一显示屏和所述第二显示屏之间的第一夹角的同时,该折叠屏手机还可以分别对所述第一显示屏和所述第二显示屏中的当前显示内容进行截屏操作,即对所述第一显示屏和所述第二显示屏进行分开截屏,从而得到所述第一显示屏对应的第一截屏图像以及得到所述第二显示屏对应的第二图像。
需要说明的是,对所述第一显示屏中的当前显示内容进行截屏操作可以是对所述第一显示屏当前显示的全部内容进行截屏操作,即可以是截取所述第一显示屏的整个屏幕,也可以是对所述第一显示屏当前显示的部分内容进行截屏操作,即也可以是截取所述第一显示屏的部分屏幕。同样地,对所述第二显示屏中的当前显示内容进行截屏操作可以是对所述第二显示屏当前显示的全部内容进行截屏操作,也可以是对所述第二显示屏当前显示的部分内容进行截屏操作。
具体地,可以根据所述第一显示屏对应的截屏框来确定所述第一显示屏对应的截屏区域,即可以根据所述第一显示屏对应的截屏框来确定是对所述第一显示屏的整个屏幕进行截屏操作,还是对所述第一显示屏的部分屏幕进行截屏操作,其中,截屏框的大小和位置可以由用户确定,即 用户可以进行截屏框大小和位置的调整。例如,可以根据图5a所示的所述第一显示屏对应的截屏框A对所述第一显示屏的部分屏幕进行截屏操作。同样地,可以根据所述第二显示屏对应的截屏框来确定所述第二显示屏对应的截屏区域,即可以根据所述第二显示屏对应的截屏框来确定是对所述第二显示屏的整个屏幕进行截屏操作,还是对所述第二显示屏的部分屏幕进行截屏操作。例如,可以根据图5a所示的所述第二显示屏对应的截屏框B对所述第二显示屏的整个屏幕进行截屏操作,在此,实际操作中,截屏框B可以框选所述第二显示屏的整个屏幕,而图5a中为示意清楚,截屏框B仅对所述第二显示屏具有显示内容的区域进行了框选。
示例的,也可以通过所述第一显示屏和所述第二显示屏整体所对应的截屏框来分别确定所述第一显示屏对应的截屏区域和所述第二显示屏对应的截屏区域,即可以根据该截屏框在所述第一显示屏和所述第二显示屏中分别框选的区域来确定所述第一显示屏对应的截屏区域和所述第二显示屏对应的截屏区域。例如,可以根据图5b所示的截屏框C分别对所述第一显示屏的整个屏幕和所述第二显示屏的整个屏幕进行截屏操作。又例如,可以根据图5c所示的截屏框D对所述第一显示屏的部分屏幕进行截屏操作,并对所述第二显示屏的整个屏幕进行截屏操作。
本申请实施例中,也可以通过其他现有方式来确定所述第一显示屏和所述第二显示屏对应的截屏区域,本申请实施例对此不作任何限定。
需要说明的是,在截屏完成后,即在该折叠屏手机得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像,并获取到所述第一显示屏和所述第二显示屏之间的第一夹角后,可将截屏图像和第一夹角进行关联保存。具体地,在进行保存时,可以将所述第一截屏图像与所述第一显示屏进行关联、可以将所述第二截屏图像与所述第二显示屏进行关联、可以将所述第一截屏图像和所述第二截屏图像进行关联,同时还可以将所述第一夹角与所述第一截屏图像和/或所述第二截屏图像进行关联,以在进行截屏图像的三维立体显示时,可以首先获取待显示的第一截屏图像和/或第二截屏图像,然后可以根据关联关系获取第一截屏图像对应的第一显示屏、第二截屏图像对应的第二显示屏以及第一显示屏和第二显示屏之间的第一夹角,从而可以根据第一夹角、第一显示屏和第二显示屏来进行第一截屏图像和第二截屏图像的三维立体显示。
例如,可以将所述第一截屏图像、所述第二截屏图像以及所述第一夹角保存于同一文件中,并记录所述第一截屏图像和/或所述第二截屏图像与所述第一夹角之间的关联关系,同时记录所述第一截屏图像和所述第二截屏图像分别关联的显示屏。
例如,可以将所述第一截屏图像与所述第二截屏图像关联保存于存储图像信息的文件A中,将所述第一夹角保存于存储角度信息的文件B中,并记录文件A中的图像信息与文件B中的夹角信息两者之间的关联关系,以及记录文件A中的所述第一截屏图像和所述第二截屏图像分别关联的显示屏。
例如,可以将所述第一截屏图像保存于存储所述第一显示屏对应的图像信息的文件A中,将所述第二截屏图像保存于存储所述第二显示屏对应的图像信息的文件B中,将所述第一夹角保存于存储角度信息的文件C中,并记录文件A中的图像信息、文件B中的图像信息以及文件C中的夹角信息三者之间的关联关系。
可选地,本申请实施例中的截屏显示也可以是连续截屏显示,例如可以是录屏显示。其中,在录屏过程中,该折叠屏手机可以分别对所述第一显示屏中的当前显示内容和所述第二显示屏中的当前显示内容进行连续的截屏操作,直至接收到录屏结束指令为止。示例的,该折叠屏手机可以根据预设的视频帧率分别对所述第一显示屏中的当前显示内容和所述第二显示屏中的当前显示 内容进行持续的截屏操作,同时可以基于每一次的截屏对应获取所述第一显示屏和所述第二显示屏之间的第一夹角。即录屏过程中,第一夹角的获取频率需与录制的视频帧率保持一致。也就是说,录屏过程中,可以构建所述第一夹角对应的第一时间轴以及所述第一截屏图像和所述第二截屏图像对应的第二时间轴,且所述第一时间轴需与所述第二时间轴保持一致。
例如,当1秒内录制的视频帧为24帧时,那么这1秒内所获取的第一夹角的数量也将为24个,以使得每一帧视频帧(包括所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像)均具有一个对应的第一夹角,且第一夹角获取的第一时间轴与视频帧录制的第二时间轴需保持一致,比如,当第一帧视频帧的录制时间为T1时,那么第一帧视频帧对应的第一夹角的获取时间也为T1,当第二帧视频帧的录制时间为T2时,那么第二帧视频帧对应的第一夹角的获取时间也为T2,……,当第n帧视频帧的录制时间为Tn时,那么第n帧视频帧对应的第一夹角的获取时间也为Tn。
需要说明的是,在连续截屏场景中,该折叠屏手机在进行视频帧和第一夹角的关联保存时,还可以进行时间轴的关联保存,即关联保存视频帧对应的第二时间轴和第一夹角对应的第一时间轴,以在进行所录制的视频帧的显示时,可以根据视频帧的第二时间轴获取待显示的各帧视频帧,并可以根据第一夹角的第一时间轴分别确定各帧视频帧对应的第一夹角,从而可以根据各帧视频帧对应的第一夹角来进行各帧视频帧的三维立体显示,以充分体现折叠屏手机的折叠、弯曲特性,提高折叠屏手机的录屏显示效果。
S302、根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
具体地,该折叠屏手机可以根据检测到的显示指令来进行截屏图像的显示。其中,所述显示指令可以是对截屏图像进行点击所生成的指令,可以是触发预设按键生成的指令,也可以是触发预设手势生成的指令,还可以是触发预设语音关键词生成的指令,本申请实施例对此不作任何限定。
应理解,该折叠屏手机在接收到针对截屏图像的显示指令时,可以获取所述第一截屏图像和所述第二截屏图像以及与之相关联的第一夹角,并可以将所述第一截屏图像和所述第二截屏图像按照所述第一夹角在该折叠屏手机的显示屏中进行显示。
例如,可以将所述第一截屏图像和所述第二截屏图像按照所述第一夹角在该折叠屏手机的第一显示屏中进行显示,或者可以将所述第一截屏图像和所述第二截屏图像按照所述第一夹角在该折叠屏手机的第二显示屏中进行显示。
例如,可以将所述第一截屏图像和所述第二截屏图像按照所述第一夹角在该折叠屏手机的第一显示屏和第二显示屏中进行显示,其中,在所述第一显示屏和所述第二显示屏中进行显示时,所述第一显示屏和所述第二显示屏可以是处于展开状态,也可以是处于折叠状态,本申请实施例对此不作任何限定。
需要说明的是,该折叠屏手机可以首先根据所述第一夹角确定所述第一截屏图像对应的第一平面和所述第二截屏图像对应的第二平面,其中,所述第一平面和所述第二平面之间的第二夹角与所述第一夹角相同;然后可以分别根据所述第一显示屏和所述第二显示屏确定所述第一平面中的第一平面区域和所述第二平面中的第二平面区域,即可以根据所述第一显示屏的第一屏幕大小和预设缩放比例确定所述第一平面中的第一平面区域和根据所述第二显示屏的第二屏幕大小和所述预设缩放比例确定所述第二平面中的第二平面区域,其中,所述第一平面区域与所述第二平面区域相连接,例如,可以根据所述第一夹角、所述第一显示屏和所述第二显示屏确定出如图6a所 示的第一平面区域和第二平面区域;最后可以根据所述第一截屏图像在所述第一显示屏中的第一位置信息确定出所述第一截屏图像在所述第一显示区域中的第一显示位置,并可以在所述第一显示位置中显示所述第一截屏图像,同时,还可以根据所述第二截屏图像在所述第二显示屏中的第二位置信息确定出所述第二截屏图像在所述第二平面区域中的第二显示位置,并可以在所述第二显示位置中显示所述第二截屏图像,以实现截屏图像的三维立体显示。例如,在一具体应用场景中,可以得到如图6b所示的三维显示效果图。
应理解,所述第一截屏图像在所述第一显示屏中的第一位置信息可以在截屏时进行确定并记录保存,同样地,所述第二截屏图像在所述第二显示屏中的第二位置信息也可以在截屏时进行确定并记录保存,其中,所述第一位置信息和所述第二位置信息可以通过现有的位置检测和/或确定方式进行确定,本申请实施例对此不作任何限定。
在一种可能的实现方式中,可以事先根据该折叠屏手机的折叠屏可能具有的折叠角度构建该折叠屏手机对应的多个三维模型,同时可以建立所构建的各三维模型与折叠角度之间的对应关系。其中,所述折叠屏的折叠角度即为所述第一显示屏和所述第二显示屏之间的第一夹角,所构建的三维模型可以包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,且所述第一显示区域与所述第二显示区域之间的第三夹角与各三维模型对应的折叠角度相同,即与各三维模型对应的第一显示屏和第二显示屏之间的第一夹角相同。
例如,可以构建折叠屏的折叠角度为10°时,该折叠屏手机对应的三维模型A;可以构建折叠屏的折叠角度为15°时,该折叠屏手机对应的三维模型B;可以构建折叠屏的折叠角度为80°时,该折叠屏手机对应的三维模型C,并可以建立三维模型A与10°对应、三维模型B与15°对应、三维模型C与80°对应的对应关系。
应理解,该折叠屏手机对应的三维模型可以由该折叠屏手机构建,也可以由其他终端设备构建,其中,所构建的三维模型可以存储在该折叠屏手机的存储器中,也可以存储在与该折叠屏手机相连接的云端服务器或者其他终端设备中。
可选地,该折叠屏手机或者其他终端设备可以通过3D渲染引擎(例如Unity)来构建该折叠屏手机在不同折叠角度下的三维模型。
具体地,该折叠屏手机或者其他终端设备可以使用Unity中的Mesh网格组件来基于该折叠屏手机中所述第一显示屏和所述第二显示屏的外形以及所述第一显示屏和所述第二显示屏之间的第一夹角,绘制该折叠屏手机在所述第一夹角的折叠状态时,所述第一显示屏对应的第一网格和所述第二显示屏对应的第二网格,其中,所述第一网格和所述第二网格之间的夹角为所述第一夹角,所述第一网格和所述第二网格所形成的整体即可以为该折叠屏手机在所述第一夹角下的三维模型,所述第一网格中可以包括上述所述的第一显示区域,所述第二网格中可以包括上述所述的第二显示区域。
需要说明的是,该折叠屏手机或者其他终端设备也可以通过3D渲染引擎所对应的其他现有构建方式来构建该折叠屏手机在不同折叠角度下的多个三维模型,本申请实施例对此不作任何限定。
应理解,在事先构建有折叠屏手机对应的多个三维模型时,当根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像时,可以首先根据所述第一夹角获取该折叠屏手机对应的三维模型,然后可以将所述第一截屏图像渲染至所述三维模型的第一显示区域,并可以将所述第二截屏图像渲染至所述三维模型的第二显区域,最后可以通过显示所述三维模型来实现截屏图像的三维 立体显示。
具体地,可以通过3D渲染引擎(例如Unity)的图像渲染功能将所述第一截屏图像渲染至所述三维模型的第一显示区域以及将所述第二截屏图像渲染至所述三维模型的第二显区域,本申请实施例对此不作任何限定。
例如,当在折叠屏手机处于如图7a所示的折叠状态下,对该折叠屏手机中的第一显示屏和第二显示屏当前显示的全部内容进行截屏操作时,可以首先获取该折叠状态下所述第一显示屏和所述第二显示屏之间的第一夹角;随后可以根据所述第一夹角从该折叠屏手机的存储器中或者从云端服务器或其他终端设备中获取与所述第一夹角对应的三维模型;然后可以将从所述第一显示屏中截取的第一截屏图像渲染至所获取的三维模型的第一显示区域以及将从所述第二显示屏中截取的第二截屏图像渲染至所获取的三维模型的第二显示区域,并通过显示所述三维模型即可以得到如图7b所示的显示效果图。
在一种可能的实现方式中,该折叠屏手机也可以直接将所述第一截屏图像和所述第二截屏图像以三维立体模式进行保存。即在截屏过程中,当确定需要对截屏图像进行三维立体显示时,该折叠屏手机在获取到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像以及所述第一显示屏和所述第二显示屏之间的第一夹角后,可以直接根据所述第一夹角从事先构建的三维模型中获取与所述第一夹角对应的三维模型,然后可以将所述第一截屏图像渲染至所获取的三维模型的第一显示区域,并可以将所述第二截屏图像渲染至所获取的三维模型的第二显示区域,然后可以将所述三维模型保存于该折叠屏手机的存储器或者云端服务器或者其他终端设备中。因此,当该折叠屏手机或者其他终端设备接收到针对该截屏图像的显示指令时,可以直接从该折叠屏手机的存储器中,或者通过有线或无线方式从云端服务器或其他终端设备中获取该截屏图像对应的三维模型,然后可以将该三维模型显示在该折叠屏手机的显示屏中,以通过提前进行三维模型的获取和截屏图像的渲染来提高截屏图像的三维立体显示的显示速度,提升用户体验。
可选地,在显示所述三维模型时,可以首先确定所述三维模型对应的显示角度,并可以根据所述显示角度来显示所述三维模型。
例如,可以将正对所述第一显示屏的角度确定为所述显示角度,或者可以将正对所述第二显示屏的角度确定为所述显示角度,还可以将正对所述第一显示屏和所述第二显示屏之间的可弯折区的角度确定为所述显示角度。
在一种可能的实现方式中,所述三维模型对应的显示角度可以根据三维模型与显示角度之间的预设对应关系确定,其中,所述预设对应关系可以在构建三维模型时建立,例如,在构建三维模型时,可以根据用户设定的对应关系建立所述预设对应关系;例如,在构建三维模型时,可以根据该折叠屏手机中图像的当前显示角度建立所述预设对应关系。
在另一种可能的实现方式中,所述三维模型对应的显示角度还可以根据三维模型当次显示的显示载体(即折叠屏手机等终端设备)确定,即每一个折叠屏手机等终端设备自身都可以具有一个针对折叠图像进行显示的显示角度,其中,该显示角度可以由用户自定义,也可以由折叠屏手机等终端设备***默认。
示例的,在截屏图像的显示过程中,用户也可以通过上下左右滑动屏幕来调整观看该截屏图像的视角,其中,上下左右均为360度可旋转视角。
在另一种可能的实现方式中,该折叠屏手机或者其他终端设备可以进行该折叠屏手机对应的三维模型的实时构建,即在进行截屏图像的显示过程中,可以实时构建该折叠屏手机当前对应的 三维模型,即可以实时构建该折叠屏手机在进行截屏操作时所处的折叠状态下的三维模型,以减少该折叠屏手机或其他终端设备的存储内存,降低资源占用,提高该折叠屏手机的截屏操作效率。
具体地,该折叠屏手机或其他终端设备可以首先获取该折叠屏手机对应的属性信息,其中,所述属性信息可以包括该折叠屏手机中所述第一显示屏和所述第二显示屏的外形等信息;然后可以根据所述属性信息和所述第一夹角来绘制该折叠屏手机对应的三维模型,其中,所绘制的三维模型可以包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,且所述第一显示区域与所述第二显示区域之间的第四夹角与该折叠屏手机在执行截屏操作时所对应的折叠角度相同,即所述第四夹角与执行截屏操作时,该折叠屏手机中的所述第一显示屏和所述第二显示屏之间的第一夹角相同;最后可以将所述第一截屏图像渲染至所述三维模型的第一显示区域以及将所述第二截屏图像渲染至所述三维模型的第二显区域,并可以通过显示所述三维模型来实现截屏图像的三维立体显示。
可选地,该折叠屏手机或者其他终端设备可以通过3D渲染引擎(例如Unity)来实时构建该折叠屏手机当前对应的三维模型。
具体地,该折叠屏手机或者其他终端设备可以首先使用Unity中的Mesh网格组件来基于该折叠屏手机对应的属性信息(例如属性信息中的第一显示屏和第二显示屏的外形)和该折叠屏手机在执行截屏操作时所对应的折叠角度,绘制处于该折叠角度时的折叠屏手机中的所述第一显示屏对应的第一网格和所述第二显示屏对应的第二网格,其中,所述第一网格和所述第二网格之间的夹角与该折叠屏手机在执行截屏操作时所对应的折叠角度相同,所述第一网格中可以包括上述所述的第一显示区域,所述第二网格中可以包括上述所述的第二显示区域。然后,可以通过Unity中的图像渲染功能将所述第一截屏图像渲染至所述三维模型的第一显示区域以及将所述第二截屏图像渲染至所述三维模型的第二显区域,并可以通过显示渲染后的三维模型来进行截屏图像的三维立体显示。
可选地,在显示所述三维模型时,可以首先确定所述三维模型对应的显示角度,并可以根据所述显示角度来显示所述三维模型。其中,所述显示角度与前述所述的显示角度的定义和确定方式相同,为简明起见,在此不再赘述。
在一种可能的实现方式中,该折叠屏手机可以根据该折叠屏手机的当前折叠状态来进行截屏图像的显示。具体地,当该折叠屏手机的当前折叠状态与进行截屏操作时的折叠状态相同时,则可以直接在该折叠屏手机的第一显示屏中进行第一截屏图像的显示,并可以直接在该折叠屏手机的第二显示屏中进行第二截屏图像的显示,即可以直接依据该折叠屏手机本身来实现截屏图像的三维立体显示,而不需要再进行三维模型的构建或者获取;而当该折叠手机的当前折叠状态与进行截屏操作时的折叠状态不相同时,则可以输出调整指令来指示用户对该折叠屏手机进行折叠状态的调整,或者再进行三维模型的构建或获取,然后基于三维模型来进行截屏图像的三维立体显示。
示例的,在进行截屏图像的显示时,该折叠屏手机可以首先获取当前折叠状态中的所述第一显示屏与所述第二显示屏之间的第五夹角,并可以判断所述第五夹角与该截屏图像对应的第一夹角是否相同;若所述第五夹角与该截屏图像对应的第一夹角相同,则可以直接在所述第一显示屏中显示所述第一截屏图像,并可以直接在所述第二显示屏中显示所述第二截屏图像;若所述第五夹角与该截屏图像对应的第一夹角不相同,则可以根据该截屏图像对应的第一夹角和所述第五夹角输出调整指令,以指示用户对所述第一显示屏和/或所述第二显示屏进行调整,例如,可以根据 所述第五夹角和所述第一夹角输出将该折叠屏手机的第一显示屏沿顺时针方向或者沿逆时针方向调整预设角度的调整指令来指示用户对所述第一显示屏进行调整。
应理解,在用户完成折叠状态的调整后,该折叠屏手机可以继续获取调整后的所述第一显示屏和所述第二显示屏之间的第五夹角,若调整后的第五夹角与该截屏图像对应的第一夹角相同,则可以直接在所述第一显示屏中显示所述第一截屏图像,并可以直接在所述第二显示屏中显示所述第二截屏图像;若调整后的第五夹角与该截屏图像对应的第一夹角不相同,则可以根据调整后的第五夹角和该截屏图像对应的第一夹角继续输出调整指令来指示用户对所述第一显示屏和/或所述第二显示屏进行调整,直至调整后的第五夹角与该截屏图像对应的第一夹角相同为止;或者,若调整后的第五夹角与该截屏图像对应的第一夹角不相同,则可以首先获取或者构建所述第一夹角对应的折叠状态下该折叠屏手机对应的三维模型,然后可以在该折叠屏手机进行截屏图像显示的当前折叠状态中,通过该三维模型来实现截屏图像的三维立体显示,即可以首先将所述第一截屏图像和所述第二截屏图像渲染于该三维模型的第一显示区域和第二显示区域,然后可以根据该折叠屏手机的当前折叠状态进行该三维模型的折叠显示。
需要说明的是,上述虽然只描述了折叠屏手机具有两个显示屏时的截屏显示,但本申请实施例对折叠屏手机的显示屏个数并不作任何限定,即本申请实施例不仅可以应用于折叠屏手机具有两个显示屏时的截屏显示,当然也可以应用于折叠屏手机具有三个或三个以上显示屏的截屏显示。其中,折叠屏手机具有三个或三个以上显示屏时的截屏显示原理与折叠屏手机具有两个显示屏时的截屏显示原理相同,即首先分别获取任意相连接的两个显示屏之间的第一夹角,并分别截取各显示屏中的当前显示内容对应的截屏图像,然后可以根据各夹角来对各截屏图像进行显示。例如,可以根据各夹角获取或者构建该折叠屏手机在进行截屏操作时的三维模型,该三维模型即可以包括三个或三个以上的显示区域,并可以将各截屏图像渲染至该三维模型中与之相对应的显示区域中,然后可以通过显示该三维模型来实现截屏图像的三维立体显示。
本申请实施例中,在接收到截屏指令时,可以首先获取所述第一显示屏和所述第二显示屏之间的第一夹角,并可以分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;然后可以根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。即本申请实施例在截屏时,可以同时获取第一显示屏和第二显示屏之间的第一夹角,使得在进行截屏图像的显示时可以根据第一夹角来进行第一截屏图像和第二截屏图像的三维立体显示,以充分体现出具有折叠屏的终端设备的折叠、弯曲特性,实现截屏图像的三维立体显示,提高截屏图像的显示效果。
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
对应于上文实施例所述的截屏显示方法,图8示出了本申请实施例提供的截屏显示装置的结构框图,为了便于说明,仅示出了与本申请实施例相关的部分。
参照图8,所述截屏显示装置应用于具有折叠屏的终端设备,所述折叠屏包括第一显示屏和第二显示屏,所述截屏显示装置,可以包括:
截屏模块801,用于获取所述第一显示屏和所述第二显示屏之间的第一夹角,并分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;
显示模块802,用于根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
在一种可能的实现方式中,所述显示模块802,可以包括:
平面确定单元,用于根据所述第一夹角确定所述第一截屏图像对应的第一平面和所述第二截屏图像对应的第二平面,所述第一平面和所述第二平面之间的第二夹角与所述第一夹角相同;
区域确定单元,用于根据所述第一显示屏和所述第二显示屏分别确定所述第一平面中的第一平面区域和所述第二平面中的第二平面区域;
第一显示单元,用于在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像。
可选地,所述第一显示单元,可以包括:
第一位置确定分单元,用于根据所述第一截屏图像在所述第一显示屏中的第一位置信息确定所述第一截屏图像在所述第一显示区域中的第一显示位置;
第二位置确定分单元,用于根据所述第二截屏图像在所述第二显示屏中的第二位置信息确定所述第二截屏图像在所述第二平面区域中的第二显示位置;
第一显示分单元,用于在所述第一显示位置中显示所述第一截屏图像,并在所述第二显示位置中显示所述第二截屏图像。
在一种可能的实现方式中,所述显示模块802,可以包括:
模型获取单元,用于根据所述第一夹角获取所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第三夹角与所述第一夹角相同;
第一图像渲染单元,用于将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
第二显示单元,用于显示所述三维模型。
示例的,所述第二显示单元,具体用于确定所述三维模型对应的显示角度,并根据所述显示角度显示所述三维模型。
在另一种可能的实现方式中,所述显示模块802,还可以包括:
属性信息获取单元,用于获取所述终端设备对应的属性信息;
模型构建单元,用于根据所述属性信息和所述第一夹角绘制所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第四夹角与所述第一夹角相同;
第二图像渲染单元,用于将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
第三显示单元,用于显示所述三维模型。
在一种可能的实现方式中,所述显示模块802,还可以包括:
第一夹角获取单元,用于获取所述第一显示屏与所述第二显示屏之间的第五夹角;
第四显示单元,用于若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
指令输出单元,用于若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角和所述第五夹角输出调整指令,以指示用户对所述第一显示屏和/或所述第二显示屏进行调整。
在另一种可能的实现方式中,所述显示模块802,还可以包括:
第二夹角获取单元,用于获取所述第一显示屏与所述第二显示屏之间的第五夹角;
第五显示单元,用于若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
第六显示单元,用于若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
可选地,所述截屏显示装置,还可以包括:
时间轴构建模块,用于构建所述第一夹角对应的第一时间轴以及所述第一截屏图像和所述第二截屏图像对应的第二时间轴,其中,所述第一时间轴和所述第二时间轴相对应;
相应地,所述显示模块802,还可以包括:
第三夹角获取单元,用于根据所述第二时间轴获取所述第一截屏图像和所述第二截屏图像,并根据所述第一时间轴获取所述第一截屏图像和所述第二截屏图像对应的第一夹角;
第七显示单元,用于根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
需要说明的是,上述装置/单元之间的信息交互、执行过程等内容,由于与本申请方法实施例基于同一构思,其具体功能及带来的技术效果,具体可参见方法实施例部分,此处不再赘述。
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中,上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。上述***中单元、模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
图9为本申请一实施例提供的终端设备的结构示意图。如图9所示,该实施例的终端设备9包括:至少一个传感器93(图9中仅示出一个)、折叠屏94、至少一个处理器90(图9中仅示出一个)、存储器91以及存储在所述存储器91中并可在所述至少一个处理器90上运行的计算机程序92,所述处理器90执行所述计算机程序92时实现上述任意各个截屏显示方法实施例中的步骤。
所述终端设备9可以包括,但不仅限于,处理器90、存储器91。本领域技术人员可以理解,图9仅仅是终端设备9的举例,并不构成对终端设备9的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如还可以包括输入输出设备、网络接入设备等。
所述处理器90可以是中央处理单元(Central Processing Unit,CPU),该处理器90还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
所述存储器91在一些实施例中可以是所述终端设备9的内部存储单元,例如终端设备9的硬盘或内存。所述存储器91在另一些实施例中也可以是所述终端设备9的外部存储设备,例如所述终端设备9上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器91还可以既包括所述终端设备9的内部存储单元也包括外部存储设备。所述存储器91用于存储操作***、应用程序、引导装载程序 (BootLoader)、数据以及其他程序等,例如所述计算机程序的程序代码等。所述存储器91还可以用于暂时地存储已经输出或者将要输出的数据。
本申请实施例还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时可实现上述各个截屏显示方法实施例中的步骤。
本申请实施例还提供了一种计算机程序产品,当计算机程序产品在终端设备上运行时,使得终端设备执行时可实现上述各个截屏显示方法实施例中的步骤。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读存储介质中。基于这样的理解,本申请实现上述实施例方法中的全部或部分流程,可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读存储介质至少可以包括:能够将计算机程序代码携带到装置/终端设备的任何实体或装置、记录介质、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质。例如U盘、移动硬盘、磁碟或者光盘等。在某些司法管辖区,根据立法和专利实践,计算机可读存储介质不可以是电载波信号和电信信号。
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
在本申请所提供的实施例中,应该理解到,所揭露的装置/终端设备和方法,可以通过其它的方式实现。例如,以上所描述的装置/终端设备实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个***,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的间接耦合或通讯连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。

Claims (20)

  1. 一种截屏显示方法,其特征在于,应用于具有折叠屏的终端设备,所述折叠屏包括第一显示屏和第二显示屏,所述截屏显示方法包括:
    获取所述第一显示屏和所述第二显示屏之间的第一夹角,并分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;
    根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
  2. 如权利要求1所述的截屏显示方法,其特征在于,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
    根据所述第一夹角确定所述第一截屏图像对应的第一平面和所述第二截屏图像对应的第二平面,所述第一平面和所述第二平面之间的第二夹角与所述第一夹角相同;
    根据所述第一显示屏和所述第二显示屏分别确定所述第一平面中的第一平面区域和所述第二平面中的第二平面区域;
    在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像。
  3. 如权利要求2所述的截屏显示方法,其特征在于,所述在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像包括:
    根据所述第一截屏图像在所述第一显示屏中的第一位置信息确定所述第一截屏图像在所述第一显示区域中的第一显示位置;
    根据所述第二截屏图像在所述第二显示屏中的第二位置信息确定所述第二截屏图像在所述第二平面区域中的第二显示位置;
    在所述第一显示位置中显示所述第一截屏图像,并在所述第二显示位置中显示所述第二截屏图像。
  4. 如权利要求1所述的截屏显示方法,其特征在于,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
    根据所述第一夹角获取所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第三夹角与所述第一夹角相同;
    将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
    显示所述三维模型。
  5. 如权利要求4所述的截屏显示方法,其特征在于,所述显示所述三维模型包括:
    确定所述三维模型对应的显示角度,并根据所述显示角度显示所述三维模型。
  6. 如权利要求1所述的截屏显示方法,其特征在于,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
    获取所述终端设备对应的属性信息;
    根据所述属性信息和所述第一夹角绘制所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第四夹角与所述第一夹角相同;
    将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
    显示所述三维模型。
  7. 如权利要求1所述的截屏显示方法,其特征在于,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
    获取所述第一显示屏与所述第二显示屏之间的第五夹角;
    若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
    若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角和所述第五夹角输出调整指令,以指示用户对所述第一显示屏和/或所述第二显示屏进行调整。
  8. 如权利要求1所述的截屏显示方法,其特征在于,所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
    获取所述第一显示屏与所述第二显示屏之间的第五夹角;
    若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
    若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
  9. 如权利要求1至8中任一项所述的截屏显示方法,其特征在于,所述截屏显示方法还包括:
    构建所述第一夹角对应的第一时间轴以及所述第一截屏图像和所述第二截屏图像对应的第二时间轴,其中,所述第一时间轴和所述第二时间轴相对应;
    所述根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像包括:
    根据所述第二时间轴获取所述第一截屏图像和所述第二截屏图像,并根据所述第一时间轴获取所述第一截屏图像和所述第二截屏图像对应的第一夹角;
    根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
  10. 一种截屏显示装置,其特征在于,应用于具有折叠屏的终端设备,所述折叠屏包括第一显示屏和第二显示屏,所述截屏显示装置包括:
    截屏模块,用于获取所述第一显示屏和所述第二显示屏之间的第一夹角,并分别对所述第一显示屏和所述第二显示屏的当前显示内容进行截屏操作,得到所述第一显示屏对应的第一截屏图像和所述第二显示屏对应的第二截屏图像;
    显示模块,用于根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
  11. 如权利要求10所述的截屏显示装置,其特征在于,所述显示模块包括:
    平面确定单元,用于根据所述第一夹角确定所述第一截屏图像对应的第一平面和所述第二截屏图像对应的第二平面,所述第一平面和所述第二平面之间的第二夹角与所述第一夹角相同;
    区域确定单元,用于根据所述第一显示屏和所述第二显示屏分别确定所述第一平面中的第一平面区域和所述第二平面中的第二平面区域;
    第一显示单元,用于在所述第一平面区域中显示所述第一截屏图像,并在所述第二平面区域中显示所述第二截屏图像。
  12. 如权利要求11所述的截屏显示装置,其特征在于,所述第一显示单元包括:
    第一位置确定分单元,用于根据所述第一截屏图像在所述第一显示屏中的第一位置信息确定 所述第一截屏图像在所述第一显示区域中的第一显示位置;
    第二位置确定分单元,用于根据所述第二截屏图像在所述第二显示屏中的第二位置信息确定所述第二截屏图像在所述第二平面区域中的第二显示位置;
    第一显示分单元,用于在所述第一显示位置中显示所述第一截屏图像,并在所述第二显示位置中显示所述第二截屏图像。
  13. 如权利要求10所述的截屏显示装置,其特征在于,所述显示模块包括:
    模型获取单元,用于根据所述第一夹角获取所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第三夹角与所述第一夹角相同;
    第一图像渲染单元,用于将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
    第二显示单元,用于显示所述三维模型。
  14. 如权利要求13所述的截屏显示装置,其特征在于,所述第二显示单元,具体用于确定所述三维模型对应的显示角度,并根据所述显示角度显示所述三维模型。
  15. 如权利要求10所述的截屏显示装置,其特征在于,所述显示模块包括:
    属性信息获取单元,用于获取所述终端设备对应的属性信息;
    模型构建单元,用于根据所述属性信息和所述第一夹角绘制所述终端设备对应的三维模型,所述三维模型包括与所述第一显示屏对应的第一显示区域以及与所述第二显示屏对应的第二显示区域,所述第一显示区域与所述第二显示区域之间的第四夹角与所述第一夹角相同;
    第二图像渲染单元,用于将所述第一截屏图像渲染至所述三维模型的第一显示区域,并将所述第二截屏图像渲染至所述三维模型的第二显区域;
    第三显示单元,用于显示所述三维模型。
  16. 如权利要求10所述的截屏显示装置,其特征在于,所述显示模块包括:
    第一夹角获取单元,用于获取所述第一显示屏与所述第二显示屏之间的第五夹角;
    第四显示单元,用于若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
    指令输出单元,用于若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角和所述第五夹角输出调整指令,以指示用户对所述第一显示屏和/或所述第二显示屏进行调整。
  17. 如权利要求10所述的截屏显示装置,其特征在于,所述显示模块包括:
    第二夹角获取单元,用于获取所述第一显示屏与所述第二显示屏之间的第五夹角;
    第五显示单元,用于若所述第五夹角与所述第一夹角相同,则在所述第一显示屏中显示所述第一截屏图像,并在所述第二显示屏中显示所述第二截屏图像;
    第六显示单元,用于若所述第五夹角与所述第一夹角不相同,则根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
  18. 如权利要求10至17中任一项所述的截屏显示装置,其特征在于,所述截屏显示装置还包括:
    时间轴构建模块,用于构建所述第一夹角对应的第一时间轴以及所述第一截屏图像和所述第二截屏图像对应的第二时间轴,其中,所述第一时间轴和所述第二时间轴相对应;
    所述显示模块,还包括:
    第三夹角获取单元,用于根据所述第二时间轴获取所述第一截屏图像和所述第二截屏图像,并根据所述第一时间轴获取所述第一截屏图像和所述第二截屏图像对应的第一夹角;
    第七显示单元,用于根据所述第一夹角显示所述第一截屏图像和所述第二截屏图像。
  19. 一种终端设备,包括折叠屏、传感器、存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1至9任一项所述的截屏显示方法。
  20. 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至9任一项所述的截屏显示方法。
PCT/CN2020/124485 2019-11-22 2020-10-28 截屏显示方法、装置和终端设备 WO2021098460A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP20890256.9A EP4047464A4 (en) 2019-11-22 2020-10-28 SCREEN CAPTURE DISPLAY METHOD AND APPARATUS, AND TERMINAL DEVICE
US17/778,642 US20220413787A1 (en) 2019-11-22 2020-10-28 Screenshot display method and apparatus, and terminal device
JP2022529748A JP7361917B2 (ja) 2019-11-22 2020-10-28 スクリーンショット表示方法及び装置、及び端末デバイス

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911155018.8 2019-11-22
CN201911155018.8A CN112835493B (zh) 2019-11-22 2019-11-22 截屏显示方法、装置和终端设备

Publications (1)

Publication Number Publication Date
WO2021098460A1 true WO2021098460A1 (zh) 2021-05-27

Family

ID=75921453

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/124485 WO2021098460A1 (zh) 2019-11-22 2020-10-28 截屏显示方法、装置和终端设备

Country Status (5)

Country Link
US (1) US20220413787A1 (zh)
EP (1) EP4047464A4 (zh)
JP (1) JP7361917B2 (zh)
CN (1) CN112835493B (zh)
WO (1) WO2021098460A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114860135A (zh) * 2022-05-23 2022-08-05 维沃移动通信有限公司 截图方法和装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116841350A (zh) * 2022-03-23 2023-10-03 华为技术有限公司 一种3d显示方法以及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2743133A2 (en) * 2012-12-13 2014-06-18 Nissan Motor Manufacturing (UK) Ltd. Camera system
US20160283014A1 (en) * 2015-03-25 2016-09-29 Tomer RIDER Facilitating dynamic detection and intelligent use of segmentation on flexible display screens
CN109358793A (zh) * 2018-09-27 2019-02-19 维沃移动通信有限公司 一种截屏方法及移动终端
CN109542306A (zh) * 2018-11-23 2019-03-29 维沃移动通信有限公司 一种截屏方法及终端设备
CN110347316A (zh) * 2018-04-08 2019-10-18 中兴通讯股份有限公司 一种电子装置、该电子装置的屏幕显示方法、介质
CN110673889A (zh) * 2019-08-31 2020-01-10 华为技术有限公司 折叠屏设备中应用打开方法及相关装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012123205A (ja) 2010-12-08 2012-06-28 Sharp Corp 折畳み式携帯端末
KR101933452B1 (ko) 2011-02-10 2019-01-02 삼성전자주식회사 디바이스 패널들의 상대적 이동을 이용한 사용자 명령들을 입력하는 방법 및 장치
KR102063952B1 (ko) 2012-10-10 2020-01-08 삼성전자주식회사 멀티 디스플레이 장치 및 멀티 디스플레이 방법
KR101951228B1 (ko) 2012-10-10 2019-02-22 삼성전자주식회사 멀티 디스플레이 장치 및 그 촬상 방법
US10503276B2 (en) 2013-12-19 2019-12-10 Korea Electronics Technology Institute Electronic device and a control method thereof
US9471201B1 (en) * 2014-05-20 2016-10-18 Google Inc. Laptop-to-tablet mode adaptation
CN104536661A (zh) * 2014-12-17 2015-04-22 深圳市金立通信设备有限公司 一种终端截屏方法
US9569859B2 (en) * 2014-12-29 2017-02-14 Dell Products, Lp System and method for redefining depth-based edge snapping for three-dimensional point selection
KR102538955B1 (ko) 2016-03-02 2023-06-01 삼성전자 주식회사 전자 장치와 전자 장치의 영상 디스플레이 및 전송 방법
CN107765952B (zh) 2017-11-07 2020-04-28 Oppo广东移动通信有限公司 截屏方法、装置及终端
CN108089808A (zh) * 2017-11-29 2018-05-29 努比亚技术有限公司 一种屏幕画面获取方法、终端及计算机可读存储介质
CN110012154A (zh) * 2019-02-22 2019-07-12 华为技术有限公司 一种具有折叠屏的电子设备的控制方法及电子设备
CN110209326B (zh) 2019-05-08 2020-12-25 珠海格力电器股份有限公司 一种截图方法、装置、折叠屏设备及存储介质
CN110231973A (zh) 2019-05-31 2019-09-13 维沃移动通信有限公司 一种截图方法和移动终端
CN112394894A (zh) * 2019-08-19 2021-02-23 中兴通讯股份有限公司 显示数据处理、显示方法、装置、终端及可读存储介质
CN114237530A (zh) * 2020-01-21 2022-03-25 华为技术有限公司 一种折叠屏的显示方法及相关装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2743133A2 (en) * 2012-12-13 2014-06-18 Nissan Motor Manufacturing (UK) Ltd. Camera system
US20160283014A1 (en) * 2015-03-25 2016-09-29 Tomer RIDER Facilitating dynamic detection and intelligent use of segmentation on flexible display screens
CN110347316A (zh) * 2018-04-08 2019-10-18 中兴通讯股份有限公司 一种电子装置、该电子装置的屏幕显示方法、介质
CN109358793A (zh) * 2018-09-27 2019-02-19 维沃移动通信有限公司 一种截屏方法及移动终端
CN109542306A (zh) * 2018-11-23 2019-03-29 维沃移动通信有限公司 一种截屏方法及终端设备
CN110673889A (zh) * 2019-08-31 2020-01-10 华为技术有限公司 折叠屏设备中应用打开方法及相关装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114860135A (zh) * 2022-05-23 2022-08-05 维沃移动通信有限公司 截图方法和装置

Also Published As

Publication number Publication date
US20220413787A1 (en) 2022-12-29
CN112835493A (zh) 2021-05-25
EP4047464A4 (en) 2023-01-04
JP7361917B2 (ja) 2023-10-16
EP4047464A1 (en) 2022-08-24
JP2023502720A (ja) 2023-01-25
CN112835493B (zh) 2022-07-22

Similar Documents

Publication Publication Date Title
WO2021104365A1 (zh) 对象分享方法及电子设备
WO2020156466A1 (zh) 拍摄方法及终端设备
WO2020258929A1 (zh) 文件夹界面切换方法及终端设备
JP2023504915A (ja) アプリケーションプログラムの制御方法及び電子機器
WO2021169992A1 (zh) 内容呈现方法、装置、终端设备及计算机可读存储介质
WO2021115479A1 (zh) 显示控制方法及电子设备
WO2021012931A1 (zh) 图标管理方法及终端
US20220300302A1 (en) Application sharing method and electronic device
WO2020215949A1 (zh) 对象处理方法及终端设备
WO2020151460A1 (zh) 对象处理方法及终端设备
WO2020156123A1 (zh) 信息处理方法及终端设备
CN111010523B (zh) 一种视频录制方法及电子设备
CN109683763A (zh) 一种图标移动方法及移动终端
WO2021129536A1 (zh) 图标移动方法及电子设备
WO2020238497A1 (zh) 图标移动方法及终端设备
WO2020207379A1 (zh) 分屏方法及终端设备
US20140320537A1 (en) Method, device and storage medium for controlling electronic map
JP2023526618A (ja) 未読メッセージの表示方法、装置及び電子機器
WO2021098460A1 (zh) 截屏显示方法、装置和终端设备
WO2021109960A1 (zh) 图像处理方法、电子设备及存储介质
WO2020215982A1 (zh) 桌面图标管理方法及终端设备
CN111143299A (zh) 一种文件管理方法及电子设备
CN110417960A (zh) 一种可折叠触摸屏的折叠方法及电子设备
CN110377235A (zh) 数据处理方法、装置、移动终端及计算机可读存储介质
CN107885512A (zh) 一种应用程序安装方法、移动终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20890256

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022529748

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2020890256

Country of ref document: EP

Effective date: 20220519

NENP Non-entry into the national phase

Ref country code: DE