CN116723256A

CN116723256A - Display method of electronic equipment with folding screen

Info

Publication number: CN116723256A
Application number: CN202210726226.4A
Authority: CN
Inventors: 吕建明; 冯帅
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-02-28
Filing date: 2022-02-28
Publication date: 2023-09-08
Also published as: CN114257670B; CN114257670A

Abstract

A display method of electronic equipment with a folding screen relates to the technical field of terminals and can solve the problem that images sent and displayed by an inner screen and an outer screen are misplaced in the screen state switching process of the electronic equipment. The electronic equipment comprises an inner screen and an outer screen, wherein a camera of the electronic equipment comprises a first camera and a second camera, the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen, and the display method comprises the following steps: acquiring a first image acquired by a camera of electronic equipment; determining whether the first image meets a first preset condition or not in the process of changing the screen folding state of the electronic equipment; under the condition that the first image meets a first preset condition, controlling a target display screen of the electronic equipment to present the first image, wherein the first preset condition comprises that a camera for collecting the first image is matched with the target display screen, and the target display screen is a display screen for displaying the image currently of the electronic equipment or a display screen for displaying the image currently to be displayed of the electronic equipment.

Description

Display method of electronic equipment with folding screen

The present application is a divisional application, the application number of which is 202210184577.7, the application date of which is 2022, 2 and 28, the entire contents of which are incorporated herein by reference.

Technical Field

The application relates to the technical field of terminals, in particular to a display method of electronic equipment with a folding screen.

Background

With the continuous development of electronic devices and display screens and the improvement of life demands of people, electronic devices with folding functions of display screens have been developed. Currently, camera functions are commonly used functions provided by electronic devices, through which a user can perform video call, photographing, video recording, or the like. An inner and outer screen camera of an electronic device having a foldable screen dynamically switches as the screen is folded and unfolded. For example, when a user uses the inner screen, the inner screen presents a preview image acquired by a camera arranged on the inner screen; when a user uses the external screen, the external screen presents preview images acquired by a camera arranged on the external screen. However, in the process of switching between the internal screen and the external screen of the electronic device, there is a case where the screen display images are shifted. For example, the electronic device has been switched from the external screen display to the internal screen display, but the preview image displayed in the internal screen of the electronic device is still an image captured by the camera of the external screen.

Disclosure of Invention

The embodiment of the application provides a display method of electronic equipment with a folding screen, and based on the method, after the electronic equipment acquires a first image acquired by an acquisition camera, when the electronic equipment determines that the acquisition camera is matched with a target display screen in the process of changing the folding state of the electronic equipment, the electronic equipment controls the target display screen to present the first image. Therefore, the electronic equipment ensures that the target display screen for displaying the image is matched with the camera for sending and displaying the image, for example, the outer screen displays the image acquired by the front camera of the outer screen, the inner screen displays the image acquired by the front camera of the inner screen, the problem that the screen sends and displays the image in a dislocation mode when the inner screen and the outer screen of the folding screen are switched is solved, and the user experience is improved.

In order to achieve the above purpose, the application adopts the following technical scheme:

in a first aspect, an embodiment of the present application provides a display method of an electronic device having a folding screen, where the electronic device includes an inner screen and an outer screen, and a camera of the electronic device includes a first camera and a second camera, where the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen, and the display method includes: acquiring a first image acquired by a camera of electronic equipment; determining whether the first image meets a first preset condition or not in the process of changing the screen folding state of the electronic equipment; under the condition that the first image meets a first preset condition, controlling a target display screen of the electronic equipment to present the first image, wherein the first preset condition comprises that a camera for collecting the first image is matched with the target display screen, and the target display screen is a display screen for displaying the image currently of the electronic equipment or a display screen for displaying the image currently to be displayed of the electronic equipment.

The first image may be an image acquired by the first camera or an image acquired by the second camera.

It will be appreciated that the process of changing the folded state of the screen by the electronic device may be a gradual transition of the electronic device from the unfolded state to the folded state, or a gradual transition of the electronic device from the folded state to the unfolded state.

In an embodiment, in a process from an unfolded state to a folded state of the electronic device, the electronic device determines whether the first image meets a first preset condition, if the electronic device determines that the first image is an image acquired by the second camera, that is, the first image is an image acquired by the front camera of the external screen, the electronic device determines that the first image meets the first preset condition, and the target display screen of the electronic device presents the first image, wherein the target display screen is the external screen of the electronic device.

In another embodiment, in a process from a folded state to an unfolded state of the electronic device, the electronic device determines whether the first image meets a first preset condition, and if the electronic device determines that the first image is an image acquired by the first camera, that is, the first image is an image acquired by a front camera of the internal screen, the electronic device determines that the first image meets the first preset condition, and the target display screen of the electronic device presents the first image, wherein the target display screen is the internal screen of the electronic device.

In the embodiment of the application, in the process of changing the screen state of the electronic equipment, the electronic equipment determines that the camera which acquires the first image is matched with the target display screen, for example, the outer screen displays the image acquired by the front camera of the outer screen, and the inner screen displays the image acquired by the front camera of the inner screen, so that the problem of dislocation of the screen display image when the inner screen and the outer screen of the folding screen are switched is solved, and the user experience is improved.

In one possible implementation, determining whether the first image meets a first preset condition includes: when the first image is an image acquired by the first camera and the target display screen is an inner screen, the first image meets a first preset condition; or when the first image is an image acquired by the second camera and the target display screen is an external screen, the first image meets a first preset condition.

It can be understood that if the electronic device determines that the first image collected by the camera is an image collected by a front camera of the internal screen and the target display screen is the internal screen, the electronic device determines that the camera of the collected first image is matched with the target display screen, that is, the first image meets a first preset condition. If the electronic equipment determines that the first image acquired by the camera is the image acquired by the front camera of the external screen and the target display screen is the external screen, the electronic equipment determines that the camera of the acquired first image is matched with the target display screen, namely the first image meets a first preset condition.

In another possible implementation manner, determining whether the first image meets the first preset condition includes: when the first image is an image acquired by the first camera and the target display screen is an external screen, the first image does not meet a first preset condition; or when the first image is an image acquired by the second camera and the target display screen is an inner screen, the first image does not meet the first preset condition.

It can be understood that if the electronic device determines that the first image collected by the camera is an image collected by the front camera of the inner screen and the target display screen is the outer screen, the electronic device determines that the camera of the collected first image is not matched with the target display screen, that is, the first image does not meet the first preset condition. If the electronic equipment determines that the first image acquired by the camera is an image acquired by the front camera of the external screen and the target display screen is the internal screen, the electronic equipment determines that the camera of the acquired first image is not matched with the target display screen, namely the first image does not meet a first preset condition.

In another possible implementation manner, the display method may further include: under the condition that the first image does not meet the first preset condition, controlling a target display screen of the electronic equipment to display a second image, wherein the second image is an image which is stored in the electronic equipment in advance and is acquired by a camera matched with the target display screen; or if the first image does not meet the first preset condition, the target display screen of the control electronic device does not present the first image.

The second image may be a history image collected by a camera matched with a target display screen pre-stored by the electronic device, for example, in the case that the target display screen is an external screen, the second image may be an image collected by a front camera of the external screen pre-stored by the electronic device; and under the condition that the target display screen is an inner screen, the second image can be an image which is stored in the electronic equipment in advance and is acquired by a front camera of the inner screen.

In some embodiments, when the first image acquired by the camera acquired by the electronic device does not meet the first preset condition, the image acquired by the camera matched with the pre-stored target display screen may be displayed in the target display screen.

In other embodiments, when the first image acquired by the camera acquired by the electronic device does not meet the first preset condition, the target display screen of the electronic device does not display the first image. In this case, the target display screen of the electronic device is a black screen, a white screen, or a display specific image.

In another possible implementation manner, after acquiring the first image acquired by the camera of the electronic device, the display method may further include: under the condition that the first image is an image acquired by the first camera, determining an image identifier of the first image as a first identifier; under the condition that the first image is an image acquired by the second camera, determining an image identifier of the first image as a second identifier; determining whether the first image meets a first preset condition includes: and determining whether the first image meets a first preset condition according to the image identification of the first image and the target display screen.

It is understood that the electronic device marks the identity of the first image according to the camera that acquired the first image. For example, the image identifier of the first image collected by the first camera is marked as a first identifier, and the image identifier of the first image collected by the second camera is marked as a second identifier.

In another possible implementation manner, determining whether the first image meets the first preset condition according to the image identifier of the first image and the target display screen includes: under the condition that the target display screen is an inner screen and the image mark of the first image is a first mark, determining that the first image meets a first preset condition; and under the condition that the target display screen is an external screen and the image identifier of the first image is a second identifier, determining that the first image meets a first preset condition.

It can be understood that the image identifier of the first image is a first identifier, that is, the first image is an image acquired by the first camera, and when the target display screen is an inner screen, the electronic device determines that the first image meets a first preset condition. The image identification of the first image is a second identification, namely the first image is an image acquired by the second camera, and when the target display screen is an external screen, the electronic equipment determines that the first image meets a first preset condition.

Therefore, the electronic equipment can determine the camera for collecting the first image according to the image identification of the first image, and the electronic equipment determines that the camera for collecting the first image is matched with the target display screen, so that the problem that the images collected by the camera are transmitted and displayed in a dislocation manner in the screen switching process of the electronic equipment is avoided.

In another possible implementation manner, in a case that the first image meets a first preset condition, controlling a target display screen of the electronic device to present the first image includes: determining an image identifier of the first image as a third identifier, wherein the third identifier is used for indicating that the first image is directly sent and displayed; the target display screen of the control electronic device presents a first image with a third logo.

In an embodiment, in a case where the electronic device determines that the camera that captures the first image matches the target display screen, the electronic device may mark the image identifier of the first image as the third identifier. Therefore, when the electronic equipment determines that the image identifier of the first image is the third identifier, the electronic equipment can directly display the first image in the target display screen, so that the camera of the acquired first image is ensured to be matched with the target display screen, and the problem that the image acquired by the camera is transmitted and displayed in a dislocation manner in the screen switching process of the electronic equipment is avoided.

In another possible implementation manner, the method further includes: and under the condition that the first image does not meet the first preset condition, determining the image identifier of the first image as a fourth identifier, wherein the fourth identifier is used for indicating that the first image is discarded.

In an embodiment, in a case where the electronic device determines that the camera that collects the first image does not match the target display screen, the electronic device may mark the image identifier of the first image as the fourth identifier. When the electronic equipment determines that the image identifier of the first image is a fourth identifier, the target display screen of the electronic equipment does not display the first image until the image identifier of the first image acquired by the electronic equipment is a third identifier, and the first image is presented on the target display screen.

When the target display screen of the electronic device does not display the first image, the target display screen of the electronic device can display a second image, wherein the second image is an image acquired by a camera matched with the target display screen stored in the electronic device in advance.

In another possible implementation manner, the internal screen of the electronic device includes a first screen and a second screen, and before determining whether the first image meets the first preset condition, the method further includes: and determining that the electronic equipment is in the process of changing the folding state of the screen according to the included angle between the first screen and the second screen.

In an embodiment, when the electronic device determines that the angle between the first screen and the second screen is gradually reduced, the electronic device determines that the screen state is from the unfolded state to the folded state; when the electronic device determines that the included angle between the first screen and the second screen is gradually increased, the electronic device determines that the screen state is from the folded state to the unfolded state.

In the process of changing the screen state of the electronic equipment, the electronic equipment can acquire the included angle between the first screen and the second screen in real time, and then the electronic equipment judges the current screen state according to the included angle, so that the accuracy of determining the screen state of the electronic equipment is improved.

In a second aspect, the application provides an electronic device, which comprises an inner screen, an outer screen, a first camera and a second camera, wherein the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen. The electronic device has the functionality to implement the method described in the first aspect above. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above. For example, the electronic device includes a processing module configured to acquire a first image acquired by a camera of the electronic device; determining whether a first image meets a first preset condition or not in the process of changing the screen folding state of the electronic equipment; under the condition that the first image meets a first preset condition, controlling a target display screen of the electronic equipment to present the first image, wherein the first preset condition comprises that a camera for collecting the first image is matched with the target display screen, and the target display screen is a display screen for displaying the image currently of the electronic equipment or a display screen for displaying the image currently to be displayed of the electronic equipment.

In a third aspect, the present application provides an electronic device comprising: a touch screen including a touch sensor and a display screen; one or more processors; a memory; wherein the memory stores one or more computer programs, the one or more computer programs comprising instructions, which when executed by the electronic device, cause the electronic device to perform the method of displaying an electronic device with a folding screen as described in any of the first aspects above.

In a fourth aspect, the present application provides a computer readable storage medium having instructions stored therein, which when run on an electronic device, cause the electronic device to perform the method of displaying an electronic device with a folding screen according to any of the first aspects.

In a fifth aspect, the present application provides a computer program product comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of displaying an electronic device with a folding screen according to any of the first aspects.

It will be appreciated that the electronic device according to the second and third aspects, the computer storage medium according to the fourth aspect, and the computer program product according to the fifth aspect are each configured to perform the corresponding methods provided above, and therefore, the advantages achieved by the method are referred to as advantages in the corresponding methods provided above, and will not be described here again.

Drawings

Fig. 1 is a schematic diagram of a folding screen mobile phone according to an embodiment of the present application when folded;

fig. 2 is a schematic diagram of a folding screen mobile phone when unfolded according to an embodiment of the present application;

fig. 3 is a schematic diagram of an application scenario of a display method according to an embodiment of the present application;

fig. 4 is a second application scenario diagram of the display method according to the embodiment of the present application;

fig. 5 is a third application scenario diagram of the display method according to the embodiment of the present application;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 7 is a schematic diagram of calculating an included angle between an A screen and a B screen according to an embodiment of the present application;

FIG. 8 is a schematic diagram of an example of a geographic coordinate system according to an embodiment of the present application;

fig. 9 is a software structure diagram of an electronic device according to an embodiment of the present application;

fig. 10 is a schematic flow chart of a display method according to an embodiment of the application;

fig. 11 is a schematic diagram of an application scenario of a display method according to an embodiment of the present application;

FIG. 12 is an exemplary diagram of a cache structure provided in an embodiment of the present application;

FIG. 13 is a second flow chart of a display method according to an embodiment of the present application;

fig. 14 is a schematic diagram of an application scenario of a display method according to an embodiment of the present application;

Fig. 15 is a sixth application scenario diagram of a display method according to an embodiment of the present application;

fig. 16 is a schematic structural diagram of another electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone.

The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

The electronic device in the embodiment of the application comprises the foldable screen, wherein the foldable screen can be unfolded or folded along the folding axis, and different display areas can be displayed in different states. Taking the electronic equipment as a folding screen mobile phone as an example, the electronic equipment is illustrated to present different display areas in different states.

Fig. 1 is a schematic diagram of a folding screen mobile phone according to an embodiment of the present application when folded. As shown in fig. 1 (a), when the folding screen mobile phone is in a fully folded state and the external screen front camera 1 is opened, an image acquired by the external screen front camera 1 is displayed by the external screen 11. As shown in fig. 1 (b), when the folding screen mobile phone is in a folded state and is mapped using the external screen rear camera 2, an image acquired by the external screen rear camera 2 is displayed by the external screen 11.

Fig. 2 is a schematic diagram of a folding screen mobile phone when unfolded according to an embodiment of the present application. The unfolding process of the folding screen mobile phone is shown in (a) of fig. 2 to (b) of fig. 2. As shown in (b) of fig. 2, assuming that the folding-screen cellular phone is in an unfolded state and is mapped using the internal-screen front camera 3, an image acquired by the internal-screen front camera 3 is displayed by the internal screen 21 or the internal screen 22, or a large screen composed of the internal screen 21 and the internal screen 22 is displayed. When the folding screen mobile phone in fig. 2 is in a fully unfolded state, for example, as shown in (b) in fig. 2, the screen included angle θ of the mobile phone may be 180 ° or approximately 180 °, so that large screen display can be realized, richer information can be provided for the user, and better use experience is brought to the user. The screen angle θ may be an angle between the inner screen 21 and the inner screen 22. As shown in fig. 2 (c), the foldable screen presents an outer screen 23 from the outside of the folding screen phone. When the folding screen mobile phone is in an unfolding state and the outer screen rear camera 1 is used for drawing, the image acquired by the outer screen rear camera 1 is displayed by the outer screen 23. Wherein the outer screen 23 may be disposed on the back of the inner screen 21 or the inner screen 22, as depicted by way of example only in fig. 2 and not limitation herein. When the folding screen mobile phone is in an unfolded state and is used for drawing a picture by using the external screen front camera 2, the image acquired by the external screen front camera 2 can be displayed by the internal screen 21 and/or the internal screen 22.

It should be noted that, the value range of the included angle θ between the inner screen 21 and the inner screen 22 may be [0 °,180 ° ]. In the embodiment of the application, if θ is within the range of [0 °, X ], it can be determined that the folding mobile phone is in a folded state, if θ is within the range of (X, 180 ° ], it can be determined that the folding mobile phone is in an unfolded state, wherein X is a preset angle threshold value, X may be set in the electronic device by a user, or may be determined by the electronic device according to a usage habit of the user.

For example, as shown in (a) of fig. 1, when the folding screen mobile phone is in a folded state and the user uses the external screen front camera 1 to perform a video call or a photo preview, the folding screen mobile phone uses the external screen front camera 1 to capture an image and the external screen 11 displays the image captured by the external screen front camera 1. The folding screen mobile phone responds to the operation of manually opening the folding screen by a user, and the folding screen is switched from a folding state to an unfolding state. For example, the unfolded state of the folding-screen mobile phone is shown in fig. 2 (b). The folding screen mobile phone uses the front-facing camera 3 to collect images, and the images collected by the front-facing camera 3 are displayed by the inner screen 21 and/or the inner screen 22. Therefore, the camera of the folding screen mobile phone is switched along with the screen state under the video or photographing scene, the process of switching the image acquired by the front camera 1 of the outer screen to the image acquired by the front camera 3 of the inner screen is realized, and the process of switching the display image of the outer screen to the display image of the inner screen is realized.

Also, as shown in (b) of fig. 2, when the folding screen mobile phone is in an unfolded state and the user uses the inner screen front camera 3 to perform a video call or a photographing preview, the folding screen mobile phone uses the inner screen front camera 3 to collect an image, and the inner screen 21 and/or the inner screen 22 displays the image collected by the inner screen front camera 3. The folding screen mobile phone responds to the operation of combining the folding screens manually by a user, and the folding screens are switched from an unfolding state to a folding state. For example, the folding state of the folding screen mobile phone is shown in fig. 1 (a). The folding screen mobile phone uses the front camera 1 of the external screen to collect images, and the external screen 11 displays the images collected by the front camera 1 of the external screen. Therefore, the camera of the folding screen mobile phone is switched along with the screen state under the video or photographing scene, the process of switching the image acquired by the front-mounted camera of the inner screen to the image acquired by the front-mounted camera of the outer screen is realized, and the process of switching the display image of the inner screen to the display image of the outer screen is realized.

It should be noted that, in the embodiment of the present application, the image may represent a photo, or may represent each frame of image in a video, which is not limited herein. However, in the related art, in the process of performing screen switching on the folding screen of the electronic device, there may be an incomplete switching on the camera corresponding to the drawing when the screen state switching is completed, or there may be an incomplete switching on the screen for displaying an image when the switching on the camera for the drawing is completed, so that there may be a case where the image display is misplaced when the screen displays the image.

In some embodiments, as shown in (a) in fig. 3, when the folding screen of the electronic device is switched from screen 1 to screen 2, the electronic device has completed the switching of the cameras, that is, the camera for capturing the image has been switched from the camera corresponding to screen 1 to the camera corresponding to screen 2. However, the screen 2 of the electronic device is not yet lighted, and at this time, the image displayed on the screen 1 is the image acquired by the camera corresponding to the screen 2. The screen 1 may be an external screen of a folding screen of the electronic device. The screen 2 may be an inner screen of a folding screen of the electronic device. Of course, the screen 1 may also be an external screen of the electronic device, and the second screen may be an internal screen of a folding screen of the electronic device, which is not limited herein.

If the screen 1 is an external screen, the camera corresponding to the screen 1 is a front camera of the external screen. If the screen 1 is an inner screen, the camera corresponding to the screen 1 is a front camera of the inner screen. Similarly, if the screen 2 is an external screen, the camera corresponding to the screen 2 is a front camera of the external screen. If the screen 2 is an inner screen, the camera corresponding to the screen 2 is a front camera of the inner screen. Likewise, the number of the cells to be processed,

still explained with reference to fig. 1 and 2 as an example, assuming that the screen 1 is the external screen 11 of the folding-screen mobile phone shown in fig. 1 (a), the camera corresponding to the screen 1 may be the external-screen front camera 1 shown in fig. 1 (a). Assuming that the screen 2 is a large screen composed of an inner screen 21 and an inner screen 22 of the folding-screen mobile phone shown in (b) of fig. 2, the camera corresponding to the screen 2 may be the inner-screen front camera 3 shown in (b) of fig. 2.

For example, as shown in fig. 4, when the electronic apparatus is in a folded state, a camera application of the electronic apparatus captures an image in response to a photographing operation of a user, and a screen 1 of the electronic apparatus displays an image captured by an external screen front camera 41, see (a) in fig. 4. In response to a user switching from a folded state to an unfolded state, a camera used for acquiring images in the electronic device is switched from an external screen front camera to an internal screen front camera. As shown in fig. 4, the camera for capturing images in the electronic device is switched from the external screen front camera 41 to the internal screen front camera 42. However, when the camera switching in the electronic device is completed, the screen 2 of the electronic device has not yet been lit. I.e. the screen switch of the electronic device has not been completed. In this case, the image captured by the front camera 42 of the internal screen of the electronic device is still displayed in the screen 1, and the screen 2 is in the black screen state, see (b) in fig. 4.

In other embodiments, as shown in fig. 3 (b), when the electronic device is switched from screen 1 to screen 2, screen 2 of the electronic device is already lit, but the camera corresponding to screen 2 of the electronic device does not send an image (e.g., the camera corresponding to screen 2 is still in an initialization phase). In this case, the image displayed in the screen 2 of the electronic device is an image captured by the camera corresponding to the current screen 1.

For example, as shown in fig. 5, when the electronic apparatus is in a folded state, a camera application of the electronic apparatus captures an image in response to a photographing operation of a user, and a screen 1 of the electronic apparatus displays an image captured by an external screen front camera 51, see (a) in fig. 5. The folding screen of the electronic device is switched from the screen 1 to the screen 2 in response to an operation of switching from the folded state to the unfolded state by the user. As shown in fig. 5, a screen displaying an image in the electronic device is switched from screen 1 to screen 2. However, when the screen switching in the electronic device is completed, the front cameras of the inner/outer screens of the electronic device are not yet switched. I.e. the electronic device is not switched from the outer screen front camera 51 to the inner screen front camera 52. In this case, when the folding screen is displayed in the unfolded state in the screen 2 of the electronic device, the image (for example, an air balloon) acquired by the front camera 51 of the external screen is shown in fig. 5 (b).

It should be noted that, the outer screen of the folding screen in fig. 1 to 5 displays the image displayed by the front camera of the outer screen, and the inner screen displays the image displayed by the front camera of the inner screen, which is only described as an example. In the embodiment of the application, the outer screen can also display the image sent by the rear camera, and the inner screen can also display the image sent by the rear camera.

Therefore, the embodiment of the application provides a display method of electronic equipment with a folding screen, which is used for controlling the target display screen of the electronic equipment to present images acquired by a camera under the condition that the electronic equipment determines that the camera for acquiring the images is matched with the target display screen. For example, the electronic device marks the image collected by the camera according to the camera for collecting the image, and then, the target display screen of the electronic device presents the image collected by the camera matched with the target display screen, or the electronic device determines to send and display the image collected by the camera matched with the display screen for displaying the image currently according to whether the display screen for displaying the image currently is matched with the camera for collecting the image or not. Therefore, the electronic equipment ensures that the target display screen of the display image of the folding screen is matched with the camera for sending and displaying the image, for example, the outer screen displays the image acquired by the front camera of the outer screen, the inner screen displays the image acquired by the front camera of the inner screen, the problem that the screen sends and displays the image in a misplacement mode when the screen state of the folding screen is switched is solved, and the user experience is improved.

The folding screen of the electronic device may be a multi-screen folding screen. The multi-screen folding screen may include multiple (two or more) screens. The plurality of screens is a plurality of individual display screens. The plurality of screens may be connected in turn by a folding shaft. Each screen can rotate around a folding shaft connected with the screen, so that the folding of the multi-screen folding screen is realized.

Exemplary, the display method of the electronic device provided by the embodiment of the application can be applied to a mobile phone, a tablet computer, a personal computer (personal computer, PC), a personal digital assistant (personal digital assistant, PDA), a smart watch, a netbook, a wearable electronic device, an augmented reality (augmented reality, AR) device, a Virtual Reality (VR) device, a vehicle-mounted device, a smart car, a smart sound device, and other electronic devices with display screens, which are not limited in this embodiment of the application.

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application, as shown in fig. 6.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it may be called directly from memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, such that the processor 110 communicates with the touch sensor 180K through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (camera serial interface, CSI), display serial interfaces (display serial interface, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100.

In the embodiment of the present application, the processor 110 may control the MIPI interface switch to close the front-mounted camera of the inner screen and open the drawing path of the front-mounted camera of the inner screen, or control the MIPI interface switch to close the front-mounted camera of the outer screen and open the drawing path of the front-mounted camera of the inner screen, thereby achieving the purpose of switching the drawing paths of the cameras.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

In an embodiment of the present application, the display 194 of the electronic device 100 may be a flexible folding screen. The flexible folding screen comprises folding edges made of flexible materials. Part or all of the flexible folding screen is made of flexible materials. The two screens formed after the flexible folding screen is folded are one complete screen of an integral structure, and the two screens can be understood as two display areas. Alternatively, the foldable screen of the electronic device may be a multi-screen foldable screen. The multi-screen folding screen may include multiple (two or more) screens. The plurality of screens is a plurality of individual display screens. The plurality of screens may be connected in turn by a folding shaft. Each screen can rotate around a folding shaft connected with the screen, so that the folding of the multi-screen folding screen is realized. The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, so that the electrical signal is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

In an embodiment of the present application, the camera 193 may include an external front camera, an internal front camera, a rear camera, and the like.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer-executable program code that includes instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes. In an embodiment of the present application, the folding screen of the electronic device 100 may be folded to form a plurality of screens. A gyro sensor 180B may be included in each screen for measuring the orientation (i.e., a directional vector of the orientation) of the corresponding screen. The electronic device 100 may determine the included angle of the adjacent screens according to the measured angle change of the orientation of each screen.

It should be noted that, in the embodiment of the present application, the electronic device includes a folding screen, and the folding screen is divided into a plurality of display areas after the electronic device is folded, where each display area is called a screen. A gyro sensor 180B may be included on each screen for measuring the orientation (i.e., directional vector of orientation) of the corresponding screen. For example, as shown in (a) of fig. 2, the electronic device is folded to form a first screen and a second screen, and the first screen and the second screen are each provided with a gyro sensor 180B therein, and the orientations of the first screen and the second screen can be measured, respectively. And the electronic equipment determines the included angle between the first screen and the second screen according to the measured change of the orientation angle of each screen.

For example, the electronic apparatus 100 is folded to form a first screen (a screen illustrated in the drawing) in which the gyro sensor a is provided and a second screen (B screen illustrated in the drawing) in which the gyro sensor B is provided, as illustrated in fig. 7. Here, a principle in which the gyro sensor a measures the orientation of the a screen (i.e., the directional vector of the orientation), the gyro sensor B measures the orientation of the B screen (i.e., the directional vector of the orientation), and a principle in which the electronic apparatus 100 calculates the angle θ between the a screen and the B screen from the orientation of the a screen and the orientation of the B screen will be described.

Wherein the coordinate system of the gyro sensor is a geographical coordinate system. As shown in fig. 8, the origin O of the geographic coordinate system is at the point where the vehicle (i.e., the device containing the gyroscopic sensor, such as electronic device 100) is located, the x-axis points east (E) along the local latitude line, the y-axis points north (N) along the local meridian line, and the z-axis points upward along the local geographic perpendicular line, and forms a right-hand rectangular coordinate system with the x-axis and the y-axis. The plane formed by the x axis and the y axis is a local horizontal plane, and the plane formed by the y axis and the z axis is a local meridian plane. Thus, it can be appreciated that the coordinate system of the gyroscopic sensor is: the gyroscope sensor is taken as an origin O, an x-axis along the direction of the local latitude line to the east, a y-axis along the direction of the local meridian to the north, and a z-axis along the direction of the local geographic plumb line (namely the opposite direction of the geographic plumb line).

The electronic device 100 can measure a direction vector of the orientation of each screen in the coordinate system of the gyro sensor provided therein using the gyro sensor 180B provided in each screen. For example, referring to a side view of the electronic device as shown in fig. 7, the direction vector of the orientation of the a screen in the coordinate system of the gyro sensor a measured by the electronic device is a vector z1, and the direction vector of the orientation of the B screen in the coordinate system of the gyro sensor B is a vector z2. The electronic device 100 can calculate the angle α between the vector z1 and the vector z2 by using the formula (1). Wherein, formula (1) is as follows:

as can be seen from fig. 7, since the vector z1 is perpendicular to the a-screen and the vector z2 is perpendicular to the B-screen, the angle θ=180° - α between the a-screen and the B-screen can be obtained. Namely, the electronic device can determine the included angle θ between the a screen and the B screen according to the measured directional vector of the a screen in the coordinate system of the gyro sensor a (i.e., vector z 1) and the directional vector of the B screen in the coordinate system of the gyro sensor B (i.e., vector z 2).

Note that, although the positions of the gyro sensors provided in the a-screen and the B-screen do not overlap, that is, the origins of the coordinate systems of the gyro sensors of the a-screen and the B-screen do not overlap, the x-axis, the y-axis, and the z-axis of the two coordinate systems are parallel, so that the coordinate systems of the gyro sensors provided in the a-screen and the B-screen can be considered to be parallel. Thus, although the vector z1 and the vector z2 are not in the same coordinate system, the axes of the two coordinate systems are parallel, and therefore, the angle α between the vector z1 and the vector z2 can be calculated by the above formula (1).

In some embodiments, the angle θ between the A screen and the B screen may also be measured by one or more other sensors. For example, one acceleration sensor 180E may be provided in each of the folding screens. The electronic device 100 (e.g., the processor 110) may measure the motion acceleration of each screen θ as it is rotated using an acceleration sensor; and then calculating the rotation angle of one screen relative to the other screen according to the measured motion acceleration, namely the included angle theta between the screen A and the screen B.

In other embodiments, the gyro sensor 180B may be a virtual gyro sensor formed by combining a plurality of other sensors. The virtual gyroscope sensor can be used for calculating the included angle between adjacent screens of the folding screen, namely the included angle theta between the screen A and the screen B.

The air pressure sensor 180C is used to measure air pressure.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object in the vicinity of the electronic device 100. The electronic device 100 can detect that the user holds the electronic device 100 close to the ear by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195, or removed from the SIM card interface 195 to enable contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, i.e.: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

The software system of the electronic device may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the invention, an Android system with a layered architecture is taken as an example, and the software structure of the electronic equipment is illustrated.

Fig. 9 is a software structure diagram of an electronic device according to an embodiment of the present application.

It will be appreciated that the layered architecture divides the software into several layers, each with a clear role and division. The layers communicate with each other through a software interface. In some embodiments, the Android system may include an application layer (abbreviated as application layer), an application framework layer (abbreviated as framework layer), a hardware abstraction layer (hardware abstract layer, HAL), and a kernel layer.

The application layer may include a series of application packages.

As shown in fig. 9, the application package may include a system application. The system application refers to an application which is set in the electronic equipment before the electronic equipment leaves a factory. By way of example, system applications may include programs for cameras, gallery, calendar, music, short messages, and conversations.

The application package may also include a third party application, which refers to an application installed after a user downloads the installation package from an application store (or application marketplace). For example, map-like applications (e.g.Etc.), take-away applications (e.g. +.>Etc.), reading class applications (e.g., e-books), social class applications (e.g., +.>) Travel class applications (e.g. +. >) Etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in fig. 9, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a folding screen management module, a camera service module, a background service module, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is for providing communication functions of the electronic device. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the mobile phone vibrates, and an indicator light blinks.

The folding screen management module is used for determining the screen state of the folding screen according to the angle between the first screen and the second screen of the folding screen. For example, the folding screen may be connected by a folding axis by the first screen and the second screen. As shown in fig. 2, the first screen may be an inner screen 21, the second screen may be an inner screen 22, and an angle between the first screen and the second screen may be an angle between the inner screen 21 and the inner screen 22.

The camera service module is used for determining the sent and displayed image and sending the sent and displayed image to the application program.

The background service module is used for sending the screen state to the camera providing module after receiving the screen state sent by the folding screen management module.

HAL is a generic interface that encapsulates the underlying hardware drivers one layer, providing the application framework layer with call drivers.

In an embodiment of the present application, the HAL may include a camera providing module and a tag setting module.

The camera providing module is used for determining a target camera of the graph according to the screen state.

The label setting module is used for marking the image acquired by the target camera.

The kernel layer is a layer between hardware and software. The kernel layer at least comprises a display driver, a camera driver, an ISP driver and an audio driver.

In some embodiments, the camera driver may include an outer screen front camera driver and an inner screen front camera driver, wherein the outer screen front camera driver may be used to drive the outer screen front camera and the inner screen front camera driver may be used to drive the inner screen front camera. In addition, the camera driver may also include a rear camera driver.

The ISP driver is used for acquiring images acquired by the camera.

The technical solutions in the following embodiments may be implemented in the electronic device 100 having the above-described hardware structure and software architecture. The following will also take the electronic device 100 as an example of a folding screen mobile phone, and this scheme will be described in an exemplary manner.

In the embodiment of the application, the camera application program in the mobile phone adopts the camera to shoot images in response to shooting operations (such as clicking or touching operations) of a user, or the social application program in the mobile phone (such as,etc.) to conduct a video call or take an image with a camera in response to a user operation. When the screen state of the folding screen of the mobile phone changes, namely, the screen for displaying the preview image in the mobile phone is switched, the camera for collecting the image is also switched. For example, after the screen state of the folding screen of the mobile phone is switched from the folding state to the unfolding state, the screen for displaying the preview image in the mobile phone is switched from the outer screen to the inner screen, and the image displayed in the display screen is switched from the image acquired by the front camera of the outer screen to the image acquired by the front camera of the inner screen.

When the screen state of the folding screen is switched from the folding state to the unfolding state, the camera of the figure is switched from the front camera of the outer screen to the front camera of the inner screen, which is only described as an example. In the embodiment of the application, when the screen state of the folding screen changes, the camera of the figure can be switched from the front camera to the rear camera, can be switched from the rear camera to the front camera, and can be switched from the rear camera 1 to the rear camera 2, and the application is not limited herein.

In the embodiment of the application, when the front cameras of the inner and outer screens of the mobile phone are dynamically switched along with the screen state of the folding screen, the problem that the front cameras of the inner and outer screens send and display images and the screen state are not synchronous can exist, so that the situation that the sent and displayed images are misplaced exists in the process of switching the inner screen and the outer screen.

In the embodiment of the application, in the process of requesting a picture by an application program in the mobile phone, an external screen front camera and an internal screen front camera in the mobile phone may both acquire images, so that the mobile phone needs to determine a final sent target image from the images acquired by the external screen front camera and the internal screen front camera.

In some embodiments, the tag setting module of the hardware abstraction layer of the mobile phone may mark the image collected by the camera, for example, the tag setting module marks the image collected by the front camera of the inner screen as a first identifier and marks the image collected by the front camera of the outer screen as a second identifier. The first mark and the second mark are respectively used for uniquely marking images acquired by the front-mounted camera of the inner screen and the front-mounted camera of the outer screen. After the tag setting module sends the marked image to the camera service module, the camera service module can determine a target image for sending and displaying from the marked image according to the screen of the current display image. A specific implementation may be exemplarily seen in the implementation of fig. 10 below.

As shown in fig. 10, the display method may include:

s11, the application program sends a drawing request to the ISP driver through the camera service module.

The image drawing request is used for acquiring an instruction for sending a display image by the camera. Here, the application program may be a system application (for example, a camera application) of the mobile phone, or may beFor third party applications in a cell phone (e.g.,etc.), without limitation herein.

In the embodiment of the application, when a mobile phone with a folding screen starts a shooting function of a camera application, or a social application program in the mobile phone responds to user operation to carry out video call, the camera application or the camera application program sends a picture request to a camera providing module.

Alternatively, the application may first send a map request to the camera service module, and then the camera service module sends the received map request to the camera providing module.

For example, fig. 11 (a) shows a user interface diagram of a folding screen mobile phone, and when the mobile phone detects that the user clicks an icon of a camera application on a desktop, and starts the camera application to perform self-timer shooting, a shooting interface shown in fig. 11 (b) is displayed. The shooting interface may include a view finder, and a preview image may be displayed in real time in the view finder. In response to the launching of the camera application, the camera application sends a map request to the camera providing module. It should be noted that, in the photographing mode and the video recording mode (i.e., the video photographing mode), the size of the viewfinder may be the same or different, which is not limited herein. For example, the view finder shown in (b) in fig. 11 may be a view finder in a photographing mode. In the video mode, the view finder may be the entire touch screen.

S12, the ISP drives to acquire images acquired by the camera.

In the embodiment of the application, after receiving a drawing request sent by an application program, an ISP (Internet service provider) drive controls a camera to drive and trigger an outer screen front camera and an inner screen front camera to acquire images, and the outer screen front camera and the inner screen front camera send the acquired images to the ISP drive. Or the ISP drive controls the camera drive to trigger the front camera or the front camera of the inner screen to send the acquired image to the ISP drive.

It will be appreciated that the ISP drive can take an image from the camera as long as it is capable of outputting an image. That is, in embodiments of the present application, the ISP driver may acquire an image captured by a camera from the camera that is currently outputting the image.

S13, the ISP drives to send images acquired by the camera to the tag setting module through the camera providing module.

S14, the label setting module marks the image acquired by the camera.

In the embodiment of the application, when the label setting module marks the image acquired by the camera, a label can be marked on a buffer corresponding to the image frame acquired by the camera. The cache corresponding to the image frames collected by the camera is used for storing image data and corresponding Metadata (Metadata). Metadata, also known as intermediate data, relay data, is mainly information describing data attributes, and is used to support functions such as indicating storage locations, history data, resource searching, file recording, and the like.

Fig. 12 is an exemplary diagram of a buffer structure corresponding to an image frame according to an embodiment of the present application, and as shown in fig. 12, the buffer structure may include a frame number, camera metadata, and image data of a preview image. The frame number indicates the number of frames of the image. The camera metadata may store the aperture, focal length, exposure time, etc. of the target camera. In the embodiment of the application, the tag setting module adds a tag in the camera metadata and is used for marking the camera for displaying the image. Therefore, when the screen of the mobile phone displays the image, the corresponding image can be displayed according to the label added in the cache of the image, the problem of image display dislocation is avoided, and the use experience of a user is improved.

In an embodiment, if the image acquired by the tag setting module and acquired by the camera is an image acquired by the front-mounted camera of the external screen, the tag setting module may mark the first identifier on the tag in the cache of the image frame. The first mark is used for marking the image as an image acquired by the front-mounted camera of the external screen.

In another embodiment, if the image acquired by the tag setting module and acquired by the camera is an image acquired by the front-end camera of the internal screen, the tag setting module may mark the tag in the cache of the image frame with the second identifier. The second mark is used for marking the image as an image acquired by the front-mounted camera of the inner screen.

It should be explained that the image collected by the camera received by the tag setting module may be one or more frames. And under the condition that the image collected by the camera received by the tag setting module is multi-frame, the tag setting module marks each frame of image according to the camera corresponding to the frame of image. For example, if the tag setting module determines that the first frame image is an image acquired by the external-screen front-end camera, the tag setting module marks the image identifier of the frame image as a first identifier. If the tag setting module determines that the second frame image is the image acquired by the front-mounted camera of the inner screen, the tag setting module marks the image identifier of the frame image as a second identifier. If the tag setting module determines that the third frame image is the image acquired by the front-mounted camera of the inner screen, the tag setting module marks the image identifier of the frame image as a second identifier.

S15, the tag setting module sends the marked image acquired by the camera to the camera service module.

S16, the camera service module determines a transmitted target image according to the screen of the current display image.

In the embodiment of the application, after the camera service module acquires the marked image sent by the tag setting module and acquired by the camera, the camera service module can determine the sent target image according to the screen of the current display image.

As shown in fig. 11, when the screen state of the mobile phone is in the unfolded state in the process that the folded screen is unfolded in response to the user's unfolding operation after the camera application in the mobile phone is started, as shown in (c) in fig. 11, the camera service module determines that the screen of the current display image is an inner screen, and the camera service module determines that the sent target image is a face image collected by the front camera of the inner screen.

It may be explained that if the screen state acquired by the camera service module is a folded state, the camera service module determines, from the images acquired by the marked cameras, that the image marked as the first mark is the target image. When the screen of the current display image in the mobile phone is an external screen, the camera service module determines the image acquired by the front camera of the external screen as a target image from the images acquired by the marked cameras. If the screen state acquired by the camera service module is the unfolding state, the camera service module determines the image marked as the second mark as the target image from the images acquired by the marked camera. When the screen of the current display image in the mobile phone is an inner screen, the camera service module determines the image acquired by the front camera of the inner screen as a target image from the images acquired by the marked cameras. Therefore, when the screen of the mobile phone displays images, the corresponding images can be displayed according to the screen state of the folding screen, the problem of image display dislocation is avoided, and the use experience of a user is improved.

S17, the camera service module sends the target image to the application program.

In the embodiment of the application, after the camera service module determines the sent target image, the target image is sent to the application program to be displayed in the screen of the folding screen.

According to the method, the tag setting module marks the image acquired by the camera according to whether the camera for acquiring the image is an inner screen front camera or an outer screen front camera, the camera service module determines the target image to be displayed according to whether the camera corresponding to the screen for displaying the image currently and the camera corresponding to the marked image are matched, the outer screen of the folding screen is ensured to display the image acquired by the outer screen front camera, the inner screen is ensured to display the image acquired by the inner screen front camera, the problem that the screen is used for displaying the image in a misplacement mode when the screen state of the folding screen is switched is solved, and the user experience is improved.

In other embodiments, when the tag setting module of the hardware abstraction layer of the mobile phone determines that the screen state of the folding screen changes, the tag setting module marks the image acquired by the camera according to whether the camera corresponding to the screen of the current display image is matched with the camera of the figure. The label setting module determines to send and display the image acquired by the camera matched with the screen of the current display image according to the image identification of the marked image, thereby ensuring that the screen of the current display image is matched with the camera of the picture, and solving the problem of misplacement of the sent and displayed image of the screen when the screen state of the folding screen is switched. A specific implementation may be exemplarily seen in the implementation of fig. 13 below.

As shown in fig. 13, the display method may include:

s21, the application program sends a drawing request to the ISP driver through the camera service module.

S22, the ISP drives to acquire images acquired by the camera.

S23, the ISP drives the camera providing module to send the image collected by the camera to the tag setting module.

In the embodiment of the present application, the implementation process of S21 to S23 may refer to the implementation process of S11 to S13, which is not described herein.

S24, the tag setting module determines that the screen state changes, and judges whether the screen of the current display image is matched with a camera for collecting the image or not.

In the embodiment of the application, the tag setting module judges whether the screen state of the folding screen changes, and when the tag setting module determines that the screen state of the folding screen changes, the tag setting module judges whether the screen of the current display image is matched with the camera for collecting the image.

It can be understood that when the screen state of the folding screen changes, the camera for sending and displaying the image can be switched along with the switching of the screen. For example, when the screen state of the folding screen is switched from the folding state to the unfolding state, that is, the screen displaying the image is switched from the outer screen to the inner screen, the camera of the figure is also switched from the front camera of the outer screen to the front camera of the inner screen. However, after the screen displaying the image is switched from the outer screen to the inner screen, there may be a camera of the figure that has not been switched. Therefore, the tag setting module judges whether the screen of the current display image is consistent with the target camera.

In some embodiments, the mobile phone may mark the screen and the camera, for example, the mobile phone may mark the external screen and the external screen front camera as the same identifier, and mark the internal screen and the internal screen front camera as the same identifier. The label setting module can judge whether the screen of the current display image is matched with the image acquisition camera according to whether the screen of the display image is consistent with the identification of the target camera.

If the label setting module determines in step S24 that the screen of the currently displayed image matches the camera of the acquired image, step S25 is executed, otherwise step S26 is executed.

S25, the label setting module marks the image acquired by the camera as a third mark.

S26, the label setting module marks the image acquired by the camera as a fourth mark.

The third mark is used for indicating the image collected by the camera to be directly sent and displayed. The image collected by the camera is matched with the screen of the current display image, and the mobile phone can directly send the image collected by the camera to display. The fourth mark is used for indicating that the image acquired by the camera is discarded. That is, the image collected by the camera is not matched with the screen of the current display image, and the mobile phone can discard the image collected by the camera.

In the embodiment of the application, if the tag setting module determines that the screen of the current display image is matched with the camera for collecting the image, the tag setting module marks the image collected by the camera as a third identifier. If the tag setting module determines that the screen of the current display image is not matched with the camera for collecting the image, the tag setting module marks the image collected by the camera as a fourth mark. For example, if the tag setting module determines that the screen on which the image is currently displayed is an external screen and the camera on which the image is acquired is an external screen front camera, the tag setting module marks the image acquired by the camera as a third identifier. If the tag setting module determines that the screen of the current display image is an outer screen and the camera for collecting the image is an inner screen front camera, the tag setting module marks the image collected by the camera as a fourth mark.

For example, as shown in fig. 12, if the tag setting module determines that the screen of the current display image matches the camera that collects the image, the tag setting module marks the cache state in the cache structure of the image collected by the camera as the third identifier. For example, the third identifier may be NORMAL. If the tag setting module determines that the screen of the current display image is not matched with the camera for collecting the image, the tag setting module marks the cache state in the cache structure of the image collected by the camera as a fourth mark. For example, the fourth identification may be ERROR.

S27, the tag setting module sends an image marked as a third mark to the camera service module.

S28, the camera service module sends the image marked as the third mark to the application program.

In the embodiment of the application, after the camera service module acquires the image marked as the third identifier sent by the tag setting module, the camera service module can send the image marked as the third identifier to the application program for display. After the camera service module acquires the image marked as the fourth mark sent by the tag setting module, the camera service module does not send the image marked as the fourth mark to the application program for display.

It can be understood that, because the image marked as the third mark is the image collected by the camera corresponding to the screen of the current display image, the camera service module sends and displays the image marked as the third mark, so that the image displayed in the current screen of the mobile phone is ensured to be the image of the corresponding camera picture, and the problem of image sending and displaying dislocation is solved.

According to the method, the tag setting module marks the image acquired by the camera according to whether the screen of the current display image is matched with the camera for acquiring the image or not, and determines to send and display the image acquired by the camera consistent with the screen of the current display image, so that the image of the front camera of the outer screen of the folding screen is ensured to be displayed, the image of the front camera of the inner screen is displayed on the inner screen, the problem of dislocation of the sent and displayed image of the screen when the screen state of the folding screen is switched is solved, and the user experience is improved.

In the embodiment of the application, when the camera service module marks the image acquired by the camera according to the label setting module, and the camera service module determines the target image for sending and displaying from the marked image, the camera service module determines that the image acquired by the camera uploaded by the hardware abstraction layer is misplaced with the screen of the current display image after the screen of the folding screen is switched, i.e. the screen of the current display image is lighted. For example, the camera service module determines that an image acquired by the camera and uploaded by the hardware abstraction layer is marked as a second identifier or a fourth identifier. Under the situation, if the camera service module loses frames of images which are staggered with the screen of the current display image, the corresponding images acquired by the camera cannot be displayed in time in the screen of the mobile phone display image, so that the screen may be blocked or black.

To this end, in some embodiments, the handset may save the last few frames of images acquired by the camera after the switch before the front camera of the internal/external screen of the handset switches. For example, the mobile phone can save the last 5 frames of images acquired by the switched cameras. When the screen switching of the folding screen is finished and the front-mounted camera of the inner/outer screen is not finished, the camera service module acquires the last frames of images acquired by the switched cameras before the screen switching and transmits and displays the last frames of images in the screen of the current display image in a frame inserting mode until the camera service module acquires the images transmitted and displayed by the camera corresponding to the screen of the current display image, and the camera service module transmits and displays the images transmitted and displayed by the camera corresponding to the screen of the current display image, so that the situation that the screen of the current display image is blocked or black screen is avoided, and the use experience of a user is improved.

For example, as shown in fig. 14, when the folding screen is in the folded state, the front camera of the external screen captures an image and displays it on the external screen, see (a) in fig. 14. When the folding screen is in a folding state, the mobile phone stores the last several frames of images (for example, 5 frames of images) acquired by the front camera of the external screen. When the folding screen is switched from the folded state to the unfolded state, for example, from (a) in fig. 14 to (b) in fig. 14, and then from the unfolded state to the folded state, for example, from (b) in fig. 14 to (c) in fig. 14. When the folding screen is switched from the inner screen to the outer screen, if the front camera of the inner screen is not completely switched to the front camera of the outer screen, the camera service module may acquire the last several frames of images acquired by the front camera of the outer screen when the screen is in the folded state, and send the several frames of images to the outer screen for display, see (c) in fig. 14.

In some embodiments, when the folding screen of the mobile phone is switched from the folding state to the unfolding state, before the folding screen is completely switched from the outer screen to the inner screen, and the camera of the figure is still the front camera of the outer screen, the mobile phone can display the image acquired by the front camera of the outer screen on a part of the screen of the inner screen. When the mobile phone determines that screen switching is completed and that the internal screen front camera is used for drawing, the internal screen formed by the first screen and the second screen displays images acquired by the internal screen front camera. Therefore, the mobile phone displays the image acquired by the front camera of the outer screen on the partial screen of the inner screen before the screen switching is completed, so that the situations of black screen or blocking and the like in the use process of the mobile phone are avoided, and the use experience of a user is improved.

Exemplary, as shown in FIG. 15, when the folding screen of the mobile phone is in a folded state, the mobile phoneWhen a video call is performed in response to a user operation, the front-facing camera of the external screen of the mobile phone collects image information of the user and displays the collected image information on the external screen of the mobile phone, see (a) in fig. 15. In the process that the folding screen of the mobile phone is switched from the folding state to the display state, the second screen of the mobile phone displays the image information acquired by the front camera of the external screen, see (b) in fig. 15. The mobile phone triggers the front-mounted camera of the inner screen to collect images, and the images collected by the front-mounted camera of the inner screen are sent and displayed by the inner screen, and the images collected by the front-mounted camera of the inner screen are displayed by a large screen formed by the first screen and the second screen of the mobile phone, see (c) in fig. 15.

Likewise, when the folding screen of the mobile phone is switched from the unfolding state to the folding state, before the folding screen is completely switched from the inner screen to the outer screen, the camera for sending and displaying the image is still the front camera of the inner screen, and the mobile phone can display the image acquired by the front camera of the inner screen on the outer screen. When the mobile phone determines that the screen switching is completed and that the image sent by the front-mounted camera of the external screen is displayed, the mobile phone controls the external screen to display the image acquired by the front-mounted camera of the external screen. Therefore, the mobile phone displays images acquired by the front camera of the inner screen through the outer screen before the screen switching is completed, the situations of black screen or blocking and the like in the use process of the mobile phone are avoided, and the use experience of a user is improved.

In summary, in the embodiment of the present application, the tag setting module marks the image collected by the camera according to whether the camera of the figure is the front camera of the inner screen or the front camera of the outer screen, and the camera service module determines the sent and displayed target image according to the consistency of the camera corresponding to the screen state of the folding screen and the camera corresponding to the marked image. Or the label setting module determines to send and display the image acquired by the camera consistent with the screen of the current display image according to whether the screen of the current display image corresponds to the camera of the picture or not. Therefore, the mobile phone ensures that the outer screen of the folding screen displays the image sent and displayed by the front camera of the outer screen, and the inner screen displays the image sent and displayed by the front camera of the inner screen, so that the problem that the image sent and displayed by the screen is misplaced when the screen state of the folding screen is switched is solved, and the user experience is improved.

As shown in fig. 16, an embodiment of the present application discloses an electronic device, which may be the mobile phone described above. The electronic device may specifically include: a touch screen 1601, the touch screen 1601 including a touch sensor 1606 and a display 1607; the display screen 1607 may include a plurality of display areas; one or more processors 1602; a memory 1603; one or more applications (not shown); and one or more computer programs 1604, the above-described devices can be connected via one or more communication buses 1605. Wherein the one or more computer programs 1604 are stored in the memory 1603 and are configured to be executed by the one or more processors 1602, the one or more computer programs 1604 comprise instructions that can be used to perform the relevant steps in the embodiments described above.

It will be appreciated that the electronic device or the like may include hardware structures and/or software modules that perform the functions described above. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.

The embodiment of the application can divide the functional modules of the electronic device and the like according to the method example, for example, each functional module can be divided corresponding to each function, and two or more functions can be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.

In the case of dividing the respective functional modules with the respective functions, one possible composition diagram of the electronic device involved in the above-described embodiment may include: a display unit, a transmission unit, a processing unit, etc. It should be noted that, all relevant contents of each step related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein.

The embodiment of the application also provides electronic equipment which comprises one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, the one or more memories being configured to store computer program code comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform the related method steps described above to implement the display method of the electronic device with a folding screen in the above embodiments.

Embodiments of the present application also provide a computer-readable storage medium having stored therein computer instructions that, when executed on an electronic device, cause the electronic device to perform the above-described related method steps to implement the display method of the electronic device with a folding screen in the above-described embodiments.

Embodiments of the present application also provide a computer program product comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the above-described related method steps to implement the display method of the electronic device with a folding screen in the above-described embodiments.

In addition, embodiments of the present application also provide an apparatus, which may be embodied as a chip, component or module, which may include a processor and a memory coupled to each other; the memory is configured to store computer-executable instructions, and when the apparatus is running, the processor may execute the computer-executable instructions stored in the memory, so that the apparatus executes the display method of the electronic device with the folding screen, which is executed by the electronic device in the above method embodiments.

The electronic device, the computer readable storage medium, the computer program product or the apparatus provided in this embodiment are configured to execute the corresponding method provided above, and therefore, the advantages achieved by the electronic device, the computer readable storage medium, the computer program product or the apparatus can refer to the advantages in the corresponding method provided above, which are not described herein.

From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above. The specific working processes of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which are not described herein.

The functional units in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: flash memory, removable hard disk, read-only memory, random access memory, magnetic or optical disk, and the like.

The foregoing is merely illustrative of specific embodiments of the present application, and the scope of the present application is not limited thereto, but any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. The display method of the electronic equipment with the folding screen comprises an inner screen and an outer screen, wherein a camera of the electronic equipment comprises a first camera and a second camera, the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen, and the display method is characterized by comprising the following steps:

acquiring a first image acquired by a camera of the electronic equipment;

when the electronic equipment is in a folded state and the first image is an image acquired by the second camera, controlling the external screen to present the first image;

when the first image is acquired by the first camera and the target display screen is the inner screen in the process of switching the electronic equipment from the folding state to the unfolding state, controlling the inner screen to display the first image, wherein the target display screen is a display screen of the current display image of the electronic equipment or a display screen of the current image to be displayed of the electronic equipment;

When the electronic equipment is in an unfolding state and the first image is an image acquired by the first camera, controlling the inner screen to present the first image;

and in the process of switching the electronic equipment from the unfolding state to the folding state, when the first image is the image acquired by the second camera and the target display screen is the outer screen, controlling the outer screen to display the first image.

2. The method according to claim 1, wherein the method further comprises:

when the first image is an image acquired by the first camera and the target display screen is the external screen in the process of switching the electronic equipment from the unfolded state to the folded state, controlling the external screen to present the second image, wherein the second image is an image acquired by a camera which is pre-stored in the electronic equipment and matched with the target display screen;

or in the process of switching the electronic equipment from the unfolding state to the folding state, when the first image is the image acquired by the first camera and the target display screen is the external screen, controlling the external screen not to present the first image.

3. The method according to claim 1, wherein the method further comprises:

when the first image is an image acquired by the second camera and the target display screen is the inner screen in the process of switching the electronic equipment from the folding state to the unfolding state, controlling the inner screen to present the second image, wherein the second image is an image acquired by a camera which is pre-stored in the electronic equipment and is matched with the target display screen;

or in the process of switching the electronic equipment from the folding state to the unfolding state, when the first image is the image acquired by the second camera and the target display screen is the inner screen, controlling the inner screen not to present the first image.

4. A method according to any one of claims 1-3, characterized in that the method further comprises:

when the first image is the image acquired by the first camera and the target display screen is the inner screen, determining an image identifier of the first image as a third identifier, wherein the third identifier is used for indicating the first image to be directly sent and displayed;

controlling the inner screen to present the first image with a third identification.

5. A method according to any one of claims 1-3, characterized in that the method further comprises:

when the first image is the image acquired by the second camera and the target display screen is the external screen, determining an image identifier of the first image as a third identifier, wherein the third identifier is used for indicating the first image to be directly sent and displayed;

controlling the external screen to present the first image with a third identifier.

6. A method according to any one of claims 1-3, characterized in that the method further comprises:

and in the process of switching the electronic equipment from the unfolding state to the folding state, when the first image is the image acquired by the first camera and the target display screen is the outer screen, determining the image identifier of the first image as a fourth identifier, wherein the fourth identifier is used for indicating to discard the first image.

7. A method according to any one of claims 1-3, characterized in that the method further comprises:

8. The method of any of claims 1-3, wherein the internal screen of the electronic device comprises a first screen and a second screen, the method further comprising:

and determining that the electronic equipment is in the process of switching from the folding state to the unfolding state according to the included angle between the first screen and the second screen.

9. The method of any of claims 1-3, wherein the internal screen of the electronic device comprises a first screen and a second screen, the method further comprising:

and determining that the electronic equipment is in the process of switching from the unfolded state to the folded state according to the included angle between the first screen and the second screen.

10. An electronic device, comprising:

the touch screen comprises a touch sensor and a display screen;

one or more processors;

a memory;

wherein the memory has stored therein one or more computer programs, the one or more computer programs comprising instructions, which when executed by the electronic device, cause the electronic device to perform the method of displaying an electronic device with a folding screen as claimed in any of claims 1-9.

11. A computer readable storage medium having instructions stored therein, which when run on an electronic device, cause the electronic device to perform the method of displaying an electronic device with a folding screen according to any of claims 1-9.