CN110570502A - method, apparatus, electronic device and computer-readable storage medium for displaying image frame - Google Patents
method, apparatus, electronic device and computer-readable storage medium for displaying image frame Download PDFInfo
- Publication number
- CN110570502A CN110570502A CN201910719487.1A CN201910719487A CN110570502A CN 110570502 A CN110570502 A CN 110570502A CN 201910719487 A CN201910719487 A CN 201910719487A CN 110570502 A CN110570502 A CN 110570502A
- Authority
- CN
- China
- Prior art keywords
- information
- rendering
- image frame
- displaying
- user input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000009877 rendering Methods 0.000 claims abstract description 225
- 230000000694 effects Effects 0.000 claims description 20
- 238000013519 translation Methods 0.000 claims description 11
- 238000012545 processing Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 230000033001 locomotion Effects 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 238000013473 artificial intelligence Methods 0.000 description 4
- 239000013307 optical fiber Substances 0.000 description 3
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present disclosure discloses a method for displaying image frames, comprising: acquiring content information of an image frame; acquiring rendering mode information of the image frame; transmitting the content information and the rendering mode information; acquiring rendering information of the image frame, wherein the rendering information corresponds to the content information and the rendering mode information; and displaying the image frame according to the rendering information. According to the method, the device, the electronic equipment and the computer readable storage medium for displaying the image frame, the rendering information of the image frame corresponding to the relevant information can be acquired by sending the relevant information of the image frame, and the image frame is displayed according to the acquired rendering information, so that the rendered image frame can be displayed at high efficiency.
Description
Technical Field
The present disclosure relates to the field of information processing, and in particular, to a method and an apparatus for displaying image frames, an electronic device, and a computer-readable storage medium.
Background
With the advancement of computer technology, image-related applications are increasingly enriched, and for example, in video applications and/or gaming applications, various renderings may be performed on image frames to enrich the display content and display effect of the image frames.
In the process of displaying image frames by running a video application and/or a game application through an electronic device, in order to enhance the display effect of the displayed image frames, rendering data of the image frames are often determined through a complex algorithm, which puts a higher requirement on the processing performance of the electronic device, and the existing electronic device and/or rendering technology may not be capable of efficiently processing and displaying the image frames.
Disclosure of Invention
The disclosed embodiments provide a method, an apparatus, an electronic device, and a computer-readable storage medium for displaying an image frame, which can acquire rendering information of the image frame corresponding to related information by sending the related information of the image frame, and then display the image frame according to the acquired rendering information, thereby displaying the rendered image frame with higher efficiency.
In a first aspect, an embodiment of the present disclosure provides a method for displaying an image frame, including: acquiring content information of an image frame; acquiring rendering mode information of the image frame; transmitting the content information and the rendering mode information; acquiring rendering information of the image frame, wherein the rendering information corresponds to the content information and the rendering mode information; and displaying the image frame according to the rendering information.
in a second aspect, an embodiment of the present disclosure provides an apparatus for displaying image frames, including: the acquisition module is used for acquiring content information of the image frame; the obtaining module is further configured to obtain rendering mode information of the image frame; a sending module, configured to send the content information and the rendering mode information; the obtaining module is further configured to obtain rendering information of the image frame, where the rendering information corresponds to the content information and the rendering mode information; and the display module is used for displaying the image frame according to the rendering information.
in a third aspect, an embodiment of the present disclosure provides an electronic device, including: a memory for storing computer readable instructions; and one or more processors coupled with the memory for executing the computer readable instructions, such that the processors when executed implement the method of displaying image frames of any of the preceding first aspects.
In a fourth aspect, the present disclosure provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, which when executed by a computer, cause the computer to perform the method for displaying image frames according to any one of the first aspect.
the present disclosure discloses a method, an apparatus, an electronic device, and a computer-readable storage medium for displaying image frames. The method for displaying the image frame comprises the following steps: acquiring content information of an image frame; acquiring rendering mode information of the image frame; transmitting the content information and the rendering mode information; acquiring rendering information of the image frame, wherein the rendering information corresponds to the content information and the rendering mode information; and displaying the image frame according to the rendering information. According to the method, the device, the electronic equipment and the computer readable storage medium for displaying the image frame, the rendering information of the image frame corresponding to the relevant information can be acquired by sending the relevant information of the image frame, and the image frame is displayed according to the acquired rendering information, so that the rendered image frame can be displayed at high efficiency.
The foregoing is a summary of the present disclosure, and for the purposes of promoting a clear understanding of the technical means of the present disclosure, the present disclosure may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
Drawings
the above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a schematic view of an application scenario of an embodiment of the present disclosure;
FIG. 2 is a flowchart of an embodiment of a method for displaying an image frame according to an embodiment of the disclosure;
Fig. 3 is a flowchart of an alternative implementation of obtaining rendering mode information of an image frame according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an embodiment of an apparatus for displaying an image frame according to an embodiment of the present disclosure;
Fig. 5 is a schematic structural diagram of an electronic device provided according to an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
it should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
the term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
As described in the background of the present disclosure, in order to enhance the display effect of the image frame, the rendering data of the image frame is often determined through a complex algorithm, which puts higher demands on the computing device for determining the rendering data, and further, as a large-screen electronic device, such as a large-sized television, is popularized and popular, the pixels and/or the resolution of the image frame displayed by the electronic device may be higher, and thus, the electronic device may also face a larger amount of computation when determining the rendering data of the electronic device. However, due to factors such as cost, the processing performance of the electronic device used by the user is often limited, and the image frames may not be efficiently rendered during the process of running the video application and/or the game application to display the image frames, thereby reducing the user experience. Accordingly, it is desirable to provide a method, an apparatus, an electronic device and a computer-readable storage medium for displaying images, which can solve the above technical problems and/or needs.
Fig. 1 is a schematic view of an application scenario of the embodiment of the present disclosure. As shown in fig. 1, the apparatus 101 for displaying image frames and the server 102 communicate via a network, wherein the apparatus 101 for displaying image frames and the server 102 comprise any form of computer equipment, and the apparatus 101 for displaying image frames may be a mobile terminal, such as a smart phone, and may also be a desktop or smart tv, for example; the network on which the device 101 for displaying the image frames communicates with the server 102 may be a wireless network, such as a 5G network, or a wired network, such as an optical fiber network.
It should be noted that, as an alternative implementation form, the apparatus 101 for displaying image frames may be implemented as software, as hardware, or as a combination of software and hardware, and as an example, the apparatus 101 for displaying image frames may be a chip, and thus may be disposed in any form of computer device described above.
Fig. 2 is a flowchart of an embodiment of a method for displaying an image frame according to an embodiment of the present disclosure, which may be performed by the apparatus for displaying an image frame according to the embodiment of the present disclosure.
As shown in fig. 2, a method of displaying an image frame according to an embodiment of the present disclosure includes the steps of:
Step S201, content information of an image frame is obtained;
In step S201, the apparatus displaying the image frame acquires content information of the image frame. The image frames may include one image frame and may also include a plurality of image frames, and for the case of a plurality of image frames, each image frame may be numbered in sequence to form a video, and displaying the plurality of image frames according to a certain frame rate may be regarded as playing the video.
As an alternative embodiment, the content information comprises and/or indicates the display content of the image frame. For example, if the content information includes a first image frame in the image frames, the first image frame may be considered to include the display content of the image frame in step S201, and the content depicted by the pixels of the first image frame may also be considered to indicate the display content of the image frame; for another example, the content information includes an identifier corresponding to the display content of the image frame, so that the display content of the image frame is indicated by the identifier. It should be noted that, in the embodiments of the present disclosure, the display content of the image frame is to be understood in a broad sense, for example, including but not limited to a background image, an object image, and/or all pixels of a part or all of the image frames.
As will be appreciated by those skilled in the art, in the embodiments of the present disclosure, image frames may also be referred to as images, each image frame is composed of pixels, and the pixels in the image frame may be characterized by a position parameter and a color parameter, so as to depict the display content of the image frame by the pixels. A typical way is to represent the position parameter and the color parameter of a pixel in an image frame by a quintuple (x, y, r, g, b), wherein the abscissa x and the ordinate y are used as the position parameter of the pixel, and the color components r, g, and b are used as the color parameter of the pixel to describe the value of the pixel in the RGB space, and the color of the pixel can be obtained by superposing r, g, and b. Of course, the position parameter and the color parameter of the pixel of the image may also be represented in other manners, for example, the color of the pixel in the LAB space is represented by (L, a, b), where L represents the brightness, a represents the degree of red and green, and b represents the degree of yellow and blue, and the position parameter of the pixel is also represented by polar coordinates, which is not limited in the embodiment of the present disclosure. It should be noted that, when the position parameter of the pixel is expressed, the coordinate system corresponding to the coordinate of the pixel may adopt an image coordinate system, a camera coordinate system, and a world coordinate system, which is not limited in this embodiment of the disclosure.
Step S202, obtaining rendering mode information of the image frame;
In step S202, the apparatus for displaying an image frame acquires rendering manner information of the image frame. In an optional embodiment, the rendering mode information indicates a rendering mode of the image frame. Wherein the rendering mode may include one or more of the following rendering modes: translation rendering, rotation rendering, special effect rendering and game event rendering.
in implementation, as an example, the rendering manner information of the image frame may include an identifier corresponding to a rendering manner, and the identifier indicates the rendering manner of the image frame. The translation rendering comprises rendering the picture of the image frame into a picture with translation motion; the rotary rendering comprises rendering pictures of the image frames into pictures with rotary motion; the special effect rendering comprises rendering pictures of the image frames into various special effects, such as a light and shadow special effect, a filter special effect, a color change special effect, a deformation special effect and the like; game event rendering includes rendering visuals of the image frames to present game events. It should be noted that, the rendering method according to the embodiment of the present disclosure is not limited, and any existing and future image rendering technology may be applied to the embodiment of the present disclosure.
step S203, sending the content information and the rendering mode information;
In step S203, the apparatus displaying the image frame transmits the content information and the rendering manner information of the image frame acquired in steps S201 and S202, for example, to a server through a network interface via a communication network. As an optional implementation manner, the communication network for transmitting the content information and the rendering manner information may be a 5G network or a wired network, since the method for displaying image frames according to the embodiment of the present disclosure may have a timeliness requirement when displaying image frames, and the content information and the rendering manner information may be quickly transmitted to a server through the 5G network or the wired network to meet the timeliness requirement.
Step S204, obtaining rendering information of the image frame, wherein the rendering information corresponds to the content information and the rendering mode information;
In step S204, the apparatus for displaying an image frame acquires rendering information of the image frame, for example, receives the rendering information of the image frame from the aforementioned server through a communication network via a network interface. As an optional embodiment, the apparatus for displaying an image frame directly acquires the rendering information from the server through a 5G network or a wired network in order to meet the timeliness requirement, for example, the apparatus for displaying an image frame is assigned with a unique MAC address, so that the rendering information can be directly received through a 5G base station based on the MAC address without forwarding the rendering information through other intermediate devices such as a router, which can avoid the rendering information from being encapsulated and decoded according to a transmission protocol of the intermediate devices such as a router, and thus, the speed of acquiring the rendering information can be increased. Wherein the rendering data of the image frame may comprise data for displaying the image frame, for example comprising position parameters and/or color parameters of part or all pixels of part or all of the image frames.
As an optional embodiment, the rendering information corresponds to the content information and the rendering manner information, and includes: the rendering information is determined by applying the rendering mode according to the display content. For example, in step S203, the apparatus for displaying an image frame sends content information and rendering manner information of the image frame to a server, and the server may apply the rendering manner to the display content according to the display content of the image frame indicated by the content information and the rendering manner indicated by the rendering manner information, so as to obtain rendering information of the image frame, and send the rendering information of the image frame to the apparatus for displaying an image, so that the apparatus for displaying an image obtains the rendering information of the image frame in step S204.
As an example, the content information sent by the apparatus for displaying an image in step S203 includes a first image frame in the image frames, and the sent rendering manner information indicates a dissipation special effect, then the rendering information received in step S204 may be obtained by applying the dissipation special effect to an object in the first image frame, for example, a server identifies an object in the first image frame, and then processes the object to be gradually dissipated through an image processing technology, and sends the processed rendering information to the apparatus for displaying an image, which may involve image processing technologies such as foreground identification and triangulation, and the image processing technology involved in the embodiment of the present disclosure is not limited; as yet another example, if the content information sent by the image displaying apparatus in step S203 indicates an identifier of a background image in the image frames, and the sent rendering manner information indicates a game event rendering, the rendering information received in step S204 may be obtained by applying the game event rendering to the background image corresponding to the identifier, for example, the server determines the background image according to the identifier of the background image in the image frames, and renders the game event on the background image according to the game event rendering, for example, the generated rendering information includes a series of image frames, the background images of the series of image frames are all background images determined according to the identifier of the background image, and the foreground images of the series of image frames represent the game event.
And S205, displaying the image frame according to the rendering information.
in step S205, the means for displaying an image frame displays the image frame according to the rendering information of the image frame acquired in step S204. As an example, if the rendering information of the image frame is obtained by applying the rendering of the game event to the background image corresponding to the identifier, the image frame displayed in step S205 will reveal the game event under the background image. It should be noted that, as those skilled in the art can understand, in the process of obtaining the rendering information of the image frame from the server and displaying the image frame, the related streaming and streaming technologies such as encoding and decoding of the rendering information, and the encoding and decoding technologies of the rendering information according to the requirements of the communication protocol when transmitting the rendering information, may adopt existing and future corresponding technologies, and the embodiment of the present disclosure does not limit this.
In the method for displaying image frames provided by the embodiment of the present disclosure, the device for displaying image frames does not determine rendering information of image frames through an image processing technology, but obtains the rendering information by sending related information of the image frames, and displays the image frames according to the obtained rendering information, so that the rendered image frames can be displayed with higher efficiency.
Fig. 3 is a flowchart illustrating an alternative implementation of acquiring rendering mode information of an image frame in step S202 according to an embodiment of the present disclosure.
As shown in fig. 3, in this alternative embodiment, the step S202: acquiring rendering mode information of the image frame, including:
s301, acquiring user input information;
In many application scenarios, how to render and display the image frame may be related to the user' S operation, so in step S301, user input information is obtained in an attempt to render and display the image frame based on the user input information. As an example, the user may input the user input information through an input interface of the apparatus for displaying an image frame, so that the apparatus for displaying an image frame acquires the user input information, for example, the user input information is acquired through physical keys included in the apparatus for displaying an image frame, or the user input information is received from an input device such as a remote controller, a game pad, a smart phone, or the like. Optionally, the user input information includes, but is not limited to, operation information and game event information, as examples of the operation information, for example, a user inputs the operation information through a smart phone to control movement of a viewing angle, or the user selects a preset item through a remote controller, as examples of the game event information, for example, the user triggers a game event through a game pad, and the like.
s302, determining the rendering mode information according to the user input information.
in step S302, the apparatus displaying the image frame will determine the rendering manner information according to the user input information acquired in step S301. Taking the example that the user input information includes operation information, when a user inputs the operation information through a smart phone to control movement of a view angle, the view angle movement may cause a translation or rotation of a picture of an image frame, so that the rendering mode may be determined to include a translation rendering and/or a rotation rendering according to the operation information, and when a game event is triggered by the user through a game pad, the rendering mode may be determined to include a game event rendering according to the operation information. In implementation, for example, a corresponding relationship between user input information and a rendering manner may be stored, and after the user input information is acquired in step S301, rendering manner information corresponding to the user input information is obtained according to the stored corresponding relationship query, which of course may also be implemented in other ways, which is not limited in this disclosure.
In an alternative embodiment, the step S302: determining the rendering mode information according to the user input information, further comprising: determining the rendering mode information of a first part in the image frame according to first user input information; predicting second user input information according to the first user input information; determining the rendering mode information of a second portion in the image frame according to the second user input information. The existing smart device can predict the user input after the input of the user, for example, when the user plays a game through a gamepad, after the input, a system receiving the input can determine or predict the next input of the user through a pre-stored correspondence or an artificial intelligence algorithm according to the input of the user, so that the input of the user can be predicted by means of the correspondence or the artificial intelligence algorithm, and then the rendering mode information can be determined according to the predicted input. As an example, for example, the first user input information includes operation information, when a user inputs operation information through a smartphone to control movement of a view angle, since the view angle movement may cause a translation or rotation of a picture of an image frame, a rendering manner of a first portion of the image frames (for example, the first 60% of all the image frames, or any one or more of the image frames) may be determined according to the first user input information, including a translation rendering and/or a rotation rendering, and then a next input of the user, that is, a movement of a control view angle in which second user input information is still in the same direction is determined through a pre-stored correspondence relationship or an artificial intelligence algorithm, then a second portion of the image frames (for example, the last 40% of all the image frames), or any one or more of the image frames) includes a translation rendering and/or a rotation rendering; as another example, for example, the first user input information includes game event information, when the image frame displaying device receives the game event information, rendering is performed on the game event according to the game event information, which determines rendering manner information of 400 image frames, the game event rendering presents the game event through the 400 image frames, and displays a plurality of options after presenting the game event, where the plurality of options correspond to different special effects, then the image frame displaying device may predict a user's selection of the plurality of options through an artificial intelligence method, for example, based on a maintained user profile or a user preference, and use the predicted selection as the second user input information, and further determine rendering is performed on the 100 image frames according to the second user input information, where the special effect rendering includes rendering the 100 image frames with the special effect selected by the user, in this example, 400 image frames representing a game event and 100 image frames subjected to special effect rendering constitute the first and second portions of the image frames in the embodiment of the present disclosure, respectively. The next input of the user can be predicted according to the actual input of the user in the mode, so that the rendering mode information of the corresponding image frame is determined in advance according to the predicted input of the user, the rendering mode information can be sent to the server in advance so as to obtain the rendering mode information of the corresponding image frame from the server, and the rendered image frame can be displayed at high efficiency.
fig. 4 is a schematic structural diagram illustrating an embodiment of an apparatus 400 for displaying an image frame according to an embodiment of the present disclosure, and as shown in fig. 4, the apparatus 400 for displaying an image frame includes an obtaining module 401, a sending module 402, and a display module 403.
the obtaining module 401 is configured to obtain content information of an image frame; the obtaining module 401 is further configured to obtain rendering mode information of the image frame; the sending module 402 is configured to send the content information and the rendering manner information; the obtaining module 401 is further configured to obtain rendering information of the image frame, where the rendering information corresponds to the content information and the rendering mode information; the display module 403 is configured to display the image frame according to the rendering information.
The obtaining module 401 may further be configured to obtain user input information, and determine the rendering mode information according to the user input information. Optionally, the obtaining module 401 may be further configured to determine the rendering manner information of the first portion in the image frame according to the first user input information; predicting second user input information according to the first user input information; determining the rendering mode information of a second portion in the image frame according to the second user input information.
The apparatus shown in fig. 4 may perform the method of the embodiment shown in fig. 2 and/or fig. 3, and a part not described in detail in this embodiment may refer to the related description of the embodiment shown in fig. 2 and/or fig. 3. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 2 and/or fig. 3, and are not described herein again.
Referring now to FIG. 5, a block diagram of an electronic device 500 suitable for use in implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 5, electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus or a communication line 504. An input/output (I/O) interface 505 is also connected to the bus or communication line 504.
Generally, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 508 including, for example, magnetic tape, hard disk, etc.; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 501.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the method of displaying image frames in the above embodiments.
computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
in the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided a method of displaying an image frame, including: acquiring content information of an image frame; acquiring rendering mode information of the image frame; transmitting the content information and the rendering mode information; acquiring rendering information of the image frame, wherein the rendering information corresponds to the content information and the rendering mode information; and displaying the image frame according to the rendering information.
Further, the content information indicates display content of the image frame.
Further, the rendering information corresponds to the content information and the rendering mode information, and includes: the rendering information is determined by applying the rendering mode according to the display content.
further, the rendering manner information indicates a rendering manner of the image frame, where the rendering manner includes one or more of the following: translation rendering, rotation rendering, special effect rendering and game event rendering.
Further, the acquiring rendering mode information of the image frame includes: acquiring user input information; and determining the rendering mode information according to the user input information.
Further, the determining the rendering mode information according to the user input information includes: determining the rendering mode information of a first part in the image frame according to first user input information; predicting second user input information according to the first user input information; determining the rendering mode information of a second portion in the image frame according to the second user input information.
further, the sending the content information and the rendering mode information includes: sending the content information and the rendering mode information to a server; the acquiring rendering information of the image frame includes: and acquiring the rendering information from the server directly through a 5G network or a wired network.
According to one or more embodiments of the present disclosure, there is provided an apparatus for displaying an image frame, including: the acquisition module is used for acquiring content information of the image frame; the obtaining module is further configured to obtain rendering mode information of the image frame; a sending module, configured to send the content information and the rendering mode information; the obtaining module is further configured to obtain rendering information of the image frame, where the rendering information corresponds to the content information and the rendering mode information; a display module for displaying the image frame according to the rendering information
Further, the content information indicates display content of the image frame.
Further, the rendering information corresponds to the content information and the rendering mode information, and includes: the rendering information is determined by applying the rendering mode according to the display content.
further, the rendering manner information indicates a rendering manner of the image frame, where the rendering manner includes one or more of the following: translation rendering, rotation rendering, special effect rendering and game event rendering.
Further, the obtaining module is further configured to obtain user input information; and determining the rendering mode information according to the user input information.
Further, the obtaining module is further configured to determine the rendering mode information of the first portion in the image frame according to first user input information; predicting second user input information according to the first user input information; determining the rendering mode information of a second portion in the image frame according to the second user input information.
Further, the sending module is further configured to send the content information and the rendering mode information to a server; the obtaining module is further configured to directly obtain the rendering information from the server through a 5G network or a wired network.
According to one or more embodiments of the present disclosure, there is provided an electronic device including: a memory for storing computer readable instructions; and one or more processors coupled with the memory for executing the computer readable instructions, such that the processors when executed implement the method of displaying image frames of any of the preceding first aspects.
According to one or more embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium, characterized in that the non-transitory computer readable storage medium stores computer instructions which, when executed by a computer, cause the computer to perform any of the methods of displaying image frames of the aforementioned first aspect.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (10)
1. A method of displaying image frames, comprising:
Acquiring content information of an image frame;
Acquiring rendering mode information of the image frame;
Transmitting the content information and the rendering mode information;
Acquiring rendering information of the image frame, wherein the rendering information corresponds to the content information and the rendering mode information;
And displaying the image frame according to the rendering information.
2. The method of displaying image frames according to claim 1, wherein the content information indicates display content of the image frames.
3. The method of claim 2, wherein the rendering information corresponding to the content information and the rendering manner information comprises:
the rendering information is determined by applying the rendering mode according to the display content.
4. The method for displaying image frames according to any one of claims 1-3, wherein the rendering manner information indicates a rendering manner of the image frame, the rendering manner including one or more of the following:
Translation rendering, rotation rendering, special effect rendering and game event rendering.
5. The method of claim 1, wherein the obtaining rendering mode information of the image frame comprises:
Acquiring user input information;
And determining the rendering mode information according to the user input information.
6. the method of claim 5, wherein determining the rendering mode information according to the user input information comprises:
Determining the rendering mode information of a first part in the image frame according to first user input information;
Predicting second user input information according to the first user input information;
determining the rendering mode information of a second portion in the image frame according to the second user input information.
7. the method of claim 1, wherein said sending the content information and the rendering mode information comprises: sending the content information and the rendering mode information to a server;
The acquiring rendering information of the image frame includes: and acquiring the rendering information from the server directly through a 5G network or a wired network.
8. An apparatus for displaying image frames, comprising:
The acquisition module is used for acquiring content information of the image frame;
the obtaining module is further configured to obtain rendering mode information of the image frame;
A sending module, configured to send the content information and the rendering mode information;
The obtaining module is further configured to obtain rendering information of the image frame, where the rendering information corresponds to the content information and the rendering mode information;
And the display module is used for displaying the image frame according to the rendering information.
9. An electronic device, comprising:
a memory for storing computer readable instructions; and
a processor for executing the computer readable instructions such that the processor when executing implements the method of displaying image frames according to any of claims 1-7.
10. A non-transitory computer readable storage medium storing computer readable instructions which, when executed by a computer, cause the computer to perform the method of displaying image frames of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910719487.1A CN110570502A (en) | 2019-08-05 | 2019-08-05 | method, apparatus, electronic device and computer-readable storage medium for displaying image frame |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910719487.1A CN110570502A (en) | 2019-08-05 | 2019-08-05 | method, apparatus, electronic device and computer-readable storage medium for displaying image frame |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110570502A true CN110570502A (en) | 2019-12-13 |
Family
ID=68774587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910719487.1A Pending CN110570502A (en) | 2019-08-05 | 2019-08-05 | method, apparatus, electronic device and computer-readable storage medium for displaying image frame |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110570502A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111260540A (en) * | 2020-01-13 | 2020-06-09 | 成都卓影科技股份有限公司 | 2D-3D 2.5D conversion engine under 5G network |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017030380A1 (en) * | 2015-08-20 | 2017-02-23 | Lg Electronics Inc. | Digital device and method of processing data therein |
| CN107622473A (en) * | 2017-09-22 | 2018-01-23 | 广东欧珀移动通信有限公司 | Image rendering method, device, terminal and computer-readable recording medium |
| CN109462776A (en) * | 2018-11-29 | 2019-03-12 | 北京字节跳动网络技术有限公司 | A kind of special video effect adding method, device, terminal device and storage medium |
| CN110058685A (en) * | 2019-03-20 | 2019-07-26 | 北京字节跳动网络技术有限公司 | Display methods, device, electronic equipment and the computer readable storage medium of virtual objects |
| CN110062176A (en) * | 2019-04-12 | 2019-07-26 | 北京字节跳动网络技术有限公司 | Generate method, apparatus, electronic equipment and the computer readable storage medium of video |
-
2019
- 2019-08-05 CN CN201910719487.1A patent/CN110570502A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017030380A1 (en) * | 2015-08-20 | 2017-02-23 | Lg Electronics Inc. | Digital device and method of processing data therein |
| CN107622473A (en) * | 2017-09-22 | 2018-01-23 | 广东欧珀移动通信有限公司 | Image rendering method, device, terminal and computer-readable recording medium |
| CN109462776A (en) * | 2018-11-29 | 2019-03-12 | 北京字节跳动网络技术有限公司 | A kind of special video effect adding method, device, terminal device and storage medium |
| CN110058685A (en) * | 2019-03-20 | 2019-07-26 | 北京字节跳动网络技术有限公司 | Display methods, device, electronic equipment and the computer readable storage medium of virtual objects |
| CN110062176A (en) * | 2019-04-12 | 2019-07-26 | 北京字节跳动网络技术有限公司 | Generate method, apparatus, electronic equipment and the computer readable storage medium of video |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111260540A (en) * | 2020-01-13 | 2020-06-09 | 成都卓影科技股份有限公司 | 2D-3D 2.5D conversion engine under 5G network |
| CN111260540B (en) * | 2020-01-13 | 2023-06-13 | 成都卓影科技股份有限公司 | 2.5D conversion engine of 2D-3D under 5G network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10110936B2 (en) | Web-based live broadcast | |
| CN112019897B (en) | Screen projection method and device, electronic equipment and computer readable medium | |
| WO2021147657A1 (en) | Frame interpolation processing method and related product | |
| JP7359521B2 (en) | Image processing method and device | |
| CN110728622B (en) | Fisheye image processing method, device, electronic equipment and computer readable medium | |
| CN110290398B (en) | Video issuing method and device, storage medium and electronic equipment | |
| CN111899192A (en) | Interaction method, interaction device, electronic equipment and computer-readable storage medium | |
| CN112738541A (en) | Picture display method and device and electronic equipment | |
| CN113989173A (en) | Video fusion method and device, electronic equipment and storage medium | |
| CN113521728A (en) | Cloud application implementation method and device, electronic equipment and storage medium | |
| US11893770B2 (en) | Method for converting a picture into a video, device, and storage medium | |
| CN115278275B (en) | Information display method, apparatus, device, storage medium, and program product | |
| CN115761090A (en) | Special effect rendering method, device, equipment, computer readable storage medium and product | |
| CN114817630A (en) | Card display method, card display device, electronic device, storage medium, and program product | |
| CN112465940B (en) | Image rendering method and device, electronic equipment and storage medium | |
| CN110570502A (en) | method, apparatus, electronic device and computer-readable storage medium for displaying image frame | |
| CN111833459A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN116248889A (en) | Image encoding and decoding method and device and electronic equipment | |
| CN113010300A (en) | Image effect refreshing method and device, electronic equipment and computer readable storage medium | |
| CN114125485B (en) | Image processing method, device, equipment and medium | |
| CN113961280B (en) | View display method and device, electronic equipment and computer readable storage medium | |
| CN114780197A (en) | Split-screen rendering method, device, equipment and storage medium | |
| CN110825480A (en) | Picture display method and device, electronic equipment and computer readable storage medium | |
| GB2600341A (en) | Image special effect processing method and apparatus, electronic device and computer-readable storage medium | |
| CN112312200A (en) | Video cover generation method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191213 |