CN114615431B - Multimedia data processing method, device, terminal and storage medium - Google Patents
Multimedia data processing method, device, terminal and storage medium Download PDFInfo
- Publication number
- CN114615431B CN114615431B CN202210236005.9A CN202210236005A CN114615431B CN 114615431 B CN114615431 B CN 114615431B CN 202210236005 A CN202210236005 A CN 202210236005A CN 114615431 B CN114615431 B CN 114615431B
- Authority
- CN
- China
- Prior art keywords
- multimedia data
- display window
- instruction
- shooting
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title abstract description 24
- 238000000034 method Methods 0.000 claims abstract description 38
- 230000004044 response Effects 0.000 claims description 19
- 230000001360 synchronised effect Effects 0.000 claims description 7
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 13
- 210000003811 finger Anatomy 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 230000037406 food intake Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000036632 reaction speed Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000005059 dormancy Effects 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000003813 thumb Anatomy 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a multimedia data processing method, device, equipment and storage medium, wherein the method comprises the following steps: responding to a shooting instruction, and acquiring shot first multimedia data; acquiring second multimedia data displayed by an object in the first multimedia data; and displaying a second display window in the range of the first display window, wherein the first display window is used for displaying the first multimedia data, and the second display window is used for displaying the second multimedia data. The method of the embodiment of the disclosure can display the second multimedia data displayed by the shot object and the shot first multimedia data simultaneously to obtain a multimedia picture combining the second multimedia data and the shot first multimedia data.
Description
Technical Field
The present disclosure relates to the field of multimedia, and in particular, to a method, an apparatus, a device, and a storage medium for processing multimedia data.
Background
When capturing video, a subject to be captured includes an electronic device, and it is sometimes necessary to simultaneously display contents displayed on the captured electronic device.
It is generally required to record photographed multimedia and multimedia displayed on a photographed object on a photographing apparatus and the photographed object, respectively, and then combine the two multimedia at a later stage. The method needs to be processed by professional technicians, has high difficulty for common users and has poor user experience.
Disclosure of Invention
The present disclosure provides a method, an apparatus, a device, and a storage medium for processing multimedia data, so as to at least solve the above technical problems in the prior art.
According to a first aspect of the present disclosure, there is provided a multimedia data processing method, the method comprising:
responding to a shooting instruction, and acquiring shot first multimedia data;
acquiring second multimedia data displayed by an object in the first multimedia data;
and displaying a second display window in the range of the first display window, wherein the first display window is used for displaying the first multimedia data, and the second display window is used for displaying the second multimedia data.
In an embodiment, acquiring second multimedia data displayed by an object in the first multimedia data includes:
transmitting a data request for requesting the second multimedia data from the object;
and receiving the second multimedia data.
In an embodiment, before the second multimedia data is acquired, the method further comprises:
confirming a connection state with the object;
and sending a wireless connection instruction based on the fact that the wireless connection instruction is not connected with the object, wherein the wireless connection instruction is used for requesting to establish wireless connection with the object.
In an embodiment, after displaying the second display window within the first display window, the method further comprises:
receiving a position adjustment instruction;
and responding to the position adjustment instruction, and moving the second display window to a designated position.
In an embodiment, the method further comprises:
recording information displayed by the first display window and the second display window, or synthesizing the second multimedia data and the first multimedia data to obtain combined multimedia data; storing the combined multimedia data.
In an embodiment, the method further comprises:
and responding to a shooting setting instruction, and carrying out shooting adjustment on the first multimedia data and/or the second multimedia data.
In an embodiment, the photographing includes a first photographing mode and a second photographing mode, the photographing instruction is a photographing instruction of the first photographing mode, and the first photographing mode and the second photographing mode are switched to each other in response to a mode switching instruction.
In an embodiment, the second multimedia data is screen capturing data.
In one embodiment, the second display window is located above the first display window.
According to a second aspect of the present disclosure, there is provided a multimedia data processing apparatus, the apparatus comprising:
the shooting module is used for responding to the selection instruction and acquiring shot first multimedia data;
an acquisition module for acquiring second multimedia data displayed by an object in the first multimedia data;
the window control module is used for displaying a second display window in the range of a first display window, the first display window is used for displaying first multimedia data, and the second display window is used for displaying second multimedia data.
According to a third aspect of the present disclosure, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described in the present disclosure.
According to a fourth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of the present disclosure.
The multimedia data processing method, the device, the equipment and the storage medium respond to shooting instructions to obtain shot first multimedia data and can obtain second multimedia data displayed by an object in the first multimedia data; and displaying a second display window in the range of the first display window, displaying the first multimedia data on the first display window, displaying the second multimedia data on the second display window, and when shooting, the shot first multimedia data and the second multimedia data displayed on the shooting object do not need post secondary synthesis, so that the user experience is improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which:
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Fig. 1 is a schematic diagram illustrating an implementation flow of a multimedia data processing method according to an embodiment of the disclosure;
fig. 2 is a schematic diagram of an interface display of a specific application of a multimedia data processing method according to an embodiment of the disclosure;
fig. 3 shows a second schematic interface display diagram of a specific application of the multimedia data processing method according to an embodiment of the disclosure;
fig. 4 illustrates an interface display schematic diagram III of a specific application of the multimedia data processing method according to the embodiment of the present disclosure;
fig. 5 is a schematic diagram showing the composition structure of a multimedia data processing apparatus according to an embodiment of the present disclosure;
fig. 6 shows a schematic diagram of a composition structure of an electronic device according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, features and advantages of the present disclosure more comprehensible, the technical solutions in the embodiments of the present disclosure will be clearly described in conjunction with the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. Based on the embodiments in this disclosure, all other embodiments that a person skilled in the art would obtain without making any inventive effort are within the scope of protection of this disclosure.
Fig. 1 shows a schematic implementation flow diagram of a multimedia data processing method according to an embodiment of the disclosure. Fig. 2 shows a schematic diagram of an interface display of a mobile phone to which the multimedia data processing method according to the embodiment of the present disclosure is specifically applied. Fig. 3 shows a second schematic interface display diagram of the multimedia data processing method according to the embodiment of the present disclosure, which is specifically applied to a mobile phone. Fig. 4 illustrates an interface display schematic diagram of the multimedia data processing method according to the embodiment of the present disclosure, which is specifically applied to a mobile phone. Referring to fig. 1 to 4, a multimedia data processing method of an embodiment of the present disclosure includes: responding to a shooting instruction, and acquiring shot first multimedia data; acquiring second multimedia data displayed by an object 300 in the first multimedia data; referring to fig. 2, a second display window 200 is displayed within the first display window 100, and referring to fig. 3 and 4, the first display window 100 is used to display first multimedia data and the second display window 200 is used to display second multimedia data.
In the multimedia data processing method disclosed by the disclosure, shooting instructions are responded to, shot first multimedia data is obtained, and meanwhile, second multimedia data displayed by an object 300 in the first multimedia data can be obtained; the second display window 200 is displayed within the range of the first display window 100, the first multimedia data is displayed in the first display window 100, the second multimedia data is displayed in the second display window 200, and when shooting, the shot first multimedia data and the second multimedia data displayed on the shooting object 300 can be displayed on the same screen, so that post secondary synthesis is not needed, and the user experience is improved.
When a user shoots, shooting operation on the shooting device can generate shooting instructions, and the shooting instructions can be generated based on clicking of a shooting application by the user or based on operation of a shortcut key. In an exemplary embodiment, the shortcut key for generating the photographing instruction may be an on-key + volume key, or a double-click volume key, etc. The volume key may be a volume + key or a volume-key. For example, a photographing instruction may be generated by simultaneously operating the on-off key and the volume key+key, and photographing may be performed in the photographing mode of the present disclosure.
In the embodiment of the disclosure, shooting may include only one shooting mode, or may include two or more shooting modes. In an exemplary embodiment, the photographing includes a first photographing mode and a second photographing mode, and the photographing instruction is a photographing instruction of the first photographing mode. And switching the first shooting mode and the second shooting mode to each other in response to the mode switching instruction. For example, in response to a photographing instruction, the first photographing mode is entered, and when a mode switching instruction is received, the first photographing mode may be switched to the second photographing mode in response to the mode switching instruction. Also, in the second photographing mode, the second photographing mode may be switched to the first photographing mode in response to the mode switching instruction, for example, the second multimedia data may be displayed in the first display window in response to the first photographing mode, and the second photographing mode may be the normal photographing mode, and the first display window may be displayed. The mode switching instruction may be generated based on a user operation, or may be generated so as to satisfy a specific condition during shooting. For example, when the user needs to switch from the current photographing mode to another photographing mode, a mode switching operation is performed, thereby generating a mode switching instruction. Or, when the object 300 in the first multimedia data does not display the multimedia data any more due to shutdown, dormancy, etc., a mode switching instruction is generated to switch to another shooting mode for shooting.
In an embodiment, acquiring the second multimedia data displayed by the object 300 in the first multimedia data includes: transmitting a data request for requesting second multimedia data from the object 300; second multimedia data is received. In this embodiment of the disclosure, the second multimedia data may be displayed on the second display window 200 by actively sending a data request to the object 300 to request the second multimedia data from the object 300, and in response to the data request, the object 300 synchronously shares the second multimedia data displayed by the object, and receiving the second multimedia data.
In other embodiments, the shooting instruction can trigger the object 300 synchronously, so that the object 300 sends the second multimedia data, receives the second multimedia data, and can display the second multimedia data on the second display window 200. The manner in which the photographing instruction synchronously triggers the object 300 is not limited. The manner of the synchronization trigger may be without the consent of the object 300, for example, may be based on receiving a shooting instruction, and sending a synchronization trigger instruction, where the synchronization trigger instruction is used to instruct the object 300 to send the second multimedia data. The object 300, upon receiving the synchronization trigger instruction, transmits the second multimedia data.
In an embodiment, before the second multimedia data is acquired, the multimedia data processing method further includes: confirm the connection state with the object 300; based on the lack of connection with the object 300, a wireless connection instruction is sent for requesting establishment of a wireless connection with the object 300. When the photographing instruction is received, a connection may be established with the subject 300 or a connection may not be established. In the embodiment of the disclosure, the connection state with the object 300 is first confirmed, and if no connection is established with the object 300, a wireless connection instruction is sent to establish a wireless connection with the object 300. If a connection has been established with the object 300, a data request or a synchronization trigger instruction may be sent to the object 300.
In an embodiment, when sending the wireless connection instruction, the data request or the synchronization triggering instruction may be sent at the same time, and the wireless connection instruction and the data request/synchronization triggering instruction are integrated into one data packet to be sent, and the object 300 receives the data packet to parse, and agrees to send the second multimedia data while agreeing to establish the connection. Can save resources and improve the reaction speed.
In the embodiment of the present disclosure, the wireless connection manner with the object 300 may be a bluetooth mode, or may be a wireless connection established based on a local area network, and the specific wireless connection manner is not limited.
In the embodiment of the disclosure, the sending of the wireless connection instruction may be implemented by any direct or indirect communication method. For example, the wireless connection instruction may be sent through a router, or sent through an instant messaging application, or sent through a short message.
In the embodiment of the present disclosure, referring to fig. 2 to 4, when the second display window 200 is displayed within the first display window 100, the second display window 200 may be displayed at a set position. The set position is a default position, and is displayed at the default position when the second display window 200 is displayed for the first time every shooting. Such as the lower left corner shown in fig. 2. The setting position may or may not be modifiable. For example, it may be freely set by the user, after each setting, to a default position, until reset. Of course, the default position is only the position at which each shot is first displayed. After display, the position or other parameters of the second display window 200 may be adjustable.
In an embodiment, after displaying the second display window 200 within the first display window 100, the multimedia data processing method further includes: receiving a window adjustment instruction; in response to the window adjustment instruction, the second display window 200 is adjusted. The size, position, shape, etc. of the second display window 200 may be adjusted according to circumstances. The user may adjust the second display window 200 in response to the operation. Window adjustment instructions include, but are not limited to, position adjustment instructions, size adjustment instructions, and shape adjustment instructions. The shape of the second display window 200 may be adapted to the shape of the object 300. For example, when the object 300 is a mobile phone, the shape of the second display window 200 may be the external shape of the mobile phone.
In an exemplary embodiment, referring to fig. 3 and 4, a position adjustment instruction is received; in response to the position adjustment instruction, the second display window 200 is moved to the specified position. The position of the second display window 200 is adjusted for reasons of screen layout, screen occlusion, etc. The position adjustment instruction may be generated based on the user operation. The user operation may be dragging, fig. 3 is a schematic diagram of the interface display before adjustment, and the second display window 200 is located at the lower left corner of the first display window 100, for example, the user presses the second display window 200, moves on the screen, and drags the second display window 200 to the target position with reference to the arrow in fig. 3. Referring to fig. 4, the second display window 200 moves to the upper right corner of the first display window 100 indicated by an arrow in fig. 3. Or generates a position adjustment instruction by double-clicking or the like, determines a destination position by clicking the screen, and moves the second display window 200 to the target position. Or may also generate position adjustment instructions or other types of adjustment instructions by calling up a menu.
In an exemplary embodiment, the resizing instruction may be a user pressing two points on the second display window 200 with a finger, and the resizing of the second display window 200 is achieved by the finger moving away from or closer to. Specifically, the operation may be a one-hand operation or a two-hand operation, for example, the thumb and the index finger of one hand are simultaneously touched and pressed on the second display window 200, or the index fingers of both hands are simultaneously touched and pressed on the second display window 200. The length and width of the second display window 200 may be adjusted in equal proportion, and at this time, whether the direction in which the two fingers move relatively is the length direction, the width direction, or the diagonal direction of the second display window 200, the length and width of the second display window 200 is reduced or enlarged in equal proportion according to a reduction instruction (two fingers are close) or an expansion instruction (two fingers are far). The length and width of the second display window 200 may be adjusted independently or in equal proportion according to a specific gesture, for example, when the direction of the relative movement of two fingers is the length direction, only the length is adjusted. When the direction in which the two fingers move relative to each other is the width direction, only the width is adjusted. When the direction of the relative movement of the two fingers is the diagonal direction, the length and width equal proportion is reduced or enlarged.
In an embodiment, the multimedia data processing method further includes storing information displayed within the first display window 100. In an exemplary embodiment, the information displayed in the first display window 100 and the second display window 200 may be recorded, so as to obtain combined multimedia data, and the combined multimedia data may be stored, so that the content displayed on the screen of the photographing apparatus may be synchronously stored. By synchronously recording the information displayed on the first display window 100 and the second display window 200, the information displayed on the photographing apparatus can be perfectly copied and saved. The specific manner of recording the screen of the photographing apparatus is not limited.
In other exemplary embodiments, the second multimedia data and the first multimedia data may be synthesized to obtain the combined multimedia data; the combined multimedia data is stored. In the embodiment of the disclosure, the first multimedia data obtained by shooting is obtained by converting an optical signal into an electrical signal and adjusting the electrical signal to a standard signal, and the second multimedia data is an object 300 received from the first multimedia data. And synthesizing the second multimedia data and the first multimedia data into combined multimedia data, wherein one path of the combined multimedia data can be sent to a screen for display, and the other path of the combined multimedia data can be stored and stored in a storage unit. When the combined multimedia data is played, a picture displayed at the time of shooting can be reproduced.
In an embodiment, the multimedia data processing method further includes: and responding to the shooting setting instruction, and carrying out shooting adjustment on the first multimedia data and/or the second multimedia data. In the embodiment of the disclosure, one or both of the first multimedia data and the second multimedia data may be subjected to shooting adjustment according to the shooting setting instruction. The shooting adjustment instructions may include, but are not limited to, shooting background settings, picture frame settings, and special effects settings. For example, the shooting setting instruction is a special effect instruction for sprinkling, and the special effect instruction for sprinkling may be performed only in the first multimedia data display range, may be performed only in the second multimedia data display range of the second display window 200, or may be performed on both the first multimedia data and the second multimedia data.
In one embodiment, the second multimedia data is screen capture data. In the embodiment of the disclosure, the object 300 in the first multimedia data continuously performs screen capturing, and sends the screen capturing data while the capturing device receives the screen capturing data and matches the screen capturing data with the second display window 200 to display the screen capturing data in the second display window 200. When the speed of screen capturing is faster than 60 frames per second, it is displayed on the second display window 200, which is substantially the same in visual effect as it is displayed on the object 300.
In other exemplary embodiments, the object 300 may transmit the second multimedia data by means of address push. And receiving the pushed multimedia address, and synchronously displaying the second multimedia data of the multimedia address. The method is suitable for multimedia data such as video, audio and the like.
In an embodiment, the multimedia data processing method further includes: receiving a second data operation instruction; and in response to the second data manipulation instruction, controlling the second multimedia data displayed on the second display window 200, and transmitting a synchronization manipulation instruction for instructing the object 300 to synchronously execute the second data manipulation instruction. The embodiment of the disclosure can control the second multimedia data displayed on the second display window 200, and simultaneously send a synchronization operation instruction to the object 300, and synchronize the second data operation instruction to the object 300, so that the object 300 performs the same operation. For example, when the second multimedia data is audio data or video data, the second data manipulation instruction may be pause, fast forward, double speed, etc., and the object 300 performs the same pause operation when the second multimedia data displayed on the second display window 200 is paused. Or the second data operation instruction is a screen snapshot instruction, and the second display window 200 is snapped in response to the screen snapshot instruction, so as to obtain a picture of the display content of the second display window 200. The object 300 also executes a screen snap instruction according to the pass operation instruction.
In one embodiment, the second display window 200 is positioned over the first display window 100. The second display window 200 is displayed on the first display window 100, so that the second display window 200 can be completely displayed, shielding is avoided, the second display window 200 floats on the first display window 100, the first multimedia data and the second multimedia data are conveniently displayed, and the second display window 200 is flexibly adjusted.
The method of the embodiment of the disclosure can be applied to various devices with shooting functions, such as mobile phones, tablet computers or special shooting devices. The first display window 100 may be an entire display screen occupying a device with a photographing function.
Referring to fig. 2 to 5, the present disclosure further provides a multimedia data processing apparatus, where the apparatus includes an ingest module, an acquisition module, and a window control module, where the ingest module is configured to respond to a selection instruction to acquire first multimedia data that is photographed; the acquisition module is used for acquiring second multimedia data displayed by the object 300 in the first multimedia data; the window control module is used for displaying a second display window 200 within the range of the first display window 100, the first display window 100 is used for displaying the first multimedia data, and the second display window 200 is used for displaying the second multimedia data.
In the multimedia data processing device disclosed by the disclosure, an ingestion module responds to a shooting instruction to acquire first multimedia data to be shot, and meanwhile, an acquisition module can acquire second multimedia data displayed by an object 300 in the first multimedia data; the window control module displays the second display window 200 within the range of the first display window 100, displays the first multimedia data on the first display window 100, and displays the second multimedia data on the second display window 200. During shooting, the shot first multimedia data and the second multimedia data displayed on the shooting object 300 can be displayed on the same screen, post secondary synthesis is not needed, and user experience is improved.
The ingestion module may include: a lens for acquiring an optical signal; a photoelectric conversion circuit for converting an optical signal into an electrical signal; and the signal processing circuit is used for processing the electric signals to obtain standard signals. The standard signal may be displayed on a screen and stored to memory.
In the embodiment of the disclosure, shooting may include only one shooting mode, or may include two or more shooting modes. In an exemplary embodiment, the photographing includes a first photographing mode and a second photographing mode, and the photographing instruction is a photographing instruction of the first photographing mode. The present disclosure also provides a multimedia data processing apparatus further comprising a mode switching module configured to switch the first photographing mode and the second photographing mode to each other in response to a mode switching instruction.
In an embodiment, the obtaining module obtains the second multimedia data displayed by the object 300 in the first multimedia data, specifically includes: transmitting a data request for requesting second multimedia data from the object 300; second multimedia data is received.
In other embodiments, the shooting instruction can trigger the object 300 synchronously, so that the object 300 sends the second multimedia data, receives the second multimedia data, and can display the second multimedia data on the second display window 200. The manner in which the photographing instruction synchronously triggers the object 300 is not limited. The manner of synchronous triggering may not need to be agreed by the object 300, for example, may be based on receiving a shooting instruction, and the acquisition module sends a synchronous triggering instruction, where the synchronous triggering instruction is used to instruct the object 300 to send the second multimedia data. The object 300, upon receiving the synchronization trigger instruction, transmits the second multimedia data.
In an embodiment, the multimedia data processing apparatus further includes a connection module, and the connection module confirms a connection state with the object 300 before the acquisition module acquires the second multimedia data; based on the lack of connection with the object 300, the connection module sends a wireless connection instruction for requesting establishment of a wireless connection with the object 300. When the photographing instruction is received, a connection may be established with the subject 300 or a connection may not be established. In the embodiment of the disclosure, the connection state with the object 300 is first confirmed, and if no connection is established with the object 300, a wireless connection instruction is sent to establish a wireless connection with the object 300. If a connection has been established with the object 300, a data request or a synchronization trigger instruction may be sent to the object 300.
In an embodiment, when the connection module sends the wireless connection instruction, the connection module may send the data request or the synchronization triggering instruction at the same time, and the connection module sets the wireless connection instruction and the data request/synchronization triggering instruction into a data packet to be sent, and the object 300 receives the data packet to parse, and agrees to send the second multimedia data while agreeing to establish the connection. Can save resources and improve the reaction speed.
In the embodiment of the disclosure, the connection module may be a bluetooth module or a wireless connection module based on a local area network.
In the embodiment of the disclosure, the connection module may send the wireless connection instruction through any direct or indirect communication manner. For example, the wireless connection instruction may be sent through a router, or sent through an instant messaging application, or sent through a short message.
In the embodiment of the present disclosure, when the window control module displays the second display window 200 within the range of the first display window 100, the second display window 200 may be displayed at a set position. The set position is a default position, and is displayed at the default position when the second display window 200 is displayed for the first time every shooting. The setting position may or may not be modifiable. For example, the user may freely set the window control module, and after each setting, the window control module is a default position until resetting. Of course, the default position is only the position at which each shot is first displayed. After display, the position or other parameters of the second display window 200 may be adjustable.
In an embodiment, the window control module is further configured to adjust the second display window 200 in response to a window adjustment instruction. After receiving the window adjustment instruction, the window control module responds to correspondingly adjust the second display window 200 according to the specific content of the adjustment instruction. For example, the size, position, shape, etc. of the second display window 200 may be adjusted according to circumstances. The user may adjust the second display window 200 in response to the operation. Window adjustment instructions include, but are not limited to, position adjustment instructions, size adjustment instructions, and shape adjustment instructions. The shape of the second display window 200 may be adapted to the shape of the object 300. For example, when the object 300 is a mobile phone, the shape of the second display window 200 may be the external shape of the mobile phone.
In an exemplary embodiment, a window control module receives a position adjustment instruction; in response to the position adjustment instruction, the second display window 200 is moved to the specified position.
In an embodiment, the multimedia data processing apparatus further includes a storage module, where the storage module is configured to store information displayed within the first display window 100.
In other exemplary embodiments, the storage module synthesizes the second multimedia data with the first multimedia data to obtain the combined multimedia data, and then stores the combined multimedia data.
In an embodiment, the multimedia data processing apparatus further includes a setting module, where the setting module is configured to perform shooting adjustment on the first multimedia data and/or the second multimedia data in response to a shooting setting instruction.
In an embodiment, the multimedia data processing apparatus further includes a data operation module, where the data operation module is configured to respond to the second data operation instruction, control the second multimedia data displayed on the second display window 200, and send a synchronization operation instruction, where the synchronization operation instruction is configured to instruct the object 300 to synchronously execute the second data operation instruction. The data operation module receives the second data operation instruction, and responds to synchronously control the shooting device and the object 300.
In one embodiment, the window control module generates a second display window, and displays the second display window 200 over the first display window 100.
The multimedia data processing apparatus according to the embodiments of the present disclosure can implement the method of the above embodiments, and the description of the embodiments of the multimedia data processing apparatus is similar to the description of the embodiments of the foregoing method, and has similar beneficial effects as the embodiments of the foregoing method, so that a detailed description is omitted. For technical details that have not been disclosed yet in the description of the embodiments of the multimedia data processing apparatus of the present disclosure, please refer to the description of the foregoing method embodiments of the present disclosure for economy of description, and therefore, no further description is given.
According to embodiments of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.
Fig. 6 illustrates a schematic block diagram of an example electronic device 600 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 may also be stored. The computing unit 601, ROM 602, and RAM 603 are connected to each other by a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Various components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, mouse, etc.; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 performs the respective methods and processes described above, such as a multimedia data processing method. For example, in some embodiments, the multimedia data processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When a computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the multimedia data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the multimedia data processing method by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
The foregoing is merely specific embodiments of the disclosure, but the protection scope of the disclosure is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the disclosure, and it is intended to cover the scope of the disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (9)
1. A method of multimedia data processing, the method comprising:
responding to a shooting instruction, and acquiring shot first multimedia data;
acquiring second multimedia data displayed by an object in the first multimedia data;
displaying a second display window in the range of the first display window, wherein the first display window is used for displaying first multimedia data, and the second display window is used for displaying second multimedia data;
responding to an operation instruction, controlling the second multimedia data displayed by the second display window, and sending a synchronous operation instruction, wherein the synchronous operation instruction is used for indicating the object to synchronously execute the operation instruction;
the shooting comprises a first shooting mode and a second shooting mode, the shooting instruction is a shooting instruction of the first shooting mode, the first shooting mode and the second shooting mode are mutually switched in response to a mode switching instruction, and the second shooting mode displays the first display window.
2. The method of claim 1, wherein obtaining the second multimedia data displayed by the object in the first multimedia data comprises:
transmitting a data request for requesting the second multimedia data from the object;
and receiving the second multimedia data.
3. The method of claim 1, wherein prior to acquiring the second multimedia data, the method further comprises:
confirming a connection state with the object;
and sending a wireless connection instruction based on the fact that the wireless connection instruction is not connected with the object, wherein the wireless connection instruction is used for requesting to establish wireless connection with the object.
4. The method of claim 1, wherein after displaying the second display window within the first display window, the method further comprises:
receiving a position adjustment instruction;
and responding to the position adjustment instruction, and moving the second display window to a designated position.
5. The method according to claim 1, wherein the method further comprises:
recording information displayed by the first display window and the second display window, or
Synthesizing the second multimedia data and the first multimedia data to obtain combined multimedia data; storing the combined multimedia data.
6. The method of claim 1, wherein the second display window is positioned over the first display window.
7. A multimedia data processing apparatus, the apparatus comprising:
the shooting module is used for responding to the shooting instruction and acquiring shot first multimedia data;
an acquisition module for acquiring second multimedia data displayed by an object in the first multimedia data;
the window control module is used for displaying a second display window in the range of a first display window, the first display window is used for displaying first multimedia data, and the second display window is used for displaying second multimedia data;
the data operation module is used for responding to an operation instruction, controlling the second multimedia data displayed by the second display window and sending a synchronous operation instruction, wherein the synchronous operation instruction is used for indicating the object to synchronously execute the operation instruction;
the shooting comprises a first shooting mode and a second shooting mode, the shooting instruction is a shooting instruction of the first shooting mode, the first shooting mode and the second shooting mode are mutually switched in response to a mode switching instruction, and the second shooting mode displays the first display window.
8. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.
9. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210236005.9A CN114615431B (en) | 2022-03-11 | 2022-03-11 | Multimedia data processing method, device, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210236005.9A CN114615431B (en) | 2022-03-11 | 2022-03-11 | Multimedia data processing method, device, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114615431A CN114615431A (en) | 2022-06-10 |
| CN114615431B true CN114615431B (en) | 2023-09-19 |
Family
ID=81862865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210236005.9A Active CN114615431B (en) | 2022-03-11 | 2022-03-11 | Multimedia data processing method, device, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114615431B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN109683714A (en) * | 2018-12-28 | 2019-04-26 | 北京小米移动软件有限公司 | Multimedia resource management method, apparatus and storage medium |
| CN110933306A (en) * | 2019-11-29 | 2020-03-27 | 维沃移动通信有限公司 | Method for sharing shooting parameters and electronic equipment |
| CN111033444A (en) * | 2017-05-10 | 2020-04-17 | 优玛尼股份有限公司 | Wearable multimedia device and cloud computing platform with application ecosystem |
| CN111880865A (en) * | 2020-07-30 | 2020-11-03 | 广州华多网络科技有限公司 | Multimedia data pushing method and device, electronic equipment and storage medium |
| CN112337100A (en) * | 2020-11-05 | 2021-02-09 | 北京字节跳动网络技术有限公司 | Live broadcast-based data processing method and device, electronic equipment and readable medium |
| WO2021218379A1 (en) * | 2020-04-28 | 2021-11-04 | 上海商汤临港智能科技有限公司 | Multimedia interaction method, apparatus and device, and storage medium |
| CN113794917A (en) * | 2021-09-15 | 2021-12-14 | 海信视像科技股份有限公司 | Display device and display control method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20210046241A (en) * | 2019-10-18 | 2021-04-28 | 엘지전자 주식회사 | Xr device and method for controlling the same |
-
2022
- 2022-03-11 CN CN202210236005.9A patent/CN114615431B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN111033444A (en) * | 2017-05-10 | 2020-04-17 | 优玛尼股份有限公司 | Wearable multimedia device and cloud computing platform with application ecosystem |
| CN109683714A (en) * | 2018-12-28 | 2019-04-26 | 北京小米移动软件有限公司 | Multimedia resource management method, apparatus and storage medium |
| CN110933306A (en) * | 2019-11-29 | 2020-03-27 | 维沃移动通信有限公司 | Method for sharing shooting parameters and electronic equipment |
| WO2021218379A1 (en) * | 2020-04-28 | 2021-11-04 | 上海商汤临港智能科技有限公司 | Multimedia interaction method, apparatus and device, and storage medium |
| CN111880865A (en) * | 2020-07-30 | 2020-11-03 | 广州华多网络科技有限公司 | Multimedia data pushing method and device, electronic equipment and storage medium |
| CN112337100A (en) * | 2020-11-05 | 2021-02-09 | 北京字节跳动网络技术有限公司 | Live broadcast-based data processing method and device, electronic equipment and readable medium |
| CN113794917A (en) * | 2021-09-15 | 2021-12-14 | 海信视像科技股份有限公司 | Display device and display control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114615431A (en) | 2022-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111913628B (en) | Sharing method and device and electronic equipment | |
| EP3182716A1 (en) | Method and device for video display | |
| EP3107086A1 (en) | Method and device for playing a multimedia file | |
| US11054987B1 (en) | Sidebar interaction method, device, and computer-readable storage medium | |
| CN112099707A (en) | Display method and device and electronic equipment | |
| US20190051147A1 (en) | Remote control method, apparatus, terminal device, and computer readable storage medium | |
| EP3525446A1 (en) | Photographing method and terminal | |
| CN108965611B (en) | Shooting interface switching method, device, equipment and storage medium | |
| US11956531B2 (en) | Video sharing method and apparatus, electronic device, and storage medium | |
| EP4207783A1 (en) | Video processing method and apparatus, device, storage medium, and computer program product | |
| CN113076048A (en) | Video display method and device, electronic equipment and storage medium | |
| CN113660504B (en) | Message display method, device, electronic equipment and storage medium | |
| CN112954193A (en) | Shooting method, shooting device, electronic equipment and medium | |
| CN114205524B (en) | Display control method and terminal | |
| CN114615431B (en) | Multimedia data processing method, device, terminal and storage medium | |
| CN114816692A (en) | Screen projection display method and device, mobile terminal and storage medium | |
| WO2023246296A1 (en) | Automatic zooming method and apparatus, and self-timer and storage medium | |
| WO2023217081A1 (en) | Element control method and apparatus for information input page, device, and medium | |
| CN115469816B (en) | Method, device, equipment and storage medium for switching reading and writing of memory | |
| CN114245017A (en) | Shooting method and device and electronic equipment | |
| CN109981729B (en) | File processing method and device, electronic equipment and computer readable storage medium | |
| CN112181344A (en) | Device calling method, device calling apparatus, interaction system, electronic device, and storage medium | |
| CN108989661B (en) | Camera equipment control method, device and system | |
| CN114860358B (en) | Object processing method and device, electronic equipment and storage medium | |
| CN115396316B (en) | Service processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |