CN116939228A - Distributed processing method, device and equipment for remote sensing image and storage medium - Google Patents
Distributed processing method, device and equipment for remote sensing image and storage medium Download PDFInfo
- Publication number
- CN116939228A CN116939228A CN202310933076.9A CN202310933076A CN116939228A CN 116939228 A CN116939228 A CN 116939228A CN 202310933076 A CN202310933076 A CN 202310933076A CN 116939228 A CN116939228 A CN 116939228A
- Authority
- CN
- China
- Prior art keywords
- remote sensing
- sensing image
- service
- image service
- polled
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000013507 mapping Methods 0.000 claims abstract description 38
- 238000004891 communication Methods 0.000 claims description 29
- 238000000034 method Methods 0.000 claims description 29
- 238000004590 computer program Methods 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 17
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2181—Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6143—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a satellite
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Astronomy & Astrophysics (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a distributed processing method, a device, equipment and a storage medium for remote sensing images. Comprising the following steps: acquiring a remote sensing image distribution request; acquiring a remote sensing image service list according to a remote sensing image distribution request; polling the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service; distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity, and storing a mapping relation between the remote sensing image and the remote sensing image service; and routing the remote sensing image request sent by the front end to a corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends the remote sensing image data to the front end. According to the embodiment of the invention, the remote sensing images are distributed to the remote sensing image services with the quantity not reaching the set threshold value for storage, so that the stability of the remote sensing image services can be ensured, and meanwhile, the distributed stored remote sensing image data can be routed to the correct remote sensing image services when requested by the front end.
Description
Technical Field
The embodiment of the invention relates to the technical field of computer information processing, in particular to a partial distribution type processing method, device and equipment for remote sensing images and a storage medium.
Background
The remote sensing image service is a component of a remote sensing data service platform. As the system operates, remote sensing image data continues to grow, a single remote sensing image service deployed on a single server node has not been able to support huge image data. Therefore, the distributed deployment of the remote sensing image service is particularly important.
Disclosure of Invention
The embodiment of the invention provides a distributed processing method, a device, equipment and a storage medium for remote sensing images, which are used for expanding the remote sensing images into a plurality of remote sensing image services for storage and are beneficial to the subsequent efficient processing of remote sensing image requests.
In a first aspect, an embodiment of the present invention provides a distributed processing method for a remote sensing image, including:
acquiring a remote sensing image distribution request; the remote sensing image distribution request carries a first remote sensing image identifier;
acquiring a remote sensing image service list according to the remote sensing image distribution request;
polling the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service;
distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity, and storing a mapping relation between the remote sensing image and the remote sensing image service;
routing the remote sensing image request sent by the front end to a corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends remote sensing image data to the front end; the remote sensing image request carries a second remote sensing image identifier.
In a second aspect, an embodiment of the present invention further provides a distributed processing apparatus for remote sensing images, including:
the distribution request acquisition module is used for acquiring a remote sensing image distribution request; the remote sensing image distribution request carries a first remote sensing image identifier;
the remote sensing image service list acquisition module is used for acquiring a remote sensing image service list according to the remote sensing image distribution request;
the image storage quantity acquisition module is used for polling the remote sensing image service list and acquiring the image storage quantity of the polled remote sensing image service;
the remote sensing image data distribution module is used for distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity and storing the mapping relation between the remote sensing images and the remote sensing image service;
the remote sensing image service routing module is used for routing the remote sensing image request sent by the front end to the corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends remote sensing image data to the front end; the remote sensing image request carries a second remote sensing image identifier.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor, so that the at least one processor can execute the distributed processing method of the remote sensing image according to the embodiment of the invention.
In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores computer instructions, where the computer instructions are configured to cause a processor to execute the method for distributed processing of remote sensing images according to the embodiment of the present invention.
The embodiment of the invention discloses a distributed processing method, a device, equipment and a storage medium for remote sensing images. Acquiring a remote sensing image distribution request; the remote sensing image distribution request carries a first remote sensing image identifier; acquiring a remote sensing image service list according to a remote sensing image distribution request; polling the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service; distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity, and storing a mapping relation between the remote sensing image and the remote sensing image service; routing the remote sensing image request sent by the front end to a corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends remote sensing image data to the front end; the remote sensing image request carries a second remote sensing image identifier. According to the distributed processing method for the remote sensing images, the remote sensing images are distributed to the remote sensing image services, the quantity of which does not reach the set threshold value, based on the image storage quantity of the remote sensing image services, so that the stability of the remote sensing image services can be ensured, and meanwhile, the distributed stored remote sensing image data can be routed to the correct remote sensing image services when requested by the front end.
Drawings
FIG. 1 is a flow chart of a distributed processing method of remote sensing images according to a first embodiment of the present invention;
fig. 2 is a schematic structural diagram of a distributed processing device for remote sensing images according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a flowchart of a remote sensing image distributed processing method according to a first embodiment of the present invention, where the method may be applied to a case of performing distributed processing on remote sensing image data, and the method may be performed by a remote sensing image distributed processing device, where the device may be implemented in a software and/or hardware form, and optionally, may be implemented by an electronic device, where the electronic device may be a mobile terminal, a PC or a server, etc. The method specifically comprises the following steps:
s110, acquiring a remote sensing image distribution request.
The remote sensing image distribution request carries a first remote sensing image identifier. The first remote sensing image may be identified by a unique identification code (Identity document, ID) for uniquely identifying the remote sensing image. In this embodiment, when the generated remote sensing image is required to be distributed to a server for storage, a user triggers a remote sensing image distribution request, and when the remote sensing image distribution request is acquired, a remote sensing image service distributor is invoked to perform subsequent remote sensing image distribution.
S120, acquiring a remote sensing image service list according to the remote sensing image distribution request.
The remote sensing image service list stores a plurality of example objects of remote sensing image services. In this embodiment, after a remote sensing image distribution request is obtained, a remote sensing image service distributor is invoked, and a currently deployed image sensing service list is obtained through a service discovery component (discovery client) and a remote sensing image service name. The remote sensing image service name may be set in a service configuration center (condul).
S130, polling the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service.
The image storage quantity characterizes the quantity of the remote sensing images stored in the remote sensing image service, and the information of the image storage quantity is stored in a set database, such as Redis. Therefore, when the current remote sensing image service is polled, the image storage quantity of the remote sensing image service needs to be queried from the setting database.
Specifically, the process of obtaining the image storage number of the polled remote sensing image service may be: extracting the communication information of the polled remote sensing image service; generating quantity inquiry key information according to the communication information; and inquiring the image storage quantity of the polled remote sensing image service based on the data inquiry key information.
The communication information comprises address information and port information. The address may be understood as a network protocol address (Internet Protocol, IP) and the PORT (PORT) may be a virtual PORT or a physical PORT. The method for generating the quantity query key information according to the communication information can be as follows: and splicing the quantity key fields with the communication information to obtain quantity inquiry key information. For example, the number key field may be denoted as "layer_count_", and the number key field and the communication information may be denoted as "layer_count_" + "IP" + ": the "+" PORT "form is spliced into a number of query key information. And finally, inquiring the image storage quantity of the polled remote sensing image service in the setting database based on the quantity inquiry key information. In this embodiment, in the setting database, the image storage number may be stored in a key-value storage format, and the key format may be: "layer_count_" + "IP" + ": "+" PORT ", value is a specific value of the quantity. Exemplary: key, layer_count_192.168.1.33:8000; value 2004.
And S140, distributing the remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity, and storing the mapping relation between the remote sensing image and the remote sensing image service.
In this embodiment, the image storage number may be used to determine whether the remote sensing image data to be distributed may be stored in the polled remote sensing image service. In order to ensure that the remote sensing image service can work stably, an upper limit of the quantity of the remote sensing images stored by each remote sensing image service needs to be set.
Specifically, the process of distributing the remote sensing image data corresponding to the first remote sensing image identifier based on the image storage quantity may be: if the image storage quantity is smaller than the set threshold value, the polled remote sensing image service is used as a target remote sensing image service, and remote sensing image data corresponding to the first remote sensing image identification is distributed to the target remote sensing image service for storage; and if the image storage quantity is greater than or equal to the set threshold value, continuing to poll the next remote sensing image service until the target remote sensing image service is polled, and distributing the remote sensing image data corresponding to the first remote sensing image identification to the target remote sensing image service for storage.
In this embodiment, if the number of stored images is smaller than the set threshold, it is indicated that the number of remote sensing images stored in the polled remote sensing image service has not reached the upper limit, and at this time, the remote sensing image data corresponding to the first remote sensing image identifier is directly distributed to the currently polled remote sensing image service for storage, and polling is stopped. If the image storage quantity is greater than or equal to the set threshold value, the fact that the quantity of the remote sensing images stored in the polled remote sensing image service reaches the upper limit is indicated, the next remote sensing image service is continuously polled until the remote sensing image service with the stored image storage quantity smaller than the set threshold value is polled, and remote sensing image data corresponding to the first remote sensing image identification are distributed to the target remote sensing image service for storage.
Further, after the remote sensing image data corresponding to the first remote sensing image identifier is distributed to the target remote sensing image service for storage, the method further comprises the following steps: and updating the image storage quantity of the target remote sensing image service.
The updating of the image storage number of the target remote sensing image service may be to add 1 to the image storage number of the target remote sensing image service. In this embodiment, after the image storage number of the remote sensing image service is queried from the setting database by the number query key information, the image storage number is added by 1 and then stored in the setting number library. The accuracy of the image storage quantity of the remote sensing image service can be ensured.
Further, the process of storing the mapping relationship between the remote sensing image and the remote sensing image service may be: and establishing a mapping relation between the remote sensing image and the remote sensing image service based on the communication information of the first remote sensing image identifier and the target remote sensing image service, and storing the mapping relation.
The method comprises the steps of establishing a mapping relation between a remote sensing image and a remote sensing image service based on communication information of a first remote sensing image identifier and a target remote sensing image service: and establishing a mapping relation between the first remote sensing image identifier and the communication information of the target remote sensing image service. And the subsequent convenient inquiry of the target remote sensing image is facilitated. The mapping may be stored in the form of key-value, for example. The first remote sensing image mark is a key, and the communication information of the target remote sensing image service is a value. Illustratively, the mapping relationship may be identified as: key: remote sensing image ID; value is IP address and port information of the remote sensing image service. And finally, storing the mapping relation in a setting database.
And S150, routing the remote sensing image request sent by the front end to the corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends the remote sensing image data to the front end.
The remote sensing image request carries a second remote sensing image identifier. The second remote sensing image identifier and the first remote sensing image identifier are identifiers for identifying the same remote sensing image.
Specifically, the remote sensing image request sent by the front end is routed to the corresponding remote sensing image service based on the mapping relation, so that the process of sending the remote sensing image data to the front end by the remote sensing image service can be as follows: receiving a remote sensing image request sent by a front end; determining a remote sensing image service corresponding to the second remote sensing image identifier according to the mapping relation; and forwarding the remote sensing image request to the remote sensing image service, so that the remote sensing image service sends remote sensing image data corresponding to the second remote sensing image identifier to the front end.
In this embodiment, when a user wants to view a remote sensing image, a remote sensing image request is triggered by a front end (e.g., a client), the front end sends the remote sensing image request to a server, the server extracts a second remote sensing image identifier from the remote sensing image request through a pre-edited parsing script (e.g., a lua script), then determines a remote sensing image service (represented by address information and port information) corresponding to the second remote sensing image identifier according to a stored mapping relationship, and then forwards the remote sensing image request to the determined remote sensing image service, so that the remote sensing image service sends remote sensing image data corresponding to the second remote sensing image identifier to the front end.
According to the technical scheme, a remote sensing image distribution request is acquired; the remote sensing image distribution request carries a first remote sensing image identifier; acquiring a remote sensing image service list according to a remote sensing image distribution request; polling the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service; distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity, and storing a mapping relation between the remote sensing image and the remote sensing image service; and routing the remote sensing image request sent by the front end to a corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends the remote sensing image data to the front end. According to the distributed processing method for the remote sensing images, the remote sensing images are distributed to the remote sensing image services, the quantity of which does not reach the set threshold value, based on the image storage quantity of the remote sensing image services, so that the stability of the remote sensing image services can be ensured, and meanwhile, the distributed stored remote sensing image data can be routed to the correct remote sensing image services when requested by the front end.
Example two
Fig. 2 is a schematic structural diagram of a distributed processing apparatus for remote sensing images according to a second embodiment of the present invention, as shown in fig. 2, the apparatus includes:
a distribution request acquisition module 210, configured to acquire a remote sensing image distribution request; the remote sensing image distribution request carries a first remote sensing image identifier;
the remote sensing image service list obtaining module 220 is configured to obtain a remote sensing image service list according to a remote sensing image distribution request;
the image storage quantity obtaining module 230 is configured to poll the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service;
the remote sensing image data distribution module 240 is configured to distribute remote sensing image data corresponding to the first remote sensing image identifier based on the image storage number, and store a mapping relationship between the remote sensing image and the remote sensing image service;
the remote sensing image service routing module 250 is configured to route the remote sensing image request sent by the front end to a corresponding remote sensing image service based on the mapping relationship, so that the remote sensing image service sends remote sensing image data to the front end; the remote sensing image request carries a second remote sensing image identifier.
Optionally, the image storage quantity obtaining module 230 is further configured to:
extracting the communication information of the polled remote sensing image service; the communication information comprises address information and port information;
generating quantity inquiry key information according to the communication information;
and inquiring the image storage quantity of the polled remote sensing image service based on the data inquiry key information.
Optionally, the remote sensing image data distribution module 240 is further configured to:
if the image storage quantity is smaller than the set threshold value, the polled remote sensing image service is used as a target remote sensing image service, and remote sensing image data corresponding to the first remote sensing image identification is distributed to the target remote sensing image service for storage;
and if the image storage quantity is greater than or equal to the set threshold value, continuing to poll the next remote sensing image service until the target remote sensing image service is polled, and distributing the remote sensing image data corresponding to the first remote sensing image identification to the target remote sensing image service for storage.
Further, the method further comprises the following steps: the image storage quantity updating module is used for:
and updating the image storage quantity of the target remote sensing image service.
Further, the method further comprises the following steps: the mapping relation storage module is used for:
and establishing a mapping relation between the remote sensing image and the remote sensing image service based on the communication information of the first remote sensing image identifier and the target remote sensing image service, and storing the mapping relation.
Further, the remote sensing image service routing module 250 is further configured to:
receiving a remote sensing image request sent by a front end;
determining a remote sensing image service corresponding to the second remote sensing image identifier according to the mapping relation;
and forwarding the remote sensing image request to the remote sensing image service, so that the remote sensing image service sends remote sensing image data corresponding to the second remote sensing image identifier to the front end.
The device can execute the method provided by all the embodiments of the invention, and has the corresponding functional modules and beneficial effects of executing the method. Technical details not described in detail in this embodiment can be found in the methods provided in all the foregoing embodiments of the invention.
Example III
Fig. 3 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 3, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a distributed processing method of the remote sensing image.
In some embodiments, the distributed processing method of the remote sensing image may be implemented as a computer program, which is tangibly embodied on a computer readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the above-described distributed processing method of the remote sensing image may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform distributed processing of the remote sensing image in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service distributed processing in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. The distributed processing method of the remote sensing image is characterized by comprising the following steps of:
acquiring a remote sensing image distribution request; the remote sensing image distribution request carries a first remote sensing image identifier;
acquiring a remote sensing image service list according to the remote sensing image distribution request;
polling the remote sensing image service list to obtain the image storage quantity of the polled remote sensing image service;
distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity, and storing a mapping relation between the remote sensing image and the remote sensing image service;
routing the remote sensing image request sent by the front end to a corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends remote sensing image data to the front end; the remote sensing image request carries a second remote sensing image identifier.
2. The method of claim 1, wherein obtaining the image storage quantity of the polled remote sensing image service comprises:
extracting the communication information of the polled remote sensing image service; wherein the communication information comprises address information and port information;
generating quantity inquiry key information according to the communication information;
and inquiring the image storage quantity of the polled remote sensing image service based on the data inquiry key information.
3. The method of claim 1, wherein distributing the remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity comprises:
if the image storage quantity is smaller than a set threshold value, the polled remote sensing image service is used as a target remote sensing image service, and remote sensing image data corresponding to the first remote sensing image identification are distributed to the target remote sensing image service for storage;
and if the image storage quantity is greater than or equal to a set threshold value, continuing to poll the next remote sensing image service until a target remote sensing image service is polled, and distributing the remote sensing image data corresponding to the first remote sensing image identification to the target remote sensing image service for storage.
4. The method of claim 3, further comprising, after distributing the remote sensing image data corresponding to the first remote sensing image identifier to the target remote sensing image service for storage:
and updating the image storage quantity of the target remote sensing image service.
5. The method of claim 3, wherein storing the mapping relationship between the remote sensing image and the remote sensing image service comprises:
and establishing a mapping relation between the remote sensing image and the remote sensing image service based on the communication information of the first remote sensing image identifier and the target remote sensing image service, and storing the mapping relation.
6. The method of claim 5, wherein routing the remote sensing image request sent by the front end to the corresponding remote sensing image service based on the mapping relationship such that the remote sensing image service sends remote sensing image data to the front end comprises:
receiving a remote sensing image request sent by a front end;
determining a remote sensing image service corresponding to the second remote sensing image identifier according to the mapping relation;
and forwarding the remote sensing image request to the remote sensing image service, so that the remote sensing image service sends remote sensing image data corresponding to the second remote sensing image identifier to the front end.
7. A distributed processing apparatus for remote sensing images, comprising:
the distribution request acquisition module is used for acquiring a remote sensing image distribution request; the remote sensing image distribution request carries a first remote sensing image identifier;
the remote sensing image service list acquisition module is used for acquiring a remote sensing image service list according to the remote sensing image distribution request;
the image storage quantity acquisition module is used for polling the remote sensing image service list and acquiring the image storage quantity of the polled remote sensing image service;
the remote sensing image data distribution module is used for distributing remote sensing image data corresponding to the first remote sensing image identification based on the image storage quantity; storing the mapping relation between the remote sensing image and the remote sensing image service;
the remote sensing image service routing module is used for routing the remote sensing image request sent by the front end to the corresponding remote sensing image service based on the mapping relation, so that the remote sensing image service sends remote sensing image data to the front end; the remote sensing image request carries a second remote sensing image identifier.
8. The apparatus of claim 7, wherein the image storage quantity acquisition module is further configured to:
extracting the communication information of the polled remote sensing image service; wherein the communication information comprises address information and port information;
generating quantity inquiry key information according to the communication information;
and inquiring the image storage quantity of the polled remote sensing image service based on the data inquiry key information.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the distributed processing method of the remote sensing image of any one of claims 1-6.
10. A computer readable storage medium storing computer instructions for causing a processor to perform the method of distributed processing of remote sensing images according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310933076.9A CN116939228A (en) | 2023-07-27 | 2023-07-27 | Distributed processing method, device and equipment for remote sensing image and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310933076.9A CN116939228A (en) | 2023-07-27 | 2023-07-27 | Distributed processing method, device and equipment for remote sensing image and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116939228A true CN116939228A (en) | 2023-10-24 |
Family
ID=88378835
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310933076.9A Pending CN116939228A (en) | 2023-07-27 | 2023-07-27 | Distributed processing method, device and equipment for remote sensing image and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116939228A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473365A (en) * | 2013-09-25 | 2013-12-25 | 北京奇虎科技有限公司 | File storage method and device based on HDFS (Hadoop Distributed File System) and distributed file system |
| CN104111897A (en) * | 2013-04-16 | 2014-10-22 | 华为技术有限公司 | Data processing method, data processing device and computer system |
| CN104283966A (en) * | 2014-10-22 | 2015-01-14 | 浪潮(北京)电子信息产业有限公司 | Data distribution algorithm and device of cloud storage system |
| CN106527981A (en) * | 2016-10-31 | 2017-03-22 | 华中科技大学 | Configuration-based data fragmentation method for adaptive distributed storage system |
| CN108712488A (en) * | 2018-05-11 | 2018-10-26 | 北京奇虎科技有限公司 | A kind of data processing method based on block chain, device, block catenary system |
| CN108737534A (en) * | 2018-05-11 | 2018-11-02 | 北京奇虎科技有限公司 | A kind of data transmission method, device, block catenary system based on block chain |
| CN109309603A (en) * | 2018-11-02 | 2019-02-05 | 华青融天(北京)软件股份有限公司 | A kind of dynamic load balanced sharing method and device |
| CN110781006A (en) * | 2019-10-28 | 2020-02-11 | 重庆紫光华山智安科技有限公司 | Load balancing method, device, node and computer readable storage medium |
| US20200310922A1 (en) * | 2019-03-29 | 2020-10-01 | International Business Machines Corporation | Restoring operation of data storage systems at disaster recovery sites |
| CN112417199A (en) * | 2020-12-03 | 2021-02-26 | 深圳前海微众银行股份有限公司 | Remote sensing image retrieval method, device, system and storage medium |
| CN112527492A (en) * | 2019-09-18 | 2021-03-19 | 华为技术有限公司 | Data storage method and device in distributed storage system |
-
2023
- 2023-07-27 CN CN202310933076.9A patent/CN116939228A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104111897A (en) * | 2013-04-16 | 2014-10-22 | 华为技术有限公司 | Data processing method, data processing device and computer system |
| CN103473365A (en) * | 2013-09-25 | 2013-12-25 | 北京奇虎科技有限公司 | File storage method and device based on HDFS (Hadoop Distributed File System) and distributed file system |
| CN104283966A (en) * | 2014-10-22 | 2015-01-14 | 浪潮(北京)电子信息产业有限公司 | Data distribution algorithm and device of cloud storage system |
| CN106527981A (en) * | 2016-10-31 | 2017-03-22 | 华中科技大学 | Configuration-based data fragmentation method for adaptive distributed storage system |
| CN108712488A (en) * | 2018-05-11 | 2018-10-26 | 北京奇虎科技有限公司 | A kind of data processing method based on block chain, device, block catenary system |
| CN108737534A (en) * | 2018-05-11 | 2018-11-02 | 北京奇虎科技有限公司 | A kind of data transmission method, device, block catenary system based on block chain |
| CN109309603A (en) * | 2018-11-02 | 2019-02-05 | 华青融天(北京)软件股份有限公司 | A kind of dynamic load balanced sharing method and device |
| US20200310922A1 (en) * | 2019-03-29 | 2020-10-01 | International Business Machines Corporation | Restoring operation of data storage systems at disaster recovery sites |
| CN112527492A (en) * | 2019-09-18 | 2021-03-19 | 华为技术有限公司 | Data storage method and device in distributed storage system |
| CN110781006A (en) * | 2019-10-28 | 2020-02-11 | 重庆紫光华山智安科技有限公司 | Load balancing method, device, node and computer readable storage medium |
| CN112417199A (en) * | 2020-12-03 | 2021-02-26 | 深圳前海微众银行股份有限公司 | Remote sensing image retrieval method, device, system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107800565B (en) | Inspection method, inspection device, inspection system, computer equipment and storage medium | |
| CN112866391A (en) | Message pushing method and device, electronic equipment and storage medium | |
| CN114389969B (en) | Method and device for testing client, electronic equipment and storage medium | |
| CN112671892B (en) | Data transmission method, device, electronic equipment and medium | |
| CN113986135B (en) | Method, device, equipment and storage medium for processing request | |
| CN113541987A (en) | Method and device for updating configuration data | |
| CN116545905A (en) | Service health detection method and device, electronic equipment and storage medium | |
| CN114070889B (en) | Configuration method, traffic forwarding device, storage medium, and program product | |
| CN114924826B (en) | Page fusion method, device and equipment based on different code platforms | |
| CN111200640A (en) | Uploading method based on client and client | |
| CN116939228A (en) | Distributed processing method, device and equipment for remote sensing image and storage medium | |
| CN115905322A (en) | Service processing method and device, electronic equipment and storage medium | |
| CN113360689B (en) | Image retrieval system, method, related device and computer program product | |
| CN113556370A (en) | Service calling method and device | |
| CN115334040B (en) | Method and device for determining Internet Protocol (IP) address of domain name | |
| CN115242733B (en) | Message multicast method, multicast gateway, electronic device and storage medium | |
| CN114449031B (en) | Information acquisition method, device, equipment and storage medium | |
| CN114615273B (en) | Data transmission method, device and equipment based on load balancing system | |
| EP3993366A2 (en) | Network load balancer, request message distribution method, program product and system | |
| CN116708362A (en) | Communication address processing method, device, equipment and storage medium | |
| CN117749889A (en) | Request processing method and device, electronic equipment and storage medium | |
| CN117596288A (en) | Message transmission method and device, electronic equipment and storage medium | |
| CN115587119A (en) | Database query method and device, electronic equipment and storage medium | |
| CN117493465A (en) | Data circulation method and device, electronic equipment and storage medium | |
| CN116886775A (en) | External exposure method and device, cluster deployment system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |