JP7380585B2 - 蓄電素子評価装置、コンピュータプログラム、蓄電素子評価方法、学習方法及び生成方法 - Google Patents
蓄電素子評価装置、コンピュータプログラム、蓄電素子評価方法、学習方法及び生成方法 Download PDFInfo
- Publication number
- JP7380585B2 JP7380585B2 JP2020554018A JP2020554018A JP7380585B2 JP 7380585 B2 JP7380585 B2 JP 7380585B2 JP 2020554018 A JP2020554018 A JP 2020554018A JP 2020554018 A JP2020554018 A JP 2020554018A JP 7380585 B2 JP7380585 B2 JP 7380585B2
- Authority
- JP
- Japan
- Prior art keywords
- storage element
- power storage
- state
- action
- reward
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011156 evaluation Methods 0.000 title claims description 225
- 238000004146 energy storage Methods 0.000 title claims description 73
- 238000000034 method Methods 0.000 title claims description 73
- 238000004590 computer program Methods 0.000 title claims description 11
- 230000009471 action Effects 0.000 claims description 177
- 230000006399 behavior Effects 0.000 claims description 123
- 230000002787 reinforcement Effects 0.000 claims description 52
- 238000004364 calculation method Methods 0.000 claims description 46
- 230000008569 process Effects 0.000 claims description 38
- 230000007704 transition Effects 0.000 claims description 33
- 230000005611 electricity Effects 0.000 claims description 32
- 230000007423 decrease Effects 0.000 claims description 26
- 238000013461 design Methods 0.000 claims description 23
- 230000007613 environmental effect Effects 0.000 claims description 16
- 230000008859 change Effects 0.000 claims description 15
- 230000006866 deterioration Effects 0.000 description 55
- 238000010586 diagram Methods 0.000 description 53
- 230000006870 function Effects 0.000 description 48
- 238000012545 processing Methods 0.000 description 28
- 238000004891 communication Methods 0.000 description 14
- 239000003795 chemical substances by application Substances 0.000 description 13
- 238000012544 monitoring process Methods 0.000 description 12
- 238000003062 neural network model Methods 0.000 description 11
- 238000010248 power generation Methods 0.000 description 10
- 238000007726 management method Methods 0.000 description 8
- 238000007599 discharging Methods 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 210000004205 output neuron Anatomy 0.000 description 5
- 230000003247 decreasing effect Effects 0.000 description 4
- 230000015654 memory Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 230000036541 health Effects 0.000 description 3
- 210000002364 input neuron Anatomy 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000011017 operating method Methods 0.000 description 3
- 101001033754 Homo sapiens Mediator of RNA polymerase II transcription subunit 31 Proteins 0.000 description 2
- 102100039122 Mediator of RNA polymerase II transcription subunit 31 Human genes 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 239000002253 acid Substances 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 101150048619 mdt-31 gene Proteins 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002028 premature Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L58/00—Methods or circuit arrangements for monitoring or controlling batteries or fuel cells, specially adapted for electric vehicles
- B60L58/10—Methods or circuit arrangements for monitoring or controlling batteries or fuel cells, specially adapted for electric vehicles for monitoring or controlling batteries
- B60L58/12—Methods or circuit arrangements for monitoring or controlling batteries or fuel cells, specially adapted for electric vehicles for monitoring or controlling batteries responding to state of charge [SoC]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/40—Business processes related to the transportation industry
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L58/00—Methods or circuit arrangements for monitoring or controlling batteries or fuel cells, specially adapted for electric vehicles
- B60L58/10—Methods or circuit arrangements for monitoring or controlling batteries or fuel cells, specially adapted for electric vehicles for monitoring or controlling batteries
- B60L58/16—Methods or circuit arrangements for monitoring or controlling batteries or fuel cells, specially adapted for electric vehicles for monitoring or controlling batteries responding to battery ageing, e.g. to the number of charging cycles or the state of health [SoH]
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/36—Arrangements for testing, measuring or monitoring the electrical condition of accumulators or electric batteries, e.g. capacity or state of charge [SoC]
- G01R31/367—Software therefor, e.g. for battery testing using modelling or look-up tables
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/36—Arrangements for testing, measuring or monitoring the electrical condition of accumulators or electric batteries, e.g. capacity or state of charge [SoC]
- G01R31/382—Arrangements for monitoring battery or accumulator variables, e.g. SoC
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/36—Arrangements for testing, measuring or monitoring the electrical condition of accumulators or electric batteries, e.g. capacity or state of charge [SoC]
- G01R31/392—Determining battery ageing or deterioration, e.g. state of health
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06315—Needs-based resource requirements planning or analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
- G06Q30/0226—Incentive systems for frequent usage, e.g. frequent flyer miles programs or point systems
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01M—PROCESSES OR MEANS, e.g. BATTERIES, FOR THE DIRECT CONVERSION OF CHEMICAL ENERGY INTO ELECTRICAL ENERGY
- H01M10/00—Secondary cells; Manufacture thereof
- H01M10/42—Methods or arrangements for servicing or maintenance of secondary cells or secondary half-cells
- H01M10/48—Accumulators combined with arrangements for measuring, testing or indicating the condition of cells, e.g. the level or density of the electrolyte
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J7/00—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
- H02J7/0047—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries with monitoring or indicating devices or circuits
- H02J7/0048—Detection of remaining charge capacity or state of charge [SOC]
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J7/00—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
- H02J7/0047—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries with monitoring or indicating devices or circuits
- H02J7/005—Detection of state of health [SOH]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2240/00—Control parameters of input or output; Target parameters
- B60L2240/40—Drive Train control parameters
- B60L2240/54—Drive Train control parameters related to batteries
- B60L2240/545—Temperature
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2240/00—Control parameters of input or output; Target parameters
- B60L2240/40—Drive Train control parameters
- B60L2240/54—Drive Train control parameters related to batteries
- B60L2240/547—Voltage
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2240/00—Control parameters of input or output; Target parameters
- B60L2240/40—Drive Train control parameters
- B60L2240/54—Drive Train control parameters related to batteries
- B60L2240/549—Current
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2240/00—Control parameters of input or output; Target parameters
- B60L2240/60—Navigation input
- B60L2240/62—Vehicle position
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2240/00—Control parameters of input or output; Target parameters
- B60L2240/60—Navigation input
- B60L2240/66—Ambient conditions
- B60L2240/662—Temperature
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2240/00—Control parameters of input or output; Target parameters
- B60L2240/70—Interactions with external data bases, e.g. traffic centres
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
- B60L2260/00—Operating Modes
- B60L2260/40—Control modes
- B60L2260/46—Control modes by self learning
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01M—PROCESSES OR MEANS, e.g. BATTERIES, FOR THE DIRECT CONVERSION OF CHEMICAL ENERGY INTO ELECTRICAL ENERGY
- H01M2220/00—Batteries for particular applications
- H01M2220/20—Batteries in motive systems, e.g. vehicle, ship, plane
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
- Y02E60/10—Energy storage using batteries
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/60—Other road transportation technologies with climate change mitigation effect
- Y02T10/70—Energy storage systems for electromobility, e.g. batteries
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/60—Other road transportation technologies with climate change mitigation effect
- Y02T10/72—Electric energy management in electromobility
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T90/00—Enabling technologies or technologies with a potential or indirect contribution to GHG emissions mitigation
- Y02T90/10—Technologies relating to charging of electric vehicles
- Y02T90/16—Information or communication technologies improving the operation of electric vehicles
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Power Engineering (AREA)
- Economics (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Sustainable Development (AREA)
- Transportation (AREA)
- General Chemical & Material Sciences (AREA)
- Electrochemistry (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Game Theory and Decision Science (AREA)
- Chemical & Material Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Manufacturing & Machinery (AREA)
- Sustainable Energy (AREA)
- Health & Medical Sciences (AREA)
- Mechanical Engineering (AREA)
- Tourism & Hospitality (AREA)
- Medical Informatics (AREA)
- Educational Administration (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Primary Health Care (AREA)
- Charge And Discharge Circuits For Batteries Or The Like (AREA)
- Secondary Cells (AREA)
- Tests Of Electric Status Of Batteries (AREA)
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
- Electric Propulsion And Braking For Vehicles (AREA)
Description
51 制御部
52 通信部
53 記憶部
54 記録媒体読取部
60 処理部
61 SOH推定部
62 報酬算出部
63 行動選択部
64 評価値テーブル
Claims (20)
- 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択する行動選択部と、
前記行動選択部で選択した行動を実行したときの前記蓄電素子の状態を取得する状態取得部と、
前記行動選択部で選択した行動を実行したときの報酬を取得する報酬取得部と、
前記状態取得部で取得した状態及び前記報酬取得部で取得した報酬に基づいて、前記行動評価情報を更新する更新部と、
を備え、
強化学習を用いて、前記行動選択部による選択処理、前記状態取得部による取得処理、前記報酬取得部による取得処理、及び前記更新部による更新処理を繰り返すことにより、報酬を最大化できる前記行動評価情報を学習し、
さらに、
前記更新部で更新した行動評価情報に基づく行動を実行して、前記蓄電素子の状態を評価する評価部を備える蓄電素子評価装置。 - 前記蓄電素子を搭載した移動体を、複数の移動エリアのうちの一の移動エリア内で移動するようにしてあり、
前記行動は、
前記移動体が移動する移動エリアから当該移動エリアと異なる他の移動エリアへの切替を含む請求項1に記載の蓄電素子評価装置。 - 前記移動エリアの切替に伴う移動体エリア間の距離に基づく報酬を算出する第1報酬算出部を備え、
前記報酬取得部は、
前記第1報酬算出部で算出した報酬を取得する請求項2に記載の蓄電素子評価装置。 - 前記行動は、
前記蓄電素子が移動体に搭載された搭載状態と移動体から取り外された保管状態との切替を含む請求項1に記載の蓄電素子評価装置。 - 前記蓄電素子は、複数の負荷のうちの一の負荷に接続してあり、
前記行動は、
前記蓄電素子に接続された負荷から当該負荷と異なる他の負荷への切替を含む請求項1に記載の蓄電素子評価装置。 - 前記切替の回数に基づく報酬を算出する第2報酬算出部を備え、
前記報酬取得部は、
前記第2報酬算出部で算出した報酬を取得する請求項2から請求項5のいずれか一項に記載の蓄電素子評価装置。 - 前記蓄電素子のSOHの低下の度合いに基づく報酬を算出する第3報酬算出部を備え、
前記報酬取得部は、
前記第3報酬算出部で算出した報酬を取得する請求項1から請求項6のいずれか一項に記載の蓄電素子評価装置。 - 前記蓄電素子の状態が寿命に到達したか否かに基づいて報酬を算出する第4報酬算出部を備え、
前記報酬取得部は、
前記第4報酬算出部で算出した報酬を取得する請求項1から請求項7のいずれか一項に記載の蓄電素子評価装置。 - 前記蓄電素子の負荷電力情報を取得する電力情報取得部と、
前記電力情報取得部で取得した負荷電力情報及び前記行動選択部で選択した行動に基づいて前記蓄電素子のSOCの推移を推定するSOC推移推定部と、
前記SOC推移推定部で推定したSOCの推移に基づいて前記蓄電素子のSOHを推定するSOH推定部と
を備え、
前記評価部は、
前記SOH推定部が推定したSOHに基づいて前記蓄電素子のSOHを含む状態を評価する請求項1から請求項8のいずれか一項に記載の蓄電素子評価装置。 - 前記蓄電素子の負荷電力情報を取得する電力情報取得部と、
前記蓄電素子のSOHを取得するSOH取得部と、
前記電力情報取得部で取得した負荷電力情報及び前記SOH取得部で取得したSOHに基づいて、前記蓄電素子のSOHを推定するSOH推定部を生成する生成部と
を備え、
前記評価部は、
前記生成部が生成したSOH推定部のSOH推定に基づいて前記蓄電素子のSOHを含む状態を評価する請求項1から請求項8のいずれか一項に記載の蓄電素子評価装置。 - 前記蓄電素子の環境温度情報を取得する温度情報取得部を備え、
前記SOH推定部は、
前記環境温度情報に基づいて前記蓄電素子のSOHを推定する請求項9又は請求項10に記載の蓄電素子評価装置。 - 前記蓄電素子の設計パラメータを取得するパラメータ取得部を備え、
前記評価部は、
前記パラメータ取得部で取得した設計パラメータに応じて前記蓄電素子の状態を評価する請求項1から請求項11のいずれか一項に記載の蓄電素子評価装置。 - 前記評価部での前記蓄電素子の状態の評価結果に基づいて、前記蓄電素子の負荷状態の変更を含む行動の指令を出力する出力部を備える請求項1から請求項12のいずれか一項に記載の蓄電素子評価装置。
- コンピュータに、
蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択する処理と、
選択した行動を実行したときの前記蓄電素子の状態を取得する処理と、
選択した行動を実行したときの報酬を取得する処理と、
取得した状態及び報酬に基づいて、前記行動評価情報を更新する処理と、
強化学習を用いて、前記行動を選択する処理、前記状態を取得する処理、前記報酬を取得する処理、及び前記行動評価情報を更新する処理を繰り返すことにより、報酬を最大化できる前記行動評価情報を学習する処理と、
更新した行動評価情報に基づく行動を実行して、前記蓄電素子の状態を評価する処理と、
を実行させるコンピュータプログラム。 - 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択し、
選択された行動を実行したときの前記蓄電素子の状態を取得し、
選択された行動を実行したときの報酬を取得し、
取得された状態及び報酬に基づいて、前記行動評価情報を更新し、
強化学習を用いて、前記行動を選択するステップ、前記状態を取得するステップ、前記報酬を取得するステップ、及び前記行動評価情報を更新するステップを繰り返すことにより、報酬を最大化できる前記行動評価情報を学習し、
更新された行動評価情報に基づく行動を実行して、前記蓄電素子の状態を評価する蓄電素子評価方法。 - 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択し、
選択された行動を実行したときの前記蓄電素子の状態を取得し、
選択された行動を実行したときの報酬を取得し、
取得された報酬に基づいて、前記行動評価情報を更新して、前記蓄電素子の状態に対応する行動を学習する学習方法。 - 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択し、
選択された行動を実行したときの前記蓄電素子の状態を取得し、
選択された行動を実行したときの報酬を取得し、
取得された報酬に基づいて、前記行動評価情報を更新し、
前記蓄電素子の設計パラメータを取得して前記行動評価情報を生成する生成方法。 - 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択する行動選択部と、
前記行動選択部で選択した行動を実行したときの前記蓄電素子の状態を取得する状態取得部と、
前記行動選択部で選択した行動を実行したときの報酬を取得する報酬取得部と、
前記状態取得部で取得した状態及び前記報酬取得部で取得した報酬に基づいて、前記行動評価情報を更新する更新部と、
前記更新部で更新した行動評価情報に基づく行動を実行して、前記蓄電素子の状態を評価する評価部を備え、
前記蓄電素子を搭載した移動体を、複数の移動エリアのうちの一の移動エリア内で移動するようにしてあり、
前記行動は、
前記移動体が移動する移動エリアから当該移動エリアと異なる他の移動エリアへの切替を含む蓄電素子評価装置。 - 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択する行動選択部と、
前記行動選択部で選択した行動を実行したときの前記蓄電素子の状態を取得する状態取得部と、
前記行動選択部で選択した行動を実行したときの報酬を取得する報酬取得部と、
前記状態取得部で取得した状態及び前記報酬取得部で取得した報酬に基づいて、前記行動評価情報を更新する更新部と、
前記更新部で更新した行動評価情報に基づく行動を実行して、前記蓄電素子の状態を評価する評価部を備え、
前記蓄電素子は、複数の負荷のうちの一の負荷に接続してあり、
前記行動は、
前記蓄電素子に接続された負荷から当該負荷と異なる他の負荷への切替を含み、
前記切替の回数に基づく報酬を算出する第2報酬算出部を備え、
前記報酬取得部は、
前記第2報酬算出部で算出した報酬を取得する蓄電素子評価装置。 - 蓄電素子の負荷状態の変更を含む行動を、行動評価情報に基づいて選択する行動選択部と、
前記行動選択部で選択した行動を実行したときの前記蓄電素子の状態を取得する状態取得部と、
前記行動選択部で選択した行動を実行したときの報酬を取得する報酬取得部と、
前記状態取得部で取得した状態及び前記報酬取得部で取得した報酬に基づいて、前記行動評価情報を更新する更新部と、
前記更新部で更新した行動評価情報に基づく行動を実行して、前記蓄電素子の状態を評価する評価部を備え、
前記蓄電素子を搭載した移動体を、複数の移動エリアのうちの一の移動エリア内で移動するようにしてあり、
前記行動は、
前記移動体が移動する移動エリアから当該移動エリアと異なる他の移動エリアへの切替を含み、
前記切替の回数に基づく報酬を算出する第2報酬算出部をさらに備え、
前記報酬取得部は、
前記第2報酬算出部で算出した報酬を取得する蓄電素子評価装置。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018205734 | 2018-10-31 | ||
JP2018205734 | 2018-10-31 | ||
PCT/JP2019/042707 WO2020090949A1 (ja) | 2018-10-31 | 2019-10-31 | 蓄電素子評価装置、コンピュータプログラム、蓄電素子評価方法、学習方法及び生成方法 |
Publications (3)
Publication Number | Publication Date |
---|---|
JPWO2020090949A1 JPWO2020090949A1 (ja) | 2021-10-14 |
JPWO2020090949A5 JPWO2020090949A5 (ja) | 2022-09-16 |
JP7380585B2 true JP7380585B2 (ja) | 2023-11-15 |
Family
ID=70464662
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020554018A Active JP7380585B2 (ja) | 2018-10-31 | 2019-10-31 | 蓄電素子評価装置、コンピュータプログラム、蓄電素子評価方法、学習方法及び生成方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20220041078A1 (ja) |
EP (1) | EP3875976A4 (ja) |
JP (1) | JP7380585B2 (ja) |
CN (1) | CN113227810A (ja) |
WO (1) | WO2020090949A1 (ja) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7108579B2 (ja) * | 2019-06-03 | 2022-07-28 | 本田技研工業株式会社 | 管理装置、管理方法、およびプログラム |
JP7314822B2 (ja) * | 2020-02-06 | 2023-07-26 | トヨタ自動車株式会社 | バッテリ劣化判定装置、バッテリ劣化判定方法、及びバッテリ劣化判定プログラム |
SE2151358A1 (en) * | 2021-11-05 | 2023-05-06 | Centre Nat Rech Scient | Joint optimization of routes and driving parameters for cycle degradation minimization in electric vehicles |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004130909A (ja) | 2002-10-10 | 2004-04-30 | Shin Kobe Electric Mach Co Ltd | 電池状態検知システム |
WO2014046179A1 (ja) | 2012-09-20 | 2014-03-27 | 積水化学工業株式会社 | 蓄電池運転制御装置、蓄電池運転制御方法及びプログラム |
WO2014083856A1 (ja) | 2012-11-30 | 2014-06-05 | 三洋電機株式会社 | 電池管理装置、電源装置およびsoc推定方法 |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8626565B2 (en) * | 2008-06-30 | 2014-01-07 | Autonomous Solutions, Inc. | Vehicle dispatching method and system |
EP2290387A3 (en) * | 2009-08-31 | 2016-11-16 | Kabushiki Kaisha Toshiba | Apparatus and method for establishing battery value index |
JP5467010B2 (ja) * | 2010-07-22 | 2014-04-09 | ニチコン株式会社 | 学習型蓄電池マネジメントシステム |
JP6301730B2 (ja) * | 2013-10-04 | 2018-03-28 | 株式会社東芝 | 電動車両の運行管理装置及び運行計画立案方法 |
JP6374747B2 (ja) * | 2014-09-29 | 2018-08-15 | 積水化学工業株式会社 | 電力管理システム及び電力管理方法 |
US20160105044A1 (en) * | 2014-10-08 | 2016-04-14 | Panasonic Intellectual Property Management Co., Ltd. | Power-storage-system control method and power-storage-system control apparatus |
AU2015404618A1 (en) * | 2015-07-31 | 2018-02-15 | Kabushiki Kaisha Toshiba | Storage battery evaluating device, power storage system and storage battery evaluating method |
JP6565490B2 (ja) | 2015-08-27 | 2019-08-28 | 株式会社デンソー | 車両の使用予測システム |
US9948119B2 (en) * | 2016-05-05 | 2018-04-17 | Inventus Holdings, Llc | Control of parallel battery utilization |
SG11202005957PA (en) * | 2017-12-27 | 2020-07-29 | Future Science Res Inc | Secondary battery management device, secondary battery, and secondary battery management program |
TWI704740B (zh) * | 2017-12-29 | 2020-09-11 | 英屬開曼群島商睿能創意公司 | 提供置於裝置交換站的複數個能源儲存裝置的方法、裝置交換站及伺服器 |
EP3803736A1 (en) * | 2018-06-07 | 2021-04-14 | DEKA Products Limited Partnership | System and method for distributed utility service execution |
GB201810755D0 (en) * | 2018-06-29 | 2018-08-15 | Univ Birmingham | Vehicle power management system and method |
US10804702B2 (en) * | 2018-10-11 | 2020-10-13 | Centrica Business Solutions Belgium | Self-organizing demand-response system |
MX2022004452A (es) * | 2019-10-18 | 2022-08-04 | Off World Inc | Sistemas y metodos para robotica industrial. |
-
2019
- 2019-10-31 CN CN201980084253.2A patent/CN113227810A/zh active Pending
- 2019-10-31 WO PCT/JP2019/042707 patent/WO2020090949A1/ja unknown
- 2019-10-31 US US17/290,191 patent/US20220041078A1/en active Pending
- 2019-10-31 EP EP19878143.7A patent/EP3875976A4/en active Pending
- 2019-10-31 JP JP2020554018A patent/JP7380585B2/ja active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004130909A (ja) | 2002-10-10 | 2004-04-30 | Shin Kobe Electric Mach Co Ltd | 電池状態検知システム |
WO2014046179A1 (ja) | 2012-09-20 | 2014-03-27 | 積水化学工業株式会社 | 蓄電池運転制御装置、蓄電池運転制御方法及びプログラム |
WO2014083856A1 (ja) | 2012-11-30 | 2014-06-05 | 三洋電機株式会社 | 電池管理装置、電源装置およびsoc推定方法 |
Also Published As
Publication number | Publication date |
---|---|
CN113227810A (zh) | 2021-08-06 |
EP3875976A1 (en) | 2021-09-08 |
EP3875976A4 (en) | 2022-01-05 |
JPWO2020090949A1 (ja) | 2021-10-14 |
WO2020090949A1 (ja) | 2020-05-07 |
US20220041078A1 (en) | 2022-02-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7380585B2 (ja) | 蓄電素子評価装置、コンピュータプログラム、蓄電素子評価方法、学習方法及び生成方法 | |
US11136008B2 (en) | Systems and methods for managing exchangeable energy storage device stations | |
Alvarez-Valdes et al. | Optimizing the level of service quality of a bike-sharing system | |
US11325494B2 (en) | Systems, methods, and storage media for determining a target battery charging level for a drive route | |
JP7381742B2 (ja) | バッテリーサービス提供システム及び方法 | |
US20210373082A1 (en) | Method and device for operating an electrically drivable motor vehicle depending on a predicted state of health of an electrical energy store | |
WO2020056157A1 (en) | Systems and methods for managing energy storage systems | |
KR102627949B1 (ko) | 전기차 충전 스테이션을 이용한 배터리 성능관리 시스템 및 방법 | |
JP6129701B2 (ja) | 充電管理装置、充電管理システムおよび充電管理方法 | |
JP2020145186A (ja) | 電池パックの性能を最適化するための機械学習モデルを適用するためのシステム、方法および記憶媒体 | |
JP7487380B2 (ja) | 電気車充電ステーションを用いたバッテリー性能管理システム及び方法 | |
CN112368198A (zh) | 车辆动力管理***和方法 | |
JP7031649B2 (ja) | 評価装置、コンピュータプログラム及び評価方法 | |
CN114829961A (zh) | 利用机器学习模型预测电池健康状况的方法和*** | |
Abbas et al. | An improved optimal forecasting algorithm for comprehensive electric vehicle charging allocation | |
US11835589B2 (en) | Method and apparatus for machine-individual improvement of the lifetime of a battery in a battery-operated machine | |
CN112529608A (zh) | 信息处理***以及程序 | |
Liu et al. | Stochastic one-way carsharing systems with dynamic relocation incentives through preference learning | |
CN116278571A (zh) | 车辆控制方法、装置、设备及存储介质 | |
CN116521374A (zh) | 一种数据处理方法、设备、车辆及计算机程序产品 | |
WO2022040399A1 (en) | Simulation-based optimization framework for controlling electric vehicles | |
US20230176137A1 (en) | Method and system for determining a remaining useful lifetime of a battery | |
CN116373680A (zh) | 运行具有可替换的设备电池组的供电设备的方法和装置以及具有预测性分派的电池组更换站 | |
WO2023181101A1 (ja) | 情報処理装置、情報処理方法、情報処理システム及びコンピュータプログラム | |
US20240202618A1 (en) | Method and system for electrical energy storage maintenance on fleet level |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220908 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20220908 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230808 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230921 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20231003 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20231016 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7380585 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |