MultiAgentDecisionProcess
|
FactoredQLastTimeStepOrQBG is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QBG function for the earlier stages. More...
#include <FactoredQLastTimeStepOrQBG.h>
Public Member Functions | |
void | Compute () |
Compute the heuristic. More... | |
void | DeInitialize () |
FactoredQLastTimeStepOrQBG (const PlanningUnitFactoredDecPOMDPDiscrete *puf) | |
(default) Constructor More... | |
FactoredQLastTimeStepOrQBG (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf) | |
double | GetQ (Index jaohI, Index jaI) const |
Returns Q(joint A-O history jaohI, jaI). More... | |
void | Initialize () |
std::string | SoftPrintBrief () const |
Returns a short description of the heuristic, can be used for constructing filenames. More... | |
~FactoredQLastTimeStepOrQBG () | |
Public Member Functions inherited from FactoredQLastTimeStepOrElse | |
void | DeInitialize () |
FactoredQLastTimeStepOrElse (const PlanningUnitFactoredDecPOMDPDiscrete *puf) | |
(default) Constructor More... | |
FactoredQLastTimeStepOrElse (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf) | |
const Scope & | GetAgentScopeForLQF (Index e, Index stage) const |
Return the AgentScope for the lqf-th LQF at time-step stage. More... | |
double | GetLocalQValue (Index LRF, Index stage, const std::vector< Index > &sfacValues, const std::vector< Index > &aoHistIs, Index agSc_jaI) const |
Get local Q-value using individual and group indices. More... | |
double | GetLocalQValue (Index LRF, Index stage, Index sfSC_sI, Index agSC_aoHistI, Index agSc_jaI) const |
Get the Q for LRF, for local state, local aoh and local joint action only then with only 'joint' (i.e., group) indices. More... | |
double | GetLocalQValue (Index LRF, Index aoHistI, Index jaI) const |
size_t | GetNrLQFs (Index stage) const |
Return the number of local Q value functions for stage. More... | |
const Scope & | GetStateFactorScopeForLQF (Index lqf, Index stage) const |
Return the State factor Scope for the lqf-th LQF at time-step stage. More... | |
void | Initialize () |
virtual | ~FactoredQLastTimeStepOrElse () |
Destructor. More... | |
Public Member Functions inherited from FactoredQFunctionStateJAOHInterface | |
virtual double | GetLocalQValue (Index e, Index stage, const std::vector< Index > &sfacValues_e, const std::vector< Index > &aoHistIs_e, const std::vector< Index > &acs_e) const |
Get local Q-value using individual indices. More... | |
virtual double | GetLocalQValue (Index e, Index stage, Index sfSC_sI, const std::vector< Index > &aoHistIs_e, Index jaI_e) const |
Get local Q-value using individual and group indices. More... | |
virtual | ~FactoredQFunctionStateJAOHInterface () |
Destructor. More... | |
Public Member Functions inherited from QFunctionJAOHInterface | |
QFunctionJAOHInterface () | |
virtual | ~QFunctionJAOHInterface () |
Destructor. More... | |
Public Member Functions inherited from QFunctionForDecPOMDPInterface | |
QFunctionForDecPOMDPInterface () | |
(default) Constructor More... | |
virtual | ~QFunctionForDecPOMDPInterface () |
Destructor. More... | |
Public Member Functions inherited from QFunctionInterface | |
virtual void | Load () |
Load the Qvalues from disk. More... | |
virtual void | Save () const |
Stores the Qvalues to disk. More... | |
virtual | ~QFunctionInterface () |
Public Member Functions inherited from QFunctionForFactoredDecPOMDP | |
virtual void | ComputeWithCachedQValues (bool computeIfNotCached) |
Compute Qvalue function, while caching the Qvalues to disk. More... | |
virtual std::string | GetCacheFilename () const |
Gets the filename where the Qvalues should be stored. More... | |
const PlanningUnitFactoredDecPOMDPDiscrete * | GetPU () const |
const PlanningUnitFactoredDecPOMDPDiscrete * | GetPUF () const |
virtual void | Load (const std::string &filename) |
Load the Qvalues from disk from a file named filename. More... | |
QFunctionForFactoredDecPOMDP (const PlanningUnitFactoredDecPOMDPDiscrete *puf) | |
(default) Constructor More... | |
QFunctionForFactoredDecPOMDP (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf) | |
virtual void | Save (const std::string &filename) const |
Stores the Qvalues to disk in file named filename. More... | |
void | SetPU (const PlanningUnitDecPOMDPDiscrete *pu) |
void | SetPU (const boost::shared_ptr< const PlanningUnitDecPOMDPDiscrete > &pu) |
void | SetPUF (const PlanningUnitFactoredDecPOMDPDiscrete *pu) |
Changes the Planning unit pointed to. More... | |
void | SetPUF (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &pu) |
Public Member Functions inherited from QFunctionForFactoredDecPOMDPInterface | |
virtual | ~QFunctionForFactoredDecPOMDPInterface () |
(default) Constructor More... | |
Private Attributes | |
bool | _m_initialized |
QBG * | _m_QBG |
FactoredQLastTimeStepOrQBG is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QBG function for the earlier stages.
FactoredQLastTimeStepOrQBG::FactoredQLastTimeStepOrQBG | ( | const PlanningUnitFactoredDecPOMDPDiscrete * | puf | ) |
(default) Constructor
References _m_initialized, and _m_QBG.
FactoredQLastTimeStepOrQBG::FactoredQLastTimeStepOrQBG | ( | const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > & | puf | ) |
References _m_initialized, and _m_QBG.
FactoredQLastTimeStepOrQBG::~FactoredQLastTimeStepOrQBG | ( | ) |
References _m_QBG.
|
virtual |
Compute the heuristic.
Reimplemented from FactoredQLastTimeStepOrElse.
References _m_initialized, _m_QBG, FactoredQLastTimeStepOrElse::Compute(), QFunctionJAOHTree::Compute(), and Initialize().
void FactoredQLastTimeStepOrQBG::DeInitialize | ( | ) |
References _m_initialized, and FactoredQLastTimeStepOrElse::DeInitialize().
Returns Q(joint A-O history jaohI, jaI).
Implements QFunctionJAOHInterface.
References _m_QBG, and QFunctionJAOHTree::GetQ().
void FactoredQLastTimeStepOrQBG::Initialize | ( | ) |
References _m_initialized, and FactoredQLastTimeStepOrElse::Initialize().
Referenced by Compute().
|
inlinevirtual |
Returns a short description of the heuristic, can be used for constructing filenames.
Implements QFunctionInterface.
|
private |
Referenced by Compute(), DeInitialize(), FactoredQLastTimeStepOrQBG(), and Initialize().
|
private |
Referenced by Compute(), FactoredQLastTimeStepOrQBG(), GetQ(), and ~FactoredQLastTimeStepOrQBG().