FactoredQLastTimeStepOrQPOMDP Class Reference

FactoredQLastTimeStepOrQPOMDP is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QPOMDP function for the earlier stages. More...

#include <FactoredQLastTimeStepOrQPOMDP.h>

Inheritance diagram for FactoredQLastTimeStepOrQPOMDP:

Public Member Functions
void	Compute ()
	Compute the heuristic. More...
void	DeInitialize ()
	FactoredQLastTimeStepOrQPOMDP (const PlanningUnitFactoredDecPOMDPDiscrete *puf)
	(default) Constructor More...
	FactoredQLastTimeStepOrQPOMDP (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf)
double	GetQ (Index jaohI, Index jaI) const
	Returns Q(joint A-O history jaohI, jaI). More...
void	Initialize ()
std::string	SoftPrintBrief () const
	Returns a short description of the heuristic, can be used for constructing filenames. More...
	~FactoredQLastTimeStepOrQPOMDP ()
Public Member Functions inherited from FactoredQLastTimeStepOrElse
void	DeInitialize ()
	FactoredQLastTimeStepOrElse (const PlanningUnitFactoredDecPOMDPDiscrete *puf)
	(default) Constructor More...
	FactoredQLastTimeStepOrElse (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf)
const Scope &	GetAgentScopeForLQF (Index e, Index stage) const
	Return the AgentScope for the lqf-th LQF at time-step stage. More...
double	GetLocalQValue (Index LRF, Index stage, const std::vector< Index > &sfacValues, const std::vector< Index > &aoHistIs, Index agSc_jaI) const
	Get local Q-value using individual and group indices. More...
double	GetLocalQValue (Index LRF, Index stage, Index sfSC_sI, Index agSC_aoHistI, Index agSc_jaI) const
	Get the Q for LRF, for local state, local aoh and local joint action only then with only 'joint' (i.e., group) indices. More...
double	GetLocalQValue (Index LRF, Index aoHistI, Index jaI) const
size_t	GetNrLQFs (Index stage) const
	Return the number of local Q value functions for stage. More...
const Scope &	GetStateFactorScopeForLQF (Index lqf, Index stage) const
	Return the State factor Scope for the lqf-th LQF at time-step stage. More...
void	Initialize ()
virtual	~FactoredQLastTimeStepOrElse ()
	Destructor. More...
Public Member Functions inherited from FactoredQFunctionStateJAOHInterface
virtual double	GetLocalQValue (Index e, Index stage, const std::vector< Index > &sfacValues_e, const std::vector< Index > &aoHistIs_e, const std::vector< Index > &acs_e) const
	Get local Q-value using individual indices. More...
virtual double	GetLocalQValue (Index e, Index stage, Index sfSC_sI, const std::vector< Index > &aoHistIs_e, Index jaI_e) const
	Get local Q-value using individual and group indices. More...
virtual	~FactoredQFunctionStateJAOHInterface ()
	Destructor. More...
Public Member Functions inherited from QFunctionJAOHInterface
	QFunctionJAOHInterface ()
virtual	~QFunctionJAOHInterface ()
	Destructor. More...
Public Member Functions inherited from QFunctionForDecPOMDPInterface
	QFunctionForDecPOMDPInterface ()
	(default) Constructor More...
virtual	~QFunctionForDecPOMDPInterface ()
	Destructor. More...
Public Member Functions inherited from QFunctionInterface
virtual void	Load ()
	Load the Qvalues from disk. More...
virtual void	Save () const
	Stores the Qvalues to disk. More...
virtual	~QFunctionInterface ()
Public Member Functions inherited from QFunctionForFactoredDecPOMDP
virtual void	ComputeWithCachedQValues (bool computeIfNotCached)
	Compute Qvalue function, while caching the Qvalues to disk. More...
virtual std::string	GetCacheFilename () const
	Gets the filename where the Qvalues should be stored. More...
const PlanningUnitFactoredDecPOMDPDiscrete *	GetPU () const
const PlanningUnitFactoredDecPOMDPDiscrete *	GetPUF () const
virtual void	Load (const std::string &filename)
	Load the Qvalues from disk from a file named filename. More...
	QFunctionForFactoredDecPOMDP (const PlanningUnitFactoredDecPOMDPDiscrete *puf)
	(default) Constructor More...
	QFunctionForFactoredDecPOMDP (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf)
virtual void	Save (const std::string &filename) const
	Stores the Qvalues to disk in file named filename. More...
void	SetPU (const PlanningUnitDecPOMDPDiscrete *pu)
void	SetPU (const boost::shared_ptr< const PlanningUnitDecPOMDPDiscrete > &pu)
void	SetPUF (const PlanningUnitFactoredDecPOMDPDiscrete *pu)
	Changes the Planning unit pointed to. More...
void	SetPUF (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &pu)
Public Member Functions inherited from QFunctionForFactoredDecPOMDPInterface
virtual	~QFunctionForFactoredDecPOMDPInterface ()
	(default) Constructor More...

Private Attributes
bool	_m_initialized
QPOMDP *	_m_QPOMDP

Detailed Description

FactoredQLastTimeStepOrQPOMDP is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QPOMDP function for the earlier stages.

Constructor & Destructor Documentation

FactoredQLastTimeStepOrQPOMDP::FactoredQLastTimeStepOrQPOMDP

(

const PlanningUnitFactoredDecPOMDPDiscrete *

puf

)

(default) Constructor

References _m_QPOMDP.

FactoredQLastTimeStepOrQPOMDP::FactoredQLastTimeStepOrQPOMDP

(

const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &

puf

)

References _m_QPOMDP.

FactoredQLastTimeStepOrQPOMDP::~FactoredQLastTimeStepOrQPOMDP

(

)

References _m_QPOMDP.

Member Function Documentation

void FactoredQLastTimeStepOrQPOMDP::Compute ( )

virtual

Compute the heuristic.

Reimplemented from FactoredQLastTimeStepOrElse.

References _m_initialized, _m_QPOMDP, FactoredQLastTimeStepOrElse::Compute(), QFunctionJAOHTree::Compute(), and Initialize().

void FactoredQLastTimeStepOrQPOMDP::DeInitialize

(

)

References _m_initialized, and FactoredQLastTimeStepOrElse::DeInitialize().

double FactoredQLastTimeStepOrQPOMDP::GetQ ( Index  jaohI, Index  jaI  ) const

virtual

Returns Q(joint A-O history jaohI, jaI).

Implements QFunctionJAOHInterface.

References _m_QPOMDP, and QFunctionJAOHTree::GetQ().

void FactoredQLastTimeStepOrQPOMDP::Initialize

(

)

References _m_initialized, and FactoredQLastTimeStepOrElse::Initialize().

Referenced by Compute().

std::string FactoredQLastTimeStepOrQPOMDP::SoftPrintBrief ( ) const

inlinevirtual

Returns a short description of the heuristic, can be used for constructing filenames.

Implements QFunctionInterface.

Member Data Documentation

bool FactoredQLastTimeStepOrQPOMDP::_m_initialized

private

Referenced by Compute(), DeInitialize(), and Initialize().

QPOMDP* FactoredQLastTimeStepOrQPOMDP::_m_QPOMDP

private

Referenced by Compute(), FactoredQLastTimeStepOrQPOMDP(), GetQ(), and ~FactoredQLastTimeStepOrQPOMDP().