#include <PrioritizedSweeping.hh>

Inheritance diagram for PrioritizedSweeping:

Classes
struct	saqPair
struct	state_info
Public Types
typedef const std::vector < float > *	state_t
Public Member Functions
virtual int	getBestAction (const std::vector< float > &s)
virtual void	planOnNewModel ()
	PrioritizedSweeping (int numactions, float gamma, float MAX_TIME, bool onlyAddLastSA, int modelType, const std::vector< float > &featmax, const std::vector< float > &featmin, Random rng=Random())
	PrioritizedSweeping (const PrioritizedSweeping &)
virtual void	setModel (MDPModel *model)
virtual bool	updateModelWithExperience (const std::vector< float > &last, int act, const std::vector< float > &curr, float reward, bool term)
virtual	~PrioritizedSweeping ()
Public Attributes
bool	ACTDEBUG
bool	LISTDEBUG
MDPModel *	model
bool	MODELDEBUG
bool	PLANNERDEBUG
bool	POLICYDEBUG
Protected Member Functions
void	addSAToList (const std::vector< float > &s, int act, float q)
state_t	canonicalize (const std::vector< float > &s)
void	createPolicy ()
void	deleteInfo (state_info *info)
double	getSeconds ()
void	initNewState (state_t s)
void	initStateInfo (state_info *info)
void	printStates ()
bool	saqPairMatch (saqPair a, saqPair b)
void	updatePriorityList (state_info *info, const std::vector< float > &next)
float	updateQValues (const std::vector< float > &state, int act)
void	updateStateActionFromModel (const std::vector< float > &state, int a)
void	updateStatesFromModel ()
Private Attributes
std::vector< float >	featmax
std::vector< float >	featmin
const float	gamma
int	lastModelUpdate
int	MAX_STEPS
const float	MAX_TIME
const int	modelType
int	nactions
int	nstates
const int	numactions
const bool	onlyAddLastSA
double	planTime
int	prevact
std::vector< float >	prevstate
std::list< saqPair >	priorityList
std::map< state_t, state_info >	statedata
std::set< std::vector< float > >	statespace
bool	timingType

Detailed Description

Definition at line 12 of file PrioritizedSweeping.hh.

Member Typedef Documentation

typedef const std::vector<float>* PrioritizedSweeping::state_t

The implementation maps all sensations to a set of canonical pointers, which serve as the internal representation of environment state.

Definition at line 18 of file PrioritizedSweeping.hh.

Constructor & Destructor Documentation

PrioritizedSweeping::PrioritizedSweeping	(	int	numactions,
		float	gamma,
		float	MAX_TIME,
		bool	onlyAddLastSA,
		int	modelType,
		const std::vector< float > &	featmax,
		const std::vector< float > &	featmin,
		Random	rng = `Random()`
	)

Standard constructor

Parameters:

numactions,numactions	in the domain
gamma	discount factor
rng	random

Definition at line 8 of file PrioritizedSweeping.cc.

PrioritizedSweeping::PrioritizedSweeping ( const PrioritizedSweeping & )

Unimplemented copy constructor: internal state cannot be simply copied.

PrioritizedSweeping::~PrioritizedSweeping ( ) [virtual]

Definition at line 41 of file PrioritizedSweeping.cc.

Member Function Documentation

void PrioritizedSweeping::addSAToList	(	const std::vector< float > &	s,
		int	act,
		float	q
	)		`[protected]`

Definition at line 692 of file PrioritizedSweeping.cc.

PrioritizedSweeping::state_t PrioritizedSweeping::canonicalize ( const std::vector< float > & s ) [protected]

Produces a canonical representation of the given sensation.

Parameters:

s	The current sensation from the environment.

Returns:: A pointer to an equivalent state in statespace.

Definition at line 235 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::createPolicy ( ) [protected]

Create policy through prioritized sweeping.

Definition at line 359 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::deleteInfo ( state_info * info ) [protected]

Definition at line 343 of file PrioritizedSweeping.cc.

int PrioritizedSweeping::getBestAction ( const std::vector< float > & state ) [virtual]

Choose the next action

Implements Planner.

Definition at line 157 of file PrioritizedSweeping.cc.

double PrioritizedSweeping::getSeconds ( ) [protected]

Definition at line 350 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::initNewState ( state_t s ) [protected]

Definition at line 55 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::initStateInfo ( state_info * info ) [protected]

Definition at line 258 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::planOnNewModel ( ) [virtual]

Implements Planner.

Definition at line 195 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::printStates ( ) [protected]

Print state info for debugging.

Definition at line 284 of file PrioritizedSweeping.cc.

bool PrioritizedSweeping::saqPairMatch	(	saqPair	a,
		saqPair	b
	)		`[protected]`

Definition at line 532 of file PrioritizedSweeping.cc.

void PrioritizedSweeping::setModel ( MDPModel * model ) [virtual]

Implements Planner.

Definition at line 43 of file PrioritizedSweeping.cc.

bool PrioritizedSweeping::updateModelWithExperience	(	const std::vector< float > &	laststate,
		int	lastact,
		const std::vector< float > &	currstate,
		float	reward,
		bool	term
	)		`[virtual]`