successor u
u scalar
s scalar

successor s u
s integer
u integer

out sequence s
*
make_MDP seed state_count succ_count
seed scalar
state_count scalar
succ_count scalar
s scalar

make_MDP s seed state_count succ_count
s integer
seed integer
state_count integer
succ_count integer

out sequence s 
*
act u
u scalar
s scalar
r scalar

act u s r
u integer
s integer
r double

out list s r
*
close_MDP

close_MDP

out empty
*