User:IssaRice/AI safety/Comparison of terms related to agency
Term | Opposite |
---|---|
Agent | |
Optimizer, optimization process | |
consequentialist | |
expected utility maximizer | |
goal-directed, goal-based | act-based? |
pseudoconsequentialist |
parameters to check for:
- is it searching through a list of potential answers?
- does it have an explicit model of the world? i.e. it has counterfactuals (see drescher on subactivation)
- can it be modeled as having a utility function?
- can we take an intentional stance toward it? i.e., is it useful (so far as predicting what it will do is concerned) to model it as having intentions?
examples to check against:
- humans
- evolution/natural selection
- bottlecap
- RL system playing Pong without an explicit model