![]() In contrast, instrumental goals, or instrumental values, are only valuable to an agent as a means toward accomplishing its final goals. See also: Instrumental and intrinsic valueįinal goals-also known as terminal goals, final values, ends, or telē-are intrinsically valuable to an intelligent agent, whether an artificial intelligence or a human being, as ends-in-themselves. Proposed basic AI drives include utility function or goal-content integrity, self-protection, freedom from interference, self-improvement, and non-satiable acquisition of additional resources. ![]() ![]() For example, a computer with the sole, unconstrained goal of solving a difficult mathematics problem like the Riemann hypothesis could attempt to turn the entire Earth into one giant computer in an effort to increase its computational power so that it can succeed in its calculations. Instrumental convergence posits that an intelligent agent with unbounded but apparently harmless goals can act in surprisingly harmful ways. More precisely, agents (beings with agency) may pursue instrumental goals-goals which are made in pursuit of some particular end, but are not the end goals themselves-without ceasing, provided that their ultimate (intrinsic) goals may never be fully satisfied. ![]() Instrumental convergence is the hypothetical tendency for most sufficiently intelligent beings (human and non-human) to pursue similar sub-goals, even if their ultimate goals are quite different. ![]()
0 Comments
Leave a Reply. |