Skip to content
doubtly

2 answers

The agents which are developed having their end uses as building blocks are called utility-based agents. When there are multiple possible alternatives, then to decide which one is best, utility-based agents are used. They choose actions based on a preference (utility) for each state. Sometimes achieving the desired goal is not enough. We may look for a quicker, safer, cheaper trip to reach a destination. Agent happiness should be taken into consideration. Utility describes how “happy” the agent is. Because of the uncertainty in the world, a utility agent chooses the action that maximizes the expected utility. A utility function maps a state onto a real number which describes the associated degree of happiness. 

Differnces

Utility-Based Agent:

  1. Decisions based on maximizing expected utility.
  2. Uses a utility function to represent preferences.
  3. No explicit model of the environment.
  4. Flexibility in adapting to different environments.
  5. Decision-making without detailed understanding of the world.

Model-Based Agent:

  1. Decisions rely on simulating the environment through an internal model.
  2. Maintains an explicit internal model of the environment.
  3. Requires modifications to the model for adaptation.
  4. Provides a detailed understanding of the environment.
  5. Decision-making involves explicit reasoning about the world state.
Doubtly · 26 Nov 2023 Report
Was this answer helpful?

A utility-based agent chooses the action that leads to the state with the highest utility (expected "happiness"), not just any state that meets the goal. It differs from a model-based agent because it uses a utility function to compare outcomes, while a model-based agent only uses its internal state and condition–action rules.

Architecture (block diagram in words)

Sensors -> [What the world is like now]
             ^  uses: state, how the world evolves,
             |        what my actions do
          [What it will be like if I do action A]
             |
          [How happy will I be in that state]  <- Utility
             |
          [What action I should do now] -> Actuators
  • It keeps an internal state updated from percepts, using knowledge of how the world evolves and what its actions do (this part is the same as a model-based agent).
  • For each possible action it predicts the resulting state.
  • A utility function maps each state to a real number showing how desirable it is.
  • It picks the action with the maximum expected utility, which also handles uncertainty and conflicting goals (fast vs safe vs cheap).

Example: a taxi agent that chooses the quickest, safest and cheapest route, not just any route to the destination.

Difference from a model-based (reflex) agent

Model-based agentUtility-based agent
Uses internal state + condition–action rulesUses internal state + model + utility function
Does not look ahead at outcomes of actionsPredicts outcomes of each action
Has no measure of how good a state isRates states by utility and maximises expected utility
Cannot trade off conflicting goalsCan trade off goals and handle uncertainty
Simpler and fasterMore flexible but more computation
Doubtly AI · 24 Oct 2026 AI-verified · Oct 2026 Report
Was this answer helpful?

Your answer

Log in or create a free account to answer this question.