Ology

When AI Helps Us Think—and When It Thinks Instead of Us

Measuring how AI affects problem understanding, strategy, team alignment, and decision quality across organizational contexts

5 sessions · 15 readings · 2 views

Curated by Ben Lorenzo

The Shape of Collaborationsession 1The Deskilling Bargainsession 2From Scores to Evidencesession 3The Social Generalization Problemsession 4The Evidence Thresholdsession 5

Opening

AI tools are moving from occasional assistants to embedded collaborators in coding, research, analysis, planning, and operational workflows. The important shift is not simply that models produce better answers. It is that they can now inspect codebases, execute analyses, coordinate tools, generate alternatives, and participate in decisions over many steps.

Recent technical work makes the effects look less uniform than the productivity narrative suggests. Anthropic reports that its engineers use AI across much of their work while still delegating relatively little outright; other research finds that AI can increase output while reducing immediate mastery of newly learned skills. Product design matters too: the same task can involve sustained human iteration in chat but near-total delegation inside a coding-agent workflow.

This creates a difficult measurement problem. Faster task completion may conceal weaker understanding, more verification work, declining expertise, or decisions that are easier to produce but harder to audit. Conversely, friction is not always a defect: asking users to clarify goals, inspect intermediate work, and compare alternatives may improve the quality of both the result and the thinking behind it.

The five sessions therefore move from human–AI interaction patterns, through cognition and skill formation, into evaluation, social generalization, and organizational safeguards. The central question is not whether AI is productive, but under what conditions it improves human and collective judgment rather than merely accelerating activity.

Five questions worth arguing about

  1. 1Does effective AI collaboration depend more on delegation skill, interface design, or the user’s underlying expertise?
  2. 2When does cognitive offloading become deskilling rather than leverage?
  3. 3Can evaluations measure improved understanding and decisions, or only successful task completion?
  4. 4How much of an AI tool’s value survives when teams, incentives, and social environments change?
  5. 5What evidence should organizations require before allowing AI to influence consequential decisions?

The Sessions

1Session 1start here

The Shape of Collaboration

The problem

The first problem is conceptual: what does it mean to “use AI” at work? A system that writes a draft after thirteen rounds of human direction is not equivalent to one that receives a single instruction and executes autonomously. Nor is either equivalent to a tool that helps a person explore work they would otherwise never attempt.

Anthropic’s internal workplace study offers an unusually concrete view of this distinction. It combines surveys, interviews, and usage data to show AI functioning less like a replacement worker than a continuously supervised collaborator. Engineers use it for debugging, codebase comprehension, and exploratory work, while retaining responsibility for tasks that are difficult to verify. The study also raises a social cost: greater AI collaboration may coincide with less collaboration with colleagues.

The Economic Index report approaches the same issue through product surfaces rather than interviews. Its comparison of chat, Cowork, and Claude Code suggests that interface and workflow architecture can alter autonomy even when the underlying model is held constant. The independent-research project complicates any simple autonomy scale by showing that productive friction—clarifying intent, pushing back, and iterating—can improve the interaction itself. These readings establish the mechanism the next session must examine more closely: what happens to human understanding when collaboration becomes delegation?

2Session 2The Deskilling Bargain3 readings3Session 3From Scores to Evidence3 readings4Session 4The Social Generalization Problem3 readings5Session 5The Evidence Threshold3 readings