Incident 44: Machine Personal Assistants Failed to Maintain Social Norms
Entities
View all entitiesIncident Stats
CSETv1 Taxonomy Classifications
Taxonomy DetailsHarm Distribution Basis
none
Sector of Deployment
administrative and support service activities
CSETv0 Taxonomy Classifications
Taxonomy DetailsFull Description
From June to December 2000, researchers at the Information Sciences Institute (ISI) at the University of Southern California (USC) deployed a team of 12 software agents in their office to act as administrative assistants facilitating routine office operations. The agents, also known as Electronic Elves and nicknamed ‘Friday’, were designed to assist their human principal in scheduling meetings, facilitating informal meetings, auctioning group tasks, and ordering meals as a means to testing agent teamwork dynamics. During the experiment, the agents violated the privacy and social norms of the office by publishing their principal’s location information and revealing an employee value hierarchy used to deconflict meetings.
Short Description
During an experiment of software personal assistants at the Information Sciences Institute (ISI) at the University of Southern California (USC), researchers found that the assistants violated the privacy of their principals and were unable to respect the social norms of the office.
Severity
Negligible
Harm Type
Psychological harm
AI System Description
A team of software agents (agent organization) designed to facilate routine office operations, such as scheduling, informal collaboration, and meeting shared goals.
System Developer
University of Southern California Information Sciences Institute
Sector of Deployment
Administrative and support service activities
Relevant AI functions
Perception, Cognition
AI Techniques
Machine learning
AI Applications
decision support, resource optimization, personalization
Location
Marina del Rey, California
Named Entities
University of Southern California Information Sciences Institute
Technology Purveyor
University of Southern California Information Sciences Institute
Beginning Date
6/2000
Ending Date
12/2000
Near Miss
Near miss
Intent
Accident
Lives Lost
No
Data Inputs
Schedule data, cellphone GPS data
Incident Reports
Reports Timeline
- View the original report at its source
- View the report at the Internet Archive
Abstract: Software personal assistants continue to be a topic of significant research interest. This article outlines some of the important lessons learned from a successfully deployed team of personal assistant agents (Electric Elves) in a…
Variants
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
Similar Incidents
Did our AI mess up? Flag the unrelated incidents