AI System Behavioral Analysis

Understanding emergent behaviors in large-scale AI deployments

This project focuses on understanding how AI systems exhibit emergent behaviors when deployed at scale, particularly examining recommendation algorithms and content moderation systems. We use innovative methodologies including counterfactual experiments to causally estimate AI system effects.

Using computational methods to study AI system behavior and understand their impact on user experiences and societal outcomes.

Key research areas include:

  • Emergent behavior analysis in large-scale AI deployments
  • Counterfactual evaluation of AI system interventions
  • Cross-platform comparative studies of AI system effects
  • Long-term impact assessment of AI-mediated interactions

Our work addresses fundamental questions about the balance between user agency and algorithmic influence in shaping online experiences. Through rigorous experimental design, we aim to separate correlation from causation in AI system evaluation.

References

2024

  1. bots.png
    Causally estimating the effect of YouTube’s recommender system using counterfactual bots
    Homa Hosseinmardi, Amir Ghasemian, Miguel Rivera-Lanas, Manoel Horta Ribeiro, Robert West, and Duncan J Watts
    Proceedings of the National Academy of Sciences, 2024

2023

  1. moderation.png
    Deplatforming did not decrease Parler users’ activity on fringe social media
    Manoel Horta Ribeiro, Homa Hosseinmardi, Robert West, and Duncan J Watts
    PNAS nexus, 2023

2021

  1. ytpnas.jpg
    Examining the consumption of radical content on YouTube
    Homa Hosseinmardi, Amir Ghasemian, Aaron Clauset, Markus Mobius, David M Rothschild, and Duncan J Watts
    Proceedings of the National Academy of Sciences, 2021