Skip to main content
×
Home
    • Aa
    • Aa

Engineering the emergence of norms: a review

  • Chris Haynes (a1), Michael Luck (a1), Peter McBurney (a1), Samhar Mahmoud (a1), Tomáš Vítek (a1) and Simon Miles (a1)...
Abstract
Abstract

Complex systems often exhibit emergent behaviour, unexpected macro-level behaviour caused by the interaction of micro-level components. In multiagent systems, these micro-level components may be autonomous agents and the emergent behaviour may be expressed as norms—patterns of behaviour that arise among the agents in response to their environment and each other. These emergent norms may be beneficial (e.g. by encouraging cooperative behaviour), or detrimental, but in either case it is useful to recognize these norms as they emerge and either encourage or discourage their establishment. We term this process engineering the emergence of norms and have identified three steps: the identification of a possible norm, evaluation of its benefit and its encouragement (or discouragement). This paper is an attempt to provide a survey of existing research related to these steps. We also provide an analysis of the approaches based upon their suitability for a variety of normative systems: we examine the requirements for agents to have autonomy over their choice of norms, the degree of observability required in the system, and the norm enforcement methods. The paper concludes with an discussion of open issues.

Copyright
References
Hide All
AndrighettoG., CampenniM., CecconiF. & ConteR. 2010a. The complex loop of norm emergence: a simulation model. In Simulating Interacting Agents and Social Phenomena, Agent-Based Social Systems 7, Takadama K., Cioffi-Revilla C., Deffuant G. (eds). Springer, 19–35.
AndrighettoG., VillatoroD. & ConteR. 2010b. Norm internalization in artificial societies. AI Communications 23(4), 325339.
ArtikisA. 2009. Formalising dynamic protocols for open agent systems. In Proceedings of the Twelth International Conference on Artificial Intelligence and Law, ICAIL ’09, 68–77. ACM.
ArtikisA. 2012. Dynamic specification of open agent systems. Journal of Logic and Computation 22(6), 13011334.
AtzoriL., IeraA. & MorabitoG. 2010. The internet of things: a survey. Computer Networks 54(15), 27872805.
AxelrodR. 1986. An evolutionary approach to norms. The American Political Science Review 80(4), 10951111.
BalkeT., De VosM. & PadgetJ. 2012. Normative run-time reasoning for institutionally-situated BDI agents. In Coordination, Organizations, Institutions, and Norms in Agent System VII, Cranefield S., van Riemsdijk M.B., Vázquez-Salceda J., Noriega P. (eds). Springer, 129–148.
BedauM. A. 1997. Weak emergence. Noûs 31(s11), 375399.
BergerT., SchreinemachersP. & WoelckeJ. 2006. Multi-agent simulation for the targeting of development policies in less-favored areas. Agricultural Systems 88(1), 2843.
BettenhausenK. & MurnighanJ. K. 1985. The emergence of norms in competitive decision-making groups. Administrative Science Quarterly 25(4), 350372.
BicchieriC. 2006. The Grammar of Society: The Nature and Dynamics of Social Norms. Cambridge University Press.
BouE., López-SánchezM. & Rodrguez-AguilarJ. A. 2007. Towards self-configuration in autonomic electronic institutions. In Coordination, Organizations, Institutions, and Norms in Agent Systems II, Lecture Notes in Computer Science 4386, 229244. Springer.
BroughtonJ. 1990. Restraint Use by Car Occupants. Transport and Road Research Laboratory Research Report, 289.
BryantV. 1985. Metric Spaces. Cambridge University Press.
BunnD. W. & OliveiraF. S. 2001. Agent-based simulation: an application to the new electricity trading arrangements of England and Wales. IEEE Transactions on Evolutionary Computation 5(5), 493503.
Campillo-SanchezP. & Gomez-SanzJ. J. 2015. A framework for developing multi-agent systems in ambient intelligence scenarios. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, 1949–1950. International Foundation for Autonomous Agents and Multiagent Systems.
CasariM. & LuiniL. 2009. Cooperation under alternative punishment institutions: an experiment. Journal of Economic Behavior & Organization 71(2), 273282.
CastelfranchiC., ConteR. & PaolucciM. 1998. Normative reputation and the costs of compliance. Journal of Artificial Societies and Social Simulation 1(3), 3.
CastelfranchiC. & FalconeR. 1998. Principles of trust for MAS: cognitive anatomy, social importance, and quantification. In The Proceedings of the International Conference on Multi Agent Systems, 72–79. IEEE.
CastelfranchiC. & FalconeR. 2003. Founding autonomy: the dialectics between (social) environment and agent’s architecture and powers. In Agents and Computational Autonomy, Lecture Notes in Computer Science 2969, 4054. Springer.
ChenC.-C., NaglS. B. & ClackC. D. 2007. Specifying, detecting and analysing emergent behaviours in multi-level agent-based simulations. In Proceedings of the 2007 Summer Computer Simulation Conference, 969–976. Society for Computer Simulation International.
ChenC.-C., NaglS. B. & ClackC. D. 2009. A formalism for multi-level emergent behaviours in designed component-based systems and agent-based simulations. In From System Complexity to Emergent Properties, Aziz-Alaoui M.A., Bertelle C. (eds). Springer, 101–114.
ConteR. & CastelfranchiC. 1999. From conventions to prescriptions. Towards an integrated view of norms. Artificial Intelligence and Law 7(4), 323340.
CranefieldS., SavarimuthuB., MeneguzziF. & OrenN. 2015. A Bayesian approach to norm identification. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, 1743–1744. International Foundation for Autonomous Agents and Multiagent Systems.
CriadoN., ArgenteE. & BottiV. 2011. Open issues for normative multi-agent systems. AI Communications 24(3), 233264.
CriadoN., ArgenteE., NoriegaP. & BottiV. 2010. Towards a normative BDI architecture for norm compliance. In Proceedings of the Multi-Agent Logics, Languages, and Organisations Federated Workshops, 2010, 65–81.
DeguetJ., DemazeauY. & MagninL. 2006. Elements about the emergence issue: a survey of emergence definitions. Complexus 3(1–3), 2431.
DelgadoJ. 2002. Emergence of social conventions in complex networks. Artificial Intelligence 141(1), 171185.
DelgadoJ., PujolJ. M. & SangüesaR. 2003. Emergence of coordination in scale-free networks. Web Intelligence and Agent Systems 1, 131138.
De PelsmackerP. & JanssensW. 2007. The effect of norms, attitudes and habits on speeding behavior: scale development and model building and estimation. Accident Analysis & Prevention 39(1), 615.
DignumF., DignumV. & JonkerC. M. 2009. Towards agents for policy making. In Multi-Agent-Based Simulation IX, Lecture Notes in Computer Science 5269, 141153. Springer.
dos Santos NetoB. F., da SilvaV. T. & de LucenaC. J. P. 2012. An architectural model for autonomous normative agents. In Advances in Artificial Intelligence-SBIA 2012, Barros L. N., Finger M., Pozo A. T., Gimenénez-Lugo G. A, Castilho M. (eds). Springer, 152–161.
ElhagA. A., BreukerJ. A. & BrouwerP. W. 2000. On the formal analysis of normative conflicts. Information & Communications Technology Law 9(3), 207217.
EmonsW. 2007. Escalating penalties for repeat offenders. International Review of Law and Economics 27(2), 170178.
FailloM., GriecoD. & ZarriL. 2013. Legitimate punishment, feedback, and the enforcement of cooperation. Games and Economic Behavior 77(1), 271283.
FinnemoreM. & SikkinkK. 1998. International norm dynamics and political change. International Organization 52(04), 887917.
FitzekF. H. P. & KatzM. D. 2007. Cellular controlled peer to peer communications: overview and potentials. In Cognitive Wireless Networks, Fitzek F.H.P., Katz M.D. (eds). Springer, 31–59.
FranksH., GriffithsN. & JhumkaA. 2013. Manipulating convention emergence using influencer agents. Autonomous Agents and Multi-Agent Systems 26(3), 315353.
GalánJ. M. & IzquierdoL. R. 2005. Appearances can be deceiving: lessons learned re-implementing Axelrod’s ‘evolutionary approach to norms’. Journal of Artificial Societies and Social Simulation 8(3), 2.
GarlickM. & ChliM. 2009. The effect of social influence and curfews on civil violence. In Proceedings of the Eighth International Conference on Autonomous Agents and Multiagent Systems – Volume 2, 1335–1336. International Foundation for Autonomous Agents and Multiagent Systems.
GibbsJ. P. 1965. Norms: the problem of definition and classification. American Journal of Sociology 70(5), 586594.
GneezyU., MeierS. & Rey-BielP. 2011. When and why incentives (don’t) work to modify behavior. The Journal of Economic Perspectives 25(4), 191209.
GriffithsN. & LuckM. 2010. Changing neighbours: improving tag-based cooperation. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems: Volume 1, 249–256. International Foundation for Autonomous Agents and Multiagent Systems.
GünayA. & YolumP. 2013. Constraint satisfaction as a tool for modeling and checking feasibility of multiagent commitments. Applied Intelligence 39(3), 489509.
HartH. L. A. 2012. The Concept of Law. Oxford University Press.
HaynesC., MilesS. & LuckM. 2014. Monitoring the impact of norms upon organisational performance: a simulation approach. In Coordination, Organizations, Institutions, and Norms in Agent Systems IX, Lecture Notes in Computer Science 8386, 103119. Springer.
HoffmannM. J. 2005. Self-organized criticality and norm avalanches. In Proceedings of the Symposium on Normative Multi-Agent Systems, AISB05: Social Intelligence and Interaction in Animals, Robots and Agents, 117–125.
HollandJ. H. 1992. Complex adaptive systems. Daedalus 121(1), 1730.
HollanderC. D. & WuA. S. 2011. The current state of normative agent-based systems. Journal of Artificial Societies and Social Simulation 14(2), 6.
ItaiwiA. M. K., AhmadM. S., TangA. Y. C. & MahmoudM. A. 2014. A proposed norms’ benefits awareness framework for norms adoption. In International Conference on Information Technology and Multimedia, pages 287–292.
JosephS., SierraC. & SchorlemmerM. 2008. A coherence based framework for institutional agents. In Coordination, Organizations, Institutions, and Norms in Agent Systems III, Lecture Notes in Computer Science 4870, 287300. Springer.
KittockJ. E. 1994. Emergent conventions and the structure of multi-agent systems. In Lectures in Complex Systems: The Proceedings of the 1993 Complex Systems Summer School, Santa Fe Institute Studies in the Sciences of Complexity Lecture Volume VI, Santa Fe Institute, Nadel L. & Stein D. (eds). Addison-Wesley Publishing Company, 114.
KotsiantisS. & KanellopoulosD. 2006. Association rules mining: a recent overview. GESTS International Transactions on Computer Science and Engineering 32(1), 7182.
KubíkA. 2003. Toward a formalization of emergence. Artificial Life 9(1), 4165.
MahmoudM. A., AhmadM. S., AhmadA., YusoffM. Z. M. & MustaphaA. 2012a. A norms mining approach to norms detection in multi-agent systems. In International Conference on Computer Information Science, Volume 1, 458–463.
MahmoudS., BarakatL., MilesS., TaweelA., DelaneyB. & LuckM. 2014. Information-based incentivisation when rewards are inadequate. In ECAI, 591–596.
MahmoudS., GriffithsN., KeppensJ. & LuckM. 2010. An analysis of norm emergence in Axelrod’s model. In Proceedings of 8th European Workshop on Multi-Agent Systems.
MahmoudS., GriffithsN., KeppensJ. & LuckM. 2012b. Efficient norm emergence through experiential dynamic punishment. In Proceedings of the Twentieth European Conference on Artificial Intelligence, Volume 12, 576–581.
MahmoudS., GriffithsN., KeppensJ. & LuckM. 2013. Norm emergence through dynamic policy adaptation in scale free networks. In Coordination, Organizations, Institutions, and Norms in Agent Systems VIII, Aldewereld H. & Sichman J. (eds), Lecture Notes in Computer Science 7756, 123140. Springer Berlin Heidelberg.
MahmoudS., GriffithsN., KeppensJ., TaweelA., Bench-CaponT. J. & LuckM. 2015a. Establishing norms with metanorms in distributed computational systems. Artificial Intelligence and Law 23(4), 367407.
MahmoudS., MilesS., TaweelA., DelaneyB. & LuckM. 2015b. Norm establishment constrained by limited resources. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, 1819–1820. International Foundation for Autonomous Agents and Multiagent Systems.
MiceliT. J. & BucciC. 2005. A simple theory of increasing penalties for repeat offenders. Review of Law & Economics 1(1), 7180.
MillJ. S. 1863. Utilitarianism. Parker, Son and Bourn.
MintzbergH. & WatersJ. A. 1985. Of strategies, deliberate and emergent. Strategic Management Journal 6(3), 257272.
ModgilS., OrenN., FaciN., MeneguzziF., MilesS. & LuckM. 2015. Monitoring compliance with e-contracts and norms. Artificial Intelligence and Law 23(2), 161196.
MogulJ. C. 2006. Emergent (mis) behavior vs. complex software systems. ACM SIGOPS Operating Systems Review 40(4), 293304.
MoralesJ., Lopez-SanchezM., Rodriguez-AguilarJ. A., VasconcelosW. & WooldridgeM. 2015. Online automated synthesis of compact normative systems. ACM Transactions on Autonomous and Adaptive Systems 10(1), 2.
MungovanD., HowleyE. & DugganJ. 2011. The influence of random interactions and decision heuristics on norm evolution in social networks. Computational and Mathematical Organization Theory 17(2), 152178.
OrenN. & MeneguzziF. 2013. Norm identification through plan recognition. In Proceedings of the Workshop on Coordination, Organization, Institutions and Norms in Agent Systems (COIN 2013@ AAMAS).
ParunakH. V. D. & VanderBokR. S. 1997. Managing emergent behavior in distributed control systems. In Proceedings of ISA Tech'97, Instrument Society of America, 1–8.
RiveretR., ArtikisA., BusquetsD. & PittJ. 2014. Self-governance by transfiguration: from learning to prescriptions. In International Conference on Deontic Logic in Computer Science, 177–191. Springer.
SavarimuthuB. & CranefieldS. 2011. Norm creation, spreading and emergence: a survey of simulation models of norms in multi-agent systems. Multiagent and Grid Systems–An International Journal 7(1), 2154.
SavarimuthuB., CranefieldS., PurvisM. & PurvisM. 2008. Role model based mechanism for norm emergence in artificial agent societies. Coordination, Organizations, Institutions, and Norms in Agent Systems III 487, 203217.
SavarimuthuB., CranefieldS., PurvisM. & PurvisM. 2010. A data mining approach to identify obligation norms in agent societies. In Agents and Data Mining Interaction, Lecture Notes in Computer Science 5980, 4358. Springer.
SavarimuthuB., CranefieldS., PurvisM. & PurvisM. 2013a. Identifying prohibition norms in agent societies. Artificial Intelligence and Law 21(1), 146.
SavarimuthuB. & DamH. K. 2013. Towards mining norms in open source software repositories. In International Workshop on Agents and Data Mining Interaction, 26–39. Springer.
SavarimuthuB., PadgetJ. & PurvisM. 2013b. Social norm recommendation for virtual agent societies. In International Conference on Principles and Practice of Multi-Agent Systems, 308–323. Springer.
SavarimuthuB. T. R., CranefieldS., PurvisM. & PurvisM. 2007. Norm emergence in agent societies formed by dynamically changing networks. In Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 464–470.
SenO. & SenS. 2010. Effects of social network topology and options on norm emergence. In Coordination, Organizations, Institutions and Norms in Agent Systems V, Lecture Notes in Computer Science 6069, 211222. Springer.
SenS. & AiriauS. 2007. Emergence of norms through social learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, 1507–1512.
SensoyM., NormanT. J., VasconcelosW. W. & SycaraK. 2012. OWL-POLAR: a framework for semantic policy representation and reasoning. Web Semantics: Science, Services and Agents on the World Wide Web 12, 148160.
SethA. K. 2008. Measuring emergence via nonlinear Granger causality. Artificial Life 11, 545552.
ShohamY. & TennenholtzM. 1995. On social laws for artificial agent societies: off-line design. Artificial Intelligence 73(1–2), 231252.
ShohamY. & TennenholtzM. 1997. On the emergence of social conventions: modeling, analysis, and simulations. Artificial Intelligence 94(1), 139166.
SinghM. P. 2013. Norms as a basis for governing sociotechnical systems. ACM Transactions on Intelligent Systems and Technology (TIST) 5(1), 21.
SinghM. P., ArrottM., BalkeT., ChopraA. K., ChristiaanseR., CranefieldS., DignumF., EynardD., FarcasE., FornaraN. & GandonF. 2013. The uses of norms. In Normative Multi-Agent Systems, Volume 4, Andrighetto G., Governatori G., Noriega P. & van der Torre L. (eds). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, 191229.
SirinE., ParsiaB., GrauB. C., KalyanpurA. & KatzY. 2007. Pellet: a practical OWL-DL reasoner. Web Semantics: Science, Services and Agents on the World Wide Web 5(2), 5153.
SycaraK. P. 1998. Multiagent systems. AI magazine 19(2), 7992.
TinnemeierN., DastaniM. & MeyerJ.-J. 2010. Programming norm change. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: Volume 1, 957–964. International Foundation for Autonomous Agents and Multiagent Systems.
Van der AalstW. M. P., van DongenB. F., HerbstJ., MarusterL., SchimmG. & WeijtersA. J. M. M. 2003. Workflow mining: a survey of issues and approaches. Data & Knowledge Engineering 47(2), 237267.
VasconcelosW., KollingbaumM. J. & NormanT. J. 2007. Resolving conflict and inconsistency in norm-regulated virtual organizations. In Proceedings of the Sixth International Joint Conference on Autonomous Agents and Multiagent Systems, 632–639. ACM.
VasconcelosW. W., KollingbaumM. J. & NormanT. J. 2009. Normative conflict resolution in multi-agent systems. Autonomous Agents and Multi-Agent Systems 19(2), 124152.
VillatoroD., AndrighettoG., Sabater-MirJ. & ConteR. 2011a. Dynamic sanctioning for robust and cost-efficient norm compliance. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Volume 11, 414–419.
VillatoroD., Sabater-MirJ. & SenS. 2011b. Social instruments for robust convention emergence. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Volume 11, 420–425.
VillatoroD., SenS. & Sabater-MirJ. 2009. Topology and memory effect on convention emergence. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, 233–240. IEEE Computer Society.
WalkerA. & WooldridgeM. 1995. Understanding the emergence of conventions in multi-agent systems. In Proceedings of the First International Conference on Multiagent Systems, 384–389.
WolfT. D. & HolvoetT. 2005. Emergence versus self-organisation: different concepts but promising when combined. In Engineering Self-Organising Systems, Brueckner S., Serugendo G. D. M., Karageorgos A. & Nagpal R. (eds), Lecture Notes in Computer Science 3464, 7791. Springer.
y LópezF. L. & LuckM. 2004. A model of normative multi-agent systems and dynamic relationships. In Regulated Agent-Based Social Systems, Lindemann G., Moldt D. & Paolucci M. (eds), Lecture Notes in Computer Science 2934, 259280. Springer.
ZhangY. & LeezerJ. 2009. Emergence of social norms in complex networks. In Proceedings of the International Conference on Computational Science and Engineering, Volume 4, 549–555. IEEE.
ZimmermannM. G. & EguluzV. M. 2005. Cooperation, social networks, and the emergence of leadership in a prisoner’s dilemma with adaptive local interactions. Physical Review E 72(5), 056118.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The Knowledge Engineering Review
  • ISSN: 0269-8889
  • EISSN: 1469-8005
  • URL: /core/journals/knowledge-engineering-review
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 5
Total number of PDF views: 15 *
Loading metrics...

Abstract views

Total abstract views: 93 *
Loading metrics...

* Views captured on Cambridge Core between 22nd August 2017 - 20th October 2017. This data will be updated every 24 hours.