Skip to main content
×
×
Home

Reputation assessment: a review and unifying abstraction

  • Phillip Taylor (a1), Lina Barakat (a2), Simon Miles (a2) and Nathan Griffiths (a1)
Abstract

Trust and reputation allow agents to make informed decisions about potential interactions. Trust in an agent is derived from direct experience with that agent, while reputation is determined by the experiences reported by other witness agents with potentially differing viewpoints. These experiences are typically aggregated in a trust and reputation model, of which there are several types that focus on different aspects. Such aspects include handling subjective perspectives of witnesses, dishonesty, or assessing the reputation of new agents. In this paper, we distil reputation systems into their fundamental aspects, discussing first how trust and reputation information is represented and second how it is disseminated among agents. Based on these discussions, a unifying abstraction is presented for trust and reputation systems, which is demonstrated by instantiating it with a broad range of reputation systems found in the literature. The abstraction is then instantiated to combine the range of capabilities of existing reputation systems in the Machine Learning Reputation System, which is evaluated using a marketplace simulation.

Copyright
References
Hide All
Aref, A. M. & Tran, T. T. 2015. A decentralized trustworthiness estimation model for open, multiagent systems (DTMAS). Journal of Trust Management 2(1), 1.
Artz, D. & Gil, Y. 2007. A survey of trust in computer science and the semantic web. Web Semantics: Science, Services and Agents on the World Wide Web 5(2), 5871.
Ashri, R., Ramchurn, S. D., Sabater, J., Luck, M. & Jennings, N. R. 2005. Trust evaluation through relationship analysis. In Proceedings of the 4th International Joint Conference on Autonomous Agents and Multiagent Systems, 1005–1011. ACM.
Breiman, L. 1996. Bagging predictors. Machine Learning 24(2), 123140.
Breiman, L. 2001. Random forests. Machine Learning 45(1), 532.
Burnett, C., Norman, T. J. & Sycara, K. 2010. Bootstrapping trust evaluations through stereotypes. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems, 241–248.
Burnett, C., Norman, T. & Sycara, K. 2013. Stereotypical trust and bias in dynamic multiagent systems. ACM Transactions on Intelligent Systems and Technology 4(2), 26.
Fang, H., Zhang, J., Şensoy, M. & Thalmann, N. 2012. A generalized stereotypical trust model. In 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications, 698–705.
Griffiths, N. 2006. Enhancing peer-to-peer collaboration using trust. Expert Systems with Applications 31(4), 849858.
Hendrikx, F., Bubendorfer, K. & Chard, R. 2015. Reputation systems: a survey and taxonomy. Journal of Parallel and Distributed Computing 75, 184197.
Ho, T. K. 1998. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(8), 832844.
Hoelz, B. W. P. & Ralha, C. G. 2015. Towards a cognitive meta-model for adaptive trust and reputation in open multi-agent systems. Autonomous Agents and Multi-Agent Systems 29(6), 11251156.
Huynh, T. D., Jennings, N. R. & Shadbolt, N. R 2004. FIRE: An integrated trust and reputation model for open multi-agent systems. In 16th European Conference on Artificial Intelligence, 18–22.
Huynh, T. D., Jennings, N. R. & Shadbolt, N. R. 2006. An integrated trust and reputation model for open multi-agent systems. Autonomous Agents and Multi-Agent Systems 13(2), 119154.
Jøsang, A. & Ismail, R. 2002. The Beta reputation system. In Proceedings of the 15th Bled Electronic Commerce Conference, 41–55.
Jøsang, A., Ismail, R. & Boyd, C. 2007. A survey of trust and reputation systems for online service provision. Decision Support Systems 43(2), 618644.
Kinateder, M., Baschny, E. & Rothermel, K. 2005. Towards a generic trust model–comparison of various trust update algorithms. In International Conference on Trust Management, 177–192. Springer.
Koster, A., Sabater-Mir, J. & Schorlemmer, M. 2012. Personalizing communication about trust. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems, 517–524.
Koster, A., Schorlemmer, M. & Sabater-Mir, J. 2012. Engineering trust alignment: theory, method and experimentation. International Journal of Human-Computer Studies 70, 450473.
Liu, X. & Datta, A. 2012. Modeling context aware dynamic trust using hidden Markov model. In Proceedings of the 26th AAAI Conference on Artificial Intelligence , AAAI’12, 1938–1944.
Liu, X., Datta, A. & Rzadca, K. 2013. Trust beyond reputation: a computational trust model based on stereotypes. Electronic Commerce Research and Applications 12, 2439.
Liu, X., Datta, A., Rzadca, K. & Lim, E.-P. 2009. StereoTrust: a group based personalized trust model. In Proceedings of the 18th ACM Conference on Information and Knowledge Management, 7–16. ACM.
Liu, X., Kaszuba, T., Nielek, R., Datta, A. & Wierzbicki, A. 2010. Using stereotypes to identify risky transactions in internet auctions. In 2010 IEEE Second International Conference on Social Computing, 513–520.
Liu, X., Tredan, G. & Datta, A. 2014. A generic trust framework for large-scale open systems using machine learning. Computational Intelligence 30(4), 700721.
Marsh, S. 1994. Trust in Distributed Artificial Intelligence. Springer, pages, 94112.
Miles, S. & Griffiths, N. 2015a. Incorporating mitigating circumstances into reputation assessment. In Proceedings of the 2nd International Workshop on Multiagent Foundations of Social Computing.
Miles, S. & Griffiths, N. 2015b. Accounting for circumstances in reputation assessment. In Proceedings of the 14th International Conference on Autonomous Agents and Multiagent Systems, 1653–1654.
Muller, T., Liu, Y. & Zhang, J. 2015. The fallacy of endogenous discounting of trust recommendations. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, 563–572.
Quinlan, R. J. 1992. Learning with continuous classes. In 5th Australian Joint Conference on Artificial Intelligence, 343–348. World Scientific.
Regan, K., Poupart, P. & Cohen, R. 2006. Bayesian reputation modeling in e-marketplaces sensitive to subjectivity, deception and change. In Proceedings of the National Conference on Artificial Intelligence, 1206–1212.
Sabater, J. & Sierra, C. 2001a. Regret: a reputation model for gregarious societies. In 4th Workshop on Deception Fraud and Trust in Agent Societies, 61–69.
Sabater, J. & Sierra, C. 2001b. Social regret, a reputation model based on social relations. ACM SIGecom Exchanges 3(1), 4456.
Schillo, M., Funk, P. & Rovatsos, M. 2000. Using trust for detecting deceitful agents in artificial societies. Applied Artificial Intelligence 14(8), 825848.
Şensoy, M., Zhang, J., Yolum, P. & Cohen, R. 2009. Poyraz: context-aware service selection under deception. Computational Intelligence 25(4), 335366.
Şensoy, M., Yilmaz, B. & Norman, T. J. 2016. STAGE: stereotypical trust assessment through graph extraction. Computational Intelligence 32(1), 72101.
Taylor, P., Griffiths, N., Barakat, L. & Miles, S. 2017a. Stereotype reputation with limited observability. In 19th International Workshop on Trust in Agent Societies.
Taylor, P., Griffiths, N., Barakat, L. & Miles, S. 2017b. Bootstrapping trust with partial and subjective observability. In Proceedings of the 16th Conference on Autonomous Agents and Multiagent Systems.
Teacy, L., Patel, J., Jennings, N. & Luck, M. 2005. Coping with inaccurate reputation sources: experimental analysis of a probabilistic trust model. In Proceedings of the 4th International Joint Conference on Autonomous Agents and Multiagent Systems, 997–1004.
Teacy, L., Luck, M., Rogers, A. & Jennings, N. 2012. An efficient and versatile approach to trust and reputation using hierarchical Bayesian modelling. Artificial Intelligence 193, 149185.
Urbano, J., Rocha, A. P. & Oliveira, E. C. 2010. Refining the trustworthiness assessment of suppliers through extraction of stereotypes. In Proceedings of the International Conference on Enterprise Information Systems, 85–92.
Vogiatzis, G., MacGillivray, I. & Chli, M. 2010. A probabilistic model for trust and reputation. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1, 1, 225–232. International Foundation for Autonomous Agents and Multiagent Systems.
Whitby, A., Jøsang, A. & Indulska, J. 2004. Filtering out unfair ratings in Bayesian reputation systems. In Proceedings of the 7th International Workshop on Trust in Agent Societies, 6, 106–117.
Witten, I., Frank, E. & Hall, M. 2011. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann.
Wooldridge, M. 2009. An Introduction to Multiagent Systems. John Wiley & Sons.
Yu, H., Shen, Z., Leung, C., Miao, C. & Lesser, V. 2013. A survey of multi-agent trust management systems. IEEE Access 1, 3550.
Zacharia, G. & Maes, P. 2000. Trust management through reputation mechanisms. Applied Artificial Intelligence 14(9), 881907.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The Knowledge Engineering Review
  • ISSN: 0269-8889
  • EISSN: 1469-8005
  • URL: /core/journals/knowledge-engineering-review
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 1
Total number of PDF views: 10 *
Loading metrics...

Abstract views

Total abstract views: 109 *
Loading metrics...

* Views captured on Cambridge Core between 12th June 2018 - 22nd August 2018. This data will be updated every 24 hours.