Skip to main content
×
Home

A probabilistic logic programming event calculus

  • ANASTASIOS SKARLATIDIS (a1) (a2), ALEXANDER ARTIKIS (a1), JASON FILIPPOU (a1) (a3) and GEORGIOS PALIOURAS (a1)
Abstract
Abstract

We present a system for recognising human activity given a symbolic representation of video content. The input of our system is a set of time-stamped short-term activities (STA) detected on video frames. The output is a set of recognised long-term activities (LTA), which are pre-defined temporal combinations of STA. The constraints on the STA that, if satisfied, lead to the recognition of an LTA, have been expressed using a dialect of the Event Calculus. In order to handle the uncertainty that naturally occurs in human activity recognition, we adapted this dialect to a state-of-the-art probabilistic logic programming framework. We present a detailed evaluation and comparison of the crisp and probabilistic approaches through experimentation on a benchmark dataset of human surveillance videos.

    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      A probabilistic logic programming event calculus
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about sending content to Dropbox.

      A probabilistic logic programming event calculus
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about sending content to Google Drive.

      A probabilistic logic programming event calculus
      Available formats
      ×
Copyright
References
Hide All
Allen J. 1983. Maintaining knowledge about temporal intervals. Communications of the ACM 26, 11, 832843.
Artikis A., Sergot M. and Paliouras G. 2010. A logic programming approach to activity recognition. In Proceedings of ACM Workshop on Events in Multimedia. ACM, New York, NY, USA, 38.
Artikis A., Sergot M. and Paliouras G. 2012. Run-time composite event recognition. In Proceedings of International Conference on Distributed Event-Based Systems (DEBS). Bry F., Paschke A., Eugster P. T., Fetzer C. and Behrend A., Eds. ACM, New York, NY, USA, 6980.
Artikis A., Skarlatidis A., Portet F. and Paliouras G. 2012. Logic-based event recognition. Knowledge Engineering Review 27, 469506.
Biswas R., Thrun S. and Fujimura K. 2007. Recognizing activities with multiple cues. In Proceedings of Workshop on Human Motion, Elgammal A. M., Rosenhahn B. and Klette R., Eds. LNCS, vol. 4814. Springer, 255270.
Brand M., Oliver N. and Pentland A. 1997. Coupled hidden Markov models for complex action recognition. In Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR). Plummer D. and Tonvick I., Eds. IEEE Computer Society, Los Alamitos, CA, USA, 994999.
Brendel W., Fern A. and Todorovic S. 2011. Probabilistic event logic for interval-based event recognition. In Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 33293336.
Bruynooghe M., Mantadelis T., Kimmig A., Gutmann B., Vennekens J., Janssens G. and De Raedt L. 2010. ProbLog technology for inference in a probabilistic first order logic. In Proceedings of European Conference on Artificial Intelligence (ECAI). Coelho H., Studer R. and Wooldridge M., Eds. IOS Press, 719724.
Bryant R. 1986. Graph-based algorithms for Boolean function manipulation. IEEE Transactions on Computers 35, 8, 677691.
Cugola G. and Margara A. 2011. Processing flows of information: From data stream to complex event processing. ACM Computing Surveys 44, 3.
Dousson C. and Maigat P. L. 2007. Chronicle recognition improvement using temporal focusing and hierarchisation. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI). Veloso M. M., Ed. 324–329.
Fierens D., den Broeck G. V., Thon I., Gutmann B. and De Raedt L. 2011. Inference in probabilistic logic programs using weighted CNF's. In Proceedings of International Conference on Uncertainty in Artificial Intelligence (UAI). Cozman F. G. and Pfeffer A., Eds. AUAI Press, 211220.
Gibson J. 1979. The ecological approach to visual perception. Houghton Mifflin, Boston.
Ginsberg M. L. 1990. Bilattices and modal operators. Journal of Logic and Computation 1, 141.
Gong S. and Xiang T. 2003. Recognition of group activities using dynamic probabilistic networks. In Proceedings of International Conference on Computer Vision. IEEE Computer Society, Los Alamitos, CA, USA, 742749.
Hakeem A. and Shah M. 2007. Learning, detection and representation of multi-agent events in videos. Artificial Intelligence 171, 8–9, 586605.
Helaoui R., Niepert M. and Stuckenschmidt H. 2011. Recognizing interleaved and concurrent activities: A statistical-relational approach. In Proceedings of International Conference on Pervasive Computing and Communications. IEEE Press, New York, NY, USA, 19.
Hongeng S. and Nevatia R. 2003. Large-scale event detection using semi-Hidden Markov Models. In Proceedings of International Conference on Computer Vision. IEEE Computer Society, Los Alamitos, CA, USA, 14551462.
Kembhavi A., Yeh T. and Davis L. S. 2010. Why did the person cross the road (there)? scene understanding using probabilistic logic models and common sense reasoning. In Proceedings of European Conference on Computer Vision (ECCV). Daniilidis K., Maragos P. and Paragios N., Eds. Springer Berlin Heidelberg, 693706.
Kimmig A., Demoen B., De Raedt L., Costa V. S. and Rocha R. 2011. On the implementation of the probabilistic logic programming language ProbLog. Theory and Practice of Logic Programming 11, 235262.
Kosmopoulos D., Antonakaki P., Valasoulis K., Kesidis A. and Perantonis S. 2008. Human behaviour classification using multiple views. In Proceedings of Hellenic Conference on Artificial Intelligence, vol. 5138. Darzentas J., Vouros G., Vosinakis S. and Arnellos A., Eds. Springer Berlin Heidelberg.
Kowalski R. and Sergot M. 1986. A logic-based calculus of events. New Generation Computing 4, 1, 6796.
Lafferty J. D., McCallum A. and Pereira F. C. N. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of International Conference on Machine Learning (ICML), Brodley C. E. and Danyluk A. P., Eds. Morgan Kaufmann, San Francisco, CA, USA, 282289.
Liao L., Fox D. and Kautz H. 2007. Hierarchical conditional random fields for GPS-based activity recognition. Robotics Research 28, 487506.
Luckham D. 2002. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Professional, Indianapolis, Indiana, USA.
Moldovan B., Moreno P., van Otterlo M., Santos-Victor J. and De Raedt L. 2012. Learning relational affordance models for robots in multi-object manipulation tasks. In Proceedings of International Conference on Robotics and Automation (ICRA). IEEE Computer Society, Los Alamitos, CA, USA, 43734378.
Morariu V. I. and Davis L. S. 2011. Multi-agent event recognition in structured scenarios. In Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 32893296.
Murphy K. 2002. Dynamic Bayesian Networks: Representation, Inference and Learning. PhD thesis, University of California.
Natarajan P. and Nevatia R. 2007. Hierarchical multi-channel semi Hidden Markov Models. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 25622567.
Rabiner L. and Juang B. 1986. An introduction to Hidden Markov Models. ASSP Magazine 3, 1, 416.
Richardson M. and Domingos P. 2006. Markov logic networks. Machine Learning 62, 1–2, 107136.
Sadilek A. and Kautz H. 2012. Location-based reasoning about complex multi-agent behavior. Journal of Artificial Intelligence Research 43, 87133.
Selman J., Amer M., Fern A. and Todorovic S. 2011. PEL-CNF: Probabilistic event logic conjunctive normal form for video interpretation. In Computer Vision Workshops. IEEE Computer Society, Los Alamitos, CA, USA, 680687.
Shet V., Harwood D. and Davis L. 2005. VidMAP: Video monitoring of activity with Prolog. In Proceedings of International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE Computer Society, Los Alamitos, CA, USA, 224229.
Shet V., Neumann J., Ramesh V. and Davis L. 2007. Bilattice-based logical reasoning for human detection. In Proceedings of International Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 18.
Siskind J. 2001. Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic. Journal of Artificial Intelligence Research 15, 3190.
Skarlatidis A., Paliouras G., Vouros G. A. and Artikis A. 2011. Probabilistic event calculus based on Markov logic networks. In RuleML America. Olken F., Palmirani M. and Sottara D., Eds. Springer Berlin Heidelberg, 155170.
Tran S. D. and Davis L. S. 2008. Event modeling and recognition using Markov logic networks. In Proceedings of European Conference on Computer Vision (ECCV). Forsyth D. A., Torr P. H. S. and Zisserman A., Eds. Springer Berlin Heidelberg, 610623.
Vail D., Veloso M. and Lafferty J. 2007. Conditional random fields for activity recognition. In Proceedings of International Conference on Autonomous Agents and Multiagent Systems (AAMAS). ACM, New York, NY, USA, 18.
Valiant L. G. 1979. The complexity of enumeration and reliability problems. SIAM Journal on Computing 8, 410421.
Wang J. and Domingos P. 2008. Hybrid Markov logic networks. In Proceedings of Conference on Artificial Intelligence (AAAI). Fox D. and Gomes C. P., Eds. AAAI Press, Menlo Park, California, USA, 11061111.
Wu T., Lian C. and Hsu J. 2007. Joint recognition of multiple concurrent activities using factorial conditional random fields. In Proceedings of AAAI Workshop on Plan, Activity, and Intent Recognition. AAAI Press, Menlo Park, California, USA.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Theory and Practice of Logic Programming
  • ISSN: 1471-0684
  • EISSN: 1475-3081
  • URL: /core/journals/theory-and-practice-of-logic-programming
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 65 *
Loading metrics...

Abstract views

Total abstract views: 219 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 21st November 2017. This data will be updated every 24 hours.