Skip to main content Accessibility help
×
Home

Invited review: Big Data in precision dairy farming

  • C. Lokhorst (a1) (a2), R. M. de Mol (a1) and C. Kamphuis (a1)

Abstract

Insight into current scientific applications of Big Data in the precision dairy farming area may help us to understand the inflated expectations around Big Data. The objective of this invited review paper is to give that scientific background and determine whether Big Data has overcome the peak of inflated expectations. A conceptual model was created, and a literature search in Scopus resulted in 1442 scientific peer reviewed papers. After thorough screening on relevance and classification by the authors, 142 papers remained for further analysis. The area of precision dairy farming (with classes in the primary chain (dairy farm, feed, breed, health, food, retail, consumer) and levels for object of interest (animal, farm, network)), the Big Data-V area (with categories on Volume, Velocity, Variety and other V’s) and the data analytics area (with categories in analysis methods (supervised learning, unsupervised learning, semi-supervised classification, reinforcement learning) and data characteristics (time-series, streaming, sequence, graph, spatial, multimedia)) were analysed. The animal sublevel, with 83% of the papers, exceeds the farm sublevel and network sublevel. Within the animal sublevel, topics within the dairy farm level prevailed with 58% over the health level (33%). Within the Big Data category, the Volume category was most favoured with 59% of the papers, followed by 37% of papers that included the Variety category. None of the papers included the Velocity category. Supervised learning, representing 87% of the papers, exceeds unsupervised learning (12%). Within supervised learning, 64% of the papers dealt with classification issues and exceeds the regression methods (36%). Time-series were used in 61% of the papers and were mostly dealing with animal-based farm data. Multimedia data appeared in a greater number of recent papers. Based on these results, it can be concluded that Big Data is a relevant topic of research within the precision dairy farming area, but that the full potential of Big Data in this precision dairy farming area is not utilised yet. However, the present authors expect the full potential of Big Data, within the precision dairy farming area, will be reached when multiple Big Data characteristics (Volume, Variety and other V’s) and sources (animal, groups, farms and chain parts) are used simultaneously, adding value to operational and strategic decision.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Invited review: Big Data in precision dairy farming
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Invited review: Big Data in precision dairy farming
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Invited review: Big Data in precision dairy farming
      Available formats
      ×

Copyright

This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike licence (http://creativecommons.org/licenses/by-nc-sa/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is included and the original work is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use.

Corresponding author

References

Hide All
Animal Task Force 2014. Research and innovation for a competitive and sustainable animal production in Europe; recommended priorities for support under Horizon 2020 in the 2016/17 work programme. Retrieved on 4 August 2017 from http://www.animaltaskforce.eu/Portals/0/ATF/horizon2020/1st%20Addendum%20ATF%20White%20Paper_final(2014)%20.pdf.
Bahr, C, Bruininx, E and van den Belt, A 2016. Nutrition, sensors and genetics – a data driven smart feeding approach by Agrifirm. In Precision dairy farming 2016 (ed. C Kamphuis and W Steeneveld), June 2016, Leeuwarden, The Netherlands, pp. 4953. Wageningen Academic Publishers, Wageningen, The Netherlands.
Berckmans, D and Keita, A (eds.) 2017. Precision livestock farming ‘17 - Papers presented at the 8th European Conference on Precision Livestock Farming, September 2017, Nantes, France.10.21820/23987073.2017.1.4
Berckmans, D and Vandermeulen, J (eds.) 2013. Precision livestock farming ‘13 - Papers presented at the 6th European Conference on Precision Livestock Farming, September 2013, Leuven, Belgium.
Brotzman, RL, Cook, NB, Nordlund, K, Bennett, TB, Gomez Rivas, A and Döpfer, D 2015. Cluster analysis of dairy herd improvement data to discover trends in performance characteristics in large upper midwest dairy herds. Journal of Dairy Science 98, 30593070.10.3168/jds.2014-8369
Caccamo, M, Guarnera, GC, Licitra, G, Azzaro, G, Petriglieri, R and Gallo, G 2015. Estimation of cow’s body condition score through statistical shape analysis and regression machines from images acquired using low-cost digital cameras. In Proceedings of the 7th European Conference on Precision Livestock Farming, September 2015, Milan, Italy, pp. 370–378.
Caja, G, Castro-Costa, A and Knight, CH 2016. Engineering to support wellbeing of dairy animals. Journal of Dairy Research 83, 136147.10.1017/S0022029916000261
Caraviello, DZ, Weigel, KA, Craven, M, Gianola, D, Cook, NB, Nordlund, KV, Fricke, PM and Wiltbank, MC 2006. Analysis of reproductive performance of lactating cows on large dairy farms using machine learning algorithms. Journal of Dairy Science 89, 47034722.10.3168/jds.S0022-0302(06)72521-8
Cole, JB, Newman, S, Foertter, F, Aguilar, I and Coffey, M 2012. Breeding and genetics symposium: Really big data: processing and analysis of very large data sets. Journal of Animal Science 90, 723733.10.2527/jas.2011-4584
Dawson, PM, Werkman, M, Brooks-Pollock, E and Tildesley, MJ 2015. Epidemic predictions in an imperfect world: modelling disease spread with partial data. Proceedings of the Royal Society B: Biological Sciences 282, 19.10.1098/rspb.2015.0205
De Mauro, A, Greco, M and Grimaldi, M 2016. A formal definition of Big Data based on its essential features. Library Review 65, 122135.10.1108/LR-06-2015-0061
De Mol, RM, Ipema, AH, Roelofs, RMG, MAJM, Lamers and Odinga, K 2007. An internet application for oestrus and mastitis detection in dairy cows. In Precision Livestock Farming ‘07 – Papers presented at the 3rd European Conference on Precision Livestock Farming (ed. S. Cox), June 2007, Skiathos, Greece, pp. 261–267. Wageningen Academic Publishers, Wageningen, The Netherlands.
Devlin, B 2012. The Big Data zoo – taming the beasts: the need for an integrated platform for enterprise information. Retrieved on 4 August 2017 from http://docs.media.bitpipe.com/io_10x/io_108041/item_630961/big%20data%20zoo.pdf.
Dias, KM, Garcia, SG and Clark, CEF 2016. Creating value of data: milking order and its role in future precision dairy feeding systems. In Precision Dairy Farming 2016 (ed. C Kamphuis and W Steeneveld), 21–23 June 2016, in Leeuwarden, The Netherlands, pp. 383385. Wageningen Academic Publishers, Wageningen, The Netherlands.
Fenn, J and Raskino, M 2008. Mastering the hype cycle: how to choose the right innovation at the right time. Harvard Business Press, Cambridge, MA, USA.
Fischer, A, Luginbühl, T, Delattre, L, Delouard, JM and Faverdin, P 2015. Rear shape in 3 dimensions summarized by principal component analysis is a good predictor of body condition score in Holstein dairy cows. Journal of Dairy Science 98, 44654476.10.3168/jds.2014-8969
Garcia, AB 2013. The use of data mining techniques to discover knowledge from animal and food data: examples related to the cattle industry. Trends in Food Science and Technology 29, 151157.10.1016/j.tifs.2012.10.004
Gargiulo, GD, Shephard, RW, Tapson, J, McEwan, AL, Bifulco, P, Cesarelli, M, Jin, C, Al-Ani, A, Wang, N and van Schaik, A 2012. Pregnancy detection and monitoring in cattle via combined foetus electrocardiogram and phonocardiogram signal processing. BMC Veterinary Research 8, 164.10.1186/1746-6148-8-164
Graunke, KL, Nürnberg, G, Repsilber, D, Puppe, B and Langbein, J 2013. Describing temperament in an ungulate: a multidimensional approach. PLoS One 8, e74579.10.1371/journal.pone.0074579
Guarino, M and Berckmans, D (eds.) 2015. Precision Livestock Farming ‘15 - Papers presented at the 7th European Conference on Precison Livestock Farming, September 2015, Milan, Italy.
Guzhva, O, Ardö, H, Herlin, A, Nilsson, M, Aström, K and Bergsten, C 2015. Automatic detection of social interactions in the waiting area of automatic milking stations using a video surveillance system. In Proceedings of the 7th European Conference on Precision Livestock Farming, September 2015, Milan, Italy, pp. 681–688.
Guzhva, O, Ardö, H, Herlin, A, Nilsson, M, Åström, K and Bergsten, C 2016. Feasibility study for the implementation of an automatic system for the detection of social interactions in the waiting area of automatic milking stations by using a video surveillance system. Computers and Electronics in Agriculture 127, 506509.10.1016/j.compag.2016.07.010
Harty, E and Healy, J 2016. Using big data and advanced analytics top optimise health and fertility. In Precision dairy farming 2016 (ed. C Kamphuis and W Steeneveld), 21–23 June 2016, Leeuwarden, The Netherlands, pp. 219222. Wageningen Academic Publishers, Wageningen, The Netherlands.
Hermans, K, Waegeman, W, Opsomer, G, van Ranst, B, de Koster, J, van Eetvelde, M and Hostens, M 2017. Novel approaches to assess the quality of fertility data stored in dairy herd management software. Journal of Dairy Science 100, 40784089.10.3168/jds.2016-11896
Homburger, H, Schneider, MK, Hilfiker, S and Lüscher, A 2014. Inferring behavioral states of grazing livestock from high-frequency position data alone. PLoS One 9, e114522.10.1371/journal.pone.0114522
Kamphuis, C and Steeneveld, W (eds.) 2016. Precision dairy farming 2016. Wageningen Academic Publishers, Wageningen, The Netherlands.10.3920/978-90-8686-829-2
Kayano, M and Kida, K 2015. Identifying alterations in metabolic profiles of dairy cows over the past two decades in Japan using principal component analysis. Journal of Dairy Science 98, 87648774.10.3168/jds.2015-9791
Kempenaar, C, Lokhorst, C, Bleumer, EJB, Veerkamp, RF, Been, T, van Evert, FK, Boogaardt, MJ, Ge, L, Wolfert, J, Verdouw, CN, van Bekkum, M, Feldbrugge, L, Verhoosel, JPC, van der Waaij, BD, van Persie, M and Noorbergen, H 2016. Big Data analysis for smart farming: results of TO2 project in theme food security. Wageningen University & Research, Wageningen, The Netherlands.
Khoramshahi, E, Yun, J, Hietaoja, J, Valros, A and Pastell, M 2013. Automatic sow pattern detection in videos: an AI approach. In Proceedings of the 6th European Conference on Precision Livestock Farming, September 2013, Leuven, Belgium, pp. 370–378.
Lacroix, R, Salehi, F, Yang, XZ and Wade, KM 1997. Effects of data preprocessing on the performance of artificial neural networks for dairy yield prediction and cow culling classification. Transactions of the American Society of Agricultural Engineers 40, 839846.10.13031/2013.21294
Laney, D 2001. 3D data management: controlling data volume, velocity, and variety. Retrieved on 4 August 2017 from http://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf.
Lohr, S 2013. The origins of Big Data’: an etymological detective story. Retrieved on 4 August 2017 from https://bits.blogs.nytimes.com/2013/02/01/the-origins-of-big-data-an-etymological-detective-story/.
Lokhorst, C, Kroeze, GH, van der Berg, JV, Blok, B and de Vries, F 1999. Datamining for knowledge discovery in dutch dairy databases. In Proceedings of the Second European Conference of the European Federation for lnformation on Perspectives of Modern Information and Communication Systems in Agriculture, Food Production and Environmental Control, Technology in Agriculture, Food and the Environment, EFITA (ed. G Schiefer, R Helbig and U Rockert), September 1999, Bonn, Germany, volume B, pp. 533–540. Universität Bonn-ILB, Bonn, Germany.
Martinez-Ortiz, C, Everson, R and Mottram, T 2013. Video tracking of dairy cows for assessing mobility scores. In Proceedinfgs of the 6th European Conference on Precision Livestock Farming, September 2013, Leuven, Belgium, pp. 154–162.
McQueen, RJ, Garner, SR, Nevill-Manning, CG and Witten, IH 1995. Applying machine learning to agricultural data. Computers and Electronics in Agriculture 12, 275293.
Mottram, T 2016. Animal board invited review: precision livestock farming for dairy cows with a focus on oestrus detection. Animal 10, 15751584.
Moya, D, Silasi, R, McAllister, TA, Genswein, B, Crowe, T, Marti, S and Schwartzkopf-Genswein, KS 2015. Use of pattern recognition techniques for early detection of morbidity in receiving feedlot cattle. Journal of Animal Science 93, 36233638.
Murthy, P, Bharadwai, A, Subrahmanyam, PA, Roy, A and Rajan, S 2014. Big Data taxonomy. Retrieved on 4 August 2017 from https://cloudsecurityalliance.org/research/big-data/.
Nadimi, ES, Jørgensen, RN, Blanes-Vidal, V and Christensen, S 2012. Monitoring and classifying animal behavior using ZigBee-based mobile ad hoc wireless sensor networks and artificial neural networks. Computers and Electronics in Agriculture 82, 4454.
Nielen, M, Schukken, YH, Brand, A, Haring, S and Ferwerda-van Zonneveld, RT 1995. Comparison of analysis techniques for on-line detection of clinical mastitis. Journal of Dairy Science 78, 10501061.
Nohuddin, PNE, Coenen, F, Christley, R and Setzkorn, C 2010. Detecting temporal pattern and cluster changes in social networks: a study focusing UK cattle movement database. In Proceedings of the 6th IFIP International Conference on Intelligent Information Processing, 13–16 October 2010, Manchester, UK, pp. 163–172.
Ortiz-Pelaez, A and Pfeiffer, DU 2008. Use of data mining techniques to investigate disease risk classification as a proxy for compromised Biosecurity of cattle herds in Wales. BMC Veterinary Research 4, 2440.
Rutten, CJ, Velthuis, AGJ, Steeneveld, W and Hogeveen, H 2013. Invited review: Sensors to support health management on dairy farms. Journal of Dairy Science 96, 19281952.
Schultz, KK, Bennett, TB, Nordlund, KV, Döpfer, D and Cook, NB 2016. Exploring relationships between dairy herd improvement monitors of performance and the transition cow index in Wisconsin dairy herds. Journal of Dairy Science 99, 75067516.
Shahriar, MS, Smith, D, Rahman, A, Freeman, M, Hills, J, Rawnsley, R, Henry, D and Bishop-Hurley, G 2016. Detecting heat events in dairy cows using accelerometers and unsupervised learning. Computers and Electronics in Agriculture 128, 2026.10.1016/j.compag.2016.08.009
Sloth, KHMN, Friggens, NC, Løvendahl, P, Andersen, PH, Jensen, J and Ingvartsen, KL 2003. Potential for improving description of bovine udder health status by combined analysis of milk parameters. Journal of Dairy Science 86, 12211232.
Sonka, S 2015. Big Data: from hype to agricultural tool. Farm Policy Journal 12, 19.
Sonka, S and Cheng, YT 2015a. Big data: more than a lot of numbers!. Farmdoc Daily 5, 201.
Sonka, S and Cheng, YT 2015b. Precision agriculture: Not the same as Big Data but…. Farmdoc Daily 5, 206.
Van der Waaij, BD, Feldbrugge, RL and Veerkamp, RF 2016. Cow feed intake prediction with machine learning. In Precision dairy farming 2016 (ed. C Kamphuis and W Steeneveld), 21–23 June 2016, Leeuwarden, The Netherlands, pp 377383. Wageningen Academic Publishers, Wageningen, The Netherlands.
Van Der Weerdt, C and de Boer, J 2015. Focusing on behaviour to ensure adoption of Big Data information services. In Precision Livestock Farming ‘15 - Papers presented at the 7th European Conference on Precision Livestock Farming (ed. M Guarino and D Berckmans), 15–18 September, Milan, Italy, pp. 721–729.
Van Rijmeman, M 2017. Why the three V’s are not sufficient to describe Big Data. Retrieved on 4 August 2017 from https://datafloq.com/read/3vs-sufficient-describe-big-data/166.
Verhoosel, JPC and Spek, J 2016. Semantics for big data applications in the smart dairy farming domain. In Proceedings of the 1st Precision Dairy Farming Conference, 21–23 June 2016, Leeuwarden, The Netherlands, pp. 211–218.
Viazzi, S, Schlageter Tello, AA, van Hertem, T, Romanini, CEB, Pluk, A, Halachmi, I, Lokhorst, C and Berckmans, D 2013. Analysis of individual classification of lameness using automatic measurement of back posture in dairy cattle. Journal of Dairy Science 96, 257266.
Vonder, MR, van Der Waaij, BD, Harmsma, EJ and Donker, G 2015. Near real-time large scale (sensor) data provisioning for PLF. In Proceedings of the 7th European Conference on Precision Livestock Farming, 15–18 September, Milan, Italy, pp. 290–297.
Williams, ML, MacParthaláin, N, Brewer, P, James, WPJ and Rose, MT 2016. A novel behavioral model of the pasture-based dairy cow from GPS data using data mining and machine learning techniques. Journal of Dairy Science 99, 20632075.
Wolfert, S, Ge, L, Verdouw, C and Bogaardt, M-J 2017. Big Data in smart farming – a review. Agricultural Systems 153, 6980.
Yao, C, Zhu, X and Weigel, KA 2016. Semi-supervised learning for genomic prediction of novel traits with small reference populations: an application to residual feed intake in dairy cattle. Genetics Selection Evolution 48, 19.
Yoder, PS, St-Pierre, NR and Weiss, WP 2014. A statistical filtering procedure to improve the accuracy of estimating population parameters in feed composition databases. Journal of Dairy Science 97, 56455656.10.3168/jds.2013-7724
Zaslavsky, A, Perera, C and Georgakopoulos, G 2012. Sensing as a service and Big Data. In Proceedings of the International Conference on Advances in Cloud Computing, July 2012, Bangalore, India, pp. 21–29.

Keywords

Type Description Title
WORD
Supplementary materials

Lokhorst et al. supplementary material
Lokhorst et al. supplementary material 1

 Word (53 KB)
53 KB

Invited review: Big Data in precision dairy farming

  • C. Lokhorst (a1) (a2), R. M. de Mol (a1) and C. Kamphuis (a1)

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed