Performance evaluation of product-service systems: literature review and research agenda

Authors

  • Suzana Regina Moro Universidade Federal de Santa Catarina http://orcid.org/0000-0002-7096-9488
  • Sandra Rolin Ensslin Universidade Federal de Santa Catarina

DOI:

https://doi.org/10.14488/1676-1901.v18i2.2864

Keywords:

Product-service System. Servitization. Performance Evaluation. Literature Review. ProKnow-C

Abstract

With the need for organizations to deliver new solutions to their customers, based on a shift from product focus to integrated solutions delivering value to their customers, product-service systems represent a promising emerging trend for organizations. However, the transition to servitization models requires that organizations also change the management of their processes and, consequently, how to evaluate their performance. In this context, this research aims to identify the works of the product-service systems area that propose performance evaluations and analyze them from the perspective of the conceptual literature of performance evaluation, proposing future research opportunities integrating the two areas. For this purpose, the Knowledge Development Process-Constructivist (ProKnow-C) was used to select the relevant literature, as well as to identify, analyze and reflect on the characteristics of the publications focused on performance evaluation. Based on a bibliographical portfolio composed of 30 articles, it was verified that the performance evaluation of product-service systems is still in development, and that 50% of the works use performance evaluation tools to evaluate product-service systems solutions, most in a qualitative way. It is presented a research agenda highlighting the need to develop and improve performance indicators to assess solutions in a number of aspects, such as sustainability, development of solutions, and operational and management processes. In addition, to promote an integrated measurement of the aspects related to the product-service systems and their effects, in all phases of the life cycle of the performance evaluation system, is shown as a gap not yet explored.

Downloads

Download data is not yet available.

Author Biography

Suzana Regina Moro, Universidade Federal de Santa Catarina

Doutoranda no Programa de Pós-graduação em Engenharia de Produção
Universidade Federal de Santa Catarina (UFSC)

References

ANNARELLI, A.; BATTISTELLA, C.; NONINO, F. Product service system: A conceptual framework from a systematic review. Journal of Cleaner Production, v. 139, p. 1011-1032, 15 dez. 2016. DOI:https://doi.org/10.1016/j.jclepro.2016.08.061

(*) ALLAIS, R.; GOBERT, J. A multidisciplinary method for sustainability assessment of PSS: Challenges and developments. CIRP Journal of Manufacturing Science and Technology, nov. 2016. DOI:https://doi.org/10.1016/j.cirpj.2016.04.007

AURICH, J. C.; MANNWEILER, C.; SCHWEITZER, E. How to design and offer services successfully. CIRP Journal of Manufacturing Science and Technology, v. 2, n. 3, p. 136-143, 2010. DOI:https://doi.org/10.1016/j.cirpj.2010.03.002

BAINES, T. S.; LIGHTFOOT, H.; EVANS, S.; NEELY, A.; GREENOUGH, R.; PEPPARD, J.; ROY, R.; SHEHAB, E.; BRAGANZA, A.; TIWARI, A.; ALCOCK, J. R.; ANGUS, J. P.; BASTL, M.; COUSENS, A.; IRVING, P.; JOHNSON, M.; KINGSTON, J.; LOCKETT, H.; MARTINEZ, V.; MICHELE, P.; TRANFIELD, D.; WALTON, I. M.; WILSON, H. State-of-the-art in product-service systems. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, v. 221, n. 10, p. 1543-1552, 2007.

DOI:http://dx.doi.org/10.1243/09544054JEM858

(*) BAINES, T.; LIGHTFOOT, H. SMART, P.; FLETCHER, S. Servitization of manufacture: Exploring the deployment and skills of people critical to the delivery of advanced services. Journal of Manufacturing Technology Management, v. 24, n. 4, p. 637-646, 2013. DOI:http://dx.doi.org/10.1108/17410381311327431

(*) BAINES, T.; W. LIGHTFOOT, H. Servitization of the manufacturing firm: Exploring the operations practices and technologies that deliver advanced services. International Journal of Operations & Production Management, v. 34, n. 1, p. 2-35, 2014. DOI:http://dx.doi.org/10.1108/IJOPM-02-2012-0086

(*) BENEDETTINI, O.; NEELY, A.; SWINK, M. Why do servitized firms fail? A risk-based explanation. International Journal of Operations & Production Management, v. 35, n. 6, p. 946-979, 2015. DOI:http://dx.doi.org/10.1108/IJOPM-02-2014-0052

BEUREN, F. H.; FERREIRA, M. G. G.; CAUCHICK MIGUEL, P. A. Product-service systems: a literature review on integrated products and services. Journal of Cleaner Production, v. 47, p. 222-231, mai. 2013. DOI:https://doi.org/10.1016/j.jclepro.2012.12.028

BEUREN, F. H.; FERREIRA, M. G. G.; ZANCUL, E. S.; CAUCHICK MIGUEL, P. A. Análise de conteúdo de publicações em sistemas produto-serviço. Revista Produção Online, v. 14, n. 1, p. 35-57, 2014. DOI:http://dx.doi.org/10.14488/1676-1901.v14.i1.1405

(#) BITITCI, U.; GARENGO, P.; DÖRFLER, V.; NUDURUPATI, S. Performance measurement: challenges for tomorrow. International Journal of Management Reviews, v. 14, n. 3, p. 305-327, 2012. DOI:http://dx.doi.org/ 10.1111/j.1468-2370.2011.00318.x

BOEHM, M.; THOMAS, O. Looking beyond the rim of one's teacup: a multidisciplinary literature review of Product-Service Systems in Information Systems, Business Management, and Engineering & Design. Journal of Cleaner Production, v. 51, p. 245-260, 15 jul. 2013. DOI:https://doi.org/10.1016/j.jclepro.2013.01.019

(*) BOONS, F.; MONTALVO, C.; QUIST, J.; WAGNER, M. Sustainable innovation, business models and economic performance: an overview. Journal of Cleaner Production, v. 45, p. 1-8, abr. 2013. DOI:https://doi.org/10.1016/j.jclepro.2012.08.013

BOOTH, A.; SUTTON, A.; PAPAIOANNOU, D. Systematic approaches to a successful literature review. Sage, 2012.

(#) BOURNE, M.; MILLS, J.; WILCOX, M.; NEELY, A.; PLATTS, K. Designing, implementing and updating performance measurement systems. International Journal of Operations & Production Management, v. 20, n. 7, p. 754-771, 2000. DOI:http://dx.doi.org/10.1108/01443570010330739

CARDOSO, T. L.; ENSSLIN, S. R.; ENSSLIN, L.; FELIU, V. M. R.; DUTRA, A. Reflexões para avanço na área de avaliação e gestão do desempenho das universidades: uma análise da literatura científica. In: Anais do Seminários em Administração (XVIII SEMEAD 2015) São Paulo-SP, 2015.

CASTRO, C. de M. A prática da pesquisa. McGraw-Hill, 1977.

(*) CESCHIN, F. Critical factors for implementing and diffusing sustainable product-service systems: insights from innovation studies and companies' experiences. Journal of Cleaner Production, v. 45, p. 74-88, abr. 2013. DOI:https://doi.org/10.1016/j.jclepro.2012.05.034

(*) CHEN, K. H.; WANG, C. H.; HUANG, S. Z.; SHEN, G. C. Service innovation and new product performance: The influence of market-linking capabilities and market turbulence. International Journal of Production Economics, v. 172, p. 54-64, fev. 2016. DOI:https://doi.org/10.1016/j.ijpe.2015.11.004

(*) CHIRUMALLA, K; BERTONI, A.; PARIDA, A.; JOHANSSON, C.; BERTONI, M. Performance measurement framework for product–service systems development: a balanced scorecard approach. International Journal of Technology Intelligence and Planning, v. 9, n. 2, p. 146-164, 2013. DOI:http://dx.doi.org/10.1504/IJTIP.2013.058135

(*) CHOU, C; CHEN, C.W.; CONLEY, C. An approach to assessing sustainable product-service systems. Journal of Cleaner Production, v. 86, p. 277-284, jan. 2015. https://doi.org/10.1016/j.jclepro.2014.08.059

CLAYTON, R. J.; BACKHOUSE, C. J.; DANI, S. Evaluating existing approaches to product-service system design: A comparison with industrial practice. Journal of Manufacturing Technology Management, v. 23, n. 3, p. 272-298, 2012. DOI:http://dx.doi.org/10.1108/17410381211217371

COLICCHIA, C.; STROZZI, F. Supply chain risk management: a new methodology for a systematic literature review, Supply Chain Management: an International Journal, v. 17, n. 4, p. 403-418, 2012. DOI: http://dx.doi.org/10.1108/13598541211246558

(*) COOPER, R. G. Perspective: the innovation dilemma: how to innovate when the market is mature. Journal of Product Innovation Management, v. 28, n. s1, p. 2-27, 2011. DOI:http://dx.doi.org/10.1111/j.1540-5885.2011.00858.x

CRESWELL, J. W. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4 th ed. SAGE Publications, Inc, 2014.

(*) DAHMANI, S; BOUCHER, X., PEILLON, S.; BESOMBES, B. A reliability diagnosis to support servitization decision-making process. Journal of Manufacturing Technology Management, v. 27, n. 4, p. 502-534, 2016. DOI:http://dx.doi.org/10.1108/JMTM-06-2015-0044

DUTRA, A.; RIPOLL-FELIU, V. M.; FILLOL, A. G.; ENSSLIN, S. R.; ENSSLIN, L. The construction of knowledge from the scientific literature about the theme seaport performance evaluation. International Journal of Productivity and Performance Management, v. 64, n. 2, p. 243-269, 2015. DOI:http://dx.doi.org/10.1108/IJPPM-01-2014-0015

(*) ELNADI, M.; SHEHAB, E. Main enablers and factors for successful implementation of lean in product-service systems. International Journal of Agile Systems and Management, v. 8, n. 3-4, p. 332-354, 2015. DOI:http://dx.doi.org/10.1504/IJASM.2015.073542

ENSSLIN, S. R.; ENSSLIN, L., BACK, F.; LACERDA, R. T. de O. Improved decision aiding in human resource management: a case using constructivist multi-criteria decision aiding. International Journal of Productivity and Performance Management, v. 62, n. 7, p. 735-757, 2013. DOI: http://dx.doi.org/10.1108/IJPPM-04-2012-0039

ENSSLIN, S. R.; ENSSLIN, L.; MATOS, L. S.; DUTRA, A.; RIPOLL-FELIU, V.M. Research opportunities in performance measurement in public utilities regulation. International Journal of Productivity and Performance Management, v. 64, n. 7, p. 994-1017, 2015. DOI:http://dx.doi.org/10.18568/1980-4865.10371-85

ENSSLIN, L.; ENSSLIN, S. R.; DUTRA, A.; REIS, N. A. N. C. BPM governance: a literature analysis of performance evaluation. Business Process Management Journal, v. 23, n. 1, p. 71-86, 2017. DOI:http://dx.doi.org/10.1108/BPMJ-11-2015-0159

(#) FRANCO-SANTOS, M.; KENNERLEY, M.; MICHELI, P.; MARTINEZ, V.; MASON, S.; MARR, B., GRAY, D.; NEELY, A. Towards a definition of a business performance measurement system. International Journal of Operations & Production Management, v. 27, n. 8, p.784-801, 2007. DOI:https://doi.org/10.1108/01443570710763778

(#) GHALAYINI, A. M.; NOBLE, J. S. The changing basis of performance measurement. International Journal of Operations & Production Management, v. 16, n. 8, p. 63-80, 1996. DOI:http://dx.doi.org/10.1108/01443579610125787

(*) GENG, X; CHU, X. A new importance–performance analysis approach for customer satisfaction evaluation supporting PSS design. Expert Systems with Applications, v. 39, n. 1, p. 1492-1502, 2012. DOI:https://doi.org/10.1016/j.eswa.2011.08.038

(*) HA, S. Y.; LEE, G. H.; KIM, B. S. Strategies for Manufacturing Servitization of Korean SMEs: By Using Data Envelopment Analysis. Journal of Applied Business Research, v. 32, n. 2, p. 635, 2016. DOI:http://dx.doi.org/10.19030/jabr.v32i2.9600

HALME, M.; JASCH, C.; SCHARP, M. Sustainable homeservices? Toward household services that enhance ecological, social and economic sustainability. Ecological Economics, v. 51, n. 1, p. 125-138, 2004. DOI:https://doi.org/10.1016/j.ecolecon.2004.04.007

(*) HALME, M.; ANTTONEN, M.; HRAUDA, G.; KORTMAN, J. Sustainability evaluation of European household services. Journal of Cleaner Production, v. 14, n. 17, p. 1529-1540, 2006. DOI:https://doi.org/10.1016/j.jclepro.2006.01.021

HERVANI, A. A.; HELMS, M. M.; SARKIS, J. Performance measurement for green supply chain management. Benchmarking: An International Journal, v. 12, n. 4, p. 330-353, 2005. DOI:http://dx.doi.org/10.1108/14635770510609015

(*) HU, H. A.; CHEN, S. H.; HSU, C. W.; WANG, C.; WU, C. L. Development of sustainability evaluation model for implementing product service systems. International Journal of Environmental Science and Technology, v. 9, n. 2, p. 343-354, 2012. DOI: http://dx.doi.org/10.1007/s13762-012-0037-7

(*) KASTALLI, I. V.; VAN LOOY, B.; NEELY, A. Steering manufacturing firms towards service business model innovation. California Management Review, v. 56, n. 1, p. 100-123, 2013. DOI:http://dx.doi.org/10.1525/cmr.2013.56.1.100

KIMITA, K.; SHIMOMURA, Y.; ARAI, T. Evaluation of customer satisfaction for PSS design. Journal of Manufacturing Technology Management, v. 20, n. 5, p. 654-673, 2009. DOI:http://dx.doi.org/10.1108/17410380910961046

KITCHENHAM, B. Procedures for Performing Systematic Reviews. Technical Report TR/SE-0401. Keele University, 2004.

(*) KOHTAMAKI, M.; HAKALA, H.; PARTANEN, J.; PARIDA, V.; WINCENT, J. The performance impact of industrial services and service orientation on manufacturing companies. Journal of Service Theory and Practice, v. 25, n. 4, p. 463-485, 2015. DOI:http://dx.doi.org/10.1108/JSTP-12-2013-0288

(*) KUO, T. C.; Ma, H. Y.; Huang, S. H.; Hu, A. H.; Huang, C. S. Barrier analysis for product service system using interpretive structural model. The International Journal of Advanced Manufacturing Technology, v. 49, n. 1-4, p. 407-417, 2010. DOI:http://dx.doi.org/10.1007/s00170-009-2399-7

(*) LEE, S.; LEE, S., GEUM, Y., LEE, H., PARK, Y. Dynamic and multidimensional measurement of product-service system (PSS) sustainability: a triple bottom line (TBL) -based system dynamics approach. Journal of Cleaner Production, v. 32, p. 173-182, 2012. DOI:https://doi.org/10.1016/j.jclepro.2012.03.032

LOVELOCK, C.; GUMMESSON, E. Wither service marketing? In search of new paradigm and fresh perspectives. Journal of Service Research, v. 47, p. 9–20, ago. 2004. DOI:https://doi.org/10.1177/1094670504266131

MANZINI, E.; VEZZOLI, C.; CLARK, G. Product service systems: using an existing concept as a new approach to sustainability. Journal of Design Research, v. 1, n. 2, p. 12-18, 2001.

(*) MARTINEZ, V.; BASTL, M.; KINGSTON, J.; EVANS, S. Challenges in transforming manufacturing organizations into product-service providers. Journal of Manufacturing Technology Management, v. 21, n. 4, p. 449-469, 2010. DOI:http://dx.doi.org/10.1108/17410381011046571

(*) MAXWELL, D.; SHEATE, W.; VAN DER VORST, R. Functional and systems aspects of the sustainable product and service development approach for industry. Journal of Cleaner Production, V. 14, N. 17, P. 1466-1479, 2006. DOI:https://doi.org/10.1016/j.jclepro.2006.01.028

MONT, O. K. Clarifying the concept of product–service system. Journal of Cleaner Production, v. 10, n. 3, p. 237-245, 2002.

DOI:https://doi.org/10.1016/S0959-6526(01)00039-7

(#) NEELY, A., GREGORY, M., PLATTS, K. Performance measurement system design: a literature review and research agenda. International Journal of Operations & Production Management, v. 15, n. 4, p. 80-116, 1995. DOI:http://dx.doi.org/10.1108/01443579510083622

(#) NEELY, A. The performance measurement revolution: why now and what next? International Journal of Operations & Production Management, v. 19, n. 2, p. 205-228, 1999. DOI:http://dx.doi.org/10.1108/01443579910247437

NEELY, A. The servitization of manufacturing: An analysis of global trends. In Proceeding of the 14th European Operations Management Association Conference. Ankara, Turkey, 17–20 June, 2007.

(*) NEELY, A. Exploring the financial consequences of the servitization of manufacturing. Operations Management Research, v. 1, n. 2, p. 103-118, 2008. DOI:https://doi.org/10.1007/s12063-009-0015-5

NETO, R A.; SILVA, S. L.; FORCELLINI, F.; FERREIRA, M. G. G.; CAUCHICK MIGUEL, P. A. Elementos integrantes de um sistema produto-serviço como potencial para alcançar um desenvolvimento sustentável: bibliometria e análise de conteúdo. Revista Produção Online, v. 14, n. 3, p. 914-938, 2014. DOI:http://dx.doi.org/10.14488/1676-1901.v14i3.1566

NG, I. C. L.; NUDURUPATI, S. S. Outcome-based service contracts in the defence industry – Mitigating the challenges. Journal of Service Management, v. 21, n. 5, p. 656–674, 2010. DOI:https://doi.org/10.1016/j.cie.2010.11.010

NIDUMOLU, R.; PRAHALAD, C. K.; RANGASWAMI, M. R. Why sustainability is now the key driver of innovation. Harvard Business Review, v. 87, n. 9, p. 56-64, 2009.

(#) NUDURUPATI, S. S.; BITITCI, U. S.; KUMAR, V.; CHAN, F. T. State of the art literature review on performance measurement. Computers & Industrial Engineering, v.60, n. 2, p. 279-290, 2011. DOI:https://doi.org/10.1016/j.cie.2010.11.010

(#) NUDURUPATI, S. S.; TEBBOUNE, S.; HARDMAN, J. Contemporary performance measurement and management (PMM) in digital economies. Production Planning & Control, v. 27, n. 3, p. 226-235, 2016. DOI:http://dx.doi.org/10.1080/09537287.2015.1092611

OSTROM, A. L. et al. Moving forward and making a difference: Research priorities for the science of service. Journal of Service Research, v. 13, p. 4–36, 2010. DOI:https://doi.org/10.1177/1094670509357611

(*) QU, M.; YU, S.; CHENA, D.; CHUA, J.; TIAN, B. State-of-the-art of design, evaluation, and operation methodologies in product service systems. Computers in Industry, v. 77, p. 1-14, 2016. DOI:https://doi.org/10.1016/j.compind.2015.12.004

(*) RAPACCINI, M.; SACCANI, N.; PEZZOTTA, G.; BURGER, T.; GANZ, W. Service development in product-service systems: a maturity model. The Service Industries Journal, v. 33, n. 3-4, p. 300-319, 2013. DOI:http://dx.doi.org/10.1080/02642069.2013.747513

(*) REIM, W.; PARIDA, V.; ÖRTQVIST, D. Product–Service Systems (PSS) business models and tactics–a systematic literature review. Journal of Cleaner Production, v. 97, p. 61-75, 2015. DOI:https://doi.org/10.1016/j.jclepro.2014.07.003

RICHARDSON, R. J. Pesquisa social: métodos e técnicas. São Paulo: 3. ed. Atlas, 1999.

(*) SCHWEITZER, E.; AURICH, J. C. Continuous improvement of industrial product-service systems. CIRP Journal of Manufacturing Science and Technology, v. 3, n. 2, p. 158-164, 2010. DOI: https://doi.org/10.1016/j.cirpj.2010.04.002

THIEL, G. G.; ENSSLIN, S. R.; ENSSLIN, L. Street Lighting Management and Performance Evaluation: Opportunities and Challenges. Lex Localis - Journal of Local Self-Government, v. 15, n. 2, p. 303-328, 2017.

TRANFIELD, D.; DENYER, D.; SMART, P. Towards a methodology for developing evidence informed management knowledge by means of systematic review, British Journal of Management, v. 14 n. 3, p. 207-222, 2003. DOI: https://doi.org/10.1111/1467-8551.00375

TUKKER, A. Eight types of product–service system: eight ways to sustainability?

Experiences from SusProNet. Business Strategy and the Environment, v. 13, n. 4, p. 246-260, 2004. DOI:https://doi.org/10.1002/bse.414

TUKKER, A. Product services for a resource-efficient and circular economy–a review. Journal of Cleaner Production, v.97, p.76-91, 2015.

DOI:https://doi.org/10.1016/j.jclepro.2013.11.049

(*) ULAGA, W.; REINARTZ, W. J. Hybrid offerings: how manufacturing firms combine goods and services successfully. Journal of Marketing, v. 75, n. 6, p. 5-23, 2011. DOI:http://dx.doi.org/10.1509/jm.09.0395

VALMORBIDA, S. M. I.; ENSSLIN, L. Construção de conhecimento sobre avaliação de desempenho para gestão organizacional: uma investigação nas pesquisas científicas internacionais. Revista Contemporânea de Contabilidade, v. 13, n. 28, p. 123-148, 2016.

VALMORBIDA, S. M. I.; ENSSLIN, S. R. Avaliação de Desempenho de Rankings Universitários: Revisão da Literatura e diretrizes para futuras investigações. In: Anais do XXXIX Encontro da ANPAD (EnANPAD 2015) Belo Horizonte -MG, 2015.

VEZZOLI, C.; CESCHIN, F.; DIEHL, J. C.; KOHTALA, C. Why have ‘Sustainable Product-Service Systems’ not been widely implemented?: Meeting new design challenges to achieve societal sustainability. Journal of Cleaner Production, v. 35, p. 288-290, 2012. DOI:https://doi.org/10.1016/j.jclepro.2012.05.050

(*) VISNJIC, I.; WIENGARTEN, F.; NEELY, A. Only the brave: Product innovation, service business model innovation, and their impact on performance. Journal of Product Innovation Management, v. 33, n. 1, p. 36-52, 2016. DOI:http://dx.doi.org/10.1111/jpim.12254

(*) XING, K.; WANG, H.F.; QIAN, W. A sustainability-oriented multi-dimensional value assessment model for product-service development. International Journal of Production Research, v. 51, n. 19, p. 5908-5933, 2013. DOI: http://dx.doi.org/10.1080/00207543.2013.810349

WALLIN, J., PARIDA, V., ISAKSSON, O. Understanding product-service system innovation capabilities development for manufacturing companies. Journal of Manufacturing Technology Management, v. 26, n. 5, p. 763-787, 2015. DOI: http://dx.doi.org/10.1108/JMTM-05-2013-0055

Published

2018-06-15

How to Cite

Moro, S. R., & Ensslin, S. R. (2018). Performance evaluation of product-service systems: literature review and research agenda. Revista Produção Online, 18(2), 532–559. https://doi.org/10.14488/1676-1901.v18i2.2864

Issue

Section

Papers