Towards Continuous Customer Validation: A Conceptual Model for Combining Qualitative Customer Feedback with Quantitative Customer Observation

Published on Jan 1, 2015 in ICSOB (International Conference on Software Business)
· DOI :10.1007/978-3-319-19593-3_13
Helena Holmström Olsson20
Estimated H-index: 20
(Malmö University),
Jan Bosch51
Estimated H-index: 51
(Chalmers University of Technology)
Software-intensive product companies are becoming increasingly data-driven as can be witnessed by the big data and Internet of Things trends. However, optimally prioritizing customer needs in a mass-market context is notoriously difficult. While most companies use product owners or managers to represent the customer, research shows that the prioritization made is far from optimal. In earlier research, we have coined the term ‘the open loop problem’ to characterize this challenge. For instance, research shows that up to half of all the features in products are never used. This paper presents a conceptual model that emphasizes the need for combining qualitative feedback in early stages of development with quantitative customer observation in later stages of development. Our model is inductively derived from an 18 months close collaboration with six large global software-intensive companies.
  • References (30)
  • Citations (25)
📖 Papers frequently viewed together
2015ICSOB: International Conference on Software Business
3 Authors (Aleksander Fabijan, ..., Jan Bosch)
27 Citations
1,766 Citations
1 Author (Eric Ries)
943 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Petra M. Bosch-Sijtsema (Chalmers University of Technology)H-Index: 15
#2Jan BoschH-Index: 51
The feedback and input of users have been an important part of product innovation in recent years. User input has been studied from different approaches and is applied through different methods in particular phases of the innovation process. However, these methods are not integrated into the whole innovation process and are used only in particular phases or on an ad hoc basis. New developments in technology, social media, and new ways of working closer with customers have opened up new possibili...
51 CitationsSource
#1Helena Holmström Olsson (Malmö University)H-Index: 20
#2Anna Sandberg (Ericsson)H-Index: 6
Last. Hiva Alahyari (Chalmers University of Technology)H-Index: 6
view all 4 authors...
In large-scale software development, there is typically a conflict between being responsive to individual customers, while at the same time achieving scale in terms of delivering a high number of features to a large customer base. Most often, organizations focus on scale and individual customer requests are viewed as problematic since they add complexity to product variation and version control. Here, we explore the use of customer-specific teams as a means to address this conflict. First, we ve...
8 CitationsSource
Aug 27, 2014 in SEAA (Software Engineering and Advanced Applications)
#1Helena Holmström Olsson (Malmö University)H-Index: 20
#2Jan Bosch (Chalmers University of Technology)H-Index: 51
35 CitationsSource
#1Mika Westerlund (Carleton University)H-Index: 18
#2Seppo Leminen (Laurea University of Applied Sciences)H-Index: 14
Last. Mervi Rajahonka (Aalto University)H-Index: 9
view all 3 authors...
This article investigates challenges pertaining to business model design in the emerging context of the Internet of Things (IOT). The evolution of business perspectives to the IOT is driven by two underlying trends: i) the change of focus from viewing the IOT primarily as a technology platform to viewing it as a business ecosystem; and ii) the shift from focusing on the business model of a firm to designing ecosystem business models. An ecosystem business model is a business model composed of va...
95 CitationsSource
Jan 1, 2014 in ICSOB (International Conference on Software Business)
#1Emil Backlund (Chalmers University of Technology)H-Index: 1
#2Mikael Bolle (Chalmers University of Technology)H-Index: 1
Last. Jan Bosch (University of Gothenburg)H-Index: 51
view all 5 authors...
Success in the software market requires constant improvement of the software. These improvements however have to directly align with the needs of the users of the software. A recent trend in software engineering is to collect post-deployment data about how users use a software system. We report in this paper about a case study with an industrial partner in which (1) we identified which data has to be collected for a web-based portal system, (2) implemented the data collection, and (3) performed ...
10 CitationsSource
Jun 3, 2014 in ICSE (International Conference on Software Engineering)
#1Fabian Fagerholm (UH: University of Helsinki)H-Index: 13
#2Alejandro Sanchez Guinea (UH: University of Helsinki)H-Index: 6
Last. Jürgen Münch (UH: University of Helsinki)H-Index: 26
view all 4 authors...
Development of software-intensive products and services increasingly occurs by continuously deploying product or service increments, such as new features and enhancements, to customers. Product and service developers need to continuously find out what customers want by direct customer feedback and observation of usage behaviour, rather than indirectly through up-front business analyses. This paper examines the preconditions for setting up an experimentation system for continuous customer experim...
48 CitationsSource
Jan 1, 2013 in LESS (Lean Enterprise Software and Systems)
#1Jan Bosch (Chalmers University of Technology)H-Index: 51
#2Helena Holmström Olsson (Malmö University)H-Index: 20
Last. Jens Ljungblad (Chalmers University of Technology)H-Index: 2
view all 4 authors...
Software startups are more popular than ever and growing in numbers. They operate under conditions of extreme uncertainty and face many challenges. Often, agile development practices and lean principles are suggested as ways to increase the odds of succeeding as a startup, as they both advocate close customer collaboration and short feedback cycles focusing on delivering direct customer value. However, based on an interview study we see that despite guidance and support in terms of well-known an...
46 CitationsSource
Jan 1, 2013 in LESS (Lean Enterprise Software and Systems)
#1Helena Holmström Olsson (Malmö University)H-Index: 20
#2Jan Bosch (Chalmers University of Technology)H-Index: 51
Today, products within telecommunication, transportation, consumer electronics, home automation, security etc. involve an increasing amount of software. As a result, organizations that have a tradition within hardware development are transforming to become software-intensive organizations. This implies products where software constitutes the majority of functionality, costs, future investments, and potential. While this shift poses a number of challenges, it brings with it opportunities as well....
25 CitationsSource
#1Paavo Ritala (Lappeenranta University of Technology)H-Index: 27
#2Vassilis Agouridas (Grenoble School of Management)H-Index: 1
Last. Otto GiesH-Index: 1
view all 4 authors...
This study focuses on value creation and capture in innovation ecosystems. It presents and discusses the findings from a qualitative, comparative case study on two European-led innovation ecosystems from the ICT and aerospace and defence sectors. The purpose of the research is to explore the tangible and intangible mechanisms related to how leading firms may facilitate value creation and capture in this context. In particular, we focus on mechanisms related to the building phase to help attract ...
63 CitationsSource
#1Steven G. BlankH-Index: 1
147 Citations
Cited By25
view all 3 authors...
Digital startups are more cutting edge for the young entrepreneurs in this year and always growing in numbers (1). This cause is affected change in business patterns in Indonesia, including Bali. This research aims about how to create a digital business with Lean Startup Machines and Questionnaire User Experience method (UEQ). This business originated from the fact that careers women in Bali had difficulty to buy traditional ceremonial equipment. We developed the early stage of software startup ...
#1Woogon Shim (Ajou University)
Agile and lean are now the mainstream tenets of software development. This development methodology is attracting attention because it can develop software that operates quickly despite uncertain situations and limited information (requirements), and it can adaptively develop while checking feedback both frequently and regularly. The key is to welcome change without resistance, which is not limited to development but also requires changes in requirement management. However, there is a lack of pra...
#1Jorge MelegatiH-Index: 1
#2Xiaofeng WangH-Index: 23
Last. Xiaofeng WangH-Index: 40
view all 2 authors...
Recent studies have proposed the use of experiments to guide software development in order to build features that users really want. In this context, product assumptions should be taken as hypotheses to be tested through experiments. User stories (US) are broadly used in the agile context but current guidelines to write them, like INVEST (Independent, Negotiable, Valuable, Estimable, Small and Testable), are not suitable in a experiment-driven context. In this paper, we present the first cycle o...
2 CitationsSource
Last. Gerrit Muller (Sewanee: The University of the South)H-Index: 2
view all 3 authors...
#1Woogon Shim (LG Electronics)H-Index: 1
#2Seok-Won Lee (Ajou University)H-Index: 13
Abstract Nowadays agile development has become a mainstream development methodology. Yet agile is still lacking in how in-depth it deals with Requirement Engineering (RE) compared to the other development stages. There have been attempts to apply agile RE techniques to traditional development and conversely to apply traditional RE techniques to agile development. But the biggest problem is that it is difficult to maintain the essence of agile which is to “collaborate”, “(iterative and frequent) ...
3 CitationsSource
#1Eriks Klotins (BTH: Blekinge Institute of Technology)H-Index: 5
#2Michael Unterkalmsteiner (BTH: Blekinge Institute of Technology)H-Index: 11
Last. Tony Gorschek (BTH: Blekinge Institute of Technology)H-Index: 33
view all 3 authors...
Context Start-up companies have become an important supplier of innovation and software-intensive products. The flexibility and reactiveness of start-ups enables fast development and launch of innovative products. However, a majority of software start-up companies fail before achieving any success. Among other factors, poor software engineering could be a significant contributor to the challenges experienced by start-ups. However, the state-of-practice of software engineering in start-ups, as we...
10 CitationsSource
#1Aleksander Fabijan (Malmö University)H-Index: 6
#2Pavel DmitrievH-Index: 8
Last. Jan Bosch (Chalmers University of Technology)H-Index: 51
view all 6 authors...
Companies need to know how much value their ideas deliver to customers. One of the most powerful ways to accurately measure this is by conducting online controlled experiments (OCEs). To run experiments, however, companies need to develop strong experimentation practices as well as align their organization and culture to experimentation. The main objective of this paper is to demonstrate how to run OCEs at large scale using the experience of companies that succeeded in scaling. Based on case stu...
6 CitationsSource
#1David Issa Mattos (Chalmers University of Technology)H-Index: 2
#2Pavel DmitrievH-Index: 8
Last. Helena Holmström Olsson (Malmö University)H-Index: 20
view all 5 authors...
Accurate prioritization of efforts in product and services development is critical to the success of every company. Online controlled experiments, also known as A/B tests, enable software companies to establish causal relationships between changes in their systems and the movements in the metrics. By experimenting, product development can be directed towards identifying and delivering value. Previous research stresses the need for data-driven development and experimentation. However, the level o...
2 CitationsSource
Cebu City government’s Long Life Medical Assistance Program aims to deliver and supply maintenance medicine to its qualifying beneficiaries. The process is done manually resulting to certain problems such as: (1) lack of evidences that the beneficiaries received the medicine intended for them; (2) inventory monitoring of medicines distributed; (3) and shortage of medicine supplies. In line with these problems, a web and mobile application called Aeon is designed in partnership with the Cebu City...
#1Jan Bosch (Chalmers University of Technology)H-Index: 51
The role of software in society and in industry in particular continues to grow exponentially. Most companies either have or are in the process of adoption continuous deployment of their software at products in the field and collect data concerning the performance of their systems. The continuous, fast feedback loops that companies now have available allow for a fundamentally different way of organizing. In fact, based on our work with dozens of companies, we have come to the conclusion that com...