2.1. Integration of user perceptions

In order to include users’ perception in the design process, two categories of methods can be considered.

The first category of methods to tackle this problem is based on the modelling of users’ perceptions or preferences according to a given set of parameterised products (modelling of perceptual data). These methods use the design of experiments (DOE) theory and assume an explicit model (generally linear without interaction) between the perceptual dimensions and the design variables. Various statistical procedures and experiment designs exist to estimate the coefficients of the model. The Japanese Kansei engineering, a well-known design method to account for users’ feelings and perceptions (Nagamachi Reference Nagamachi1995), belongs to this category. For instance, it is considered in sound design to explore how human feelings and emotions can be evoked by a sound’s physical properties. For warning sounds, many studies proposed an experimental approach with listening tests to understand human perceptions for sound design (Ibrahim, Yiap & Andrias Reference Ibrahim, Yiap and Andrias2018). In Marshall, Lee & Austria (Reference Marshall, Lee and Austria2007), different listening scenarios are proposed to study two objectives, namely annoyance and urgency, with a fixed DOE. Knowing the effect of sound parameters on the perceived urgency is important to give precise recommendations (Edworthy, Loxley & Dennis Reference Edworthy, Loxley and Dennis1991). Another approach consists in testing how classical psychoacoustic metrics (loudness, roughness, fluctuation strength etc.) can explain perceptual assessments (Lee et al. Reference Lee, Lee, Shin and Han2017).

To study and understand human reaction to sounds, experiments generally use a parameterised sound synthesis method and model-based DOE (e.g., D-optimal DOE). The limitation of such an approach is that a model between the acoustic parameters and the perceptual dimension must be assumed in advance, given that the exact form of the model is generally unknown. To reduce the complexity of the models, the sounds proposed in the listening tests are generally simple stimuli that are not representative of the complexity of real design solutions and fail to be relevant for multiple objectives. Furthermore, a systematic exploration of a large sound space can be a tedious task – or even infeasible – and user listening fatigue has to be taken into account.

The second category of methods for the analysis of users’ perceptions is not model-based and uses human–computer interactions. These methods are model-free in content (contrary to DOE, there is no model of the behaviour of the respondent), but model-driven for the solution search. In this case, an algorithm gradually refines the propositions made to the users. In interactive evolutionary computation (IEC) algorithms, for example, the user plays the role of the evaluator in an evolutionary process (Takagi Reference Takagi2001). In IEC, the user assesses the fitness of a design population (which is the adaptation of the population to the problem), by rating the proposed designs or choosing the best ones, for example. IEC has been applied to many domains (music, writing, education, food industry etc.) involving different sensory modalities.

Particular cases of IEC are IGAs, where genetic operators, such as recombination, crossover and mutation, are used to modify the designs throughout the optimisation process. This method has been used, for example, to capture the aesthetic intention of participants for the design of cartoons (Gu, Tang & Frazer Reference Gu, Tang and Frazer2006). IGAs have also been tested in our previous studies for the design of car dashboards (Poirson et al. Reference Poirson, Petiot, Boivin and Blumenthal2013), which have confirmed their relevance for extracting design trends and obtaining a final product solution that optimises a determined semantic dimension. IGAs have the advantage of not needing restrictive assumptions regarding the perceptual model of the participant. Interaction effects are in fact implicitly integrated in the course of the model-driven search in the solution space. IGAs have been used in sound design for musical compositions (Biles Reference Biles2007) or to design sign sounds, with the purpose of communicating a message through a melody (Miki et al. Reference Miki, Orita, Wake and Hiroyasu2006). Subtle perceptual phenomena can be taken into account for the optimisation of products involving sensory constraints, such as the tuning of cochlear implants (Wakefield et al. Reference Wakefield, Van Den Honert, Parkinson and Lineaweaver2005).

Nevertheless, the implementation of IGAs to support sounds design remains rare. The first reason is that the design of products’ sounds is a relatively recent discipline that does not have as well-established guidelines as in visual design, where products can be described by illustrations or advanced 3D models (Eppinger & Ulrich Reference Eppinger and Ulrich2016). Conversely, sounds are immaterial and embedded in time, which makes the definition of prototypes difficult. ‘Sound sketches’, using, for example, voices and gesture (Delle Monache et al. Reference Delle Monache, Rocchesso, Bevilacqua, Lemaitre, Baldan and Cera2018), can be proposed to rough out a design proposal, but their use still remains limited. The second reason is that the design of sounds is critically dependent on the process of listening. According to Özcan & Van Egmond (Reference Özcan and Van Egmond2012), products’ sounds remain mainly based on the subjective experience of the designer because perceptual factors are complex to investigate. Several perceptual dimensions, potentially conflicting, may be elicited when listening to a sound. And even if generic tools based on a shared vocabulary and sound examples can be proposed (Carron et al. Reference Carron, Rotureau, Dubois, Misdariis and Susini2017), their adaptation to a particular project remains difficult.

Comparisons of IGA and classical DOE are rare in the engineering design literature. DOE allows for the definition of optimal products, the estimate of effects of factors on the response and the generation of predictions in the design space (with the model), while IGA is only oriented towards the search for the optimal product. A comparison of IGA and fractional factorial design for the design of warning sounds is presented in Petiot et al. (Reference Petiot, Villa, Denjean and Diaz2020). Results show that the IGA method can be an interesting alternative to classical DOE to help the design of sounds. Another comparative study concerns the design of the shape of a bottle using Conjoint Analysis, where the authors conclude on the superiority of interactive evolutionary algorithms on fractional DOE to elicit the optimum product, but without explanations for the reasons behind this superiority (Teichert & Shehu Reference Teichert and Shehu2007).

2.2. Multiobjective IGA

Genetic algorithms take inspiration from some knowledge of the evolutionary process of living organisms to solve optimisation problems (Goldberg Reference Goldberg1989). Potential solutions to a given problem are coded as strings of numbers called chromosomes. A chromosome is composed of several sections, called genes, each coding the values of different parameters of the corresponding solution. Solutions are evaluated in groups, called generations, usually using a fitness function. At each generation, a mating pool is created based on previous solutions’ performances with respect to the problem’s objectives. So-called genetic operators are applied to the solutions within that mating pool to create the next generation of solutions that will be evaluated. This process is repeated until convergence is achieved or the maximum number of generations is reached.

In IGAs, the evaluation of the solutions (fitness) is done by a human, so the fitness function does not have a mathematical expression. With this approach, it is possible to find solutions to problems involving a semantic dimension (such as the notion of ‘unpleasantness’ in this study, or the ‘clearance’ of a car dashboard in Poirson et al. Reference Poirson, Petiot, Boivin and Blumenthal2013), or perceptual dimensions. IGA can be used to assist the design of hearing aids (Durant et al. Reference Durant, Wakefield, Tasell and Rickert2004) or to optimise the affordances of steering wheels (Mata et al. Reference Mata, Fadel, Garland and Zanker2018). In this type of procedure, user fatigue is the main limitation to the maximum number of possible evaluations. This limits both the number of solutions per generation as well as the number of generations, which has an impact on the convergence of the algorithm. What is more, for time-varying solutions such as sounds, only one solution can be evaluated at a time.

The optimisation problem addressed in this paper is bi-objective, which means that there are potentially several equally satisfying solutions (Pareto efficient). To address this constraint, the proposed method considers an adaptation of the NSGA-II algorithm (Nondominated Sorting Genetic Algorithm II; Deb et al. Reference Deb, Pratap, Agarwal and Meyarivan2002), which aims at finding an approximation of the optimal Pareto front of the potential solutions. A Pareto front comprises the solutions that are nondominated in the Pareto sense. A solution is said to Pareto-dominate another one if it is better or equal to this solution for all objectives and if there is at least one objective where it is strictly better. An example of this is shown in Figure 1, where solutions are represented according to two objectives that must be minimised. The group of nondominated solutions is called the Pareto front. By ignoring the solutions of the Pareto front, it is possible to find the second front (Rank 2) of nondominated solutions, and so on. Figure 1b shows an example of the Pareto front (Rank 1) and other successive ranks.

Figure 1.

Example of Pareto domination for a bi-objective problem where both objectives have to be minimised. In (a), the black square Pareto dominates the white squares. In (b), the nondomination ranks are shown.

In the NSGA-II algorithm, the solutions are compared based on the so-called crowded-comparison operator. A solution is considered better than another one if it has a lower (closer to 1) nondomination rank. The nondomination rank of a solution corresponds to the nondominated front it belongs to. Within a nondominated front, the solutions are ranked based on their distances to other solutions of the same front in the objective space. Solutions that are further away from other solutions are considered better. This aims at ultimately obtaining solutions that are evenly spread along the optimal Pareto front.

In this elitist algorithm, a register of the best solutions evaluated is updated after each generation and is used to create the following one. This register has the same size $ N $ as the number of solutions in a generation’s population. After each evaluation of a generation of $ N $ solutions, the register is updated by keeping the best $ N $ solutions amongst the union of the $ N $ solutions in the current generation and the $ N $ solutions that are currently in the register. At the first generation, the register being empty, it is initialised with all $ N $ solutions within the population.

2.3. Implementation of the IGA

Our implementation uses the NSGA-II algorithm (Deb et al. Reference Deb, Pratap, Agarwal and Meyarivan2002). The procedure is implemented as follows: the first generation of $ N $ solutions is generated using a Latin Hypercube Sample. After evaluation by the user, the best-solution register is initialised with all $ N $ solutions of this first generation. The next generation is created by randomly applying one of the following genetic operators to each solution within the register, which constitutes the mating pool:

1. (i) Mutation: the solution is replicated to the next generation, with one gene value randomly changed.

2. (ii) Crossover: another solution is selected within the register through a binary tournament based on the crowded-comparison operator. The chromosomes representing the two solutions are combined, in order to create a new one. This is done by randomly selecting a chromosome location, splitting each chromosome into two parts around that location and connecting the first part of one solution with the second part of the other one. The order in which the solutions are combined is chosen randomly.

3. (iii) Selection: the solution is replicated in the next generation without any modification.

The probability for each operator to be applied is defined by a rate $ {m}_r $ , $ {c}_r $ and $ {s}_r $ , corresponding to mutation, crossover and selection, respectively. These rates are normalised so that they add up to 1, that is, $ {m}_r+{c}_r+{s}_r\hskip0.35em =\hskip0.35em 1 $ .

To select which operator to apply, a number $ r $ is randomly generated between 0 and 1:

1. (i) If $ 0\hskip0.35em \le \hskip0.35em r\hskip0.35em \le \hskip0.35em {m}_r $ , a mutation is applied.

2. (ii) If $ {m}_r<r\hskip0.35em \le \hskip0.35em {m}_r+{c}_r $ , a crossover with another solution is applied.

3. (iii) If $ {m}_r+{c}_r<r\hskip0.35em \le \hskip0.35em 1 $ , a selection is applied.

This process is repeated at each generation. The size of the register is kept constant, only containing the $ N $ best solutions.

The same solution (sound) can thus be evaluated several times during the optimisation process, and some variability is expected with regard to the evaluation of the two objectives by the subject. Thus, there is a risk that the best-solution register would contain several times the same sound, with different objective values. This would reduce diversity in the mating pool, which could lead to a premature convergence. To prevent this, each solution in the register is only present once, associated with the latest evaluation that the subject provided for this sound.

3.1. QV sound synthesis

The QV sounds are synthesised using the additive synthesis technique (Roads Reference Roads1996). By considering an analysis of current sounds of different carmakers (Misdariis et al. Reference Misdariis, Cera, Levallois and Locqueteau2012) and personal propositions (Petiot et al. Reference Petiot, Kristensen and Maier2013), the generation of different but plausible sounds for an electric car includes two types of sounds: (1) a ‘harmonic’ sound (discrete distribution of energy with respect to frequency – the frequencies being multiple of a fundamental) and (2) a noise sound (continuous distribution of energy with respect to frequency). The ‘harmonic’ sound is made of two components: a motor sound ( $ {C}_1 $ ), mimicking a combustion engine, and a major chord ( $ {C}_2 $ ), giving a tonal component. The noise sound is also made of two independent noise bands ( $ {C}_3 $ and $ {C}_4 $ ). More formally:

1. (i) $ {C}_1 $ , the engine-like sound, is simulated with a weighted sum of harmonics corresponding to a four-cylinder internal combustion engine (ICE; with RPM the rotation speed of the motor (tr/mn), the fundamental frequency is given by $ {f}_1\hskip0.35em =\hskip0.35em \frac{RPM}{60} $ ).

(1) $$ {C}_1(t)\hskip0.35em =\hskip0.35em \sum \limits_{i\hskip0.35em =\hskip0.35em 1}^6{a}_{1_i}\sin \left(2\pi {f}_{1_i}t\right). $$

1. (ii) $ {C}_2 $ , the major chord, is made of three harmonic (periodic) notes (root note [fundamental frequency $ {f}_2 $ ], major third [ $ \frac{5}{4}{f}_2 $ ] and fifth [ $ \frac{3}{2}{f}_2 $ ]). Each note is composed of six harmonics (e.g., for the root note, harmonics $ {f}_{2_i}\in \left\{{f}_2,2{f}_2,3{f}_2,4{f}_2,5{f}_2,6{f}_2\right\} $ with the corresponding amplitudes $ {a}_{2_i}\in \left\{\mathrm{1,0.4,0.4,0.1,0.1,0.1}\right\} $ ),

(2) $$ {C}_2(t)\hskip0.35em =\hskip0.35em \sum \limits_{i\hskip0.35em =\hskip0.35em 1}^6{a}_{2_i}\left(\sin \left(2\pi {f}_{2_i}t\right)+\sin \left(2\pi \frac{5}{4}{f}_{2_i}t\right)+\sin \left(2\pi \frac{3}{2}{f}_{2_i}t\right)\right). $$

1. (iii) $ {C}_3 $ , the first noise component, is built as a sum of 150 sines with random phase and frequency,

(3) $$ {C}_3(t)\hskip0.35em =\hskip0.35em \sum \limits_{i\hskip0.35em =\hskip0.35em 1}^{150}\sin \left(2\pi {f}_{3_i}t+{\phi}_{3_i}\right), $$

with $ {f}_{3_i}\in \left[0,2{f}_3\right] $ and $ {\phi}_{3_i}\in \left[0,2\pi \right] $ .

1. (iv) $ {C}_4 $ , the second noise component, is identical to $ {C}_3 $ , but with another frequency range. The frequency $ {f}_4 $ is chosen so that $ {C}_4 $ has a wider frequency range than $ {C}_3 $ ,

(4) $$ {C}_4(t)\hskip0.35em =\hskip0.35em \sum \limits_{i\hskip0.35em =\hskip0.35em 1}^{150}\sin \left(2\pi {f}_{4_i}t+{\phi}_{4_i}\right), $$

with $ {f}_{4_i}\in \left[0,2{f}_4\right] $ and $ {\phi}_{4_i}\in \left[0,2\pi \right] $ .

The resulting sound $ s(t) $ is the weighted sum of these four components, to which amplitude modulation is applied, with modulation index $ m $ and modulation frequency $ {f}_m $ :

(5) $$ s(t)\hskip0.35em =\hskip0.35em (1+m\cdot \mathrm{sin}(2{\pi f}_mt))\cdot ({a}_1\cdot {C}_1(t)+{a}_2\cdot {C}_2(t)+{a}_3\cdot {C}_3(t)+{a}_4\cdot {C}_4(t)). $$

The four amplitude coefficients $ {a}_i $ are normalised so that

(6) $$ \sqrt{\sum \limits_{i\hskip0.35em =\hskip0.35em 1}^4{a}_i^2}\hskip0.35em =\hskip0.35em 1, $$

and the ratio between $ {a}_3 $ and $ {a}_4 $ is chosen equal to $ 0.5 $ .

Figure 2 illustrates each component by showing spectrograms (representation of the evolution of the spectrum of the signal with respect to time) of a sample, for a vehicle driving at constant speed. The horizontal stripes in the top spectrograms denote a harmonic structure made of pure sinusoids, whereas the wide horizontal bands in the bottom plots indicate noise. There is no variation over the horizontal axis, because the sounds are stationary, apart from a short fade in and fade out. Example of sounds can be listened to at https://mathieulagrange.github.io/souaille2021interactive/.

Figure 2.

Spectrograms of the four synthesiser components, without amplitude modulation. Top-left: $ {C}_1 $ motor sound, with $ {f}_1=200 $  Hz. Top-right: $ {C}_2 $ chord sound, with $ {f}_2=300 $  Hz. Bottom-left: $ {C}_3 $ first noise, with $ {f}_3=200 $  Hz. Bottom-right: $ {C}_4 $ second noise, with $ {f}_4=600 $  Hz. The brighter the colour, the more power there is in the corresponding time–frequency bin.

The definition of the structure of the synthesised sound and the choice of the variables is the result of many tests, innovative proposals and sound engineering experience of the authors. A complete justification is out of the scope of this paper, the contribution being centred on the optimisation of a given parameterised synthesiser. It is out of the scope of this paper to describe all the parameters of the synthesiser (there are more than 70 independent parameters to define a sound). We can mention that all the frequencies and amplitudes of the components are adjustable, to create credible and original sounds. The synthesiser is controlled by the speed of the car. In this study, this parameter is irrelevant given that the listening tests are made with a constant speed of the car. Readers interested by the design of synthesised QV sounds may consult Pedersen et al. (Reference Pedersen, Gadegaard, Kjems and Skov2011) or Petiot et al. (Reference Petiot, Kristensen and Maier2013) for more information on the evolution of the sound according to speed.

Among the different synthesis parameters of the sounds, it is necessary to define the optimisation variables of the problem, that is, the variables that are manipulated by the IGA and coded in the genome (design space of the genetic code). After several experiments, the following six factors (A, B, C, D, E and F), and their corresponding levels (A1 for Level 1 of Factor A), are chosen to get a large diversity of sounds (see Table 1). These factors control the frequency content and the amplitudes of the synthesiser components, as well as the amplitude and frequency of the amplitude modulation. The choice of the factors is motivated by previous findings showing that harmonic complexity and amplitude modulation are related to detectability (Parizet et al. Reference Parizet, Ellermeier and Robart2014).

Table 1.

Description of the design factors manipulated by the IGA. The values correspond to a speed vehicle of 20 km/hour.

Furthermore, it has been shown that the preference for an EV sound can be related to how similar it is to an ICE car sound (Petiot et al. Reference Petiot, Kristensen and Maier2013). To take that into account, the synthesis method is able to create sounds that resemble more or less an ICE car sound, depending on the value of Factor A. The setting of the levels of the factors required many adjustments (not reported here) to obtain audible differences between sounds, but with still ‘convenient’ sounds. The values of the levels correspond to a speed of 20 km/hour (the speed used for the listening test).

Figure 3 shows the spectrogram of two examples of QV sounds with a constant speed of 20 km/hour, with amplitude modulation, which results in alternating brighter and darker vertical bands. The levels of the factors for these examples are (A3, B4, C3, D4, E2, F4) (left) and (A2, B3, C4, D2, E3, F3) (right). For the first one, this corresponds to:

1. (i) $ {a}_1\hskip0.35em =\hskip0.35em 0.4 $ , $ {a}_2\hskip0.35em =\hskip0.35em 0.8 $ , $ {a}_3\hskip0.35em =\hskip0.35em 0.2 $ and $ {a}_4\hskip0.35em =\hskip0.35em 0.4 $ (from A3 and C3);

2. (ii) $ {f}_1\hskip0.35em =\hskip0.35em 200 $  Hz, $ {f}_2\hskip0.35em =\hskip0.35em 300 $  Hz, $ {f}_3\hskip0.35em =\hskip0.35em 200 $  Hz and $ {f}_4\hskip0.35em =\hskip0.35em 600 $  Hz (B4);

3. (iii) Five harmonics for the motor and five for the chord (D4);

4. (iv) $ {f}_m\hskip0.35em =\hskip0.35em 2 $  Hz and $ m\hskip0.35em =\hskip0.35em 50 $ % (E2 and F4).

Figure 3.

Spectrogram of the complete sounds synthesised with parameters (A3, B4, C3, D4, E2, F4) (left) and (A2, B3, C4, D2, E3, F3) (right) with a constant speed vehicle (addition of the four synthesised components, with amplitude modulation).

For the second one, this corresponds to:

1. (i) $ {a}_1\hskip0.35em =\hskip0.35em 0.89 $ , $ {a}_2\hskip0.35em =\hskip0.35em 0.45 $ , $ {a}_3\hskip0.35em =\hskip0.35em 0 $ and $ {a}_4\hskip0.35em =\hskip0.35em 0 $ (from A2 and C4);

2. (ii) $ {f}_1\hskip0.35em =\hskip0.35em 160 $  Hz, $ {f}_2\hskip0.35em =\hskip0.35em 240 $  Hz, $ {f}_3\hskip0.35em =\hskip0.35em 160 $  Hz and $ {f}_4\hskip0.35em =\hskip0.35em 480 $  Hz (B3);

3. (iii) One harmonic for the motor and five for the chord (D2);

4. (iv) $ {f}_m\hskip0.35em =\hskip0.35em 5 $  Hz and $ m\hskip0.35em =\hskip0.35em 33 $ % (E3 and F3).

3.2. Listening test scenario

The experiment aims at evaluating the unpleasantness and the detectability of QV sounds. To this end, the following scenario is considered: a pedestrian, standing on the sidewalk of a street, waits before crossing (see Figure 4). A QV may pass by, coming either from the right or from the left. The listener is static, and must indicate when he/she detects the QV. For all the passages, the speed of the car is kept constant (20 km/hour) and the direction of the car is randomly chosen as left or right.

Figure 4.

Passing-by scenario for the listening test: pedestrian located on the sidewalk of a street.

To improve the realism of the test, the car sound is mixed with a urban environment background, made from a stereo street recording of a busy intersection in Paris, France. To be used as background noise, the soundscape must be amorphous (Maffiolo Reference Maffiolo1999) and not contain any perceivable emergent event (horns, car passing etc.; Kerber & Fastl Reference Kerber and Fastl2008). For this, distracting sounds and close vehicle sounds that could be mistaken for the QV warning sound to evaluate are edited out of the recording. To avoid the potential fatigue of the participant due to the repetition of the exact same background noise during the test, the part of the audio file selected (around 10 seconds) is randomly chosen among the 42-second long recording.

To increase the level of immersion of the listener, and to obtain a more realistic passing-by scenario, the following properties have been implemented for the design of the sound stimuli:

1. (i) The sound level of the QV is modulated according to the vehicle/listener distance. The model used, based on acoustic theory, considers the QV as a monopole and provides a sound level inversely proportional to the distance to the listener ( $ \frac{1}{r} $ ; see Figure 5).

2. (ii) The Doppler effect is simulated with a shifting in frequency due to the moving source.

3. (iii) The left/right panning of the QV sound is controlled in such a way that the source goes progressively from one canal (left or right, depending of the direction of the QV) to the other (right or left) according to the position of the vehicle. The amplitude panning is controlled using a sine law (Pulkki Reference Pulkki2001).

Figure 5.

Timeline of the mix of the background and the quiet vehicle (QV) sound, with their respective amplitude-level evolution (the x-axis represents indifferently the time or the distance of the QV, given that the speed of the vehicle is constant). Note the asymmetry of the amplitude relatively to the listening point.

For the sake of simplicity, the simulation does not include other sound sources, such as tire noise.

In order to reduce the duration of each evaluation, the attenuation function of the QV sound is asymmetrical (reduction in $ \frac{1}{r^2} $ once the car passed in front of the listener), as in Misdariis et al. (Reference Misdariis, Gruson and Susini2013), that is, the attenuation is faster than the increase of the sound level. This choice does not affect the detectability of the QV sound, which always occurs in the approach phase. We assume that this asymmetry does not have any effect on the assessments of unpleasantness.

The scenario’s timeline is shown in Figure 5. The total duration of each sound stimulus is around 10 seconds.

Figure 6 shows the spectrogram of the previous QV sound (A3, B4, C3, D4, E2, F4; Figure 3), now spatialised and mixed with the background noise. The masking of the warning sound by the background is illustrated by the fact that the horizontal stripes only appear some time after $ {t}_1 $ . The shifting in frequency, due to the Doppler effect, is visible after time $ {t}_3 $ , corresponding to the listener position. The sound can be listened to at https://mathieulagrange.github.io/souaille2021interactive/.

Figure 6.

Spectrogram of an example of a quiet vehicle sound, spatialised and mixed with the background. Time $ {t}_1 $ is the time at which the vehicle warning sound starts, and time $ {t}_3 $ is the moment the vehicle passes in front of the listener. The horizontal stripes correspond to the harmonic content of the warning sound, progressively emerging from the background.

3.3. Test procedure and interface

The participants listened to the scenarios using computers and Beyerdynamics DT-990 headphones. The sound level was calibrated so that the background sound is around 69 dBA, when measured with a sound-level meter at the headphone’s output. This level was chosen to be consistent with the dBA level measured during the recording of the background. The warning sound level relative to the background was manually adjusted to avoid having too many sounds detected too early or too late. The mean levels of the warning sounds ranged from 59 dBA to 80 dBA, with 95% of the sounds in the design space having values above 68 dBA (5th percentile).

The interface for the assessments of the QV sound is shown in Figure 7. After clicking on the ‘Select’ button, which launches the synthesis of the sound, participants had to strike the ‘space bar’ to start playing the sound. This corresponds to the definition of time $ {t}_0 $ (see Figure 5). Next, they had to strike on the keyboard the ‘a’ key as soon as they detect the QV coming from the left, or the ‘e’ key if it is coming from the right (French AZERTY keyboard). This strike allows the definition of the detection time $ {t}_2 $ . To avoid habituation of the participant in the detection time (and detect inconsistent subjects), the starting time $ {t}_1 $ of the QV sound in the mixture was variable, randomly chosen in the interval [1, 3] seconds. Of course, given this small interval, the event is highly predictable. A larger interval was not reasonable, as it would have increased the duration of the test. Hence, the protocol provides an estimate of the lower bound of the detection time, because it is clear that in real-life situation, when people do not wait for the arrival of a car, the detection time would be larger. This lower bound of the detection time is considered as representative of the detectability of the sound of the car.

Figure 7.

Interface for the assessment of the detectability and the unpleasantness of a quiet vehicle sound (structured rating scale).

The detection time is then given by

(7) $$ {D}_t\hskip0.35em =\hskip0.35em {t}_2-{t}_1. $$

If the subject pressed a key before the vehicle warning sound is actually playing, that is, before $ {t}_1 $ , the detection time of the sound is changed by default to an arbitrary value (average between the minimum and maximum possible values for the detection time [ $ \frac{t_1+{t}_3}{2} $ ]), and a warning was recorded. If the car was not detected or detected too late, that is, after time $ {t}_3 $ , the detection time was set to $ {t}_3 $ , that is, the time at which the car passes in front of the subject, and a warning was recorded. If the subject made a mistake when assessing the arrival direction of the car, no action was taken, but a warning was recorded. This random change in the direction of the car is very important in the protocol to be able to detect ‘false alarms’ or ‘wrong detections’, in order to check the reliability of the assessments. The detection time can be converted into the distance to pedestrian using $ V $ , the speed of the car. The distance to pedestrian $ {D}_p $ at the time of the detection is then given by

(8) $$ {D}_p\hskip0.35em =\hskip0.35em \left({t}_3-{t}_2\right)\times V. $$

With the distance to pedestrian, a safety zone can be defined given the stopping distance of the car. The stopping distance of a car on a dry road is around 7.5 m at 20 km/hour. Thus, distances to pedestrian $ {D}_p $ lower than 7.5 m are considered as dangerous. This corresponds to a detection time $ {D}_t $ greater than 4.05 seconds.

After listening to the sound clip, the participants had to evaluate the unpleasantness of the sound on a continuous structured semantic scale going from ‘0’ (‘Not at all unpleasant’) to ‘10’ (‘Very unpleasant’) using a slider as shown in Figure 7. To explain the semantic dimension of unpleasantness, the following information is given to the participants. ‘If the car passed by your house during a calm moment, how unpleasant would the sound be?’

Participants were able to replay the stimuli to assess the unpleasantness (as many times as required), but not to assess detectability. Indeed, they had already heard the sound and knew the direction of arrival of the car.

In the beginning of the test, the subjects were presented with a tutorial, so that they could familiarise themselves with the interface and understand which type of sounds they should pay attention to.

4.1. Materials and method

For the first experiment, 32 students (16 males and 16 females) from the École Centrale de Nantes, France, with no reported auditory deficiencies, used the IGA procedure. They evaluated 11 generations of 9 sounds (99 sounds), which took approximately half an hour. Values of $ {m}_r\hskip0.35em =\hskip0.35em 0.7 $ , $ {c}_r\hskip0.35em =\hskip0.35em 0.25 $ and $ {s}_r\hskip0.35em =\hskip0.35em 0.05 $ were used for the IGA. A high mutation rate is chosen, to preserve diversity in spite of the small number of individuals per generation and to avoid premature convergence. At the end of the test, for each participant, the following information is available:

1. (i) the set of Rank 1 sounds of the register at the last generation, that constitutes Pareto optimal solutions;

2. (ii) all the sounds assessed during the 11 generations.

Linear model of detectability and unpleasantness

To study the influence of the design factors of the sounds on the detectability and the unpleasantness, a linear model without interactions is fitted to the data. For all participants, all sounds generated during the IGA experiments are used for the modelling (union of all the sounds assessed during the 11 generations). The model corresponds to a linear mixed model (similar to an analysis of variance [ANOVA]), with the six factors A, B, C, D, E and F with a fixed effect and the factor ‘subject’ with a random effect (Khuri, Mathew & Sinha Reference Khuri, Mathew and Sinha1998). The model is given by

(9) $$ {y}_{ijklmnop}\hskip0.70em =\hskip0.70em \mu +{A}_i+{B}_j+{C}_k+{D}_l+{E}_m+{F}_n+{S}_o+{\varepsilon}_{ijklmnop} $$

with:

1. (i) $ {y}_{ijklmnop} $ : detection time, or unpleasantness rating, for the observation $ p $ of the sound $ \left({A}_i,{B}_j,{C}_k,{D}_l,{E}_m,{F}_n\right) $ by participant $ {S}_o $ ;

2. (ii) $ \mu $ : intercept;

3. (iii) $ {A}_i $ : coefficient of the level $ i $ of factor $ A $ , with $ {\mathrm{sum}}_i{A}_i\hskip0.35em =\hskip0.35em 0 $ (centred parameterisation). The other coefficients correspond obviously to factors B, C, D, E and F;

4. (iv) $ {S}_o $ : coefficient of the subject $ o $ ;

5. (v) $ {\varepsilon}_{ijklmnop} $ : error term, $ \varepsilon \sim N\left(0,{\sigma}^2\right) $ .

The determination coefficients $ {R}^2 $ of the models are examined, together with the importance of the factors and their effect using the Fisher significance test. The percentage of importance $ {I}_j $ of factor $ A $ in the model is given by

(10) $$ {I}_A\left(\%\right)\hskip0.35em =\hskip0.35em \frac{\max_i\left({A}_i\right)-{\min}_i\left({A}_i\right)}{\sum_{M\in A,B,C,D,E,F}\left({\max}_k\left({M}_k\right)-{\min}_k\left({M}_k\right)\right)}. $$

Expressions are similar for the other factors.

Two models are fitted to the data, one for detection time and one for unpleasantness. An analysis of the parameters of the model is made in order to understand the main effects of the factors on the detectability and the unpleasantness.

Definition of the ‘best’ individual sound $ {\boldsymbol{IGA}}_{\boldsymbol{opt}}^{\boldsymbol{i}} $

The following method has been set to define a unique QV sound, labelled $ {IGA}_{opt}^i $ , for each participant $ i $ . The first stage is to discard solutions of the Pareto set that are too extreme according to one of the objectives. Among the solutions of the individual Pareto set, solutions for which the detection time was above 4.05 seconds were rejected (detection time below the safety zone; see Section 3.3). Similarly, solutions with a very high unpleasantness relative to the unpleasantness range used by the participant were rejected. To do so, a min-max normalisation of the participant’s unpleasantness evaluations was performed, and the sounds in the upper third of the resulting range were withdrawn.

The second stage consists in the definition of a unique sound. With the remaining sounds, for each participant $ i $ , the TOPSIS method (Technique for Order of Preference by Similarity to Ideal Solution; Hwang & Yoon Reference Hwang and Yoon1981) was used to select a unique optimal sound, $ {IGA}_{opt}^i $ . The first step of this method is to build a matrix $ {x}_{kj} $ from the remaining sounds’ objective values, where each row corresponds to a sound $ k $ and each column corresponds to an objective (in our case, $ j\hskip0.35em =\hskip0.35em 2 $ ). Then, each column of $ {x}_{kj} $ is normalised by $ {\sum}_k{x}_{kj}^2 $ and multiplied by a weight. In our case, we give an equal weight of 0.5 to each objective. Two ideal solutions are then defined:

1. (i) the positive ideal solution (PIS) which has, for each objective, the lowest value taken by the solutions in the considered group, meaning that $ PIS\hskip0.35em =\hskip0.35em \left\{\min \left({x}_{k1}\right),\min \left({x}_{k2}\right)\right\} $ ;

2. (ii) the negative ideal solution (NIS) which has, for each objective, the highest value taken by the solutions in the considered group, meaning that $ PIS\hskip0.35em =\hskip0.35em \left\{\max \left({x}_{k1}\right),\max \left({x}_{k2}\right)\right\} $ .

After computing the Euclidean distance between each solution and the PIS and the NIS, respectively, called $ {d}_{PIS} $ and $ {d}_{NIS} $ , the following distance is computed:

(11) $$ distance\hskip0.35em =\hskip0.35em \frac{d_{NIS}}{d_{NIS}+{d}_{PIS}}. $$

The chosen optimal solution $ {IGA}_{opt}^i $ of participant $ i $ is the one that maximises this distance, which equals 1 if the sounds happen to be the PIS and 0 if it is the NIS.

This process allows the definition of individual optimal sounds $ {IGA}_{opt}^i $ , one for each participant $ i $ .

Analysis of $ Optimalset $ , the set of Pareto optimal solutions

The union, for all the participants, of all the individual Pareto solutions is formed. This set, labelled $ Optimalset $ , represents a selection of QV sounds that, from a perceptual point of view, make a satisfying trade-off between detectability and unpleasantness for the participants. To provide information that could be used as recommendations for a sound designer, an analysis of these sounds according to the most occurring factor-level combinations is conducted.

To draw design recommendations, the principle of the method is to consider the selection process of the designs made during the IGA experiment as a random process that depends on a discrete probability distribution. The set $ Optimalset $ , of size $ N $ , is a subset of the sample space $ \Omega $ (full factorial design). From the chosen designs in $ Optimalset $ , estimates of the parameters of the probability distribution can be calculated. And with these parameters, it becomes possible to make inferences and provide a probability score for any design of the design space.

Joint probability

Given the sample space $ \Omega $ (set of all possible designs of the design space), and the design variables $ {X}_i $ , (i = 1–6) that describe the design, the first model that can be made is to assume that the choice of the designs in $ Optimalset $ depends on all the variables and all their possible interactions. In this case, the probability distribution of the selection process of any design $ d $ defined by the design variables $ {X}_i $ , (i = 1–6), $ d\hskip0.35em =\hskip0.35em ({X}_1\hskip0.35em =\hskip0.35em {x}_1,\hskip0.35em {X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, \hskip0.35em {X}_6\hskip0.35em =\hskip0.35em {x}_6) $ by the IGA experiments is given by the joint probability:

(12) $$ P\left(D\hskip0.35em =\hskip0.35em d\right)\hskip0.35em =\hskip0.35em P\left({X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, {X}_6\hskip0.35em =\hskip0.35em {x}_6\right)\hskip0.35em =\hskip0.35em \frac{\mathit{\operatorname{card}}\left\{D\hskip0.35em \in \hskip0.35em Optimalset/D\hskip0.35em =\hskip0.35em d\right\}}{\mathit{\operatorname{card}}(Optimalset)}, $$

where $ \mathit{\operatorname{card}} $ represents the cardinality of a set (number of elements). For example, if a design is present once in $ Optimalset $ , its probability is $ P\hskip0.35em =\hskip0.35em \frac{1}{\mathit{\operatorname{card}}(Optimalset)} $ .

If it is not chosen, its probability is $ P\hskip0.35em =\hskip0.35em 0 $ . This six-dimension joint probability is not so interesting to make design recommendations because it is only able to recommend designs that are present (and abundant) in $ Optimalset $ . To be able to make recommendations on the levels of the design variables $ {X}_i $ , it is necessary to make assumptions on the independence of the variables in the selection process.

Marginal probability

If we consider that the variables $ {X}_i $ ( $ i\hskip0.35em =\hskip0.35em 1 $ – $ 6 $ ) are mutually independent in the selection process (no interaction between them), then the probability distribution of the selection process of any design $ d\hskip0.35em =\hskip0.35em ({X}_1\hskip0.35em =\hskip0.35em {x}_1,\hskip0.35em {X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, \hskip0.35em {X}_6\hskip0.35em =\hskip0.35em {x}_6) $ becomes

(13) $$ P\left({X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, {X}_6\hskip0.35em =\hskip0.35em {x}_6\right)\hskip0.35em =\hskip0.35em \prod \limits_{i\hskip0.35em =\hskip0.35em 1}^6P\left({X}_i\hskip0.35em =\hskip0.35em {x}_i\right). $$

When the variables are mutually independent, the joint probability is simply the product of the marginal probabilities, where

(14) $$ P\left({X}_i\hskip0.35em =\hskip0.35em {x}_i\right)\hskip0.35em =\hskip0.35em \frac{\mathit{\operatorname{card}}\left\{D\hskip0.35em \in \hskip0.35em Optimalset/{X}_i\hskip0.35em =\hskip0.35em {x}_i\right\}}{\mathit{\operatorname{card}}(Optimalset)}. $$

In this case, the design with the largest probability, that is, the one that should be recommended, is the design with the most occurring level for each variable. Of course, the mutual independence of all the variables is a very strong assumption that only holds if there is no interaction between the variables in the selection process (in the perception of participants). This is rather unlikely in design where the global assessment of a product may be different to the sum of the assessments of each of its variables (Sylcott, Michalek & Cagan Reference Sylcott, Michalek and Cagan2015).

Independence checking of the variables

Between the two previous methods that have limited applicability for making design recommendations, it is interesting to propose a model that is based on assumptions concerning the independence of the variables in the selection process that can be checked. Our proposal is to check, with a statistical test, the independence of any pairs of variables in $ Optimalset $ . We propose to use the chi-square independence test to determine whether there is a significant association between two qualitative variables. For example, suppose that the pairwise independence test shows that the two groups of variables $ \left\{{X}_1,{X}_2,{X}_3\right\} $ and $ \left\{{X}_4,{X}_5,{X}_6\right\} $ are independent. Then, from this information, it is possible to simplify the expression of the joint probability and get the probability distribution of the selection process for any design $ d\hskip0.35em =\hskip0.35em \left({X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, {X}_6\hskip0.35em =\hskip0.35em {x}_6\right) $ , given by

(15) $$ {\displaystyle \begin{array}{l}P\left({X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, {X}_6\hskip0.35em =\hskip0.35em {x}_6\right)\hskip0.35em =\hskip0.35em P\left({X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,{X}_3\hskip0.35em =\hskip0.35em {x}_3\right)\\ {}\hskip16.24em .P\left({X}_4\hskip0.35em =\hskip0.35em {x}_4,{X}_5\hskip0.35em =\hskip0.35em {x}_5,{X}_6\hskip0.35em =\hskip0.35em {x}_6\right),\end{array}} $$

where

(16) $$ P\left({X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,{X}_3\hskip0.35em =\hskip0.35em {x}_3\right)\hskip0.35em =\hskip0.35em \frac{\mathit{\operatorname{card}}\left\{D\hskip0.35em \in \hskip0.35em Optimalset/{X}_1\hskip0.35em =\hskip0.35em {x}_1,{X}_2\hskip0.35em =\hskip0.35em {x}_2,{X}_3\hskip0.35em =\hskip0.35em {x}_3\right\}}{\mathit{\operatorname{card}}(Optimalset)}, $$

(17) $$ P\left({X}_4\hskip0.35em =\hskip0.35em {x}_4,{X}_5\hskip0.35em =\hskip0.35em {x}_5,{X}_6\hskip0.35em =\hskip0.35em {x}_6\right)\hskip0.35em =\hskip0.35em \frac{\mathit{\operatorname{card}}\left\{D\hskip0.35em \in \hskip0.35em Optimalset/{X}_4\hskip0.35em =\hskip0.35em {x}_4,{X}_5\hskip0.35em =\hskip0.35em {x}_5,{X}_6\hskip0.35em =\hskip0.35em {x}_6\right\}}{\mathit{\operatorname{card}}(Optimalset)}. $$

It is then possible to calculate the probabilities of all the designs $ d\hskip0.35em =\hskip0.35em ({X}_1\hskip0.35em =\hskip0.35em {x}_1,\hskip0.35em {X}_2\hskip0.35em =\hskip0.35em {x}_2,\dots, \hskip0.35em {X}_6\hskip0.35em =\hskip0.35em {x}_6) $ of the design space.

It is important to note that if all the variables are dependent (conjoint graph), the recommendations are simply the list of designs of $ Optimalset $ .

Recommended designs

A ranking of the design space by decreasing probability allows the definition of the ‘best’ designs, that is, the designs with the largest probabilities, to be recommended. Some of them are of course present in $ Optimalset $ , but it is likely that designs that are not present in $ Optimalset $ will get a high probability, and be interesting for the design problem. These designs may possess interesting characteristic combinations that explain their presence in the Pareto set. A set of eight sounds (labelled reco1 to reco8) that get the highest probability score is proposed as recommended designs. They will be compared to other designs in Experiment 3.

5.1. Materials and method

One week after Experiment 1 (time to analyse the results), the second experiment was proposed to the participants of Experiment 1. Twenty-four out of the 32 previous subjects re-evaluated their own optimal solution $ {IGA}_{opt}^i $ , as well as two designed sounds ( $ design1 $ and $ design2 $ ) and four random sounds ( $ rand1 $ , $ rand2 $ , $ rand3 $ and $ rand4 $ ).

The designed sounds were proposed by a skilled person having a thorough knowledge of the possibilities offered by the synthesiser (T.S., one of the co-authors). These designs were intended to be good compromises between unpleasantness and detection time while having a different timbre with respect to one another. They were designed by tuning the parameters of the synthesiser while listening to its output, without prior information on the preferences of the test group. This allowed the designer to develop an intuition of how the design parameters related to his own perception of unpleasantness and detectability. The designer tried to find areas of the design space where a small change in parameters would make the sound either too unpleasant or not detectable enough. The sound $ design1 $ is high pitched, with a small number of harmonics, no noise content and no amplitude modulation. Its parameter values are (A2 B4 C4 D2 $ \mid $ E1 F1). The sound $ design2 $ is pitched slightly lower, with just noise and fast, low amplitude modulation. Its parameter values are (A1 B3 C1 D1 $ \mid $ E4 F2).

In addition to these two designed sounds, four random sounds ( $ rand1 $ , $ rand2 $ , $ rand3 $ and $ rand4 $ ) are generated by a random generation in the design space based on a Latin Hypercube Sampling. Those sounds are taken as baseline to judge the relative performances of the other sounds, designed and $ IGA $ . The sounds can be listened to at https://mathieulagrange.github.io/souaille2021interactive/.

All subjects evaluated the same designed and random sounds, together with their own optimum $ {IGA}_{opt}^i $ . All the assessments were repeated four times to stabilise variance. Thus, each participant had to evaluate 7 × 4 = 28 sounds, presented one at a time (one per page in the interface), in a random order. For each evaluation, the interface was identical and there was no indication regarding which sound is being evaluated.

First, in order to assess the ability of subjects to perceive differences (intra-individual variability compared to inter-sounds variability), a one-way ANOVA (with the factor type of sounds) was done for each subject and each objective (omnibus test).

The sounds were next compared using two criteria:

1. (i) Their membership to the Pareto front, based on their mean unpleasantness and detection time. This does not include any statistical test.

2. (ii) The statistical significance of the pairwise differences between the mean unpleasantness values, for all pairs of sounds. Likewise for the detection time. Tukey’s HSD (Honestly Significant Difference) test was used to assess these differences for each pair of sounds among $ {IGA}_{opt}^i $ , $ design1 $ , $ design2 $ , $ rand1 $ , $ rand2 $ , $ rand3 $ and $ rand4 $ .

6.1. Materials and method

In this experiment, a second panel of subjects (different from the previous panel) is asked to assess the detectability and unpleasantness of different QV sound proposals, including the recommended designs obtained with the method described previously (see the ‘Recommended designs’ and ‘Design recommendations’ sections). Seventeen students (14 males and 3 females) from the École Centrale de Nantes, France, with no reported auditory deficiencies, participated to the test with the protocol described previously. Eighteen QV sounds were proposed to the evaluation:

1. (i) Eight sounds ( $ rand1 $ to $ rand8 $ – category $ Random $ ) randomly defined in the experimental space. $ rand1 $ to $ rand4 $ are the same random sound as in Experiment 2.

2. (ii) Two sounds ( $ design1 $ and $ design2 $ – category $ Designed $ ), designed by a sound designer with instructions for ‘good detectability’ and ‘low unpleasantness’. These sounds are the same as those of Experiment 2.

3. (iii) Eight sounds ( $ reco1 $ to $ reco8 $ – category $ Recommended $ ), recommended by the method described in the previous section (sounds with the largest probability according to the selection process).

To be able to assess the experimental variability in the assessments, four repetitions of each sound were proposed. In total, each participant had to assess 72 (18 × 4) QV sounds, proposed in a randomised order. The performances of each pair of sounds were compared using Tukey’s HSD Multiple Comparison test. Just like for Experiment 2, the intra-individual variability was assessed with two ANOVAs for each subject, one for unpleasantness and one for detection time.

The sounds were compared using the same two criteria as for Experiment 2 (Membership to the Pareto front and multiple comparison tests).

7.1. Method

The different stages for the definition and the analysis of the three experiments are summarised in Figure 18. The flowchart presents the linking of the different stages, and the analysis of the results to address the research questions Q1 and Q2:

1. (i) Experiment 2 allows the addressing of question Q1, with a comparison at the individual level of the performances of the IGA sounds for detectability and unpleasantness;

2. (ii) Experiment 3 allows the addressing of question Q2, with a comparison of the performances of the recommended sounds for detectability and unpleasantness with an external panel of participants.

Figure 18.

Overview of the flowchart for the analysis of Experiments 1–3.

8.1. Sound level

Even though a study of the acoustical properties of the sounds is out of the scope of this paper, it is important to note that the sounds were not equalised in loudness during the experiments. Since perceived loudness is expected to be an important factor for unpleasantness and detectability, an analysis of the A-weighted equivalent continuous sound level $ {L}_{Aeq} $ of the evaluated warning sounds was done for each experiment. More specifically, the correlation between $ {L}_{Aeq} $ and the two objectives was calculated, based on the raw evaluations of the subjects, after eliminating outliers. The computation of $ {L}_{Aeq} $ is provided in the following equation:

(19) $$ {L}_{Aeq}\hskip0.35em =\hskip0.35em 10\log \left(\frac{1}{t_2-{t}_1}{\int}_{t_1}^{t_2}\frac{p_A^2}{p_{ref}^2}\right), $$

where $ {t}_1 $ and $ {t}_2 $ are, respectively, the beginning and the end of the signal, $ {p}_A $ is the instantaneous A-weighted sound pressure and $ {p}_{ref} $ is the reference sound pressure of $ 20\times {10}^{-6} $ Pascals.

Table 7 shows the Pearson’s correlation coefficients $ \rho $ between the subjects’ evaluations and $ {L}_{Aeq} $ for all three experiments. It shows a significant positive correlation between unpleasantness and $ {L}_{Aeq} $ , as well as a significant negative correlation between detection time and $ {L}_{Aeq} $ . These results confirm a general trend that, on average, the louder a sound is, the faster it is to detect and the more unpleasant it becomes, which is expected.

Table 7.

Pearson’s correlation coefficients between $ {L}_{Aeq} $ and the two objectives, computed from all subjects’ evaluations, without any pre-processing. All coefficients are statistically significant ( $ p<0.001 $ ).

However, the sound level is not a relevant explicating factor. For example, the $ {L}_{Aeq} $ is equal to 77 dB for $ rand2 $ and 75 dB for $ reco2 $ , but $ \mathit{\operatorname{rand}}2 $ is significantly less unpleasant (Figure 13) and significantly less detectable (Figure 14) than $ reco2 $ . To better explain the differences between the sounds, spectral information should be considered. The sound level alone would be insufficient to make design recommendations.

8.2. QV sound design using an IGA

The first experiment showed that an IGA can be used to interactively explore a sound design space and to define efficient solutions for a bi-objective optimisation problem. This is consistent with previous studies showing the application of IGAs as interactive design tools to address complex perceptual dimensions or affordances (Brintrup et al. Reference Brintrup, Ramsden, Takagi and Tiwari2008; Mata et al. Reference Mata, Fadel, Garland and Zanker2018). In particular, when the two dimensions are conflicting, an IGA may provide efficient designs because interactions between variables are integrated during the interactive solutions search. The linear models without interactions fitted to the data showed opposite effects of the factors on the two objectives, making them ineffective for delivering relevant recommendations.

We believe that an IGA is not intended to replace a designer. Rather, the method could be seen as a complementary tool to assist the work of a sound designer, when the perceptual dimensions are complex or even conflicting. A designer can, for example, perform Experiment 1, in order to get a set of Pareto optimal solutions. These solutions could be considered as ‘presets’ of the sound synthesis method, that could be next ‘fine-tuned’ by the designer, using additional constraints. For QV sounds, constraints related to the brand identity may be, for example, particularly important. This idea is similar to the concept of ‘perceptually relevant presets’ of a musical synthesiser, presented in Roche (Reference Roche2020). The diversity of the proposals on the Pareto front is also a strong point of the method, in order for the designer to propose several prototypes to stakeholders. In a customisation perspective of the QV sound, it could also be interesting to present to customers via a Web interface a way to customise the sound of their vehicle using IGA. In this study, we did not take into account legal or technical considerations regarding the design. An important advantage of the proposed approach is that those constraints can easily be included in the optimisation process, either directly in the sound synthesis method, or as optimisation constraints.

8.3. Design recommendation method