Hostname: page-component-77f85d65b8-6c7dr Total loading time: 0 Render date: 2026-03-28T14:38:33.368Z Has data issue: false hasContentIssue false

Multi-model workload specifications and their application to cyber-physical systems

Published online by Cambridge University Press:  03 May 2024

A response to the following question: Time-Sensitive Software

Alan Burns*
Affiliation:
The University of York, York, UK
Sanjoy Baruah
Affiliation:
Washington University in St. Louis, St. Louis, WA, USA
*
Corresponding author: Alan Burns; Email: alan.burns@york.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

To address the question of how to deliver time-sensitive software for cyber-physical systems (CPS) requires a range of modelling and analysis techniques to be developed and integrated. A number of these required techniques are unique to time-sensitive software where timeliness is a correctness property rather than a performance attribute. This paper focuses on how to obtain worst-case estimates of the software’s execution time; in particular, it considers how workload models are derived from assumptions about the system’s run-time behaviour. The specific contribution of this paper is the exploration of the notion that a system can be subject to more than one workload model. Examples illustrate how such multi-models can lead to improved schedulability and hence more efficient CPS. An important property of the approach is that the derived analysis exhibits model-bounded behaviour. This ensures that the maximum load on the system is never higher than that implied by the individual models.

Information

Type
Results
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press
Figure 0

Figure 1. The top diagram depicts system execution as a mapping from a set ${\cal A}$ of assumed behaviours of its environment to a set ${\cal O}$ of system behaviours that fulfils its obligations. The middle diagram depicts a mixed-criticality system in which the sets of assumptions and obligations satisfy a subset/ super-set relationship. And the bottom diagram depicts the execution of multi-model systems with overlapping integrated assumptions and obligations.

Figure 1

Table 1. Workload model for when ${\cal A}1$ applies

Figure 2

Table 2. Workload model for when ${\cal A}2$ applies

Figure 3

Table 3. Single Workload model for when ${\cal A}$ applies

Figure 4

Table 4. Workload model for when ${\cal A}0$ applies

Figure 5

Figure 2. The three states of the example system, together with the maximum number of Dogs and Cats allowed in each state.

Figure 6

Figure 3. The three tasks ${\tau _p}$ (red), ${\tau _c}$ (blue) and ${\tau _d}$ (grey) are released at time 0. At time 1 task ${\tau _c}$ executes upon an input with 6 Cats. The environment causes a switch of models somewhere within the interval $\left[ {2,8} \right]$. At time 8 task ${\tau _d}$ executes upon an input with 6 Dogs. At time 14 its deadline elapses but it has only executed for 4 of its required 6 time units.

Figure 7

Table 5. Example values from eq. (2) for ${T_E} = 4$ and ${T_E} = 5$

Figure 8

Table 6. Example values for analysis of $S2$

Figure 9

Table 7. Workload model for when ${\cal A}$ and $SKP$ applies

Figure 10

Table 8. Workload model for when ${\cal A}$ and $SKD$ applies

Figure 11

Table 9. Workload model for when ${\cal A}$ and $SKC$ applies

Figure 12

Table 10. Workload model for when ${\cal A}$ applies with no Stakeholder

Figure 13

Table 11. Workload model for when ${\cal A}1$ and $SKD$ applies

Figure 14

Table 12. Workload model for mission-critical behaviour

Figure 15

Table 13. Workload model for safety-critical behaviour

Author Comment: Multi-model workload specifications and their application to cyber-physical systems — R0/PR1

Comments

No accompanying comment.

Review: Multi-model workload specifications and their application to cyber-physical systems — R0/PR2

Comments

This paper proposes a unique approach to the modelling of mixed-criticality/cyber-physical system's (MCS/CPS) workloads as dictated by its environmental assumptions and its corresponding guarantees. Each workload model defines its relevant task set and timing properties (e.g., period, deadline, and WCET). Because the system can only be in one workload at a time, schedulability analysis remains straightforward and system resources can be better provisioned. The occurrence of system overloading when transitioning between workload models is prevented by the idea of "model-bounded behaviour".

This paper is relevant for the journal, proposes a unique perspective on the modelling of mixed-criticality workloads, and offers interesting research avenues in the modelling and scheduling of MCS/CPS. Although this paper does lack experimental results, its position on multi-model workloads is worthy of dissemination.

While MCS is discussed extensively in the main body of this paper, CPS is only really mentioned in the conclusions. The introduction should establish a stronger link between MCS and CPS.

In the background section, the discussion of the MCS landscape clarifies the many meanings of criticality and argues for a multi-model view of a task set under different criticalities.

In the multi sporadic task model section, the dog-cat running example helps to illustrate the multi-model approach but its relevance to MCS or CPS is weak. Perhaps a robotics example could be used instead (e.g., an autonomous robot with modes for path following and obstacle avoidance, depending on the number/type of objects encountered).

In the model-bounded behaviour section, the semantics of state transitions is not clear. When a task exceeds its budgeted WCET, is the task terminated with its results discarded? When the environment satisfies multiple assumptions, would the next state be chosen non-deterministically? In Figure 3, it appears that the system continues with state S1 (top) and S2 (bottom) instead of transitioning to state S0. It is unclear as to when (state S0) workload A0 applies and why all transitions must go through state S0. When a transition is triggered in state S1 or S2, why not simply wait until an idle instant is reached before transitioning to S2 or S1, respectively? When would a transition be made when the system is in a state with no idle instant, i.e., its workload model has 100% system utilisation?

Minor comments:

* Add citations for the RMPA and DMPA schemes.

* Figure 3, bottom: According to the workload of S0, shouldn't there be an execution for task tc at [t+11, t+13] and for task td at [t+14, t+15]?

* Mode switching, between periodic task sets, that avoids system overloads is discussed in Giotto: Thomas A. Henzinger, Benjamin Horowitz, and Christoph Meyer Kirsch. 2001. Embedded Control Systems Development with Giotto. SIGPLAN Not. 36, 8 (Aug. 2001), 64–72. https://doi.org/10.1145/384196.384208

Presentation

Overall score 5 out of 5
Is the article written in clear and proper English? (30%)
5 out of 5
Is the data presented in the most useful manner? (40%)
5 out of 5
Does the paper cite relevant and related articles appropriately? (30%)
5 out of 5

Context

Overall score 4.25 out of 5
Does the title suitably represent the article? (25%)
4 out of 5
Does the abstract correctly embody the content of the article? (25%)
5 out of 5
Does the introduction give appropriate context and indicate the relevance of the results to the question or hypothesis under consideration? (25%)
5 out of 5
Is the objective of the experiment clearly defined? (25%)
3 out of 5

Results

Overall score 3 out of 5
Is sufficient detail provided to allow replication of the study? (50%)
3 out of 5
Are the limitations of the experiment as well as the contributions of the results clearly outlined? (50%)
3 out of 5

Review: Multi-model workload specifications and their application to cyber-physical systems — R0/PR3

Comments

The paper proposes the use of Multi-Models to enhance the efficiency of Cyber-Physical Systems (CPS). Multi-models involve defining system behavior through an integrated collection of models, allowing for different modes of operation, environmental states, or user/stakeholder perspectives. This approach, an extension of hierarchical models used in Mixed-Criticality systems, is explored as a means to deliver more efficient and realistic CPS while ensuring comprehensibility for safety-case development. Strong points of the paper:

-It is well-written in English and easy to follow.

Weak points of the paper:

- Although the importance of the problem is well highlighted, the paper could not show how the authors exactly solved that problem. It needs to be well formulated using response time analysis, stimulability analysis, performance metric analysis, etc. None of them are employed to do that while considering scalability. They just have some trivial examples, simple tables with no consideration of mathematical representations to prove the soundness and completeness of the method.

Hence, in conclusion, the paper could not show how the method solves the problem and what kinds of benefits we can get after using this method.

Presentation

Overall score 2.6 out of 5
Is the article written in clear and proper English? (30%)
4 out of 5
Is the data presented in the most useful manner? (40%)
2 out of 5
Does the paper cite relevant and related articles appropriately? (30%)
2 out of 5

Context

Overall score 2.75 out of 5
Does the title suitably represent the article? (25%)
3 out of 5
Does the abstract correctly embody the content of the article? (25%)
4 out of 5
Does the introduction give appropriate context and indicate the relevance of the results to the question or hypothesis under consideration? (25%)
3 out of 5
Is the objective of the experiment clearly defined? (25%)
1 out of 5

Results

Overall score 1 out of 5
Is sufficient detail provided to allow replication of the study? (50%)
1 out of 5
Are the limitations of the experiment as well as the contributions of the results clearly outlined? (50%)
1 out of 5

Review: Multi-model workload specifications and their application to cyber-physical systems — R0/PR4

Comments

Strengths:

+ The paper's topic is very well suited for this journal, which focuses on CPS.

+ The paper addresses a very important problem domain in real-time systems, where systems have multiple modes of operation for mixed-criticality support and fault tolerance. We certainly need good analytical frameworks to analyze such adaptive systems.

Weaknesses:

- Certain arguments seem too hand-wavy or incorrect. They are indicated by (*) below and deserve a closer look.

- The paper's arguments are based on a simple toy example, which does not speak to the generality of the approach.

Detailed comments:

- This work will be more self-contained if terms like "relative deadline" and "response time" are more clearly defined in the background. More specifically, it is unclear how the worst-case response time in the tables are calculated.

- Page 3: What are the forms of the assumptions considered in this paper, boolean formulas with inequalities?

- Page 4, "The fourth column in Table 1..." => "The fifth column in Table 1..."

- (*) Page 4, "The assumptions for the single model (A) must capture all possible behaviors, so A = A1 \/ A2, i.e., A = N_Dogs <= 7 /\ N_Cats <= 6" => I think the i.e. part is incorrect, since A = A1 \/ A2 = (N_Dogs <= 7 /\ N_Cats <= 2) \/ (N_Cats <= 6 /\ N_Dogs <= 1) does not equal (N_Dogs <= 7 /\ N_Cats <= 6). (N_Dogs <= 7 /\ N_Cats <= 2) \/ (N_Cats <= 6 /\ N_Dogs <= 1) is already the simpliest form. This seems like a serious problem because Table 3 might no longer make sense and the scenario of having 6 Cats and 6 Dogs on page 5 will be infeasile, as they are outside of both sets of assumptions.

- Page 5: The discussion on both Assumptions A1 and A2 holding at the same time or only one set at a time reminds me of the Assume-Guarantee Contract literature, in which contracts can be composed to form a lattice ordered by a refinement relation.

- Page 5, "In the later it is reasonable ..." => A word seems missing after "later."

- (*) Page 5, "So a movement between there being 6 Cats to 6 Dogs must go via a phase of execution in which there are at most 2 Cats and 1 Dog": This is my main concern of the paper. What if this constraint (on the analytical models) is not observed in the environment? Is the technique then invalidated?

- (*) Page 6, "Again simulating from time t until there is an idle instance will _prove_ that the system natrually has model-bounded behavior" => I fail to see how this forms a proof? Why does the simulation prove that the system has model-bounded behavior? What if we don't find the idle instance? Also, does "idle instance" mean the "end of simulation?"

- Page 6, "The movement from being defined by one model to being constrained by the other is _slow_ when compared with the _rate_ at which the tasks execute." => I am not sure how we know this? If we have info on the rate at which Dogs and Cats arrive, such that we can state confidently that state transition is not a problem, shouldn't this information on the pets' arrival/departure rate be included in the assumptions, for these assumptions to be complete? Given the way these assumptions are currently specified, to me it seems like we have to consider all possible rates of change.

- Page 7, "By requiring model-bounded behavior for the general integrated multi-model framework we have removed the need to derive this analysis." => But is this requirement enforcible in practice?

Presentation

Overall score 3.9 out of 5
Is the article written in clear and proper English? (30%)
4 out of 5
Is the data presented in the most useful manner? (40%)
3 out of 5
Does the paper cite relevant and related articles appropriately? (30%)
5 out of 5

Context

Overall score 4 out of 5
Does the title suitably represent the article? (25%)
5 out of 5
Does the abstract correctly embody the content of the article? (25%)
4 out of 5
Does the introduction give appropriate context and indicate the relevance of the results to the question or hypothesis under consideration? (25%)
3 out of 5
Is the objective of the experiment clearly defined? (25%)
4 out of 5

Results

Overall score 2.6 out of 5
Is sufficient detail provided to allow replication of the study? (50%)
3 out of 5
Are the limitations of the experiment as well as the contributions of the results clearly outlined? (50%)
2 out of 5

Recommendation: Multi-model workload specifications and their application to cyber-physical systems — R0/PR5

Comments

No accompanying comment.

Author Comment: Multi-model workload specifications and their application to cyber-physical systems — R1/PR6

Comments

No accompanying comment.

Recommendation: Multi-model workload specifications and their application to cyber-physical systems — R1/PR7

Comments

No accompanying comment.

Author Comment: Multi-model workload specifications and their application to cyber-physical systems — R2/PR8

Comments

No accompanying comment.

Decision: Multi-model workload specifications and their application to cyber-physical systems — R2/PR9

Comments

No accompanying comment.