ABSTRACT
Testing heterogeneous IoT applications such as a home automation systems integrating a variety of devices poses serious challenges. Oftentimes requirements are vaguely defined. Consumer grade cyber-physical devices and software may not meet the reliability and quality standard needed. Plus, system behavior may partially depend on various environmental conditions. For example, WI-FI congestion may cause packet delay; meanwhile cold weather may cause an unexpected drop of inside temperature.
We surmise that generating and executing failure exposing scenarios is especially challenging. Modeling phenomenons such as network traffic or weather conditions is complex. One possible solution is to rely on machine learning models approximating the reality. These models, integrated in a system model, can be used to define surrogate models and fitness functions to steer the search in the direction of failure inducing scenarios.
However, these models also should be validated. Therefore, there should be a double loop co-evolution between machine learned surrogate models functions and fitness functions.
Overall, we argue that in such complex cyber-physical systems, co-evolution and multi-hybrid approaches are needed.
- Sara Abbaspour Asadollah, Rafia Inam, and Hans Hansson. 2015. A Survey on Testing for Cyber Physical System. In Testing Software and Systems, Khaled El-Fakih, Gerassimos Barlas, and Nina Yevtushenko (Eds.). Springer International Publishing, Cham, 194--207.Google Scholar
- Sumathi Balakrishnan, Hemalata Vasudavan, and Raja Kumar Murugesan. 2018. Smart Home Technologies: A Preliminary Review. In Proceedings of the 6th International Conference on Information Technology: IoT and Smart City (ICIT 2018). ACM, New York, NY, USA, 120--127. https://doi.org/10.1145/3301551.3301575Google ScholarDigital Library
- Sergio Bittanti. 2019. Model Identification and Data Analysis. Wiley.Google Scholar
- G. Box and M.Jenkins. 1970. Time Series Forecasting Analysis and Control. Holden Day, San Francisco (USA).Google Scholar
- Lorenzo Farina and Sergio Rinaldi. 2000. Positive Linear Systems: Theory and Applications. Wiley.Google ScholarCross Ref
- Carlos A. González, Mojtaba Varmazyar, Shiva Nejati, Lionel C. Briand, and Yago Isasi. 2018. Enabling Model Testing of Cyber-Physical Systems. In Proceedings of the 21th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS '18). Association for Computing Machinery, New York, NY, USA, 176--186. https://doi.org/10.1145/3239372.3239409Google ScholarDigital Library
- Concettina Del Grosso, Giuliano Antoniol, Ettore Merlo, and Philippe Galinier. 2008. Detecting buffer overflow via automatic test input data generation. Computers & OR 35, 10 (2008), 3125--3143.Google ScholarDigital Library
- E. Hart, D. Corne, and P. Ross. 2004. The state of the art in evolutionary scheduling. Genetic Programming and Evolvable Machines (2004).Google Scholar
- Claudio Menghi, Shiva Nejati, Lionel C. Briand, and Yago Isasi Parache. 2019. Approximation-Refinement Testing of Compute-Intensive Cyber-Physical Models: An Approach Based on System Identification. ICSE 2020 abs/1910.02837 (2019). arXiv:1910.02837 http://arxiv.org/abs/1910.02837Google Scholar
- Claudio Menghi, Shiva Nejati, Khouloud Gaaloul, and Lionel C. Briand. 2019. Generating Automated and Online Test Oracles for Simulink Models with Continuous and Uncertain Behaviors. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019). Association for Computing Machinery, New York, NY, USA, 27--38. https://doi.org/10.1145/3338906.3338920Google Scholar
- Albert Mestres, Eduard Alarcón, Yusheng Ji, and Albert Cabellos-Aparicio. 2018. Understanding the Modeling of Computer Network Delays Using Neural Networks. In Proceedings of the 2018 Workshop on Big Data Analytics and Machine Learning for Data Communication Networks (Big-DAMA '18). Association for Computing Machinery, New York, NY, USA, 46--52. https://doi.org/10.1145/3229607.3229613Google ScholarDigital Library
- Seung Yeob Shin, Shiva Nejati, Mehrdad Sabetzadeh, Lionel C. Briand, Chetan Arora, and Frank Zimmer. 2019. Dynamic Adaptive Network Configuration for IoT Systems: A Search-based Approach. CoRR abs/1905.12763 (2019). arXiv:1905.12763 http://arxiv.org/abs/1905.12763Google Scholar
Index Terms
Double Cycle Hybrid Testing of Hybrid Distributed IoT System
Recommendations
System testing for object-oriented systems with test case prioritization
This paper presents an approach to generate test cases from UML 2.0 sequence diagrams and subsequently prioritize those test cases using model information encapsulated in the sequence diagrams. The test cases generated according to the proposed approach ...
Measuring and Improving Latency to Avoid Test Suite Wear Out
ICSTW '09: Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation WorkshopsThis paper introduces the concept of test suite latency. The more latent a test suite, the more it is possible to repeatedly select subsets that achieve a test goal (such as coverage) without re-applying test cases. Where a test case is re-applied it ...
Optimisation of software testing using Genetic Algorithm
Software testing is meant to increase confidence in the correctness of software. Test data generation is one of the key issues in software testing. A properly generated test suite may not only locate the errors in a software system, but also help in ...
Comments