Embedded SW Testing Introduction @ ESAF 2018

1. Embedded SW Testing

2. Swift Act LLC …

3. I am …
 14+ years experience in Embedded Systems and SW Engineering
 SECC, Valeo, Toshiba
 Co-founder of Swift Act Services
 ISTQB Advanced Full certified
 https://eg.linkedin.com/in/amrali
 Track records in 4 continents and 12 countries
 Reviewed 3 books

4. Skill vs. Knowledge
Skill
Know
ledge
Is applying
Is acquiring
Testing is a skill and applying it to embedded
systems requires additional skills!

5. TestingMicrocontrollersProgramming
Embedded Tester Skill Set

6. Test Levels
 A point in the development
model where testing is done.
 A development model can have
more than a test level depending
on the model and the project.

7. Component Testing
 AKA unit, program, or module testing

8. Integration Testing Levels
Component integration testingSystem integration
testing

9. Structural Strategies Examples
Top-down approach Bottom-up approach

10. Functional Strategies Examples
Minimum capability Thread capability

11. Big-Bang Strategy Example

12. System Testing
 Testing the system as a whole
 End-to-end behavior is the focus.
 Usually carried by independent test team

13. Acceptance Testing
 Goal is to establish confidence in the system; not to find bugs.
 Usually done by customers or system users or any other stakeholders
 Asses the readiness of the system for deployment or use
 Test forms:
 UAT
 OAT
 Contract/Regulation AT
 Alpha or Beta

14. Verification
Customer
Involvement
or Intended
Operational
Environment
Validatio
n
Validation and Verification

15. Test Type
Functional
Non-
Functional
Structural
Related-
to-change
Test Types
 Tests can be grouped based on specific targets, reasons, or objectives.
 SW models can be developed and used in:
 Functional testing
 Non-functional testing
 Structural testing

16. Test Techniques

17. Important Testing Techniques
 Black-box
 EP, BVA, S/M, PW, DT ...
 White-box
 MC/DC, decision-testing …
 Static analysis
 Control-flow, call-graph ...
 Dynamic analysis
 Memory-leaks, wild pointers, profiling ...

18. Problem Space
 Myth: Structure techniques are used
for low test levels.
 Myth: Non-functional test is done @
higher levels.
 Fact: Every test technique and test
type is applicable @ every test level.
 You need to find your position in the
testing grid.

19. Selecting and Combining Techniques
 Techniques must be combined.
 Combined techniques are more powerful than trying to find a single “best” technique.
 When techniques are combined, test cases should cover all applicable coverage criteria.
 To select techniques, consider:
 Applicability
 Limitations and difficulties
 Coverage goals
 Defects typically detected

20. Different Embedded SW Testing Jobs
Embedded
SW Testing
Embedded
SW
Validation
Embedded
Systems
Validation
Programming C is a must Yes, any Yes, any
Microcontrollers Yes Yes Yes
Testing Techniques Yes Yes Yes
Unit Testing Yes No No
Integration Testing Yes No No
System Testing May be Yes Yes
Acceptance Testing May be May be Yes

21. Demo: Sebha Testing
8/27/18Embedded SW Testing 101 © 21

22. Demo: Static Architecture
Sebha
+
R
H
U
TSW
DISP
Counter
OS
SSD
SW States Sebha Count
Scheduling

23. Demo: Dynamic Architecture
time
SSD Task @ 5 ms
SW Task @ 20 ms DISP Task @ 20 ms
Sebha Task @ 20 ms

24. Demo: Seven Segment Display
 SSD_Init
 SSD_SetSymbol
 SSD_SetState
 SSD_GetSymbol
 SSD_GetState
 SSD_Update

25. Demo: Functional Integration
time
time
time
time

26. Demo: SW Validation Testing

27. Swift Act LLC offers
 Mini Embedded SW Testing 101 x 2 days
 Embedded SW Testing 101 x 4 days
 Contacts:
 www.swift-act.com
 training@swift-act.com
 https://www.facebook.com/groups/EmbeddedSystemsTraining/

28. References
 Advanced SW Testing Volume 1, 2 and 3 2nd edition