Model checking and validation with OpenMBEE and the IncQuery Suite

1. Model checking and validation with
OpenMBEE and the IncQuery Suite
István Ráth
CEO
MODELS 2020 Industry Days / OpenMBEE Day 2

2. • No global consistency
• Data lock-in
• Difficult & expensive
customization
• Vendor lock-in
• Silos
MBSE Pains
ALM/PLM
Systems
design
Simulation
Electrical engineering
Legacy
documents
Wiki
Custom DSL

3. j p l . n a s a . g o v2020/01/27 6
E. Bower: NASA JPL Systems Environment. https://trs.jpl.nasa.gov/handle/2014/49490

4. IncQuery Suite:
Analyze Your Digital Threads
Revolutionary analysis suite
for MBSE
• Efficiently extracts engineering
data from proprietary silos…
• to create a unified, searchable
and analysable representation
of your entire digital thread.

5. IncQuery Suite
features
Validation reports Analysis dashboard Engineering data queries Tool integration platform
Automatically
validate
documents /
projects
Standards
(UML/SysML,
UPDM, UAF, …)
Custom rules
Jupyter ecosystem
In-depth,
interactive, visual
analysis reports
Integrating into
documentation
management
platforms
Graph queries
(SPARQL, VQL)
Full-text search
Enterprise access
control
Connect to open
and proprietary
engineering tools
Integrated
knowledge graph
for the entire
digital thread
Workflow
automation

6. IncQuery Suite
Connects to…

7. IncQuery Suite Deployment
Authoring tools
IncQuery
Desktop
Repository
• Easy-to-use query authoring tool
• Commercial add-on for
Cameo System Modeler
• Powerful features for validation,
visualization, model comprehension
IncQuery
Server
Web Console
Cloud-based
services
• Enterprise-class application
• Runs on-prem, or on Amazon
/ OpenShift / Azure …
• Containerized, elastic
deployment
• Integrated with enterprise
identity management and
access control
Jupyter
notebooks

8. IncQuery Desktop
Custom model
queries supported by
advanced text editor
– content assist,
syntax highlight
Powerful language
tailored to models -
supporting query
reuse and
compositionality

9. IncQuery Server
Web Console
Custom model queries in your
browser
• SPARQL
• Lucene / Elasticsearch
(full-text search)
• VIATRA Query Language
Subject to repository access
control – fully integrated with
enterprise identity
management

10. IncQuery Server
Web Console
Runs 10x faster anything currently
on the market
– full validation of 1 million model
elements in under a second!
Repository-wide validation and
change impact analysis
– avoid breakage as models evolve

11. IncQuery Server
Jupyter integration
OpenAPI standard compliant
interfaces
– integrate with your tools easily
Jupyter notebook support
– generate beautiful interactive
reports on the web

12. Case studies

13. Case study:
Tool integration at Airbus
• Thousands of applications
• Across several verticals
• engineering, manufacturing, extended enterprise, customer
service, …
• ADAM by A^3
(Advanced Digital, Design and Manufacturing)
• An integration platform to enable data continuity across all
Airbus applications
• Conceptual framework addressing 5 layers
Data
Semantics
Models
Services
Visualization

14. The Challenge
Interoperability platform
Product modeling
Reports and dashboards
Tradeoff analysis
• Web-based automation
• Push-button solution for a complex
simulation-based validation
scenario
• Scale to large and complex
projects

15. The Solution
1. Edit system model 2. Commit changes to repository
3. Trigger
processing
IncQuery
Server
5. Show results
on web UI /
generate
reports
4. Execute
automated
simulation
https://www.airbus-sv.com/projects/9

16. Case Study: Model Checking as a Service
• Simulation, testing may not find every error
• ”Holy grail” of hidden formal methods
• Systematically checks the model by traversing state space
• Automated bidirectional translation between engineering domain (e.g. SysML) and
formal domain (e.g. timed automata)
20
In collaboration with

17. Motivating Example
21
Battery
control
Data transfer

18. Motivating Example
22
Should never transmit when the battery is below 40%

19. Transformation chain: forwards
7 Back-annotation
4 Transformation
SysML
tool
1 Modeling (user)
Jupyter
notebook
2 V&V actions (user)
IncQuery Server
MCaaS
add-on
3 Static checksModel
repository
MC runtime 2
5
Formal model + query
translation
6
Result + trace
back-annotation
Gamma
intermediate
models
Theta
model checker
MC runtime 1
5
Formal model + query
translation
6
Result + trace
back-annotation
Gamma
intermediate
models
UPPAAL
model checker
23
• Static validation rules in
VQL
• SysML-to-Gamma SCL
mappings using VIATRA
(PSSM semantics-
preserving mappings)
3 4
5

20. Transformation chain: backwards
7 Back-annotation
4 Transformation
SysML
tool
1 Modeling (user)
Jupyter
notebook
2 V&V actions (user)
IncQuery Server
MCaaS
add-on
3 Static checksModel
repository
MC runtime 2
5
Formal model + query
translation
6
Result + trace
back-annotation
Gamma
intermediate
models
Theta
model checker
MC runtime 1
5
Formal model + query
translation
6
Result + trace
back-annotation
Gamma
intermediate
models
UPPAAL
model checker
24
6 7
Model checker trace Gamma trace SysML sequence diagram

21. Summary

22. Open source projects by IncQuery Labs
in the OpenMBEE ecosystem
• V4MD
• http://github.com/viatra/v4md
• MagicDraw bindings for Eclipse VIATRA
• MD_plugin_skeleton
• https://github.com/IncQueryLabs/MD_plugin_skel
eton
• Basic MagicDraw plug-in built using Gradle
(inspired by MDK)
• Demonstrates the usage of V4MD
• MDK fork
• https://github.com/IncQueryLabs/mdk
• Example usage of V4MD within MDK
Frameworks Benchmarks and demos
• MD model query benchmark
• https://github.com/IncQueryLabs/magicdr
aw-viatra-benchmark
• Scalability benchmark for model queries
over MagicDraw models
• Based on scaled-up variants of TMT
• TMT model fork
• https://github.com/IncQueryLabs/TMT-
SysML-Model
• Examples of custom complex validation
queries inspired by NASA JPL
• IncQuery Jupyter demos
• https://github.com/IncQueryLabs/incquer
y-server-jupyter

23. Live Demo For The Public OpenMBEE MMS Repository
mms.openmbee.org
openmbee.incquery.io
Jupyter notebook on
mybinder.org

24. Key takeaways
• IncQuery can help unlock the potential of the cloud for MBSE
• Deployment
• Automation
• Scalability
• Interoperability
• Check out the MCaaS paper / presentation:
• "Model Checking as a Service: Towards Pragmatic Hidden Formal Methods"
(Benedek Horváth et al., OpenMBEE Workshop 2020 Session 2)
https://youtu.be/q6LOQldiO40
• Pointers
• https://incquery.io
• https://openmbee.incquery.io
• https://incquerylabs.com

25. info@incquerylabs.com
incquerylabs.com
+36 70 633 3973
Thank you!
@IncQueryLabs