SlideShare a Scribd company logo
1 of 27
From Requirements Management to
Requirements Authoring –
An Experience Report from Airbus Group
Jean-Claude Roussel, Gerard Auvray -
Airbus Group
Juan Llorens – The REUSE Company
2
3
50%50%
29%29%
21%21%
30%30%
52%52%
18%18%
20%20%
22%22%
58%58%
Requirements Engineering Capability
ProjectPerformances
Correlation between Project Performances and
Requirement Engineering Capability
Why doing Requirements Engineering ?
Source : Report on SE Effectiveness Survey NDIA-IEEE-SEI/CMU-INCOSE Nov 2012
• 70% of defects are introduced during requirements phases
– It is important to write effective Requirements
• Experiences shown that about 25% of system Requirements are critical and can
grammatically be improved
– No Shall: 8 to 10%
– Forbidden words: 10 to 15%
– Subject, multiple objects, design: 15%
– Incorrect grammar: 50%, …
• Requirements error costs are high
– Fixing requirements after delivery may cost up to 100 times the one for fixing a requirement error
• Training, best practices and verifying requirements by reviews can help to get complete
and consistent requirements:
– But the process is costly and time consuming
• Reduce the number of iterations between System Engineers and sub-contractors and
improve the verification activities
Why doing Requirements Engineering ?
4
5
(source: INCOSE Systems Engineering Handbook )
Why doing Requirements Engineering ?
Survey on Industrial Practices:
Most common defects on Requirements
6
Study in the scope of RAMP project (Requirements Analysis and Modeling
Process) in partnership with Airbus Group, RENAULT, EDF, ADN, CORTIM,
ENSTA, IRIT, PARIS 1 UNIVERSITY
(end 2010 over 22 industrials in several domains worldwide: interviews and questionnaires)
06/20/14
Requirements are
mainly written in natural
language
QUALITY
ISSUES !
6
A perfect…bad requirement !
Whatever the context, the system should be able to
switch-off as quickly as possible, to restart without
inducing any perturbation and at the same time to
inform the operator in a friendly and understandable
manner…
 Need to perform a Requirement Quality Analysis against all the set of
the system Requirements to improve the requirement quality before any
delivery.
Requirement not SMART (Specific, Measurable, Attainable, Realisable, Traceable)
Ambiguous (What System ?)
Several muddled requirements (switch-off, restart, inform)
No use of shall
Not measurable (quickly, same time,,..)
Not testable (friendly, understandable,..)
…
7
From Requirements Management
to Requirements Authoring
Requirements Quality Control:
Huge review effort for quality verification
My tailor is rich
I should need RAT
Requirements Writing:
Working with requirements inside DOORS
8
Requirements Quality Control:
Huge review effort for quality verification
Requirements Quality Assurance:
Authoring “right the first time” on top of DOORS
My tailor is rich
I should need RAT
Requirements Writing:
Working with requirements inside DOORS
Requirements Quality Control:
Smaller review effort for quality verification
From Requirements Management
to Requirements Authoring
9
A first answer :
Requirements Quality Analysis (RQA) Tool
– Tool delivered by TRC (The Reuse Company)
– Completely linked with DOORS Tool
– Focusing on Syntactic analysis (DQA) and Semantic analysis (RQA V4.1)
– Tool evaluation
– Airbus Group Innovations
– Airbus Defense and Space
– Close cooperation with TRC in order to improve the tool
– Tool deployment
– Limited in Airbus Defense and Space
– R&T project focusing on how to improve the requirements quality
analysis process
– Operationally deployed in Airbus (Commercial Aircraft)
• A320neo Cabin Flex
10
From Requirements Analysis to Authoring
So far RQAV3 was a verification tool:
– Checking the quality of individual requirements once they are written
– Based on +25 metrics
– Checking the consistency of the overall specification
RQA has evolved towards the Requirements Quality Suite (RQS) inV4
– Supports the CCC approach (Correctness, Consistency and Completeness)
– V4 is mainly focused on “authoring”
– Includes RQA, Requirements AuthoringTool (RAT) and KM
RAT:“The SMARTer* way to create requirements”:
An assistant to Engineers during the authoring process
Including a wide set of customizable boilerplates
Helping Engineers during authoring with an intellisense system
* SMART stands for Specific, Measurable, Attainable, Realisable, Traceable
11
Requirements Quality Analysis :
Product Improvement
DQA
V2.1
RQA
V3.1
RQS
V4 – V14
Semantics
Syntactic
+
Semantic
Syntactic
Check
Authoring
Page
12
12
The Requirements Quality Suite (RQS)
The Requirements Quality Suite (RQS) intends to tackle requirements quality
management by offering a set of tools and processes.
RQS models requirements quality using the CCC approach (Correctness,
Consistency and Completeness)
Requirements Quality Analyzer (RQA):
to setup, check and manage the quality of a
requirements specification.
Requirements Authoring Tool (RAT):
to assist authors in the process of creating
requirements with the right level of quality
knowledgeMANAGER (kM):
to manage knowledge around a
requirements specification:
-the ontology it is based on
-the structure of the requirements to be used in the
project
-the communication between authors and domain
architects.
13
Requirements Quality Metrics :
CCC Support
Consistency
(semantic)
Consistency
(inconsistent
units)
Completeness
(missing req.)
Correctness
(individual
metrics)
Completeness
(missing links)
Page
14
14
Correctness :
Individual requirement supported metrics
– Size
– Readability
– Conditional vs. imperative
sentences
– Active vs. passive voice
– Optional sentences
– Ambiguous sentences
– Subjective sentences
– Implicit sentences
– Abuse of connectors
– Negations
– Speculative sentences
– Use of false friends
– Design terms
– Flow terms
– Number of domain nouns and
verbs
– Acronyms
– Hierarchical levels
– Volatility
– Number of dependences
– Forbidden Words
– Standard Requirement (match
pattern)
Page 15
15
Consistency : Supported Metrics
Consistency applies to requirements sets
–Redundant requirements: Several requirements expressing the same
need at the same level of abstraction.
–Inconsistent units: Different requirements in the same
module/block/project uses different metric units.
–Inconsistent Content: Different requirements present value restrictions
that are not compatible.
16
Completeness: Supported Metrics
Completeness applies to requirements sets
–Missing requirements: Lacks the existence of requirements expressing
the same need at the different level of abstraction in different modules/blocks
of the same project.
–Missing Links Lacks the existence of links between requirements
expressing the same need at the different level of abstraction in different
modules/blocks of the same project.
17
RAT : Requirements Authoring Tool
• Main features:
– Assisting authors while they’re writing requirements
– Following a agreed upon set of patterns
• Other (on the fly) features:
– Quality assessment (correctness based
on individual metrics) on the fly
– Consistency analysis on the fly
– Missing links on the fly
– Inconsistent units analysis on the fly
18
• Author assistance on the fly (typing requirement)
Pattern choicePattern choice
Valid paths to fulfill the selected patterns
Ontology terms to keep
fulfilling the selected patterns
RAT : Requirements Authoring Tool
19
• Author assistance on the fly (done requirement)
Pattern fulfilledPattern fulfilled
RAT : Requirements Authoring Tool
20
• Quality assessment on the fly
RAT : Requirements Authoring Tool
21
• Semantically similar requirements on the fly
There’s a requirement in the SKB very similar to the writing requirementThere’s a requirement in the SKB very similar to the writing requirement
RAT : Requirements Authoring Tool
22
• Inconsistent measurement units on the fly
There’s a requirement in the SKB conflicting with the writing requirementThere’s a requirement in the SKB conflicting with the writing requirement
RAT : Requirements Authoring Tool
23
Knowledge Manager
• Main features:
– Vocabulary management
– Thesaurus management
– Requirements Patterns management
– Semantic indexing and retrieval services
• Ontology construction:
– By reusing existing vocabulary, thesauri, ontologies
– By creating a semantic graph out of existing
documentation
– By “elicitating” with the help of experts
– By attending the suggestions provided by end users
24
The System Knowledge Base: An ontology
P
a
g
e
25
Controlled vocabulary: valid
terms, forbidden terms…
Optionally can include a
Glossary (description for every
term)
Taxonomy: terms hierarchically
organized
Thesaurus: hierarchies,
associations, synonyms…
Light Ontology: syntactic and
Semantic groupings for Terms
and Actions (verbs). Domain
terms and verbs
Full-Ontology: patterns and requirements
structures
Pattern Management
Full-Ontology: boilerplates and
requirements structures
Knowledge (Ontology)
Management
Page
26
Knowledge Manager
Thank You!
Your Feedback is Important!
Access the Innovate agenda tool to complete your
session surveys from your smartphone, laptop or
conference kiosk.
27

More Related Content

What's hot

Supplier Quality Improvement
Supplier Quality ImprovementSupplier Quality Improvement
Supplier Quality Improvement
gstevick1980
 
Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016
Prem Papabathini
 
11+YrsQAProfile_ ValidH1BAug2018
11+YrsQAProfile_ ValidH1BAug201811+YrsQAProfile_ ValidH1BAug2018
11+YrsQAProfile_ ValidH1BAug2018
Arun R
 
RACI Team Practice
RACI Team PracticeRACI Team Practice
RACI Team Practice
Martin Ruddy
 
Tammy Clark Resume - Final
Tammy Clark Resume - FinalTammy Clark Resume - Final
Tammy Clark Resume - Final
Tammy Clark
 
Gautham Dileep (Resume)
Gautham Dileep (Resume)Gautham Dileep (Resume)
Gautham Dileep (Resume)
Gautham Dileep
 
04 ppap training material
04 ppap training material04 ppap training material
04 ppap training material
營松 林
 

What's hot (20)

Shalini Sharma Resume
Shalini Sharma ResumeShalini Sharma Resume
Shalini Sharma Resume
 
Fmq lqos introduction npi rev 2
Fmq  lqos introduction npi rev 2Fmq  lqos introduction npi rev 2
Fmq lqos introduction npi rev 2
 
Supplier Quality Assurance Engineer with 3.7 years experience
Supplier Quality Assurance Engineer with 3.7 years experienceSupplier Quality Assurance Engineer with 3.7 years experience
Supplier Quality Assurance Engineer with 3.7 years experience
 
Supplier Quality Improvement
Supplier Quality ImprovementSupplier Quality Improvement
Supplier Quality Improvement
 
Automotive SPICE® 3.0 - What is new and what has changed?
Automotive SPICE® 3.0 - What is new and what has changed?Automotive SPICE® 3.0 - What is new and what has changed?
Automotive SPICE® 3.0 - What is new and what has changed?
 
sudhir_2016
sudhir_2016sudhir_2016
sudhir_2016
 
Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016Prem_Papabathini_Resume_2016
Prem_Papabathini_Resume_2016
 
11+YrsQAProfile_ ValidH1BAug2018
11+YrsQAProfile_ ValidH1BAug201811+YrsQAProfile_ ValidH1BAug2018
11+YrsQAProfile_ ValidH1BAug2018
 
R 8 - 2015
R  8 - 2015R  8 - 2015
R 8 - 2015
 
LMS TESTING SERVICES
LMS TESTING SERVICESLMS TESTING SERVICES
LMS TESTING SERVICES
 
NASA Project Management Wall Chart
NASA Project Management Wall ChartNASA Project Management Wall Chart
NASA Project Management Wall Chart
 
RACI Team Practice
RACI Team PracticeRACI Team Practice
RACI Team Practice
 
Tammy Clark Resume - Final
Tammy Clark Resume - FinalTammy Clark Resume - Final
Tammy Clark Resume - Final
 
Spice
SpiceSpice
Spice
 
Resume vibin jacob
Resume vibin jacobResume vibin jacob
Resume vibin jacob
 
Gautham Dileep (Resume)
Gautham Dileep (Resume)Gautham Dileep (Resume)
Gautham Dileep (Resume)
 
Webinar "Gestión de la calidad en entornos SAP"
Webinar "Gestión de la calidad en entornos SAP"Webinar "Gestión de la calidad en entornos SAP"
Webinar "Gestión de la calidad en entornos SAP"
 
CVDEC14
CVDEC14CVDEC14
CVDEC14
 
SHYAMAL KUMAR SURAI-CV
SHYAMAL KUMAR SURAI-CVSHYAMAL KUMAR SURAI-CV
SHYAMAL KUMAR SURAI-CV
 
04 ppap training material
04 ppap training material04 ppap training material
04 ppap training material
 

Similar to From requirements management to requirements authoring - Innovate 2014

Requirements engineering vii
Requirements engineering viiRequirements engineering vii
Requirements engineering vii
indrisrozas
 
исследование концепции
исследование концепцииисследование концепции
исследование концепции
Tatiana rey
 
SharadchandraPawar 4 Years Manual and Web service Testinng
SharadchandraPawar  4 Years Manual and Web service TestinngSharadchandraPawar  4 Years Manual and Web service Testinng
SharadchandraPawar 4 Years Manual and Web service Testinng
Sharad Pawar
 
Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...
Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...
Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...
Philippe Krief
 
Manmadha_Rao_ Q A Test Manager_Lead -Resume CyberKorp Inc
Manmadha_Rao_  Q A Test Manager_Lead -Resume CyberKorp IncManmadha_Rao_  Q A Test Manager_Lead -Resume CyberKorp Inc
Manmadha_Rao_ Q A Test Manager_Lead -Resume CyberKorp Inc
Manmadha Rao Rangala
 

Similar to From requirements management to requirements authoring - Innovate 2014 (20)

Solo Requisitos 2008 - 07 Upc
Solo Requisitos 2008 - 07 UpcSolo Requisitos 2008 - 07 Upc
Solo Requisitos 2008 - 07 Upc
 
From requirements quality to requirements authoring
From requirements quality to requirements authoringFrom requirements quality to requirements authoring
From requirements quality to requirements authoring
 
RQS - Requirements Quality Suite
RQS - Requirements Quality SuiteRQS - Requirements Quality Suite
RQS - Requirements Quality Suite
 
Software development PROCESS
Software development PROCESSSoftware development PROCESS
Software development PROCESS
 
Traceability Beyond Source Code: An Elusive Target?
Traceability Beyond Source Code: An Elusive Target?Traceability Beyond Source Code: An Elusive Target?
Traceability Beyond Source Code: An Elusive Target?
 
[2015/2016] Software development process
[2015/2016] Software development process[2015/2016] Software development process
[2015/2016] Software development process
 
Requirements engineering vii
Requirements engineering viiRequirements engineering vii
Requirements engineering vii
 
исследование концепции
исследование концепцииисследование концепции
исследование концепции
 
Software Quality Architecture And Code Audit
Software Quality Architecture And Code AuditSoftware Quality Architecture And Code Audit
Software Quality Architecture And Code Audit
 
SharadchandraPawar 4 Years Manual and Web service Testinng
SharadchandraPawar  4 Years Manual and Web service TestinngSharadchandraPawar  4 Years Manual and Web service Testinng
SharadchandraPawar 4 Years Manual and Web service Testinng
 
Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...
Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...
Moving to Agile Methods and DevOps on IBM i with ARCAD Pack for Rational 1479...
 
Evaluation and Rating program for Construction Quality and Task Completion
Evaluation and Rating program for Construction Quality and Task CompletionEvaluation and Rating program for Construction Quality and Task Completion
Evaluation and Rating program for Construction Quality and Task Completion
 
SQA Lecture 01 (Introduction) - Testing and SQA
SQA Lecture 01 (Introduction) - Testing and SQASQA Lecture 01 (Introduction) - Testing and SQA
SQA Lecture 01 (Introduction) - Testing and SQA
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive Goal
 
Qualilogy services 201409v1
Qualilogy services 201409v1Qualilogy services 201409v1
Qualilogy services 201409v1
 
Manmadha_Rao_ Q A Test Manager_Lead -Resume CyberKorp Inc
Manmadha_Rao_  Q A Test Manager_Lead -Resume CyberKorp IncManmadha_Rao_  Q A Test Manager_Lead -Resume CyberKorp Inc
Manmadha_Rao_ Q A Test Manager_Lead -Resume CyberKorp Inc
 
Ravi_Nelluri_QA
Ravi_Nelluri_QARavi_Nelluri_QA
Ravi_Nelluri_QA
 
TLC2018 Thomas Haver: Transform with Enterprise Automation
TLC2018 Thomas Haver: Transform with Enterprise AutomationTLC2018 Thomas Haver: Transform with Enterprise Automation
TLC2018 Thomas Haver: Transform with Enterprise Automation
 
Man.ppt
Man.pptMan.ppt
Man.ppt
 
My Profile
My ProfileMy Profile
My Profile
 

More from The REUSE Company

More from The REUSE Company (6)

Technology presentation
Technology presentationTechnology presentation
Technology presentation
 
Knowledge Centric Systems Engineering
Knowledge Centric Systems EngineeringKnowledge Centric Systems Engineering
Knowledge Centric Systems Engineering
 
Requirements Quality Analyzer (DOORS Edition): Deployment Guide
Requirements Quality Analyzer (DOORS Edition): Deployment GuideRequirements Quality Analyzer (DOORS Edition): Deployment Guide
Requirements Quality Analyzer (DOORS Edition): Deployment Guide
 
Requirements quality - A theoretical introduction
Requirements quality - A theoretical introductionRequirements quality - A theoretical introduction
Requirements quality - A theoretical introduction
 
RQA - Requirements Quality Analyzer
RQA - Requirements Quality AnalyzerRQA - Requirements Quality Analyzer
RQA - Requirements Quality Analyzer
 
OBSE - Ontology Based System Engineering
OBSE - Ontology Based System EngineeringOBSE - Ontology Based System Engineering
OBSE - Ontology Based System Engineering
 

Recently uploaded

AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
Alluxio, Inc.
 
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfMastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
mbmh111980
 

Recently uploaded (20)

APVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purityAPVP,apvp apvp High quality supplier safe spot transport, 98% purity
APVP,apvp apvp High quality supplier safe spot transport, 98% purity
 
Workforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdfWorkforce Efficiency with Employee Time Tracking Software.pdf
Workforce Efficiency with Employee Time Tracking Software.pdf
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM Integration
 
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
 
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
 
how-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfhow-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdf
 
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
 
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfMastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
 
10 Essential Software Testing Tools You Need to Know About.pdf
10 Essential Software Testing Tools You Need to Know About.pdf10 Essential Software Testing Tools You Need to Know About.pdf
10 Essential Software Testing Tools You Need to Know About.pdf
 
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
KLARNA -  Language Models and Knowledge Graphs: A Systems ApproachKLARNA -  Language Models and Knowledge Graphs: A Systems Approach
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
 
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdfA Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
A Comprehensive Appium Guide for Hybrid App Automation Testing.pdf
 
How to pick right visual testing tool.pdf
How to pick right visual testing tool.pdfHow to pick right visual testing tool.pdf
How to pick right visual testing tool.pdf
 
The Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion ProductionThe Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion Production
 
CompTIA Security+ (Study Notes) for cs.pdf
CompTIA Security+ (Study Notes) for cs.pdfCompTIA Security+ (Study Notes) for cs.pdf
CompTIA Security+ (Study Notes) for cs.pdf
 
IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024
 
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product UpdatesGraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
 
5 Reasons Driving Warehouse Management Systems Demand
5 Reasons Driving Warehouse Management Systems Demand5 Reasons Driving Warehouse Management Systems Demand
5 Reasons Driving Warehouse Management Systems Demand
 
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
 
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdf
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdfImplementing KPIs and Right Metrics for Agile Delivery Teams.pdf
Implementing KPIs and Right Metrics for Agile Delivery Teams.pdf
 

From requirements management to requirements authoring - Innovate 2014

  • 1. From Requirements Management to Requirements Authoring – An Experience Report from Airbus Group Jean-Claude Roussel, Gerard Auvray - Airbus Group Juan Llorens – The REUSE Company
  • 2. 2
  • 3. 3 50%50% 29%29% 21%21% 30%30% 52%52% 18%18% 20%20% 22%22% 58%58% Requirements Engineering Capability ProjectPerformances Correlation between Project Performances and Requirement Engineering Capability Why doing Requirements Engineering ? Source : Report on SE Effectiveness Survey NDIA-IEEE-SEI/CMU-INCOSE Nov 2012
  • 4. • 70% of defects are introduced during requirements phases – It is important to write effective Requirements • Experiences shown that about 25% of system Requirements are critical and can grammatically be improved – No Shall: 8 to 10% – Forbidden words: 10 to 15% – Subject, multiple objects, design: 15% – Incorrect grammar: 50%, … • Requirements error costs are high – Fixing requirements after delivery may cost up to 100 times the one for fixing a requirement error • Training, best practices and verifying requirements by reviews can help to get complete and consistent requirements: – But the process is costly and time consuming • Reduce the number of iterations between System Engineers and sub-contractors and improve the verification activities Why doing Requirements Engineering ? 4
  • 5. 5 (source: INCOSE Systems Engineering Handbook ) Why doing Requirements Engineering ?
  • 6. Survey on Industrial Practices: Most common defects on Requirements 6 Study in the scope of RAMP project (Requirements Analysis and Modeling Process) in partnership with Airbus Group, RENAULT, EDF, ADN, CORTIM, ENSTA, IRIT, PARIS 1 UNIVERSITY (end 2010 over 22 industrials in several domains worldwide: interviews and questionnaires) 06/20/14 Requirements are mainly written in natural language QUALITY ISSUES ! 6
  • 7. A perfect…bad requirement ! Whatever the context, the system should be able to switch-off as quickly as possible, to restart without inducing any perturbation and at the same time to inform the operator in a friendly and understandable manner…  Need to perform a Requirement Quality Analysis against all the set of the system Requirements to improve the requirement quality before any delivery. Requirement not SMART (Specific, Measurable, Attainable, Realisable, Traceable) Ambiguous (What System ?) Several muddled requirements (switch-off, restart, inform) No use of shall Not measurable (quickly, same time,,..) Not testable (friendly, understandable,..) … 7
  • 8. From Requirements Management to Requirements Authoring Requirements Quality Control: Huge review effort for quality verification My tailor is rich I should need RAT Requirements Writing: Working with requirements inside DOORS 8
  • 9. Requirements Quality Control: Huge review effort for quality verification Requirements Quality Assurance: Authoring “right the first time” on top of DOORS My tailor is rich I should need RAT Requirements Writing: Working with requirements inside DOORS Requirements Quality Control: Smaller review effort for quality verification From Requirements Management to Requirements Authoring 9
  • 10. A first answer : Requirements Quality Analysis (RQA) Tool – Tool delivered by TRC (The Reuse Company) – Completely linked with DOORS Tool – Focusing on Syntactic analysis (DQA) and Semantic analysis (RQA V4.1) – Tool evaluation – Airbus Group Innovations – Airbus Defense and Space – Close cooperation with TRC in order to improve the tool – Tool deployment – Limited in Airbus Defense and Space – R&T project focusing on how to improve the requirements quality analysis process – Operationally deployed in Airbus (Commercial Aircraft) • A320neo Cabin Flex 10
  • 11. From Requirements Analysis to Authoring So far RQAV3 was a verification tool: – Checking the quality of individual requirements once they are written – Based on +25 metrics – Checking the consistency of the overall specification RQA has evolved towards the Requirements Quality Suite (RQS) inV4 – Supports the CCC approach (Correctness, Consistency and Completeness) – V4 is mainly focused on “authoring” – Includes RQA, Requirements AuthoringTool (RAT) and KM RAT:“The SMARTer* way to create requirements”: An assistant to Engineers during the authoring process Including a wide set of customizable boilerplates Helping Engineers during authoring with an intellisense system * SMART stands for Specific, Measurable, Attainable, Realisable, Traceable 11
  • 12. Requirements Quality Analysis : Product Improvement DQA V2.1 RQA V3.1 RQS V4 – V14 Semantics Syntactic + Semantic Syntactic Check Authoring Page 12 12
  • 13. The Requirements Quality Suite (RQS) The Requirements Quality Suite (RQS) intends to tackle requirements quality management by offering a set of tools and processes. RQS models requirements quality using the CCC approach (Correctness, Consistency and Completeness) Requirements Quality Analyzer (RQA): to setup, check and manage the quality of a requirements specification. Requirements Authoring Tool (RAT): to assist authors in the process of creating requirements with the right level of quality knowledgeMANAGER (kM): to manage knowledge around a requirements specification: -the ontology it is based on -the structure of the requirements to be used in the project -the communication between authors and domain architects. 13
  • 14. Requirements Quality Metrics : CCC Support Consistency (semantic) Consistency (inconsistent units) Completeness (missing req.) Correctness (individual metrics) Completeness (missing links) Page 14 14
  • 15. Correctness : Individual requirement supported metrics – Size – Readability – Conditional vs. imperative sentences – Active vs. passive voice – Optional sentences – Ambiguous sentences – Subjective sentences – Implicit sentences – Abuse of connectors – Negations – Speculative sentences – Use of false friends – Design terms – Flow terms – Number of domain nouns and verbs – Acronyms – Hierarchical levels – Volatility – Number of dependences – Forbidden Words – Standard Requirement (match pattern) Page 15 15
  • 16. Consistency : Supported Metrics Consistency applies to requirements sets –Redundant requirements: Several requirements expressing the same need at the same level of abstraction. –Inconsistent units: Different requirements in the same module/block/project uses different metric units. –Inconsistent Content: Different requirements present value restrictions that are not compatible. 16
  • 17. Completeness: Supported Metrics Completeness applies to requirements sets –Missing requirements: Lacks the existence of requirements expressing the same need at the different level of abstraction in different modules/blocks of the same project. –Missing Links Lacks the existence of links between requirements expressing the same need at the different level of abstraction in different modules/blocks of the same project. 17
  • 18. RAT : Requirements Authoring Tool • Main features: – Assisting authors while they’re writing requirements – Following a agreed upon set of patterns • Other (on the fly) features: – Quality assessment (correctness based on individual metrics) on the fly – Consistency analysis on the fly – Missing links on the fly – Inconsistent units analysis on the fly 18
  • 19. • Author assistance on the fly (typing requirement) Pattern choicePattern choice Valid paths to fulfill the selected patterns Ontology terms to keep fulfilling the selected patterns RAT : Requirements Authoring Tool 19
  • 20. • Author assistance on the fly (done requirement) Pattern fulfilledPattern fulfilled RAT : Requirements Authoring Tool 20
  • 21. • Quality assessment on the fly RAT : Requirements Authoring Tool 21
  • 22. • Semantically similar requirements on the fly There’s a requirement in the SKB very similar to the writing requirementThere’s a requirement in the SKB very similar to the writing requirement RAT : Requirements Authoring Tool 22
  • 23. • Inconsistent measurement units on the fly There’s a requirement in the SKB conflicting with the writing requirementThere’s a requirement in the SKB conflicting with the writing requirement RAT : Requirements Authoring Tool 23
  • 24. Knowledge Manager • Main features: – Vocabulary management – Thesaurus management – Requirements Patterns management – Semantic indexing and retrieval services • Ontology construction: – By reusing existing vocabulary, thesauri, ontologies – By creating a semantic graph out of existing documentation – By “elicitating” with the help of experts – By attending the suggestions provided by end users 24
  • 25. The System Knowledge Base: An ontology P a g e 25
  • 26. Controlled vocabulary: valid terms, forbidden terms… Optionally can include a Glossary (description for every term) Taxonomy: terms hierarchically organized Thesaurus: hierarchies, associations, synonyms… Light Ontology: syntactic and Semantic groupings for Terms and Actions (verbs). Domain terms and verbs Full-Ontology: patterns and requirements structures Pattern Management Full-Ontology: boilerplates and requirements structures Knowledge (Ontology) Management Page 26 Knowledge Manager
  • 27. Thank You! Your Feedback is Important! Access the Innovate agenda tool to complete your session surveys from your smartphone, laptop or conference kiosk. 27