Proposed Model-Based Approach to Qualification

undefined
A Proposed Model-Based Approach
To Qualification (Formal V&V)
Raymond Wolfgang, Surety Engineering, Sandia National Laboratories
Albuquerque, NM, 87112
rwolfga@sandia.gov
Sandia National Laboratories is a multi-mission laboratory managed and operated by National Technology and
Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S.
Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
SAND2020-0710 PE
MBSE – Not Just For Design
Qualification = V&V!
Government systems, formal process
Many companies have moved to model based design
and development
Some operations – qualification – still document based
www.incose.org/iw2020
2
Using MBSE tool to track, organize, and finally grant
“Qualified” status to a product can save time and money
Document Based Qualification
My role: Qualification Engineer for multiple components
Qualification Plan in MS Word
Wide range of parts: tire valve to complex Electro/mech parts
Requirements, design, production, Reliability
Plan is for Verification; approach works for Validation also
Required for Government / High Consequence Items
www.incose.org/iw2020
3
Tracking the work is not doing the work; any reductions
through use of a MBSE tool are most welcome
Example: Coffee Pot
www.incose.org/iw2020
4
Data Elements: Requirements & Design
Integrated Data as a Foundation of Systems Engr.
Define data elements!
Requirements
Functional, Interface, Transport, Environmental, …
Solid drawings / CREO
Handling specification
Production specifications
Programmatic: status reports, SEMP, REMP, V&V plan, …
www.incose.org/iw2020
5
Coffee Pot: Top Level, Physical
www.incose.org/iw2020
6
Standard SE process apply: physical architecture
Move to V&V Plan: MS-Word
Introduction
Product Information
Drawing Set
Qualification Strategy
Prototype Builds
Status Reports
Test Equipment
Customer Experience tests
Requirements Validation
Chassis, Cartridge seat, … Electrical
Design Qualification
Prototype Build 1, 2, 3
Chassis, Cartridge seat, … Electrical
Readiness Level
TRL / MRL
Chassis, Cartridge seat, … Electrical
Production Development
Tooling, gauges
Vendor data and qualification
Production, Handling, Packaging specs
Test Strategy
Acceptance Equipment
Customer trials
Verification
Data repository
Final Acceptance
www.incose.org/iw2020
7
The MS-Word approach is “One-dimensional”: up and down the
page. It’s all there, but hard to access specific data quickly
Very Linear! Read Top-to-Bottom
Introduction
Product Information
Drawing Set
Qualification Strategy
Prototype Builds
Status Reports
Test Equipment
Customer Experience tests
Requirements Validation
Chassis, Cartridge seat, … Electrical
Design Qualification
Prototype Build 1, 2, 3
Chassis, Cartridge seat, … Electrical
Readiness Level
TRL / MRL
Chassis, Cartridge seat, … Electrical
Production Development
Tooling, gauges
Vendor data and qualification
Production, Handling, Packaging specs
Test Strategy
Acceptance Equipment
Customer trials
Verification
Data repository
Final Acceptance
www.incose.org/iw2020
8
The MS-Word approach is “One-dimensional”: up and down the
page. It’s all there, but hard to access specific data quickly
New Approach: Model Based
www.incose.org/iw2020
9
Requirements
Drawings
Production Spec
Handling Spec
Packaging Spec
Prelim. Review
Status Reports
Gate Review
Final Des. Rev.
Prod. Review
TRL
MRL
KPPs
CPPs
Test Equipment
Test Plans
Test Results
Tooling
Gauges
Coffee System
Each physical item’s data is more accessible than buried
in a MS Word document
Recursive
www.incose.org/iw2020
10
Chassis
Requirements
Drawings
Production Spec
Handling Spec
Packaging Spec
Prelim. Review
Final Des. Rev.
Prod. Review
MRL
KPPs
CPPs
Tooling
Gauges
Model allows flexible and recursive approach
Can Work with Different Views
www.incose.org/iw2020
11
Coffee System
Tests
Status
Reports
Reviews
TRL /
MRL
Require-
ments
PP’s
Equipment
This view very helpful for formal V&V
Still have Functional Architecture
www.incose.org/iw2020
12
Make Coffee
Heat
Water
Store
Water for
successive
uses
Accept
Keurig
Cartridges
“Brew”
Coffee
Stay in
one piece
during
use
Be
Electrically
Safe
Duplicating this is MS Word far more complex
Can Link the Data Elements …
www.incose.org/iw2020
13
Functions:
Make coffee
Be elec. Safe
Hold Water
….
Tests:
Repeatability
Taste
User Interface
Reviews:
Conceptual
Final
Status
Reports:
Report 1
Report 2
Report 3
Requirements:
Req 1
Req 2
Req 3
Product Def’n:
Part 1, ver. A
Part 2, ver. B
Part 3, ver. B
… to Produce the Traceability Matrix
www.incose.org/iw2020
14
Functions:
Make coffee
Be elec. Safe
Hold Water
….
Tests:
Repeatability
Taste
User Interface
Reviews:
Conceptual
Final
Status
Reports:
Report 1
Report 2
Report 3
Requirements:
Req 1
Req 2
Req 3
Requirements to
Activities = RVTM !
Works for Production V&V
www.incose.org/iw2020
15
Functions:
Make coffee
Be elec. Safe
Hold Water
….
Physical:
Chassis
Electrical
Water Reservoir
Tooling:
Tool 1
Tool 2
Test Equip:
Machine 1
Rack 2
Testbench 3
Production
Observations:
Process 1
Process 2
Process 3
V&V Data Much More Accessible
Requirements, mapped to:
Functions, Physical architecture, Testing, equipment, tooling
Adaptable to changes
Edit a MS Word doc –> now we edit the Model.
Verification & Validation now far smoother
Test activities, pointers to artifacts (plans, reports) linked.
RVTM can be produced automatically
May still want to enter linking into a RM database such as DOORS
www.incose.org/iw2020
16
Clarifications
Not a replacement for a RM system such as DOORS
Not performing engineering design
May find interfaces
Could hang off of a design MBSE system
Requires maintenance, tool support
Not for change control, or workflow management
www.incose.org/iw2020
17
All of these are workable! MB approach still recommended
Proposed: Worth the Front End Effort
Easier for Qualification Engineer to perform job
Built-in Context Diagram
Scalable: can drill-down to part (or function) in question
Can easily pass on work to successor, mid-project
Government acceptance can be Model-Based
Reviews can walk through the model, vs. a Word doc.
Can spot gaps, hidden interfaces more easily
Early on is best, but can see gaps at any time
www.incose.org/iw2020
18
Higher Quality Product, Lower Cost
Time (hours, salary) spent on qualification effort reduced
Visual approach, easier to spot interface V&V gaps
Increase customer confidence, satisfaction
Some government customers, very concerned about
transparency
Some like to ‘drill down’.
www.incose.org/iw2020
19
Up-front investment in MBSE V&V infrastructure is worth it
undefined
Slide Note
Embed
Share

Address the shift towards model-based design and development for qualification processes, showcasing the benefits of using MBSE tools for tracking, organizing, and granting qualified status to products. The discussion includes insights on document-based qualification, role of a Qualification Engineer, and integrating data elements for efficient system engineering.

  • Model-Based Approach
  • Qualification Engineer
  • MBSE Tools
  • System Engineering
  • Document-Based Qualification

Uploaded on Feb 21, 2025 | 1 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.

E N D

Presentation Transcript


  1. Raymond Wolfgang, Surety Engineering, Sandia National Laboratories Albuquerque, NM, 87112 rwolfga@sandia.gov A Proposed Model-Based Approach To Qualification (Formal V&V) SAND2020-0710 PE Sandia National Laboratories is a multi-mission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy s National Nuclear Security Administration under contract DE-NA0003525. www.incose.org/iw2020

  2. MBSE Not Just For Design Qualification = V&V! Government systems, formal process Many companies have moved to model based design and development Some operations qualification still document based Using MBSE tool to track, organize, and finally grant Qualified status to a product can save time and money www.incose.org/iw2020 2

  3. Document Based Qualification My role: Qualification Engineer for multiple components Qualification Plan in MS Word Wide range of parts: tire valve to complex Electro/mech parts Requirements, design, production, Reliability Plan is for Verification; approach works for Validation also Required for Government / High Consequence Items Tracking the work is not doing the work; any reductions through use of a MBSE tool are most welcome www.incose.org/iw2020 3

  4. Example: Coffee Pot www.incose.org/iw2020 4

  5. Data Elements: Requirements & Design Integrated Data as a Foundation of Systems Engr. Define data elements! Requirements Functional, Interface, Transport, Environmental, Solid drawings / CREO Handling specification Production specifications Programmatic: status reports, SEMP, REMP, V&V plan, www.incose.org/iw2020 5

  6. Coffee Pot: Top Level, Physical Standard SE process apply: physical architecture Coffee System Water Reservoir Water flow system Heating Element Cartridge Receptacle Assembly Chassis Electrical System www.incose.org/iw2020 6

  7. Move to V&V Plan: MS-Word Introduction Product Information Drawing Set Qualification Strategy Prototype Builds Status Reports Test Equipment Customer Experience tests Requirements Validation Chassis, Cartridge seat, Electrical Design Qualification Prototype Build 1, 2, 3 Chassis, Cartridge seat, Electrical Readiness Level TRL / MRL Chassis, Cartridge seat, Electrical Production Development Tooling, gauges Vendor data and qualification Production, Handling, Packaging specs Test Strategy Acceptance Equipment Customer trials Verification Data repository Final Acceptance The MS-Word approach is One-dimensional : up and down the page. It s all there, but hard to access specific data quickly www.incose.org/iw2020 7

  8. Very Linear! Read Top-to-Bottom Introduction Product Information Drawing Set Qualification Strategy Prototype Builds Status Reports Test Equipment Customer Experience tests Requirements Validation Chassis, Cartridge seat, Electrical Design Qualification Prototype Build 1, 2, 3 Chassis, Cartridge seat, Electrical Readiness Level TRL / MRL Chassis, Cartridge seat, Electrical Production Development Tooling, gauges Vendor data and qualification Production, Handling, Packaging specs Test Strategy Acceptance Equipment Customer trials Verification Data repository Final Acceptance The MS-Word approach is One-dimensional : up and down the page. It s all there, but hard to access specific data quickly www.incose.org/iw2020 8

  9. New Approach: Model Based Coffee System Requirements Drawings Production Spec Handling Spec Packaging Spec Prelim. Review Status Reports Gate Review Final Des. Rev. Prod. Review TRL MRL KPPs CPPs Test Equipment Test Plans Test Results Tooling Gauges Each physical item s data is more accessible than buried in a MS Word document www.incose.org/iw2020 9

  10. Recursive Chassis Requirements Drawings Production Spec Handling Spec Packaging Spec Prelim. Review Final Des. Rev. Prod. Review MRL KPPs CPPs Tooling Gauges Model allows flexible and recursive approach www.incose.org/iw2020 10

  11. Can Work with Different Views Coffee System Status Reports Tests TRL / MRL Equipment Reviews Require- ments PP s This view very helpful for formal V&V www.incose.org/iw2020 11

  12. Still have Functional Architecture Make Coffee Store Water for successive uses Heat Water Brew Coffee Accept Keurig Cartridges Stay in one piece during use Be Electrically Safe Duplicating this is MS Word far more complex www.incose.org/iw2020 12

  13. Can Link the Data Elements Reviews: Conceptual Final Functions: Make coffee Be elec. Safe Hold Water . Tests: Repeatability Taste User Interface Status Reports: Report 1 Report 2 Report 3 Product Def n: Part 1, ver. A Part 2, ver. B Part 3, ver. B Requirements: Req 1 Req 2 Req 3 www.incose.org/iw2020 13

  14. to Produce the Traceability Matrix Reviews: Conceptual Final Functions: Make coffee Be elec. Safe Hold Water . Tests: Repeatability Taste User Interface Status Reports: Report 1 Report 2 Report 3 Requirements: Req 1 Req 2 Req 3 Requirements to Activities = RVTM ! www.incose.org/iw2020 14

  15. Works for Production V&V Tooling: Tool 1 Tool 2 Functions: Make coffee Be elec. Safe Hold Water . Physical: Chassis Electrical Water Reservoir Test Equip: Machine 1 Rack 2 Testbench 3 Production Observations: Process 1 Process 2 Process 3 www.incose.org/iw2020 15

  16. V&V Data Much More Accessible Requirements, mapped to: Functions, Physical architecture, Testing, equipment, tooling Adaptable to changes Edit a MS Word doc > now we edit the Model. Verification & Validation now far smoother Test activities, pointers to artifacts (plans, reports) linked. RVTM can be produced automatically May still want to enter linking into a RM database such as DOORS www.incose.org/iw2020 16

  17. Clarifications Not a replacement for a RM system such as DOORS Not performing engineering design May find interfaces Could hang off of a design MBSE system Requires maintenance, tool support Not for change control, or workflow management All of these are workable! MB approach still recommended www.incose.org/iw2020 17

  18. Proposed: Worth the Front End Effort Easier for Qualification Engineer to perform job Built-in Context Diagram Scalable: can drill-down to part (or function) in question Can easily pass on work to successor, mid-project Government acceptance can be Model-Based Reviews can walk through the model, vs. a Word doc. Can spot gaps, hidden interfaces more easily Early on is best, but can see gaps at any time www.incose.org/iw2020 18

  19. Higher Quality Product, Lower Cost Time (hours, salary) spent on qualification effort reduced Visual approach, easier to spot interface V&V gaps Increase customer confidence, satisfaction Some government customers, very concerned about transparency Some like to drill down . Up-front investment in MBSE V&V infrastructure is worth it www.incose.org/iw2020 19

  20. www.incose.org/iw2020

Related


More Related Content

giItT1WQy@!-/#