STAT.COE: Scientia Prudentia et Valor - Testing and Analysis Center of Excellence
Scientific Test and Analysis Techniques
Center of Excellence (STAT COE)
OSD DTE&A
Scientia Prudentia et Valor
T&E Current System Challenges
•
Efficient and effective test of cyber-physical systems to inform
technical baseline knowledge and reengineering
•
Reliability testing
•
Software testing (DevSecOps)
•
Validation of modeling and simulation
•
Test information integration within digital engineering
•
Model-based systems engineering informing test planning
•
Qualified system-specific test personnel
•
Test range complexity and realism
•
Interoperability testing
•
Cyber testing
2
T
e
s
t
p
l
a
n
n
i
n
g
f
o
r
c
o
m
p
l
e
x
s
y
s
t
e
m
s
r
e
q
u
i
r
e
s
a
p
p
r
o
p
r
i
a
t
e
r
e
s
o
u
r
c
e
s
a
n
d
a
m
e
t
h
o
d
i
c
a
l
a
p
p
r
o
a
c
h
(
S
T
A
T
p
r
o
c
e
s
s
)
t
o
a
c
h
i
e
v
e
i
n
f
o
r
m
a
t
i
o
n
t
o
i
n
f
o
r
m
d
e
v
e
l
o
p
m
e
n
t
r
i
s
k
a
n
d
p
o
s
s
i
b
l
e
r
e
e
n
g
i
n
e
e
r
i
n
g
STAT COE 2019 Autonomy Workshop
Challenges List
•
Data (added 2019)
•
Cybersecurity (separated from safety in 2015 list)
•
Simulation for Developmental Mission Assurance (added 2019)
•
Safety (separated from Cybersecurity in 2015 list)
•
Human System Teaming
•
Infrastructure and Personnel
•
Requirements and Measures
•
Design for Test
•
Test Adequacy and Integration
•
Post-Acceptance Testing
•
Testing Continuum
•
Ethical and Legal Assurance (added 2020)
3
T
e
s
t
p
l
a
n
n
i
n
g
f
o
r
c
o
m
p
l
e
x
A
D
A
P
T
I
V
E
s
y
s
t
e
m
s
r
e
q
u
i
r
e
s
a
l
l
c
u
r
r
e
n
t
c
h
a
l
l
e
n
g
e
s
t
o
b
e
m
e
t
i
n
a
d
d
i
t
i
o
n
t
o
a
d
d
r
e
s
s
i
n
g
t
h
e
s
e
n
e
w
c
h
a
l
l
e
n
g
e
s
Some Observations about Training and
Education within DoD
•
The more technical the training and education, the more
relatable it needs to be to the student job needs or it will be
forgotten
•
The workforce craves training and education to perform
challenging tasks that need to be performed now
•
The question often arises whether we have the correct
workforce specialty mix; but, changing the mix is slow so we
should focus on opportunities to expand the current
workforces knowledge, skills, and abilities while not neglecting
long term position changes
4
STAT COE Short Courses
5
–
DOE 251 Design of Experiments (test planners and analysts) – 1 week
–
DOE 252 Advanced DOE (test planners and analysts) – 1 week
–
DOE 320 Design of Experiments (program managers and systems engineers) – 2 days
–
REL 220 Reliability for Practitioners (test planners and analysts) – 2 days
–
STAT 110 Scientific Test and Analysis Techniques Overview – 1 day
–
STAT 410 STAT Executive Course -1-4 hours
–
Recently developed 2 hour modules:
•
Introduction to Reliability & Requirements for Reliability, Availability, and
Maintainability
•
System Decomposition
•
Assessing Reliability
•
Reliability Test Planning
•
Bayesian Reliability
•
Software Reliability
•
Availability and Maintainability
AFIT Graduate T&E Certificate Program
6
•
The AFIT Graduate T&E Certificate Program consists of the following
courses:
–
STAT 583 Introduction to Probability and Statistics
–
OPER 679 Empirical Modeling
–
OPER 688 Operational Experimentation
–
LOGM 634 Reliability, Maintainability, and Supportability
–
OPER 689 Advanced Statistical Methods for Test
•
Graduate ~20 students per year
AFIT Mini-Masters in Data Analytics
•
The Mini-Masters in Data Analytics consists of the following courses
–
DASC 500 Introduction to Data Analytics
–
DASC 501 Databases (Design, Use and Management)
–
DASC 511 Object Oriented Programming (Python)
–
DASC 512 Applied STATS (use of Python)
–
DASC 522 Machine Learning (use of Python)
•
Audience is a broad Air Force audience
•
Over 1700 applicants
•
273 active students
•
Graduate up to 320 students per year
7
Education through STAT COE Website
(8/4/2017 to 08/21/2019)
8
As of 08/31/2020
B
e
s
t
P
r
a
c
t
i
c
e
D
o
w
n
l
o
a
d
s
/
M
o
n
t
h
STAT.COE, led by Director Darryl K. Ahner, focuses on efficient testing of cyber-physical systems, reliability testing, software testing, and more. Challenges include cybersecurity, safety, and human system teaming. The center addresses workforce training needs for challenging tasks and emphasizes continuous skill enhancement.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
STAT T&E COE: Scientia Prudentia et Valor Scientific Test and Analysis Techniques Center of Excellence (STAT COE) OSD DTE&A Darryl K. Ahner, PhD, PE Director www.AFIT.edu/STAT 937-255-3636 x 4736 Scientia Prudentia et Valor
T&E Current System Challenges STAT T&E COE: Scientia Prudentia et Valor Efficient and effective test of cyber-physical systems to inform technical baseline knowledge and reengineering Reliability testing Software testing (DevSecOps) Validation of modeling and simulation Test information integration within digital engineering Model-based systems engineering informing test planning Qualified system-specific test personnel Test range complexity and realism Interoperability testing Cyber testing Test planning for complex systems requires appropriate resources and a methodical approach (STAT process) to achieve information to inform development risk and possible reengineering 2
STAT COE 2019 Autonomy Workshop Challenges List STAT T&E COE: Scientia Prudentia et Valor Data (added 2019) Cybersecurity (separated from safety in 2015 list) Simulation for Developmental Mission Assurance (added 2019) Safety (separated from Cybersecurity in 2015 list) Human System Teaming Infrastructure and Personnel Requirements and Measures Design for Test Test Adequacy and Integration Post-Acceptance Testing Testing Continuum Ethical and Legal Assurance (added 2020) Test planning for complex ADAPTIVE systems requires all current challenges to be met in addition to addressing these new challenges 3
Some Observations about Training and Education within DoD STAT T&E COE: Scientia Prudentia et Valor The more technical the training and education, the more relatable it needs to be to the student job needs or it will be forgotten The workforce craves training and education to perform challenging tasks that need to be performed now The question often arises whether we have the correct workforce specialty mix; but, changing the mix is slow so we should focus on opportunities to expand the current workforces knowledge, skills, and abilities while not neglecting long term position changes 4
STAT COE Short Courses STAT T&E COE: Scientia Prudentia et Valor DOE 251 Design of Experiments (test planners and analysts) 1 week DOE 252 Advanced DOE (test planners and analysts) 1 week DOE 320 Design of Experiments (program managers and systems engineers) 2 days REL 220 Reliability for Practitioners (test planners and analysts) 2 days STAT 110 Scientific Test and Analysis Techniques Overview 1 day STAT 410 STAT Executive Course -1-4 hours Recently developed 2 hour modules: Introduction to Reliability & Requirements for Reliability, Availability, and Maintainability System Decomposition Assessing Reliability Reliability Test Planning Bayesian Reliability Software Reliability Availability and Maintainability 5
AFIT Graduate T&E Certificate Program STAT T&E COE: Scientia Prudentia et Valor The AFIT Graduate T&E Certificate Program consists of the following courses: STAT 583 Introduction to Probability and Statistics OPER 679 Empirical Modeling OPER 688 Operational Experimentation LOGM 634 Reliability, Maintainability, and Supportability OPER 689 Advanced Statistical Methods for Test Graduate ~20 students per year 6
AFIT Mini-Masters in Data Analytics STAT T&E COE: Scientia Prudentia et Valor The Mini-Masters in Data Analytics consists of the following courses DASC 500 Introduction to Data Analytics DASC 501 Databases (Design, Use and Management) DASC 511 Object Oriented Programming (Python) DASC 512 Applied STATS (use of Python) DASC 522 Machine Learning (use of Python) Audience is a broad Air Force audience Over 1700 applicants 273 active students Graduate up to 320 students per year 7
Education through STAT COE Website (8/4/2017 to 08/21/2019) STAT T&E COE: Scientia Prudentia et Valor Best Practice Downloads / Month Visitors (7/1/2015 7/31/2020): Downloads (7/1/2015 7/31/2020): 70,095 Avg Visitors per Month (12 mo avg): 2,359 48,676 8 As of 08/31/2020
