The Drive for Innovation in Systems Engineering D. Scott Lucero Office of the Deputy Assistant Secretary of Defense for Systems Engineering 20th Annual NDIA Systems Engineering Conference Springfield, VA October 25, 2017 10/25/2017 Page-1
Defense Research & Engineering Strategy Mitigate current and anticipated threat capabilities Enable new or extended capabilities affordably in existing military systems Create technology surprise through science and engineering Focus on Technical Excellence Deliver Technologically Superior Capabilities Grow and Sustain our S&T and Engineering Capability 10/25/2017 Page-2
Evolving Capability Up until World War II, almost all munitions missed the mark Massing of forces needed to achieve effects Strategic government investments created an offset providing technological advantage Atomic weapons, precision guided munitions allow reliable targeting Massing of forces no longer absolute necessity Current innovations are driven by industry Broadly available technology creates a need for velocity 10/25/2017 Page-3
Systems Are Changing From: Systems built to last Heuristic-based decisions Deeply integrated architectures Hierarchical development organizations Satisfying requirements Automated systems Static certification Standalone systems To: Systems built to evolve Data-driven decisions Layered, modular architectures Ecosystems of partners, agile teams of teams Constant experimentation and innovation Learning systems Dynamic, continuous certification Composable sets of mission focused systems Systems Engineering Needs to Change Credit: Derived from David Long, Former INCOSE President 10/25/2017 Page-4
Industrial Age Acquisition and Engineering Processes Horizontal Accuracy (m 95%) 7 6 5 4 3 2 1 0 GPS III Position Accuracy (90% w/c loc, MGUE Aviation Receiver) Anticipate less pessimistic data after OCX award Anticipate less uncertainty after SS IIIA CDR Notes: UEE = 0.8m rms (GPS III CDD) Red Yellow Green Milestone CS URE = 0.46m rms (based on CS-800) SS URE = 0.32m rms (based on CDRL A045) HDOP & VDOP from Massatt TOR Milestones = Key events for PNT-1 data updates CDD Horiz Reqt Current Value IOC/FOC Plan GPS III and MGUE CDDs System Configuration Block II Electronic Protection GPS II Capability Delivery and GPS III SYS-800 Requirements Satisfaction IIF Final MGUE1 IIIA MGUE2 MGUE3 IIIB Current AEP 5.5 Four IIFs 10 IIFs First IIIA OCX 1.0 OCX 2.0 Six IIIAs OCX 3.0 OT&E Block II fielding OT&E fielding fielding OT&E Four IIIBs MGUE4 1/3 MGUE Segment Milestone OCX 4.0 Two IIICs 4 IIICs 10 IIICs 11 IIICs 18 IIICs fielding fielded Date (approx) Oct-09 Jan-10 Dec-10 Jun-11 Jul-13 Dec-13 Jan-14 Jul-14 Feb-15 May-15 Sep-15 Aug-16 Nov-16 Dec-16 Feb-17 Dec-17 Mar-18 Aug-18 Feb-19 Oct-19 Apr-20 Oct-20 Oct-21 Jan-22 Oct-23 Block III Effectivity - - - - - - 10 10 10 15 15 15 15 15 17 17 17 17 20 20 25 25 30 30 30 12 M- 18 M- First M- OCX 2.0 Second Third M- OCX 3.0 12 L1C/ Final M- 18 L1C/ 12 Dir'l 18 Dir'l 18 Spot AEP 5.5 First 2 1 L1C/ OCX 1.0 12 L5 First 2 18 L5 First 2 Sufficient 27 Segment Milestone Contribution to code/flex/ code/flex/ code UE supports M- M-code code UE supports Boosted- code UE Boosted- XL sats XL sats Beam Today supports IIFs set Boosted- supports sats (1 in IIIAs set sats (4 in IIIBs set Full OCX MGUE for Boosted- Capability/Accomplishment Criteria L2C sats L2C sats (Ground) Code, Flex, UE (HH) (Air) IIIB (dir'l M sats (1 (Marine) M sats (4 (1 in (4 in sats (4 in SAASM healthy M sat L2C view) healthy view) healthy Navwar M sats (1 in view) (4 in view) fielded L5, L1C fielded fielded XL, OTAR) in view) fielded in view) view) view) view) Dual- Frequency Civil Nav. Constellation Management Positioning, Navigation & Space Segment 8 IIR-Ms 8 IIR-Ms 2 IIFs 4 IIFs 10 IIFs 11 IIFs 11 IIFs 12 IIFs 12 IIFs 12 IIFs 2 IIIAs 6 IIIAs 7 IIIAs 8 IIIAs 8 IIIAs 2 IIIBs 4 IIIBs 6 IIIBs 8 IIIBs 2 IIICs 4 IIICs 5 IIICs 10 IIICs 11 IIICs 18 IIICs Control Segment AEP 5.2 AEP 5.5 AEP 5.5 AEP 5.5 AEP 5.5 AEP 5.5 OCX 1.0 OCX 1.0 OCX 1.0 OCX 2.0 OCX 2.0 OCX 2.0 OCX 2.0 OCX 2.0 OCX 3.0 OCX 3.0 OCX 3.0 OCX 3.0 OCX 4.0 OCX 4.0 OCX 4.0 OCX 4.0 OCX 4.0 OCX 4.0 OCX 4.0 User Segment SAASM SAASM SAASM SAASM SAASM SAASM SAASM SAASM MGUE1 MGUE1 MGUE1 MGUE1 MGUE2 MGUE3 MGUE3 MGUE3 MGUE3 MGUE4 MGUE4 MGUE4 MGUE4 MGUE4 MGUE4 MGUE4 MGUE4 SAASM - ICI ICI ICI ICI ICI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI M-Code - - - - - - - - - ICI ICI ICI ICI ICI ICI ICI ICI ICI ICI ICI ICI FCI FCI FCI FCI Flex Power - - - - - - - - - ICI ICI ICI ICI ICI ICI ICI ICI ICI ICI ICI ICI FCI FCI FCI FCI Block II Electronic Prot. - IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC IOC FOC FOC FOC FOC 2nd Civil Signal (L2C) - - - - - - ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI ICI/FCI 3rd Civil Signal (L5) - - - - - - - - - ICI ICI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI FCI Dual-Freq Civil Nav. - - - - - - - - - IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC IOC/FOC SYS-800 Requirements: Total % of SYS-800 ReqIDs Satisfied at Effectivity: 10 15 17 20 25 30 Constell. Cmd & Ctrl 16 0% 0% 0% 0% 0% 69% 69% 69% 88% 88% 88% 88% 88% 94% 94% 94% 94% 94% 94% 94% 94% 100% 100% 100% Operations Support 30 0% 0% 0% 0% 0% 60% 60% 60% 73% 73% 73% 73% 73% 73% 73% 73% 73% 97% 97% 100% 100% 100% 100% 100% Signal Monitoring 22 0% 0% 0% 0% 0% 64% 64% 64% 68% 68% 68% 68% 68% 68% 68% 68% 68% 86% 86% 86% 86% 100% 100% 100% Constellation Mgmt. 64 0% 0% 0% 0% 0% 61% 61% 61% 73% 73% 73% 73% 73% 75% 75% 75% 75% 92% 92% 94% 94% 100% 100% 100% IIF Backward Compat. 191 0% 0% 0% 0% 0% 97% 97% 97% 99% 99% 99% 99% 99% 99% 99% 99% 99% 99% 99% 99% 99% 100% 100% 100% 4th Civil Signal (L1C) 5 0% 0% 0% 0% 0% 40% 40% 40% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% PNT Solution 40 0% 0% 0% 0% 0% 40% 40% 40% 58% 58% 58% 58% 58% 58% 58% 58% 58% 65% 65% 65% 65% 80% 80% 80% Net Readiness 7 0% 0% 0% 0% 0% 29% 29% 29% 57% 57% 57% 57% 57% 57% 57% 57% 57% 86% 86% 86% 86% 100% 100% 100% Timing (PNT) Determination Signal Upgradeability 5 0% 0% 0% 0% 0% 0% 0% 0% 20% 20% 20% 20% 20% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% Integrity/Continuity 31 0% 0% 0% 0% 0% 45% 45% 45% 55% 55% 55% 55% 55% 55% 55% 55% 55% 58% 58% 58% 58% 61% 61% 61% PNT Determination 252 0% 0% 0% 0% 0% 78% 78% 78% 85% 85% 85% 85% 85% 87% 87% 87% 87% 90% 90% 90% 90% 92% 92% 92% Military Protection and Operations Boosted EC M-Code 17 0% 0% 0% 0% 0% 12% 12% 12% 35% 35% 35% 35% 35% 53% 53% 53% 53% 88% 88% 88% 88% 88% 88% 88% Military Signal Security 36 0% 0% 0% 0% 0% 83% 83% 83% 83% 83% 83% 83% 83% 83% 83% 83% 83% 86% 86% 86% 86% 100% 100% 100% Near Real-Time C2 12 0% 0% 0% 0% 0% 17% 17% 17% 17% 17% 17% 17% 17% 75% 75% 75% 75% 75% 75% 75% 75% 100% 100% 100% Autonavigation 11 0% 0% 0% 0% 0% 27% 27% 27% 36% 36% 36% 36% 36% 45% 45% 45% 45% 55% 55% 55% 55% 91% 91% 91% Spot Beam/NAVWAR 37 0% 0% 0% 0% 0% 3% 3% 3% 3% 3% 3% 3% 3% 3% 3% 3% 3% 81% 81% 81% 81% 100% 100% 100% Military Protection 109 0% 0% 0% 0% 0% 35% 35% 35% 39% 39% 39% 39% 39% 49% 49% 49% 49% 80% 80% 80% 80% 97% 97% 97% All CDD Capabilities: 351 0% 0% 0% 0% 0% 57% 57% 57% 66% 66% 66% 66% 66% 71% 71% 71% 71% 85% 85% 86% 86% 94% 94% 94% Taylor s scientific management Empirical methods to synthesize workflows to improve economic efficiency Inspires industrial and systems engineering, business process management, lean six sigma, operations research Optimizing engineering & production drives need for stable requirements, well-defined processes Optimizing methods to change engineering & production requires increasing the cycles of learning: To identify necessary changes To incorporate those changes into systems Material Solution Analysis Technical Maturity and Risk Reduction Requirements Mgmt Interface Mgmt Engineering and Manufacturing Development Configuration Management Limited Rate Production 2009 Operational Testing => Full Rate Production => Fielding Architecture SI TIM#3 SV PDR SI TIM#4 SI TIM#5 OCX awd 2010 RAFS CDR IIIB SRR OCX PDR IIIA CDR 2011 2012 Control Space User Risk Management Tech Assessments & Reviews Integration & Verification Schedule 10/25/2017 Page-5
Initiatives to Accelerate Change National Defense Authorization Act (NDAA) for Fiscal Year 2017 Acquisition Agility Act Modular Open Systems Approaches New authorities for prototyping, experimentation & rapid fielding Defining requirements likely to evolve due to evolving technology, threat or interoperability needs Reorganization of USD(AT&L) NDAA FY2017 Creates separate organizations for acquisition and for innovative technologies Middle Tier Acquisition Policy NDAA FY2016 Creates alternate acquisition path for rapid prototyping and fielding Engineered Resilient Systems 2011 Research and development of deep tradespace analysis methods to address the nature of evolving missions and threats Joint Urgent Operational Needs processes 2004 10/25/2017 Page-6
Methods for Managing Software-Intensive Acquisitions Spiral Development Model (Boehm 1986) Incremental Commitment Model (Boehm 2007) DoD Instruction 5000.02 Operation of the Defense Acquisition System (Jan 2015) Software Intensive Hybrid Software Dominant Agile Development 2001 Incrementally Deployed Software Intensive Accelerated 10/25/2017 Page-7
Other Systems Engineering Perspectives MIL-STD-499 Engineering Management Issued by Air Force in 1969 and 1974 Draft MIL-STD-499B never published in 1990 s acquisition reform era Not time-sequenced, like the V-model Process seems to encourage trades in the need-space and the solution-space Less focused on production Less prescriptive less useful in organizing activities 10/25/2017 Page-8
Methods for Selecting Acquisition Approaches High Confidence in Requirements ~(R+ R) Low Resilience Robustness Accept Low Optimize Options Ability to Respond Adapt High ~ fn(t + T + $ + time + architectures) Notes: Framework helps overcome tendency to develop optimal solutions to static requirements Each axis belongs to a separate community Uncertainty around Requirements and Technology can be informed by intelligence community Credit: Derived from Michael Pennock, Stevens Institute 10/25/2017 Page-9
Interesting Research Questions Gauging confidence in requirements, ability to respond Analysis of trades across the mission space and the solution space Gauging risk, rework Hedging methods Actual increases in velocity of capability delivered Methods to increase ability to respond e.g., MBSE, advanced manufacturing Dynamic and continuous learning and certification Multiple systems interrelationships Portfolio management, mission engineering Others? 10/25/2017 Page-10
For Additional Information D. Scott Lucero Deputy Director, Strategic Initiatives Office of the DASD Systems Engineering 571-372-6452 don.s.lucero.civ@mail.mil 10/25/2017 Page-11
Systems Engineering: Critical to Defense Acquisition Defense Innovation Marketplace http://www.defenseinnovationmarketplace.mil DASD, Systems Engineering http://www.acq.osd.mil/se 10/25/2017 Page-12